try to create the NAS-Bench-201 api from NAS-Bench-201-v1_0-e61699.pth
NASBench201API(15625/15625 architectures, file=NAS-Bench-201-v1_0-e61699.pth)

---------- The (    0/15625) 000000-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.319, top1 = 88.92%], valid : [loss = 0.566, top1 = 81.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.86 ms.
cifar10        train : [loss = 0.271, top1 = 90.67%], test  : [loss = 0.430, top1 = 85.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.18 ms.
cifar100       train : [loss = 1.511, top1 = 57.73%], valid : [loss = 1.742, top1 = 52.70%], test : [loss = 1.736, top1 = 52.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.14%], valid : [loss = 2.944, top1 = 28.21%], test : [loss = 2.989, top1 = 26.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 63.92%], valid : [loss = 1.048, top1 = 62.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    1/15625) 000001-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.439, top1 = 90.77%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.95 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.300, top1 = 93.66%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.36 ms.
cifar100       train : [loss = 0.048, top1 = 99.44%], valid : [loss = 1.373, top1 = 69.83%], test : [loss = 1.351, top1 = 70.29%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 1.459, top1 = 60.34%], valid : [loss = 2.230, top1 = 44.49%], test : [loss = 2.266, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 86.10%], valid : [loss = 0.539, top1 = 81.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    2/15625) 000002-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.31%], valid : [loss = 0.566, top1 = 81.91%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.51 ms.
cifar10        train : [loss = 0.279, top1 = 90.38%], test  : [loss = 0.430, top1 = 85.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.03 ms.
cifar100       train : [loss = 1.432, top1 = 59.74%], valid : [loss = 1.702, top1 = 54.30%], test : [loss = 1.676, top1 = 54.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.974, top1 = 27.22%], valid : [loss = 2.973, top1 = 27.63%], test : [loss = 3.016, top1 = 27.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.50%], valid : [loss = 1.038, top1 = 62.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    3/15625) 000003-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.04 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.24%], valid : [loss = 0.477, top1 = 84.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.300, top1 = 89.97%], test  : [loss = 0.396, top1 = 86.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.31 ms.
cifar100       train : [loss = 1.339, top1 = 62.86%], valid : [loss = 1.539, top1 = 57.41%], test : [loss = 1.515, top1 = 58.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.15 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.46%], valid : [loss = 2.907, top1 = 29.43%], test : [loss = 2.972, top1 = 28.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    4/15625) 000004-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.29%], valid : [loss = 0.459, top1 = 85.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.49 ms.
cifar10        train : [loss = 0.241, top1 = 91.96%], test  : [loss = 0.360, top1 = 88.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.34 ms.
cifar100       train : [loss = 1.205, top1 = 66.00%], valid : [loss = 1.434, top1 = 59.57%], test : [loss = 1.417, top1 = 60.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.732, top1 = 32.19%], valid : [loss = 2.747, top1 = 32.14%], test : [loss = 2.783, top1 = 31.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.006, top1 = 64.05%], valid : [loss = 1.036, top1 = 63.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    5/15625) 000005-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.575, top1 = 87.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.391, top1 = 91.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.61 ms.
cifar100       train : [loss = 0.182, top1 = 95.89%], valid : [loss = 1.496, top1 = 66.23%], test : [loss = 1.484, top1 = 66.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.21%], valid : [loss = 2.472, top1 = 37.88%], test : [loss = 2.499, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.06%], valid : [loss = 0.738, top1 = 74.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    6/15625) 000006-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.572, top1 = 88.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.94 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.364, top1 = 92.51%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.20 ms.
cifar100       train : [loss = 0.102, top1 = 98.17%], valid : [loss = 1.425, top1 = 68.65%], test : [loss = 1.402, top1 = 68.36%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.70%], valid : [loss = 2.443, top1 = 38.84%], test : [loss = 2.438, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.45%], valid : [loss = 0.699, top1 = 76.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    7/15625) 000007-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.459, top1 = 89.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.312, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.65 ms.
cifar100       train : [loss = 0.327, top1 = 91.10%], valid : [loss = 1.303, top1 = 67.13%], test : [loss = 1.299, top1 = 67.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.18%], valid : [loss = 2.359, top1 = 40.13%], test : [loss = 2.403, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.89%], valid : [loss = 0.538, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    8/15625) 000008-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.479, top1 = 89.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.342, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 0.234, top1 = 93.87%], valid : [loss = 1.349, top1 = 67.81%], test : [loss = 1.331, top1 = 68.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 1.950, top1 = 48.74%], valid : [loss = 2.305, top1 = 41.02%], test : [loss = 2.340, top1 = 41.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.10%], valid : [loss = 0.602, top1 = 79.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (    9/15625) 000009-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.94%], valid : [loss = 0.475, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10        train : [loss = 0.302, top1 = 89.84%], test  : [loss = 0.401, top1 = 86.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.15 ms.
cifar100       train : [loss = 1.324, top1 = 63.27%], valid : [loss = 1.529, top1 = 57.81%], test : [loss = 1.503, top1 = 58.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.56%], valid : [loss = 2.897, top1 = 29.40%], test : [loss = 2.966, top1 = 27.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   10/15625) 000010-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.58 ms.
cifar10-valid  train : [loscifas = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.87 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   11/15625) 000011-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.559, top1 = 87.94%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.93 ms.
cifar10        train : [loss = 0.016, top1 = 99.55%], test  : [loss = 0.363, top1 = 91.58%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.14 ms.
cifar100       train : [loss = 0.154, top1 = 96.10%], valid : [loss = 1.424, top1 = 67.45%], test : [loss = 1.437, top1 = 67.61%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.03%], valid : [loss = 2.788, top1 = 30.41%], test : [loss = 2.790, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 64.44%], valid : [loss = 1.006, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   12/15625) 000012-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.40 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   13/15625) 000013-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.539, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.346, top1 = 91.82%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.42 ms.
cifar100       train : [loss = 0.302, top1 = 91.80%], valid : [loss = 1.288, top1 = 67.61%], test : [loss = 1.296, top1 = 67.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.39%], valid : [loss = 2.431, top1 = 38.19%], test : [loss = 2.433, top1 = 38.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.49%], valid : [loss = 0.811, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   14/15625) 000014-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.512, top1 = 88.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.334, top1 = 92.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.349, top1 = 90.44%], valid : [loss = 1.281, top1 = 66.96%], test : [loss = 1.282, top1 = 67.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.51%], valid : [loss = 2.407, top1 = 38.98%], test : [loss = 2.424, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   15/15625) 000015-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.61 ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.87%], valid : [loss = 1.226, top1 = 56.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.05 ms.
cifar10        train : [loss = 1.156, top1 = 58.91%], test  : [loss = 1.151, top1 = 58.78%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.17 ms.
cifar100       train : [loss = 2.664, top1 = 33.03%], valid : [loss = 2.747, top1 = 31.84%], test : [loss = 2.725, top1 = 32.43%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.94 ms.
ImageNet16-120 train : [loss = 3.831, top1 = 12.98%], valid : [loss = 3.819, top1 = 13.71%], test : [loss = 3.833, top1 = 13.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.670, top1 = 37.66%], valid : [loss = 1.719, top1 = 34.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   16/15625) 000016-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.465, top1 = 90.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.307, top1 = 93.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.00 ms.
cifar100       train : [loss = 0.081, top1 = 98.67%], valid : [loss = 1.403, top1 = 68.87%], test : [loss = 1.381, top1 = 69.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 1.600, top1 = 57.00%], valid : [loss = 2.299, top1 = 42.49%], test : [loss = 2.312, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.34%], valid : [loss = 0.505, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   17/15625) 000017-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.596, top1 = 86.70%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.80 ms.
cifar10        train : [loss = 0.025, top1 = 99.39%], test  : [loss = 0.436, top1 = 89.43%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.36 ms.
cifar100       train : [loss = 0.353, top1 = 90.44%], valid : [loss = 1.466, top1 = 64.51%], test : [loss = 1.463, top1 = 64.21%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.98%], valid : [loss = 2.517, top1 = 36.58%], test : [loss = 2.556, top1 = 36.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 77.10%], valid : [loss = 0.718, top1 = 75.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   18/15625) 000018-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.588, top1 = 87.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.394, top1 = 91.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.29 ms.
cifar100       train : [loss = 0.147, top1 = 96.78%], valid : [loss = 1.605, top1 = 64.81%], test : [loss = 1.597, top1 = 64.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.076, top1 = 45.93%], valid : [loss = 2.476, top1 = 37.98%], test : [loss = 2.516, top1 = 38.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.33%], valid : [loss = 0.804, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   19/15625) 000019-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.38%], valid : [loss = 0.692, top1 = 84.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.53 ms.
cifar10        train : [loss = 0.054, top1 = 98.33%], test  : [loss = 0.437, top1 = 88.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.634, top1 = 81.40%], valid : [loss = 1.508, top1 = 61.36%], test : [loss = 1.496, top1 = 62.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 2.664, top1 = 33.42%], valid : [loss = 2.803, top1 = 30.44%], test : [loss = 2.861, top1 = 29.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.22%], valid : [loss = 0.858, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   20/15625) 000020-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.21 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.579, top1 = 87.29%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10        train : [loss = 0.041, top1 = 98.78%], test  : [loss = 0.389, top1 = 90.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.43 ms.
cifar100       train : [loss = 0.551, top1 = 83.89%], valid : [loss = 1.412, top1 = 63.89%], test : [loss = 1.391, top1 = 64.15%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.480, top1 = 37.18%], valid : [loss = 2.599, top1 = 34.20%], test : [loss = 2.654, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.87%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   21/15625) 000021-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.479, top1 = 89.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.316, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.89 ms.
cifar100       train : [loss = 0.277, top1 = 92.84%], valid : [loss = 1.196, top1 = 68.97%], test : [loss = 1.200, top1 = 69.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 49.96%], valid : [loss = 2.233, top1 = 42.57%], test : [loss = 2.239, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   22/15625) 000022-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.625, top1 = 86.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.038, top1 = 98.89%], test  : [loss = 0.401, top1 = 89.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.534, top1 = 84.50%], valid : [loss = 1.454, top1 = 63.01%], test : [loss = 1.426, top1 = 63.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.49%], valid : [loss = 2.562, top1 = 35.49%], test : [loss = 2.586, top1 = 36.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.86%], valid : [loss = 0.912, top1 = 67.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   23/15625) 000023-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.622, top1 = 86.13%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.19 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.407, top1 = 90.19%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.83 ms.
cifar100       train : [loss = 0.509, top1 = 85.11%], valid : [loss = 1.458, top1 = 63.23%], test : [loss = 1.468, top1 = 62.86%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.66%], valid : [loss = 2.546, top1 = 35.30%], test : [loss = 2.566, top1 = 36.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.63%], valid : [loss = 0.832, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   24/15625) 000024-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.304, top1 = 89.53%], valid : [loss = 0.561, top1 = 82.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10        train : [loss = 0.246, top1 = 91.60%], test  : [loss = 0.396, top1 = 87.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.38 ms.
cifar100       train : [loss = 1.427, top1 = 60.05%], valid : [loss = 1.689, top1 = 54.53%], test : [loss = 1.659, top1 = 55.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.958, top1 = 27.73%], valid : [loss = 2.958, top1 = 27.82%], test : [loss = 3.030, top1 = 26.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.90%], valid : [loss = 1.008, top1 = 64.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   25/15625) 000025-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.96%], valid : [loss = 0.480, top1 = 84.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 0.302, top1 = 89.85%], test  : [loss = 0.401, top1 = 86.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.06 ms.
cifar100       train : [loss = 1.334, top1 = 63.05%], valid : [loss = 1.538, top1 = 57.30%], test : [loss = 1.519, top1 = 58.41%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.26 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.80%], valid : [loss = 2.899, top1 = 29.12%], test : [loss = 2.952, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   26/15625) 000026-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.30%], valid : [loss = 0.567, top1 = 87.18%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.01 ms.
cifar10        train : [loss = 0.055, top1 = 98.22%], test  : [loss = 0.383, top1 = 90.05%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.10 ms.
cifar100       train : [loss = 0.561, top1 = 83.53%], valid : [loss = 1.299, top1 = 65.50%], test : [loss = 1.288, top1 = 66.01%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.02%], valid : [loss = 2.438, top1 = 38.62%], test : [loss = 2.448, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.86%], valid : [loss = 0.722, top1 = 75.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   27/15625) 000027-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.10%], valid : [loss = 0.567, top1 = 86.58%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.92 ms.
cifar10        train : [loss = 0.064, top1 = 97.92%], test  : [loss = 0.363, top1 = 90.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.65 ms.
cifar100       train : [loss = 0.668, top1 = 80.35%], valid : [loss = 1.279, top1 = 64.79%], test : [loss = 1.286, top1 = 64.79%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.34%], valid : [loss = 2.502, top1 = 36.47%], test : [loss = 2.548, top1 = 35.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.89%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   28/15625) 000028-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.301, top1 = 89.69%], valid : [loss = 0.534, top1 = 83.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.50 ms.
cifar10        train : [loss = 0.265, top1 = 90.88%], test  : [loss = 0.420, top1 = 86.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.81 ms.
cifar100       train : [loss = 1.482, top1 = 58.86%], valid : [loss = 1.714, top1 = 53.68%], test : [loss = 1.709, top1 = 53.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.942, top1 = 27.90%], valid : [loss = 2.943, top1 = 28.37%], test : [loss = 3.006, top1 = 27.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.001, top1 = 64.09%], valid : [loss = 1.076, top1 = 61.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   29/15625) 000029-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.686, top1 = 84.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10        train : [loss = 0.053, top1 = 98.43%], test  : [loss = 0.429, top1 = 88.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 0.640, top1 = 81.21%], valid : [loss = 1.521, top1 = 61.71%], test : [loss = 1.506, top1 = 61.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.35%], valid : [loss = 2.828, top1 = 30.73%], test : [loss = 2.862, top1 = 30.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   30/15625) 000030-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.329, top1 = 91.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 0.344, top1 = 90.57%], valid : [loss = 1.289, top1 = 66.46%], test : [loss = 1.296, top1 = 67.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.78 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.71%], valid : [loss = 2.407, top1 = 38.86%], test : [loss = 2.435, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   31/15625) 000031-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.583, top1 = 87.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.389, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.32 ms.
cifar100       train : [loss = 0.410, top1 = 88.32%], valid : [loss = 1.394, top1 = 65.32%], test : [loss = 1.397, top1 = 65.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.318, top1 = 40.56%], valid : [loss = 2.526, top1 = 36.26%], test : [loss = 2.533, top1 = 36.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.59%], valid : [loss = 0.806, top1 = 72.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   32/15625) 000032-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.454, top1 = 89.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.303, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 0.219, top1 = 94.65%], valid : [loss = 1.338, top1 = 67.53%], test : [loss = 1.318, top1 = 68.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.68%], valid : [loss = 2.301, top1 = 42.16%], test : [loss = 2.338, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.50%], valid : [loss = 0.540, top1 = 81.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   33/15625) 000033-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.532, top1 = 88.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.344, top1 = 91.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.80 ms.
cifar100       train : [loss = 0.257, top1 = 93.44%], valid : [loss = 1.256, top1 = 68.22%], test : [loss = 1.252, top1 = 68.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.73%], valid : [loss = 2.248, top1 = 41.86%], test : [loss = 2.258, top1 = 42.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.14%], valid : [loss = 0.685, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   34/15625) 000034-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.543, top1 = 88.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.360, top1 = 91.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.323, top1 = 91.21%], valid : [loss = 1.285, top1 = 67.18%], test : [loss = 1.296, top1 = 67.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 44.00%], valid : [loss = 2.425, top1 = 38.56%], test : [loss = 2.445, top1 = 38.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   35/15625) 000035-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.65%], valid : [loss = 0.542, top1 = 88.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.027, top1 = 99.23%], test  : [loss = 0.345, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.422, top1 = 87.85%], valid : [loss = 1.282, top1 = 66.81%], test : [loss = 1.274, top1 = 66.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.251, top1 = 41.95%], valid : [loss = 2.408, top1 = 39.13%], test : [loss = 2.444, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   36/15625) 000036-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.587, top1 = 87.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.26 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.393, top1 = 91.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.163, top1 = 96.32%], valid : [loss = 1.555, top1 = 65.57%], test : [loss = 1.553, top1 = 65.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 2.096, top1 = 45.56%], valid : [loss = 2.487, top1 = 37.62%], test : [loss = 2.519, top1 = 37.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.94%], valid : [loss = 0.819, top1 = 71.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   37/15625) 000037-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.78%], valid : [loss = 0.511, top1 = 87.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.23 ms.
cifar10        train : [loss = 0.082, top1 = 97.43%], test  : [loss = 0.354, top1 = 89.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.06 ms.
cifar100       train : [loss = 0.726, top1 = 78.85%], valid : [loss = 1.307, top1 = 64.87%], test : [loss = 1.292, top1 = 64.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.91%], valid : [loss = 2.599, top1 = 35.04%], test : [loss = 2.633, top1 = 34.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.35%], valid : [loss = 0.648, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   38/15625) 000038-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.561, top1 = 88.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.358, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.147, top1 = 96.49%], valid : [loss = 1.351, top1 = 68.45%], test : [loss = 1.386, top1 = 68.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.28%], valid : [loss = 2.545, top1 = 35.40%], test : [loss = 2.554, top1 = 35.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 65.81%], valid : [loss = 0.960, top1 = 65.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   39/15625) 000039-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.30%], valid : [loss = 0.458, top1 = 86.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.08 ms.
cifar10        train : [loss = 0.116, top1 = 96.39%], test  : [loss = 0.332, top1 = 89.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.64 ms.
cifar100       train : [loss = 0.858, top1 = 75.60%], valid : [loss = 1.279, top1 = 64.48%], test : [loss = 1.283, top1 = 63.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.87%], valid : [loss = 2.614, top1 = 34.56%], test : [loss = 2.651, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.17%], valid : [loss = 0.666, top1 = 77.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   40/15625) 000040-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.04%], valid : [loss = 0.850, top1 = 72.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 0.573, top1 = 79.91%], test  : [loss = 0.717, top1 = 75.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 1.812, top1 = 51.42%], valid : [loss = 2.068, top1 = 46.53%], test : [loss = 2.078, top1 = 46.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.78%], valid : [loss = 3.642, top1 = 16.49%], test : [loss = 3.667, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.193, top1 = 56.80%], valid : [loss = 1.245, top1 = 55.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   41/15625) 000041-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.15%], valid : [loss = 0.464, top1 = 86.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.159, top1 = 94.77%], test  : [loss = 0.348, top1 = 88.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.99 ms.
cifar100       train : [loss = 1.005, top1 = 71.50%], valid : [loss = 1.368, top1 = 62.07%], test : [loss = 1.361, top1 = 61.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.74%], valid : [loss = 2.685, top1 = 32.74%], test : [loss = 2.714, top1 = 32.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   42/15625) 000042-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.426, top1 = 91.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.299, top1 = 93.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.30 ms.
cifar100       train : [loss = 0.067, top1 = 99.06%], valid : [loss = 1.343, top1 = 70.19%], test : [loss = 1.338, top1 = 70.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 1.545, top1 = 58.25%], valid : [loss = 2.268, top1 = 43.42%], test : [loss = 2.269, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.43%], valid : [loss = 0.499, top1 = 83.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   43/15625) 000043-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.551, top1 = 88.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.366, top1 = 91.73%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 0.251, top1 = 93.24%], valid : [loss = 1.324, top1 = 67.43%], test : [loss = 1.336, top1 = 67.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.44%], valid : [loss = 2.428, top1 = 38.12%], test : [loss = 2.434, top1 = 38.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   44/15625) 000044-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.43%], valid : [loss = 0.734, top1 = 75.54%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.465, top1 = 83.75%], test  : [loss = 0.609, top1 = 79.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.85 ms.
cifar100       train : [loss = 1.813, top1 = 50.81%], valid : [loss = 1.997, top1 = 47.09%], test : [loss = 1.991, top1 = 47.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 3.452, top1 = 18.73%], valid : [loss = 3.451, top1 = 19.13%], test : [loss = 3.484, top1 = 17.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.229, top1 = 55.21%], valid : [loss = 1.277, top1 = 54.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   45/15625) 000045-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.29%], valid : [loss = 0.460, top1 = 86.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.111, top1 = 96.55%], test  : [loss = 0.329, top1 = 89.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 0.877, top1 = 75.05%], valid : [loss = 1.299, top1 = 63.78%], test : [loss = 1.276, top1 = 64.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.04 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.61%], valid : [loss = 2.627, top1 = 34.89%], test : [loss = 2.663, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   46/15625) 000046-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.585, top1 = 87.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.389, top1 = 91.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.19 ms.
cifar100       train : [loss = 0.357, top1 = 89.96%], valid : [loss = 1.403, top1 = 65.43%], test : [loss = 1.401, top1 = 65.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.18%], valid : [loss = 2.456, top1 = 38.19%], test : [loss = 2.502, top1 = 38.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.00%], valid : [loss = 0.841, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   47/15625) 000047-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.589, top1 = 87.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.387, top1 = 91.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 0.411, top1 = 88.30%], valid : [loss = 1.398, top1 = 65.45%], test : [loss = 1.386, top1 = 65.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.71%], valid : [loss = 2.514, top1 = 36.74%], test : [loss = 2.529, top1 = 36.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   48/15625) 000048-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.61%], valid : [loss = 0.534, top1 = 82.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.290, top1 = 90.10%], test  : [loss = 0.410, top1 = 86.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.335, top1 = 62.50%], valid : [loss = 1.555, top1 = 57.13%], test : [loss = 1.551, top1 = 57.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 2.876, top1 = 29.30%], valid : [loss = 2.876, top1 = 29.57%], test : [loss = 2.909, top1 = 28.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.15%], valid : [loss = 0.965, top1 = 65.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   49/15625) 000049-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.557, top1 = 87.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.374, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.386, top1 = 89.11%], valid : [loss = 1.403, top1 = 65.62%], test : [loss = 1.377, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.80%], valid : [loss = 2.467, top1 = 37.91%], test : [loss = 2.514, top1 = 37.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.756, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   50/15625) 000050-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.481, top1 = 89.82%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.75 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.301, top1 = 93.13%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.44 ms.
cifar100       train : [loss = 0.117, top1 = 97.81%], valid : [loss = 1.257, top1 = 70.33%], test : [loss = 1.283, top1 = 69.76%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.78 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.25%], valid : [loss = 2.152, top1 = 44.67%], test : [loss = 2.159, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.99%], valid : [loss = 0.609, top1 = 79.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   51/15625) 000051-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.19%], valid : [loss = 0.579, top1 = 85.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.111, top1 = 96.35%], test  : [loss = 0.401, top1 = 88.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.833, top1 = 75.53%], valid : [loss = 1.418, top1 = 62.13%], test : [loss = 1.414, top1 = 61.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 32.96%], valid : [loss = 2.758, top1 = 31.98%], test : [loss = 2.830, top1 = 30.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.24%], valid : [loss = 0.692, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   52/15625) 000052-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.443, top1 = 90.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.298, top1 = 93.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.112, top1 = 97.68%], valid : [loss = 1.339, top1 = 70.15%], test : [loss = 1.325, top1 = 69.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 1.683, top1 = 54.92%], valid : [loss = 2.208, top1 = 44.23%], test : [loss = 2.231, top1 = 43.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.66%], valid : [loss = 0.562, top1 = 81.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   53/15625) 000053-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.23 ms.
cifar10-valid  train : [loss = 1.843, top1 = 33.26%], valid : [loss = 1.858, top1 = 32.85%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.72 ms.
cifar10        train : [loss = 1.321, top1 = 52.43%], test  : [loss = 1.317, top1 = 52.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.42 ms.
cifar100       train : [loss = 3.800, top1 = 11.87%], valid : [loss = 3.901, top1 = 10.42%], test : [loss = 3.895, top1 = 10.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.31 ms.
ImageNet16-120 train : [loss = 3.945, top1 = 11.22%], valid : [loss = 3.932, top1 = 11.68%], test : [loss = 3.947, top1 = 11.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.58%], valid : [loss = 1.967, top1 = 27.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   54/15625) 000054-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.583, top1 = 87.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.397, top1 = 91.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.78 ms.
cifar100       train : [loss = 0.177, top1 = 95.78%], valid : [loss = 1.560, top1 = 65.38%], test : [loss = 1.537, top1 = 65.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.98%], valid : [loss = 2.423, top1 = 38.94%], test : [loss = 2.465, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.30%], valid : [loss = 0.792, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   55/15625) 000055-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.05 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.07%], valid : [loss = 0.483, top1 = 84.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.04 ms.
cifar10        train : [loss = 0.299, top1 = 90.06%], test  : [loss = 0.397, top1 = 86.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.18 ms.
cifar100       train : [loss = 1.337, top1 = 62.92%], valid : [loss = 1.548, top1 = 57.87%], test : [loss = 1.514, top1 = 58.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.12 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.70%], valid : [loss = 2.906, top1 = 29.31%], test : [loss = 2.956, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   56/15625) 000056-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.419, top1 = 90.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.280, top1 = 93.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.37 ms.
cifar100       train : [loss = 0.126, top1 = 97.50%], valid : [loss = 1.294, top1 = 69.95%], test : [loss = 1.309, top1 = 69.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 1.723, top1 = 53.94%], valid : [loss = 2.233, top1 = 43.36%], test : [loss = 2.253, top1 = 43.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.10%], valid : [loss = 0.536, top1 = 82.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   57/15625) 000057-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.78%], valid : [loss = 0.856, top1 = 72.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.22 ms.
cifar10        train : [loss = 0.549, top1 = 80.93%], test  : [loss = 0.715, top1 = 75.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.50 ms.
cifar100       train : [loss = 1.774, top1 = 52.18%], valid : [loss = 2.059, top1 = 46.97%], test : [loss = 2.071, top1 = 46.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.83%], valid : [loss = 3.624, top1 = 16.54%], test : [loss = 3.667, top1 = 16.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   58/15625) 000058-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.00 ms.
cifar10-valid  train : [loss = 1.099, top1 = 60.95%], valid : [loss = 1.150, top1 = 59.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.97 ms.
cifar10        train : [loss = 1.066, top1 = 62.37%], test  : [loss = 1.063, top1 = 62.34%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.59 ms.
cifar100       train : [loss = 2.583, top1 = 34.79%], valid : [loss = 2.660, top1 = 33.69%], test : [loss = 2.634, top1 = 34.01%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.11 ms.
ImageNet16-120 train : [loss = 3.788, top1 = 13.59%], valid : [loss = 3.767, top1 = 14.51%], test : [loss = 3.791, top1 = 13.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   59/15625) 000059-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.04%], valid : [loss = 0.632, top1 = 84.79%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.072, top1 = 97.68%], test  : [loss = 0.404, top1 = 88.87%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.56 ms.
cifar100       train : [loss = 0.758, top1 = 77.80%], valid : [loss = 1.429, top1 = 62.11%], test : [loss = 1.412, top1 = 62.37%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.50%], valid : [loss = 2.677, top1 = 33.16%], test : [loss = 2.712, top1 = 32.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.08%], valid : [loss = 0.860, top1 = 69.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   60/15625) 000060-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.71%], valid : [loss = 0.470, top1 = 86.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.59 ms.
cifar10        train : [loss = 0.125, top1 = 96.07%], test  : [loss = 0.345, top1 = 89.15%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.69 ms.
cifar100       train : [loss = 0.761, top1 = 78.67%], valid : [loss = 1.271, top1 = 64.79%], test : [loss = 1.273, top1 = 64.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.80%], valid : [loss = 2.590, top1 = 34.64%], test : [loss = 2.608, top1 = 34.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   61/15625) 000061-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.718, top1 = 85.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.024, top1 = 99.36%], test  : [loss = 0.498, top1 = 88.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.338, top1 = 90.93%], valid : [loss = 1.594, top1 = 62.55%], test : [loss = 1.574, top1 = 63.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.454, top1 = 37.80%], valid : [loss = 2.812, top1 = 31.32%], test : [loss = 2.847, top1 = 31.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.87%], valid : [loss = 0.841, top1 = 70.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   62/15625) 000062-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.325, top1 = 92.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.83 ms.
cifar100       train : [loss = 0.311, top1 = 91.54%], valid : [loss = 1.266, top1 = 67.69%], test : [loss = 1.272, top1 = 68.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.73%], valid : [loss = 2.327, top1 = 40.08%], test : [loss = 2.339, top1 = 40.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.72%], valid : [loss = 0.721, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   63/15625) 000063-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.558, top1 = 88.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.367, top1 = 92.42%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.15 ms.
cifar100       train : [loss = 0.120, top1 = 97.24%], valid : [loss = 1.407, top1 = 68.55%], test : [loss = 1.412, top1 = 68.41%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.54%], valid : [loss = 2.240, top1 = 42.79%], test : [loss = 2.262, top1 = 42.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.06%], valid : [loss = 0.900, top1 = 67.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   64/15625) 000064-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.509, top1 = 89.55%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.68 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.358, top1 = 92.72%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.48 ms.
cifar100       train : [loss = 0.095, top1 = 98.15%], valid : [loss = 1.348, top1 = 69.64%], test : [loss = 1.345, top1 = 69.17%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.29 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.08%], valid : [loss = 2.317, top1 = 40.74%], test : [loss = 2.324, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.59%], valid : [loss = 0.873, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   65/15625) 000065-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.473, top1 = 90.40%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.54 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.313, top1 = 93.49%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.17 ms.
cifar100       train : [loss = 0.058, top1 = 99.22%], valid : [loss = 1.296, top1 = 70.54%], test : [loss = 1.294, top1 = 70.72%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 1.603, top1 = 56.79%], valid : [loss = 2.154, top1 = 44.96%], test : [loss = 2.143, top1 = 45.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.68%], valid : [loss = 0.720, top1 = 74.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   66/15625) 000066-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.46%], valid : [loss = 0.853, top1 = 72.05%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10        train : [loss = 0.562, top1 = 80.33%], test  : [loss = 0.721, top1 = 75.73%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.25 ms.
cifar100       train : [loss = 1.773, top1 = 52.12%], valid : [loss = 2.049, top1 = 46.83%], test : [loss = 2.071, top1 = 46.77%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.49 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.67%], valid : [loss = 3.642, top1 = 16.28%], test : [loss = 3.677, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   67/15625) 000067-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.512, top1 = 89.70%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.48 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.316, top1 = 93.37%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.23 ms.
cifar100       train : [loss = 0.068, top1 = 99.05%], valid : [loss = 1.364, top1 = 69.41%], test : [loss = 1.399, top1 = 69.00%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 1.772, top1 = 52.81%], valid : [loss = 2.262, top1 = 42.70%], test : [loss = 2.242, top1 = 43.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.51%], valid : [loss = 0.678, top1 = 76.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   68/15625) 000068-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.521, top1 = 88.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.338, top1 = 91.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.49 ms.
cifar100       train : [loss = 0.433, top1 = 87.39%], valid : [loss = 1.263, top1 = 66.94%], test : [loss = 1.270, top1 = 66.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.41%], valid : [loss = 2.371, top1 = 39.39%], test : [loss = 2.366, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   69/15625) 000069-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.71%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.52 ms.
cifar100       train : [loss = 0.066, top1 = 99.00%], valid : [loss = 1.374, top1 = 70.16%], test : [loss = 1.308, top1 = 71.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 1.543, top1 = 58.33%], valid : [loss = 2.235, top1 = 44.11%], test : [loss = 2.273, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   70/15625) 000070-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.527, top1 = 88.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.345, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.47 ms.
cifar100       train : [loss = 0.351, top1 = 90.40%], valid : [loss = 1.303, top1 = 66.86%], test : [loss = 1.290, top1 = 66.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.37%], valid : [loss = 2.419, top1 = 38.58%], test : [loss = 2.414, top1 = 39.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   71/15625) 000071-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.596, top1 = 86.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.62 ms.
cifar10        train : [loss = 0.025, top1 = 99.35%], test  : [loss = 0.381, top1 = 90.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.517, top1 = 84.95%], valid : [loss = 1.445, top1 = 63.73%], test : [loss = 1.427, top1 = 63.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.97%], valid : [loss = 2.536, top1 = 36.20%], test : [loss = 2.549, top1 = 36.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 72.90%], valid : [loss = 0.817, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   72/15625) 000072-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.89%], valid : [loss = 0.479, top1 = 84.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.301, top1 = 89.91%], test  : [loss = 0.396, top1 = 86.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.49 ms.
cifar100       train : [loss = 1.331, top1 = 63.13%], valid : [loss = 1.529, top1 = 57.96%], test : [loss = 1.510, top1 = 58.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.32 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.61%], valid : [loss = 2.907, top1 = 29.41%], test : [loss = 2.964, top1 = 28.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   73/15625) 000073-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.714, top1 = 85.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10        train : [loss = 0.021, top1 = 99.40%], test  : [loss = 0.466, top1 = 89.51%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.61 ms.
cifar100       train : [loss = 0.299, top1 = 91.99%], valid : [loss = 1.658, top1 = 61.87%], test : [loss = 1.702, top1 = 61.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.39%], valid : [loss = 2.707, top1 = 33.66%], test : [loss = 2.748, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.73%], valid : [loss = 0.889, top1 = 68.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   74/15625) 000074-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.66 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   75/15625) 000075-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.23%], valid : [loss = 0.858, top1 = 70.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10        train : [loss = 0.687, top1 = 75.90%], test  : [loss = 0.770, top1 = 73.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.64 ms.
cifar100       train : [loss = 1.951, top1 = 48.12%], valid : [loss = 2.121, top1 = 44.47%], test : [loss = 2.129, top1 = 44.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.73%], valid : [loss = 3.671, top1 = 15.81%], test : [loss = 3.693, top1 = 14.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   76/15625) 000076-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.56 ms.
cifar10-valid  train : [loss = 0.241, top1 = 91.83%], valid : [loss = 0.524, top1 = 83.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10        train : [loss = 0.241, top1 = 91.79%], test  : [loss = 0.385, top1 = 87.27%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 1.310, top1 = 63.09%], valid : [loss = 1.577, top1 = 56.86%], test : [loss = 1.574, top1 = 56.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.47 ms.
ImageNet16-120 train : [loss = 2.869, top1 = 29.36%], valid : [loss = 2.885, top1 = 29.44%], test : [loss = 2.942, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.46%], valid : [loss = 1.001, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   77/15625) 000077-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 90.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.318, top1 = 93.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.117, top1 = 97.63%], valid : [loss = 1.294, top1 = 69.15%], test : [loss = 1.288, top1 = 69.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.711, top1 = 54.15%], valid : [loss = 2.170, top1 = 44.01%], test : [loss = 2.192, top1 = 44.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   78/15625) 000078-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.510, top1 = 88.69%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.331, top1 = 91.93%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.57 ms.
cifar100       train : [loss = 0.338, top1 = 90.81%], valid : [loss = 1.305, top1 = 66.79%], test : [loss = 1.288, top1 = 66.97%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.50%], valid : [loss = 2.413, top1 = 38.54%], test : [loss = 2.414, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.13%], valid : [loss = 0.705, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   79/15625) 000079-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.318, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.328, top1 = 91.09%], valid : [loss = 1.317, top1 = 67.09%], test : [loss = 1.307, top1 = 67.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.19%], valid : [loss = 2.350, top1 = 40.08%], test : [loss = 2.406, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.33%], valid : [loss = 0.557, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   80/15625) 000080-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.491, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.318, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.271, top1 = 93.10%], valid : [loss = 1.207, top1 = 69.11%], test : [loss = 1.214, top1 = 69.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.71%], valid : [loss = 2.231, top1 = 42.52%], test : [loss = 2.243, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   81/15625) 000081-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.15 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.415, top1 = 91.35%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.24 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.254, top1 = 94.30%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.66 ms.
cifar100       train : [loss = 0.021, top1 = 99.87%], valid : [loss = 1.272, top1 = 72.77%], test : [loss = 1.274, top1 = 72.30%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.41 ms.
ImageNet16-120 train : [loss = 1.124, top1 = 68.73%], valid : [loss = 2.251, top1 = 45.53%], test : [loss = 2.235, top1 = 46.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.67%], valid : [loss = 0.479, top1 = 83.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   82/15625) 000082-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.552, top1 = 88.82%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.88 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.374, top1 = 92.15%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.49 ms.
cifar100       train : [loss = 0.109, top1 = 97.69%], valid : [loss = 1.527, top1 = 66.11%], test : [loss = 1.516, top1 = 66.31%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 35.70%], valid : [loss = 2.715, top1 = 32.34%], test : [loss = 2.722, top1 = 32.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 58.47%], valid : [loss = 1.160, top1 = 57.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   83/15625) 000083-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.345, top1 = 88.09%], valid : [loss = 0.577, top1 = 81.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.290, top1 = 90.07%], test  : [loss = 0.447, top1 = 85.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 1.558, top1 = 56.72%], valid : [loss = 1.804, top1 = 51.61%], test : [loss = 1.783, top1 = 52.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.075, top1 = 25.30%], valid : [loss = 3.077, top1 = 25.40%], test : [loss = 3.141, top1 = 24.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.33%], valid : [loss = 1.054, top1 = 62.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   84/15625) 000084-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.564, top1 = 87.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.369, top1 = 91.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.93 ms.
cifar100       train : [loss = 0.387, top1 = 89.02%], valid : [loss = 1.396, top1 = 65.32%], test : [loss = 1.382, top1 = 65.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.62%], valid : [loss = 2.489, top1 = 37.12%], test : [loss = 2.499, top1 = 37.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   85/15625) 000085-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.588, top1 = 87.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.394, top1 = 90.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.35 ms.
cifar100       train : [loss = 0.213, top1 = 95.06%], valid : [loss = 1.432, top1 = 65.98%], test : [loss = 1.426, top1 = 66.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.08%], valid : [loss = 2.486, top1 = 37.81%], test : [loss = 2.495, top1 = 38.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.62%], valid : [loss = 0.719, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   86/15625) 000086-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.448, top1 = 89.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.301, top1 = 92.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 0.205, top1 = 95.23%], valid : [loss = 1.272, top1 = 68.29%], test : [loss = 1.276, top1 = 69.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.67%], valid : [loss = 2.245, top1 = 42.70%], test : [loss = 2.298, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.418, top1 = 85.70%], valid : [loss = 0.528, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   87/15625) 000087-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.12%], valid : [loss = 0.754, top1 = 74.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10        train : [loss = 0.566, top1 = 80.38%], test  : [loss = 0.629, top1 = 78.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.90 ms.
cifar100       train : [loss = 1.974, top1 = 46.79%], valid : [loss = 2.124, top1 = 43.65%], test : [loss = 2.112, top1 = 44.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.33 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.40%], valid : [loss = 3.244, top1 = 22.72%], test : [loss = 3.249, top1 = 22.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.21%], valid : [loss = 1.330, top1 = 51.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   88/15625) 000088-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.49%], valid : [loss = 0.451, top1 = 86.41%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.11 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.349, top1 = 88.52%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.93 ms.
cifar100       train : [loss = 0.980, top1 = 72.02%], valid : [loss = 1.349, top1 = 62.14%], test : [loss = 1.341, top1 = 62.61%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.20%], valid : [loss = 2.665, top1 = 33.36%], test : [loss = 2.702, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 75.17%], valid : [loss = 0.769, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   89/15625) 000089-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.468, top1 = 88.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.317, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 0.333, top1 = 90.85%], valid : [loss = 1.314, top1 = 66.76%], test : [loss = 1.312, top1 = 67.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.21%], valid : [loss = 2.387, top1 = 40.01%], test : [loss = 2.387, top1 = 40.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.26%], valid : [loss = 0.555, top1 = 81.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   90/15625) 000090-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.603, top1 = 86.75%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.40 ms.
cifar10        train : [loss = 0.018, top1 = 99.63%], test  : [loss = 0.411, top1 = 90.11%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.96 ms.
cifar100       train : [loss = 0.214, top1 = 95.21%], valid : [loss = 1.435, top1 = 66.13%], test : [loss = 1.420, top1 = 65.93%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 2.083, top1 = 45.74%], valid : [loss = 2.511, top1 = 37.64%], test : [loss = 2.529, top1 = 37.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.94%], valid : [loss = 0.744, top1 = 74.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   91/15625) 000091-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.33%], valid : [loss = 0.577, top1 = 86.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10        train : [loss = 0.052, top1 = 98.33%], test  : [loss = 0.387, top1 = 89.83%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.05 ms.
cifar100       train : [loss = 0.518, top1 = 85.05%], valid : [loss = 1.386, top1 = 64.27%], test : [loss = 1.368, top1 = 64.69%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.45%], valid : [loss = 2.497, top1 = 36.47%], test : [loss = 2.511, top1 = 36.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 71.82%], valid : [loss = 0.845, top1 = 69.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   92/15625) 000092-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.616, top1 = 87.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.405, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.169, top1 = 96.36%], valid : [loss = 1.496, top1 = 65.92%], test : [loss = 1.445, top1 = 66.79%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.65%], valid : [loss = 2.486, top1 = 38.13%], test : [loss = 2.480, top1 = 38.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.19%], valid : [loss = 0.729, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   93/15625) 000093-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.577, top1 = 87.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.389, top1 = 91.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.08 ms.
cifar100       train : [loss = 0.396, top1 = 88.76%], valid : [loss = 1.409, top1 = 65.48%], test : [loss = 1.385, top1 = 65.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.14%], valid : [loss = 2.520, top1 = 36.78%], test : [loss = 2.529, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   94/15625) 000094-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.202, top1 = 93.15%], valid : [loss = 0.526, top1 = 84.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10        train : [loss = 0.207, top1 = 93.02%], test  : [loss = 0.383, top1 = 87.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.86 ms.
cifar100       train : [loss = 1.236, top1 = 65.02%], valid : [loss = 1.535, top1 = 58.59%], test : [loss = 1.550, top1 = 57.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 2.779, top1 = 31.09%], valid : [loss = 2.824, top1 = 30.13%], test : [loss = 2.854, top1 = 29.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.87%], valid : [loss = 1.013, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   95/15625) 000095-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10-valid  train : [loss = 0.788, top1 = 72.08%], valid : [loss = 1.108, top1 = 63.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10        train : [loss = 0.779, top1 = 72.48%], test  : [loss = 0.911, top1 = 68.64%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 2.129, top1 = 44.10%], valid : [loss = 2.395, top1 = 39.61%], test : [loss = 2.410, top1 = 39.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.64 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.90%], valid : [loss = 3.827, top1 = 13.78%], test : [loss = 3.831, top1 = 13.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   96/15625) 000096-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.631, top1 = 85.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 0.031, top1 = 99.14%], test  : [loss = 0.402, top1 = 90.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.46 ms.
cifar100       train : [loss = 0.514, top1 = 85.07%], valid : [loss = 1.443, top1 = 63.75%], test : [loss = 1.430, top1 = 63.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.97%], valid : [loss = 2.576, top1 = 36.00%], test : [loss = 2.606, top1 = 34.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.03%], valid : [loss = 0.849, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   97/15625) 000097-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.46%], valid : [loss = 0.468, top1 = 86.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.158, top1 = 94.81%], test  : [loss = 0.354, top1 = 88.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 1.007, top1 = 71.39%], valid : [loss = 1.355, top1 = 62.09%], test : [loss = 1.359, top1 = 62.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.81%], valid : [loss = 2.689, top1 = 33.01%], test : [loss = 2.715, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   98/15625) 000098-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.28%], valid : [loss = 0.620, top1 = 85.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.12 ms.
cifar10        train : [loss = 0.063, top1 = 98.08%], test  : [loss = 0.408, top1 = 89.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.65 ms.
cifar100       train : [loss = 0.671, top1 = 80.38%], valid : [loss = 1.378, top1 = 63.65%], test : [loss = 1.366, top1 = 63.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.31%], valid : [loss = 2.652, top1 = 33.52%], test : [loss = 2.691, top1 = 32.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.68%], valid : [loss = 0.803, top1 = 71.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (   99/15625) 000099-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.428, top1 = 90.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.282, top1 = 93.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.87 ms.
cifar100       train : [loss = 0.068, top1 = 99.05%], valid : [loss = 1.344, top1 = 70.13%], test : [loss = 1.347, top1 = 70.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 1.548, top1 = 58.08%], valid : [loss = 2.246, top1 = 43.68%], test : [loss = 2.260, top1 = 43.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.94%], valid : [loss = 0.485, top1 = 83.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  100/15625) 000100-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.547, top1 = 88.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.46 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.350, top1 = 92.13%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.71 ms.
cifar100       train : [loss = 0.282, top1 = 92.29%], valid : [loss = 1.335, top1 = 67.09%], test : [loss = 1.313, top1 = 67.85%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.13%], valid : [loss = 2.405, top1 = 39.08%], test : [loss = 2.412, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.00%], valid : [loss = 0.834, top1 = 70.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  101/15625) 000101-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.48%], valid : [loss = 0.502, top1 = 84.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10        train : [loss = 0.176, top1 = 94.05%], test  : [loss = 0.381, top1 = 88.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 1.095, top1 = 68.59%], valid : [loss = 1.443, top1 = 60.62%], test : [loss = 1.448, top1 = 59.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.79%], valid : [loss = 2.648, top1 = 33.74%], test : [loss = 2.672, top1 = 33.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.73%], valid : [loss = 0.933, top1 = 66.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  102/15625) 000102-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.490, top1 = 89.10%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.315, top1 = 92.20%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.20 ms.
cifar100       train : [loss = 0.228, top1 = 94.40%], valid : [loss = 1.238, top1 = 69.26%], test : [loss = 1.256, top1 = 68.84%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 1.926, top1 = 49.22%], valid : [loss = 2.280, top1 = 41.81%], test : [loss = 2.258, top1 = 42.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.67%], valid : [loss = 0.659, top1 = 77.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  103/15625) 000103-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.532, top1 = 88.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.338, top1 = 92.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.160, top1 = 96.40%], valid : [loss = 1.322, top1 = 68.76%], test : [loss = 1.319, top1 = 68.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.84%], valid : [loss = 2.321, top1 = 40.91%], test : [loss = 2.325, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.41%], valid : [loss = 0.739, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  104/15625) 000104-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10        train : [loss = 2.303, top1 = 9.95%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  105/15625) 000105-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.82 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.69 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.60 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  106/15625) 000106-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.16%], valid : [loss = 0.855, top1 = 72.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.568, top1 = 80.17%], test  : [loss = 0.722, top1 = 75.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.33 ms.
cifar100       train : [loss = 1.780, top1 = 51.92%], valid : [loss = 2.037, top1 = 47.04%], test : [loss = 2.055, top1 = 47.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.85%], valid : [loss = 3.636, top1 = 16.67%], test : [loss = 3.673, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  107/15625) 000107-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.153, top1 = 95.02%], valid : [loss = 0.531, top1 = 84.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.155, top1 = 94.77%], test  : [loss = 0.399, top1 = 87.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.992, top1 = 71.32%], valid : [loss = 1.483, top1 = 59.75%], test : [loss = 1.470, top1 = 60.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.694, top1 = 32.62%], valid : [loss = 2.746, top1 = 31.76%], test : [loss = 2.779, top1 = 31.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.75%], valid : [loss = 0.945, top1 = 66.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  108/15625) 000108-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.44 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  109/15625) 000109-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.524, top1 = 89.61%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.317, top1 = 93.20%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.67 ms.
cifar100       train : [loss = 0.096, top1 = 98.28%], valid : [loss = 1.280, top1 = 70.09%], test : [loss = 1.283, top1 = 69.87%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.72 ms.
ImageNet16-120 train : [loss = 1.624, top1 = 56.26%], valid : [loss = 2.157, top1 = 44.90%], test : [loss = 2.158, top1 = 45.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 78.30%], valid : [loss = 0.703, top1 = 75.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  110/15625) 000110-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.526, top1 = 88.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.359, top1 = 90.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.91 ms.
cifar100       train : [loss = 0.511, top1 = 84.87%], valid : [loss = 1.370, top1 = 65.35%], test : [loss = 1.348, top1 = 65.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.61%], valid : [loss = 2.539, top1 = 35.72%], test : [loss = 2.556, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.44%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  111/15625) 000111-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.417, top1 = 90.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.74 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.279, top1 = 93.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.46 ms.
cifar100       train : [loss = 0.062, top1 = 99.12%], valid : [loss = 1.373, top1 = 69.84%], test : [loss = 1.328, top1 = 70.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.42 ms.
ImageNet16-120 train : [loss = 1.513, top1 = 59.02%], valid : [loss = 2.226, top1 = 44.72%], test : [loss = 2.226, top1 = 44.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.343, top1 = 88.28%], valid : [loss = 0.481, top1 = 83.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  112/15625) 000112-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.499, top1 = 89.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.336, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.55 ms.
cifar100       train : [loss = 0.332, top1 = 91.04%], valid : [loss = 1.297, top1 = 66.78%], test : [loss = 1.295, top1 = 67.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.00%], valid : [loss = 2.399, top1 = 39.41%], test : [loss = 2.405, top1 = 39.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  113/15625) 000113-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.241, top1 = 91.79%], valid : [loss = 0.517, top1 = 83.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.77 ms.
cifar10        train : [loss = 0.241, top1 = 91.70%], test  : [loss = 0.386, top1 = 87.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.01 ms.
cifar100       train : [loss = 1.341, top1 = 62.27%], valid : [loss = 1.605, top1 = 56.39%], test : [loss = 1.608, top1 = 56.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.49 ms.
ImageNet16-120 train : [loss = 2.863, top1 = 29.51%], valid : [loss = 2.868, top1 = 29.62%], test : [loss = 2.927, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.46%], valid : [loss = 1.001, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  114/15625) 000114-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.57%], valid : [loss = 0.583, top1 = 86.99%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.041, top1 = 98.79%], test  : [loss = 0.388, top1 = 90.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.19 ms.
cifar100       train : [loss = 0.551, top1 = 83.75%], valid : [loss = 1.411, top1 = 64.01%], test : [loss = 1.387, top1 = 64.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.03%], valid : [loss = 2.638, top1 = 34.16%], test : [loss = 2.656, top1 = 34.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.27%], valid : [loss = 0.707, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  115/15625) 000115-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.622, top1 = 86.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 0.030, top1 = 99.16%], test  : [loss = 0.391, top1 = 90.45%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.38 ms.
cifar100       train : [loss = 0.513, top1 = 84.99%], valid : [loss = 1.421, top1 = 63.96%], test : [loss = 1.441, top1 = 63.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.16%], valid : [loss = 2.568, top1 = 35.22%], test : [loss = 2.609, top1 = 35.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  116/15625) 000116-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.490, top1 = 88.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.324, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.237, top1 = 94.17%], valid : [loss = 1.255, top1 = 68.25%], test : [loss = 1.258, top1 = 68.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.31%], valid : [loss = 2.269, top1 = 41.71%], test : [loss = 2.299, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  117/15625) 000117-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.581, top1 = 88.58%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.40 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.380, top1 = 92.33%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.41 ms.
cifar100       train : [loss = 0.086, top1 = 98.58%], valid : [loss = 1.450, top1 = 68.14%], test : [loss = 1.467, top1 = 68.43%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.95 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.02%], valid : [loss = 2.432, top1 = 39.10%], test : [loss = 2.441, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.78%], valid : [loss = 0.751, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  118/15625) 000118-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.98%], valid : [loss = 0.689, top1 = 76.58%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.45 ms.
cifar10        train : [loss = 0.540, top1 = 81.17%], test  : [loss = 0.596, top1 = 79.55%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.76 ms.
cifar100       train : [loss = 1.752, top1 = 52.55%], valid : [loss = 1.888, top1 = 49.51%], test : [loss = 1.922, top1 = 49.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.30 ms.
ImageNet16-120 train : [loss = 3.380, top1 = 20.26%], valid : [loss = 3.356, top1 = 21.12%], test : [loss = 3.404, top1 = 19.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  119/15625) 000119-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.492, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.324, top1 = 92.18%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.26 ms.
cifar100       train : [loss = 0.266, top1 = 93.18%], valid : [loss = 1.224, top1 = 69.04%], test : [loss = 1.210, top1 = 69.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.96%], valid : [loss = 2.215, top1 = 42.73%], test : [loss = 2.229, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.28%], valid : [loss = 0.628, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  120/15625) 000120-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.01 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  121/15625) 000121-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.551, top1 = 88.72%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.369, top1 = 91.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.68 ms.
cifar100       train : [loss = 0.173, top1 = 96.31%], valid : [loss = 1.393, top1 = 67.69%], test : [loss = 1.383, top1 = 67.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.88%], valid : [loss = 2.446, top1 = 38.53%], test : [loss = 2.454, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.96%], valid : [loss = 0.683, top1 = 76.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  122/15625) 000122-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.599, top1 = 86.77%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.21 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.407, top1 = 89.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.62 ms.
cifar100       train : [loss = 0.357, top1 = 90.42%], valid : [loss = 1.404, top1 = 65.49%], test : [loss = 1.371, top1 = 65.57%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.37%], valid : [loss = 2.544, top1 = 35.94%], test : [loss = 2.562, top1 = 36.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.25%], valid : [loss = 0.768, top1 = 73.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  123/15625) 000123-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.49%], valid : [loss = 1.031, top1 = 77.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.106, top1 = 96.49%], test  : [loss = 0.617, top1 = 83.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.10 ms.
cifar100       train : [loss = 0.691, top1 = 80.25%], valid : [loss = 2.015, top1 = 52.62%], test : [loss = 1.994, top1 = 52.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.945, top1 = 28.19%], valid : [loss = 3.223, top1 = 23.29%], test : [loss = 3.264, top1 = 22.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.019, top1 = 63.05%], valid : [loss = 1.092, top1 = 61.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  124/15625) 000124-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.454, top1 = 89.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.72 ms.
cifar100       train : [loss = 0.330, top1 = 90.93%], valid : [loss = 1.304, top1 = 67.30%], test : [loss = 1.316, top1 = 67.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.25%], valid : [loss = 2.369, top1 = 39.90%], test : [loss = 2.396, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.451, top1 = 84.30%], valid : [loss = 0.551, top1 = 81.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  125/15625) 000125-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.10%], valid : [loss = 0.562, top1 = 86.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10        train : [loss = 0.064, top1 = 97.94%], test  : [loss = 0.372, top1 = 89.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 0.654, top1 = 80.61%], valid : [loss = 1.297, top1 = 64.94%], test : [loss = 1.294, top1 = 65.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.11%], valid : [loss = 2.508, top1 = 36.34%], test : [loss = 2.545, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  126/15625) 000126-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.83%], valid : [loss = 0.598, top1 = 80.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10        train : [loss = 0.323, top1 = 88.83%], test  : [loss = 0.464, top1 = 84.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.05 ms.
cifar100       train : [loss = 1.568, top1 = 56.23%], valid : [loss = 1.792, top1 = 51.75%], test : [loss = 1.809, top1 = 51.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.955, top1 = 27.45%], valid : [loss = 2.981, top1 = 27.32%], test : [loss = 3.031, top1 = 25.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 62.10%], valid : [loss = 1.107, top1 = 60.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  127/15625) 000127-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.43%], valid : [loss = 0.463, top1 = 86.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10        train : [loss = 0.162, top1 = 94.73%], test  : [loss = 0.345, top1 = 88.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 1.013, top1 = 71.30%], valid : [loss = 1.357, top1 = 62.06%], test : [loss = 1.361, top1 = 61.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.75%], valid : [loss = 2.677, top1 = 33.34%], test : [loss = 2.712, top1 = 32.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  128/15625) 000128-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.315, top1 = 92.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.15 ms.
cifar100       train : [loss = 0.322, top1 = 91.30%], valid : [loss = 1.260, top1 = 67.60%], test : [loss = 1.243, top1 = 68.53%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.60%], valid : [loss = 2.313, top1 = 40.82%], test : [loss = 2.336, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 80.96%], valid : [loss = 0.618, top1 = 78.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  129/15625) 000129-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.504, top1 = 89.85%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.88 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.303, top1 = 93.57%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.21 ms.
cifar100       train : [loss = 0.070, top1 = 98.90%], valid : [loss = 1.292, top1 = 70.66%], test : [loss = 1.323, top1 = 70.47%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.57 ms.
ImageNet16-120 train : [loss = 1.600, top1 = 56.90%], valid : [loss = 2.133, top1 = 44.66%], test : [loss = 2.146, top1 = 45.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.52%], valid : [loss = 0.735, top1 = 74.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  130/15625) 000130-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.474, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.327, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.11 ms.
cifar100       train : [loss = 0.278, top1 = 92.62%], valid : [loss = 1.377, top1 = 66.75%], test : [loss = 1.323, top1 = 67.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.46%], valid : [loss = 2.353, top1 = 40.67%], test : [loss = 2.376, top1 = 40.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.15%], valid : [loss = 0.595, top1 = 79.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  131/15625) 000131-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.64%], valid : [loss = 0.670, top1 = 82.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.161, top1 = 94.52%], test  : [loss = 0.453, top1 = 86.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.976, top1 = 71.68%], valid : [loss = 1.636, top1 = 57.25%], test : [loss = 1.627, top1 = 57.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 3.106, top1 = 24.18%], valid : [loss = 3.151, top1 = 23.74%], test : [loss = 3.191, top1 = 22.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.009, top1 = 63.72%], valid : [loss = 1.051, top1 = 62.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  132/15625) 000132-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.447, top1 = 89.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.30 ms.
cifar100       train : [loss = 0.325, top1 = 91.22%], valid : [loss = 1.315, top1 = 66.91%], test : [loss = 1.302, top1 = 67.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.23%], valid : [loss = 2.335, top1 = 40.74%], test : [loss = 2.395, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.451, top1 = 84.30%], valid : [loss = 0.551, top1 = 81.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  133/15625) 000133-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.471, top1 = 90.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.313, top1 = 93.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.67 ms.
cifar100       train : [loss = 0.084, top1 = 98.50%], valid : [loss = 1.348, top1 = 70.18%], test : [loss = 1.358, top1 = 70.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 1.636, top1 = 56.07%], valid : [loss = 2.219, top1 = 43.86%], test : [loss = 2.241, top1 = 43.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.42%], valid : [loss = 0.550, top1 = 81.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  134/15625) 000134-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.41%], valid : [loss = 0.560, top1 = 87.20%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.21 ms.
cifar10        train : [loss = 0.046, top1 = 98.60%], test  : [loss = 0.386, top1 = 90.07%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.17 ms.
cifar100       train : [loss = 0.549, top1 = 83.98%], valid : [loss = 1.284, top1 = 65.87%], test : [loss = 1.303, top1 = 65.61%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.20%], valid : [loss = 2.425, top1 = 38.82%], test : [loss = 2.432, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.07%], valid : [loss = 0.737, top1 = 74.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  135/15625) 000135-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.453, top1 = 89.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.014, top1 = 99.75%], test  : [loss = 0.324, top1 = 91.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 0.326, top1 = 91.17%], valid : [loss = 1.312, top1 = 67.59%], test : [loss = 1.324, top1 = 66.99%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.15%], valid : [loss = 2.391, top1 = 39.49%], test : [loss = 2.418, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  136/15625) 000136-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.534, top1 = 88.95%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.66 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.347, top1 = 92.14%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.49 ms.
cifar100       train : [loss = 0.106, top1 = 97.57%], valid : [loss = 1.444, top1 = 67.89%], test : [loss = 1.442, top1 = 68.17%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.47 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 38.93%], valid : [loss = 2.586, top1 = 34.87%], test : [loss = 2.580, top1 = 35.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 66.78%], valid : [loss = 0.952, top1 = 66.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  137/15625) 000137-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.438, top1 = 90.50%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.80 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.317, top1 = 93.18%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.48 ms.
cifar100       train : [loss = 0.057, top1 = 99.17%], valid : [loss = 1.435, top1 = 69.42%], test : [loss = 1.398, top1 = 69.61%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 1.554, top1 = 58.13%], valid : [loss = 2.266, top1 = 43.53%], test : [loss = 2.290, top1 = 43.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.66%], valid : [loss = 0.589, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  138/15625) 000138-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.54 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.501, top1 = 89.94%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=19.87 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.295, top1 = 93.67%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.65 ms.
cifar100       train : [loss = 0.029, top1 = 99.76%], valid : [loss = 1.339, top1 = 71.37%], test : [loss = 1.347, top1 = 70.91%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=20.40 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.32%], valid : [loss = 2.329, top1 = 40.66%], test : [loss = 2.323, top1 = 41.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.82%], valid : [loss = 0.805, top1 = 71.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  139/15625) 000139-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.81%], valid : [loss = 0.520, top1 = 86.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10        train : [loss = 0.069, top1 = 97.97%], test  : [loss = 0.347, top1 = 90.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.647, top1 = 81.28%], valid : [loss = 1.312, top1 = 65.19%], test : [loss = 1.299, top1 = 65.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.45%], valid : [loss = 2.516, top1 = 36.47%], test : [loss = 2.523, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.17%], valid : [loss = 0.877, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  140/15625) 000140-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.499, top1 = 88.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.327, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.72 ms.
cifar100       train : [loss = 0.314, top1 = 91.55%], valid : [loss = 1.269, top1 = 67.54%], test : [loss = 1.259, top1 = 67.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.27%], valid : [loss = 2.309, top1 = 41.06%], test : [loss = 2.330, top1 = 41.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.16%], valid : [loss = 0.651, top1 = 77.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  141/15625) 000141-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.39%], valid : [loss = 0.567, top1 = 87.03%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10        train : [loss = 0.052, top1 = 98.38%], test  : [loss = 0.373, top1 = 90.19%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.35 ms.
cifar100       train : [loss = 0.575, top1 = 83.32%], valid : [loss = 1.318, top1 = 65.73%], test : [loss = 1.311, top1 = 65.39%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.75%], valid : [loss = 2.422, top1 = 38.08%], test : [loss = 2.442, top1 = 38.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.24%], valid : [loss = 0.719, top1 = 75.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  142/15625) 000142-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.480, top1 = 89.20%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.41 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.305, top1 = 92.33%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.30 ms.
cifar100       train : [loss = 0.281, top1 = 92.70%], valid : [loss = 1.224, top1 = 68.66%], test : [loss = 1.219, top1 = 68.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.64%], valid : [loss = 2.214, top1 = 42.82%], test : [loss = 2.246, top1 = 42.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.23%], valid : [loss = 0.643, top1 = 77.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  143/15625) 000143-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.534, top1 = 88.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.027, top1 = 99.19%], test  : [loss = 0.361, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.441, top1 = 87.20%], valid : [loss = 1.254, top1 = 67.35%], test : [loss = 1.256, top1 = 67.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.39%], valid : [loss = 2.363, top1 = 40.34%], test : [loss = 2.393, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  144/15625) 000144-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.59%], valid : [loss = 0.553, top1 = 82.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.245, top1 = 91.72%], test  : [loss = 0.404, top1 = 86.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.75 ms.
cifar100       train : [loss = 1.343, top1 = 62.15%], valid : [loss = 1.616, top1 = 56.09%], test : [loss = 1.591, top1 = 56.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.843, top1 = 29.85%], valid : [loss = 2.857, top1 = 29.93%], test : [loss = 2.904, top1 = 29.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.03%], valid : [loss = 1.025, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  145/15625) 000145-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.03%], valid : [loss = 0.522, top1 = 87.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10        train : [loss = 0.075, top1 = 97.61%], test  : [loss = 0.357, top1 = 90.03%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.79 ms.
cifar100       train : [loss = 0.707, top1 = 79.14%], valid : [loss = 1.358, top1 = 63.97%], test : [loss = 1.344, top1 = 64.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.520, top1 = 36.30%], valid : [loss = 2.625, top1 = 33.94%], test : [loss = 2.674, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.01%], valid : [loss = 0.656, top1 = 77.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  146/15625) 000146-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.296, top1 = 89.75%], valid : [loss = 0.564, top1 = 82.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.275, top1 = 90.59%], test  : [loss = 0.426, top1 = 86.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 1.402, top1 = 60.60%], valid : [loss = 1.651, top1 = 55.11%], test : [loss = 1.639, top1 = 55.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.947, top1 = 27.85%], valid : [loss = 2.956, top1 = 27.73%], test : [loss = 3.000, top1 = 27.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.42%], valid : [loss = 1.017, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  147/15625) 000147-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.558, top1 = 89.13%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.337, top1 = 93.06%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.11 ms.
cifar100       train : [loss = 0.043, top1 = 99.47%], valid : [loss = 1.457, top1 = 69.06%], test : [loss = 1.439, top1 = 69.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.666, top1 = 55.39%], valid : [loss = 2.389, top1 = 41.20%], test : [loss = 2.382, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.34%], valid : [loss = 0.690, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  148/15625) 000148-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.478, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.319, top1 = 92.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.86 ms.
cifar100       train : [loss = 0.320, top1 = 91.41%], valid : [loss = 1.265, top1 = 67.88%], test : [loss = 1.244, top1 = 67.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.63%], valid : [loss = 2.312, top1 = 40.52%], test : [loss = 2.343, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.585, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  149/15625) 000149-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.33%], valid : [loss = 0.522, top1 = 87.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10        train : [loss = 0.055, top1 = 98.36%], test  : [loss = 0.360, top1 = 90.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.78 ms.
cifar100       train : [loss = 0.627, top1 = 81.61%], valid : [loss = 1.352, top1 = 64.87%], test : [loss = 1.312, top1 = 65.67%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.52%], valid : [loss = 2.507, top1 = 36.74%], test : [loss = 2.538, top1 = 36.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.25%], valid : [loss = 0.631, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  150/15625) 000150-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.77%], valid : [loss = 0.620, top1 = 84.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10        train : [loss = 0.085, top1 = 97.24%], test  : [loss = 0.406, top1 = 88.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.78 ms.
cifar100       train : [loss = 0.757, top1 = 77.79%], valid : [loss = 1.414, top1 = 62.67%], test : [loss = 1.394, top1 = 62.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.56%], valid : [loss = 2.721, top1 = 32.00%], test : [loss = 2.732, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.79%], valid : [loss = 0.846, top1 = 70.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  151/15625) 000151-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.22%], valid : [loss = 0.723, top1 = 75.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.587, top1 = 79.68%], test  : [loss = 0.642, top1 = 77.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.85 ms.
cifar100       train : [loss = 1.958, top1 = 47.24%], valid : [loss = 2.099, top1 = 44.49%], test : [loss = 2.082, top1 = 44.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.17%], valid : [loss = 3.226, top1 = 22.93%], test : [loss = 3.264, top1 = 21.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.88%], valid : [loss = 1.336, top1 = 52.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  152/15625) 000152-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.499, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.325, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.238, top1 = 94.18%], valid : [loss = 1.264, top1 = 68.45%], test : [loss = 1.263, top1 = 68.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.28%], valid : [loss = 2.267, top1 = 41.79%], test : [loss = 2.285, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  153/15625) 000153-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.483, top1 = 90.15%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.317, top1 = 93.24%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.87 ms.
cifar100       train : [loss = 0.091, top1 = 98.46%], valid : [loss = 1.285, top1 = 69.73%], test : [loss = 1.278, top1 = 70.28%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.57 ms.
ImageNet16-120 train : [loss = 1.637, top1 = 56.01%], valid : [loss = 2.130, top1 = 45.07%], test : [loss = 2.158, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.21%], valid : [loss = 0.594, top1 = 79.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  154/15625) 000154-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.602, top1 = 87.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.44 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.391, top1 = 91.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.20 ms.
cifar100       train : [loss = 0.257, top1 = 93.47%], valid : [loss = 1.581, top1 = 63.43%], test : [loss = 1.578, top1 = 63.69%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 2.092, top1 = 45.44%], valid : [loss = 2.471, top1 = 37.98%], test : [loss = 2.503, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.39%], valid : [loss = 0.798, top1 = 72.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  155/15625) 000155-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.209, top1 = 92.94%], valid : [loss = 0.555, top1 = 83.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.205, top1 = 93.10%], test  : [loss = 0.403, top1 = 87.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 1.256, top1 = 64.20%], valid : [loss = 1.586, top1 = 56.53%], test : [loss = 1.577, top1 = 57.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.698, top1 = 32.66%], valid : [loss = 2.727, top1 = 32.21%], test : [loss = 2.763, top1 = 31.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.41%], valid : [loss = 0.976, top1 = 65.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  156/15625) 000156-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.229, top1 = 92.25%], valid : [loss = 0.555, top1 = 83.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.67 ms.
cifar10        train : [loss = 0.226, top1 = 92.26%], test  : [loss = 0.407, top1 = 87.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 1.299, top1 = 63.07%], valid : [loss = 1.596, top1 = 56.50%], test : [loss = 1.599, top1 = 56.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.776, top1 = 31.12%], valid : [loss = 2.767, top1 = 31.52%], test : [loss = 2.825, top1 = 30.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.28%], valid : [loss = 1.001, top1 = 64.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  157/15625) 000157-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.30 ms.
cifar10-valid  train : [loss = 1.816, top1 = 33.36%], valid : [loss = 1.824, top1 = 33.31%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.47 ms.
cifar10        train : [loss = 1.343, top1 = 51.21%], test  : [loss = 1.349, top1 = 51.13%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.60 ms.
cifar100       train : [loss = 3.858, top1 = 10.79%], valid : [loss = 3.925, top1 = 9.77%], test : [loss = 3.922, top1 = 10.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.99 ms.
ImageNet16-120 train : [loss = 4.054, top1 = 9.54%], valid : [loss = 4.047, top1 = 9.69%], test : [loss = 4.072, top1 = 9.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.979, top1 = 26.41%], valid : [loss = 1.977, top1 = 27.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  158/15625) 000158-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.544, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.363, top1 = 92.70%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.47 ms.
cifar100       train : [loss = 0.062, top1 = 99.21%], valid : [loss = 1.407, top1 = 69.65%], test : [loss = 1.411, top1 = 69.35%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.18%], valid : [loss = 2.394, top1 = 40.09%], test : [loss = 2.411, top1 = 41.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.46%], valid : [loss = 0.714, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  159/15625) 000159-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.455, top1 = 86.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.112, top1 = 96.57%], test  : [loss = 0.321, top1 = 89.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 0.870, top1 = 75.22%], valid : [loss = 1.299, top1 = 64.17%], test : [loss = 1.280, top1 = 64.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.57%], valid : [loss = 2.631, top1 = 34.39%], test : [loss = 2.657, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  160/15625) 000160-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.291, top1 = 90.03%], valid : [loss = 0.560, top1 = 82.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.274, top1 = 90.54%], test  : [loss = 0.418, top1 = 86.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 1.407, top1 = 60.45%], valid : [loss = 1.662, top1 = 54.77%], test : [loss = 1.649, top1 = 55.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 2.957, top1 = 27.78%], valid : [loss = 2.960, top1 = 27.76%], test : [loss = 3.011, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 65.24%], valid : [loss = 1.038, top1 = 63.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  161/15625) 000161-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.586, top1 = 87.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.396, top1 = 90.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.80 ms.
cifar100       train : [loss = 0.390, top1 = 88.90%], valid : [loss = 1.403, top1 = 65.36%], test : [loss = 1.378, top1 = 65.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.81%], valid : [loss = 2.506, top1 = 36.50%], test : [loss = 2.531, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  162/15625) 000162-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.573, top1 = 88.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.71 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.387, top1 = 91.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.12 ms.
cifar100       train : [loss = 0.135, top1 = 97.36%], valid : [loss = 1.477, top1 = 66.93%], test : [loss = 1.469, top1 = 66.97%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.958, top1 = 48.55%], valid : [loss = 2.412, top1 = 39.40%], test : [loss = 2.455, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.90%], valid : [loss = 0.771, top1 = 73.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  163/15625) 000163-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.66%], valid : [loss = 0.542, top1 = 82.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.77 ms.
cifar10        train : [loss = 0.297, top1 = 89.85%], test  : [loss = 0.431, top1 = 85.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.31 ms.
cifar100       train : [loss = 1.299, top1 = 63.32%], valid : [loss = 1.585, top1 = 57.15%], test : [loss = 1.575, top1 = 57.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 3.072, top1 = 25.67%], valid : [loss = 3.081, top1 = 26.17%], test : [loss = 3.141, top1 = 24.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.11%], valid : [loss = 1.251, top1 = 54.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  164/15625) 000164-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.43%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.364, top1 = 92.54%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.62 ms.
cifar100       train : [loss = 0.084, top1 = 98.59%], valid : [loss = 1.438, top1 = 68.50%], test : [loss = 1.464, top1 = 68.13%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.20%], valid : [loss = 2.355, top1 = 41.28%], test : [loss = 2.375, top1 = 41.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 77.99%], valid : [loss = 0.714, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  165/15625) 000165-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.308, top1 = 92.94%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.93 ms.
cifar100       train : [loss = 0.145, top1 = 96.98%], valid : [loss = 1.292, top1 = 69.25%], test : [loss = 1.310, top1 = 69.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.91 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.07%], valid : [loss = 2.286, top1 = 41.77%], test : [loss = 2.305, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 79.01%], valid : [loss = 0.676, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  166/15625) 000166-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.82 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.42%], valid : [loss = 0.461, top1 = 86.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10        train : [loss = 0.161, top1 = 94.77%], test  : [loss = 0.346, top1 = 88.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.97 ms.
cifar100       train : [loss = 0.994, top1 = 71.68%], valid : [loss = 1.357, top1 = 62.09%], test : [loss = 1.355, top1 = 61.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.69%], valid : [loss = 2.701, top1 = 32.50%], test : [loss = 2.702, top1 = 32.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.69%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  167/15625) 000167-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.28%], valid : [loss = 0.601, top1 = 85.57%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10        train : [loss = 0.070, top1 = 97.86%], test  : [loss = 0.408, top1 = 88.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 0.697, top1 = 79.72%], valid : [loss = 1.374, top1 = 63.39%], test : [loss = 1.357, top1 = 63.89%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.29%], valid : [loss = 2.643, top1 = 33.62%], test : [loss = 2.674, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  168/15625) 000168-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.84 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.420, top1 = 91.24%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.269, top1 = 94.13%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.44 ms.
cifar100       train : [loss = 0.037, top1 = 99.60%], valid : [loss = 1.298, top1 = 71.80%], test : [loss = 1.271, top1 = 72.03%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 1.346, top1 = 63.12%], valid : [loss = 2.191, top1 = 45.40%], test : [loss = 2.208, top1 = 45.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.341, top1 = 88.43%], valid : [loss = 0.494, top1 = 83.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  169/15625) 000169-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.697, top1 = 84.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.051, top1 = 98.49%], test  : [loss = 0.443, top1 = 88.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.602, top1 = 82.37%], valid : [loss = 1.547, top1 = 61.51%], test : [loss = 1.515, top1 = 61.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.80%], valid : [loss = 2.809, top1 = 30.84%], test : [loss = 2.847, top1 = 30.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.72%], valid : [loss = 0.883, top1 = 68.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  170/15625) 000170-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.129, top1 = 96.02%], valid : [loss = 0.454, top1 = 86.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.157, top1 = 94.86%], test  : [loss = 0.345, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.61 ms.
cifar100       train : [loss = 1.005, top1 = 71.38%], valid : [loss = 1.348, top1 = 62.35%], test : [loss = 1.362, top1 = 61.39%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.73%], valid : [loss = 2.694, top1 = 32.77%], test : [loss = 2.718, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  171/15625) 000171-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.539, top1 = 89.19%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.08 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.343, top1 = 92.76%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.56 ms.
cifar100       train : [loss = 0.096, top1 = 98.26%], valid : [loss = 1.296, top1 = 69.60%], test : [loss = 1.315, top1 = 69.66%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.40%], valid : [loss = 2.304, top1 = 41.18%], test : [loss = 2.317, top1 = 41.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.55%], valid : [loss = 0.826, top1 = 70.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  172/15625) 000172-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.36 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  173/15625) 000173-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.202, top1 = 93.29%], valid : [loss = 0.485, top1 = 84.57%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.96 ms.
cifar10        train : [loss = 0.244, top1 = 91.84%], test  : [loss = 0.405, top1 = 86.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.75 ms.
cifar100       train : [loss = 1.411, top1 = 60.86%], valid : [loss = 1.662, top1 = 54.68%], test : [loss = 1.646, top1 = 55.13%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 3.407, top1 = 19.50%], valid : [loss = 3.409, top1 = 19.22%], test : [loss = 3.423, top1 = 19.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  174/15625) 000174-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.494, top1 = 88.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.319, top1 = 92.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 0.322, top1 = 91.40%], valid : [loss = 1.250, top1 = 68.04%], test : [loss = 1.270, top1 = 67.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.66%], valid : [loss = 2.321, top1 = 40.68%], test : [loss = 2.330, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  175/15625) 000175-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.130, top1 = 95.91%], valid : [loss = 0.608, top1 = 83.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.144, top1 = 95.35%], test  : [loss = 0.428, top1 = 87.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.30 ms.
cifar100       train : [loss = 0.791, top1 = 77.17%], valid : [loss = 1.473, top1 = 61.31%], test : [loss = 1.466, top1 = 61.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.837, top1 = 29.95%], valid : [loss = 2.885, top1 = 29.02%], test : [loss = 2.903, top1 = 29.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.89%], valid : [loss = 0.992, top1 = 65.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  176/15625) 000176-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.32%], valid : [loss = 0.587, top1 = 85.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 0.109, top1 = 96.44%], test  : [loss = 0.394, top1 = 88.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 0.819, top1 = 76.00%], valid : [loss = 1.406, top1 = 62.46%], test : [loss = 1.407, top1 = 62.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.03%], valid : [loss = 2.763, top1 = 31.17%], test : [loss = 2.810, top1 = 31.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  177/15625) 000177-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.82%], valid : [loss = 0.542, top1 = 84.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.73 ms.
cifar10        train : [loss = 0.200, top1 = 93.21%], test  : [loss = 0.398, top1 = 87.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.39 ms.
cifar100       train : [loss = 1.060, top1 = 69.51%], valid : [loss = 1.472, top1 = 59.92%], test : [loss = 1.473, top1 = 59.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.720, top1 = 32.17%], valid : [loss = 2.761, top1 = 31.46%], test : [loss = 2.801, top1 = 30.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 66.82%], valid : [loss = 0.964, top1 = 65.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  178/15625) 000178-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.547, top1 = 88.44%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.63 ms.
cifar10        train : [loss = 0.019, top1 = 99.51%], test  : [loss = 0.361, top1 = 91.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.95 ms.
cifar100       train : [loss = 0.283, top1 = 92.35%], valid : [loss = 1.279, top1 = 67.81%], test : [loss = 1.310, top1 = 67.23%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 2.014, top1 = 47.22%], valid : [loss = 2.292, top1 = 41.56%], test : [loss = 2.293, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.09%], valid : [loss = 0.800, top1 = 71.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  179/15625) 000179-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.549, top1 = 88.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.340, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.91 ms.
cifar100       train : [loss = 0.331, top1 = 91.05%], valid : [loss = 1.296, top1 = 66.51%], test : [loss = 1.314, top1 = 66.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.55%], valid : [loss = 2.431, top1 = 38.51%], test : [loss = 2.447, top1 = 38.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 73.96%], valid : [loss = 0.788, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  180/15625) 000180-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.491, top1 = 90.06%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.95 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.318, top1 = 93.24%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.52 ms.
cifar100       train : [loss = 0.115, top1 = 97.74%], valid : [loss = 1.319, top1 = 69.19%], test : [loss = 1.308, top1 = 69.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 1.716, top1 = 54.16%], valid : [loss = 2.198, top1 = 43.46%], test : [loss = 2.192, top1 = 43.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.70%], valid : [loss = 0.608, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  181/15625) 000181-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.096, top1 = 97.31%], valid : [loss = 0.468, top1 = 86.27%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.10 ms.
cifar10        train : [loss = 0.128, top1 = 95.97%], test  : [loss = 0.334, top1 = 89.29%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.48 ms.
cifar100       train : [loss = 0.809, top1 = 77.14%], valid : [loss = 1.292, top1 = 64.18%], test : [loss = 1.295, top1 = 63.81%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.76%], valid : [loss = 2.603, top1 = 34.86%], test : [loss = 2.596, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.08%], valid : [loss = 0.799, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  182/15625) 000182-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.61 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.56 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.15 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.49 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  183/15625) 000183-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.310, top1 = 89.28%], valid : [loss = 0.578, top1 = 81.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.266, top1 = 90.86%], test  : [loss = 0.435, top1 = 85.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.27 ms.
cifar100       train : [loss = 1.389, top1 = 60.98%], valid : [loss = 1.701, top1 = 54.51%], test : [loss = 1.694, top1 = 54.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.990, top1 = 27.12%], valid : [loss = 3.023, top1 = 26.80%], test : [loss = 3.088, top1 = 26.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.36%], valid : [loss = 1.210, top1 = 56.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  184/15625) 000184-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.559, top1 = 88.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.030, top1 = 99.08%], test  : [loss = 0.362, top1 = 91.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.67 ms.
cifar100       train : [loss = 0.389, top1 = 88.92%], valid : [loss = 1.390, top1 = 65.11%], test : [loss = 1.402, top1 = 65.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.722, top1 = 31.32%], valid : [loss = 2.792, top1 = 30.03%], test : [loss = 2.792, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.32%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  185/15625) 000185-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.54%], valid : [loss = 0.559, top1 = 87.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.033, top1 = 99.05%], test  : [loss = 0.379, top1 = 90.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.03 ms.
cifar100       train : [loss = 0.570, top1 = 83.62%], valid : [loss = 1.364, top1 = 63.97%], test : [loss = 1.363, top1 = 64.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 2.520, top1 = 35.85%], valid : [loss = 2.606, top1 = 33.67%], test : [loss = 2.632, top1 = 34.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.06%], valid : [loss = 0.902, top1 = 67.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  186/15625) 000186-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.53 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.08%], valid : [loss = 0.477, top1 = 84.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.62 ms.
cifar10        train : [loss = 0.304, top1 = 89.88%], test  : [loss = 0.403, top1 = 86.45%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.62 ms.
cifar100       train : [loss = 1.325, top1 = 63.28%], valid : [loss = 1.531, top1 = 58.19%], test : [loss = 1.504, top1 = 58.14%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.60%], valid : [loss = 2.899, top1 = 29.50%], test : [loss = 2.960, top1 = 27.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  187/15625) 000187-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.069, top1 = 97.83%], valid : [loss = 0.549, top1 = 86.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10        train : [loss = 0.109, top1 = 96.30%], test  : [loss = 0.392, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.86 ms.
cifar100       train : [loss = 0.813, top1 = 76.16%], valid : [loss = 1.398, top1 = 62.12%], test : [loss = 1.379, top1 = 62.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.67%], valid : [loss = 2.608, top1 = 34.46%], test : [loss = 2.631, top1 = 34.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.33%], valid : [loss = 0.909, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  188/15625) 000188-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.95%], valid : [loss = 0.502, top1 = 85.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.163, top1 = 94.55%], test  : [loss = 0.372, top1 = 88.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 1.034, top1 = 70.27%], valid : [loss = 1.437, top1 = 61.05%], test : [loss = 1.417, top1 = 61.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.61%], valid : [loss = 2.604, top1 = 35.23%], test : [loss = 2.636, top1 = 33.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.56%], valid : [loss = 0.966, top1 = 65.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  189/15625) 000189-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.453, top1 = 90.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.306, top1 = 93.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.076, top1 = 98.76%], valid : [loss = 1.377, top1 = 69.37%], test : [loss = 1.366, top1 = 69.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 1.569, top1 = 57.65%], valid : [loss = 2.244, top1 = 43.66%], test : [loss = 2.277, top1 = 43.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.69%], valid : [loss = 0.516, top1 = 82.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  190/15625) 000190-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.77%], valid : [loss = 0.609, top1 = 86.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.031, top1 = 99.14%], test  : [loss = 0.405, top1 = 90.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.02 ms.
cifar100       train : [loss = 0.499, top1 = 85.41%], valid : [loss = 1.376, top1 = 64.89%], test : [loss = 1.375, top1 = 64.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 39.14%], valid : [loss = 2.546, top1 = 35.93%], test : [loss = 2.575, top1 = 35.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.28%], valid : [loss = 0.843, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  191/15625) 000191-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.91 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.608, top1 = 87.21%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.411, top1 = 91.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.53 ms.
cifar100       train : [loss = 0.322, top1 = 90.99%], valid : [loss = 1.428, top1 = 65.65%], test : [loss = 1.434, top1 = 65.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.70%], valid : [loss = 2.466, top1 = 37.52%], test : [loss = 2.474, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.07%], valid : [loss = 0.841, top1 = 70.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  192/15625) 000192-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.578, top1 = 88.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.387, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.81 ms.
cifar100       train : [loss = 0.118, top1 = 97.69%], valid : [loss = 1.466, top1 = 67.21%], test : [loss = 1.464, top1 = 67.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.62%], valid : [loss = 2.448, top1 = 39.11%], test : [loss = 2.480, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.99%], valid : [loss = 0.786, top1 = 72.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  193/15625) 000193-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.59%], valid : [loss = 0.612, top1 = 84.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.087, top1 = 97.19%], test  : [loss = 0.416, top1 = 88.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.702, top1 = 79.38%], valid : [loss = 1.534, top1 = 60.39%], test : [loss = 1.546, top1 = 60.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 3.210, top1 = 21.88%], valid : [loss = 3.216, top1 = 21.52%], test : [loss = 3.251, top1 = 21.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.96%], valid : [loss = 1.085, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  194/15625) 000194-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.316, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.57 ms.
cifar100       train : [loss = 0.324, top1 = 91.28%], valid : [loss = 1.304, top1 = 67.33%], test : [loss = 1.306, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.15%], valid : [loss = 2.359, top1 = 39.57%], test : [loss = 2.374, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.445, top1 = 84.64%], valid : [loss = 0.544, top1 = 81.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  195/15625) 000195-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.582, top1 = 86.94%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.039, top1 = 98.80%], test  : [loss = 0.401, top1 = 89.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 0.549, top1 = 83.82%], valid : [loss = 1.393, top1 = 64.02%], test : [loss = 1.400, top1 = 63.99%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.89%], valid : [loss = 2.615, top1 = 34.43%], test : [loss = 2.672, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  196/15625) 000196-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.05%], valid : [loss = 0.476, top1 = 84.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.298, top1 = 90.01%], test  : [loss = 0.398, top1 = 86.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 1.332, top1 = 63.15%], valid : [loss = 1.549, top1 = 57.30%], test : [loss = 1.513, top1 = 58.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.89%], valid : [loss = 2.899, top1 = 29.72%], test : [loss = 2.938, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  197/15625) 000197-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.613, top1 = 87.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.401, top1 = 91.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.211, top1 = 95.05%], valid : [loss = 1.430, top1 = 66.61%], test : [loss = 1.430, top1 = 66.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.09%], valid : [loss = 2.506, top1 = 37.38%], test : [loss = 2.525, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  198/15625) 000198-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.563, top1 = 88.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.373, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.157, top1 = 96.59%], valid : [loss = 1.428, top1 = 67.32%], test : [loss = 1.430, top1 = 67.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.62%], valid : [loss = 2.424, top1 = 39.59%], test : [loss = 2.441, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 77.79%], valid : [loss = 0.716, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  199/15625) 000199-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.91 ms.
cifar10-valid  train : [loss = 0.488, top1 = 82.83%], valid : [loss = 0.651, top1 = 77.98%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10        train : [loss = 0.510, top1 = 82.25%], test  : [loss = 0.588, top1 = 80.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.56 ms.
cifar100       train : [loss = 1.698, top1 = 53.83%], valid : [loss = 1.855, top1 = 50.33%], test : [loss = 1.890, top1 = 49.73%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.43 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.41%], valid : [loss = 3.309, top1 = 21.39%], test : [loss = 3.335, top1 = 21.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  200/15625) 000200-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.87%], valid : [loss = 0.745, top1 = 82.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.093, top1 = 97.00%], test  : [loss = 0.482, top1 = 86.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.58 ms.
cifar100       train : [loss = 0.838, top1 = 75.64%], valid : [loss = 1.584, top1 = 59.14%], test : [loss = 1.561, top1 = 58.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 2.841, top1 = 29.88%], valid : [loss = 2.979, top1 = 27.68%], test : [loss = 3.027, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  201/15625) 000201-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.85%], valid : [loss = 0.478, top1 = 84.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.301, top1 = 89.88%], test  : [loss = 0.400, top1 = 86.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 1.334, top1 = 63.06%], valid : [loss = 1.541, top1 = 57.71%], test : [loss = 1.523, top1 = 58.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.76%], valid : [loss = 2.886, top1 = 29.31%], test : [loss = 2.956, top1 = 28.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  202/15625) 000202-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.536, top1 = 89.28%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.91 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.353, top1 = 92.78%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.08 ms.
cifar100       train : [loss = 0.080, top1 = 98.69%], valid : [loss = 1.476, top1 = 68.55%], test : [loss = 1.460, top1 = 68.61%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.38 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 53.03%], valid : [loss = 2.365, top1 = 41.26%], test : [loss = 2.399, top1 = 41.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.41%], valid : [loss = 0.723, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  203/15625) 000203-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.491, top1 = 90.24%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.35 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.305, top1 = 93.58%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.31 ms.
cifar100       train : [loss = 0.056, top1 = 99.29%], valid : [loss = 1.295, top1 = 70.37%], test : [loss = 1.287, top1 = 70.67%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.83 ms.
ImageNet16-120 train : [loss = 1.711, top1 = 54.27%], valid : [loss = 2.159, top1 = 44.63%], test : [loss = 2.155, top1 = 45.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.43%], valid : [loss = 0.664, top1 = 77.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  204/15625) 000204-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.473, top1 = 89.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.307, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.320, top1 = 91.46%], valid : [loss = 1.270, top1 = 67.35%], test : [loss = 1.269, top1 = 67.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.75%], valid : [loss = 2.330, top1 = 40.77%], test : [loss = 2.333, top1 = 41.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.52%], valid : [loss = 0.621, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  205/15625) 000205-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.464, top1 = 89.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.310, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.329, top1 = 91.02%], valid : [loss = 1.274, top1 = 67.69%], test : [loss = 1.312, top1 = 67.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.44%], valid : [loss = 2.352, top1 = 40.08%], test : [loss = 2.369, top1 = 39.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.462, top1 = 83.89%], valid : [loss = 0.557, top1 = 81.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  206/15625) 000206-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.318, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.18 ms.
cifar100       train : [loss = 0.327, top1 = 91.19%], valid : [loss = 1.312, top1 = 66.94%], test : [loss = 1.302, top1 = 67.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.81 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.38%], valid : [loss = 2.374, top1 = 39.93%], test : [loss = 2.398, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  207/15625) 000207-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.616, top1 = 87.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.407, top1 = 91.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.54 ms.
cifar100       train : [loss = 0.128, top1 = 97.15%], valid : [loss = 1.593, top1 = 66.14%], test : [loss = 1.581, top1 = 66.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.26%], valid : [loss = 2.457, top1 = 37.90%], test : [loss = 2.466, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.75%], valid : [loss = 0.798, top1 = 72.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  208/15625) 000208-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.53%], valid : [loss = 0.735, top1 = 74.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 0.559, top1 = 80.72%], test  : [loss = 0.611, top1 = 79.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.44 ms.
cifar100       train : [loss = 2.096, top1 = 44.01%], valid : [loss = 2.223, top1 = 41.48%], test : [loss = 2.209, top1 = 41.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 3.289, top1 = 21.42%], valid : [loss = 3.267, top1 = 22.14%], test : [loss = 3.311, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.277, top1 = 54.36%], valid : [loss = 1.339, top1 = 52.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  209/15625) 000209-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.594, top1 = 87.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.406, top1 = 91.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.203, top1 = 95.29%], valid : [loss = 1.466, top1 = 66.21%], test : [loss = 1.422, top1 = 66.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.43%], valid : [loss = 2.474, top1 = 37.82%], test : [loss = 2.511, top1 = 38.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.58%], valid : [loss = 0.693, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  210/15625) 000210-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.55%], valid : [loss = 0.853, top1 = 72.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10        train : [loss = 0.555, top1 = 80.55%], test  : [loss = 0.718, top1 = 75.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 1.781, top1 = 52.02%], valid : [loss = 2.060, top1 = 46.81%], test : [loss = 2.072, top1 = 46.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.85%], valid : [loss = 3.634, top1 = 16.69%], test : [loss = 3.661, top1 = 16.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  211/15625) 000211-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.527, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.53 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.355, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.24 ms.
cifar100       train : [loss = 0.051, top1 = 99.48%], valid : [loss = 1.449, top1 = 69.02%], test : [loss = 1.429, top1 = 69.57%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.626, top1 = 56.34%], valid : [loss = 2.392, top1 = 41.51%], test : [loss = 2.413, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.73%], valid : [loss = 0.628, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  212/15625) 000212-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.501, top1 = 89.88%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.13 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.321, top1 = 93.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.35 ms.
cifar100       train : [loss = 0.109, top1 = 97.85%], valid : [loss = 1.305, top1 = 69.41%], test : [loss = 1.296, top1 = 69.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.56 ms.
ImageNet16-120 train : [loss = 1.708, top1 = 54.30%], valid : [loss = 2.184, top1 = 44.00%], test : [loss = 2.197, top1 = 44.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.70%], valid : [loss = 0.608, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  213/15625) 000213-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.538, top1 = 88.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.344, top1 = 91.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 0.297, top1 = 91.91%], valid : [loss = 1.297, top1 = 67.29%], test : [loss = 1.312, top1 = 67.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.90%], valid : [loss = 2.420, top1 = 38.60%], test : [loss = 2.439, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  214/15625) 000214-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.429, top1 = 90.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.285, top1 = 93.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.04 ms.
cifar100       train : [loss = 0.117, top1 = 97.81%], valid : [loss = 1.334, top1 = 69.41%], test : [loss = 1.339, top1 = 69.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 1.700, top1 = 54.53%], valid : [loss = 2.247, top1 = 43.07%], test : [loss = 2.278, top1 = 42.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.14%], valid : [loss = 0.552, top1 = 81.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  215/15625) 000215-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.95%], valid : [loss = 0.863, top1 = 71.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.71 ms.
cifar10        train : [loss = 0.566, top1 = 80.16%], test  : [loss = 0.727, top1 = 75.52%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.73 ms.
cifar100       train : [loss = 1.788, top1 = 51.93%], valid : [loss = 2.057, top1 = 47.11%], test : [loss = 2.076, top1 = 46.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.10 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.79%], valid : [loss = 3.634, top1 = 16.46%], test : [loss = 3.666, top1 = 15.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  216/15625) 000216-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.182, top1 = 93.89%], valid : [loss = 0.939, top1 = 75.62%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 0.233, top1 = 91.93%], test  : [loss = 0.621, top1 = 81.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 1.155, top1 = 66.89%], valid : [loss = 1.833, top1 = 52.96%], test : [loss = 1.815, top1 = 53.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 3.258, top1 = 22.20%], valid : [loss = 3.368, top1 = 20.79%], test : [loss = 3.420, top1 = 19.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.085, top1 = 61.35%], valid : [loss = 1.129, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  217/15625) 000217-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.576, top1 = 87.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.21 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.381, top1 = 91.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.353, top1 = 90.07%], valid : [loss = 1.411, top1 = 65.58%], test : [loss = 1.386, top1 = 66.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.40%], valid : [loss = 2.471, top1 = 37.92%], test : [loss = 2.499, top1 = 37.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.53%], valid : [loss = 0.861, top1 = 69.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  218/15625) 000218-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.511, top1 = 88.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.018, top1 = 99.58%], test  : [loss = 0.361, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.385, top1 = 88.94%], valid : [loss = 1.348, top1 = 66.17%], test : [loss = 1.323, top1 = 66.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.58%], valid : [loss = 2.434, top1 = 38.26%], test : [loss = 2.462, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.59%], valid : [loss = 0.640, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  219/15625) 000219-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.426, top1 = 90.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.286, top1 = 93.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.187, top1 = 95.58%], valid : [loss = 1.268, top1 = 69.55%], test : [loss = 1.286, top1 = 69.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.50%], valid : [loss = 2.249, top1 = 42.76%], test : [loss = 2.294, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  220/15625) 000220-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.220, top1 = 92.61%], valid : [loss = 0.555, top1 = 83.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.202, top1 = 93.07%], test  : [loss = 0.396, top1 = 87.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.30 ms.
cifar100       train : [loss = 1.257, top1 = 64.34%], valid : [loss = 1.558, top1 = 57.49%], test : [loss = 1.547, top1 = 57.53%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.06%], valid : [loss = 2.713, top1 = 32.36%], test : [loss = 2.751, top1 = 32.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.55%], valid : [loss = 1.031, top1 = 63.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  221/15625) 000221-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.576, top1 = 87.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.390, top1 = 91.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 0.390, top1 = 89.00%], valid : [loss = 1.399, top1 = 65.28%], test : [loss = 1.392, top1 = 65.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.92%], valid : [loss = 2.498, top1 = 37.71%], test : [loss = 2.540, top1 = 36.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  222/15625) 000222-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.24%], valid : [loss = 0.454, top1 = 86.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.159, top1 = 94.84%], test  : [loss = 0.342, top1 = 88.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 1.007, top1 = 71.52%], valid : [loss = 1.370, top1 = 62.13%], test : [loss = 1.370, top1 = 61.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.50%], valid : [loss = 2.701, top1 = 32.63%], test : [loss = 2.732, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.36%], valid : [loss = 0.780, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  223/15625) 000223-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.52 ms.
cifar10-valid  train : [loss = 0.794, top1 = 72.08%], valid : [loss = 1.117, top1 = 62.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.10 ms.
cifar10        train : [loss = 0.780, top1 = 72.58%], test  : [loss = 0.918, top1 = 68.78%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.59 ms.
cifar100       train : [loss = 2.135, top1 = 44.08%], valid : [loss = 2.406, top1 = 39.73%], test : [loss = 2.413, top1 = 39.18%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.95 ms.
ImageNet16-120 train : [loss = 3.763, top1 = 13.88%], valid : [loss = 3.823, top1 = 13.83%], test : [loss = 3.834, top1 = 13.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  224/15625) 000224-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.490, top1 = 89.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.20 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.324, top1 = 92.99%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.56 ms.
cifar100       train : [loss = 0.121, top1 = 97.65%], valid : [loss = 1.281, top1 = 69.57%], test : [loss = 1.304, top1 = 69.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.35%], valid : [loss = 2.285, top1 = 42.08%], test : [loss = 2.273, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.46%], valid : [loss = 0.638, top1 = 78.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  225/15625) 000225-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.48 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  226/15625) 000226-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.293, top1 = 90.15%], valid : [loss = 0.469, top1 = 84.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.278, top1 = 90.59%], test  : [loss = 0.378, top1 = 87.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.54 ms.
cifar100       train : [loss = 1.285, top1 = 63.91%], valid : [loss = 1.488, top1 = 58.51%], test : [loss = 1.459, top1 = 58.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.40%], valid : [loss = 2.820, top1 = 30.89%], test : [loss = 2.854, top1 = 29.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.82%], valid : [loss = 1.031, top1 = 63.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  227/15625) 000227-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.537, top1 = 89.25%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.48 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.346, top1 = 92.79%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.33 ms.
cifar100       train : [loss = 0.080, top1 = 98.50%], valid : [loss = 1.396, top1 = 69.15%], test : [loss = 1.402, top1 = 68.97%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.44%], valid : [loss = 2.365, top1 = 39.89%], test : [loss = 2.374, top1 = 40.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.50%], valid : [loss = 0.836, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  228/15625) 000228-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.475, top1 = 89.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.327, top1 = 92.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.198, top1 = 94.92%], valid : [loss = 1.349, top1 = 68.26%], test : [loss = 1.341, top1 = 68.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.31%], valid : [loss = 2.315, top1 = 41.03%], test : [loss = 2.328, top1 = 41.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.68%], valid : [loss = 0.540, top1 = 81.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  229/15625) 000229-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.93%], valid : [loss = 0.746, top1 = 83.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.087, top1 = 97.19%], test  : [loss = 0.486, top1 = 86.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.31 ms.
cifar100       train : [loss = 0.842, top1 = 75.43%], valid : [loss = 1.591, top1 = 58.68%], test : [loss = 1.564, top1 = 59.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.830, top1 = 30.04%], valid : [loss = 2.960, top1 = 28.24%], test : [loss = 3.012, top1 = 27.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  230/15625) 000230-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.89 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.71%], valid : [loss = 0.466, top1 = 86.46%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.51 ms.
cifar10        train : [loss = 0.121, top1 = 96.23%], test  : [loss = 0.337, top1 = 89.42%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.11 ms.
cifar100       train : [loss = 0.752, top1 = 78.97%], valid : [loss = 1.277, top1 = 64.65%], test : [loss = 1.265, top1 = 64.53%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.67 ms.
ImageNet16-120 train : [loss = 2.507, top1 = 36.54%], valid : [loss = 2.600, top1 = 35.13%], test : [loss = 2.610, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.86%], valid : [loss = 0.848, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  231/15625) 000231-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.296, top1 = 89.68%], valid : [loss = 0.575, top1 = 81.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.249, top1 = 91.32%], test  : [loss = 0.408, top1 = 86.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 1.390, top1 = 60.95%], valid : [loss = 1.656, top1 = 54.69%], test : [loss = 1.632, top1 = 55.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.850, top1 = 29.62%], valid : [loss = 2.878, top1 = 29.68%], test : [loss = 2.907, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.62%], valid : [loss = 1.014, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  232/15625) 000232-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.25 ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.29%], valid : [loss = 0.977, top1 = 66.49%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.89 ms.
cifar10        train : [loss = 0.775, top1 = 72.74%], test  : [loss = 0.859, top1 = 69.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.76 ms.
cifar100       train : [loss = 2.265, top1 = 41.30%], valid : [loss = 2.406, top1 = 39.21%], test : [loss = 2.433, top1 = 38.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.87 ms.
ImageNet16-120 train : [loss = 3.744, top1 = 14.30%], valid : [loss = 3.767, top1 = 14.69%], test : [loss = 3.775, top1 = 13.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 47.09%], valid : [loss = 1.475, top1 = 45.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  233/15625) 000233-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.61 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.66 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  234/15625) 000234-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.04%], valid : [loss = 0.577, top1 = 86.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10        train : [loss = 0.068, top1 = 97.77%], test  : [loss = 0.380, top1 = 89.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.30 ms.
cifar100       train : [loss = 0.696, top1 = 79.52%], valid : [loss = 1.329, top1 = 64.50%], test : [loss = 1.330, top1 = 64.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.69%], valid : [loss = 2.482, top1 = 37.19%], test : [loss = 2.502, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.02%], valid : [loss = 0.763, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  235/15625) 000235-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.490, top1 = 89.98%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.327, top1 = 93.00%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.84 ms.
cifar100       train : [loss = 0.121, top1 = 97.61%], valid : [loss = 1.312, top1 = 68.79%], test : [loss = 1.319, top1 = 69.37%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.30 ms.
ImageNet16-120 train : [loss = 1.694, top1 = 54.68%], valid : [loss = 2.188, top1 = 43.79%], test : [loss = 2.190, top1 = 44.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.70%], valid : [loss = 0.608, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  236/15625) 000236-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.19%], valid : [loss = 0.460, top1 = 86.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.162, top1 = 94.67%], test  : [loss = 0.351, top1 = 88.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 1.024, top1 = 70.94%], valid : [loss = 1.362, top1 = 61.76%], test : [loss = 1.356, top1 = 61.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.60%], valid : [loss = 2.689, top1 = 33.02%], test : [loss = 2.714, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  237/15625) 000237-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.532, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.345, top1 = 92.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.01 ms.
cifar100       train : [loss = 0.152, top1 = 96.50%], valid : [loss = 1.350, top1 = 68.02%], test : [loss = 1.316, top1 = 68.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.006, top1 = 47.36%], valid : [loss = 2.354, top1 = 39.97%], test : [loss = 2.334, top1 = 40.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.39%], valid : [loss = 0.819, top1 = 71.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  238/15625) 000238-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.578, top1 = 88.49%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.370, top1 = 92.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.11 ms.
cifar100       train : [loss = 0.098, top1 = 98.24%], valid : [loss = 1.455, top1 = 68.44%], test : [loss = 1.431, top1 = 68.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.74%], valid : [loss = 2.421, top1 = 40.27%], test : [loss = 2.436, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.13%], valid : [loss = 0.788, top1 = 72.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  239/15625) 000239-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.79 ms.
cifar10-valid  train : [loss = 1.837, top1 = 33.56%], valid : [loss = 1.855, top1 = 33.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.54 ms.
cifar10        train : [loss = 1.298, top1 = 53.22%], test  : [loss = 1.300, top1 = 52.80%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.58 ms.
cifar100       train : [loss = 3.802, top1 = 11.84%], valid : [loss = 3.906, top1 = 10.35%], test : [loss = 3.899, top1 = 10.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.41 ms.
ImageNet16-120 train : [loss = 3.936, top1 = 11.29%], valid : [loss = 3.918, top1 = 11.79%], test : [loss = 3.920, top1 = 11.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.53%], valid : [loss = 1.967, top1 = 27.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  240/15625) 000240-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.72%], valid : [loss = 0.654, top1 = 77.96%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10        train : [loss = 0.520, top1 = 81.94%], test  : [loss = 0.594, top1 = 79.79%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.10 ms.
cifar100       train : [loss = 1.696, top1 = 53.99%], valid : [loss = 1.855, top1 = 50.47%], test : [loss = 1.873, top1 = 50.55%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.67 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.27%], valid : [loss = 3.313, top1 = 21.61%], test : [loss = 3.350, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  241/15625) 000241-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.543, top1 = 88.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.00 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.339, top1 = 92.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.14 ms.
cifar100       train : [loss = 0.318, top1 = 91.32%], valid : [loss = 1.302, top1 = 67.19%], test : [loss = 1.309, top1 = 67.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.52 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.22%], valid : [loss = 2.434, top1 = 39.07%], test : [loss = 2.436, top1 = 38.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.19%], valid : [loss = 0.765, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  242/15625) 000242-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.561, top1 = 89.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.87 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.348, top1 = 92.80%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.84 ms.
cifar100       train : [loss = 0.126, top1 = 97.35%], valid : [loss = 1.365, top1 = 68.73%], test : [loss = 1.334, top1 = 69.25%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.96 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.83%], valid : [loss = 2.325, top1 = 41.11%], test : [loss = 2.332, top1 = 41.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.28%], valid : [loss = 0.835, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  243/15625) 000243-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.09%], valid : [loss = 0.471, top1 = 84.62%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10        train : [loss = 0.299, top1 = 90.01%], test  : [loss = 0.403, top1 = 86.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.90 ms.
cifar100       train : [loss = 1.325, top1 = 63.20%], valid : [loss = 1.552, top1 = 57.45%], test : [loss = 1.518, top1 = 58.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.12 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.73%], valid : [loss = 2.900, top1 = 29.54%], test : [loss = 2.942, top1 = 28.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  244/15625) 000244-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.429, top1 = 90.92%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.34 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.293, top1 = 93.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.40 ms.
cifar100       train : [loss = 0.055, top1 = 99.18%], valid : [loss = 1.338, top1 = 70.65%], test : [loss = 1.346, top1 = 70.93%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 1.481, top1 = 59.75%], valid : [loss = 2.190, top1 = 45.01%], test : [loss = 2.220, top1 = 44.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.365, top1 = 87.44%], valid : [loss = 0.501, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  245/15625) 000245-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.312, top1 = 89.23%], valid : [loss = 0.566, top1 = 82.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.276, top1 = 90.54%], test  : [loss = 0.423, top1 = 86.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 1.405, top1 = 60.44%], valid : [loss = 1.666, top1 = 54.81%], test : [loss = 1.648, top1 = 55.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.950, top1 = 27.81%], valid : [loss = 2.945, top1 = 28.44%], test : [loss = 3.001, top1 = 26.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.88%], valid : [loss = 1.026, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  246/15625) 000246-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.552, top1 = 88.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.68 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.369, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.96 ms.
cifar100       train : [loss = 0.164, top1 = 96.50%], valid : [loss = 1.404, top1 = 67.65%], test : [loss = 1.408, top1 = 67.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.68%], valid : [loss = 2.425, top1 = 39.56%], test : [loss = 2.442, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 78.87%], valid : [loss = 0.689, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  247/15625) 000247-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.398, top1 = 85.95%], valid : [loss = 0.622, top1 = 79.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.329, top1 = 88.70%], test  : [loss = 0.467, top1 = 84.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.04 ms.
cifar100       train : [loss = 1.651, top1 = 54.50%], valid : [loss = 1.872, top1 = 49.73%], test : [loss = 1.885, top1 = 49.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 22.83%], valid : [loss = 3.197, top1 = 23.08%], test : [loss = 3.253, top1 = 22.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.069, top1 = 61.31%], valid : [loss = 1.107, top1 = 60.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  248/15625) 000248-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.433, top1 = 90.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.286, top1 = 93.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.25 ms.
cifar100       train : [loss = 0.183, top1 = 95.70%], valid : [loss = 1.290, top1 = 69.23%], test : [loss = 1.270, top1 = 69.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.69%], valid : [loss = 2.258, top1 = 42.53%], test : [loss = 2.297, top1 = 42.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.33%], valid : [loss = 0.505, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  249/15625) 000249-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.489, top1 = 89.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.311, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.44 ms.
cifar100       train : [loss = 0.287, top1 = 92.55%], valid : [loss = 1.229, top1 = 68.11%], test : [loss = 1.221, top1 = 68.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.04%], valid : [loss = 2.221, top1 = 42.27%], test : [loss = 2.225, top1 = 43.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  250/15625) 000250-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.92%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.065, top1 = 99.03%], valid : [loss = 1.331, top1 = 70.57%], test : [loss = 1.356, top1 = 69.97%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 1.553, top1 = 58.11%], valid : [loss = 2.239, top1 = 43.44%], test : [loss = 2.279, top1 = 43.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  251/15625) 000251-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.45 ms.
cifar10-valid  train : [loss = 0.232, top1 = 92.13%], valid : [loss = 0.561, top1 = 82.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.67 ms.
cifar10        train : [loss = 0.234, top1 = 92.04%], test  : [loss = 0.418, top1 = 86.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 1.259, top1 = 64.30%], valid : [loss = 1.595, top1 = 56.74%], test : [loss = 1.594, top1 = 57.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.962, top1 = 27.80%], valid : [loss = 2.990, top1 = 27.40%], test : [loss = 3.038, top1 = 26.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.43%], valid : [loss = 1.187, top1 = 57.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  252/15625) 000252-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.313, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.92 ms.
cifar100       train : [loss = 0.130, top1 = 97.39%], valid : [loss = 1.281, top1 = 69.55%], test : [loss = 1.306, top1 = 69.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.77%], valid : [loss = 2.264, top1 = 43.14%], test : [loss = 2.267, top1 = 42.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.10%], valid : [loss = 0.671, top1 = 76.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  253/15625) 000253-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.29%], valid : [loss = 0.472, top1 = 86.20%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.50 ms.
cifar10        train : [loss = 0.124, top1 = 96.11%], test  : [loss = 0.338, top1 = 89.25%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.45 ms.
cifar100       train : [loss = 0.765, top1 = 78.63%], valid : [loss = 1.273, top1 = 64.65%], test : [loss = 1.278, top1 = 64.69%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.506, top1 = 36.62%], valid : [loss = 2.596, top1 = 35.08%], test : [loss = 2.614, top1 = 34.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  254/15625) 000254-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.19%], valid : [loss = 0.563, top1 = 86.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10        train : [loss = 0.063, top1 = 98.01%], test  : [loss = 0.369, top1 = 89.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.05 ms.
cifar100       train : [loss = 0.657, top1 = 80.64%], valid : [loss = 1.306, top1 = 65.06%], test : [loss = 1.309, top1 = 64.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.10%], valid : [loss = 2.511, top1 = 36.66%], test : [loss = 2.548, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  255/15625) 000255-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.072, top1 = 97.96%], valid : [loss = 0.571, top1 = 85.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.114, top1 = 96.24%], test  : [loss = 0.376, top1 = 88.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.799, top1 = 76.84%], valid : [loss = 1.397, top1 = 62.53%], test : [loss = 1.392, top1 = 62.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.70%], valid : [loss = 2.625, top1 = 33.86%], test : [loss = 2.664, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.76%], valid : [loss = 0.897, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  256/15625) 000256-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.439, top1 = 90.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.296, top1 = 92.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.82 ms.
cifar100       train : [loss = 0.179, top1 = 95.81%], valid : [loss = 1.304, top1 = 69.03%], test : [loss = 1.307, top1 = 68.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.03%], valid : [loss = 2.240, top1 = 43.27%], test : [loss = 2.258, top1 = 43.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.77%], valid : [loss = 0.521, top1 = 82.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  257/15625) 000257-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.29%], valid : [loss = 0.720, top1 = 83.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.055, top1 = 98.30%], test  : [loss = 0.439, top1 = 88.59%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.66 ms.
cifar100       train : [loss = 0.635, top1 = 81.40%], valid : [loss = 1.521, top1 = 61.38%], test : [loss = 1.511, top1 = 61.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 33.08%], valid : [loss = 2.828, top1 = 30.20%], test : [loss = 2.868, top1 = 30.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.94%], valid : [loss = 0.890, top1 = 68.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  258/15625) 000258-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.421, top1 = 91.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.32 ms.
cifar100       train : [loss = 0.066, top1 = 99.03%], valid : [loss = 1.332, top1 = 70.18%], test : [loss = 1.345, top1 = 69.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 1.542, top1 = 58.34%], valid : [loss = 2.241, top1 = 43.84%], test : [loss = 2.249, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  259/15625) 000259-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.23%], valid : [loss = 0.605, top1 = 85.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.071, top1 = 97.80%], test  : [loss = 0.398, top1 = 88.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.706, top1 = 79.58%], valid : [loss = 1.378, top1 = 63.51%], test : [loss = 1.355, top1 = 63.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.90%], valid : [loss = 2.669, top1 = 33.61%], test : [loss = 2.679, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  260/15625) 000260-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.292, top1 = 89.97%], valid : [loss = 0.555, top1 = 82.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.278, top1 = 90.36%], test  : [loss = 0.429, top1 = 85.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.424, top1 = 60.10%], valid : [loss = 1.694, top1 = 54.61%], test : [loss = 1.656, top1 = 54.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 3.020, top1 = 26.61%], valid : [loss = 3.037, top1 = 27.12%], test : [loss = 3.104, top1 = 25.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.92%], valid : [loss = 1.134, top1 = 59.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  261/15625) 000261-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.530, top1 = 89.26%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.23 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.330, top1 = 92.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.69 ms.
cifar100       train : [loss = 0.056, top1 = 99.14%], valid : [loss = 1.382, top1 = 69.85%], test : [loss = 1.403, top1 = 69.69%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.750, top1 = 53.32%], valid : [loss = 2.272, top1 = 42.52%], test : [loss = 2.272, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.02%], valid : [loss = 0.752, top1 = 73.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  262/15625) 000262-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.29%], valid : [loss = 0.907, top1 = 77.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10        train : [loss = 0.169, top1 = 94.24%], test  : [loss = 0.584, top1 = 83.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 0.976, top1 = 71.84%], valid : [loss = 1.755, top1 = 54.83%], test : [loss = 1.745, top1 = 55.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 3.113, top1 = 25.01%], valid : [loss = 3.241, top1 = 22.82%], test : [loss = 3.293, top1 = 22.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.54%], valid : [loss = 1.166, top1 = 58.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  263/15625) 000263-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.516, top1 = 88.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.335, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.46 ms.
cifar100       train : [loss = 0.346, top1 = 90.57%], valid : [loss = 1.288, top1 = 67.13%], test : [loss = 1.281, top1 = 67.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.59%], valid : [loss = 2.409, top1 = 39.01%], test : [loss = 2.413, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  264/15625) 000264-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.561, top1 = 87.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.364, top1 = 91.57%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.56 ms.
cifar100       train : [loss = 0.182, top1 = 95.42%], valid : [loss = 1.416, top1 = 67.17%], test : [loss = 1.412, top1 = 67.23%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.03%], valid : [loss = 2.381, top1 = 39.44%], test : [loss = 2.395, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.48%], valid : [loss = 0.898, top1 = 68.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  265/15625) 000265-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 91.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.69 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.288, top1 = 93.88%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.59 ms.
cifar100       train : [loss = 0.033, top1 = 99.68%], valid : [loss = 1.332, top1 = 72.11%], test : [loss = 1.293, top1 = 71.87%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 1.311, top1 = 64.04%], valid : [loss = 2.219, top1 = 45.33%], test : [loss = 2.216, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.344, top1 = 88.10%], valid : [loss = 0.497, top1 = 83.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  266/15625) 000266-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.181, top1 = 93.85%], valid : [loss = 0.719, top1 = 80.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.177, top1 = 93.95%], test  : [loss = 0.503, top1 = 85.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.772, top1 = 77.37%], valid : [loss = 1.626, top1 = 58.54%], test : [loss = 1.662, top1 = 58.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 3.475, top1 = 17.32%], valid : [loss = 3.479, top1 = 17.64%], test : [loss = 3.473, top1 = 17.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.374, top1 = 49.03%], valid : [loss = 1.379, top1 = 48.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  267/15625) 000267-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.566, top1 = 87.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.019, top1 = 99.48%], test  : [loss = 0.377, top1 = 91.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.299, top1 = 91.95%], valid : [loss = 1.298, top1 = 67.51%], test : [loss = 1.309, top1 = 67.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.41%], valid : [loss = 2.398, top1 = 39.33%], test : [loss = 2.417, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.50%], valid : [loss = 0.873, top1 = 69.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  268/15625) 000268-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.538, top1 = 88.81%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.85 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.340, top1 = 92.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.50 ms.
cifar100       train : [loss = 0.138, top1 = 96.89%], valid : [loss = 1.349, top1 = 68.46%], test : [loss = 1.348, top1 = 69.07%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.89%], valid : [loss = 2.366, top1 = 39.80%], test : [loss = 2.371, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.65%], valid : [loss = 0.864, top1 = 69.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  269/15625) 000269-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.520, top1 = 88.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.333, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.60 ms.
cifar100       train : [loss = 0.343, top1 = 90.59%], valid : [loss = 1.281, top1 = 66.78%], test : [loss = 1.303, top1 = 67.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.73%], valid : [loss = 2.413, top1 = 38.68%], test : [loss = 2.413, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.08%], valid : [loss = 0.659, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  270/15625) 000270-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.42%], valid : [loss = 0.674, top1 = 85.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10        train : [loss = 0.053, top1 = 98.41%], test  : [loss = 0.459, top1 = 88.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.35 ms.
cifar100       train : [loss = 0.637, top1 = 81.33%], valid : [loss = 1.533, top1 = 61.11%], test : [loss = 1.511, top1 = 61.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.25%], valid : [loss = 2.810, top1 = 30.70%], test : [loss = 2.871, top1 = 30.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.68%], valid : [loss = 0.892, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  271/15625) 000271-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.309, top1 = 89.30%], valid : [loss = 0.555, top1 = 82.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.290, top1 = 90.06%], test  : [loss = 0.440, top1 = 85.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.68 ms.
cifar100       train : [loss = 1.460, top1 = 59.09%], valid : [loss = 1.698, top1 = 53.62%], test : [loss = 1.695, top1 = 54.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 2.994, top1 = 26.98%], valid : [loss = 3.000, top1 = 27.10%], test : [loss = 3.055, top1 = 26.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.10%], valid : [loss = 0.992, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  272/15625) 000272-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.580, top1 = 87.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.383, top1 = 91.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 0.397, top1 = 88.70%], valid : [loss = 1.383, top1 = 66.07%], test : [loss = 1.388, top1 = 65.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 2.314, top1 = 40.67%], valid : [loss = 2.516, top1 = 36.79%], test : [loss = 2.543, top1 = 36.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  273/15625) 000273-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.559, top1 = 88.33%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.353, top1 = 92.01%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.15 ms.
cifar100       train : [loss = 0.251, top1 = 93.30%], valid : [loss = 1.328, top1 = 67.18%], test : [loss = 1.319, top1 = 67.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.62%], valid : [loss = 2.443, top1 = 37.73%], test : [loss = 2.435, top1 = 38.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.938, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  274/15625) 000274-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.62 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.46%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.58 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.20%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.95 ms.
cifar100       train : [loss = 0.069, top1 = 98.93%], valid : [loss = 1.335, top1 = 69.97%], test : [loss = 1.349, top1 = 70.00%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.99 ms.
ImageNet16-120 train : [loss = 1.641, top1 = 55.97%], valid : [loss = 2.203, top1 = 44.06%], test : [loss = 2.232, top1 = 43.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.94%], valid : [loss = 0.589, top1 = 80.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  275/15625) 000275-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.83%], valid : [loss = 0.478, top1 = 84.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10        train : [loss = 0.301, top1 = 89.94%], test  : [loss = 0.399, top1 = 86.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.12 ms.
cifar100       train : [loss = 1.320, top1 = 63.44%], valid : [loss = 1.530, top1 = 58.35%], test : [loss = 1.508, top1 = 58.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.66%], valid : [loss = 2.903, top1 = 29.13%], test : [loss = 2.957, top1 = 27.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  276/15625) 000276-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.264, top1 = 90.90%], valid : [loss = 0.678, top1 = 79.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.55 ms.
cifar10        train : [loss = 0.266, top1 = 90.80%], test  : [loss = 0.511, top1 = 83.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 1.053, top1 = 69.65%], valid : [loss = 1.753, top1 = 54.23%], test : [loss = 1.758, top1 = 54.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 3.826, top1 = 11.69%], valid : [loss = 3.821, top1 = 12.39%], test : [loss = 3.812, top1 = 11.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.454, top1 = 46.26%], valid : [loss = 1.467, top1 = 45.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  277/15625) 000277-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.512, top1 = 89.48%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.24 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.327, top1 = 92.63%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.15 ms.
cifar100       train : [loss = 0.141, top1 = 97.11%], valid : [loss = 1.293, top1 = 69.41%], test : [loss = 1.299, top1 = 69.33%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.61%], valid : [loss = 2.306, top1 = 40.79%], test : [loss = 2.305, top1 = 42.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.08%], valid : [loss = 0.690, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  278/15625) 000278-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.96%], valid : [loss = 0.473, top1 = 84.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.297, top1 = 90.12%], test  : [loss = 0.399, top1 = 86.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.82 ms.
cifar100       train : [loss = 1.338, top1 = 62.92%], valid : [loss = 1.545, top1 = 57.50%], test : [loss = 1.521, top1 = 57.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.64%], valid : [loss = 2.900, top1 = 29.31%], test : [loss = 2.961, top1 = 27.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  279/15625) 000279-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.581, top1 = 87.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.37 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.390, top1 = 91.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 0.397, top1 = 88.73%], valid : [loss = 1.409, top1 = 65.43%], test : [loss = 1.387, top1 = 65.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.85%], valid : [loss = 2.479, top1 = 37.51%], test : [loss = 2.507, top1 = 36.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 73.75%], valid : [loss = 0.808, top1 = 71.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  280/15625) 000280-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.676, top1 = 77.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10        train : [loss = 0.512, top1 = 82.22%], test  : [loss = 0.589, top1 = 79.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.19 ms.
cifar100       train : [loss = 1.728, top1 = 53.22%], valid : [loss = 1.900, top1 = 49.46%], test : [loss = 1.893, top1 = 49.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.20 ms.
ImageNet16-120 train : [loss = 3.342, top1 = 21.04%], valid : [loss = 3.338, top1 = 20.99%], test : [loss = 3.361, top1 = 21.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  281/15625) 000281-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.491, top1 = 89.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.44 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.305, top1 = 92.46%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.12 ms.
cifar100       train : [loss = 0.237, top1 = 94.06%], valid : [loss = 1.256, top1 = 68.30%], test : [loss = 1.259, top1 = 68.55%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.70 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 48.88%], valid : [loss = 2.268, top1 = 41.49%], test : [loss = 2.299, top1 = 41.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.74%], valid : [loss = 0.675, top1 = 76.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  282/15625) 000282-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.630, top1 = 87.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.54 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.415, top1 = 91.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.44 ms.
cifar100       train : [loss = 0.140, top1 = 96.94%], valid : [loss = 1.576, top1 = 65.61%], test : [loss = 1.548, top1 = 66.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.11%], valid : [loss = 2.460, top1 = 38.22%], test : [loss = 2.499, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.91%], valid : [loss = 0.804, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  283/15625) 000283-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.461, top1 = 89.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.313, top1 = 92.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.81 ms.
cifar100       train : [loss = 0.201, top1 = 95.14%], valid : [loss = 1.301, top1 = 68.70%], test : [loss = 1.309, top1 = 68.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.42%], valid : [loss = 2.277, top1 = 42.27%], test : [loss = 2.297, top1 = 43.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.94%], valid : [loss = 0.544, top1 = 81.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  284/15625) 000284-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.26%], valid : [loss = 0.462, top1 = 86.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10        train : [loss = 0.161, top1 = 94.69%], test  : [loss = 0.347, top1 = 88.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.15 ms.
cifar100       train : [loss = 0.999, top1 = 71.49%], valid : [loss = 1.368, top1 = 61.68%], test : [loss = 1.349, top1 = 62.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 33.98%], valid : [loss = 2.676, top1 = 33.40%], test : [loss = 2.697, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  285/15625) 000285-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.466, top1 = 89.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.297, top1 = 92.82%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.19 ms.
cifar100       train : [loss = 0.256, top1 = 93.32%], valid : [loss = 1.221, top1 = 68.89%], test : [loss = 1.232, top1 = 69.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.72%], valid : [loss = 2.223, top1 = 42.18%], test : [loss = 2.240, top1 = 42.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  286/15625) 000286-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.187, top1 = 93.74%], valid : [loss = 0.556, top1 = 83.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.196, top1 = 93.41%], test  : [loss = 0.397, top1 = 87.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.08 ms.
cifar100       train : [loss = 1.229, top1 = 64.97%], valid : [loss = 1.557, top1 = 57.40%], test : [loss = 1.546, top1 = 57.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.93%], valid : [loss = 2.722, top1 = 32.09%], test : [loss = 2.761, top1 = 30.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 66.90%], valid : [loss = 0.969, top1 = 66.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  287/15625) 000287-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.554, top1 = 87.87%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.343, top1 = 91.53%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.48 ms.
cifar100       train : [loss = 0.416, top1 = 88.05%], valid : [loss = 1.249, top1 = 67.23%], test : [loss = 1.262, top1 = 66.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.31 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.71%], valid : [loss = 2.403, top1 = 39.08%], test : [loss = 2.419, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 70.74%], valid : [loss = 0.866, top1 = 69.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  288/15625) 000288-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.497, top1 = 89.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.07 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.342, top1 = 92.65%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.53 ms.
cifar100       train : [loss = 0.183, top1 = 95.35%], valid : [loss = 1.428, top1 = 67.33%], test : [loss = 1.408, top1 = 67.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.28%], valid : [loss = 2.304, top1 = 41.74%], test : [loss = 2.332, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.77%], valid : [loss = 0.599, top1 = 79.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  289/15625) 000289-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.624, top1 = 86.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10        train : [loss = 0.022, top1 = 99.45%], test  : [loss = 0.410, top1 = 90.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.78 ms.
cifar100       train : [loss = 0.256, top1 = 93.35%], valid : [loss = 1.563, top1 = 63.91%], test : [loss = 1.560, top1 = 63.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.33%], valid : [loss = 2.533, top1 = 37.12%], test : [loss = 2.560, top1 = 36.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.53%], valid : [loss = 0.871, top1 = 69.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  290/15625) 000290-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.17%], valid : [loss = 0.547, top1 = 85.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.112, top1 = 96.35%], test  : [loss = 0.374, top1 = 88.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.792, top1 = 76.96%], valid : [loss = 1.394, top1 = 62.97%], test : [loss = 1.369, top1 = 63.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.89%], valid : [loss = 2.609, top1 = 33.97%], test : [loss = 2.645, top1 = 34.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.70%], valid : [loss = 0.895, top1 = 68.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  291/15625) 000291-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.39%], valid : [loss = 0.491, top1 = 86.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.92 ms.
cifar10        train : [loss = 0.094, top1 = 96.97%], test  : [loss = 0.338, top1 = 90.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.659, top1 = 81.05%], valid : [loss = 1.234, top1 = 65.91%], test : [loss = 1.222, top1 = 66.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.19%], valid : [loss = 2.440, top1 = 37.96%], test : [loss = 2.475, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.05%], valid : [loss = 0.921, top1 = 67.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  292/15625) 000292-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.582, top1 = 87.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.403, top1 = 91.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.35 ms.
cifar100       train : [loss = 0.181, top1 = 95.94%], valid : [loss = 1.473, top1 = 66.34%], test : [loss = 1.442, top1 = 66.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.79%], valid : [loss = 2.478, top1 = 38.13%], test : [loss = 2.505, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.15%], valid : [loss = 0.763, top1 = 73.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  293/15625) 000293-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.48%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.10 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.318, top1 = 93.08%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.23 ms.
cifar100       train : [loss = 0.075, top1 = 98.83%], valid : [loss = 1.307, top1 = 70.31%], test : [loss = 1.295, top1 = 70.23%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.64%], valid : [loss = 2.262, top1 = 42.43%], test : [loss = 2.245, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.46%], valid : [loss = 0.785, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  294/15625) 000294-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.526, top1 = 88.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.324, top1 = 92.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.55 ms.
cifar100       train : [loss = 0.328, top1 = 91.08%], valid : [loss = 1.278, top1 = 67.17%], test : [loss = 1.278, top1 = 67.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.83%], valid : [loss = 2.393, top1 = 39.39%], test : [loss = 2.411, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  295/15625) 000295-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.438, top1 = 90.89%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.73%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.91 ms.
cifar100       train : [loss = 0.064, top1 = 99.06%], valid : [loss = 1.354, top1 = 69.93%], test : [loss = 1.324, top1 = 70.69%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 1.535, top1 = 58.48%], valid : [loss = 2.229, top1 = 44.16%], test : [loss = 2.283, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.17%], valid : [loss = 0.505, top1 = 83.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  296/15625) 000296-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.15%], valid : [loss = 0.456, top1 = 86.84%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=14.73 ms.
cifar10        train : [loss = 0.112, top1 = 96.53%], test  : [loss = 0.325, top1 = 89.71%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=14.27 ms.
cifar100       train : [loss = 0.856, top1 = 75.73%], valid : [loss = 1.291, top1 = 64.23%], test : [loss = 1.284, top1 = 63.79%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.57%], valid : [loss = 2.624, top1 = 33.71%], test : [loss = 2.664, top1 = 33.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  297/15625) 000297-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.11 ms.
cifar10-valid  train : [loss = 1.710, top1 = 36.76%], valid : [loss = 1.721, top1 = 36.84%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10        train : [loss = 1.366, top1 = 50.08%], test  : [loss = 1.370, top1 = 50.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.68 ms.
cifar100       train : [loss = 3.875, top1 = 10.54%], valid : [loss = 3.924, top1 = 9.77%], test : [loss = 3.922, top1 = 10.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.66 ms.
ImageNet16-120 train : [loss = 4.061, top1 = 9.42%], valid : [loss = 4.059, top1 = 9.83%], test : [loss = 4.063, top1 = 9.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.981, top1 = 26.40%], valid : [loss = 1.985, top1 = 26.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  298/15625) 000298-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.093, top1 = 97.32%], valid : [loss = 0.524, top1 = 85.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10        train : [loss = 0.174, top1 = 94.23%], test  : [loss = 0.376, top1 = 88.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.15 ms.
cifar100       train : [loss = 0.977, top1 = 71.88%], valid : [loss = 1.389, top1 = 62.41%], test : [loss = 1.361, top1 = 61.87%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.82%], valid : [loss = 2.691, top1 = 33.23%], test : [loss = 2.749, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.32%], valid : [loss = 0.949, top1 = 66.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  299/15625) 000299-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.582, top1 = 87.39%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=16.92 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.391, top1 = 90.99%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=17.04 ms.
cifar100       train : [loss = 0.396, top1 = 88.80%], valid : [loss = 1.384, top1 = 65.68%], test : [loss = 1.398, top1 = 65.58%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 41.01%], valid : [loss = 2.513, top1 = 37.07%], test : [loss = 2.524, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.27%], valid : [loss = 0.799, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  300/15625) 000300-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.639, top1 = 86.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10        train : [loss = 0.029, top1 = 99.28%], test  : [loss = 0.431, top1 = 89.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.61 ms.
cifar100       train : [loss = 0.361, top1 = 90.35%], valid : [loss = 1.424, top1 = 64.92%], test : [loss = 1.407, top1 = 65.57%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.46%], valid : [loss = 2.615, top1 = 34.92%], test : [loss = 2.628, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  301/15625) 000301-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.496, top1 = 89.88%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.39 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.315, top1 = 93.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.98 ms.
cifar100       train : [loss = 0.077, top1 = 98.81%], valid : [loss = 1.320, top1 = 69.73%], test : [loss = 1.357, top1 = 69.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.62 ms.
ImageNet16-120 train : [loss = 1.682, top1 = 54.95%], valid : [loss = 2.252, top1 = 43.15%], test : [loss = 2.239, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.32%], valid : [loss = 0.643, top1 = 77.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  302/15625) 000302-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.456, top1 = 83.87%], valid : [loss = 0.684, top1 = 77.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.370, top1 = 87.21%], test  : [loss = 0.496, top1 = 83.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 1.699, top1 = 52.98%], valid : [loss = 1.920, top1 = 48.63%], test : [loss = 1.915, top1 = 49.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 3.210, top1 = 22.68%], valid : [loss = 3.210, top1 = 22.22%], test : [loss = 3.271, top1 = 22.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.047, top1 = 62.09%], valid : [loss = 1.087, top1 = 60.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  303/15625) 000303-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.21%], valid : [loss = 0.558, top1 = 86.94%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.72 ms.
cifar10        train : [loss = 0.061, top1 = 98.06%], test  : [loss = 0.375, top1 = 89.84%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.26 ms.
cifar100       train : [loss = 0.655, top1 = 80.59%], valid : [loss = 1.318, top1 = 65.48%], test : [loss = 1.314, top1 = 64.91%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.14%], valid : [loss = 2.469, top1 = 37.25%], test : [loss = 2.503, top1 = 36.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.93%], valid : [loss = 0.712, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  304/15625) 000304-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.066, top1 = 97.97%], valid : [loss = 0.613, top1 = 84.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.086, top1 = 97.18%], test  : [loss = 0.413, top1 = 88.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.45 ms.
cifar100       train : [loss = 0.715, top1 = 78.93%], valid : [loss = 1.569, top1 = 59.65%], test : [loss = 1.563, top1 = 59.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 3.185, top1 = 22.30%], valid : [loss = 3.194, top1 = 21.45%], test : [loss = 3.239, top1 = 21.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  305/15625) 000305-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.68%], valid : [loss = 0.671, top1 = 77.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.04 ms.
cifar10        train : [loss = 0.532, top1 = 81.46%], test  : [loss = 0.596, top1 = 79.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.89 ms.
cifar100       train : [loss = 1.739, top1 = 52.86%], valid : [loss = 1.891, top1 = 49.52%], test : [loss = 1.915, top1 = 49.19%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.75 ms.
ImageNet16-120 train : [loss = 3.389, top1 = 20.07%], valid : [loss = 3.373, top1 = 20.57%], test : [loss = 3.409, top1 = 19.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  306/15625) 000306-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.71%], valid : [loss = 0.840, top1 = 71.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.684, top1 = 76.06%], test  : [loss = 0.765, top1 = 73.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.68 ms.
cifar100       train : [loss = 1.940, top1 = 48.21%], valid : [loss = 2.112, top1 = 45.38%], test : [loss = 2.134, top1 = 44.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 3.639, top1 = 15.88%], valid : [loss = 3.663, top1 = 16.17%], test : [loss = 3.686, top1 = 15.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  307/15625) 000307-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.561, top1 = 88.21%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.350, top1 = 92.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.43 ms.
cifar100       train : [loss = 0.122, top1 = 97.11%], valid : [loss = 1.454, top1 = 67.79%], test : [loss = 1.442, top1 = 68.30%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.49%], valid : [loss = 2.414, top1 = 38.42%], test : [loss = 2.424, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.54%], valid : [loss = 0.869, top1 = 68.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  308/15625) 000308-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.539, top1 = 88.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.341, top1 = 91.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.335, top1 = 90.79%], valid : [loss = 1.300, top1 = 66.68%], test : [loss = 1.286, top1 = 67.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.34%], valid : [loss = 2.413, top1 = 38.77%], test : [loss = 2.427, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  309/15625) 000309-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.54%], valid : [loss = 0.454, top1 = 86.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.42 ms.
cifar10        train : [loss = 0.146, top1 = 95.36%], test  : [loss = 0.341, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.72 ms.
cifar100       train : [loss = 0.965, top1 = 72.62%], valid : [loss = 1.335, top1 = 62.86%], test : [loss = 1.340, top1 = 62.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.616, top1 = 34.23%], valid : [loss = 2.664, top1 = 33.43%], test : [loss = 2.710, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  310/15625) 000310-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.540, top1 = 88.55%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10        train : [loss = 0.016, top1 = 99.55%], test  : [loss = 0.363, top1 = 91.95%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.13 ms.
cifar100       train : [loss = 0.314, top1 = 91.30%], valid : [loss = 1.348, top1 = 66.49%], test : [loss = 1.313, top1 = 67.49%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.26%], valid : [loss = 2.345, top1 = 39.73%], test : [loss = 2.357, top1 = 40.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.01%], valid : [loss = 0.848, top1 = 70.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  311/15625) 000311-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.95%], valid : [loss = 0.545, top1 = 85.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.118, top1 = 96.17%], test  : [loss = 0.373, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.826, top1 = 75.87%], valid : [loss = 1.380, top1 = 63.10%], test : [loss = 1.388, top1 = 62.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.62%], valid : [loss = 2.621, top1 = 34.29%], test : [loss = 2.640, top1 = 34.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.59%], valid : [loss = 0.895, top1 = 68.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  312/15625) 000312-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.39%], valid : [loss = 0.608, top1 = 85.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.040, top1 = 98.84%], test  : [loss = 0.398, top1 = 89.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 0.596, top1 = 82.54%], valid : [loss = 1.460, top1 = 62.63%], test : [loss = 1.437, top1 = 62.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.410, top1 = 38.48%], valid : [loss = 2.604, top1 = 34.78%], test : [loss = 2.588, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.82%], valid : [loss = 0.872, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  313/15625) 000313-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.24 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.37%], valid : [loss = 0.855, top1 = 71.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10        train : [loss = 0.552, top1 = 80.75%], test  : [loss = 0.719, top1 = 75.77%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.66 ms.
cifar100       train : [loss = 1.772, top1 = 52.18%], valid : [loss = 2.059, top1 = 47.19%], test : [loss = 2.077, top1 = 46.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.43 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.84%], valid : [loss = 3.643, top1 = 16.12%], test : [loss = 3.658, top1 = 15.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  314/15625) 000314-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.496, top1 = 88.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.334, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.67 ms.
cifar100       train : [loss = 0.325, top1 = 91.20%], valid : [loss = 1.271, top1 = 67.27%], test : [loss = 1.276, top1 = 67.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.12%], valid : [loss = 2.416, top1 = 38.67%], test : [loss = 2.420, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.79%], valid : [loss = 0.648, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  315/15625) 000315-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.35%], valid : [loss = 0.723, top1 = 81.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 0.129, top1 = 95.69%], test  : [loss = 0.483, top1 = 86.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.764, top1 = 77.45%], valid : [loss = 1.672, top1 = 57.71%], test : [loss = 1.656, top1 = 58.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 3.263, top1 = 21.07%], valid : [loss = 3.299, top1 = 20.52%], test : [loss = 3.313, top1 = 20.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.333, top1 = 50.44%], valid : [loss = 1.365, top1 = 49.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  316/15625) 000316-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.555, top1 = 88.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.66 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.360, top1 = 91.91%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.69 ms.
cifar100       train : [loss = 0.223, top1 = 94.37%], valid : [loss = 1.300, top1 = 68.55%], test : [loss = 1.297, top1 = 68.25%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.66%], valid : [loss = 2.325, top1 = 40.73%], test : [loss = 2.330, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 70.93%], valid : [loss = 0.856, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  317/15625) 000317-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.28%], valid : [loss = 0.521, top1 = 84.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.186, top1 = 93.71%], test  : [loss = 0.387, top1 = 87.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 1.197, top1 = 65.96%], valid : [loss = 1.504, top1 = 58.67%], test : [loss = 1.505, top1 = 58.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.70%], valid : [loss = 2.672, top1 = 33.30%], test : [loss = 2.737, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 67.17%], valid : [loss = 0.970, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  318/15625) 000318-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.460, top1 = 90.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.321, top1 = 92.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.085, top1 = 98.55%], valid : [loss = 1.411, top1 = 69.21%], test : [loss = 1.447, top1 = 68.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.05%], valid : [loss = 2.345, top1 = 41.10%], test : [loss = 2.356, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.61%], valid : [loss = 0.606, top1 = 79.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  319/15625) 000319-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.36 ms.
cifar10-valid  train : [loss = 0.325, top1 = 88.81%], valid : [loss = 0.558, top1 = 81.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.270, top1 = 90.80%], test  : [loss = 0.431, top1 = 85.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.23 ms.
cifar100       train : [loss = 1.488, top1 = 58.61%], valid : [loss = 1.718, top1 = 53.40%], test : [loss = 1.694, top1 = 54.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.18 ms.
ImageNet16-120 train : [loss = 2.948, top1 = 27.78%], valid : [loss = 2.951, top1 = 28.17%], test : [loss = 3.026, top1 = 26.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.001, top1 = 64.09%], valid : [loss = 1.076, top1 = 61.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  320/15625) 000320-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.23%], valid : [loss = 0.568, top1 = 86.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.77 ms.
cifar10        train : [loss = 0.064, top1 = 97.92%], test  : [loss = 0.382, top1 = 89.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.75 ms.
cifar100       train : [loss = 0.663, top1 = 80.37%], valid : [loss = 1.348, top1 = 63.85%], test : [loss = 1.334, top1 = 64.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.98 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.58%], valid : [loss = 2.503, top1 = 36.98%], test : [loss = 2.520, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.82%], valid : [loss = 0.810, top1 = 71.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  321/15625) 000321-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.10%], valid : [loss = 0.459, top1 = 86.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10        train : [loss = 0.113, top1 = 96.48%], test  : [loss = 0.328, top1 = 89.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.13 ms.
cifar100       train : [loss = 0.861, top1 = 75.45%], valid : [loss = 1.292, top1 = 64.11%], test : [loss = 1.283, top1 = 64.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.65%], valid : [loss = 2.626, top1 = 33.58%], test : [loss = 2.674, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  322/15625) 000322-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.445, top1 = 90.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.289, top1 = 93.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.27 ms.
cifar100       train : [loss = 0.060, top1 = 99.18%], valid : [loss = 1.338, top1 = 70.55%], test : [loss = 1.345, top1 = 70.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.505, top1 = 59.21%], valid : [loss = 2.243, top1 = 43.87%], test : [loss = 2.239, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.20%], valid : [loss = 0.496, top1 = 83.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  323/15625) 000323-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.70%], valid : [loss = 0.462, top1 = 86.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.73 ms.
cifar10        train : [loss = 0.149, top1 = 95.18%], test  : [loss = 0.346, top1 = 88.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.77 ms.
cifar100       train : [loss = 0.987, top1 = 72.11%], valid : [loss = 1.347, top1 = 62.85%], test : [loss = 1.344, top1 = 62.63%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.06%], valid : [loss = 2.690, top1 = 32.80%], test : [loss = 2.696, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  324/15625) 000324-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.62%], valid : [loss = 0.694, top1 = 79.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.314, top1 = 89.02%], test  : [loss = 0.535, top1 = 82.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.31 ms.
cifar100       train : [loss = 1.325, top1 = 62.50%], valid : [loss = 1.774, top1 = 53.25%], test : [loss = 1.781, top1 = 52.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 20.90%], valid : [loss = 3.371, top1 = 20.17%], test : [loss = 3.411, top1 = 19.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.179, top1 = 57.79%], valid : [loss = 1.256, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  325/15625) 000325-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.572, top1 = 88.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.401, top1 = 91.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.44 ms.
cifar100       train : [loss = 0.151, top1 = 96.52%], valid : [loss = 1.496, top1 = 67.20%], test : [loss = 1.485, top1 = 66.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.73%], valid : [loss = 2.496, top1 = 37.72%], test : [loss = 2.571, top1 = 36.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.67%], valid : [loss = 0.635, top1 = 78.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  326/15625) 000326-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.423, top1 = 90.50%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.78 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.269, top1 = 93.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.88 ms.
cifar100       train : [loss = 0.133, top1 = 97.22%], valid : [loss = 1.267, top1 = 69.93%], test : [loss = 1.290, top1 = 69.75%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.35%], valid : [loss = 2.204, top1 = 44.70%], test : [loss = 2.197, top1 = 44.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.35%], valid : [loss = 0.517, top1 = 82.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  327/15625) 000327-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.30%], valid : [loss = 0.521, top1 = 87.48%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=16.87 ms.
cifar10        train : [loss = 0.059, top1 = 98.22%], test  : [loss = 0.364, top1 = 90.22%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=14.80 ms.
cifar100       train : [loss = 0.636, top1 = 81.33%], valid : [loss = 1.328, top1 = 65.15%], test : [loss = 1.311, top1 = 65.11%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.96%], valid : [loss = 2.516, top1 = 36.69%], test : [loss = 2.570, top1 = 35.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.54%], valid : [loss = 0.606, top1 = 79.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  328/15625) 000328-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.481, top1 = 88.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.303, top1 = 92.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 0.319, top1 = 91.33%], valid : [loss = 1.252, top1 = 67.88%], test : [loss = 1.263, top1 = 67.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.63%], valid : [loss = 2.308, top1 = 41.13%], test : [loss = 2.346, top1 = 41.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  329/15625) 000329-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.102, top1 = 97.04%], valid : [loss = 0.464, top1 = 86.14%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.36 ms.
cifar10        train : [loss = 0.143, top1 = 95.32%], test  : [loss = 0.337, top1 = 89.17%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.57 ms.
cifar100       train : [loss = 0.900, top1 = 74.37%], valid : [loss = 1.295, top1 = 63.85%], test : [loss = 1.295, top1 = 63.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.72%], valid : [loss = 2.599, top1 = 34.78%], test : [loss = 2.621, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.45%], valid : [loss = 0.752, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  330/15625) 000330-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.85%], valid : [loss = 0.667, top1 = 78.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.89 ms.
cifar10        train : [loss = 0.334, top1 = 88.41%], test  : [loss = 0.509, top1 = 83.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 1.454, top1 = 59.40%], valid : [loss = 1.771, top1 = 52.54%], test : [loss = 1.754, top1 = 53.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.83%], valid : [loss = 3.237, top1 = 22.57%], test : [loss = 3.263, top1 = 22.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.44%], valid : [loss = 1.202, top1 = 56.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  331/15625) 000331-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.57 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.89%], valid : [loss = 0.549, top1 = 82.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.26 ms.
cifar10        train : [loss = 0.239, top1 = 91.83%], test  : [loss = 0.390, top1 = 86.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.54 ms.
cifar100       train : [loss = 1.418, top1 = 60.32%], valid : [loss = 1.659, top1 = 54.54%], test : [loss = 1.659, top1 = 54.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.68 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 28.07%], valid : [loss = 2.948, top1 = 28.58%], test : [loss = 3.000, top1 = 27.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.997, top1 = 64.23%], valid : [loss = 1.019, top1 = 63.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  332/15625) 000332-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.07%], valid : [loss = 0.649, top1 = 78.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10        train : [loss = 0.512, top1 = 82.30%], test  : [loss = 0.588, top1 = 80.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.66 ms.
cifar100       train : [loss = 1.697, top1 = 53.90%], valid : [loss = 1.852, top1 = 50.37%], test : [loss = 1.879, top1 = 50.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.36%], valid : [loss = 3.304, top1 = 21.57%], test : [loss = 3.347, top1 = 21.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  333/15625) 000333-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.093, top1 = 97.24%], valid : [loss = 0.541, top1 = 85.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.56 ms.
cifar10        train : [loss = 0.094, top1 = 97.07%], test  : [loss = 0.358, top1 = 89.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.803, top1 = 76.57%], valid : [loss = 1.367, top1 = 63.13%], test : [loss = 1.384, top1 = 62.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.67%], valid : [loss = 2.638, top1 = 33.85%], test : [loss = 2.652, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 68.29%], valid : [loss = 0.948, top1 = 67.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  334/15625) 000334-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.71%], valid : [loss = 0.858, top1 = 71.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.29 ms.
cifar10        train : [loss = 0.554, top1 = 80.63%], test  : [loss = 0.712, top1 = 76.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.08 ms.
cifar100       train : [loss = 1.777, top1 = 52.10%], valid : [loss = 2.050, top1 = 47.20%], test : [loss = 2.058, top1 = 46.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.79%], valid : [loss = 3.635, top1 = 16.75%], test : [loss = 3.667, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.199, top1 = 56.76%], valid : [loss = 1.258, top1 = 55.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  335/15625) 000335-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.517, top1 = 88.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.023, top1 = 99.35%], test  : [loss = 0.348, top1 = 91.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.398, top1 = 88.52%], valid : [loss = 1.238, top1 = 67.99%], test : [loss = 1.268, top1 = 66.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.74%], valid : [loss = 2.405, top1 = 39.85%], test : [loss = 2.447, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.12%], valid : [loss = 0.738, top1 = 74.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  336/15625) 000336-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.583, top1 = 87.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.388, top1 = 90.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.10 ms.
cifar100       train : [loss = 0.407, top1 = 88.33%], valid : [loss = 1.400, top1 = 65.56%], test : [loss = 1.378, top1 = 65.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.05%], valid : [loss = 2.491, top1 = 37.71%], test : [loss = 2.515, top1 = 37.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.81%], valid : [loss = 0.782, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  337/15625) 000337-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.150, top1 = 95.26%], valid : [loss = 0.504, top1 = 85.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.07 ms.
cifar10        train : [loss = 0.167, top1 = 94.36%], test  : [loss = 0.365, top1 = 88.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 1.036, top1 = 70.31%], valid : [loss = 1.379, top1 = 61.64%], test : [loss = 1.371, top1 = 61.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.99%], valid : [loss = 2.590, top1 = 35.26%], test : [loss = 2.607, top1 = 34.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.33%], valid : [loss = 0.978, top1 = 65.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  338/15625) 000338-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.26%], valid : [loss = 0.455, top1 = 87.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.99 ms.
cifar10        train : [loss = 0.071, top1 = 98.07%], test  : [loss = 0.321, top1 = 90.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.19 ms.
cifar100       train : [loss = 0.635, top1 = 82.35%], valid : [loss = 1.227, top1 = 66.20%], test : [loss = 1.217, top1 = 66.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.49%], valid : [loss = 2.505, top1 = 37.07%], test : [loss = 2.525, top1 = 36.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.52%], valid : [loss = 0.641, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  339/15625) 000339-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.650, top1 = 86.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.45 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.424, top1 = 90.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.204, top1 = 95.22%], valid : [loss = 1.552, top1 = 65.31%], test : [loss = 1.573, top1 = 64.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.30%], valid : [loss = 2.505, top1 = 37.60%], test : [loss = 2.520, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.02%], valid : [loss = 0.821, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  340/15625) 000340-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.59%], valid : [loss = 0.579, top1 = 87.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.041, top1 = 98.78%], test  : [loss = 0.399, top1 = 90.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.23 ms.
cifar100       train : [loss = 0.574, top1 = 83.08%], valid : [loss = 1.408, top1 = 64.04%], test : [loss = 1.407, top1 = 64.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.84%], valid : [loss = 2.622, top1 = 34.93%], test : [loss = 2.688, top1 = 33.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.53%], valid : [loss = 0.719, top1 = 75.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  341/15625) 000341-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.246, top1 = 91.63%], valid : [loss = 0.967, top1 = 73.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.288, top1 = 89.96%], test  : [loss = 0.597, top1 = 81.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.73 ms.
cifar100       train : [loss = 1.297, top1 = 63.32%], valid : [loss = 1.883, top1 = 51.09%], test : [loss = 1.879, top1 = 51.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 3.276, top1 = 21.77%], valid : [loss = 3.378, top1 = 20.47%], test : [loss = 3.401, top1 = 19.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.102, top1 = 60.05%], valid : [loss = 1.150, top1 = 58.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  342/15625) 000342-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.28%], valid : [loss = 0.608, top1 = 85.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.417, top1 = 88.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.25 ms.
cifar100       train : [loss = 0.706, top1 = 79.39%], valid : [loss = 1.386, top1 = 63.40%], test : [loss = 1.365, top1 = 63.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.90%], valid : [loss = 2.664, top1 = 33.08%], test : [loss = 2.694, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  343/15625) 000343-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.39%], valid : [loss = 0.908, top1 = 76.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.230, top1 = 92.03%], test  : [loss = 0.581, top1 = 82.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.41 ms.
cifar100       train : [loss = 1.167, top1 = 66.78%], valid : [loss = 1.802, top1 = 52.74%], test : [loss = 1.775, top1 = 54.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.72%], valid : [loss = 3.321, top1 = 21.82%], test : [loss = 3.360, top1 = 20.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  344/15625) 000344-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.68%], valid : [loss = 0.625, top1 = 86.74%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10        train : [loss = 0.017, top1 = 99.53%], test  : [loss = 0.411, top1 = 90.91%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.17 ms.
cifar100       train : [loss = 0.361, top1 = 89.88%], valid : [loss = 1.475, top1 = 63.50%], test : [loss = 1.492, top1 = 63.83%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 3.052, top1 = 24.66%], valid : [loss = 3.060, top1 = 24.42%], test : [loss = 3.080, top1 = 23.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.83%], valid : [loss = 1.205, top1 = 56.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  345/15625) 000345-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.16%], valid : [loss = 1.172, top1 = 58.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.76 ms.
cifar10        train : [loss = 1.049, top1 = 62.96%], test  : [loss = 1.052, top1 = 62.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.67 ms.
cifar100       train : [loss = 2.583, top1 = 34.82%], valid : [loss = 2.649, top1 = 33.85%], test : [loss = 2.636, top1 = 34.27%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.83 ms.
ImageNet16-120 train : [loss = 3.784, top1 = 13.68%], valid : [loss = 3.761, top1 = 14.54%], test : [loss = 3.788, top1 = 13.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  346/15625) 000346-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.24%], valid : [loss = 0.457, top1 = 86.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.150, top1 = 95.04%], test  : [loss = 0.341, top1 = 88.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 0.989, top1 = 71.83%], valid : [loss = 1.351, top1 = 62.58%], test : [loss = 1.342, top1 = 61.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.71%], valid : [loss = 2.700, top1 = 32.67%], test : [loss = 2.725, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  347/15625) 000347-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.72%], valid : [loss = 0.456, top1 = 86.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10        train : [loss = 0.147, top1 = 95.24%], test  : [loss = 0.341, top1 = 88.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.60 ms.
cifar100       train : [loss = 0.968, top1 = 72.50%], valid : [loss = 1.346, top1 = 62.42%], test : [loss = 1.339, top1 = 62.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 2.609, top1 = 34.41%], valid : [loss = 2.649, top1 = 33.90%], test : [loss = 2.687, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.769, top1 = 72.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  348/15625) 000348-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.97%], valid : [loss = 0.722, top1 = 83.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.088, top1 = 97.15%], test  : [loss = 0.487, top1 = 86.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.804, top1 = 76.49%], valid : [loss = 1.526, top1 = 60.66%], test : [loss = 1.523, top1 = 60.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.805, top1 = 30.60%], valid : [loss = 2.919, top1 = 28.90%], test : [loss = 2.975, top1 = 27.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.09%], valid : [loss = 0.883, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  349/15625) 000349-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.42%], valid : [loss = 0.546, top1 = 83.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10        train : [loss = 0.193, top1 = 93.40%], test  : [loss = 0.403, top1 = 87.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.73 ms.
cifar100       train : [loss = 1.250, top1 = 64.36%], valid : [loss = 1.550, top1 = 57.65%], test : [loss = 1.533, top1 = 57.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.713, top1 = 32.41%], valid : [loss = 2.752, top1 = 31.98%], test : [loss = 2.794, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  350/15625) 000350-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.508, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.318, top1 = 92.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.59 ms.
cifar100       train : [loss = 0.155, top1 = 96.73%], valid : [loss = 1.304, top1 = 68.63%], test : [loss = 1.296, top1 = 69.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.42%], valid : [loss = 2.290, top1 = 41.63%], test : [loss = 2.283, top1 = 42.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.33%], valid : [loss = 0.662, top1 = 77.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  351/15625) 000351-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.495, top1 = 89.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.82 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.328, top1 = 92.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.29 ms.
cifar100       train : [loss = 0.213, top1 = 94.78%], valid : [loss = 1.236, top1 = 69.00%], test : [loss = 1.231, top1 = 69.61%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.66%], valid : [loss = 2.213, top1 = 43.72%], test : [loss = 2.228, top1 = 43.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.35%], valid : [loss = 0.655, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  352/15625) 000352-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 90.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.96 ms.
cifar100       train : [loss = 0.053, top1 = 99.31%], valid : [loss = 1.336, top1 = 70.92%], test : [loss = 1.311, top1 = 70.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 1.498, top1 = 59.57%], valid : [loss = 2.266, top1 = 44.12%], test : [loss = 2.231, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.32%], valid : [loss = 0.512, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  353/15625) 000353-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.91%], valid : [loss = 0.520, top1 = 82.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.402, top1 = 86.35%], test  : [loss = 0.466, top1 = 84.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 1.531, top1 = 57.68%], valid : [loss = 1.657, top1 = 54.34%], test : [loss = 1.657, top1 = 54.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.33%], valid : [loss = 3.012, top1 = 27.30%], test : [loss = 3.046, top1 = 26.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.78%], valid : [loss = 1.138, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  354/15625) 000354-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.28%], valid : [loss = 0.456, top1 = 87.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.39 ms.
cifar10        train : [loss = 0.115, top1 = 96.39%], test  : [loss = 0.329, top1 = 89.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.15 ms.
cifar100       train : [loss = 0.866, top1 = 75.27%], valid : [loss = 1.287, top1 = 64.26%], test : [loss = 1.278, top1 = 63.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.17 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.47%], valid : [loss = 2.638, top1 = 33.52%], test : [loss = 2.655, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.99%], valid : [loss = 0.629, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  355/15625) 000355-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.418, top1 = 90.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.293, top1 = 93.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.17 ms.
cifar100       train : [loss = 0.173, top1 = 96.00%], valid : [loss = 1.257, top1 = 69.87%], test : [loss = 1.263, top1 = 69.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.01%], valid : [loss = 2.262, top1 = 42.25%], test : [loss = 2.282, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  356/15625) 000356-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.474, top1 = 89.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.325, top1 = 92.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.17 ms.
cifar100       train : [loss = 0.092, top1 = 98.26%], valid : [loss = 1.429, top1 = 68.07%], test : [loss = 1.444, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.89%], valid : [loss = 2.301, top1 = 41.48%], test : [loss = 2.352, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.36%], valid : [loss = 0.539, top1 = 81.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  357/15625) 000357-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.259, top1 = 90.95%], valid : [loss = 0.524, top1 = 83.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.243, top1 = 91.65%], test  : [loss = 0.405, top1 = 86.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 1.332, top1 = 62.25%], valid : [loss = 1.608, top1 = 56.04%], test : [loss = 1.610, top1 = 56.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.811, top1 = 30.47%], valid : [loss = 2.819, top1 = 30.39%], test : [loss = 2.861, top1 = 29.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.20%], valid : [loss = 1.007, top1 = 64.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  358/15625) 000358-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.542, top1 = 88.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.358, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.59 ms.
cifar100       train : [loss = 0.253, top1 = 93.19%], valid : [loss = 1.314, top1 = 68.34%], test : [loss = 1.317, top1 = 67.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.199, top1 = 43.04%], valid : [loss = 2.440, top1 = 38.25%], test : [loss = 2.461, top1 = 37.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.921, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  359/15625) 000359-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.36%], valid : [loss = 0.610, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.072, top1 = 97.80%], test  : [loss = 0.411, top1 = 88.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.96 ms.
cifar100       train : [loss = 0.716, top1 = 79.28%], valid : [loss = 1.389, top1 = 62.82%], test : [loss = 1.381, top1 = 63.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.10%], valid : [loss = 2.658, top1 = 33.37%], test : [loss = 2.675, top1 = 33.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  360/15625) 000360-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.476, top1 = 89.49%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.295, top1 = 92.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.41 ms.
cifar100       train : [loss = 0.140, top1 = 97.16%], valid : [loss = 1.300, top1 = 68.97%], test : [loss = 1.283, top1 = 69.35%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.49%], valid : [loss = 2.192, top1 = 43.43%], test : [loss = 2.229, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 84.18%], valid : [loss = 0.550, top1 = 81.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  361/15625) 000361-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.519, top1 = 89.34%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.59 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.321, top1 = 93.25%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.99 ms.
cifar100       train : [loss = 0.060, top1 = 99.03%], valid : [loss = 1.376, top1 = 70.16%], test : [loss = 1.389, top1 = 69.58%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.48 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.21%], valid : [loss = 2.336, top1 = 40.47%], test : [loss = 2.297, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.68%], valid : [loss = 0.898, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  362/15625) 000362-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.557, top1 = 88.41%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.372, top1 = 91.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.85 ms.
cifar100       train : [loss = 0.197, top1 = 94.98%], valid : [loss = 1.352, top1 = 67.97%], test : [loss = 1.324, top1 = 68.46%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.87 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.07%], valid : [loss = 2.389, top1 = 39.32%], test : [loss = 2.401, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.56%], valid : [loss = 0.899, top1 = 68.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  363/15625) 000363-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.211, top1 = 92.88%], valid : [loss = 0.544, top1 = 83.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.208, top1 = 92.95%], test  : [loss = 0.393, top1 = 87.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.51 ms.
cifar100       train : [loss = 1.287, top1 = 63.46%], valid : [loss = 1.585, top1 = 56.75%], test : [loss = 1.571, top1 = 56.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.733, top1 = 31.91%], valid : [loss = 2.759, top1 = 31.21%], test : [loss = 2.800, top1 = 30.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.48%], valid : [loss = 1.005, top1 = 63.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  364/15625) 000364-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.24%], valid : [loss = 0.648, top1 = 78.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.533, top1 = 81.43%], test  : [loss = 0.607, top1 = 79.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.20 ms.
cifar100       train : [loss = 1.692, top1 = 54.06%], valid : [loss = 1.875, top1 = 49.86%], test : [loss = 1.868, top1 = 50.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.95 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.25%], valid : [loss = 3.313, top1 = 21.37%], test : [loss = 3.334, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  365/15625) 000365-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.47%], valid : [loss = 1.234, top1 = 56.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 1.122, top1 = 60.25%], test  : [loss = 1.130, top1 = 59.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.99 ms.
cifar100       train : [loss = 2.651, top1 = 33.42%], valid : [loss = 2.730, top1 = 32.04%], test : [loss = 2.713, top1 = 32.41%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.33 ms.
ImageNet16-120 train : [loss = 3.823, top1 = 13.07%], valid : [loss = 3.817, top1 = 14.00%], test : [loss = 3.835, top1 = 13.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.676, top1 = 37.21%], valid : [loss = 1.738, top1 = 33.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  366/15625) 000366-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.506, top1 = 88.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.334, top1 = 91.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.13 ms.
cifar100       train : [loss = 0.325, top1 = 91.22%], valid : [loss = 1.265, top1 = 67.65%], test : [loss = 1.305, top1 = 66.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.92%], valid : [loss = 2.399, top1 = 38.43%], test : [loss = 2.438, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  367/15625) 000367-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.612, top1 = 87.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.400, top1 = 91.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.88 ms.
cifar100       train : [loss = 0.180, top1 = 95.93%], valid : [loss = 1.515, top1 = 66.08%], test : [loss = 1.499, top1 = 65.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.46%], valid : [loss = 2.513, top1 = 37.55%], test : [loss = 2.536, top1 = 37.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.00%], valid : [loss = 0.808, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  368/15625) 000368-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.643, top1 = 85.65%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.11 ms.
cifar10        train : [loss = 0.031, top1 = 99.20%], test  : [loss = 0.451, top1 = 89.03%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.86 ms.
cifar100       train : [loss = 0.385, top1 = 89.43%], valid : [loss = 1.504, top1 = 63.64%], test : [loss = 1.460, top1 = 64.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.73%], valid : [loss = 2.560, top1 = 36.48%], test : [loss = 2.611, top1 = 35.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.88%], valid : [loss = 0.823, top1 = 71.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  369/15625) 000369-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.657, top1 = 86.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.430, top1 = 90.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 0.186, top1 = 95.64%], valid : [loss = 1.579, top1 = 64.85%], test : [loss = 1.594, top1 = 64.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.196, top1 = 43.31%], valid : [loss = 2.633, top1 = 35.12%], test : [loss = 2.662, top1 = 34.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.12%], valid : [loss = 0.833, top1 = 70.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  370/15625) 000370-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.513, top1 = 88.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.332, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.256, top1 = 93.62%], valid : [loss = 1.255, top1 = 68.40%], test : [loss = 1.259, top1 = 68.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.65%], valid : [loss = 2.276, top1 = 41.47%], test : [loss = 2.289, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 79.05%], valid : [loss = 0.679, top1 = 76.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  371/15625) 000371-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.572, top1 = 87.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.387, top1 = 91.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.68 ms.
cifar100       train : [loss = 0.394, top1 = 88.78%], valid : [loss = 1.398, top1 = 65.73%], test : [loss = 1.398, top1 = 65.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.317, top1 = 40.62%], valid : [loss = 2.521, top1 = 36.35%], test : [loss = 2.545, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  372/15625) 000372-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.40 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.288, top1 = 92.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.44 ms.
cifar100       train : [loss = 0.171, top1 = 96.14%], valid : [loss = 1.289, top1 = 69.38%], test : [loss = 1.300, top1 = 69.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.791, top1 = 52.36%], valid : [loss = 2.247, top1 = 42.85%], test : [loss = 2.297, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.69%], valid : [loss = 0.508, top1 = 82.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  373/15625) 000373-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.463, top1 = 89.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.308, top1 = 92.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.289, top1 = 92.44%], valid : [loss = 1.225, top1 = 68.89%], test : [loss = 1.254, top1 = 68.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.68%], valid : [loss = 2.290, top1 = 41.03%], test : [loss = 2.282, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.29%], valid : [loss = 0.622, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  374/15625) 000374-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.99 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.501, top1 = 90.08%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.15 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.301, top1 = 93.45%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.91 ms.
cifar100       train : [loss = 0.069, top1 = 98.99%], valid : [loss = 1.312, top1 = 70.23%], test : [loss = 1.308, top1 = 70.22%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.08 ms.
ImageNet16-120 train : [loss = 1.593, top1 = 56.99%], valid : [loss = 2.142, top1 = 45.13%], test : [loss = 2.143, top1 = 45.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.49%], valid : [loss = 0.684, top1 = 76.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  375/15625) 000375-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.458, top1 = 86.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10        train : [loss = 0.113, top1 = 96.54%], test  : [loss = 0.343, top1 = 89.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 0.864, top1 = 75.48%], valid : [loss = 1.302, top1 = 63.86%], test : [loss = 1.293, top1 = 64.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.58%], valid : [loss = 2.625, top1 = 34.45%], test : [loss = 2.653, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  376/15625) 000376-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.066, top1 = 97.96%], valid : [loss = 0.583, top1 = 85.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.05 ms.
cifar10        train : [loss = 0.080, top1 = 97.37%], test  : [loss = 0.423, top1 = 88.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.662, top1 = 81.08%], valid : [loss = 1.470, top1 = 61.64%], test : [loss = 1.468, top1 = 61.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 3.318, top1 = 19.32%], valid : [loss = 3.303, top1 = 19.88%], test : [loss = 3.308, top1 = 19.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.515, top1 = 43.74%], valid : [loss = 1.505, top1 = 44.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  377/15625) 000377-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.502, top1 = 88.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.44 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.333, top1 = 92.23%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.60 ms.
cifar100       train : [loss = 0.322, top1 = 91.45%], valid : [loss = 1.284, top1 = 66.68%], test : [loss = 1.303, top1 = 67.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.02%], valid : [loss = 2.409, top1 = 38.70%], test : [loss = 2.388, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 81.00%], valid : [loss = 0.620, top1 = 78.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  378/15625) 000378-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.536, top1 = 89.76%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.39 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.315, top1 = 93.51%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.89 ms.
cifar100       train : [loss = 0.046, top1 = 99.35%], valid : [loss = 1.335, top1 = 70.44%], test : [loss = 1.336, top1 = 70.70%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.52 ms.
ImageNet16-120 train : [loss = 1.638, top1 = 56.03%], valid : [loss = 2.238, top1 = 43.50%], test : [loss = 2.223, top1 = 43.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.46%], valid : [loss = 0.642, top1 = 77.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  379/15625) 000379-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.80%], valid : [loss = 0.766, top1 = 82.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10        train : [loss = 0.077, top1 = 97.58%], test  : [loss = 0.475, top1 = 87.31%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.29 ms.
cifar100       train : [loss = 0.798, top1 = 76.88%], valid : [loss = 1.603, top1 = 58.46%], test : [loss = 1.581, top1 = 59.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 2.795, top1 = 30.78%], valid : [loss = 2.933, top1 = 28.00%], test : [loss = 2.959, top1 = 27.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.75%], valid : [loss = 0.893, top1 = 68.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  380/15625) 000380-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.512, top1 = 88.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.326, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.337, top1 = 90.77%], valid : [loss = 1.279, top1 = 67.41%], test : [loss = 1.283, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.67%], valid : [loss = 2.411, top1 = 39.14%], test : [loss = 2.413, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  381/15625) 000381-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.47%], valid : [loss = 0.566, top1 = 87.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10        train : [loss = 0.024, top1 = 99.30%], test  : [loss = 0.359, top1 = 91.44%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.60 ms.
cifar100       train : [loss = 0.185, top1 = 95.19%], valid : [loss = 1.303, top1 = 69.40%], test : [loss = 1.343, top1 = 68.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 33.82%], valid : [loss = 2.698, top1 = 31.52%], test : [loss = 2.711, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.25%], valid : [loss = 0.961, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  382/15625) 000382-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.503, top1 = 89.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.321, top1 = 92.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.14 ms.
cifar100       train : [loss = 0.152, top1 = 96.77%], valid : [loss = 1.271, top1 = 69.10%], test : [loss = 1.276, top1 = 69.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.13%], valid : [loss = 2.312, top1 = 41.40%], test : [loss = 2.306, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  383/15625) 000383-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.31%], valid : [loss = 0.597, top1 = 84.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10        train : [loss = 0.115, top1 = 96.17%], test  : [loss = 0.410, top1 = 88.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.77 ms.
cifar100       train : [loss = 0.707, top1 = 79.12%], valid : [loss = 1.548, top1 = 60.51%], test : [loss = 1.533, top1 = 60.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 3.244, top1 = 21.17%], valid : [loss = 3.254, top1 = 20.57%], test : [loss = 3.263, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.113, top1 = 59.59%], valid : [loss = 1.143, top1 = 59.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  384/15625) 000384-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.543, top1 = 88.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.342, top1 = 91.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.322, top1 = 91.22%], valid : [loss = 1.286, top1 = 68.15%], test : [loss = 1.305, top1 = 67.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.170, top1 = 43.59%], valid : [loss = 2.435, top1 = 37.57%], test : [loss = 2.438, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.60%], valid : [loss = 0.785, top1 = 72.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  385/15625) 000385-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.496, top1 = 90.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.324, top1 = 93.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.67 ms.
cifar100       train : [loss = 0.113, top1 = 97.83%], valid : [loss = 1.279, top1 = 69.90%], test : [loss = 1.296, top1 = 70.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 1.700, top1 = 54.41%], valid : [loss = 2.184, top1 = 43.93%], test : [loss = 2.206, top1 = 44.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  386/15625) 000386-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.24%], valid : [loss = 0.595, top1 = 82.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.180, top1 = 93.99%], test  : [loss = 0.436, top1 = 86.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.999, top1 = 71.10%], valid : [loss = 1.531, top1 = 59.28%], test : [loss = 1.550, top1 = 59.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 3.000, top1 = 26.87%], valid : [loss = 3.045, top1 = 26.33%], test : [loss = 3.076, top1 = 25.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 65.10%], valid : [loss = 1.016, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  387/15625) 000387-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.79 ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.61%], valid : [loss = 0.524, top1 = 82.43%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.25 ms.
cifar10        train : [loss = 0.399, top1 = 86.44%], test  : [loss = 0.463, top1 = 84.26%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.46 ms.
cifar100       train : [loss = 1.540, top1 = 57.68%], valid : [loss = 1.658, top1 = 54.49%], test : [loss = 1.658, top1 = 54.55%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.10 ms.
ImageNet16-120 train : [loss = 3.031, top1 = 26.47%], valid : [loss = 3.005, top1 = 27.72%], test : [loss = 3.045, top1 = 26.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  388/15625) 000388-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.481, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.65 ms.
cifar100       train : [loss = 0.316, top1 = 91.61%], valid : [loss = 1.265, top1 = 67.76%], test : [loss = 1.248, top1 = 68.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.79%], valid : [loss = 2.317, top1 = 40.95%], test : [loss = 2.328, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.585, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  389/15625) 000389-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.523, top1 = 88.46%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.55 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.330, top1 = 92.07%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.72 ms.
cifar100       train : [loss = 0.322, top1 = 91.31%], valid : [loss = 1.274, top1 = 67.23%], test : [loss = 1.273, top1 = 67.64%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.59 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.58%], valid : [loss = 2.275, top1 = 40.98%], test : [loss = 2.280, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.50%], valid : [loss = 0.810, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  390/15625) 000390-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.02 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.76%], valid : [loss = 0.851, top1 = 72.05%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.95 ms.
cifar10        train : [loss = 0.564, top1 = 80.28%], test  : [loss = 0.719, top1 = 75.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.02 ms.
cifar100       train : [loss = 1.783, top1 = 52.04%], valid : [loss = 2.066, top1 = 47.29%], test : [loss = 2.078, top1 = 46.69%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.11 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.83%], valid : [loss = 3.642, top1 = 16.79%], test : [loss = 3.667, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  391/15625) 000391-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.550, top1 = 88.63%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.80 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.356, top1 = 91.99%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.54 ms.
cifar100       train : [loss = 0.242, top1 = 93.56%], valid : [loss = 1.320, top1 = 67.69%], test : [loss = 1.338, top1 = 68.07%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.04 ms.
ImageNet16-120 train : [loss = 2.206, top1 = 42.78%], valid : [loss = 2.444, top1 = 37.93%], test : [loss = 2.444, top1 = 38.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.82%], valid : [loss = 0.895, top1 = 68.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  392/15625) 000392-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.468, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.323, top1 = 92.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.62 ms.
cifar100       train : [loss = 0.319, top1 = 91.52%], valid : [loss = 1.250, top1 = 67.69%], test : [loss = 1.254, top1 = 67.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.63%], valid : [loss = 2.312, top1 = 40.63%], test : [loss = 2.335, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.93%], valid : [loss = 0.600, top1 = 79.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  393/15625) 000393-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.496, top1 = 88.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.021, top1 = 99.48%], test  : [loss = 0.331, top1 = 91.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.405, top1 = 88.39%], valid : [loss = 1.313, top1 = 66.53%], test : [loss = 1.324, top1 = 66.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.62%], valid : [loss = 2.394, top1 = 39.43%], test : [loss = 2.446, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.50%], valid : [loss = 0.634, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  394/15625) 000394-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.513, top1 = 88.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.358, top1 = 90.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.12 ms.
cifar100       train : [loss = 0.474, top1 = 86.18%], valid : [loss = 1.326, top1 = 66.05%], test : [loss = 1.340, top1 = 65.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.13%], valid : [loss = 2.532, top1 = 36.29%], test : [loss = 2.542, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.28%], valid : [loss = 0.679, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  395/15625) 000395-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.18%], valid : [loss = 0.449, top1 = 87.15%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.116, top1 = 96.37%], test  : [loss = 0.325, top1 = 89.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.862, top1 = 75.60%], valid : [loss = 1.285, top1 = 64.43%], test : [loss = 1.271, top1 = 64.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.48%], valid : [loss = 2.626, top1 = 34.61%], test : [loss = 2.656, top1 = 33.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.61%], valid : [loss = 0.631, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  396/15625) 000396-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.67%], valid : [loss = 0.707, top1 = 75.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10        train : [loss = 0.546, top1 = 80.98%], test  : [loss = 0.606, top1 = 79.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.30 ms.
cifar100       train : [loss = 1.770, top1 = 51.97%], valid : [loss = 1.912, top1 = 49.39%], test : [loss = 1.940, top1 = 48.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.75 ms.
ImageNet16-120 train : [loss = 3.397, top1 = 20.02%], valid : [loss = 3.390, top1 = 20.27%], test : [loss = 3.419, top1 = 18.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.378, top1 = 49.92%], valid : [loss = 1.393, top1 = 49.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  397/15625) 000397-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.442, top1 = 89.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.302, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.44 ms.
cifar100       train : [loss = 0.208, top1 = 95.09%], valid : [loss = 1.280, top1 = 68.75%], test : [loss = 1.272, top1 = 68.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.47%], valid : [loss = 2.266, top1 = 42.09%], test : [loss = 2.298, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.448, top1 = 84.40%], valid : [loss = 0.546, top1 = 81.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  398/15625) 000398-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.497, top1 = 89.36%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.48 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.318, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.76 ms.
cifar100       train : [loss = 0.230, top1 = 94.13%], valid : [loss = 1.251, top1 = 68.91%], test : [loss = 1.284, top1 = 68.91%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.25%], valid : [loss = 2.235, top1 = 42.47%], test : [loss = 2.267, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.28%], valid : [loss = 0.611, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  399/15625) 000399-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.542, top1 = 88.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.346, top1 = 91.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.17 ms.
cifar100       train : [loss = 0.302, top1 = 91.79%], valid : [loss = 1.312, top1 = 66.65%], test : [loss = 1.320, top1 = 67.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.76%], valid : [loss = 2.438, top1 = 38.43%], test : [loss = 2.431, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.82%], valid : [loss = 0.894, top1 = 68.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  400/15625) 000400-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.555, top1 = 88.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.09 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.346, top1 = 92.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.30 ms.
cifar100       train : [loss = 0.248, top1 = 93.35%], valid : [loss = 1.319, top1 = 67.61%], test : [loss = 1.336, top1 = 67.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.204, top1 = 42.80%], valid : [loss = 2.422, top1 = 38.18%], test : [loss = 2.425, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  401/15625) 000401-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.17%], valid : [loss = 0.538, top1 = 84.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10        train : [loss = 0.173, top1 = 94.18%], test  : [loss = 0.377, top1 = 88.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.30 ms.
cifar100       train : [loss = 1.200, top1 = 65.94%], valid : [loss = 1.519, top1 = 58.22%], test : [loss = 1.511, top1 = 58.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.10%], valid : [loss = 2.664, top1 = 33.63%], test : [loss = 2.715, top1 = 32.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.60%], valid : [loss = 0.959, top1 = 66.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  402/15625) 000402-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.528, top1 = 88.63%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.17 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.333, top1 = 91.93%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.80 ms.
cifar100       train : [loss = 0.320, top1 = 91.33%], valid : [loss = 1.253, top1 = 67.86%], test : [loss = 1.268, top1 = 67.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.60%], valid : [loss = 2.327, top1 = 40.67%], test : [loss = 2.345, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.30%], valid : [loss = 0.746, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  403/15625) 000403-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.481, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.313, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.320, top1 = 91.36%], valid : [loss = 1.246, top1 = 67.78%], test : [loss = 1.243, top1 = 67.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.61%], valid : [loss = 2.305, top1 = 40.61%], test : [loss = 2.319, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  404/15625) 000404-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.516, top1 = 88.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.338, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.59 ms.
cifar100       train : [loss = 0.342, top1 = 90.55%], valid : [loss = 1.281, top1 = 67.29%], test : [loss = 1.281, top1 = 67.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.65%], valid : [loss = 2.404, top1 = 39.11%], test : [loss = 2.403, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  405/15625) 000405-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.13%], valid : [loss = 0.574, top1 = 86.48%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.05 ms.
cifar10        train : [loss = 0.065, top1 = 97.90%], test  : [loss = 0.371, top1 = 89.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.83 ms.
cifar100       train : [loss = 0.664, top1 = 80.40%], valid : [loss = 1.307, top1 = 64.55%], test : [loss = 1.322, top1 = 64.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.395, top1 = 38.74%], valid : [loss = 2.521, top1 = 36.70%], test : [loss = 2.562, top1 = 35.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.71%], valid : [loss = 0.891, top1 = 68.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  406/15625) 000406-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.41%], valid : [loss = 0.553, top1 = 87.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.034, top1 = 98.95%], test  : [loss = 0.351, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.436, top1 = 87.30%], valid : [loss = 1.306, top1 = 66.55%], test : [loss = 1.321, top1 = 66.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 2.831, top1 = 28.97%], valid : [loss = 2.889, top1 = 27.30%], test : [loss = 2.912, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.047, top1 = 62.06%], valid : [loss = 1.056, top1 = 62.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  407/15625) 000407-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.22 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.76%], valid : [loss = 0.862, top1 = 71.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10        train : [loss = 0.565, top1 = 80.12%], test  : [loss = 0.722, top1 = 75.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.97 ms.
cifar100       train : [loss = 1.783, top1 = 51.91%], valid : [loss = 2.050, top1 = 46.79%], test : [loss = 2.064, top1 = 46.83%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.75 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.82%], valid : [loss = 3.644, top1 = 16.29%], test : [loss = 3.668, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  408/15625) 000408-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.25%], valid : [loss = 0.582, top1 = 85.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 0.105, top1 = 96.57%], test  : [loss = 0.398, top1 = 88.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 0.825, top1 = 75.89%], valid : [loss = 1.420, top1 = 62.40%], test : [loss = 1.425, top1 = 62.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 32.98%], valid : [loss = 2.769, top1 = 31.67%], test : [loss = 2.807, top1 = 30.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  409/15625) 000409-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.19%], valid : [loss = 0.576, top1 = 86.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.063, top1 = 97.99%], test  : [loss = 0.354, top1 = 90.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.95 ms.
cifar100       train : [loss = 0.647, top1 = 80.98%], valid : [loss = 1.315, top1 = 64.72%], test : [loss = 1.307, top1 = 65.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.362, top1 = 39.41%], valid : [loss = 2.511, top1 = 36.10%], test : [loss = 2.540, top1 = 36.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.66%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  410/15625) 000410-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.476, top1 = 89.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.311, top1 = 92.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.256, top1 = 93.31%], valid : [loss = 1.206, top1 = 69.35%], test : [loss = 1.235, top1 = 69.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 49.97%], valid : [loss = 2.235, top1 = 41.93%], test : [loss = 2.235, top1 = 42.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  411/15625) 000411-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.508, top1 = 89.51%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.319, top1 = 93.04%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.73 ms.
cifar100       train : [loss = 0.133, top1 = 97.40%], valid : [loss = 1.289, top1 = 68.77%], test : [loss = 1.301, top1 = 69.34%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.33 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.84%], valid : [loss = 2.276, top1 = 42.11%], test : [loss = 2.272, top1 = 42.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.69%], valid : [loss = 0.680, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  412/15625) 000412-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.533, top1 = 88.98%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.34 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.345, top1 = 92.21%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.78 ms.
cifar100       train : [loss = 0.224, top1 = 94.05%], valid : [loss = 1.285, top1 = 68.21%], test : [loss = 1.289, top1 = 68.59%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.65 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.18%], valid : [loss = 2.278, top1 = 41.36%], test : [loss = 2.307, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.36%], valid : [loss = 0.915, top1 = 67.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  413/15625) 000413-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.525, top1 = 89.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.336, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.36 ms.
cifar100       train : [loss = 0.199, top1 = 95.07%], valid : [loss = 1.267, top1 = 69.06%], test : [loss = 1.289, top1 = 68.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.13 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.71%], valid : [loss = 2.282, top1 = 42.01%], test : [loss = 2.278, top1 = 42.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.48%], valid : [loss = 0.702, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  414/15625) 000414-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.211, top1 = 92.98%], valid : [loss = 0.487, top1 = 84.53%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10        train : [loss = 0.233, top1 = 92.14%], test  : [loss = 0.394, top1 = 86.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.33 ms.
cifar100       train : [loss = 1.332, top1 = 62.66%], valid : [loss = 1.584, top1 = 56.43%], test : [loss = 1.589, top1 = 55.81%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 3.246, top1 = 22.17%], valid : [loss = 3.227, top1 = 22.46%], test : [loss = 3.242, top1 = 22.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  415/15625) 000415-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.098, top1 = 97.04%], valid : [loss = 0.557, top1 = 84.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.127, top1 = 95.78%], test  : [loss = 0.374, top1 = 88.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.864, top1 = 74.80%], valid : [loss = 1.415, top1 = 62.11%], test : [loss = 1.419, top1 = 61.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 34.83%], valid : [loss = 2.642, top1 = 33.61%], test : [loss = 2.696, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.31%], valid : [loss = 0.924, top1 = 67.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  416/15625) 000416-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.539, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.358, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.411, top1 = 88.10%], valid : [loss = 1.258, top1 = 67.11%], test : [loss = 1.276, top1 = 67.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.16%], valid : [loss = 2.411, top1 = 38.62%], test : [loss = 2.437, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.96%], valid : [loss = 0.756, top1 = 73.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  417/15625) 000417-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.82%], valid : [loss = 0.847, top1 = 71.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.573, top1 = 80.06%], test  : [loss = 0.723, top1 = 75.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 1.798, top1 = 51.45%], valid : [loss = 2.062, top1 = 46.39%], test : [loss = 2.073, top1 = 46.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.68%], valid : [loss = 3.643, top1 = 16.51%], test : [loss = 3.669, top1 = 15.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  418/15625) 000418-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.483, top1 = 89.09%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.34 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.324, top1 = 92.03%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.05 ms.
cifar100       train : [loss = 0.253, top1 = 93.55%], valid : [loss = 1.218, top1 = 68.79%], test : [loss = 1.198, top1 = 69.33%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.76%], valid : [loss = 2.198, top1 = 43.02%], test : [loss = 2.216, top1 = 43.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.34%], valid : [loss = 0.715, top1 = 75.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  419/15625) 000419-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.80%], valid : [loss = 0.484, top1 = 84.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10        train : [loss = 0.298, top1 = 90.00%], test  : [loss = 0.399, top1 = 86.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.15 ms.
cifar100       train : [loss = 1.327, top1 = 63.19%], valid : [loss = 1.531, top1 = 58.05%], test : [loss = 1.510, top1 = 58.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.67%], valid : [loss = 2.910, top1 = 29.14%], test : [loss = 2.965, top1 = 28.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  420/15625) 000420-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.66%], valid : [loss = 0.542, top1 = 82.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.03 ms.
cifar10        train : [loss = 0.237, top1 = 91.85%], test  : [loss = 0.393, top1 = 87.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.64 ms.
cifar100       train : [loss = 1.348, top1 = 62.00%], valid : [loss = 1.614, top1 = 55.96%], test : [loss = 1.611, top1 = 56.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.832, top1 = 30.04%], valid : [loss = 2.861, top1 = 29.62%], test : [loss = 2.906, top1 = 28.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.11%], valid : [loss = 1.038, top1 = 63.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  421/15625) 000421-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.511, top1 = 88.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.027, top1 = 99.26%], test  : [loss = 0.348, top1 = 91.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.40 ms.
cifar100       train : [loss = 0.475, top1 = 85.98%], valid : [loss = 1.328, top1 = 66.15%], test : [loss = 1.330, top1 = 65.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.21%], valid : [loss = 2.534, top1 = 36.31%], test : [loss = 2.556, top1 = 35.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  422/15625) 000422-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.485, top1 = 88.91%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.64 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.313, top1 = 92.03%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.32 ms.
cifar100       train : [loss = 0.267, top1 = 93.26%], valid : [loss = 1.201, top1 = 68.95%], test : [loss = 1.212, top1 = 68.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.76%], valid : [loss = 2.238, top1 = 42.79%], test : [loss = 2.255, top1 = 42.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.62%], valid : [loss = 0.733, top1 = 74.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  423/15625) 000423-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.335, top1 = 88.47%], valid : [loss = 0.564, top1 = 81.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10        train : [loss = 0.306, top1 = 89.52%], test  : [loss = 0.445, top1 = 85.29%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.29 ms.
cifar100       train : [loss = 1.560, top1 = 56.66%], valid : [loss = 1.784, top1 = 51.88%], test : [loss = 1.776, top1 = 51.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 3.074, top1 = 25.33%], valid : [loss = 3.081, top1 = 25.70%], test : [loss = 3.127, top1 = 24.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.21%], valid : [loss = 1.067, top1 = 62.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  424/15625) 000424-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.26%], valid : [loss = 0.471, top1 = 85.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.158, top1 = 94.87%], test  : [loss = 0.346, top1 = 88.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.90 ms.
cifar100       train : [loss = 0.989, top1 = 71.83%], valid : [loss = 1.347, top1 = 62.51%], test : [loss = 1.353, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.97%], valid : [loss = 2.675, top1 = 32.98%], test : [loss = 2.709, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  425/15625) 000425-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.436, top1 = 90.42%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.86 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.306, top1 = 93.18%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.72 ms.
cifar100       train : [loss = 0.059, top1 = 99.21%], valid : [loss = 1.367, top1 = 69.95%], test : [loss = 1.385, top1 = 69.53%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 1.526, top1 = 58.75%], valid : [loss = 2.276, top1 = 43.98%], test : [loss = 2.296, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 85.09%], valid : [loss = 0.554, top1 = 81.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  426/15625) 000426-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.64 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.25 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  427/15625) 000427-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.23%], valid : [loss = 0.460, top1 = 86.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.162, top1 = 94.65%], test  : [loss = 0.344, top1 = 88.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 1.027, top1 = 70.84%], valid : [loss = 1.382, top1 = 61.70%], test : [loss = 1.382, top1 = 61.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.67%], valid : [loss = 2.703, top1 = 33.01%], test : [loss = 2.719, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  428/15625) 000428-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.450, top1 = 89.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.71 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.302, top1 = 92.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.187, top1 = 95.74%], valid : [loss = 1.267, top1 = 69.39%], test : [loss = 1.256, top1 = 69.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.84%], valid : [loss = 2.259, top1 = 42.41%], test : [loss = 2.250, top1 = 43.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.415, top1 = 85.73%], valid : [loss = 0.535, top1 = 82.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  429/15625) 000429-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.638, top1 = 86.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.428, top1 = 90.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.60 ms.
cifar100       train : [loss = 0.185, top1 = 95.75%], valid : [loss = 1.577, top1 = 65.03%], test : [loss = 1.575, top1 = 64.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.87%], valid : [loss = 2.547, top1 = 35.96%], test : [loss = 2.561, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.00%], valid : [loss = 0.760, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  430/15625) 000430-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.137, top1 = 97.23%], valid : [loss = 1.311, top1 = 68.85%], test : [loss = 1.307, top1 = 68.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.36%], valid : [loss = 2.271, top1 = 42.06%], test : [loss = 2.257, top1 = 43.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  431/15625) 000431-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.523, top1 = 88.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.334, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 0.337, top1 = 90.84%], valid : [loss = 1.280, top1 = 67.41%], test : [loss = 1.288, top1 = 67.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.66 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.73%], valid : [loss = 2.405, top1 = 39.31%], test : [loss = 2.404, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  432/15625) 000432-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.23 ms.
cifar10-valid  train : [loss = 1.804, top1 = 34.74%], valid : [loss = 1.827, top1 = 33.81%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.21 ms.
cifar10        train : [loss = 1.192, top1 = 57.34%], test  : [loss = 1.192, top1 = 56.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.31 ms.
cifar100       train : [loss = 3.772, top1 = 12.46%], valid : [loss = 3.858, top1 = 10.70%], test : [loss = 3.851, top1 = 11.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.06 ms.
ImageNet16-120 train : [loss = 3.747, top1 = 14.08%], valid : [loss = 3.712, top1 = 15.29%], test : [loss = 3.730, top1 = 14.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  433/15625) 000433-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.700, top1 = 84.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10        train : [loss = 0.053, top1 = 98.38%], test  : [loss = 0.444, top1 = 88.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.18 ms.
cifar100       train : [loss = 0.633, top1 = 81.53%], valid : [loss = 1.535, top1 = 60.95%], test : [loss = 1.495, top1 = 61.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.37%], valid : [loss = 2.821, top1 = 30.14%], test : [loss = 2.873, top1 = 30.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  434/15625) 000434-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.87%], valid : [loss = 0.551, top1 = 82.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.37 ms.
cifar10        train : [loss = 0.242, top1 = 91.70%], test  : [loss = 0.407, top1 = 86.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.83 ms.
cifar100       train : [loss = 1.337, top1 = 62.18%], valid : [loss = 1.636, top1 = 55.78%], test : [loss = 1.616, top1 = 56.01%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.859, top1 = 29.52%], valid : [loss = 2.865, top1 = 29.67%], test : [loss = 2.936, top1 = 28.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 66.00%], valid : [loss = 1.016, top1 = 64.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  435/15625) 000435-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.87%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.15%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.74 ms.
cifar100       train : [loss = 0.083, top1 = 98.57%], valid : [loss = 1.308, top1 = 69.96%], test : [loss = 1.301, top1 = 70.41%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 1.608, top1 = 56.68%], valid : [loss = 2.181, top1 = 44.29%], test : [loss = 2.157, top1 = 45.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.53%], valid : [loss = 0.677, top1 = 76.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  436/15625) 000436-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.53 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.623, top1 = 86.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10        train : [loss = 0.028, top1 = 99.26%], test  : [loss = 0.409, top1 = 89.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.10 ms.
cifar100       train : [loss = 0.486, top1 = 85.87%], valid : [loss = 1.418, top1 = 64.23%], test : [loss = 1.405, top1 = 64.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.418, top1 = 38.38%], valid : [loss = 2.585, top1 = 34.99%], test : [loss = 2.626, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.30%], valid : [loss = 0.867, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  437/15625) 000437-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.37%], valid : [loss = 0.865, top1 = 71.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10        train : [loss = 0.548, top1 = 80.83%], test  : [loss = 0.710, top1 = 75.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.81 ms.
cifar100       train : [loss = 1.771, top1 = 52.24%], valid : [loss = 2.052, top1 = 47.03%], test : [loss = 2.071, top1 = 46.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.92%], valid : [loss = 3.638, top1 = 17.00%], test : [loss = 3.666, top1 = 15.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  438/15625) 000438-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.576, top1 = 87.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.393, top1 = 90.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.19 ms.
cifar100       train : [loss = 0.406, top1 = 88.38%], valid : [loss = 1.412, top1 = 65.03%], test : [loss = 1.408, top1 = 65.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.84%], valid : [loss = 2.528, top1 = 36.22%], test : [loss = 2.529, top1 = 36.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.29%], valid : [loss = 0.767, top1 = 73.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  439/15625) 000439-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.485, top1 = 89.78%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.71 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.287, top1 = 93.53%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.07 ms.
cifar100       train : [loss = 0.105, top1 = 98.14%], valid : [loss = 1.244, top1 = 70.39%], test : [loss = 1.242, top1 = 70.66%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 1.702, top1 = 54.51%], valid : [loss = 2.146, top1 = 44.27%], test : [loss = 2.147, top1 = 45.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.577, top1 = 79.80%], valid : [loss = 0.674, top1 = 76.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  440/15625) 000440-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=22.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.510, top1 = 90.03%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=23.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.305, top1 = 93.47%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=23.12 ms.
cifar100       train : [loss = 0.043, top1 = 99.48%], valid : [loss = 1.343, top1 = 70.60%], test : [loss = 1.340, top1 = 70.41%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=23.31 ms.
ImageNet16-120 train : [loss = 1.784, top1 = 52.45%], valid : [loss = 2.269, top1 = 42.33%], test : [loss = 2.241, top1 = 43.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.84%], valid : [loss = 0.711, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  441/15625) 000441-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.56 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  442/15625) 000442-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.56%], valid : [loss = 0.859, top1 = 71.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.554, top1 = 80.67%], test  : [loss = 0.718, top1 = 75.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.81 ms.
cifar100       train : [loss = 1.774, top1 = 52.17%], valid : [loss = 2.048, top1 = 47.29%], test : [loss = 2.060, top1 = 46.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.81%], valid : [loss = 3.637, top1 = 16.70%], test : [loss = 3.663, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.203, top1 = 56.89%], valid : [loss = 1.260, top1 = 54.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  443/15625) 000443-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.56%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.67 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.383, top1 = 92.24%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.93 ms.
cifar100       train : [loss = 0.094, top1 = 98.35%], valid : [loss = 1.522, top1 = 67.13%], test : [loss = 1.504, top1 = 67.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.85%], valid : [loss = 2.435, top1 = 39.62%], test : [loss = 2.440, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.24%], valid : [loss = 0.776, top1 = 72.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  444/15625) 000444-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.538, top1 = 88.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.379, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.43 ms.
cifar100       train : [loss = 0.094, top1 = 98.26%], valid : [loss = 1.477, top1 = 67.64%], test : [loss = 1.479, top1 = 67.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.32%], valid : [loss = 2.371, top1 = 41.09%], test : [loss = 2.382, top1 = 41.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.83%], valid : [loss = 0.675, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  445/15625) 000445-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.623, top1 = 86.36%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.78 ms.
cifar10        train : [loss = 0.029, top1 = 99.31%], test  : [loss = 0.414, top1 = 89.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.50 ms.
cifar100       train : [loss = 0.377, top1 = 89.93%], valid : [loss = 1.422, top1 = 64.78%], test : [loss = 1.432, top1 = 64.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.00%], valid : [loss = 2.623, top1 = 34.41%], test : [loss = 2.643, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.58%], valid : [loss = 0.755, top1 = 73.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  446/15625) 000446-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.434, top1 = 89.96%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.64 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.283, top1 = 92.97%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.81 ms.
cifar100       train : [loss = 0.131, top1 = 97.55%], valid : [loss = 1.266, top1 = 69.63%], test : [loss = 1.253, top1 = 70.05%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 1.667, top1 = 55.39%], valid : [loss = 2.201, top1 = 43.89%], test : [loss = 2.212, top1 = 44.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.410, top1 = 85.80%], valid : [loss = 0.520, top1 = 82.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  447/15625) 000447-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.47%], valid : [loss = 0.694, top1 = 84.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.054, top1 = 98.35%], test  : [loss = 0.436, top1 = 88.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.60 ms.
cifar100       train : [loss = 0.623, top1 = 81.78%], valid : [loss = 1.506, top1 = 61.87%], test : [loss = 1.507, top1 = 62.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.44%], valid : [loss = 2.828, top1 = 30.32%], test : [loss = 2.881, top1 = 29.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  448/15625) 000448-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.574, top1 = 88.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.359, top1 = 92.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.200, top1 = 94.87%], valid : [loss = 1.395, top1 = 66.79%], test : [loss = 1.395, top1 = 67.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.35%], valid : [loss = 2.431, top1 = 37.99%], test : [loss = 2.452, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.10%], valid : [loss = 0.952, top1 = 65.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  449/15625) 000449-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.345, top1 = 87.99%], valid : [loss = 0.577, top1 = 81.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.14 ms.
cifar10        train : [loss = 0.300, top1 = 89.70%], test  : [loss = 0.445, top1 = 85.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.28 ms.
cifar100       train : [loss = 1.526, top1 = 57.44%], valid : [loss = 1.759, top1 = 52.53%], test : [loss = 1.751, top1 = 52.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.94 ms.
ImageNet16-120 train : [loss = 3.008, top1 = 26.56%], valid : [loss = 3.004, top1 = 26.99%], test : [loss = 3.062, top1 = 25.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 63.06%], valid : [loss = 1.080, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  450/15625) 000450-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.526, top1 = 88.55%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.44 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.353, top1 = 91.84%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.22 ms.
cifar100       train : [loss = 0.259, top1 = 93.54%], valid : [loss = 1.308, top1 = 67.31%], test : [loss = 1.315, top1 = 67.43%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.70 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.67%], valid : [loss = 2.308, top1 = 40.73%], test : [loss = 2.318, top1 = 40.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.35%], valid : [loss = 0.863, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  451/15625) 000451-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.590, top1 = 87.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.375, top1 = 91.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 0.404, top1 = 88.56%], valid : [loss = 1.423, top1 = 64.81%], test : [loss = 1.395, top1 = 65.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.84%], valid : [loss = 2.524, top1 = 36.94%], test : [loss = 2.535, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.12%], valid : [loss = 0.811, top1 = 71.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  452/15625) 000452-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.50%], valid : [loss = 0.759, top1 = 79.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.190, top1 = 93.40%], test  : [loss = 0.529, top1 = 84.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 0.905, top1 = 73.61%], valid : [loss = 1.664, top1 = 56.54%], test : [loss = 1.688, top1 = 56.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 3.435, top1 = 17.96%], valid : [loss = 3.448, top1 = 18.40%], test : [loss = 3.459, top1 = 17.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.11%], valid : [loss = 1.270, top1 = 54.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  453/15625) 000453-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.316, top1 = 92.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.35 ms.
cifar100       train : [loss = 0.328, top1 = 90.99%], valid : [loss = 1.298, top1 = 67.04%], test : [loss = 1.301, top1 = 67.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.28%], valid : [loss = 2.356, top1 = 40.16%], test : [loss = 2.397, top1 = 39.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 84.06%], valid : [loss = 0.552, top1 = 81.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  454/15625) 000454-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.476, top1 = 89.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.313, top1 = 92.50%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.55 ms.
cifar100       train : [loss = 0.316, top1 = 91.59%], valid : [loss = 1.250, top1 = 67.93%], test : [loss = 1.250, top1 = 68.25%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.65%], valid : [loss = 2.318, top1 = 40.94%], test : [loss = 2.326, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.32%], valid : [loss = 0.581, top1 = 80.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  455/15625) 000455-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.433, top1 = 90.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.292, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.09 ms.
cifar100       train : [loss = 0.117, top1 = 97.94%], valid : [loss = 1.290, top1 = 69.47%], test : [loss = 1.299, top1 = 69.17%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.42%], valid : [loss = 2.204, top1 = 44.26%], test : [loss = 2.233, top1 = 43.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.412, top1 = 85.95%], valid : [loss = 0.523, top1 = 82.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  456/15625) 000456-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.569, top1 = 88.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.384, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.24 ms.
cifar100       train : [loss = 0.122, top1 = 97.65%], valid : [loss = 1.530, top1 = 66.65%], test : [loss = 1.545, top1 = 66.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.85%], valid : [loss = 2.429, top1 = 39.99%], test : [loss = 2.426, top1 = 39.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.70%], valid : [loss = 0.740, top1 = 74.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  457/15625) 000457-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.183, top1 = 93.94%], valid : [loss = 0.535, top1 = 84.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10        train : [loss = 0.192, top1 = 93.49%], test  : [loss = 0.378, top1 = 87.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 1.186, top1 = 66.15%], valid : [loss = 1.513, top1 = 58.77%], test : [loss = 1.504, top1 = 58.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.31%], valid : [loss = 2.708, top1 = 32.50%], test : [loss = 2.745, top1 = 31.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 66.93%], valid : [loss = 0.966, top1 = 65.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  458/15625) 000458-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.571, top1 = 88.62%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.53 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.372, top1 = 92.47%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.67 ms.
cifar100       train : [loss = 0.054, top1 = 99.37%], valid : [loss = 1.433, top1 = 68.93%], test : [loss = 1.433, top1 = 69.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.41 ms.
ImageNet16-120 train : [loss = 1.692, top1 = 54.85%], valid : [loss = 2.414, top1 = 40.61%], test : [loss = 2.442, top1 = 40.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.06%], valid : [loss = 0.725, top1 = 75.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  459/15625) 000459-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.312, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.20 ms.
cifar100       train : [loss = 0.331, top1 = 90.94%], valid : [loss = 1.295, top1 = 67.32%], test : [loss = 1.311, top1 = 67.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.04%], valid : [loss = 2.366, top1 = 40.06%], test : [loss = 2.411, top1 = 40.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.94%], valid : [loss = 0.567, top1 = 80.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  460/15625) 000460-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.478, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.311, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.320, top1 = 91.46%], valid : [loss = 1.242, top1 = 67.75%], test : [loss = 1.244, top1 = 68.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.68%], valid : [loss = 2.311, top1 = 40.82%], test : [loss = 2.339, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  461/15625) 000461-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.533, top1 = 88.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.91 ms.
cifar10        train : [loss = 0.025, top1 = 99.30%], test  : [loss = 0.359, top1 = 91.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.406, top1 = 88.29%], valid : [loss = 1.267, top1 = 66.88%], test : [loss = 1.277, top1 = 67.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.211, top1 = 42.78%], valid : [loss = 2.404, top1 = 38.60%], test : [loss = 2.432, top1 = 38.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.56%], valid : [loss = 0.759, top1 = 73.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  462/15625) 000462-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.25%], valid : [loss = 0.611, top1 = 85.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.072, top1 = 97.80%], test  : [loss = 0.399, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.70 ms.
cifar100       train : [loss = 0.716, top1 = 79.28%], valid : [loss = 1.384, top1 = 63.41%], test : [loss = 1.387, top1 = 63.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.74%], valid : [loss = 2.661, top1 = 33.39%], test : [loss = 2.712, top1 = 33.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  463/15625) 000463-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.570, top1 = 87.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.389, top1 = 91.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.06 ms.
cifar100       train : [loss = 0.290, top1 = 92.20%], valid : [loss = 1.430, top1 = 65.63%], test : [loss = 1.434, top1 = 65.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.68%], valid : [loss = 2.431, top1 = 38.56%], test : [loss = 2.468, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.38%], valid : [loss = 0.813, top1 = 71.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  464/15625) 000464-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.81%], valid : [loss = 0.476, top1 = 84.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.299, top1 = 90.02%], test  : [loss = 0.395, top1 = 86.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 1.330, top1 = 63.10%], valid : [loss = 1.542, top1 = 57.78%], test : [loss = 1.523, top1 = 57.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.86%], valid : [loss = 2.899, top1 = 30.01%], test : [loss = 2.947, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  465/15625) 000465-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.55 ms.
cifar10-valid  train : [loss = 0.879, top1 = 69.63%], valid : [loss = 0.917, top1 = 68.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.37 ms.
cifar10        train : [loss = 0.843, top1 = 71.17%], test  : [loss = 0.847, top1 = 70.52%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.34 ms.
cifar100       train : [loss = 2.310, top1 = 40.95%], valid : [loss = 2.364, top1 = 38.95%], test : [loss = 2.358, top1 = 39.71%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.79 ms.
ImageNet16-120 train : [loss = 3.487, top1 = 18.51%], valid : [loss = 3.474, top1 = 19.06%], test : [loss = 3.487, top1 = 18.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.717, top1 = 36.06%], valid : [loss = 1.723, top1 = 35.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  466/15625) 000466-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.517, top1 = 89.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.88 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.324, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.10 ms.
cifar100       train : [loss = 0.119, top1 = 97.64%], valid : [loss = 1.312, top1 = 68.93%], test : [loss = 1.298, top1 = 69.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.01%], valid : [loss = 2.191, top1 = 43.91%], test : [loss = 2.196, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.34%], valid : [loss = 0.647, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  467/15625) 000467-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.90%], valid : [loss = 0.748, top1 = 74.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10        train : [loss = 0.553, top1 = 80.66%], test  : [loss = 0.633, top1 = 78.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 1.948, top1 = 46.97%], valid : [loss = 2.086, top1 = 44.29%], test : [loss = 2.081, top1 = 44.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.06 ms.
ImageNet16-120 train : [loss = 3.009, top1 = 26.45%], valid : [loss = 2.984, top1 = 27.17%], test : [loss = 3.033, top1 = 25.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.171, top1 = 57.84%], valid : [loss = 1.212, top1 = 57.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  468/15625) 000468-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.363, top1 = 87.29%], valid : [loss = 0.617, top1 = 79.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.309, top1 = 89.29%], test  : [loss = 0.445, top1 = 85.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 1.499, top1 = 58.14%], valid : [loss = 1.730, top1 = 53.43%], test : [loss = 1.725, top1 = 53.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.15%], valid : [loss = 3.041, top1 = 26.33%], test : [loss = 3.083, top1 = 25.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.88%], valid : [loss = 1.021, top1 = 63.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  469/15625) 000469-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.576, top1 = 88.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.378, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.63 ms.
cifar100       train : [loss = 0.149, top1 = 96.92%], valid : [loss = 1.441, top1 = 67.36%], test : [loss = 1.459, top1 = 67.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.55%], valid : [loss = 2.472, top1 = 38.36%], test : [loss = 2.462, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.28%], valid : [loss = 0.717, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  470/15625) 000470-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.542, top1 = 88.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.347, top1 = 91.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.58 ms.
cifar100       train : [loss = 0.327, top1 = 91.02%], valid : [loss = 1.297, top1 = 67.13%], test : [loss = 1.302, top1 = 67.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 44.01%], valid : [loss = 2.418, top1 = 38.79%], test : [loss = 2.435, top1 = 38.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.682, top1 = 76.25%], valid : [loss = 0.735, top1 = 74.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  471/15625) 000471-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.545, top1 = 88.37%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.32 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.348, top1 = 91.74%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.71 ms.
cifar100       train : [loss = 0.302, top1 = 91.79%], valid : [loss = 1.307, top1 = 66.95%], test : [loss = 1.313, top1 = 67.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.92%], valid : [loss = 2.417, top1 = 38.62%], test : [loss = 2.431, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.59%], valid : [loss = 0.869, top1 = 69.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  472/15625) 000472-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.530, top1 = 88.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.348, top1 = 91.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.32 ms.
cifar100       train : [loss = 0.332, top1 = 90.97%], valid : [loss = 1.289, top1 = 66.71%], test : [loss = 1.275, top1 = 67.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.78%], valid : [loss = 2.394, top1 = 39.17%], test : [loss = 2.398, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.92%], valid : [loss = 0.769, top1 = 73.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  473/15625) 000473-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.50%], valid : [loss = 0.635, top1 = 86.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 0.045, top1 = 98.72%], test  : [loss = 0.433, top1 = 89.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.28 ms.
cifar100       train : [loss = 0.505, top1 = 85.51%], valid : [loss = 1.413, top1 = 64.39%], test : [loss = 1.422, top1 = 64.43%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.446, top1 = 37.82%], valid : [loss = 2.684, top1 = 33.78%], test : [loss = 2.721, top1 = 33.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.42%], valid : [loss = 0.716, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  474/15625) 000474-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.306, top1 = 89.50%], valid : [loss = 0.560, top1 = 82.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.297, top1 = 89.73%], test  : [loss = 0.424, top1 = 85.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 1.304, top1 = 63.34%], valid : [loss = 1.592, top1 = 56.72%], test : [loss = 1.590, top1 = 56.66%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 3.066, top1 = 25.89%], valid : [loss = 3.074, top1 = 26.11%], test : [loss = 3.141, top1 = 25.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.18%], valid : [loss = 1.248, top1 = 54.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  475/15625) 000475-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.35%], valid : [loss = 0.529, top1 = 82.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.400, top1 = 86.42%], test  : [loss = 0.461, top1 = 84.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.86 ms.
cifar100       train : [loss = 1.535, top1 = 57.72%], valid : [loss = 1.655, top1 = 54.81%], test : [loss = 1.637, top1 = 55.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.46%], valid : [loss = 3.016, top1 = 27.18%], test : [loss = 3.050, top1 = 26.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.134, top1 = 59.92%], valid : [loss = 1.146, top1 = 59.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  476/15625) 000476-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.620, top1 = 87.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.400, top1 = 91.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.61 ms.
cifar100       train : [loss = 0.122, top1 = 97.38%], valid : [loss = 1.555, top1 = 65.91%], test : [loss = 1.575, top1 = 65.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.84%], valid : [loss = 2.443, top1 = 38.42%], test : [loss = 2.440, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 76.76%], valid : [loss = 0.739, top1 = 74.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  477/15625) 000477-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.77%], valid : [loss = 0.490, top1 = 84.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.85 ms.
cifar10        train : [loss = 0.260, top1 = 91.19%], test  : [loss = 0.412, top1 = 86.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.89 ms.
cifar100       train : [loss = 1.266, top1 = 64.48%], valid : [loss = 1.539, top1 = 57.43%], test : [loss = 1.531, top1 = 57.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 3.385, top1 = 19.94%], valid : [loss = 3.394, top1 = 20.09%], test : [loss = 3.403, top1 = 19.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.047, top1 = 62.37%], valid : [loss = 1.052, top1 = 61.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  478/15625) 000478-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.474, top1 = 89.12%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.04 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.314, top1 = 92.19%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.31 ms.
cifar100       train : [loss = 0.293, top1 = 92.00%], valid : [loss = 1.321, top1 = 67.54%], test : [loss = 1.332, top1 = 67.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.020, top1 = 47.17%], valid : [loss = 2.353, top1 = 40.43%], test : [loss = 2.377, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.61%], valid : [loss = 0.651, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  479/15625) 000479-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.62%], valid : [loss = 0.438, top1 = 87.91%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.39 ms.
cifar10        train : [loss = 0.055, top1 = 98.65%], test  : [loss = 0.312, top1 = 90.62%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.17 ms.
cifar100       train : [loss = 0.544, top1 = 85.15%], valid : [loss = 1.194, top1 = 67.66%], test : [loss = 1.203, top1 = 66.99%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.90%], valid : [loss = 2.461, top1 = 38.61%], test : [loss = 2.469, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.93%], valid : [loss = 0.621, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  480/15625) 000480-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.546, top1 = 89.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.368, top1 = 92.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.087, top1 = 98.54%], valid : [loss = 1.469, top1 = 68.17%], test : [loss = 1.441, top1 = 68.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 1.786, top1 = 52.53%], valid : [loss = 2.386, top1 = 40.37%], test : [loss = 2.399, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.23%], valid : [loss = 0.674, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  481/15625) 000481-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.310, top1 = 89.29%], valid : [loss = 0.556, top1 = 82.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.85 ms.
cifar10        train : [loss = 0.254, top1 = 91.26%], test  : [loss = 0.413, top1 = 86.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 1.446, top1 = 59.40%], valid : [loss = 1.688, top1 = 53.24%], test : [loss = 1.680, top1 = 53.97%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.883, top1 = 28.85%], valid : [loss = 2.906, top1 = 29.04%], test : [loss = 2.942, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.982, top1 = 64.81%], valid : [loss = 1.023, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  482/15625) 000482-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.097, top1 = 96.76%], valid : [loss = 0.603, top1 = 84.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.105, top1 = 96.50%], test  : [loss = 0.429, top1 = 88.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.791, top1 = 76.79%], valid : [loss = 1.617, top1 = 58.16%], test : [loss = 1.603, top1 = 58.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 3.691, top1 = 13.24%], valid : [loss = 3.669, top1 = 14.07%], test : [loss = 3.671, top1 = 13.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.282, top1 = 52.68%], valid : [loss = 1.312, top1 = 51.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  483/15625) 000483-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.71%], valid : [loss = 0.613, top1 = 86.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.031, top1 = 99.16%], test  : [loss = 0.414, top1 = 89.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.512, top1 = 85.05%], valid : [loss = 1.413, top1 = 64.29%], test : [loss = 1.405, top1 = 64.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.30%], valid : [loss = 2.558, top1 = 35.42%], test : [loss = 2.583, top1 = 35.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.00%], valid : [loss = 0.825, top1 = 71.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  484/15625) 000484-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.551, top1 = 88.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.345, top1 = 91.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 0.326, top1 = 90.89%], valid : [loss = 1.336, top1 = 66.79%], test : [loss = 1.356, top1 = 66.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.34%], valid : [loss = 2.455, top1 = 37.77%], test : [loss = 2.466, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.74%], valid : [loss = 0.916, top1 = 67.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  485/15625) 000485-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.50%], valid : [loss = 0.445, top1 = 87.86%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.12 ms.
cifar10        train : [loss = 0.059, top1 = 98.51%], test  : [loss = 0.327, top1 = 90.21%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.13 ms.
cifar100       train : [loss = 0.558, top1 = 84.84%], valid : [loss = 1.226, top1 = 66.67%], test : [loss = 1.204, top1 = 67.59%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.274, top1 = 41.58%], valid : [loss = 2.461, top1 = 38.17%], test : [loss = 2.487, top1 = 37.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.58%], valid : [loss = 0.659, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  486/15625) 000486-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.514, top1 = 88.67%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.334, top1 = 91.83%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.71 ms.
cifar100       train : [loss = 0.327, top1 = 91.20%], valid : [loss = 1.283, top1 = 67.03%], test : [loss = 1.290, top1 = 67.33%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.39 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.12%], valid : [loss = 2.401, top1 = 38.81%], test : [loss = 2.398, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  487/15625) 000487-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.476, top1 = 90.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.06 ms.
cifar100       train : [loss = 0.102, top1 = 98.19%], valid : [loss = 1.278, top1 = 69.93%], test : [loss = 1.267, top1 = 70.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 1.668, top1 = 55.30%], valid : [loss = 2.165, top1 = 44.24%], test : [loss = 2.178, top1 = 44.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.82%], valid : [loss = 0.640, top1 = 78.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  488/15625) 000488-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.521, top1 = 88.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.327, top1 = 92.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.327, top1 = 91.18%], valid : [loss = 1.289, top1 = 66.86%], test : [loss = 1.278, top1 = 67.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.16%], valid : [loss = 2.396, top1 = 38.74%], test : [loss = 2.399, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  489/15625) 000489-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.20%], valid : [loss = 0.606, top1 = 85.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.072, top1 = 97.81%], test  : [loss = 0.403, top1 = 88.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.708, top1 = 79.44%], valid : [loss = 1.384, top1 = 63.19%], test : [loss = 1.382, top1 = 63.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.46%], valid : [loss = 2.672, top1 = 33.39%], test : [loss = 2.709, top1 = 32.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.18%], valid : [loss = 0.787, top1 = 72.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  490/15625) 000490-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.505, top1 = 89.86%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.02 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.321, top1 = 93.09%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.47 ms.
cifar100       train : [loss = 0.065, top1 = 99.13%], valid : [loss = 1.355, top1 = 69.80%], test : [loss = 1.345, top1 = 69.43%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 1.717, top1 = 54.14%], valid : [loss = 2.206, top1 = 43.70%], test : [loss = 2.227, top1 = 43.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.47%], valid : [loss = 0.663, top1 = 77.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  491/15625) 000491-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.466, top1 = 89.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.291, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.91 ms.
cifar100       train : [loss = 0.123, top1 = 97.68%], valid : [loss = 1.290, top1 = 69.41%], test : [loss = 1.242, top1 = 70.51%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.77 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.75%], valid : [loss = 2.177, top1 = 43.79%], test : [loss = 2.204, top1 = 44.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.46%], valid : [loss = 0.642, top1 = 77.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  492/15625) 000492-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.308, top1 = 92.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.79 ms.
cifar100       train : [loss = 0.320, top1 = 91.32%], valid : [loss = 1.305, top1 = 67.20%], test : [loss = 1.321, top1 = 66.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.25%], valid : [loss = 2.368, top1 = 39.97%], test : [loss = 2.409, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.553, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  493/15625) 000493-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.18%], valid : [loss = 0.580, top1 = 86.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10        train : [loss = 0.061, top1 = 98.02%], test  : [loss = 0.379, top1 = 90.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 0.659, top1 = 80.43%], valid : [loss = 1.322, top1 = 64.45%], test : [loss = 1.320, top1 = 64.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.353, top1 = 39.64%], valid : [loss = 2.479, top1 = 36.69%], test : [loss = 2.502, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  494/15625) 000494-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.264, top1 = 90.97%], valid : [loss = 1.040, top1 = 72.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.329, top1 = 88.52%], test  : [loss = 0.691, top1 = 78.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.87 ms.
cifar100       train : [loss = 1.351, top1 = 62.24%], valid : [loss = 1.924, top1 = 50.13%], test : [loss = 1.932, top1 = 50.69%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 3.408, top1 = 19.73%], valid : [loss = 3.510, top1 = 17.92%], test : [loss = 3.550, top1 = 17.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.162, top1 = 58.08%], valid : [loss = 1.231, top1 = 56.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  495/15625) 000495-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.513, top1 = 88.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.340, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.23 ms.
cifar100       train : [loss = 0.320, top1 = 91.37%], valid : [loss = 1.279, top1 = 67.13%], test : [loss = 1.283, top1 = 67.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.03%], valid : [loss = 2.400, top1 = 39.37%], test : [loss = 2.418, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  496/15625) 000496-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.537, top1 = 88.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.024, top1 = 99.31%], test  : [loss = 0.346, top1 = 91.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.54 ms.
cifar100       train : [loss = 0.423, top1 = 87.78%], valid : [loss = 1.263, top1 = 67.14%], test : [loss = 1.288, top1 = 66.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.77%], valid : [loss = 2.400, top1 = 39.29%], test : [loss = 2.435, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.52%], valid : [loss = 0.764, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  497/15625) 000497-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.453, top1 = 90.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.300, top1 = 93.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.65 ms.
cifar100       train : [loss = 0.071, top1 = 98.89%], valid : [loss = 1.377, top1 = 69.57%], test : [loss = 1.335, top1 = 70.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 1.558, top1 = 57.94%], valid : [loss = 2.263, top1 = 43.37%], test : [loss = 2.285, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.84%], valid : [loss = 0.498, top1 = 83.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  498/15625) 000498-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.49 ms.
cifar10-valid  train : [loss = 1.804, top1 = 34.74%], valid : [loss = 1.826, top1 = 33.90%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.93 ms.
cifar10        train : [loss = 1.216, top1 = 56.34%], test  : [loss = 1.222, top1 = 55.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.84 ms.
cifar100       train : [loss = 3.773, top1 = 12.48%], valid : [loss = 3.859, top1 = 10.72%], test : [loss = 3.852, top1 = 11.51%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.82 ms.
ImageNet16-120 train : [loss = 3.766, top1 = 13.91%], valid : [loss = 3.733, top1 = 14.69%], test : [loss = 3.753, top1 = 14.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  499/15625) 000499-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.607, top1 = 87.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.413, top1 = 91.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.14 ms.
cifar100       train : [loss = 0.185, top1 = 95.73%], valid : [loss = 1.491, top1 = 65.91%], test : [loss = 1.521, top1 = 65.23%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.88%], valid : [loss = 2.480, top1 = 37.72%], test : [loss = 2.502, top1 = 37.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.20%], valid : [loss = 0.761, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  500/15625) 000500-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.327, top1 = 92.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.345, top1 = 90.48%], valid : [loss = 1.290, top1 = 67.20%], test : [loss = 1.294, top1 = 66.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.50 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.56%], valid : [loss = 2.428, top1 = 38.60%], test : [loss = 2.421, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  501/15625) 000501-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.73%], valid : [loss = 0.666, top1 = 77.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.541, top1 = 81.26%], test  : [loss = 0.616, top1 = 79.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.30 ms.
cifar100       train : [loss = 1.714, top1 = 53.54%], valid : [loss = 1.865, top1 = 50.67%], test : [loss = 1.894, top1 = 50.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.00 ms.
ImageNet16-120 train : [loss = 3.336, top1 = 21.11%], valid : [loss = 3.309, top1 = 21.37%], test : [loss = 3.356, top1 = 21.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  502/15625) 000502-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.321, top1 = 88.90%], valid : [loss = 0.562, top1 = 82.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10        train : [loss = 0.289, top1 = 90.06%], test  : [loss = 0.439, top1 = 85.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 1.542, top1 = 56.99%], valid : [loss = 1.758, top1 = 52.31%], test : [loss = 1.777, top1 = 51.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 2.945, top1 = 27.65%], valid : [loss = 2.969, top1 = 27.38%], test : [loss = 3.005, top1 = 26.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.28%], valid : [loss = 1.038, top1 = 63.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  503/15625) 000503-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.572, top1 = 88.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.384, top1 = 91.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.49 ms.
cifar100       train : [loss = 0.109, top1 = 97.78%], valid : [loss = 1.549, top1 = 66.74%], test : [loss = 1.545, top1 = 66.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.926, top1 = 49.37%], valid : [loss = 2.406, top1 = 39.36%], test : [loss = 2.443, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.88%], valid : [loss = 0.736, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  504/15625) 000504-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.613, top1 = 86.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.397, top1 = 90.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.49 ms.
cifar100       train : [loss = 0.475, top1 = 86.16%], valid : [loss = 1.410, top1 = 64.11%], test : [loss = 1.391, top1 = 65.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 40.07%], valid : [loss = 2.526, top1 = 36.64%], test : [loss = 2.555, top1 = 36.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.90%], valid : [loss = 0.835, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  505/15625) 000505-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.455, top1 = 86.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.47 ms.
cifar10        train : [loss = 0.111, top1 = 96.59%], test  : [loss = 0.321, top1 = 89.93%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.18 ms.
cifar100       train : [loss = 0.861, top1 = 75.53%], valid : [loss = 1.288, top1 = 64.23%], test : [loss = 1.272, top1 = 64.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.73%], valid : [loss = 2.617, top1 = 34.59%], test : [loss = 2.647, top1 = 33.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.98%], valid : [loss = 0.642, top1 = 77.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  506/15625) 000506-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.479, top1 = 89.48%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.300, top1 = 92.70%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.39 ms.
cifar100       train : [loss = 0.250, top1 = 93.52%], valid : [loss = 1.220, top1 = 69.13%], test : [loss = 1.237, top1 = 69.03%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.04%], valid : [loss = 2.234, top1 = 42.54%], test : [loss = 2.255, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.61%], valid : [loss = 0.577, top1 = 80.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  507/15625) 000507-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.524, top1 = 88.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.336, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 0.332, top1 = 90.94%], valid : [loss = 1.275, top1 = 67.27%], test : [loss = 1.295, top1 = 66.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.65%], valid : [loss = 2.415, top1 = 38.86%], test : [loss = 2.410, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  508/15625) 000508-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.463, top1 = 89.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.308, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.36 ms.
cifar100       train : [loss = 0.333, top1 = 90.86%], valid : [loss = 1.283, top1 = 67.75%], test : [loss = 1.297, top1 = 67.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.17%], valid : [loss = 2.387, top1 = 39.70%], test : [loss = 2.428, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  509/15625) 000509-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.518, top1 = 88.68%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.335, top1 = 92.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.62 ms.
cifar100       train : [loss = 0.330, top1 = 91.03%], valid : [loss = 1.284, top1 = 66.76%], test : [loss = 1.271, top1 = 67.25%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.91%], valid : [loss = 2.411, top1 = 38.81%], test : [loss = 2.401, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  510/15625) 000510-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.454, top1 = 89.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.317, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.197, top1 = 95.21%], valid : [loss = 1.293, top1 = 69.27%], test : [loss = 1.308, top1 = 68.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.26%], valid : [loss = 2.262, top1 = 42.63%], test : [loss = 2.294, top1 = 42.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.454, top1 = 84.33%], valid : [loss = 0.561, top1 = 80.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  511/15625) 000511-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.629, top1 = 86.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.57 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.409, top1 = 90.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.66 ms.
cifar100       train : [loss = 0.505, top1 = 85.37%], valid : [loss = 1.445, top1 = 63.47%], test : [loss = 1.437, top1 = 63.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.24%], valid : [loss = 2.557, top1 = 35.77%], test : [loss = 2.587, top1 = 35.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.39%], valid : [loss = 0.857, top1 = 69.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  512/15625) 000512-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.234, top1 = 92.12%], valid : [loss = 0.499, top1 = 84.08%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.65 ms.
cifar10        train : [loss = 0.239, top1 = 91.95%], test  : [loss = 0.400, top1 = 86.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.45 ms.
cifar100       train : [loss = 1.252, top1 = 64.86%], valid : [loss = 1.526, top1 = 57.27%], test : [loss = 1.539, top1 = 57.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 3.360, top1 = 20.04%], valid : [loss = 3.373, top1 = 19.70%], test : [loss = 3.388, top1 = 19.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.44%], valid : [loss = 1.046, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  513/15625) 000513-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.01%], valid : [loss = 0.567, top1 = 86.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10        train : [loss = 0.066, top1 = 97.85%], test  : [loss = 0.380, top1 = 89.83%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.06 ms.
cifar100       train : [loss = 0.686, top1 = 79.85%], valid : [loss = 1.326, top1 = 65.20%], test : [loss = 1.317, top1 = 64.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.52%], valid : [loss = 2.472, top1 = 37.41%], test : [loss = 2.516, top1 = 36.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.32%], valid : [loss = 0.847, top1 = 70.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  514/15625) 000514-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.559, top1 = 88.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.363, top1 = 91.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.80 ms.
cifar100       train : [loss = 0.157, top1 = 96.71%], valid : [loss = 1.437, top1 = 67.42%], test : [loss = 1.420, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.37%], valid : [loss = 2.438, top1 = 39.20%], test : [loss = 2.463, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.25%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  515/15625) 000515-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.529, top1 = 88.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.349, top1 = 91.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.323, top1 = 91.16%], valid : [loss = 1.279, top1 = 67.35%], test : [loss = 1.290, top1 = 67.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.151, top1 = 44.05%], valid : [loss = 2.422, top1 = 38.61%], test : [loss = 2.418, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.60%], valid : [loss = 0.832, top1 = 70.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  516/15625) 000516-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.292, top1 = 90.02%], valid : [loss = 0.564, top1 = 82.21%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10        train : [loss = 0.254, top1 = 91.35%], test  : [loss = 0.417, top1 = 86.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.65 ms.
cifar100       train : [loss = 1.357, top1 = 61.65%], valid : [loss = 1.642, top1 = 55.57%], test : [loss = 1.628, top1 = 55.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.932, top1 = 28.10%], valid : [loss = 2.930, top1 = 28.24%], test : [loss = 2.978, top1 = 27.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 64.90%], valid : [loss = 1.027, top1 = 63.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  517/15625) 000517-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.310, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.73 ms.
cifar100       train : [loss = 0.335, top1 = 90.80%], valid : [loss = 1.314, top1 = 67.03%], test : [loss = 1.315, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.11%], valid : [loss = 2.364, top1 = 40.28%], test : [loss = 2.400, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.64%], valid : [loss = 0.570, top1 = 80.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  518/15625) 000518-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.490, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.327, top1 = 92.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.09 ms.
cifar100       train : [loss = 0.273, top1 = 92.81%], valid : [loss = 1.214, top1 = 69.35%], test : [loss = 1.242, top1 = 68.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 48.96%], valid : [loss = 2.231, top1 = 42.42%], test : [loss = 2.261, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.98%], valid : [loss = 0.579, top1 = 80.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  519/15625) 000519-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.643, top1 = 86.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.445, top1 = 90.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.22 ms.
cifar100       train : [loss = 0.283, top1 = 92.57%], valid : [loss = 1.536, top1 = 64.03%], test : [loss = 1.534, top1 = 64.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.206, top1 = 43.00%], valid : [loss = 2.570, top1 = 35.78%], test : [loss = 2.566, top1 = 36.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.68%], valid : [loss = 0.821, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  520/15625) 000520-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.510, top1 = 88.92%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.36 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.336, top1 = 91.91%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.32 ms.
cifar100       train : [loss = 0.250, top1 = 93.56%], valid : [loss = 1.247, top1 = 68.59%], test : [loss = 1.253, top1 = 68.78%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.22%], valid : [loss = 2.242, top1 = 42.27%], test : [loss = 2.234, top1 = 42.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.69%], valid : [loss = 0.643, top1 = 78.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  521/15625) 000521-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.34 ms.
cifar10-valid  train : [loss = 1.181, top1 = 57.96%], valid : [loss = 1.229, top1 = 56.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10        train : [loss = 1.134, top1 = 59.71%], test  : [loss = 1.132, top1 = 59.64%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.36 ms.
cifar100       train : [loss = 2.679, top1 = 32.66%], valid : [loss = 2.750, top1 = 32.21%], test : [loss = 2.737, top1 = 31.71%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.65 ms.
ImageNet16-120 train : [loss = 3.830, top1 = 12.99%], valid : [loss = 3.829, top1 = 13.71%], test : [loss = 3.847, top1 = 12.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.676, top1 = 37.21%], valid : [loss = 1.738, top1 = 33.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  522/15625) 000522-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.514, top1 = 88.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.354, top1 = 91.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.31 ms.
cifar100       train : [loss = 0.473, top1 = 86.19%], valid : [loss = 1.343, top1 = 65.81%], test : [loss = 1.349, top1 = 65.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.13%], valid : [loss = 2.526, top1 = 36.57%], test : [loss = 2.571, top1 = 35.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 79.19%], valid : [loss = 0.692, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  523/15625) 000523-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.22%], valid : [loss = 0.462, top1 = 86.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.162, top1 = 94.70%], test  : [loss = 0.355, top1 = 88.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.07 ms.
cifar100       train : [loss = 1.000, top1 = 71.54%], valid : [loss = 1.361, top1 = 61.48%], test : [loss = 1.339, top1 = 62.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.82%], valid : [loss = 2.689, top1 = 32.79%], test : [loss = 2.702, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  524/15625) 000524-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.495, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.321, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.11 ms.
cifar100       train : [loss = 0.320, top1 = 91.39%], valid : [loss = 1.254, top1 = 67.79%], test : [loss = 1.240, top1 = 68.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.82%], valid : [loss = 2.308, top1 = 41.01%], test : [loss = 2.340, top1 = 41.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  525/15625) 000525-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.501, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.323, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 0.326, top1 = 91.12%], valid : [loss = 1.273, top1 = 67.14%], test : [loss = 1.275, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.12%], valid : [loss = 2.414, top1 = 38.72%], test : [loss = 2.404, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  526/15625) 000526-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.131, top1 = 95.91%], valid : [loss = 0.599, top1 = 83.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10        train : [loss = 0.143, top1 = 95.27%], test  : [loss = 0.409, top1 = 87.67%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.72 ms.
cifar100       train : [loss = 1.063, top1 = 69.47%], valid : [loss = 1.501, top1 = 59.26%], test : [loss = 1.491, top1 = 59.69%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.93%], valid : [loss = 2.632, top1 = 33.90%], test : [loss = 2.654, top1 = 33.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.23%], valid : [loss = 0.895, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  527/15625) 000527-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.459, top1 = 89.82%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.77 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.304, top1 = 92.69%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.23 ms.
cifar100       train : [loss = 0.236, top1 = 93.94%], valid : [loss = 1.251, top1 = 68.89%], test : [loss = 1.249, top1 = 68.72%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.70 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.34%], valid : [loss = 2.236, top1 = 42.40%], test : [loss = 2.241, top1 = 42.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.495, top1 = 83.04%], valid : [loss = 0.590, top1 = 79.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  528/15625) 000528-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.223, top1 = 92.38%], valid : [loss = 0.558, top1 = 83.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.217, top1 = 92.56%], test  : [loss = 0.412, top1 = 86.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.84 ms.
cifar100       train : [loss = 1.315, top1 = 62.77%], valid : [loss = 1.612, top1 = 56.10%], test : [loss = 1.596, top1 = 56.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.751, top1 = 31.57%], valid : [loss = 2.787, top1 = 31.04%], test : [loss = 2.811, top1 = 30.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 66.77%], valid : [loss = 0.977, top1 = 65.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  529/15625) 000529-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.449, top1 = 87.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.112, top1 = 96.57%], test  : [loss = 0.325, top1 = 89.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 0.860, top1 = 75.49%], valid : [loss = 1.292, top1 = 64.11%], test : [loss = 1.269, top1 = 64.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.55%], valid : [loss = 2.624, top1 = 33.97%], test : [loss = 2.658, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.43%], valid : [loss = 0.664, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  530/15625) 000530-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.68%], valid : [loss = 0.876, top1 = 70.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10        train : [loss = 0.690, top1 = 75.92%], test  : [loss = 0.774, top1 = 73.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.31 ms.
cifar100       train : [loss = 1.967, top1 = 47.66%], valid : [loss = 2.137, top1 = 44.66%], test : [loss = 2.161, top1 = 44.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 3.653, top1 = 15.68%], valid : [loss = 3.669, top1 = 15.76%], test : [loss = 3.692, top1 = 15.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  531/15625) 000531-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.545, top1 = 89.34%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.22 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.339, top1 = 92.59%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.43 ms.
cifar100       train : [loss = 0.115, top1 = 97.64%], valid : [loss = 1.326, top1 = 69.57%], test : [loss = 1.365, top1 = 68.85%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.44 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.06%], valid : [loss = 2.228, top1 = 43.32%], test : [loss = 2.234, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.69%], valid : [loss = 0.680, top1 = 76.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  532/15625) 000532-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.18%], valid : [loss = 0.627, top1 = 85.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10        train : [loss = 0.071, top1 = 97.85%], test  : [loss = 0.395, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.01 ms.
cifar100       train : [loss = 0.714, top1 = 79.22%], valid : [loss = 1.375, top1 = 63.45%], test : [loss = 1.372, top1 = 63.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.80%], valid : [loss = 2.656, top1 = 33.66%], test : [loss = 2.678, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.26%], valid : [loss = 0.776, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  533/15625) 000533-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.82%], valid : [loss = 0.521, top1 = 85.63%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10        train : [loss = 0.171, top1 = 94.29%], test  : [loss = 0.369, top1 = 88.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.23 ms.
cifar100       train : [loss = 0.988, top1 = 71.54%], valid : [loss = 1.360, top1 = 62.15%], test : [loss = 1.355, top1 = 62.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.53%], valid : [loss = 2.692, top1 = 32.34%], test : [loss = 2.745, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.75%], valid : [loss = 1.015, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  534/15625) 000534-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.572, top1 = 88.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.372, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.193, top1 = 95.47%], valid : [loss = 1.402, top1 = 66.99%], test : [loss = 1.396, top1 = 67.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.72%], valid : [loss = 2.469, top1 = 38.52%], test : [loss = 2.480, top1 = 38.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.89%], valid : [loss = 0.715, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  535/15625) 000535-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.501, top1 = 89.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.329, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.06 ms.
cifar100       train : [loss = 0.230, top1 = 94.41%], valid : [loss = 1.233, top1 = 69.11%], test : [loss = 1.257, top1 = 68.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.43%], valid : [loss = 2.273, top1 = 42.12%], test : [loss = 2.279, top1 = 41.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  536/15625) 000536-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.479, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.309, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 0.319, top1 = 91.53%], valid : [loss = 1.250, top1 = 67.65%], test : [loss = 1.260, top1 = 67.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.66%], valid : [loss = 2.313, top1 = 40.96%], test : [loss = 2.333, top1 = 40.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  537/15625) 000537-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.22%], valid : [loss = 0.557, top1 = 84.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10        train : [loss = 0.192, top1 = 93.49%], test  : [loss = 0.396, top1 = 87.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.80 ms.
cifar100       train : [loss = 1.051, top1 = 69.62%], valid : [loss = 1.444, top1 = 60.84%], test : [loss = 1.439, top1 = 60.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.712, top1 = 32.28%], valid : [loss = 2.766, top1 = 31.48%], test : [loss = 2.808, top1 = 30.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.64%], valid : [loss = 0.997, top1 = 64.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  538/15625) 000538-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.154, top1 = 95.09%], valid : [loss = 0.505, top1 = 85.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.172, top1 = 94.14%], test  : [loss = 0.379, top1 = 88.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.35 ms.
cifar100       train : [loss = 1.088, top1 = 68.65%], valid : [loss = 1.465, top1 = 60.06%], test : [loss = 1.464, top1 = 59.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.602, top1 = 34.65%], valid : [loss = 2.642, top1 = 33.98%], test : [loss = 2.679, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.94%], valid : [loss = 0.936, top1 = 66.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  539/15625) 000539-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.457, top1 = 90.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.308, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.077, top1 = 98.67%], valid : [loss = 1.435, top1 = 68.75%], test : [loss = 1.403, top1 = 69.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.626, top1 = 56.29%], valid : [loss = 2.235, top1 = 43.89%], test : [loss = 2.268, top1 = 44.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.474, top1 = 83.57%], valid : [loss = 0.598, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  540/15625) 000540-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.89 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.51 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.26 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  541/15625) 000541-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.427, top1 = 91.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.285, top1 = 93.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.80 ms.
cifar100       train : [loss = 0.062, top1 = 99.13%], valid : [loss = 1.344, top1 = 70.48%], test : [loss = 1.330, top1 = 70.79%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.516, top1 = 58.97%], valid : [loss = 2.219, top1 = 44.59%], test : [loss = 2.234, top1 = 44.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.358, top1 = 87.68%], valid : [loss = 0.495, top1 = 83.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  542/15625) 000542-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.492, top1 = 90.17%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.73 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.320, top1 = 93.31%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.15 ms.
cifar100       train : [loss = 0.062, top1 = 99.10%], valid : [loss = 1.329, top1 = 70.23%], test : [loss = 1.289, top1 = 70.71%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.60 ms.
ImageNet16-120 train : [loss = 1.578, top1 = 57.44%], valid : [loss = 2.140, top1 = 45.59%], test : [loss = 2.149, top1 = 45.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.67%], valid : [loss = 0.738, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  543/15625) 000543-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.417, top1 = 91.10%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.29 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.288, top1 = 93.71%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.54 ms.
cifar100       train : [loss = 0.046, top1 = 99.48%], valid : [loss = 1.332, top1 = 70.87%], test : [loss = 1.314, top1 = 71.09%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 1.446, top1 = 60.64%], valid : [loss = 2.226, top1 = 44.10%], test : [loss = 2.235, top1 = 44.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.64%], valid : [loss = 0.497, top1 = 83.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  544/15625) 000544-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.54%], valid : [loss = 0.462, top1 = 86.42%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=21.00 ms.
cifar10        train : [loss = 0.123, top1 = 96.14%], test  : [loss = 0.347, top1 = 88.84%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.56 ms.
cifar100       train : [loss = 0.747, top1 = 79.13%], valid : [loss = 1.285, top1 = 64.30%], test : [loss = 1.258, top1 = 64.77%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.62 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.70%], valid : [loss = 2.583, top1 = 35.29%], test : [loss = 2.605, top1 = 34.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.41%], valid : [loss = 0.845, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  545/15625) 000545-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  546/15625) 000546-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.43%], valid : [loss = 0.870, top1 = 79.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.127, top1 = 95.80%], test  : [loss = 0.538, top1 = 85.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.42 ms.
cifar100       train : [loss = 0.837, top1 = 75.75%], valid : [loss = 1.663, top1 = 58.05%], test : [loss = 1.683, top1 = 57.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 3.031, top1 = 26.51%], valid : [loss = 3.162, top1 = 23.79%], test : [loss = 3.203, top1 = 23.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.122, top1 = 59.48%], valid : [loss = 1.172, top1 = 58.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  547/15625) 000547-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.544, top1 = 88.59%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.48 ms.
cifar10        train : [loss = 0.011, top1 = 99.70%], test  : [loss = 0.343, top1 = 92.32%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.07 ms.
cifar100       train : [loss = 0.199, top1 = 94.85%], valid : [loss = 1.337, top1 = 68.18%], test : [loss = 1.352, top1 = 67.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.15%], valid : [loss = 2.272, top1 = 42.04%], test : [loss = 2.301, top1 = 41.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.19%], valid : [loss = 0.836, top1 = 70.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  548/15625) 000548-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.454, top1 = 89.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.323, top1 = 91.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.66 ms.
cifar100       train : [loss = 0.221, top1 = 94.66%], valid : [loss = 1.295, top1 = 68.31%], test : [loss = 1.275, top1 = 68.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.20%], valid : [loss = 2.269, top1 = 42.10%], test : [loss = 2.300, top1 = 42.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.19%], valid : [loss = 0.531, top1 = 82.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  549/15625) 000549-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.601, top1 = 87.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.403, top1 = 90.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.00 ms.
cifar100       train : [loss = 0.177, top1 = 95.79%], valid : [loss = 1.542, top1 = 65.31%], test : [loss = 1.565, top1 = 65.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.86 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.43%], valid : [loss = 2.510, top1 = 37.07%], test : [loss = 2.509, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.06%], valid : [loss = 0.816, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  550/15625) 000550-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.04%], valid : [loss = 0.467, top1 = 85.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10        train : [loss = 0.158, top1 = 94.77%], test  : [loss = 0.342, top1 = 88.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.51 ms.
cifar100       train : [loss = 1.000, top1 = 71.54%], valid : [loss = 1.356, top1 = 62.09%], test : [loss = 1.356, top1 = 62.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.59 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.75%], valid : [loss = 2.676, top1 = 33.19%], test : [loss = 2.706, top1 = 33.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  551/15625) 000551-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.77 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.526, top1 = 89.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.39 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.336, top1 = 93.05%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.34 ms.
cifar100       train : [loss = 0.108, top1 = 97.83%], valid : [loss = 1.370, top1 = 69.25%], test : [loss = 1.367, top1 = 69.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 1.719, top1 = 53.94%], valid : [loss = 2.191, top1 = 44.21%], test : [loss = 2.224, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.06%], valid : [loss = 0.574, top1 = 80.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  552/15625) 000552-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  553/15625) 000553-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.222, top1 = 92.41%], valid : [loss = 0.559, top1 = 83.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.218, top1 = 92.51%], test  : [loss = 0.410, top1 = 86.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 1.327, top1 = 62.44%], valid : [loss = 1.597, top1 = 56.38%], test : [loss = 1.608, top1 = 56.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.726, top1 = 32.00%], valid : [loss = 2.752, top1 = 31.19%], test : [loss = 2.794, top1 = 31.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.29%], valid : [loss = 0.993, top1 = 64.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  554/15625) 000554-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.466, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.315, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.338, top1 = 90.72%], valid : [loss = 1.302, top1 = 67.54%], test : [loss = 1.300, top1 = 66.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.98%], valid : [loss = 2.372, top1 = 39.90%], test : [loss = 2.396, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.462, top1 = 84.10%], valid : [loss = 0.561, top1 = 80.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  555/15625) 000555-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.589, top1 = 86.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.408, top1 = 89.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.507, top1 = 85.17%], valid : [loss = 1.412, top1 = 63.81%], test : [loss = 1.388, top1 = 64.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 39.10%], valid : [loss = 2.577, top1 = 35.37%], test : [loss = 2.576, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.94%], valid : [loss = 0.826, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  556/15625) 000556-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10-valid  train : [loss = 0.292, top1 = 89.96%], valid : [loss = 0.491, top1 = 84.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.288, top1 = 90.22%], test  : [loss = 0.397, top1 = 86.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.296, top1 = 63.57%], valid : [loss = 1.518, top1 = 57.95%], test : [loss = 1.499, top1 = 58.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.857, top1 = 29.78%], valid : [loss = 2.840, top1 = 30.34%], test : [loss = 2.895, top1 = 29.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.33%], valid : [loss = 0.970, top1 = 65.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  557/15625) 000557-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.41%], valid : [loss = 0.548, top1 = 83.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.205, top1 = 92.99%], test  : [loss = 0.402, top1 = 87.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 1.275, top1 = 63.83%], valid : [loss = 1.577, top1 = 56.79%], test : [loss = 1.560, top1 = 57.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.694, top1 = 32.63%], valid : [loss = 2.722, top1 = 31.84%], test : [loss = 2.753, top1 = 31.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.88%], valid : [loss = 0.967, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  558/15625) 000558-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.73 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.92%], valid : [loss = 0.472, top1 = 86.29%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.99 ms.
cifar10        train : [loss = 0.118, top1 = 96.34%], test  : [loss = 0.335, top1 = 89.21%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.83 ms.
cifar100       train : [loss = 0.746, top1 = 79.08%], valid : [loss = 1.279, top1 = 64.56%], test : [loss = 1.284, top1 = 64.60%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.69 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.17%], valid : [loss = 2.578, top1 = 35.40%], test : [loss = 2.586, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 71.99%], valid : [loss = 0.827, top1 = 70.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  559/15625) 000559-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.21%], valid : [loss = 0.737, top1 = 82.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.089, top1 = 97.08%], test  : [loss = 0.455, top1 = 87.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.792, top1 = 76.78%], valid : [loss = 1.563, top1 = 59.33%], test : [loss = 1.563, top1 = 59.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.743, top1 = 31.87%], valid : [loss = 2.906, top1 = 28.83%], test : [loss = 2.948, top1 = 28.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.896, top1 = 67.69%], valid : [loss = 0.967, top1 = 65.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  560/15625) 000560-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.523, top1 = 88.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.327, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.91 ms.
cifar100       train : [loss = 0.338, top1 = 90.76%], valid : [loss = 1.294, top1 = 66.74%], test : [loss = 1.290, top1 = 67.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.72%], valid : [loss = 2.403, top1 = 38.84%], test : [loss = 2.414, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  561/15625) 000561-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.04%], valid : [loss = 0.474, top1 = 84.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10        train : [loss = 0.296, top1 = 90.10%], test  : [loss = 0.394, top1 = 86.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 1.328, top1 = 63.08%], valid : [loss = 1.525, top1 = 57.73%], test : [loss = 1.514, top1 = 58.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.54%], valid : [loss = 2.912, top1 = 29.68%], test : [loss = 2.947, top1 = 28.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  562/15625) 000562-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.07%], valid : [loss = 0.562, top1 = 86.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.70 ms.
cifar10        train : [loss = 0.057, top1 = 98.13%], test  : [loss = 0.369, top1 = 90.14%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.19 ms.
cifar100       train : [loss = 0.594, top1 = 82.39%], valid : [loss = 1.315, top1 = 64.69%], test : [loss = 1.313, top1 = 65.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.18%], valid : [loss = 2.549, top1 = 35.97%], test : [loss = 2.544, top1 = 36.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 67.04%], valid : [loss = 0.958, top1 = 65.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  563/15625) 000563-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.566, top1 = 88.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.379, top1 = 92.23%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.60 ms.
cifar100       train : [loss = 0.101, top1 = 98.13%], valid : [loss = 1.455, top1 = 67.87%], test : [loss = 1.463, top1 = 67.85%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.42%], valid : [loss = 2.434, top1 = 39.78%], test : [loss = 2.444, top1 = 39.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.10%], valid : [loss = 0.709, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  564/15625) 000564-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.247, top1 = 91.77%], valid : [loss = 0.516, top1 = 83.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.229, top1 = 92.22%], test  : [loss = 0.393, top1 = 87.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 1.293, top1 = 63.60%], valid : [loss = 1.560, top1 = 57.57%], test : [loss = 1.560, top1 = 57.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.754, top1 = 31.66%], valid : [loss = 2.758, top1 = 31.76%], test : [loss = 2.801, top1 = 31.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.65%], valid : [loss = 1.005, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  565/15625) 000565-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.596, top1 = 87.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.394, top1 = 91.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.385, top1 = 89.14%], valid : [loss = 1.407, top1 = 65.22%], test : [loss = 1.422, top1 = 65.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.02%], valid : [loss = 2.512, top1 = 36.94%], test : [loss = 2.510, top1 = 37.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.18%], valid : [loss = 0.796, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  566/15625) 000566-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.39%], valid : [loss = 0.629, top1 = 79.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.24 ms.
cifar10        train : [loss = 0.318, top1 = 89.07%], test  : [loss = 0.453, top1 = 84.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.07 ms.
cifar100       train : [loss = 1.569, top1 = 56.16%], valid : [loss = 1.804, top1 = 50.97%], test : [loss = 1.803, top1 = 51.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.906, top1 = 28.40%], valid : [loss = 2.931, top1 = 27.93%], test : [loss = 2.971, top1 = 27.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.074, top1 = 61.17%], valid : [loss = 1.147, top1 = 59.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  567/15625) 000567-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.18 ms.
cifar10-valid  train : [loss = 0.961, top1 = 66.21%], valid : [loss = 1.003, top1 = 65.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.00 ms.
cifar10        train : [loss = 0.899, top1 = 68.85%], test  : [loss = 0.902, top1 = 68.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.36 ms.
cifar100       train : [loss = 2.375, top1 = 39.10%], valid : [loss = 2.440, top1 = 37.73%], test : [loss = 2.426, top1 = 38.05%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.49 ms.
ImageNet16-120 train : [loss = 3.635, top1 = 15.91%], valid : [loss = 3.608, top1 = 16.83%], test : [loss = 3.626, top1 = 16.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.610, top1 = 39.64%], valid : [loss = 1.669, top1 = 36.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  568/15625) 000568-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.587, top1 = 87.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.392, top1 = 90.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.41 ms.
cifar100       train : [loss = 0.399, top1 = 88.67%], valid : [loss = 1.421, top1 = 64.81%], test : [loss = 1.387, top1 = 65.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.29%], valid : [loss = 2.496, top1 = 37.39%], test : [loss = 2.523, top1 = 36.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 71.87%], valid : [loss = 0.843, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  569/15625) 000569-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.77 ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.04%], valid : [loss = 0.867, top1 = 70.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.10 ms.
cifar10        train : [loss = 0.686, top1 = 76.00%], test  : [loss = 0.770, top1 = 73.07%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.29 ms.
cifar100       train : [loss = 1.963, top1 = 47.87%], valid : [loss = 2.130, top1 = 44.87%], test : [loss = 2.153, top1 = 43.88%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.13 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.76%], valid : [loss = 3.673, top1 = 16.01%], test : [loss = 3.692, top1 = 14.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  570/15625) 000570-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.569, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.379, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.27 ms.
cifar100       train : [loss = 0.399, top1 = 88.69%], valid : [loss = 1.411, top1 = 65.03%], test : [loss = 1.398, top1 = 65.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.78 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.91%], valid : [loss = 2.468, top1 = 37.87%], test : [loss = 2.480, top1 = 38.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.97%], valid : [loss = 0.767, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  571/15625) 000571-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.493, top1 = 90.14%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.24 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.299, top1 = 93.69%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.39 ms.
cifar100       train : [loss = 0.042, top1 = 99.54%], valid : [loss = 1.316, top1 = 70.87%], test : [loss = 1.320, top1 = 70.95%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.26 ms.
ImageNet16-120 train : [loss = 1.547, top1 = 58.21%], valid : [loss = 2.186, top1 = 44.64%], test : [loss = 2.152, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.30%], valid : [loss = 0.629, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  572/15625) 000572-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.426, top1 = 90.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.277, top1 = 93.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.77 ms.
cifar100       train : [loss = 0.162, top1 = 96.37%], valid : [loss = 1.297, top1 = 69.49%], test : [loss = 1.253, top1 = 70.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 1.782, top1 = 52.54%], valid : [loss = 2.210, top1 = 43.82%], test : [loss = 2.233, top1 = 43.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.95%], valid : [loss = 0.508, top1 = 82.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  573/15625) 000573-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.520, top1 = 88.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.341, top1 = 91.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.99 ms.
cifar100       train : [loss = 0.338, top1 = 90.75%], valid : [loss = 1.298, top1 = 67.02%], test : [loss = 1.304, top1 = 67.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.57%], valid : [loss = 2.424, top1 = 38.33%], test : [loss = 2.429, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  574/15625) 000574-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.17%], valid : [loss = 0.860, top1 = 71.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 0.549, top1 = 80.79%], test  : [loss = 0.712, top1 = 75.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 1.774, top1 = 52.19%], valid : [loss = 2.044, top1 = 47.07%], test : [loss = 2.058, top1 = 46.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.90%], valid : [loss = 3.642, top1 = 16.58%], test : [loss = 3.672, top1 = 15.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  575/15625) 000575-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.531, top1 = 89.35%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.94 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.356, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.56 ms.
cifar100       train : [loss = 0.078, top1 = 98.82%], valid : [loss = 1.455, top1 = 68.29%], test : [loss = 1.447, top1 = 68.34%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.53%], valid : [loss = 2.362, top1 = 41.28%], test : [loss = 2.370, top1 = 42.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.89%], valid : [loss = 0.667, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  576/15625) 000576-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.161, top1 = 94.80%], valid : [loss = 0.479, top1 = 85.23%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.22 ms.
cifar10        train : [loss = 0.182, top1 = 94.05%], test  : [loss = 0.367, top1 = 88.12%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.74 ms.
cifar100       train : [loss = 1.049, top1 = 70.42%], valid : [loss = 1.415, top1 = 60.62%], test : [loss = 1.409, top1 = 60.43%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 27.98%], valid : [loss = 2.953, top1 = 27.30%], test : [loss = 2.973, top1 = 26.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 63.81%], valid : [loss = 1.028, top1 = 63.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  577/15625) 000577-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.431, top1 = 90.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.282, top1 = 93.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.15 ms.
cifar100       train : [loss = 0.184, top1 = 95.61%], valid : [loss = 1.277, top1 = 68.93%], test : [loss = 1.280, top1 = 69.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.60%], valid : [loss = 2.242, top1 = 43.10%], test : [loss = 2.285, top1 = 42.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.03%], valid : [loss = 0.504, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  578/15625) 000578-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.536, top1 = 88.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.89 ms.
cifar10        train : [loss = 0.025, top1 = 99.29%], test  : [loss = 0.351, top1 = 91.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.420, top1 = 87.93%], valid : [loss = 1.270, top1 = 66.82%], test : [loss = 1.268, top1 = 66.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.227, top1 = 42.40%], valid : [loss = 2.405, top1 = 39.49%], test : [loss = 2.439, top1 = 38.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.86%], valid : [loss = 0.850, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  579/15625) 000579-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.55%], valid : [loss = 0.465, top1 = 86.36%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.10 ms.
cifar10        train : [loss = 0.121, top1 = 96.23%], test  : [loss = 0.344, top1 = 89.16%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.29 ms.
cifar100       train : [loss = 0.746, top1 = 79.24%], valid : [loss = 1.263, top1 = 65.06%], test : [loss = 1.261, top1 = 65.17%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.504, top1 = 36.67%], valid : [loss = 2.599, top1 = 34.73%], test : [loss = 2.621, top1 = 34.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  580/15625) 000580-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.32%], valid : [loss = 0.456, top1 = 86.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10        train : [loss = 0.110, top1 = 96.64%], test  : [loss = 0.327, top1 = 89.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.98 ms.
cifar100       train : [loss = 0.859, top1 = 75.58%], valid : [loss = 1.298, top1 = 64.05%], test : [loss = 1.285, top1 = 63.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.54%], valid : [loss = 2.638, top1 = 33.93%], test : [loss = 2.662, top1 = 33.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  581/15625) 000581-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.493, top1 = 88.90%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.38 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.324, top1 = 91.96%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.18 ms.
cifar100       train : [loss = 0.278, top1 = 92.68%], valid : [loss = 1.243, top1 = 68.17%], test : [loss = 1.229, top1 = 68.83%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.83%], valid : [loss = 2.212, top1 = 42.50%], test : [loss = 2.236, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.94%], valid : [loss = 0.648, top1 = 77.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  582/15625) 000582-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.418, top1 = 91.28%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.59 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.270, top1 = 94.18%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.49 ms.
cifar100       train : [loss = 0.020, top1 = 99.88%], valid : [loss = 1.278, top1 = 72.43%], test : [loss = 1.262, top1 = 72.84%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.123, top1 = 68.72%], valid : [loss = 2.282, top1 = 44.77%], test : [loss = 2.309, top1 = 45.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.83%], valid : [loss = 0.480, top1 = 84.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  583/15625) 000583-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.72%], valid : [loss = 0.851, top1 = 70.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10        train : [loss = 0.707, top1 = 75.16%], test  : [loss = 0.787, top1 = 72.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.59 ms.
cifar100       train : [loss = 1.973, top1 = 47.56%], valid : [loss = 2.142, top1 = 44.69%], test : [loss = 2.158, top1 = 44.13%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 3.655, top1 = 15.61%], valid : [loss = 3.679, top1 = 15.68%], test : [loss = 3.705, top1 = 14.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.407, top1 = 48.48%], valid : [loss = 1.438, top1 = 48.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  584/15625) 000584-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.81%], valid : [loss = 0.555, top1 = 82.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10        train : [loss = 0.237, top1 = 91.90%], test  : [loss = 0.403, top1 = 87.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 1.371, top1 = 61.27%], valid : [loss = 1.633, top1 = 55.73%], test : [loss = 1.633, top1 = 55.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.818, top1 = 30.18%], valid : [loss = 2.858, top1 = 29.76%], test : [loss = 2.880, top1 = 29.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.28%], valid : [loss = 0.987, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  585/15625) 000585-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.537, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.353, top1 = 92.39%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.46 ms.
cifar100       train : [loss = 0.070, top1 = 99.11%], valid : [loss = 1.441, top1 = 68.59%], test : [loss = 1.459, top1 = 68.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.79 ms.
ImageNet16-120 train : [loss = 1.712, top1 = 54.28%], valid : [loss = 2.364, top1 = 41.16%], test : [loss = 2.397, top1 = 41.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.40%], valid : [loss = 0.652, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  586/15625) 000586-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.20%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.321, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.24 ms.
cifar100       train : [loss = 0.113, top1 = 97.86%], valid : [loss = 1.303, top1 = 69.59%], test : [loss = 1.314, top1 = 69.33%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.29%], valid : [loss = 2.299, top1 = 41.96%], test : [loss = 2.268, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.33%], valid : [loss = 0.806, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  587/15625) 000587-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.447, top1 = 90.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.293, top1 = 93.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.05 ms.
cifar100       train : [loss = 0.074, top1 = 98.85%], valid : [loss = 1.365, top1 = 70.01%], test : [loss = 1.328, top1 = 70.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.538, top1 = 58.44%], valid : [loss = 2.223, top1 = 44.06%], test : [loss = 2.233, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 85.73%], valid : [loss = 0.538, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  588/15625) 000588-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.486, top1 = 89.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.318, top1 = 92.39%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.63 ms.
cifar100       train : [loss = 0.234, top1 = 94.33%], valid : [loss = 1.282, top1 = 68.02%], test : [loss = 1.272, top1 = 68.17%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.25%], valid : [loss = 2.285, top1 = 41.43%], test : [loss = 2.314, top1 = 41.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.49%], valid : [loss = 0.645, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  589/15625) 000589-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.88 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.25%], valid : [loss = 0.525, top1 = 86.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.080, top1 = 97.61%], test  : [loss = 0.344, top1 = 90.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 0.696, top1 = 79.87%], valid : [loss = 1.305, top1 = 64.95%], test : [loss = 1.285, top1 = 65.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.22%], valid : [loss = 2.510, top1 = 36.97%], test : [loss = 2.528, top1 = 36.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.60%], valid : [loss = 0.912, top1 = 67.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  590/15625) 000590-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.571, top1 = 88.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.373, top1 = 91.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.179, top1 = 95.99%], valid : [loss = 1.391, top1 = 67.68%], test : [loss = 1.419, top1 = 67.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.87%], valid : [loss = 2.468, top1 = 37.94%], test : [loss = 2.469, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  591/15625) 000591-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.503, top1 = 88.94%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.98 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.306, top1 = 92.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.86 ms.
cifar100       train : [loss = 0.233, top1 = 94.32%], valid : [loss = 1.253, top1 = 68.53%], test : [loss = 1.253, top1 = 69.02%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.40%], valid : [loss = 2.285, top1 = 41.62%], test : [loss = 2.287, top1 = 42.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.42%], valid : [loss = 0.656, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  592/15625) 000592-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.21%], valid : [loss = 0.845, top1 = 72.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 0.574, top1 = 79.99%], test  : [loss = 0.726, top1 = 75.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.55 ms.
cifar100       train : [loss = 1.802, top1 = 51.52%], valid : [loss = 2.063, top1 = 46.45%], test : [loss = 2.070, top1 = 46.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 3.594, top1 = 16.69%], valid : [loss = 3.639, top1 = 16.63%], test : [loss = 3.664, top1 = 15.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.196, top1 = 57.09%], valid : [loss = 1.262, top1 = 54.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  593/15625) 000593-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.555, top1 = 89.35%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.94 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.331, top1 = 92.91%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.20 ms.
cifar100       train : [loss = 0.076, top1 = 98.57%], valid : [loss = 1.391, top1 = 69.21%], test : [loss = 1.399, top1 = 68.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.15%], valid : [loss = 2.439, top1 = 37.71%], test : [loss = 2.469, top1 = 37.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.30%], valid : [loss = 1.048, top1 = 62.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  594/15625) 000594-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.21%], valid : [loss = 0.478, top1 = 84.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.296, top1 = 90.15%], test  : [loss = 0.400, top1 = 86.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 1.320, top1 = 63.31%], valid : [loss = 1.525, top1 = 57.67%], test : [loss = 1.501, top1 = 58.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.74%], valid : [loss = 2.898, top1 = 29.57%], test : [loss = 2.961, top1 = 28.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  595/15625) 000595-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.27%], valid : [loss = 0.602, top1 = 85.67%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.46 ms.
cifar10        train : [loss = 0.069, top1 = 97.89%], test  : [loss = 0.410, top1 = 88.78%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.38 ms.
cifar100       train : [loss = 0.713, top1 = 79.27%], valid : [loss = 1.409, top1 = 62.65%], test : [loss = 1.376, top1 = 63.17%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.91%], valid : [loss = 2.663, top1 = 33.68%], test : [loss = 2.703, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.80%], valid : [loss = 0.804, top1 = 71.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  596/15625) 000596-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.505, top1 = 88.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.334, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.75 ms.
cifar100       train : [loss = 0.344, top1 = 90.55%], valid : [loss = 1.278, top1 = 67.31%], test : [loss = 1.284, top1 = 66.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.84%], valid : [loss = 2.403, top1 = 38.76%], test : [loss = 2.410, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  597/15625) 000597-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.75%], valid : [loss = 0.530, top1 = 88.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.025, top1 = 99.27%], test  : [loss = 0.355, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.420, top1 = 87.86%], valid : [loss = 1.277, top1 = 67.22%], test : [loss = 1.261, top1 = 67.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.53%], valid : [loss = 2.366, top1 = 39.62%], test : [loss = 2.378, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  598/15625) 000598-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.86 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.549, top1 = 88.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.349, top1 = 92.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.43 ms.
cifar100       train : [loss = 0.170, top1 = 96.15%], valid : [loss = 1.348, top1 = 67.56%], test : [loss = 1.374, top1 = 67.55%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.28%], valid : [loss = 2.334, top1 = 39.93%], test : [loss = 2.335, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.55%], valid : [loss = 0.821, top1 = 71.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  599/15625) 000599-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.210, top1 = 92.94%], valid : [loss = 0.545, top1 = 83.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.203, top1 = 93.10%], test  : [loss = 0.396, top1 = 87.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.63 ms.
cifar100       train : [loss = 1.260, top1 = 64.19%], valid : [loss = 1.554, top1 = 57.32%], test : [loss = 1.560, top1 = 57.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.695, top1 = 32.70%], valid : [loss = 2.727, top1 = 31.96%], test : [loss = 2.772, top1 = 30.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.88%], valid : [loss = 1.031, top1 = 63.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  600/15625) 000600-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.545, top1 = 88.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.355, top1 = 91.86%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.70 ms.
cifar100       train : [loss = 0.151, top1 = 96.24%], valid : [loss = 1.392, top1 = 68.00%], test : [loss = 1.375, top1 = 68.46%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.05 ms.
ImageNet16-120 train : [loss = 2.423, top1 = 37.85%], valid : [loss = 2.593, top1 = 34.08%], test : [loss = 2.595, top1 = 34.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.56%], valid : [loss = 1.026, top1 = 63.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  601/15625) 000601-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.51%], valid : [loss = 0.805, top1 = 72.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.714, top1 = 74.93%], test  : [loss = 0.756, top1 = 73.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.54 ms.
cifar100       train : [loss = 2.085, top1 = 44.73%], valid : [loss = 2.229, top1 = 42.03%], test : [loss = 2.221, top1 = 42.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 3.431, top1 = 18.98%], valid : [loss = 3.416, top1 = 19.74%], test : [loss = 3.445, top1 = 18.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.456, top1 = 46.79%], valid : [loss = 1.514, top1 = 44.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  602/15625) 000602-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.550, top1 = 88.09%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.06 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.354, top1 = 91.66%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.59 ms.
cifar100       train : [loss = 0.305, top1 = 91.43%], valid : [loss = 1.324, top1 = 67.12%], test : [loss = 1.336, top1 = 67.33%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.29%], valid : [loss = 2.448, top1 = 37.50%], test : [loss = 2.472, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 66.74%], valid : [loss = 0.951, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  603/15625) 000603-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.237, top1 = 91.91%], valid : [loss = 0.525, top1 = 83.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.238, top1 = 91.92%], test  : [loss = 0.382, top1 = 87.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.350, top1 = 62.05%], valid : [loss = 1.623, top1 = 56.20%], test : [loss = 1.599, top1 = 56.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.855, top1 = 29.70%], valid : [loss = 2.873, top1 = 29.01%], test : [loss = 2.926, top1 = 28.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.41%], valid : [loss = 0.984, top1 = 65.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  604/15625) 000604-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.537, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.371, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.16 ms.
cifar100       train : [loss = 0.089, top1 = 98.48%], valid : [loss = 1.456, top1 = 68.14%], test : [loss = 1.446, top1 = 67.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.49%], valid : [loss = 2.377, top1 = 40.28%], test : [loss = 2.407, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.14%], valid : [loss = 0.695, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  605/15625) 000605-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.55%], valid : [loss = 0.551, top1 = 82.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.270, top1 = 90.63%], test  : [loss = 0.412, top1 = 86.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 1.400, top1 = 60.50%], valid : [loss = 1.664, top1 = 54.45%], test : [loss = 1.649, top1 = 54.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.903, top1 = 28.67%], valid : [loss = 2.899, top1 = 29.31%], test : [loss = 2.954, top1 = 27.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.87%], valid : [loss = 1.036, top1 = 63.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  606/15625) 000606-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.11%], valid : [loss = 0.884, top1 = 71.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.547, top1 = 80.82%], test  : [loss = 0.712, top1 = 75.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.42 ms.
cifar100       train : [loss = 1.776, top1 = 52.21%], valid : [loss = 2.059, top1 = 47.18%], test : [loss = 2.078, top1 = 46.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.90%], valid : [loss = 3.631, top1 = 16.72%], test : [loss = 3.670, top1 = 15.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  607/15625) 000607-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.454, top1 = 89.81%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.298, top1 = 92.86%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.00 ms.
cifar100       train : [loss = 0.239, top1 = 93.97%], valid : [loss = 1.237, top1 = 68.85%], test : [loss = 1.230, top1 = 69.08%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.50%], valid : [loss = 2.191, top1 = 43.41%], test : [loss = 2.227, top1 = 43.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.91%], valid : [loss = 0.648, top1 = 77.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  608/15625) 000608-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.37%], valid : [loss = 0.704, top1 = 84.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10        train : [loss = 0.059, top1 = 98.21%], test  : [loss = 0.453, top1 = 88.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.34 ms.
cifar100       train : [loss = 0.628, top1 = 81.50%], valid : [loss = 1.496, top1 = 61.89%], test : [loss = 1.472, top1 = 62.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.663, top1 = 33.49%], valid : [loss = 2.815, top1 = 31.20%], test : [loss = 2.872, top1 = 30.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.73%], valid : [loss = 0.890, top1 = 68.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  609/15625) 000609-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.521, top1 = 89.83%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.337, top1 = 93.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.21 ms.
cifar100       train : [loss = 0.069, top1 = 98.85%], valid : [loss = 1.394, top1 = 69.20%], test : [loss = 1.372, top1 = 69.95%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.23%], valid : [loss = 2.201, top1 = 43.81%], test : [loss = 2.191, top1 = 44.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.50%], valid : [loss = 0.709, top1 = 75.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  610/15625) 000610-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.573, top1 = 88.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.384, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.69 ms.
cifar100       train : [loss = 0.109, top1 = 97.92%], valid : [loss = 1.474, top1 = 68.05%], test : [loss = 1.466, top1 = 67.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.77%], valid : [loss = 2.405, top1 = 40.03%], test : [loss = 2.415, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.69%], valid : [loss = 0.726, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  611/15625) 000611-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.467, top1 = 89.68%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.21 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.317, top1 = 92.72%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.88 ms.
cifar100       train : [loss = 0.283, top1 = 92.49%], valid : [loss = 1.257, top1 = 68.07%], test : [loss = 1.256, top1 = 68.12%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.50 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.19%], valid : [loss = 2.219, top1 = 42.86%], test : [loss = 2.203, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.84%], valid : [loss = 0.586, top1 = 80.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  612/15625) 000612-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.72%], valid : [loss = 0.850, top1 = 72.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.550, top1 = 80.81%], test  : [loss = 0.715, top1 = 75.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.35 ms.
cifar100       train : [loss = 1.778, top1 = 52.15%], valid : [loss = 2.072, top1 = 46.81%], test : [loss = 2.065, top1 = 47.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.88%], valid : [loss = 3.634, top1 = 16.69%], test : [loss = 3.658, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.42%], valid : [loss = 1.248, top1 = 55.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  613/15625) 000613-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.548, top1 = 88.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.355, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.35 ms.
cifar100       train : [loss = 0.410, top1 = 88.11%], valid : [loss = 1.247, top1 = 67.21%], test : [loss = 1.266, top1 = 67.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.32%], valid : [loss = 2.410, top1 = 39.32%], test : [loss = 2.432, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  614/15625) 000614-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.99%], valid : [loss = 0.461, top1 = 86.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10        train : [loss = 0.149, top1 = 95.13%], test  : [loss = 0.343, top1 = 88.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.47 ms.
cifar100       train : [loss = 0.964, top1 = 72.61%], valid : [loss = 1.334, top1 = 62.93%], test : [loss = 1.344, top1 = 62.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.607, top1 = 34.42%], valid : [loss = 2.663, top1 = 32.99%], test : [loss = 2.693, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  615/15625) 000615-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.470, top1 = 89.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 0.322, top1 = 91.35%], valid : [loss = 1.261, top1 = 67.61%], test : [loss = 1.263, top1 = 68.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.76%], valid : [loss = 2.326, top1 = 40.36%], test : [loss = 2.342, top1 = 40.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  616/15625) 000616-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.487, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.305, top1 = 92.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.59 ms.
cifar100       train : [loss = 0.315, top1 = 91.55%], valid : [loss = 1.260, top1 = 67.38%], test : [loss = 1.253, top1 = 67.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.81%], valid : [loss = 2.302, top1 = 41.11%], test : [loss = 2.346, top1 = 40.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.29%], valid : [loss = 0.617, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  617/15625) 000617-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.561, top1 = 88.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.353, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.31 ms.
cifar100       train : [loss = 0.290, top1 = 91.94%], valid : [loss = 1.333, top1 = 67.23%], test : [loss = 1.318, top1 = 67.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.14%], valid : [loss = 2.433, top1 = 38.52%], test : [loss = 2.428, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.28%], valid : [loss = 0.900, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  618/15625) 000618-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.524, top1 = 89.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.359, top1 = 92.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.62 ms.
cifar100       train : [loss = 0.114, top1 = 97.86%], valid : [loss = 1.422, top1 = 68.05%], test : [loss = 1.446, top1 = 67.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.97%], valid : [loss = 2.403, top1 = 40.30%], test : [loss = 2.419, top1 = 40.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.37%], valid : [loss = 0.727, top1 = 74.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  619/15625) 000619-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.17%], valid : [loss = 0.571, top1 = 86.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.97 ms.
cifar10        train : [loss = 0.062, top1 = 98.01%], test  : [loss = 0.381, top1 = 89.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.68 ms.
cifar100       train : [loss = 0.670, top1 = 80.24%], valid : [loss = 1.354, top1 = 63.77%], test : [loss = 1.326, top1 = 65.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.04%], valid : [loss = 2.481, top1 = 37.03%], test : [loss = 2.493, top1 = 36.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  620/15625) 000620-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.88 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.31%], valid : [loss = 0.860, top1 = 71.98%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 0.546, top1 = 80.90%], test  : [loss = 0.710, top1 = 75.88%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.71 ms.
cifar100       train : [loss = 1.761, top1 = 52.51%], valid : [loss = 2.051, top1 = 47.37%], test : [loss = 2.075, top1 = 46.51%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.22 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.83%], valid : [loss = 3.637, top1 = 16.76%], test : [loss = 3.670, top1 = 15.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  621/15625) 000621-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.602, top1 = 87.74%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.16 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.390, top1 = 91.56%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.79 ms.
cifar100       train : [loss = 0.159, top1 = 96.61%], valid : [loss = 1.453, top1 = 66.98%], test : [loss = 1.451, top1 = 66.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.61%], valid : [loss = 2.428, top1 = 39.07%], test : [loss = 2.438, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.61%], valid : [loss = 0.743, top1 = 74.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  622/15625) 000622-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.477, top1 = 89.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.305, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.33 ms.
cifar100       train : [loss = 0.280, top1 = 92.68%], valid : [loss = 1.229, top1 = 68.68%], test : [loss = 1.242, top1 = 68.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.09%], valid : [loss = 2.211, top1 = 42.89%], test : [loss = 2.229, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  623/15625) 000623-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.547, top1 = 89.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.340, top1 = 92.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.74 ms.
cifar100       train : [loss = 0.163, top1 = 96.03%], valid : [loss = 1.405, top1 = 67.38%], test : [loss = 1.408, top1 = 68.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.04%], valid : [loss = 2.333, top1 = 39.42%], test : [loss = 2.354, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.52%], valid : [loss = 0.864, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  624/15625) 000624-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.39%], valid : [loss = 1.134, top1 = 62.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.784, top1 = 72.56%], test  : [loss = 0.929, top1 = 67.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.14 ms.
cifar100       train : [loss = 2.132, top1 = 44.09%], valid : [loss = 2.416, top1 = 39.11%], test : [loss = 2.433, top1 = 38.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 3.754, top1 = 14.11%], valid : [loss = 3.817, top1 = 14.10%], test : [loss = 3.825, top1 = 13.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.78%], valid : [loss = 1.412, top1 = 49.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  625/15625) 000625-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.541, top1 = 87.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.358, top1 = 91.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.514, top1 = 85.32%], valid : [loss = 1.337, top1 = 65.03%], test : [loss = 1.334, top1 = 65.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.322, top1 = 40.23%], valid : [loss = 2.466, top1 = 37.06%], test : [loss = 2.475, top1 = 37.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.93%], valid : [loss = 0.819, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  626/15625) 000626-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.482, top1 = 89.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.78 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.308, top1 = 92.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.92 ms.
cifar100       train : [loss = 0.293, top1 = 92.38%], valid : [loss = 1.233, top1 = 67.94%], test : [loss = 1.201, top1 = 69.11%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.39 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.67%], valid : [loss = 2.201, top1 = 43.32%], test : [loss = 2.230, top1 = 42.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.45%], valid : [loss = 0.715, top1 = 75.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  627/15625) 000627-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.15%], valid : [loss = 0.584, top1 = 85.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10        train : [loss = 0.107, top1 = 96.44%], test  : [loss = 0.392, top1 = 88.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.74 ms.
cifar100       train : [loss = 0.821, top1 = 75.89%], valid : [loss = 1.421, top1 = 62.10%], test : [loss = 1.406, top1 = 62.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.76 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.11%], valid : [loss = 2.763, top1 = 31.67%], test : [loss = 2.810, top1 = 31.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  628/15625) 000628-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.574, top1 = 87.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.381, top1 = 91.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.94 ms.
cifar100       train : [loss = 0.395, top1 = 88.95%], valid : [loss = 1.423, top1 = 65.09%], test : [loss = 1.398, top1 = 65.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.95%], valid : [loss = 2.508, top1 = 37.08%], test : [loss = 2.553, top1 = 36.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  629/15625) 000629-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.515, top1 = 89.75%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.07 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.317, top1 = 93.30%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.31 ms.
cifar100       train : [loss = 0.070, top1 = 98.93%], valid : [loss = 1.368, top1 = 69.03%], test : [loss = 1.375, top1 = 69.44%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.79%], valid : [loss = 2.377, top1 = 39.54%], test : [loss = 2.364, top1 = 40.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.820, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  630/15625) 000630-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.494, top1 = 88.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.327, top1 = 92.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.331, top1 = 90.99%], valid : [loss = 1.268, top1 = 67.49%], test : [loss = 1.276, top1 = 67.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.77%], valid : [loss = 2.401, top1 = 39.30%], test : [loss = 2.404, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  631/15625) 000631-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.707, top1 = 85.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.022, top1 = 99.43%], test  : [loss = 0.500, top1 = 88.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.286, top1 = 92.69%], valid : [loss = 1.606, top1 = 63.41%], test : [loss = 1.587, top1 = 62.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.57%], valid : [loss = 2.754, top1 = 32.43%], test : [loss = 2.799, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.11%], valid : [loss = 0.794, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  632/15625) 000632-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.19 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.64 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.68 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  633/15625) 000633-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.41%], valid : [loss = 0.696, top1 = 82.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.150, top1 = 94.93%], test  : [loss = 0.444, top1 = 86.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.43 ms.
cifar100       train : [loss = 0.957, top1 = 72.27%], valid : [loss = 1.617, top1 = 57.68%], test : [loss = 1.610, top1 = 57.13%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 3.090, top1 = 24.55%], valid : [loss = 3.136, top1 = 24.12%], test : [loss = 3.185, top1 = 22.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.66%], valid : [loss = 0.986, top1 = 65.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  634/15625) 000634-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.09%], valid : [loss = 0.512, top1 = 85.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.155, top1 = 94.86%], test  : [loss = 0.378, top1 = 88.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 1.077, top1 = 69.17%], valid : [loss = 1.467, top1 = 60.41%], test : [loss = 1.446, top1 = 60.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.18%], valid : [loss = 2.676, top1 = 33.72%], test : [loss = 2.707, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.59%], valid : [loss = 0.970, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  635/15625) 000635-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.15%], valid : [loss = 0.861, top1 = 71.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 0.547, top1 = 81.10%], test  : [loss = 0.711, top1 = 75.79%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.97 ms.
cifar100       train : [loss = 1.772, top1 = 52.17%], valid : [loss = 2.050, top1 = 47.27%], test : [loss = 2.074, top1 = 46.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.52 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.82%], valid : [loss = 3.629, top1 = 16.49%], test : [loss = 3.669, top1 = 15.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  636/15625) 000636-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.381, top1 = 86.86%], valid : [loss = 0.520, top1 = 82.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10        train : [loss = 0.392, top1 = 86.71%], test  : [loss = 0.461, top1 = 84.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.45 ms.
cifar100       train : [loss = 1.532, top1 = 57.71%], valid : [loss = 1.661, top1 = 54.44%], test : [loss = 1.664, top1 = 54.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 3.039, top1 = 26.31%], valid : [loss = 3.000, top1 = 27.38%], test : [loss = 3.060, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.134, top1 = 59.92%], valid : [loss = 1.146, top1 = 59.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  637/15625) 000637-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.06%], valid : [loss = 0.568, top1 = 86.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10        train : [loss = 0.063, top1 = 97.99%], test  : [loss = 0.379, top1 = 89.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 0.669, top1 = 80.26%], valid : [loss = 1.340, top1 = 64.15%], test : [loss = 1.317, top1 = 64.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.82%], valid : [loss = 2.495, top1 = 37.06%], test : [loss = 2.490, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  638/15625) 000638-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.626, top1 = 86.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.410, top1 = 90.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.82 ms.
cifar100       train : [loss = 0.259, top1 = 93.55%], valid : [loss = 1.481, top1 = 64.84%], test : [loss = 1.477, top1 = 65.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.54%], valid : [loss = 2.569, top1 = 35.80%], test : [loss = 2.559, top1 = 36.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.89%], valid : [loss = 0.770, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  639/15625) 000639-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.187, top1 = 93.71%], valid : [loss = 0.527, top1 = 84.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.189, top1 = 93.55%], test  : [loss = 0.388, top1 = 87.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 1.229, top1 = 65.03%], valid : [loss = 1.538, top1 = 58.32%], test : [loss = 1.530, top1 = 58.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.661, top1 = 33.44%], valid : [loss = 2.698, top1 = 32.43%], test : [loss = 2.728, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.23%], valid : [loss = 0.982, top1 = 65.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  640/15625) 000640-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.38 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.26%], valid : [loss = 0.864, top1 = 71.82%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.89 ms.
cifar10        train : [loss = 0.548, top1 = 80.88%], test  : [loss = 0.710, top1 = 75.86%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.31 ms.
cifar100       train : [loss = 1.768, top1 = 52.22%], valid : [loss = 2.046, top1 = 47.26%], test : [loss = 2.072, top1 = 46.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.40 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.89%], valid : [loss = 3.635, top1 = 16.71%], test : [loss = 3.653, top1 = 15.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  641/15625) 000641-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.562, top1 = 88.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.366, top1 = 92.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 0.166, top1 = 96.41%], valid : [loss = 1.394, top1 = 67.77%], test : [loss = 1.382, top1 = 67.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.31%], valid : [loss = 2.464, top1 = 38.69%], test : [loss = 2.475, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.48%], valid : [loss = 0.710, top1 = 75.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  642/15625) 000642-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.45%], valid : [loss = 0.512, top1 = 85.95%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.159, top1 = 94.69%], test  : [loss = 0.379, top1 = 88.04%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.39 ms.
cifar100       train : [loss = 0.889, top1 = 74.43%], valid : [loss = 1.347, top1 = 62.93%], test : [loss = 1.322, top1 = 63.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 34.01%], valid : [loss = 2.706, top1 = 32.70%], test : [loss = 2.738, top1 = 31.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.886, top1 = 68.60%], valid : [loss = 0.922, top1 = 67.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  643/15625) 000643-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.58%], valid : [loss = 0.557, top1 = 87.32%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.46 ms.
cifar10        train : [loss = 0.040, top1 = 98.79%], test  : [loss = 0.369, top1 = 90.45%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.04 ms.
cifar100       train : [loss = 0.464, top1 = 86.58%], valid : [loss = 1.320, top1 = 65.85%], test : [loss = 1.329, top1 = 66.01%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 2.211, top1 = 42.71%], valid : [loss = 2.401, top1 = 38.76%], test : [loss = 2.430, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.20%], valid : [loss = 0.773, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  644/15625) 000644-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.570, top1 = 88.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.355, top1 = 91.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.31 ms.
cifar100       train : [loss = 0.289, top1 = 91.91%], valid : [loss = 1.315, top1 = 67.43%], test : [loss = 1.336, top1 = 67.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.03%], valid : [loss = 2.424, top1 = 38.17%], test : [loss = 2.423, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  645/15625) 000645-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.11 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.303, top1 = 93.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.21 ms.
cifar100       train : [loss = 0.128, top1 = 97.49%], valid : [loss = 1.299, top1 = 69.36%], test : [loss = 1.290, top1 = 69.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.28%], valid : [loss = 2.289, top1 = 42.31%], test : [loss = 2.254, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  646/15625) 000646-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.83%], valid : [loss = 0.538, top1 = 84.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.189, top1 = 93.60%], test  : [loss = 0.395, top1 = 87.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.61 ms.
cifar100       train : [loss = 1.245, top1 = 64.54%], valid : [loss = 1.536, top1 = 57.90%], test : [loss = 1.543, top1 = 57.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.19%], valid : [loss = 2.723, top1 = 32.46%], test : [loss = 2.760, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.43%], valid : [loss = 0.956, top1 = 66.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  647/15625) 000647-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.533, top1 = 89.47%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.316, top1 = 93.20%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.99 ms.
cifar100       train : [loss = 0.068, top1 = 98.93%], valid : [loss = 1.368, top1 = 69.70%], test : [loss = 1.382, top1 = 69.36%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.53%], valid : [loss = 2.302, top1 = 42.20%], test : [loss = 2.281, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.27%], valid : [loss = 0.742, top1 = 74.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  648/15625) 000648-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.499, top1 = 90.11%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.307, top1 = 93.48%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.20 ms.
cifar100       train : [loss = 0.039, top1 = 99.50%], valid : [loss = 1.357, top1 = 70.59%], test : [loss = 1.349, top1 = 70.79%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.99 ms.
ImageNet16-120 train : [loss = 1.612, top1 = 56.56%], valid : [loss = 2.153, top1 = 44.62%], test : [loss = 2.169, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.79%], valid : [loss = 0.768, top1 = 72.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  649/15625) 000649-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=22.04 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.572, top1 = 87.36%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=19.97 ms.
cifar10        train : [loss = 0.033, top1 = 99.05%], test  : [loss = 0.374, top1 = 90.60%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=22.44 ms.
cifar100       train : [loss = 0.380, top1 = 89.34%], valid : [loss = 1.264, top1 = 67.45%], test : [loss = 1.272, top1 = 67.13%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=20.33 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.12%], valid : [loss = 2.362, top1 = 40.02%], test : [loss = 2.383, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.25%], valid : [loss = 0.769, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  650/15625) 000650-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.582, top1 = 87.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.024, top1 = 99.30%], test  : [loss = 0.400, top1 = 90.73%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.21 ms.
cifar100       train : [loss = 0.333, top1 = 90.73%], valid : [loss = 1.442, top1 = 64.27%], test : [loss = 1.443, top1 = 64.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.896, top1 = 27.77%], valid : [loss = 2.960, top1 = 26.68%], test : [loss = 2.960, top1 = 26.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  651/15625) 000651-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.237, top1 = 91.91%], valid : [loss = 0.537, top1 = 83.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10        train : [loss = 0.243, top1 = 91.66%], test  : [loss = 0.400, top1 = 87.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.335, top1 = 62.51%], valid : [loss = 1.592, top1 = 56.51%], test : [loss = 1.580, top1 = 56.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 2.849, top1 = 29.77%], valid : [loss = 2.870, top1 = 29.92%], test : [loss = 2.926, top1 = 28.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  652/15625) 000652-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.528, top1 = 89.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.331, top1 = 93.05%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.95 ms.
cifar100       train : [loss = 0.105, top1 = 98.01%], valid : [loss = 1.333, top1 = 68.77%], test : [loss = 1.327, top1 = 69.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.62%], valid : [loss = 2.302, top1 = 41.49%], test : [loss = 2.265, top1 = 42.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.96%], valid : [loss = 0.748, top1 = 73.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  653/15625) 000653-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.570, top1 = 87.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.384, top1 = 91.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 0.399, top1 = 88.71%], valid : [loss = 1.388, top1 = 65.70%], test : [loss = 1.383, top1 = 65.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.68 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.88%], valid : [loss = 2.528, top1 = 36.34%], test : [loss = 2.533, top1 = 36.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  654/15625) 000654-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.453, top1 = 90.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.301, top1 = 93.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.19 ms.
cifar100       train : [loss = 0.071, top1 = 98.81%], valid : [loss = 1.345, top1 = 70.55%], test : [loss = 1.328, top1 = 70.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 1.543, top1 = 58.35%], valid : [loss = 2.206, top1 = 44.82%], test : [loss = 2.250, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.339, top1 = 88.48%], valid : [loss = 0.489, top1 = 83.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  655/15625) 000655-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.439, top1 = 91.34%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.66 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.289, top1 = 94.08%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.13 ms.
cifar100       train : [loss = 0.018, top1 = 99.88%], valid : [loss = 1.342, top1 = 71.73%], test : [loss = 1.328, top1 = 72.01%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.87 ms.
ImageNet16-120 train : [loss = 1.111, top1 = 69.19%], valid : [loss = 2.256, top1 = 45.57%], test : [loss = 2.262, top1 = 45.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.318, top1 = 89.37%], valid : [loss = 0.475, top1 = 84.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  656/15625) 000656-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.60%], valid : [loss = 0.564, top1 = 87.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.033, top1 = 99.05%], test  : [loss = 0.367, top1 = 90.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.01 ms.
cifar100       train : [loss = 0.472, top1 = 86.39%], valid : [loss = 1.328, top1 = 64.99%], test : [loss = 1.338, top1 = 65.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.48%], valid : [loss = 2.624, top1 = 33.30%], test : [loss = 2.645, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  657/15625) 000657-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.96%], valid : [loss = 0.475, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.300, top1 = 89.99%], test  : [loss = 0.396, top1 = 86.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.21 ms.
cifar100       train : [loss = 1.320, top1 = 63.29%], valid : [loss = 1.537, top1 = 57.70%], test : [loss = 1.509, top1 = 58.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.82%], valid : [loss = 2.901, top1 = 29.80%], test : [loss = 2.952, top1 = 27.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  658/15625) 000658-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.439, top1 = 90.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.297, top1 = 93.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.11 ms.
cifar100       train : [loss = 0.157, top1 = 96.41%], valid : [loss = 1.296, top1 = 69.68%], test : [loss = 1.284, top1 = 69.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 1.761, top1 = 53.12%], valid : [loss = 2.238, top1 = 43.37%], test : [loss = 2.290, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.398, top1 = 86.28%], valid : [loss = 0.529, top1 = 82.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  659/15625) 000659-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.01%], valid : [loss = 0.475, top1 = 84.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10        train : [loss = 0.297, top1 = 90.03%], test  : [loss = 0.389, top1 = 86.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.45 ms.
cifar100       train : [loss = 1.315, top1 = 63.55%], valid : [loss = 1.524, top1 = 57.87%], test : [loss = 1.486, top1 = 58.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.65%], valid : [loss = 2.900, top1 = 30.55%], test : [loss = 2.949, top1 = 28.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.13%], valid : [loss = 0.731, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  660/15625) 000660-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.07%], valid : [loss = 0.605, top1 = 80.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.26 ms.
cifar10        train : [loss = 0.320, top1 = 88.97%], test  : [loss = 0.455, top1 = 84.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.82 ms.
cifar100       train : [loss = 1.546, top1 = 56.91%], valid : [loss = 1.759, top1 = 52.38%], test : [loss = 1.772, top1 = 52.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 3.114, top1 = 24.52%], valid : [loss = 3.117, top1 = 24.45%], test : [loss = 3.192, top1 = 23.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.37%], valid : [loss = 1.085, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  661/15625) 000661-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.27%], valid : [loss = 0.629, top1 = 85.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.51 ms.
cifar10        train : [loss = 0.059, top1 = 98.21%], test  : [loss = 0.433, top1 = 88.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.40 ms.
cifar100       train : [loss = 0.656, top1 = 80.79%], valid : [loss = 1.388, top1 = 63.37%], test : [loss = 1.394, top1 = 63.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.50%], valid : [loss = 2.626, top1 = 34.78%], test : [loss = 2.667, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.38%], valid : [loss = 0.853, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  662/15625) 000662-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.563, top1 = 87.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10        train : [loss = 0.032, top1 = 99.03%], test  : [loss = 0.380, top1 = 90.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.515, top1 = 85.06%], valid : [loss = 1.370, top1 = 64.46%], test : [loss = 1.369, top1 = 64.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 2.594, top1 = 34.13%], valid : [loss = 2.667, top1 = 31.47%], test : [loss = 2.689, top1 = 32.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.45%], valid : [loss = 0.868, top1 = 69.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  663/15625) 000663-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.485, top1 = 90.28%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.10 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.312, top1 = 93.24%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.95 ms.
cifar100       train : [loss = 0.061, top1 = 99.09%], valid : [loss = 1.375, top1 = 69.44%], test : [loss = 1.339, top1 = 70.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.01 ms.
ImageNet16-120 train : [loss = 1.523, top1 = 58.78%], valid : [loss = 2.200, top1 = 44.12%], test : [loss = 2.209, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.68%], valid : [loss = 0.574, top1 = 80.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  664/15625) 000664-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.510, top1 = 88.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.028, top1 = 99.25%], test  : [loss = 0.351, top1 = 91.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.56 ms.
cifar100       train : [loss = 0.479, top1 = 85.93%], valid : [loss = 1.340, top1 = 65.71%], test : [loss = 1.343, top1 = 65.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.32%], valid : [loss = 2.517, top1 = 36.98%], test : [loss = 2.530, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  665/15625) 000665-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.495, top1 = 88.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.48 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.349, top1 = 91.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.87 ms.
cifar100       train : [loss = 0.383, top1 = 89.09%], valid : [loss = 1.341, top1 = 66.75%], test : [loss = 1.341, top1 = 66.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.25 ms.
ImageNet16-120 train : [loss = 2.170, top1 = 43.81%], valid : [loss = 2.405, top1 = 38.80%], test : [loss = 2.447, top1 = 38.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.24%], valid : [loss = 0.628, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  666/15625) 000666-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.480, top1 = 89.30%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.69 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.307, top1 = 92.55%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.90 ms.
cifar100       train : [loss = 0.230, top1 = 94.45%], valid : [loss = 1.230, top1 = 68.20%], test : [loss = 1.240, top1 = 68.99%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.93 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.52%], valid : [loss = 2.257, top1 = 42.18%], test : [loss = 2.269, top1 = 42.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.47%], valid : [loss = 0.677, top1 = 76.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  667/15625) 000667-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.546, top1 = 88.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.029, top1 = 99.15%], test  : [loss = 0.365, top1 = 91.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.441, top1 = 87.02%], valid : [loss = 1.279, top1 = 67.21%], test : [loss = 1.267, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.80%], valid : [loss = 2.371, top1 = 39.43%], test : [loss = 2.411, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.91%], valid : [loss = 0.793, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  668/15625) 000668-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.33%], valid : [loss = 0.669, top1 = 85.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10        train : [loss = 0.055, top1 = 98.33%], test  : [loss = 0.453, top1 = 88.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 0.631, top1 = 81.57%], valid : [loss = 1.516, top1 = 61.44%], test : [loss = 1.514, top1 = 62.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 33.21%], valid : [loss = 2.824, top1 = 30.08%], test : [loss = 2.859, top1 = 30.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.86%], valid : [loss = 0.895, top1 = 68.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  669/15625) 000669-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.81 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  670/15625) 000670-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.21%], valid : [loss = 0.604, top1 = 85.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.404, top1 = 88.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 0.711, top1 = 79.30%], valid : [loss = 1.395, top1 = 63.13%], test : [loss = 1.392, top1 = 62.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.81%], valid : [loss = 2.658, top1 = 33.60%], test : [loss = 2.699, top1 = 32.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  671/15625) 000671-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.37%], valid : [loss = 0.694, top1 = 81.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.142, top1 = 95.17%], test  : [loss = 0.447, top1 = 87.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 0.954, top1 = 72.29%], valid : [loss = 1.635, top1 = 56.74%], test : [loss = 1.617, top1 = 57.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 25.51%], valid : [loss = 3.103, top1 = 25.40%], test : [loss = 3.165, top1 = 23.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.15%], valid : [loss = 1.050, top1 = 62.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  672/15625) 000672-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.483, top1 = 89.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.62 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.315, top1 = 92.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.86 ms.
cifar100       train : [loss = 0.299, top1 = 92.05%], valid : [loss = 1.256, top1 = 67.98%], test : [loss = 1.243, top1 = 68.45%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.96 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.22%], valid : [loss = 2.269, top1 = 41.90%], test : [loss = 2.288, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.490, top1 = 83.01%], valid : [loss = 0.584, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  673/15625) 000673-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.190, top1 = 93.66%], valid : [loss = 0.542, top1 = 83.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.76 ms.
cifar10        train : [loss = 0.194, top1 = 93.41%], test  : [loss = 0.389, top1 = 87.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 1.174, top1 = 66.36%], valid : [loss = 1.513, top1 = 58.38%], test : [loss = 1.498, top1 = 59.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.721, top1 = 32.17%], valid : [loss = 2.748, top1 = 31.29%], test : [loss = 2.784, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.18%], valid : [loss = 0.996, top1 = 64.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  674/15625) 000674-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.77%], valid : [loss = 0.842, top1 = 72.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.84 ms.
cifar10        train : [loss = 0.561, top1 = 80.42%], test  : [loss = 0.715, top1 = 75.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.46 ms.
cifar100       train : [loss = 1.781, top1 = 51.99%], valid : [loss = 2.053, top1 = 46.55%], test : [loss = 2.061, top1 = 47.11%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.80%], valid : [loss = 3.633, top1 = 16.67%], test : [loss = 3.657, top1 = 16.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  675/15625) 000675-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.56 ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.58%], valid : [loss = 1.097, top1 = 62.72%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10        train : [loss = 0.893, top1 = 68.49%], test  : [loss = 0.967, top1 = 65.90%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.65 ms.
cifar100       train : [loss = 2.291, top1 = 40.57%], valid : [loss = 2.510, top1 = 37.21%], test : [loss = 2.522, top1 = 36.77%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 3.821, top1 = 12.99%], valid : [loss = 3.843, top1 = 13.68%], test : [loss = 3.843, top1 = 13.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.503, top1 = 44.78%], valid : [loss = 1.526, top1 = 44.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  676/15625) 000676-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.39%], valid : [loss = 0.800, top1 = 80.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10        train : [loss = 0.112, top1 = 96.27%], test  : [loss = 0.551, top1 = 85.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.585, top1 = 83.10%], valid : [loss = 1.710, top1 = 57.74%], test : [loss = 1.775, top1 = 57.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 3.302, top1 = 20.59%], valid : [loss = 3.336, top1 = 20.17%], test : [loss = 3.354, top1 = 19.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.233, top1 = 54.79%], valid : [loss = 1.273, top1 = 53.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  677/15625) 000677-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.61%], valid : [loss = 0.864, top1 = 72.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.552, top1 = 80.65%], test  : [loss = 0.714, top1 = 75.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 1.759, top1 = 52.61%], valid : [loss = 2.025, top1 = 47.63%], test : [loss = 2.046, top1 = 47.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.90%], valid : [loss = 3.626, top1 = 16.62%], test : [loss = 3.673, top1 = 16.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  678/15625) 000678-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.42 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.342, top1 = 91.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.10 ms.
cifar100       train : [loss = 0.205, top1 = 95.04%], valid : [loss = 1.297, top1 = 68.20%], test : [loss = 1.294, top1 = 68.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.71%], valid : [loss = 2.307, top1 = 41.13%], test : [loss = 2.360, top1 = 41.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.29%], valid : [loss = 0.735, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  679/15625) 000679-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.526, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.337, top1 = 91.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.32 ms.
cifar100       train : [loss = 0.339, top1 = 90.77%], valid : [loss = 1.282, top1 = 67.45%], test : [loss = 1.284, top1 = 67.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.95%], valid : [loss = 2.422, top1 = 39.22%], test : [loss = 2.427, top1 = 38.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  680/15625) 000680-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.490, top1 = 89.02%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.91 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.309, top1 = 92.38%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.66 ms.
cifar100       train : [loss = 0.243, top1 = 94.04%], valid : [loss = 1.249, top1 = 68.88%], test : [loss = 1.232, top1 = 68.60%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 1.777, top1 = 52.70%], valid : [loss = 2.169, top1 = 44.20%], test : [loss = 2.178, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 77.00%], valid : [loss = 0.719, top1 = 74.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  681/15625) 000681-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.517, top1 = 89.49%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.97 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.308, top1 = 93.17%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.17 ms.
cifar100       train : [loss = 0.114, top1 = 97.75%], valid : [loss = 1.281, top1 = 69.62%], test : [loss = 1.264, top1 = 70.22%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.710, top1 = 54.31%], valid : [loss = 2.171, top1 = 44.25%], test : [loss = 2.172, top1 = 44.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.96%], valid : [loss = 0.728, top1 = 74.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  682/15625) 000682-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.512, top1 = 89.64%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.96 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.321, top1 = 93.22%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.47 ms.
cifar100       train : [loss = 0.070, top1 = 98.92%], valid : [loss = 1.362, top1 = 69.62%], test : [loss = 1.351, top1 = 69.29%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 46.94%], valid : [loss = 2.388, top1 = 39.18%], test : [loss = 2.391, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.38%], valid : [loss = 0.784, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  683/15625) 000683-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.72%], valid : [loss = 0.885, top1 = 69.36%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10        train : [loss = 0.727, top1 = 74.46%], test  : [loss = 0.779, top1 = 73.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.10 ms.
cifar100       train : [loss = 2.342, top1 = 38.91%], valid : [loss = 2.455, top1 = 36.96%], test : [loss = 2.440, top1 = 37.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.99 ms.
ImageNet16-120 train : [loss = 3.524, top1 = 17.57%], valid : [loss = 3.522, top1 = 18.15%], test : [loss = 3.530, top1 = 17.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 46.90%], valid : [loss = 1.500, top1 = 45.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  684/15625) 000684-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.446, top1 = 90.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.298, top1 = 93.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.29 ms.
cifar100       train : [loss = 0.063, top1 = 99.06%], valid : [loss = 1.360, top1 = 69.63%], test : [loss = 1.310, top1 = 71.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 1.516, top1 = 58.97%], valid : [loss = 2.226, top1 = 44.62%], test : [loss = 2.268, top1 = 43.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.56%], valid : [loss = 0.520, top1 = 82.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  685/15625) 000685-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.36%], valid : [loss = 0.577, top1 = 86.63%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.66 ms.
cifar10        train : [loss = 0.054, top1 = 98.32%], test  : [loss = 0.363, top1 = 90.33%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.32 ms.
cifar100       train : [loss = 0.575, top1 = 83.28%], valid : [loss = 1.341, top1 = 64.66%], test : [loss = 1.318, top1 = 64.95%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.04%], valid : [loss = 2.431, top1 = 37.78%], test : [loss = 2.446, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.92%], valid : [loss = 0.735, top1 = 74.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  686/15625) 000686-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.596, top1 = 88.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.378, top1 = 91.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.35 ms.
cifar100       train : [loss = 0.085, top1 = 98.63%], valid : [loss = 1.464, top1 = 67.93%], test : [loss = 1.455, top1 = 68.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.91%], valid : [loss = 2.453, top1 = 38.80%], test : [loss = 2.462, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.16%], valid : [loss = 0.709, top1 = 75.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  687/15625) 000687-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.314, top1 = 89.29%], valid : [loss = 0.539, top1 = 82.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.274, top1 = 90.61%], test  : [loss = 0.435, top1 = 85.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.18 ms.
cifar100       train : [loss = 1.460, top1 = 59.31%], valid : [loss = 1.679, top1 = 54.66%], test : [loss = 1.685, top1 = 54.71%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.68 ms.
ImageNet16-120 train : [loss = 2.954, top1 = 27.64%], valid : [loss = 2.960, top1 = 28.20%], test : [loss = 3.008, top1 = 26.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.87%], valid : [loss = 1.064, top1 = 62.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  688/15625) 000688-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.528, top1 = 89.53%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.74 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.339, top1 = 93.08%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.70 ms.
cifar100       train : [loss = 0.072, top1 = 98.84%], valid : [loss = 1.389, top1 = 68.79%], test : [loss = 1.396, top1 = 69.23%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.28 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.57%], valid : [loss = 2.295, top1 = 41.72%], test : [loss = 2.300, top1 = 41.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.73%], valid : [loss = 0.654, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  689/15625) 000689-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.432, top1 = 90.14%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.293, top1 = 92.96%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.96 ms.
cifar100       train : [loss = 0.113, top1 = 97.89%], valid : [loss = 1.264, top1 = 70.56%], test : [loss = 1.279, top1 = 70.33%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 1.653, top1 = 55.73%], valid : [loss = 2.189, top1 = 44.67%], test : [loss = 2.218, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 87.18%], valid : [loss = 0.514, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  690/15625) 000690-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.85%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.67 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.292, top1 = 93.75%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.67 ms.
cifar100       train : [loss = 0.047, top1 = 99.48%], valid : [loss = 1.352, top1 = 70.97%], test : [loss = 1.325, top1 = 71.22%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 1.463, top1 = 60.38%], valid : [loss = 2.217, top1 = 44.22%], test : [loss = 2.247, top1 = 44.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 87.08%], valid : [loss = 0.506, top1 = 83.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  691/15625) 000691-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.641, top1 = 86.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.030, top1 = 99.21%], test  : [loss = 0.430, top1 = 89.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.65 ms.
cifar100       train : [loss = 0.375, top1 = 89.89%], valid : [loss = 1.438, top1 = 64.74%], test : [loss = 1.416, top1 = 64.97%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.281, top1 = 41.52%], valid : [loss = 2.602, top1 = 34.98%], test : [loss = 2.623, top1 = 35.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  692/15625) 000692-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.463, top1 = 90.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.301, top1 = 93.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.48 ms.
cifar100       train : [loss = 0.080, top1 = 98.71%], valid : [loss = 1.369, top1 = 69.63%], test : [loss = 1.372, top1 = 69.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 1.597, top1 = 57.07%], valid : [loss = 2.270, top1 = 42.90%], test : [loss = 2.305, top1 = 43.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.95%], valid : [loss = 0.513, top1 = 82.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  693/15625) 000693-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.63%], valid : [loss = 0.946, top1 = 67.70%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 0.774, top1 = 72.84%], test  : [loss = 0.861, top1 = 69.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.01 ms.
cifar100       train : [loss = 2.129, top1 = 43.89%], valid : [loss = 2.311, top1 = 40.68%], test : [loss = 2.335, top1 = 40.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.84 ms.
ImageNet16-120 train : [loss = 3.738, top1 = 14.36%], valid : [loss = 3.766, top1 = 14.43%], test : [loss = 3.775, top1 = 13.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.460, top1 = 46.64%], valid : [loss = 1.477, top1 = 46.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  694/15625) 000694-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.570, top1 = 87.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.376, top1 = 91.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 0.392, top1 = 88.89%], valid : [loss = 1.397, top1 = 65.97%], test : [loss = 1.406, top1 = 65.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.73%], valid : [loss = 2.518, top1 = 36.75%], test : [loss = 2.535, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  695/15625) 000695-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.524, top1 = 89.53%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.40 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.312, top1 = 93.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.97 ms.
cifar100       train : [loss = 0.075, top1 = 98.77%], valid : [loss = 1.334, top1 = 69.72%], test : [loss = 1.366, top1 = 69.15%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 47.90%], valid : [loss = 2.345, top1 = 39.97%], test : [loss = 2.329, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 77.00%], valid : [loss = 0.714, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  696/15625) 000696-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.29%], valid : [loss = 0.555, top1 = 83.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.203, top1 = 93.20%], test  : [loss = 0.397, top1 = 87.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.62 ms.
cifar100       train : [loss = 1.255, top1 = 64.23%], valid : [loss = 1.551, top1 = 57.79%], test : [loss = 1.561, top1 = 57.25%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.41 ms.
ImageNet16-120 train : [loss = 2.721, top1 = 32.18%], valid : [loss = 2.744, top1 = 31.67%], test : [loss = 2.776, top1 = 31.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  697/15625) 000697-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.51%], valid : [loss = 0.603, top1 = 86.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.88 ms.
cifar10        train : [loss = 0.036, top1 = 98.86%], test  : [loss = 0.395, top1 = 90.70%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.45 ms.
cifar100       train : [loss = 0.304, top1 = 91.36%], valid : [loss = 1.484, top1 = 64.89%], test : [loss = 1.482, top1 = 64.55%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.806, top1 = 29.49%], valid : [loss = 2.890, top1 = 27.67%], test : [loss = 2.903, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.187, top1 = 56.22%], valid : [loss = 1.190, top1 = 56.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  698/15625) 000698-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.560, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.15 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.366, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.91 ms.
cifar100       train : [loss = 0.098, top1 = 98.25%], valid : [loss = 1.457, top1 = 67.59%], test : [loss = 1.431, top1 = 68.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 51.15%], valid : [loss = 2.400, top1 = 39.67%], test : [loss = 2.414, top1 = 40.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.04%], valid : [loss = 0.724, top1 = 74.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  699/15625) 000699-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.392, top1 = 91.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.52 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.259, top1 = 93.85%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.09 ms.
cifar100       train : [loss = 0.047, top1 = 99.47%], valid : [loss = 1.266, top1 = 72.02%], test : [loss = 1.228, top1 = 72.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.409, top1 = 61.51%], valid : [loss = 2.202, top1 = 45.67%], test : [loss = 2.247, top1 = 45.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.331, top1 = 88.71%], valid : [loss = 0.481, top1 = 84.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  700/15625) 000700-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.323, top1 = 91.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.16 ms.
cifar100       train : [loss = 0.329, top1 = 91.16%], valid : [loss = 1.330, top1 = 66.13%], test : [loss = 1.323, top1 = 66.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.32 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.25%], valid : [loss = 2.349, top1 = 40.31%], test : [loss = 2.413, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  701/15625) 000701-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.33%], valid : [loss = 0.466, top1 = 85.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.154, top1 = 94.92%], test  : [loss = 0.345, top1 = 88.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.18 ms.
cifar100       train : [loss = 0.983, top1 = 71.97%], valid : [loss = 1.338, top1 = 62.58%], test : [loss = 1.343, top1 = 62.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.05%], valid : [loss = 2.674, top1 = 32.90%], test : [loss = 2.695, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  702/15625) 000702-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.506, top1 = 90.04%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.62 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.312, top1 = 93.15%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.95 ms.
cifar100       train : [loss = 0.116, top1 = 97.65%], valid : [loss = 1.263, top1 = 70.35%], test : [loss = 1.261, top1 = 70.01%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.15 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.72%], valid : [loss = 2.168, top1 = 43.88%], test : [loss = 2.195, top1 = 43.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.62%], valid : [loss = 0.703, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  703/15625) 000703-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.550, top1 = 89.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.368, top1 = 92.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.49 ms.
cifar100       train : [loss = 0.098, top1 = 98.28%], valid : [loss = 1.454, top1 = 68.04%], test : [loss = 1.451, top1 = 68.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.69%], valid : [loss = 2.419, top1 = 39.88%], test : [loss = 2.457, top1 = 39.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  704/15625) 000704-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.44%], valid : [loss = 0.466, top1 = 86.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10        train : [loss = 0.156, top1 = 94.80%], test  : [loss = 0.350, top1 = 88.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.74 ms.
cifar100       train : [loss = 0.966, top1 = 72.50%], valid : [loss = 1.339, top1 = 62.71%], test : [loss = 1.342, top1 = 62.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.98%], valid : [loss = 2.683, top1 = 33.23%], test : [loss = 2.711, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  705/15625) 000705-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.21%], valid : [loss = 0.550, top1 = 83.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10        train : [loss = 0.198, top1 = 93.36%], test  : [loss = 0.395, top1 = 87.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.85 ms.
cifar100       train : [loss = 1.262, top1 = 64.20%], valid : [loss = 1.553, top1 = 57.67%], test : [loss = 1.553, top1 = 57.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.702, top1 = 32.65%], valid : [loss = 2.731, top1 = 32.04%], test : [loss = 2.783, top1 = 31.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  706/15625) 000706-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.80%], valid : [loss = 0.637, top1 = 84.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10        train : [loss = 0.085, top1 = 97.30%], test  : [loss = 0.408, top1 = 88.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 0.777, top1 = 77.23%], valid : [loss = 1.439, top1 = 61.59%], test : [loss = 1.413, top1 = 61.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.43%], valid : [loss = 2.729, top1 = 32.35%], test : [loss = 2.760, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  707/15625) 000707-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.488, top1 = 90.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.38%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.20 ms.
cifar100       train : [loss = 0.063, top1 = 99.14%], valid : [loss = 1.309, top1 = 70.34%], test : [loss = 1.333, top1 = 70.02%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 1.619, top1 = 56.42%], valid : [loss = 2.190, top1 = 44.53%], test : [loss = 2.160, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.92%], valid : [loss = 0.617, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  708/15625) 000708-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.490, top1 = 90.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.319, top1 = 93.11%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.68 ms.
cifar100       train : [loss = 0.124, top1 = 97.48%], valid : [loss = 1.316, top1 = 68.43%], test : [loss = 1.323, top1 = 69.01%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.62%], valid : [loss = 2.192, top1 = 44.15%], test : [loss = 2.185, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.74%], valid : [loss = 0.663, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  709/15625) 000709-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.20%], valid : [loss = 0.449, top1 = 87.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10        train : [loss = 0.112, top1 = 96.59%], test  : [loss = 0.328, top1 = 89.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.852, top1 = 75.84%], valid : [loss = 1.273, top1 = 64.02%], test : [loss = 1.283, top1 = 64.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.63%], valid : [loss = 2.612, top1 = 34.37%], test : [loss = 2.646, top1 = 33.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.61%], valid : [loss = 0.631, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  710/15625) 000710-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.65%], valid : [loss = 0.741, top1 = 79.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.181, top1 = 93.67%], test  : [loss = 0.510, top1 = 85.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.33 ms.
cifar100       train : [loss = 0.879, top1 = 74.33%], valid : [loss = 1.660, top1 = 57.27%], test : [loss = 1.651, top1 = 57.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.512, top1 = 16.70%], valid : [loss = 3.521, top1 = 16.57%], test : [loss = 3.524, top1 = 16.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.38%], valid : [loss = 1.303, top1 = 52.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  711/15625) 000711-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.35%], valid : [loss = 0.459, top1 = 86.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.329, top1 = 89.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 0.873, top1 = 75.20%], valid : [loss = 1.300, top1 = 63.93%], test : [loss = 1.280, top1 = 63.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.51%], valid : [loss = 2.636, top1 = 34.56%], test : [loss = 2.665, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  712/15625) 000712-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.35%], valid : [loss = 0.451, top1 = 86.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10        train : [loss = 0.151, top1 = 95.10%], test  : [loss = 0.345, top1 = 89.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.02 ms.
cifar100       train : [loss = 0.970, top1 = 72.57%], valid : [loss = 1.339, top1 = 63.03%], test : [loss = 1.330, top1 = 63.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.84%], valid : [loss = 2.690, top1 = 32.82%], test : [loss = 2.711, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  713/15625) 000713-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.59%], valid : [loss = 0.630, top1 = 84.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.092, top1 = 97.01%], test  : [loss = 0.413, top1 = 88.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.34 ms.
cifar100       train : [loss = 0.690, top1 = 79.56%], valid : [loss = 1.539, top1 = 60.60%], test : [loss = 1.536, top1 = 60.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 3.184, top1 = 22.44%], valid : [loss = 3.192, top1 = 22.50%], test : [loss = 3.230, top1 = 21.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.96%], valid : [loss = 1.085, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  714/15625) 000714-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.291, top1 = 92.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 0.201, top1 = 95.27%], valid : [loss = 1.281, top1 = 68.98%], test : [loss = 1.264, top1 = 69.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.07%], valid : [loss = 2.242, top1 = 43.03%], test : [loss = 2.283, top1 = 42.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  715/15625) 000715-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.13%], valid : [loss = 0.456, top1 = 86.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10        train : [loss = 0.112, top1 = 96.58%], test  : [loss = 0.322, top1 = 89.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.80 ms.
cifar100       train : [loss = 0.857, top1 = 75.60%], valid : [loss = 1.302, top1 = 64.00%], test : [loss = 1.292, top1 = 64.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.565, top1 = 35.38%], valid : [loss = 2.611, top1 = 34.95%], test : [loss = 2.667, top1 = 33.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.86%], valid : [loss = 0.650, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  716/15625) 000716-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.81 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.26%], valid : [loss = 0.863, top1 = 71.76%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.91 ms.
cifar10        train : [loss = 0.554, top1 = 80.67%], test  : [loss = 0.709, top1 = 75.67%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.74 ms.
cifar100       train : [loss = 1.772, top1 = 52.18%], valid : [loss = 2.050, top1 = 47.09%], test : [loss = 2.072, top1 = 46.14%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.85 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.84%], valid : [loss = 3.640, top1 = 16.12%], test : [loss = 3.653, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  717/15625) 000717-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.556, top1 = 88.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.375, top1 = 91.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.191, top1 = 95.61%], valid : [loss = 1.440, top1 = 66.85%], test : [loss = 1.441, top1 = 66.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.85 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.53%], valid : [loss = 2.432, top1 = 39.75%], test : [loss = 2.447, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.697, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  718/15625) 000718-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.93%], valid : [loss = 0.577, top1 = 86.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10        train : [loss = 0.061, top1 = 98.04%], test  : [loss = 0.380, top1 = 89.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.04 ms.
cifar100       train : [loss = 0.663, top1 = 80.50%], valid : [loss = 1.338, top1 = 64.60%], test : [loss = 1.337, top1 = 64.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.353, top1 = 39.71%], valid : [loss = 2.486, top1 = 36.62%], test : [loss = 2.509, top1 = 36.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  719/15625) 000719-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.45%], valid : [loss = 0.689, top1 = 76.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.364, top1 = 87.31%], test  : [loss = 0.498, top1 = 83.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.31 ms.
cifar100       train : [loss = 1.651, top1 = 54.50%], valid : [loss = 1.869, top1 = 50.21%], test : [loss = 1.877, top1 = 50.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 3.218, top1 = 22.85%], valid : [loss = 3.210, top1 = 23.03%], test : [loss = 3.287, top1 = 21.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.223, top1 = 55.87%], valid : [loss = 1.251, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  720/15625) 000720-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.76%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.340, top1 = 91.97%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.25 ms.
cifar100       train : [loss = 0.342, top1 = 90.70%], valid : [loss = 1.261, top1 = 67.09%], test : [loss = 1.263, top1 = 67.66%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.72%], valid : [loss = 2.402, top1 = 39.10%], test : [loss = 2.428, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.65%], valid : [loss = 0.786, top1 = 72.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  721/15625) 000721-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.446, top1 = 89.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.292, top1 = 92.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.199, top1 = 95.41%], valid : [loss = 1.247, top1 = 69.40%], test : [loss = 1.244, top1 = 69.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.46%], valid : [loss = 2.256, top1 = 42.52%], test : [loss = 2.298, top1 = 42.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.23%], valid : [loss = 0.559, top1 = 81.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  722/15625) 000722-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.433, top1 = 91.15%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.292, top1 = 93.78%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.73 ms.
cifar100       train : [loss = 0.034, top1 = 99.67%], valid : [loss = 1.344, top1 = 71.37%], test : [loss = 1.283, top1 = 72.26%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 1.321, top1 = 63.73%], valid : [loss = 2.176, top1 = 46.02%], test : [loss = 2.264, top1 = 44.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.74%], valid : [loss = 0.472, top1 = 84.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  723/15625) 000723-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10-valid  train : [loss = 1.111, top1 = 60.50%], valid : [loss = 1.160, top1 = 58.91%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10        train : [loss = 1.053, top1 = 62.78%], test  : [loss = 1.054, top1 = 62.72%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.08 ms.
cifar100       train : [loss = 2.556, top1 = 35.29%], valid : [loss = 2.629, top1 = 34.27%], test : [loss = 2.611, top1 = 34.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.26 ms.
ImageNet16-120 train : [loss = 3.781, top1 = 13.73%], valid : [loss = 3.758, top1 = 14.68%], test : [loss = 3.790, top1 = 13.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  724/15625) 000724-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.55%], valid : [loss = 0.444, top1 = 87.98%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.85 ms.
cifar10        train : [loss = 0.054, top1 = 98.71%], test  : [loss = 0.311, top1 = 90.72%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.10 ms.
cifar100       train : [loss = 0.568, top1 = 84.35%], valid : [loss = 1.217, top1 = 66.88%], test : [loss = 1.202, top1 = 67.05%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.55%], valid : [loss = 2.459, top1 = 38.28%], test : [loss = 2.482, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.71%], valid : [loss = 0.659, top1 = 76.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  725/15625) 000725-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.526, top1 = 89.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.350, top1 = 92.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.08 ms.
cifar100       train : [loss = 0.086, top1 = 98.60%], valid : [loss = 1.436, top1 = 68.21%], test : [loss = 1.421, top1 = 68.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.02%], valid : [loss = 2.384, top1 = 40.68%], test : [loss = 2.408, top1 = 40.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.35%], valid : [loss = 0.676, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  726/15625) 000726-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.73%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.48 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.331, top1 = 92.11%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.88 ms.
cifar100       train : [loss = 0.333, top1 = 90.91%], valid : [loss = 1.273, top1 = 67.69%], test : [loss = 1.275, top1 = 67.45%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.73%], valid : [loss = 2.391, top1 = 39.32%], test : [loss = 2.418, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.56%], valid : [loss = 0.698, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  727/15625) 000727-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.635, top1 = 86.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10        train : [loss = 0.029, top1 = 99.28%], test  : [loss = 0.442, top1 = 89.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.85 ms.
cifar100       train : [loss = 0.364, top1 = 90.31%], valid : [loss = 1.417, top1 = 65.05%], test : [loss = 1.412, top1 = 65.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.24%], valid : [loss = 2.610, top1 = 35.17%], test : [loss = 2.624, top1 = 35.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  728/15625) 000728-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.51%], valid : [loss = 0.622, top1 = 84.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.090, top1 = 97.02%], test  : [loss = 0.409, top1 = 88.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.675, top1 = 80.07%], valid : [loss = 1.531, top1 = 60.81%], test : [loss = 1.520, top1 = 61.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 3.172, top1 = 22.66%], valid : [loss = 3.182, top1 = 22.48%], test : [loss = 3.218, top1 = 22.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.96%], valid : [loss = 1.085, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  729/15625) 000729-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.554, top1 = 87.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.361, top1 = 91.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.359, top1 = 89.99%], valid : [loss = 1.328, top1 = 65.97%], test : [loss = 1.319, top1 = 66.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.64%], valid : [loss = 2.480, top1 = 37.25%], test : [loss = 2.476, top1 = 38.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.34%], valid : [loss = 0.890, top1 = 69.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  730/15625) 000730-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.577, top1 = 87.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.396, top1 = 91.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 0.388, top1 = 89.06%], valid : [loss = 1.381, top1 = 65.83%], test : [loss = 1.401, top1 = 65.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.91%], valid : [loss = 2.506, top1 = 36.59%], test : [loss = 2.537, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  731/15625) 000731-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.552, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.371, top1 = 91.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.162, top1 = 96.60%], valid : [loss = 1.413, top1 = 67.62%], test : [loss = 1.420, top1 = 67.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.95%], valid : [loss = 2.422, top1 = 39.58%], test : [loss = 2.435, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 78.87%], valid : [loss = 0.689, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  732/15625) 000732-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.75 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.504, top1 = 90.04%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.43 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.322, top1 = 93.38%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.48 ms.
cifar100       train : [loss = 0.065, top1 = 98.91%], valid : [loss = 1.346, top1 = 70.49%], test : [loss = 1.333, top1 = 70.72%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.76 ms.
ImageNet16-120 train : [loss = 1.689, top1 = 54.81%], valid : [loss = 2.193, top1 = 44.28%], test : [loss = 2.188, top1 = 44.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 73.81%], valid : [loss = 0.784, top1 = 72.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  733/15625) 000733-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.287, top1 = 93.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.181, top1 = 95.78%], valid : [loss = 1.266, top1 = 69.63%], test : [loss = 1.286, top1 = 69.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.40 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 52.04%], valid : [loss = 2.229, top1 = 43.18%], test : [loss = 2.267, top1 = 42.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.33%], valid : [loss = 0.505, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  734/15625) 000734-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.98%], valid : [loss = 0.710, top1 = 83.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.090, top1 = 97.07%], test  : [loss = 0.485, top1 = 86.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.85 ms.
cifar100       train : [loss = 0.806, top1 = 76.50%], valid : [loss = 1.558, top1 = 59.89%], test : [loss = 1.542, top1 = 60.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.10%], valid : [loss = 2.951, top1 = 27.93%], test : [loss = 2.998, top1 = 27.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  735/15625) 000735-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.62%], valid : [loss = 0.443, top1 = 87.83%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.48 ms.
cifar10        train : [loss = 0.054, top1 = 98.66%], test  : [loss = 0.308, top1 = 90.76%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.31 ms.
cifar100       train : [loss = 0.552, top1 = 84.88%], valid : [loss = 1.206, top1 = 66.96%], test : [loss = 1.203, top1 = 66.65%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.88%], valid : [loss = 2.455, top1 = 38.41%], test : [loss = 2.462, top1 = 38.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 81.00%], valid : [loss = 0.619, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  736/15625) 000736-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.50%], valid : [loss = 0.552, top1 = 86.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10        train : [loss = 0.046, top1 = 98.62%], test  : [loss = 0.374, top1 = 90.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.25 ms.
cifar100       train : [loss = 0.587, top1 = 82.79%], valid : [loss = 1.330, top1 = 64.91%], test : [loss = 1.359, top1 = 64.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.445, top1 = 37.86%], valid : [loss = 2.598, top1 = 34.15%], test : [loss = 2.647, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.29%], valid : [loss = 0.670, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  737/15625) 000737-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 21.55 M, Params=0.171 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.65%], valid : [loss = 0.447, top1 = 86.57%]
cifar10        FLOP= 21.55 M, Params=0.171 MB, latency=18.19 ms.
cifar10        train : [loss = 0.149, top1 = 95.19%], test  : [loss = 0.330, top1 = 89.31%]
cifar100       FLOP= 21.55 M, Params=0.177 MB, latency=17.44 ms.
cifar100       train : [loss = 0.970, top1 = 72.39%], valid : [loss = 1.336, top1 = 62.76%], test : [loss = 1.348, top1 = 61.92%]
ImageNet16-120 FLOP=  5.39 M, Params=0.178 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.95%], valid : [loss = 2.681, top1 = 32.87%], test : [loss = 2.689, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.66%], valid : [loss = 0.792, top1 = 71.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  738/15625) 000738-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.61%], valid : [loss = 0.687, top1 = 82.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.102, top1 = 96.57%], test  : [loss = 0.431, top1 = 87.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.08 ms.
cifar100       train : [loss = 0.685, top1 = 79.84%], valid : [loss = 1.523, top1 = 60.46%], test : [loss = 1.501, top1 = 61.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 2.972, top1 = 26.61%], valid : [loss = 3.003, top1 = 26.50%], test : [loss = 3.051, top1 = 25.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.015, top1 = 63.50%], valid : [loss = 1.055, top1 = 62.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  739/15625) 000739-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.92%], valid : [loss = 0.524, top1 = 87.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10        train : [loss = 0.077, top1 = 97.51%], test  : [loss = 0.367, top1 = 89.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.32 ms.
cifar100       train : [loss = 0.712, top1 = 79.03%], valid : [loss = 1.340, top1 = 64.19%], test : [loss = 1.320, top1 = 64.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.17%], valid : [loss = 2.635, top1 = 33.43%], test : [loss = 2.685, top1 = 33.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  740/15625) 000740-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.558, top1 = 87.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.384, top1 = 91.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.21 ms.
cifar100       train : [loss = 0.403, top1 = 88.52%], valid : [loss = 1.428, top1 = 65.08%], test : [loss = 1.384, top1 = 65.41%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.91%], valid : [loss = 2.486, top1 = 36.58%], test : [loss = 2.521, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  741/15625) 000741-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.35%], valid : [loss = 0.684, top1 = 84.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.055, top1 = 98.28%], test  : [loss = 0.438, top1 = 88.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.13 ms.
cifar100       train : [loss = 0.626, top1 = 81.64%], valid : [loss = 1.533, top1 = 61.25%], test : [loss = 1.478, top1 = 62.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 33.30%], valid : [loss = 2.822, top1 = 31.30%], test : [loss = 2.861, top1 = 30.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  742/15625) 000742-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.538, top1 = 88.71%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.95 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.347, top1 = 92.42%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.54 ms.
cifar100       train : [loss = 0.089, top1 = 97.95%], valid : [loss = 1.453, top1 = 68.87%], test : [loss = 1.464, top1 = 68.57%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.24 ms.
ImageNet16-120 train : [loss = 2.424, top1 = 37.96%], valid : [loss = 2.638, top1 = 33.35%], test : [loss = 2.645, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.52%], valid : [loss = 0.873, top1 = 69.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  743/15625) 000743-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.53%], valid : [loss = 0.904, top1 = 76.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10        train : [loss = 0.234, top1 = 91.92%], test  : [loss = 0.595, top1 = 82.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.164, top1 = 66.89%], valid : [loss = 1.812, top1 = 53.28%], test : [loss = 1.789, top1 = 54.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 3.223, top1 = 22.78%], valid : [loss = 3.313, top1 = 22.02%], test : [loss = 3.355, top1 = 20.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  744/15625) 000744-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.583, top1 = 87.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.388, top1 = 90.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 0.392, top1 = 88.82%], valid : [loss = 1.389, top1 = 65.77%], test : [loss = 1.387, top1 = 65.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.73%], valid : [loss = 2.519, top1 = 36.74%], test : [loss = 2.559, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  745/15625) 000745-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.78%], valid : [loss = 0.860, top1 = 70.75%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10        train : [loss = 0.685, top1 = 75.89%], test  : [loss = 0.769, top1 = 73.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.82 ms.
cifar100       train : [loss = 2.004, top1 = 46.76%], valid : [loss = 2.185, top1 = 43.67%], test : [loss = 2.200, top1 = 43.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.70%], valid : [loss = 3.674, top1 = 15.88%], test : [loss = 3.690, top1 = 14.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  746/15625) 000746-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.92%], valid : [loss = 0.556, top1 = 85.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10        train : [loss = 0.107, top1 = 96.51%], test  : [loss = 0.362, top1 = 89.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.01 ms.
cifar100       train : [loss = 0.719, top1 = 79.06%], valid : [loss = 1.355, top1 = 64.06%], test : [loss = 1.364, top1 = 63.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.464, top1 = 37.36%], valid : [loss = 2.561, top1 = 34.65%], test : [loss = 2.592, top1 = 35.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.65%], valid : [loss = 0.911, top1 = 68.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  747/15625) 000747-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.00 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.513, top1 = 89.86%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.17 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.03%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.11 ms.
cifar100       train : [loss = 0.074, top1 = 98.82%], valid : [loss = 1.360, top1 = 69.87%], test : [loss = 1.371, top1 = 69.23%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.36 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.36%], valid : [loss = 2.291, top1 = 41.30%], test : [loss = 2.259, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.34%], valid : [loss = 0.841, top1 = 70.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  748/15625) 000748-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.34%], valid : [loss = 0.541, top1 = 84.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.39 ms.
cifar10        train : [loss = 0.179, top1 = 93.99%], test  : [loss = 0.386, top1 = 88.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.75 ms.
cifar100       train : [loss = 1.201, top1 = 65.89%], valid : [loss = 1.518, top1 = 58.53%], test : [loss = 1.501, top1 = 58.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.64%], valid : [loss = 2.656, top1 = 33.27%], test : [loss = 2.692, top1 = 32.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.49%], valid : [loss = 0.933, top1 = 67.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  749/15625) 000749-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=23.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.501, top1 = 90.09%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.312, top1 = 93.15%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=22.84 ms.
cifar100       train : [loss = 0.053, top1 = 99.39%], valid : [loss = 1.338, top1 = 70.14%], test : [loss = 1.339, top1 = 69.85%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=20.90 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.63%], valid : [loss = 2.216, top1 = 42.97%], test : [loss = 2.200, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.00%], valid : [loss = 0.695, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  750/15625) 000750-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.556, top1 = 89.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.82 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.366, top1 = 92.44%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.45 ms.
cifar100       train : [loss = 0.074, top1 = 98.89%], valid : [loss = 1.449, top1 = 68.59%], test : [loss = 1.468, top1 = 68.87%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.05%], valid : [loss = 2.361, top1 = 40.32%], test : [loss = 2.387, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.41%], valid : [loss = 0.749, top1 = 74.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  751/15625) 000751-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.525, top1 = 88.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.027, top1 = 99.23%], test  : [loss = 0.350, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.93 ms.
cifar100       train : [loss = 0.454, top1 = 86.78%], valid : [loss = 1.251, top1 = 66.68%], test : [loss = 1.256, top1 = 67.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.55%], valid : [loss = 2.374, top1 = 38.97%], test : [loss = 2.376, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.54%], valid : [loss = 0.814, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  752/15625) 000752-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.470, top1 = 89.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.302, top1 = 92.41%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.62 ms.
cifar100       train : [loss = 0.297, top1 = 92.18%], valid : [loss = 1.233, top1 = 68.76%], test : [loss = 1.242, top1 = 68.45%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.21%], valid : [loss = 2.291, top1 = 41.65%], test : [loss = 2.294, top1 = 41.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.20%], valid : [loss = 0.603, top1 = 79.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  753/15625) 000753-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.43 ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.78%], valid : [loss = 0.516, top1 = 82.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10        train : [loss = 0.398, top1 = 86.47%], test  : [loss = 0.467, top1 = 84.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.04 ms.
cifar100       train : [loss = 1.538, top1 = 57.70%], valid : [loss = 1.659, top1 = 54.70%], test : [loss = 1.651, top1 = 54.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.42 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.45%], valid : [loss = 2.995, top1 = 27.30%], test : [loss = 3.045, top1 = 26.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.78%], valid : [loss = 1.138, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  754/15625) 000754-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.577, top1 = 87.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.30 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.390, top1 = 91.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.61 ms.
cifar100       train : [loss = 0.396, top1 = 88.93%], valid : [loss = 1.419, top1 = 64.51%], test : [loss = 1.383, top1 = 65.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.72%], valid : [loss = 2.512, top1 = 36.38%], test : [loss = 2.534, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  755/15625) 000755-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.50%], valid : [loss = 0.628, top1 = 85.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.382, top1 = 90.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.77 ms.
cifar100       train : [loss = 0.547, top1 = 83.95%], valid : [loss = 1.438, top1 = 63.60%], test : [loss = 1.413, top1 = 63.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.10%], valid : [loss = 2.563, top1 = 35.40%], test : [loss = 2.586, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.68%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  756/15625) 000756-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.25%], valid : [loss = 0.577, top1 = 86.85%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.99 ms.
cifar10        train : [loss = 0.054, top1 = 98.24%], test  : [loss = 0.360, top1 = 90.46%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.97 ms.
cifar100       train : [loss = 0.568, top1 = 83.06%], valid : [loss = 1.335, top1 = 64.85%], test : [loss = 1.338, top1 = 65.03%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.53%], valid : [loss = 2.468, top1 = 36.97%], test : [loss = 2.515, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.43%], valid : [loss = 0.926, top1 = 67.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  757/15625) 000757-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.226, top1 = 92.40%], valid : [loss = 0.515, top1 = 83.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.90 ms.
cifar10        train : [loss = 0.222, top1 = 92.46%], test  : [loss = 0.397, top1 = 87.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 1.359, top1 = 61.74%], valid : [loss = 1.640, top1 = 55.71%], test : [loss = 1.621, top1 = 55.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.893, top1 = 28.74%], valid : [loss = 2.904, top1 = 28.80%], test : [loss = 2.950, top1 = 26.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.003, top1 = 64.28%], valid : [loss = 1.047, top1 = 62.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  758/15625) 000758-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.10 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.33%], valid : [loss = 0.473, top1 = 84.66%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10        train : [loss = 0.301, top1 = 90.09%], test  : [loss = 0.398, top1 = 86.71%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.73 ms.
cifar100       train : [loss = 1.332, top1 = 63.14%], valid : [loss = 1.533, top1 = 58.20%], test : [loss = 1.518, top1 = 58.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.06 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.66%], valid : [loss = 2.887, top1 = 29.82%], test : [loss = 2.945, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  759/15625) 000759-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.544, top1 = 80.96%], valid : [loss = 0.852, top1 = 71.93%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.561, top1 = 80.33%], test  : [loss = 0.717, top1 = 75.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.44 ms.
cifar100       train : [loss = 1.803, top1 = 51.37%], valid : [loss = 2.075, top1 = 46.74%], test : [loss = 2.080, top1 = 46.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.82%], valid : [loss = 3.641, top1 = 16.53%], test : [loss = 3.664, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.22%], valid : [loss = 1.258, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  760/15625) 000760-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.495, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.327, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.79 ms.
cifar100       train : [loss = 0.225, top1 = 94.53%], valid : [loss = 1.235, top1 = 68.64%], test : [loss = 1.254, top1 = 68.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.09 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.33%], valid : [loss = 2.268, top1 = 41.83%], test : [loss = 2.267, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  761/15625) 000761-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.585, top1 = 87.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.382, top1 = 91.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 0.375, top1 = 89.44%], valid : [loss = 1.394, top1 = 65.43%], test : [loss = 1.382, top1 = 65.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.31%], valid : [loss = 2.508, top1 = 36.90%], test : [loss = 2.546, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.15%], valid : [loss = 0.838, top1 = 70.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  762/15625) 000762-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.73%], valid : [loss = 0.556, top1 = 83.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.31 ms.
cifar10        train : [loss = 0.197, top1 = 93.30%], test  : [loss = 0.394, top1 = 87.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.50 ms.
cifar100       train : [loss = 1.243, top1 = 64.70%], valid : [loss = 1.550, top1 = 57.65%], test : [loss = 1.544, top1 = 57.21%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.07%], valid : [loss = 2.708, top1 = 32.12%], test : [loss = 2.749, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.45%], valid : [loss = 0.962, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  763/15625) 000763-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.46%], valid : [loss = 0.851, top1 = 71.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.560, top1 = 80.48%], test  : [loss = 0.717, top1 = 75.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 1.780, top1 = 52.08%], valid : [loss = 2.049, top1 = 46.38%], test : [loss = 2.056, top1 = 47.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.93%], valid : [loss = 3.636, top1 = 16.20%], test : [loss = 3.664, top1 = 15.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  764/15625) 000764-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.58%], valid : [loss = 0.851, top1 = 72.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.42 ms.
cifar10        train : [loss = 0.557, top1 = 80.66%], test  : [loss = 0.715, top1 = 75.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.49 ms.
cifar100       train : [loss = 1.768, top1 = 52.25%], valid : [loss = 2.053, top1 = 47.12%], test : [loss = 2.055, top1 = 46.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.79%], valid : [loss = 3.641, top1 = 16.53%], test : [loss = 3.676, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  765/15625) 000765-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.13%], valid : [loss = 0.529, top1 = 84.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10        train : [loss = 0.184, top1 = 93.83%], test  : [loss = 0.383, top1 = 88.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.189, top1 = 66.19%], valid : [loss = 1.506, top1 = 58.78%], test : [loss = 1.493, top1 = 59.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.70%], valid : [loss = 2.705, top1 = 32.61%], test : [loss = 2.736, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.20%], valid : [loss = 0.954, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  766/15625) 000766-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.53%], valid : [loss = 0.441, top1 = 87.90%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.87 ms.
cifar10        train : [loss = 0.055, top1 = 98.66%], test  : [loss = 0.299, top1 = 90.94%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.21 ms.
cifar100       train : [loss = 0.562, top1 = 84.49%], valid : [loss = 1.225, top1 = 66.59%], test : [loss = 1.203, top1 = 67.25%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.10 ms.
ImageNet16-120 train : [loss = 2.275, top1 = 41.68%], valid : [loss = 2.448, top1 = 38.25%], test : [loss = 2.464, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.92%], valid : [loss = 0.633, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  767/15625) 000767-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.39%], valid : [loss = 0.857, top1 = 79.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.131, top1 = 95.61%], test  : [loss = 0.541, top1 = 84.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 0.845, top1 = 75.31%], valid : [loss = 1.684, top1 = 57.68%], test : [loss = 1.689, top1 = 57.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.31%], valid : [loss = 3.179, top1 = 24.27%], test : [loss = 3.217, top1 = 23.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  768/15625) 000768-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.56%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=16.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.05%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=16.94 ms.
cifar100       train : [loss = 0.346, top1 = 90.57%], valid : [loss = 1.292, top1 = 66.93%], test : [loss = 1.288, top1 = 67.32%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.73%], valid : [loss = 2.388, top1 = 39.09%], test : [loss = 2.405, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  769/15625) 000769-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.72%], valid : [loss = 0.707, top1 = 76.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10        train : [loss = 0.407, top1 = 85.86%], test  : [loss = 0.543, top1 = 82.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.93 ms.
cifar100       train : [loss = 1.616, top1 = 55.36%], valid : [loss = 1.871, top1 = 49.66%], test : [loss = 1.862, top1 = 50.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 3.295, top1 = 21.50%], valid : [loss = 3.296, top1 = 21.68%], test : [loss = 3.328, top1 = 20.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.208, top1 = 56.22%], valid : [loss = 1.256, top1 = 54.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  770/15625) 000770-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.535, top1 = 89.34%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=20.22 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.354, top1 = 92.72%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=18.64 ms.
cifar100       train : [loss = 0.079, top1 = 98.73%], valid : [loss = 1.446, top1 = 68.31%], test : [loss = 1.444, top1 = 68.45%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.71%], valid : [loss = 2.365, top1 = 41.02%], test : [loss = 2.407, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.44%], valid : [loss = 0.683, top1 = 76.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  771/15625) 000771-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 0.330, top1 = 91.03%], valid : [loss = 1.298, top1 = 67.36%], test : [loss = 1.308, top1 = 67.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.11%], valid : [loss = 2.353, top1 = 40.63%], test : [loss = 2.410, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.33%], valid : [loss = 0.557, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  772/15625) 000772-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.63 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.40%], valid : [loss = 0.669, top1 = 77.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10        train : [loss = 0.538, top1 = 81.17%], test  : [loss = 0.603, top1 = 79.46%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.06 ms.
cifar100       train : [loss = 2.017, top1 = 46.64%], valid : [loss = 2.126, top1 = 44.84%], test : [loss = 2.141, top1 = 44.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.57 ms.
ImageNet16-120 train : [loss = 3.390, top1 = 20.14%], valid : [loss = 3.368, top1 = 20.82%], test : [loss = 3.413, top1 = 19.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  773/15625) 000773-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.561, top1 = 88.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.86 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.355, top1 = 92.77%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.01 ms.
cifar100       train : [loss = 0.102, top1 = 98.14%], valid : [loss = 1.448, top1 = 67.92%], test : [loss = 1.428, top1 = 67.87%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.81%], valid : [loss = 2.463, top1 = 38.68%], test : [loss = 2.431, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 78.97%], valid : [loss = 0.692, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  774/15625) 000774-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.545, top1 = 87.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.368, top1 = 91.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.321, top1 = 91.19%], valid : [loss = 1.418, top1 = 65.68%], test : [loss = 1.427, top1 = 65.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.40%], valid : [loss = 2.432, top1 = 38.88%], test : [loss = 2.456, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.05%], valid : [loss = 0.804, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  775/15625) 000775-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.619, top1 = 85.29%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=16.98 ms.
cifar10        train : [loss = 0.070, top1 = 97.86%], test  : [loss = 0.411, top1 = 88.61%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=17.20 ms.
cifar100       train : [loss = 0.710, top1 = 79.35%], valid : [loss = 1.372, top1 = 63.25%], test : [loss = 1.366, top1 = 63.73%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.54%], valid : [loss = 2.664, top1 = 33.68%], test : [loss = 2.714, top1 = 32.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.77%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  776/15625) 000776-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.09%], valid : [loss = 0.764, top1 = 73.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10        train : [loss = 0.519, top1 = 82.04%], test  : [loss = 0.579, top1 = 80.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 2.045, top1 = 45.00%], valid : [loss = 2.146, top1 = 42.83%], test : [loss = 2.152, top1 = 42.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 3.241, top1 = 22.07%], valid : [loss = 3.206, top1 = 23.37%], test : [loss = 3.250, top1 = 22.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.152, top1 = 58.61%], valid : [loss = 1.187, top1 = 57.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  777/15625) 000777-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.02%], valid : [loss = 0.477, top1 = 84.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10        train : [loss = 0.295, top1 = 90.17%], test  : [loss = 0.398, top1 = 86.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 1.315, top1 = 63.48%], valid : [loss = 1.526, top1 = 58.08%], test : [loss = 1.507, top1 = 58.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.66%], valid : [loss = 2.890, top1 = 29.83%], test : [loss = 2.949, top1 = 28.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  778/15625) 000778-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.528, top1 = 88.48%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.12 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.319, top1 = 92.34%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.47 ms.
cifar100       train : [loss = 0.230, top1 = 94.39%], valid : [loss = 1.309, top1 = 67.74%], test : [loss = 1.297, top1 = 68.56%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.06%], valid : [loss = 2.330, top1 = 40.28%], test : [loss = 2.324, top1 = 40.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.49%], valid : [loss = 0.631, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  779/15625) 000779-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.71%], valid : [loss = 0.466, top1 = 86.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10        train : [loss = 0.147, top1 = 95.23%], test  : [loss = 0.338, top1 = 89.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.15 ms.
cifar100       train : [loss = 0.984, top1 = 72.13%], valid : [loss = 1.352, top1 = 62.52%], test : [loss = 1.346, top1 = 62.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.06%], valid : [loss = 2.692, top1 = 32.72%], test : [loss = 2.707, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  780/15625) 000780-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.06%], valid : [loss = 1.073, top1 = 77.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.084, top1 = 97.37%], test  : [loss = 0.659, top1 = 83.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.588, top1 = 83.35%], valid : [loss = 1.984, top1 = 54.65%], test : [loss = 1.971, top1 = 54.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.75%], valid : [loss = 3.205, top1 = 24.17%], test : [loss = 3.217, top1 = 23.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.24%], valid : [loss = 1.101, top1 = 60.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  781/15625) 000781-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.516, top1 = 88.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.328, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.336, top1 = 90.81%], valid : [loss = 1.291, top1 = 67.32%], test : [loss = 1.272, top1 = 67.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.60%], valid : [loss = 2.418, top1 = 39.03%], test : [loss = 2.424, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.738, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  782/15625) 000782-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.476, top1 = 89.27%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.296, top1 = 92.58%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.30 ms.
cifar100       train : [loss = 0.277, top1 = 92.79%], valid : [loss = 1.237, top1 = 68.40%], test : [loss = 1.230, top1 = 68.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.55 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.62%], valid : [loss = 2.211, top1 = 42.74%], test : [loss = 2.219, top1 = 43.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.60%], valid : [loss = 0.639, top1 = 78.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  783/15625) 000783-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.540, top1 = 88.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.348, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.16 ms.
cifar100       train : [loss = 0.342, top1 = 90.48%], valid : [loss = 1.272, top1 = 67.45%], test : [loss = 1.296, top1 = 67.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.03%], valid : [loss = 2.434, top1 = 38.30%], test : [loss = 2.428, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.58%], valid : [loss = 0.887, top1 = 68.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  784/15625) 000784-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.18%], valid : [loss = 0.724, top1 = 81.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.161, top1 = 94.52%], test  : [loss = 0.466, top1 = 86.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.70 ms.
cifar100       train : [loss = 0.994, top1 = 71.28%], valid : [loss = 1.682, top1 = 55.73%], test : [loss = 1.659, top1 = 56.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 25.59%], valid : [loss = 3.119, top1 = 24.52%], test : [loss = 3.162, top1 = 23.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.79%], valid : [loss = 1.002, top1 = 64.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  785/15625) 000785-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.566, top1 = 88.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.382, top1 = 91.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.178, top1 = 96.12%], valid : [loss = 1.414, top1 = 66.97%], test : [loss = 1.408, top1 = 67.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.84%], valid : [loss = 2.480, top1 = 38.13%], test : [loss = 2.481, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  786/15625) 000786-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.73%], valid : [loss = 0.641, top1 = 84.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.401, top1 = 88.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.76 ms.
cifar100       train : [loss = 0.782, top1 = 77.14%], valid : [loss = 1.432, top1 = 61.55%], test : [loss = 1.418, top1 = 62.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.15%], valid : [loss = 2.733, top1 = 32.30%], test : [loss = 2.756, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  787/15625) 000787-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.515, top1 = 88.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.56 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.332, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.68 ms.
cifar100       train : [loss = 0.317, top1 = 91.46%], valid : [loss = 1.262, top1 = 67.99%], test : [loss = 1.282, top1 = 67.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.69%], valid : [loss = 2.326, top1 = 40.67%], test : [loss = 2.350, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.51%], valid : [loss = 0.682, top1 = 76.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  788/15625) 000788-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.152, top1 = 94.89%], valid : [loss = 0.735, top1 = 80.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10        train : [loss = 0.184, top1 = 93.66%], test  : [loss = 0.507, top1 = 85.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.06 ms.
cifar100       train : [loss = 0.892, top1 = 73.91%], valid : [loss = 1.672, top1 = 57.01%], test : [loss = 1.700, top1 = 56.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 3.514, top1 = 16.57%], valid : [loss = 3.503, top1 = 16.88%], test : [loss = 3.529, top1 = 16.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.63%], valid : [loss = 1.283, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  789/15625) 000789-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.10%], valid : [loss = 0.474, top1 = 84.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 0.299, top1 = 90.02%], test  : [loss = 0.397, top1 = 86.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.37 ms.
cifar100       train : [loss = 1.330, top1 = 63.20%], valid : [loss = 1.540, top1 = 57.59%], test : [loss = 1.510, top1 = 58.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.58%], valid : [loss = 2.911, top1 = 28.51%], test : [loss = 2.961, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  790/15625) 000790-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.562, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.373, top1 = 92.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.119, top1 = 97.72%], valid : [loss = 1.459, top1 = 67.66%], test : [loss = 1.451, top1 = 67.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.26%], valid : [loss = 2.400, top1 = 40.14%], test : [loss = 2.416, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.46%], valid : [loss = 0.751, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  791/15625) 000791-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.522, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.328, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.37 ms.
cifar100       train : [loss = 0.342, top1 = 90.62%], valid : [loss = 1.280, top1 = 67.03%], test : [loss = 1.274, top1 = 67.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.48%], valid : [loss = 2.417, top1 = 39.03%], test : [loss = 2.420, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  792/15625) 000792-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.51%], valid : [loss = 0.531, top1 = 84.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10        train : [loss = 0.179, top1 = 94.00%], test  : [loss = 0.386, top1 = 87.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 1.206, top1 = 65.81%], valid : [loss = 1.511, top1 = 58.78%], test : [loss = 1.501, top1 = 58.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.71 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.61%], valid : [loss = 2.709, top1 = 31.96%], test : [loss = 2.747, top1 = 32.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.50%], valid : [loss = 0.952, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  793/15625) 000793-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.441, top1 = 90.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.301, top1 = 92.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.25 ms.
cifar100       train : [loss = 0.172, top1 = 96.08%], valid : [loss = 1.251, top1 = 70.09%], test : [loss = 1.279, top1 = 69.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.790, top1 = 52.38%], valid : [loss = 2.278, top1 = 42.31%], test : [loss = 2.280, top1 = 42.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.24%], valid : [loss = 0.519, top1 = 82.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  794/15625) 000794-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.31%], valid : [loss = 0.466, top1 = 85.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10        train : [loss = 0.155, top1 = 94.97%], test  : [loss = 0.347, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.40 ms.
cifar100       train : [loss = 0.997, top1 = 71.62%], valid : [loss = 1.358, top1 = 61.89%], test : [loss = 1.345, top1 = 62.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.61%], valid : [loss = 2.706, top1 = 32.31%], test : [loss = 2.712, top1 = 32.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  795/15625) 000795-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.229, top1 = 92.14%], valid : [loss = 0.545, top1 = 83.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10        train : [loss = 0.222, top1 = 92.42%], test  : [loss = 0.403, top1 = 87.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.13 ms.
cifar100       train : [loss = 1.319, top1 = 62.59%], valid : [loss = 1.596, top1 = 56.12%], test : [loss = 1.597, top1 = 56.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.66%], valid : [loss = 2.777, top1 = 31.29%], test : [loss = 2.806, top1 = 30.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.24%], valid : [loss = 0.993, top1 = 64.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  796/15625) 000796-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.505, top1 = 88.77%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.94 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.323, top1 = 92.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.37 ms.
cifar100       train : [loss = 0.337, top1 = 90.86%], valid : [loss = 1.277, top1 = 67.11%], test : [loss = 1.271, top1 = 67.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.10%], valid : [loss = 2.400, top1 = 38.82%], test : [loss = 2.426, top1 = 38.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 81.00%], valid : [loss = 0.620, top1 = 78.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  797/15625) 000797-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.416, top1 = 90.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.281, top1 = 93.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.43 ms.
cifar100       train : [loss = 0.188, top1 = 95.47%], valid : [loss = 1.303, top1 = 69.19%], test : [loss = 1.265, top1 = 69.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.51%], valid : [loss = 2.260, top1 = 42.18%], test : [loss = 2.286, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  798/15625) 000798-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.39%], valid : [loss = 0.466, top1 = 86.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.161, top1 = 94.74%], test  : [loss = 0.343, top1 = 88.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 1.012, top1 = 71.11%], valid : [loss = 1.362, top1 = 62.07%], test : [loss = 1.351, top1 = 61.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.86%], valid : [loss = 2.683, top1 = 33.29%], test : [loss = 2.706, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  799/15625) 000799-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.36%], valid : [loss = 0.629, top1 = 79.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.374, top1 = 87.01%], test  : [loss = 0.501, top1 = 82.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.25 ms.
cifar100       train : [loss = 1.706, top1 = 52.84%], valid : [loss = 1.915, top1 = 48.75%], test : [loss = 1.923, top1 = 48.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 3.215, top1 = 22.66%], valid : [loss = 3.206, top1 = 23.06%], test : [loss = 3.274, top1 = 22.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.035, top1 = 62.59%], valid : [loss = 1.083, top1 = 60.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  800/15625) 000800-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.560, top1 = 87.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.361, top1 = 91.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.60 ms.
cifar100       train : [loss = 0.311, top1 = 91.38%], valid : [loss = 1.320, top1 = 67.05%], test : [loss = 1.325, top1 = 67.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.220, top1 = 42.54%], valid : [loss = 2.436, top1 = 37.88%], test : [loss = 2.467, top1 = 38.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.09%], valid : [loss = 0.909, top1 = 68.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  801/15625) 000801-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.531, top1 = 89.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.350, top1 = 92.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.23 ms.
cifar100       train : [loss = 0.131, top1 = 97.19%], valid : [loss = 1.341, top1 = 68.31%], test : [loss = 1.381, top1 = 68.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.11%], valid : [loss = 2.308, top1 = 41.18%], test : [loss = 2.307, top1 = 41.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.49%], valid : [loss = 0.781, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  802/15625) 000802-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.30%], valid : [loss = 0.611, top1 = 85.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.073, top1 = 97.75%], test  : [loss = 0.404, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 0.717, top1 = 79.20%], valid : [loss = 1.399, top1 = 63.12%], test : [loss = 1.389, top1 = 62.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.88%], valid : [loss = 2.667, top1 = 33.26%], test : [loss = 2.697, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.63%], valid : [loss = 0.784, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  803/15625) 000803-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.503, top1 = 89.49%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.56 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.302, top1 = 92.94%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.03 ms.
cifar100       train : [loss = 0.117, top1 = 97.88%], valid : [loss = 1.288, top1 = 69.40%], test : [loss = 1.305, top1 = 69.16%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.89 ms.
ImageNet16-120 train : [loss = 1.671, top1 = 55.24%], valid : [loss = 2.202, top1 = 44.52%], test : [loss = 2.216, top1 = 44.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.69%], valid : [loss = 0.663, top1 = 77.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  804/15625) 000804-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.317, top1 = 91.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.86 ms.
cifar100       train : [loss = 0.330, top1 = 90.95%], valid : [loss = 1.293, top1 = 67.48%], test : [loss = 1.311, top1 = 66.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.26%], valid : [loss = 2.365, top1 = 40.01%], test : [loss = 2.403, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.30%], valid : [loss = 0.571, top1 = 80.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  805/15625) 000805-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.560, top1 = 87.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.374, top1 = 91.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.380, top1 = 89.30%], valid : [loss = 1.374, top1 = 66.24%], test : [loss = 1.382, top1 = 66.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.82%], valid : [loss = 2.479, top1 = 37.48%], test : [loss = 2.510, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.94%], valid : [loss = 0.749, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  806/15625) 000806-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.74%], valid : [loss = 0.985, top1 = 66.44%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.784, top1 = 72.46%], test  : [loss = 0.873, top1 = 69.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 2.139, top1 = 43.88%], valid : [loss = 2.313, top1 = 40.93%], test : [loss = 2.334, top1 = 40.46%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.80 ms.
ImageNet16-120 train : [loss = 3.744, top1 = 14.17%], valid : [loss = 3.772, top1 = 14.53%], test : [loss = 3.774, top1 = 13.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  807/15625) 000807-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.100, top1 = 96.96%], valid : [loss = 0.490, top1 = 86.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10        train : [loss = 0.110, top1 = 96.38%], test  : [loss = 0.341, top1 = 89.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.725, top1 = 79.10%], valid : [loss = 1.253, top1 = 65.65%], test : [loss = 1.228, top1 = 66.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.352, top1 = 39.82%], valid : [loss = 2.446, top1 = 37.88%], test : [loss = 2.467, top1 = 38.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.02%], valid : [loss = 0.934, top1 = 66.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  808/15625) 000808-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.559, top1 = 88.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.88 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.351, top1 = 92.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.21 ms.
cifar100       train : [loss = 0.115, top1 = 97.60%], valid : [loss = 1.373, top1 = 68.71%], test : [loss = 1.362, top1 = 68.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.50%], valid : [loss = 2.312, top1 = 41.62%], test : [loss = 2.335, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.91%], valid : [loss = 0.797, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  809/15625) 000809-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.620, top1 = 87.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.428, top1 = 90.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.11 ms.
cifar100       train : [loss = 0.205, top1 = 95.14%], valid : [loss = 1.474, top1 = 66.06%], test : [loss = 1.487, top1 = 65.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.38%], valid : [loss = 2.473, top1 = 37.69%], test : [loss = 2.490, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 74.56%], valid : [loss = 0.783, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  810/15625) 000810-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.323, top1 = 93.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.44 ms.
cifar100       train : [loss = 0.119, top1 = 97.66%], valid : [loss = 1.304, top1 = 69.57%], test : [loss = 1.325, top1 = 69.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.711, top1 = 54.17%], valid : [loss = 2.180, top1 = 44.33%], test : [loss = 2.198, top1 = 44.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  811/15625) 000811-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.512, top1 = 88.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.323, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.21 ms.
cifar100       train : [loss = 0.341, top1 = 90.70%], valid : [loss = 1.274, top1 = 67.05%], test : [loss = 1.260, top1 = 67.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.35%], valid : [loss = 2.411, top1 = 39.08%], test : [loss = 2.426, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  812/15625) 000812-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.59%], valid : [loss = 0.723, top1 = 75.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.71 ms.
cifar10        train : [loss = 0.491, top1 = 82.95%], test  : [loss = 0.573, top1 = 80.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.50 ms.
cifar100       train : [loss = 1.968, top1 = 46.83%], valid : [loss = 2.093, top1 = 44.69%], test : [loss = 2.093, top1 = 44.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.988, top1 = 26.98%], valid : [loss = 2.986, top1 = 27.21%], test : [loss = 3.010, top1 = 26.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.78%], valid : [loss = 1.192, top1 = 57.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  813/15625) 000813-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.552, top1 = 88.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10        train : [loss = 0.015, top1 = 99.60%], test  : [loss = 0.364, top1 = 91.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.48 ms.
cifar100       train : [loss = 0.272, top1 = 92.72%], valid : [loss = 1.349, top1 = 66.95%], test : [loss = 1.349, top1 = 67.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.59%], valid : [loss = 2.466, top1 = 37.49%], test : [loss = 2.474, top1 = 37.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.23%], valid : [loss = 0.828, top1 = 70.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  814/15625) 000814-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.547, top1 = 88.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.362, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.26 ms.
cifar100       train : [loss = 0.250, top1 = 93.30%], valid : [loss = 1.315, top1 = 67.37%], test : [loss = 1.328, top1 = 67.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.39%], valid : [loss = 2.415, top1 = 39.02%], test : [loss = 2.422, top1 = 38.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  815/15625) 000815-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.551, top1 = 88.89%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.364, top1 = 92.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.70 ms.
cifar100       train : [loss = 0.082, top1 = 98.67%], valid : [loss = 1.457, top1 = 68.29%], test : [loss = 1.458, top1 = 68.92%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 1.841, top1 = 51.21%], valid : [loss = 2.407, top1 = 39.94%], test : [loss = 2.438, top1 = 40.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.46%], valid : [loss = 0.731, top1 = 74.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  816/15625) 000816-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.566, top1 = 87.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.032, top1 = 99.05%], test  : [loss = 0.364, top1 = 91.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.479, top1 = 86.39%], valid : [loss = 1.317, top1 = 65.68%], test : [loss = 1.319, top1 = 65.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 36.77%], valid : [loss = 2.563, top1 = 34.79%], test : [loss = 2.594, top1 = 34.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  817/15625) 000817-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.480, top1 = 89.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.42 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.339, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.173, top1 = 95.93%], valid : [loss = 1.333, top1 = 68.83%], test : [loss = 1.322, top1 = 68.53%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 50.04%], valid : [loss = 2.306, top1 = 41.16%], test : [loss = 2.349, top1 = 41.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 83.02%], valid : [loss = 0.583, top1 = 80.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  818/15625) 000818-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.37%], valid : [loss = 0.610, top1 = 84.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.34 ms.
cifar10        train : [loss = 0.097, top1 = 96.80%], test  : [loss = 0.420, top1 = 88.52%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.80 ms.
cifar100       train : [loss = 0.731, top1 = 78.82%], valid : [loss = 1.528, top1 = 59.88%], test : [loss = 1.523, top1 = 60.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 4.334, top1 = 5.39%], valid : [loss = 4.309, top1 = 5.73%], test : [loss = 4.319, top1 = 5.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.623, top1 = 39.36%], valid : [loss = 1.617, top1 = 39.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  819/15625) 000819-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.55%], valid : [loss = 0.573, top1 = 87.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.029, top1 = 99.12%], test  : [loss = 0.365, top1 = 91.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.13 ms.
cifar100       train : [loss = 0.423, top1 = 87.63%], valid : [loss = 1.283, top1 = 66.54%], test : [loss = 1.290, top1 = 66.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 41.97%], valid : [loss = 2.426, top1 = 38.94%], test : [loss = 2.448, top1 = 38.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.855, top1 = 69.47%], valid : [loss = 0.888, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  820/15625) 000820-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.629, top1 = 86.25%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.37 ms.
cifar10        train : [loss = 0.026, top1 = 99.31%], test  : [loss = 0.392, top1 = 90.53%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.26 ms.
cifar100       train : [loss = 0.497, top1 = 85.61%], valid : [loss = 1.421, top1 = 63.58%], test : [loss = 1.432, top1 = 63.65%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.76%], valid : [loss = 2.504, top1 = 36.56%], test : [loss = 2.539, top1 = 36.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.43%], valid : [loss = 0.866, top1 = 69.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  821/15625) 000821-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.542, top1 = 88.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.358, top1 = 91.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.98 ms.
cifar100       train : [loss = 0.431, top1 = 87.37%], valid : [loss = 1.285, top1 = 66.79%], test : [loss = 1.297, top1 = 67.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.21%], valid : [loss = 2.395, top1 = 39.52%], test : [loss = 2.419, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.76%], valid : [loss = 0.880, top1 = 69.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  822/15625) 000822-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.62%], valid : [loss = 0.555, top1 = 87.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.029, top1 = 99.11%], test  : [loss = 0.360, top1 = 91.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.89 ms.
cifar100       train : [loss = 0.417, top1 = 87.94%], valid : [loss = 1.274, top1 = 67.01%], test : [loss = 1.274, top1 = 66.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.75%], valid : [loss = 2.442, top1 = 38.42%], test : [loss = 2.455, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.68%], valid : [loss = 0.896, top1 = 68.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  823/15625) 000823-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.556, top1 = 87.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 0.033, top1 = 99.11%], test  : [loss = 0.396, top1 = 90.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 0.452, top1 = 87.00%], valid : [loss = 1.371, top1 = 64.93%], test : [loss = 1.390, top1 = 64.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.57%], valid : [loss = 2.584, top1 = 35.40%], test : [loss = 2.625, top1 = 34.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.61%], valid : [loss = 0.662, top1 = 77.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  824/15625) 000824-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.28%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.86 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.316, top1 = 92.86%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.49 ms.
cifar100       train : [loss = 0.132, top1 = 97.39%], valid : [loss = 1.287, top1 = 69.10%], test : [loss = 1.282, top1 = 69.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.30 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.48%], valid : [loss = 2.285, top1 = 42.04%], test : [loss = 2.269, top1 = 42.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.79%], valid : [loss = 0.645, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  825/15625) 000825-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.14%], valid : [loss = 0.563, top1 = 86.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10        train : [loss = 0.065, top1 = 97.91%], test  : [loss = 0.362, top1 = 90.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.33 ms.
cifar100       train : [loss = 0.648, top1 = 80.86%], valid : [loss = 1.301, top1 = 65.01%], test : [loss = 1.322, top1 = 64.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.372, top1 = 39.31%], valid : [loss = 2.511, top1 = 36.43%], test : [loss = 2.525, top1 = 36.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  826/15625) 000826-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.55%], valid : [loss = 0.867, top1 = 79.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.126, top1 = 95.77%], test  : [loss = 0.557, top1 = 84.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.855, top1 = 75.18%], valid : [loss = 1.682, top1 = 57.20%], test : [loss = 1.662, top1 = 57.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.35%], valid : [loss = 3.175, top1 = 23.92%], test : [loss = 3.209, top1 = 23.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.079, top1 = 60.77%], valid : [loss = 1.136, top1 = 59.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  827/15625) 000827-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.535, top1 = 88.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.342, top1 = 92.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.58 ms.
cifar100       train : [loss = 0.146, top1 = 96.43%], valid : [loss = 1.368, top1 = 68.47%], test : [loss = 1.389, top1 = 68.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.63%], valid : [loss = 2.367, top1 = 40.50%], test : [loss = 2.375, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.30%], valid : [loss = 0.907, top1 = 67.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  828/15625) 000828-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.563, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10        train : [loss = 0.034, top1 = 99.01%], test  : [loss = 0.356, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 0.543, top1 = 84.52%], valid : [loss = 1.361, top1 = 64.28%], test : [loss = 1.371, top1 = 64.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.574, top1 = 34.57%], valid : [loss = 2.653, top1 = 32.87%], test : [loss = 2.671, top1 = 32.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  829/15625) 000829-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.564, top1 = 88.49%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.48 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.383, top1 = 91.80%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.50 ms.
cifar100       train : [loss = 0.088, top1 = 98.86%], valid : [loss = 1.404, top1 = 68.39%], test : [loss = 1.389, top1 = 68.71%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.99%], valid : [loss = 2.426, top1 = 39.62%], test : [loss = 2.443, top1 = 40.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.32%], valid : [loss = 0.695, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  830/15625) 000830-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.96%], valid : [loss = 0.754, top1 = 74.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.45 ms.
cifar10        train : [loss = 0.496, top1 = 82.88%], test  : [loss = 0.572, top1 = 80.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 2.047, top1 = 44.87%], valid : [loss = 2.165, top1 = 42.61%], test : [loss = 2.170, top1 = 42.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.013, top1 = 26.30%], valid : [loss = 3.006, top1 = 26.30%], test : [loss = 3.039, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  831/15625) 000831-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.27%], valid : [loss = 0.538, top1 = 85.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10        train : [loss = 0.106, top1 = 96.62%], test  : [loss = 0.360, top1 = 89.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.06 ms.
cifar100       train : [loss = 0.738, top1 = 78.74%], valid : [loss = 1.316, top1 = 64.51%], test : [loss = 1.311, top1 = 64.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.65%], valid : [loss = 2.576, top1 = 35.00%], test : [loss = 2.594, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 68.97%], valid : [loss = 0.919, top1 = 67.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  832/15625) 000832-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.71 ms.
cifar10-valid  train : [loss = 1.838, top1 = 33.58%], valid : [loss = 1.856, top1 = 33.17%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.74 ms.
cifar10        train : [loss = 1.326, top1 = 51.69%], test  : [loss = 1.329, top1 = 51.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.42 ms.
cifar100       train : [loss = 3.802, top1 = 11.83%], valid : [loss = 3.905, top1 = 10.39%], test : [loss = 3.899, top1 = 10.81%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.82 ms.
ImageNet16-120 train : [loss = 3.897, top1 = 11.97%], valid : [loss = 3.878, top1 = 12.32%], test : [loss = 3.894, top1 = 12.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.47%], valid : [loss = 1.967, top1 = 27.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  833/15625) 000833-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.488, top1 = 88.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.312, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.70 ms.
cifar100       train : [loss = 0.292, top1 = 92.27%], valid : [loss = 1.222, top1 = 68.61%], test : [loss = 1.244, top1 = 68.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.24%], valid : [loss = 2.252, top1 = 42.07%], test : [loss = 2.283, top1 = 42.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.27%], valid : [loss = 0.650, top1 = 77.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  834/15625) 000834-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.51%], valid : [loss = 0.850, top1 = 72.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 0.565, top1 = 80.35%], test  : [loss = 0.718, top1 = 75.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 1.779, top1 = 52.09%], valid : [loss = 2.043, top1 = 47.35%], test : [loss = 2.052, top1 = 47.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.75%], valid : [loss = 3.633, top1 = 16.94%], test : [loss = 3.669, top1 = 15.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  835/15625) 000835-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.22%], valid : [loss = 0.455, top1 = 86.12%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.80 ms.
cifar10        train : [loss = 0.161, top1 = 94.75%], test  : [loss = 0.345, top1 = 88.84%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.98 ms.
cifar100       train : [loss = 1.019, top1 = 70.89%], valid : [loss = 1.367, top1 = 61.75%], test : [loss = 1.356, top1 = 61.91%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.99 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.62%], valid : [loss = 2.680, top1 = 33.41%], test : [loss = 2.710, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 74.67%], valid : [loss = 0.763, top1 = 73.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  836/15625) 000836-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.27%], valid : [loss = 0.455, top1 = 86.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.156, top1 = 94.90%], test  : [loss = 0.341, top1 = 88.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.43 ms.
cifar100       train : [loss = 1.007, top1 = 71.37%], valid : [loss = 1.366, top1 = 61.68%], test : [loss = 1.353, top1 = 62.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 34.02%], valid : [loss = 2.694, top1 = 32.62%], test : [loss = 2.707, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  837/15625) 000837-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.458, top1 = 89.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.314, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.43 ms.
cifar100       train : [loss = 0.327, top1 = 91.08%], valid : [loss = 1.298, top1 = 67.18%], test : [loss = 1.300, top1 = 67.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.15%], valid : [loss = 2.362, top1 = 40.33%], test : [loss = 2.396, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.50%], valid : [loss = 0.577, top1 = 80.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  838/15625) 000838-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.537, top1 = 89.03%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.340, top1 = 92.57%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.12 ms.
cifar100       train : [loss = 0.181, top1 = 95.58%], valid : [loss = 1.269, top1 = 69.85%], test : [loss = 1.289, top1 = 69.52%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.50%], valid : [loss = 2.210, top1 = 43.12%], test : [loss = 2.226, top1 = 43.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.40%], valid : [loss = 0.785, top1 = 72.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  839/15625) 000839-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.81%], valid : [loss = 0.732, top1 = 83.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.088, top1 = 97.10%], test  : [loss = 0.481, top1 = 87.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 0.821, top1 = 76.05%], valid : [loss = 1.569, top1 = 59.61%], test : [loss = 1.567, top1 = 59.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.17%], valid : [loss = 2.942, top1 = 28.27%], test : [loss = 2.999, top1 = 27.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.44%], valid : [loss = 0.867, top1 = 69.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  840/15625) 000840-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.50%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.40 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.318, top1 = 93.05%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.70 ms.
cifar100       train : [loss = 0.061, top1 = 99.18%], valid : [loss = 1.332, top1 = 69.85%], test : [loss = 1.325, top1 = 69.97%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.65%], valid : [loss = 2.323, top1 = 41.31%], test : [loss = 2.329, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.41%], valid : [loss = 0.835, top1 = 70.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  841/15625) 000841-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.560, top1 = 88.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.379, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.38 ms.
cifar100       train : [loss = 0.173, top1 = 96.15%], valid : [loss = 1.420, top1 = 67.69%], test : [loss = 1.422, top1 = 67.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 48.10%], valid : [loss = 2.371, top1 = 40.63%], test : [loss = 2.396, top1 = 40.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.03%], valid : [loss = 0.671, top1 = 76.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  842/15625) 000842-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.539, top1 = 88.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.339, top1 = 91.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 0.333, top1 = 90.92%], valid : [loss = 1.287, top1 = 66.63%], test : [loss = 1.310, top1 = 66.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.68%], valid : [loss = 2.417, top1 = 39.41%], test : [loss = 2.411, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.52%], valid : [loss = 0.651, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  843/15625) 000843-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.532, top1 = 88.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.81 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.344, top1 = 91.85%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.16 ms.
cifar100       train : [loss = 0.329, top1 = 90.92%], valid : [loss = 1.289, top1 = 66.91%], test : [loss = 1.293, top1 = 67.13%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.70 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.95%], valid : [loss = 2.412, top1 = 38.77%], test : [loss = 2.427, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.01%], valid : [loss = 0.808, top1 = 71.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  844/15625) 000844-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.435, top1 = 91.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.291, top1 = 93.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.74 ms.
cifar100       train : [loss = 0.060, top1 = 99.16%], valid : [loss = 1.343, top1 = 70.48%], test : [loss = 1.334, top1 = 70.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 1.515, top1 = 58.98%], valid : [loss = 2.255, top1 = 43.71%], test : [loss = 2.245, top1 = 44.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.358, top1 = 87.53%], valid : [loss = 0.500, top1 = 83.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  845/15625) 000845-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.65%], valid : [loss = 1.127, top1 = 62.65%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.23 ms.
cifar10        train : [loss = 0.776, top1 = 72.70%], test  : [loss = 0.911, top1 = 68.80%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.25 ms.
cifar100       train : [loss = 2.145, top1 = 43.76%], valid : [loss = 2.417, top1 = 39.09%], test : [loss = 2.433, top1 = 38.70%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.95%], valid : [loss = 3.821, top1 = 13.92%], test : [loss = 3.827, top1 = 13.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  846/15625) 000846-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.507, top1 = 88.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.336, top1 = 91.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.14 ms.
cifar100       train : [loss = 0.342, top1 = 90.63%], valid : [loss = 1.292, top1 = 66.91%], test : [loss = 1.302, top1 = 66.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.72%], valid : [loss = 2.414, top1 = 38.79%], test : [loss = 2.396, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  847/15625) 000847-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.549, top1 = 87.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10        train : [loss = 0.032, top1 = 99.10%], test  : [loss = 0.350, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.474, top1 = 86.48%], valid : [loss = 1.288, top1 = 65.79%], test : [loss = 1.291, top1 = 66.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.583, top1 = 34.39%], valid : [loss = 2.656, top1 = 32.77%], test : [loss = 2.680, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  848/15625) 000848-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.35%], valid : [loss = 0.622, top1 = 85.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.070, top1 = 97.89%], test  : [loss = 0.401, top1 = 88.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.06 ms.
cifar100       train : [loss = 0.722, top1 = 78.88%], valid : [loss = 1.411, top1 = 62.72%], test : [loss = 1.373, top1 = 63.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.98%], valid : [loss = 2.667, top1 = 33.52%], test : [loss = 2.682, top1 = 33.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  849/15625) 000849-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.65%], valid : [loss = 0.525, top1 = 82.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.393, top1 = 86.59%], test  : [loss = 0.463, top1 = 84.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.539, top1 = 57.82%], valid : [loss = 1.661, top1 = 54.58%], test : [loss = 1.650, top1 = 54.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.42%], valid : [loss = 3.008, top1 = 26.92%], test : [loss = 3.043, top1 = 26.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.54%], valid : [loss = 1.147, top1 = 59.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  850/15625) 000850-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.57%], valid : [loss = 0.657, top1 = 78.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.521, top1 = 82.04%], test  : [loss = 0.588, top1 = 80.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.44 ms.
cifar100       train : [loss = 1.690, top1 = 54.17%], valid : [loss = 1.848, top1 = 50.51%], test : [loss = 1.881, top1 = 51.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.27%], valid : [loss = 3.320, top1 = 20.94%], test : [loss = 3.347, top1 = 21.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  851/15625) 000851-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.317, top1 = 89.12%], valid : [loss = 0.568, top1 = 81.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10        train : [loss = 0.254, top1 = 91.31%], test  : [loss = 0.411, top1 = 86.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.58 ms.
cifar100       train : [loss = 1.449, top1 = 59.26%], valid : [loss = 1.679, top1 = 54.22%], test : [loss = 1.690, top1 = 53.93%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.895, top1 = 28.62%], valid : [loss = 2.916, top1 = 28.71%], test : [loss = 2.951, top1 = 27.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.992, top1 = 64.34%], valid : [loss = 1.028, top1 = 63.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  852/15625) 000852-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.95%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.47 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.308, top1 = 93.33%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.35 ms.
cifar100       train : [loss = 0.065, top1 = 99.03%], valid : [loss = 1.314, top1 = 70.14%], test : [loss = 1.341, top1 = 69.89%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.77%], valid : [loss = 2.306, top1 = 41.13%], test : [loss = 2.322, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.03%], valid : [loss = 0.872, top1 = 68.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  853/15625) 000853-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.73%], valid : [loss = 0.913, top1 = 76.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.228, top1 = 92.10%], test  : [loss = 0.615, top1 = 81.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.83 ms.
cifar100       train : [loss = 1.160, top1 = 67.04%], valid : [loss = 1.783, top1 = 53.51%], test : [loss = 1.769, top1 = 54.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.69%], valid : [loss = 3.327, top1 = 21.57%], test : [loss = 3.379, top1 = 20.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  854/15625) 000854-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.502, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.346, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 0.480, top1 = 85.96%], valid : [loss = 1.350, top1 = 65.59%], test : [loss = 1.362, top1 = 65.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.03%], valid : [loss = 2.525, top1 = 36.56%], test : [loss = 2.550, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.17%], valid : [loss = 0.679, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  855/15625) 000855-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.507, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.336, top1 = 92.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.343, top1 = 90.39%], valid : [loss = 1.251, top1 = 67.61%], test : [loss = 1.250, top1 = 68.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.69%], valid : [loss = 2.326, top1 = 40.78%], test : [loss = 2.337, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.12%], valid : [loss = 0.743, top1 = 74.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  856/15625) 000856-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.485, top1 = 89.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.322, top1 = 91.28%], valid : [loss = 1.264, top1 = 67.15%], test : [loss = 1.267, top1 = 67.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.78%], valid : [loss = 2.322, top1 = 41.16%], test : [loss = 2.338, top1 = 40.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  857/15625) 000857-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.423, top1 = 91.07%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.270, top1 = 93.99%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.93 ms.
cifar100       train : [loss = 0.031, top1 = 99.75%], valid : [loss = 1.256, top1 = 72.51%], test : [loss = 1.210, top1 = 72.88%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.86 ms.
ImageNet16-120 train : [loss = 1.223, top1 = 66.20%], valid : [loss = 2.167, top1 = 46.38%], test : [loss = 2.182, top1 = 47.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 88.18%], valid : [loss = 0.497, top1 = 83.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  858/15625) 000858-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.23%], valid : [loss = 0.459, top1 = 86.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.87 ms.
cifar10        train : [loss = 0.116, top1 = 96.43%], test  : [loss = 0.328, top1 = 89.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.88 ms.
cifar100       train : [loss = 0.857, top1 = 75.60%], valid : [loss = 1.293, top1 = 64.08%], test : [loss = 1.283, top1 = 64.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.56%], valid : [loss = 2.628, top1 = 34.79%], test : [loss = 2.661, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.09%], valid : [loss = 0.653, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  859/15625) 000859-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.05%], valid : [loss = 0.496, top1 = 87.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10        train : [loss = 0.073, top1 = 97.74%], test  : [loss = 0.341, top1 = 90.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.43 ms.
cifar100       train : [loss = 0.706, top1 = 79.53%], valid : [loss = 1.313, top1 = 64.93%], test : [loss = 1.293, top1 = 65.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.425, top1 = 38.26%], valid : [loss = 2.554, top1 = 35.64%], test : [loss = 2.576, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.80%], valid : [loss = 0.627, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  860/15625) 000860-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.31%], valid : [loss = 0.526, top1 = 87.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10        train : [loss = 0.057, top1 = 98.29%], test  : [loss = 0.365, top1 = 89.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.85 ms.
cifar100       train : [loss = 0.602, top1 = 82.17%], valid : [loss = 1.345, top1 = 65.03%], test : [loss = 1.335, top1 = 65.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.92%], valid : [loss = 2.493, top1 = 36.93%], test : [loss = 2.525, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.79%], valid : [loss = 0.613, top1 = 79.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  861/15625) 000861-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.76%], valid : [loss = 0.888, top1 = 76.91%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10        train : [loss = 0.220, top1 = 92.47%], test  : [loss = 0.609, top1 = 81.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.11 ms.
cifar100       train : [loss = 1.156, top1 = 67.20%], valid : [loss = 1.766, top1 = 54.32%], test : [loss = 1.754, top1 = 54.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 3.210, top1 = 23.17%], valid : [loss = 3.310, top1 = 21.77%], test : [loss = 3.351, top1 = 20.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.76%], valid : [loss = 1.087, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  862/15625) 000862-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=23.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.501, top1 = 89.90%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=21.54 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.294, top1 = 93.49%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=19.89 ms.
cifar100       train : [loss = 0.068, top1 = 99.12%], valid : [loss = 1.235, top1 = 70.95%], test : [loss = 1.239, top1 = 71.04%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=22.68 ms.
ImageNet16-120 train : [loss = 1.542, top1 = 58.23%], valid : [loss = 2.110, top1 = 46.09%], test : [loss = 2.114, top1 = 45.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.65%], valid : [loss = 0.644, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  863/15625) 000863-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.570, top1 = 87.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.73 ms.
cifar10        train : [loss = 0.035, top1 = 98.94%], test  : [loss = 0.365, top1 = 90.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 0.531, top1 = 84.50%], valid : [loss = 1.360, top1 = 64.50%], test : [loss = 1.362, top1 = 64.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 34.78%], valid : [loss = 2.643, top1 = 33.18%], test : [loss = 2.649, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  864/15625) 000864-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.097, top1 = 96.95%], valid : [loss = 0.706, top1 = 81.93%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.138, top1 = 95.37%], test  : [loss = 0.456, top1 = 86.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.53 ms.
cifar100       train : [loss = 0.925, top1 = 73.16%], valid : [loss = 1.629, top1 = 57.10%], test : [loss = 1.629, top1 = 57.51%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 3.020, top1 = 25.89%], valid : [loss = 3.093, top1 = 25.11%], test : [loss = 3.155, top1 = 23.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.72%], valid : [loss = 0.992, top1 = 64.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  865/15625) 000865-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.83%], valid : [loss = 0.664, top1 = 85.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.24 ms.
cifar10        train : [loss = 0.029, top1 = 99.28%], test  : [loss = 0.420, top1 = 89.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 0.389, top1 = 89.54%], valid : [loss = 1.412, top1 = 64.72%], test : [loss = 1.404, top1 = 65.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.41%], valid : [loss = 2.614, top1 = 35.13%], test : [loss = 2.621, top1 = 35.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  866/15625) 000866-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.478, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.97 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.84 ms.
cifar100       train : [loss = 0.318, top1 = 91.48%], valid : [loss = 1.264, top1 = 67.37%], test : [loss = 1.260, top1 = 68.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.77%], valid : [loss = 2.314, top1 = 40.96%], test : [loss = 2.349, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  867/15625) 000867-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.92 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.67 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.71 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.70 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  868/15625) 000868-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.444, top1 = 89.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.300, top1 = 92.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.206, top1 = 95.18%], valid : [loss = 1.261, top1 = 68.78%], test : [loss = 1.256, top1 = 69.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.54%], valid : [loss = 2.270, top1 = 42.21%], test : [loss = 2.314, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  869/15625) 000869-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.428, top1 = 91.22%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.14 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.271, top1 = 93.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.66 ms.
cifar100       train : [loss = 0.030, top1 = 99.75%], valid : [loss = 1.326, top1 = 71.97%], test : [loss = 1.305, top1 = 71.69%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.96 ms.
ImageNet16-120 train : [loss = 1.286, top1 = 64.65%], valid : [loss = 2.222, top1 = 45.59%], test : [loss = 2.235, top1 = 45.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.314, top1 = 89.32%], valid : [loss = 0.478, top1 = 84.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  870/15625) 000870-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.528, top1 = 88.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10        train : [loss = 0.025, top1 = 99.29%], test  : [loss = 0.360, top1 = 91.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.92 ms.
cifar100       train : [loss = 0.409, top1 = 88.25%], valid : [loss = 1.277, top1 = 66.91%], test : [loss = 1.271, top1 = 66.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.57%], valid : [loss = 2.403, top1 = 39.27%], test : [loss = 2.434, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.71%], valid : [loss = 0.718, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  871/15625) 000871-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.532, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.339, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.299, top1 = 91.91%], valid : [loss = 1.273, top1 = 67.70%], test : [loss = 1.294, top1 = 67.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.75%], valid : [loss = 2.409, top1 = 38.82%], test : [loss = 2.429, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  872/15625) 000872-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.439, top1 = 89.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.299, top1 = 92.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.205, top1 = 95.21%], valid : [loss = 1.264, top1 = 68.72%], test : [loss = 1.260, top1 = 69.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.82%], valid : [loss = 2.259, top1 = 42.17%], test : [loss = 2.301, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  873/15625) 000873-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.510, top1 = 89.92%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.36 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.74%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.46 ms.
cifar100       train : [loss = 0.070, top1 = 98.97%], valid : [loss = 1.315, top1 = 70.13%], test : [loss = 1.333, top1 = 70.16%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.96 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.74%], valid : [loss = 2.233, top1 = 42.89%], test : [loss = 2.236, top1 = 42.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 79.26%], valid : [loss = 0.680, top1 = 76.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  874/15625) 000874-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.34%], valid : [loss = 0.608, top1 = 85.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.071, top1 = 97.86%], test  : [loss = 0.411, top1 = 88.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.712, top1 = 79.32%], valid : [loss = 1.386, top1 = 62.93%], test : [loss = 1.391, top1 = 63.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.09%], valid : [loss = 2.645, top1 = 33.71%], test : [loss = 2.688, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.36%], valid : [loss = 0.792, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  875/15625) 000875-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.512, top1 = 88.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.331, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.57 ms.
cifar100       train : [loss = 0.232, top1 = 94.29%], valid : [loss = 1.298, top1 = 67.83%], test : [loss = 1.302, top1 = 67.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.38%], valid : [loss = 2.331, top1 = 41.09%], test : [loss = 2.331, top1 = 40.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.11%], valid : [loss = 0.700, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  876/15625) 000876-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.488, top1 = 82.86%], valid : [loss = 0.647, top1 = 78.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.508, top1 = 82.40%], test  : [loss = 0.587, top1 = 80.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.35 ms.
cifar100       train : [loss = 1.680, top1 = 54.35%], valid : [loss = 1.854, top1 = 50.82%], test : [loss = 1.859, top1 = 50.97%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 3.331, top1 = 21.21%], valid : [loss = 3.316, top1 = 21.33%], test : [loss = 3.344, top1 = 20.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  877/15625) 000877-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.523, top1 = 88.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.028, top1 = 99.19%], test  : [loss = 0.356, top1 = 91.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.98 ms.
cifar100       train : [loss = 0.474, top1 = 86.15%], valid : [loss = 1.357, top1 = 65.68%], test : [loss = 1.352, top1 = 65.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 40.10%], valid : [loss = 2.522, top1 = 36.60%], test : [loss = 2.563, top1 = 35.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  878/15625) 000878-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.367, top1 = 87.26%], valid : [loss = 0.609, top1 = 80.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.313, top1 = 89.26%], test  : [loss = 0.454, top1 = 84.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.62 ms.
cifar100       train : [loss = 1.569, top1 = 56.36%], valid : [loss = 1.796, top1 = 51.67%], test : [loss = 1.781, top1 = 51.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 3.093, top1 = 24.95%], valid : [loss = 3.094, top1 = 24.91%], test : [loss = 3.167, top1 = 23.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.69%], valid : [loss = 1.044, top1 = 62.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  879/15625) 000879-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  880/15625) 000880-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.633, top1 = 86.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.408, top1 = 90.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.87 ms.
cifar100       train : [loss = 0.268, top1 = 93.09%], valid : [loss = 1.556, top1 = 64.19%], test : [loss = 1.559, top1 = 63.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.60%], valid : [loss = 2.517, top1 = 36.39%], test : [loss = 2.546, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.87%], valid : [loss = 0.820, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  881/15625) 000881-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.580, top1 = 88.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.376, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.170, top1 = 96.38%], valid : [loss = 1.413, top1 = 67.65%], test : [loss = 1.385, top1 = 67.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 48.03%], valid : [loss = 2.465, top1 = 38.89%], test : [loss = 2.482, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.70%], valid : [loss = 0.689, top1 = 75.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  882/15625) 000882-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.35%], valid : [loss = 0.461, top1 = 85.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.155, top1 = 94.98%], test  : [loss = 0.342, top1 = 88.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.07 ms.
cifar100       train : [loss = 0.998, top1 = 71.57%], valid : [loss = 1.358, top1 = 61.93%], test : [loss = 1.345, top1 = 61.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.81%], valid : [loss = 2.676, top1 = 32.79%], test : [loss = 2.707, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  883/15625) 000883-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.561, top1 = 88.43%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.369, top1 = 92.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.28 ms.
cifar100       train : [loss = 0.126, top1 = 97.56%], valid : [loss = 1.467, top1 = 67.16%], test : [loss = 1.436, top1 = 67.71%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.90 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.60%], valid : [loss = 2.410, top1 = 39.67%], test : [loss = 2.421, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.65%], valid : [loss = 0.725, top1 = 74.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  884/15625) 000884-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.432, top1 = 89.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.297, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.12 ms.
cifar100       train : [loss = 0.206, top1 = 95.16%], valid : [loss = 1.282, top1 = 68.79%], test : [loss = 1.291, top1 = 68.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.89%], valid : [loss = 2.276, top1 = 42.10%], test : [loss = 2.297, top1 = 42.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.89%], valid : [loss = 0.529, top1 = 82.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  885/15625) 000885-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.89 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  886/15625) 000886-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.102, top1 = 97.05%], valid : [loss = 0.466, top1 = 86.19%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10        train : [loss = 0.142, top1 = 95.39%], test  : [loss = 0.337, top1 = 89.21%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.86 ms.
cifar100       train : [loss = 0.906, top1 = 74.14%], valid : [loss = 1.325, top1 = 63.25%], test : [loss = 1.306, top1 = 63.31%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.66%], valid : [loss = 2.635, top1 = 33.87%], test : [loss = 2.647, top1 = 33.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.41%], valid : [loss = 0.766, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  887/15625) 000887-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.11%], valid : [loss = 0.758, top1 = 73.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.583, top1 = 79.79%], test  : [loss = 0.639, top1 = 78.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 2.000, top1 = 46.03%], valid : [loss = 2.156, top1 = 43.34%], test : [loss = 2.143, top1 = 43.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.248, top1 = 22.08%], valid : [loss = 3.251, top1 = 22.50%], test : [loss = 3.269, top1 = 21.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.00%], valid : [loss = 1.329, top1 = 52.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  888/15625) 000888-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.58%], valid : [loss = 0.607, top1 = 87.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.032, top1 = 99.02%], test  : [loss = 0.390, top1 = 90.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.46 ms.
cifar100       train : [loss = 0.397, top1 = 88.74%], valid : [loss = 1.476, top1 = 63.43%], test : [loss = 1.462, top1 = 63.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.792, top1 = 29.80%], valid : [loss = 2.870, top1 = 28.32%], test : [loss = 2.860, top1 = 28.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  889/15625) 000889-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.609, top1 = 87.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.415, top1 = 91.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.148, top1 = 96.96%], valid : [loss = 1.549, top1 = 66.05%], test : [loss = 1.560, top1 = 65.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 46.08%], valid : [loss = 2.578, top1 = 36.24%], test : [loss = 2.574, top1 = 36.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.32%], valid : [loss = 0.769, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  890/15625) 000890-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.102, top1 = 97.03%], valid : [loss = 0.462, top1 = 86.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.137, top1 = 95.69%], test  : [loss = 0.346, top1 = 89.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.32 ms.
cifar100       train : [loss = 0.875, top1 = 75.24%], valid : [loss = 1.320, top1 = 63.42%], test : [loss = 1.305, top1 = 63.57%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.520, top1 = 36.23%], valid : [loss = 2.627, top1 = 33.97%], test : [loss = 2.624, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.69%], valid : [loss = 0.786, top1 = 72.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  891/15625) 000891-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.340, top1 = 91.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.86 ms.
cifar100       train : [loss = 0.338, top1 = 90.81%], valid : [loss = 1.300, top1 = 66.79%], test : [loss = 1.287, top1 = 67.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.60%], valid : [loss = 2.410, top1 = 38.53%], test : [loss = 2.419, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  892/15625) 000892-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.550, top1 = 88.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.370, top1 = 92.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.25 ms.
cifar100       train : [loss = 0.103, top1 = 98.15%], valid : [loss = 1.462, top1 = 68.13%], test : [loss = 1.455, top1 = 67.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.84%], valid : [loss = 2.427, top1 = 39.06%], test : [loss = 2.446, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  893/15625) 000893-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.48 ms.
cifar10-valid  train : [loss = 1.278, top1 = 54.00%], valid : [loss = 1.322, top1 = 52.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10        train : [loss = 1.286, top1 = 53.90%], test  : [loss = 1.290, top1 = 53.90%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.57 ms.
cifar100       train : [loss = 2.800, top1 = 30.20%], valid : [loss = 2.902, top1 = 28.57%], test : [loss = 2.890, top1 = 28.69%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.66 ms.
ImageNet16-120 train : [loss = 3.934, top1 = 11.38%], valid : [loss = 3.936, top1 = 11.80%], test : [loss = 3.955, top1 = 10.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.759, top1 = 33.54%], valid : [loss = 1.752, top1 = 34.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  894/15625) 000894-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.17%], valid : [loss = 0.467, top1 = 85.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 0.160, top1 = 94.79%], test  : [loss = 0.351, top1 = 88.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 0.994, top1 = 71.63%], valid : [loss = 1.362, top1 = 61.95%], test : [loss = 1.342, top1 = 61.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.78%], valid : [loss = 2.685, top1 = 32.91%], test : [loss = 2.710, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  895/15625) 000895-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.500, top1 = 89.67%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.12 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.311, top1 = 93.08%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.31 ms.
cifar100       train : [loss = 0.129, top1 = 97.46%], valid : [loss = 1.306, top1 = 69.18%], test : [loss = 1.298, top1 = 69.67%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.18%], valid : [loss = 2.289, top1 = 42.54%], test : [loss = 2.256, top1 = 42.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.05%], valid : [loss = 0.668, top1 = 76.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  896/15625) 000896-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.449, top1 = 89.29%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.324, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.318, top1 = 91.48%], valid : [loss = 1.290, top1 = 67.35%], test : [loss = 1.306, top1 = 67.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.21%], valid : [loss = 2.371, top1 = 39.69%], test : [loss = 2.396, top1 = 40.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.85%], valid : [loss = 0.540, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  897/15625) 000897-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.76%], valid : [loss = 0.646, top1 = 85.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.038, top1 = 98.98%], test  : [loss = 0.428, top1 = 89.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.40 ms.
cifar100       train : [loss = 0.440, top1 = 87.76%], valid : [loss = 1.421, top1 = 63.91%], test : [loss = 1.429, top1 = 64.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.29%], valid : [loss = 2.609, top1 = 35.36%], test : [loss = 2.628, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.20%], valid : [loss = 0.792, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  898/15625) 000898-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.412, top1 = 90.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.275, top1 = 93.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.89 ms.
cifar100       train : [loss = 0.184, top1 = 95.69%], valid : [loss = 1.281, top1 = 68.99%], test : [loss = 1.257, top1 = 70.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.54%], valid : [loss = 2.257, top1 = 42.57%], test : [loss = 2.267, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  899/15625) 000899-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.20%], valid : [loss = 0.846, top1 = 72.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.70 ms.
cifar10        train : [loss = 0.553, top1 = 80.70%], test  : [loss = 0.719, top1 = 75.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.96 ms.
cifar100       train : [loss = 1.770, top1 = 52.26%], valid : [loss = 2.056, top1 = 46.75%], test : [loss = 2.066, top1 = 47.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.91%], valid : [loss = 3.639, top1 = 16.23%], test : [loss = 3.665, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  900/15625) 000900-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.62%], valid : [loss = 0.516, top1 = 85.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.44 ms.
cifar10        train : [loss = 0.180, top1 = 93.93%], test  : [loss = 0.383, top1 = 87.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.04 ms.
cifar100       train : [loss = 1.026, top1 = 70.59%], valid : [loss = 1.412, top1 = 61.09%], test : [loss = 1.400, top1 = 61.63%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.28%], valid : [loss = 2.731, top1 = 32.34%], test : [loss = 2.782, top1 = 31.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.899, top1 = 67.88%], valid : [loss = 0.946, top1 = 66.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  901/15625) 000901-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.47%], valid : [loss = 0.658, top1 = 77.91%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.16 ms.
cifar10        train : [loss = 0.511, top1 = 82.31%], test  : [loss = 0.587, top1 = 80.23%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.39 ms.
cifar100       train : [loss = 1.691, top1 = 53.90%], valid : [loss = 1.858, top1 = 50.56%], test : [loss = 1.870, top1 = 50.55%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.05 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.30%], valid : [loss = 3.308, top1 = 22.04%], test : [loss = 3.342, top1 = 21.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  902/15625) 000902-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.76%], valid : [loss = 0.539, top1 = 86.93%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10        train : [loss = 0.072, top1 = 97.62%], test  : [loss = 0.357, top1 = 90.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.50 ms.
cifar100       train : [loss = 0.682, top1 = 79.71%], valid : [loss = 1.321, top1 = 64.36%], test : [loss = 1.309, top1 = 64.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 38.96%], valid : [loss = 2.518, top1 = 36.12%], test : [loss = 2.536, top1 = 35.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.75%], valid : [loss = 0.968, top1 = 65.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  903/15625) 000903-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.452, top1 = 89.83%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.63 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.307, top1 = 92.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.44 ms.
cifar100       train : [loss = 0.126, top1 = 97.55%], valid : [loss = 1.297, top1 = 69.72%], test : [loss = 1.295, top1 = 69.85%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.85%], valid : [loss = 2.211, top1 = 43.89%], test : [loss = 2.249, top1 = 43.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 86.13%], valid : [loss = 0.522, top1 = 82.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  904/15625) 000904-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.29%], valid : [loss = 0.515, top1 = 86.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.105, top1 = 96.67%], test  : [loss = 0.358, top1 = 89.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 0.755, top1 = 78.18%], valid : [loss = 1.321, top1 = 64.23%], test : [loss = 1.322, top1 = 64.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.34%], valid : [loss = 2.540, top1 = 36.13%], test : [loss = 2.584, top1 = 35.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 70.09%], valid : [loss = 0.894, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  905/15625) 000905-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.08%], valid : [loss = 0.545, top1 = 83.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.224, top1 = 92.35%], test  : [loss = 0.411, top1 = 86.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 1.299, top1 = 63.10%], valid : [loss = 1.577, top1 = 56.89%], test : [loss = 1.592, top1 = 56.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.717, top1 = 32.13%], valid : [loss = 2.756, top1 = 31.41%], test : [loss = 2.789, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.949, top1 = 65.92%], valid : [loss = 0.980, top1 = 65.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  906/15625) 000906-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.44%], valid : [loss = 0.464, top1 = 85.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10        train : [loss = 0.159, top1 = 94.76%], test  : [loss = 0.347, top1 = 88.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.94 ms.
cifar100       train : [loss = 0.993, top1 = 71.83%], valid : [loss = 1.356, top1 = 62.29%], test : [loss = 1.337, top1 = 62.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.77%], valid : [loss = 2.682, top1 = 32.93%], test : [loss = 2.702, top1 = 32.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  907/15625) 000907-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.577, top1 = 88.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.383, top1 = 91.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.08 ms.
cifar100       train : [loss = 0.061, top1 = 99.31%], valid : [loss = 1.499, top1 = 67.80%], test : [loss = 1.480, top1 = 67.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.78 ms.
ImageNet16-120 train : [loss = 1.726, top1 = 54.04%], valid : [loss = 2.430, top1 = 40.32%], test : [loss = 2.450, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.08%], valid : [loss = 0.710, top1 = 75.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  908/15625) 000908-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.535, top1 = 88.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.348, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.95 ms.
cifar100       train : [loss = 0.292, top1 = 92.11%], valid : [loss = 1.291, top1 = 67.38%], test : [loss = 1.306, top1 = 67.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.75%], valid : [loss = 2.403, top1 = 39.59%], test : [loss = 2.394, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.02%], valid : [loss = 0.831, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  909/15625) 000909-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.607, top1 = 86.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.394, top1 = 90.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.496, top1 = 85.56%], valid : [loss = 1.398, top1 = 64.14%], test : [loss = 1.389, top1 = 64.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.17%], valid : [loss = 2.570, top1 = 35.62%], test : [loss = 2.594, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.94%], valid : [loss = 0.826, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  910/15625) 000910-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.516, top1 = 89.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.30%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.84 ms.
cifar100       train : [loss = 0.074, top1 = 98.79%], valid : [loss = 1.359, top1 = 69.35%], test : [loss = 1.373, top1 = 69.57%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.020, top1 = 47.01%], valid : [loss = 2.373, top1 = 39.76%], test : [loss = 2.368, top1 = 40.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  911/15625) 000911-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.586, top1 = 87.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.022, top1 = 99.42%], test  : [loss = 0.384, top1 = 90.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.51 ms.
cifar100       train : [loss = 0.465, top1 = 86.62%], valid : [loss = 1.385, top1 = 65.01%], test : [loss = 1.379, top1 = 64.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.16%], valid : [loss = 2.481, top1 = 37.90%], test : [loss = 2.508, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.46%], valid : [loss = 0.818, top1 = 71.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  912/15625) 000912-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.502, top1 = 89.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.323, top1 = 93.18%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.83 ms.
cifar100       train : [loss = 0.116, top1 = 97.75%], valid : [loss = 1.288, top1 = 69.26%], test : [loss = 1.308, top1 = 69.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.15 ms.
ImageNet16-120 train : [loss = 1.739, top1 = 53.52%], valid : [loss = 2.177, top1 = 44.01%], test : [loss = 2.198, top1 = 43.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.24%], valid : [loss = 0.633, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  913/15625) 000913-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.64 ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.50%], valid : [loss = 0.891, top1 = 69.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.728, top1 = 74.33%], test  : [loss = 0.777, top1 = 73.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.79 ms.
cifar100       train : [loss = 2.374, top1 = 38.04%], valid : [loss = 2.497, top1 = 35.63%], test : [loss = 2.491, top1 = 35.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 3.547, top1 = 17.23%], valid : [loss = 3.535, top1 = 17.97%], test : [loss = 3.564, top1 = 16.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.447, top1 = 47.19%], valid : [loss = 1.498, top1 = 44.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  914/15625) 000914-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.603, top1 = 87.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.406, top1 = 91.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.28 ms.
cifar100       train : [loss = 0.159, top1 = 96.52%], valid : [loss = 1.471, top1 = 66.50%], test : [loss = 1.469, top1 = 66.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 2.028, top1 = 46.96%], valid : [loss = 2.478, top1 = 38.27%], test : [loss = 2.485, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.45%], valid : [loss = 0.768, top1 = 73.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  915/15625) 000915-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=23.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.474, top1 = 89.62%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=23.22 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.298, top1 = 92.79%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=22.02 ms.
cifar100       train : [loss = 0.162, top1 = 96.42%], valid : [loss = 1.276, top1 = 68.94%], test : [loss = 1.279, top1 = 69.48%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=21.07 ms.
ImageNet16-120 train : [loss = 1.684, top1 = 54.82%], valid : [loss = 2.140, top1 = 44.88%], test : [loss = 2.148, top1 = 45.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.51%], valid : [loss = 0.673, top1 = 77.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  916/15625) 000916-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.483, top1 = 89.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.316, top1 = 92.02%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.31 ms.
cifar100       train : [loss = 0.278, top1 = 92.74%], valid : [loss = 1.208, top1 = 68.98%], test : [loss = 1.236, top1 = 68.59%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.46 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.86%], valid : [loss = 2.213, top1 = 42.86%], test : [loss = 2.239, top1 = 42.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.29%], valid : [loss = 0.666, top1 = 77.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  917/15625) 000917-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.77%], valid : [loss = 0.634, top1 = 86.10%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.29 ms.
cifar10        train : [loss = 0.032, top1 = 99.18%], test  : [loss = 0.426, top1 = 89.49%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.30 ms.
cifar100       train : [loss = 0.371, top1 = 89.96%], valid : [loss = 1.477, top1 = 63.97%], test : [loss = 1.479, top1 = 64.19%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.22%], valid : [loss = 2.616, top1 = 34.41%], test : [loss = 2.642, top1 = 35.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.25%], valid : [loss = 0.832, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  918/15625) 000918-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.11%], valid : [loss = 0.576, top1 = 86.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10        train : [loss = 0.061, top1 = 98.05%], test  : [loss = 0.371, top1 = 89.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.10 ms.
cifar100       train : [loss = 0.655, top1 = 80.70%], valid : [loss = 1.313, top1 = 64.87%], test : [loss = 1.309, top1 = 64.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.399, top1 = 38.66%], valid : [loss = 2.527, top1 = 35.72%], test : [loss = 2.551, top1 = 35.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  919/15625) 000919-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.48%], valid : [loss = 0.569, top1 = 87.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10        train : [loss = 0.032, top1 = 99.00%], test  : [loss = 0.357, top1 = 90.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.90 ms.
cifar100       train : [loss = 0.427, top1 = 87.50%], valid : [loss = 1.278, top1 = 66.56%], test : [loss = 1.296, top1 = 66.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.38%], valid : [loss = 2.449, top1 = 37.52%], test : [loss = 2.484, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.64%], valid : [loss = 0.922, top1 = 67.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  920/15625) 000920-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.238, top1 = 91.88%], valid : [loss = 0.959, top1 = 73.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.298, top1 = 89.59%], test  : [loss = 0.632, top1 = 80.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.53 ms.
cifar100       train : [loss = 1.307, top1 = 63.15%], valid : [loss = 1.905, top1 = 51.14%], test : [loss = 1.909, top1 = 51.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.25 ms.
ImageNet16-120 train : [loss = 3.265, top1 = 22.07%], valid : [loss = 3.382, top1 = 20.47%], test : [loss = 3.394, top1 = 20.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.107, top1 = 60.06%], valid : [loss = 1.163, top1 = 58.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  921/15625) 000921-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.483, top1 = 89.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.66 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.311, top1 = 92.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.46 ms.
cifar100       train : [loss = 0.316, top1 = 91.48%], valid : [loss = 1.257, top1 = 67.46%], test : [loss = 1.244, top1 = 68.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.82%], valid : [loss = 2.231, top1 = 42.37%], test : [loss = 2.242, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  922/15625) 000922-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.25%], valid : [loss = 0.647, top1 = 78.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10        train : [loss = 0.333, top1 = 88.49%], test  : [loss = 0.453, top1 = 84.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 1.610, top1 = 55.16%], valid : [loss = 1.845, top1 = 50.29%], test : [loss = 1.850, top1 = 50.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.12%], valid : [loss = 2.947, top1 = 27.88%], test : [loss = 2.977, top1 = 27.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.026, top1 = 63.23%], valid : [loss = 1.095, top1 = 60.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  923/15625) 000923-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.580, top1 = 88.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.376, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.20 ms.
cifar100       train : [loss = 0.111, top1 = 97.77%], valid : [loss = 1.487, top1 = 67.47%], test : [loss = 1.518, top1 = 66.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.80%], valid : [loss = 2.416, top1 = 39.71%], test : [loss = 2.433, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.97%], valid : [loss = 0.752, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  924/15625) 000924-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.561, top1 = 88.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.349, top1 = 91.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.65 ms.
cifar100       train : [loss = 0.433, top1 = 87.33%], valid : [loss = 1.272, top1 = 66.61%], test : [loss = 1.261, top1 = 67.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.28%], valid : [loss = 2.372, top1 = 39.29%], test : [loss = 2.393, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.45%], valid : [loss = 0.862, top1 = 69.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  925/15625) 000925-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.496, top1 = 89.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.344, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.65 ms.
cifar100       train : [loss = 0.183, top1 = 95.60%], valid : [loss = 1.379, top1 = 68.29%], test : [loss = 1.335, top1 = 68.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.71%], valid : [loss = 2.377, top1 = 39.93%], test : [loss = 2.401, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.73%], valid : [loss = 0.635, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  926/15625) 000926-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.266, top1 = 90.84%], valid : [loss = 0.539, top1 = 83.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.230, top1 = 92.12%], test  : [loss = 0.400, top1 = 87.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 1.359, top1 = 61.67%], valid : [loss = 1.635, top1 = 55.75%], test : [loss = 1.613, top1 = 55.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.828, top1 = 30.10%], valid : [loss = 2.844, top1 = 30.06%], test : [loss = 2.875, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 65.80%], valid : [loss = 0.999, top1 = 64.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  927/15625) 000927-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.84%], valid : [loss = 0.548, top1 = 83.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.208, top1 = 92.91%], test  : [loss = 0.396, top1 = 87.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 1.307, top1 = 62.88%], valid : [loss = 1.582, top1 = 56.81%], test : [loss = 1.587, top1 = 56.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.720, top1 = 32.21%], valid : [loss = 2.744, top1 = 31.52%], test : [loss = 2.785, top1 = 30.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.48%], valid : [loss = 1.005, top1 = 63.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  928/15625) 000928-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.42%], valid : [loss = 0.522, top1 = 84.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10        train : [loss = 0.171, top1 = 94.21%], test  : [loss = 0.376, top1 = 88.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 1.195, top1 = 66.08%], valid : [loss = 1.519, top1 = 58.57%], test : [loss = 1.508, top1 = 58.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.47%], valid : [loss = 2.700, top1 = 32.51%], test : [loss = 2.738, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.20%], valid : [loss = 0.954, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  929/15625) 000929-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.70%], valid : [loss = 0.603, top1 = 80.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.318, top1 = 89.07%], test  : [loss = 0.458, top1 = 84.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 1.422, top1 = 60.10%], valid : [loss = 1.701, top1 = 54.09%], test : [loss = 1.699, top1 = 54.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 3.136, top1 = 24.42%], valid : [loss = 3.134, top1 = 24.37%], test : [loss = 3.202, top1 = 23.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.239, top1 = 55.20%], valid : [loss = 1.263, top1 = 54.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  930/15625) 000930-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.24%], valid : [loss = 0.641, top1 = 85.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.049, top1 = 98.49%], test  : [loss = 0.406, top1 = 89.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.621, top1 = 81.73%], valid : [loss = 1.445, top1 = 62.53%], test : [loss = 1.426, top1 = 62.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.35%], valid : [loss = 2.632, top1 = 34.33%], test : [loss = 2.650, top1 = 34.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.38%], valid : [loss = 0.888, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  931/15625) 000931-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.15 ms.
cifar10-valid  train : [loss = 1.135, top1 = 59.67%], valid : [loss = 1.180, top1 = 58.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10        train : [loss = 1.078, top1 = 61.91%], test  : [loss = 1.083, top1 = 61.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 2.575, top1 = 35.05%], valid : [loss = 2.643, top1 = 33.89%], test : [loss = 2.623, top1 = 34.83%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.87 ms.
ImageNet16-120 train : [loss = 3.778, top1 = 13.77%], valid : [loss = 3.766, top1 = 14.73%], test : [loss = 3.779, top1 = 14.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  932/15625) 000932-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.527, top1 = 88.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.330, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.333, top1 = 90.85%], valid : [loss = 1.269, top1 = 67.33%], test : [loss = 1.302, top1 = 66.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.93%], valid : [loss = 2.388, top1 = 39.31%], test : [loss = 2.391, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.97%], valid : [loss = 0.663, top1 = 77.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  933/15625) 000933-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.38 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.60 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.96 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.64 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  934/15625) 000934-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.69 ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.50%], valid : [loss = 0.847, top1 = 71.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10        train : [loss = 0.667, top1 = 76.72%], test  : [loss = 0.753, top1 = 74.02%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.97 ms.
cifar100       train : [loss = 1.956, top1 = 47.99%], valid : [loss = 2.127, top1 = 45.26%], test : [loss = 2.166, top1 = 44.37%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 3.652, top1 = 15.70%], valid : [loss = 3.677, top1 = 16.03%], test : [loss = 3.694, top1 = 14.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  935/15625) 000935-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.57%], valid : [loss = 0.858, top1 = 75.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10        train : [loss = 0.310, top1 = 89.17%], test  : [loss = 0.626, top1 = 80.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.33 ms.
cifar100       train : [loss = 1.351, top1 = 61.85%], valid : [loss = 1.908, top1 = 50.51%], test : [loss = 1.915, top1 = 50.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 3.479, top1 = 17.64%], valid : [loss = 3.500, top1 = 18.49%], test : [loss = 3.506, top1 = 17.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  936/15625) 000936-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.824, top1 = 71.05%], valid : [loss = 1.128, top1 = 62.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.791, top1 = 72.20%], test  : [loss = 0.920, top1 = 68.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.97 ms.
cifar100       train : [loss = 2.144, top1 = 43.89%], valid : [loss = 2.415, top1 = 38.98%], test : [loss = 2.415, top1 = 38.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 3.774, top1 = 13.77%], valid : [loss = 3.816, top1 = 13.99%], test : [loss = 3.828, top1 = 13.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.367, top1 = 50.31%], valid : [loss = 1.410, top1 = 48.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  937/15625) 000937-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 91.01%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.284, top1 = 93.70%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.16 ms.
cifar100       train : [loss = 0.039, top1 = 99.64%], valid : [loss = 1.337, top1 = 70.68%], test : [loss = 1.299, top1 = 71.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 1.410, top1 = 61.57%], valid : [loss = 2.238, top1 = 44.58%], test : [loss = 2.256, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.405, top1 = 85.81%], valid : [loss = 0.537, top1 = 81.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  938/15625) 000938-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.526, top1 = 89.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.95 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.344, top1 = 92.92%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.73 ms.
cifar100       train : [loss = 0.088, top1 = 98.45%], valid : [loss = 1.338, top1 = 69.65%], test : [loss = 1.322, top1 = 69.49%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 1.629, top1 = 56.19%], valid : [loss = 2.172, top1 = 44.56%], test : [loss = 2.170, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.84%], valid : [loss = 0.693, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  939/15625) 000939-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.94 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.10 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.15 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  940/15625) 000940-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.17%], valid : [loss = 0.452, top1 = 86.13%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.05 ms.
cifar10        train : [loss = 0.158, top1 = 94.81%], test  : [loss = 0.346, top1 = 88.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.12 ms.
cifar100       train : [loss = 1.014, top1 = 71.13%], valid : [loss = 1.372, top1 = 61.39%], test : [loss = 1.374, top1 = 61.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.72%], valid : [loss = 2.695, top1 = 33.00%], test : [loss = 2.713, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  941/15625) 000941-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.340, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.53 ms.
cifar100       train : [loss = 0.346, top1 = 90.64%], valid : [loss = 1.284, top1 = 67.14%], test : [loss = 1.266, top1 = 67.41%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.71%], valid : [loss = 2.409, top1 = 38.69%], test : [loss = 2.421, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  942/15625) 000942-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.64 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.61%], valid : [loss = 0.459, top1 = 86.52%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.76 ms.
cifar10        train : [loss = 0.120, top1 = 96.29%], test  : [loss = 0.333, top1 = 89.56%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.35 ms.
cifar100       train : [loss = 0.750, top1 = 79.16%], valid : [loss = 1.275, top1 = 64.84%], test : [loss = 1.279, top1 = 64.35%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.68%], valid : [loss = 2.584, top1 = 35.13%], test : [loss = 2.613, top1 = 34.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.70%], valid : [loss = 0.813, top1 = 71.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  943/15625) 000943-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.04%], valid : [loss = 0.701, top1 = 81.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10        train : [loss = 0.169, top1 = 94.15%], test  : [loss = 0.450, top1 = 86.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 1.008, top1 = 70.68%], valid : [loss = 1.647, top1 = 56.67%], test : [loss = 1.622, top1 = 56.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 3.149, top1 = 23.39%], valid : [loss = 3.202, top1 = 23.03%], test : [loss = 3.221, top1 = 22.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.78%], valid : [loss = 0.945, top1 = 66.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  944/15625) 000944-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.568, top1 = 88.88%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.27 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.380, top1 = 92.24%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.12 ms.
cifar100       train : [loss = 0.103, top1 = 98.16%], valid : [loss = 1.459, top1 = 67.38%], test : [loss = 1.468, top1 = 67.78%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.19 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.47%], valid : [loss = 2.446, top1 = 39.32%], test : [loss = 2.469, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.31%], valid : [loss = 0.685, top1 = 76.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  945/15625) 000945-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.568, top1 = 89.60%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.356, top1 = 93.03%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.16 ms.
cifar100       train : [loss = 0.042, top1 = 99.40%], valid : [loss = 1.407, top1 = 70.16%], test : [loss = 1.385, top1 = 70.13%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.81 ms.
ImageNet16-120 train : [loss = 1.602, top1 = 56.87%], valid : [loss = 2.274, top1 = 43.12%], test : [loss = 2.266, top1 = 43.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.78%], valid : [loss = 0.701, top1 = 75.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  946/15625) 000946-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.225, top1 = 92.42%], valid : [loss = 0.504, top1 = 84.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.192, top1 = 93.53%], test  : [loss = 0.385, top1 = 87.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.96 ms.
cifar100       train : [loss = 1.254, top1 = 64.52%], valid : [loss = 1.558, top1 = 57.81%], test : [loss = 1.545, top1 = 57.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 31.80%], valid : [loss = 2.774, top1 = 31.27%], test : [loss = 2.821, top1 = 30.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.36%], valid : [loss = 0.966, top1 = 65.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  947/15625) 000947-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.94%], valid : [loss = 0.775, top1 = 82.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.64 ms.
cifar10        train : [loss = 0.084, top1 = 97.32%], test  : [loss = 0.490, top1 = 86.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.69 ms.
cifar100       train : [loss = 0.826, top1 = 75.94%], valid : [loss = 1.573, top1 = 59.61%], test : [loss = 1.567, top1 = 59.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.799, top1 = 30.69%], valid : [loss = 2.923, top1 = 28.51%], test : [loss = 2.972, top1 = 28.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  948/15625) 000948-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.193, top1 = 93.50%], valid : [loss = 0.563, top1 = 83.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10        train : [loss = 0.206, top1 = 92.99%], test  : [loss = 0.400, top1 = 87.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.04 ms.
cifar100       train : [loss = 1.283, top1 = 63.48%], valid : [loss = 1.582, top1 = 56.49%], test : [loss = 1.578, top1 = 56.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.710, top1 = 32.34%], valid : [loss = 2.728, top1 = 32.04%], test : [loss = 2.784, top1 = 31.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 67.14%], valid : [loss = 0.965, top1 = 65.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  949/15625) 000949-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.101, top1 = 96.73%], valid : [loss = 0.760, top1 = 80.85%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.52 ms.
cifar10        train : [loss = 0.135, top1 = 95.38%], test  : [loss = 0.451, top1 = 86.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.03 ms.
cifar100       train : [loss = 0.858, top1 = 74.73%], valid : [loss = 1.602, top1 = 58.22%], test : [loss = 1.603, top1 = 58.57%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.956, top1 = 27.10%], valid : [loss = 3.023, top1 = 26.38%], test : [loss = 3.063, top1 = 25.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.12%], valid : [loss = 1.077, top1 = 61.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  950/15625) 000950-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.569, top1 = 87.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.42 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.397, top1 = 90.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.94 ms.
cifar100       train : [loss = 0.402, top1 = 88.58%], valid : [loss = 1.379, top1 = 65.54%], test : [loss = 1.412, top1 = 65.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.05%], valid : [loss = 2.525, top1 = 36.87%], test : [loss = 2.527, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  951/15625) 000951-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.550, top1 = 88.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.340, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.66 ms.
cifar100       train : [loss = 0.220, top1 = 94.29%], valid : [loss = 1.290, top1 = 67.95%], test : [loss = 1.292, top1 = 69.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.68%], valid : [loss = 2.275, top1 = 41.80%], test : [loss = 2.281, top1 = 42.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.27%], valid : [loss = 0.756, top1 = 73.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  952/15625) 000952-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.103, top1 = 96.72%], valid : [loss = 0.761, top1 = 80.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10        train : [loss = 0.150, top1 = 94.89%], test  : [loss = 0.500, top1 = 85.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.11 ms.
cifar100       train : [loss = 0.905, top1 = 73.68%], valid : [loss = 1.630, top1 = 57.65%], test : [loss = 1.615, top1 = 57.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.998, top1 = 26.26%], valid : [loss = 3.068, top1 = 25.78%], test : [loss = 3.115, top1 = 24.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.74%], valid : [loss = 1.018, top1 = 63.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  953/15625) 000953-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.92%], valid : [loss = 0.768, top1 = 82.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.088, top1 = 97.19%], test  : [loss = 0.488, top1 = 86.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.37 ms.
cifar100       train : [loss = 0.795, top1 = 76.84%], valid : [loss = 1.554, top1 = 59.97%], test : [loss = 1.517, top1 = 60.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 30.41%], valid : [loss = 2.950, top1 = 28.28%], test : [loss = 2.985, top1 = 28.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  954/15625) 000954-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10-valid  train : [loss = 1.841, top1 = 33.36%], valid : [loss = 1.859, top1 = 32.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 1.309, top1 = 52.80%], test  : [loss = 1.314, top1 = 52.32%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.05 ms.
cifar100       train : [loss = 3.800, top1 = 11.88%], valid : [loss = 3.903, top1 = 10.43%], test : [loss = 3.897, top1 = 10.91%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.20 ms.
ImageNet16-120 train : [loss = 3.949, top1 = 11.15%], valid : [loss = 3.939, top1 = 11.53%], test : [loss = 3.949, top1 = 11.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.58%], valid : [loss = 1.967, top1 = 27.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  955/15625) 000955-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.553, top1 = 88.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.369, top1 = 91.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.17 ms.
cifar100       train : [loss = 0.164, top1 = 96.53%], valid : [loss = 1.415, top1 = 67.71%], test : [loss = 1.424, top1 = 67.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.76%], valid : [loss = 2.419, top1 = 39.86%], test : [loss = 2.418, top1 = 39.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.11%], valid : [loss = 0.693, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  956/15625) 000956-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.30%], valid : [loss = 0.465, top1 = 86.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10        train : [loss = 0.154, top1 = 95.00%], test  : [loss = 0.343, top1 = 89.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 1.001, top1 = 71.39%], valid : [loss = 1.361, top1 = 62.14%], test : [loss = 1.356, top1 = 62.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.73%], valid : [loss = 2.687, top1 = 32.46%], test : [loss = 2.708, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  957/15625) 000957-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.15 ms.
cifar10-valid  train : [loss = 0.997, top1 = 64.78%], valid : [loss = 1.030, top1 = 63.95%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10        train : [loss = 0.903, top1 = 68.59%], test  : [loss = 0.900, top1 = 68.35%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.56 ms.
cifar100       train : [loss = 2.393, top1 = 38.81%], valid : [loss = 2.457, top1 = 37.36%], test : [loss = 2.448, top1 = 37.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.59 ms.
ImageNet16-120 train : [loss = 3.634, top1 = 15.93%], valid : [loss = 3.599, top1 = 16.80%], test : [loss = 3.641, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.604, top1 = 39.67%], valid : [loss = 1.620, top1 = 38.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  958/15625) 000958-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.501, top1 = 89.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.322, top1 = 92.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.92 ms.
cifar100       train : [loss = 0.194, top1 = 95.47%], valid : [loss = 1.279, top1 = 68.31%], test : [loss = 1.305, top1 = 68.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.48%], valid : [loss = 2.248, top1 = 42.64%], test : [loss = 2.264, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.02%], valid : [loss = 0.654, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  959/15625) 000959-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.470, top1 = 89.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.328, top1 = 92.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.38 ms.
cifar100       train : [loss = 0.104, top1 = 97.99%], valid : [loss = 1.416, top1 = 67.52%], test : [loss = 1.426, top1 = 68.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.31%], valid : [loss = 2.302, top1 = 41.94%], test : [loss = 2.349, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.32%], valid : [loss = 0.537, top1 = 81.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  960/15625) 000960-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.486, top1 = 89.56%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.67 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.313, top1 = 92.85%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.28 ms.
cifar100       train : [loss = 0.137, top1 = 97.26%], valid : [loss = 1.254, top1 = 69.59%], test : [loss = 1.270, top1 = 69.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 1.747, top1 = 53.34%], valid : [loss = 2.162, top1 = 44.73%], test : [loss = 2.192, top1 = 44.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.12%], valid : [loss = 0.668, top1 = 77.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  961/15625) 000961-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.473, top1 = 89.67%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.80 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.297, top1 = 92.64%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.16 ms.
cifar100       train : [loss = 0.248, top1 = 93.59%], valid : [loss = 1.230, top1 = 69.23%], test : [loss = 1.246, top1 = 69.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.87%], valid : [loss = 2.216, top1 = 42.71%], test : [loss = 2.251, top1 = 42.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.71%], valid : [loss = 0.611, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  962/15625) 000962-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.097, top1 = 96.85%], valid : [loss = 0.610, top1 = 84.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10        train : [loss = 0.096, top1 = 96.88%], test  : [loss = 0.416, top1 = 88.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.697, top1 = 79.62%], valid : [loss = 1.530, top1 = 60.66%], test : [loss = 1.505, top1 = 61.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 3.191, top1 = 22.21%], valid : [loss = 3.199, top1 = 22.00%], test : [loss = 3.233, top1 = 21.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 62.74%], valid : [loss = 1.065, top1 = 61.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  963/15625) 000963-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.365, top1 = 91.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.33 ms.
cifar100       train : [loss = 0.278, top1 = 92.48%], valid : [loss = 1.406, top1 = 66.63%], test : [loss = 1.386, top1 = 66.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.26 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.03%], valid : [loss = 2.396, top1 = 39.31%], test : [loss = 2.407, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.33%], valid : [loss = 0.599, top1 = 79.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  964/15625) 000964-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.313, top1 = 89.20%], valid : [loss = 0.567, top1 = 82.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10        train : [loss = 0.291, top1 = 89.96%], test  : [loss = 0.441, top1 = 85.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 1.467, top1 = 59.05%], valid : [loss = 1.705, top1 = 53.75%], test : [loss = 1.693, top1 = 54.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.999, top1 = 26.89%], valid : [loss = 2.989, top1 = 27.33%], test : [loss = 3.045, top1 = 26.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.10%], valid : [loss = 0.992, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  965/15625) 000965-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.548, top1 = 88.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.344, top1 = 92.21%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.57 ms.
cifar100       train : [loss = 0.188, top1 = 95.56%], valid : [loss = 1.334, top1 = 68.11%], test : [loss = 1.352, top1 = 67.83%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.27%], valid : [loss = 2.451, top1 = 37.46%], test : [loss = 2.470, top1 = 37.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.58%], valid : [loss = 0.855, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  966/15625) 000966-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.26%], valid : [loss = 0.485, top1 = 87.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.051, top1 = 98.54%], test  : [loss = 0.363, top1 = 90.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.90 ms.
cifar100       train : [loss = 0.539, top1 = 84.51%], valid : [loss = 1.232, top1 = 66.73%], test : [loss = 1.198, top1 = 67.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.149, top1 = 44.10%], valid : [loss = 2.357, top1 = 40.32%], test : [loss = 2.365, top1 = 40.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.71%], valid : [loss = 0.819, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  967/15625) 000967-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.63%], valid : [loss = 0.621, top1 = 84.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10        train : [loss = 0.093, top1 = 96.96%], test  : [loss = 0.417, top1 = 88.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 0.694, top1 = 79.59%], valid : [loss = 1.528, top1 = 60.69%], test : [loss = 1.526, top1 = 60.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 21.47%], valid : [loss = 3.236, top1 = 20.81%], test : [loss = 3.263, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 63.04%], valid : [loss = 1.057, top1 = 62.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  968/15625) 000968-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.55%], valid : [loss = 0.465, top1 = 86.15%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.65 ms.
cifar10        train : [loss = 0.150, top1 = 95.10%], test  : [loss = 0.340, top1 = 89.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.72 ms.
cifar100       train : [loss = 0.975, top1 = 72.30%], valid : [loss = 1.345, top1 = 62.23%], test : [loss = 1.339, top1 = 62.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 33.99%], valid : [loss = 2.672, top1 = 33.06%], test : [loss = 2.713, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.769, top1 = 72.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  969/15625) 000969-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.697, top1 = 84.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10        train : [loss = 0.054, top1 = 98.34%], test  : [loss = 0.446, top1 = 88.52%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.80 ms.
cifar100       train : [loss = 0.620, top1 = 81.74%], valid : [loss = 1.511, top1 = 61.89%], test : [loss = 1.466, top1 = 62.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.24%], valid : [loss = 2.840, top1 = 30.06%], test : [loss = 2.876, top1 = 29.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  970/15625) 000970-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.10%], valid : [loss = 0.475, top1 = 84.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.299, top1 = 89.99%], test  : [loss = 0.400, top1 = 86.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.41 ms.
cifar100       train : [loss = 1.328, top1 = 63.13%], valid : [loss = 1.531, top1 = 58.00%], test : [loss = 1.510, top1 = 58.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.60%], valid : [loss = 2.909, top1 = 29.90%], test : [loss = 2.959, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 74.93%], valid : [loss = 0.755, top1 = 73.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  971/15625) 000971-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.37%], valid : [loss = 0.529, top1 = 84.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.171, top1 = 94.33%], test  : [loss = 0.375, top1 = 88.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.80 ms.
cifar100       train : [loss = 1.193, top1 = 65.99%], valid : [loss = 1.519, top1 = 58.67%], test : [loss = 1.505, top1 = 58.91%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.61%], valid : [loss = 2.698, top1 = 32.72%], test : [loss = 2.730, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.20%], valid : [loss = 0.954, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  972/15625) 000972-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.507, top1 = 88.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10        train : [loss = 0.028, top1 = 99.20%], test  : [loss = 0.353, top1 = 91.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.63 ms.
cifar100       train : [loss = 0.472, top1 = 86.19%], valid : [loss = 1.360, top1 = 65.79%], test : [loss = 1.339, top1 = 65.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 40.12%], valid : [loss = 2.535, top1 = 36.26%], test : [loss = 2.556, top1 = 35.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.96%], valid : [loss = 0.663, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  973/15625) 000973-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.560, top1 = 88.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.364, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.12 ms.
cifar100       train : [loss = 0.176, top1 = 96.09%], valid : [loss = 1.391, top1 = 67.29%], test : [loss = 1.410, top1 = 66.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.70%], valid : [loss = 2.462, top1 = 38.40%], test : [loss = 2.461, top1 = 38.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  974/15625) 000974-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.99 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.23%], valid : [loss = 0.451, top1 = 87.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.37 ms.
cifar10        train : [loss = 0.113, top1 = 96.56%], test  : [loss = 0.328, top1 = 89.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.94 ms.
cifar100       train : [loss = 0.856, top1 = 75.69%], valid : [loss = 1.299, top1 = 64.31%], test : [loss = 1.275, top1 = 64.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.76%], valid : [loss = 2.625, top1 = 34.79%], test : [loss = 2.645, top1 = 34.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.09%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  975/15625) 000975-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.23%], valid : [loss = 0.463, top1 = 86.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.24 ms.
cifar10        train : [loss = 0.113, top1 = 96.49%], test  : [loss = 0.338, top1 = 89.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 0.864, top1 = 75.36%], valid : [loss = 1.294, top1 = 64.18%], test : [loss = 1.300, top1 = 63.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.98 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.65%], valid : [loss = 2.632, top1 = 34.17%], test : [loss = 2.670, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  976/15625) 000976-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.329, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.59 ms.
cifar100       train : [loss = 0.345, top1 = 90.55%], valid : [loss = 1.287, top1 = 67.00%], test : [loss = 1.294, top1 = 66.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.51%], valid : [loss = 2.415, top1 = 38.63%], test : [loss = 2.410, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.658, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  977/15625) 000977-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.430, top1 = 90.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.291, top1 = 92.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.35 ms.
cifar100       train : [loss = 0.181, top1 = 95.83%], valid : [loss = 1.278, top1 = 69.05%], test : [loss = 1.296, top1 = 69.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.04%], valid : [loss = 2.243, top1 = 42.52%], test : [loss = 2.282, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.91%], valid : [loss = 0.531, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  978/15625) 000978-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.28%], valid : [loss = 0.451, top1 = 87.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.331, top1 = 89.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.97 ms.
cifar100       train : [loss = 0.864, top1 = 75.41%], valid : [loss = 1.298, top1 = 63.99%], test : [loss = 1.272, top1 = 64.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.83%], valid : [loss = 2.612, top1 = 34.58%], test : [loss = 2.659, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.76%], valid : [loss = 0.649, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  979/15625) 000979-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.63%], valid : [loss = 0.614, top1 = 86.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.04 ms.
cifar10        train : [loss = 0.019, top1 = 99.44%], test  : [loss = 0.388, top1 = 91.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.08 ms.
cifar100       train : [loss = 0.367, top1 = 89.68%], valid : [loss = 1.476, top1 = 63.83%], test : [loss = 1.473, top1 = 63.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.735, top1 = 30.85%], valid : [loss = 2.806, top1 = 29.30%], test : [loss = 2.834, top1 = 28.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  980/15625) 000980-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.654, top1 = 86.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.420, top1 = 90.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.37 ms.
cifar100       train : [loss = 0.223, top1 = 94.50%], valid : [loss = 1.637, top1 = 63.70%], test : [loss = 1.658, top1 = 63.03%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.04%], valid : [loss = 2.491, top1 = 37.86%], test : [loss = 2.513, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 73.00%], valid : [loss = 0.824, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  981/15625) 000981-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.479, top1 = 89.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.320, top1 = 92.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.323, top1 = 91.26%], valid : [loss = 1.269, top1 = 67.57%], test : [loss = 1.276, top1 = 67.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.80%], valid : [loss = 2.310, top1 = 40.38%], test : [loss = 2.315, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.17%], valid : [loss = 0.600, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  982/15625) 000982-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.533, top1 = 89.55%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.349, top1 = 92.74%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.97 ms.
cifar100       train : [loss = 0.108, top1 = 97.86%], valid : [loss = 1.321, top1 = 69.41%], test : [loss = 1.343, top1 = 69.60%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.98 ms.
ImageNet16-120 train : [loss = 1.783, top1 = 52.58%], valid : [loss = 2.235, top1 = 43.12%], test : [loss = 2.246, top1 = 42.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.70%], valid : [loss = 0.703, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  983/15625) 000983-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.495, top1 = 90.08%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=22.08 ms.
cifar10        train : [loss = 0.002, top1 = 99.96%], test  : [loss = 0.313, top1 = 93.46%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.92 ms.
cifar100       train : [loss = 0.033, top1 = 99.66%], valid : [loss = 1.339, top1 = 70.99%], test : [loss = 1.352, top1 = 70.49%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=19.29 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.58%], valid : [loss = 2.283, top1 = 41.94%], test : [loss = 2.287, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.07%], valid : [loss = 0.651, top1 = 77.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  984/15625) 000984-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.652, top1 = 86.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10        train : [loss = 0.027, top1 = 99.25%], test  : [loss = 0.422, top1 = 89.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.333, top1 = 90.91%], valid : [loss = 1.609, top1 = 62.21%], test : [loss = 1.588, top1 = 62.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.14%], valid : [loss = 2.519, top1 = 37.02%], test : [loss = 2.555, top1 = 36.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.06%], valid : [loss = 0.820, top1 = 71.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  985/15625) 000985-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.573, top1 = 88.09%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.77 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.359, top1 = 91.96%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.66 ms.
cifar100       train : [loss = 0.156, top1 = 96.07%], valid : [loss = 1.423, top1 = 67.89%], test : [loss = 1.448, top1 = 67.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 33.92%], valid : [loss = 2.747, top1 = 30.68%], test : [loss = 2.755, top1 = 31.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.093, top1 = 59.80%], valid : [loss = 1.105, top1 = 59.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  986/15625) 000986-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.578, top1 = 87.12%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10        train : [loss = 0.025, top1 = 99.40%], test  : [loss = 0.406, top1 = 89.90%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.64 ms.
cifar100       train : [loss = 0.340, top1 = 90.99%], valid : [loss = 1.371, top1 = 65.76%], test : [loss = 1.370, top1 = 65.57%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.47%], valid : [loss = 2.531, top1 = 36.88%], test : [loss = 2.525, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.16%], valid : [loss = 0.727, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  987/15625) 000987-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.654, top1 = 86.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10        train : [loss = 0.020, top1 = 99.51%], test  : [loss = 0.441, top1 = 89.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.45 ms.
cifar100       train : [loss = 0.238, top1 = 93.92%], valid : [loss = 1.561, top1 = 64.25%], test : [loss = 1.574, top1 = 64.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.36%], valid : [loss = 2.545, top1 = 35.53%], test : [loss = 2.580, top1 = 35.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.26%], valid : [loss = 0.813, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  988/15625) 000988-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.291, top1 = 90.01%], valid : [loss = 0.550, top1 = 82.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10        train : [loss = 0.297, top1 = 89.75%], test  : [loss = 0.426, top1 = 85.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.08 ms.
cifar100       train : [loss = 1.289, top1 = 63.57%], valid : [loss = 1.565, top1 = 57.32%], test : [loss = 1.574, top1 = 57.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 3.072, top1 = 25.65%], valid : [loss = 3.072, top1 = 25.54%], test : [loss = 3.143, top1 = 24.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.40%], valid : [loss = 1.236, top1 = 55.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  989/15625) 000989-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.05%], valid : [loss = 0.598, top1 = 80.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.288, top1 = 90.06%], test  : [loss = 0.427, top1 = 85.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.48 ms.
cifar100       train : [loss = 1.471, top1 = 58.86%], valid : [loss = 1.712, top1 = 53.69%], test : [loss = 1.700, top1 = 53.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 3.024, top1 = 26.35%], valid : [loss = 3.030, top1 = 26.84%], test : [loss = 3.067, top1 = 25.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 66.01%], valid : [loss = 0.999, top1 = 64.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  990/15625) 000990-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.483, top1 = 89.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.77 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.311, top1 = 92.07%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.11 ms.
cifar100       train : [loss = 0.262, top1 = 93.25%], valid : [loss = 1.212, top1 = 69.02%], test : [loss = 1.234, top1 = 68.75%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.95%], valid : [loss = 2.214, top1 = 42.62%], test : [loss = 2.247, top1 = 42.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 82.04%], valid : [loss = 0.599, top1 = 79.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  991/15625) 000991-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.68 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.350, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.00 ms.
cifar100       train : [loss = 0.102, top1 = 98.29%], valid : [loss = 1.439, top1 = 67.91%], test : [loss = 1.420, top1 = 68.31%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.73 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.75%], valid : [loss = 2.357, top1 = 40.63%], test : [loss = 2.388, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.06%], valid : [loss = 0.695, top1 = 75.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  992/15625) 000992-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.531, top1 = 88.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.07 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.337, top1 = 91.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.24 ms.
cifar100       train : [loss = 0.346, top1 = 90.56%], valid : [loss = 1.285, top1 = 67.02%], test : [loss = 1.265, top1 = 67.17%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.69%], valid : [loss = 2.405, top1 = 38.60%], test : [loss = 2.414, top1 = 39.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  993/15625) 000993-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.520, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.333, top1 = 92.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.97 ms.
cifar100       train : [loss = 0.347, top1 = 90.55%], valid : [loss = 1.285, top1 = 67.22%], test : [loss = 1.283, top1 = 67.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.46%], valid : [loss = 2.408, top1 = 39.12%], test : [loss = 2.427, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  994/15625) 000994-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.64%], valid : [loss = 0.464, top1 = 86.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10        train : [loss = 0.151, top1 = 95.02%], test  : [loss = 0.340, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.66 ms.
cifar100       train : [loss = 0.969, top1 = 72.47%], valid : [loss = 1.344, top1 = 62.28%], test : [loss = 1.349, top1 = 62.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.23%], valid : [loss = 2.663, top1 = 33.04%], test : [loss = 2.696, top1 = 32.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  995/15625) 000995-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.076, top1 = 98.07%], valid : [loss = 0.464, top1 = 86.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10        train : [loss = 0.113, top1 = 96.56%], test  : [loss = 0.325, top1 = 89.74%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.34 ms.
cifar100       train : [loss = 0.861, top1 = 75.47%], valid : [loss = 1.293, top1 = 63.72%], test : [loss = 1.275, top1 = 64.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.60%], valid : [loss = 2.626, top1 = 33.93%], test : [loss = 2.655, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.676, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  996/15625) 000996-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.530, top1 = 89.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.38 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.328, top1 = 92.56%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.98 ms.
cifar100       train : [loss = 0.161, top1 = 96.50%], valid : [loss = 1.314, top1 = 68.62%], test : [loss = 1.315, top1 = 68.89%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.929, top1 = 49.14%], valid : [loss = 2.316, top1 = 41.08%], test : [loss = 2.311, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.57%], valid : [loss = 0.714, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  997/15625) 000997-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.130, top1 = 96.01%], valid : [loss = 0.468, top1 = 85.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10        train : [loss = 0.167, top1 = 94.48%], test  : [loss = 0.350, top1 = 88.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.82 ms.
cifar100       train : [loss = 0.991, top1 = 71.82%], valid : [loss = 1.355, top1 = 62.03%], test : [loss = 1.350, top1 = 62.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.61%], valid : [loss = 2.685, top1 = 32.81%], test : [loss = 2.731, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.49%], valid : [loss = 0.781, top1 = 72.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  998/15625) 000998-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.557, top1 = 89.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.20 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.362, top1 = 92.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.70 ms.
cifar100       train : [loss = 0.103, top1 = 98.12%], valid : [loss = 1.450, top1 = 68.17%], test : [loss = 1.464, top1 = 68.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.75%], valid : [loss = 2.443, top1 = 39.28%], test : [loss = 2.436, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (  999/15625) 000999-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.574, top1 = 88.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.393, top1 = 91.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.06 ms.
cifar100       train : [loss = 0.173, top1 = 96.24%], valid : [loss = 1.450, top1 = 66.44%], test : [loss = 1.452, top1 = 66.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.72%], valid : [loss = 2.438, top1 = 38.84%], test : [loss = 2.450, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.89%], valid : [loss = 0.693, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1000/15625) 001000-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.436, top1 = 90.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.293, top1 = 93.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.97 ms.
cifar100       train : [loss = 0.066, top1 = 99.04%], valid : [loss = 1.336, top1 = 70.19%], test : [loss = 1.300, top1 = 70.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 1.528, top1 = 58.59%], valid : [loss = 2.201, top1 = 44.21%], test : [loss = 2.243, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.44%], valid : [loss = 0.489, top1 = 83.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1001/15625) 001001-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.98%], valid : [loss = 0.531, top1 = 86.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.074, top1 = 97.65%], test  : [loss = 0.372, top1 = 89.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.14 ms.
cifar100       train : [loss = 0.713, top1 = 78.90%], valid : [loss = 1.351, top1 = 64.07%], test : [loss = 1.352, top1 = 64.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.524, top1 = 36.23%], valid : [loss = 2.650, top1 = 33.89%], test : [loss = 2.674, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.678, top1 = 76.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1002/15625) 001002-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.552, top1 = 88.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.02 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.348, top1 = 92.14%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.58 ms.
cifar100       train : [loss = 0.252, top1 = 93.20%], valid : [loss = 1.335, top1 = 67.49%], test : [loss = 1.334, top1 = 67.95%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.22%], valid : [loss = 2.442, top1 = 37.61%], test : [loss = 2.458, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.938, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1003/15625) 001003-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.24%], valid : [loss = 0.957, top1 = 67.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.790, top1 = 72.20%], test  : [loss = 0.876, top1 = 69.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.31 ms.
cifar100       train : [loss = 2.150, top1 = 43.67%], valid : [loss = 2.328, top1 = 40.71%], test : [loss = 2.356, top1 = 40.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 3.743, top1 = 14.28%], valid : [loss = 3.756, top1 = 14.98%], test : [loss = 3.779, top1 = 13.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.463, top1 = 46.40%], valid : [loss = 1.488, top1 = 45.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1004/15625) 001004-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.31%], valid : [loss = 0.931, top1 = 75.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.231, top1 = 92.08%], test  : [loss = 0.596, top1 = 82.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.163, top1 = 66.90%], valid : [loss = 1.759, top1 = 53.84%], test : [loss = 1.762, top1 = 54.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.62%], valid : [loss = 3.339, top1 = 21.51%], test : [loss = 3.375, top1 = 20.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.55%], valid : [loss = 1.073, top1 = 61.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1005/15625) 001005-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.53%], valid : [loss = 0.457, top1 = 86.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.65 ms.
cifar10        train : [loss = 0.151, top1 = 95.09%], test  : [loss = 0.339, top1 = 89.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.06 ms.
cifar100       train : [loss = 0.986, top1 = 71.97%], valid : [loss = 1.355, top1 = 62.48%], test : [loss = 1.351, top1 = 62.17%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.08%], valid : [loss = 2.668, top1 = 33.20%], test : [loss = 2.701, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1006/15625) 001006-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.324, top1 = 92.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.19 ms.
cifar100       train : [loss = 0.143, top1 = 97.05%], valid : [loss = 1.317, top1 = 68.47%], test : [loss = 1.285, top1 = 69.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.18%], valid : [loss = 2.292, top1 = 41.88%], test : [loss = 2.301, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.11%], valid : [loss = 0.792, top1 = 72.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1007/15625) 001007-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10-valid  train : [loss = 0.924, top1 = 67.25%], valid : [loss = 1.106, top1 = 62.23%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10        train : [loss = 0.872, top1 = 69.25%], test  : [loss = 0.941, top1 = 67.27%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.31 ms.
cifar100       train : [loss = 2.324, top1 = 39.77%], valid : [loss = 2.512, top1 = 36.99%], test : [loss = 2.518, top1 = 36.77%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.72 ms.
ImageNet16-120 train : [loss = 3.814, top1 = 13.15%], valid : [loss = 3.835, top1 = 13.44%], test : [loss = 3.846, top1 = 13.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.503, top1 = 44.78%], valid : [loss = 1.526, top1 = 44.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1008/15625) 001008-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.56%], valid : [loss = 0.696, top1 = 82.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10        train : [loss = 0.145, top1 = 95.07%], test  : [loss = 0.445, top1 = 86.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.17 ms.
cifar100       train : [loss = 0.983, top1 = 71.54%], valid : [loss = 1.623, top1 = 57.23%], test : [loss = 1.619, top1 = 57.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 3.094, top1 = 24.38%], valid : [loss = 3.150, top1 = 24.38%], test : [loss = 3.181, top1 = 23.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.75%], valid : [loss = 1.018, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1009/15625) 001009-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.539, top1 = 88.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.351, top1 = 91.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.56 ms.
cifar100       train : [loss = 0.435, top1 = 87.33%], valid : [loss = 1.234, top1 = 67.22%], test : [loss = 1.254, top1 = 66.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.51%], valid : [loss = 2.369, top1 = 39.63%], test : [loss = 2.386, top1 = 38.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.33%], valid : [loss = 0.802, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1010/15625) 001010-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.519, top1 = 89.16%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.98 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.327, top1 = 92.77%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.23 ms.
cifar100       train : [loss = 0.147, top1 = 96.93%], valid : [loss = 1.292, top1 = 68.93%], test : [loss = 1.281, top1 = 69.38%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.56%], valid : [loss = 2.304, top1 = 41.50%], test : [loss = 2.293, top1 = 42.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.45%], valid : [loss = 0.729, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1011/15625) 001011-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.572, top1 = 88.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.374, top1 = 92.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.37 ms.
cifar100       train : [loss = 0.166, top1 = 96.43%], valid : [loss = 1.408, top1 = 67.61%], test : [loss = 1.406, top1 = 67.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.34 ms.
ImageNet16-120 train : [loss = 1.969, top1 = 48.28%], valid : [loss = 2.475, top1 = 37.86%], test : [loss = 2.473, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.42%], valid : [loss = 0.712, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1012/15625) 001012-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.65%], valid : [loss = 0.461, top1 = 86.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10        train : [loss = 0.151, top1 = 95.09%], test  : [loss = 0.339, top1 = 89.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 0.967, top1 = 72.60%], valid : [loss = 1.343, top1 = 62.56%], test : [loss = 1.335, top1 = 62.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.05%], valid : [loss = 2.689, top1 = 32.82%], test : [loss = 2.698, top1 = 32.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1013/15625) 001013-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.470, top1 = 89.81%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.12 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.297, top1 = 93.03%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.37 ms.
cifar100       train : [loss = 0.153, top1 = 96.60%], valid : [loss = 1.244, top1 = 69.77%], test : [loss = 1.249, top1 = 69.35%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.52 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.37%], valid : [loss = 2.164, top1 = 44.74%], test : [loss = 2.156, top1 = 45.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.28%], valid : [loss = 0.647, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1014/15625) 001014-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.597, top1 = 86.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.027, top1 = 99.27%], test  : [loss = 0.389, top1 = 90.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.505, top1 = 85.24%], valid : [loss = 1.402, top1 = 64.32%], test : [loss = 1.395, top1 = 64.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.90%], valid : [loss = 2.537, top1 = 36.06%], test : [loss = 2.557, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.06%], valid : [loss = 0.820, top1 = 71.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1015/15625) 001015-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.620, top1 = 87.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.415, top1 = 90.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.05 ms.
cifar100       train : [loss = 0.139, top1 = 96.97%], valid : [loss = 1.610, top1 = 65.17%], test : [loss = 1.635, top1 = 64.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 44.07%], valid : [loss = 2.480, top1 = 37.90%], test : [loss = 2.499, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.72%], valid : [loss = 0.832, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1016/15625) 001016-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.606, top1 = 87.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.409, top1 = 91.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.203, top1 = 95.29%], valid : [loss = 1.443, top1 = 66.71%], test : [loss = 1.432, top1 = 67.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.25%], valid : [loss = 2.474, top1 = 37.87%], test : [loss = 2.500, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.87%], valid : [loss = 0.744, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1017/15625) 001017-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.32%], valid : [loss = 0.861, top1 = 71.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10        train : [loss = 0.553, top1 = 80.73%], test  : [loss = 0.711, top1 = 75.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.31 ms.
cifar100       train : [loss = 1.782, top1 = 51.99%], valid : [loss = 2.051, top1 = 47.17%], test : [loss = 2.063, top1 = 46.61%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.91%], valid : [loss = 3.630, top1 = 16.20%], test : [loss = 3.656, top1 = 15.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1018/15625) 001018-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.519, top1 = 88.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.321, top1 = 92.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 0.324, top1 = 91.28%], valid : [loss = 1.278, top1 = 67.37%], test : [loss = 1.293, top1 = 67.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.70%], valid : [loss = 2.414, top1 = 39.11%], test : [loss = 2.418, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1019/15625) 001019-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.650, top1 = 86.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.440, top1 = 90.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.54 ms.
cifar100       train : [loss = 0.231, top1 = 94.33%], valid : [loss = 1.492, top1 = 65.47%], test : [loss = 1.497, top1 = 65.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.20%], valid : [loss = 2.580, top1 = 36.12%], test : [loss = 2.615, top1 = 35.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.29%], valid : [loss = 0.766, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1020/15625) 001020-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.23%], valid : [loss = 0.470, top1 = 84.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.296, top1 = 90.17%], test  : [loss = 0.395, top1 = 86.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 1.323, top1 = 63.36%], valid : [loss = 1.540, top1 = 57.88%], test : [loss = 1.500, top1 = 58.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.72%], valid : [loss = 2.899, top1 = 29.41%], test : [loss = 2.960, top1 = 27.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1021/15625) 001021-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.533, top1 = 89.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.338, top1 = 92.68%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.71 ms.
cifar100       train : [loss = 0.116, top1 = 97.61%], valid : [loss = 1.322, top1 = 69.19%], test : [loss = 1.334, top1 = 69.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.39%], valid : [loss = 2.385, top1 = 39.33%], test : [loss = 2.385, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.45%], valid : [loss = 0.846, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1022/15625) 001022-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.62%], valid : [loss = 0.561, top1 = 87.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.366, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.75 ms.
cifar100       train : [loss = 0.514, top1 = 85.33%], valid : [loss = 1.349, top1 = 64.60%], test : [loss = 1.330, top1 = 65.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.07%], valid : [loss = 2.626, top1 = 33.69%], test : [loss = 2.669, top1 = 32.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1023/15625) 001023-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.505, top1 = 89.33%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.317, top1 = 92.69%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.93 ms.
cifar100       train : [loss = 0.144, top1 = 97.03%], valid : [loss = 1.291, top1 = 68.72%], test : [loss = 1.274, top1 = 69.85%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.81%], valid : [loss = 2.295, top1 = 41.40%], test : [loss = 2.285, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.07%], valid : [loss = 0.743, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1024/15625) 001024-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.532, top1 = 89.29%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.75 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.322, top1 = 93.10%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.17 ms.
cifar100       train : [loss = 0.080, top1 = 98.54%], valid : [loss = 1.392, top1 = 68.89%], test : [loss = 1.407, top1 = 69.15%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 45.80%], valid : [loss = 2.368, top1 = 40.03%], test : [loss = 2.373, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.00%], valid : [loss = 0.850, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1025/15625) 001025-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.521, top1 = 88.79%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10        train : [loss = 0.015, top1 = 99.59%], test  : [loss = 0.353, top1 = 91.85%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.38 ms.
cifar100       train : [loss = 0.294, top1 = 91.87%], valid : [loss = 1.357, top1 = 66.78%], test : [loss = 1.359, top1 = 66.57%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 1.950, top1 = 48.54%], valid : [loss = 2.269, top1 = 41.82%], test : [loss = 2.280, top1 = 41.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 77.94%], valid : [loss = 0.701, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1026/15625) 001026-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.155, top1 = 95.00%], valid : [loss = 0.912, top1 = 76.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.216, top1 = 92.52%], test  : [loss = 0.590, top1 = 82.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.44 ms.
cifar100       train : [loss = 1.159, top1 = 67.01%], valid : [loss = 1.821, top1 = 53.03%], test : [loss = 1.793, top1 = 53.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.87%], valid : [loss = 3.324, top1 = 22.26%], test : [loss = 3.355, top1 = 20.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.76%], valid : [loss = 1.087, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1027/15625) 001027-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.489, top1 = 90.19%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.304, top1 = 93.50%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.27 ms.
cifar100       train : [loss = 0.065, top1 = 99.13%], valid : [loss = 1.318, top1 = 70.22%], test : [loss = 1.315, top1 = 70.35%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.582, top1 = 57.39%], valid : [loss = 2.156, top1 = 45.16%], test : [loss = 2.166, top1 = 45.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 82.11%], valid : [loss = 0.613, top1 = 78.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1028/15625) 001028-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.35 ms.
cifar10-valid  train : [loss = 0.655, top1 = 77.05%], valid : [loss = 0.834, top1 = 71.73%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.91 ms.
cifar10        train : [loss = 0.660, top1 = 76.88%], test  : [loss = 0.751, top1 = 74.21%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 1.961, top1 = 47.89%], valid : [loss = 2.125, top1 = 44.85%], test : [loss = 2.159, top1 = 44.43%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.62 ms.
ImageNet16-120 train : [loss = 3.645, top1 = 15.82%], valid : [loss = 3.670, top1 = 16.27%], test : [loss = 3.685, top1 = 14.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1029/15625) 001029-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.35%], valid : [loss = 0.828, top1 = 79.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.136, top1 = 95.40%], test  : [loss = 0.549, top1 = 84.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 0.841, top1 = 75.59%], valid : [loss = 1.665, top1 = 57.97%], test : [loss = 1.667, top1 = 57.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.39%], valid : [loss = 3.177, top1 = 23.87%], test : [loss = 3.204, top1 = 23.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.77%], valid : [loss = 1.102, top1 = 60.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1030/15625) 001030-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.556, top1 = 88.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.386, top1 = 92.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.167, top1 = 96.40%], valid : [loss = 1.412, top1 = 67.05%], test : [loss = 1.445, top1 = 66.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.01%], valid : [loss = 2.466, top1 = 38.61%], test : [loss = 2.475, top1 = 39.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1031/15625) 001031-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.570, top1 = 87.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.45 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.391, top1 = 91.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.416, top1 = 88.17%], valid : [loss = 1.395, top1 = 65.23%], test : [loss = 1.380, top1 = 65.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.90 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.65%], valid : [loss = 2.515, top1 = 37.03%], test : [loss = 2.549, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.44%], valid : [loss = 0.782, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1032/15625) 001032-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.655, top1 = 85.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.80 ms.
cifar10        train : [loss = 0.038, top1 = 98.95%], test  : [loss = 0.431, top1 = 89.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 0.426, top1 = 88.25%], valid : [loss = 1.415, top1 = 64.34%], test : [loss = 1.405, top1 = 64.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.09%], valid : [loss = 2.650, top1 = 33.98%], test : [loss = 2.662, top1 = 34.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.29%], valid : [loss = 0.805, top1 = 72.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1033/15625) 001033-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.13%], valid : [loss = 0.578, top1 = 86.23%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.46 ms.
cifar10        train : [loss = 0.060, top1 = 98.05%], test  : [loss = 0.389, top1 = 89.47%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.45 ms.
cifar100       train : [loss = 0.524, top1 = 84.61%], valid : [loss = 1.363, top1 = 64.85%], test : [loss = 1.352, top1 = 65.17%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.323, top1 = 40.19%], valid : [loss = 2.489, top1 = 37.14%], test : [loss = 2.530, top1 = 36.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.31%], valid : [loss = 1.011, top1 = 63.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1034/15625) 001034-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.523, top1 = 89.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.97 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.334, top1 = 92.49%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.00 ms.
cifar100       train : [loss = 0.240, top1 = 93.98%], valid : [loss = 1.388, top1 = 66.04%], test : [loss = 1.382, top1 = 66.35%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.48%], valid : [loss = 2.426, top1 = 38.09%], test : [loss = 2.447, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 69.94%], valid : [loss = 0.888, top1 = 68.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1035/15625) 001035-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.292, top1 = 92.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.196, top1 = 95.43%], valid : [loss = 1.266, top1 = 69.47%], test : [loss = 1.250, top1 = 69.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.36%], valid : [loss = 2.231, top1 = 43.22%], test : [loss = 2.295, top1 = 42.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1036/15625) 001036-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.524, top1 = 88.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.356, top1 = 91.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.322, top1 = 90.92%], valid : [loss = 1.303, top1 = 67.15%], test : [loss = 1.316, top1 = 67.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.195, top1 = 43.08%], valid : [loss = 2.432, top1 = 38.21%], test : [loss = 2.453, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.21%], valid : [loss = 0.917, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1037/15625) 001037-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.584, top1 = 87.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.022, top1 = 99.34%], test  : [loss = 0.388, top1 = 90.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.93 ms.
cifar100       train : [loss = 0.346, top1 = 90.35%], valid : [loss = 1.456, top1 = 64.06%], test : [loss = 1.457, top1 = 64.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.860, top1 = 28.47%], valid : [loss = 2.921, top1 = 27.30%], test : [loss = 2.925, top1 = 27.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1038/15625) 001038-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.523, top1 = 88.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.318, top1 = 92.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.68 ms.
cifar100       train : [loss = 0.326, top1 = 91.22%], valid : [loss = 1.275, top1 = 67.45%], test : [loss = 1.289, top1 = 67.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.73%], valid : [loss = 2.412, top1 = 39.36%], test : [loss = 2.403, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1039/15625) 001039-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.65%], valid : [loss = 0.647, top1 = 78.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10        train : [loss = 0.510, top1 = 82.26%], test  : [loss = 0.589, top1 = 79.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.52 ms.
cifar100       train : [loss = 1.692, top1 = 54.11%], valid : [loss = 1.862, top1 = 50.50%], test : [loss = 1.882, top1 = 50.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.26%], valid : [loss = 3.310, top1 = 21.92%], test : [loss = 3.354, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.71%], valid : [loss = 1.305, top1 = 53.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1040/15625) 001040-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.483, top1 = 89.61%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.296, top1 = 92.84%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.27 ms.
cifar100       train : [loss = 0.232, top1 = 94.19%], valid : [loss = 1.256, top1 = 68.63%], test : [loss = 1.255, top1 = 68.86%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.35 ms.
ImageNet16-120 train : [loss = 1.850, top1 = 51.03%], valid : [loss = 2.203, top1 = 43.03%], test : [loss = 2.194, top1 = 43.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.79%], valid : [loss = 0.729, top1 = 74.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1041/15625) 001041-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.100, top1 = 96.98%], valid : [loss = 0.526, top1 = 85.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.114, top1 = 96.35%], test  : [loss = 0.369, top1 = 88.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.03 ms.
cifar100       train : [loss = 0.789, top1 = 77.28%], valid : [loss = 1.366, top1 = 62.61%], test : [loss = 1.362, top1 = 63.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.39%], valid : [loss = 2.598, top1 = 34.67%], test : [loss = 2.636, top1 = 34.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.00%], valid : [loss = 0.937, top1 = 67.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1042/15625) 001042-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.536, top1 = 89.16%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.355, top1 = 92.51%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.72 ms.
cifar100       train : [loss = 0.138, top1 = 97.07%], valid : [loss = 1.460, top1 = 66.45%], test : [loss = 1.462, top1 = 66.35%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 40.53%], valid : [loss = 2.498, top1 = 36.04%], test : [loss = 2.514, top1 = 35.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.31%], valid : [loss = 0.939, top1 = 66.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1043/15625) 001043-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.15%], valid : [loss = 0.572, top1 = 86.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10        train : [loss = 0.061, top1 = 98.03%], test  : [loss = 0.378, top1 = 89.79%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.11 ms.
cifar100       train : [loss = 0.644, top1 = 80.91%], valid : [loss = 1.316, top1 = 65.15%], test : [loss = 1.313, top1 = 64.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.24%], valid : [loss = 2.510, top1 = 36.39%], test : [loss = 2.536, top1 = 36.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.91%], valid : [loss = 0.871, top1 = 69.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1044/15625) 001044-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.488, top1 = 88.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.317, top1 = 91.47%], valid : [loss = 1.251, top1 = 67.88%], test : [loss = 1.245, top1 = 67.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.79%], valid : [loss = 2.305, top1 = 41.14%], test : [loss = 2.333, top1 = 41.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1045/15625) 001045-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.42%], valid : [loss = 0.520, top1 = 87.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.045, top1 = 98.78%], test  : [loss = 0.352, top1 = 90.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.68 ms.
cifar100       train : [loss = 0.495, top1 = 86.01%], valid : [loss = 1.305, top1 = 66.25%], test : [loss = 1.291, top1 = 66.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.03%], valid : [loss = 2.416, top1 = 38.97%], test : [loss = 2.442, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.74%], valid : [loss = 0.852, top1 = 70.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1046/15625) 001046-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.508, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.307, top1 = 93.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.124, top1 = 97.60%], valid : [loss = 1.297, top1 = 69.29%], test : [loss = 1.278, top1 = 69.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.50%], valid : [loss = 2.282, top1 = 42.16%], test : [loss = 2.260, top1 = 42.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1047/15625) 001047-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.68%], valid : [loss = 0.488, top1 = 86.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10        train : [loss = 0.097, top1 = 96.89%], test  : [loss = 0.345, top1 = 89.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.33 ms.
cifar100       train : [loss = 0.661, top1 = 81.11%], valid : [loss = 1.226, top1 = 66.21%], test : [loss = 1.218, top1 = 66.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.41%], valid : [loss = 2.439, top1 = 38.59%], test : [loss = 2.453, top1 = 38.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.73%], valid : [loss = 0.867, top1 = 69.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1048/15625) 001048-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.604, top1 = 87.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.39 ms.
cifar10        train : [loss = 0.018, top1 = 99.58%], test  : [loss = 0.423, top1 = 90.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.17 ms.
cifar100       train : [loss = 0.247, top1 = 93.79%], valid : [loss = 1.484, top1 = 65.57%], test : [loss = 1.484, top1 = 65.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.218, top1 = 42.85%], valid : [loss = 2.571, top1 = 36.06%], test : [loss = 2.585, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.41%], valid : [loss = 0.812, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1049/15625) 001049-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.35%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.36 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.297, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.80 ms.
cifar100       train : [loss = 0.218, top1 = 94.84%], valid : [loss = 1.210, top1 = 69.39%], test : [loss = 1.221, top1 = 69.15%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.76 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.99%], valid : [loss = 2.234, top1 = 42.69%], test : [loss = 2.233, top1 = 43.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.27%], valid : [loss = 0.624, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1050/15625) 001050-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.486, top1 = 89.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.328, top1 = 92.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.178, top1 = 95.82%], valid : [loss = 1.312, top1 = 68.90%], test : [loss = 1.306, top1 = 68.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.90%], valid : [loss = 2.295, top1 = 42.69%], test : [loss = 2.308, top1 = 42.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 84.95%], valid : [loss = 0.556, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1051/15625) 001051-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.08%], valid : [loss = 0.479, top1 = 84.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.296, top1 = 90.11%], test  : [loss = 0.394, top1 = 86.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.95 ms.
cifar100       train : [loss = 1.316, top1 = 63.39%], valid : [loss = 1.519, top1 = 58.12%], test : [loss = 1.502, top1 = 58.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.81%], valid : [loss = 2.896, top1 = 29.52%], test : [loss = 2.954, top1 = 28.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1052/15625) 001052-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.29%], valid : [loss = 0.584, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.106, top1 = 96.45%], test  : [loss = 0.389, top1 = 88.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 0.815, top1 = 76.00%], valid : [loss = 1.412, top1 = 62.47%], test : [loss = 1.406, top1 = 62.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 32.95%], valid : [loss = 2.765, top1 = 31.18%], test : [loss = 2.815, top1 = 31.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1053/15625) 001053-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.529, top1 = 89.81%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.329, top1 = 93.39%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.27 ms.
cifar100       train : [loss = 0.062, top1 = 99.05%], valid : [loss = 1.378, top1 = 70.33%], test : [loss = 1.387, top1 = 70.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.83 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.37%], valid : [loss = 2.209, top1 = 44.14%], test : [loss = 2.200, top1 = 44.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.16%], valid : [loss = 0.712, top1 = 75.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1054/15625) 001054-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.257, top1 = 91.31%], valid : [loss = 0.563, top1 = 82.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.243, top1 = 91.77%], test  : [loss = 0.413, top1 = 86.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 1.315, top1 = 62.74%], valid : [loss = 1.595, top1 = 56.50%], test : [loss = 1.598, top1 = 56.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.760, top1 = 31.30%], valid : [loss = 2.791, top1 = 30.91%], test : [loss = 2.838, top1 = 29.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.47%], valid : [loss = 0.983, top1 = 64.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1055/15625) 001055-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.542, top1 = 88.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.66 ms.
cifar10        train : [loss = 0.018, top1 = 99.51%], test  : [loss = 0.358, top1 = 91.54%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.81 ms.
cifar100       train : [loss = 0.202, top1 = 94.78%], valid : [loss = 1.395, top1 = 66.85%], test : [loss = 1.393, top1 = 67.61%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 2.089, top1 = 45.49%], valid : [loss = 2.369, top1 = 40.41%], test : [loss = 2.376, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.16%], valid : [loss = 0.937, top1 = 66.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1056/15625) 001056-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.20%], valid : [loss = 0.734, top1 = 75.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10        train : [loss = 0.471, top1 = 83.58%], test  : [loss = 0.546, top1 = 81.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.68 ms.
cifar100       train : [loss = 1.945, top1 = 46.89%], valid : [loss = 2.066, top1 = 44.11%], test : [loss = 2.077, top1 = 44.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 3.005, top1 = 26.55%], valid : [loss = 3.007, top1 = 27.24%], test : [loss = 3.025, top1 = 26.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.156, top1 = 58.27%], valid : [loss = 1.191, top1 = 57.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1057/15625) 001057-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.22 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.47%], valid : [loss = 0.857, top1 = 72.06%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.28 ms.
cifar10        train : [loss = 0.556, top1 = 80.60%], test  : [loss = 0.719, top1 = 75.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.31 ms.
cifar100       train : [loss = 1.770, top1 = 52.22%], valid : [loss = 2.036, top1 = 47.43%], test : [loss = 2.068, top1 = 46.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.08 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.89%], valid : [loss = 3.635, top1 = 16.22%], test : [loss = 3.658, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1058/15625) 001058-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.517, top1 = 89.70%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.323, top1 = 93.22%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.45 ms.
cifar100       train : [loss = 0.067, top1 = 99.00%], valid : [loss = 1.359, top1 = 69.64%], test : [loss = 1.352, top1 = 69.71%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 48.99%], valid : [loss = 2.368, top1 = 39.66%], test : [loss = 2.352, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.820, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1059/15625) 001059-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.450, top1 = 90.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.82 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.295, top1 = 93.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.33 ms.
cifar100       train : [loss = 0.114, top1 = 97.66%], valid : [loss = 1.368, top1 = 69.54%], test : [loss = 1.346, top1 = 70.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.686, top1 = 54.85%], valid : [loss = 2.263, top1 = 43.02%], test : [loss = 2.265, top1 = 43.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.26%], valid : [loss = 0.493, top1 = 83.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1060/15625) 001060-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.37%], valid : [loss = 0.591, top1 = 87.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.79 ms.
cifar10        train : [loss = 0.049, top1 = 98.48%], test  : [loss = 0.379, top1 = 90.30%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.40 ms.
cifar100       train : [loss = 0.501, top1 = 85.63%], valid : [loss = 1.305, top1 = 66.03%], test : [loss = 1.312, top1 = 65.61%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 2.211, top1 = 42.67%], valid : [loss = 2.438, top1 = 38.60%], test : [loss = 2.458, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 71.01%], valid : [loss = 0.872, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1061/15625) 001061-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.29%], valid : [loss = 0.474, top1 = 84.52%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.90 ms.
cifar10        train : [loss = 0.299, top1 = 90.05%], test  : [loss = 0.397, top1 = 86.60%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.18 ms.
cifar100       train : [loss = 1.322, top1 = 63.36%], valid : [loss = 1.525, top1 = 58.28%], test : [loss = 1.512, top1 = 58.47%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.42 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.81%], valid : [loss = 2.877, top1 = 29.97%], test : [loss = 2.947, top1 = 28.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1062/15625) 001062-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.12 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.499, top1 = 90.12%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.305, top1 = 93.64%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.38 ms.
cifar100       train : [loss = 0.038, top1 = 99.58%], valid : [loss = 1.350, top1 = 70.39%], test : [loss = 1.350, top1 = 70.38%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.67 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.05%], valid : [loss = 2.305, top1 = 41.71%], test : [loss = 2.306, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.36%], valid : [loss = 0.767, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1063/15625) 001063-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.33 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.41 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1064/15625) 001064-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.190, top1 = 93.77%], valid : [loss = 0.481, top1 = 84.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10        train : [loss = 0.237, top1 = 91.99%], test  : [loss = 0.404, top1 = 86.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.27 ms.
cifar100       train : [loss = 1.179, top1 = 66.80%], valid : [loss = 1.488, top1 = 58.71%], test : [loss = 1.486, top1 = 58.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 3.179, top1 = 23.31%], valid : [loss = 3.176, top1 = 23.34%], test : [loss = 3.202, top1 = 23.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.74%], valid : [loss = 1.039, top1 = 62.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1065/15625) 001065-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.58%], valid : [loss = 0.981, top1 = 80.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.047, top1 = 98.66%], test  : [loss = 0.647, top1 = 84.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.67 ms.
cifar100       train : [loss = 0.429, top1 = 88.19%], valid : [loss = 1.859, top1 = 57.50%], test : [loss = 1.864, top1 = 57.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 2.778, top1 = 31.43%], valid : [loss = 3.129, top1 = 25.11%], test : [loss = 3.157, top1 = 25.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.46%], valid : [loss = 1.035, top1 = 63.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1066/15625) 001066-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.521, top1 = 88.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.325, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.168, top1 = 96.26%], valid : [loss = 1.295, top1 = 68.39%], test : [loss = 1.298, top1 = 69.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.54%], valid : [loss = 2.306, top1 = 41.40%], test : [loss = 2.317, top1 = 41.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.88%], valid : [loss = 0.672, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1067/15625) 001067-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.590, top1 = 86.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.406, top1 = 90.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.485, top1 = 85.85%], valid : [loss = 1.393, top1 = 65.06%], test : [loss = 1.367, top1 = 65.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.358, top1 = 39.81%], valid : [loss = 2.524, top1 = 36.63%], test : [loss = 2.558, top1 = 36.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.07%], valid : [loss = 0.791, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1068/15625) 001068-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.346, top1 = 92.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.74 ms.
cifar100       train : [loss = 0.155, top1 = 96.39%], valid : [loss = 1.337, top1 = 68.47%], test : [loss = 1.338, top1 = 68.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.19%], valid : [loss = 2.286, top1 = 41.38%], test : [loss = 2.290, top1 = 42.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.49%], valid : [loss = 0.753, top1 = 73.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1069/15625) 001069-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.506, top1 = 89.99%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.60 ms.
cifar100       train : [loss = 0.121, top1 = 97.64%], valid : [loss = 1.329, top1 = 68.73%], test : [loss = 1.318, top1 = 69.47%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.684, top1 = 54.92%], valid : [loss = 2.177, top1 = 43.99%], test : [loss = 2.192, top1 = 44.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.70%], valid : [loss = 0.608, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1070/15625) 001070-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10-valid  train : [loss = 1.189, top1 = 57.60%], valid : [loss = 1.235, top1 = 56.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10        train : [loss = 1.121, top1 = 60.20%], test  : [loss = 1.118, top1 = 60.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.98 ms.
cifar100       train : [loss = 2.638, top1 = 33.50%], valid : [loss = 2.718, top1 = 32.26%], test : [loss = 2.701, top1 = 32.53%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.05 ms.
ImageNet16-120 train : [loss = 3.825, top1 = 13.10%], valid : [loss = 3.814, top1 = 13.80%], test : [loss = 3.832, top1 = 13.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.670, top1 = 37.32%], valid : [loss = 1.694, top1 = 35.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1071/15625) 001071-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.602, top1 = 86.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.024, top1 = 99.38%], test  : [loss = 0.393, top1 = 90.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.67 ms.
cifar100       train : [loss = 0.439, top1 = 87.29%], valid : [loss = 1.399, top1 = 65.59%], test : [loss = 1.399, top1 = 65.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.24%], valid : [loss = 2.493, top1 = 36.54%], test : [loss = 2.538, top1 = 36.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.82%], valid : [loss = 0.823, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1072/15625) 001072-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.19%], valid : [loss = 0.599, top1 = 85.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 0.068, top1 = 97.92%], test  : [loss = 0.408, top1 = 88.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 0.715, top1 = 79.23%], valid : [loss = 1.398, top1 = 63.16%], test : [loss = 1.376, top1 = 63.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.85%], valid : [loss = 2.656, top1 = 33.53%], test : [loss = 2.703, top1 = 33.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1073/15625) 001073-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.485, top1 = 89.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.314, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.33 ms.
cifar100       train : [loss = 0.135, top1 = 97.29%], valid : [loss = 1.274, top1 = 69.50%], test : [loss = 1.280, top1 = 69.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.13%], valid : [loss = 2.184, top1 = 43.88%], test : [loss = 2.202, top1 = 43.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.36%], valid : [loss = 0.595, top1 = 79.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1074/15625) 001074-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.501, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.359, top1 = 90.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.92 ms.
cifar100       train : [loss = 0.483, top1 = 85.88%], valid : [loss = 1.339, top1 = 65.61%], test : [loss = 1.338, top1 = 65.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.27%], valid : [loss = 2.524, top1 = 36.50%], test : [loss = 2.548, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.12%], valid : [loss = 0.628, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1075/15625) 001075-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.11%], valid : [loss = 0.572, top1 = 86.85%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10        train : [loss = 0.062, top1 = 98.01%], test  : [loss = 0.372, top1 = 89.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.03 ms.
cifar100       train : [loss = 0.648, top1 = 80.93%], valid : [loss = 1.309, top1 = 65.05%], test : [loss = 1.317, top1 = 65.23%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 2.362, top1 = 39.49%], valid : [loss = 2.501, top1 = 36.50%], test : [loss = 2.521, top1 = 35.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.08%], valid : [loss = 0.761, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1076/15625) 001076-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.253, top1 = 91.33%], valid : [loss = 0.529, top1 = 83.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10        train : [loss = 0.256, top1 = 91.21%], test  : [loss = 0.403, top1 = 86.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.79 ms.
cifar100       train : [loss = 1.409, top1 = 60.63%], valid : [loss = 1.668, top1 = 54.73%], test : [loss = 1.644, top1 = 55.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.930, top1 = 28.19%], valid : [loss = 2.949, top1 = 27.96%], test : [loss = 3.017, top1 = 27.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.74%], valid : [loss = 1.002, top1 = 64.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1077/15625) 001077-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.517, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.335, top1 = 92.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.46 ms.
cifar100       train : [loss = 0.334, top1 = 90.93%], valid : [loss = 1.283, top1 = 66.76%], test : [loss = 1.276, top1 = 67.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.93%], valid : [loss = 2.395, top1 = 39.07%], test : [loss = 2.401, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1078/15625) 001078-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.490, top1 = 89.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.302, top1 = 93.26%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.19 ms.
cifar100       train : [loss = 0.128, top1 = 97.45%], valid : [loss = 1.310, top1 = 69.32%], test : [loss = 1.298, top1 = 69.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 1.784, top1 = 52.60%], valid : [loss = 2.238, top1 = 42.17%], test : [loss = 2.277, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 81.00%], valid : [loss = 0.629, top1 = 78.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1079/15625) 001079-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.453, top1 = 90.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.319, top1 = 92.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.51 ms.
cifar100       train : [loss = 0.144, top1 = 96.87%], valid : [loss = 1.422, top1 = 68.14%], test : [loss = 1.419, top1 = 68.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.68%], valid : [loss = 2.366, top1 = 40.00%], test : [loss = 2.370, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.40%], valid : [loss = 0.537, top1 = 81.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1080/15625) 001080-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.518, top1 = 89.67%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.68 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.331, top1 = 93.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.07 ms.
cifar100       train : [loss = 0.033, top1 = 99.68%], valid : [loss = 1.433, top1 = 70.08%], test : [loss = 1.428, top1 = 69.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 1.552, top1 = 58.24%], valid : [loss = 2.373, top1 = 41.77%], test : [loss = 2.408, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.38%], valid : [loss = 0.707, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1081/15625) 001081-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.61%], valid : [loss = 0.648, top1 = 78.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10        train : [loss = 0.526, top1 = 81.74%], test  : [loss = 0.606, top1 = 79.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.28 ms.
cifar100       train : [loss = 1.732, top1 = 53.10%], valid : [loss = 1.870, top1 = 50.10%], test : [loss = 1.891, top1 = 50.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.30%], valid : [loss = 3.292, top1 = 20.93%], test : [loss = 3.325, top1 = 21.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1082/15625) 001082-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.79%], valid : [loss = 0.718, top1 = 83.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.26 ms.
cifar10        train : [loss = 0.090, top1 = 97.02%], test  : [loss = 0.459, top1 = 87.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.64 ms.
cifar100       train : [loss = 0.848, top1 = 75.41%], valid : [loss = 1.586, top1 = 58.66%], test : [loss = 1.567, top1 = 59.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.99 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 30.45%], valid : [loss = 2.941, top1 = 28.60%], test : [loss = 2.972, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.89%], valid : [loss = 0.869, top1 = 69.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1083/15625) 001083-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.93%], valid : [loss = 0.873, top1 = 77.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.97 ms.
cifar10        train : [loss = 0.189, top1 = 93.54%], test  : [loss = 0.584, top1 = 83.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.18 ms.
cifar100       train : [loss = 1.028, top1 = 70.64%], valid : [loss = 1.767, top1 = 55.38%], test : [loss = 1.751, top1 = 55.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.110, top1 = 25.05%], valid : [loss = 3.238, top1 = 23.10%], test : [loss = 3.268, top1 = 22.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.82%], valid : [loss = 1.198, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1084/15625) 001084-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.476, top1 = 89.64%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.61 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.286, top1 = 93.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.32 ms.
cifar100       train : [loss = 0.115, top1 = 97.87%], valid : [loss = 1.257, top1 = 69.54%], test : [loss = 1.262, top1 = 69.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.42 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.68%], valid : [loss = 2.182, top1 = 44.07%], test : [loss = 2.180, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.44%], valid : [loss = 0.577, top1 = 80.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1085/15625) 001085-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.89%], valid : [loss = 0.851, top1 = 71.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 0.563, top1 = 80.41%], test  : [loss = 0.719, top1 = 75.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 1.790, top1 = 51.90%], valid : [loss = 2.053, top1 = 46.89%], test : [loss = 2.066, top1 = 46.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.76%], valid : [loss = 3.633, top1 = 16.60%], test : [loss = 3.668, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1086/15625) 001086-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.516, top1 = 89.57%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.335, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.99 ms.
cifar100       train : [loss = 0.099, top1 = 98.15%], valid : [loss = 1.361, top1 = 68.86%], test : [loss = 1.359, top1 = 69.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.57 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.12%], valid : [loss = 2.322, top1 = 41.20%], test : [loss = 2.328, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 66.00%], valid : [loss = 0.969, top1 = 65.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1087/15625) 001087-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.93%], valid : [loss = 0.870, top1 = 71.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10        train : [loss = 0.552, top1 = 80.74%], test  : [loss = 0.711, top1 = 75.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.55 ms.
cifar100       train : [loss = 1.789, top1 = 51.81%], valid : [loss = 2.086, top1 = 45.88%], test : [loss = 2.094, top1 = 46.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.86%], valid : [loss = 3.631, top1 = 16.63%], test : [loss = 3.663, top1 = 15.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1088/15625) 001088-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.459, top1 = 89.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.311, top1 = 92.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.11 ms.
cifar100       train : [loss = 0.203, top1 = 95.06%], valid : [loss = 1.346, top1 = 68.29%], test : [loss = 1.318, top1 = 68.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.63%], valid : [loss = 2.306, top1 = 41.86%], test : [loss = 2.330, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.74%], valid : [loss = 0.578, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1089/15625) 001089-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.496, top1 = 88.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.332, top1 = 91.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.272, top1 = 92.83%], valid : [loss = 1.290, top1 = 67.88%], test : [loss = 1.299, top1 = 67.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.59%], valid : [loss = 2.295, top1 = 40.93%], test : [loss = 2.333, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.35%], valid : [loss = 0.627, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1090/15625) 001090-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.44%], valid : [loss = 0.469, top1 = 87.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10        train : [loss = 0.069, top1 = 98.10%], test  : [loss = 0.319, top1 = 90.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.60 ms.
cifar100       train : [loss = 0.635, top1 = 82.45%], valid : [loss = 1.284, top1 = 65.14%], test : [loss = 1.246, top1 = 65.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 40.08%], valid : [loss = 2.491, top1 = 36.97%], test : [loss = 2.526, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.29%], valid : [loss = 0.619, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1091/15625) 001091-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.32%], valid : [loss = 0.454, top1 = 86.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.155, top1 = 94.95%], test  : [loss = 0.344, top1 = 88.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.68 ms.
cifar100       train : [loss = 1.014, top1 = 71.27%], valid : [loss = 1.360, top1 = 62.07%], test : [loss = 1.378, top1 = 61.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.57%], valid : [loss = 2.695, top1 = 32.51%], test : [loss = 2.731, top1 = 32.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1092/15625) 001092-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.94%], valid : [loss = 0.642, top1 = 78.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.43 ms.
cifar10        train : [loss = 0.511, top1 = 82.26%], test  : [loss = 0.594, top1 = 79.45%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.06 ms.
cifar100       train : [loss = 1.718, top1 = 53.31%], valid : [loss = 1.890, top1 = 49.94%], test : [loss = 1.885, top1 = 50.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 21.11%], valid : [loss = 3.318, top1 = 21.80%], test : [loss = 3.350, top1 = 21.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.14%], valid : [loss = 1.299, top1 = 53.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1093/15625) 001093-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.84%], valid : [loss = 0.559, top1 = 88.43%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.340, top1 = 92.54%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.43 ms.
cifar100       train : [loss = 0.147, top1 = 96.50%], valid : [loss = 1.533, top1 = 66.20%], test : [loss = 1.575, top1 = 65.40%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 32.65%], valid : [loss = 2.822, top1 = 30.13%], test : [loss = 2.824, top1 = 29.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.246, top1 = 54.69%], valid : [loss = 1.258, top1 = 54.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1094/15625) 001094-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.26%], valid : [loss = 0.869, top1 = 79.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.136, top1 = 95.38%], test  : [loss = 0.529, top1 = 84.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.51 ms.
cifar100       train : [loss = 0.846, top1 = 75.36%], valid : [loss = 1.680, top1 = 57.68%], test : [loss = 1.687, top1 = 57.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 3.018, top1 = 26.74%], valid : [loss = 3.164, top1 = 24.33%], test : [loss = 3.185, top1 = 24.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1095/15625) 001095-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.08%], valid : [loss = 0.575, top1 = 86.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=17.44 ms.
cifar10        train : [loss = 0.062, top1 = 97.99%], test  : [loss = 0.363, top1 = 90.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.73 ms.
cifar100       train : [loss = 0.654, top1 = 80.78%], valid : [loss = 1.332, top1 = 64.12%], test : [loss = 1.350, top1 = 63.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.370, top1 = 39.24%], valid : [loss = 2.495, top1 = 36.93%], test : [loss = 2.530, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1096/15625) 001096-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.521, top1 = 88.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.342, top1 = 91.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.93 ms.
cifar100       train : [loss = 0.331, top1 = 90.94%], valid : [loss = 1.292, top1 = 68.18%], test : [loss = 1.282, top1 = 68.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.56%], valid : [loss = 2.428, top1 = 38.60%], test : [loss = 2.423, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.22%], valid : [loss = 0.657, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1097/15625) 001097-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.59%], valid : [loss = 0.525, top1 = 83.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10        train : [loss = 0.240, top1 = 91.82%], test  : [loss = 0.394, top1 = 87.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 1.358, top1 = 61.83%], valid : [loss = 1.614, top1 = 56.13%], test : [loss = 1.603, top1 = 56.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.882, top1 = 29.12%], valid : [loss = 2.890, top1 = 29.27%], test : [loss = 2.946, top1 = 27.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.37%], valid : [loss = 0.997, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1098/15625) 001098-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.27%], valid : [loss = 0.462, top1 = 85.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10        train : [loss = 0.154, top1 = 95.03%], test  : [loss = 0.341, top1 = 89.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.35 ms.
cifar100       train : [loss = 1.011, top1 = 71.15%], valid : [loss = 1.384, top1 = 61.24%], test : [loss = 1.368, top1 = 61.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.73%], valid : [loss = 2.668, top1 = 33.23%], test : [loss = 2.719, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1099/15625) 001099-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.505, top1 = 88.52%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.319, top1 = 92.24%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.01 ms.
cifar100       train : [loss = 0.335, top1 = 90.95%], valid : [loss = 1.287, top1 = 67.56%], test : [loss = 1.296, top1 = 67.14%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.56%], valid : [loss = 2.404, top1 = 38.73%], test : [loss = 2.432, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1100/15625) 001100-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.15%], valid : [loss = 0.564, top1 = 86.77%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.89 ms.
cifar10        train : [loss = 0.063, top1 = 97.98%], test  : [loss = 0.381, top1 = 89.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.21 ms.
cifar100       train : [loss = 0.653, top1 = 80.73%], valid : [loss = 1.344, top1 = 64.37%], test : [loss = 1.320, top1 = 64.66%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.06%], valid : [loss = 2.522, top1 = 35.93%], test : [loss = 2.548, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.65%], valid : [loss = 0.854, top1 = 70.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1101/15625) 001101-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.58%], valid : [loss = 0.605, top1 = 86.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.036, top1 = 99.00%], test  : [loss = 0.381, top1 = 90.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.12 ms.
cifar100       train : [loss = 0.549, top1 = 83.95%], valid : [loss = 1.459, top1 = 62.74%], test : [loss = 1.447, top1 = 63.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.45%], valid : [loss = 2.584, top1 = 34.47%], test : [loss = 2.588, top1 = 34.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.70%], valid : [loss = 0.887, top1 = 68.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1102/15625) 001102-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.551, top1 = 88.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.373, top1 = 91.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.26 ms.
cifar100       train : [loss = 0.213, top1 = 94.71%], valid : [loss = 1.497, top1 = 65.62%], test : [loss = 1.448, top1 = 66.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.75%], valid : [loss = 2.415, top1 = 39.80%], test : [loss = 2.429, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.33%], valid : [loss = 0.736, top1 = 74.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1103/15625) 001103-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.180, top1 = 93.97%], valid : [loss = 0.537, top1 = 84.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10        train : [loss = 0.179, top1 = 93.97%], test  : [loss = 0.385, top1 = 87.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 1.215, top1 = 65.54%], valid : [loss = 1.525, top1 = 57.93%], test : [loss = 1.509, top1 = 58.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.94%], valid : [loss = 2.676, top1 = 33.19%], test : [loss = 2.734, top1 = 32.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 66.86%], valid : [loss = 0.962, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1104/15625) 001104-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.26%], valid : [loss = 0.612, top1 = 84.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10        train : [loss = 0.092, top1 = 96.95%], test  : [loss = 0.424, top1 = 88.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.95 ms.
cifar100       train : [loss = 0.723, top1 = 78.57%], valid : [loss = 1.559, top1 = 60.26%], test : [loss = 1.558, top1 = 59.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 3.162, top1 = 23.00%], valid : [loss = 3.184, top1 = 23.23%], test : [loss = 3.195, top1 = 22.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1105/15625) 001105-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.62 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.314, top1 = 93.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.24 ms.
cifar100       train : [loss = 0.132, top1 = 97.28%], valid : [loss = 1.284, top1 = 69.76%], test : [loss = 1.314, top1 = 68.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.53%], valid : [loss = 2.277, top1 = 43.40%], test : [loss = 2.258, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1106/15625) 001106-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.66%], valid : [loss = 0.570, top1 = 82.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.264, top1 = 90.98%], test  : [loss = 0.412, top1 = 86.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 1.527, top1 = 57.36%], valid : [loss = 1.757, top1 = 52.40%], test : [loss = 1.746, top1 = 52.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.946, top1 = 27.75%], valid : [loss = 2.950, top1 = 27.72%], test : [loss = 3.012, top1 = 26.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.56%], valid : [loss = 1.024, top1 = 63.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1107/15625) 001107-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.70 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.93%], valid : [loss = 0.867, top1 = 71.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.95 ms.
cifar10        train : [loss = 0.569, top1 = 80.10%], test  : [loss = 0.730, top1 = 75.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.57 ms.
cifar100       train : [loss = 1.777, top1 = 52.21%], valid : [loss = 2.055, top1 = 46.85%], test : [loss = 2.049, top1 = 46.72%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.84 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.67%], valid : [loss = 3.647, top1 = 16.49%], test : [loss = 3.675, top1 = 15.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1108/15625) 001108-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.38%], valid : [loss = 0.476, top1 = 85.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.80 ms.
cifar10        train : [loss = 0.145, top1 = 95.31%], test  : [loss = 0.353, top1 = 88.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.05 ms.
cifar100       train : [loss = 0.819, top1 = 76.96%], valid : [loss = 1.304, top1 = 64.34%], test : [loss = 1.298, top1 = 63.04%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.45%], valid : [loss = 2.716, top1 = 31.60%], test : [loss = 2.724, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.118, top1 = 59.58%], valid : [loss = 1.120, top1 = 59.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1109/15625) 001109-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.63%], valid : [loss = 0.617, top1 = 84.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.76 ms.
cifar10        train : [loss = 0.097, top1 = 96.75%], test  : [loss = 0.418, top1 = 88.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.63 ms.
cifar100       train : [loss = 0.687, top1 = 79.87%], valid : [loss = 1.530, top1 = 60.60%], test : [loss = 1.505, top1 = 60.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 3.148, top1 = 23.05%], valid : [loss = 3.148, top1 = 23.93%], test : [loss = 3.190, top1 = 21.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1110/15625) 001110-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.66%], valid : [loss = 0.489, top1 = 84.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.299, top1 = 89.96%], test  : [loss = 0.399, top1 = 86.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 1.335, top1 = 63.22%], valid : [loss = 1.546, top1 = 57.56%], test : [loss = 1.506, top1 = 58.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.76%], valid : [loss = 2.909, top1 = 29.07%], test : [loss = 2.945, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1111/15625) 001111-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.75%], valid : [loss = 0.525, top1 = 82.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10        train : [loss = 0.393, top1 = 86.60%], test  : [loss = 0.463, top1 = 84.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 1.536, top1 = 57.79%], valid : [loss = 1.649, top1 = 54.53%], test : [loss = 1.648, top1 = 54.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.18 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.41%], valid : [loss = 3.014, top1 = 27.45%], test : [loss = 3.057, top1 = 25.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 60.45%], valid : [loss = 1.137, top1 = 59.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1112/15625) 001112-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.475, top1 = 88.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.328, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 0.321, top1 = 91.37%], valid : [loss = 1.222, top1 = 68.56%], test : [loss = 1.234, top1 = 68.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.37%], valid : [loss = 2.340, top1 = 40.80%], test : [loss = 2.357, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1113/15625) 001113-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.51%], valid : [loss = 0.439, top1 = 87.81%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.49 ms.
cifar10        train : [loss = 0.058, top1 = 98.55%], test  : [loss = 0.317, top1 = 90.70%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.11 ms.
cifar100       train : [loss = 0.560, top1 = 84.77%], valid : [loss = 1.200, top1 = 67.62%], test : [loss = 1.174, top1 = 67.44%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.70%], valid : [loss = 2.435, top1 = 38.83%], test : [loss = 2.450, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.94%], valid : [loss = 0.675, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1114/15625) 001114-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.425, top1 = 91.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.003, top1 = 99.99%], test  : [loss = 0.282, top1 = 93.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.07 ms.
cifar100       train : [loss = 0.066, top1 = 99.02%], valid : [loss = 1.347, top1 = 70.58%], test : [loss = 1.324, top1 = 70.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 1.545, top1 = 58.22%], valid : [loss = 2.234, top1 = 43.73%], test : [loss = 2.262, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1115/15625) 001115-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.65%], valid : [loss = 0.566, top1 = 88.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10        train : [loss = 0.017, top1 = 99.52%], test  : [loss = 0.369, top1 = 91.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.02 ms.
cifar100       train : [loss = 0.262, top1 = 92.64%], valid : [loss = 1.361, top1 = 67.06%], test : [loss = 1.379, top1 = 67.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.75%], valid : [loss = 2.505, top1 = 35.07%], test : [loss = 2.546, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 66.80%], valid : [loss = 0.970, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1116/15625) 001116-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.02%], valid : [loss = 0.850, top1 = 72.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10        train : [loss = 0.565, top1 = 80.22%], test  : [loss = 0.723, top1 = 75.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.86 ms.
cifar100       train : [loss = 1.790, top1 = 51.97%], valid : [loss = 2.069, top1 = 46.55%], test : [loss = 2.075, top1 = 46.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.70%], valid : [loss = 3.643, top1 = 16.62%], test : [loss = 3.662, top1 = 15.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1117/15625) 001117-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.62%], valid : [loss = 0.468, top1 = 86.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.53 ms.
cifar10        train : [loss = 0.126, top1 = 95.97%], test  : [loss = 0.342, top1 = 89.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.57 ms.
cifar100       train : [loss = 0.740, top1 = 79.30%], valid : [loss = 1.262, top1 = 64.94%], test : [loss = 1.256, top1 = 65.34%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.24%], valid : [loss = 2.617, top1 = 34.27%], test : [loss = 2.642, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.18%], valid : [loss = 0.819, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1118/15625) 001118-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.51%], valid : [loss = 0.867, top1 = 71.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10        train : [loss = 0.544, top1 = 80.98%], test  : [loss = 0.694, top1 = 76.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.42 ms.
cifar100       train : [loss = 1.763, top1 = 52.61%], valid : [loss = 2.047, top1 = 47.08%], test : [loss = 2.048, top1 = 47.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.85%], valid : [loss = 3.658, top1 = 15.10%], test : [loss = 3.662, top1 = 16.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1119/15625) 001119-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.69%], valid : [loss = 0.716, top1 = 75.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.41 ms.
cifar10        train : [loss = 0.561, top1 = 80.66%], test  : [loss = 0.621, top1 = 78.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 1.952, top1 = 47.66%], valid : [loss = 2.091, top1 = 44.93%], test : [loss = 2.078, top1 = 45.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.34%], valid : [loss = 3.218, top1 = 22.73%], test : [loss = 3.245, top1 = 22.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.88%], valid : [loss = 1.336, top1 = 52.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1120/15625) 001120-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.513, top1 = 89.84%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.17 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.304, top1 = 93.23%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.49 ms.
cifar100       train : [loss = 0.066, top1 = 98.84%], valid : [loss = 1.299, top1 = 70.56%], test : [loss = 1.294, top1 = 71.14%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.61 ms.
ImageNet16-120 train : [loss = 1.585, top1 = 57.31%], valid : [loss = 2.129, top1 = 45.93%], test : [loss = 2.180, top1 = 45.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.04%], valid : [loss = 0.653, top1 = 77.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1121/15625) 001121-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.549, top1 = 88.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.95 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.358, top1 = 91.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.33 ms.
cifar100       train : [loss = 0.430, top1 = 87.37%], valid : [loss = 1.260, top1 = 67.08%], test : [loss = 1.274, top1 = 67.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.68%], valid : [loss = 2.379, top1 = 39.53%], test : [loss = 2.399, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.21%], valid : [loss = 0.855, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1122/15625) 001122-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.38%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.336, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.27 ms.
cifar100       train : [loss = 0.134, top1 = 97.16%], valid : [loss = 1.325, top1 = 69.08%], test : [loss = 1.336, top1 = 68.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.41 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 51.97%], valid : [loss = 2.224, top1 = 42.83%], test : [loss = 2.229, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.49%], valid : [loss = 0.683, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1123/15625) 001123-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.81%], valid : [loss = 0.614, top1 = 85.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10        train : [loss = 0.082, top1 = 97.40%], test  : [loss = 0.377, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.13 ms.
cifar100       train : [loss = 0.773, top1 = 77.16%], valid : [loss = 1.424, top1 = 62.44%], test : [loss = 1.394, top1 = 62.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.603, top1 = 34.53%], valid : [loss = 2.719, top1 = 32.63%], test : [loss = 2.738, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.16%], valid : [loss = 0.835, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1124/15625) 001124-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.58%], valid : [loss = 0.640, top1 = 86.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.036, top1 = 98.98%], test  : [loss = 0.387, top1 = 90.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.72 ms.
cifar100       train : [loss = 0.529, top1 = 84.51%], valid : [loss = 1.431, top1 = 63.40%], test : [loss = 1.405, top1 = 63.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.408, top1 = 38.56%], valid : [loss = 2.569, top1 = 35.93%], test : [loss = 2.619, top1 = 34.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.39%], valid : [loss = 0.890, top1 = 68.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1125/15625) 001125-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10-valid  train : [loss = 1.837, top1 = 33.71%], valid : [loss = 1.859, top1 = 33.00%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.55 ms.
cifar10        train : [loss = 1.278, top1 = 53.86%], test  : [loss = 1.287, top1 = 53.07%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.21 ms.
cifar100       train : [loss = 3.805, top1 = 11.87%], valid : [loss = 3.905, top1 = 10.04%], test : [loss = 3.900, top1 = 10.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.09 ms.
ImageNet16-120 train : [loss = 3.910, top1 = 11.86%], valid : [loss = 3.904, top1 = 12.30%], test : [loss = 3.926, top1 = 11.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.50%], valid : [loss = 1.968, top1 = 27.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1126/15625) 001126-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.657, top1 = 86.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.409, top1 = 90.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.19 ms.
cifar100       train : [loss = 0.205, top1 = 95.22%], valid : [loss = 1.474, top1 = 66.34%], test : [loss = 1.510, top1 = 64.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.08%], valid : [loss = 2.471, top1 = 37.83%], test : [loss = 2.519, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.08%], valid : [loss = 0.810, top1 = 71.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1127/15625) 001127-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.441, top1 = 89.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.321, top1 = 91.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.327, top1 = 91.12%], valid : [loss = 1.257, top1 = 67.48%], test : [loss = 1.305, top1 = 67.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.83%], valid : [loss = 2.358, top1 = 40.07%], test : [loss = 2.413, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.89%], valid : [loss = 0.559, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1128/15625) 001128-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.574, top1 = 87.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.86 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.372, top1 = 91.57%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.58 ms.
cifar100       train : [loss = 0.397, top1 = 88.65%], valid : [loss = 1.434, top1 = 64.90%], test : [loss = 1.392, top1 = 65.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.96%], valid : [loss = 2.516, top1 = 36.83%], test : [loss = 2.541, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1129/15625) 001129-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.567, top1 = 88.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.389, top1 = 91.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.113, top1 = 97.65%], valid : [loss = 1.534, top1 = 66.79%], test : [loss = 1.538, top1 = 66.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.45%], valid : [loss = 2.415, top1 = 39.27%], test : [loss = 2.423, top1 = 39.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.33%], valid : [loss = 0.724, top1 = 74.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1130/15625) 001130-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.526, top1 = 89.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.355, top1 = 92.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.82 ms.
cifar100       train : [loss = 0.104, top1 = 97.91%], valid : [loss = 1.325, top1 = 69.88%], test : [loss = 1.283, top1 = 70.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.12%], valid : [loss = 2.128, top1 = 45.13%], test : [loss = 2.147, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.30%], valid : [loss = 0.698, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1131/15625) 001131-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.320, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.67 ms.
cifar100       train : [loss = 0.326, top1 = 91.11%], valid : [loss = 1.313, top1 = 67.15%], test : [loss = 1.299, top1 = 67.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.16%], valid : [loss = 2.367, top1 = 39.68%], test : [loss = 2.408, top1 = 39.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.446, top1 = 84.50%], valid : [loss = 0.547, top1 = 81.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1132/15625) 001132-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.50%], valid : [loss = 0.670, top1 = 84.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.053, top1 = 98.37%], test  : [loss = 0.434, top1 = 88.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 0.619, top1 = 81.90%], valid : [loss = 1.557, top1 = 61.50%], test : [loss = 1.520, top1 = 61.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.28%], valid : [loss = 2.829, top1 = 30.97%], test : [loss = 2.864, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.08%], valid : [loss = 0.886, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1133/15625) 001133-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.614, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.073, top1 = 97.75%], test  : [loss = 0.391, top1 = 88.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.87 ms.
cifar100       train : [loss = 0.721, top1 = 79.04%], valid : [loss = 1.394, top1 = 63.03%], test : [loss = 1.384, top1 = 63.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.72%], valid : [loss = 2.686, top1 = 33.47%], test : [loss = 2.700, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1134/15625) 001134-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.478, top1 = 82.97%], valid : [loss = 0.686, top1 = 77.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10        train : [loss = 0.443, top1 = 84.66%], test  : [loss = 0.567, top1 = 81.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.23 ms.
cifar100       train : [loss = 1.721, top1 = 52.85%], valid : [loss = 1.949, top1 = 48.78%], test : [loss = 1.948, top1 = 49.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 3.366, top1 = 20.10%], valid : [loss = 3.374, top1 = 20.37%], test : [loss = 3.403, top1 = 19.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.201, top1 = 56.68%], valid : [loss = 1.247, top1 = 55.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1135/15625) 001135-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.96%], valid : [loss = 0.451, top1 = 89.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.325, top1 = 91.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.336, top1 = 90.72%], valid : [loss = 1.322, top1 = 67.32%], test : [loss = 1.289, top1 = 67.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.17%], valid : [loss = 2.362, top1 = 40.50%], test : [loss = 2.422, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.03%], valid : [loss = 0.570, top1 = 80.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1136/15625) 001136-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.619, top1 = 87.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.394, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 0.244, top1 = 94.00%], valid : [loss = 1.446, top1 = 65.20%], test : [loss = 1.458, top1 = 66.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.14%], valid : [loss = 2.546, top1 = 36.33%], test : [loss = 2.578, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.18%], valid : [loss = 0.781, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1137/15625) 001137-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.64%], valid : [loss = 0.623, top1 = 86.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10        train : [loss = 0.035, top1 = 99.01%], test  : [loss = 0.392, top1 = 90.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.48 ms.
cifar100       train : [loss = 0.525, top1 = 84.81%], valid : [loss = 1.404, top1 = 64.22%], test : [loss = 1.363, top1 = 65.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.32%], valid : [loss = 2.601, top1 = 35.20%], test : [loss = 2.597, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.36%], valid : [loss = 0.835, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1138/15625) 001138-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.318, top1 = 92.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.281, top1 = 92.63%], valid : [loss = 1.292, top1 = 67.60%], test : [loss = 1.289, top1 = 68.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.89 ms.
ImageNet16-120 train : [loss = 2.004, top1 = 47.46%], valid : [loss = 2.313, top1 = 40.70%], test : [loss = 2.348, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.62%], valid : [loss = 0.731, top1 = 74.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1139/15625) 001139-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.92%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.333, top1 = 92.96%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.18 ms.
cifar100       train : [loss = 0.096, top1 = 98.23%], valid : [loss = 1.383, top1 = 68.96%], test : [loss = 1.342, top1 = 69.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 1.628, top1 = 56.23%], valid : [loss = 2.205, top1 = 43.40%], test : [loss = 2.227, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.22%], valid : [loss = 0.568, top1 = 80.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1140/15625) 001140-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.98%], valid : [loss = 0.475, top1 = 84.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10        train : [loss = 0.298, top1 = 90.07%], test  : [loss = 0.398, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.34 ms.
cifar100       train : [loss = 1.324, top1 = 63.27%], valid : [loss = 1.511, top1 = 58.68%], test : [loss = 1.500, top1 = 58.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.45%], valid : [loss = 2.926, top1 = 28.80%], test : [loss = 2.967, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1141/15625) 001141-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.16%], valid : [loss = 0.473, top1 = 85.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.158, top1 = 94.85%], test  : [loss = 0.349, top1 = 88.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.72 ms.
cifar100       train : [loss = 0.997, top1 = 71.57%], valid : [loss = 1.359, top1 = 62.02%], test : [loss = 1.342, top1 = 61.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.81%], valid : [loss = 2.681, top1 = 33.09%], test : [loss = 2.718, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1142/15625) 001142-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.39%], valid : [loss = 0.597, top1 = 86.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10        train : [loss = 0.018, top1 = 99.47%], test  : [loss = 0.397, top1 = 90.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.87 ms.
cifar100       train : [loss = 0.414, top1 = 88.32%], valid : [loss = 1.476, top1 = 64.00%], test : [loss = 1.442, top1 = 62.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.723, top1 = 31.30%], valid : [loss = 2.785, top1 = 29.97%], test : [loss = 2.806, top1 = 29.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.21%], valid : [loss = 1.221, top1 = 55.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1143/15625) 001143-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.82%], valid : [loss = 0.702, top1 = 83.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.091, top1 = 97.12%], test  : [loss = 0.484, top1 = 86.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.36 ms.
cifar100       train : [loss = 0.832, top1 = 75.79%], valid : [loss = 1.566, top1 = 59.36%], test : [loss = 1.604, top1 = 58.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.810, top1 = 30.34%], valid : [loss = 2.928, top1 = 28.10%], test : [loss = 2.985, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.90%], valid : [loss = 0.894, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1144/15625) 001144-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.495, top1 = 89.39%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.46 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.326, top1 = 92.40%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.45 ms.
cifar100       train : [loss = 0.174, top1 = 96.24%], valid : [loss = 1.346, top1 = 67.88%], test : [loss = 1.313, top1 = 68.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.19%], valid : [loss = 2.252, top1 = 42.67%], test : [loss = 2.261, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.49%], valid : [loss = 0.664, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1145/15625) 001145-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.532, top1 = 89.43%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.91 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.329, top1 = 93.08%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.20 ms.
cifar100       train : [loss = 0.070, top1 = 98.82%], valid : [loss = 1.333, top1 = 69.98%], test : [loss = 1.343, top1 = 70.22%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.13 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.46%], valid : [loss = 2.433, top1 = 38.40%], test : [loss = 2.440, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.34%], valid : [loss = 0.844, top1 = 69.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1146/15625) 001146-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.38%], valid : [loss = 0.462, top1 = 86.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.159, top1 = 94.80%], test  : [loss = 0.360, top1 = 88.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.52 ms.
cifar100       train : [loss = 1.003, top1 = 71.42%], valid : [loss = 1.381, top1 = 61.30%], test : [loss = 1.369, top1 = 61.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.80%], valid : [loss = 2.680, top1 = 32.20%], test : [loss = 2.740, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1147/15625) 001147-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.25%], valid : [loss = 0.456, top1 = 87.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.114, top1 = 96.55%], test  : [loss = 0.337, top1 = 89.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.55 ms.
cifar100       train : [loss = 0.870, top1 = 75.35%], valid : [loss = 1.306, top1 = 64.17%], test : [loss = 1.287, top1 = 63.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.59%], valid : [loss = 2.626, top1 = 33.80%], test : [loss = 2.658, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1148/15625) 001148-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.512, top1 = 89.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.298, top1 = 92.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.03 ms.
cifar100       train : [loss = 0.164, top1 = 96.61%], valid : [loss = 1.311, top1 = 68.34%], test : [loss = 1.338, top1 = 68.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.26%], valid : [loss = 2.284, top1 = 41.83%], test : [loss = 2.325, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1149/15625) 001149-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.512, top1 = 89.61%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.81 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.364, top1 = 92.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.66 ms.
cifar100       train : [loss = 0.084, top1 = 98.50%], valid : [loss = 1.304, top1 = 70.24%], test : [loss = 1.296, top1 = 69.92%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 1.717, top1 = 54.07%], valid : [loss = 2.234, top1 = 42.67%], test : [loss = 2.231, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.72%], valid : [loss = 0.908, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1150/15625) 001150-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.653, top1 = 86.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.435, top1 = 90.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.98 ms.
cifar100       train : [loss = 0.222, top1 = 94.50%], valid : [loss = 1.567, top1 = 63.20%], test : [loss = 1.599, top1 = 63.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.27%], valid : [loss = 2.609, top1 = 34.53%], test : [loss = 2.620, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.34%], valid : [loss = 0.766, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1151/15625) 001151-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 16.96 M, Params=0.139 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.34%], valid : [loss = 0.453, top1 = 87.07%]
cifar10        FLOP= 16.96 M, Params=0.139 MB, latency=15.94 ms.
cifar10        train : [loss = 0.111, top1 = 96.59%], test  : [loss = 0.319, top1 = 89.86%]
cifar100       FLOP= 16.96 M, Params=0.144 MB, latency=15.29 ms.
cifar100       train : [loss = 0.858, top1 = 75.49%], valid : [loss = 1.293, top1 = 63.65%], test : [loss = 1.279, top1 = 64.03%]
ImageNet16-120 FLOP=  4.25 M, Params=0.146 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.64%], valid : [loss = 2.614, top1 = 34.53%], test : [loss = 2.664, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.50%], valid : [loss = 0.655, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1152/15625) 001152-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.47%], valid : [loss = 0.462, top1 = 86.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10        train : [loss = 0.150, top1 = 95.12%], test  : [loss = 0.337, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.12 ms.
cifar100       train : [loss = 0.983, top1 = 72.03%], valid : [loss = 1.342, top1 = 62.70%], test : [loss = 1.343, top1 = 62.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.12%], valid : [loss = 2.680, top1 = 32.37%], test : [loss = 2.696, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1153/15625) 001153-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.597, top1 = 86.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.039, top1 = 98.87%], test  : [loss = 0.396, top1 = 90.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 0.558, top1 = 83.50%], valid : [loss = 1.362, top1 = 64.38%], test : [loss = 1.413, top1 = 64.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.93%], valid : [loss = 2.630, top1 = 34.53%], test : [loss = 2.662, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.52%], valid : [loss = 0.627, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1154/15625) 001154-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.532, top1 = 89.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.98 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.296, top1 = 93.10%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.58 ms.
cifar100       train : [loss = 0.146, top1 = 96.96%], valid : [loss = 1.277, top1 = 69.70%], test : [loss = 1.297, top1 = 68.88%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.43%], valid : [loss = 2.309, top1 = 41.63%], test : [loss = 2.265, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.45%], valid : [loss = 0.729, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1155/15625) 001155-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.215, top1 = 92.58%], valid : [loss = 0.554, top1 = 83.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10        train : [loss = 0.221, top1 = 92.42%], test  : [loss = 0.412, top1 = 86.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.96 ms.
cifar100       train : [loss = 1.286, top1 = 63.53%], valid : [loss = 1.570, top1 = 57.80%], test : [loss = 1.575, top1 = 57.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.719, top1 = 32.28%], valid : [loss = 2.729, top1 = 31.63%], test : [loss = 2.801, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.08%], valid : [loss = 0.995, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1156/15625) 001156-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.00 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.11%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.321, top1 = 92.68%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.82 ms.
cifar100       train : [loss = 0.157, top1 = 96.59%], valid : [loss = 1.274, top1 = 69.34%], test : [loss = 1.324, top1 = 68.92%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 51.01%], valid : [loss = 2.306, top1 = 41.50%], test : [loss = 2.265, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.78%], valid : [loss = 0.702, top1 = 75.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1157/15625) 001157-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.508, top1 = 88.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.325, top1 = 91.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.05 ms.
cifar100       train : [loss = 0.335, top1 = 90.83%], valid : [loss = 1.288, top1 = 66.20%], test : [loss = 1.278, top1 = 68.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.64%], valid : [loss = 2.382, top1 = 38.37%], test : [loss = 2.393, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.76%], valid : [loss = 0.720, top1 = 74.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1158/15625) 001158-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.70%], valid : [loss = 0.957, top1 = 67.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.49 ms.
cifar10        train : [loss = 0.784, top1 = 72.66%], test  : [loss = 0.852, top1 = 70.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.56 ms.
cifar100       train : [loss = 2.149, top1 = 43.79%], valid : [loss = 2.316, top1 = 40.58%], test : [loss = 2.336, top1 = 40.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 3.748, top1 = 14.10%], valid : [loss = 3.784, top1 = 15.03%], test : [loss = 3.780, top1 = 13.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.454, top1 = 46.72%], valid : [loss = 1.494, top1 = 45.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1159/15625) 001159-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.70%], valid : [loss = 0.545, top1 = 83.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.197, top1 = 93.36%], test  : [loss = 0.401, top1 = 87.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.77 ms.
cifar100       train : [loss = 1.241, top1 = 64.64%], valid : [loss = 1.562, top1 = 57.15%], test : [loss = 1.538, top1 = 57.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 34.00%], valid : [loss = 2.691, top1 = 32.73%], test : [loss = 2.719, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.70%], valid : [loss = 1.023, top1 = 63.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1160/15625) 001160-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=21.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.502, top1 = 90.10%]
cifar10        FLOP=188.66 M, Params=1.317 MB, latency=23.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.307, top1 = 93.35%]
cifar100       FLOP=188.67 M, Params=1.322 MB, latency=22.84 ms.
cifar100       train : [loss = 0.030, top1 = 99.71%], valid : [loss = 1.324, top1 = 71.84%], test : [loss = 1.359, top1 = 70.66%]
ImageNet16-120 FLOP= 47.17 M, Params=1.324 MB, latency=21.84 ms.
ImageNet16-120 train : [loss = 1.797, top1 = 52.08%], valid : [loss = 2.267, top1 = 42.03%], test : [loss = 2.303, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.66%], valid : [loss = 0.786, top1 = 72.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1161/15625) 001161-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.531, top1 = 88.96%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.38 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.352, top1 = 92.05%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.83 ms.
cifar100       train : [loss = 0.234, top1 = 93.88%], valid : [loss = 1.299, top1 = 67.96%], test : [loss = 1.289, top1 = 68.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.79%], valid : [loss = 2.394, top1 = 40.63%], test : [loss = 2.393, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.62%], valid : [loss = 0.833, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1162/15625) 001162-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.400, top1 = 90.90%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.80 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.278, top1 = 93.43%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.99 ms.
cifar100       train : [loss = 0.185, top1 = 95.64%], valid : [loss = 1.265, top1 = 70.04%], test : [loss = 1.236, top1 = 69.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 1.845, top1 = 51.01%], valid : [loss = 2.263, top1 = 42.73%], test : [loss = 2.288, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.54%], valid : [loss = 0.504, top1 = 83.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1163/15625) 001163-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.126, top1 = 95.74%], valid : [loss = 0.664, top1 = 82.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10        train : [loss = 0.158, top1 = 94.66%], test  : [loss = 0.504, top1 = 85.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 1.000, top1 = 71.23%], valid : [loss = 1.687, top1 = 56.50%], test : [loss = 1.679, top1 = 55.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 25.51%], valid : [loss = 3.131, top1 = 24.87%], test : [loss = 3.186, top1 = 23.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.50%], valid : [loss = 0.982, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1164/15625) 001164-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.86%], valid : [loss = 0.482, top1 = 84.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 0.302, top1 = 89.95%], test  : [loss = 0.402, top1 = 86.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.86 ms.
cifar100       train : [loss = 1.336, top1 = 62.98%], valid : [loss = 1.544, top1 = 57.81%], test : [loss = 1.514, top1 = 58.13%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.02 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.60%], valid : [loss = 2.906, top1 = 29.13%], test : [loss = 2.952, top1 = 28.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1165/15625) 001165-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.72%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.26 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.331, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.87 ms.
cifar100       train : [loss = 0.118, top1 = 97.62%], valid : [loss = 1.307, top1 = 69.08%], test : [loss = 1.326, top1 = 69.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.68%], valid : [loss = 2.182, top1 = 44.08%], test : [loss = 2.207, top1 = 44.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 84.97%], valid : [loss = 0.551, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1166/15625) 001166-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.02 ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.46%], valid : [loss = 0.530, top1 = 82.16%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.29 ms.
cifar10        train : [loss = 0.400, top1 = 86.25%], test  : [loss = 0.473, top1 = 84.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.84 ms.
cifar100       train : [loss = 1.572, top1 = 57.13%], valid : [loss = 1.697, top1 = 53.86%], test : [loss = 1.675, top1 = 54.22%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.36 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.42%], valid : [loss = 3.002, top1 = 27.17%], test : [loss = 3.064, top1 = 26.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1167/15625) 001167-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.83%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.14 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.348, top1 = 92.63%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.50 ms.
cifar100       train : [loss = 0.068, top1 = 98.89%], valid : [loss = 1.350, top1 = 69.92%], test : [loss = 1.370, top1 = 69.76%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.30 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.70%], valid : [loss = 2.357, top1 = 40.67%], test : [loss = 2.327, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 71.96%], valid : [loss = 0.835, top1 = 70.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1168/15625) 001168-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.512, top1 = 88.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.356, top1 = 90.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.93 ms.
cifar100       train : [loss = 0.478, top1 = 85.84%], valid : [loss = 1.313, top1 = 66.30%], test : [loss = 1.299, top1 = 66.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.80%], valid : [loss = 2.549, top1 = 35.37%], test : [loss = 2.557, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 78.08%], valid : [loss = 0.713, top1 = 75.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1169/15625) 001169-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.547, top1 = 88.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.342, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.282, top1 = 92.30%], valid : [loss = 1.226, top1 = 69.18%], test : [loss = 1.287, top1 = 67.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.86%], valid : [loss = 2.304, top1 = 40.60%], test : [loss = 2.313, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.02%], valid : [loss = 0.798, top1 = 72.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1170/15625) 001170-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.518, top1 = 88.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.322, top1 = 92.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.67 ms.
cifar100       train : [loss = 0.272, top1 = 92.92%], valid : [loss = 1.257, top1 = 67.89%], test : [loss = 1.252, top1 = 68.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.72%], valid : [loss = 2.277, top1 = 41.30%], test : [loss = 2.288, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.74%], valid : [loss = 0.615, top1 = 78.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1171/15625) 001171-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.47%], valid : [loss = 0.466, top1 = 86.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.97 ms.
cifar10        train : [loss = 0.156, top1 = 94.90%], test  : [loss = 0.344, top1 = 88.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.49 ms.
cifar100       train : [loss = 0.994, top1 = 71.63%], valid : [loss = 1.360, top1 = 62.09%], test : [loss = 1.342, top1 = 62.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.06%], valid : [loss = 2.668, top1 = 33.40%], test : [loss = 2.699, top1 = 32.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1172/15625) 001172-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 88.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.328, top1 = 91.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.08 ms.
cifar100       train : [loss = 0.326, top1 = 91.18%], valid : [loss = 1.317, top1 = 67.39%], test : [loss = 1.306, top1 = 67.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.28%], valid : [loss = 2.364, top1 = 39.93%], test : [loss = 2.397, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.53%], valid : [loss = 0.547, top1 = 81.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1173/15625) 001173-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.541, top1 = 89.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.353, top1 = 92.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.24 ms.
cifar100       train : [loss = 0.045, top1 = 99.57%], valid : [loss = 1.412, top1 = 69.61%], test : [loss = 1.409, top1 = 69.41%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.57 ms.
ImageNet16-120 train : [loss = 1.638, top1 = 56.02%], valid : [loss = 2.384, top1 = 41.23%], test : [loss = 2.402, top1 = 41.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.66%], valid : [loss = 0.706, top1 = 75.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1174/15625) 001174-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.065, top1 = 98.03%], valid : [loss = 0.569, top1 = 85.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.112, top1 = 96.29%], test  : [loss = 0.389, top1 = 88.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.832, top1 = 75.62%], valid : [loss = 1.409, top1 = 61.97%], test : [loss = 1.423, top1 = 62.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.689, top1 = 32.75%], valid : [loss = 2.767, top1 = 31.14%], test : [loss = 2.824, top1 = 30.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.57%], valid : [loss = 0.722, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1175/15625) 001175-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.617, top1 = 87.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.403, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.211, top1 = 95.02%], valid : [loss = 1.463, top1 = 65.95%], test : [loss = 1.427, top1 = 66.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.05%], valid : [loss = 2.495, top1 = 37.91%], test : [loss = 2.501, top1 = 38.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1176/15625) 001176-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.508, top1 = 88.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.330, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.24 ms.
cifar100       train : [loss = 0.334, top1 = 90.94%], valid : [loss = 1.297, top1 = 66.56%], test : [loss = 1.285, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.11%], valid : [loss = 2.396, top1 = 39.40%], test : [loss = 2.414, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.07%], valid : [loss = 0.643, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1177/15625) 001177-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.444, top1 = 90.74%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.302, top1 = 93.61%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.04 ms.
cifar100       train : [loss = 0.050, top1 = 99.42%], valid : [loss = 1.358, top1 = 70.07%], test : [loss = 1.349, top1 = 70.67%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 1.470, top1 = 60.11%], valid : [loss = 2.238, top1 = 44.18%], test : [loss = 2.247, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 87.00%], valid : [loss = 0.514, top1 = 82.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1178/15625) 001178-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.590, top1 = 87.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.401, top1 = 90.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.77 ms.
cifar100       train : [loss = 0.264, top1 = 93.03%], valid : [loss = 1.448, top1 = 65.37%], test : [loss = 1.437, top1 = 65.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 43.05%], valid : [loss = 2.560, top1 = 36.08%], test : [loss = 2.625, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.54%], valid : [loss = 0.677, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1179/15625) 001179-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.70%], valid : [loss = 0.644, top1 = 81.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10        train : [loss = 0.179, top1 = 93.81%], test  : [loss = 0.434, top1 = 86.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 1.018, top1 = 70.55%], valid : [loss = 1.536, top1 = 58.46%], test : [loss = 1.534, top1 = 58.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.983, top1 = 26.74%], valid : [loss = 3.043, top1 = 25.69%], test : [loss = 3.063, top1 = 25.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.086, top1 = 60.87%], valid : [loss = 1.113, top1 = 60.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1180/15625) 001180-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.520, top1 = 88.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.37 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.80 ms.
cifar100       train : [loss = 0.272, top1 = 92.75%], valid : [loss = 1.273, top1 = 68.10%], test : [loss = 1.255, top1 = 68.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.85%], valid : [loss = 2.284, top1 = 41.57%], test : [loss = 2.303, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.91%], valid : [loss = 0.725, top1 = 74.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1181/15625) 001181-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.575, top1 = 87.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.384, top1 = 91.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.28 ms.
cifar100       train : [loss = 0.397, top1 = 88.76%], valid : [loss = 1.403, top1 = 65.58%], test : [loss = 1.372, top1 = 66.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.94%], valid : [loss = 2.517, top1 = 37.08%], test : [loss = 2.530, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1182/15625) 001182-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.46%], valid : [loss = 0.748, top1 = 74.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.525, top1 = 81.87%], test  : [loss = 0.605, top1 = 79.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.56 ms.
cifar100       train : [loss = 1.971, top1 = 46.62%], valid : [loss = 2.090, top1 = 44.15%], test : [loss = 2.100, top1 = 43.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.968, top1 = 27.27%], valid : [loss = 2.953, top1 = 27.63%], test : [loss = 2.983, top1 = 26.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.56%], valid : [loss = 1.196, top1 = 57.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1183/15625) 001183-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.08 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.67%], valid : [loss = 0.504, top1 = 83.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.98 ms.
cifar10        train : [loss = 0.267, top1 = 90.98%], test  : [loss = 0.374, top1 = 87.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.51 ms.
cifar100       train : [loss = 1.309, top1 = 63.43%], valid : [loss = 1.512, top1 = 58.07%], test : [loss = 1.499, top1 = 57.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 2.819, top1 = 30.49%], valid : [loss = 2.816, top1 = 30.74%], test : [loss = 2.852, top1 = 29.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.992, top1 = 64.51%], valid : [loss = 0.999, top1 = 64.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1184/15625) 001184-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.29 ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.53%], valid : [loss = 1.017, top1 = 65.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.94 ms.
cifar10        train : [loss = 0.764, top1 = 73.12%], test  : [loss = 0.847, top1 = 70.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.00 ms.
cifar100       train : [loss = 2.141, top1 = 43.75%], valid : [loss = 2.320, top1 = 40.79%], test : [loss = 2.346, top1 = 40.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.58 ms.
ImageNet16-120 train : [loss = 3.743, top1 = 14.27%], valid : [loss = 3.772, top1 = 14.56%], test : [loss = 3.773, top1 = 13.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1185/15625) 001185-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.558, top1 = 87.42%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.91 ms.
cifar10        train : [loss = 0.034, top1 = 98.99%], test  : [loss = 0.352, top1 = 91.17%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.22 ms.
cifar100       train : [loss = 0.562, top1 = 83.81%], valid : [loss = 1.373, top1 = 63.98%], test : [loss = 1.350, top1 = 64.45%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.43%], valid : [loss = 2.619, top1 = 34.12%], test : [loss = 2.647, top1 = 33.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.25%], valid : [loss = 0.927, top1 = 66.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1186/15625) 001186-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.628, top1 = 87.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.403, top1 = 90.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.235, top1 = 94.11%], valid : [loss = 1.527, top1 = 64.81%], test : [loss = 1.555, top1 = 64.53%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.06%], valid : [loss = 2.488, top1 = 37.31%], test : [loss = 2.486, top1 = 38.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.49%], valid : [loss = 0.785, top1 = 72.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1187/15625) 001187-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.45%], valid : [loss = 0.557, top1 = 87.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.356, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.488, top1 = 85.98%], valid : [loss = 1.280, top1 = 66.07%], test : [loss = 1.313, top1 = 65.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 35.44%], valid : [loss = 2.622, top1 = 34.03%], test : [loss = 2.635, top1 = 33.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1188/15625) 001188-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.21%], valid : [loss = 0.472, top1 = 85.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10        train : [loss = 0.157, top1 = 94.88%], test  : [loss = 0.339, top1 = 89.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.83 ms.
cifar100       train : [loss = 0.993, top1 = 71.77%], valid : [loss = 1.350, top1 = 62.33%], test : [loss = 1.339, top1 = 62.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.76%], valid : [loss = 2.694, top1 = 32.89%], test : [loss = 2.712, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1189/15625) 001189-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.70%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.78 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.318, top1 = 93.05%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.58 ms.
cifar100       train : [loss = 0.089, top1 = 98.36%], valid : [loss = 1.314, top1 = 69.87%], test : [loss = 1.297, top1 = 70.11%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.32 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.57%], valid : [loss = 2.322, top1 = 40.51%], test : [loss = 2.284, top1 = 41.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.49%], valid : [loss = 0.760, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1190/15625) 001190-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.561, top1 = 88.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.13 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.378, top1 = 91.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.81 ms.
cifar100       train : [loss = 0.133, top1 = 97.12%], valid : [loss = 1.495, top1 = 66.51%], test : [loss = 1.510, top1 = 66.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.18%], valid : [loss = 2.465, top1 = 38.58%], test : [loss = 2.465, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.06%], valid : [loss = 0.792, top1 = 72.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1191/15625) 001191-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.587, top1 = 86.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.02 ms.
cifar10        train : [loss = 0.042, top1 = 98.76%], test  : [loss = 0.403, top1 = 89.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.16 ms.
cifar100       train : [loss = 0.564, top1 = 83.38%], valid : [loss = 1.403, top1 = 64.10%], test : [loss = 1.414, top1 = 63.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 37.00%], valid : [loss = 2.615, top1 = 33.94%], test : [loss = 2.671, top1 = 33.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.85%], valid : [loss = 0.805, top1 = 71.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1192/15625) 001192-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.530, top1 = 88.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.339, top1 = 91.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.87 ms.
cifar100       train : [loss = 0.285, top1 = 92.27%], valid : [loss = 1.269, top1 = 67.90%], test : [loss = 1.258, top1 = 68.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.50%], valid : [loss = 2.280, top1 = 41.18%], test : [loss = 2.319, top1 = 41.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 77.96%], valid : [loss = 0.697, top1 = 75.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1193/15625) 001193-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.583, top1 = 87.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.399, top1 = 91.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 0.399, top1 = 88.65%], valid : [loss = 1.403, top1 = 65.31%], test : [loss = 1.376, top1 = 65.63%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.87%], valid : [loss = 2.518, top1 = 36.63%], test : [loss = 2.538, top1 = 36.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1194/15625) 001194-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.89%], valid : [loss = 0.480, top1 = 84.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10        train : [loss = 0.298, top1 = 89.97%], test  : [loss = 0.402, top1 = 86.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.31 ms.
cifar100       train : [loss = 1.332, top1 = 63.02%], valid : [loss = 1.535, top1 = 57.53%], test : [loss = 1.516, top1 = 58.11%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.44 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.59%], valid : [loss = 2.921, top1 = 28.96%], test : [loss = 2.958, top1 = 28.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1195/15625) 001195-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.537, top1 = 89.34%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.38 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.318, top1 = 93.14%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.29 ms.
cifar100       train : [loss = 0.065, top1 = 99.01%], valid : [loss = 1.371, top1 = 69.50%], test : [loss = 1.330, top1 = 70.15%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.14 ms.
ImageNet16-120 train : [loss = 1.699, top1 = 54.59%], valid : [loss = 2.259, top1 = 42.77%], test : [loss = 2.257, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.37%], valid : [loss = 0.791, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1196/15625) 001196-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.510, top1 = 88.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.335, top1 = 92.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.43 ms.
cifar100       train : [loss = 0.344, top1 = 90.66%], valid : [loss = 1.288, top1 = 67.09%], test : [loss = 1.310, top1 = 67.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.78%], valid : [loss = 2.421, top1 = 38.54%], test : [loss = 2.416, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1197/15625) 001197-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.63%], valid : [loss = 0.679, top1 = 83.36%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.66 ms.
cifar10        train : [loss = 0.107, top1 = 96.45%], test  : [loss = 0.465, top1 = 87.37%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.25 ms.
cifar100       train : [loss = 0.449, top1 = 87.00%], valid : [loss = 1.624, top1 = 60.50%], test : [loss = 1.658, top1 = 60.65%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 3.181, top1 = 22.72%], valid : [loss = 3.240, top1 = 22.40%], test : [loss = 3.256, top1 = 21.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 57.67%], valid : [loss = 1.174, top1 = 57.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1198/15625) 001198-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.570, top1 = 87.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.387, top1 = 91.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.02 ms.
cifar100       train : [loss = 0.393, top1 = 88.93%], valid : [loss = 1.399, top1 = 65.07%], test : [loss = 1.390, top1 = 65.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.06%], valid : [loss = 2.506, top1 = 36.34%], test : [loss = 2.534, top1 = 36.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1199/15625) 001199-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.95%], valid : [loss = 0.530, top1 = 86.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.075, top1 = 97.61%], test  : [loss = 0.370, top1 = 89.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.22 ms.
cifar100       train : [loss = 0.713, top1 = 78.98%], valid : [loss = 1.356, top1 = 64.19%], test : [loss = 1.337, top1 = 64.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.00%], valid : [loss = 2.630, top1 = 34.80%], test : [loss = 2.699, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.04%], valid : [loss = 0.668, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1200/15625) 001200-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.42%], valid : [loss = 0.528, top1 = 83.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.248, top1 = 91.58%], test  : [loss = 0.403, top1 = 86.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 1.349, top1 = 62.27%], valid : [loss = 1.635, top1 = 55.78%], test : [loss = 1.598, top1 = 56.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.830, top1 = 30.11%], valid : [loss = 2.837, top1 = 30.24%], test : [loss = 2.889, top1 = 29.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 65.96%], valid : [loss = 0.983, top1 = 65.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1201/15625) 001201-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.02%], valid : [loss = 0.860, top1 = 71.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10        train : [loss = 0.562, top1 = 80.50%], test  : [loss = 0.722, top1 = 75.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.92 ms.
cifar100       train : [loss = 1.787, top1 = 51.80%], valid : [loss = 2.041, top1 = 47.28%], test : [loss = 2.055, top1 = 46.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.80%], valid : [loss = 3.646, top1 = 16.62%], test : [loss = 3.668, top1 = 15.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1202/15625) 001202-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.303, top1 = 89.39%], valid : [loss = 0.568, top1 = 81.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.272, top1 = 90.70%], test  : [loss = 0.414, top1 = 86.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.14 ms.
cifar100       train : [loss = 1.494, top1 = 58.04%], valid : [loss = 1.728, top1 = 53.16%], test : [loss = 1.731, top1 = 53.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 2.936, top1 = 27.92%], valid : [loss = 2.958, top1 = 27.90%], test : [loss = 2.998, top1 = 27.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1203/15625) 001203-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.556, top1 = 89.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.367, top1 = 92.63%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.57 ms.
cifar100       train : [loss = 0.104, top1 = 98.15%], valid : [loss = 1.444, top1 = 68.00%], test : [loss = 1.442, top1 = 67.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.50%], valid : [loss = 2.446, top1 = 38.77%], test : [loss = 2.440, top1 = 40.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1204/15625) 001204-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.45%], valid : [loss = 0.444, top1 = 87.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.94 ms.
cifar10        train : [loss = 0.059, top1 = 98.50%], test  : [loss = 0.320, top1 = 90.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.71 ms.
cifar100       train : [loss = 0.588, top1 = 83.88%], valid : [loss = 1.239, top1 = 66.45%], test : [loss = 1.220, top1 = 66.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.24%], valid : [loss = 2.462, top1 = 38.01%], test : [loss = 2.487, top1 = 37.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1205/15625) 001205-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.307, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 0.326, top1 = 91.11%], valid : [loss = 1.317, top1 = 66.93%], test : [loss = 1.288, top1 = 67.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.34%], valid : [loss = 2.359, top1 = 40.91%], test : [loss = 2.401, top1 = 39.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 84.28%], valid : [loss = 0.561, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1206/15625) 001206-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.234, top1 = 91.94%], valid : [loss = 0.516, top1 = 83.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10        train : [loss = 0.240, top1 = 91.79%], test  : [loss = 0.388, top1 = 87.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.70 ms.
cifar100       train : [loss = 1.368, top1 = 61.48%], valid : [loss = 1.631, top1 = 55.27%], test : [loss = 1.621, top1 = 55.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 2.870, top1 = 29.34%], valid : [loss = 2.875, top1 = 29.46%], test : [loss = 2.938, top1 = 27.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.46%], valid : [loss = 1.001, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1207/15625) 001207-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.516, top1 = 88.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.332, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.89 ms.
cifar100       train : [loss = 0.345, top1 = 90.66%], valid : [loss = 1.285, top1 = 67.20%], test : [loss = 1.295, top1 = 67.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.81%], valid : [loss = 2.395, top1 = 39.16%], test : [loss = 2.412, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.66%], valid : [loss = 0.633, top1 = 78.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1208/15625) 001208-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.533, top1 = 88.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10        train : [loss = 0.013, top1 = 99.65%], test  : [loss = 0.350, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.175, top1 = 95.65%], valid : [loss = 1.302, top1 = 68.63%], test : [loss = 1.316, top1 = 68.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 33.54%], valid : [loss = 2.736, top1 = 31.48%], test : [loss = 2.745, top1 = 30.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.58%], valid : [loss = 0.936, top1 = 66.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1209/15625) 001209-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.77%], valid : [loss = 0.455, top1 = 86.49%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10        train : [loss = 0.152, top1 = 95.04%], test  : [loss = 0.339, top1 = 88.92%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.06 ms.
cifar100       train : [loss = 0.980, top1 = 72.08%], valid : [loss = 1.348, top1 = 62.39%], test : [loss = 1.350, top1 = 62.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.18%], valid : [loss = 2.668, top1 = 33.38%], test : [loss = 2.698, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.755, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1210/15625) 001210-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.505, top1 = 88.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.341, top1 = 91.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.336, top1 = 90.83%], valid : [loss = 1.289, top1 = 66.91%], test : [loss = 1.296, top1 = 67.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.35%], valid : [loss = 2.415, top1 = 38.96%], test : [loss = 2.427, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1211/15625) 001211-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.74%], valid : [loss = 0.787, top1 = 82.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.088, top1 = 97.21%], test  : [loss = 0.475, top1 = 87.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.87 ms.
cifar100       train : [loss = 0.810, top1 = 76.46%], valid : [loss = 1.561, top1 = 59.62%], test : [loss = 1.531, top1 = 60.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 2.827, top1 = 30.05%], valid : [loss = 2.957, top1 = 28.60%], test : [loss = 3.012, top1 = 27.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 71.00%], valid : [loss = 0.872, top1 = 69.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1212/15625) 001212-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.28%], valid : [loss = 0.863, top1 = 71.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10        train : [loss = 0.554, top1 = 80.65%], test  : [loss = 0.715, top1 = 75.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.74 ms.
cifar100       train : [loss = 1.773, top1 = 52.17%], valid : [loss = 2.046, top1 = 47.00%], test : [loss = 2.046, top1 = 47.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.84%], valid : [loss = 3.640, top1 = 16.69%], test : [loss = 3.674, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1213/15625) 001213-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.494, top1 = 88.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10        train : [loss = 0.017, top1 = 99.62%], test  : [loss = 0.337, top1 = 91.57%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.17 ms.
cifar100       train : [loss = 0.386, top1 = 89.04%], valid : [loss = 1.348, top1 = 66.28%], test : [loss = 1.361, top1 = 66.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.68%], valid : [loss = 2.386, top1 = 39.44%], test : [loss = 2.433, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.24%], valid : [loss = 0.628, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1214/15625) 001214-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.221, top1 = 92.42%], valid : [loss = 0.556, top1 = 83.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.230, top1 = 92.14%], test  : [loss = 0.411, top1 = 86.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 1.249, top1 = 64.54%], valid : [loss = 1.607, top1 = 56.92%], test : [loss = 1.594, top1 = 57.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.973, top1 = 27.59%], valid : [loss = 3.009, top1 = 26.83%], test : [loss = 3.056, top1 = 26.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.147, top1 = 58.74%], valid : [loss = 1.198, top1 = 57.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1215/15625) 001215-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.74%], valid : [loss = 0.459, top1 = 86.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.148, top1 = 95.20%], test  : [loss = 0.339, top1 = 89.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.35 ms.
cifar100       train : [loss = 0.967, top1 = 72.47%], valid : [loss = 1.346, top1 = 62.17%], test : [loss = 1.343, top1 = 62.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.32%], valid : [loss = 2.668, top1 = 33.71%], test : [loss = 2.688, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1216/15625) 001216-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.187, top1 = 93.70%], valid : [loss = 0.713, top1 = 80.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.71 ms.
cifar10        train : [loss = 0.191, top1 = 93.46%], test  : [loss = 0.502, top1 = 85.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.69 ms.
cifar100       train : [loss = 0.896, top1 = 73.90%], valid : [loss = 1.637, top1 = 57.52%], test : [loss = 1.644, top1 = 57.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 3.530, top1 = 16.24%], valid : [loss = 3.535, top1 = 16.74%], test : [loss = 3.525, top1 = 16.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 52.86%], valid : [loss = 1.309, top1 = 52.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1217/15625) 001217-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.484, top1 = 89.25%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.73 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.301, top1 = 92.52%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.20 ms.
cifar100       train : [loss = 0.214, top1 = 94.89%], valid : [loss = 1.218, top1 = 69.55%], test : [loss = 1.210, top1 = 69.44%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.46 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.12%], valid : [loss = 2.234, top1 = 42.61%], test : [loss = 2.243, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.84%], valid : [loss = 0.626, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1218/15625) 001218-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.67%], valid : [loss = 0.584, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.019, top1 = 99.47%], test  : [loss = 0.376, top1 = 91.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.40 ms.
cifar100       train : [loss = 0.275, top1 = 92.27%], valid : [loss = 1.452, top1 = 65.66%], test : [loss = 1.458, top1 = 66.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.717, top1 = 31.44%], valid : [loss = 2.816, top1 = 29.64%], test : [loss = 2.828, top1 = 29.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.51%], valid : [loss = 1.096, top1 = 60.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1219/15625) 001219-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.498, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.332, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.77 ms.
cifar100       train : [loss = 0.326, top1 = 91.12%], valid : [loss = 1.285, top1 = 66.92%], test : [loss = 1.288, top1 = 67.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.25%], valid : [loss = 2.404, top1 = 38.34%], test : [loss = 2.407, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1220/15625) 001220-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.510, top1 = 88.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.335, top1 = 91.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.36 ms.
cifar100       train : [loss = 0.347, top1 = 90.50%], valid : [loss = 1.284, top1 = 67.09%], test : [loss = 1.280, top1 = 67.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.31 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.60%], valid : [loss = 2.393, top1 = 39.31%], test : [loss = 2.417, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1221/15625) 001221-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.99 ms.
cifar10-valid  train : [loss = 1.132, top1 = 59.60%], valid : [loss = 1.178, top1 = 58.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10        train : [loss = 1.095, top1 = 61.29%], test  : [loss = 1.093, top1 = 60.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 2.578, top1 = 34.97%], valid : [loss = 2.648, top1 = 34.11%], test : [loss = 2.623, top1 = 34.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.49 ms.
ImageNet16-120 train : [loss = 3.791, top1 = 13.55%], valid : [loss = 3.777, top1 = 14.41%], test : [loss = 3.790, top1 = 14.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1222/15625) 001222-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.363, top1 = 87.37%], valid : [loss = 0.605, top1 = 80.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.300, top1 = 89.68%], test  : [loss = 0.445, top1 = 85.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 1.380, top1 = 61.32%], valid : [loss = 1.700, top1 = 54.20%], test : [loss = 1.698, top1 = 54.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.977, top1 = 27.33%], valid : [loss = 3.029, top1 = 26.88%], test : [loss = 3.056, top1 = 26.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.26%], valid : [loss = 1.247, top1 = 55.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1223/15625) 001223-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.443, top1 = 89.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.309, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.323, top1 = 91.29%], valid : [loss = 1.289, top1 = 67.71%], test : [loss = 1.297, top1 = 67.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.41%], valid : [loss = 2.366, top1 = 40.22%], test : [loss = 2.390, top1 = 39.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.460, top1 = 83.94%], valid : [loss = 0.570, top1 = 80.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1224/15625) 001224-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.462, top1 = 88.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.309, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 0.329, top1 = 91.06%], valid : [loss = 1.322, top1 = 66.63%], test : [loss = 1.313, top1 = 67.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.12%], valid : [loss = 2.360, top1 = 39.81%], test : [loss = 2.403, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1225/15625) 001225-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.25%], valid : [loss = 0.674, top1 = 83.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.94 ms.
cifar10        train : [loss = 0.094, top1 = 96.97%], test  : [loss = 0.430, top1 = 87.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.79 ms.
cifar100       train : [loss = 0.865, top1 = 74.89%], valid : [loss = 1.543, top1 = 59.67%], test : [loss = 1.524, top1 = 59.81%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.51%], valid : [loss = 2.759, top1 = 31.49%], test : [loss = 2.802, top1 = 31.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.99%], valid : [loss = 0.969, top1 = 65.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1226/15625) 001226-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.68%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.12 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.360, top1 = 92.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.40 ms.
cifar100       train : [loss = 0.087, top1 = 98.86%], valid : [loss = 1.419, top1 = 67.73%], test : [loss = 1.406, top1 = 68.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.775, top1 = 52.89%], valid : [loss = 2.416, top1 = 39.99%], test : [loss = 2.435, top1 = 40.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 77.84%], valid : [loss = 0.729, top1 = 74.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1227/15625) 001227-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10        train : [loss = 0.014, top1 = 99.77%], test  : [loss = 0.313, top1 = 91.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 0.327, top1 = 91.16%], valid : [loss = 1.340, top1 = 66.24%], test : [loss = 1.321, top1 = 66.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.27%], valid : [loss = 2.394, top1 = 40.18%], test : [loss = 2.391, top1 = 39.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1228/15625) 001228-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.21 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.60%], valid : [loss = 0.528, top1 = 86.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.101, top1 = 96.77%], test  : [loss = 0.361, top1 = 89.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 0.713, top1 = 79.36%], valid : [loss = 1.321, top1 = 64.23%], test : [loss = 1.318, top1 = 64.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.449, top1 = 37.80%], valid : [loss = 2.534, top1 = 35.66%], test : [loss = 2.547, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.72%], valid : [loss = 0.872, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1229/15625) 001229-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.529, top1 = 88.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.388, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.50 ms.
cifar100       train : [loss = 0.375, top1 = 89.22%], valid : [loss = 1.394, top1 = 65.33%], test : [loss = 1.405, top1 = 65.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.96%], valid : [loss = 2.488, top1 = 37.06%], test : [loss = 2.528, top1 = 37.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.40%], valid : [loss = 0.651, top1 = 77.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1230/15625) 001230-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.263, top1 = 90.98%], valid : [loss = 1.084, top1 = 71.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10        train : [loss = 0.313, top1 = 89.10%], test  : [loss = 0.682, top1 = 79.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.99 ms.
cifar100       train : [loss = 1.247, top1 = 64.72%], valid : [loss = 1.902, top1 = 51.00%], test : [loss = 1.918, top1 = 51.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.17%], valid : [loss = 3.461, top1 = 18.90%], test : [loss = 3.494, top1 = 18.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.262, top1 = 53.79%], valid : [loss = 1.326, top1 = 52.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1231/15625) 001231-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.678, top1 = 76.20%], valid : [loss = 0.846, top1 = 71.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.678, top1 = 76.30%], test  : [loss = 0.771, top1 = 73.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.64 ms.
cifar100       train : [loss = 1.975, top1 = 47.59%], valid : [loss = 2.140, top1 = 44.63%], test : [loss = 2.165, top1 = 44.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.78 ms.
ImageNet16-120 train : [loss = 3.644, top1 = 15.85%], valid : [loss = 3.662, top1 = 15.98%], test : [loss = 3.686, top1 = 15.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1232/15625) 001232-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.58%], valid : [loss = 0.857, top1 = 71.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.555, top1 = 80.59%], test  : [loss = 0.715, top1 = 75.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.85 ms.
cifar100       train : [loss = 1.769, top1 = 52.28%], valid : [loss = 2.047, top1 = 47.01%], test : [loss = 2.049, top1 = 47.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.88%], valid : [loss = 3.630, top1 = 16.43%], test : [loss = 3.664, top1 = 15.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1233/15625) 001233-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.553, top1 = 87.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.360, top1 = 91.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 0.422, top1 = 87.85%], valid : [loss = 1.273, top1 = 66.97%], test : [loss = 1.257, top1 = 66.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.18%], valid : [loss = 2.413, top1 = 38.89%], test : [loss = 2.441, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.40%], valid : [loss = 0.810, top1 = 71.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1234/15625) 001234-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.60 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1235/15625) 001235-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.48%], valid : [loss = 0.844, top1 = 79.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.125, top1 = 95.81%], test  : [loss = 0.535, top1 = 85.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.11 ms.
cifar100       train : [loss = 0.842, top1 = 75.55%], valid : [loss = 1.677, top1 = 57.31%], test : [loss = 1.681, top1 = 57.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.32%], valid : [loss = 3.178, top1 = 24.27%], test : [loss = 3.211, top1 = 23.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.037, top1 = 62.71%], valid : [loss = 1.096, top1 = 60.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1236/15625) 001236-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.067, top1 = 97.88%], valid : [loss = 0.640, top1 = 84.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.093, top1 = 96.94%], test  : [loss = 0.437, top1 = 87.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.699, top1 = 79.36%], valid : [loss = 1.576, top1 = 59.85%], test : [loss = 1.594, top1 = 59.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 25.11%], valid : [loss = 3.081, top1 = 24.93%], test : [loss = 3.102, top1 = 24.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.196, top1 = 56.01%], valid : [loss = 1.210, top1 = 55.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1237/15625) 001237-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.484, top1 = 89.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.309, top1 = 93.11%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.89 ms.
cifar100       train : [loss = 0.131, top1 = 97.20%], valid : [loss = 1.238, top1 = 70.75%], test : [loss = 1.250, top1 = 70.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.747, top1 = 53.41%], valid : [loss = 2.176, top1 = 43.97%], test : [loss = 2.162, top1 = 45.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.59%], valid : [loss = 0.708, top1 = 75.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1238/15625) 001238-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.26%], valid : [loss = 0.524, top1 = 84.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.188, top1 = 93.65%], test  : [loss = 0.386, top1 = 87.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 1.194, top1 = 66.11%], valid : [loss = 1.506, top1 = 58.78%], test : [loss = 1.520, top1 = 58.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.652, top1 = 33.72%], valid : [loss = 2.678, top1 = 33.22%], test : [loss = 2.725, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.68%], valid : [loss = 0.982, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1239/15625) 001239-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.527, top1 = 89.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.324, top1 = 92.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.231, top1 = 93.99%], valid : [loss = 1.255, top1 = 68.71%], test : [loss = 1.271, top1 = 68.79%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.96%], valid : [loss = 2.230, top1 = 42.54%], test : [loss = 2.242, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.17%], valid : [loss = 0.780, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1240/15625) 001240-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.60%], valid : [loss = 0.536, top1 = 85.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.116, top1 = 96.26%], test  : [loss = 0.357, top1 = 89.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.53 ms.
cifar100       train : [loss = 0.789, top1 = 77.03%], valid : [loss = 1.376, top1 = 63.05%], test : [loss = 1.366, top1 = 63.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.54%], valid : [loss = 2.571, top1 = 34.72%], test : [loss = 2.610, top1 = 34.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.36%], valid : [loss = 0.922, top1 = 67.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1241/15625) 001241-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.94%], valid : [loss = 0.538, top1 = 85.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.090, top1 = 97.19%], test  : [loss = 0.375, top1 = 89.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 0.781, top1 = 77.25%], valid : [loss = 1.381, top1 = 63.03%], test : [loss = 1.396, top1 = 62.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 37.03%], valid : [loss = 2.574, top1 = 34.74%], test : [loss = 2.630, top1 = 34.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.43%], valid : [loss = 0.872, top1 = 69.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1242/15625) 001242-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.92%], valid : [loss = 0.858, top1 = 71.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.567, top1 = 80.16%], test  : [loss = 0.720, top1 = 75.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.14 ms.
cifar100       train : [loss = 1.791, top1 = 51.95%], valid : [loss = 2.068, top1 = 46.63%], test : [loss = 2.076, top1 = 46.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.75%], valid : [loss = 3.638, top1 = 16.63%], test : [loss = 3.657, top1 = 15.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1243/15625) 001243-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.22%], valid : [loss = 0.455, top1 = 86.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.07 ms.
cifar10        train : [loss = 0.115, top1 = 96.44%], test  : [loss = 0.335, top1 = 89.44%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.89 ms.
cifar100       train : [loss = 0.852, top1 = 75.91%], valid : [loss = 1.298, top1 = 63.95%], test : [loss = 1.287, top1 = 63.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.79%], valid : [loss = 2.623, top1 = 34.39%], test : [loss = 2.642, top1 = 33.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.34%], valid : [loss = 0.640, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1244/15625) 001244-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.31%], valid : [loss = 0.518, top1 = 86.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.098, top1 = 96.84%], test  : [loss = 0.350, top1 = 89.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.08 ms.
cifar100       train : [loss = 0.676, top1 = 80.58%], valid : [loss = 1.291, top1 = 65.19%], test : [loss = 1.281, top1 = 65.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 2.431, top1 = 38.11%], valid : [loss = 2.535, top1 = 36.22%], test : [loss = 2.541, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.15%], valid : [loss = 0.875, top1 = 69.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1245/15625) 001245-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.500, top1 = 88.94%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.00 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.315, top1 = 92.26%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.88 ms.
cifar100       train : [loss = 0.248, top1 = 93.86%], valid : [loss = 1.239, top1 = 68.62%], test : [loss = 1.262, top1 = 68.33%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.51%], valid : [loss = 2.282, top1 = 42.23%], test : [loss = 2.289, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.42%], valid : [loss = 0.656, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1246/15625) 001246-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.569, top1 = 87.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.380, top1 = 91.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 0.386, top1 = 89.06%], valid : [loss = 1.413, top1 = 65.13%], test : [loss = 1.399, top1 = 65.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.265, top1 = 41.73%], valid : [loss = 2.471, top1 = 37.78%], test : [loss = 2.506, top1 = 36.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.756, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1247/15625) 001247-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.85 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.09%], valid : [loss = 0.580, top1 = 86.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10        train : [loss = 0.065, top1 = 97.90%], test  : [loss = 0.381, top1 = 89.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.673, top1 = 80.14%], valid : [loss = 1.348, top1 = 64.38%], test : [loss = 1.336, top1 = 64.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.355, top1 = 39.63%], valid : [loss = 2.480, top1 = 37.22%], test : [loss = 2.510, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.58%], valid : [loss = 0.783, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1248/15625) 001248-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.443, top1 = 89.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.292, top1 = 92.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.45 ms.
cifar100       train : [loss = 0.201, top1 = 95.38%], valid : [loss = 1.257, top1 = 69.47%], test : [loss = 1.247, top1 = 69.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 51.04%], valid : [loss = 2.268, top1 = 42.42%], test : [loss = 2.300, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.398, top1 = 86.10%], valid : [loss = 0.517, top1 = 82.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1249/15625) 001249-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.88%], valid : [loss = 0.849, top1 = 71.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.571, top1 = 80.08%], test  : [loss = 0.729, top1 = 75.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.87 ms.
cifar100       train : [loss = 1.792, top1 = 51.76%], valid : [loss = 2.064, top1 = 46.64%], test : [loss = 2.056, top1 = 47.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 3.596, top1 = 16.69%], valid : [loss = 3.645, top1 = 16.64%], test : [loss = 3.684, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1250/15625) 001250-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.571, top1 = 88.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.355, top1 = 92.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.41 ms.
cifar100       train : [loss = 0.139, top1 = 96.75%], valid : [loss = 1.396, top1 = 68.18%], test : [loss = 1.393, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.10%], valid : [loss = 2.352, top1 = 40.64%], test : [loss = 2.364, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.22%], valid : [loss = 0.913, top1 = 67.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1251/15625) 001251-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.553, top1 = 88.35%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.364, top1 = 91.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.96 ms.
cifar100       train : [loss = 0.222, top1 = 94.43%], valid : [loss = 1.262, top1 = 68.89%], test : [loss = 1.291, top1 = 68.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.97%], valid : [loss = 2.228, top1 = 42.73%], test : [loss = 2.242, top1 = 43.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.95%], valid : [loss = 0.720, top1 = 75.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1252/15625) 001252-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.25%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.318, top1 = 92.81%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.84 ms.
cifar100       train : [loss = 0.089, top1 = 98.62%], valid : [loss = 1.293, top1 = 69.55%], test : [loss = 1.297, top1 = 69.66%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.33 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.15%], valid : [loss = 2.270, top1 = 42.83%], test : [loss = 2.272, top1 = 42.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.84%], valid : [loss = 0.704, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1253/15625) 001253-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.659, top1 = 85.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.48 ms.
cifar10        train : [loss = 0.031, top1 = 99.18%], test  : [loss = 0.426, top1 = 89.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.13 ms.
cifar100       train : [loss = 0.345, top1 = 90.61%], valid : [loss = 1.541, top1 = 63.42%], test : [loss = 1.518, top1 = 63.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.65%], valid : [loss = 2.613, top1 = 35.00%], test : [loss = 2.633, top1 = 34.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.25%], valid : [loss = 0.836, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1254/15625) 001254-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.75%], valid : [loss = 0.571, top1 = 87.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.017, top1 = 99.52%], test  : [loss = 0.372, top1 = 91.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.15 ms.
cifar100       train : [loss = 0.258, top1 = 92.85%], valid : [loss = 1.357, top1 = 67.29%], test : [loss = 1.367, top1 = 67.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 2.455, top1 = 37.01%], valid : [loss = 2.579, top1 = 34.16%], test : [loss = 2.586, top1 = 34.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.62%], valid : [loss = 0.954, top1 = 65.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1255/15625) 001255-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.501, top1 = 89.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.329, top1 = 92.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.118, top1 = 97.71%], valid : [loss = 1.312, top1 = 68.83%], test : [loss = 1.299, top1 = 69.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 1.714, top1 = 54.13%], valid : [loss = 2.170, top1 = 43.93%], test : [loss = 2.184, top1 = 44.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1256/15625) 001256-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.566, top1 = 88.69%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.61 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.354, top1 = 92.30%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.17 ms.
cifar100       train : [loss = 0.135, top1 = 97.08%], valid : [loss = 1.346, top1 = 68.99%], test : [loss = 1.355, top1 = 68.73%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.85 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.31%], valid : [loss = 2.277, top1 = 42.46%], test : [loss = 2.251, top1 = 42.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.02%], valid : [loss = 0.839, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1257/15625) 001257-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.614, top1 = 85.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.92 ms.
cifar10        train : [loss = 0.071, top1 = 97.86%], test  : [loss = 0.394, top1 = 88.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.82 ms.
cifar100       train : [loss = 0.716, top1 = 79.25%], valid : [loss = 1.374, top1 = 63.42%], test : [loss = 1.379, top1 = 63.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.13%], valid : [loss = 2.656, top1 = 34.01%], test : [loss = 2.684, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1258/15625) 001258-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.49%], valid : [loss = 0.613, top1 = 84.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.091, top1 = 96.98%], test  : [loss = 0.417, top1 = 88.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 0.646, top1 = 80.98%], valid : [loss = 1.576, top1 = 60.23%], test : [loss = 1.600, top1 = 60.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 3.245, top1 = 21.22%], valid : [loss = 3.265, top1 = 20.98%], test : [loss = 3.293, top1 = 20.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.206, top1 = 56.23%], valid : [loss = 1.222, top1 = 55.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1259/15625) 001259-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.268, top1 = 90.88%], valid : [loss = 0.538, top1 = 83.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.242, top1 = 91.73%], test  : [loss = 0.392, top1 = 87.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.21 ms.
cifar100       train : [loss = 1.334, top1 = 62.31%], valid : [loss = 1.609, top1 = 56.21%], test : [loss = 1.590, top1 = 56.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.799, top1 = 30.74%], valid : [loss = 2.806, top1 = 30.62%], test : [loss = 2.855, top1 = 30.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.26%], valid : [loss = 1.027, top1 = 63.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1260/15625) 001260-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.93%], valid : [loss = 0.539, top1 = 86.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10        train : [loss = 0.073, top1 = 97.70%], test  : [loss = 0.357, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.30 ms.
cifar100       train : [loss = 0.722, top1 = 78.71%], valid : [loss = 1.364, top1 = 64.01%], test : [loss = 1.352, top1 = 63.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.21%], valid : [loss = 2.647, top1 = 33.67%], test : [loss = 2.687, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.04%], valid : [loss = 0.668, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1261/15625) 001261-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.491, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.51 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.325, top1 = 92.26%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.81 ms.
cifar100       train : [loss = 0.162, top1 = 96.46%], valid : [loss = 1.314, top1 = 68.33%], test : [loss = 1.312, top1 = 68.77%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 1.799, top1 = 52.19%], valid : [loss = 2.215, top1 = 43.02%], test : [loss = 2.235, top1 = 43.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.75%], valid : [loss = 0.560, top1 = 80.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1262/15625) 001262-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.335, top1 = 91.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.16 ms.
cifar100       train : [loss = 0.342, top1 = 90.68%], valid : [loss = 1.304, top1 = 66.72%], test : [loss = 1.287, top1 = 66.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.55%], valid : [loss = 2.420, top1 = 38.76%], test : [loss = 2.422, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1263/15625) 001263-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.04%], valid : [loss = 0.475, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10        train : [loss = 0.299, top1 = 89.95%], test  : [loss = 0.402, top1 = 86.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.88 ms.
cifar100       train : [loss = 1.338, top1 = 62.94%], valid : [loss = 1.535, top1 = 57.65%], test : [loss = 1.504, top1 = 58.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.64%], valid : [loss = 2.892, top1 = 29.72%], test : [loss = 2.949, top1 = 28.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1264/15625) 001264-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.523, top1 = 89.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.321, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.08 ms.
cifar100       train : [loss = 0.118, top1 = 97.65%], valid : [loss = 1.315, top1 = 69.28%], test : [loss = 1.297, top1 = 69.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.74%], valid : [loss = 2.310, top1 = 41.29%], test : [loss = 2.295, top1 = 42.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.68%], valid : [loss = 0.779, top1 = 72.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1265/15625) 001265-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.482, top1 = 89.27%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.317, top1 = 92.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.51 ms.
cifar100       train : [loss = 0.285, top1 = 92.63%], valid : [loss = 1.193, top1 = 68.75%], test : [loss = 1.206, top1 = 69.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.54 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.63%], valid : [loss = 2.227, top1 = 42.71%], test : [loss = 2.233, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.28%], valid : [loss = 0.628, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1266/15625) 001266-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.518, top1 = 82.00%], valid : [loss = 0.669, top1 = 77.42%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10        train : [loss = 0.526, top1 = 81.86%], test  : [loss = 0.601, top1 = 79.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 1.676, top1 = 54.45%], valid : [loss = 1.845, top1 = 50.78%], test : [loss = 1.848, top1 = 51.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.338, top1 = 21.14%], valid : [loss = 3.327, top1 = 21.67%], test : [loss = 3.355, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1267/15625) 001267-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.489, top1 = 89.67%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.77 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.302, top1 = 93.27%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.64 ms.
cifar100       train : [loss = 0.123, top1 = 97.63%], valid : [loss = 1.245, top1 = 69.80%], test : [loss = 1.250, top1 = 70.13%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.01 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.76%], valid : [loss = 2.166, top1 = 44.51%], test : [loss = 2.175, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.53%], valid : [loss = 0.634, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1268/15625) 001268-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.14%], valid : [loss = 0.589, top1 = 86.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.053, top1 = 98.33%], test  : [loss = 0.376, top1 = 90.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.542, top1 = 83.87%], valid : [loss = 1.329, top1 = 65.21%], test : [loss = 1.325, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 36.94%], valid : [loss = 2.606, top1 = 34.07%], test : [loss = 2.620, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.40%], valid : [loss = 0.942, top1 = 66.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1269/15625) 001269-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.84%], valid : [loss = 0.517, top1 = 86.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10        train : [loss = 0.073, top1 = 97.81%], test  : [loss = 0.345, top1 = 90.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.18 ms.
cifar100       train : [loss = 0.660, top1 = 80.94%], valid : [loss = 1.305, top1 = 64.85%], test : [loss = 1.290, top1 = 65.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.75%], valid : [loss = 2.476, top1 = 37.11%], test : [loss = 2.497, top1 = 37.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 70.20%], valid : [loss = 0.890, top1 = 68.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1270/15625) 001270-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.77 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.642, top1 = 86.03%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10        train : [loss = 0.023, top1 = 99.48%], test  : [loss = 0.446, top1 = 89.29%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.86 ms.
cifar100       train : [loss = 0.286, top1 = 93.12%], valid : [loss = 1.504, top1 = 64.08%], test : [loss = 1.505, top1 = 63.99%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.250, top1 = 42.13%], valid : [loss = 2.690, top1 = 34.14%], test : [loss = 2.714, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.38%], valid : [loss = 0.798, top1 = 72.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1271/15625) 001271-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.561, top1 = 87.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.391, top1 = 91.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 0.385, top1 = 89.16%], valid : [loss = 1.400, top1 = 65.44%], test : [loss = 1.383, top1 = 65.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.258, top1 = 41.83%], valid : [loss = 2.476, top1 = 37.82%], test : [loss = 2.495, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.66%], valid : [loss = 0.778, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1272/15625) 001272-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.24 ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.13%], valid : [loss = 0.849, top1 = 71.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.06 ms.
cifar10        train : [loss = 0.685, top1 = 76.04%], test  : [loss = 0.769, top1 = 73.35%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.14 ms.
cifar100       train : [loss = 1.961, top1 = 47.79%], valid : [loss = 2.121, top1 = 44.69%], test : [loss = 2.149, top1 = 44.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.37 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.77%], valid : [loss = 3.672, top1 = 15.59%], test : [loss = 3.690, top1 = 14.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1273/15625) 001273-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.64%], valid : [loss = 0.866, top1 = 75.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 0.313, top1 = 89.02%], test  : [loss = 0.629, top1 = 80.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.36 ms.
cifar100       train : [loss = 1.351, top1 = 62.06%], valid : [loss = 1.910, top1 = 50.29%], test : [loss = 1.917, top1 = 50.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 3.462, top1 = 17.96%], valid : [loss = 3.495, top1 = 17.82%], test : [loss = 3.487, top1 = 17.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.19%], valid : [loss = 1.301, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1274/15625) 001274-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.24%], valid : [loss = 0.674, top1 = 85.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.043, top1 = 98.65%], test  : [loss = 0.440, top1 = 89.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.412, top1 = 88.34%], valid : [loss = 1.590, top1 = 61.69%], test : [loss = 1.593, top1 = 61.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 29.76%], valid : [loss = 2.908, top1 = 28.32%], test : [loss = 2.920, top1 = 27.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.50%], valid : [loss = 1.011, top1 = 63.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1275/15625) 001275-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.518, top1 = 89.51%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.54 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 93.18%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.39 ms.
cifar100       train : [loss = 0.067, top1 = 98.83%], valid : [loss = 1.358, top1 = 70.01%], test : [loss = 1.365, top1 = 69.90%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=23.11 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.21%], valid : [loss = 2.419, top1 = 38.33%], test : [loss = 2.424, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 69.72%], valid : [loss = 0.888, top1 = 68.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1276/15625) 001276-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.86%], valid : [loss = 0.758, top1 = 74.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.67 ms.
cifar10        train : [loss = 0.474, top1 = 83.44%], test  : [loss = 0.593, top1 = 79.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.14 ms.
cifar100       train : [loss = 1.874, top1 = 49.17%], valid : [loss = 2.052, top1 = 45.69%], test : [loss = 2.054, top1 = 45.71%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 3.509, top1 = 17.73%], valid : [loss = 3.500, top1 = 18.11%], test : [loss = 3.532, top1 = 17.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.218, top1 = 55.89%], valid : [loss = 1.255, top1 = 54.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1277/15625) 001277-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.514, top1 = 89.66%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.33%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.38 ms.
cifar100       train : [loss = 0.070, top1 = 98.93%], valid : [loss = 1.371, top1 = 69.56%], test : [loss = 1.358, top1 = 69.77%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=23.39 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.27%], valid : [loss = 2.392, top1 = 38.82%], test : [loss = 2.396, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.48%], valid : [loss = 0.731, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1278/15625) 001278-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.40%], valid : [loss = 0.656, top1 = 84.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.074, top1 = 97.60%], test  : [loss = 0.425, top1 = 88.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.654, top1 = 80.74%], valid : [loss = 1.523, top1 = 60.81%], test : [loss = 1.525, top1 = 60.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 27.96%], valid : [loss = 2.972, top1 = 27.04%], test : [loss = 3.008, top1 = 26.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 65.04%], valid : [loss = 1.010, top1 = 63.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1279/15625) 001279-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.58%], valid : [loss = 0.658, top1 = 84.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10        train : [loss = 0.083, top1 = 97.33%], test  : [loss = 0.415, top1 = 88.31%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.44 ms.
cifar100       train : [loss = 0.783, top1 = 77.05%], valid : [loss = 1.423, top1 = 62.13%], test : [loss = 1.412, top1 = 61.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.599, top1 = 34.50%], valid : [loss = 2.727, top1 = 32.77%], test : [loss = 2.753, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 69.91%], valid : [loss = 0.886, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1280/15625) 001280-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.260, top1 = 91.11%], valid : [loss = 0.541, top1 = 83.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.243, top1 = 91.72%], test  : [loss = 0.402, top1 = 86.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.38 ms.
cifar100       train : [loss = 1.315, top1 = 62.90%], valid : [loss = 1.602, top1 = 56.83%], test : [loss = 1.576, top1 = 57.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.98 ms.
ImageNet16-120 train : [loss = 2.861, top1 = 29.61%], valid : [loss = 2.862, top1 = 29.77%], test : [loss = 2.937, top1 = 28.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.80%], valid : [loss = 1.026, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1281/15625) 001281-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.48 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.350, top1 = 92.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.88 ms.
cifar100       train : [loss = 0.047, top1 = 99.54%], valid : [loss = 1.423, top1 = 69.55%], test : [loss = 1.434, top1 = 69.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 1.619, top1 = 56.53%], valid : [loss = 2.414, top1 = 41.34%], test : [loss = 2.420, top1 = 41.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 79.97%], valid : [loss = 0.677, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1282/15625) 001282-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.686, top1 = 85.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.38 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.461, top1 = 89.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.00 ms.
cifar100       train : [loss = 0.393, top1 = 89.09%], valid : [loss = 1.678, top1 = 60.63%], test : [loss = 1.667, top1 = 60.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.75%], valid : [loss = 2.633, top1 = 34.02%], test : [loss = 2.660, top1 = 34.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.62%], valid : [loss = 0.865, top1 = 69.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1283/15625) 001283-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.91%], valid : [loss = 0.455, top1 = 86.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10        train : [loss = 0.149, top1 = 95.17%], test  : [loss = 0.351, top1 = 88.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.31 ms.
cifar100       train : [loss = 0.972, top1 = 72.30%], valid : [loss = 1.340, top1 = 62.55%], test : [loss = 1.329, top1 = 62.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.15%], valid : [loss = 2.673, top1 = 33.47%], test : [loss = 2.696, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1284/15625) 001284-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.49%], valid : [loss = 0.854, top1 = 72.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.551, top1 = 80.75%], test  : [loss = 0.713, top1 = 75.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 1.779, top1 = 52.12%], valid : [loss = 2.056, top1 = 46.77%], test : [loss = 2.061, top1 = 47.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.80%], valid : [loss = 3.643, top1 = 16.67%], test : [loss = 3.671, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1285/15625) 001285-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.428, top1 = 90.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.89 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.291, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.44 ms.
cifar100       train : [loss = 0.116, top1 = 97.90%], valid : [loss = 1.288, top1 = 69.68%], test : [loss = 1.278, top1 = 69.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.42%], valid : [loss = 2.212, top1 = 43.16%], test : [loss = 2.234, top1 = 44.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.408, top1 = 86.01%], valid : [loss = 0.529, top1 = 82.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1286/15625) 001286-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.39%], valid : [loss = 0.727, top1 = 84.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.053, top1 = 98.37%], test  : [loss = 0.444, top1 = 88.68%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.74 ms.
cifar100       train : [loss = 0.639, top1 = 81.29%], valid : [loss = 1.519, top1 = 62.13%], test : [loss = 1.493, top1 = 61.81%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.31%], valid : [loss = 2.829, top1 = 30.43%], test : [loss = 2.878, top1 = 30.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.99%], valid : [loss = 0.878, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1287/15625) 001287-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.433, top1 = 90.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.293, top1 = 92.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.92 ms.
cifar100       train : [loss = 0.102, top1 = 98.29%], valid : [loss = 1.313, top1 = 69.43%], test : [loss = 1.304, top1 = 69.49%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.48%], valid : [loss = 2.247, top1 = 42.74%], test : [loss = 2.268, top1 = 43.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.85%], valid : [loss = 0.526, top1 = 82.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1288/15625) 001288-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.447, top1 = 89.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.316, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.30 ms.
cifar100       train : [loss = 0.326, top1 = 91.10%], valid : [loss = 1.289, top1 = 67.20%], test : [loss = 1.305, top1 = 67.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.28%], valid : [loss = 2.360, top1 = 39.91%], test : [loss = 2.393, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.89%], valid : [loss = 0.538, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1289/15625) 001289-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.492, top1 = 89.18%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.304, top1 = 92.52%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.35 ms.
cifar100       train : [loss = 0.304, top1 = 91.82%], valid : [loss = 1.268, top1 = 68.52%], test : [loss = 1.266, top1 = 68.28%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.89 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.01%], valid : [loss = 2.223, top1 = 42.39%], test : [loss = 2.226, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.16%], valid : [loss = 0.627, top1 = 78.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1290/15625) 001290-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.485, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.337, top1 = 92.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.211, top1 = 94.61%], valid : [loss = 1.345, top1 = 68.24%], test : [loss = 1.382, top1 = 67.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.64%], valid : [loss = 2.282, top1 = 42.07%], test : [loss = 2.319, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.94%], valid : [loss = 0.562, top1 = 80.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1291/15625) 001291-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.22 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.31 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.88 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.08 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1292/15625) 001292-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.55%], valid : [loss = 0.571, top1 = 87.11%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.42 ms.
cifar10        train : [loss = 0.039, top1 = 98.80%], test  : [loss = 0.378, top1 = 90.03%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.45 ms.
cifar100       train : [loss = 0.451, top1 = 87.10%], valid : [loss = 1.270, top1 = 66.88%], test : [loss = 1.282, top1 = 66.58%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 44.01%], valid : [loss = 2.385, top1 = 39.03%], test : [loss = 2.404, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.58%], valid : [loss = 0.780, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1293/15625) 001293-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.85 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.03%], valid : [loss = 0.582, top1 = 86.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.067, top1 = 97.81%], test  : [loss = 0.383, top1 = 89.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.705, top1 = 79.32%], valid : [loss = 1.339, top1 = 64.16%], test : [loss = 1.328, top1 = 64.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.357, top1 = 39.53%], valid : [loss = 2.475, top1 = 37.03%], test : [loss = 2.513, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.02%], valid : [loss = 0.763, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1294/15625) 001294-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.46%], valid : [loss = 0.835, top1 = 79.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10        train : [loss = 0.127, top1 = 95.77%], test  : [loss = 0.534, top1 = 85.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.08 ms.
cifar100       train : [loss = 0.855, top1 = 75.22%], valid : [loss = 1.701, top1 = 57.38%], test : [loss = 1.704, top1 = 57.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 3.026, top1 = 26.60%], valid : [loss = 3.155, top1 = 24.72%], test : [loss = 3.195, top1 = 23.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.111, top1 = 59.92%], valid : [loss = 1.151, top1 = 59.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1295/15625) 001295-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.508, top1 = 89.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.337, top1 = 92.49%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.84 ms.
cifar100       train : [loss = 0.211, top1 = 94.72%], valid : [loss = 1.254, top1 = 68.91%], test : [loss = 1.264, top1 = 68.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.59%], valid : [loss = 2.248, top1 = 42.30%], test : [loss = 2.277, top1 = 42.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.55%], valid : [loss = 0.617, top1 = 78.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1296/15625) 001296-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.79 ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.28%], valid : [loss = 0.852, top1 = 71.04%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10        train : [loss = 0.677, top1 = 76.33%], test  : [loss = 0.766, top1 = 73.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.92 ms.
cifar100       train : [loss = 1.956, top1 = 48.02%], valid : [loss = 2.124, top1 = 44.67%], test : [loss = 2.135, top1 = 44.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.29 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.73%], valid : [loss = 3.685, top1 = 15.62%], test : [loss = 3.696, top1 = 14.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1297/15625) 001297-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.366, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.121, top1 = 97.68%], valid : [loss = 1.420, top1 = 68.09%], test : [loss = 1.406, top1 = 67.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.62%], valid : [loss = 2.402, top1 = 40.01%], test : [loss = 2.400, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.38%], valid : [loss = 0.719, top1 = 75.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1298/15625) 001298-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.528, top1 = 88.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.328, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.344, top1 = 90.54%], valid : [loss = 1.282, top1 = 67.27%], test : [loss = 1.289, top1 = 67.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.52%], valid : [loss = 2.413, top1 = 39.23%], test : [loss = 2.416, top1 = 38.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.27%], valid : [loss = 0.642, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1299/15625) 001299-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.580, top1 = 87.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.387, top1 = 91.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.49 ms.
cifar100       train : [loss = 0.401, top1 = 88.67%], valid : [loss = 1.403, top1 = 65.37%], test : [loss = 1.393, top1 = 65.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 41.01%], valid : [loss = 2.513, top1 = 36.87%], test : [loss = 2.538, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.22%], valid : [loss = 0.815, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1300/15625) 001300-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.560, top1 = 88.95%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.366, top1 = 92.57%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.72 ms.
cifar100       train : [loss = 0.098, top1 = 98.26%], valid : [loss = 1.448, top1 = 67.77%], test : [loss = 1.440, top1 = 68.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.61%], valid : [loss = 2.439, top1 = 39.49%], test : [loss = 2.456, top1 = 39.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.64%], valid : [loss = 0.713, top1 = 75.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1301/15625) 001301-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.541, top1 = 88.96%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.372, top1 = 92.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.11 ms.
cifar100       train : [loss = 0.147, top1 = 96.68%], valid : [loss = 1.439, top1 = 67.19%], test : [loss = 1.449, top1 = 66.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.65 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 38.69%], valid : [loss = 2.561, top1 = 34.74%], test : [loss = 2.552, top1 = 35.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 64.56%], valid : [loss = 1.005, top1 = 63.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1302/15625) 001302-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.46%], valid : [loss = 0.531, top1 = 84.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10        train : [loss = 0.178, top1 = 93.99%], test  : [loss = 0.381, top1 = 88.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 1.182, top1 = 66.37%], valid : [loss = 1.520, top1 = 58.75%], test : [loss = 1.510, top1 = 59.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.91%], valid : [loss = 2.684, top1 = 33.16%], test : [loss = 2.740, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1303/15625) 001303-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=23.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.474, top1 = 89.31%]
cifar10        FLOP= 62.83 M, Params=0.456 MB, latency=24.03 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.305, top1 = 92.49%]
cifar100       FLOP= 62.84 M, Params=0.462 MB, latency=22.00 ms.
cifar100       train : [loss = 0.187, top1 = 95.80%], valid : [loss = 1.229, top1 = 69.78%], test : [loss = 1.235, top1 = 69.61%]
ImageNet16-120 FLOP= 15.72 M, Params=0.463 MB, latency=22.29 ms.
ImageNet16-120 train : [loss = 1.793, top1 = 52.31%], valid : [loss = 2.181, top1 = 43.66%], test : [loss = 2.199, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.40%], valid : [loss = 0.727, top1 = 74.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1304/15625) 001304-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.484, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.324, top1 = 91.33%], valid : [loss = 1.249, top1 = 67.65%], test : [loss = 1.265, top1 = 67.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.92%], valid : [loss = 2.301, top1 = 40.87%], test : [loss = 2.332, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1305/15625) 001305-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.658, top1 = 86.12%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10        train : [loss = 0.021, top1 = 99.52%], test  : [loss = 0.451, top1 = 89.48%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.57 ms.
cifar100       train : [loss = 0.323, top1 = 91.64%], valid : [loss = 1.474, top1 = 64.05%], test : [loss = 1.457, top1 = 64.55%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 41.96%], valid : [loss = 2.594, top1 = 35.11%], test : [loss = 2.592, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.16%], valid : [loss = 0.805, top1 = 71.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1306/15625) 001306-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.84%], valid : [loss = 0.660, top1 = 85.64%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.00 ms.
cifar10        train : [loss = 0.031, top1 = 99.26%], test  : [loss = 0.427, top1 = 89.24%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.94 ms.
cifar100       train : [loss = 0.388, top1 = 89.64%], valid : [loss = 1.450, top1 = 64.13%], test : [loss = 1.424, top1 = 64.47%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.31 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 40.98%], valid : [loss = 2.602, top1 = 35.22%], test : [loss = 2.625, top1 = 34.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.76%], valid : [loss = 0.777, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1307/15625) 001307-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.54%], valid : [loss = 0.583, top1 = 86.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.40 ms.
cifar10        train : [loss = 0.042, top1 = 98.77%], test  : [loss = 0.399, top1 = 89.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.87 ms.
cifar100       train : [loss = 0.553, top1 = 83.82%], valid : [loss = 1.407, top1 = 63.56%], test : [loss = 1.402, top1 = 64.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.04%], valid : [loss = 2.625, top1 = 34.18%], test : [loss = 2.660, top1 = 33.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.08%], valid : [loss = 0.683, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1308/15625) 001308-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.63%], valid : [loss = 0.660, top1 = 78.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10        train : [loss = 0.505, top1 = 82.55%], test  : [loss = 0.585, top1 = 80.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.10 ms.
cifar100       train : [loss = 1.689, top1 = 54.28%], valid : [loss = 1.853, top1 = 50.69%], test : [loss = 1.864, top1 = 50.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.31%], valid : [loss = 3.308, top1 = 21.40%], test : [loss = 3.333, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1309/15625) 001309-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.304, top1 = 89.46%], valid : [loss = 0.567, top1 = 81.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.264, top1 = 90.97%], test  : [loss = 0.415, top1 = 86.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.05 ms.
cifar100       train : [loss = 1.491, top1 = 58.27%], valid : [loss = 1.742, top1 = 53.40%], test : [loss = 1.729, top1 = 52.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.09%], valid : [loss = 2.943, top1 = 27.97%], test : [loss = 3.000, top1 = 26.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1310/15625) 001310-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.91 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.11%], valid : [loss = 0.472, top1 = 84.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10        train : [loss = 0.304, top1 = 89.86%], test  : [loss = 0.407, top1 = 86.40%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.55 ms.
cifar100       train : [loss = 1.328, top1 = 63.15%], valid : [loss = 1.532, top1 = 57.98%], test : [loss = 1.510, top1 = 58.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.53%], valid : [loss = 2.905, top1 = 29.44%], test : [loss = 2.965, top1 = 28.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1311/15625) 001311-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.69%], valid : [loss = 0.688, top1 = 76.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.532, top1 = 81.53%], test  : [loss = 0.603, top1 = 79.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.19 ms.
cifar100       train : [loss = 1.786, top1 = 51.73%], valid : [loss = 1.931, top1 = 48.84%], test : [loss = 1.947, top1 = 48.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 3.394, top1 = 19.96%], valid : [loss = 3.380, top1 = 20.78%], test : [loss = 3.415, top1 = 19.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.379, top1 = 49.75%], valid : [loss = 1.391, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1312/15625) 001312-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.22%], valid : [loss = 0.651, top1 = 78.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10        train : [loss = 0.508, top1 = 82.42%], test  : [loss = 0.587, top1 = 80.22%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.91 ms.
cifar100       train : [loss = 1.691, top1 = 54.11%], valid : [loss = 1.865, top1 = 50.83%], test : [loss = 1.875, top1 = 50.64%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.32 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.32%], valid : [loss = 3.323, top1 = 21.21%], test : [loss = 3.355, top1 = 21.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1313/15625) 001313-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.511, top1 = 88.72%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.334, top1 = 92.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.98 ms.
cifar100       train : [loss = 0.356, top1 = 90.26%], valid : [loss = 1.287, top1 = 66.57%], test : [loss = 1.285, top1 = 67.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.49%], valid : [loss = 2.419, top1 = 38.47%], test : [loss = 2.416, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.06%], valid : [loss = 0.642, top1 = 77.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1314/15625) 001314-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.584, top1 = 88.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.47 ms.
cifar10        train : [loss = 0.026, top1 = 99.24%], test  : [loss = 0.354, top1 = 91.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.57 ms.
cifar100       train : [loss = 0.314, top1 = 91.28%], valid : [loss = 1.259, top1 = 68.58%], test : [loss = 1.298, top1 = 67.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.089, top1 = 45.48%], valid : [loss = 2.315, top1 = 40.68%], test : [loss = 2.337, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.72%], valid : [loss = 0.913, top1 = 67.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1315/15625) 001315-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.56%], valid : [loss = 0.838, top1 = 82.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10        train : [loss = 0.050, top1 = 98.54%], test  : [loss = 0.560, top1 = 86.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.38 ms.
cifar100       train : [loss = 0.508, top1 = 85.62%], valid : [loss = 1.741, top1 = 58.86%], test : [loss = 1.745, top1 = 58.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 33.05%], valid : [loss = 3.005, top1 = 27.39%], test : [loss = 3.032, top1 = 27.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.29%], valid : [loss = 0.915, top1 = 67.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1316/15625) 001316-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.555, top1 = 89.15%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.352, top1 = 92.80%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.18 ms.
cifar100       train : [loss = 0.076, top1 = 98.60%], valid : [loss = 1.432, top1 = 68.91%], test : [loss = 1.439, top1 = 69.03%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 2.090, top1 = 45.28%], valid : [loss = 2.370, top1 = 39.20%], test : [loss = 2.384, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 68.60%], valid : [loss = 0.888, top1 = 68.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1317/15625) 001317-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.416, top1 = 91.37%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.272, top1 = 94.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.49 ms.
cifar100       train : [loss = 0.032, top1 = 99.67%], valid : [loss = 1.285, top1 = 72.64%], test : [loss = 1.265, top1 = 72.57%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 1.307, top1 = 63.99%], valid : [loss = 2.215, top1 = 45.46%], test : [loss = 2.213, top1 = 45.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.326, top1 = 88.81%], valid : [loss = 0.478, top1 = 84.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1318/15625) 001318-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.412, top1 = 85.63%], valid : [loss = 0.658, top1 = 78.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.377, top1 = 86.93%], test  : [loss = 0.532, top1 = 82.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 1.602, top1 = 55.84%], valid : [loss = 1.835, top1 = 51.19%], test : [loss = 1.848, top1 = 50.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 3.281, top1 = 21.79%], valid : [loss = 3.305, top1 = 22.09%], test : [loss = 3.316, top1 = 21.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.159, top1 = 58.40%], valid : [loss = 1.199, top1 = 57.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1319/15625) 001319-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.617, top1 = 85.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10        train : [loss = 0.072, top1 = 97.77%], test  : [loss = 0.409, top1 = 88.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.56 ms.
cifar100       train : [loss = 0.712, top1 = 79.36%], valid : [loss = 1.395, top1 = 62.86%], test : [loss = 1.361, top1 = 63.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.08%], valid : [loss = 2.651, top1 = 33.89%], test : [loss = 2.701, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1320/15625) 001320-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.35%], valid : [loss = 0.601, top1 = 86.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.395, top1 = 90.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.39 ms.
cifar100       train : [loss = 0.269, top1 = 92.67%], valid : [loss = 1.545, top1 = 64.15%], test : [loss = 1.571, top1 = 63.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.967, top1 = 26.55%], valid : [loss = 3.043, top1 = 25.42%], test : [loss = 3.040, top1 = 25.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.954, top1 = 65.55%], valid : [loss = 1.006, top1 = 64.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1321/15625) 001321-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.07%], valid : [loss = 0.568, top1 = 86.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.064, top1 = 97.94%], test  : [loss = 0.373, top1 = 90.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.17 ms.
cifar100       train : [loss = 0.660, top1 = 80.51%], valid : [loss = 1.345, top1 = 64.11%], test : [loss = 1.329, top1 = 64.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 39.98%], valid : [loss = 2.476, top1 = 36.93%], test : [loss = 2.490, top1 = 37.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1322/15625) 001322-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.458, top1 = 89.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.306, top1 = 92.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.11 ms.
cifar100       train : [loss = 0.204, top1 = 95.19%], valid : [loss = 1.277, top1 = 69.37%], test : [loss = 1.266, top1 = 69.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.28%], valid : [loss = 2.257, top1 = 42.63%], test : [loss = 2.273, top1 = 42.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.07%], valid : [loss = 0.541, top1 = 81.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1323/15625) 001323-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10        train : [loss = 2.303, top1 = 9.95%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.82 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1324/15625) 001324-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.576, top1 = 87.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.039, top1 = 98.83%], test  : [loss = 0.395, top1 = 89.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 0.559, top1 = 83.52%], valid : [loss = 1.395, top1 = 64.15%], test : [loss = 1.417, top1 = 63.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.96%], valid : [loss = 2.619, top1 = 34.27%], test : [loss = 2.652, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1325/15625) 001325-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.10%], valid : [loss = 1.112, top1 = 62.98%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.54 ms.
cifar10        train : [loss = 0.785, top1 = 72.44%], test  : [loss = 0.909, top1 = 68.57%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.59 ms.
cifar100       train : [loss = 2.139, top1 = 43.98%], valid : [loss = 2.400, top1 = 39.53%], test : [loss = 2.419, top1 = 39.40%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.06 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.90%], valid : [loss = 3.816, top1 = 13.54%], test : [loss = 3.838, top1 = 13.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1326/15625) 001326-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.20%], valid : [loss = 0.829, top1 = 79.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.139, top1 = 95.25%], test  : [loss = 0.545, top1 = 84.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.27 ms.
cifar100       train : [loss = 0.878, top1 = 74.45%], valid : [loss = 1.690, top1 = 57.15%], test : [loss = 1.682, top1 = 57.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.46%], valid : [loss = 3.165, top1 = 24.38%], test : [loss = 3.201, top1 = 23.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.082, top1 = 61.29%], valid : [loss = 1.139, top1 = 59.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1327/15625) 001327-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.576, top1 = 88.55%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.72 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.370, top1 = 92.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.94 ms.
cifar100       train : [loss = 0.087, top1 = 98.56%], valid : [loss = 1.499, top1 = 67.45%], test : [loss = 1.488, top1 = 67.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 51.06%], valid : [loss = 2.432, top1 = 39.34%], test : [loss = 2.420, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.682, top1 = 75.78%], valid : [loss = 0.760, top1 = 73.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1328/15625) 001328-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.53%], valid : [loss = 0.559, top1 = 87.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10        train : [loss = 0.036, top1 = 98.96%], test  : [loss = 0.366, top1 = 90.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.38 ms.
cifar100       train : [loss = 0.525, top1 = 84.93%], valid : [loss = 1.335, top1 = 64.45%], test : [loss = 1.332, top1 = 65.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.575, top1 = 34.60%], valid : [loss = 2.648, top1 = 32.83%], test : [loss = 2.668, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.06%], valid : [loss = 0.861, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1329/15625) 001329-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.49 ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.30%], valid : [loss = 0.525, top1 = 82.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.01 ms.
cifar10        train : [loss = 0.403, top1 = 86.29%], test  : [loss = 0.471, top1 = 84.03%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.58 ms.
cifar100       train : [loss = 1.540, top1 = 57.69%], valid : [loss = 1.667, top1 = 54.37%], test : [loss = 1.653, top1 = 54.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.68 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 26.41%], valid : [loss = 3.016, top1 = 26.44%], test : [loss = 3.052, top1 = 26.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1330/15625) 001330-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.48%], valid : [loss = 0.646, top1 = 85.68%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.66 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.406, top1 = 90.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.27 ms.
cifar100       train : [loss = 0.537, top1 = 84.28%], valid : [loss = 1.424, top1 = 63.47%], test : [loss = 1.442, top1 = 62.75%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.34%], valid : [loss = 2.529, top1 = 36.18%], test : [loss = 2.554, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.56%], valid : [loss = 0.883, top1 = 68.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1331/15625) 001331-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.46%], valid : [loss = 0.632, top1 = 85.57%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.32 ms.
cifar10        train : [loss = 0.052, top1 = 98.44%], test  : [loss = 0.413, top1 = 89.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.61 ms.
cifar100       train : [loss = 0.626, top1 = 81.76%], valid : [loss = 1.388, top1 = 63.69%], test : [loss = 1.389, top1 = 63.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.22%], valid : [loss = 2.634, top1 = 34.19%], test : [loss = 2.665, top1 = 33.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.10%], valid : [loss = 0.827, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1332/15625) 001332-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.509, top1 = 89.35%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.28 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.311, top1 = 93.13%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.44 ms.
cifar100       train : [loss = 0.131, top1 = 97.40%], valid : [loss = 1.307, top1 = 69.23%], test : [loss = 1.288, top1 = 69.53%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.49 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.82%], valid : [loss = 2.275, top1 = 41.98%], test : [loss = 2.280, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 81.01%], valid : [loss = 0.638, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1333/15625) 001333-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.621, top1 = 86.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.86 ms.
cifar10        train : [loss = 0.029, top1 = 99.31%], test  : [loss = 0.434, top1 = 89.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.21 ms.
cifar100       train : [loss = 0.359, top1 = 90.53%], valid : [loss = 1.423, top1 = 65.22%], test : [loss = 1.404, top1 = 65.43%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.87 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.73%], valid : [loss = 2.598, top1 = 35.24%], test : [loss = 2.605, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.45%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1334/15625) 001334-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.19%], valid : [loss = 0.621, top1 = 85.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.26 ms.
cifar10        train : [loss = 0.073, top1 = 97.80%], test  : [loss = 0.394, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.83 ms.
cifar100       train : [loss = 0.714, top1 = 79.28%], valid : [loss = 1.392, top1 = 63.28%], test : [loss = 1.379, top1 = 63.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.85%], valid : [loss = 2.676, top1 = 33.49%], test : [loss = 2.699, top1 = 32.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1335/15625) 001335-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.495, top1 = 89.80%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.76 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.305, top1 = 93.33%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.12 ms.
cifar100       train : [loss = 0.058, top1 = 99.09%], valid : [loss = 1.381, top1 = 69.93%], test : [loss = 1.391, top1 = 69.61%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.97 ms.
ImageNet16-120 train : [loss = 1.731, top1 = 53.82%], valid : [loss = 2.280, top1 = 41.74%], test : [loss = 2.256, top1 = 43.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.22%], valid : [loss = 0.709, top1 = 75.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1336/15625) 001336-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.21%], valid : [loss = 0.557, top1 = 87.21%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.62 ms.
cifar10        train : [loss = 0.057, top1 = 98.22%], test  : [loss = 0.388, top1 = 89.83%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.62 ms.
cifar100       train : [loss = 0.587, top1 = 82.88%], valid : [loss = 1.313, top1 = 65.28%], test : [loss = 1.314, top1 = 65.51%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.09%], valid : [loss = 2.438, top1 = 37.74%], test : [loss = 2.453, top1 = 37.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 74.82%], valid : [loss = 0.753, top1 = 73.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1337/15625) 001337-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.472, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.326, top1 = 91.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.318, top1 = 91.41%], valid : [loss = 1.253, top1 = 67.85%], test : [loss = 1.268, top1 = 67.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.64%], valid : [loss = 2.307, top1 = 40.26%], test : [loss = 2.336, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1338/15625) 001338-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.637, top1 = 87.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.415, top1 = 91.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 0.237, top1 = 94.14%], valid : [loss = 1.518, top1 = 65.14%], test : [loss = 1.536, top1 = 64.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 45.00%], valid : [loss = 2.542, top1 = 37.32%], test : [loss = 2.545, top1 = 37.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.30%], valid : [loss = 0.784, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1339/15625) 001339-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.332, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.92 ms.
cifar100       train : [loss = 0.351, top1 = 90.45%], valid : [loss = 1.275, top1 = 66.79%], test : [loss = 1.285, top1 = 67.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.48%], valid : [loss = 2.412, top1 = 38.32%], test : [loss = 2.430, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1340/15625) 001340-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.95%], valid : [loss = 0.524, top1 = 85.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10        train : [loss = 0.181, top1 = 93.88%], test  : [loss = 0.382, top1 = 87.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.62 ms.
cifar100       train : [loss = 0.983, top1 = 71.79%], valid : [loss = 1.372, top1 = 62.15%], test : [loss = 1.363, top1 = 61.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.662, top1 = 33.43%], valid : [loss = 2.703, top1 = 32.92%], test : [loss = 2.769, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.899, top1 = 67.88%], valid : [loss = 0.946, top1 = 66.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1341/15625) 001341-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.452, top1 = 89.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.316, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.39 ms.
cifar100       train : [loss = 0.318, top1 = 91.42%], valid : [loss = 1.298, top1 = 67.53%], test : [loss = 1.298, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.53%], valid : [loss = 2.339, top1 = 40.24%], test : [loss = 2.395, top1 = 40.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.37%], valid : [loss = 0.554, top1 = 81.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1342/15625) 001342-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.39%], valid : [loss = 0.865, top1 = 71.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10        train : [loss = 0.556, top1 = 80.51%], test  : [loss = 0.721, top1 = 75.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.29 ms.
cifar100       train : [loss = 1.779, top1 = 52.18%], valid : [loss = 2.048, top1 = 47.19%], test : [loss = 2.062, top1 = 46.73%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.61 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.91%], valid : [loss = 3.628, top1 = 16.80%], test : [loss = 3.676, top1 = 15.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1343/15625) 001343-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.47%], valid : [loss = 0.578, top1 = 86.93%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.86 ms.
cifar10        train : [loss = 0.043, top1 = 98.68%], test  : [loss = 0.391, top1 = 90.10%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.92 ms.
cifar100       train : [loss = 0.449, top1 = 87.05%], valid : [loss = 1.416, top1 = 64.85%], test : [loss = 1.426, top1 = 64.33%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.77%], valid : [loss = 2.435, top1 = 38.64%], test : [loss = 2.441, top1 = 38.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.85%], valid : [loss = 0.921, top1 = 67.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1344/15625) 001344-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.592, top1 = 85.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10        train : [loss = 0.069, top1 = 97.93%], test  : [loss = 0.407, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.69 ms.
cifar100       train : [loss = 0.707, top1 = 79.52%], valid : [loss = 1.352, top1 = 64.23%], test : [loss = 1.347, top1 = 64.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.12%], valid : [loss = 2.660, top1 = 34.03%], test : [loss = 2.691, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 74.94%], valid : [loss = 0.769, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1345/15625) 001345-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.581, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.387, top1 = 91.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.38 ms.
cifar100       train : [loss = 0.148, top1 = 96.91%], valid : [loss = 1.450, top1 = 67.27%], test : [loss = 1.447, top1 = 67.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.62%], valid : [loss = 2.486, top1 = 37.83%], test : [loss = 2.488, top1 = 38.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.55%], valid : [loss = 0.784, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1346/15625) 001346-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.484, top1 = 90.27%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=18.90 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.310, top1 = 93.48%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.66 ms.
cifar100       train : [loss = 0.041, top1 = 99.58%], valid : [loss = 1.276, top1 = 71.41%], test : [loss = 1.276, top1 = 71.29%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.31 ms.
ImageNet16-120 train : [loss = 1.646, top1 = 55.66%], valid : [loss = 2.179, top1 = 44.74%], test : [loss = 2.186, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.44%], valid : [loss = 0.779, top1 = 72.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1347/15625) 001347-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.516, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.333, top1 = 92.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.97 ms.
cifar100       train : [loss = 0.220, top1 = 94.30%], valid : [loss = 1.264, top1 = 68.53%], test : [loss = 1.276, top1 = 68.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 1.947, top1 = 48.70%], valid : [loss = 2.275, top1 = 41.62%], test : [loss = 2.281, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.96%], valid : [loss = 0.785, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1348/15625) 001348-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.88%], valid : [loss = 0.885, top1 = 76.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.186, top1 = 93.55%], test  : [loss = 0.553, top1 = 83.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.42 ms.
cifar100       train : [loss = 1.030, top1 = 70.37%], valid : [loss = 1.772, top1 = 54.71%], test : [loss = 1.760, top1 = 54.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 3.099, top1 = 25.20%], valid : [loss = 3.241, top1 = 23.27%], test : [loss = 3.261, top1 = 22.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.82%], valid : [loss = 1.198, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1349/15625) 001349-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.466, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.318, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 0.328, top1 = 91.08%], valid : [loss = 1.292, top1 = 67.17%], test : [loss = 1.312, top1 = 67.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.16%], valid : [loss = 2.369, top1 = 40.46%], test : [loss = 2.431, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1350/15625) 001350-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.96%], valid : [loss = 0.576, top1 = 86.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.22 ms.
cifar10        train : [loss = 0.069, top1 = 97.72%], test  : [loss = 0.399, top1 = 89.22%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.03 ms.
cifar100       train : [loss = 0.604, top1 = 82.42%], valid : [loss = 1.433, top1 = 62.79%], test : [loss = 1.429, top1 = 63.05%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.54%], valid : [loss = 2.470, top1 = 37.40%], test : [loss = 2.513, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.47%], valid : [loss = 1.042, top1 = 62.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1351/15625) 001351-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.87%], valid : [loss = 0.478, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.299, top1 = 89.91%], test  : [loss = 0.400, top1 = 86.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 1.333, top1 = 63.00%], valid : [loss = 1.536, top1 = 57.81%], test : [loss = 1.516, top1 = 57.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.64%], valid : [loss = 2.907, top1 = 29.59%], test : [loss = 2.946, top1 = 27.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1352/15625) 001352-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.505, top1 = 88.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.326, top1 = 92.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.231, top1 = 94.39%], valid : [loss = 1.234, top1 = 68.72%], test : [loss = 1.263, top1 = 68.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 49.01%], valid : [loss = 2.276, top1 = 41.70%], test : [loss = 2.296, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1353/15625) 001353-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.05 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.482, top1 = 89.09%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.306, top1 = 92.36%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.64 ms.
cifar100       train : [loss = 0.217, top1 = 94.93%], valid : [loss = 1.218, top1 = 69.56%], test : [loss = 1.218, top1 = 69.32%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=21.11 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 51.99%], valid : [loss = 2.164, top1 = 43.73%], test : [loss = 2.186, top1 = 44.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.55%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1354/15625) 001354-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.32%], valid : [loss = 0.464, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10        train : [loss = 0.157, top1 = 94.86%], test  : [loss = 0.343, top1 = 88.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.87 ms.
cifar100       train : [loss = 1.000, top1 = 71.53%], valid : [loss = 1.355, top1 = 62.08%], test : [loss = 1.341, top1 = 62.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.62%], valid : [loss = 2.697, top1 = 32.84%], test : [loss = 2.702, top1 = 32.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1355/15625) 001355-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.82%], valid : [loss = 0.543, top1 = 83.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.238, top1 = 91.88%], test  : [loss = 0.403, top1 = 86.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 1.353, top1 = 61.89%], valid : [loss = 1.609, top1 = 55.93%], test : [loss = 1.598, top1 = 55.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.814, top1 = 30.38%], valid : [loss = 2.861, top1 = 29.78%], test : [loss = 2.879, top1 = 29.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.949, top1 = 65.94%], valid : [loss = 0.987, top1 = 64.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1356/15625) 001356-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.497, top1 = 89.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.328, top1 = 92.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.230, top1 = 94.42%], valid : [loss = 1.305, top1 = 67.59%], test : [loss = 1.296, top1 = 68.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.961, top1 = 48.35%], valid : [loss = 2.311, top1 = 41.09%], test : [loss = 2.325, top1 = 41.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.11%], valid : [loss = 0.700, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1357/15625) 001357-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.56%], valid : [loss = 0.437, top1 = 88.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.21 ms.
cifar10        train : [loss = 0.052, top1 = 98.76%], test  : [loss = 0.311, top1 = 90.80%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.13 ms.
cifar100       train : [loss = 0.564, top1 = 84.50%], valid : [loss = 1.219, top1 = 66.83%], test : [loss = 1.203, top1 = 67.48%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.56%], valid : [loss = 2.469, top1 = 37.81%], test : [loss = 2.484, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.32%], valid : [loss = 0.640, top1 = 78.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1358/15625) 001358-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.75 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.21%], valid : [loss = 0.857, top1 = 71.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10        train : [loss = 0.551, top1 = 80.73%], test  : [loss = 0.714, top1 = 75.64%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.44 ms.
cifar100       train : [loss = 1.777, top1 = 52.14%], valid : [loss = 2.072, top1 = 46.67%], test : [loss = 2.074, top1 = 46.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.91 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.83%], valid : [loss = 3.632, top1 = 16.69%], test : [loss = 3.666, top1 = 15.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1359/15625) 001359-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.45%], valid : [loss = 0.452, top1 = 86.73%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10        train : [loss = 0.126, top1 = 95.99%], test  : [loss = 0.332, top1 = 89.35%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.74 ms.
cifar100       train : [loss = 0.789, top1 = 77.81%], valid : [loss = 1.275, top1 = 64.59%], test : [loss = 1.263, top1 = 64.49%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 37.01%], valid : [loss = 2.582, top1 = 35.14%], test : [loss = 2.590, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.46%], valid : [loss = 0.813, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1360/15625) 001360-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.501, top1 = 89.89%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 93.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.17 ms.
cifar100       train : [loss = 0.103, top1 = 98.08%], valid : [loss = 1.293, top1 = 69.61%], test : [loss = 1.295, top1 = 69.97%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 1.679, top1 = 54.92%], valid : [loss = 2.165, top1 = 44.70%], test : [loss = 2.212, top1 = 44.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.19%], valid : [loss = 0.579, top1 = 80.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1361/15625) 001361-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.24 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.514, top1 = 90.08%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.322, top1 = 93.43%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.20 ms.
cifar100       train : [loss = 0.043, top1 = 99.44%], valid : [loss = 1.345, top1 = 70.49%], test : [loss = 1.337, top1 = 70.42%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.95 ms.
ImageNet16-120 train : [loss = 1.752, top1 = 53.28%], valid : [loss = 2.284, top1 = 42.26%], test : [loss = 2.269, top1 = 42.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.92%], valid : [loss = 0.722, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1362/15625) 001362-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.484, top1 = 89.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.58 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.324, top1 = 92.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.80 ms.
cifar100       train : [loss = 0.270, top1 = 93.08%], valid : [loss = 1.230, top1 = 68.47%], test : [loss = 1.218, top1 = 69.05%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.12 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.92%], valid : [loss = 2.221, top1 = 42.01%], test : [loss = 2.226, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.629, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1363/15625) 001363-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.468, top1 = 89.30%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.91 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.304, top1 = 92.40%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.53 ms.
cifar100       train : [loss = 0.212, top1 = 95.01%], valid : [loss = 1.233, top1 = 68.96%], test : [loss = 1.253, top1 = 69.01%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.01%], valid : [loss = 2.233, top1 = 42.80%], test : [loss = 2.257, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.09%], valid : [loss = 0.626, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1364/15625) 001364-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.540, top1 = 88.43%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.357, top1 = 91.69%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.60 ms.
cifar100       train : [loss = 0.289, top1 = 91.87%], valid : [loss = 1.336, top1 = 66.76%], test : [loss = 1.330, top1 = 67.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.13%], valid : [loss = 2.424, top1 = 38.23%], test : [loss = 2.427, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.28%], valid : [loss = 0.920, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1365/15625) 001365-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.55%], valid : [loss = 0.449, top1 = 86.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.00 ms.
cifar10        train : [loss = 0.155, top1 = 94.91%], test  : [loss = 0.347, top1 = 88.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.70 ms.
cifar100       train : [loss = 0.979, top1 = 72.18%], valid : [loss = 1.350, top1 = 62.32%], test : [loss = 1.337, top1 = 62.51%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.11%], valid : [loss = 2.679, top1 = 33.31%], test : [loss = 2.688, top1 = 32.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1366/15625) 001366-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.507, top1 = 88.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.335, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.17 ms.
cifar100       train : [loss = 0.326, top1 = 91.22%], valid : [loss = 1.298, top1 = 67.06%], test : [loss = 1.281, top1 = 67.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.17%], valid : [loss = 2.382, top1 = 39.43%], test : [loss = 2.415, top1 = 39.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1367/15625) 001367-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.488, top1 = 88.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.309, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.98 ms.
cifar100       train : [loss = 0.327, top1 = 91.17%], valid : [loss = 1.246, top1 = 67.66%], test : [loss = 1.236, top1 = 67.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.84%], valid : [loss = 2.308, top1 = 40.93%], test : [loss = 2.341, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1368/15625) 001368-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.91%], valid : [loss = 0.470, top1 = 86.38%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.55 ms.
cifar10        train : [loss = 0.115, top1 = 96.41%], test  : [loss = 0.334, top1 = 89.50%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.25 ms.
cifar100       train : [loss = 0.741, top1 = 79.24%], valid : [loss = 1.280, top1 = 64.53%], test : [loss = 1.282, top1 = 64.36%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.14%], valid : [loss = 2.586, top1 = 35.77%], test : [loss = 2.613, top1 = 34.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.34%], valid : [loss = 0.862, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1369/15625) 001369-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.212, top1 = 92.87%], valid : [loss = 0.550, top1 = 83.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.213, top1 = 92.75%], test  : [loss = 0.403, top1 = 87.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.01 ms.
cifar100       train : [loss = 1.280, top1 = 63.36%], valid : [loss = 1.565, top1 = 56.90%], test : [loss = 1.570, top1 = 56.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.702, top1 = 32.50%], valid : [loss = 2.734, top1 = 31.99%], test : [loss = 2.770, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.04%], valid : [loss = 0.978, top1 = 64.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1370/15625) 001370-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.25%], valid : [loss = 0.458, top1 = 86.77%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.28 ms.
cifar10        train : [loss = 0.114, top1 = 96.51%], test  : [loss = 0.335, top1 = 89.40%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.66 ms.
cifar100       train : [loss = 0.732, top1 = 79.56%], valid : [loss = 1.288, top1 = 64.53%], test : [loss = 1.275, top1 = 64.82%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.06 ms.
ImageNet16-120 train : [loss = 2.471, top1 = 37.36%], valid : [loss = 2.577, top1 = 34.96%], test : [loss = 2.594, top1 = 34.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.65%], valid : [loss = 0.764, top1 = 72.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1371/15625) 001371-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.518, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.344, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.88 ms.
cifar100       train : [loss = 0.262, top1 = 93.23%], valid : [loss = 1.278, top1 = 68.18%], test : [loss = 1.253, top1 = 68.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.95%], valid : [loss = 2.228, top1 = 42.66%], test : [loss = 2.265, top1 = 42.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.14%], valid : [loss = 0.685, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1372/15625) 001372-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.527, top1 = 88.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10        train : [loss = 0.028, top1 = 99.20%], test  : [loss = 0.357, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.426, top1 = 87.67%], valid : [loss = 1.244, top1 = 67.77%], test : [loss = 1.239, top1 = 67.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.48%], valid : [loss = 2.374, top1 = 39.30%], test : [loss = 2.376, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.90%], valid : [loss = 0.832, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1373/15625) 001373-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.39%], valid : [loss = 0.546, top1 = 83.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10        train : [loss = 0.190, top1 = 93.63%], test  : [loss = 0.389, top1 = 87.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 1.221, top1 = 65.22%], valid : [loss = 1.545, top1 = 57.77%], test : [loss = 1.530, top1 = 57.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.22%], valid : [loss = 2.717, top1 = 32.34%], test : [loss = 2.757, top1 = 31.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.46%], valid : [loss = 1.032, top1 = 63.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1374/15625) 001374-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.551, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.366, top1 = 92.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.16 ms.
cifar100       train : [loss = 0.126, top1 = 97.60%], valid : [loss = 1.446, top1 = 67.24%], test : [loss = 1.459, top1 = 67.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.49%], valid : [loss = 2.390, top1 = 39.36%], test : [loss = 2.425, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.48%], valid : [loss = 0.706, top1 = 75.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1375/15625) 001375-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.603, top1 = 87.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.394, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.44 ms.
cifar100       train : [loss = 0.237, top1 = 93.95%], valid : [loss = 1.501, top1 = 65.21%], test : [loss = 1.478, top1 = 65.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 45.11%], valid : [loss = 2.487, top1 = 37.59%], test : [loss = 2.501, top1 = 38.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.79%], valid : [loss = 0.736, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1376/15625) 001376-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.81%], valid : [loss = 0.604, top1 = 84.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10        train : [loss = 0.095, top1 = 96.85%], test  : [loss = 0.413, top1 = 88.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 0.690, top1 = 79.65%], valid : [loss = 1.505, top1 = 61.28%], test : [loss = 1.505, top1 = 61.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 3.218, top1 = 21.62%], valid : [loss = 3.228, top1 = 21.42%], test : [loss = 3.256, top1 = 20.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 62.06%], valid : [loss = 1.066, top1 = 61.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1377/15625) 001377-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.098, top1 = 97.08%], valid : [loss = 0.522, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.44 ms.
cifar10        train : [loss = 0.157, top1 = 94.78%], test  : [loss = 0.376, top1 = 88.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.76 ms.
cifar100       train : [loss = 0.934, top1 = 73.11%], valid : [loss = 1.353, top1 = 62.77%], test : [loss = 1.335, top1 = 62.97%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.65%], valid : [loss = 2.696, top1 = 33.17%], test : [loss = 2.747, top1 = 31.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.32%], valid : [loss = 0.949, top1 = 66.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1378/15625) 001378-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.542, top1 = 88.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.025, top1 = 99.29%], test  : [loss = 0.351, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.409, top1 = 88.23%], valid : [loss = 1.265, top1 = 66.72%], test : [loss = 1.287, top1 = 66.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.32%], valid : [loss = 2.403, top1 = 39.39%], test : [loss = 2.442, top1 = 38.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1379/15625) 001379-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.560, top1 = 87.50%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.76 ms.
cifar10        train : [loss = 0.038, top1 = 98.83%], test  : [loss = 0.373, top1 = 90.52%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.58 ms.
cifar100       train : [loss = 0.475, top1 = 86.18%], valid : [loss = 1.340, top1 = 65.45%], test : [loss = 1.334, top1 = 65.34%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.85%], valid : [loss = 2.368, top1 = 39.39%], test : [loss = 2.363, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.61%], valid : [loss = 0.808, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1380/15625) 001380-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.15%], valid : [loss = 0.580, top1 = 85.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.04 ms.
cifar10        train : [loss = 0.107, top1 = 96.46%], test  : [loss = 0.391, top1 = 88.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.84 ms.
cifar100       train : [loss = 0.816, top1 = 76.06%], valid : [loss = 1.404, top1 = 62.39%], test : [loss = 1.388, top1 = 62.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.10%], valid : [loss = 2.763, top1 = 31.47%], test : [loss = 2.813, top1 = 31.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1381/15625) 001381-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.99 ms.
cifar10-valid  train : [loss = 1.309, top1 = 52.81%], valid : [loss = 1.362, top1 = 51.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10        train : [loss = 1.308, top1 = 52.91%], test  : [loss = 1.303, top1 = 53.24%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.39 ms.
cifar100       train : [loss = 2.833, top1 = 29.50%], valid : [loss = 2.925, top1 = 27.93%], test : [loss = 2.919, top1 = 28.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.20 ms.
ImageNet16-120 train : [loss = 3.981, top1 = 10.64%], valid : [loss = 3.981, top1 = 10.80%], test : [loss = 3.999, top1 = 10.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.858, top1 = 30.99%], valid : [loss = 1.819, top1 = 31.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1382/15625) 001382-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.464, top1 = 89.42%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.37 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.310, top1 = 92.45%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.89 ms.
cifar100       train : [loss = 0.227, top1 = 94.58%], valid : [loss = 1.228, top1 = 68.90%], test : [loss = 1.230, top1 = 69.02%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.16 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 50.03%], valid : [loss = 2.235, top1 = 42.46%], test : [loss = 2.254, top1 = 42.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.78%], valid : [loss = 0.642, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1383/15625) 001383-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.418, top1 = 90.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.280, top1 = 93.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.74 ms.
cifar100       train : [loss = 0.151, top1 = 96.57%], valid : [loss = 1.278, top1 = 70.11%], test : [loss = 1.256, top1 = 70.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.748, top1 = 53.40%], valid : [loss = 2.229, top1 = 43.49%], test : [loss = 2.250, top1 = 43.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.367, top1 = 87.44%], valid : [loss = 0.506, top1 = 82.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1384/15625) 001384-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.15%], valid : [loss = 0.475, top1 = 84.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.297, top1 = 90.05%], test  : [loss = 0.395, top1 = 86.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 1.315, top1 = 63.56%], valid : [loss = 1.531, top1 = 57.87%], test : [loss = 1.504, top1 = 58.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.83%], valid : [loss = 2.899, top1 = 29.57%], test : [loss = 2.948, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1385/15625) 001385-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.36%], valid : [loss = 0.583, top1 = 85.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10        train : [loss = 0.105, top1 = 96.54%], test  : [loss = 0.396, top1 = 88.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 0.808, top1 = 76.21%], valid : [loss = 1.410, top1 = 62.51%], test : [loss = 1.390, top1 = 62.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.12%], valid : [loss = 2.757, top1 = 32.12%], test : [loss = 2.809, top1 = 31.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.05%], valid : [loss = 0.718, top1 = 75.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1386/15625) 001386-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.290, top1 = 93.11%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.72 ms.
cifar100       train : [loss = 0.109, top1 = 98.04%], valid : [loss = 1.292, top1 = 69.86%], test : [loss = 1.296, top1 = 69.75%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 1.689, top1 = 54.83%], valid : [loss = 2.215, top1 = 44.18%], test : [loss = 2.219, top1 = 43.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.410, top1 = 85.84%], valid : [loss = 0.527, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1387/15625) 001387-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.453, top1 = 89.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.301, top1 = 92.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.62 ms.
cifar100       train : [loss = 0.181, top1 = 95.83%], valid : [loss = 1.279, top1 = 69.43%], test : [loss = 1.261, top1 = 69.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.795, top1 = 52.25%], valid : [loss = 2.237, top1 = 42.74%], test : [loss = 2.255, top1 = 43.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.96%], valid : [loss = 0.527, top1 = 82.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1388/15625) 001388-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.654, top1 = 87.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.422, top1 = 91.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.88 ms.
cifar100       train : [loss = 0.132, top1 = 97.13%], valid : [loss = 1.628, top1 = 65.22%], test : [loss = 1.614, top1 = 65.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.11%], valid : [loss = 2.475, top1 = 37.21%], test : [loss = 2.496, top1 = 37.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.44%], valid : [loss = 0.766, top1 = 73.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1389/15625) 001389-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.618, top1 = 87.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.421, top1 = 90.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.95 ms.
cifar100       train : [loss = 0.150, top1 = 96.58%], valid : [loss = 1.572, top1 = 65.49%], test : [loss = 1.592, top1 = 65.61%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.16%], valid : [loss = 2.484, top1 = 37.41%], test : [loss = 2.499, top1 = 38.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.75%], valid : [loss = 0.814, top1 = 71.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1390/15625) 001390-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.70 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.39%], valid : [loss = 0.852, top1 = 71.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.559, top1 = 80.41%], test  : [loss = 0.719, top1 = 75.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.17 ms.
cifar100       train : [loss = 1.779, top1 = 52.04%], valid : [loss = 2.053, top1 = 46.95%], test : [loss = 2.064, top1 = 46.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.82%], valid : [loss = 3.638, top1 = 16.54%], test : [loss = 3.663, top1 = 15.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1391/15625) 001391-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.469, top1 = 89.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.324, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.271, top1 = 92.77%], valid : [loss = 1.334, top1 = 67.54%], test : [loss = 1.330, top1 = 67.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.60%], valid : [loss = 2.341, top1 = 40.23%], test : [loss = 2.374, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.12%], valid : [loss = 0.605, top1 = 79.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1392/15625) 001392-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.569, top1 = 87.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.397, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.93 ms.
cifar100       train : [loss = 0.398, top1 = 88.72%], valid : [loss = 1.381, top1 = 65.39%], test : [loss = 1.367, top1 = 66.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.83%], valid : [loss = 2.513, top1 = 37.11%], test : [loss = 2.551, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.67%], valid : [loss = 0.790, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1393/15625) 001393-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.633, top1 = 86.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.402, top1 = 90.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.27 ms.
cifar100       train : [loss = 0.524, top1 = 84.59%], valid : [loss = 1.398, top1 = 64.64%], test : [loss = 1.412, top1 = 63.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.21%], valid : [loss = 2.561, top1 = 35.60%], test : [loss = 2.592, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1394/15625) 001394-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.43%], valid : [loss = 0.625, top1 = 80.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.271, top1 = 90.74%], test  : [loss = 0.463, top1 = 84.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.62 ms.
cifar100       train : [loss = 1.349, top1 = 62.09%], valid : [loss = 1.690, top1 = 55.16%], test : [loss = 1.694, top1 = 54.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 3.097, top1 = 25.10%], valid : [loss = 3.113, top1 = 24.97%], test : [loss = 3.142, top1 = 23.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.073, top1 = 61.05%], valid : [loss = 1.121, top1 = 60.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1395/15625) 001395-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.066, top1 = 97.91%], valid : [loss = 0.565, top1 = 85.79%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10        train : [loss = 0.101, top1 = 96.59%], test  : [loss = 0.387, top1 = 89.12%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.10 ms.
cifar100       train : [loss = 0.759, top1 = 77.59%], valid : [loss = 1.389, top1 = 62.74%], test : [loss = 1.397, top1 = 62.47%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.27%], valid : [loss = 2.682, top1 = 32.73%], test : [loss = 2.692, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.913, top1 = 67.07%], valid : [loss = 0.930, top1 = 66.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1396/15625) 001396-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.498, top1 = 89.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.39 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.315, top1 = 92.85%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.27 ms.
cifar100       train : [loss = 0.136, top1 = 97.28%], valid : [loss = 1.296, top1 = 69.21%], test : [loss = 1.299, top1 = 69.16%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.35 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.38%], valid : [loss = 2.274, top1 = 42.81%], test : [loss = 2.290, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.78%], valid : [loss = 0.718, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1397/15625) 001397-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.89%], valid : [loss = 0.736, top1 = 74.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 0.563, top1 = 80.60%], test  : [loss = 0.619, top1 = 78.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.20 ms.
cifar100       train : [loss = 2.055, top1 = 44.98%], valid : [loss = 2.174, top1 = 43.06%], test : [loss = 2.164, top1 = 42.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 3.291, top1 = 21.32%], valid : [loss = 3.275, top1 = 22.00%], test : [loss = 3.314, top1 = 21.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.277, top1 = 54.36%], valid : [loss = 1.339, top1 = 52.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1398/15625) 001398-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.544, top1 = 88.61%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.378, top1 = 91.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.51 ms.
cifar100       train : [loss = 0.117, top1 = 97.87%], valid : [loss = 1.437, top1 = 67.48%], test : [loss = 1.444, top1 = 67.33%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.15%], valid : [loss = 2.376, top1 = 40.21%], test : [loss = 2.385, top1 = 41.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.36%], valid : [loss = 0.673, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1399/15625) 001399-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.322, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.06 ms.
cifar100       train : [loss = 0.330, top1 = 91.15%], valid : [loss = 1.303, top1 = 67.33%], test : [loss = 1.303, top1 = 67.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.04%], valid : [loss = 2.368, top1 = 39.94%], test : [loss = 2.423, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.47%], valid : [loss = 0.568, top1 = 80.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1400/15625) 001400-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.556, top1 = 88.42%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.35 ms.
cifar10        train : [loss = 0.017, top1 = 99.52%], test  : [loss = 0.372, top1 = 91.63%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.09 ms.
cifar100       train : [loss = 0.258, top1 = 93.21%], valid : [loss = 1.301, top1 = 67.95%], test : [loss = 1.305, top1 = 67.70%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.960, top1 = 48.43%], valid : [loss = 2.264, top1 = 41.97%], test : [loss = 2.282, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.55%], valid : [loss = 0.784, top1 = 72.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1401/15625) 001401-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.124, top1 = 95.93%], valid : [loss = 0.758, top1 = 80.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.163, top1 = 94.41%], test  : [loss = 0.512, top1 = 85.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 0.868, top1 = 74.66%], valid : [loss = 1.640, top1 = 57.54%], test : [loss = 1.678, top1 = 56.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 3.341, top1 = 19.94%], valid : [loss = 3.360, top1 = 19.83%], test : [loss = 3.383, top1 = 19.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.236, top1 = 54.69%], valid : [loss = 1.268, top1 = 53.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1402/15625) 001402-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.60 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.563, top1 = 88.01%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.365, top1 = 91.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.83 ms.
cifar100       train : [loss = 0.213, top1 = 94.51%], valid : [loss = 1.294, top1 = 67.98%], test : [loss = 1.330, top1 = 68.01%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.50 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 39.93%], valid : [loss = 2.534, top1 = 35.16%], test : [loss = 2.531, top1 = 36.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.00%], valid : [loss = 0.932, top1 = 66.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1403/15625) 001403-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.19%], valid : [loss = 0.578, top1 = 85.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.106, top1 = 96.43%], test  : [loss = 0.394, top1 = 88.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.87 ms.
cifar100       train : [loss = 0.819, top1 = 75.94%], valid : [loss = 1.393, top1 = 62.85%], test : [loss = 1.399, top1 = 62.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.01%], valid : [loss = 2.755, top1 = 31.60%], test : [loss = 2.809, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1404/15625) 001404-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.11%], valid : [loss = 0.557, top1 = 87.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.05 ms.
cifar10        train : [loss = 0.062, top1 = 97.98%], test  : [loss = 0.376, top1 = 89.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.60 ms.
cifar100       train : [loss = 0.655, top1 = 80.64%], valid : [loss = 1.330, top1 = 64.63%], test : [loss = 1.313, top1 = 64.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.85%], valid : [loss = 2.480, top1 = 37.36%], test : [loss = 2.507, top1 = 36.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 73.25%], valid : [loss = 0.837, top1 = 70.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1405/15625) 001405-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.22%], valid : [loss = 0.597, top1 = 85.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.072, top1 = 97.84%], test  : [loss = 0.393, top1 = 88.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.31 ms.
cifar100       train : [loss = 0.708, top1 = 79.43%], valid : [loss = 1.391, top1 = 62.67%], test : [loss = 1.359, top1 = 63.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.72%], valid : [loss = 2.667, top1 = 33.70%], test : [loss = 2.686, top1 = 33.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.82%], valid : [loss = 0.800, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1406/15625) 001406-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.502, top1 = 89.90%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.61 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.317, top1 = 93.39%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.42 ms.
cifar100       train : [loss = 0.075, top1 = 98.84%], valid : [loss = 1.370, top1 = 69.21%], test : [loss = 1.375, top1 = 69.31%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.39 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.49%], valid : [loss = 2.363, top1 = 40.07%], test : [loss = 2.339, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.88%], valid : [loss = 0.814, top1 = 71.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1407/15625) 001407-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.63%], valid : [loss = 0.622, top1 = 84.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10        train : [loss = 0.089, top1 = 97.14%], test  : [loss = 0.403, top1 = 88.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.41 ms.
cifar100       train : [loss = 0.768, top1 = 77.52%], valid : [loss = 1.429, top1 = 61.99%], test : [loss = 1.397, top1 = 62.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 34.43%], valid : [loss = 2.738, top1 = 31.92%], test : [loss = 2.760, top1 = 31.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.42%], valid : [loss = 0.844, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1408/15625) 001408-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.17%], valid : [loss = 0.649, top1 = 78.18%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10        train : [loss = 0.516, top1 = 82.11%], test  : [loss = 0.595, top1 = 79.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.05 ms.
cifar100       train : [loss = 1.688, top1 = 54.16%], valid : [loss = 1.856, top1 = 50.79%], test : [loss = 1.870, top1 = 50.63%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.03 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.36%], valid : [loss = 3.317, top1 = 21.59%], test : [loss = 3.354, top1 = 20.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1409/15625) 001409-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.03%], valid : [loss = 0.478, top1 = 84.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.301, top1 = 89.97%], test  : [loss = 0.405, top1 = 86.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.68 ms.
cifar100       train : [loss = 1.317, top1 = 63.44%], valid : [loss = 1.536, top1 = 57.55%], test : [loss = 1.510, top1 = 58.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.83%], valid : [loss = 2.902, top1 = 29.76%], test : [loss = 2.947, top1 = 28.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1410/15625) 001410-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.210, top1 = 92.87%], valid : [loss = 0.555, top1 = 83.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.208, top1 = 92.91%], test  : [loss = 0.405, top1 = 87.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.19 ms.
cifar100       train : [loss = 1.302, top1 = 63.09%], valid : [loss = 1.589, top1 = 56.61%], test : [loss = 1.578, top1 = 56.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 2.725, top1 = 32.13%], valid : [loss = 2.746, top1 = 31.66%], test : [loss = 2.790, top1 = 31.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.23%], valid : [loss = 0.997, top1 = 64.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1411/15625) 001411-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.32%], valid : [loss = 0.761, top1 = 73.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.506, top1 = 82.48%], test  : [loss = 0.564, top1 = 80.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.68 ms.
cifar100       train : [loss = 2.074, top1 = 44.51%], valid : [loss = 2.163, top1 = 42.74%], test : [loss = 2.171, top1 = 42.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.46%], valid : [loss = 3.189, top1 = 23.36%], test : [loss = 3.239, top1 = 22.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.09%], valid : [loss = 1.198, top1 = 57.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1412/15625) 001412-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.44%], valid : [loss = 0.576, top1 = 81.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10        train : [loss = 0.322, top1 = 88.85%], test  : [loss = 0.464, top1 = 84.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 1.461, top1 = 59.16%], valid : [loss = 1.727, top1 = 53.39%], test : [loss = 1.727, top1 = 53.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.125, top1 = 24.62%], valid : [loss = 3.137, top1 = 24.53%], test : [loss = 3.196, top1 = 24.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.238, top1 = 55.36%], valid : [loss = 1.267, top1 = 53.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1413/15625) 001413-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.437, top1 = 90.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.288, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.42 ms.
cifar100       train : [loss = 0.199, top1 = 95.34%], valid : [loss = 1.269, top1 = 69.31%], test : [loss = 1.266, top1 = 69.19%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.47%], valid : [loss = 2.248, top1 = 43.04%], test : [loss = 2.286, top1 = 42.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.403, top1 = 86.13%], valid : [loss = 0.526, top1 = 82.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1414/15625) 001414-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.484, top1 = 90.35%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.303, top1 = 93.55%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.39 ms.
cifar100       train : [loss = 0.040, top1 = 99.59%], valid : [loss = 1.335, top1 = 70.52%], test : [loss = 1.321, top1 = 70.94%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.67 ms.
ImageNet16-120 train : [loss = 1.593, top1 = 57.10%], valid : [loss = 2.191, top1 = 44.56%], test : [loss = 2.197, top1 = 45.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.61%], valid : [loss = 0.718, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1415/15625) 001415-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.318, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.05 ms.
cifar100       train : [loss = 0.333, top1 = 90.89%], valid : [loss = 1.300, top1 = 67.27%], test : [loss = 1.286, top1 = 67.35%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.25%], valid : [loss = 2.372, top1 = 39.79%], test : [loss = 2.405, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.93%], valid : [loss = 0.518, top1 = 82.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1416/15625) 001416-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.26%], valid : [loss = 0.453, top1 = 86.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.113, top1 = 96.50%], test  : [loss = 0.328, top1 = 89.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 0.855, top1 = 75.72%], valid : [loss = 1.290, top1 = 64.34%], test : [loss = 1.275, top1 = 64.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.77%], valid : [loss = 2.618, top1 = 34.16%], test : [loss = 2.653, top1 = 33.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1417/15625) 001417-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.535, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.360, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.55 ms.
cifar100       train : [loss = 0.246, top1 = 93.46%], valid : [loss = 1.296, top1 = 67.93%], test : [loss = 1.325, top1 = 68.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.73%], valid : [loss = 2.445, top1 = 38.34%], test : [loss = 2.437, top1 = 38.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.921, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1418/15625) 001418-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.97%], valid : [loss = 1.328, top1 = 52.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10        train : [loss = 1.224, top1 = 56.12%], test  : [loss = 1.237, top1 = 55.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.67 ms.
cifar100       train : [loss = 2.808, top1 = 30.18%], valid : [loss = 2.895, top1 = 28.74%], test : [loss = 2.884, top1 = 28.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.02 ms.
ImageNet16-120 train : [loss = 3.939, top1 = 11.33%], valid : [loss = 3.943, top1 = 11.98%], test : [loss = 3.948, top1 = 11.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.758, top1 = 33.78%], valid : [loss = 1.749, top1 = 33.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1419/15625) 001419-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.579, top1 = 87.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.384, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.61 ms.
cifar100       train : [loss = 0.400, top1 = 88.56%], valid : [loss = 1.384, top1 = 65.68%], test : [loss = 1.390, top1 = 65.73%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.14%], valid : [loss = 2.500, top1 = 36.79%], test : [loss = 2.538, top1 = 36.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.22%], valid : [loss = 0.815, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1420/15625) 001420-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.598, top1 = 88.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.381, top1 = 92.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.58 ms.
cifar100       train : [loss = 0.154, top1 = 96.71%], valid : [loss = 1.485, top1 = 66.79%], test : [loss = 1.463, top1 = 67.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 1.961, top1 = 48.52%], valid : [loss = 2.460, top1 = 38.93%], test : [loss = 2.456, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.23%], valid : [loss = 0.717, top1 = 75.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1421/15625) 001421-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.146, top1 = 95.14%], valid : [loss = 0.885, top1 = 77.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10        train : [loss = 0.224, top1 = 92.29%], test  : [loss = 0.595, top1 = 82.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.160, top1 = 66.97%], valid : [loss = 1.807, top1 = 53.08%], test : [loss = 1.785, top1 = 54.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.82%], valid : [loss = 3.331, top1 = 21.40%], test : [loss = 3.358, top1 = 20.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1422/15625) 001422-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.608, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.399, top1 = 91.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.67 ms.
cifar100       train : [loss = 0.202, top1 = 95.38%], valid : [loss = 1.439, top1 = 66.35%], test : [loss = 1.427, top1 = 66.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.14%], valid : [loss = 2.479, top1 = 38.41%], test : [loss = 2.508, top1 = 38.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1423/15625) 001423-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.05%], valid : [loss = 0.557, top1 = 83.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 0.207, top1 = 92.99%], test  : [loss = 0.404, top1 = 87.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 1.312, top1 = 62.93%], valid : [loss = 1.585, top1 = 56.58%], test : [loss = 1.586, top1 = 56.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.733, top1 = 31.92%], valid : [loss = 2.753, top1 = 31.51%], test : [loss = 2.801, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.23%], valid : [loss = 0.997, top1 = 64.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1424/15625) 001424-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.476, top1 = 89.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.327, top1 = 92.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 0.293, top1 = 92.10%], valid : [loss = 1.316, top1 = 67.58%], test : [loss = 1.307, top1 = 67.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.25%], valid : [loss = 2.324, top1 = 41.12%], test : [loss = 2.364, top1 = 40.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.466, top1 = 84.14%], valid : [loss = 0.563, top1 = 81.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1425/15625) 001425-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 91.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.06 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.274, top1 = 93.93%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.83 ms.
cifar100       train : [loss = 0.045, top1 = 99.46%], valid : [loss = 1.275, top1 = 71.93%], test : [loss = 1.264, top1 = 72.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.71 ms.
ImageNet16-120 train : [loss = 1.396, top1 = 61.90%], valid : [loss = 2.191, top1 = 45.32%], test : [loss = 2.203, top1 = 45.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.324, top1 = 89.21%], valid : [loss = 0.483, top1 = 83.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1426/15625) 001426-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.583, top1 = 85.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10        train : [loss = 0.068, top1 = 97.95%], test  : [loss = 0.399, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.25 ms.
cifar100       train : [loss = 0.699, top1 = 79.72%], valid : [loss = 1.374, top1 = 63.52%], test : [loss = 1.370, top1 = 63.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.37%], valid : [loss = 2.624, top1 = 34.26%], test : [loss = 2.675, top1 = 34.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1427/15625) 001427-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.17 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.591, top1 = 88.08%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.60 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.397, top1 = 91.51%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.89 ms.
cifar100       train : [loss = 0.106, top1 = 98.20%], valid : [loss = 1.472, top1 = 67.13%], test : [loss = 1.443, top1 = 67.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.99%], valid : [loss = 2.436, top1 = 39.53%], test : [loss = 2.458, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.96%], valid : [loss = 0.710, top1 = 75.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1428/15625) 001428-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.506, top1 = 89.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.316, top1 = 93.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.117, top1 = 97.71%], valid : [loss = 1.297, top1 = 69.73%], test : [loss = 1.284, top1 = 69.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.24%], valid : [loss = 2.182, top1 = 44.32%], test : [loss = 2.200, top1 = 44.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1429/15625) 001429-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.490, top1 = 89.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.326, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.65 ms.
cifar100       train : [loss = 0.315, top1 = 91.54%], valid : [loss = 1.277, top1 = 67.39%], test : [loss = 1.257, top1 = 68.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.63%], valid : [loss = 2.331, top1 = 40.06%], test : [loss = 2.339, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1430/15625) 001430-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.510, top1 = 88.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.322, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.82 ms.
cifar100       train : [loss = 0.320, top1 = 91.46%], valid : [loss = 1.250, top1 = 67.89%], test : [loss = 1.260, top1 = 67.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.57%], valid : [loss = 2.324, top1 = 40.51%], test : [loss = 2.349, top1 = 41.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.42%], valid : [loss = 0.633, top1 = 78.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1431/15625) 001431-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.67%], valid : [loss = 0.462, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.152, top1 = 95.10%], test  : [loss = 0.351, top1 = 88.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.29 ms.
cifar100       train : [loss = 0.977, top1 = 72.15%], valid : [loss = 1.344, top1 = 62.29%], test : [loss = 1.342, top1 = 62.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 33.96%], valid : [loss = 2.673, top1 = 33.42%], test : [loss = 2.701, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1432/15625) 001432-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.447, top1 = 87.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.111, top1 = 96.57%], test  : [loss = 0.331, top1 = 89.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.14 ms.
cifar100       train : [loss = 0.862, top1 = 75.50%], valid : [loss = 1.302, top1 = 63.85%], test : [loss = 1.273, top1 = 64.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.78%], valid : [loss = 2.630, top1 = 34.26%], test : [loss = 2.649, top1 = 34.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.12%], valid : [loss = 0.663, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1433/15625) 001433-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.589, top1 = 87.83%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.404, top1 = 91.11%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.20 ms.
cifar100       train : [loss = 0.188, top1 = 95.78%], valid : [loss = 1.449, top1 = 66.43%], test : [loss = 1.451, top1 = 65.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.34 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.42%], valid : [loss = 2.484, top1 = 37.87%], test : [loss = 2.503, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.10%], valid : [loss = 0.787, top1 = 72.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1434/15625) 001434-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.466, top1 = 89.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.15 ms.
cifar100       train : [loss = 0.317, top1 = 91.46%], valid : [loss = 1.232, top1 = 68.37%], test : [loss = 1.251, top1 = 68.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.79%], valid : [loss = 2.322, top1 = 40.54%], test : [loss = 2.351, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1435/15625) 001435-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.47%], valid : [loss = 0.458, top1 = 86.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10        train : [loss = 0.148, top1 = 95.19%], test  : [loss = 0.338, top1 = 89.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.94 ms.
cifar100       train : [loss = 0.972, top1 = 72.41%], valid : [loss = 1.341, top1 = 62.70%], test : [loss = 1.346, top1 = 62.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.13%], valid : [loss = 2.682, top1 = 32.91%], test : [loss = 2.695, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1436/15625) 001436-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.11%], valid : [loss = 0.582, top1 = 86.63%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.87 ms.
cifar10        train : [loss = 0.062, top1 = 97.99%], test  : [loss = 0.374, top1 = 89.92%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.63 ms.
cifar100       train : [loss = 0.652, top1 = 80.82%], valid : [loss = 1.319, top1 = 65.29%], test : [loss = 1.320, top1 = 64.85%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.77%], valid : [loss = 2.494, top1 = 36.58%], test : [loss = 2.519, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.797, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1437/15625) 001437-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.548, top1 = 88.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.348, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.237, top1 = 93.71%], valid : [loss = 1.299, top1 = 68.10%], test : [loss = 1.298, top1 = 68.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.28%], valid : [loss = 2.431, top1 = 38.00%], test : [loss = 2.449, top1 = 38.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.74%], valid : [loss = 0.906, top1 = 67.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1438/15625) 001438-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.560, top1 = 88.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.59 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.362, top1 = 91.96%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.56 ms.
cifar100       train : [loss = 0.135, top1 = 96.85%], valid : [loss = 1.440, top1 = 67.06%], test : [loss = 1.415, top1 = 67.88%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 2.599, top1 = 34.13%], valid : [loss = 2.744, top1 = 31.36%], test : [loss = 2.754, top1 = 31.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.000, top1 = 63.98%], valid : [loss = 1.013, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1439/15625) 001439-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.523, top1 = 88.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.72 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.334, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.09 ms.
cifar100       train : [loss = 0.273, top1 = 92.77%], valid : [loss = 1.264, top1 = 67.68%], test : [loss = 1.270, top1 = 68.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.67%], valid : [loss = 2.314, top1 = 40.83%], test : [loss = 2.328, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.88%], valid : [loss = 0.724, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1440/15625) 001440-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.04 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.78%], valid : [loss = 0.570, top1 = 88.29%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.46 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.376, top1 = 91.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.65 ms.
cifar100       train : [loss = 0.330, top1 = 91.00%], valid : [loss = 1.450, top1 = 64.29%], test : [loss = 1.426, top1 = 64.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.46 ms.
ImageNet16-120 train : [loss = 2.466, top1 = 36.67%], valid : [loss = 2.586, top1 = 33.94%], test : [loss = 2.610, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.108, top1 = 60.03%], valid : [loss = 1.148, top1 = 58.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1441/15625) 001441-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.52%], valid : [loss = 0.548, top1 = 82.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.260, top1 = 91.11%], test  : [loss = 0.412, top1 = 86.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.91 ms.
cifar100       train : [loss = 1.419, top1 = 60.30%], valid : [loss = 1.667, top1 = 54.59%], test : [loss = 1.657, top1 = 55.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.952, top1 = 27.75%], valid : [loss = 2.954, top1 = 28.03%], test : [loss = 3.003, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.74%], valid : [loss = 1.018, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1442/15625) 001442-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.48%], valid : [loss = 0.863, top1 = 71.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 0.548, top1 = 80.88%], test  : [loss = 0.715, top1 = 75.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 1.764, top1 = 52.29%], valid : [loss = 2.043, top1 = 47.30%], test : [loss = 2.064, top1 = 46.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 3.574, top1 = 17.05%], valid : [loss = 3.632, top1 = 16.31%], test : [loss = 3.665, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1443/15625) 001443-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.69%], valid : [loss = 0.538, top1 = 88.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.340, top1 = 91.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.434, top1 = 87.35%], valid : [loss = 1.232, top1 = 67.83%], test : [loss = 1.250, top1 = 67.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.52%], valid : [loss = 2.380, top1 = 39.58%], test : [loss = 2.374, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1444/15625) 001444-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.40%], valid : [loss = 0.566, top1 = 87.35%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.33 ms.
cifar10        train : [loss = 0.046, top1 = 98.52%], test  : [loss = 0.383, top1 = 90.17%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.89 ms.
cifar100       train : [loss = 0.486, top1 = 85.84%], valid : [loss = 1.330, top1 = 65.50%], test : [loss = 1.342, top1 = 65.09%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.97 ms.
ImageNet16-120 train : [loss = 2.200, top1 = 43.05%], valid : [loss = 2.399, top1 = 39.07%], test : [loss = 2.414, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.20%], valid : [loss = 0.845, top1 = 70.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1445/15625) 001445-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.464, top1 = 90.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.325, top1 = 93.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.64 ms.
cifar100       train : [loss = 0.088, top1 = 98.34%], valid : [loss = 1.402, top1 = 69.39%], test : [loss = 1.408, top1 = 68.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 1.672, top1 = 55.33%], valid : [loss = 2.273, top1 = 43.70%], test : [loss = 2.318, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.48%], valid : [loss = 0.584, top1 = 80.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1446/15625) 001446-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.503, top1 = 89.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.67 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.309, top1 = 93.06%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.63 ms.
cifar100       train : [loss = 0.124, top1 = 97.57%], valid : [loss = 1.284, top1 = 69.29%], test : [loss = 1.272, top1 = 70.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.52 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.14%], valid : [loss = 2.270, top1 = 42.09%], test : [loss = 2.278, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.72%], valid : [loss = 0.700, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1447/15625) 001447-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.627, top1 = 86.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.027, top1 = 99.31%], test  : [loss = 0.440, top1 = 89.29%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.33 ms.
cifar100       train : [loss = 0.364, top1 = 90.37%], valid : [loss = 1.415, top1 = 64.87%], test : [loss = 1.391, top1 = 65.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.276, top1 = 41.52%], valid : [loss = 2.580, top1 = 35.26%], test : [loss = 2.604, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1448/15625) 001448-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.43 ms.
cifar10-valid  train : [loss = 0.462, top1 = 83.87%], valid : [loss = 0.635, top1 = 78.74%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10        train : [loss = 0.502, top1 = 82.68%], test  : [loss = 0.585, top1 = 80.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.67 ms.
cifar100       train : [loss = 1.671, top1 = 54.60%], valid : [loss = 1.848, top1 = 51.05%], test : [loss = 1.856, top1 = 51.01%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.58 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.29%], valid : [loss = 3.329, top1 = 21.51%], test : [loss = 3.353, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1449/15625) 001449-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.507, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.334, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.334, top1 = 90.86%], valid : [loss = 1.287, top1 = 67.08%], test : [loss = 1.268, top1 = 67.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.11%], valid : [loss = 2.393, top1 = 39.30%], test : [loss = 2.386, top1 = 40.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1450/15625) 001450-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.431, top1 = 90.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.294, top1 = 92.69%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.57 ms.
cifar100       train : [loss = 0.119, top1 = 97.88%], valid : [loss = 1.282, top1 = 69.72%], test : [loss = 1.256, top1 = 70.51%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 1.635, top1 = 56.19%], valid : [loss = 2.178, top1 = 44.64%], test : [loss = 2.195, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.11%], valid : [loss = 0.558, top1 = 81.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1451/15625) 001451-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.98%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.27 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.314, top1 = 92.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.81 ms.
cifar100       train : [loss = 0.206, top1 = 94.77%], valid : [loss = 1.292, top1 = 68.78%], test : [loss = 1.279, top1 = 69.07%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 1.789, top1 = 52.29%], valid : [loss = 2.187, top1 = 43.72%], test : [loss = 2.203, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.06%], valid : [loss = 0.625, top1 = 78.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1452/15625) 001452-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.77%], valid : [loss = 0.497, top1 = 84.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10        train : [loss = 0.271, top1 = 90.90%], test  : [loss = 0.382, top1 = 87.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.37 ms.
cifar100       train : [loss = 1.288, top1 = 63.85%], valid : [loss = 1.507, top1 = 58.55%], test : [loss = 1.501, top1 = 58.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 2.826, top1 = 30.41%], valid : [loss = 2.830, top1 = 30.68%], test : [loss = 2.861, top1 = 30.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.982, top1 = 65.10%], valid : [loss = 1.007, top1 = 64.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1453/15625) 001453-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.491, top1 = 88.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.313, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.316, top1 = 91.54%], valid : [loss = 1.267, top1 = 67.33%], test : [loss = 1.248, top1 = 68.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.60%], valid : [loss = 2.303, top1 = 41.22%], test : [loss = 2.334, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1454/15625) 001454-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.579, top1 = 87.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.379, top1 = 91.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.82 ms.
cifar100       train : [loss = 0.398, top1 = 88.74%], valid : [loss = 1.404, top1 = 65.05%], test : [loss = 1.414, top1 = 65.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.89%], valid : [loss = 2.518, top1 = 36.70%], test : [loss = 2.535, top1 = 36.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1455/15625) 001455-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.581, top1 = 87.75%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.79 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.399, top1 = 90.92%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.22 ms.
cifar100       train : [loss = 0.146, top1 = 96.88%], valid : [loss = 1.511, top1 = 66.16%], test : [loss = 1.539, top1 = 65.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.28 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.19%], valid : [loss = 2.473, top1 = 38.23%], test : [loss = 2.499, top1 = 38.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.07%], valid : [loss = 0.754, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1456/15625) 001456-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.31%], valid : [loss = 0.562, top1 = 82.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.206, top1 = 93.01%], test  : [loss = 0.399, top1 = 87.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.77 ms.
cifar100       train : [loss = 1.269, top1 = 63.81%], valid : [loss = 1.559, top1 = 57.35%], test : [loss = 1.570, top1 = 56.39%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.713, top1 = 32.33%], valid : [loss = 2.740, top1 = 31.60%], test : [loss = 2.772, top1 = 30.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.58%], valid : [loss = 1.015, top1 = 63.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1457/15625) 001457-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.500, top1 = 88.95%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.328, top1 = 92.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.41 ms.
cifar100       train : [loss = 0.325, top1 = 91.21%], valid : [loss = 1.273, top1 = 67.78%], test : [loss = 1.293, top1 = 67.55%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.62 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.23%], valid : [loss = 2.374, top1 = 39.11%], test : [loss = 2.397, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.32%], valid : [loss = 0.634, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1458/15625) 001458-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.97%], valid : [loss = 0.580, top1 = 85.74%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.18 ms.
cifar10        train : [loss = 0.055, top1 = 98.45%], test  : [loss = 0.381, top1 = 89.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.25 ms.
cifar100       train : [loss = 0.588, top1 = 83.03%], valid : [loss = 1.352, top1 = 64.85%], test : [loss = 1.343, top1 = 64.85%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.362, top1 = 39.53%], valid : [loss = 2.489, top1 = 36.98%], test : [loss = 2.540, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.44%], valid : [loss = 0.808, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1459/15625) 001459-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.82 ms.
cifar10-valid  train : [loss = 0.001, top1 = 100.00%], valid : [loss = 0.424, top1 = 91.45%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.18 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.277, top1 = 94.30%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.37 ms.
cifar100       train : [loss = 0.020, top1 = 99.83%], valid : [loss = 1.310, top1 = 72.51%], test : [loss = 1.282, top1 = 73.14%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.45 ms.
ImageNet16-120 train : [loss = 1.147, top1 = 68.20%], valid : [loss = 2.204, top1 = 46.27%], test : [loss = 2.222, top1 = 46.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.320, top1 = 88.96%], valid : [loss = 0.472, top1 = 84.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1460/15625) 001460-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.481, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.35 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.308, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.90 ms.
cifar100       train : [loss = 0.313, top1 = 91.68%], valid : [loss = 1.255, top1 = 67.86%], test : [loss = 1.250, top1 = 67.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.74%], valid : [loss = 2.324, top1 = 40.18%], test : [loss = 2.324, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.41%], valid : [loss = 0.605, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1461/15625) 001461-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.557, top1 = 88.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.387, top1 = 91.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.61 ms.
cifar100       train : [loss = 0.143, top1 = 97.05%], valid : [loss = 1.457, top1 = 66.61%], test : [loss = 1.475, top1 = 66.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.72%], valid : [loss = 2.411, top1 = 39.03%], test : [loss = 2.420, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.30%], valid : [loss = 0.714, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1462/15625) 001462-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=220.12 M, Params=1.532 MB, latency=23.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.491, top1 = 90.20%]
cifar10        FLOP=220.12 M, Params=1.532 MB, latency=24.17 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.296, top1 = 93.76%]
cifar100       FLOP=220.13 M, Params=1.537 MB, latency=22.58 ms.
cifar100       train : [loss = 0.024, top1 = 99.79%], valid : [loss = 1.365, top1 = 70.71%], test : [loss = 1.354, top1 = 71.11%]
ImageNet16-120 FLOP= 55.04 M, Params=1.539 MB, latency=22.16 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.60%], valid : [loss = 2.316, top1 = 40.78%], test : [loss = 2.311, top1 = 41.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=220.12 M, Params=1.532 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.61%], valid : [loss = 0.866, top1 = 69.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1463/15625) 001463-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.624, top1 = 87.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.418, top1 = 90.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.06 ms.
cifar100       train : [loss = 0.169, top1 = 96.48%], valid : [loss = 1.441, top1 = 66.44%], test : [loss = 1.474, top1 = 66.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.23%], valid : [loss = 2.539, top1 = 36.76%], test : [loss = 2.545, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.80%], valid : [loss = 0.767, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1464/15625) 001464-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.571, top1 = 87.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.388, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.398, top1 = 88.75%], valid : [loss = 1.397, top1 = 65.45%], test : [loss = 1.393, top1 = 65.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.73%], valid : [loss = 2.509, top1 = 36.88%], test : [loss = 2.531, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1465/15625) 001465-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.145, top1 = 95.29%], valid : [loss = 0.510, top1 = 85.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10        train : [loss = 0.167, top1 = 94.37%], test  : [loss = 0.365, top1 = 88.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.78 ms.
cifar100       train : [loss = 1.045, top1 = 70.16%], valid : [loss = 1.410, top1 = 61.61%], test : [loss = 1.402, top1 = 61.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.26 ms.
ImageNet16-120 train : [loss = 2.593, top1 = 34.81%], valid : [loss = 2.626, top1 = 34.51%], test : [loss = 2.668, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 68.10%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1466/15625) 001466-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.10%], valid : [loss = 0.530, top1 = 84.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10        train : [loss = 0.156, top1 = 94.82%], test  : [loss = 0.385, top1 = 87.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.31 ms.
cifar100       train : [loss = 1.110, top1 = 68.25%], valid : [loss = 1.461, top1 = 59.71%], test : [loss = 1.461, top1 = 59.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.570, top1 = 35.25%], valid : [loss = 2.638, top1 = 33.77%], test : [loss = 2.669, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 66.91%], valid : [loss = 0.975, top1 = 65.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1467/15625) 001467-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.543, top1 = 88.72%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.81 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.334, top1 = 92.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.47 ms.
cifar100       train : [loss = 0.273, top1 = 92.50%], valid : [loss = 1.277, top1 = 68.24%], test : [loss = 1.270, top1 = 68.53%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.47%], valid : [loss = 2.278, top1 = 41.12%], test : [loss = 2.302, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.90%], valid : [loss = 0.826, top1 = 70.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1468/15625) 001468-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.42%], valid : [loss = 0.484, top1 = 84.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.13 ms.
cifar10        train : [loss = 0.202, top1 = 93.24%], test  : [loss = 0.370, top1 = 87.72%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.08 ms.
cifar100       train : [loss = 1.197, top1 = 66.25%], valid : [loss = 1.504, top1 = 58.37%], test : [loss = 1.500, top1 = 58.40%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.46%], valid : [loss = 3.234, top1 = 22.82%], test : [loss = 3.257, top1 = 22.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.82%], valid : [loss = 1.022, top1 = 63.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1469/15625) 001469-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.563, top1 = 88.80%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.377, top1 = 92.23%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.67 ms.
cifar100       train : [loss = 0.097, top1 = 98.21%], valid : [loss = 1.464, top1 = 67.95%], test : [loss = 1.446, top1 = 68.15%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.09%], valid : [loss = 2.440, top1 = 39.12%], test : [loss = 2.445, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.78%], valid : [loss = 0.745, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1470/15625) 001470-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.19%], valid : [loss = 0.573, top1 = 86.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10        train : [loss = 0.065, top1 = 97.91%], test  : [loss = 0.382, top1 = 89.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.26 ms.
cifar100       train : [loss = 0.668, top1 = 80.21%], valid : [loss = 1.332, top1 = 64.52%], test : [loss = 1.335, top1 = 64.47%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.78%], valid : [loss = 2.475, top1 = 37.27%], test : [loss = 2.506, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.63%], valid : [loss = 0.769, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1471/15625) 001471-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.64%], valid : [loss = 0.565, top1 = 87.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.81 ms.
cifar10        train : [loss = 0.029, top1 = 99.16%], test  : [loss = 0.365, top1 = 91.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.43 ms.
cifar100       train : [loss = 0.497, top1 = 85.71%], valid : [loss = 1.349, top1 = 65.03%], test : [loss = 1.349, top1 = 65.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.40%], valid : [loss = 2.594, top1 = 34.20%], test : [loss = 2.620, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 0.963, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1472/15625) 001472-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.516, top1 = 89.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.57 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.345, top1 = 92.62%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.31 ms.
cifar100       train : [loss = 0.090, top1 = 98.50%], valid : [loss = 1.452, top1 = 68.36%], test : [loss = 1.447, top1 = 68.53%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.28%], valid : [loss = 2.353, top1 = 41.30%], test : [loss = 2.363, top1 = 41.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.50%], valid : [loss = 0.707, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1473/15625) 001473-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.574, top1 = 87.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.383, top1 = 91.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.67 ms.
cifar100       train : [loss = 0.406, top1 = 88.58%], valid : [loss = 1.394, top1 = 65.19%], test : [loss = 1.406, top1 = 65.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 41.07%], valid : [loss = 2.518, top1 = 36.56%], test : [loss = 2.547, top1 = 36.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1474/15625) 001474-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.35%], valid : [loss = 0.585, top1 = 86.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10        train : [loss = 0.072, top1 = 97.77%], test  : [loss = 0.402, top1 = 88.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.96 ms.
cifar100       train : [loss = 0.709, top1 = 79.56%], valid : [loss = 1.372, top1 = 63.51%], test : [loss = 1.365, top1 = 63.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.17%], valid : [loss = 2.651, top1 = 34.33%], test : [loss = 2.689, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1475/15625) 001475-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.319, top1 = 91.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.08 ms.
cifar100       train : [loss = 0.325, top1 = 91.12%], valid : [loss = 1.287, top1 = 67.27%], test : [loss = 1.309, top1 = 66.97%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.40%], valid : [loss = 2.371, top1 = 40.24%], test : [loss = 2.391, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1476/15625) 001476-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.73%], valid : [loss = 0.574, top1 = 81.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.267, top1 = 90.79%], test  : [loss = 0.421, top1 = 86.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.49 ms.
cifar100       train : [loss = 1.463, top1 = 59.10%], valid : [loss = 1.696, top1 = 54.22%], test : [loss = 1.698, top1 = 53.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.932, top1 = 27.91%], valid : [loss = 2.956, top1 = 28.04%], test : [loss = 3.007, top1 = 27.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1477/15625) 001477-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.01 ms.
cifar10-valid  train : [loss = 1.742, top1 = 36.46%], valid : [loss = 1.767, top1 = 35.79%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.71 ms.
cifar10        train : [loss = 1.271, top1 = 53.90%], test  : [loss = 1.281, top1 = 53.46%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.72 ms.
cifar100       train : [loss = 3.799, top1 = 11.93%], valid : [loss = 3.910, top1 = 10.25%], test : [loss = 3.903, top1 = 10.83%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.44 ms.
ImageNet16-120 train : [loss = 3.935, top1 = 11.34%], valid : [loss = 3.922, top1 = 12.19%], test : [loss = 3.939, top1 = 11.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.53%], valid : [loss = 1.967, top1 = 27.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1478/15625) 001478-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.202, top1 = 93.23%], valid : [loss = 0.547, top1 = 83.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10        train : [loss = 0.194, top1 = 93.39%], test  : [loss = 0.393, top1 = 87.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 1.264, top1 = 64.17%], valid : [loss = 1.550, top1 = 57.57%], test : [loss = 1.559, top1 = 57.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.695, top1 = 32.68%], valid : [loss = 2.741, top1 = 31.68%], test : [loss = 2.777, top1 = 31.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.42%], valid : [loss = 0.987, top1 = 65.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1479/15625) 001479-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.531, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.342, top1 = 92.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.92 ms.
cifar100       train : [loss = 0.346, top1 = 89.98%], valid : [loss = 1.284, top1 = 67.60%], test : [loss = 1.290, top1 = 67.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.63%], valid : [loss = 2.313, top1 = 40.21%], test : [loss = 2.328, top1 = 40.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.51%], valid : [loss = 0.926, top1 = 67.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1480/15625) 001480-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.69%], valid : [loss = 0.452, top1 = 86.36%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.153, top1 = 95.04%], test  : [loss = 0.345, top1 = 88.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.39 ms.
cifar100       train : [loss = 0.972, top1 = 72.42%], valid : [loss = 1.346, top1 = 62.44%], test : [loss = 1.343, top1 = 62.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.15%], valid : [loss = 2.680, top1 = 33.06%], test : [loss = 2.704, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1481/15625) 001481-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.23%], valid : [loss = 0.474, top1 = 84.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.10 ms.
cifar10        train : [loss = 0.298, top1 = 90.12%], test  : [loss = 0.394, top1 = 86.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.44 ms.
cifar100       train : [loss = 1.316, top1 = 63.69%], valid : [loss = 1.511, top1 = 58.13%], test : [loss = 1.485, top1 = 58.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.62%], valid : [loss = 2.907, top1 = 29.71%], test : [loss = 2.944, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.81%], valid : [loss = 0.768, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1482/15625) 001482-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.27%], valid : [loss = 0.911, top1 = 77.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.166, top1 = 94.33%], test  : [loss = 0.569, top1 = 83.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 0.952, top1 = 72.62%], valid : [loss = 1.747, top1 = 55.49%], test : [loss = 1.727, top1 = 55.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 3.153, top1 = 24.32%], valid : [loss = 3.285, top1 = 22.51%], test : [loss = 3.325, top1 = 21.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.101, top1 = 60.25%], valid : [loss = 1.159, top1 = 58.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1483/15625) 001483-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.609, top1 = 85.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.391, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.18 ms.
cifar100       train : [loss = 0.707, top1 = 79.52%], valid : [loss = 1.389, top1 = 62.88%], test : [loss = 1.377, top1 = 63.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.94%], valid : [loss = 2.644, top1 = 34.49%], test : [loss = 2.684, top1 = 33.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.26%], valid : [loss = 0.776, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1484/15625) 001484-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.73%], valid : [loss = 0.548, top1 = 86.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.51 ms.
cifar10        train : [loss = 0.077, top1 = 97.46%], test  : [loss = 0.371, top1 = 89.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.35 ms.
cifar100       train : [loss = 0.720, top1 = 78.66%], valid : [loss = 1.386, top1 = 63.81%], test : [loss = 1.359, top1 = 63.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 2.515, top1 = 36.28%], valid : [loss = 2.631, top1 = 34.06%], test : [loss = 2.673, top1 = 33.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.76%], valid : [loss = 0.667, top1 = 77.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1485/15625) 001485-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.329, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.05 ms.
cifar100       train : [loss = 0.303, top1 = 91.70%], valid : [loss = 1.263, top1 = 68.01%], test : [loss = 1.291, top1 = 67.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.85%], valid : [loss = 2.309, top1 = 40.29%], test : [loss = 2.336, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.18%], valid : [loss = 0.833, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1486/15625) 001486-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.528, top1 = 88.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.57 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.332, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.78 ms.
cifar100       train : [loss = 0.286, top1 = 92.36%], valid : [loss = 1.292, top1 = 67.75%], test : [loss = 1.289, top1 = 67.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.16%], valid : [loss = 2.398, top1 = 38.60%], test : [loss = 2.401, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.16%], valid : [loss = 0.797, top1 = 72.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1487/15625) 001487-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.439, top1 = 89.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.310, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.74 ms.
cifar100       train : [loss = 0.223, top1 = 94.55%], valid : [loss = 1.297, top1 = 68.66%], test : [loss = 1.258, top1 = 69.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.24%], valid : [loss = 2.277, top1 = 42.04%], test : [loss = 2.288, top1 = 42.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.82%], valid : [loss = 0.540, top1 = 81.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1488/15625) 001488-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.95%], valid : [loss = 0.552, top1 = 86.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.062, top1 = 98.16%], test  : [loss = 0.361, top1 = 89.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.37 ms.
cifar100       train : [loss = 0.592, top1 = 82.85%], valid : [loss = 1.361, top1 = 64.47%], test : [loss = 1.344, top1 = 64.53%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.23%], valid : [loss = 2.517, top1 = 36.41%], test : [loss = 2.533, top1 = 36.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.40%], valid : [loss = 0.835, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1489/15625) 001489-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.535, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.45 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.344, top1 = 92.48%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.37 ms.
cifar100       train : [loss = 0.144, top1 = 96.98%], valid : [loss = 1.285, top1 = 69.09%], test : [loss = 1.306, top1 = 68.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.76%], valid : [loss = 2.278, top1 = 41.53%], test : [loss = 2.266, top1 = 41.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.62%], valid : [loss = 0.692, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1490/15625) 001490-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.60%], valid : [loss = 0.430, top1 = 88.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.80 ms.
cifar10        train : [loss = 0.051, top1 = 98.80%], test  : [loss = 0.303, top1 = 91.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.90 ms.
cifar100       train : [loss = 0.563, top1 = 84.63%], valid : [loss = 1.205, top1 = 67.13%], test : [loss = 1.215, top1 = 67.01%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.44 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.82%], valid : [loss = 2.453, top1 = 38.21%], test : [loss = 2.482, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.74%], valid : [loss = 0.633, top1 = 78.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1491/15625) 001491-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.541, top1 = 89.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.337, top1 = 92.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.26 ms.
cifar100       train : [loss = 0.146, top1 = 96.54%], valid : [loss = 1.381, top1 = 68.01%], test : [loss = 1.380, top1 = 68.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.72%], valid : [loss = 2.364, top1 = 39.81%], test : [loss = 2.357, top1 = 40.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.72%], valid : [loss = 0.952, top1 = 65.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1492/15625) 001492-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.594, top1 = 86.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.394, top1 = 90.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.39 ms.
cifar100       train : [loss = 0.457, top1 = 86.72%], valid : [loss = 1.391, top1 = 65.09%], test : [loss = 1.367, top1 = 64.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.63%], valid : [loss = 2.493, top1 = 37.19%], test : [loss = 2.528, top1 = 37.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 72.96%], valid : [loss = 0.807, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1493/15625) 001493-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.502, top1 = 88.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.329, top1 = 92.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.84 ms.
cifar100       train : [loss = 0.343, top1 = 90.58%], valid : [loss = 1.216, top1 = 68.21%], test : [loss = 1.247, top1 = 68.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.13%], valid : [loss = 2.316, top1 = 41.06%], test : [loss = 2.313, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.84%], valid : [loss = 0.642, top1 = 78.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1494/15625) 001494-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.566, top1 = 87.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.375, top1 = 91.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.16 ms.
cifar100       train : [loss = 0.317, top1 = 91.32%], valid : [loss = 1.419, top1 = 65.44%], test : [loss = 1.429, top1 = 66.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.53%], valid : [loss = 2.414, top1 = 38.98%], test : [loss = 2.460, top1 = 38.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.91%], valid : [loss = 0.804, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1495/15625) 001495-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.72%], valid : [loss = 0.608, top1 = 84.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10        train : [loss = 0.125, top1 = 95.77%], test  : [loss = 0.414, top1 = 88.04%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.21 ms.
cifar100       train : [loss = 0.870, top1 = 74.29%], valid : [loss = 1.471, top1 = 60.50%], test : [loss = 1.468, top1 = 61.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.685, top1 = 32.81%], valid : [loss = 2.771, top1 = 31.41%], test : [loss = 2.813, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.32%], valid : [loss = 0.726, top1 = 74.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1496/15625) 001496-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.25%], valid : [loss = 0.605, top1 = 85.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.79 ms.
cifar10        train : [loss = 0.067, top1 = 97.98%], test  : [loss = 0.396, top1 = 88.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.37 ms.
cifar100       train : [loss = 0.709, top1 = 79.40%], valid : [loss = 1.394, top1 = 63.11%], test : [loss = 1.367, top1 = 63.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.04%], valid : [loss = 2.660, top1 = 33.62%], test : [loss = 2.685, top1 = 33.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1497/15625) 001497-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.36%], valid : [loss = 0.477, top1 = 84.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.18 ms.
cifar10        train : [loss = 0.297, top1 = 90.12%], test  : [loss = 0.400, top1 = 86.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 1.325, top1 = 63.40%], valid : [loss = 1.526, top1 = 57.88%], test : [loss = 1.504, top1 = 58.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.85%], valid : [loss = 2.882, top1 = 29.97%], test : [loss = 2.951, top1 = 28.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1498/15625) 001498-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=24.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.500, top1 = 89.93%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=24.03 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.306, top1 = 93.10%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=22.07 ms.
cifar100       train : [loss = 0.086, top1 = 98.64%], valid : [loss = 1.272, top1 = 69.96%], test : [loss = 1.272, top1 = 70.20%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=21.27 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.88%], valid : [loss = 2.188, top1 = 43.61%], test : [loss = 2.175, top1 = 44.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 78.17%], valid : [loss = 0.716, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1499/15625) 001499-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.539, top1 = 88.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.61 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.349, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.194, top1 = 95.16%], valid : [loss = 1.332, top1 = 67.90%], test : [loss = 1.354, top1 = 67.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.29%], valid : [loss = 2.393, top1 = 38.96%], test : [loss = 2.385, top1 = 39.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.44%], valid : [loss = 0.827, top1 = 70.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1500/15625) 001500-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.41%], valid : [loss = 0.564, top1 = 87.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.01 ms.
cifar10        train : [loss = 0.027, top1 = 99.19%], test  : [loss = 0.375, top1 = 91.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.61 ms.
cifar100       train : [loss = 0.387, top1 = 88.87%], valid : [loss = 1.364, top1 = 65.45%], test : [loss = 1.367, top1 = 65.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.712, top1 = 31.38%], valid : [loss = 2.785, top1 = 29.31%], test : [loss = 2.787, top1 = 30.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.31%], valid : [loss = 1.275, top1 = 53.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1501/15625) 001501-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 1.108, top1 = 60.58%], valid : [loss = 1.160, top1 = 59.00%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10        train : [loss = 1.046, top1 = 63.08%], test  : [loss = 1.052, top1 = 62.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.55 ms.
cifar100       train : [loss = 2.579, top1 = 34.79%], valid : [loss = 2.647, top1 = 33.77%], test : [loss = 2.630, top1 = 34.23%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.35 ms.
ImageNet16-120 train : [loss = 3.781, top1 = 13.73%], valid : [loss = 3.764, top1 = 14.40%], test : [loss = 3.787, top1 = 13.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1502/15625) 001502-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.043, top1 = 99.00%], valid : [loss = 0.523, top1 = 86.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.068, top1 = 98.00%], test  : [loss = 0.350, top1 = 90.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.27 ms.
cifar100       train : [loss = 0.641, top1 = 81.56%], valid : [loss = 1.282, top1 = 65.25%], test : [loss = 1.264, top1 = 65.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.89%], valid : [loss = 2.474, top1 = 37.29%], test : [loss = 2.526, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.872, top1 = 68.74%], valid : [loss = 0.917, top1 = 67.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1503/15625) 001503-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.575, top1 = 87.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.375, top1 = 91.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.50 ms.
cifar100       train : [loss = 0.384, top1 = 89.16%], valid : [loss = 1.409, top1 = 65.37%], test : [loss = 1.415, top1 = 65.07%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.59%], valid : [loss = 2.479, top1 = 37.59%], test : [loss = 2.515, top1 = 36.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.01%], valid : [loss = 0.837, top1 = 70.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1504/15625) 001504-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.52%], valid : [loss = 0.458, top1 = 86.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.52 ms.
cifar10        train : [loss = 0.149, top1 = 95.18%], test  : [loss = 0.346, top1 = 88.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 0.964, top1 = 72.49%], valid : [loss = 1.337, top1 = 62.77%], test : [loss = 1.336, top1 = 62.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.01%], valid : [loss = 2.686, top1 = 32.73%], test : [loss = 2.709, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1505/15625) 001505-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.91 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.84%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1506/15625) 001506-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.556, top1 = 89.04%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.375, top1 = 92.40%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.27 ms.
cifar100       train : [loss = 0.100, top1 = 98.25%], valid : [loss = 1.463, top1 = 67.87%], test : [loss = 1.439, top1 = 68.20%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.55 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.57%], valid : [loss = 2.421, top1 = 39.46%], test : [loss = 2.448, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.00%], valid : [loss = 0.715, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1507/15625) 001507-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.475, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.310, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.36 ms.
cifar100       train : [loss = 0.323, top1 = 91.20%], valid : [loss = 1.240, top1 = 68.27%], test : [loss = 1.232, top1 = 67.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.67%], valid : [loss = 2.320, top1 = 41.04%], test : [loss = 2.333, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 80.95%], valid : [loss = 0.624, top1 = 78.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1508/15625) 001508-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.05%], valid : [loss = 0.612, top1 = 84.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.087, top1 = 97.14%], test  : [loss = 0.419, top1 = 88.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.12 ms.
cifar100       train : [loss = 0.673, top1 = 80.12%], valid : [loss = 1.521, top1 = 60.51%], test : [loss = 1.506, top1 = 61.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 3.172, top1 = 22.55%], valid : [loss = 3.186, top1 = 22.57%], test : [loss = 3.231, top1 = 22.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1509/15625) 001509-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.60 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.96 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1510/15625) 001510-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.573, top1 = 88.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.400, top1 = 91.86%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.104, top1 = 98.17%], valid : [loss = 1.521, top1 = 67.02%], test : [loss = 1.531, top1 = 66.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.28%], valid : [loss = 2.454, top1 = 39.44%], test : [loss = 2.463, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.98%], valid : [loss = 0.711, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1511/15625) 001511-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.536, top1 = 88.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.351, top1 = 91.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.203, top1 = 94.79%], valid : [loss = 1.280, top1 = 68.69%], test : [loss = 1.289, top1 = 69.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 35.40%], valid : [loss = 2.640, top1 = 33.01%], test : [loss = 2.663, top1 = 32.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.89%], valid : [loss = 0.952, top1 = 66.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1512/15625) 001512-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.611, top1 = 87.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.408, top1 = 91.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 0.217, top1 = 94.57%], valid : [loss = 1.518, top1 = 64.91%], test : [loss = 1.501, top1 = 65.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.94%], valid : [loss = 2.514, top1 = 36.96%], test : [loss = 2.561, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.57%], valid : [loss = 0.791, top1 = 72.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1513/15625) 001513-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.616, top1 = 86.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.394, top1 = 90.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.501, top1 = 85.44%], valid : [loss = 1.407, top1 = 64.29%], test : [loss = 1.407, top1 = 64.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.82 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.85%], valid : [loss = 2.544, top1 = 35.76%], test : [loss = 2.574, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.84%], valid : [loss = 0.851, top1 = 70.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1514/15625) 001514-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.426, top1 = 90.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.289, top1 = 93.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.94 ms.
cifar100       train : [loss = 0.111, top1 = 97.95%], valid : [loss = 1.294, top1 = 70.07%], test : [loss = 1.283, top1 = 69.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.680, top1 = 55.01%], valid : [loss = 2.217, top1 = 43.82%], test : [loss = 2.244, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.23%], valid : [loss = 0.517, top1 = 82.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1515/15625) 001515-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.70%], valid : [loss = 0.528, top1 = 84.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.161, top1 = 94.63%], test  : [loss = 0.365, top1 = 88.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.95 ms.
cifar100       train : [loss = 1.144, top1 = 67.49%], valid : [loss = 1.469, top1 = 59.98%], test : [loss = 1.469, top1 = 59.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.54%], valid : [loss = 2.668, top1 = 33.22%], test : [loss = 2.712, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.49%], valid : [loss = 0.981, top1 = 65.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1516/15625) 001516-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.302, top1 = 92.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.320, top1 = 91.30%], valid : [loss = 1.308, top1 = 67.15%], test : [loss = 1.314, top1 = 67.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.47%], valid : [loss = 2.364, top1 = 39.99%], test : [loss = 2.395, top1 = 39.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.00%], valid : [loss = 0.556, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1517/15625) 001517-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.62%], valid : [loss = 0.554, top1 = 87.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.366, top1 = 91.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.19 ms.
cifar100       train : [loss = 0.544, top1 = 84.26%], valid : [loss = 1.379, top1 = 63.78%], test : [loss = 1.365, top1 = 64.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.13%], valid : [loss = 2.634, top1 = 33.31%], test : [loss = 2.659, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1518/15625) 001518-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.24%], valid : [loss = 0.606, top1 = 83.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.40 ms.
cifar10        train : [loss = 0.166, top1 = 94.45%], test  : [loss = 0.397, top1 = 87.65%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.48 ms.
cifar100       train : [loss = 0.962, top1 = 72.23%], valid : [loss = 1.472, top1 = 60.59%], test : [loss = 1.444, top1 = 60.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.39%], valid : [loss = 2.743, top1 = 31.84%], test : [loss = 2.778, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.00%], valid : [loss = 0.929, top1 = 66.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1519/15625) 001519-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.540, top1 = 88.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.42 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.366, top1 = 91.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.45 ms.
cifar100       train : [loss = 0.193, top1 = 95.65%], valid : [loss = 1.402, top1 = 66.93%], test : [loss = 1.375, top1 = 67.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 2.007, top1 = 47.41%], valid : [loss = 2.436, top1 = 38.56%], test : [loss = 2.430, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.42%], valid : [loss = 0.719, top1 = 75.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1520/15625) 001520-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.30%], valid : [loss = 0.471, top1 = 84.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.298, top1 = 90.03%], test  : [loss = 0.400, top1 = 86.48%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 1.323, top1 = 63.32%], valid : [loss = 1.530, top1 = 58.06%], test : [loss = 1.507, top1 = 58.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.76 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.80%], valid : [loss = 2.897, top1 = 29.60%], test : [loss = 2.964, top1 = 28.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1521/15625) 001521-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.461, top1 = 89.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.325, top1 = 92.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 0.182, top1 = 95.54%], valid : [loss = 1.318, top1 = 69.46%], test : [loss = 1.326, top1 = 68.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.39%], valid : [loss = 2.287, top1 = 42.46%], test : [loss = 2.317, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.73%], valid : [loss = 0.560, top1 = 81.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1522/15625) 001522-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.44%], valid : [loss = 0.649, top1 = 78.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.40 ms.
cifar10        train : [loss = 0.508, top1 = 82.36%], test  : [loss = 0.594, top1 = 79.86%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.68 ms.
cifar100       train : [loss = 1.691, top1 = 54.16%], valid : [loss = 1.860, top1 = 50.31%], test : [loss = 1.862, top1 = 50.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.23 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.31%], valid : [loss = 3.306, top1 = 21.40%], test : [loss = 3.341, top1 = 21.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1523/15625) 001523-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.553, top1 = 88.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.31 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.355, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.95 ms.
cifar100       train : [loss = 0.182, top1 = 95.49%], valid : [loss = 1.377, top1 = 67.89%], test : [loss = 1.382, top1 = 67.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.91%], valid : [loss = 2.387, top1 = 39.78%], test : [loss = 2.380, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.42%], valid : [loss = 0.993, top1 = 64.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1524/15625) 001524-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.556, top1 = 87.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.031, top1 = 99.06%], test  : [loss = 0.354, top1 = 91.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.97 ms.
cifar100       train : [loss = 0.529, top1 = 84.70%], valid : [loss = 1.350, top1 = 64.03%], test : [loss = 1.344, top1 = 64.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.605, top1 = 33.88%], valid : [loss = 2.683, top1 = 32.34%], test : [loss = 2.696, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1525/15625) 001525-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.628, top1 = 87.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.411, top1 = 90.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.73 ms.
cifar100       train : [loss = 0.238, top1 = 93.99%], valid : [loss = 1.572, top1 = 63.93%], test : [loss = 1.549, top1 = 64.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.73%], valid : [loss = 2.495, top1 = 36.93%], test : [loss = 2.514, top1 = 37.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.06%], valid : [loss = 0.775, top1 = 73.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1526/15625) 001526-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.07%], valid : [loss = 0.645, top1 = 84.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.051, top1 = 98.41%], test  : [loss = 0.397, top1 = 89.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.656, top1 = 80.77%], valid : [loss = 1.443, top1 = 62.38%], test : [loss = 1.433, top1 = 63.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 37.29%], valid : [loss = 2.622, top1 = 34.51%], test : [loss = 2.658, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.08%], valid : [loss = 0.870, top1 = 69.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1527/15625) 001527-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.453, top1 = 90.14%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.27 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.307, top1 = 92.85%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.63 ms.
cifar100       train : [loss = 0.115, top1 = 97.75%], valid : [loss = 1.290, top1 = 70.14%], test : [loss = 1.286, top1 = 70.34%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 1.626, top1 = 56.31%], valid : [loss = 2.170, top1 = 44.63%], test : [loss = 2.204, top1 = 44.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.21%], valid : [loss = 0.536, top1 = 81.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1528/15625) 001528-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.43%], valid : [loss = 0.646, top1 = 78.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.99 ms.
cifar10        train : [loss = 0.508, top1 = 82.42%], test  : [loss = 0.583, top1 = 80.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.713, top1 = 53.57%], valid : [loss = 1.876, top1 = 50.01%], test : [loss = 1.894, top1 = 50.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 21.15%], valid : [loss = 3.310, top1 = 21.94%], test : [loss = 3.347, top1 = 21.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.71%], valid : [loss = 1.305, top1 = 53.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1529/15625) 001529-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.328, top1 = 92.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.84 ms.
cifar100       train : [loss = 0.313, top1 = 91.62%], valid : [loss = 1.275, top1 = 67.30%], test : [loss = 1.253, top1 = 67.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.79%], valid : [loss = 2.329, top1 = 40.49%], test : [loss = 2.339, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.42%], valid : [loss = 0.702, top1 = 75.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1530/15625) 001530-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.430, top1 = 90.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.296, top1 = 92.86%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.125, top1 = 97.61%], valid : [loss = 1.310, top1 = 69.61%], test : [loss = 1.292, top1 = 69.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.705, top1 = 54.41%], valid : [loss = 2.214, top1 = 43.63%], test : [loss = 2.230, top1 = 44.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.32%], valid : [loss = 0.547, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1531/15625) 001531-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.324, top1 = 88.67%], valid : [loss = 0.601, top1 = 80.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10        train : [loss = 0.288, top1 = 90.13%], test  : [loss = 0.436, top1 = 85.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.81 ms.
cifar100       train : [loss = 1.541, top1 = 56.98%], valid : [loss = 1.773, top1 = 52.02%], test : [loss = 1.796, top1 = 51.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 2.963, top1 = 27.40%], valid : [loss = 2.985, top1 = 27.23%], test : [loss = 3.019, top1 = 26.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.50%], valid : [loss = 1.021, top1 = 63.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1532/15625) 001532-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.72%], valid : [loss = 0.526, top1 = 87.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10        train : [loss = 0.035, top1 = 99.06%], test  : [loss = 0.367, top1 = 90.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.27 ms.
cifar100       train : [loss = 0.505, top1 = 85.30%], valid : [loss = 1.325, top1 = 65.82%], test : [loss = 1.322, top1 = 66.17%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.38%], valid : [loss = 2.467, top1 = 37.73%], test : [loss = 2.500, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.29%], valid : [loss = 0.632, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1533/15625) 001533-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.21%], valid : [loss = 0.620, top1 = 79.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.313, top1 = 89.26%], test  : [loss = 0.455, top1 = 84.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.25 ms.
cifar100       train : [loss = 1.585, top1 = 55.84%], valid : [loss = 1.829, top1 = 50.51%], test : [loss = 1.818, top1 = 51.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.948, top1 = 27.60%], valid : [loss = 2.970, top1 = 27.30%], test : [loss = 3.025, top1 = 26.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 62.43%], valid : [loss = 1.072, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1534/15625) 001534-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.75%], valid : [loss = 0.979, top1 = 66.54%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.79 ms.
cifar10        train : [loss = 0.779, top1 = 72.66%], test  : [loss = 0.867, top1 = 69.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.50 ms.
cifar100       train : [loss = 2.164, top1 = 43.16%], valid : [loss = 2.340, top1 = 40.12%], test : [loss = 2.365, top1 = 40.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 3.742, top1 = 14.30%], valid : [loss = 3.775, top1 = 14.41%], test : [loss = 3.771, top1 = 13.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.462, top1 = 46.22%], valid : [loss = 1.477, top1 = 46.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1535/15625) 001535-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.686, top1 = 84.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10        train : [loss = 0.057, top1 = 98.25%], test  : [loss = 0.436, top1 = 88.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.73 ms.
cifar100       train : [loss = 0.625, top1 = 81.74%], valid : [loss = 1.504, top1 = 61.95%], test : [loss = 1.498, top1 = 62.13%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.46%], valid : [loss = 2.816, top1 = 30.14%], test : [loss = 2.880, top1 = 30.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.890, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1536/15625) 001536-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.599, top1 = 87.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.397, top1 = 91.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.69 ms.
cifar100       train : [loss = 0.227, top1 = 94.26%], valid : [loss = 1.503, top1 = 65.24%], test : [loss = 1.486, top1 = 65.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.34%], valid : [loss = 2.457, top1 = 38.53%], test : [loss = 2.488, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.65%], valid : [loss = 0.767, top1 = 73.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1537/15625) 001537-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.505, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.328, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.57 ms.
cifar100       train : [loss = 0.324, top1 = 91.24%], valid : [loss = 1.277, top1 = 67.21%], test : [loss = 1.280, top1 = 67.75%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.16%], valid : [loss = 2.397, top1 = 38.97%], test : [loss = 2.416, top1 = 38.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.79%], valid : [loss = 0.648, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1538/15625) 001538-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.623, top1 = 87.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.397, top1 = 91.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.63 ms.
cifar100       train : [loss = 0.146, top1 = 96.92%], valid : [loss = 1.526, top1 = 65.88%], test : [loss = 1.539, top1 = 65.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.56%], valid : [loss = 2.414, top1 = 39.50%], test : [loss = 2.451, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 73.83%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1539/15625) 001539-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.66 ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.79%], valid : [loss = 1.108, top1 = 63.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.94 ms.
cifar10        train : [loss = 0.786, top1 = 72.34%], test  : [loss = 0.913, top1 = 68.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.06 ms.
cifar100       train : [loss = 2.143, top1 = 43.87%], valid : [loss = 2.421, top1 = 39.26%], test : [loss = 2.412, top1 = 39.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.94%], valid : [loss = 3.821, top1 = 14.17%], test : [loss = 3.833, top1 = 13.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.359, top1 = 50.69%], valid : [loss = 1.401, top1 = 49.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1540/15625) 001540-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.232, top1 = 92.12%], valid : [loss = 0.521, top1 = 83.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 0.240, top1 = 91.84%], test  : [loss = 0.394, top1 = 87.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 1.349, top1 = 62.02%], valid : [loss = 1.626, top1 = 55.62%], test : [loss = 1.614, top1 = 55.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 2.848, top1 = 29.66%], valid : [loss = 2.864, top1 = 29.31%], test : [loss = 2.924, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1541/15625) 001541-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.445, top1 = 89.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.323, top1 = 92.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.81 ms.
cifar100       train : [loss = 0.120, top1 = 97.48%], valid : [loss = 1.385, top1 = 68.73%], test : [loss = 1.383, top1 = 68.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 1.748, top1 = 53.41%], valid : [loss = 2.260, top1 = 42.73%], test : [loss = 2.290, top1 = 41.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.75%], valid : [loss = 0.568, top1 = 80.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1542/15625) 001542-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.00 ms.
cifar10-valid  train : [loss = 0.932, top1 = 67.39%], valid : [loss = 0.973, top1 = 66.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10        train : [loss = 0.904, top1 = 68.58%], test  : [loss = 0.902, top1 = 68.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.61 ms.
cifar100       train : [loss = 2.393, top1 = 38.89%], valid : [loss = 2.463, top1 = 37.29%], test : [loss = 2.450, top1 = 37.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.24 ms.
ImageNet16-120 train : [loss = 3.631, top1 = 15.99%], valid : [loss = 3.591, top1 = 17.32%], test : [loss = 3.634, top1 = 16.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.604, top1 = 39.67%], valid : [loss = 1.620, top1 = 38.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1543/15625) 001543-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.558, top1 = 88.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.388, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.89 ms.
cifar100       train : [loss = 0.111, top1 = 97.78%], valid : [loss = 1.477, top1 = 67.17%], test : [loss = 1.491, top1 = 67.33%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 50.15%], valid : [loss = 2.416, top1 = 39.39%], test : [loss = 2.409, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.97%], valid : [loss = 0.752, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1544/15625) 001544-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.522, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.331, top1 = 92.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.245, top1 = 93.60%], valid : [loss = 1.245, top1 = 68.93%], test : [loss = 1.253, top1 = 68.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.04%], valid : [loss = 2.218, top1 = 43.34%], test : [loss = 2.248, top1 = 43.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.25%], valid : [loss = 0.639, top1 = 78.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1545/15625) 001545-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.542, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.350, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.300, top1 = 91.82%], valid : [loss = 1.311, top1 = 67.29%], test : [loss = 1.283, top1 = 68.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.01%], valid : [loss = 2.428, top1 = 38.80%], test : [loss = 2.430, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1546/15625) 001546-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.45 ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.93%], valid : [loss = 0.975, top1 = 66.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10        train : [loss = 0.766, top1 = 73.02%], test  : [loss = 0.854, top1 = 70.34%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.26 ms.
cifar100       train : [loss = 2.130, top1 = 44.06%], valid : [loss = 2.318, top1 = 40.59%], test : [loss = 2.329, top1 = 40.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.32 ms.
ImageNet16-120 train : [loss = 3.739, top1 = 14.26%], valid : [loss = 3.772, top1 = 14.19%], test : [loss = 3.772, top1 = 13.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1547/15625) 001547-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.41%], valid : [loss = 0.494, top1 = 86.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10        train : [loss = 0.096, top1 = 96.87%], test  : [loss = 0.332, top1 = 90.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.715, top1 = 79.40%], valid : [loss = 1.239, top1 = 65.87%], test : [loss = 1.224, top1 = 65.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 40.05%], valid : [loss = 2.443, top1 = 38.17%], test : [loss = 2.463, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.17%], valid : [loss = 0.883, top1 = 68.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1548/15625) 001548-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.527, top1 = 88.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.332, top1 = 92.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.83 ms.
cifar100       train : [loss = 0.206, top1 = 94.99%], valid : [loss = 1.283, top1 = 68.53%], test : [loss = 1.289, top1 = 69.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.85%], valid : [loss = 2.337, top1 = 40.07%], test : [loss = 2.345, top1 = 41.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.29%], valid : [loss = 0.735, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1549/15625) 001549-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.09%], valid : [loss = 0.477, top1 = 84.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.07 ms.
cifar10        train : [loss = 0.297, top1 = 90.03%], test  : [loss = 0.397, top1 = 86.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.26 ms.
cifar100       train : [loss = 1.318, top1 = 63.51%], valid : [loss = 1.536, top1 = 57.63%], test : [loss = 1.505, top1 = 58.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.88%], valid : [loss = 2.906, top1 = 29.96%], test : [loss = 2.946, top1 = 28.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1550/15625) 001550-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.100, top1 = 97.08%], valid : [loss = 0.566, top1 = 84.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10        train : [loss = 0.120, top1 = 96.21%], test  : [loss = 0.376, top1 = 88.67%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.28 ms.
cifar100       train : [loss = 1.027, top1 = 70.64%], valid : [loss = 1.462, top1 = 60.09%], test : [loss = 1.465, top1 = 60.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.443, top1 = 37.91%], valid : [loss = 2.555, top1 = 35.93%], test : [loss = 2.590, top1 = 35.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 69.97%], valid : [loss = 0.892, top1 = 68.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1551/15625) 001551-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.39%], valid : [loss = 0.853, top1 = 79.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.132, top1 = 95.56%], test  : [loss = 0.547, top1 = 84.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.28 ms.
cifar100       train : [loss = 0.851, top1 = 75.20%], valid : [loss = 1.690, top1 = 57.12%], test : [loss = 1.678, top1 = 57.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 3.028, top1 = 26.62%], valid : [loss = 3.171, top1 = 24.57%], test : [loss = 3.178, top1 = 24.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1552/15625) 001552-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.73%], valid : [loss = 0.611, top1 = 84.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10        train : [loss = 0.084, top1 = 97.33%], test  : [loss = 0.413, top1 = 88.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.47 ms.
cifar100       train : [loss = 0.781, top1 = 77.13%], valid : [loss = 1.431, top1 = 62.34%], test : [loss = 1.420, top1 = 61.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.06%], valid : [loss = 2.734, top1 = 31.50%], test : [loss = 2.749, top1 = 31.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1553/15625) 001553-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.26 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1554/15625) 001554-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.295, top1 = 89.85%], valid : [loss = 0.565, top1 = 82.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.278, top1 = 90.48%], test  : [loss = 0.431, top1 = 85.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.31 ms.
cifar100       train : [loss = 1.390, top1 = 60.78%], valid : [loss = 1.660, top1 = 54.99%], test : [loss = 1.637, top1 = 55.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.981, top1 = 27.25%], valid : [loss = 2.992, top1 = 26.49%], test : [loss = 3.034, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 65.21%], valid : [loss = 1.026, top1 = 63.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1555/15625) 001555-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.490, top1 = 90.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.19 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.308, top1 = 93.47%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.02 ms.
cifar100       train : [loss = 0.066, top1 = 99.09%], valid : [loss = 1.291, top1 = 70.30%], test : [loss = 1.304, top1 = 70.41%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.08 ms.
ImageNet16-120 train : [loss = 1.600, top1 = 56.83%], valid : [loss = 2.125, top1 = 45.67%], test : [loss = 2.125, top1 = 45.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.02%], valid : [loss = 0.682, top1 = 76.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1556/15625) 001556-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.422, top1 = 91.13%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.28 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.287, top1 = 93.75%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.50 ms.
cifar100       train : [loss = 0.042, top1 = 99.56%], valid : [loss = 1.339, top1 = 71.29%], test : [loss = 1.325, top1 = 71.28%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 1.419, top1 = 61.29%], valid : [loss = 2.217, top1 = 45.07%], test : [loss = 2.198, top1 = 45.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.357, top1 = 87.76%], valid : [loss = 0.489, top1 = 83.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1557/15625) 001557-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.73%], valid : [loss = 0.595, top1 = 87.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10        train : [loss = 0.019, top1 = 99.45%], test  : [loss = 0.398, top1 = 90.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.39 ms.
cifar100       train : [loss = 0.347, top1 = 90.35%], valid : [loss = 1.444, top1 = 64.47%], test : [loss = 1.454, top1 = 64.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.761, top1 = 30.28%], valid : [loss = 2.845, top1 = 28.41%], test : [loss = 2.863, top1 = 28.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.194, top1 = 56.08%], valid : [loss = 1.197, top1 = 56.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1558/15625) 001558-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.27%], valid : [loss = 0.449, top1 = 87.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.111, top1 = 96.61%], test  : [loss = 0.328, top1 = 89.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.28 ms.
cifar100       train : [loss = 0.862, top1 = 75.39%], valid : [loss = 1.303, top1 = 64.17%], test : [loss = 1.282, top1 = 64.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.82%], valid : [loss = 2.617, top1 = 34.46%], test : [loss = 2.653, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1559/15625) 001559-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.556, top1 = 88.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.353, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.45 ms.
cifar100       train : [loss = 0.245, top1 = 93.51%], valid : [loss = 1.346, top1 = 67.27%], test : [loss = 1.313, top1 = 68.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.215, top1 = 42.66%], valid : [loss = 2.438, top1 = 38.42%], test : [loss = 2.460, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.10%], valid : [loss = 0.976, top1 = 64.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1560/15625) 001560-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.61 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.19 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.12 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1561/15625) 001561-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.239, top1 = 91.80%], valid : [loss = 0.530, top1 = 83.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10        train : [loss = 0.239, top1 = 91.83%], test  : [loss = 0.389, top1 = 87.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.78 ms.
cifar100       train : [loss = 1.338, top1 = 62.27%], valid : [loss = 1.613, top1 = 56.29%], test : [loss = 1.614, top1 = 56.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 2.876, top1 = 29.20%], valid : [loss = 2.887, top1 = 28.79%], test : [loss = 2.945, top1 = 27.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.46%], valid : [loss = 1.001, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1562/15625) 001562-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.81 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1563/15625) 001563-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.583, top1 = 88.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.395, top1 = 91.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.213, top1 = 95.05%], valid : [loss = 1.428, top1 = 66.36%], test : [loss = 1.435, top1 = 66.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.14%], valid : [loss = 2.466, top1 = 38.00%], test : [loss = 2.512, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.21%], valid : [loss = 0.712, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1564/15625) 001564-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.450, top1 = 90.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.308, top1 = 93.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.082, top1 = 98.63%], valid : [loss = 1.382, top1 = 68.98%], test : [loss = 1.352, top1 = 69.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.91%], valid : [loss = 2.257, top1 = 43.50%], test : [loss = 2.321, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.95%], valid : [loss = 0.513, top1 = 82.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1565/15625) 001565-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.01%], valid : [loss = 0.470, top1 = 84.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.301, top1 = 89.91%], test  : [loss = 0.397, top1 = 86.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.69 ms.
cifar100       train : [loss = 1.332, top1 = 63.04%], valid : [loss = 1.532, top1 = 57.91%], test : [loss = 1.500, top1 = 58.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 28.43%], valid : [loss = 2.920, top1 = 28.86%], test : [loss = 2.966, top1 = 28.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.09%], valid : [loss = 0.764, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1566/15625) 001566-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.536, top1 = 88.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.347, top1 = 91.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.441, top1 = 87.21%], valid : [loss = 1.263, top1 = 67.17%], test : [loss = 1.256, top1 = 67.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.17%], valid : [loss = 2.358, top1 = 40.14%], test : [loss = 2.416, top1 = 38.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1567/15625) 001567-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.460, top1 = 89.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.316, top1 = 92.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 0.203, top1 = 95.00%], valid : [loss = 1.316, top1 = 68.44%], test : [loss = 1.345, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.67%], valid : [loss = 2.293, top1 = 42.13%], test : [loss = 2.326, top1 = 42.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.74%], valid : [loss = 0.578, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1568/15625) 001568-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.465, top1 = 89.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.314, top1 = 92.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.47 ms.
cifar100       train : [loss = 0.325, top1 = 91.15%], valid : [loss = 1.320, top1 = 66.75%], test : [loss = 1.309, top1 = 67.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.32%], valid : [loss = 2.363, top1 = 39.97%], test : [loss = 2.411, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1569/15625) 001569-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.627, top1 = 86.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.407, top1 = 90.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.65 ms.
cifar100       train : [loss = 0.533, top1 = 84.34%], valid : [loss = 1.416, top1 = 63.94%], test : [loss = 1.429, top1 = 63.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.40%], valid : [loss = 2.556, top1 = 36.04%], test : [loss = 2.584, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.09%], valid : [loss = 0.904, top1 = 68.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1570/15625) 001570-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10-valid  train : [loss = 1.163, top1 = 58.44%], valid : [loss = 1.213, top1 = 57.12%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.50 ms.
cifar10        train : [loss = 1.128, top1 = 59.87%], test  : [loss = 1.131, top1 = 59.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.39 ms.
cifar100       train : [loss = 2.662, top1 = 33.16%], valid : [loss = 2.736, top1 = 32.33%], test : [loss = 2.715, top1 = 32.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.24 ms.
ImageNet16-120 train : [loss = 3.839, top1 = 12.88%], valid : [loss = 3.819, top1 = 13.79%], test : [loss = 3.837, top1 = 12.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.670, top1 = 37.66%], valid : [loss = 1.719, top1 = 34.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1571/15625) 001571-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.576, top1 = 86.92%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.16 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.361, top1 = 91.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.35 ms.
cifar100       train : [loss = 0.415, top1 = 87.87%], valid : [loss = 1.362, top1 = 65.62%], test : [loss = 1.367, top1 = 66.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.50%], valid : [loss = 2.618, top1 = 34.00%], test : [loss = 2.634, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.30%], valid : [loss = 0.954, top1 = 66.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1572/15625) 001572-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.421, top1 = 90.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.284, top1 = 93.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.85 ms.
cifar100       train : [loss = 0.188, top1 = 95.53%], valid : [loss = 1.262, top1 = 69.61%], test : [loss = 1.260, top1 = 69.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.52%], valid : [loss = 2.266, top1 = 42.49%], test : [loss = 2.286, top1 = 42.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1573/15625) 001573-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.47%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.308, top1 = 93.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.20 ms.
cifar100       train : [loss = 0.126, top1 = 97.53%], valid : [loss = 1.284, top1 = 69.25%], test : [loss = 1.320, top1 = 68.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.75 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.18%], valid : [loss = 2.279, top1 = 42.17%], test : [loss = 2.256, top1 = 42.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.26%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1574/15625) 001574-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.01%], valid : [loss = 0.476, top1 = 84.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10        train : [loss = 0.298, top1 = 90.00%], test  : [loss = 0.394, top1 = 86.57%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 1.333, top1 = 63.05%], valid : [loss = 1.539, top1 = 57.61%], test : [loss = 1.515, top1 = 58.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.68%], valid : [loss = 2.893, top1 = 29.86%], test : [loss = 2.946, top1 = 28.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.27%], valid : [loss = 0.759, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1575/15625) 001575-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.449, top1 = 89.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.319, top1 = 92.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.57 ms.
cifar100       train : [loss = 0.179, top1 = 96.03%], valid : [loss = 1.314, top1 = 68.53%], test : [loss = 1.309, top1 = 68.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.55%], valid : [loss = 2.256, top1 = 42.76%], test : [loss = 2.270, top1 = 43.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.79%], valid : [loss = 0.552, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1576/15625) 001576-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.580, top1 = 88.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.10 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.377, top1 = 91.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.189, top1 = 95.62%], valid : [loss = 1.403, top1 = 67.39%], test : [loss = 1.443, top1 = 67.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.91%], valid : [loss = 2.459, top1 = 38.79%], test : [loss = 2.480, top1 = 38.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.89%], valid : [loss = 0.715, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1577/15625) 001577-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.586, top1 = 87.95%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.85 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.385, top1 = 91.93%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.08 ms.
cifar100       train : [loss = 0.137, top1 = 97.22%], valid : [loss = 1.510, top1 = 66.47%], test : [loss = 1.506, top1 = 66.26%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.31%], valid : [loss = 2.421, top1 = 39.87%], test : [loss = 2.426, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.78%], valid : [loss = 0.767, top1 = 73.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1578/15625) 001578-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.507, top1 = 89.63%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.06 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.337, top1 = 92.56%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.74 ms.
cifar100       train : [loss = 0.165, top1 = 96.20%], valid : [loss = 1.258, top1 = 69.63%], test : [loss = 1.259, top1 = 69.70%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 1.773, top1 = 52.74%], valid : [loss = 2.210, top1 = 43.36%], test : [loss = 2.202, top1 = 43.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.32%], valid : [loss = 0.712, top1 = 75.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1579/15625) 001579-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.523, top1 = 88.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.027, top1 = 99.30%], test  : [loss = 0.359, top1 = 91.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.06 ms.
cifar100       train : [loss = 0.480, top1 = 86.10%], valid : [loss = 1.349, top1 = 65.65%], test : [loss = 1.372, top1 = 65.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.15%], valid : [loss = 2.546, top1 = 35.83%], test : [loss = 2.559, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.93%], valid : [loss = 0.709, top1 = 75.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1580/15625) 001580-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.559, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.400, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.94 ms.
cifar100       train : [loss = 0.223, top1 = 94.63%], valid : [loss = 1.407, top1 = 66.37%], test : [loss = 1.391, top1 = 66.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.73%], valid : [loss = 2.459, top1 = 37.96%], test : [loss = 2.474, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.37%], valid : [loss = 0.734, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1581/15625) 001581-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.572, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.363, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.32 ms.
cifar100       train : [loss = 0.392, top1 = 88.86%], valid : [loss = 1.400, top1 = 65.56%], test : [loss = 1.390, top1 = 65.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.77%], valid : [loss = 2.464, top1 = 37.94%], test : [loss = 2.497, top1 = 37.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.32%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1582/15625) 001582-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.54%], valid : [loss = 1.000, top1 = 65.75%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10        train : [loss = 0.787, top1 = 72.29%], test  : [loss = 0.871, top1 = 69.63%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.12 ms.
cifar100       train : [loss = 2.134, top1 = 44.07%], valid : [loss = 2.319, top1 = 40.96%], test : [loss = 2.340, top1 = 40.26%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.78 ms.
ImageNet16-120 train : [loss = 3.744, top1 = 14.20%], valid : [loss = 3.762, top1 = 14.43%], test : [loss = 3.779, top1 = 13.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 47.09%], valid : [loss = 1.475, top1 = 45.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1583/15625) 001583-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.448, top1 = 90.76%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.94 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.290, top1 = 93.67%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.37 ms.
cifar100       train : [loss = 0.052, top1 = 99.31%], valid : [loss = 1.307, top1 = 71.24%], test : [loss = 1.283, top1 = 71.33%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 1.444, top1 = 60.69%], valid : [loss = 2.208, top1 = 44.43%], test : [loss = 2.220, top1 = 44.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.41%], valid : [loss = 0.492, top1 = 83.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1584/15625) 001584-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.483, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.308, top1 = 92.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.05 ms.
cifar100       train : [loss = 0.318, top1 = 91.51%], valid : [loss = 1.235, top1 = 67.81%], test : [loss = 1.235, top1 = 68.21%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.71%], valid : [loss = 2.333, top1 = 40.26%], test : [loss = 2.334, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.48%], valid : [loss = 0.596, top1 = 79.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1585/15625) 001585-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.413, top1 = 90.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.280, top1 = 93.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 0.185, top1 = 95.64%], valid : [loss = 1.282, top1 = 69.46%], test : [loss = 1.277, top1 = 69.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.46%], valid : [loss = 2.259, top1 = 42.47%], test : [loss = 2.291, top1 = 42.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1586/15625) 001586-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.96 ms.
cifar10-valid  train : [loss = 1.525, top1 = 44.28%], valid : [loss = 1.557, top1 = 42.95%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.26 ms.
cifar10        train : [loss = 1.028, top1 = 63.53%], test  : [loss = 1.041, top1 = 62.94%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.99 ms.
cifar100       train : [loss = 3.666, top1 = 14.68%], valid : [loss = 3.745, top1 = 12.47%], test : [loss = 3.734, top1 = 13.51%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.21 ms.
ImageNet16-120 train : [loss = 3.689, top1 = 14.98%], valid : [loss = 3.664, top1 = 16.17%], test : [loss = 3.690, top1 = 15.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.902, top1 = 30.57%], valid : [loss = 1.907, top1 = 30.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1587/15625) 001587-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.541, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.348, top1 = 92.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.97 ms.
cifar100       train : [loss = 0.079, top1 = 98.83%], valid : [loss = 1.436, top1 = 68.98%], test : [loss = 1.426, top1 = 68.85%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 1.746, top1 = 53.51%], valid : [loss = 2.377, top1 = 41.23%], test : [loss = 2.381, top1 = 41.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.661, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1588/15625) 001588-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.553, top1 = 88.22%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.44 ms.
cifar10        train : [loss = 0.022, top1 = 99.36%], test  : [loss = 0.378, top1 = 91.22%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.77 ms.
cifar100       train : [loss = 0.252, top1 = 93.33%], valid : [loss = 1.321, top1 = 67.48%], test : [loss = 1.332, top1 = 67.33%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.12%], valid : [loss = 2.379, top1 = 39.48%], test : [loss = 2.401, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 67.99%], valid : [loss = 0.936, top1 = 66.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1589/15625) 001589-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.18%], valid : [loss = 0.719, top1 = 80.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.186, top1 = 93.51%], test  : [loss = 0.504, top1 = 84.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.72 ms.
cifar100       train : [loss = 0.903, top1 = 73.54%], valid : [loss = 1.636, top1 = 57.31%], test : [loss = 1.645, top1 = 57.41%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 3.517, top1 = 16.55%], valid : [loss = 3.518, top1 = 16.74%], test : [loss = 3.523, top1 = 16.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.90%], valid : [loss = 1.293, top1 = 52.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1590/15625) 001590-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.67 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.547, top1 = 88.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.337, top1 = 91.97%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.24 ms.
cifar100       train : [loss = 0.297, top1 = 91.98%], valid : [loss = 1.288, top1 = 67.45%], test : [loss = 1.301, top1 = 67.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.71 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 43.97%], valid : [loss = 2.417, top1 = 38.46%], test : [loss = 2.428, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.28%], valid : [loss = 0.820, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1591/15625) 001591-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.87%], valid : [loss = 0.583, top1 = 81.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.271, top1 = 90.63%], test  : [loss = 0.433, top1 = 85.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.70 ms.
cifar100       train : [loss = 1.403, top1 = 60.64%], valid : [loss = 1.722, top1 = 53.86%], test : [loss = 1.732, top1 = 54.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 3.083, top1 = 25.44%], valid : [loss = 3.104, top1 = 24.91%], test : [loss = 3.144, top1 = 25.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.269, top1 = 53.87%], valid : [loss = 1.318, top1 = 52.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1592/15625) 001592-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.265, top1 = 90.89%], valid : [loss = 0.519, top1 = 83.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10        train : [loss = 0.232, top1 = 92.07%], test  : [loss = 0.388, top1 = 87.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.02 ms.
cifar100       train : [loss = 1.330, top1 = 62.34%], valid : [loss = 1.597, top1 = 56.58%], test : [loss = 1.586, top1 = 56.99%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.856, top1 = 29.45%], valid : [loss = 2.857, top1 = 29.42%], test : [loss = 2.895, top1 = 28.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.060, top1 = 61.53%], valid : [loss = 1.095, top1 = 60.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1593/15625) 001593-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.24%], valid : [loss = 0.458, top1 = 86.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10        train : [loss = 0.158, top1 = 94.87%], test  : [loss = 0.348, top1 = 88.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.56 ms.
cifar100       train : [loss = 0.992, top1 = 71.75%], valid : [loss = 1.355, top1 = 62.65%], test : [loss = 1.360, top1 = 62.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.69%], valid : [loss = 2.687, top1 = 32.66%], test : [loss = 2.723, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1594/15625) 001594-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.17%], valid : [loss = 0.593, top1 = 85.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.074, top1 = 97.74%], test  : [loss = 0.399, top1 = 88.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.723, top1 = 78.96%], valid : [loss = 1.404, top1 = 62.59%], test : [loss = 1.371, top1 = 63.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.84%], valid : [loss = 2.657, top1 = 33.59%], test : [loss = 2.706, top1 = 32.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1595/15625) 001595-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.129, top1 = 96.05%], valid : [loss = 0.465, top1 = 85.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.155, top1 = 94.93%], test  : [loss = 0.344, top1 = 88.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.990, top1 = 71.85%], valid : [loss = 1.343, top1 = 62.60%], test : [loss = 1.342, top1 = 62.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.69%], valid : [loss = 2.691, top1 = 32.98%], test : [loss = 2.725, top1 = 32.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1596/15625) 001596-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.575, top1 = 87.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.389, top1 = 91.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 0.400, top1 = 88.64%], valid : [loss = 1.406, top1 = 65.34%], test : [loss = 1.412, top1 = 65.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.91%], valid : [loss = 2.511, top1 = 36.82%], test : [loss = 2.546, top1 = 36.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1597/15625) 001597-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.563, top1 = 87.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.031, top1 = 99.07%], test  : [loss = 0.346, top1 = 91.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.76 ms.
cifar100       train : [loss = 0.422, top1 = 87.70%], valid : [loss = 1.274, top1 = 67.09%], test : [loss = 1.302, top1 = 66.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.46%], valid : [loss = 2.447, top1 = 38.44%], test : [loss = 2.469, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.26%], valid : [loss = 0.974, top1 = 65.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1598/15625) 001598-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.64%], valid : [loss = 0.546, top1 = 83.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.217, top1 = 92.55%], test  : [loss = 0.404, top1 = 87.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 1.304, top1 = 62.92%], valid : [loss = 1.587, top1 = 56.85%], test : [loss = 1.599, top1 = 56.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 2.715, top1 = 32.29%], valid : [loss = 2.747, top1 = 31.84%], test : [loss = 2.794, top1 = 31.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.04%], valid : [loss = 0.978, top1 = 64.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1599/15625) 001599-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.62%], valid : [loss = 0.457, top1 = 86.66%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.91 ms.
cifar10        train : [loss = 0.120, top1 = 96.22%], test  : [loss = 0.341, top1 = 89.10%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.40 ms.
cifar100       train : [loss = 0.755, top1 = 78.74%], valid : [loss = 1.265, top1 = 65.08%], test : [loss = 1.277, top1 = 64.63%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 2.509, top1 = 36.56%], valid : [loss = 2.601, top1 = 34.97%], test : [loss = 2.612, top1 = 34.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.41%], valid : [loss = 0.845, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1600/15625) 001600-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.26%], valid : [loss = 0.930, top1 = 76.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10        train : [loss = 0.225, top1 = 92.23%], test  : [loss = 0.606, top1 = 81.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.46 ms.
cifar100       train : [loss = 1.157, top1 = 67.14%], valid : [loss = 1.774, top1 = 53.91%], test : [loss = 1.754, top1 = 54.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 3.236, top1 = 22.56%], valid : [loss = 3.335, top1 = 21.16%], test : [loss = 3.381, top1 = 20.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1601/15625) 001601-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.88%], valid : [loss = 0.479, top1 = 84.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10        train : [loss = 0.302, top1 = 89.92%], test  : [loss = 0.402, top1 = 86.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.81 ms.
cifar100       train : [loss = 1.318, top1 = 63.24%], valid : [loss = 1.527, top1 = 58.07%], test : [loss = 1.492, top1 = 58.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.63%], valid : [loss = 2.886, top1 = 29.29%], test : [loss = 2.952, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1602/15625) 001602-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.68%], valid : [loss = 0.629, top1 = 84.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.086, top1 = 97.25%], test  : [loss = 0.396, top1 = 88.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.71 ms.
cifar100       train : [loss = 0.794, top1 = 76.68%], valid : [loss = 1.428, top1 = 62.07%], test : [loss = 1.409, top1 = 62.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.17%], valid : [loss = 2.742, top1 = 31.63%], test : [loss = 2.772, top1 = 31.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1603/15625) 001603-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.539, top1 = 88.99%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.47 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.328, top1 = 92.57%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.01 ms.
cifar100       train : [loss = 0.167, top1 = 96.11%], valid : [loss = 1.290, top1 = 69.51%], test : [loss = 1.285, top1 = 69.41%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.09 ms.
ImageNet16-120 train : [loss = 1.770, top1 = 52.91%], valid : [loss = 2.216, top1 = 43.18%], test : [loss = 2.201, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.50%], valid : [loss = 0.742, top1 = 73.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1604/15625) 001604-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.547, top1 = 88.67%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.359, top1 = 91.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.39 ms.
cifar100       train : [loss = 0.132, top1 = 96.97%], valid : [loss = 1.370, top1 = 68.29%], test : [loss = 1.358, top1 = 68.85%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.39 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 39.94%], valid : [loss = 2.516, top1 = 36.08%], test : [loss = 2.529, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.958, top1 = 65.72%], valid : [loss = 1.004, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1605/15625) 001605-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.548, top1 = 87.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.349, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 0.422, top1 = 87.82%], valid : [loss = 1.257, top1 = 66.73%], test : [loss = 1.282, top1 = 66.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 2.232, top1 = 42.31%], valid : [loss = 2.416, top1 = 38.78%], test : [loss = 2.432, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1606/15625) 001606-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.77%], valid : [loss = 0.457, top1 = 86.57%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10        train : [loss = 0.119, top1 = 96.23%], test  : [loss = 0.335, top1 = 89.43%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.61 ms.
cifar100       train : [loss = 0.773, top1 = 78.38%], valid : [loss = 1.297, top1 = 64.40%], test : [loss = 1.288, top1 = 64.09%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 36.50%], valid : [loss = 2.604, top1 = 35.42%], test : [loss = 2.631, top1 = 33.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1607/15625) 001607-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.18 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.37%], valid : [loss = 0.522, top1 = 87.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.14 ms.
cifar10        train : [loss = 0.056, top1 = 98.35%], test  : [loss = 0.360, top1 = 90.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.25 ms.
cifar100       train : [loss = 0.637, top1 = 81.27%], valid : [loss = 1.310, top1 = 65.75%], test : [loss = 1.287, top1 = 65.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.30%], valid : [loss = 2.506, top1 = 36.44%], test : [loss = 2.554, top1 = 35.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.94%], valid : [loss = 0.655, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1608/15625) 001608-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.94%], valid : [loss = 0.561, top1 = 86.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.061, top1 = 98.28%], test  : [loss = 0.371, top1 = 89.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 0.596, top1 = 82.80%], valid : [loss = 1.350, top1 = 64.89%], test : [loss = 1.329, top1 = 65.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.81%], valid : [loss = 2.459, top1 = 37.42%], test : [loss = 2.496, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.16%], valid : [loss = 0.846, top1 = 70.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1609/15625) 001609-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.27%], valid : [loss = 0.531, top1 = 87.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10        train : [loss = 0.059, top1 = 98.20%], test  : [loss = 0.354, top1 = 90.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.59 ms.
cifar100       train : [loss = 0.640, top1 = 81.14%], valid : [loss = 1.304, top1 = 65.14%], test : [loss = 1.299, top1 = 65.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.29%], valid : [loss = 2.522, top1 = 36.49%], test : [loss = 2.548, top1 = 35.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.29%], valid : [loss = 0.625, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1610/15625) 001610-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.477, top1 = 84.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.301, top1 = 89.93%], test  : [loss = 0.397, top1 = 86.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.76 ms.
cifar100       train : [loss = 1.330, top1 = 63.06%], valid : [loss = 1.537, top1 = 57.99%], test : [loss = 1.493, top1 = 58.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.55%], valid : [loss = 2.903, top1 = 29.28%], test : [loss = 2.965, top1 = 27.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1611/15625) 001611-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.583, top1 = 87.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.389, top1 = 91.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.397, top1 = 88.71%], valid : [loss = 1.419, top1 = 64.83%], test : [loss = 1.401, top1 = 65.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.85%], valid : [loss = 2.518, top1 = 36.53%], test : [loss = 2.537, top1 = 36.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1612/15625) 001612-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.542, top1 = 89.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.346, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.87 ms.
cifar100       train : [loss = 0.059, top1 = 99.32%], valid : [loss = 1.455, top1 = 68.63%], test : [loss = 1.435, top1 = 68.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.702, top1 = 54.54%], valid : [loss = 2.405, top1 = 40.42%], test : [loss = 2.420, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.10%], valid : [loss = 0.696, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1613/15625) 001613-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.577, top1 = 88.57%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.93 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.361, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.25 ms.
cifar100       train : [loss = 0.087, top1 = 98.76%], valid : [loss = 1.457, top1 = 68.30%], test : [loss = 1.458, top1 = 67.99%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.12 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.38%], valid : [loss = 2.435, top1 = 39.33%], test : [loss = 2.441, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.58%], valid : [loss = 0.721, top1 = 75.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1614/15625) 001614-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.545, top1 = 88.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.350, top1 = 91.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.94 ms.
cifar100       train : [loss = 0.429, top1 = 87.56%], valid : [loss = 1.241, top1 = 67.17%], test : [loss = 1.260, top1 = 67.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.37%], valid : [loss = 2.356, top1 = 39.57%], test : [loss = 2.379, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1615/15625) 001615-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.46%], valid : [loss = 0.645, top1 = 85.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10        train : [loss = 0.057, top1 = 98.27%], test  : [loss = 0.419, top1 = 89.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.79 ms.
cifar100       train : [loss = 0.664, top1 = 80.53%], valid : [loss = 1.392, top1 = 63.47%], test : [loss = 1.388, top1 = 63.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.474, top1 = 37.16%], valid : [loss = 2.602, top1 = 35.07%], test : [loss = 2.648, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.05%], valid : [loss = 0.840, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1616/15625) 001616-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.34%], valid : [loss = 0.454, top1 = 87.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 0.110, top1 = 96.62%], test  : [loss = 0.331, top1 = 89.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.17 ms.
cifar100       train : [loss = 0.865, top1 = 75.36%], valid : [loss = 1.297, top1 = 63.95%], test : [loss = 1.289, top1 = 63.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.57%], valid : [loss = 2.628, top1 = 34.12%], test : [loss = 2.673, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1617/15625) 001617-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.451, top1 = 90.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.23 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.301, top1 = 93.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 0.074, top1 = 98.84%], valid : [loss = 1.368, top1 = 69.77%], test : [loss = 1.350, top1 = 69.53%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 1.574, top1 = 57.56%], valid : [loss = 2.268, top1 = 43.08%], test : [loss = 2.283, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.52%], valid : [loss = 0.494, top1 = 83.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1618/15625) 001618-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.95%], valid : [loss = 0.680, top1 = 77.02%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 0.615, top1 = 78.48%], test  : [loss = 0.667, top1 = 77.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.76 ms.
cifar100       train : [loss = 1.730, top1 = 53.07%], valid : [loss = 1.890, top1 = 49.73%], test : [loss = 1.910, top1 = 49.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.25 ms.
ImageNet16-120 train : [loss = 3.384, top1 = 20.13%], valid : [loss = 3.373, top1 = 20.91%], test : [loss = 3.410, top1 = 19.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1619/15625) 001619-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.47%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.54 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.333, top1 = 93.21%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.89 ms.
cifar100       train : [loss = 0.077, top1 = 98.72%], valid : [loss = 1.378, top1 = 69.06%], test : [loss = 1.367, top1 = 69.39%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.771, top1 = 52.76%], valid : [loss = 2.267, top1 = 42.58%], test : [loss = 2.268, top1 = 42.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.26%], valid : [loss = 0.639, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1620/15625) 001620-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.60%], valid : [loss = 0.702, top1 = 81.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.145, top1 = 95.10%], test  : [loss = 0.468, top1 = 86.13%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.64 ms.
cifar100       train : [loss = 1.013, top1 = 70.81%], valid : [loss = 1.642, top1 = 56.83%], test : [loss = 1.597, top1 = 57.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 2.797, top1 = 30.77%], valid : [loss = 2.887, top1 = 28.99%], test : [loss = 2.964, top1 = 28.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.69%], valid : [loss = 0.979, top1 = 65.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1621/15625) 001621-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.87%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.75 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.324, top1 = 93.13%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.78 ms.
cifar100       train : [loss = 0.111, top1 = 97.83%], valid : [loss = 1.315, top1 = 69.17%], test : [loss = 1.283, top1 = 70.15%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.25 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.85%], valid : [loss = 2.182, top1 = 44.41%], test : [loss = 2.186, top1 = 44.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.72%], valid : [loss = 0.656, top1 = 77.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1622/15625) 001622-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.38%], valid : [loss = 0.673, top1 = 84.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.434, top1 = 88.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.66 ms.
cifar100       train : [loss = 0.636, top1 = 81.50%], valid : [loss = 1.521, top1 = 61.59%], test : [loss = 1.500, top1 = 61.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.76 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.47%], valid : [loss = 2.825, top1 = 30.68%], test : [loss = 2.866, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1623/15625) 001623-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.542, top1 = 88.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.357, top1 = 91.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.334, top1 = 90.83%], valid : [loss = 1.301, top1 = 67.16%], test : [loss = 1.290, top1 = 67.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.85%], valid : [loss = 2.425, top1 = 38.42%], test : [loss = 2.428, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1624/15625) 001624-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.69%], valid : [loss = 0.473, top1 = 85.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10        train : [loss = 0.155, top1 = 94.96%], test  : [loss = 0.345, top1 = 88.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.96 ms.
cifar100       train : [loss = 0.980, top1 = 72.07%], valid : [loss = 1.353, top1 = 62.05%], test : [loss = 1.332, top1 = 62.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.08 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.09%], valid : [loss = 2.661, top1 = 33.44%], test : [loss = 2.696, top1 = 32.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.14%], valid : [loss = 0.759, top1 = 73.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1625/15625) 001625-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.544, top1 = 88.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.362, top1 = 91.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.54 ms.
cifar100       train : [loss = 0.202, top1 = 95.31%], valid : [loss = 1.384, top1 = 66.90%], test : [loss = 1.402, top1 = 66.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.019, top1 = 47.17%], valid : [loss = 2.433, top1 = 39.16%], test : [loss = 2.418, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.42%], valid : [loss = 0.719, top1 = 75.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1626/15625) 001626-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.458, top1 = 89.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.310, top1 = 92.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.90 ms.
cifar100       train : [loss = 0.202, top1 = 95.10%], valid : [loss = 1.309, top1 = 68.71%], test : [loss = 1.301, top1 = 68.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.43%], valid : [loss = 2.273, top1 = 42.19%], test : [loss = 2.298, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.94%], valid : [loss = 0.544, top1 = 81.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1627/15625) 001627-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.619, top1 = 86.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.413, top1 = 90.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 0.514, top1 = 85.02%], valid : [loss = 1.430, top1 = 63.70%], test : [loss = 1.417, top1 = 64.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 38.96%], valid : [loss = 2.569, top1 = 35.63%], test : [loss = 2.614, top1 = 35.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1628/15625) 001628-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.59%], valid : [loss = 0.614, top1 = 84.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.090, top1 = 97.13%], test  : [loss = 0.399, top1 = 88.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.788, top1 = 76.93%], valid : [loss = 1.439, top1 = 61.84%], test : [loss = 1.417, top1 = 61.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.88%], valid : [loss = 2.745, top1 = 32.33%], test : [loss = 2.767, top1 = 31.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.75%], valid : [loss = 0.867, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1629/15625) 001629-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.22%], valid : [loss = 0.872, top1 = 71.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.556, top1 = 80.57%], test  : [loss = 0.714, top1 = 75.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 1.771, top1 = 52.32%], valid : [loss = 2.061, top1 = 46.59%], test : [loss = 2.067, top1 = 46.71%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.87%], valid : [loss = 3.641, top1 = 16.20%], test : [loss = 3.679, top1 = 15.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1630/15625) 001630-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.553, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.359, top1 = 91.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.00 ms.
cifar100       train : [loss = 0.201, top1 = 95.33%], valid : [loss = 1.405, top1 = 66.71%], test : [loss = 1.395, top1 = 67.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.76%], valid : [loss = 2.419, top1 = 38.98%], test : [loss = 2.437, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.53%], valid : [loss = 0.714, top1 = 75.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1631/15625) 001631-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.27%], valid : [loss = 0.452, top1 = 87.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10        train : [loss = 0.115, top1 = 96.42%], test  : [loss = 0.329, top1 = 89.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.02 ms.
cifar100       train : [loss = 0.861, top1 = 75.50%], valid : [loss = 1.298, top1 = 63.79%], test : [loss = 1.275, top1 = 63.99%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.67%], valid : [loss = 2.628, top1 = 34.18%], test : [loss = 2.663, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.76%], valid : [loss = 0.671, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1632/15625) 001632-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.518, top1 = 89.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.74 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.320, top1 = 93.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.32 ms.
cifar100       train : [loss = 0.067, top1 = 99.02%], valid : [loss = 1.360, top1 = 69.23%], test : [loss = 1.334, top1 = 70.12%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.46 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.89%], valid : [loss = 2.315, top1 = 41.16%], test : [loss = 2.292, top1 = 42.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.09%], valid : [loss = 0.713, top1 = 75.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1633/15625) 001633-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.322, top1 = 88.86%], valid : [loss = 0.567, top1 = 81.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10        train : [loss = 0.303, top1 = 89.55%], test  : [loss = 0.447, top1 = 85.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 1.559, top1 = 56.47%], valid : [loss = 1.779, top1 = 51.95%], test : [loss = 1.767, top1 = 51.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 2.945, top1 = 27.75%], valid : [loss = 2.970, top1 = 27.22%], test : [loss = 3.027, top1 = 26.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.50%], valid : [loss = 1.021, top1 = 63.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1634/15625) 001634-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.18%], valid : [loss = 0.616, top1 = 85.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.072, top1 = 97.82%], test  : [loss = 0.403, top1 = 88.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.92 ms.
cifar100       train : [loss = 0.721, top1 = 79.11%], valid : [loss = 1.395, top1 = 62.99%], test : [loss = 1.365, top1 = 63.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.72%], valid : [loss = 2.662, top1 = 33.86%], test : [loss = 2.703, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.03%], valid : [loss = 0.792, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1635/15625) 001635-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.68%], valid : [loss = 0.520, top1 = 84.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.215, top1 = 92.67%], test  : [loss = 0.382, top1 = 87.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 1.217, top1 = 65.35%], valid : [loss = 1.532, top1 = 58.28%], test : [loss = 1.530, top1 = 58.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.764, top1 = 31.44%], valid : [loss = 2.781, top1 = 31.33%], test : [loss = 2.829, top1 = 30.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.44%], valid : [loss = 0.938, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1636/15625) 001636-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.548, top1 = 89.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.347, top1 = 92.64%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.97 ms.
cifar100       train : [loss = 0.123, top1 = 97.45%], valid : [loss = 1.352, top1 = 68.81%], test : [loss = 1.342, top1 = 68.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.856, top1 = 50.90%], valid : [loss = 2.308, top1 = 41.09%], test : [loss = 2.288, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.22%], valid : [loss = 0.837, top1 = 70.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1637/15625) 001637-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.95%], valid : [loss = 0.472, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.301, top1 = 89.92%], test  : [loss = 0.395, top1 = 86.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.88 ms.
cifar100       train : [loss = 1.328, top1 = 63.14%], valid : [loss = 1.526, top1 = 58.04%], test : [loss = 1.511, top1 = 58.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.61%], valid : [loss = 2.906, top1 = 29.36%], test : [loss = 2.960, top1 = 27.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1638/15625) 001638-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.556, top1 = 88.84%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.64%], test  : [loss = 0.380, top1 = 91.70%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.36 ms.
cifar100       train : [loss = 0.257, top1 = 93.13%], valid : [loss = 1.344, top1 = 67.36%], test : [loss = 1.365, top1 = 67.27%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.63%], valid : [loss = 2.274, top1 = 42.12%], test : [loss = 2.283, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.09%], valid : [loss = 0.790, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1639/15625) 001639-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.47%], valid : [loss = 0.559, top1 = 87.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.033, top1 = 99.00%], test  : [loss = 0.378, top1 = 90.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.12 ms.
cifar100       train : [loss = 0.553, top1 = 83.86%], valid : [loss = 1.361, top1 = 64.29%], test : [loss = 1.352, top1 = 64.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 33.33%], valid : [loss = 2.681, top1 = 32.16%], test : [loss = 2.723, top1 = 32.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 70.20%], valid : [loss = 0.871, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1640/15625) 001640-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.542, top1 = 87.99%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.12 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.346, top1 = 91.41%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.47 ms.
cifar100       train : [loss = 0.427, top1 = 87.69%], valid : [loss = 1.271, top1 = 66.65%], test : [loss = 1.262, top1 = 66.93%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.32%], valid : [loss = 2.396, top1 = 39.33%], test : [loss = 2.449, top1 = 38.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.48%], valid : [loss = 0.890, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1641/15625) 001641-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.584, top1 = 87.58%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.397, top1 = 91.02%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.11 ms.
cifar100       train : [loss = 0.377, top1 = 89.38%], valid : [loss = 1.420, top1 = 65.21%], test : [loss = 1.392, top1 = 65.21%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.34%], valid : [loss = 2.511, top1 = 36.86%], test : [loss = 2.525, top1 = 36.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.86%], valid : [loss = 0.759, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1642/15625) 001642-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.16%], valid : [loss = 0.621, top1 = 85.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.069, top1 = 97.91%], test  : [loss = 0.403, top1 = 88.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.65 ms.
cifar100       train : [loss = 0.709, top1 = 79.39%], valid : [loss = 1.358, top1 = 63.69%], test : [loss = 1.359, top1 = 63.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.77%], valid : [loss = 2.658, top1 = 33.26%], test : [loss = 2.699, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.67%], valid : [loss = 0.771, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1643/15625) 001643-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.554, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.353, top1 = 92.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.255, top1 = 92.99%], valid : [loss = 1.324, top1 = 67.71%], test : [loss = 1.352, top1 = 67.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.54%], valid : [loss = 2.467, top1 = 37.81%], test : [loss = 2.491, top1 = 37.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.14%], valid : [loss = 0.912, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1644/15625) 001644-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.75%], valid : [loss = 0.643, top1 = 84.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10        train : [loss = 0.083, top1 = 97.34%], test  : [loss = 0.411, top1 = 88.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.70 ms.
cifar100       train : [loss = 0.748, top1 = 78.09%], valid : [loss = 1.399, top1 = 62.88%], test : [loss = 1.398, top1 = 62.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.36%], valid : [loss = 2.727, top1 = 32.01%], test : [loss = 2.758, top1 = 31.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.56%], valid : [loss = 0.858, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1645/15625) 001645-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.53%], valid : [loss = 0.442, top1 = 87.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10        train : [loss = 0.054, top1 = 98.70%], test  : [loss = 0.312, top1 = 90.41%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.26 ms.
cifar100       train : [loss = 0.584, top1 = 83.91%], valid : [loss = 1.234, top1 = 66.63%], test : [loss = 1.230, top1 = 66.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.14%], valid : [loss = 2.481, top1 = 37.86%], test : [loss = 2.469, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1646/15625) 001646-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.76%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.330, top1 = 93.10%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.17 ms.
cifar100       train : [loss = 0.078, top1 = 98.77%], valid : [loss = 1.374, top1 = 69.26%], test : [loss = 1.391, top1 = 69.59%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.40%], valid : [loss = 2.374, top1 = 39.44%], test : [loss = 2.386, top1 = 39.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.07%], valid : [loss = 0.775, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1647/15625) 001647-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.08 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.525, top1 = 89.32%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.42 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.350, top1 = 92.46%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.70 ms.
cifar100       train : [loss = 0.056, top1 = 99.50%], valid : [loss = 1.404, top1 = 69.19%], test : [loss = 1.378, top1 = 69.85%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 1.659, top1 = 55.62%], valid : [loss = 2.402, top1 = 40.46%], test : [loss = 2.436, top1 = 41.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.62%], valid : [loss = 0.662, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1648/15625) 001648-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.586, top1 = 87.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.386, top1 = 91.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.74 ms.
cifar100       train : [loss = 0.411, top1 = 88.40%], valid : [loss = 1.385, top1 = 65.25%], test : [loss = 1.361, top1 = 65.61%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.71%], valid : [loss = 2.522, top1 = 36.43%], test : [loss = 2.535, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.30%], valid : [loss = 0.789, top1 = 72.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1649/15625) 001649-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.581, top1 = 87.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.386, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.154, top1 = 96.52%], valid : [loss = 1.495, top1 = 66.41%], test : [loss = 1.500, top1 = 66.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.008, top1 = 47.46%], valid : [loss = 2.442, top1 = 38.79%], test : [loss = 2.455, top1 = 38.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.25%], valid : [loss = 0.780, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1650/15625) 001650-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.675, top1 = 86.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.407, top1 = 90.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.70 ms.
cifar100       train : [loss = 0.238, top1 = 94.16%], valid : [loss = 1.577, top1 = 63.89%], test : [loss = 1.599, top1 = 63.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.08%], valid : [loss = 2.514, top1 = 37.27%], test : [loss = 2.531, top1 = 37.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 73.91%], valid : [loss = 0.800, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1651/15625) 001651-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.45 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.36 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.14 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.23 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1652/15625) 001652-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.568, top1 = 87.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.381, top1 = 91.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.52 ms.
cifar100       train : [loss = 0.395, top1 = 88.75%], valid : [loss = 1.392, top1 = 65.36%], test : [loss = 1.402, top1 = 65.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.51 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.90%], valid : [loss = 2.516, top1 = 37.30%], test : [loss = 2.541, top1 = 36.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1653/15625) 001653-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.468, top1 = 90.06%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.310, top1 = 93.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.82 ms.
cifar100       train : [loss = 0.073, top1 = 98.76%], valid : [loss = 1.434, top1 = 69.04%], test : [loss = 1.428, top1 = 69.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.678, top1 = 55.11%], valid : [loss = 2.246, top1 = 43.21%], test : [loss = 2.273, top1 = 43.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.66%], valid : [loss = 0.682, top1 = 76.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1654/15625) 001654-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.498, top1 = 90.11%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=21.39 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.304, top1 = 93.66%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.63 ms.
cifar100       train : [loss = 0.034, top1 = 99.66%], valid : [loss = 1.387, top1 = 70.03%], test : [loss = 1.361, top1 = 70.69%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=21.55 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.00%], valid : [loss = 2.300, top1 = 40.43%], test : [loss = 2.300, top1 = 41.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.51%], valid : [loss = 0.905, top1 = 67.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1655/15625) 001655-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.47 ms.
cifar10-valid  train : [loss = 0.540, top1 = 80.99%], valid : [loss = 0.680, top1 = 76.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10        train : [loss = 0.563, top1 = 80.40%], test  : [loss = 0.621, top1 = 78.64%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.51 ms.
cifar100       train : [loss = 1.742, top1 = 52.69%], valid : [loss = 1.893, top1 = 49.80%], test : [loss = 1.934, top1 = 49.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.67 ms.
ImageNet16-120 train : [loss = 3.382, top1 = 20.23%], valid : [loss = 3.364, top1 = 20.68%], test : [loss = 3.405, top1 = 19.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1656/15625) 001656-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.04 ms.
cifar100       train : [loss = 0.065, top1 = 99.08%], valid : [loss = 1.346, top1 = 70.30%], test : [loss = 1.317, top1 = 71.13%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 1.544, top1 = 58.24%], valid : [loss = 2.230, top1 = 43.63%], test : [loss = 2.272, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1657/15625) 001657-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.548, top1 = 88.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.353, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.92 ms.
cifar100       train : [loss = 0.262, top1 = 92.77%], valid : [loss = 1.332, top1 = 67.05%], test : [loss = 1.343, top1 = 67.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.73%], valid : [loss = 2.444, top1 = 37.69%], test : [loss = 2.453, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 66.61%], valid : [loss = 0.953, top1 = 65.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1658/15625) 001658-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.02 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.502, top1 = 89.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.329, top1 = 92.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.137, top1 = 97.07%], valid : [loss = 1.266, top1 = 69.45%], test : [loss = 1.275, top1 = 69.41%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.02 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 51.86%], valid : [loss = 2.184, top1 = 43.48%], test : [loss = 2.191, top1 = 43.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.85%], valid : [loss = 0.680, top1 = 76.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1659/15625) 001659-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.492, top1 = 89.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.333, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.155, top1 = 96.48%], valid : [loss = 1.348, top1 = 68.43%], test : [loss = 1.343, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.74%], valid : [loss = 2.371, top1 = 40.52%], test : [loss = 2.374, top1 = 40.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.57%], valid : [loss = 0.637, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1660/15625) 001660-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.17%], valid : [loss = 0.861, top1 = 71.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.552, top1 = 80.71%], test  : [loss = 0.710, top1 = 75.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 1.782, top1 = 51.90%], valid : [loss = 2.059, top1 = 46.99%], test : [loss = 2.061, top1 = 46.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.80%], valid : [loss = 3.642, top1 = 16.99%], test : [loss = 3.665, top1 = 15.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1661/15625) 001661-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.561, top1 = 88.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.374, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.170, top1 = 95.85%], valid : [loss = 1.402, top1 = 67.16%], test : [loss = 1.447, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.79%], valid : [loss = 2.343, top1 = 40.96%], test : [loss = 2.377, top1 = 39.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.88%], valid : [loss = 0.792, top1 = 72.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1662/15625) 001662-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.579, top1 = 87.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.381, top1 = 91.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 0.405, top1 = 88.48%], valid : [loss = 1.390, top1 = 65.24%], test : [loss = 1.395, top1 = 65.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.09%], valid : [loss = 2.504, top1 = 36.97%], test : [loss = 2.528, top1 = 36.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1663/15625) 001663-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.77%], valid : [loss = 0.520, top1 = 86.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.075, top1 = 97.75%], test  : [loss = 0.347, top1 = 90.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.675, top1 = 80.39%], valid : [loss = 1.311, top1 = 64.52%], test : [loss = 1.283, top1 = 65.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.25%], valid : [loss = 2.499, top1 = 36.70%], test : [loss = 2.519, top1 = 36.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.51%], valid : [loss = 0.883, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1664/15625) 001664-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.37%], valid : [loss = 0.584, top1 = 86.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10        train : [loss = 0.037, top1 = 98.88%], test  : [loss = 0.384, top1 = 90.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.81 ms.
cifar100       train : [loss = 0.510, top1 = 85.35%], valid : [loss = 1.388, top1 = 64.28%], test : [loss = 1.387, top1 = 64.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 36.71%], valid : [loss = 2.584, top1 = 34.17%], test : [loss = 2.579, top1 = 34.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.078, top1 = 61.20%], valid : [loss = 1.090, top1 = 60.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1665/15625) 001665-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.243, top1 = 91.71%], valid : [loss = 0.525, top1 = 83.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.251, top1 = 91.41%], test  : [loss = 0.394, top1 = 86.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.05 ms.
cifar100       train : [loss = 1.409, top1 = 60.58%], valid : [loss = 1.655, top1 = 55.53%], test : [loss = 1.662, top1 = 55.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.18 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.36%], valid : [loss = 2.925, top1 = 28.71%], test : [loss = 2.991, top1 = 27.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.54%], valid : [loss = 1.003, top1 = 64.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1666/15625) 001666-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.612, top1 = 86.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.391, top1 = 90.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.00 ms.
cifar100       train : [loss = 0.300, top1 = 92.06%], valid : [loss = 1.503, top1 = 64.42%], test : [loss = 1.479, top1 = 64.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.85%], valid : [loss = 2.508, top1 = 37.22%], test : [loss = 2.535, top1 = 37.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.88%], valid : [loss = 0.798, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1667/15625) 001667-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.67%], valid : [loss = 0.607, top1 = 80.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.70 ms.
cifar10        train : [loss = 0.287, top1 = 90.17%], test  : [loss = 0.439, top1 = 85.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.19 ms.
cifar100       train : [loss = 1.543, top1 = 56.84%], valid : [loss = 1.775, top1 = 52.38%], test : [loss = 1.767, top1 = 52.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.889, top1 = 28.80%], valid : [loss = 2.932, top1 = 28.41%], test : [loss = 2.962, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.026, top1 = 62.91%], valid : [loss = 1.085, top1 = 61.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1668/15625) 001668-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.470, top1 = 89.57%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.86 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.318, top1 = 92.34%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.98 ms.
cifar100       train : [loss = 0.224, top1 = 94.47%], valid : [loss = 1.237, top1 = 68.90%], test : [loss = 1.256, top1 = 69.17%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=21.24 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.44%], valid : [loss = 2.192, top1 = 43.09%], test : [loss = 2.200, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.679, top1 = 76.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1669/15625) 001669-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 90.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.274, top1 = 93.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.02 ms.
cifar100       train : [loss = 0.069, top1 = 98.98%], valid : [loss = 1.365, top1 = 70.34%], test : [loss = 1.338, top1 = 70.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 1.552, top1 = 58.03%], valid : [loss = 2.234, top1 = 44.11%], test : [loss = 2.261, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.94%], valid : [loss = 0.485, top1 = 83.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1670/15625) 001670-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.232, top1 = 92.10%], valid : [loss = 0.518, top1 = 83.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.227, top1 = 92.28%], test  : [loss = 0.387, top1 = 87.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 1.316, top1 = 63.02%], valid : [loss = 1.577, top1 = 56.93%], test : [loss = 1.552, top1 = 57.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.756, top1 = 31.56%], valid : [loss = 2.774, top1 = 31.18%], test : [loss = 2.811, top1 = 30.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.75%], valid : [loss = 0.997, top1 = 64.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1671/15625) 001671-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.21%], valid : [loss = 0.553, top1 = 83.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10        train : [loss = 0.197, top1 = 93.39%], test  : [loss = 0.399, top1 = 87.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.05 ms.
cifar100       train : [loss = 1.271, top1 = 63.93%], valid : [loss = 1.556, top1 = 57.47%], test : [loss = 1.552, top1 = 57.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 2.709, top1 = 32.42%], valid : [loss = 2.742, top1 = 31.27%], test : [loss = 2.785, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1672/15625) 001672-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.72%], valid : [loss = 1.113, top1 = 62.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.784, top1 = 72.41%], test  : [loss = 0.916, top1 = 68.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.89 ms.
cifar100       train : [loss = 2.119, top1 = 44.40%], valid : [loss = 2.393, top1 = 39.51%], test : [loss = 2.407, top1 = 39.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 3.759, top1 = 14.02%], valid : [loss = 3.811, top1 = 14.01%], test : [loss = 3.835, top1 = 13.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.362, top1 = 50.29%], valid : [loss = 1.425, top1 = 48.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1673/15625) 001673-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.614, top1 = 87.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.411, top1 = 91.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.43 ms.
cifar100       train : [loss = 0.208, top1 = 95.09%], valid : [loss = 1.419, top1 = 66.45%], test : [loss = 1.405, top1 = 66.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.21%], valid : [loss = 2.465, top1 = 38.39%], test : [loss = 2.527, top1 = 37.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.42%], valid : [loss = 0.758, top1 = 73.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1674/15625) 001674-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.46%], valid : [loss = 0.588, top1 = 87.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.040, top1 = 98.77%], test  : [loss = 0.385, top1 = 90.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.34 ms.
cifar100       train : [loss = 0.497, top1 = 85.39%], valid : [loss = 1.304, top1 = 66.23%], test : [loss = 1.312, top1 = 65.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.05%], valid : [loss = 2.547, top1 = 35.72%], test : [loss = 2.564, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.06%], valid : [loss = 0.944, top1 = 66.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1675/15625) 001675-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.34%], valid : [loss = 0.461, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10        train : [loss = 0.160, top1 = 94.74%], test  : [loss = 0.350, top1 = 88.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.99 ms.
cifar100       train : [loss = 0.999, top1 = 71.52%], valid : [loss = 1.364, top1 = 61.50%], test : [loss = 1.342, top1 = 62.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.77%], valid : [loss = 2.687, top1 = 32.84%], test : [loss = 2.728, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1676/15625) 001676-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.93%], valid : [loss = 0.990, top1 = 65.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.803, top1 = 71.83%], test  : [loss = 0.882, top1 = 69.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.63 ms.
cifar100       train : [loss = 2.132, top1 = 44.07%], valid : [loss = 2.316, top1 = 40.71%], test : [loss = 2.330, top1 = 40.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 3.757, top1 = 14.06%], valid : [loss = 3.785, top1 = 13.96%], test : [loss = 3.787, top1 = 13.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 47.04%], valid : [loss = 1.486, top1 = 46.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1677/15625) 001677-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.21 ms.
cifar10-valid  train : [loss = 1.299, top1 = 53.14%], valid : [loss = 1.343, top1 = 51.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10        train : [loss = 1.254, top1 = 54.97%], test  : [loss = 1.257, top1 = 54.73%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.20 ms.
cifar100       train : [loss = 2.791, top1 = 30.53%], valid : [loss = 2.889, top1 = 29.19%], test : [loss = 2.869, top1 = 29.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.77 ms.
ImageNet16-120 train : [loss = 3.962, top1 = 11.04%], valid : [loss = 3.960, top1 = 11.66%], test : [loss = 3.981, top1 = 10.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.763, top1 = 33.43%], valid : [loss = 1.754, top1 = 33.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1678/15625) 001678-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.500, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.329, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.12 ms.
cifar100       train : [loss = 0.333, top1 = 91.06%], valid : [loss = 1.278, top1 = 67.04%], test : [loss = 1.285, top1 = 67.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.93%], valid : [loss = 2.406, top1 = 38.86%], test : [loss = 2.407, top1 = 39.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.79%], valid : [loss = 0.648, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1679/15625) 001679-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.588, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.381, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.21 ms.
cifar100       train : [loss = 0.085, top1 = 98.72%], valid : [loss = 1.452, top1 = 67.77%], test : [loss = 1.447, top1 = 67.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.85 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.36%], valid : [loss = 2.467, top1 = 39.12%], test : [loss = 2.460, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.04%], valid : [loss = 0.669, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1680/15625) 001680-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.516, top1 = 88.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.331, top1 = 91.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=15.08 ms.
cifar100       train : [loss = 0.340, top1 = 90.67%], valid : [loss = 1.299, top1 = 66.77%], test : [loss = 1.276, top1 = 67.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.72%], valid : [loss = 2.398, top1 = 39.33%], test : [loss = 2.410, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1681/15625) 001681-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.484, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.320, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.65 ms.
cifar100       train : [loss = 0.334, top1 = 90.93%], valid : [loss = 1.226, top1 = 68.30%], test : [loss = 1.261, top1 = 67.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.80%], valid : [loss = 2.303, top1 = 40.94%], test : [loss = 2.331, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.55%], valid : [loss = 0.590, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1682/15625) 001682-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.512, top1 = 88.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.330, top1 = 92.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.57 ms.
cifar100       train : [loss = 0.346, top1 = 90.55%], valid : [loss = 1.291, top1 = 66.85%], test : [loss = 1.285, top1 = 67.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.42%], valid : [loss = 2.396, top1 = 39.14%], test : [loss = 2.431, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1683/15625) 001683-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.436, top1 = 89.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.298, top1 = 92.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.207, top1 = 95.15%], valid : [loss = 1.288, top1 = 68.87%], test : [loss = 1.280, top1 = 68.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 51.06%], valid : [loss = 2.239, top1 = 43.24%], test : [loss = 2.273, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.42%], valid : [loss = 0.522, top1 = 82.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1684/15625) 001684-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.574, top1 = 87.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.396, top1 = 91.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.78 ms.
cifar100       train : [loss = 0.403, top1 = 88.62%], valid : [loss = 1.389, top1 = 65.12%], test : [loss = 1.381, top1 = 65.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.75%], valid : [loss = 2.525, top1 = 36.93%], test : [loss = 2.532, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.67%], valid : [loss = 0.790, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1685/15625) 001685-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.61%], valid : [loss = 0.602, top1 = 80.53%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.286, top1 = 90.20%], test  : [loss = 0.437, top1 = 85.78%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.42 ms.
cifar100       train : [loss = 1.542, top1 = 56.92%], valid : [loss = 1.775, top1 = 52.43%], test : [loss = 1.775, top1 = 52.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.890, top1 = 28.75%], valid : [loss = 2.919, top1 = 28.38%], test : [loss = 2.970, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.046, top1 = 62.06%], valid : [loss = 1.097, top1 = 60.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1686/15625) 001686-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.627, top1 = 87.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.412, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.196, top1 = 95.37%], valid : [loss = 1.438, top1 = 66.59%], test : [loss = 1.442, top1 = 66.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.03%], valid : [loss = 2.469, top1 = 37.94%], test : [loss = 2.490, top1 = 38.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.51%], valid : [loss = 0.792, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1687/15625) 001687-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.488, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.313, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.43 ms.
cifar100       train : [loss = 0.325, top1 = 91.19%], valid : [loss = 1.239, top1 = 67.39%], test : [loss = 1.253, top1 = 68.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.74%], valid : [loss = 2.304, top1 = 41.00%], test : [loss = 2.333, top1 = 40.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1688/15625) 001688-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.624, top1 = 86.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.397, top1 = 90.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.60 ms.
cifar100       train : [loss = 0.517, top1 = 84.89%], valid : [loss = 1.408, top1 = 63.93%], test : [loss = 1.414, top1 = 63.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.10%], valid : [loss = 2.568, top1 = 35.32%], test : [loss = 2.578, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1689/15625) 001689-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.563, top1 = 87.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.396, top1 = 90.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.71 ms.
cifar100       train : [loss = 0.396, top1 = 88.72%], valid : [loss = 1.396, top1 = 65.63%], test : [loss = 1.407, top1 = 65.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.91%], valid : [loss = 2.506, top1 = 37.27%], test : [loss = 2.540, top1 = 36.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.22%], valid : [loss = 0.815, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1690/15625) 001690-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.97%], valid : [loss = 0.479, top1 = 84.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.55 ms.
cifar10        train : [loss = 0.301, top1 = 89.97%], test  : [loss = 0.398, top1 = 86.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.37 ms.
cifar100       train : [loss = 1.339, top1 = 62.89%], valid : [loss = 1.551, top1 = 57.23%], test : [loss = 1.516, top1 = 58.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.66%], valid : [loss = 2.899, top1 = 29.51%], test : [loss = 2.965, top1 = 28.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1691/15625) 001691-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.622, top1 = 87.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.408, top1 = 91.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.08 ms.
cifar100       train : [loss = 0.176, top1 = 96.11%], valid : [loss = 1.467, top1 = 66.15%], test : [loss = 1.471, top1 = 66.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.027, top1 = 47.04%], valid : [loss = 2.479, top1 = 37.96%], test : [loss = 2.492, top1 = 38.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.70%], valid : [loss = 0.782, top1 = 72.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1692/15625) 001692-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.352, top1 = 91.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.344, top1 = 90.62%], valid : [loss = 1.287, top1 = 66.81%], test : [loss = 1.288, top1 = 67.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.57%], valid : [loss = 2.403, top1 = 39.14%], test : [loss = 2.408, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1693/15625) 001693-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.79%], valid : [loss = 0.521, top1 = 88.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.022, top1 = 99.40%], test  : [loss = 0.336, top1 = 91.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.371, top1 = 89.32%], valid : [loss = 1.241, top1 = 67.91%], test : [loss = 1.250, top1 = 67.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.02%], valid : [loss = 2.314, top1 = 40.74%], test : [loss = 2.342, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 68.95%], valid : [loss = 0.893, top1 = 68.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1694/15625) 001694-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.15%], valid : [loss = 0.858, top1 = 71.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10        train : [loss = 0.557, top1 = 80.48%], test  : [loss = 0.713, top1 = 75.74%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.87 ms.
cifar100       train : [loss = 1.772, top1 = 52.24%], valid : [loss = 2.050, top1 = 47.40%], test : [loss = 2.054, top1 = 46.83%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.27 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.82%], valid : [loss = 3.637, top1 = 16.54%], test : [loss = 3.669, top1 = 15.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1695/15625) 001695-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.61%], valid : [loss = 0.600, top1 = 80.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10        train : [loss = 0.307, top1 = 89.39%], test  : [loss = 0.445, top1 = 85.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.62 ms.
cifar100       train : [loss = 1.573, top1 = 56.05%], valid : [loss = 1.808, top1 = 50.91%], test : [loss = 1.823, top1 = 50.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.881, top1 = 28.96%], valid : [loss = 2.909, top1 = 28.33%], test : [loss = 2.950, top1 = 27.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.19%], valid : [loss = 1.133, top1 = 59.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1696/15625) 001696-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.47%], valid : [loss = 0.738, top1 = 74.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.566, top1 = 80.43%], test  : [loss = 0.623, top1 = 78.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.85 ms.
cifar100       train : [loss = 1.976, top1 = 46.78%], valid : [loss = 2.122, top1 = 43.91%], test : [loss = 2.119, top1 = 43.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 3.245, top1 = 22.16%], valid : [loss = 3.240, top1 = 22.66%], test : [loss = 3.264, top1 = 22.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1697/15625) 001697-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.338, top1 = 91.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.24 ms.
cifar100       train : [loss = 0.219, top1 = 94.50%], valid : [loss = 1.303, top1 = 68.70%], test : [loss = 1.319, top1 = 68.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.32%], valid : [loss = 2.298, top1 = 41.93%], test : [loss = 2.318, top1 = 41.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.470, top1 = 83.63%], valid : [loss = 0.564, top1 = 80.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1698/15625) 001698-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.15%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.308, top1 = 92.18%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.05 ms.
cifar100       train : [loss = 0.327, top1 = 91.09%], valid : [loss = 1.298, top1 = 67.51%], test : [loss = 1.294, top1 = 67.41%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.24%], valid : [loss = 2.376, top1 = 40.03%], test : [loss = 2.429, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.446, top1 = 84.43%], valid : [loss = 0.548, top1 = 81.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1699/15625) 001699-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.558, top1 = 87.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.366, top1 = 91.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.00 ms.
cifar100       train : [loss = 0.271, top1 = 92.21%], valid : [loss = 1.362, top1 = 66.95%], test : [loss = 1.390, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.52%], valid : [loss = 2.491, top1 = 36.10%], test : [loss = 2.510, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.948, top1 = 65.89%], valid : [loss = 0.982, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1700/15625) 001700-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.34%], valid : [loss = 0.857, top1 = 79.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.132, top1 = 95.57%], test  : [loss = 0.546, top1 = 84.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.21 ms.
cifar100       train : [loss = 0.863, top1 = 74.90%], valid : [loss = 1.653, top1 = 57.67%], test : [loss = 1.641, top1 = 58.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.47%], valid : [loss = 3.174, top1 = 24.53%], test : [loss = 3.210, top1 = 23.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 61.73%], valid : [loss = 1.121, top1 = 59.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1701/15625) 001701-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.545, top1 = 88.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.91 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.371, top1 = 91.73%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.18 ms.
cifar100       train : [loss = 0.190, top1 = 95.80%], valid : [loss = 1.397, top1 = 66.87%], test : [loss = 1.377, top1 = 67.59%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.15 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.57%], valid : [loss = 2.424, top1 = 39.00%], test : [loss = 2.423, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.29%], valid : [loss = 0.718, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1702/15625) 001702-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.61%], valid : [loss = 0.674, top1 = 83.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10        train : [loss = 0.074, top1 = 97.67%], test  : [loss = 0.416, top1 = 88.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 0.760, top1 = 77.71%], valid : [loss = 1.432, top1 = 62.04%], test : [loss = 1.440, top1 = 61.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.575, top1 = 35.09%], valid : [loss = 2.710, top1 = 32.83%], test : [loss = 2.731, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.49%], valid : [loss = 0.918, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1703/15625) 001703-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.613, top1 = 85.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10        train : [loss = 0.068, top1 = 97.91%], test  : [loss = 0.399, top1 = 88.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.82 ms.
cifar100       train : [loss = 0.710, top1 = 79.43%], valid : [loss = 1.378, top1 = 63.01%], test : [loss = 1.381, top1 = 63.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.15%], valid : [loss = 2.641, top1 = 34.06%], test : [loss = 2.664, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1704/15625) 001704-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.563, top1 = 88.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.359, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.04 ms.
cifar100       train : [loss = 0.293, top1 = 91.92%], valid : [loss = 1.314, top1 = 67.01%], test : [loss = 1.299, top1 = 67.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.12%], valid : [loss = 2.406, top1 = 38.89%], test : [loss = 2.420, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.11%], valid : [loss = 0.856, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1705/15625) 001705-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.70%], valid : [loss = 0.460, top1 = 86.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10        train : [loss = 0.148, top1 = 95.23%], test  : [loss = 0.342, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.32 ms.
cifar100       train : [loss = 0.998, top1 = 71.69%], valid : [loss = 1.365, top1 = 61.81%], test : [loss = 1.357, top1 = 61.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.21%], valid : [loss = 2.678, top1 = 32.96%], test : [loss = 2.687, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1706/15625) 001706-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.484, top1 = 88.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.313, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.36 ms.
cifar100       train : [loss = 0.333, top1 = 90.99%], valid : [loss = 1.238, top1 = 67.43%], test : [loss = 1.232, top1 = 68.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.71%], valid : [loss = 2.311, top1 = 40.74%], test : [loss = 2.328, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1707/15625) 001707-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.537, top1 = 88.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.358, top1 = 91.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.302, top1 = 91.74%], valid : [loss = 1.304, top1 = 67.46%], test : [loss = 1.312, top1 = 67.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 43.74%], valid : [loss = 2.411, top1 = 38.76%], test : [loss = 2.431, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.82%], valid : [loss = 0.894, top1 = 68.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1708/15625) 001708-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.471, top1 = 89.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.316, top1 = 92.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.321, top1 = 91.38%], valid : [loss = 1.263, top1 = 67.19%], test : [loss = 1.237, top1 = 68.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.73%], valid : [loss = 2.323, top1 = 40.44%], test : [loss = 2.358, top1 = 40.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1709/15625) 001709-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.77%], valid : [loss = 0.648, top1 = 84.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.19 ms.
cifar10        train : [loss = 0.086, top1 = 97.24%], test  : [loss = 0.407, top1 = 88.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.793, top1 = 76.80%], valid : [loss = 1.442, top1 = 61.35%], test : [loss = 1.431, top1 = 61.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.04%], valid : [loss = 2.745, top1 = 32.20%], test : [loss = 2.780, top1 = 31.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.51%], valid : [loss = 0.850, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1710/15625) 001710-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.37%], valid : [loss = 0.449, top1 = 87.57%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.25 ms.
cifar10        train : [loss = 0.071, top1 = 98.08%], test  : [loss = 0.325, top1 = 89.90%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.77 ms.
cifar100       train : [loss = 0.595, top1 = 83.60%], valid : [loss = 1.216, top1 = 66.84%], test : [loss = 1.202, top1 = 66.98%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.98%], valid : [loss = 2.490, top1 = 37.59%], test : [loss = 2.498, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.66%], valid : [loss = 0.642, top1 = 77.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1711/15625) 001711-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.33%], valid : [loss = 0.683, top1 = 82.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10        train : [loss = 0.121, top1 = 95.92%], test  : [loss = 0.458, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.01 ms.
cifar100       train : [loss = 0.932, top1 = 72.91%], valid : [loss = 1.691, top1 = 56.64%], test : [loss = 1.671, top1 = 57.25%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.794, top1 = 30.86%], valid : [loss = 2.934, top1 = 28.02%], test : [loss = 2.969, top1 = 28.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.56%], valid : [loss = 0.981, top1 = 65.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1712/15625) 001712-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.252, top1 = 91.53%], valid : [loss = 0.530, top1 = 83.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.247, top1 = 91.59%], test  : [loss = 0.411, top1 = 86.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 1.324, top1 = 62.53%], valid : [loss = 1.620, top1 = 56.00%], test : [loss = 1.589, top1 = 56.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.39 ms.
ImageNet16-120 train : [loss = 2.898, top1 = 28.82%], valid : [loss = 2.880, top1 = 29.42%], test : [loss = 2.941, top1 = 28.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.76%], valid : [loss = 1.023, top1 = 63.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1713/15625) 001713-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.34%], valid : [loss = 0.546, top1 = 87.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.036, top1 = 98.92%], test  : [loss = 0.361, top1 = 90.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.37 ms.
cifar100       train : [loss = 0.447, top1 = 87.08%], valid : [loss = 1.448, top1 = 64.19%], test : [loss = 1.438, top1 = 64.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.754, top1 = 30.60%], valid : [loss = 2.802, top1 = 29.68%], test : [loss = 2.827, top1 = 29.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.229, top1 = 55.56%], valid : [loss = 1.250, top1 = 54.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1714/15625) 001714-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.593, top1 = 86.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.025, top1 = 99.33%], test  : [loss = 0.380, top1 = 90.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.54 ms.
cifar100       train : [loss = 0.508, top1 = 85.09%], valid : [loss = 1.407, top1 = 64.30%], test : [loss = 1.419, top1 = 64.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.89%], valid : [loss = 2.548, top1 = 35.97%], test : [loss = 2.557, top1 = 36.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 72.95%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1715/15625) 001715-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.29%], valid : [loss = 0.621, top1 = 84.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10        train : [loss = 0.087, top1 = 97.11%], test  : [loss = 0.405, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.82 ms.
cifar100       train : [loss = 0.660, top1 = 80.54%], valid : [loss = 1.372, top1 = 63.56%], test : [loss = 1.378, top1 = 63.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.16%], valid : [loss = 2.633, top1 = 33.91%], test : [loss = 2.645, top1 = 33.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.64%], valid : [loss = 1.025, top1 = 63.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1716/15625) 001716-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=23.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.472, top1 = 90.49%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=22.61 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.299, top1 = 93.65%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=23.21 ms.
cifar100       train : [loss = 0.059, top1 = 99.25%], valid : [loss = 1.380, top1 = 69.08%], test : [loss = 1.367, top1 = 69.35%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=21.52 ms.
ImageNet16-120 train : [loss = 1.486, top1 = 59.67%], valid : [loss = 2.138, top1 = 45.59%], test : [loss = 2.146, top1 = 46.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.88%], valid : [loss = 0.694, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1717/15625) 001717-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.89%], valid : [loss = 0.997, top1 = 65.99%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10        train : [loss = 0.773, top1 = 72.72%], test  : [loss = 0.863, top1 = 69.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.79 ms.
cifar100       train : [loss = 2.142, top1 = 43.90%], valid : [loss = 2.311, top1 = 40.83%], test : [loss = 2.330, top1 = 41.07%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.31%], valid : [loss = 3.772, top1 = 14.61%], test : [loss = 3.776, top1 = 13.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.460, top1 = 46.64%], valid : [loss = 1.477, top1 = 46.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1718/15625) 001718-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.33%], valid : [loss = 0.528, top1 = 86.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.084, top1 = 97.44%], test  : [loss = 0.351, top1 = 89.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.754, top1 = 78.06%], valid : [loss = 1.345, top1 = 63.85%], test : [loss = 1.364, top1 = 63.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.424, top1 = 38.27%], valid : [loss = 2.544, top1 = 36.06%], test : [loss = 2.572, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.16%], valid : [loss = 0.875, top1 = 69.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1719/15625) 001719-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.295, top1 = 90.02%], valid : [loss = 0.478, top1 = 84.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.29 ms.
cifar10        train : [loss = 0.272, top1 = 90.81%], test  : [loss = 0.381, top1 = 87.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.09 ms.
cifar100       train : [loss = 1.269, top1 = 64.38%], valid : [loss = 1.478, top1 = 59.00%], test : [loss = 1.470, top1 = 59.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.810, top1 = 30.55%], valid : [loss = 2.818, top1 = 31.10%], test : [loss = 2.852, top1 = 29.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.067, top1 = 62.19%], valid : [loss = 1.095, top1 = 61.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1720/15625) 001720-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.575, top1 = 87.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.386, top1 = 91.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.401, top1 = 88.61%], valid : [loss = 1.377, top1 = 65.89%], test : [loss = 1.401, top1 = 65.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.76%], valid : [loss = 2.516, top1 = 36.63%], test : [loss = 2.548, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1721/15625) 001721-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.602, top1 = 87.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.404, top1 = 90.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.37 ms.
cifar100       train : [loss = 0.223, top1 = 94.50%], valid : [loss = 1.498, top1 = 65.21%], test : [loss = 1.500, top1 = 65.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.12%], valid : [loss = 2.475, top1 = 37.73%], test : [loss = 2.479, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 74.80%], valid : [loss = 0.775, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1722/15625) 001722-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.56 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.55%], valid : [loss = 0.866, top1 = 75.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.49 ms.
cifar10        train : [loss = 0.305, top1 = 89.35%], test  : [loss = 0.630, top1 = 80.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.55 ms.
cifar100       train : [loss = 1.386, top1 = 61.20%], valid : [loss = 1.940, top1 = 50.09%], test : [loss = 1.954, top1 = 49.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 3.488, top1 = 17.52%], valid : [loss = 3.514, top1 = 17.63%], test : [loss = 3.520, top1 = 16.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1723/15625) 001723-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.11%], valid : [loss = 0.568, top1 = 86.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.068, top1 = 97.77%], test  : [loss = 0.370, top1 = 89.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.81 ms.
cifar100       train : [loss = 0.655, top1 = 80.72%], valid : [loss = 1.293, top1 = 65.05%], test : [loss = 1.297, top1 = 64.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.96%], valid : [loss = 2.507, top1 = 36.22%], test : [loss = 2.541, top1 = 36.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.05%], valid : [loss = 0.838, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1724/15625) 001724-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.504, top1 = 89.74%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.322, top1 = 93.18%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.31 ms.
cifar100       train : [loss = 0.053, top1 = 99.26%], valid : [loss = 1.337, top1 = 70.58%], test : [loss = 1.360, top1 = 70.05%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.56 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.80%], valid : [loss = 2.338, top1 = 40.63%], test : [loss = 2.314, top1 = 41.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.25%], valid : [loss = 0.726, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1725/15625) 001725-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.575, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.387, top1 = 90.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.87 ms.
cifar100       train : [loss = 0.351, top1 = 90.20%], valid : [loss = 1.439, top1 = 64.91%], test : [loss = 1.397, top1 = 65.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.18%], valid : [loss = 2.485, top1 = 37.11%], test : [loss = 2.494, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.48%], valid : [loss = 0.852, top1 = 70.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1726/15625) 001726-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.664, top1 = 86.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.425, top1 = 90.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.295, top1 = 92.28%], valid : [loss = 1.564, top1 = 63.33%], test : [loss = 1.581, top1 = 63.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 2.200, top1 = 43.14%], valid : [loss = 2.563, top1 = 35.84%], test : [loss = 2.566, top1 = 36.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.51%], valid : [loss = 0.841, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1727/15625) 001727-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.06%], valid : [loss = 0.753, top1 = 74.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.508, top1 = 82.28%], test  : [loss = 0.577, top1 = 80.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.41 ms.
cifar100       train : [loss = 2.048, top1 = 44.30%], valid : [loss = 2.176, top1 = 41.81%], test : [loss = 2.195, top1 = 41.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.093, top1 = 24.68%], valid : [loss = 3.087, top1 = 25.02%], test : [loss = 3.102, top1 = 24.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.00%], valid : [loss = 1.197, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1728/15625) 001728-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.59%], valid : [loss = 0.526, top1 = 82.31%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10        train : [loss = 0.390, top1 = 86.71%], test  : [loss = 0.457, top1 = 84.64%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.65 ms.
cifar100       train : [loss = 1.539, top1 = 57.71%], valid : [loss = 1.660, top1 = 54.61%], test : [loss = 1.650, top1 = 55.15%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.30 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.32%], valid : [loss = 3.009, top1 = 27.52%], test : [loss = 3.053, top1 = 26.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1729/15625) 001729-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.517, top1 = 89.75%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.32 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.338, top1 = 92.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.03 ms.
cifar100       train : [loss = 0.035, top1 = 99.70%], valid : [loss = 1.404, top1 = 69.94%], test : [loss = 1.405, top1 = 69.73%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.71 ms.
ImageNet16-120 train : [loss = 1.542, top1 = 58.47%], valid : [loss = 2.412, top1 = 40.66%], test : [loss = 2.417, top1 = 41.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.20%], valid : [loss = 0.680, top1 = 76.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1730/15625) 001730-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.287, top1 = 89.97%], valid : [loss = 0.549, top1 = 82.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10        train : [loss = 0.254, top1 = 91.35%], test  : [loss = 0.416, top1 = 86.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.84 ms.
cifar100       train : [loss = 1.426, top1 = 59.83%], valid : [loss = 1.673, top1 = 54.46%], test : [loss = 1.665, top1 = 54.53%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.891, top1 = 28.80%], valid : [loss = 2.906, top1 = 28.76%], test : [loss = 2.962, top1 = 27.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.75%], valid : [loss = 1.019, top1 = 63.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1731/15625) 001731-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.545, top1 = 89.01%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.45 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.381, top1 = 91.96%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.84 ms.
cifar100       train : [loss = 0.151, top1 = 96.58%], valid : [loss = 1.425, top1 = 66.97%], test : [loss = 1.439, top1 = 66.67%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.82 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 41.73%], valid : [loss = 2.460, top1 = 36.78%], test : [loss = 2.485, top1 = 36.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 67.49%], valid : [loss = 0.962, top1 = 65.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1732/15625) 001732-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.63%], valid : [loss = 0.468, top1 = 85.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10        train : [loss = 0.153, top1 = 95.00%], test  : [loss = 0.344, top1 = 88.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.62 ms.
cifar100       train : [loss = 0.972, top1 = 72.39%], valid : [loss = 1.347, top1 = 62.47%], test : [loss = 1.335, top1 = 62.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.20%], valid : [loss = 2.679, top1 = 33.64%], test : [loss = 2.704, top1 = 32.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.787, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1733/15625) 001733-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.331, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.32 ms.
cifar100       train : [loss = 0.285, top1 = 92.31%], valid : [loss = 1.336, top1 = 67.24%], test : [loss = 1.326, top1 = 67.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.50%], valid : [loss = 2.330, top1 = 40.77%], test : [loss = 2.377, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.35%], valid : [loss = 0.599, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1734/15625) 001734-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.547, top1 = 88.99%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.88 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.358, top1 = 92.24%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.71 ms.
cifar100       train : [loss = 0.160, top1 = 96.41%], valid : [loss = 1.403, top1 = 67.15%], test : [loss = 1.414, top1 = 67.23%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.65 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.73%], valid : [loss = 2.356, top1 = 39.26%], test : [loss = 2.361, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.62%], valid : [loss = 0.896, top1 = 68.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1735/15625) 001735-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.27%], valid : [loss = 0.660, top1 = 83.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10        train : [loss = 0.127, top1 = 95.76%], test  : [loss = 0.431, top1 = 87.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.10 ms.
cifar100       train : [loss = 0.857, top1 = 74.87%], valid : [loss = 1.484, top1 = 60.43%], test : [loss = 1.479, top1 = 60.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.752, top1 = 31.26%], valid : [loss = 2.865, top1 = 29.07%], test : [loss = 2.898, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 65.54%], valid : [loss = 0.987, top1 = 65.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1736/15625) 001736-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.529, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.318, top1 = 92.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.35 ms.
cifar100       train : [loss = 0.238, top1 = 93.78%], valid : [loss = 1.283, top1 = 67.89%], test : [loss = 1.287, top1 = 68.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 49.94%], valid : [loss = 2.204, top1 = 42.69%], test : [loss = 2.243, top1 = 42.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.29%], valid : [loss = 0.664, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1737/15625) 001737-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.814, top1 = 71.17%], valid : [loss = 0.984, top1 = 66.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10        train : [loss = 0.776, top1 = 72.68%], test  : [loss = 0.861, top1 = 69.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.19 ms.
cifar100       train : [loss = 2.138, top1 = 43.93%], valid : [loss = 2.313, top1 = 40.93%], test : [loss = 2.330, top1 = 40.74%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 3.751, top1 = 14.11%], valid : [loss = 3.774, top1 = 14.12%], test : [loss = 3.783, top1 = 13.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.447, top1 = 46.88%], valid : [loss = 1.467, top1 = 46.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1738/15625) 001738-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.688, top1 = 85.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.024, top1 = 99.38%], test  : [loss = 0.431, top1 = 89.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.343, top1 = 90.74%], valid : [loss = 1.570, top1 = 62.64%], test : [loss = 1.586, top1 = 62.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.79%], valid : [loss = 2.579, top1 = 35.88%], test : [loss = 2.600, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.77%], valid : [loss = 0.830, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1739/15625) 001739-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.23%], valid : [loss = 0.723, top1 = 82.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.76 ms.
cifar10        train : [loss = 0.103, top1 = 96.62%], test  : [loss = 0.500, top1 = 86.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.83 ms.
cifar100       train : [loss = 0.698, top1 = 79.66%], valid : [loss = 1.653, top1 = 58.53%], test : [loss = 1.612, top1 = 58.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 27.82%], valid : [loss = 3.020, top1 = 26.58%], test : [loss = 3.049, top1 = 25.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.000, top1 = 63.92%], valid : [loss = 1.037, top1 = 63.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1740/15625) 001740-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.461, top1 = 89.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.330, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.344, top1 = 90.49%], valid : [loss = 1.316, top1 = 66.64%], test : [loss = 1.310, top1 = 67.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.75%], valid : [loss = 2.360, top1 = 40.17%], test : [loss = 2.388, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.20%], valid : [loss = 0.612, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1741/15625) 001741-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.83%], valid : [loss = 0.557, top1 = 86.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.28 ms.
cifar10        train : [loss = 0.067, top1 = 98.05%], test  : [loss = 0.365, top1 = 89.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.64 ms.
cifar100       train : [loss = 0.618, top1 = 82.06%], valid : [loss = 1.353, top1 = 64.57%], test : [loss = 1.334, top1 = 64.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.60%], valid : [loss = 2.471, top1 = 37.12%], test : [loss = 2.500, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 69.95%], valid : [loss = 0.899, top1 = 68.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1742/15625) 001742-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.488, top1 = 90.08%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 93.43%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.47 ms.
cifar100       train : [loss = 0.106, top1 = 97.91%], valid : [loss = 1.266, top1 = 70.37%], test : [loss = 1.267, top1 = 70.46%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.41 ms.
ImageNet16-120 train : [loss = 1.617, top1 = 56.41%], valid : [loss = 2.126, top1 = 45.77%], test : [loss = 2.147, top1 = 45.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.68%], valid : [loss = 0.679, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1743/15625) 001743-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.260, top1 = 91.21%], valid : [loss = 0.499, top1 = 84.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.16 ms.
cifar10        train : [loss = 0.228, top1 = 92.21%], test  : [loss = 0.380, top1 = 87.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.43 ms.
cifar100       train : [loss = 1.256, top1 = 64.30%], valid : [loss = 1.538, top1 = 57.72%], test : [loss = 1.544, top1 = 57.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.773, top1 = 31.35%], valid : [loss = 2.790, top1 = 31.03%], test : [loss = 2.832, top1 = 29.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 67.00%], valid : [loss = 0.973, top1 = 65.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1744/15625) 001744-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.49%], valid : [loss = 0.689, top1 = 84.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.055, top1 = 98.33%], test  : [loss = 0.446, top1 = 88.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.634, top1 = 81.39%], valid : [loss = 1.519, top1 = 61.10%], test : [loss = 1.491, top1 = 62.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.30%], valid : [loss = 2.820, top1 = 30.48%], test : [loss = 2.860, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.86%], valid : [loss = 0.895, top1 = 68.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1745/15625) 001745-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.514, top1 = 89.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.325, top1 = 93.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.116, top1 = 97.70%], valid : [loss = 1.290, top1 = 69.26%], test : [loss = 1.319, top1 = 69.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.696, top1 = 54.57%], valid : [loss = 2.185, top1 = 43.89%], test : [loss = 2.195, top1 = 44.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1746/15625) 001746-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10-valid  train : [loss = 1.218, top1 = 56.04%], valid : [loss = 1.269, top1 = 54.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 1.156, top1 = 58.75%], test  : [loss = 1.164, top1 = 58.36%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.05 ms.
cifar100       train : [loss = 2.673, top1 = 32.90%], valid : [loss = 2.755, top1 = 32.00%], test : [loss = 2.742, top1 = 32.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.42 ms.
ImageNet16-120 train : [loss = 3.870, top1 = 12.41%], valid : [loss = 3.875, top1 = 12.94%], test : [loss = 3.888, top1 = 12.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1747/15625) 001747-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.516, top1 = 88.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.335, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.75 ms.
cifar100       train : [loss = 0.342, top1 = 90.70%], valid : [loss = 1.275, top1 = 67.29%], test : [loss = 1.285, top1 = 67.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.68%], valid : [loss = 2.411, top1 = 38.81%], test : [loss = 2.421, top1 = 39.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1748/15625) 001748-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.36%], valid : [loss = 0.519, top1 = 84.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10        train : [loss = 0.184, top1 = 93.86%], test  : [loss = 0.388, top1 = 87.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.78 ms.
cifar100       train : [loss = 1.203, top1 = 65.79%], valid : [loss = 1.518, top1 = 58.45%], test : [loss = 1.507, top1 = 58.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.31%], valid : [loss = 2.701, top1 = 32.30%], test : [loss = 2.749, top1 = 31.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.37%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1749/15625) 001749-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.507, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.326, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.85 ms.
cifar100       train : [loss = 0.149, top1 = 96.90%], valid : [loss = 1.289, top1 = 69.05%], test : [loss = 1.300, top1 = 69.33%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.57 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 50.90%], valid : [loss = 2.313, top1 = 40.67%], test : [loss = 2.286, top1 = 41.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.28%], valid : [loss = 0.695, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1750/15625) 001750-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.94%], valid : [loss = 0.554, top1 = 85.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.113, top1 = 96.40%], test  : [loss = 0.376, top1 = 88.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.810, top1 = 76.38%], valid : [loss = 1.392, top1 = 62.45%], test : [loss = 1.387, top1 = 62.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.38%], valid : [loss = 2.635, top1 = 33.73%], test : [loss = 2.658, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.57%], valid : [loss = 0.927, top1 = 67.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1751/15625) 001751-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.31%], valid : [loss = 0.456, top1 = 86.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.43 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.326, top1 = 89.56%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.53 ms.
cifar100       train : [loss = 0.862, top1 = 75.45%], valid : [loss = 1.290, top1 = 63.89%], test : [loss = 1.284, top1 = 64.13%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.75%], valid : [loss = 2.621, top1 = 34.17%], test : [loss = 2.641, top1 = 33.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1752/15625) 001752-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.606, top1 = 86.63%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.31 ms.
cifar10        train : [loss = 0.028, top1 = 99.29%], test  : [loss = 0.419, top1 = 89.80%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.43 ms.
cifar100       train : [loss = 0.348, top1 = 90.74%], valid : [loss = 1.369, top1 = 66.11%], test : [loss = 1.344, top1 = 65.45%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.79%], valid : [loss = 2.540, top1 = 36.61%], test : [loss = 2.553, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.20%], valid : [loss = 0.762, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1753/15625) 001753-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.560, top1 = 88.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.370, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.78 ms.
cifar100       train : [loss = 0.167, top1 = 96.50%], valid : [loss = 1.385, top1 = 68.14%], test : [loss = 1.392, top1 = 67.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.30%], valid : [loss = 2.471, top1 = 38.07%], test : [loss = 2.467, top1 = 39.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.70%], valid : [loss = 0.689, top1 = 75.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1754/15625) 001754-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.43%], valid : [loss = 0.647, top1 = 78.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.503, top1 = 82.58%], test  : [loss = 0.588, top1 = 80.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.22 ms.
cifar100       train : [loss = 1.689, top1 = 54.24%], valid : [loss = 1.863, top1 = 50.23%], test : [loss = 1.875, top1 = 50.71%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.33%], valid : [loss = 3.312, top1 = 21.24%], test : [loss = 3.356, top1 = 20.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1755/15625) 001755-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.16%], valid : [loss = 0.470, top1 = 84.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.84 ms.
cifar10        train : [loss = 0.296, top1 = 90.11%], test  : [loss = 0.401, top1 = 86.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.77 ms.
cifar100       train : [loss = 1.319, top1 = 63.45%], valid : [loss = 1.524, top1 = 58.50%], test : [loss = 1.492, top1 = 58.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.93%], valid : [loss = 2.894, top1 = 29.12%], test : [loss = 2.945, top1 = 28.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1756/15625) 001756-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.64%], valid : [loss = 0.579, top1 = 86.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10        train : [loss = 0.042, top1 = 98.73%], test  : [loss = 0.380, top1 = 90.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.41 ms.
cifar100       train : [loss = 0.551, top1 = 83.78%], valid : [loss = 1.406, top1 = 64.05%], test : [loss = 1.416, top1 = 63.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 37.01%], valid : [loss = 2.611, top1 = 34.61%], test : [loss = 2.666, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1757/15625) 001757-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.153, top1 = 95.12%], valid : [loss = 0.534, top1 = 84.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10        train : [loss = 0.176, top1 = 94.12%], test  : [loss = 0.386, top1 = 87.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.08 ms.
cifar100       train : [loss = 1.159, top1 = 66.93%], valid : [loss = 1.490, top1 = 58.99%], test : [loss = 1.488, top1 = 59.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.15%], valid : [loss = 2.690, top1 = 33.31%], test : [loss = 2.714, top1 = 32.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.20%], valid : [loss = 0.954, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1758/15625) 001758-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.311, top1 = 92.11%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.69 ms.
cifar100       train : [loss = 0.238, top1 = 94.16%], valid : [loss = 1.243, top1 = 68.21%], test : [loss = 1.238, top1 = 69.19%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.28 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.81%], valid : [loss = 2.245, top1 = 42.31%], test : [loss = 2.266, top1 = 42.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 81.75%], valid : [loss = 0.602, top1 = 79.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1759/15625) 001759-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.23%], valid : [loss = 0.563, top1 = 86.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.83 ms.
cifar10        train : [loss = 0.058, top1 = 98.19%], test  : [loss = 0.355, top1 = 90.26%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.53 ms.
cifar100       train : [loss = 0.636, top1 = 81.26%], valid : [loss = 1.295, top1 = 65.09%], test : [loss = 1.306, top1 = 64.96%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.58%], valid : [loss = 2.501, top1 = 36.79%], test : [loss = 2.527, top1 = 36.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.13%], valid : [loss = 0.822, top1 = 71.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1760/15625) 001760-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.58%], valid : [loss = 0.567, top1 = 87.47%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.365, top1 = 90.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.72 ms.
cifar100       train : [loss = 0.417, top1 = 87.94%], valid : [loss = 1.284, top1 = 66.81%], test : [loss = 1.281, top1 = 66.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.85%], valid : [loss = 2.437, top1 = 38.33%], test : [loss = 2.452, top1 = 37.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.56%], valid : [loss = 0.901, top1 = 68.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1761/15625) 001761-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.348, top1 = 87.83%], valid : [loss = 0.570, top1 = 81.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10        train : [loss = 0.310, top1 = 89.39%], test  : [loss = 0.448, top1 = 85.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.26 ms.
cifar100       train : [loss = 1.548, top1 = 56.93%], valid : [loss = 1.777, top1 = 51.91%], test : [loss = 1.754, top1 = 52.73%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 3.057, top1 = 25.61%], valid : [loss = 3.045, top1 = 26.09%], test : [loss = 3.124, top1 = 25.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.84%], valid : [loss = 1.078, top1 = 61.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1762/15625) 001762-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.75 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.348, top1 = 92.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.14 ms.
cifar100       train : [loss = 0.077, top1 = 98.86%], valid : [loss = 1.441, top1 = 68.67%], test : [loss = 1.449, top1 = 68.41%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 1.758, top1 = 53.15%], valid : [loss = 2.350, top1 = 40.69%], test : [loss = 2.374, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.36%], valid : [loss = 0.625, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1763/15625) 001763-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.487, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.314, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.29 ms.
cifar100       train : [loss = 0.322, top1 = 91.41%], valid : [loss = 1.248, top1 = 67.96%], test : [loss = 1.238, top1 = 68.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.71%], valid : [loss = 2.319, top1 = 40.42%], test : [loss = 2.349, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.52%], valid : [loss = 0.621, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1764/15625) 001764-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.554, top1 = 87.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10        train : [loss = 0.030, top1 = 99.08%], test  : [loss = 0.343, top1 = 91.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.69 ms.
cifar100       train : [loss = 0.408, top1 = 88.23%], valid : [loss = 1.242, top1 = 67.35%], test : [loss = 1.275, top1 = 67.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 41.90%], valid : [loss = 2.423, top1 = 38.49%], test : [loss = 2.436, top1 = 39.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.954, top1 = 65.46%], valid : [loss = 0.998, top1 = 64.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1765/15625) 001765-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.52 ms.
cifar10-valid  train : [loss = 1.520, top1 = 44.53%], valid : [loss = 1.554, top1 = 43.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.92 ms.
cifar10        train : [loss = 1.209, top1 = 56.67%], test  : [loss = 1.214, top1 = 56.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.59 ms.
cifar100       train : [loss = 3.804, top1 = 11.86%], valid : [loss = 3.887, top1 = 10.39%], test : [loss = 3.883, top1 = 11.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.84 ms.
ImageNet16-120 train : [loss = 3.784, top1 = 13.48%], valid : [loss = 3.752, top1 = 14.34%], test : [loss = 3.762, top1 = 14.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.957, top1 = 27.94%], valid : [loss = 1.961, top1 = 27.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1766/15625) 001766-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.551, top1 = 88.46%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.373, top1 = 91.82%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.58 ms.
cifar100       train : [loss = 0.165, top1 = 96.50%], valid : [loss = 1.464, top1 = 66.21%], test : [loss = 1.463, top1 = 66.25%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.63 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.29%], valid : [loss = 2.415, top1 = 39.12%], test : [loss = 2.415, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.53%], valid : [loss = 0.734, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1767/15625) 001767-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.34%], valid : [loss = 0.750, top1 = 79.49%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10        train : [loss = 0.193, top1 = 93.47%], test  : [loss = 0.512, top1 = 84.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.80 ms.
cifar100       train : [loss = 0.882, top1 = 74.19%], valid : [loss = 1.627, top1 = 57.97%], test : [loss = 1.649, top1 = 57.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 3.494, top1 = 17.00%], valid : [loss = 3.486, top1 = 17.21%], test : [loss = 3.500, top1 = 16.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.53%], valid : [loss = 1.240, top1 = 55.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1768/15625) 001768-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.07%], valid : [loss = 0.878, top1 = 70.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.688, top1 = 75.81%], test  : [loss = 0.776, top1 = 73.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.27 ms.
cifar100       train : [loss = 1.966, top1 = 47.83%], valid : [loss = 2.150, top1 = 44.15%], test : [loss = 2.160, top1 = 44.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 3.645, top1 = 15.78%], valid : [loss = 3.668, top1 = 15.71%], test : [loss = 3.696, top1 = 14.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1769/15625) 001769-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.532, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.334, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.213, top1 = 94.76%], valid : [loss = 1.267, top1 = 68.41%], test : [loss = 1.283, top1 = 68.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.94%], valid : [loss = 2.347, top1 = 40.33%], test : [loss = 2.352, top1 = 40.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.29%], valid : [loss = 0.735, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1770/15625) 001770-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.98%], valid : [loss = 0.630, top1 = 85.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.052, top1 = 98.34%], test  : [loss = 0.411, top1 = 89.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.40 ms.
cifar100       train : [loss = 0.335, top1 = 90.71%], valid : [loss = 1.571, top1 = 63.21%], test : [loss = 1.582, top1 = 62.45%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 2.984, top1 = 26.33%], valid : [loss = 3.033, top1 = 25.74%], test : [loss = 3.054, top1 = 25.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.070, top1 = 60.83%], valid : [loss = 1.100, top1 = 60.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1771/15625) 001771-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.40%], valid : [loss = 0.738, top1 = 80.10%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.184, top1 = 93.67%], test  : [loss = 0.517, top1 = 84.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.82 ms.
cifar100       train : [loss = 0.881, top1 = 74.15%], valid : [loss = 1.631, top1 = 58.03%], test : [loss = 1.653, top1 = 57.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 3.464, top1 = 17.50%], valid : [loss = 3.472, top1 = 17.56%], test : [loss = 3.476, top1 = 17.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1772/15625) 001772-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.475, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.13 ms.
cifar100       train : [loss = 0.301, top1 = 92.14%], valid : [loss = 1.254, top1 = 67.45%], test : [loss = 1.251, top1 = 68.23%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 1.967, top1 = 48.28%], valid : [loss = 2.288, top1 = 41.54%], test : [loss = 2.302, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.14%], valid : [loss = 0.595, top1 = 79.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1773/15625) 001773-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.591, top1 = 87.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.394, top1 = 90.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.413, top1 = 88.24%], valid : [loss = 1.401, top1 = 65.15%], test : [loss = 1.403, top1 = 65.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.76%], valid : [loss = 2.505, top1 = 37.19%], test : [loss = 2.542, top1 = 36.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.02%], valid : [loss = 0.825, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1774/15625) 001774-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.80 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1775/15625) 001775-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.572, top1 = 88.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.357, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.59 ms.
cifar100       train : [loss = 0.165, top1 = 96.49%], valid : [loss = 1.375, top1 = 67.80%], test : [loss = 1.372, top1 = 67.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 1.966, top1 = 48.40%], valid : [loss = 2.456, top1 = 38.60%], test : [loss = 2.475, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.58%], valid : [loss = 0.708, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1776/15625) 001776-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.43%], valid : [loss = 0.846, top1 = 72.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.75 ms.
cifar10        train : [loss = 0.552, top1 = 80.62%], test  : [loss = 0.713, top1 = 75.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.71 ms.
cifar100       train : [loss = 1.784, top1 = 51.90%], valid : [loss = 2.053, top1 = 47.41%], test : [loss = 2.068, top1 = 46.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.91%], valid : [loss = 3.639, top1 = 16.66%], test : [loss = 3.672, top1 = 15.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1777/15625) 001777-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.88%], valid : [loss = 0.697, top1 = 79.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.254, top1 = 91.17%], test  : [loss = 0.513, top1 = 83.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.47 ms.
cifar100       train : [loss = 1.109, top1 = 68.27%], valid : [loss = 1.691, top1 = 55.41%], test : [loss = 1.696, top1 = 55.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 3.130, top1 = 24.45%], valid : [loss = 3.185, top1 = 23.83%], test : [loss = 3.211, top1 = 22.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.121, top1 = 59.54%], valid : [loss = 1.197, top1 = 57.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1778/15625) 001778-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.514, top1 = 88.64%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.10 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.320, top1 = 92.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.14 ms.
cifar100       train : [loss = 0.335, top1 = 90.85%], valid : [loss = 1.271, top1 = 66.98%], test : [loss = 1.283, top1 = 67.15%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.82 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.84%], valid : [loss = 2.409, top1 = 39.02%], test : [loss = 2.414, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.54%], valid : [loss = 0.678, top1 = 76.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1779/15625) 001779-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.37%], valid : [loss = 0.667, top1 = 82.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.44 ms.
cifar10        train : [loss = 0.144, top1 = 95.17%], test  : [loss = 0.455, top1 = 86.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.04 ms.
cifar100       train : [loss = 0.951, top1 = 72.37%], valid : [loss = 1.619, top1 = 57.41%], test : [loss = 1.615, top1 = 57.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 3.070, top1 = 24.97%], valid : [loss = 3.125, top1 = 24.37%], test : [loss = 3.167, top1 = 23.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.75%], valid : [loss = 1.018, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1780/15625) 001780-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.344, top1 = 91.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.32 ms.
cifar100       train : [loss = 0.335, top1 = 90.96%], valid : [loss = 1.287, top1 = 67.15%], test : [loss = 1.276, top1 = 67.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.98%], valid : [loss = 2.398, top1 = 39.10%], test : [loss = 2.411, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1781/15625) 001781-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.23%], valid : [loss = 0.444, top1 = 87.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10        train : [loss = 0.112, top1 = 96.54%], test  : [loss = 0.323, top1 = 89.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.28 ms.
cifar100       train : [loss = 0.854, top1 = 75.62%], valid : [loss = 1.298, top1 = 64.15%], test : [loss = 1.277, top1 = 64.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.70%], valid : [loss = 2.625, top1 = 34.80%], test : [loss = 2.670, top1 = 33.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1782/15625) 001782-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.30 ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.94%], valid : [loss = 0.640, top1 = 78.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.28 ms.
cifar10        train : [loss = 0.504, top1 = 82.56%], test  : [loss = 0.584, top1 = 80.23%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.29 ms.
cifar100       train : [loss = 1.673, top1 = 54.56%], valid : [loss = 1.848, top1 = 50.89%], test : [loss = 1.860, top1 = 50.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.40 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.35%], valid : [loss = 3.304, top1 = 22.18%], test : [loss = 3.343, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1783/15625) 001783-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.488, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.95 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.309, top1 = 92.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.88 ms.
cifar100       train : [loss = 0.243, top1 = 94.06%], valid : [loss = 1.264, top1 = 68.41%], test : [loss = 1.247, top1 = 68.83%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.07 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.56%], valid : [loss = 2.271, top1 = 41.96%], test : [loss = 2.284, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.86%], valid : [loss = 0.692, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1784/15625) 001784-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.41%], valid : [loss = 0.601, top1 = 83.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.126, top1 = 95.72%], test  : [loss = 0.423, top1 = 87.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.85 ms.
cifar100       train : [loss = 0.806, top1 = 76.28%], valid : [loss = 1.599, top1 = 58.53%], test : [loss = 1.603, top1 = 58.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 3.420, top1 = 17.88%], valid : [loss = 3.428, top1 = 18.08%], test : [loss = 3.420, top1 = 17.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.302, top1 = 52.17%], valid : [loss = 1.298, top1 = 52.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1785/15625) 001785-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.23%], valid : [loss = 0.478, top1 = 84.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10        train : [loss = 0.299, top1 = 89.94%], test  : [loss = 0.402, top1 = 86.59%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.32 ms.
cifar100       train : [loss = 1.315, top1 = 63.58%], valid : [loss = 1.532, top1 = 58.01%], test : [loss = 1.502, top1 = 58.29%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.70 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.78%], valid : [loss = 2.894, top1 = 29.69%], test : [loss = 2.951, top1 = 28.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1786/15625) 001786-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.533, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.38 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.342, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.00 ms.
cifar100       train : [loss = 0.197, top1 = 95.10%], valid : [loss = 1.306, top1 = 68.63%], test : [loss = 1.295, top1 = 69.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.408, top1 = 38.08%], valid : [loss = 2.541, top1 = 35.41%], test : [loss = 2.565, top1 = 34.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.56%], valid : [loss = 0.878, top1 = 68.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1787/15625) 001787-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.83%], valid : [loss = 0.853, top1 = 71.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.561, top1 = 80.36%], test  : [loss = 0.711, top1 = 75.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.36 ms.
cifar100       train : [loss = 1.789, top1 = 51.93%], valid : [loss = 2.061, top1 = 46.93%], test : [loss = 2.082, top1 = 46.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.89%], valid : [loss = 3.639, top1 = 16.39%], test : [loss = 3.661, top1 = 15.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.84%], valid : [loss = 1.256, top1 = 55.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1788/15625) 001788-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.632, top1 = 87.13%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.422, top1 = 91.12%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.47 ms.
cifar100       train : [loss = 0.161, top1 = 96.57%], valid : [loss = 1.469, top1 = 66.59%], test : [loss = 1.490, top1 = 66.49%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.54 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.31%], valid : [loss = 2.468, top1 = 38.36%], test : [loss = 2.493, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.85%], valid : [loss = 0.779, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1789/15625) 001789-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.553, top1 = 88.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.352, top1 = 91.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.42 ms.
cifar100       train : [loss = 0.417, top1 = 87.96%], valid : [loss = 1.252, top1 = 67.47%], test : [loss = 1.253, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 2.223, top1 = 42.53%], valid : [loss = 2.392, top1 = 39.44%], test : [loss = 2.424, top1 = 38.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.86%], valid : [loss = 0.850, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1790/15625) 001790-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.573, top1 = 87.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.390, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 0.391, top1 = 88.93%], valid : [loss = 1.386, top1 = 65.35%], test : [loss = 1.373, top1 = 65.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.92%], valid : [loss = 2.506, top1 = 36.76%], test : [loss = 2.516, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1791/15625) 001791-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.600, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.396, top1 = 91.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.29 ms.
cifar100       train : [loss = 0.209, top1 = 95.05%], valid : [loss = 1.471, top1 = 65.91%], test : [loss = 1.448, top1 = 66.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 46.11%], valid : [loss = 2.513, top1 = 37.48%], test : [loss = 2.513, top1 = 38.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1792/15625) 001792-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.473, top1 = 90.30%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.77 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.297, top1 = 93.47%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.26 ms.
cifar100       train : [loss = 0.072, top1 = 99.02%], valid : [loss = 1.300, top1 = 69.85%], test : [loss = 1.309, top1 = 70.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.33 ms.
ImageNet16-120 train : [loss = 1.570, top1 = 57.64%], valid : [loss = 2.137, top1 = 45.09%], test : [loss = 2.170, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 80.01%], valid : [loss = 0.659, top1 = 77.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1793/15625) 001793-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.527, top1 = 89.13%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.30 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.354, top1 = 92.44%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.86 ms.
cifar100       train : [loss = 0.130, top1 = 97.08%], valid : [loss = 1.369, top1 = 68.67%], test : [loss = 1.352, top1 = 69.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.86 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.22%], valid : [loss = 2.357, top1 = 40.00%], test : [loss = 2.350, top1 = 40.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.41%], valid : [loss = 0.868, top1 = 69.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1794/15625) 001794-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.16%], valid : [loss = 0.586, top1 = 86.63%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.060, top1 = 98.06%], test  : [loss = 0.367, top1 = 90.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 0.666, top1 = 80.19%], valid : [loss = 1.331, top1 = 64.90%], test : [loss = 1.339, top1 = 64.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.82%], valid : [loss = 2.482, top1 = 37.06%], test : [loss = 2.498, top1 = 36.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1795/15625) 001795-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.563, top1 = 88.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.381, top1 = 92.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.76 ms.
cifar100       train : [loss = 0.063, top1 = 99.13%], valid : [loss = 1.462, top1 = 68.78%], test : [loss = 1.469, top1 = 68.51%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.30%], valid : [loss = 2.420, top1 = 39.82%], test : [loss = 2.442, top1 = 40.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.67%], valid : [loss = 0.710, top1 = 75.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1796/15625) 001796-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.587, top1 = 88.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.388, top1 = 92.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 0.117, top1 = 97.71%], valid : [loss = 1.507, top1 = 66.82%], test : [loss = 1.497, top1 = 66.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.65%], valid : [loss = 2.446, top1 = 39.36%], test : [loss = 2.478, top1 = 38.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.71%], valid : [loss = 0.781, top1 = 72.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1797/15625) 001797-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.516, top1 = 89.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.34 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.24%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.99 ms.
cifar100       train : [loss = 0.069, top1 = 98.95%], valid : [loss = 1.380, top1 = 69.09%], test : [loss = 1.377, top1 = 68.90%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 46.93%], valid : [loss = 2.379, top1 = 39.90%], test : [loss = 2.391, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1798/15625) 001798-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.843, top1 = 72.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.70 ms.
cifar10        train : [loss = 0.555, top1 = 80.69%], test  : [loss = 0.715, top1 = 75.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 1.765, top1 = 52.49%], valid : [loss = 2.033, top1 = 47.59%], test : [loss = 2.059, top1 = 47.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 17.01%], valid : [loss = 3.631, top1 = 16.57%], test : [loss = 3.664, top1 = 15.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1799/15625) 001799-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.465, top1 = 89.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.326, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 0.326, top1 = 91.10%], valid : [loss = 1.302, top1 = 67.51%], test : [loss = 1.255, top1 = 68.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.14%], valid : [loss = 2.340, top1 = 39.99%], test : [loss = 2.391, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.41%], valid : [loss = 0.544, top1 = 81.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1800/15625) 001800-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.28%], valid : [loss = 0.736, top1 = 75.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10        train : [loss = 0.508, top1 = 82.38%], test  : [loss = 0.590, top1 = 79.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 1.939, top1 = 47.35%], valid : [loss = 2.059, top1 = 44.85%], test : [loss = 2.066, top1 = 44.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.990, top1 = 26.86%], valid : [loss = 2.966, top1 = 27.36%], test : [loss = 3.010, top1 = 26.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.73%], valid : [loss = 1.201, top1 = 57.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1801/15625) 001801-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.570, top1 = 87.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.388, top1 = 91.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.379, top1 = 89.35%], valid : [loss = 1.403, top1 = 65.47%], test : [loss = 1.402, top1 = 65.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.279, top1 = 41.38%], valid : [loss = 2.515, top1 = 36.78%], test : [loss = 2.518, top1 = 37.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.57%], valid : [loss = 0.842, top1 = 70.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1802/15625) 001802-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.41 ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.63%], valid : [loss = 0.765, top1 = 73.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10        train : [loss = 0.616, top1 = 79.01%], test  : [loss = 0.658, top1 = 77.04%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.77 ms.
cifar100       train : [loss = 2.058, top1 = 45.86%], valid : [loss = 2.143, top1 = 43.87%], test : [loss = 2.122, top1 = 44.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 3.277, top1 = 21.78%], valid : [loss = 3.245, top1 = 22.13%], test : [loss = 3.270, top1 = 21.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.315, top1 = 52.71%], valid : [loss = 1.360, top1 = 50.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1803/15625) 001803-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.58%], valid : [loss = 0.860, top1 = 72.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.06 ms.
cifar10        train : [loss = 0.547, top1 = 80.89%], test  : [loss = 0.710, top1 = 75.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.98 ms.
cifar100       train : [loss = 1.768, top1 = 52.20%], valid : [loss = 2.039, top1 = 47.30%], test : [loss = 2.056, top1 = 46.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.95%], valid : [loss = 3.633, top1 = 16.96%], test : [loss = 3.660, top1 = 15.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1804/15625) 001804-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.00 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.75%], valid : [loss = 0.457, top1 = 86.39%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.46 ms.
cifar10        train : [loss = 0.154, top1 = 94.90%], test  : [loss = 0.340, top1 = 89.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.50 ms.
cifar100       train : [loss = 0.982, top1 = 72.14%], valid : [loss = 1.347, top1 = 62.27%], test : [loss = 1.340, top1 = 62.25%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.67 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.19%], valid : [loss = 2.673, top1 = 33.29%], test : [loss = 2.707, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.79%], valid : [loss = 0.789, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1805/15625) 001805-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.472, top1 = 89.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.318, top1 = 92.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 0.326, top1 = 91.02%], valid : [loss = 1.292, top1 = 67.46%], test : [loss = 1.324, top1 = 66.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.29%], valid : [loss = 2.380, top1 = 39.63%], test : [loss = 2.416, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1806/15625) 001806-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.489, top1 = 89.21%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.307, top1 = 92.38%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.62 ms.
cifar100       train : [loss = 0.261, top1 = 93.38%], valid : [loss = 1.218, top1 = 68.81%], test : [loss = 1.211, top1 = 69.11%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.13%], valid : [loss = 2.211, top1 = 42.89%], test : [loss = 2.235, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.72%], valid : [loss = 0.589, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1807/15625) 001807-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.586, top1 = 87.35%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.74 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.381, top1 = 91.33%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.88 ms.
cifar100       train : [loss = 0.376, top1 = 89.39%], valid : [loss = 1.408, top1 = 65.60%], test : [loss = 1.410, top1 = 65.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.37%], valid : [loss = 2.489, top1 = 37.17%], test : [loss = 2.512, top1 = 37.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.73%], valid : [loss = 0.788, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1808/15625) 001808-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.560, top1 = 87.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.371, top1 = 91.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.377, top1 = 89.43%], valid : [loss = 1.405, top1 = 64.89%], test : [loss = 1.390, top1 = 65.53%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.12%], valid : [loss = 2.469, top1 = 37.43%], test : [loss = 2.465, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.15%], valid : [loss = 0.672, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1809/15625) 001809-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.71%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.327, top1 = 92.02%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.76 ms.
cifar100       train : [loss = 0.347, top1 = 90.48%], valid : [loss = 1.273, top1 = 67.32%], test : [loss = 1.296, top1 = 66.99%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.89%], valid : [loss = 2.436, top1 = 38.02%], test : [loss = 2.429, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.87%], valid : [loss = 0.717, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1810/15625) 001810-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.501, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.315, top1 = 92.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.54 ms.
cifar100       train : [loss = 0.108, top1 = 97.92%], valid : [loss = 1.279, top1 = 69.62%], test : [loss = 1.299, top1 = 69.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.69 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.30%], valid : [loss = 2.299, top1 = 41.39%], test : [loss = 2.297, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.74%], valid : [loss = 0.738, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1811/15625) 001811-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.57%], valid : [loss = 0.502, top1 = 86.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.066, top1 = 98.07%], test  : [loss = 0.332, top1 = 90.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.24 ms.
cifar100       train : [loss = 0.631, top1 = 81.76%], valid : [loss = 1.286, top1 = 65.67%], test : [loss = 1.282, top1 = 65.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.46%], valid : [loss = 2.452, top1 = 37.50%], test : [loss = 2.488, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.54%], valid : [loss = 0.916, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1812/15625) 001812-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.535, top1 = 89.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.333, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.14 ms.
cifar100       train : [loss = 0.133, top1 = 97.16%], valid : [loss = 1.342, top1 = 68.45%], test : [loss = 1.349, top1 = 68.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.96%], valid : [loss = 2.252, top1 = 42.73%], test : [loss = 2.281, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.87%], valid : [loss = 0.759, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1813/15625) 001813-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.537, top1 = 88.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.348, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.297, top1 = 91.93%], valid : [loss = 1.325, top1 = 67.21%], test : [loss = 1.311, top1 = 67.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.06%], valid : [loss = 2.408, top1 = 38.77%], test : [loss = 2.433, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1814/15625) 001814-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.89%], valid : [loss = 0.463, top1 = 86.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.77 ms.
cifar10        train : [loss = 0.117, top1 = 96.37%], test  : [loss = 0.335, top1 = 89.45%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.37 ms.
cifar100       train : [loss = 0.733, top1 = 79.44%], valid : [loss = 1.263, top1 = 65.15%], test : [loss = 1.257, top1 = 64.99%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.92%], valid : [loss = 2.589, top1 = 34.64%], test : [loss = 2.611, top1 = 34.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1815/15625) 001815-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.332, top1 = 91.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.331, top1 = 91.00%], valid : [loss = 1.280, top1 = 67.11%], test : [loss = 1.292, top1 = 67.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.86%], valid : [loss = 2.421, top1 = 38.92%], test : [loss = 2.425, top1 = 38.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1816/15625) 001816-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.518, top1 = 89.14%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.24 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.332, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.48 ms.
cifar100       train : [loss = 0.185, top1 = 95.65%], valid : [loss = 1.295, top1 = 68.43%], test : [loss = 1.297, top1 = 68.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.12 ms.
ImageNet16-120 train : [loss = 1.862, top1 = 50.76%], valid : [loss = 2.255, top1 = 42.58%], test : [loss = 2.273, top1 = 42.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.93%], valid : [loss = 0.651, top1 = 77.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1817/15625) 001817-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.71%], valid : [loss = 0.461, top1 = 85.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.06 ms.
cifar10        train : [loss = 0.233, top1 = 92.18%], test  : [loss = 0.350, top1 = 88.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 1.196, top1 = 66.32%], valid : [loss = 1.425, top1 = 60.05%], test : [loss = 1.408, top1 = 60.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 2.731, top1 = 32.27%], valid : [loss = 2.734, top1 = 32.50%], test : [loss = 2.779, top1 = 31.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.006, top1 = 64.05%], valid : [loss = 1.036, top1 = 63.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1818/15625) 001818-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.419, top1 = 90.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.39 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.285, top1 = 93.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.24 ms.
cifar100       train : [loss = 0.086, top1 = 98.47%], valid : [loss = 1.324, top1 = 70.15%], test : [loss = 1.310, top1 = 70.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.597, top1 = 56.91%], valid : [loss = 2.237, top1 = 44.20%], test : [loss = 2.263, top1 = 43.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.76%], valid : [loss = 0.513, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1819/15625) 001819-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.558, top1 = 88.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.352, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.48 ms.
cifar100       train : [loss = 0.287, top1 = 91.98%], valid : [loss = 1.314, top1 = 67.53%], test : [loss = 1.328, top1 = 67.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.149, top1 = 44.10%], valid : [loss = 2.422, top1 = 38.50%], test : [loss = 2.418, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1820/15625) 001820-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.555, top1 = 88.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.357, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.191, top1 = 95.24%], valid : [loss = 1.348, top1 = 67.92%], test : [loss = 1.334, top1 = 68.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.09%], valid : [loss = 2.374, top1 = 39.30%], test : [loss = 2.407, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.00%], valid : [loss = 0.907, top1 = 68.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1821/15625) 001821-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.518, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.335, top1 = 92.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.57 ms.
cifar100       train : [loss = 0.264, top1 = 92.92%], valid : [loss = 1.241, top1 = 68.72%], test : [loss = 1.257, top1 = 68.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.75%], valid : [loss = 2.254, top1 = 42.36%], test : [loss = 2.279, top1 = 41.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.29%], valid : [loss = 0.691, top1 = 76.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1822/15625) 001822-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.590, top1 = 87.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.390, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.383, top1 = 89.12%], valid : [loss = 1.387, top1 = 65.54%], test : [loss = 1.421, top1 = 65.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.33%], valid : [loss = 2.499, top1 = 36.93%], test : [loss = 2.530, top1 = 37.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.53%], valid : [loss = 0.839, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1823/15625) 001823-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.447, top1 = 89.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.58 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.293, top1 = 92.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.198, top1 = 95.38%], valid : [loss = 1.248, top1 = 69.41%], test : [loss = 1.255, top1 = 68.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.43%], valid : [loss = 2.245, top1 = 42.73%], test : [loss = 2.293, top1 = 42.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.48%], valid : [loss = 0.515, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1824/15625) 001824-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.536, top1 = 89.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.16 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.343, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.72 ms.
cifar100       train : [loss = 0.220, top1 = 94.22%], valid : [loss = 1.297, top1 = 68.11%], test : [loss = 1.301, top1 = 68.79%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 1.961, top1 = 48.40%], valid : [loss = 2.278, top1 = 41.82%], test : [loss = 2.306, top1 = 41.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.47%], valid : [loss = 0.816, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1825/15625) 001825-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.442, top1 = 90.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.309, top1 = 92.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.15 ms.
cifar100       train : [loss = 0.102, top1 = 98.12%], valid : [loss = 1.377, top1 = 68.95%], test : [loss = 1.348, top1 = 69.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 1.684, top1 = 54.93%], valid : [loss = 2.284, top1 = 42.44%], test : [loss = 2.310, top1 = 42.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.24%], valid : [loss = 0.541, top1 = 81.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1826/15625) 001826-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.679, top1 = 85.53%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10        train : [loss = 0.037, top1 = 98.92%], test  : [loss = 0.448, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.42 ms.
cifar100       train : [loss = 0.455, top1 = 87.30%], valid : [loss = 1.459, top1 = 63.22%], test : [loss = 1.462, top1 = 63.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.18%], valid : [loss = 2.684, top1 = 33.53%], test : [loss = 2.700, top1 = 34.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.850, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1827/15625) 001827-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.464, top1 = 89.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.319, top1 = 91.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.21 ms.
cifar100       train : [loss = 0.320, top1 = 91.28%], valid : [loss = 1.318, top1 = 67.07%], test : [loss = 1.303, top1 = 67.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.35%], valid : [loss = 2.360, top1 = 39.88%], test : [loss = 2.395, top1 = 40.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.63%], valid : [loss = 0.557, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1828/15625) 001828-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.59 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.479, top1 = 89.51%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.299, top1 = 92.66%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.63 ms.
cifar100       train : [loss = 0.233, top1 = 94.11%], valid : [loss = 1.208, top1 = 69.59%], test : [loss = 1.232, top1 = 69.34%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.11 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 50.86%], valid : [loss = 2.200, top1 = 43.47%], test : [loss = 2.217, top1 = 43.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.37%], valid : [loss = 0.618, top1 = 78.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1829/15625) 001829-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.71%], valid : [loss = 0.862, top1 = 70.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.666, top1 = 76.59%], test  : [loss = 0.759, top1 = 73.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 1.957, top1 = 48.02%], valid : [loss = 2.129, top1 = 44.64%], test : [loss = 2.149, top1 = 44.66%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.75%], valid : [loss = 3.668, top1 = 16.17%], test : [loss = 3.696, top1 = 14.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1830/15625) 001830-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.616, top1 = 86.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.403, top1 = 90.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.51 ms.
cifar100       train : [loss = 0.504, top1 = 85.27%], valid : [loss = 1.379, top1 = 64.67%], test : [loss = 1.371, top1 = 64.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 2.398, top1 = 38.92%], valid : [loss = 2.560, top1 = 35.59%], test : [loss = 2.603, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.86%], valid : [loss = 0.839, top1 = 70.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1831/15625) 001831-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.19 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.23%], valid : [loss = 0.861, top1 = 71.87%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10        train : [loss = 0.553, top1 = 80.67%], test  : [loss = 0.718, top1 = 75.35%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.08 ms.
cifar100       train : [loss = 1.773, top1 = 52.09%], valid : [loss = 2.045, top1 = 47.23%], test : [loss = 2.073, top1 = 46.19%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.92 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.85%], valid : [loss = 3.635, top1 = 16.41%], test : [loss = 3.660, top1 = 15.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1832/15625) 001832-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.75%], valid : [loss = 0.456, top1 = 86.37%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.98 ms.
cifar10        train : [loss = 0.148, top1 = 95.17%], test  : [loss = 0.337, top1 = 89.13%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.11 ms.
cifar100       train : [loss = 0.972, top1 = 72.23%], valid : [loss = 1.348, top1 = 62.50%], test : [loss = 1.353, top1 = 62.25%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 2.605, top1 = 34.46%], valid : [loss = 2.676, top1 = 33.13%], test : [loss = 2.678, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.40%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1833/15625) 001833-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.46%], valid : [loss = 0.535, top1 = 86.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.085, top1 = 97.34%], test  : [loss = 0.361, top1 = 89.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.767, top1 = 77.60%], valid : [loss = 1.395, top1 = 62.69%], test : [loss = 1.380, top1 = 63.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.464, top1 = 37.32%], valid : [loss = 2.584, top1 = 35.11%], test : [loss = 2.614, top1 = 34.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.03%], valid : [loss = 0.862, top1 = 69.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1834/15625) 001834-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.566, top1 = 89.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.359, top1 = 92.63%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.70 ms.
cifar100       train : [loss = 0.100, top1 = 98.20%], valid : [loss = 1.449, top1 = 68.10%], test : [loss = 1.419, top1 = 68.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.44 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.67%], valid : [loss = 2.451, top1 = 38.83%], test : [loss = 2.444, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.31%], valid : [loss = 0.685, top1 = 76.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1835/15625) 001835-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=6.87 ms.
cifar10-valid  train : [loss = 1.629, top1 = 41.33%], valid : [loss = 1.656, top1 = 39.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.42 ms.
cifar10        train : [loss = 1.256, top1 = 55.21%], test  : [loss = 1.264, top1 = 54.30%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.73 ms.
cifar100       train : [loss = 3.594, top1 = 16.48%], valid : [loss = 3.632, top1 = 15.03%], test : [loss = 3.636, top1 = 15.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.68 ms.
ImageNet16-120 train : [loss = 3.619, top1 = 15.91%], valid : [loss = 3.601, top1 = 16.43%], test : [loss = 3.602, top1 = 16.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.774, top1 = 34.35%], valid : [loss = 1.782, top1 = 34.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1836/15625) 001836-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.332, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.342, top1 = 90.67%], valid : [loss = 1.278, top1 = 67.33%], test : [loss = 1.288, top1 = 67.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.75%], valid : [loss = 2.402, top1 = 39.40%], test : [loss = 2.395, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1837/15625) 001837-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.621, top1 = 86.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.401, top1 = 90.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.29 ms.
cifar100       train : [loss = 0.501, top1 = 85.32%], valid : [loss = 1.409, top1 = 64.13%], test : [loss = 1.404, top1 = 64.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.37%], valid : [loss = 2.554, top1 = 35.76%], test : [loss = 2.592, top1 = 35.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.55%], valid : [loss = 0.835, top1 = 70.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1838/15625) 001838-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.03%], valid : [loss = 0.820, top1 = 79.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10        train : [loss = 0.187, top1 = 93.57%], test  : [loss = 0.550, top1 = 83.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.54 ms.
cifar100       train : [loss = 0.947, top1 = 72.56%], valid : [loss = 1.699, top1 = 56.03%], test : [loss = 1.710, top1 = 56.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 3.121, top1 = 23.68%], valid : [loss = 3.166, top1 = 22.82%], test : [loss = 3.198, top1 = 22.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.173, top1 = 57.04%], valid : [loss = 1.202, top1 = 56.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1839/15625) 001839-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.225, top1 = 92.40%], valid : [loss = 0.527, top1 = 83.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.34 ms.
cifar10        train : [loss = 0.215, top1 = 92.73%], test  : [loss = 0.377, top1 = 87.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.15 ms.
cifar100       train : [loss = 1.303, top1 = 63.22%], valid : [loss = 1.589, top1 = 56.40%], test : [loss = 1.574, top1 = 57.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.798, top1 = 30.66%], valid : [loss = 2.841, top1 = 30.37%], test : [loss = 2.870, top1 = 29.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 64.90%], valid : [loss = 1.010, top1 = 64.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1840/15625) 001840-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.493, top1 = 89.63%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.301, top1 = 93.16%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.38 ms.
cifar100       train : [loss = 0.099, top1 = 98.38%], valid : [loss = 1.264, top1 = 69.86%], test : [loss = 1.258, top1 = 70.03%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.59 ms.
ImageNet16-120 train : [loss = 1.699, top1 = 54.60%], valid : [loss = 2.200, top1 = 43.99%], test : [loss = 2.209, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.97%], valid : [loss = 0.632, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1841/15625) 001841-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.29%], valid : [loss = 0.458, top1 = 86.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.107, top1 = 96.79%], test  : [loss = 0.331, top1 = 89.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.10 ms.
cifar100       train : [loss = 0.866, top1 = 75.38%], valid : [loss = 1.303, top1 = 64.25%], test : [loss = 1.284, top1 = 64.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.73%], valid : [loss = 2.618, top1 = 34.22%], test : [loss = 2.656, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1842/15625) 001842-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.422, top1 = 91.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.289, top1 = 93.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.53 ms.
cifar100       train : [loss = 0.057, top1 = 99.25%], valid : [loss = 1.323, top1 = 70.36%], test : [loss = 1.324, top1 = 70.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 1.494, top1 = 59.41%], valid : [loss = 2.222, top1 = 44.68%], test : [loss = 2.254, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.54%], valid : [loss = 0.498, top1 = 83.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1843/15625) 001843-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.531, top1 = 89.44%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.59 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.349, top1 = 92.48%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.52 ms.
cifar100       train : [loss = 0.145, top1 = 96.87%], valid : [loss = 1.365, top1 = 67.59%], test : [loss = 1.352, top1 = 68.25%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.38 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 43.88%], valid : [loss = 2.402, top1 = 38.54%], test : [loss = 2.386, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.901, top1 = 68.10%], valid : [loss = 0.929, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1844/15625) 001844-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.607, top1 = 86.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.405, top1 = 89.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.86 ms.
cifar100       train : [loss = 0.518, top1 = 84.84%], valid : [loss = 1.407, top1 = 64.57%], test : [loss = 1.417, top1 = 64.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.18%], valid : [loss = 2.569, top1 = 35.73%], test : [loss = 2.600, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1845/15625) 001845-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.482, top1 = 89.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.308, top1 = 92.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.36 ms.
cifar100       train : [loss = 0.263, top1 = 93.11%], valid : [loss = 1.248, top1 = 68.51%], test : [loss = 1.236, top1 = 69.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.09%], valid : [loss = 2.202, top1 = 43.29%], test : [loss = 2.217, top1 = 43.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.35%], valid : [loss = 0.638, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1846/15625) 001846-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.62%], valid : [loss = 0.643, top1 = 85.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.394, top1 = 90.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.43 ms.
cifar100       train : [loss = 0.500, top1 = 85.40%], valid : [loss = 1.448, top1 = 63.69%], test : [loss = 1.461, top1 = 63.61%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.81 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.90%], valid : [loss = 2.546, top1 = 36.41%], test : [loss = 2.562, top1 = 36.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.18%], valid : [loss = 0.850, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1847/15625) 001847-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.34%], valid : [loss = 0.534, top1 = 86.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.044, top1 = 98.82%], test  : [loss = 0.360, top1 = 90.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.27 ms.
cifar100       train : [loss = 0.494, top1 = 86.08%], valid : [loss = 1.304, top1 = 66.05%], test : [loss = 1.281, top1 = 66.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 42.03%], valid : [loss = 2.416, top1 = 38.36%], test : [loss = 2.458, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.43%], valid : [loss = 0.834, top1 = 70.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1848/15625) 001848-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.576, top1 = 88.11%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.85 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.377, top1 = 91.81%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.03 ms.
cifar100       train : [loss = 0.124, top1 = 97.21%], valid : [loss = 1.552, top1 = 65.49%], test : [loss = 1.554, top1 = 65.73%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.14 ms.
ImageNet16-120 train : [loss = 2.748, top1 = 30.93%], valid : [loss = 2.863, top1 = 28.44%], test : [loss = 2.865, top1 = 29.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.091, top1 = 60.39%], valid : [loss = 1.111, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1849/15625) 001849-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.88 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.47 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1850/15625) 001850-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.88%], valid : [loss = 0.572, top1 = 85.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.069, top1 = 97.97%], test  : [loss = 0.369, top1 = 89.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.56 ms.
cifar100       train : [loss = 0.617, top1 = 82.06%], valid : [loss = 1.350, top1 = 64.51%], test : [loss = 1.361, top1 = 64.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.00%], valid : [loss = 2.512, top1 = 36.82%], test : [loss = 2.545, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.37%], valid : [loss = 0.824, top1 = 71.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1851/15625) 001851-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.84%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1852/15625) 001852-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1853/15625) 001853-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.555, top1 = 87.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.362, top1 = 91.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.391, top1 = 88.93%], valid : [loss = 1.404, top1 = 65.72%], test : [loss = 1.414, top1 = 65.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.81%], valid : [loss = 2.488, top1 = 37.98%], test : [loss = 2.496, top1 = 37.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.32%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1854/15625) 001854-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.563, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.365, top1 = 91.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.294, top1 = 91.93%], valid : [loss = 1.319, top1 = 67.25%], test : [loss = 1.324, top1 = 67.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.51%], valid : [loss = 2.419, top1 = 39.01%], test : [loss = 2.400, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 66.71%], valid : [loss = 0.940, top1 = 65.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1855/15625) 001855-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.36%], valid : [loss = 0.651, top1 = 78.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10        train : [loss = 0.514, top1 = 82.16%], test  : [loss = 0.595, top1 = 79.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 1.686, top1 = 54.14%], valid : [loss = 1.851, top1 = 50.79%], test : [loss = 1.871, top1 = 50.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.18%], valid : [loss = 3.308, top1 = 22.03%], test : [loss = 3.358, top1 = 21.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.71%], valid : [loss = 1.305, top1 = 53.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1856/15625) 001856-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 90.69%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.87 ms.
cifar100       train : [loss = 0.055, top1 = 99.23%], valid : [loss = 1.349, top1 = 70.43%], test : [loss = 1.348, top1 = 69.91%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 1.496, top1 = 59.51%], valid : [loss = 2.222, top1 = 44.16%], test : [loss = 2.269, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.28%], valid : [loss = 0.599, top1 = 79.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1857/15625) 001857-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.54%], valid : [loss = 0.930, top1 = 76.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 0.225, top1 = 92.26%], test  : [loss = 0.600, top1 = 82.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.41 ms.
cifar100       train : [loss = 1.148, top1 = 67.34%], valid : [loss = 1.770, top1 = 53.83%], test : [loss = 1.774, top1 = 54.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.71%], valid : [loss = 3.327, top1 = 21.84%], test : [loss = 3.371, top1 = 20.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.59%], valid : [loss = 1.130, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1858/15625) 001858-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.543, top1 = 88.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.60 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.346, top1 = 92.12%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.91 ms.
cifar100       train : [loss = 0.170, top1 = 95.69%], valid : [loss = 1.334, top1 = 68.69%], test : [loss = 1.334, top1 = 68.50%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.46%], valid : [loss = 2.256, top1 = 41.90%], test : [loss = 2.246, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.14%], valid : [loss = 0.874, top1 = 69.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1859/15625) 001859-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.556, top1 = 87.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.383, top1 = 91.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 0.406, top1 = 88.48%], valid : [loss = 1.388, top1 = 65.23%], test : [loss = 1.400, top1 = 65.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.79%], valid : [loss = 2.503, top1 = 36.88%], test : [loss = 2.517, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.32%], valid : [loss = 0.822, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1860/15625) 001860-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.22%], valid : [loss = 0.478, top1 = 84.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.296, top1 = 90.11%], test  : [loss = 0.396, top1 = 86.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 1.327, top1 = 63.19%], valid : [loss = 1.536, top1 = 58.31%], test : [loss = 1.508, top1 = 58.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.81%], valid : [loss = 2.900, top1 = 29.16%], test : [loss = 2.954, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1861/15625) 001861-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.55%], valid : [loss = 0.607, top1 = 86.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.388, top1 = 90.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.71 ms.
cifar100       train : [loss = 0.529, top1 = 84.60%], valid : [loss = 1.444, top1 = 63.21%], test : [loss = 1.438, top1 = 62.97%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.27%], valid : [loss = 2.525, top1 = 36.23%], test : [loss = 2.552, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.00%], valid : [loss = 0.887, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1862/15625) 001862-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.577, top1 = 87.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.383, top1 = 91.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.418, top1 = 88.06%], valid : [loss = 1.390, top1 = 65.31%], test : [loss = 1.390, top1 = 65.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.64%], valid : [loss = 2.522, top1 = 36.52%], test : [loss = 2.548, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.16%], valid : [loss = 0.817, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1863/15625) 001863-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.39 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.22%], valid : [loss = 0.474, top1 = 84.49%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.299, top1 = 90.04%], test  : [loss = 0.397, top1 = 86.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.95 ms.
cifar100       train : [loss = 1.325, top1 = 63.29%], valid : [loss = 1.532, top1 = 57.88%], test : [loss = 1.516, top1 = 58.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.69 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.82%], valid : [loss = 2.881, top1 = 29.76%], test : [loss = 2.948, top1 = 28.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1864/15625) 001864-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.558, top1 = 87.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.387, top1 = 91.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.404, top1 = 88.45%], valid : [loss = 1.393, top1 = 65.59%], test : [loss = 1.378, top1 = 65.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.79%], valid : [loss = 2.503, top1 = 36.89%], test : [loss = 2.536, top1 = 36.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.93%], valid : [loss = 0.777, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1865/15625) 001865-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.512, top1 = 90.05%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.26 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.21%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.06 ms.
cifar100       train : [loss = 0.073, top1 = 98.88%], valid : [loss = 1.328, top1 = 69.83%], test : [loss = 1.347, top1 = 69.76%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.20 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.67%], valid : [loss = 2.298, top1 = 41.56%], test : [loss = 2.296, top1 = 41.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.80%], valid : [loss = 0.773, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1866/15625) 001866-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.21%], valid : [loss = 0.715, top1 = 82.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10        train : [loss = 0.093, top1 = 96.96%], test  : [loss = 0.459, top1 = 87.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 0.797, top1 = 76.65%], valid : [loss = 1.568, top1 = 59.55%], test : [loss = 1.545, top1 = 59.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 2.759, top1 = 31.51%], valid : [loss = 2.887, top1 = 28.83%], test : [loss = 2.947, top1 = 28.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.87%], valid : [loss = 0.921, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1867/15625) 001867-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.606, top1 = 85.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.397, top1 = 88.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.75 ms.
cifar100       train : [loss = 0.713, top1 = 79.21%], valid : [loss = 1.403, top1 = 62.85%], test : [loss = 1.380, top1 = 63.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.98%], valid : [loss = 2.659, top1 = 34.39%], test : [loss = 2.688, top1 = 33.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.63%], valid : [loss = 0.784, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1868/15625) 001868-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.329, top1 = 92.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.342, top1 = 90.67%], valid : [loss = 1.271, top1 = 66.95%], test : [loss = 1.272, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.88%], valid : [loss = 2.410, top1 = 39.04%], test : [loss = 2.397, top1 = 39.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1869/15625) 001869-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.509, top1 = 89.73%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.02 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.316, top1 = 93.35%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.55 ms.
cifar100       train : [loss = 0.042, top1 = 99.45%], valid : [loss = 1.412, top1 = 69.85%], test : [loss = 1.405, top1 = 69.94%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=23.74 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.50%], valid : [loss = 2.305, top1 = 41.50%], test : [loss = 2.288, top1 = 42.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.12%], valid : [loss = 0.719, top1 = 75.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1870/15625) 001870-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.69%], valid : [loss = 0.556, top1 = 84.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.127, top1 = 95.92%], test  : [loss = 0.391, top1 = 88.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.02 ms.
cifar100       train : [loss = 0.990, top1 = 71.50%], valid : [loss = 1.426, top1 = 61.06%], test : [loss = 1.439, top1 = 60.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 37.17%], valid : [loss = 2.579, top1 = 35.27%], test : [loss = 2.603, top1 = 34.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.855, top1 = 69.33%], valid : [loss = 0.913, top1 = 68.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1871/15625) 001871-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.199, top1 = 93.18%], valid : [loss = 0.952, top1 = 74.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.244, top1 = 91.50%], test  : [loss = 0.607, top1 = 81.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.56 ms.
cifar100       train : [loss = 1.178, top1 = 66.58%], valid : [loss = 1.908, top1 = 51.38%], test : [loss = 1.873, top1 = 52.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 3.200, top1 = 23.33%], valid : [loss = 3.337, top1 = 21.49%], test : [loss = 3.335, top1 = 20.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 56.61%], valid : [loss = 1.251, top1 = 54.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1872/15625) 001872-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.17%], valid : [loss = 0.474, top1 = 84.36%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10        train : [loss = 0.296, top1 = 90.10%], test  : [loss = 0.396, top1 = 86.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.04 ms.
cifar100       train : [loss = 1.322, top1 = 63.41%], valid : [loss = 1.526, top1 = 57.87%], test : [loss = 1.506, top1 = 58.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.76%], valid : [loss = 2.905, top1 = 29.31%], test : [loss = 2.942, top1 = 28.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1873/15625) 001873-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.458, top1 = 89.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.327, top1 = 91.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 0.323, top1 = 91.27%], valid : [loss = 1.320, top1 = 66.87%], test : [loss = 1.344, top1 = 66.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.41%], valid : [loss = 2.358, top1 = 39.92%], test : [loss = 2.390, top1 = 39.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1874/15625) 001874-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.47%], valid : [loss = 0.724, top1 = 80.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10        train : [loss = 0.181, top1 = 93.79%], test  : [loss = 0.504, top1 = 84.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.52 ms.
cifar100       train : [loss = 0.889, top1 = 74.00%], valid : [loss = 1.653, top1 = 57.36%], test : [loss = 1.662, top1 = 56.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 3.487, top1 = 17.05%], valid : [loss = 3.493, top1 = 17.02%], test : [loss = 3.493, top1 = 17.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 53.76%], valid : [loss = 1.278, top1 = 53.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1875/15625) 001875-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.560, top1 = 87.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.390, top1 = 91.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.84 ms.
cifar100       train : [loss = 0.355, top1 = 90.01%], valid : [loss = 1.414, top1 = 65.07%], test : [loss = 1.430, top1 = 65.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.37%], valid : [loss = 2.465, top1 = 38.09%], test : [loss = 2.499, top1 = 37.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.10%], valid : [loss = 0.865, top1 = 69.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1876/15625) 001876-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.08%], valid : [loss = 0.574, top1 = 86.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10        train : [loss = 0.061, top1 = 98.01%], test  : [loss = 0.383, top1 = 89.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.94 ms.
cifar100       train : [loss = 0.674, top1 = 80.16%], valid : [loss = 1.347, top1 = 64.21%], test : [loss = 1.321, top1 = 64.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.76%], valid : [loss = 2.484, top1 = 36.77%], test : [loss = 2.496, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1877/15625) 001877-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.71 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.545, top1 = 89.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.367, top1 = 92.57%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.04 ms.
cifar100       train : [loss = 0.063, top1 = 99.05%], valid : [loss = 1.502, top1 = 68.16%], test : [loss = 1.512, top1 = 68.07%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.35 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 51.98%], valid : [loss = 2.400, top1 = 40.16%], test : [loss = 2.432, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.57%], valid : [loss = 0.746, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1878/15625) 001878-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.99%], valid : [loss = 0.499, top1 = 87.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10        train : [loss = 0.078, top1 = 97.61%], test  : [loss = 0.348, top1 = 89.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.31 ms.
cifar100       train : [loss = 0.712, top1 = 79.32%], valid : [loss = 1.301, top1 = 65.23%], test : [loss = 1.284, top1 = 65.13%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.444, top1 = 37.90%], valid : [loss = 2.565, top1 = 35.59%], test : [loss = 2.590, top1 = 35.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.32%], valid : [loss = 0.657, top1 = 77.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1879/15625) 001879-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.677, top1 = 84.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.055, top1 = 98.33%], test  : [loss = 0.451, top1 = 88.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.08 ms.
cifar100       train : [loss = 0.624, top1 = 81.71%], valid : [loss = 1.549, top1 = 61.03%], test : [loss = 1.507, top1 = 61.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.32%], valid : [loss = 2.831, top1 = 30.46%], test : [loss = 2.885, top1 = 30.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.11%], valid : [loss = 0.884, top1 = 68.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1880/15625) 001880-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.480, top1 = 89.12%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.313, top1 = 92.28%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.22 ms.
cifar100       train : [loss = 0.232, top1 = 94.38%], valid : [loss = 1.254, top1 = 68.23%], test : [loss = 1.256, top1 = 68.26%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.58%], valid : [loss = 2.267, top1 = 41.86%], test : [loss = 2.284, top1 = 41.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.86%], valid : [loss = 0.692, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1881/15625) 001881-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.88 ms.
cifar10-valid  train : [loss = 1.184, top1 = 57.58%], valid : [loss = 1.233, top1 = 56.22%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10        train : [loss = 1.133, top1 = 59.80%], test  : [loss = 1.139, top1 = 59.55%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.02 ms.
cifar100       train : [loss = 2.632, top1 = 33.79%], valid : [loss = 2.713, top1 = 32.07%], test : [loss = 2.693, top1 = 32.73%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.40 ms.
ImageNet16-120 train : [loss = 3.825, top1 = 13.05%], valid : [loss = 3.815, top1 = 13.98%], test : [loss = 3.838, top1 = 13.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.686, top1 = 36.92%], valid : [loss = 1.737, top1 = 33.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1882/15625) 001882-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.49%], valid : [loss = 0.458, top1 = 86.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.154, top1 = 95.00%], test  : [loss = 0.345, top1 = 88.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.975, top1 = 72.22%], valid : [loss = 1.345, top1 = 62.44%], test : [loss = 1.333, top1 = 62.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.01%], valid : [loss = 2.678, top1 = 32.91%], test : [loss = 2.702, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1883/15625) 001883-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.563, top1 = 88.14%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.353, top1 = 91.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.89 ms.
cifar100       train : [loss = 0.288, top1 = 91.98%], valid : [loss = 1.323, top1 = 67.36%], test : [loss = 1.331, top1 = 67.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.04%], valid : [loss = 2.419, top1 = 38.63%], test : [loss = 2.429, top1 = 38.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1884/15625) 001884-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.590, top1 = 87.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.414, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.26 ms.
cifar100       train : [loss = 0.162, top1 = 96.52%], valid : [loss = 1.510, top1 = 66.21%], test : [loss = 1.521, top1 = 65.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.20%], valid : [loss = 2.473, top1 = 38.26%], test : [loss = 2.499, top1 = 38.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.78%], valid : [loss = 0.749, top1 = 73.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1885/15625) 001885-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.52%], valid : [loss = 0.968, top1 = 66.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.89 ms.
cifar10        train : [loss = 0.786, top1 = 72.38%], test  : [loss = 0.870, top1 = 69.74%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.80 ms.
cifar100       train : [loss = 2.124, top1 = 44.18%], valid : [loss = 2.309, top1 = 40.57%], test : [loss = 2.326, top1 = 40.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.92 ms.
ImageNet16-120 train : [loss = 3.734, top1 = 14.34%], valid : [loss = 3.770, top1 = 14.47%], test : [loss = 3.770, top1 = 13.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1886/15625) 001886-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.497, top1 = 89.89%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 93.10%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.63 ms.
cifar100       train : [loss = 0.120, top1 = 97.62%], valid : [loss = 1.306, top1 = 69.03%], test : [loss = 1.316, top1 = 69.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.85 ms.
ImageNet16-120 train : [loss = 1.690, top1 = 54.70%], valid : [loss = 2.172, top1 = 44.10%], test : [loss = 2.188, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.72%], valid : [loss = 0.656, top1 = 77.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1887/15625) 001887-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.53%], valid : [loss = 0.641, top1 = 85.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10        train : [loss = 0.034, top1 = 99.04%], test  : [loss = 0.396, top1 = 89.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.33 ms.
cifar100       train : [loss = 0.541, top1 = 84.16%], valid : [loss = 1.428, top1 = 63.53%], test : [loss = 1.440, top1 = 63.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.60%], valid : [loss = 2.557, top1 = 35.29%], test : [loss = 2.569, top1 = 35.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.59%], valid : [loss = 0.900, top1 = 68.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1888/15625) 001888-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.525, top1 = 88.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.23 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.346, top1 = 91.91%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.31 ms.
cifar100       train : [loss = 0.292, top1 = 92.11%], valid : [loss = 1.270, top1 = 68.11%], test : [loss = 1.250, top1 = 68.16%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.72 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.13%], valid : [loss = 2.279, top1 = 41.50%], test : [loss = 2.284, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.96%], valid : [loss = 0.717, top1 = 75.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1889/15625) 001889-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.49%], valid : [loss = 0.829, top1 = 80.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.40 ms.
cifar10        train : [loss = 0.131, top1 = 95.64%], test  : [loss = 0.543, top1 = 84.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.39 ms.
cifar100       train : [loss = 0.854, top1 = 75.21%], valid : [loss = 1.661, top1 = 57.62%], test : [loss = 1.674, top1 = 57.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.47%], valid : [loss = 3.177, top1 = 24.44%], test : [loss = 3.201, top1 = 23.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.72%], valid : [loss = 1.074, top1 = 62.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1890/15625) 001890-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.05%], valid : [loss = 0.730, top1 = 75.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.586, top1 = 79.61%], test  : [loss = 0.656, top1 = 77.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.48 ms.
cifar100       train : [loss = 1.985, top1 = 46.36%], valid : [loss = 2.144, top1 = 43.45%], test : [loss = 2.125, top1 = 43.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.14 ms.
ImageNet16-120 train : [loss = 3.247, top1 = 22.04%], valid : [loss = 3.258, top1 = 22.10%], test : [loss = 3.273, top1 = 22.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.275, top1 = 54.14%], valid : [loss = 1.327, top1 = 52.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1891/15625) 001891-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=19.25 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.94%], valid : [loss = 0.461, top1 = 86.50%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=20.43 ms.
cifar10        train : [loss = 0.116, top1 = 96.42%], test  : [loss = 0.335, top1 = 89.30%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=20.12 ms.
cifar100       train : [loss = 0.729, top1 = 79.58%], valid : [loss = 1.267, top1 = 65.30%], test : [loss = 1.269, top1 = 64.88%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 2.472, top1 = 37.39%], valid : [loss = 2.571, top1 = 35.50%], test : [loss = 2.587, top1 = 34.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 69.87%], valid : [loss = 0.888, top1 = 68.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1892/15625) 001892-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.490, top1 = 89.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.24 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.312, top1 = 92.47%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.67 ms.
cifar100       train : [loss = 0.274, top1 = 92.83%], valid : [loss = 1.227, top1 = 68.97%], test : [loss = 1.247, top1 = 68.57%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 48.93%], valid : [loss = 2.239, top1 = 42.79%], test : [loss = 2.267, top1 = 42.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.30%], valid : [loss = 0.626, top1 = 78.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1893/15625) 001893-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.37%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.95 ms.
cifar10        train : [loss = 0.011, top1 = 99.84%], test  : [loss = 0.311, top1 = 92.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.87 ms.
cifar100       train : [loss = 0.242, top1 = 94.05%], valid : [loss = 1.223, top1 = 69.13%], test : [loss = 1.211, top1 = 69.37%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 48.98%], valid : [loss = 2.253, top1 = 42.13%], test : [loss = 2.264, top1 = 42.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.45%], valid : [loss = 0.650, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1894/15625) 001894-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.518, top1 = 88.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.327, top1 = 92.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.28 ms.
cifar100       train : [loss = 0.327, top1 = 91.17%], valid : [loss = 1.276, top1 = 67.20%], test : [loss = 1.287, top1 = 67.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.85%], valid : [loss = 2.404, top1 = 39.53%], test : [loss = 2.412, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1895/15625) 001895-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.331, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.334, top1 = 90.90%], valid : [loss = 1.286, top1 = 67.19%], test : [loss = 1.282, top1 = 67.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.81%], valid : [loss = 2.423, top1 = 38.58%], test : [loss = 2.428, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1896/15625) 001896-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.531, top1 = 89.82%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.38%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.57 ms.
cifar100       train : [loss = 0.061, top1 = 99.16%], valid : [loss = 1.340, top1 = 69.57%], test : [loss = 1.366, top1 = 69.59%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.40 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.20%], valid : [loss = 2.317, top1 = 41.21%], test : [loss = 2.332, top1 = 40.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.94%], valid : [loss = 0.814, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1897/15625) 001897-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.507, top1 = 89.24%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.69 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.324, top1 = 92.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.88 ms.
cifar100       train : [loss = 0.154, top1 = 96.59%], valid : [loss = 1.339, top1 = 68.47%], test : [loss = 1.345, top1 = 68.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.07%], valid : [loss = 2.287, top1 = 41.47%], test : [loss = 2.306, top1 = 42.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.63%], valid : [loss = 0.626, top1 = 78.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1898/15625) 001898-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.469, top1 = 88.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.306, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.97 ms.
cifar100       train : [loss = 0.322, top1 = 91.22%], valid : [loss = 1.295, top1 = 67.31%], test : [loss = 1.295, top1 = 67.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.47%], valid : [loss = 2.376, top1 = 39.89%], test : [loss = 2.395, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.37%], valid : [loss = 0.560, top1 = 81.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1899/15625) 001899-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.549, top1 = 88.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.351, top1 = 92.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.65 ms.
cifar100       train : [loss = 0.245, top1 = 93.47%], valid : [loss = 1.330, top1 = 67.71%], test : [loss = 1.339, top1 = 67.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.01%], valid : [loss = 2.423, top1 = 38.87%], test : [loss = 2.432, top1 = 38.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1900/15625) 001900-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.67%], valid : [loss = 0.697, top1 = 85.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.031, top1 = 99.12%], test  : [loss = 0.445, top1 = 89.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.375, top1 = 89.64%], valid : [loss = 1.595, top1 = 62.06%], test : [loss = 1.614, top1 = 61.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.74%], valid : [loss = 2.631, top1 = 34.31%], test : [loss = 2.669, top1 = 34.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.57%], valid : [loss = 0.835, top1 = 70.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1901/15625) 001901-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.562, top1 = 88.63%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.02 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.369, top1 = 92.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.87 ms.
cifar100       train : [loss = 0.170, top1 = 96.31%], valid : [loss = 1.382, top1 = 68.10%], test : [loss = 1.420, top1 = 67.33%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.28%], valid : [loss = 2.463, top1 = 38.34%], test : [loss = 2.440, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.65%], valid : [loss = 0.737, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1902/15625) 001902-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.565, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.361, top1 = 92.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.44 ms.
cifar100       train : [loss = 0.100, top1 = 98.21%], valid : [loss = 1.437, top1 = 68.18%], test : [loss = 1.433, top1 = 68.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.85%], valid : [loss = 2.423, top1 = 39.48%], test : [loss = 2.430, top1 = 40.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.85%], valid : [loss = 0.730, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1903/15625) 001903-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.60%], valid : [loss = 0.581, top1 = 86.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10        train : [loss = 0.041, top1 = 98.79%], test  : [loss = 0.384, top1 = 90.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 0.555, top1 = 83.63%], valid : [loss = 1.411, top1 = 64.09%], test : [loss = 1.413, top1 = 63.97%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.04 ms.
ImageNet16-120 train : [loss = 2.487, top1 = 36.94%], valid : [loss = 2.606, top1 = 34.37%], test : [loss = 2.653, top1 = 33.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.98%], valid : [loss = 0.716, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1904/15625) 001904-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.58%], valid : [loss = 0.452, top1 = 86.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10        train : [loss = 0.151, top1 = 95.11%], test  : [loss = 0.340, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.83 ms.
cifar100       train : [loss = 0.980, top1 = 72.02%], valid : [loss = 1.341, top1 = 62.23%], test : [loss = 1.337, top1 = 62.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.17%], valid : [loss = 2.675, top1 = 32.79%], test : [loss = 2.685, top1 = 32.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.40%], valid : [loss = 0.792, top1 = 72.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1905/15625) 001905-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.306, top1 = 89.39%], valid : [loss = 0.566, top1 = 82.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10        train : [loss = 0.294, top1 = 89.88%], test  : [loss = 0.423, top1 = 85.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 1.315, top1 = 63.04%], valid : [loss = 1.587, top1 = 56.66%], test : [loss = 1.592, top1 = 56.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 3.074, top1 = 25.72%], valid : [loss = 3.081, top1 = 25.71%], test : [loss = 3.138, top1 = 24.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.210, top1 = 56.20%], valid : [loss = 1.259, top1 = 54.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1906/15625) 001906-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.430, top1 = 91.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.280, top1 = 93.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.36 ms.
cifar100       train : [loss = 0.065, top1 = 99.06%], valid : [loss = 1.356, top1 = 70.02%], test : [loss = 1.331, top1 = 70.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.514, top1 = 59.03%], valid : [loss = 2.213, top1 = 43.70%], test : [loss = 2.243, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 88.12%], valid : [loss = 0.496, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1907/15625) 001907-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.57%], valid : [loss = 0.463, top1 = 86.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10        train : [loss = 0.152, top1 = 95.01%], test  : [loss = 0.351, top1 = 88.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.61 ms.
cifar100       train : [loss = 0.999, top1 = 71.63%], valid : [loss = 1.366, top1 = 61.67%], test : [loss = 1.373, top1 = 61.39%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.12%], valid : [loss = 2.670, top1 = 33.46%], test : [loss = 2.696, top1 = 33.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1908/15625) 001908-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.546, top1 = 88.21%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.74 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.346, top1 = 91.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.38 ms.
cifar100       train : [loss = 0.329, top1 = 90.98%], valid : [loss = 1.294, top1 = 66.94%], test : [loss = 1.277, top1 = 67.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.90 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.51%], valid : [loss = 2.429, top1 = 38.37%], test : [loss = 2.442, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.08%], valid : [loss = 0.770, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1909/15625) 001909-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.511, top1 = 88.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.329, top1 = 92.02%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.76 ms.
cifar100       train : [loss = 0.335, top1 = 90.80%], valid : [loss = 1.291, top1 = 67.07%], test : [loss = 1.272, top1 = 67.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.95%], valid : [loss = 2.411, top1 = 38.90%], test : [loss = 2.405, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1910/15625) 001910-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.482, top1 = 89.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.311, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.32 ms.
cifar100       train : [loss = 0.238, top1 = 94.16%], valid : [loss = 1.237, top1 = 69.09%], test : [loss = 1.248, top1 = 68.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.36%], valid : [loss = 2.260, top1 = 41.52%], test : [loss = 2.292, top1 = 41.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.93%], valid : [loss = 0.597, top1 = 79.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1911/15625) 001911-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.82 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.73 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.94 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.17 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.85%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1912/15625) 001912-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.468, top1 = 89.91%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 92.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 0.119, top1 = 97.48%], valid : [loss = 1.389, top1 = 68.73%], test : [loss = 1.374, top1 = 68.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.34%], valid : [loss = 2.277, top1 = 42.29%], test : [loss = 2.313, top1 = 42.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.412, top1 = 85.86%], valid : [loss = 0.529, top1 = 82.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1913/15625) 001913-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.588, top1 = 88.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.368, top1 = 92.32%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.11 ms.
cifar100       train : [loss = 0.085, top1 = 98.61%], valid : [loss = 1.506, top1 = 68.03%], test : [loss = 1.513, top1 = 67.27%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.44 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.92%], valid : [loss = 2.420, top1 = 39.74%], test : [loss = 2.433, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.11%], valid : [loss = 0.797, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1914/15625) 001914-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.16%], valid : [loss = 0.673, top1 = 84.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.052, top1 = 98.39%], test  : [loss = 0.405, top1 = 89.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.634, top1 = 81.35%], valid : [loss = 1.450, top1 = 62.73%], test : [loss = 1.431, top1 = 63.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.457, top1 = 37.53%], valid : [loss = 2.612, top1 = 34.66%], test : [loss = 2.646, top1 = 33.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.80%], valid : [loss = 0.864, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1915/15625) 001915-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.594, top1 = 87.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.418, top1 = 90.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.232, top1 = 94.26%], valid : [loss = 1.465, top1 = 65.82%], test : [loss = 1.450, top1 = 66.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.74%], valid : [loss = 2.529, top1 = 36.28%], test : [loss = 2.526, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.48%], valid : [loss = 0.754, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1916/15625) 001916-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.483, top1 = 89.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.308, top1 = 92.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 0.315, top1 = 91.61%], valid : [loss = 1.248, top1 = 67.87%], test : [loss = 1.246, top1 = 68.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.79%], valid : [loss = 2.314, top1 = 40.80%], test : [loss = 2.329, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.21%], valid : [loss = 0.620, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1917/15625) 001917-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.17%], valid : [loss = 0.562, top1 = 86.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10        train : [loss = 0.061, top1 = 98.07%], test  : [loss = 0.372, top1 = 89.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.66 ms.
cifar100       train : [loss = 0.642, top1 = 81.15%], valid : [loss = 1.311, top1 = 64.25%], test : [loss = 1.301, top1 = 64.67%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.13%], valid : [loss = 2.517, top1 = 36.34%], test : [loss = 2.524, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1918/15625) 001918-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.46%], valid : [loss = 0.463, top1 = 86.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.154, top1 = 94.97%], test  : [loss = 0.338, top1 = 88.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.76 ms.
cifar100       train : [loss = 0.967, top1 = 72.35%], valid : [loss = 1.333, top1 = 62.85%], test : [loss = 1.329, top1 = 62.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.83%], valid : [loss = 2.684, top1 = 32.80%], test : [loss = 2.733, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.75%], valid : [loss = 0.791, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1919/15625) 001919-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.45%], valid : [loss = 0.719, top1 = 75.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10        train : [loss = 0.383, top1 = 86.77%], test  : [loss = 0.517, top1 = 82.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 1.717, top1 = 52.89%], valid : [loss = 1.931, top1 = 49.09%], test : [loss = 1.935, top1 = 48.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 3.339, top1 = 20.66%], valid : [loss = 3.337, top1 = 21.16%], test : [loss = 3.387, top1 = 20.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.240, top1 = 55.04%], valid : [loss = 1.281, top1 = 53.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1920/15625) 001920-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.490, top1 = 88.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.70 ms.
cifar100       train : [loss = 0.312, top1 = 91.63%], valid : [loss = 1.277, top1 = 67.51%], test : [loss = 1.254, top1 = 68.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.75%], valid : [loss = 2.318, top1 = 40.34%], test : [loss = 2.332, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1921/15625) 001921-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.12%], valid : [loss = 0.470, top1 = 84.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.296, top1 = 90.02%], test  : [loss = 0.393, top1 = 86.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 1.318, top1 = 63.52%], valid : [loss = 1.525, top1 = 58.31%], test : [loss = 1.499, top1 = 58.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.68%], valid : [loss = 2.893, top1 = 29.40%], test : [loss = 2.951, top1 = 28.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1922/15625) 001922-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.19%], valid : [loss = 1.140, top1 = 62.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10        train : [loss = 0.776, top1 = 72.76%], test  : [loss = 0.920, top1 = 68.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.30 ms.
cifar100       train : [loss = 2.120, top1 = 44.33%], valid : [loss = 2.391, top1 = 39.84%], test : [loss = 2.396, top1 = 39.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 3.752, top1 = 14.07%], valid : [loss = 3.812, top1 = 14.09%], test : [loss = 3.832, top1 = 13.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.359, top1 = 50.36%], valid : [loss = 1.423, top1 = 48.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1923/15625) 001923-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.58%], valid : [loss = 0.455, top1 = 86.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10        train : [loss = 0.150, top1 = 95.12%], test  : [loss = 0.338, top1 = 89.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.41 ms.
cifar100       train : [loss = 0.971, top1 = 72.40%], valid : [loss = 1.333, top1 = 62.96%], test : [loss = 1.336, top1 = 62.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.19%], valid : [loss = 2.683, top1 = 33.46%], test : [loss = 2.690, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1924/15625) 001924-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.066, top1 = 97.97%], valid : [loss = 0.607, top1 = 84.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10        train : [loss = 0.086, top1 = 97.23%], test  : [loss = 0.425, top1 = 88.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.74 ms.
cifar100       train : [loss = 0.667, top1 = 80.29%], valid : [loss = 1.512, top1 = 60.79%], test : [loss = 1.526, top1 = 60.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 3.175, top1 = 22.53%], valid : [loss = 3.186, top1 = 22.18%], test : [loss = 3.223, top1 = 21.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.061, top1 = 61.75%], valid : [loss = 1.088, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1925/15625) 001925-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.577, top1 = 87.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.385, top1 = 90.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.21 ms.
cifar100       train : [loss = 0.418, top1 = 88.10%], valid : [loss = 1.401, top1 = 65.15%], test : [loss = 1.392, top1 = 65.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.71%], valid : [loss = 2.498, top1 = 36.94%], test : [loss = 2.530, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.02%], valid : [loss = 0.825, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1926/15625) 001926-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.09 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.523, top1 = 89.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.333, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.80 ms.
cifar100       train : [loss = 0.126, top1 = 97.41%], valid : [loss = 1.308, top1 = 69.03%], test : [loss = 1.295, top1 = 69.83%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.35%], valid : [loss = 2.297, top1 = 41.57%], test : [loss = 2.289, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 77.03%], valid : [loss = 0.713, top1 = 75.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1927/15625) 001927-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.50%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.330, top1 = 93.21%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.89 ms.
cifar100       train : [loss = 0.072, top1 = 98.70%], valid : [loss = 1.395, top1 = 69.46%], test : [loss = 1.420, top1 = 69.03%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.54%], valid : [loss = 2.320, top1 = 40.67%], test : [loss = 2.300, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.77%], valid : [loss = 0.946, top1 = 66.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1928/15625) 001928-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.152, top1 = 94.89%], valid : [loss = 0.859, top1 = 77.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10        train : [loss = 0.229, top1 = 92.14%], test  : [loss = 0.581, top1 = 82.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 1.172, top1 = 66.71%], valid : [loss = 1.816, top1 = 53.18%], test : [loss = 1.801, top1 = 54.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.81%], valid : [loss = 3.320, top1 = 21.64%], test : [loss = 3.356, top1 = 21.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1929/15625) 001929-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.26%], valid : [loss = 0.936, top1 = 75.87%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.46 ms.
cifar10        train : [loss = 0.228, top1 = 92.14%], test  : [loss = 0.594, top1 = 82.26%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.40 ms.
cifar100       train : [loss = 1.164, top1 = 67.01%], valid : [loss = 1.802, top1 = 53.49%], test : [loss = 1.781, top1 = 53.83%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 3.220, top1 = 22.82%], valid : [loss = 3.326, top1 = 21.77%], test : [loss = 3.362, top1 = 20.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.94%], valid : [loss = 1.083, top1 = 61.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1930/15625) 001930-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.88 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.18%], valid : [loss = 0.676, top1 = 77.01%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10        train : [loss = 0.589, top1 = 79.50%], test  : [loss = 0.642, top1 = 78.03%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.22 ms.
cifar100       train : [loss = 1.724, top1 = 53.05%], valid : [loss = 1.866, top1 = 50.63%], test : [loss = 1.893, top1 = 49.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.68 ms.
ImageNet16-120 train : [loss = 3.384, top1 = 20.18%], valid : [loss = 3.367, top1 = 20.84%], test : [loss = 3.404, top1 = 19.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1931/15625) 001931-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.42%], valid : [loss = 0.457, top1 = 86.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10        train : [loss = 0.154, top1 = 94.99%], test  : [loss = 0.352, top1 = 88.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.22 ms.
cifar100       train : [loss = 0.997, top1 = 71.68%], valid : [loss = 1.356, top1 = 62.00%], test : [loss = 1.363, top1 = 61.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.10%], valid : [loss = 2.671, top1 = 33.16%], test : [loss = 2.693, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1932/15625) 001932-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.528, top1 = 89.35%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.40 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.347, top1 = 92.89%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.49 ms.
cifar100       train : [loss = 0.068, top1 = 99.03%], valid : [loss = 1.472, top1 = 68.48%], test : [loss = 1.445, top1 = 68.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.749, top1 = 53.44%], valid : [loss = 2.351, top1 = 41.42%], test : [loss = 2.393, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.71%], valid : [loss = 0.703, top1 = 75.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1933/15625) 001933-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.484, top1 = 89.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.321, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.39 ms.
cifar100       train : [loss = 0.309, top1 = 91.72%], valid : [loss = 1.282, top1 = 67.35%], test : [loss = 1.255, top1 = 67.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.70%], valid : [loss = 2.321, top1 = 40.01%], test : [loss = 2.327, top1 = 41.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1934/15625) 001934-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.537, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.15 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.335, top1 = 92.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.74 ms.
cifar100       train : [loss = 0.133, top1 = 97.31%], valid : [loss = 1.337, top1 = 68.66%], test : [loss = 1.335, top1 = 68.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.60%], valid : [loss = 2.363, top1 = 39.72%], test : [loss = 2.343, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.86%], valid : [loss = 0.755, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1935/15625) 001935-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.593, top1 = 87.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 0.020, top1 = 99.50%], test  : [loss = 0.378, top1 = 90.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.14 ms.
cifar100       train : [loss = 0.425, top1 = 87.74%], valid : [loss = 1.399, top1 = 65.05%], test : [loss = 1.399, top1 = 64.73%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.34%], valid : [loss = 2.525, top1 = 35.98%], test : [loss = 2.544, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.76%], valid : [loss = 0.847, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1936/15625) 001936-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.485, top1 = 89.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.65 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.309, top1 = 92.33%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.76 ms.
cifar100       train : [loss = 0.315, top1 = 91.51%], valid : [loss = 1.250, top1 = 68.05%], test : [loss = 1.250, top1 = 67.83%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.46 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.80%], valid : [loss = 2.309, top1 = 41.14%], test : [loss = 2.338, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.80%], valid : [loss = 0.584, top1 = 80.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1937/15625) 001937-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.24%], valid : [loss = 0.595, top1 = 85.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.106, top1 = 96.47%], test  : [loss = 0.385, top1 = 88.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.83 ms.
cifar100       train : [loss = 0.820, top1 = 75.90%], valid : [loss = 1.408, top1 = 62.33%], test : [loss = 1.391, top1 = 62.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.11%], valid : [loss = 2.766, top1 = 31.01%], test : [loss = 2.809, top1 = 31.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1938/15625) 001938-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.503, top1 = 89.61%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.94 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.307, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.77 ms.
cifar100       train : [loss = 0.125, top1 = 97.56%], valid : [loss = 1.292, top1 = 69.03%], test : [loss = 1.307, top1 = 69.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.47%], valid : [loss = 2.276, top1 = 42.69%], test : [loss = 2.281, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.53%], valid : [loss = 0.689, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1939/15625) 001939-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.427, top1 = 90.39%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.62 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.284, top1 = 93.27%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.08 ms.
cifar100       train : [loss = 0.136, top1 = 97.16%], valid : [loss = 1.248, top1 = 70.43%], test : [loss = 1.217, top1 = 70.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.656, top1 = 55.67%], valid : [loss = 2.170, top1 = 44.68%], test : [loss = 2.182, top1 = 45.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.41%], valid : [loss = 0.529, top1 = 82.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1940/15625) 001940-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.98%], valid : [loss = 0.912, top1 = 76.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10        train : [loss = 0.211, top1 = 92.77%], test  : [loss = 0.587, top1 = 82.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.68 ms.
cifar100       train : [loss = 1.117, top1 = 68.13%], valid : [loss = 1.760, top1 = 54.26%], test : [loss = 1.747, top1 = 55.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 3.183, top1 = 23.46%], valid : [loss = 3.284, top1 = 22.11%], test : [loss = 3.329, top1 = 21.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.055, top1 = 62.29%], valid : [loss = 1.111, top1 = 60.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1941/15625) 001941-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.443, top1 = 90.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.72 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.283, top1 = 93.53%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.75 ms.
cifar100       train : [loss = 0.091, top1 = 98.30%], valid : [loss = 1.331, top1 = 70.17%], test : [loss = 1.314, top1 = 70.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 1.609, top1 = 56.57%], valid : [loss = 2.176, top1 = 44.88%], test : [loss = 2.215, top1 = 44.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.66%], valid : [loss = 0.515, top1 = 82.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1942/15625) 001942-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.01%], valid : [loss = 0.651, top1 = 78.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.503, top1 = 82.57%], test  : [loss = 0.580, top1 = 80.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.15 ms.
cifar100       train : [loss = 1.706, top1 = 53.72%], valid : [loss = 1.864, top1 = 50.37%], test : [loss = 1.886, top1 = 49.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 3.341, top1 = 21.07%], valid : [loss = 3.314, top1 = 21.04%], test : [loss = 3.365, top1 = 20.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.261, top1 = 54.63%], valid : [loss = 1.284, top1 = 54.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1943/15625) 001943-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.432, top1 = 90.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.291, top1 = 93.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.175, top1 = 95.91%], valid : [loss = 1.258, top1 = 69.97%], test : [loss = 1.270, top1 = 69.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 52.01%], valid : [loss = 2.250, top1 = 42.88%], test : [loss = 2.268, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1944/15625) 001944-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.289, top1 = 90.10%], valid : [loss = 0.530, top1 = 82.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10        train : [loss = 0.259, top1 = 91.28%], test  : [loss = 0.429, top1 = 86.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.37 ms.
cifar100       train : [loss = 1.449, top1 = 59.54%], valid : [loss = 1.697, top1 = 54.15%], test : [loss = 1.686, top1 = 54.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 2.952, top1 = 27.79%], valid : [loss = 2.940, top1 = 28.32%], test : [loss = 3.021, top1 = 26.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.65%], valid : [loss = 1.062, top1 = 62.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1945/15625) 001945-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.303, top1 = 92.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.66 ms.
cifar100       train : [loss = 0.320, top1 = 91.42%], valid : [loss = 1.235, top1 = 68.23%], test : [loss = 1.246, top1 = 68.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.75%], valid : [loss = 2.326, top1 = 40.58%], test : [loss = 2.327, top1 = 41.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.39%], valid : [loss = 0.587, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1946/15625) 001946-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.12%], valid : [loss = 0.844, top1 = 71.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.561, top1 = 80.38%], test  : [loss = 0.724, top1 = 75.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 1.781, top1 = 52.04%], valid : [loss = 2.045, top1 = 47.29%], test : [loss = 2.053, top1 = 46.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.90%], valid : [loss = 3.639, top1 = 16.70%], test : [loss = 3.676, top1 = 15.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1947/15625) 001947-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.41%], valid : [loss = 0.550, top1 = 86.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.54 ms.
cifar10        train : [loss = 0.047, top1 = 98.75%], test  : [loss = 0.351, top1 = 90.36%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.12 ms.
cifar100       train : [loss = 0.483, top1 = 86.27%], valid : [loss = 1.288, top1 = 66.42%], test : [loss = 1.291, top1 = 66.57%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.265, top1 = 41.53%], valid : [loss = 2.457, top1 = 37.86%], test : [loss = 2.467, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 71.60%], valid : [loss = 0.846, top1 = 70.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1948/15625) 001948-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.50%], valid : [loss = 0.615, top1 = 86.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.035, top1 = 98.98%], test  : [loss = 0.400, top1 = 90.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 0.537, top1 = 84.38%], valid : [loss = 1.401, top1 = 63.71%], test : [loss = 1.416, top1 = 63.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.18%], valid : [loss = 2.558, top1 = 35.86%], test : [loss = 2.583, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.09%], valid : [loss = 0.904, top1 = 68.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1949/15625) 001949-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.70%], valid : [loss = 0.696, top1 = 83.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.091, top1 = 97.10%], test  : [loss = 0.488, top1 = 86.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 0.806, top1 = 76.44%], valid : [loss = 1.536, top1 = 60.27%], test : [loss = 1.506, top1 = 60.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.14%], valid : [loss = 2.958, top1 = 28.51%], test : [loss = 2.998, top1 = 27.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.46%], valid : [loss = 0.882, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1950/15625) 001950-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.572, top1 = 88.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.015, top1 = 99.60%], test  : [loss = 0.359, top1 = 91.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.91 ms.
cifar100       train : [loss = 0.294, top1 = 91.71%], valid : [loss = 1.355, top1 = 66.87%], test : [loss = 1.356, top1 = 67.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.187, top1 = 43.27%], valid : [loss = 2.448, top1 = 38.12%], test : [loss = 2.436, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.60%], valid : [loss = 0.922, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1951/15625) 001951-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.511, top1 = 89.62%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.69 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.343, top1 = 92.73%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.83 ms.
cifar100       train : [loss = 0.068, top1 = 98.74%], valid : [loss = 1.434, top1 = 69.13%], test : [loss = 1.413, top1 = 69.81%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.19%], valid : [loss = 2.332, top1 = 40.97%], test : [loss = 2.332, top1 = 41.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.41%], valid : [loss = 0.785, top1 = 72.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1952/15625) 001952-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.497, top1 = 88.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.13 ms.
cifar100       train : [loss = 0.313, top1 = 91.64%], valid : [loss = 1.237, top1 = 68.29%], test : [loss = 1.247, top1 = 68.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.71%], valid : [loss = 2.322, top1 = 40.57%], test : [loss = 2.319, top1 = 40.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1953/15625) 001953-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.13%], valid : [loss = 0.851, top1 = 71.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.60 ms.
cifar10        train : [loss = 0.564, top1 = 80.44%], test  : [loss = 0.722, top1 = 75.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 1.794, top1 = 51.74%], valid : [loss = 2.055, top1 = 46.99%], test : [loss = 2.071, top1 = 46.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.82%], valid : [loss = 3.633, top1 = 16.59%], test : [loss = 3.669, top1 = 15.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1954/15625) 001954-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.642, top1 = 85.79%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.52 ms.
cifar10        train : [loss = 0.038, top1 = 98.94%], test  : [loss = 0.421, top1 = 89.37%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.12 ms.
cifar100       train : [loss = 0.412, top1 = 88.51%], valid : [loss = 1.490, top1 = 62.87%], test : [loss = 1.500, top1 = 62.85%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.57%], valid : [loss = 2.644, top1 = 33.98%], test : [loss = 2.664, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.14%], valid : [loss = 0.810, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1955/15625) 001955-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.575, top1 = 88.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10        train : [loss = 0.014, top1 = 99.61%], test  : [loss = 0.373, top1 = 91.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.98 ms.
cifar100       train : [loss = 0.236, top1 = 93.73%], valid : [loss = 1.364, top1 = 67.11%], test : [loss = 1.380, top1 = 67.21%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 2.093, top1 = 45.39%], valid : [loss = 2.403, top1 = 39.20%], test : [loss = 2.412, top1 = 39.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.90%], valid : [loss = 0.927, top1 = 67.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1956/15625) 001956-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.610, top1 = 86.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.407, top1 = 90.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.96 ms.
cifar100       train : [loss = 0.512, top1 = 85.03%], valid : [loss = 1.433, top1 = 63.31%], test : [loss = 1.433, top1 = 63.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.89%], valid : [loss = 2.569, top1 = 35.16%], test : [loss = 2.590, top1 = 35.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1957/15625) 001957-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.38%], valid : [loss = 0.633, top1 = 85.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.095, top1 = 96.82%], test  : [loss = 0.406, top1 = 88.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.38 ms.
cifar100       train : [loss = 0.749, top1 = 77.90%], valid : [loss = 1.428, top1 = 62.24%], test : [loss = 1.413, top1 = 62.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 35.90%], valid : [loss = 2.646, top1 = 33.81%], test : [loss = 2.678, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.80%], valid : [loss = 0.906, top1 = 67.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1958/15625) 001958-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.547, top1 = 88.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.46 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.364, top1 = 91.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.77 ms.
cifar100       train : [loss = 0.296, top1 = 92.14%], valid : [loss = 1.378, top1 = 66.11%], test : [loss = 1.384, top1 = 66.17%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.83%], valid : [loss = 2.424, top1 = 38.36%], test : [loss = 2.423, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.76%], valid : [loss = 0.922, top1 = 66.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1959/15625) 001959-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.15%], valid : [loss = 0.453, top1 = 87.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10        train : [loss = 0.113, top1 = 96.50%], test  : [loss = 0.324, top1 = 89.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.62 ms.
cifar100       train : [loss = 0.861, top1 = 75.51%], valid : [loss = 1.286, top1 = 64.48%], test : [loss = 1.282, top1 = 64.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.75%], valid : [loss = 2.625, top1 = 34.30%], test : [loss = 2.661, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.676, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1960/15625) 001960-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.62%], valid : [loss = 0.558, top1 = 87.70%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.75 ms.
cifar10        train : [loss = 0.021, top1 = 99.38%], test  : [loss = 0.360, top1 = 91.59%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.97 ms.
cifar100       train : [loss = 0.262, top1 = 92.59%], valid : [loss = 1.335, top1 = 67.71%], test : [loss = 1.352, top1 = 67.63%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 33.56%], valid : [loss = 2.704, top1 = 31.17%], test : [loss = 2.720, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.22%], valid : [loss = 1.001, top1 = 64.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1961/15625) 001961-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.505, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.356, top1 = 92.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.57 ms.
cifar100       train : [loss = 0.060, top1 = 99.21%], valid : [loss = 1.435, top1 = 68.66%], test : [loss = 1.443, top1 = 68.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 1.713, top1 = 54.29%], valid : [loss = 2.339, top1 = 41.24%], test : [loss = 2.342, top1 = 41.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.55%], valid : [loss = 0.621, top1 = 78.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1962/15625) 001962-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.91%], valid : [loss = 0.483, top1 = 84.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10        train : [loss = 0.300, top1 = 90.00%], test  : [loss = 0.400, top1 = 86.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.56 ms.
cifar100       train : [loss = 1.330, top1 = 63.07%], valid : [loss = 1.527, top1 = 57.85%], test : [loss = 1.509, top1 = 58.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.78%], valid : [loss = 2.893, top1 = 29.74%], test : [loss = 2.972, top1 = 27.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1963/15625) 001963-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 90.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.285, top1 = 93.64%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.40 ms.
cifar100       train : [loss = 0.047, top1 = 99.43%], valid : [loss = 1.345, top1 = 71.13%], test : [loss = 1.332, top1 = 70.97%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 1.469, top1 = 60.12%], valid : [loss = 2.237, top1 = 44.74%], test : [loss = 2.258, top1 = 44.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.14%], valid : [loss = 0.503, top1 = 83.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1964/15625) 001964-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.473, top1 = 89.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.22 ms.
cifar100       train : [loss = 0.321, top1 = 91.37%], valid : [loss = 1.260, top1 = 67.19%], test : [loss = 1.253, top1 = 67.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.66%], valid : [loss = 2.314, top1 = 40.86%], test : [loss = 2.341, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.93%], valid : [loss = 0.600, top1 = 79.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1965/15625) 001965-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.427, top1 = 90.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.056, top1 = 99.31%], valid : [loss = 1.323, top1 = 70.65%], test : [loss = 1.313, top1 = 70.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.488, top1 = 59.68%], valid : [loss = 2.242, top1 = 43.87%], test : [loss = 2.246, top1 = 44.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.59%], valid : [loss = 0.494, top1 = 83.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1966/15625) 001966-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.450, top1 = 89.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.323, top1 = 91.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.82 ms.
cifar100       train : [loss = 0.328, top1 = 91.09%], valid : [loss = 1.298, top1 = 67.45%], test : [loss = 1.304, top1 = 67.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.22%], valid : [loss = 2.351, top1 = 39.84%], test : [loss = 2.413, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.63%], valid : [loss = 0.557, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1967/15625) 001967-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.589, top1 = 86.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.398, top1 = 90.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.499, top1 = 85.35%], valid : [loss = 1.419, top1 = 64.38%], test : [loss = 1.383, top1 = 64.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 39.07%], valid : [loss = 2.556, top1 = 36.16%], test : [loss = 2.586, top1 = 35.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.66%], valid : [loss = 0.833, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1968/15625) 001968-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.446, top1 = 90.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.291, top1 = 92.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.160, top1 = 96.44%], valid : [loss = 1.339, top1 = 68.69%], test : [loss = 1.293, top1 = 69.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 1.773, top1 = 52.73%], valid : [loss = 2.266, top1 = 42.54%], test : [loss = 2.288, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.443, top1 = 84.44%], valid : [loss = 0.561, top1 = 80.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1969/15625) 001969-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.550, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.343, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.227, top1 = 94.20%], valid : [loss = 1.285, top1 = 68.48%], test : [loss = 1.293, top1 = 68.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 41.72%], valid : [loss = 2.484, top1 = 36.57%], test : [loss = 2.487, top1 = 37.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.63%], valid : [loss = 0.861, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1970/15625) 001970-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.503, top1 = 89.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.312, top1 = 92.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.96 ms.
cifar100       train : [loss = 0.125, top1 = 97.54%], valid : [loss = 1.292, top1 = 69.41%], test : [loss = 1.294, top1 = 69.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 1.811, top1 = 51.93%], valid : [loss = 2.253, top1 = 42.28%], test : [loss = 2.282, top1 = 42.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1971/15625) 001971-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.687, top1 = 76.04%], valid : [loss = 0.855, top1 = 70.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10        train : [loss = 0.671, top1 = 76.49%], test  : [loss = 0.768, top1 = 73.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.53 ms.
cifar100       train : [loss = 1.960, top1 = 47.93%], valid : [loss = 2.143, top1 = 44.44%], test : [loss = 2.150, top1 = 44.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 3.654, top1 = 15.71%], valid : [loss = 3.671, top1 = 15.80%], test : [loss = 3.700, top1 = 14.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.385, top1 = 49.74%], valid : [loss = 1.400, top1 = 49.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1972/15625) 001972-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.47%], valid : [loss = 0.609, top1 = 85.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.078, top1 = 97.48%], test  : [loss = 0.414, top1 = 88.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.664, top1 = 80.61%], valid : [loss = 1.520, top1 = 60.95%], test : [loss = 1.507, top1 = 61.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 3.033, top1 = 25.44%], valid : [loss = 3.073, top1 = 24.92%], test : [loss = 3.089, top1 = 24.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 63.94%], valid : [loss = 1.027, top1 = 63.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1973/15625) 001973-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.528, top1 = 88.40%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.342, top1 = 91.66%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.60 ms.
cifar100       train : [loss = 0.342, top1 = 90.64%], valid : [loss = 1.285, top1 = 66.97%], test : [loss = 1.280, top1 = 67.45%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.62%], valid : [loss = 2.412, top1 = 38.63%], test : [loss = 2.422, top1 = 38.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1974/15625) 001974-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.37%], valid : [loss = 0.705, top1 = 84.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10        train : [loss = 0.054, top1 = 98.35%], test  : [loss = 0.447, top1 = 88.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.72 ms.
cifar100       train : [loss = 0.632, top1 = 81.39%], valid : [loss = 1.539, top1 = 60.97%], test : [loss = 1.499, top1 = 61.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.41%], valid : [loss = 2.829, top1 = 30.58%], test : [loss = 2.893, top1 = 29.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1975/15625) 001975-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.461, top1 = 89.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.314, top1 = 92.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.15 ms.
cifar100       train : [loss = 0.163, top1 = 96.32%], valid : [loss = 1.330, top1 = 69.01%], test : [loss = 1.344, top1 = 68.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.88%], valid : [loss = 2.289, top1 = 42.09%], test : [loss = 2.304, top1 = 42.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 84.73%], valid : [loss = 0.552, top1 = 81.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1976/15625) 001976-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.476, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.49 ms.
cifar100       train : [loss = 0.323, top1 = 91.25%], valid : [loss = 1.263, top1 = 67.75%], test : [loss = 1.248, top1 = 67.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.68%], valid : [loss = 2.323, top1 = 40.20%], test : [loss = 2.354, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.88%], valid : [loss = 0.559, top1 = 81.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1977/15625) 001977-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.16 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.92%], valid : [loss = 0.475, top1 = 84.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.23 ms.
cifar10        train : [loss = 0.301, top1 = 89.97%], test  : [loss = 0.399, top1 = 86.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.58 ms.
cifar100       train : [loss = 1.329, top1 = 63.10%], valid : [loss = 1.532, top1 = 57.42%], test : [loss = 1.505, top1 = 58.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.14 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.75%], valid : [loss = 2.914, top1 = 29.39%], test : [loss = 2.958, top1 = 28.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1978/15625) 001978-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.291, top1 = 90.04%], valid : [loss = 0.654, top1 = 79.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.280, top1 = 90.45%], test  : [loss = 0.471, top1 = 84.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.69 ms.
cifar100       train : [loss = 1.379, top1 = 61.28%], valid : [loss = 1.715, top1 = 53.95%], test : [loss = 1.721, top1 = 54.01%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 3.002, top1 = 26.91%], valid : [loss = 3.036, top1 = 26.88%], test : [loss = 3.047, top1 = 26.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.062, top1 = 62.15%], valid : [loss = 1.114, top1 = 60.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1979/15625) 001979-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.463, top1 = 89.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.331, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.263, top1 = 93.13%], valid : [loss = 1.299, top1 = 67.89%], test : [loss = 1.288, top1 = 68.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.39%], valid : [loss = 2.324, top1 = 41.21%], test : [loss = 2.348, top1 = 40.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.33%], valid : [loss = 0.565, top1 = 80.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1980/15625) 001980-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.493, top1 = 82.85%], valid : [loss = 0.654, top1 = 77.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.519, top1 = 82.03%], test  : [loss = 0.595, top1 = 79.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.49 ms.
cifar100       train : [loss = 1.706, top1 = 53.67%], valid : [loss = 1.869, top1 = 50.33%], test : [loss = 1.876, top1 = 50.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.23%], valid : [loss = 3.321, top1 = 21.40%], test : [loss = 3.354, top1 = 21.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1981/15625) 001981-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.317, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.319, top1 = 91.50%], valid : [loss = 1.264, top1 = 67.37%], test : [loss = 1.263, top1 = 68.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.59%], valid : [loss = 2.307, top1 = 40.96%], test : [loss = 2.332, top1 = 40.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.66%], valid : [loss = 0.571, top1 = 80.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1982/15625) 001982-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.55%], valid : [loss = 0.447, top1 = 87.79%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.30 ms.
cifar10        train : [loss = 0.056, top1 = 98.70%], test  : [loss = 0.317, top1 = 90.55%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.85 ms.
cifar100       train : [loss = 0.583, top1 = 84.04%], valid : [loss = 1.224, top1 = 66.67%], test : [loss = 1.210, top1 = 66.63%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.12%], valid : [loss = 2.463, top1 = 38.01%], test : [loss = 2.489, top1 = 37.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.47%], valid : [loss = 0.632, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1983/15625) 001983-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.525, top1 = 88.77%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.65 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.324, top1 = 92.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.93 ms.
cifar100       train : [loss = 0.191, top1 = 95.54%], valid : [loss = 1.305, top1 = 68.52%], test : [loss = 1.285, top1 = 68.63%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.98 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.31%], valid : [loss = 2.274, top1 = 41.47%], test : [loss = 2.271, top1 = 41.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.87%], valid : [loss = 0.732, top1 = 74.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1984/15625) 001984-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.477, top1 = 89.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.34 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.328, top1 = 91.91%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.95 ms.
cifar100       train : [loss = 0.286, top1 = 92.53%], valid : [loss = 1.225, top1 = 68.75%], test : [loss = 1.215, top1 = 68.62%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.70%], valid : [loss = 2.224, top1 = 42.69%], test : [loss = 2.239, top1 = 42.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.29%], valid : [loss = 0.666, top1 = 77.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1985/15625) 001985-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.609, top1 = 86.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.026, top1 = 99.31%], test  : [loss = 0.389, top1 = 90.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.02 ms.
cifar100       train : [loss = 0.511, top1 = 85.09%], valid : [loss = 1.413, top1 = 63.99%], test : [loss = 1.409, top1 = 64.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.95%], valid : [loss = 2.534, top1 = 36.69%], test : [loss = 2.558, top1 = 36.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.77%], valid : [loss = 0.825, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1986/15625) 001986-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.478, top1 = 89.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.342, top1 = 91.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.299, top1 = 91.88%], valid : [loss = 1.331, top1 = 67.11%], test : [loss = 1.316, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 46.98%], valid : [loss = 2.351, top1 = 40.06%], test : [loss = 2.356, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.29%], valid : [loss = 0.548, top1 = 81.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1987/15625) 001987-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.65 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.69%], valid : [loss = 0.645, top1 = 84.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10        train : [loss = 0.084, top1 = 97.30%], test  : [loss = 0.402, top1 = 88.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 0.806, top1 = 76.42%], valid : [loss = 1.436, top1 = 61.87%], test : [loss = 1.444, top1 = 61.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.16%], valid : [loss = 2.740, top1 = 32.00%], test : [loss = 2.768, top1 = 31.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1988/15625) 001988-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.68%], valid : [loss = 0.581, top1 = 81.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.61 ms.
cifar10        train : [loss = 0.322, top1 = 88.93%], test  : [loss = 0.459, top1 = 84.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 1.546, top1 = 56.92%], valid : [loss = 1.794, top1 = 51.42%], test : [loss = 1.762, top1 = 52.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.120, top1 = 24.47%], valid : [loss = 3.121, top1 = 24.42%], test : [loss = 3.179, top1 = 23.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.044, top1 = 62.43%], valid : [loss = 1.091, top1 = 61.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1989/15625) 001989-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.606, top1 = 85.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.071, top1 = 97.85%], test  : [loss = 0.388, top1 = 89.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 0.723, top1 = 79.01%], valid : [loss = 1.396, top1 = 63.19%], test : [loss = 1.366, top1 = 63.77%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.94%], valid : [loss = 2.649, top1 = 33.63%], test : [loss = 2.695, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1990/15625) 001990-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.648, top1 = 76.96%], valid : [loss = 0.752, top1 = 73.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10        train : [loss = 0.577, top1 = 79.86%], test  : [loss = 0.636, top1 = 78.18%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 1.986, top1 = 46.36%], valid : [loss = 2.151, top1 = 43.05%], test : [loss = 2.148, top1 = 43.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.29%], valid : [loss = 3.238, top1 = 22.70%], test : [loss = 3.258, top1 = 22.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.293, top1 = 53.28%], valid : [loss = 1.334, top1 = 52.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1991/15625) 001991-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.533, top1 = 88.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.351, top1 = 91.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.328, top1 = 91.12%], valid : [loss = 1.288, top1 = 67.34%], test : [loss = 1.311, top1 = 66.75%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 43.84%], valid : [loss = 2.415, top1 = 39.34%], test : [loss = 2.430, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 71.94%], valid : [loss = 0.840, top1 = 70.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1992/15625) 001992-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.310, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 0.321, top1 = 91.33%], valid : [loss = 1.326, top1 = 67.08%], test : [loss = 1.314, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.30%], valid : [loss = 2.361, top1 = 39.93%], test : [loss = 2.392, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.68%], valid : [loss = 0.563, top1 = 80.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1993/15625) 001993-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.55%], valid : [loss = 0.462, top1 = 86.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10        train : [loss = 0.152, top1 = 95.10%], test  : [loss = 0.338, top1 = 89.14%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.43 ms.
cifar100       train : [loss = 0.964, top1 = 72.52%], valid : [loss = 1.344, top1 = 62.47%], test : [loss = 1.337, top1 = 62.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.18%], valid : [loss = 2.673, top1 = 33.60%], test : [loss = 2.701, top1 = 32.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.40%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1994/15625) 001994-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.29%], valid : [loss = 0.515, top1 = 86.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.088, top1 = 97.16%], test  : [loss = 0.348, top1 = 90.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.670, top1 = 80.59%], valid : [loss = 1.222, top1 = 66.38%], test : [loss = 1.192, top1 = 66.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.78%], valid : [loss = 2.460, top1 = 37.56%], test : [loss = 2.471, top1 = 37.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.61%], valid : [loss = 0.908, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1995/15625) 001995-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.34 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.77%], valid : [loss = 0.483, top1 = 84.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.70 ms.
cifar10        train : [loss = 0.300, top1 = 89.98%], test  : [loss = 0.401, top1 = 86.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.79 ms.
cifar100       train : [loss = 1.327, top1 = 63.16%], valid : [loss = 1.530, top1 = 58.12%], test : [loss = 1.496, top1 = 58.37%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.18 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.60%], valid : [loss = 2.900, top1 = 29.62%], test : [loss = 2.966, top1 = 27.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1996/15625) 001996-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.522, top1 = 88.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.331, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.86 ms.
cifar100       train : [loss = 0.346, top1 = 90.51%], valid : [loss = 1.290, top1 = 66.80%], test : [loss = 1.264, top1 = 67.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.38%], valid : [loss = 2.424, top1 = 38.61%], test : [loss = 2.420, top1 = 39.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1997/15625) 001997-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.586, top1 = 87.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.390, top1 = 90.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 0.408, top1 = 88.34%], valid : [loss = 1.412, top1 = 65.15%], test : [loss = 1.389, top1 = 65.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.85%], valid : [loss = 2.519, top1 = 37.12%], test : [loss = 2.551, top1 = 36.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.16%], valid : [loss = 0.817, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1998/15625) 001998-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10-valid  train : [loss = 0.886, top1 = 68.54%], valid : [loss = 1.041, top1 = 64.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.39 ms.
cifar10        train : [loss = 0.785, top1 = 72.39%], test  : [loss = 0.869, top1 = 69.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.08 ms.
cifar100       train : [loss = 2.147, top1 = 43.63%], valid : [loss = 2.330, top1 = 40.53%], test : [loss = 2.347, top1 = 40.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.14 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.25%], valid : [loss = 3.765, top1 = 14.79%], test : [loss = 3.772, top1 = 13.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 1999/15625) 001999-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.77 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.86%], valid : [loss = 0.505, top1 = 84.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.172, top1 = 94.26%], test  : [loss = 0.365, top1 = 88.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.46 ms.
cifar100       train : [loss = 1.047, top1 = 69.92%], valid : [loss = 1.405, top1 = 60.97%], test : [loss = 1.390, top1 = 61.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.38 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.56%], valid : [loss = 2.637, top1 = 34.10%], test : [loss = 2.684, top1 = 32.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 68.10%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2000/15625) 002000-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.554, top1 = 88.39%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.97 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.349, top1 = 91.86%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.27 ms.
cifar100       train : [loss = 0.290, top1 = 91.91%], valid : [loss = 1.319, top1 = 67.35%], test : [loss = 1.351, top1 = 67.05%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.33 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.20%], valid : [loss = 2.416, top1 = 38.47%], test : [loss = 2.428, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.00%], valid : [loss = 0.908, top1 = 67.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2001/15625) 002001-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.28%], valid : [loss = 0.545, top1 = 82.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.71 ms.
cifar10        train : [loss = 0.261, top1 = 91.09%], test  : [loss = 0.415, top1 = 86.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.24 ms.
cifar100       train : [loss = 1.395, top1 = 60.75%], valid : [loss = 1.659, top1 = 55.11%], test : [loss = 1.623, top1 = 55.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.900, top1 = 28.80%], valid : [loss = 2.882, top1 = 29.31%], test : [loss = 2.940, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.64%], valid : [loss = 1.018, top1 = 63.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2002/15625) 002002-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.16%], valid : [loss = 0.451, top1 = 86.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10        train : [loss = 0.156, top1 = 94.93%], test  : [loss = 0.344, top1 = 88.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.89 ms.
cifar100       train : [loss = 1.002, top1 = 71.41%], valid : [loss = 1.355, top1 = 62.07%], test : [loss = 1.359, top1 = 61.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.85%], valid : [loss = 2.660, top1 = 33.08%], test : [loss = 2.716, top1 = 32.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2003/15625) 002003-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.44%], valid : [loss = 0.869, top1 = 75.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10        train : [loss = 0.309, top1 = 89.31%], test  : [loss = 0.622, top1 = 80.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.51 ms.
cifar100       train : [loss = 1.359, top1 = 61.69%], valid : [loss = 1.903, top1 = 50.65%], test : [loss = 1.907, top1 = 50.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 3.493, top1 = 17.44%], valid : [loss = 3.511, top1 = 17.63%], test : [loss = 3.513, top1 = 17.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.19%], valid : [loss = 1.301, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2004/15625) 002004-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.339, top1 = 91.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 0.336, top1 = 90.75%], valid : [loss = 1.282, top1 = 67.13%], test : [loss = 1.283, top1 = 67.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.78%], valid : [loss = 2.410, top1 = 38.59%], test : [loss = 2.407, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2005/15625) 002005-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.551, top1 = 88.70%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.87 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.362, top1 = 92.19%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.55 ms.
cifar100       train : [loss = 0.136, top1 = 96.95%], valid : [loss = 1.365, top1 = 68.67%], test : [loss = 1.357, top1 = 68.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.33 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.17%], valid : [loss = 2.388, top1 = 39.74%], test : [loss = 2.378, top1 = 39.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.12%], valid : [loss = 0.958, top1 = 66.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2006/15625) 002006-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.522, top1 = 89.69%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.335, top1 = 92.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.98 ms.
cifar100       train : [loss = 0.074, top1 = 98.84%], valid : [loss = 1.347, top1 = 69.71%], test : [loss = 1.372, top1 = 69.01%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.86 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.38%], valid : [loss = 2.372, top1 = 39.50%], test : [loss = 2.376, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2007/15625) 002007-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.675, top1 = 84.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10        train : [loss = 0.052, top1 = 98.43%], test  : [loss = 0.438, top1 = 88.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.35 ms.
cifar100       train : [loss = 0.629, top1 = 81.58%], valid : [loss = 1.534, top1 = 61.49%], test : [loss = 1.504, top1 = 62.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.13%], valid : [loss = 2.818, top1 = 30.62%], test : [loss = 2.885, top1 = 29.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2008/15625) 002008-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.91%], valid : [loss = 0.563, top1 = 86.03%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.19 ms.
cifar10        train : [loss = 0.069, top1 = 98.03%], test  : [loss = 0.366, top1 = 89.68%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.87 ms.
cifar100       train : [loss = 0.588, top1 = 82.94%], valid : [loss = 1.330, top1 = 64.76%], test : [loss = 1.318, top1 = 65.47%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 39.94%], valid : [loss = 2.482, top1 = 37.38%], test : [loss = 2.504, top1 = 37.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.48%], valid : [loss = 0.881, top1 = 69.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2009/15625) 002009-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.578, top1 = 86.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10        train : [loss = 0.041, top1 = 98.77%], test  : [loss = 0.396, top1 = 90.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 0.560, top1 = 83.47%], valid : [loss = 1.404, top1 = 63.92%], test : [loss = 1.416, top1 = 63.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.89%], valid : [loss = 2.632, top1 = 33.72%], test : [loss = 2.677, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2010/15625) 002010-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.471, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.318, top1 = 91.62%], valid : [loss = 1.243, top1 = 67.74%], test : [loss = 1.245, top1 = 68.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.79%], valid : [loss = 2.306, top1 = 40.97%], test : [loss = 2.321, top1 = 41.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.55%], valid : [loss = 0.590, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2011/15625) 002011-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=23.85 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.494, top1 = 89.57%]
cifar10        FLOP= 62.83 M, Params=0.456 MB, latency=23.11 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.305, top1 = 92.83%]
cifar100       FLOP= 62.84 M, Params=0.462 MB, latency=24.16 ms.
cifar100       train : [loss = 0.162, top1 = 96.38%], valid : [loss = 1.248, top1 = 69.69%], test : [loss = 1.237, top1 = 69.79%]
ImageNet16-120 FLOP= 15.72 M, Params=0.463 MB, latency=24.88 ms.
ImageNet16-120 train : [loss = 1.770, top1 = 52.82%], valid : [loss = 2.141, top1 = 44.89%], test : [loss = 2.152, top1 = 44.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 77.06%], valid : [loss = 0.721, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2012/15625) 002012-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.553, top1 = 88.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10        train : [loss = 0.019, top1 = 99.48%], test  : [loss = 0.356, top1 = 91.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.89 ms.
cifar100       train : [loss = 0.231, top1 = 93.90%], valid : [loss = 1.357, top1 = 67.54%], test : [loss = 1.357, top1 = 67.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 38.61%], valid : [loss = 2.542, top1 = 35.19%], test : [loss = 2.538, top1 = 35.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.77%], valid : [loss = 0.958, top1 = 65.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2013/15625) 002013-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.425, top1 = 90.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.66 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.274, top1 = 93.80%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.61 ms.
cifar100       train : [loss = 0.073, top1 = 98.86%], valid : [loss = 1.314, top1 = 70.95%], test : [loss = 1.308, top1 = 70.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.69 ms.
ImageNet16-120 train : [loss = 1.523, top1 = 58.69%], valid : [loss = 2.195, top1 = 45.31%], test : [loss = 2.232, top1 = 44.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.13%], valid : [loss = 0.515, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2014/15625) 002014-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.540, top1 = 88.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.52 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.351, top1 = 91.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.425, top1 = 87.73%], valid : [loss = 1.272, top1 = 67.10%], test : [loss = 1.278, top1 = 66.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.07%], valid : [loss = 2.434, top1 = 38.66%], test : [loss = 2.460, top1 = 37.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.93%], valid : [loss = 0.810, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2015/15625) 002015-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.582, top1 = 87.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.82 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.392, top1 = 91.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.10 ms.
cifar100       train : [loss = 0.359, top1 = 89.94%], valid : [loss = 1.412, top1 = 65.31%], test : [loss = 1.424, top1 = 65.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.24%], valid : [loss = 2.468, top1 = 37.73%], test : [loss = 2.506, top1 = 37.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.15%], valid : [loss = 0.872, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2016/15625) 002016-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.505, top1 = 89.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 92.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.53 ms.
cifar100       train : [loss = 0.132, top1 = 97.39%], valid : [loss = 1.291, top1 = 69.15%], test : [loss = 1.295, top1 = 69.03%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.38%], valid : [loss = 2.275, top1 = 41.62%], test : [loss = 2.274, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.10%], valid : [loss = 0.671, top1 = 76.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2017/15625) 002017-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.204, top1 = 93.16%], valid : [loss = 0.596, top1 = 82.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10        train : [loss = 0.183, top1 = 93.78%], test  : [loss = 0.409, top1 = 87.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.22 ms.
cifar100       train : [loss = 1.204, top1 = 65.68%], valid : [loss = 1.565, top1 = 57.76%], test : [loss = 1.570, top1 = 57.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.04%], valid : [loss = 2.668, top1 = 33.56%], test : [loss = 2.723, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 67.74%], valid : [loss = 0.961, top1 = 66.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2018/15625) 002018-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 91.06%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.262, top1 = 94.06%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.84 ms.
cifar100       train : [loss = 0.042, top1 = 99.56%], valid : [loss = 1.277, top1 = 71.92%], test : [loss = 1.236, top1 = 72.36%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.82 ms.
ImageNet16-120 train : [loss = 1.333, top1 = 63.53%], valid : [loss = 2.178, top1 = 45.96%], test : [loss = 2.179, top1 = 46.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 88.09%], valid : [loss = 0.483, top1 = 83.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2019/15625) 002019-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.28%], valid : [loss = 0.568, top1 = 85.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.113, top1 = 96.22%], test  : [loss = 0.393, top1 = 88.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 0.826, top1 = 75.78%], valid : [loss = 1.399, top1 = 62.83%], test : [loss = 1.390, top1 = 62.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.682, top1 = 32.93%], valid : [loss = 2.753, top1 = 31.91%], test : [loss = 2.805, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.24%], valid : [loss = 0.692, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2020/15625) 002020-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.45%], valid : [loss = 0.462, top1 = 86.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.164, top1 = 94.60%], test  : [loss = 0.350, top1 = 88.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.69 ms.
cifar100       train : [loss = 1.012, top1 = 71.18%], valid : [loss = 1.364, top1 = 61.87%], test : [loss = 1.358, top1 = 61.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.59%], valid : [loss = 2.704, top1 = 32.73%], test : [loss = 2.725, top1 = 32.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2021/15625) 002021-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.77%], valid : [loss = 0.624, top1 = 84.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.085, top1 = 97.30%], test  : [loss = 0.410, top1 = 88.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.773, top1 = 77.27%], valid : [loss = 1.433, top1 = 62.04%], test : [loss = 1.409, top1 = 61.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.85%], valid : [loss = 2.757, top1 = 31.77%], test : [loss = 2.778, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.72%], valid : [loss = 0.851, top1 = 70.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2022/15625) 002022-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.526, top1 = 88.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.339, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.12 ms.
cifar100       train : [loss = 0.348, top1 = 90.50%], valid : [loss = 1.282, top1 = 66.57%], test : [loss = 1.286, top1 = 67.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.76%], valid : [loss = 2.398, top1 = 39.21%], test : [loss = 2.410, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2023/15625) 002023-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.577, top1 = 88.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.379, top1 = 91.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.05 ms.
cifar100       train : [loss = 0.156, top1 = 96.64%], valid : [loss = 1.491, top1 = 66.09%], test : [loss = 1.500, top1 = 66.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 1.982, top1 = 47.93%], valid : [loss = 2.417, top1 = 39.29%], test : [loss = 2.433, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 76.01%], valid : [loss = 0.764, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2024/15625) 002024-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.253, top1 = 91.39%], valid : [loss = 0.538, top1 = 83.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10        train : [loss = 0.228, top1 = 92.30%], test  : [loss = 0.407, top1 = 86.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 1.306, top1 = 62.96%], valid : [loss = 1.572, top1 = 57.12%], test : [loss = 1.567, top1 = 57.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.846, top1 = 29.86%], valid : [loss = 2.847, top1 = 30.40%], test : [loss = 2.891, top1 = 29.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.37%], valid : [loss = 1.058, top1 = 62.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2025/15625) 002025-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.486, top1 = 88.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.347, top1 = 91.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.79 ms.
cifar100       train : [loss = 0.313, top1 = 91.24%], valid : [loss = 1.325, top1 = 67.33%], test : [loss = 1.320, top1 = 67.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.75%], valid : [loss = 2.325, top1 = 40.62%], test : [loss = 2.352, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.14%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2026/15625) 002026-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.306, top1 = 92.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 0.223, top1 = 94.61%], valid : [loss = 1.293, top1 = 68.15%], test : [loss = 1.277, top1 = 68.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.26%], valid : [loss = 2.269, top1 = 42.38%], test : [loss = 2.295, top1 = 42.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.433, top1 = 85.00%], valid : [loss = 0.537, top1 = 82.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2027/15625) 002027-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.12%], valid : [loss = 0.552, top1 = 82.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.274, top1 = 90.62%], test  : [loss = 0.430, top1 = 85.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.74 ms.
cifar100       train : [loss = 1.416, top1 = 60.12%], valid : [loss = 1.668, top1 = 55.33%], test : [loss = 1.663, top1 = 54.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.962, top1 = 27.66%], valid : [loss = 2.953, top1 = 27.34%], test : [loss = 3.025, top1 = 26.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.957, top1 = 65.62%], valid : [loss = 1.018, top1 = 64.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2028/15625) 002028-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.258, top1 = 91.14%], valid : [loss = 0.589, top1 = 81.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10        train : [loss = 0.262, top1 = 91.00%], test  : [loss = 0.425, top1 = 86.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.54 ms.
cifar100       train : [loss = 1.328, top1 = 62.52%], valid : [loss = 1.646, top1 = 55.69%], test : [loss = 1.675, top1 = 55.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 3.049, top1 = 26.17%], valid : [loss = 3.074, top1 = 25.88%], test : [loss = 3.119, top1 = 25.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.10%], valid : [loss = 1.190, top1 = 57.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2029/15625) 002029-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.428, top1 = 90.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.294, top1 = 92.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 0.205, top1 = 95.27%], valid : [loss = 1.292, top1 = 68.68%], test : [loss = 1.259, top1 = 69.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.85%], valid : [loss = 2.268, top1 = 41.99%], test : [loss = 2.294, top1 = 42.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2030/15625) 002030-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.452, top1 = 91.02%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.49 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.291, top1 = 94.02%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.86 ms.
cifar100       train : [loss = 0.020, top1 = 99.86%], valid : [loss = 1.322, top1 = 72.35%], test : [loss = 1.289, top1 = 72.65%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 1.170, top1 = 67.55%], valid : [loss = 2.254, top1 = 45.91%], test : [loss = 2.274, top1 = 46.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.72%], valid : [loss = 0.479, top1 = 84.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2031/15625) 002031-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.53%], valid : [loss = 0.445, top1 = 87.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10        train : [loss = 0.055, top1 = 98.64%], test  : [loss = 0.317, top1 = 90.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.585, top1 = 84.04%], valid : [loss = 1.215, top1 = 66.73%], test : [loss = 1.196, top1 = 66.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.21%], valid : [loss = 2.459, top1 = 38.30%], test : [loss = 2.470, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.12%], valid : [loss = 0.652, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2032/15625) 002032-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.544, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.356, top1 = 92.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.18 ms.
cifar100       train : [loss = 0.250, top1 = 93.33%], valid : [loss = 1.314, top1 = 67.69%], test : [loss = 1.329, top1 = 67.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.83%], valid : [loss = 2.443, top1 = 38.22%], test : [loss = 2.460, top1 = 37.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2033/15625) 002033-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.28%], valid : [loss = 0.586, top1 = 85.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.107, top1 = 96.42%], test  : [loss = 0.392, top1 = 88.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.818, top1 = 75.98%], valid : [loss = 1.417, top1 = 62.47%], test : [loss = 1.405, top1 = 62.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 32.99%], valid : [loss = 2.763, top1 = 32.14%], test : [loss = 2.814, top1 = 30.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2034/15625) 002034-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.487, top1 = 89.06%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.12 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.312, top1 = 92.22%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.52 ms.
cifar100       train : [loss = 0.283, top1 = 92.60%], valid : [loss = 1.212, top1 = 68.57%], test : [loss = 1.209, top1 = 68.87%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.61 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.90%], valid : [loss = 2.233, top1 = 41.82%], test : [loss = 2.232, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.50%], valid : [loss = 0.642, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2035/15625) 002035-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.455, top1 = 86.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.112, top1 = 96.54%], test  : [loss = 0.325, top1 = 89.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.57 ms.
cifar100       train : [loss = 0.867, top1 = 75.30%], valid : [loss = 1.310, top1 = 63.63%], test : [loss = 1.291, top1 = 63.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.72%], valid : [loss = 2.620, top1 = 34.40%], test : [loss = 2.649, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2036/15625) 002036-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.38%], valid : [loss = 0.566, top1 = 81.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10        train : [loss = 0.285, top1 = 90.23%], test  : [loss = 0.429, top1 = 85.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.20 ms.
cifar100       train : [loss = 1.544, top1 = 57.10%], valid : [loss = 1.771, top1 = 52.54%], test : [loss = 1.765, top1 = 52.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 3.060, top1 = 25.68%], valid : [loss = 3.060, top1 = 26.03%], test : [loss = 3.125, top1 = 24.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.004, top1 = 63.91%], valid : [loss = 1.029, top1 = 62.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2037/15625) 002037-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.48 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.319, top1 = 92.12%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.72 ms.
cifar100       train : [loss = 0.321, top1 = 91.36%], valid : [loss = 1.287, top1 = 67.12%], test : [loss = 1.286, top1 = 67.35%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.15%], valid : [loss = 2.414, top1 = 38.76%], test : [loss = 2.406, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.84%], valid : [loss = 0.653, top1 = 77.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2038/15625) 002038-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.561, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.376, top1 = 91.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.72 ms.
cifar100       train : [loss = 0.176, top1 = 96.17%], valid : [loss = 1.445, top1 = 66.70%], test : [loss = 1.441, top1 = 66.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 47.90%], valid : [loss = 2.437, top1 = 39.26%], test : [loss = 2.455, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.78%], valid : [loss = 0.688, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2039/15625) 002039-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.230, top1 = 92.17%], valid : [loss = 0.555, top1 = 83.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.207, top1 = 92.97%], test  : [loss = 0.405, top1 = 87.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 1.289, top1 = 63.38%], valid : [loss = 1.573, top1 = 56.91%], test : [loss = 1.576, top1 = 56.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.715, top1 = 32.25%], valid : [loss = 2.739, top1 = 31.80%], test : [loss = 2.798, top1 = 31.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.948, top1 = 65.82%], valid : [loss = 1.000, top1 = 64.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2040/15625) 002040-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.35%], valid : [loss = 0.461, top1 = 86.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10        train : [loss = 0.157, top1 = 94.91%], test  : [loss = 0.351, top1 = 88.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 1.006, top1 = 71.35%], valid : [loss = 1.368, top1 = 61.59%], test : [loss = 1.359, top1 = 61.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.76%], valid : [loss = 2.692, top1 = 32.42%], test : [loss = 2.705, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2041/15625) 002041-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.26%], valid : [loss = 0.558, top1 = 82.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10        train : [loss = 0.244, top1 = 91.71%], test  : [loss = 0.408, top1 = 86.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 1.382, top1 = 61.06%], valid : [loss = 1.628, top1 = 55.64%], test : [loss = 1.614, top1 = 55.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.869, top1 = 29.33%], valid : [loss = 2.870, top1 = 29.39%], test : [loss = 2.907, top1 = 28.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.046, top1 = 62.39%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2042/15625) 002042-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.154, top1 = 94.84%], valid : [loss = 0.737, top1 = 80.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10        train : [loss = 0.183, top1 = 93.70%], test  : [loss = 0.517, top1 = 84.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.10 ms.
cifar100       train : [loss = 0.868, top1 = 74.63%], valid : [loss = 1.665, top1 = 57.30%], test : [loss = 1.675, top1 = 56.77%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 3.462, top1 = 17.51%], valid : [loss = 3.470, top1 = 17.89%], test : [loss = 3.469, top1 = 17.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.46%], valid : [loss = 1.311, top1 = 52.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2043/15625) 002043-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.77%], valid : [loss = 0.536, top1 = 84.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.165, top1 = 94.46%], test  : [loss = 0.378, top1 = 88.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 1.147, top1 = 67.30%], valid : [loss = 1.480, top1 = 58.99%], test : [loss = 1.465, top1 = 59.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.566, top1 = 35.39%], valid : [loss = 2.623, top1 = 34.66%], test : [loss = 2.667, top1 = 33.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.21%], valid : [loss = 0.937, top1 = 66.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2044/15625) 002044-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.519, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.30 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.324, top1 = 92.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.65 ms.
cifar100       train : [loss = 0.227, top1 = 94.44%], valid : [loss = 1.274, top1 = 68.23%], test : [loss = 1.286, top1 = 68.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.63%], valid : [loss = 2.277, top1 = 42.04%], test : [loss = 2.299, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.40%], valid : [loss = 0.690, top1 = 76.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2045/15625) 002045-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.668, top1 = 85.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.428, top1 = 89.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.77 ms.
cifar100       train : [loss = 0.343, top1 = 90.62%], valid : [loss = 1.542, top1 = 63.46%], test : [loss = 1.525, top1 = 63.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.323, top1 = 40.55%], valid : [loss = 2.623, top1 = 34.39%], test : [loss = 2.642, top1 = 34.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.62%], valid : [loss = 0.827, top1 = 70.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2046/15625) 002046-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.607, top1 = 87.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.411, top1 = 91.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.208, top1 = 95.14%], valid : [loss = 1.424, top1 = 66.85%], test : [loss = 1.410, top1 = 66.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 45.98%], valid : [loss = 2.499, top1 = 37.17%], test : [loss = 2.508, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.87%], valid : [loss = 0.744, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2047/15625) 002047-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.508, top1 = 88.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.338, top1 = 91.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.83 ms.
cifar100       train : [loss = 0.336, top1 = 90.82%], valid : [loss = 1.282, top1 = 67.08%], test : [loss = 1.275, top1 = 67.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.68%], valid : [loss = 2.417, top1 = 38.72%], test : [loss = 2.433, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2048/15625) 002048-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.437, top1 = 89.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.299, top1 = 92.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.02 ms.
cifar100       train : [loss = 0.144, top1 = 96.99%], valid : [loss = 1.351, top1 = 68.45%], test : [loss = 1.346, top1 = 68.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.775, top1 = 52.82%], valid : [loss = 2.256, top1 = 43.22%], test : [loss = 2.308, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.27%], valid : [loss = 0.535, top1 = 82.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2049/15625) 002049-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.564, top1 = 89.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.33 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.360, top1 = 92.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.00 ms.
cifar100       train : [loss = 0.143, top1 = 96.72%], valid : [loss = 1.343, top1 = 68.43%], test : [loss = 1.360, top1 = 68.67%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.84%], valid : [loss = 2.253, top1 = 42.58%], test : [loss = 2.239, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.90%], valid : [loss = 0.777, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2050/15625) 002050-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2051/15625) 002051-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2052/15625) 002052-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.600, top1 = 87.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.399, top1 = 90.80%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.78 ms.
cifar100       train : [loss = 0.414, top1 = 88.13%], valid : [loss = 1.404, top1 = 65.00%], test : [loss = 1.413, top1 = 65.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.99%], valid : [loss = 2.510, top1 = 37.17%], test : [loss = 2.544, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.07%], valid : [loss = 0.822, top1 = 70.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2053/15625) 002053-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.409, top1 = 91.36%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.259, top1 = 94.21%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.01 ms.
cifar100       train : [loss = 0.025, top1 = 99.79%], valid : [loss = 1.258, top1 = 73.09%], test : [loss = 1.277, top1 = 72.20%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.32 ms.
ImageNet16-120 train : [loss = 1.224, top1 = 66.20%], valid : [loss = 2.222, top1 = 45.42%], test : [loss = 2.256, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.306, top1 = 89.52%], valid : [loss = 0.467, top1 = 84.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2054/15625) 002054-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.54%], valid : [loss = 0.623, top1 = 86.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10        train : [loss = 0.030, top1 = 99.16%], test  : [loss = 0.406, top1 = 90.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.06 ms.
cifar100       train : [loss = 0.512, top1 = 85.06%], valid : [loss = 1.429, top1 = 63.67%], test : [loss = 1.459, top1 = 63.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.21%], valid : [loss = 2.519, top1 = 36.42%], test : [loss = 2.545, top1 = 36.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.86%], valid : [loss = 0.897, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2055/15625) 002055-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.514, top1 = 88.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.331, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.349, top1 = 90.44%], valid : [loss = 1.277, top1 = 67.17%], test : [loss = 1.306, top1 = 66.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.41%], valid : [loss = 2.417, top1 = 38.77%], test : [loss = 2.441, top1 = 38.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2056/15625) 002056-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.54%], valid : [loss = 0.574, top1 = 87.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10        train : [loss = 0.042, top1 = 98.76%], test  : [loss = 0.393, top1 = 90.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.555, top1 = 83.59%], valid : [loss = 1.410, top1 = 64.19%], test : [loss = 1.414, top1 = 63.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.87%], valid : [loss = 2.615, top1 = 35.02%], test : [loss = 2.672, top1 = 33.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.71%], valid : [loss = 0.658, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2057/15625) 002057-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.462, top1 = 89.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.315, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.27 ms.
cifar100       train : [loss = 0.327, top1 = 91.12%], valid : [loss = 1.325, top1 = 66.46%], test : [loss = 1.299, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.16%], valid : [loss = 2.387, top1 = 39.83%], test : [loss = 2.421, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2058/15625) 002058-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.424, top1 = 90.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.279, top1 = 93.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.186, top1 = 95.64%], valid : [loss = 1.269, top1 = 69.19%], test : [loss = 1.263, top1 = 69.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.56%], valid : [loss = 2.254, top1 = 42.62%], test : [loss = 2.278, top1 = 42.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2059/15625) 002059-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.557, top1 = 87.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.378, top1 = 91.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.374, top1 = 89.43%], valid : [loss = 1.401, top1 = 65.73%], test : [loss = 1.411, top1 = 65.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.31 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.80%], valid : [loss = 2.486, top1 = 37.31%], test : [loss = 2.498, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.21%], valid : [loss = 0.769, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2060/15625) 002060-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.47%], valid : [loss = 0.550, top1 = 85.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.34 ms.
cifar10        train : [loss = 0.101, top1 = 96.79%], test  : [loss = 0.363, top1 = 89.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.37 ms.
cifar100       train : [loss = 0.831, top1 = 75.67%], valid : [loss = 1.434, top1 = 61.63%], test : [loss = 1.437, top1 = 62.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.79%], valid : [loss = 2.602, top1 = 34.23%], test : [loss = 2.632, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.13%], valid : [loss = 0.905, top1 = 67.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2061/15625) 002061-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.99%], valid : [loss = 0.546, top1 = 86.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10        train : [loss = 0.076, top1 = 97.57%], test  : [loss = 0.364, top1 = 89.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 0.710, top1 = 79.17%], valid : [loss = 1.347, top1 = 64.67%], test : [loss = 1.345, top1 = 63.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.11%], valid : [loss = 2.646, top1 = 34.08%], test : [loss = 2.705, top1 = 33.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2062/15625) 002062-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.55%], valid : [loss = 0.704, top1 = 84.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.043, top1 = 98.74%], test  : [loss = 0.470, top1 = 88.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 0.428, top1 = 87.89%], valid : [loss = 1.654, top1 = 60.72%], test : [loss = 1.666, top1 = 60.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.317, top1 = 40.59%], valid : [loss = 2.631, top1 = 34.60%], test : [loss = 2.674, top1 = 34.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.05%], valid : [loss = 0.900, top1 = 68.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2063/15625) 002063-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.17%], valid : [loss = 0.455, top1 = 86.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10        train : [loss = 0.161, top1 = 94.76%], test  : [loss = 0.351, top1 = 88.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 0.983, top1 = 71.95%], valid : [loss = 1.344, top1 = 62.62%], test : [loss = 1.343, top1 = 62.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.01%], valid : [loss = 2.667, top1 = 32.96%], test : [loss = 2.693, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2064/15625) 002064-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.534, top1 = 88.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.337, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.27 ms.
cifar100       train : [loss = 0.334, top1 = 90.98%], valid : [loss = 1.284, top1 = 67.05%], test : [loss = 1.290, top1 = 67.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.66%], valid : [loss = 2.413, top1 = 38.91%], test : [loss = 2.426, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2065/15625) 002065-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.53%], valid : [loss = 0.575, top1 = 86.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.040, top1 = 98.79%], test  : [loss = 0.394, top1 = 90.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.561, top1 = 83.47%], valid : [loss = 1.398, top1 = 63.91%], test : [loss = 1.391, top1 = 64.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 36.95%], valid : [loss = 2.610, top1 = 34.41%], test : [loss = 2.666, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.82%], valid : [loss = 0.660, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2066/15625) 002066-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.446, top1 = 90.69%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.17 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.287, top1 = 93.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.53 ms.
cifar100       train : [loss = 0.049, top1 = 99.40%], valid : [loss = 1.367, top1 = 70.59%], test : [loss = 1.340, top1 = 70.77%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.39 ms.
ImageNet16-120 train : [loss = 1.471, top1 = 60.04%], valid : [loss = 2.218, top1 = 44.48%], test : [loss = 2.268, top1 = 43.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.410, top1 = 86.08%], valid : [loss = 0.521, top1 = 82.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2067/15625) 002067-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.41%], valid : [loss = 0.945, top1 = 75.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.225, top1 = 92.33%], test  : [loss = 0.598, top1 = 81.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 1.188, top1 = 66.30%], valid : [loss = 1.818, top1 = 52.88%], test : [loss = 1.798, top1 = 53.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.86%], valid : [loss = 3.323, top1 = 21.96%], test : [loss = 3.351, top1 = 21.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2068/15625) 002068-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.530, top1 = 88.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.341, top1 = 91.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.298, top1 = 91.92%], valid : [loss = 1.294, top1 = 67.27%], test : [loss = 1.295, top1 = 67.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.71%], valid : [loss = 2.428, top1 = 38.56%], test : [loss = 2.449, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2069/15625) 002069-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.482, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.15 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.317, top1 = 92.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.93 ms.
cifar100       train : [loss = 0.229, top1 = 94.44%], valid : [loss = 1.253, top1 = 68.59%], test : [loss = 1.238, top1 = 69.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.39 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.33%], valid : [loss = 2.268, top1 = 42.08%], test : [loss = 2.289, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.33%], valid : [loss = 0.649, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2070/15625) 002070-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.73%], valid : [loss = 0.461, top1 = 86.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 0.152, top1 = 95.07%], test  : [loss = 0.346, top1 = 88.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.48 ms.
cifar100       train : [loss = 0.969, top1 = 72.39%], valid : [loss = 1.337, top1 = 62.88%], test : [loss = 1.342, top1 = 62.39%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.21%], valid : [loss = 2.673, top1 = 33.39%], test : [loss = 2.692, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.26%], valid : [loss = 0.756, top1 = 73.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2071/15625) 002071-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.559, top1 = 88.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.354, top1 = 92.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.242, top1 = 93.43%], valid : [loss = 1.325, top1 = 67.93%], test : [loss = 1.310, top1 = 68.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.083, top1 = 45.60%], valid : [loss = 2.384, top1 = 39.66%], test : [loss = 2.376, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.31%], valid : [loss = 0.850, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2072/15625) 002072-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.662, top1 = 77.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.533, top1 = 81.68%], test  : [loss = 0.601, top1 = 79.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 1.716, top1 = 53.63%], valid : [loss = 1.883, top1 = 49.93%], test : [loss = 1.894, top1 = 50.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 3.362, top1 = 20.70%], valid : [loss = 3.340, top1 = 20.88%], test : [loss = 3.381, top1 = 20.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.267, top1 = 54.38%], valid : [loss = 1.304, top1 = 53.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2073/15625) 002073-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.478, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.316, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.323, top1 = 91.29%], valid : [loss = 1.262, top1 = 67.67%], test : [loss = 1.251, top1 = 67.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.82%], valid : [loss = 2.309, top1 = 40.86%], test : [loss = 2.339, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.88%], valid : [loss = 0.617, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2074/15625) 002074-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.67 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.539, top1 = 89.03%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.55 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.355, top1 = 92.23%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.66 ms.
cifar100       train : [loss = 0.142, top1 = 96.86%], valid : [loss = 1.315, top1 = 68.70%], test : [loss = 1.350, top1 = 68.39%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.75 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.87%], valid : [loss = 2.301, top1 = 41.04%], test : [loss = 2.302, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.46%], valid : [loss = 0.907, top1 = 67.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2075/15625) 002075-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.485, top1 = 89.57%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.07 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.311, top1 = 92.83%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.73 ms.
cifar100       train : [loss = 0.129, top1 = 97.50%], valid : [loss = 1.255, top1 = 69.73%], test : [loss = 1.288, top1 = 69.37%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.33 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.06%], valid : [loss = 2.177, top1 = 43.97%], test : [loss = 2.193, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.66%], valid : [loss = 0.604, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2076/15625) 002076-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.22%], valid : [loss = 0.464, top1 = 86.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.30 ms.
cifar10        train : [loss = 0.157, top1 = 94.88%], test  : [loss = 0.349, top1 = 88.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.85 ms.
cifar100       train : [loss = 0.992, top1 = 71.81%], valid : [loss = 1.354, top1 = 62.17%], test : [loss = 1.339, top1 = 62.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.56%], valid : [loss = 2.697, top1 = 32.67%], test : [loss = 2.719, top1 = 32.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.73%], valid : [loss = 0.774, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2077/15625) 002077-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.478, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.70 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.317, top1 = 92.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.61 ms.
cifar100       train : [loss = 0.278, top1 = 92.89%], valid : [loss = 1.192, top1 = 69.15%], test : [loss = 1.216, top1 = 68.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.66%], valid : [loss = 2.217, top1 = 43.02%], test : [loss = 2.240, top1 = 42.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.23%], valid : [loss = 0.643, top1 = 77.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2078/15625) 002078-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.551, top1 = 87.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.378, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.392, top1 = 88.93%], valid : [loss = 1.357, top1 = 66.11%], test : [loss = 1.366, top1 = 65.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.265, top1 = 41.68%], valid : [loss = 2.477, top1 = 37.44%], test : [loss = 2.516, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.32%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2079/15625) 002079-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.582, top1 = 87.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.396, top1 = 91.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 0.394, top1 = 88.86%], valid : [loss = 1.402, top1 = 65.35%], test : [loss = 1.408, top1 = 65.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.96%], valid : [loss = 2.527, top1 = 36.20%], test : [loss = 2.534, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2080/15625) 002080-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.504, top1 = 88.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10        train : [loss = 0.017, top1 = 99.63%], test  : [loss = 0.344, top1 = 91.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.33 ms.
cifar100       train : [loss = 0.386, top1 = 89.12%], valid : [loss = 1.345, top1 = 66.15%], test : [loss = 1.337, top1 = 66.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.68%], valid : [loss = 2.393, top1 = 39.11%], test : [loss = 2.440, top1 = 38.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.24%], valid : [loss = 0.620, top1 = 78.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2081/15625) 002081-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.77%], valid : [loss = 0.508, top1 = 85.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10        train : [loss = 0.169, top1 = 94.32%], test  : [loss = 0.375, top1 = 88.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 1.105, top1 = 68.41%], valid : [loss = 1.462, top1 = 60.21%], test : [loss = 1.459, top1 = 60.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.97%], valid : [loss = 2.671, top1 = 33.61%], test : [loss = 2.727, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.53%], valid : [loss = 0.962, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2082/15625) 002082-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.506, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.319, top1 = 92.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.75 ms.
cifar100       train : [loss = 0.168, top1 = 96.22%], valid : [loss = 1.319, top1 = 68.62%], test : [loss = 1.314, top1 = 68.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.926, top1 = 49.24%], valid : [loss = 2.318, top1 = 40.90%], test : [loss = 2.319, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.88%], valid : [loss = 0.672, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2083/15625) 002083-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.513, top1 = 88.66%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.322, top1 = 92.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.58 ms.
cifar100       train : [loss = 0.332, top1 = 90.95%], valid : [loss = 1.274, top1 = 67.12%], test : [loss = 1.275, top1 = 67.19%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.08%], valid : [loss = 2.401, top1 = 38.70%], test : [loss = 2.399, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.98%], valid : [loss = 0.644, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2084/15625) 002084-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.86%], valid : [loss = 0.848, top1 = 71.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.20 ms.
cifar10        train : [loss = 0.564, top1 = 80.31%], test  : [loss = 0.708, top1 = 75.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.32 ms.
cifar100       train : [loss = 1.798, top1 = 51.50%], valid : [loss = 2.050, top1 = 47.01%], test : [loss = 2.071, top1 = 46.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.72%], valid : [loss = 3.631, top1 = 16.23%], test : [loss = 3.665, top1 = 15.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.09%], valid : [loss = 1.257, top1 = 55.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2085/15625) 002085-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.73 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.559, top1 = 87.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10        train : [loss = 0.019, top1 = 99.49%], test  : [loss = 0.364, top1 = 91.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.95 ms.
cifar100       train : [loss = 0.256, top1 = 93.25%], valid : [loss = 1.318, top1 = 67.65%], test : [loss = 1.326, top1 = 67.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 39.91%], valid : [loss = 2.520, top1 = 36.54%], test : [loss = 2.543, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.12%], valid : [loss = 0.936, top1 = 67.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2086/15625) 002086-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.538, top1 = 88.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.343, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.327, top1 = 91.06%], valid : [loss = 1.292, top1 = 67.09%], test : [loss = 1.308, top1 = 67.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.97%], valid : [loss = 2.427, top1 = 38.34%], test : [loss = 2.431, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2087/15625) 002087-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.588, top1 = 87.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.398, top1 = 91.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.215, top1 = 94.87%], valid : [loss = 1.413, top1 = 66.77%], test : [loss = 1.399, top1 = 66.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.13%], valid : [loss = 2.478, top1 = 37.50%], test : [loss = 2.491, top1 = 38.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 77.80%], valid : [loss = 0.704, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2088/15625) 002088-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.704, top1 = 85.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.453, top1 = 89.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.12 ms.
cifar100       train : [loss = 0.292, top1 = 92.50%], valid : [loss = 1.651, top1 = 61.86%], test : [loss = 1.647, top1 = 62.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 2.212, top1 = 42.92%], valid : [loss = 2.578, top1 = 35.99%], test : [loss = 2.586, top1 = 36.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.07%], valid : [loss = 0.841, top1 = 70.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2089/15625) 002089-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.65 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.13%], valid : [loss = 0.579, top1 = 86.62%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.23 ms.
cifar10        train : [loss = 0.065, top1 = 97.90%], test  : [loss = 0.377, top1 = 89.86%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.33 ms.
cifar100       train : [loss = 0.659, top1 = 80.54%], valid : [loss = 1.323, top1 = 64.57%], test : [loss = 1.304, top1 = 65.01%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 39.92%], valid : [loss = 2.483, top1 = 37.13%], test : [loss = 2.511, top1 = 36.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 73.87%], valid : [loss = 0.792, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2090/15625) 002090-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.05%], valid : [loss = 0.476, top1 = 84.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10        train : [loss = 0.300, top1 = 89.91%], test  : [loss = 0.401, top1 = 86.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 1.322, top1 = 63.35%], valid : [loss = 1.528, top1 = 57.75%], test : [loss = 1.503, top1 = 58.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.63%], valid : [loss = 2.904, top1 = 29.71%], test : [loss = 2.960, top1 = 27.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2091/15625) 002091-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.521, top1 = 89.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.334, top1 = 92.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.223, top1 = 94.27%], valid : [loss = 1.280, top1 = 68.81%], test : [loss = 1.316, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.81%], valid : [loss = 2.262, top1 = 41.92%], test : [loss = 2.285, top1 = 42.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.06%], valid : [loss = 0.809, top1 = 71.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2092/15625) 002092-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.748, top1 = 84.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.81 ms.
cifar10        train : [loss = 0.027, top1 = 99.36%], test  : [loss = 0.531, top1 = 87.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.30 ms.
cifar100       train : [loss = 0.385, top1 = 89.69%], valid : [loss = 1.606, top1 = 62.01%], test : [loss = 1.588, top1 = 62.17%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.06%], valid : [loss = 2.869, top1 = 30.46%], test : [loss = 2.902, top1 = 29.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.91%], valid : [loss = 0.833, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2093/15625) 002093-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.12%], valid : [loss = 0.587, top1 = 86.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10        train : [loss = 0.066, top1 = 97.84%], test  : [loss = 0.378, top1 = 89.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.01 ms.
cifar100       train : [loss = 0.658, top1 = 80.59%], valid : [loss = 1.315, top1 = 64.97%], test : [loss = 1.289, top1 = 65.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 39.92%], valid : [loss = 2.476, top1 = 37.27%], test : [loss = 2.504, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2094/15625) 002094-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.54%], valid : [loss = 0.640, top1 = 84.29%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.01 ms.
cifar10        train : [loss = 0.093, top1 = 96.99%], test  : [loss = 0.390, top1 = 88.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.26 ms.
cifar100       train : [loss = 0.794, top1 = 76.87%], valid : [loss = 1.429, top1 = 61.80%], test : [loss = 1.407, top1 = 62.40%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.06%], valid : [loss = 2.745, top1 = 32.09%], test : [loss = 2.758, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.44%], valid : [loss = 0.868, top1 = 69.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2095/15625) 002095-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.74%], valid : [loss = 0.464, top1 = 86.51%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.05 ms.
cifar10        train : [loss = 0.122, top1 = 96.19%], test  : [loss = 0.340, top1 = 89.19%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.04 ms.
cifar100       train : [loss = 0.762, top1 = 78.67%], valid : [loss = 1.281, top1 = 64.70%], test : [loss = 1.276, top1 = 64.52%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.88%], valid : [loss = 2.575, top1 = 35.30%], test : [loss = 2.611, top1 = 34.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.53%], valid : [loss = 0.887, top1 = 68.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2096/15625) 002096-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.485, top1 = 89.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.346, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 0.233, top1 = 94.01%], valid : [loss = 1.353, top1 = 67.35%], test : [loss = 1.354, top1 = 67.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.97%], valid : [loss = 2.290, top1 = 41.33%], test : [loss = 2.331, top1 = 41.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.10%], valid : [loss = 0.602, top1 = 79.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2097/15625) 002097-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.01 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.34%], valid : [loss = 0.858, top1 = 71.92%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10        train : [loss = 0.556, top1 = 80.66%], test  : [loss = 0.708, top1 = 75.89%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.14 ms.
cifar100       train : [loss = 1.788, top1 = 51.84%], valid : [loss = 2.062, top1 = 46.52%], test : [loss = 2.065, top1 = 47.01%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.72%], valid : [loss = 3.643, top1 = 16.42%], test : [loss = 3.668, top1 = 15.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2098/15625) 002098-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.55%], valid : [loss = 0.582, top1 = 87.47%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.58 ms.
cifar10        train : [loss = 0.036, top1 = 98.90%], test  : [loss = 0.393, top1 = 90.41%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.93 ms.
cifar100       train : [loss = 0.421, top1 = 87.98%], valid : [loss = 1.344, top1 = 65.97%], test : [loss = 1.332, top1 = 66.40%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.85%], valid : [loss = 2.356, top1 = 40.06%], test : [loss = 2.374, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.81%], valid : [loss = 0.797, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2099/15625) 002099-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.475, top1 = 89.18%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.69 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.306, top1 = 92.38%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.92 ms.
cifar100       train : [loss = 0.218, top1 = 94.77%], valid : [loss = 1.233, top1 = 68.69%], test : [loss = 1.235, top1 = 69.31%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.62%], valid : [loss = 2.218, top1 = 42.58%], test : [loss = 2.245, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.03%], valid : [loss = 0.600, top1 = 79.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2100/15625) 002100-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.573, top1 = 88.18%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.88 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.370, top1 = 92.02%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.25 ms.
cifar100       train : [loss = 0.152, top1 = 96.84%], valid : [loss = 1.461, top1 = 66.68%], test : [loss = 1.428, top1 = 67.35%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.20%], valid : [loss = 2.480, top1 = 37.99%], test : [loss = 2.465, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.92%], valid : [loss = 0.779, top1 = 72.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2101/15625) 002101-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.23%], valid : [loss = 0.858, top1 = 71.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10        train : [loss = 0.561, top1 = 80.37%], test  : [loss = 0.723, top1 = 75.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 1.777, top1 = 52.16%], valid : [loss = 2.047, top1 = 46.76%], test : [loss = 2.073, top1 = 46.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.80%], valid : [loss = 3.635, top1 = 16.58%], test : [loss = 3.666, top1 = 15.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2102/15625) 002102-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.414, top1 = 90.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.286, top1 = 93.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.81 ms.
cifar100       train : [loss = 0.173, top1 = 96.02%], valid : [loss = 1.277, top1 = 69.58%], test : [loss = 1.259, top1 = 69.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.00%], valid : [loss = 2.254, top1 = 43.02%], test : [loss = 2.279, top1 = 42.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.383, top1 = 87.00%], valid : [loss = 0.514, top1 = 82.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2103/15625) 002103-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.527, top1 = 88.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.327, top1 = 92.33%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.93 ms.
cifar100       train : [loss = 0.331, top1 = 90.99%], valid : [loss = 1.279, top1 = 66.91%], test : [loss = 1.283, top1 = 66.99%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.07 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.74%], valid : [loss = 2.409, top1 = 38.70%], test : [loss = 2.402, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2104/15625) 002104-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.625, top1 = 86.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.394, top1 = 90.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 0.502, top1 = 85.39%], valid : [loss = 1.430, top1 = 63.63%], test : [loss = 1.422, top1 = 64.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.18%], valid : [loss = 2.569, top1 = 35.96%], test : [loss = 2.580, top1 = 35.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2105/15625) 002105-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.536, top1 = 89.32%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.338, top1 = 92.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.08 ms.
cifar100       train : [loss = 0.080, top1 = 98.52%], valid : [loss = 1.433, top1 = 68.77%], test : [loss = 1.431, top1 = 69.17%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.35 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.39%], valid : [loss = 2.361, top1 = 39.92%], test : [loss = 2.358, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.22%], valid : [loss = 0.890, top1 = 68.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2106/15625) 002106-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.68%], valid : [loss = 0.674, top1 = 83.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10        train : [loss = 0.097, top1 = 96.80%], test  : [loss = 0.464, top1 = 87.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.33 ms.
cifar100       train : [loss = 0.433, top1 = 87.67%], valid : [loss = 1.718, top1 = 59.45%], test : [loss = 1.739, top1 = 59.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 3.300, top1 = 20.52%], valid : [loss = 3.348, top1 = 20.10%], test : [loss = 3.361, top1 = 19.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.17%], valid : [loss = 1.286, top1 = 52.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2107/15625) 002107-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.25 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.555, top1 = 88.22%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.72 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.371, top1 = 91.75%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.65 ms.
cifar100       train : [loss = 0.142, top1 = 96.44%], valid : [loss = 1.386, top1 = 68.73%], test : [loss = 1.409, top1 = 68.55%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 2.487, top1 = 36.51%], valid : [loss = 2.652, top1 = 33.32%], test : [loss = 2.659, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.94%], valid : [loss = 0.927, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2108/15625) 002108-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.28%], valid : [loss = 0.629, top1 = 85.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10        train : [loss = 0.047, top1 = 98.58%], test  : [loss = 0.393, top1 = 89.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 0.617, top1 = 81.84%], valid : [loss = 1.473, top1 = 62.38%], test : [loss = 1.467, top1 = 62.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.417, top1 = 38.43%], valid : [loss = 2.603, top1 = 34.88%], test : [loss = 2.619, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.84%], valid : [loss = 0.896, top1 = 68.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2109/15625) 002109-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.03%], valid : [loss = 0.659, top1 = 84.48%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.95 ms.
cifar10        train : [loss = 0.066, top1 = 97.91%], test  : [loss = 0.404, top1 = 89.00%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.27 ms.
cifar100       train : [loss = 0.734, top1 = 78.42%], valid : [loss = 1.453, top1 = 61.69%], test : [loss = 1.457, top1 = 61.72%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.62%], valid : [loss = 2.688, top1 = 32.92%], test : [loss = 2.721, top1 = 32.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.58%], valid : [loss = 0.856, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2110/15625) 002110-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.281, top1 = 90.34%], valid : [loss = 0.549, top1 = 82.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.276, top1 = 90.54%], test  : [loss = 0.424, top1 = 86.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.30 ms.
cifar100       train : [loss = 1.437, top1 = 59.86%], valid : [loss = 1.717, top1 = 53.98%], test : [loss = 1.689, top1 = 54.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 3.016, top1 = 26.68%], valid : [loss = 3.028, top1 = 26.30%], test : [loss = 3.095, top1 = 25.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.92%], valid : [loss = 1.134, top1 = 59.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2111/15625) 002111-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.209, top1 = 93.09%], valid : [loss = 0.480, top1 = 84.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.42 ms.
cifar10        train : [loss = 0.249, top1 = 91.56%], test  : [loss = 0.407, top1 = 86.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.53 ms.
cifar100       train : [loss = 1.470, top1 = 59.39%], valid : [loss = 1.703, top1 = 53.25%], test : [loss = 1.696, top1 = 53.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 2.936, top1 = 27.61%], valid : [loss = 2.937, top1 = 27.53%], test : [loss = 2.982, top1 = 26.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2112/15625) 002112-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.54%], valid : [loss = 0.509, top1 = 87.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.049, top1 = 98.60%], test  : [loss = 0.365, top1 = 90.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.25 ms.
cifar100       train : [loss = 0.545, top1 = 84.25%], valid : [loss = 1.272, top1 = 66.68%], test : [loss = 1.267, top1 = 66.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.73%], valid : [loss = 2.427, top1 = 38.38%], test : [loss = 2.466, top1 = 38.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.84%], valid : [loss = 0.640, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2113/15625) 002113-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.517, top1 = 88.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.00 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.332, top1 = 92.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.56 ms.
cifar100       train : [loss = 0.335, top1 = 90.87%], valid : [loss = 1.290, top1 = 66.66%], test : [loss = 1.286, top1 = 66.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.52%], valid : [loss = 2.408, top1 = 38.72%], test : [loss = 2.427, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2114/15625) 002114-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.529, top1 = 88.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.330, top1 = 91.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.36 ms.
cifar100       train : [loss = 0.339, top1 = 90.77%], valid : [loss = 1.285, top1 = 67.13%], test : [loss = 1.281, top1 = 67.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.59%], valid : [loss = 2.401, top1 = 39.10%], test : [loss = 2.429, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2115/15625) 002115-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.18%], valid : [loss = 0.906, top1 = 76.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.215, top1 = 92.61%], test  : [loss = 0.587, top1 = 82.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 1.152, top1 = 67.25%], valid : [loss = 1.777, top1 = 53.77%], test : [loss = 1.779, top1 = 54.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 3.233, top1 = 22.61%], valid : [loss = 3.348, top1 = 21.37%], test : [loss = 3.367, top1 = 20.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2116/15625) 002116-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.520, top1 = 88.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.335, top1 = 91.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.86 ms.
cifar100       train : [loss = 0.319, top1 = 91.40%], valid : [loss = 1.282, top1 = 67.65%], test : [loss = 1.271, top1 = 67.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.71%], valid : [loss = 2.320, top1 = 41.32%], test : [loss = 2.337, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.98%], valid : [loss = 0.654, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2117/15625) 002117-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.37%], valid : [loss = 0.629, top1 = 83.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.62 ms.
cifar10        train : [loss = 0.090, top1 = 97.02%], test  : [loss = 0.427, top1 = 88.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.59 ms.
cifar100       train : [loss = 0.659, top1 = 80.56%], valid : [loss = 1.527, top1 = 60.71%], test : [loss = 1.531, top1 = 60.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.28 ms.
ImageNet16-120 train : [loss = 3.053, top1 = 25.04%], valid : [loss = 3.077, top1 = 24.67%], test : [loss = 3.089, top1 = 24.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 65.01%], valid : [loss = 1.031, top1 = 63.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2118/15625) 002118-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.204, top1 = 93.25%], valid : [loss = 0.631, top1 = 81.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10        train : [loss = 0.193, top1 = 93.46%], test  : [loss = 0.440, top1 = 86.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 1.072, top1 = 69.21%], valid : [loss = 1.588, top1 = 57.67%], test : [loss = 1.606, top1 = 57.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.14%], valid : [loss = 3.081, top1 = 25.33%], test : [loss = 3.098, top1 = 25.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 64.00%], valid : [loss = 1.076, top1 = 61.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2119/15625) 002119-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.56%], valid : [loss = 0.716, top1 = 80.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10        train : [loss = 0.195, top1 = 93.27%], test  : [loss = 0.508, top1 = 84.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.34 ms.
cifar100       train : [loss = 0.896, top1 = 73.81%], valid : [loss = 1.646, top1 = 57.31%], test : [loss = 1.681, top1 = 56.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 3.541, top1 = 16.07%], valid : [loss = 3.527, top1 = 16.84%], test : [loss = 3.534, top1 = 15.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 53.76%], valid : [loss = 1.278, top1 = 53.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2120/15625) 002120-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.208, top1 = 92.90%], valid : [loss = 0.543, top1 = 83.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.203, top1 = 93.06%], test  : [loss = 0.397, top1 = 87.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 1.281, top1 = 63.58%], valid : [loss = 1.562, top1 = 57.49%], test : [loss = 1.568, top1 = 56.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.718, top1 = 32.26%], valid : [loss = 2.745, top1 = 31.56%], test : [loss = 2.788, top1 = 30.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.50%], valid : [loss = 0.990, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2121/15625) 002121-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.486, top1 = 89.87%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.21 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.293, top1 = 93.31%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.44 ms.
cifar100       train : [loss = 0.118, top1 = 97.77%], valid : [loss = 1.250, top1 = 70.14%], test : [loss = 1.264, top1 = 69.87%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.42 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.09%], valid : [loss = 2.190, top1 = 44.00%], test : [loss = 2.183, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.63%], valid : [loss = 0.622, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2122/15625) 002122-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.65%], valid : [loss = 0.539, top1 = 88.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10        train : [loss = 0.026, top1 = 99.24%], test  : [loss = 0.351, top1 = 91.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.31 ms.
cifar100       train : [loss = 0.441, top1 = 87.17%], valid : [loss = 1.277, top1 = 66.46%], test : [loss = 1.291, top1 = 66.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.228, top1 = 42.38%], valid : [loss = 2.411, top1 = 38.93%], test : [loss = 2.431, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.86%], valid : [loss = 0.850, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2123/15625) 002123-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.339, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.38 ms.
cifar100       train : [loss = 0.162, top1 = 96.33%], valid : [loss = 1.320, top1 = 68.55%], test : [loss = 1.318, top1 = 68.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.790, top1 = 52.34%], valid : [loss = 2.205, top1 = 43.22%], test : [loss = 2.237, top1 = 43.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 74.05%], valid : [loss = 0.795, top1 = 72.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2124/15625) 002124-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.82%], valid : [loss = 0.862, top1 = 71.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10        train : [loss = 0.553, top1 = 80.67%], test  : [loss = 0.716, top1 = 75.46%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.28 ms.
cifar100       train : [loss = 1.788, top1 = 51.99%], valid : [loss = 2.075, top1 = 46.45%], test : [loss = 2.080, top1 = 46.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.79%], valid : [loss = 3.634, top1 = 16.53%], test : [loss = 3.667, top1 = 15.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2125/15625) 002125-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.43%], valid : [loss = 0.718, top1 = 75.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10        train : [loss = 0.551, top1 = 80.88%], test  : [loss = 0.612, top1 = 78.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.89 ms.
cifar100       train : [loss = 1.758, top1 = 52.45%], valid : [loss = 1.896, top1 = 49.45%], test : [loss = 1.926, top1 = 49.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.43 ms.
ImageNet16-120 train : [loss = 3.378, top1 = 20.24%], valid : [loss = 3.368, top1 = 20.99%], test : [loss = 3.404, top1 = 19.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2126/15625) 002126-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.64 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.88%], valid : [loss = 0.552, top1 = 88.76%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.367, top1 = 92.24%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.86 ms.
cifar100       train : [loss = 0.151, top1 = 96.64%], valid : [loss = 1.513, top1 = 65.67%], test : [loss = 1.495, top1 = 66.36%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.25 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 40.44%], valid : [loss = 2.486, top1 = 36.38%], test : [loss = 2.501, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 1.116, top1 = 59.75%], valid : [loss = 1.140, top1 = 59.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2127/15625) 002127-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.536, top1 = 88.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.354, top1 = 91.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.37 ms.
cifar100       train : [loss = 0.303, top1 = 91.78%], valid : [loss = 1.304, top1 = 67.20%], test : [loss = 1.311, top1 = 67.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 2.170, top1 = 43.65%], valid : [loss = 2.425, top1 = 38.43%], test : [loss = 2.429, top1 = 38.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.82%], valid : [loss = 0.894, top1 = 68.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2128/15625) 002128-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.29%], valid : [loss = 0.613, top1 = 85.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.28 ms.
cifar10        train : [loss = 0.071, top1 = 97.84%], test  : [loss = 0.405, top1 = 88.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.83 ms.
cifar100       train : [loss = 0.714, top1 = 79.10%], valid : [loss = 1.393, top1 = 62.71%], test : [loss = 1.390, top1 = 62.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.99%], valid : [loss = 2.652, top1 = 33.71%], test : [loss = 2.684, top1 = 33.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.63%], valid : [loss = 0.784, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2129/15625) 002129-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.505, top1 = 88.77%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.331, top1 = 92.08%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.65 ms.
cifar100       train : [loss = 0.330, top1 = 91.07%], valid : [loss = 1.278, top1 = 67.70%], test : [loss = 1.282, top1 = 67.87%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.13%], valid : [loss = 2.392, top1 = 39.08%], test : [loss = 2.422, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.32%], valid : [loss = 0.614, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2130/15625) 002130-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.94%], valid : [loss = 0.588, top1 = 86.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10        train : [loss = 0.041, top1 = 98.70%], test  : [loss = 0.366, top1 = 90.71%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.12 ms.
cifar100       train : [loss = 0.352, top1 = 89.77%], valid : [loss = 1.407, top1 = 65.07%], test : [loss = 1.430, top1 = 64.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 3.025, top1 = 25.28%], valid : [loss = 3.085, top1 = 24.52%], test : [loss = 3.100, top1 = 24.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.173, top1 = 57.11%], valid : [loss = 1.169, top1 = 56.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2131/15625) 002131-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.268, top1 = 90.70%], valid : [loss = 0.836, top1 = 75.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.309, top1 = 89.24%], test  : [loss = 0.618, top1 = 80.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.62 ms.
cifar100       train : [loss = 1.370, top1 = 61.48%], valid : [loss = 1.902, top1 = 50.21%], test : [loss = 1.934, top1 = 50.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 3.490, top1 = 17.41%], valid : [loss = 3.516, top1 = 17.97%], test : [loss = 3.527, top1 = 16.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.30%], valid : [loss = 1.275, top1 = 53.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2132/15625) 002132-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.90%], valid : [loss = 0.468, top1 = 84.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.299, top1 = 89.92%], test  : [loss = 0.393, top1 = 86.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 1.327, top1 = 63.20%], valid : [loss = 1.535, top1 = 57.99%], test : [loss = 1.512, top1 = 58.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.66%], valid : [loss = 2.902, top1 = 29.10%], test : [loss = 2.952, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2133/15625) 002133-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.47%], valid : [loss = 0.621, top1 = 84.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.094, top1 = 96.86%], test  : [loss = 0.417, top1 = 88.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.59 ms.
cifar100       train : [loss = 0.720, top1 = 78.88%], valid : [loss = 1.540, top1 = 60.05%], test : [loss = 1.530, top1 = 60.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 21.46%], valid : [loss = 3.229, top1 = 20.79%], test : [loss = 3.268, top1 = 20.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.071, top1 = 61.42%], valid : [loss = 1.095, top1 = 61.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2134/15625) 002134-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.12 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.99%], valid : [loss = 0.478, top1 = 84.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10        train : [loss = 0.298, top1 = 90.10%], test  : [loss = 0.403, top1 = 86.59%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.44 ms.
cifar100       train : [loss = 1.327, top1 = 63.19%], valid : [loss = 1.536, top1 = 57.91%], test : [loss = 1.506, top1 = 58.01%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.67%], valid : [loss = 2.906, top1 = 29.27%], test : [loss = 2.955, top1 = 28.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2135/15625) 002135-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.545, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10        train : [loss = 0.027, top1 = 99.24%], test  : [loss = 0.364, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.411, top1 = 88.16%], valid : [loss = 1.274, top1 = 67.42%], test : [loss = 1.289, top1 = 66.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.17%], valid : [loss = 2.425, top1 = 38.90%], test : [loss = 2.444, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2136/15625) 002136-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.420, top1 = 90.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.273, top1 = 93.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.187, top1 = 95.50%], valid : [loss = 1.275, top1 = 69.59%], test : [loss = 1.271, top1 = 69.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.42%], valid : [loss = 2.257, top1 = 41.93%], test : [loss = 2.303, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2137/15625) 002137-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.18%], valid : [loss = 0.456, top1 = 86.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.111, top1 = 96.60%], test  : [loss = 0.327, top1 = 89.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.25 ms.
cifar100       train : [loss = 0.858, top1 = 75.57%], valid : [loss = 1.292, top1 = 63.97%], test : [loss = 1.276, top1 = 63.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.74%], valid : [loss = 2.618, top1 = 34.83%], test : [loss = 2.664, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.99%], valid : [loss = 0.651, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2138/15625) 002138-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.09%], valid : [loss = 0.778, top1 = 73.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10        train : [loss = 0.595, top1 = 79.27%], test  : [loss = 0.645, top1 = 77.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 2.139, top1 = 42.70%], valid : [loss = 2.271, top1 = 40.71%], test : [loss = 2.274, top1 = 40.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 3.352, top1 = 20.21%], valid : [loss = 3.336, top1 = 20.73%], test : [loss = 3.380, top1 = 19.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.292, top1 = 52.94%], valid : [loss = 1.349, top1 = 51.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2139/15625) 002139-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.37%], valid : [loss = 0.448, top1 = 87.60%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.73 ms.
cifar10        train : [loss = 0.067, top1 = 98.24%], test  : [loss = 0.318, top1 = 90.25%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.44 ms.
cifar100       train : [loss = 0.593, top1 = 83.66%], valid : [loss = 1.220, top1 = 66.60%], test : [loss = 1.220, top1 = 66.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.93%], valid : [loss = 2.502, top1 = 37.57%], test : [loss = 2.509, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.26%], valid : [loss = 0.657, top1 = 77.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2140/15625) 002140-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.581, top1 = 87.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.396, top1 = 90.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.05 ms.
cifar100       train : [loss = 0.198, top1 = 95.40%], valid : [loss = 1.453, top1 = 66.41%], test : [loss = 1.461, top1 = 65.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.02%], valid : [loss = 2.484, top1 = 37.93%], test : [loss = 2.480, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.19%], valid : [loss = 0.712, top1 = 75.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2141/15625) 002141-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.80%], valid : [loss = 0.458, top1 = 86.31%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.149, top1 = 95.20%], test  : [loss = 0.342, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.53 ms.
cifar100       train : [loss = 0.964, top1 = 72.50%], valid : [loss = 1.343, top1 = 62.35%], test : [loss = 1.330, top1 = 62.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.26%], valid : [loss = 2.666, top1 = 33.48%], test : [loss = 2.683, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2142/15625) 002142-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.551, top1 = 89.27%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.66 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.371, top1 = 92.60%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.01 ms.
cifar100       train : [loss = 0.033, top1 = 99.72%], valid : [loss = 1.449, top1 = 69.73%], test : [loss = 1.420, top1 = 70.03%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.09 ms.
ImageNet16-120 train : [loss = 1.591, top1 = 57.21%], valid : [loss = 2.409, top1 = 41.36%], test : [loss = 2.415, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.84%], valid : [loss = 0.654, top1 = 77.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2143/15625) 002143-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.98%], valid : [loss = 0.534, top1 = 86.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10        train : [loss = 0.076, top1 = 97.56%], test  : [loss = 0.374, top1 = 89.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.88 ms.
cifar100       train : [loss = 0.714, top1 = 78.88%], valid : [loss = 1.348, top1 = 64.05%], test : [loss = 1.338, top1 = 64.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.09%], valid : [loss = 2.641, top1 = 33.36%], test : [loss = 2.681, top1 = 33.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2144/15625) 002144-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.653, top1 = 85.65%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.56 ms.
cifar10        train : [loss = 0.038, top1 = 98.95%], test  : [loss = 0.430, top1 = 88.96%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.65 ms.
cifar100       train : [loss = 0.411, top1 = 88.64%], valid : [loss = 1.509, top1 = 62.94%], test : [loss = 1.488, top1 = 63.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.07%], valid : [loss = 2.666, top1 = 33.89%], test : [loss = 2.662, top1 = 34.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.19%], valid : [loss = 0.841, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2145/15625) 002145-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.55%], valid : [loss = 0.655, top1 = 85.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.041, top1 = 98.78%], test  : [loss = 0.411, top1 = 89.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 0.556, top1 = 83.79%], valid : [loss = 1.410, top1 = 64.07%], test : [loss = 1.394, top1 = 64.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 37.30%], valid : [loss = 2.613, top1 = 34.51%], test : [loss = 2.664, top1 = 33.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.98%], valid : [loss = 0.927, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2146/15625) 002146-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.567, top1 = 88.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.04 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.351, top1 = 92.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.79 ms.
cifar100       train : [loss = 0.217, top1 = 94.18%], valid : [loss = 1.374, top1 = 67.53%], test : [loss = 1.368, top1 = 68.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.45%], valid : [loss = 2.413, top1 = 38.83%], test : [loss = 2.427, top1 = 38.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.980, top1 = 64.54%], valid : [loss = 0.997, top1 = 64.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2147/15625) 002147-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.64%], valid : [loss = 0.511, top1 = 87.86%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.46 ms.
cifar10        train : [loss = 0.041, top1 = 98.88%], test  : [loss = 0.362, top1 = 90.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.94 ms.
cifar100       train : [loss = 0.498, top1 = 85.65%], valid : [loss = 1.308, top1 = 66.31%], test : [loss = 1.294, top1 = 66.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.56%], valid : [loss = 2.432, top1 = 38.62%], test : [loss = 2.446, top1 = 38.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.98%], valid : [loss = 0.602, top1 = 79.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2148/15625) 002148-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.57 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2149/15625) 002149-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.538, top1 = 89.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.349, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.85 ms.
cifar100       train : [loss = 0.096, top1 = 97.97%], valid : [loss = 1.360, top1 = 69.73%], test : [loss = 1.353, top1 = 69.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.68 ms.
ImageNet16-120 train : [loss = 1.689, top1 = 54.74%], valid : [loss = 2.177, top1 = 44.27%], test : [loss = 2.190, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.60%], valid : [loss = 0.769, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2150/15625) 002150-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.48%], valid : [loss = 0.677, top1 = 83.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10        train : [loss = 0.079, top1 = 97.47%], test  : [loss = 0.436, top1 = 87.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.39 ms.
cifar100       train : [loss = 0.770, top1 = 77.46%], valid : [loss = 1.445, top1 = 61.46%], test : [loss = 1.449, top1 = 61.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.563, top1 = 35.29%], valid : [loss = 2.678, top1 = 33.40%], test : [loss = 2.719, top1 = 33.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.81%], valid : [loss = 0.879, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2151/15625) 002151-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.518, top1 = 88.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.332, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.33 ms.
cifar100       train : [loss = 0.349, top1 = 90.44%], valid : [loss = 1.270, top1 = 67.07%], test : [loss = 1.276, top1 = 67.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.60%], valid : [loss = 2.413, top1 = 38.46%], test : [loss = 2.434, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.27%], valid : [loss = 0.642, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2152/15625) 002152-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.89%], valid : [loss = 0.479, top1 = 84.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.301, top1 = 89.95%], test  : [loss = 0.400, top1 = 86.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.42 ms.
cifar100       train : [loss = 1.329, top1 = 63.14%], valid : [loss = 1.528, top1 = 57.92%], test : [loss = 1.508, top1 = 58.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.61%], valid : [loss = 2.902, top1 = 29.74%], test : [loss = 2.962, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2153/15625) 002153-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.567, top1 = 87.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.384, top1 = 91.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 0.394, top1 = 88.90%], valid : [loss = 1.382, top1 = 65.78%], test : [loss = 1.410, top1 = 65.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.09%], valid : [loss = 2.511, top1 = 37.04%], test : [loss = 2.531, top1 = 36.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2154/15625) 002154-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.43%], valid : [loss = 0.573, top1 = 87.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10        train : [loss = 0.036, top1 = 98.89%], test  : [loss = 0.370, top1 = 90.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.534, top1 = 84.55%], valid : [loss = 1.347, top1 = 64.47%], test : [loss = 1.346, top1 = 64.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 32.71%], valid : [loss = 2.719, top1 = 31.03%], test : [loss = 2.742, top1 = 31.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.65%], valid : [loss = 0.816, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2155/15625) 002155-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.18%], valid : [loss = 0.847, top1 = 71.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.664, top1 = 76.71%], test  : [loss = 0.759, top1 = 73.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.37 ms.
cifar100       train : [loss = 1.949, top1 = 48.16%], valid : [loss = 2.128, top1 = 44.93%], test : [loss = 2.144, top1 = 45.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.71%], valid : [loss = 3.676, top1 = 15.66%], test : [loss = 3.699, top1 = 14.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2156/15625) 002156-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.28%], valid : [loss = 0.550, top1 = 86.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10        train : [loss = 0.049, top1 = 98.69%], test  : [loss = 0.352, top1 = 90.59%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 0.513, top1 = 85.32%], valid : [loss = 1.309, top1 = 65.83%], test : [loss = 1.298, top1 = 66.21%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.66%], valid : [loss = 2.433, top1 = 38.59%], test : [loss = 2.455, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.43%], valid : [loss = 0.834, top1 = 70.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2157/15625) 002157-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.83%], valid : [loss = 0.758, top1 = 82.69%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.085, top1 = 97.30%], test  : [loss = 0.476, top1 = 87.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.80 ms.
cifar100       train : [loss = 0.821, top1 = 76.15%], valid : [loss = 1.547, top1 = 59.58%], test : [loss = 1.514, top1 = 59.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.808, top1 = 30.48%], valid : [loss = 2.931, top1 = 28.14%], test : [loss = 2.989, top1 = 27.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2158/15625) 002158-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.461, top1 = 89.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.22 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.305, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.61 ms.
cifar100       train : [loss = 0.228, top1 = 94.42%], valid : [loss = 1.272, top1 = 68.77%], test : [loss = 1.297, top1 = 68.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.42%], valid : [loss = 2.267, top1 = 42.50%], test : [loss = 2.298, top1 = 42.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.77%], valid : [loss = 0.554, top1 = 81.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2159/15625) 002159-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.410, top1 = 91.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.35 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.273, top1 = 93.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.44 ms.
cifar100       train : [loss = 0.050, top1 = 99.37%], valid : [loss = 1.297, top1 = 71.72%], test : [loss = 1.299, top1 = 71.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.39 ms.
ImageNet16-120 train : [loss = 1.409, top1 = 61.57%], valid : [loss = 2.166, top1 = 45.68%], test : [loss = 2.195, top1 = 45.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 88.05%], valid : [loss = 0.492, top1 = 83.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2160/15625) 002160-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.53%], valid : [loss = 0.442, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.055, top1 = 98.65%], test  : [loss = 0.311, top1 = 90.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.01 ms.
cifar100       train : [loss = 0.588, top1 = 83.82%], valid : [loss = 1.227, top1 = 66.59%], test : [loss = 1.211, top1 = 66.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 41.04%], valid : [loss = 2.474, top1 = 37.27%], test : [loss = 2.487, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.36%], valid : [loss = 0.630, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2161/15625) 002161-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.03%], valid : [loss = 0.548, top1 = 83.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10        train : [loss = 0.198, top1 = 93.25%], test  : [loss = 0.394, top1 = 87.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 1.293, top1 = 63.23%], valid : [loss = 1.595, top1 = 56.79%], test : [loss = 1.578, top1 = 57.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.716, top1 = 32.29%], valid : [loss = 2.740, top1 = 32.00%], test : [loss = 2.789, top1 = 31.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.48%], valid : [loss = 1.005, top1 = 63.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2162/15625) 002162-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.452, top1 = 90.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.52 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.293, top1 = 93.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.35 ms.
cifar100       train : [loss = 0.062, top1 = 99.05%], valid : [loss = 1.354, top1 = 70.04%], test : [loss = 1.315, top1 = 70.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 1.517, top1 = 58.87%], valid : [loss = 2.230, top1 = 44.33%], test : [loss = 2.219, top1 = 45.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 88.32%], valid : [loss = 0.496, top1 = 83.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2163/15625) 002163-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.589, top1 = 88.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.387, top1 = 91.67%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.07 ms.
cifar100       train : [loss = 0.173, top1 = 96.19%], valid : [loss = 1.448, top1 = 66.96%], test : [loss = 1.444, top1 = 66.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.06%], valid : [loss = 2.446, top1 = 39.13%], test : [loss = 2.464, top1 = 39.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.42%], valid : [loss = 0.752, top1 = 73.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2164/15625) 002164-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.29%], valid : [loss = 0.591, top1 = 85.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.067, top1 = 97.98%], test  : [loss = 0.412, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.34 ms.
cifar100       train : [loss = 0.699, top1 = 79.58%], valid : [loss = 1.389, top1 = 63.36%], test : [loss = 1.366, top1 = 63.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.33%], valid : [loss = 2.653, top1 = 33.98%], test : [loss = 2.657, top1 = 33.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.00%], valid : [loss = 0.772, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2165/15625) 002165-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.486, top1 = 88.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.324, top1 = 91.25%], valid : [loss = 1.247, top1 = 67.70%], test : [loss = 1.245, top1 = 68.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.74%], valid : [loss = 2.317, top1 = 40.31%], test : [loss = 2.336, top1 = 41.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2166/15625) 002166-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.618, top1 = 87.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.400, top1 = 91.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.94 ms.
cifar100       train : [loss = 0.105, top1 = 97.96%], valid : [loss = 1.582, top1 = 66.63%], test : [loss = 1.568, top1 = 66.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.977, top1 = 48.20%], valid : [loss = 2.499, top1 = 37.74%], test : [loss = 2.513, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 76.93%], valid : [loss = 0.739, top1 = 73.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2167/15625) 002167-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.522, top1 = 89.51%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.55 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.319, top1 = 93.33%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.40 ms.
cifar100       train : [loss = 0.067, top1 = 99.01%], valid : [loss = 1.348, top1 = 69.21%], test : [loss = 1.359, top1 = 69.77%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.54%], valid : [loss = 2.350, top1 = 39.92%], test : [loss = 2.351, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.39%], valid : [loss = 0.726, top1 = 74.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2168/15625) 002168-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.091, top1 = 97.53%], valid : [loss = 0.471, top1 = 86.36%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.30 ms.
cifar10        train : [loss = 0.122, top1 = 96.22%], test  : [loss = 0.341, top1 = 89.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.49 ms.
cifar100       train : [loss = 0.761, top1 = 78.64%], valid : [loss = 1.276, top1 = 64.64%], test : [loss = 1.288, top1 = 64.09%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.80%], valid : [loss = 2.596, top1 = 34.86%], test : [loss = 2.612, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.76%], valid : [loss = 0.859, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2169/15625) 002169-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.578, top1 = 88.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.388, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.176, top1 = 96.11%], valid : [loss = 1.400, top1 = 67.45%], test : [loss = 1.419, top1 = 67.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.81%], valid : [loss = 2.475, top1 = 38.33%], test : [loss = 2.475, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2170/15625) 002170-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.480, top1 = 89.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.316, top1 = 92.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.69 ms.
cifar100       train : [loss = 0.266, top1 = 93.02%], valid : [loss = 1.223, top1 = 68.75%], test : [loss = 1.234, top1 = 68.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.78%], valid : [loss = 2.213, top1 = 42.77%], test : [loss = 2.241, top1 = 43.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2171/15625) 002171-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.56%], valid : [loss = 0.459, top1 = 86.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10        train : [loss = 0.150, top1 = 95.14%], test  : [loss = 0.340, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.984, top1 = 71.94%], valid : [loss = 1.348, top1 = 62.12%], test : [loss = 1.345, top1 = 62.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.15%], valid : [loss = 2.681, top1 = 32.86%], test : [loss = 2.695, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2172/15625) 002172-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.545, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.372, top1 = 91.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.197, top1 = 95.46%], valid : [loss = 1.394, top1 = 67.14%], test : [loss = 1.394, top1 = 66.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 47.13%], valid : [loss = 2.418, top1 = 38.91%], test : [loss = 2.443, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.52%], valid : [loss = 0.706, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2173/15625) 002173-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.514, top1 = 88.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.333, top1 = 92.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.11 ms.
cifar100       train : [loss = 0.235, top1 = 94.13%], valid : [loss = 1.270, top1 = 68.21%], test : [loss = 1.297, top1 = 68.45%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.07%], valid : [loss = 2.312, top1 = 40.43%], test : [loss = 2.314, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.70%], valid : [loss = 0.685, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2174/15625) 002174-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.483, top1 = 89.38%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.95 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.311, top1 = 92.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.45 ms.
cifar100       train : [loss = 0.276, top1 = 92.91%], valid : [loss = 1.201, top1 = 69.18%], test : [loss = 1.188, top1 = 69.37%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.78%], valid : [loss = 2.207, top1 = 42.72%], test : [loss = 2.224, top1 = 42.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.72%], valid : [loss = 0.663, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2175/15625) 002175-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.678, top1 = 86.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.462, top1 = 90.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.216, top1 = 94.83%], valid : [loss = 1.590, top1 = 64.28%], test : [loss = 1.582, top1 = 64.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.72%], valid : [loss = 2.701, top1 = 33.12%], test : [loss = 2.725, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.26%], valid : [loss = 0.777, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2176/15625) 002176-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.87 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.78%], valid : [loss = 0.860, top1 = 71.52%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.20 ms.
cifar10        train : [loss = 0.554, top1 = 80.67%], test  : [loss = 0.713, top1 = 75.75%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.35 ms.
cifar100       train : [loss = 1.786, top1 = 51.77%], valid : [loss = 2.054, top1 = 47.15%], test : [loss = 2.064, top1 = 46.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.74 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.74%], valid : [loss = 3.635, top1 = 16.48%], test : [loss = 3.671, top1 = 15.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2177/15625) 002177-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10-valid  train : [loss = 1.141, top1 = 59.37%], valid : [loss = 1.187, top1 = 57.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.38 ms.
cifar10        train : [loss = 1.079, top1 = 61.85%], test  : [loss = 1.080, top1 = 61.60%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.35 ms.
cifar100       train : [loss = 2.591, top1 = 34.48%], valid : [loss = 2.661, top1 = 33.55%], test : [loss = 2.631, top1 = 33.89%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.93 ms.
ImageNet16-120 train : [loss = 3.789, top1 = 13.55%], valid : [loss = 3.779, top1 = 14.22%], test : [loss = 3.791, top1 = 14.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2178/15625) 002178-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.542, top1 = 88.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.93 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.352, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.71 ms.
cifar100       train : [loss = 0.192, top1 = 95.33%], valid : [loss = 1.344, top1 = 67.65%], test : [loss = 1.333, top1 = 67.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.25%], valid : [loss = 2.390, top1 = 39.17%], test : [loss = 2.394, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.872, top1 = 68.78%], valid : [loss = 0.913, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2179/15625) 002179-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.17%], valid : [loss = 0.593, top1 = 80.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.310, top1 = 89.33%], test  : [loss = 0.448, top1 = 85.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.84 ms.
cifar100       train : [loss = 1.569, top1 = 56.47%], valid : [loss = 1.797, top1 = 52.37%], test : [loss = 1.799, top1 = 51.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.64 ms.
ImageNet16-120 train : [loss = 3.173, top1 = 23.56%], valid : [loss = 3.176, top1 = 23.98%], test : [loss = 3.224, top1 = 22.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.131, top1 = 59.22%], valid : [loss = 1.171, top1 = 57.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2180/15625) 002180-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.644, top1 = 86.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.440, top1 = 90.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.18 ms.
cifar100       train : [loss = 0.277, top1 = 92.67%], valid : [loss = 1.499, top1 = 64.75%], test : [loss = 1.508, top1 = 65.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.91%], valid : [loss = 2.545, top1 = 36.60%], test : [loss = 2.588, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.68%], valid : [loss = 0.821, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2181/15625) 002181-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.40%], valid : [loss = 0.852, top1 = 71.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.53 ms.
cifar10        train : [loss = 0.562, top1 = 80.36%], test  : [loss = 0.714, top1 = 75.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.09 ms.
cifar100       train : [loss = 1.789, top1 = 51.81%], valid : [loss = 2.049, top1 = 47.29%], test : [loss = 2.066, top1 = 46.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.72%], valid : [loss = 3.648, top1 = 16.57%], test : [loss = 3.674, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2182/15625) 002182-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.70%], valid : [loss = 0.632, top1 = 84.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.087, top1 = 97.19%], test  : [loss = 0.401, top1 = 88.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.08 ms.
cifar100       train : [loss = 0.785, top1 = 77.01%], valid : [loss = 1.430, top1 = 61.93%], test : [loss = 1.420, top1 = 62.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.25 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.07%], valid : [loss = 2.748, top1 = 31.87%], test : [loss = 2.749, top1 = 32.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2183/15625) 002183-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.603, top1 = 87.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.402, top1 = 91.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.62 ms.
cifar100       train : [loss = 0.142, top1 = 97.31%], valid : [loss = 1.459, top1 = 67.04%], test : [loss = 1.454, top1 = 66.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.19%], valid : [loss = 2.498, top1 = 37.76%], test : [loss = 2.541, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.24%], valid : [loss = 0.729, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2184/15625) 002184-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.072, top1 = 97.71%], valid : [loss = 0.605, top1 = 84.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10        train : [loss = 0.090, top1 = 97.05%], test  : [loss = 0.423, top1 = 88.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.16 ms.
cifar100       train : [loss = 0.691, top1 = 79.57%], valid : [loss = 1.530, top1 = 60.14%], test : [loss = 1.533, top1 = 60.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.200, top1 = 21.95%], valid : [loss = 3.211, top1 = 21.79%], test : [loss = 3.239, top1 = 20.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2185/15625) 002185-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.598, top1 = 87.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.399, top1 = 91.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.34 ms.
cifar100       train : [loss = 0.230, top1 = 94.26%], valid : [loss = 1.491, top1 = 65.27%], test : [loss = 1.495, top1 = 65.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 45.00%], valid : [loss = 2.480, top1 = 38.02%], test : [loss = 2.514, top1 = 37.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 74.80%], valid : [loss = 0.775, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2186/15625) 002186-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.75%], valid : [loss = 0.521, top1 = 82.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.397, top1 = 86.51%], test  : [loss = 0.466, top1 = 84.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 1.534, top1 = 57.79%], valid : [loss = 1.662, top1 = 54.04%], test : [loss = 1.648, top1 = 54.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 26.19%], valid : [loss = 3.028, top1 = 26.84%], test : [loss = 3.061, top1 = 26.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.140, top1 = 59.49%], valid : [loss = 1.160, top1 = 58.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2187/15625) 002187-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.418, top1 = 90.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.279, top1 = 93.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.172, top1 = 95.98%], valid : [loss = 1.288, top1 = 69.57%], test : [loss = 1.270, top1 = 69.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 51.98%], valid : [loss = 2.251, top1 = 43.08%], test : [loss = 2.283, top1 = 42.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.94%], valid : [loss = 0.512, top1 = 82.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2188/15625) 002188-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.56 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.469, top1 = 90.12%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.83 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.297, top1 = 93.25%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.51 ms.
cifar100       train : [loss = 0.085, top1 = 98.68%], valid : [loss = 1.279, top1 = 70.09%], test : [loss = 1.265, top1 = 70.54%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.97 ms.
ImageNet16-120 train : [loss = 1.630, top1 = 56.24%], valid : [loss = 2.146, top1 = 45.19%], test : [loss = 2.149, top1 = 44.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.09%], valid : [loss = 0.622, top1 = 78.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2189/15625) 002189-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.507, top1 = 88.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.358, top1 = 90.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 0.478, top1 = 85.99%], valid : [loss = 1.338, top1 = 65.81%], test : [loss = 1.333, top1 = 65.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.31%], valid : [loss = 2.518, top1 = 36.34%], test : [loss = 2.542, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2190/15625) 002190-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.20 ms.
cifar10-valid  train : [loss = 1.203, top1 = 56.96%], valid : [loss = 1.247, top1 = 55.81%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.35 ms.
cifar10        train : [loss = 1.190, top1 = 57.54%], test  : [loss = 1.191, top1 = 57.08%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.04 ms.
cifar100       train : [loss = 2.678, top1 = 32.89%], valid : [loss = 2.755, top1 = 31.74%], test : [loss = 2.727, top1 = 32.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.63 ms.
ImageNet16-120 train : [loss = 3.830, top1 = 13.00%], valid : [loss = 3.813, top1 = 14.14%], test : [loss = 3.830, top1 = 13.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.676, top1 = 37.21%], valid : [loss = 1.738, top1 = 33.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2191/15625) 002191-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.82%], valid : [loss = 0.480, top1 = 84.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10        train : [loss = 0.303, top1 = 89.90%], test  : [loss = 0.404, top1 = 86.26%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.66 ms.
cifar100       train : [loss = 1.336, top1 = 62.90%], valid : [loss = 1.538, top1 = 57.75%], test : [loss = 1.510, top1 = 58.39%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.61 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.64%], valid : [loss = 2.898, top1 = 29.64%], test : [loss = 2.956, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2192/15625) 002192-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.471, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.05 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.324, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.68 ms.
cifar100       train : [loss = 0.293, top1 = 92.07%], valid : [loss = 1.352, top1 = 66.68%], test : [loss = 1.304, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.40%], valid : [loss = 2.345, top1 = 40.09%], test : [loss = 2.371, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.34%], valid : [loss = 0.611, top1 = 79.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2193/15625) 002193-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.561, top1 = 88.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.355, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.87 ms.
cifar100       train : [loss = 0.292, top1 = 91.88%], valid : [loss = 1.307, top1 = 67.61%], test : [loss = 1.338, top1 = 67.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.24%], valid : [loss = 2.436, top1 = 38.17%], test : [loss = 2.440, top1 = 38.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2194/15625) 002194-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.29%], valid : [loss = 0.471, top1 = 85.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10        train : [loss = 0.160, top1 = 94.81%], test  : [loss = 0.355, top1 = 88.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.999, top1 = 71.54%], valid : [loss = 1.357, top1 = 61.93%], test : [loss = 1.345, top1 = 62.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.64%], valid : [loss = 2.675, top1 = 33.44%], test : [loss = 2.726, top1 = 31.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2195/15625) 002195-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.63%], valid : [loss = 0.765, top1 = 73.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.593, top1 = 79.30%], test  : [loss = 0.658, top1 = 77.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.32 ms.
cifar100       train : [loss = 2.051, top1 = 45.01%], valid : [loss = 2.198, top1 = 42.65%], test : [loss = 2.193, top1 = 41.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.254, top1 = 21.90%], valid : [loss = 3.254, top1 = 22.78%], test : [loss = 3.275, top1 = 21.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.275, top1 = 54.14%], valid : [loss = 1.327, top1 = 52.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2196/15625) 002196-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.477, top1 = 84.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.299, top1 = 89.97%], test  : [loss = 0.397, top1 = 86.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.66 ms.
cifar100       train : [loss = 1.325, top1 = 63.20%], valid : [loss = 1.532, top1 = 57.95%], test : [loss = 1.509, top1 = 58.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.58%], valid : [loss = 2.901, top1 = 29.42%], test : [loss = 2.965, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2197/15625) 002197-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.496, top1 = 89.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.323, top1 = 93.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.112, top1 = 97.84%], valid : [loss = 1.279, top1 = 69.92%], test : [loss = 1.272, top1 = 69.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 1.710, top1 = 54.20%], valid : [loss = 2.188, top1 = 43.77%], test : [loss = 2.183, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2198/15625) 002198-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.296, top1 = 89.79%], valid : [loss = 0.471, top1 = 84.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10        train : [loss = 0.271, top1 = 90.87%], test  : [loss = 0.375, top1 = 87.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.77 ms.
cifar100       train : [loss = 1.275, top1 = 64.33%], valid : [loss = 1.474, top1 = 58.79%], test : [loss = 1.445, top1 = 59.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 2.816, top1 = 30.53%], valid : [loss = 2.805, top1 = 30.57%], test : [loss = 2.842, top1 = 29.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.34%], valid : [loss = 1.010, top1 = 64.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2199/15625) 002199-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.76 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.547, top1 = 88.83%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.86 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.364, top1 = 92.13%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.27 ms.
cifar100       train : [loss = 0.204, top1 = 94.81%], valid : [loss = 1.511, top1 = 65.03%], test : [loss = 1.504, top1 = 65.43%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.92 ms.
ImageNet16-120 train : [loss = 2.318, top1 = 39.86%], valid : [loss = 2.497, top1 = 36.00%], test : [loss = 2.523, top1 = 36.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.84%], valid : [loss = 1.027, top1 = 63.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2200/15625) 002200-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.18%], valid : [loss = 0.454, top1 = 86.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.117, top1 = 96.32%], test  : [loss = 0.331, top1 = 89.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.871, top1 = 75.27%], valid : [loss = 1.301, top1 = 63.82%], test : [loss = 1.294, top1 = 63.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.565, top1 = 35.41%], valid : [loss = 2.634, top1 = 33.68%], test : [loss = 2.668, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.48%], valid : [loss = 0.680, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2201/15625) 002201-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.564, top1 = 87.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.388, top1 = 90.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.435, top1 = 87.53%], valid : [loss = 1.386, top1 = 65.71%], test : [loss = 1.366, top1 = 65.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.79%], valid : [loss = 2.486, top1 = 37.22%], test : [loss = 2.531, top1 = 36.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.37%], valid : [loss = 0.786, top1 = 72.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2202/15625) 002202-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.529, top1 = 88.58%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.352, top1 = 91.90%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.61 ms.
cifar100       train : [loss = 0.298, top1 = 92.25%], valid : [loss = 1.478, top1 = 64.49%], test : [loss = 1.464, top1 = 64.93%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.01 ms.
ImageNet16-120 train : [loss = 2.194, top1 = 43.02%], valid : [loss = 2.404, top1 = 38.64%], test : [loss = 2.391, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.32%], valid : [loss = 0.850, top1 = 69.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2203/15625) 002203-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.535, top1 = 87.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.038, top1 = 98.89%], test  : [loss = 0.372, top1 = 90.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.82 ms.
cifar100       train : [loss = 0.481, top1 = 86.08%], valid : [loss = 1.371, top1 = 65.36%], test : [loss = 1.347, top1 = 65.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.247, top1 = 42.04%], valid : [loss = 2.454, top1 = 37.70%], test : [loss = 2.490, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.44%], valid : [loss = 0.624, top1 = 78.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2204/15625) 002204-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.312, top1 = 89.29%], valid : [loss = 0.562, top1 = 82.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.266, top1 = 90.85%], test  : [loss = 0.421, top1 = 86.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 1.442, top1 = 59.41%], valid : [loss = 1.681, top1 = 54.40%], test : [loss = 1.672, top1 = 54.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.883, top1 = 28.92%], valid : [loss = 2.900, top1 = 28.96%], test : [loss = 2.935, top1 = 27.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.27%], valid : [loss = 1.068, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2205/15625) 002205-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.89%], valid : [loss = 0.752, top1 = 74.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.482, top1 = 83.07%], test  : [loss = 0.608, top1 = 79.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 1.863, top1 = 49.50%], valid : [loss = 2.052, top1 = 45.99%], test : [loss = 2.044, top1 = 46.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 3.517, top1 = 17.60%], valid : [loss = 3.514, top1 = 18.24%], test : [loss = 3.545, top1 = 17.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.218, top1 = 55.89%], valid : [loss = 1.255, top1 = 54.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2206/15625) 002206-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.17 ms.
cifar10-valid  train : [loss = 0.788, top1 = 72.21%], valid : [loss = 1.114, top1 = 63.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.89 ms.
cifar10        train : [loss = 0.777, top1 = 72.73%], test  : [loss = 0.921, top1 = 68.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.86 ms.
cifar100       train : [loss = 2.146, top1 = 43.81%], valid : [loss = 2.441, top1 = 38.61%], test : [loss = 2.447, top1 = 38.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 3.758, top1 = 14.05%], valid : [loss = 3.814, top1 = 13.68%], test : [loss = 3.831, top1 = 13.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.78%], valid : [loss = 1.412, top1 = 49.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2207/15625) 002207-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.504, top1 = 88.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.328, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.343, top1 = 90.72%], valid : [loss = 1.307, top1 = 66.29%], test : [loss = 1.293, top1 = 66.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.39%], valid : [loss = 2.415, top1 = 38.49%], test : [loss = 2.419, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2208/15625) 002208-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.455, top1 = 89.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.90 ms.
cifar100       train : [loss = 0.329, top1 = 91.05%], valid : [loss = 1.318, top1 = 67.03%], test : [loss = 1.288, top1 = 67.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.08%], valid : [loss = 2.357, top1 = 39.82%], test : [loss = 2.386, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.433, top1 = 85.02%], valid : [loss = 0.555, top1 = 81.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2209/15625) 002209-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.504, top1 = 89.31%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.318, top1 = 92.77%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.48 ms.
cifar100       train : [loss = 0.142, top1 = 97.12%], valid : [loss = 1.296, top1 = 69.12%], test : [loss = 1.304, top1 = 68.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.41%], valid : [loss = 2.297, top1 = 41.73%], test : [loss = 2.305, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.08%], valid : [loss = 0.671, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2210/15625) 002210-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.485, top1 = 90.09%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.309, top1 = 93.64%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.12 ms.
cifar100       train : [loss = 0.067, top1 = 99.08%], valid : [loss = 1.274, top1 = 70.41%], test : [loss = 1.243, top1 = 71.10%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.61 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.85%], valid : [loss = 2.146, top1 = 45.61%], test : [loss = 2.146, top1 = 45.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.57%], valid : [loss = 0.617, top1 = 79.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2211/15625) 002211-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.17%], valid : [loss = 0.472, top1 = 84.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.299, top1 = 89.92%], test  : [loss = 0.396, top1 = 86.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 1.334, top1 = 62.99%], valid : [loss = 1.547, top1 = 57.71%], test : [loss = 1.519, top1 = 57.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.79%], valid : [loss = 2.894, top1 = 29.74%], test : [loss = 2.948, top1 = 28.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2212/15625) 002212-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.498, top1 = 89.98%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.31 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.325, top1 = 93.10%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.47 ms.
cifar100       train : [loss = 0.070, top1 = 99.00%], valid : [loss = 1.297, top1 = 69.99%], test : [loss = 1.297, top1 = 70.49%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.88 ms.
ImageNet16-120 train : [loss = 1.555, top1 = 58.03%], valid : [loss = 2.150, top1 = 44.92%], test : [loss = 2.153, top1 = 45.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.58%], valid : [loss = 0.607, top1 = 79.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2213/15625) 002213-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.503, top1 = 89.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.325, top1 = 93.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.04 ms.
cifar100       train : [loss = 0.107, top1 = 98.01%], valid : [loss = 1.285, top1 = 70.29%], test : [loss = 1.265, top1 = 70.43%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 1.665, top1 = 55.34%], valid : [loss = 2.165, top1 = 44.33%], test : [loss = 2.147, top1 = 45.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.64%], valid : [loss = 0.611, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2214/15625) 002214-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.616, top1 = 86.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.027, top1 = 99.25%], test  : [loss = 0.400, top1 = 90.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.38 ms.
cifar100       train : [loss = 0.521, top1 = 84.83%], valid : [loss = 1.445, top1 = 63.77%], test : [loss = 1.438, top1 = 63.69%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.24%], valid : [loss = 2.573, top1 = 34.81%], test : [loss = 2.589, top1 = 35.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.83%], valid : [loss = 0.838, top1 = 70.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2215/15625) 002215-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.98%], valid : [loss = 0.567, top1 = 86.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10        train : [loss = 0.063, top1 = 97.96%], test  : [loss = 0.377, top1 = 90.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.95 ms.
cifar100       train : [loss = 0.680, top1 = 79.93%], valid : [loss = 1.336, top1 = 64.19%], test : [loss = 1.325, top1 = 64.63%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 39.99%], valid : [loss = 2.477, top1 = 37.49%], test : [loss = 2.491, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2216/15625) 002216-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.70%], valid : [loss = 0.451, top1 = 86.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.00 ms.
cifar10        train : [loss = 0.154, top1 = 94.95%], test  : [loss = 0.344, top1 = 88.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.58 ms.
cifar100       train : [loss = 0.974, top1 = 72.27%], valid : [loss = 1.351, top1 = 62.13%], test : [loss = 1.344, top1 = 61.99%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.15%], valid : [loss = 2.681, top1 = 33.34%], test : [loss = 2.686, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2217/15625) 002217-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.511, top1 = 90.01%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.19 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.315, top1 = 93.26%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.41 ms.
cifar100       train : [loss = 0.062, top1 = 98.93%], valid : [loss = 1.399, top1 = 69.93%], test : [loss = 1.362, top1 = 69.83%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.17 ms.
ImageNet16-120 train : [loss = 1.535, top1 = 58.54%], valid : [loss = 2.150, top1 = 45.40%], test : [loss = 2.156, top1 = 45.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 79.12%], valid : [loss = 0.685, top1 = 76.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2218/15625) 002218-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.631, top1 = 86.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.391, top1 = 90.52%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.65 ms.
cifar100       train : [loss = 0.508, top1 = 85.09%], valid : [loss = 1.403, top1 = 64.32%], test : [loss = 1.408, top1 = 63.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.02%], valid : [loss = 2.557, top1 = 35.59%], test : [loss = 2.604, top1 = 35.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2219/15625) 002219-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.568, top1 = 87.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.017, top1 = 99.62%], test  : [loss = 0.381, top1 = 91.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.403, top1 = 88.55%], valid : [loss = 1.392, top1 = 65.67%], test : [loss = 1.383, top1 = 65.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.87%], valid : [loss = 2.502, top1 = 36.74%], test : [loss = 2.534, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.63%], valid : [loss = 0.829, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2220/15625) 002220-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.52%], valid : [loss = 0.855, top1 = 75.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.310, top1 = 89.16%], test  : [loss = 0.618, top1 = 80.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 1.374, top1 = 61.34%], valid : [loss = 1.940, top1 = 49.68%], test : [loss = 1.953, top1 = 49.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.479, top1 = 17.68%], valid : [loss = 3.511, top1 = 17.46%], test : [loss = 3.509, top1 = 16.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2221/15625) 002221-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.00%], valid : [loss = 0.571, top1 = 86.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.90 ms.
cifar10        train : [loss = 0.066, top1 = 97.88%], test  : [loss = 0.386, top1 = 89.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.53 ms.
cifar100       train : [loss = 0.667, top1 = 80.27%], valid : [loss = 1.326, top1 = 64.91%], test : [loss = 1.333, top1 = 64.39%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 2.346, top1 = 39.77%], valid : [loss = 2.484, top1 = 37.16%], test : [loss = 2.513, top1 = 36.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.63%], valid : [loss = 0.769, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2222/15625) 002222-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.14%], valid : [loss = 0.478, top1 = 84.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.91 ms.
cifar10        train : [loss = 0.300, top1 = 89.89%], test  : [loss = 0.396, top1 = 86.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.92 ms.
cifar100       train : [loss = 1.318, top1 = 63.46%], valid : [loss = 1.524, top1 = 57.85%], test : [loss = 1.504, top1 = 58.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.69%], valid : [loss = 2.905, top1 = 29.48%], test : [loss = 2.955, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2223/15625) 002223-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.19 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.48%], valid : [loss = 0.567, top1 = 87.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.372, top1 = 90.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.03 ms.
cifar100       train : [loss = 0.603, top1 = 82.41%], valid : [loss = 1.409, top1 = 63.10%], test : [loss = 1.405, top1 = 63.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 2.603, top1 = 33.97%], valid : [loss = 2.669, top1 = 32.41%], test : [loss = 2.689, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.86%], valid : [loss = 0.964, top1 = 65.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2224/15625) 002224-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.465, top1 = 90.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.42 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.312, top1 = 93.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.66 ms.
cifar100       train : [loss = 0.098, top1 = 98.22%], valid : [loss = 1.306, top1 = 69.92%], test : [loss = 1.310, top1 = 69.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.40 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 55.14%], valid : [loss = 2.225, top1 = 43.63%], test : [loss = 2.237, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 81.92%], valid : [loss = 0.632, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2225/15625) 002225-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.420, top1 = 90.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.285, top1 = 93.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.87 ms.
cifar100       train : [loss = 0.057, top1 = 99.26%], valid : [loss = 1.340, top1 = 70.55%], test : [loss = 1.309, top1 = 70.87%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.21 ms.
ImageNet16-120 train : [loss = 1.494, top1 = 59.52%], valid : [loss = 2.208, top1 = 44.64%], test : [loss = 2.229, top1 = 44.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.344, top1 = 88.33%], valid : [loss = 0.476, top1 = 83.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2226/15625) 002226-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.59%], valid : [loss = 1.103, top1 = 63.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10        train : [loss = 0.791, top1 = 72.15%], test  : [loss = 0.919, top1 = 68.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.48 ms.
cifar100       train : [loss = 2.150, top1 = 43.81%], valid : [loss = 2.432, top1 = 39.34%], test : [loss = 2.429, top1 = 39.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 3.768, top1 = 13.90%], valid : [loss = 3.817, top1 = 13.99%], test : [loss = 3.830, top1 = 13.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.359, top1 = 50.69%], valid : [loss = 1.401, top1 = 49.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2227/15625) 002227-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.534, top1 = 89.51%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.36 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.316, top1 = 93.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.52 ms.
cifar100       train : [loss = 0.074, top1 = 98.83%], valid : [loss = 1.365, top1 = 69.59%], test : [loss = 1.384, top1 = 68.77%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.997, top1 = 47.56%], valid : [loss = 2.362, top1 = 39.99%], test : [loss = 2.357, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.78%], valid : [loss = 0.765, top1 = 73.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2228/15625) 002228-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.615, top1 = 87.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.65 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.396, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.25 ms.
cifar100       train : [loss = 0.213, top1 = 94.95%], valid : [loss = 1.468, top1 = 66.23%], test : [loss = 1.453, top1 = 65.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 46.05%], valid : [loss = 2.496, top1 = 37.70%], test : [loss = 2.520, top1 = 37.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2229/15625) 002229-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.547, top1 = 88.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.20 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.360, top1 = 92.44%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.44 ms.
cifar100       train : [loss = 0.092, top1 = 98.00%], valid : [loss = 1.437, top1 = 68.58%], test : [loss = 1.464, top1 = 68.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.39 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 42.81%], valid : [loss = 2.432, top1 = 38.30%], test : [loss = 2.433, top1 = 37.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.42%], valid : [loss = 0.901, top1 = 68.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2230/15625) 002230-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.34%], valid : [loss = 0.745, top1 = 74.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.594, top1 = 79.29%], test  : [loss = 0.660, top1 = 77.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.12 ms.
cifar100       train : [loss = 2.011, top1 = 45.80%], valid : [loss = 2.167, top1 = 42.78%], test : [loss = 2.154, top1 = 42.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 3.248, top1 = 22.00%], valid : [loss = 3.254, top1 = 22.48%], test : [loss = 3.280, top1 = 22.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.73%], valid : [loss = 1.334, top1 = 52.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2231/15625) 002231-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.61 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.544, top1 = 89.40%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.352, top1 = 92.12%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.93 ms.
cifar100       train : [loss = 0.163, top1 = 96.24%], valid : [loss = 1.275, top1 = 69.33%], test : [loss = 1.297, top1 = 69.41%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.08%], valid : [loss = 2.193, top1 = 43.60%], test : [loss = 2.210, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.34%], valid : [loss = 0.770, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2232/15625) 002232-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.04%], valid : [loss = 0.865, top1 = 71.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.47 ms.
cifar10        train : [loss = 0.560, top1 = 80.44%], test  : [loss = 0.719, top1 = 75.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.57 ms.
cifar100       train : [loss = 1.782, top1 = 51.95%], valid : [loss = 2.063, top1 = 46.93%], test : [loss = 2.066, top1 = 46.75%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.58 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.78%], valid : [loss = 3.647, top1 = 16.20%], test : [loss = 3.673, top1 = 15.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2233/15625) 002233-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.34%], valid : [loss = 0.600, top1 = 85.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10        train : [loss = 0.071, top1 = 97.88%], test  : [loss = 0.413, top1 = 88.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.72 ms.
cifar100       train : [loss = 0.697, top1 = 79.71%], valid : [loss = 1.359, top1 = 63.53%], test : [loss = 1.354, top1 = 63.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.05%], valid : [loss = 2.658, top1 = 33.82%], test : [loss = 2.684, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.95%], valid : [loss = 0.777, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2234/15625) 002234-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.24%], valid : [loss = 0.837, top1 = 73.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.55 ms.
cifar10        train : [loss = 0.427, top1 = 85.14%], test  : [loss = 0.643, top1 = 78.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.58 ms.
cifar100       train : [loss = 1.334, top1 = 62.20%], valid : [loss = 1.955, top1 = 49.22%], test : [loss = 1.982, top1 = 49.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 3.805, top1 = 12.28%], valid : [loss = 3.817, top1 = 12.68%], test : [loss = 3.818, top1 = 11.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.408, top1 = 48.23%], valid : [loss = 1.437, top1 = 47.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2235/15625) 002235-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.559, top1 = 88.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.34 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.345, top1 = 92.36%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.60 ms.
cifar100       train : [loss = 0.116, top1 = 97.40%], valid : [loss = 1.412, top1 = 68.41%], test : [loss = 1.416, top1 = 68.47%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 35.53%], valid : [loss = 2.681, top1 = 32.54%], test : [loss = 2.685, top1 = 32.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 64.62%], valid : [loss = 0.994, top1 = 64.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2236/15625) 002236-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.72%], valid : [loss = 0.553, top1 = 88.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.32 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.360, top1 = 91.72%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.66 ms.
cifar100       train : [loss = 0.263, top1 = 92.59%], valid : [loss = 1.351, top1 = 67.31%], test : [loss = 1.350, top1 = 67.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.20%], valid : [loss = 2.616, top1 = 33.77%], test : [loss = 2.626, top1 = 33.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 65.01%], valid : [loss = 1.002, top1 = 64.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2237/15625) 002237-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.39%], valid : [loss = 0.704, top1 = 84.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10        train : [loss = 0.051, top1 = 98.47%], test  : [loss = 0.453, top1 = 88.45%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.77 ms.
cifar100       train : [loss = 0.630, top1 = 81.52%], valid : [loss = 1.499, top1 = 61.91%], test : [loss = 1.511, top1 = 62.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 33.05%], valid : [loss = 2.847, top1 = 30.24%], test : [loss = 2.878, top1 = 30.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2238/15625) 002238-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.526, top1 = 89.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.341, top1 = 92.85%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.69 ms.
cifar100       train : [loss = 0.121, top1 = 97.40%], valid : [loss = 1.286, top1 = 70.03%], test : [loss = 1.299, top1 = 69.83%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.88 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.51%], valid : [loss = 2.161, top1 = 44.63%], test : [loss = 2.176, top1 = 44.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.750, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2239/15625) 002239-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.561, top1 = 87.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.385, top1 = 91.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.08 ms.
cifar100       train : [loss = 0.403, top1 = 88.53%], valid : [loss = 1.381, top1 = 65.41%], test : [loss = 1.388, top1 = 65.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.41%], valid : [loss = 2.481, top1 = 37.60%], test : [loss = 2.504, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.37%], valid : [loss = 0.761, top1 = 73.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2240/15625) 002240-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.531, top1 = 88.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.336, top1 = 91.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.26 ms.
cifar100       train : [loss = 0.344, top1 = 90.63%], valid : [loss = 1.278, top1 = 66.67%], test : [loss = 1.267, top1 = 67.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.52%], valid : [loss = 2.410, top1 = 38.70%], test : [loss = 2.412, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2241/15625) 002241-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.90%], valid : [loss = 0.473, top1 = 84.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10        train : [loss = 0.299, top1 = 90.06%], test  : [loss = 0.395, top1 = 86.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.72 ms.
cifar100       train : [loss = 1.334, top1 = 63.05%], valid : [loss = 1.548, top1 = 57.50%], test : [loss = 1.524, top1 = 57.87%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.66%], valid : [loss = 2.902, top1 = 29.76%], test : [loss = 2.939, top1 = 28.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2242/15625) 002242-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.643, top1 = 86.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.419, top1 = 90.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.19 ms.
cifar100       train : [loss = 0.192, top1 = 95.36%], valid : [loss = 1.620, top1 = 64.20%], test : [loss = 1.601, top1 = 64.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.020, top1 = 47.19%], valid : [loss = 2.432, top1 = 39.03%], test : [loss = 2.448, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.54%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2243/15625) 002243-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.306, top1 = 89.39%], valid : [loss = 0.542, top1 = 82.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.291, top1 = 90.01%], test  : [loss = 0.424, top1 = 85.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.44 ms.
cifar100       train : [loss = 1.316, top1 = 63.02%], valid : [loss = 1.593, top1 = 56.67%], test : [loss = 1.595, top1 = 56.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 3.061, top1 = 25.86%], valid : [loss = 3.065, top1 = 26.09%], test : [loss = 3.139, top1 = 25.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.40%], valid : [loss = 1.236, top1 = 55.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2244/15625) 002244-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.57%], valid : [loss = 0.576, top1 = 81.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 0.285, top1 = 90.11%], test  : [loss = 0.435, top1 = 85.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 1.479, top1 = 58.50%], valid : [loss = 1.729, top1 = 53.42%], test : [loss = 1.716, top1 = 53.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.937, top1 = 27.91%], valid : [loss = 2.951, top1 = 27.91%], test : [loss = 3.007, top1 = 26.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2245/15625) 002245-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.455, top1 = 89.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.308, top1 = 92.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.170, top1 = 96.24%], valid : [loss = 1.261, top1 = 69.60%], test : [loss = 1.259, top1 = 69.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.12%], valid : [loss = 2.237, top1 = 42.81%], test : [loss = 2.270, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.48%], valid : [loss = 0.562, top1 = 80.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2246/15625) 002246-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.65 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.487, top1 = 90.13%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.21 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.293, top1 = 93.67%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.59 ms.
cifar100       train : [loss = 0.065, top1 = 99.08%], valid : [loss = 1.308, top1 = 70.23%], test : [loss = 1.311, top1 = 70.53%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.565, top1 = 57.71%], valid : [loss = 2.154, top1 = 44.81%], test : [loss = 2.169, top1 = 45.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 80.94%], valid : [loss = 0.627, top1 = 78.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2247/15625) 002247-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.72%], valid : [loss = 0.625, top1 = 86.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10        train : [loss = 0.037, top1 = 98.99%], test  : [loss = 0.416, top1 = 89.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.80 ms.
cifar100       train : [loss = 0.437, top1 = 87.88%], valid : [loss = 1.401, top1 = 64.33%], test : [loss = 1.382, top1 = 64.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.07%], valid : [loss = 2.579, top1 = 35.78%], test : [loss = 2.595, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.11%], valid : [loss = 0.751, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2248/15625) 002248-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.32%], valid : [loss = 0.600, top1 = 84.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.20 ms.
cifar10        train : [loss = 0.127, top1 = 95.70%], test  : [loss = 0.421, top1 = 87.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.31 ms.
cifar100       train : [loss = 0.732, top1 = 78.41%], valid : [loss = 1.565, top1 = 59.29%], test : [loss = 1.574, top1 = 59.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 3.208, top1 = 21.85%], valid : [loss = 3.225, top1 = 21.71%], test : [loss = 3.257, top1 = 20.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.102, top1 = 59.76%], valid : [loss = 1.131, top1 = 59.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2249/15625) 002249-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.95%], valid : [loss = 0.580, top1 = 86.33%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.46 ms.
cifar10        train : [loss = 0.063, top1 = 98.02%], test  : [loss = 0.390, top1 = 89.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.74 ms.
cifar100       train : [loss = 0.587, top1 = 83.07%], valid : [loss = 1.411, top1 = 63.92%], test : [loss = 1.402, top1 = 63.56%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.50%], valid : [loss = 2.508, top1 = 36.52%], test : [loss = 2.528, top1 = 36.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.97%], valid : [loss = 0.887, top1 = 68.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2250/15625) 002250-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.542, top1 = 88.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.346, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.10 ms.
cifar100       train : [loss = 0.440, top1 = 87.23%], valid : [loss = 1.278, top1 = 66.50%], test : [loss = 1.264, top1 = 67.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.42%], valid : [loss = 2.372, top1 = 39.66%], test : [loss = 2.382, top1 = 39.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2251/15625) 002251-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.211, top1 = 92.80%], valid : [loss = 0.884, top1 = 75.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.66 ms.
cifar10        train : [loss = 0.218, top1 = 92.44%], test  : [loss = 0.562, top1 = 82.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.81 ms.
cifar100       train : [loss = 1.126, top1 = 67.72%], valid : [loss = 1.813, top1 = 52.92%], test : [loss = 1.823, top1 = 52.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 3.145, top1 = 24.30%], valid : [loss = 3.269, top1 = 21.94%], test : [loss = 3.280, top1 = 22.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.160, top1 = 57.94%], valid : [loss = 1.219, top1 = 56.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2252/15625) 002252-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.483, top1 = 89.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.317, top1 = 91.51%], valid : [loss = 1.260, top1 = 67.59%], test : [loss = 1.255, top1 = 67.75%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.67%], valid : [loss = 2.309, top1 = 40.91%], test : [loss = 2.337, top1 = 40.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 81.92%], valid : [loss = 0.593, top1 = 79.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2253/15625) 002253-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.30 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.60%], valid : [loss = 0.468, top1 = 86.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.37 ms.
cifar10        train : [loss = 0.127, top1 = 96.07%], test  : [loss = 0.343, top1 = 89.10%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.21 ms.
cifar100       train : [loss = 0.753, top1 = 78.88%], valid : [loss = 1.278, top1 = 64.49%], test : [loss = 1.268, top1 = 64.41%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.75 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.89%], valid : [loss = 2.592, top1 = 34.78%], test : [loss = 2.592, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.80%], valid : [loss = 0.890, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2254/15625) 002254-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.424, top1 = 91.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.05 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.11 ms.
cifar100       train : [loss = 0.067, top1 = 99.07%], valid : [loss = 1.351, top1 = 70.21%], test : [loss = 1.326, top1 = 70.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.551, top1 = 58.08%], valid : [loss = 2.258, top1 = 43.33%], test : [loss = 2.279, top1 = 43.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.77%], valid : [loss = 0.541, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2255/15625) 002255-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.578, top1 = 88.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.373, top1 = 91.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.09 ms.
cifar100       train : [loss = 0.161, top1 = 96.57%], valid : [loss = 1.402, top1 = 67.65%], test : [loss = 1.437, top1 = 66.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.35%], valid : [loss = 2.484, top1 = 38.28%], test : [loss = 2.497, top1 = 38.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.20%], valid : [loss = 0.722, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2256/15625) 002256-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.311, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.20 ms.
cifar100       train : [loss = 0.319, top1 = 91.43%], valid : [loss = 1.235, top1 = 68.13%], test : [loss = 1.245, top1 = 68.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.64%], valid : [loss = 2.317, top1 = 40.96%], test : [loss = 2.346, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.03%], valid : [loss = 0.625, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2257/15625) 002257-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.416, top1 = 90.69%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.269, top1 = 93.49%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.71 ms.
cifar100       train : [loss = 0.124, top1 = 97.54%], valid : [loss = 1.263, top1 = 70.58%], test : [loss = 1.234, top1 = 70.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.71 ms.
ImageNet16-120 train : [loss = 1.678, top1 = 55.03%], valid : [loss = 2.184, top1 = 44.89%], test : [loss = 2.208, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.514, top1 = 82.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2258/15625) 002258-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.37%], valid : [loss = 0.466, top1 = 85.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.160, top1 = 94.71%], test  : [loss = 0.347, top1 = 88.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.36 ms.
cifar100       train : [loss = 1.009, top1 = 71.39%], valid : [loss = 1.363, top1 = 62.15%], test : [loss = 1.343, top1 = 62.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.70%], valid : [loss = 2.703, top1 = 33.01%], test : [loss = 2.712, top1 = 31.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2259/15625) 002259-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.626, top1 = 87.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.423, top1 = 90.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.59 ms.
cifar100       train : [loss = 0.156, top1 = 96.96%], valid : [loss = 1.473, top1 = 66.30%], test : [loss = 1.452, top1 = 66.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.23%], valid : [loss = 2.521, top1 = 37.08%], test : [loss = 2.560, top1 = 37.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.78%], valid : [loss = 0.752, top1 = 74.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2260/15625) 002260-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.99%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.60 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.327, top1 = 93.06%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.03 ms.
cifar100       train : [loss = 0.082, top1 = 98.64%], valid : [loss = 1.307, top1 = 69.65%], test : [loss = 1.286, top1 = 70.15%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 1.761, top1 = 52.98%], valid : [loss = 2.204, top1 = 43.28%], test : [loss = 2.196, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.91%], valid : [loss = 0.747, top1 = 73.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2261/15625) 002261-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.54%], valid : [loss = 0.567, top1 = 87.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10        train : [loss = 0.031, top1 = 99.08%], test  : [loss = 0.353, top1 = 91.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.40 ms.
cifar100       train : [loss = 0.544, top1 = 84.35%], valid : [loss = 1.374, top1 = 63.79%], test : [loss = 1.357, top1 = 64.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.48%], valid : [loss = 2.627, top1 = 34.02%], test : [loss = 2.641, top1 = 33.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.42%], valid : [loss = 0.941, top1 = 66.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2262/15625) 002262-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.566, top1 = 87.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.387, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.61 ms.
cifar100       train : [loss = 0.382, top1 = 89.24%], valid : [loss = 1.395, top1 = 65.60%], test : [loss = 1.383, top1 = 66.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.74%], valid : [loss = 2.470, top1 = 37.52%], test : [loss = 2.498, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.21%], valid : [loss = 0.744, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2263/15625) 002263-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.570, top1 = 88.83%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.380, top1 = 92.48%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.25 ms.
cifar100       train : [loss = 0.057, top1 = 99.24%], valid : [loss = 1.486, top1 = 68.25%], test : [loss = 1.495, top1 = 68.27%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 1.783, top1 = 52.68%], valid : [loss = 2.417, top1 = 39.47%], test : [loss = 2.425, top1 = 40.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.12%], valid : [loss = 0.692, top1 = 76.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2264/15625) 002264-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.442, top1 = 89.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.87 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.292, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.14 ms.
cifar100       train : [loss = 0.197, top1 = 95.43%], valid : [loss = 1.253, top1 = 69.17%], test : [loss = 1.265, top1 = 69.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.50%], valid : [loss = 2.243, top1 = 42.68%], test : [loss = 2.286, top1 = 42.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.22%], valid : [loss = 0.527, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2265/15625) 002265-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.23%], valid : [loss = 0.473, top1 = 84.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.52 ms.
cifar10        train : [loss = 0.298, top1 = 90.10%], test  : [loss = 0.396, top1 = 86.70%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.76 ms.
cifar100       train : [loss = 1.324, top1 = 63.23%], valid : [loss = 1.530, top1 = 57.90%], test : [loss = 1.516, top1 = 58.25%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.66 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.86%], valid : [loss = 2.874, top1 = 29.94%], test : [loss = 2.946, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2266/15625) 002266-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.53%], valid : [loss = 0.868, top1 = 71.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.64 ms.
cifar10        train : [loss = 0.543, top1 = 81.10%], test  : [loss = 0.710, top1 = 75.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.50 ms.
cifar100       train : [loss = 1.761, top1 = 52.58%], valid : [loss = 2.039, top1 = 47.34%], test : [loss = 2.048, top1 = 47.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 16.95%], valid : [loss = 3.631, top1 = 16.41%], test : [loss = 3.674, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2267/15625) 002267-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.304, top1 = 89.52%], valid : [loss = 0.567, top1 = 81.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.272, top1 = 90.68%], test  : [loss = 0.415, top1 = 86.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.70 ms.
cifar100       train : [loss = 1.404, top1 = 60.43%], valid : [loss = 1.670, top1 = 54.56%], test : [loss = 1.660, top1 = 54.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 2.805, top1 = 30.60%], valid : [loss = 2.828, top1 = 30.22%], test : [loss = 2.852, top1 = 30.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.42%], valid : [loss = 1.032, top1 = 63.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2268/15625) 002268-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.530, top1 = 88.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.345, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.91 ms.
cifar100       train : [loss = 0.325, top1 = 91.16%], valid : [loss = 1.301, top1 = 67.33%], test : [loss = 1.312, top1 = 66.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.97%], valid : [loss = 2.428, top1 = 38.93%], test : [loss = 2.440, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.96%], valid : [loss = 0.839, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2269/15625) 002269-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.505, top1 = 89.49%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.337, top1 = 92.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.89 ms.
cifar100       train : [loss = 0.153, top1 = 96.57%], valid : [loss = 1.312, top1 = 69.09%], test : [loss = 1.314, top1 = 69.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.69%], valid : [loss = 2.213, top1 = 43.12%], test : [loss = 2.237, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.88%], valid : [loss = 0.724, top1 = 75.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2270/15625) 002270-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.092, top1 = 96.95%], valid : [loss = 0.616, top1 = 84.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.109, top1 = 96.30%], test  : [loss = 0.416, top1 = 88.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.632, top1 = 81.30%], valid : [loss = 1.524, top1 = 61.16%], test : [loss = 1.532, top1 = 61.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 3.124, top1 = 23.45%], valid : [loss = 3.163, top1 = 22.70%], test : [loss = 3.196, top1 = 22.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.18%], valid : [loss = 1.082, top1 = 61.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2271/15625) 002271-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.95%], valid : [loss = 0.701, top1 = 83.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.93 ms.
cifar10        train : [loss = 0.085, top1 = 97.26%], test  : [loss = 0.477, top1 = 87.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.34 ms.
cifar100       train : [loss = 0.799, top1 = 76.65%], valid : [loss = 1.520, top1 = 60.47%], test : [loss = 1.515, top1 = 60.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 30.41%], valid : [loss = 2.933, top1 = 28.12%], test : [loss = 2.969, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2272/15625) 002272-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.507, top1 = 89.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10        train : [loss = 0.005, top1 = 99.87%], test  : [loss = 0.324, top1 = 93.13%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.15 ms.
cifar100       train : [loss = 0.111, top1 = 97.70%], valid : [loss = 1.301, top1 = 69.97%], test : [loss = 1.304, top1 = 69.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.96 ms.
ImageNet16-120 train : [loss = 1.639, top1 = 55.85%], valid : [loss = 2.158, top1 = 44.83%], test : [loss = 2.186, top1 = 44.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.68%], valid : [loss = 0.636, top1 = 78.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2273/15625) 002273-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.335, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.98 ms.
cifar100       train : [loss = 0.280, top1 = 92.51%], valid : [loss = 1.263, top1 = 67.91%], test : [loss = 1.281, top1 = 67.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.58%], valid : [loss = 2.319, top1 = 40.20%], test : [loss = 2.314, top1 = 41.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.76%], valid : [loss = 0.733, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2274/15625) 002274-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.568, top1 = 88.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.374, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.54 ms.
cifar100       train : [loss = 0.186, top1 = 95.31%], valid : [loss = 1.400, top1 = 66.97%], test : [loss = 1.392, top1 = 67.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.42%], valid : [loss = 2.421, top1 = 38.33%], test : [loss = 2.455, top1 = 37.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.10%], valid : [loss = 0.955, top1 = 65.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2275/15625) 002275-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.315, top1 = 91.57%], valid : [loss = 1.241, top1 = 67.84%], test : [loss = 1.253, top1 = 67.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.55%], valid : [loss = 2.328, top1 = 40.40%], test : [loss = 2.348, top1 = 40.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2276/15625) 002276-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.487, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.294, top1 = 92.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.321, top1 = 91.38%], valid : [loss = 1.291, top1 = 66.87%], test : [loss = 1.243, top1 = 67.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.54%], valid : [loss = 2.296, top1 = 40.83%], test : [loss = 2.330, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2277/15625) 002277-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.30%], valid : [loss = 0.546, top1 = 86.86%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10        train : [loss = 0.066, top1 = 97.90%], test  : [loss = 0.366, top1 = 89.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.79 ms.
cifar100       train : [loss = 0.678, top1 = 80.16%], valid : [loss = 1.322, top1 = 64.58%], test : [loss = 1.316, top1 = 64.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.395, top1 = 38.85%], valid : [loss = 2.522, top1 = 35.93%], test : [loss = 2.557, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.22%], valid : [loss = 0.756, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2278/15625) 002278-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.510, top1 = 88.87%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.55 ms.
cifar10        train : [loss = 0.017, top1 = 99.54%], test  : [loss = 0.346, top1 = 91.77%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.59 ms.
cifar100       train : [loss = 0.283, top1 = 92.28%], valid : [loss = 1.305, top1 = 67.78%], test : [loss = 1.317, top1 = 67.39%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.11 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.99%], valid : [loss = 2.325, top1 = 40.68%], test : [loss = 2.368, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.37%], valid : [loss = 0.757, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2279/15625) 002279-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.34 ms.
cifar10-valid  train : [loss = 0.262, top1 = 91.31%], valid : [loss = 0.474, top1 = 84.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.41 ms.
cifar10        train : [loss = 0.302, top1 = 89.95%], test  : [loss = 0.394, top1 = 86.77%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 1.328, top1 = 63.26%], valid : [loss = 1.518, top1 = 57.97%], test : [loss = 1.508, top1 = 58.55%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.27 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.73%], valid : [loss = 2.892, top1 = 30.18%], test : [loss = 2.948, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2280/15625) 002280-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.481, top1 = 89.56%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.319, top1 = 92.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.94 ms.
cifar100       train : [loss = 0.235, top1 = 93.93%], valid : [loss = 1.247, top1 = 69.36%], test : [loss = 1.241, top1 = 69.44%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.45 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.33%], valid : [loss = 2.240, top1 = 42.73%], test : [loss = 2.252, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.82%], valid : [loss = 0.637, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2281/15625) 002281-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.452, top1 = 89.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.307, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.86 ms.
cifar100       train : [loss = 0.318, top1 = 91.43%], valid : [loss = 1.310, top1 = 67.05%], test : [loss = 1.316, top1 = 67.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.37%], valid : [loss = 2.369, top1 = 39.60%], test : [loss = 2.411, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.553, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2282/15625) 002282-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.541, top1 = 89.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.27 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.346, top1 = 92.89%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.52 ms.
cifar100       train : [loss = 0.082, top1 = 98.55%], valid : [loss = 1.411, top1 = 68.83%], test : [loss = 1.399, top1 = 69.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.03%], valid : [loss = 2.347, top1 = 40.98%], test : [loss = 2.330, top1 = 40.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.60%], valid : [loss = 0.659, top1 = 77.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2283/15625) 002283-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.490, top1 = 82.86%], valid : [loss = 0.646, top1 = 78.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10        train : [loss = 0.510, top1 = 82.45%], test  : [loss = 0.585, top1 = 80.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 1.698, top1 = 54.17%], valid : [loss = 1.863, top1 = 50.08%], test : [loss = 1.874, top1 = 50.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.30%], valid : [loss = 3.305, top1 = 21.84%], test : [loss = 3.346, top1 = 21.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2284/15625) 002284-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.29 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2285/15625) 002285-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.58%], valid : [loss = 0.529, top1 = 88.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10        train : [loss = 0.030, top1 = 99.07%], test  : [loss = 0.350, top1 = 91.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.78 ms.
cifar100       train : [loss = 0.461, top1 = 86.50%], valid : [loss = 1.259, top1 = 66.74%], test : [loss = 1.283, top1 = 66.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.84%], valid : [loss = 2.386, top1 = 39.68%], test : [loss = 2.392, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.886, top1 = 67.98%], valid : [loss = 0.943, top1 = 66.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2286/15625) 002286-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.97%], valid : [loss = 0.480, top1 = 84.23%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10        train : [loss = 0.301, top1 = 90.00%], test  : [loss = 0.399, top1 = 86.61%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.98 ms.
cifar100       train : [loss = 1.335, top1 = 62.97%], valid : [loss = 1.543, top1 = 57.77%], test : [loss = 1.518, top1 = 58.11%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.14 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.62%], valid : [loss = 2.905, top1 = 29.21%], test : [loss = 2.953, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2287/15625) 002287-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.29%], valid : [loss = 0.731, top1 = 83.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.064, top1 = 98.03%], test  : [loss = 0.457, top1 = 87.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.68 ms.
cifar100       train : [loss = 0.582, top1 = 83.33%], valid : [loss = 1.742, top1 = 57.69%], test : [loss = 1.748, top1 = 57.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.448, top1 = 37.66%], valid : [loss = 2.739, top1 = 31.95%], test : [loss = 2.787, top1 = 31.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.56%], valid : [loss = 0.881, top1 = 68.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2288/15625) 002288-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.582, top1 = 87.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.53 ms.
cifar10        train : [loss = 0.041, top1 = 98.80%], test  : [loss = 0.384, top1 = 90.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.554, top1 = 83.60%], valid : [loss = 1.406, top1 = 64.08%], test : [loss = 1.404, top1 = 63.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.74%], valid : [loss = 2.616, top1 = 33.88%], test : [loss = 2.675, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2289/15625) 002289-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.52%], valid : [loss = 0.556, top1 = 87.14%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.91 ms.
cifar10        train : [loss = 0.043, top1 = 98.72%], test  : [loss = 0.363, top1 = 90.33%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.39 ms.
cifar100       train : [loss = 0.524, top1 = 84.76%], valid : [loss = 1.305, top1 = 65.47%], test : [loss = 1.292, top1 = 65.80%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.03%], valid : [loss = 2.415, top1 = 38.36%], test : [loss = 2.449, top1 = 38.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.40%], valid : [loss = 0.721, top1 = 75.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2290/15625) 002290-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.608, top1 = 86.47%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.97 ms.
cifar10        train : [loss = 0.026, top1 = 99.38%], test  : [loss = 0.428, top1 = 89.47%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.27 ms.
cifar100       train : [loss = 0.378, top1 = 90.01%], valid : [loss = 1.422, top1 = 64.37%], test : [loss = 1.394, top1 = 64.90%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.46%], valid : [loss = 2.608, top1 = 35.58%], test : [loss = 2.622, top1 = 35.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.74%], valid : [loss = 0.772, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2291/15625) 002291-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.86%], valid : [loss = 0.779, top1 = 73.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.555, top1 = 80.64%], test  : [loss = 0.606, top1 = 79.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 2.061, top1 = 44.32%], valid : [loss = 2.168, top1 = 42.35%], test : [loss = 2.154, top1 = 43.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 3.262, top1 = 21.61%], valid : [loss = 3.230, top1 = 22.41%], test : [loss = 3.264, top1 = 21.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.52%], valid : [loss = 1.241, top1 = 55.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2292/15625) 002292-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.546, top1 = 88.61%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.41 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.336, top1 = 92.75%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.03 ms.
cifar100       train : [loss = 0.085, top1 = 98.26%], valid : [loss = 1.414, top1 = 69.33%], test : [loss = 1.423, top1 = 68.69%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 2.149, top1 = 44.04%], valid : [loss = 2.405, top1 = 38.23%], test : [loss = 2.410, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 70.80%], valid : [loss = 0.857, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2293/15625) 002293-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.23%], valid : [loss = 0.680, top1 = 76.87%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.10 ms.
cifar10        train : [loss = 0.536, top1 = 81.26%], test  : [loss = 0.604, top1 = 79.30%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.37 ms.
cifar100       train : [loss = 1.734, top1 = 52.93%], valid : [loss = 1.866, top1 = 49.91%], test : [loss = 1.902, top1 = 49.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 3.388, top1 = 20.07%], valid : [loss = 3.367, top1 = 20.73%], test : [loss = 3.406, top1 = 19.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2294/15625) 002294-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.497, top1 = 88.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.305, top1 = 92.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 0.298, top1 = 92.11%], valid : [loss = 1.222, top1 = 68.70%], test : [loss = 1.225, top1 = 68.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.12%], valid : [loss = 2.226, top1 = 42.77%], test : [loss = 2.264, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.27%], valid : [loss = 0.650, top1 = 77.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2295/15625) 002295-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.468, top1 = 89.27%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.305, top1 = 92.57%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.59 ms.
cifar100       train : [loss = 0.321, top1 = 91.37%], valid : [loss = 1.247, top1 = 68.32%], test : [loss = 1.262, top1 = 67.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.77%], valid : [loss = 2.299, top1 = 40.50%], test : [loss = 2.341, top1 = 40.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.51%], valid : [loss = 0.613, top1 = 79.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2296/15625) 002296-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.39%], valid : [loss = 0.449, top1 = 86.48%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.61 ms.
cifar10        train : [loss = 0.152, top1 = 95.02%], test  : [loss = 0.336, top1 = 89.15%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.34 ms.
cifar100       train : [loss = 0.983, top1 = 72.10%], valid : [loss = 1.345, top1 = 62.16%], test : [loss = 1.335, top1 = 61.95%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.10%], valid : [loss = 2.685, top1 = 32.87%], test : [loss = 2.686, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2297/15625) 002297-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.49%], valid : [loss = 0.445, top1 = 87.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.056, top1 = 98.60%], test  : [loss = 0.315, top1 = 90.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.97 ms.
cifar100       train : [loss = 0.592, top1 = 83.64%], valid : [loss = 1.238, top1 = 66.30%], test : [loss = 1.215, top1 = 66.53%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.16%], valid : [loss = 2.461, top1 = 37.90%], test : [loss = 2.487, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2298/15625) 002298-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.67%], valid : [loss = 0.554, top1 = 87.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.364, top1 = 91.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.28 ms.
cifar100       train : [loss = 0.374, top1 = 89.51%], valid : [loss = 1.322, top1 = 66.15%], test : [loss = 1.289, top1 = 66.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.73 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.74%], valid : [loss = 2.417, top1 = 38.77%], test : [loss = 2.439, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.84%], valid : [loss = 0.922, top1 = 66.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2299/15625) 002299-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.14 ms.
cifar10-valid  train : [loss = 0.873, top1 = 69.74%], valid : [loss = 0.917, top1 = 68.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.61 ms.
cifar10        train : [loss = 0.832, top1 = 71.57%], test  : [loss = 0.839, top1 = 70.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.95 ms.
cifar100       train : [loss = 2.323, top1 = 40.67%], valid : [loss = 2.382, top1 = 38.57%], test : [loss = 2.374, top1 = 38.97%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.56 ms.
ImageNet16-120 train : [loss = 3.492, top1 = 18.40%], valid : [loss = 3.478, top1 = 18.87%], test : [loss = 3.486, top1 = 18.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.717, top1 = 36.06%], valid : [loss = 1.723, top1 = 35.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2300/15625) 002300-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.574, top1 = 87.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.393, top1 = 91.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.89 ms.
cifar100       train : [loss = 0.398, top1 = 88.77%], valid : [loss = 1.406, top1 = 65.26%], test : [loss = 1.374, top1 = 65.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 41.00%], valid : [loss = 2.515, top1 = 37.06%], test : [loss = 2.534, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2301/15625) 002301-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.578, top1 = 88.48%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.389, top1 = 91.92%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.14 ms.
cifar100       train : [loss = 0.088, top1 = 98.51%], valid : [loss = 1.483, top1 = 67.74%], test : [loss = 1.492, top1 = 67.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.95 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.74%], valid : [loss = 2.432, top1 = 39.93%], test : [loss = 2.454, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.03%], valid : [loss = 0.767, top1 = 73.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2302/15625) 002302-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.549, top1 = 89.18%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.23 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.369, top1 = 92.50%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.72 ms.
cifar100       train : [loss = 0.105, top1 = 98.06%], valid : [loss = 1.410, top1 = 68.18%], test : [loss = 1.467, top1 = 68.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.48%], valid : [loss = 2.439, top1 = 39.37%], test : [loss = 2.482, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.31%], valid : [loss = 0.685, top1 = 76.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2303/15625) 002303-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.569, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.396, top1 = 91.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.404, top1 = 88.52%], valid : [loss = 1.377, top1 = 65.44%], test : [loss = 1.374, top1 = 65.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.67%], valid : [loss = 2.521, top1 = 36.69%], test : [loss = 2.541, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2304/15625) 002304-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.03%], valid : [loss = 0.486, top1 = 84.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.307, top1 = 89.75%], test  : [loss = 0.403, top1 = 86.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.70 ms.
cifar100       train : [loss = 1.325, top1 = 63.39%], valid : [loss = 1.536, top1 = 58.44%], test : [loss = 1.505, top1 = 58.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.906, top1 = 29.01%], valid : [loss = 2.886, top1 = 29.73%], test : [loss = 2.947, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2305/15625) 002305-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.217, top1 = 92.60%], valid : [loss = 0.545, top1 = 83.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.222, top1 = 92.45%], test  : [loss = 0.405, top1 = 87.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.53 ms.
cifar100       train : [loss = 1.297, top1 = 63.23%], valid : [loss = 1.573, top1 = 57.05%], test : [loss = 1.575, top1 = 56.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.731, top1 = 31.93%], valid : [loss = 2.766, top1 = 31.22%], test : [loss = 2.805, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.56%], valid : [loss = 0.953, top1 = 66.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2306/15625) 002306-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.26%], valid : [loss = 0.550, top1 = 83.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10        train : [loss = 0.193, top1 = 93.48%], test  : [loss = 0.403, top1 = 87.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.65 ms.
cifar100       train : [loss = 1.260, top1 = 64.14%], valid : [loss = 1.557, top1 = 57.66%], test : [loss = 1.553, top1 = 57.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.42 ms.
ImageNet16-120 train : [loss = 2.713, top1 = 32.36%], valid : [loss = 2.726, top1 = 32.43%], test : [loss = 2.799, top1 = 31.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2307/15625) 002307-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.509, top1 = 89.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.320, top1 = 92.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.49 ms.
cifar100       train : [loss = 0.253, top1 = 93.21%], valid : [loss = 1.234, top1 = 69.56%], test : [loss = 1.257, top1 = 69.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 1.881, top1 = 50.25%], valid : [loss = 2.234, top1 = 42.10%], test : [loss = 2.249, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.65%], valid : [loss = 0.665, top1 = 77.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2308/15625) 002308-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.238, top1 = 91.88%], valid : [loss = 0.555, top1 = 83.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.229, top1 = 92.16%], test  : [loss = 0.401, top1 = 86.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.316, top1 = 62.74%], valid : [loss = 1.606, top1 = 56.47%], test : [loss = 1.601, top1 = 56.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.790, top1 = 30.86%], valid : [loss = 2.802, top1 = 30.48%], test : [loss = 2.836, top1 = 29.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.33%], valid : [loss = 1.005, top1 = 64.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2309/15625) 002309-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.225, top1 = 92.30%], valid : [loss = 0.495, top1 = 84.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.204, top1 = 92.97%], test  : [loss = 0.378, top1 = 87.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 1.237, top1 = 64.97%], valid : [loss = 1.573, top1 = 57.34%], test : [loss = 1.522, top1 = 58.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.763, top1 = 31.43%], valid : [loss = 2.827, top1 = 30.80%], test : [loss = 2.826, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.36%], valid : [loss = 0.966, top1 = 65.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2310/15625) 002310-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.449, top1 = 89.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.326, top1 = 92.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.49 ms.
cifar100       train : [loss = 0.325, top1 = 91.15%], valid : [loss = 1.294, top1 = 66.98%], test : [loss = 1.326, top1 = 67.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.25%], valid : [loss = 2.403, top1 = 39.33%], test : [loss = 2.412, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2311/15625) 002311-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.53%], valid : [loss = 0.515, top1 = 83.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.04 ms.
cifar10        train : [loss = 0.244, top1 = 91.64%], test  : [loss = 0.394, top1 = 87.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 1.342, top1 = 62.10%], valid : [loss = 1.593, top1 = 56.71%], test : [loss = 1.593, top1 = 56.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.854, top1 = 29.56%], valid : [loss = 2.869, top1 = 29.42%], test : [loss = 2.917, top1 = 28.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 0.979, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2312/15625) 002312-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.66%], valid : [loss = 0.620, top1 = 84.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.096, top1 = 96.91%], test  : [loss = 0.404, top1 = 88.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.32 ms.
cifar100       train : [loss = 0.888, top1 = 74.11%], valid : [loss = 1.490, top1 = 60.08%], test : [loss = 1.476, top1 = 60.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.05%], valid : [loss = 2.775, top1 = 31.13%], test : [loss = 2.825, top1 = 30.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 70.21%], valid : [loss = 0.895, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2313/15625) 002313-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.514, top1 = 88.80%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.85 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.342, top1 = 91.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.49 ms.
cifar100       train : [loss = 0.348, top1 = 90.63%], valid : [loss = 1.268, top1 = 66.88%], test : [loss = 1.266, top1 = 67.50%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.53%], valid : [loss = 2.419, top1 = 38.27%], test : [loss = 2.437, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.76%], valid : [loss = 0.685, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2314/15625) 002314-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.48%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.12 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.329, top1 = 93.04%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.92 ms.
cifar100       train : [loss = 0.071, top1 = 98.91%], valid : [loss = 1.361, top1 = 69.25%], test : [loss = 1.367, top1 = 69.37%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.53%], valid : [loss = 2.360, top1 = 39.91%], test : [loss = 2.373, top1 = 39.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2315/15625) 002315-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.53%], valid : [loss = 0.567, top1 = 83.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10        train : [loss = 0.174, top1 = 94.14%], test  : [loss = 0.381, top1 = 87.67%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.13 ms.
cifar100       train : [loss = 1.169, top1 = 66.71%], valid : [loss = 1.505, top1 = 58.78%], test : [loss = 1.530, top1 = 58.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 34.98%], valid : [loss = 2.647, top1 = 33.47%], test : [loss = 2.701, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.94%], valid : [loss = 0.981, top1 = 65.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2316/15625) 002316-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.70%], valid : [loss = 0.606, top1 = 84.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10        train : [loss = 0.091, top1 = 96.99%], test  : [loss = 0.429, top1 = 88.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 0.709, top1 = 79.06%], valid : [loss = 1.534, top1 = 60.04%], test : [loss = 1.540, top1 = 60.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 3.193, top1 = 22.15%], valid : [loss = 3.205, top1 = 22.07%], test : [loss = 3.250, top1 = 21.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2317/15625) 002317-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.044, top1 = 99.01%], valid : [loss = 0.555, top1 = 85.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.81 ms.
cifar10        train : [loss = 0.062, top1 = 98.25%], test  : [loss = 0.338, top1 = 90.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.30 ms.
cifar100       train : [loss = 0.572, top1 = 83.62%], valid : [loss = 1.297, top1 = 65.70%], test : [loss = 1.305, top1 = 65.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.65%], valid : [loss = 2.444, top1 = 38.10%], test : [loss = 2.469, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.59%], valid : [loss = 0.911, top1 = 68.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2318/15625) 002318-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.17%], valid : [loss = 0.661, top1 = 77.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10        train : [loss = 0.543, top1 = 81.05%], test  : [loss = 0.593, top1 = 79.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.38 ms.
cifar100       train : [loss = 1.778, top1 = 51.79%], valid : [loss = 1.913, top1 = 49.60%], test : [loss = 1.943, top1 = 48.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.74 ms.
ImageNet16-120 train : [loss = 3.377, top1 = 20.17%], valid : [loss = 3.363, top1 = 20.77%], test : [loss = 3.391, top1 = 19.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.349, top1 = 51.06%], valid : [loss = 1.374, top1 = 50.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2319/15625) 002319-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.89%], valid : [loss = 0.634, top1 = 86.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.61 ms.
cifar10        train : [loss = 0.029, top1 = 99.30%], test  : [loss = 0.442, top1 = 89.07%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.30 ms.
cifar100       train : [loss = 0.380, top1 = 89.90%], valid : [loss = 1.413, top1 = 64.48%], test : [loss = 1.408, top1 = 64.90%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.20%], valid : [loss = 2.597, top1 = 34.67%], test : [loss = 2.595, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.69%], valid : [loss = 0.790, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2320/15625) 002320-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.525, top1 = 89.45%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.340, top1 = 92.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.35 ms.
cifar100       train : [loss = 0.081, top1 = 98.46%], valid : [loss = 1.409, top1 = 69.31%], test : [loss = 1.389, top1 = 69.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.46%], valid : [loss = 2.347, top1 = 40.84%], test : [loss = 2.331, top1 = 41.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.50%], valid : [loss = 0.836, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2321/15625) 002321-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.28%], valid : [loss = 0.489, top1 = 84.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.52 ms.
cifar10        train : [loss = 0.225, top1 = 92.45%], test  : [loss = 0.390, top1 = 87.17%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.23 ms.
cifar100       train : [loss = 1.413, top1 = 60.71%], valid : [loss = 1.651, top1 = 53.82%], test : [loss = 1.653, top1 = 54.50%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.65%], valid : [loss = 2.947, top1 = 27.17%], test : [loss = 2.956, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.85%], valid : [loss = 1.017, top1 = 63.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2322/15625) 002322-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.533, top1 = 88.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.25 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.362, top1 = 91.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.29 ms.
cifar100       train : [loss = 0.330, top1 = 90.66%], valid : [loss = 1.401, top1 = 65.62%], test : [loss = 1.416, top1 = 66.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.193, top1 = 43.33%], valid : [loss = 2.468, top1 = 36.83%], test : [loss = 2.502, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.53%], valid : [loss = 0.727, top1 = 75.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2323/15625) 002323-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.494, top1 = 88.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.298, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.89 ms.
cifar100       train : [loss = 0.322, top1 = 91.38%], valid : [loss = 1.277, top1 = 67.56%], test : [loss = 1.265, top1 = 67.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.62%], valid : [loss = 2.306, top1 = 40.97%], test : [loss = 2.344, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.29%], valid : [loss = 0.617, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2324/15625) 002324-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.449, top1 = 89.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.278, top1 = 93.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.82 ms.
cifar100       train : [loss = 0.205, top1 = 95.16%], valid : [loss = 1.267, top1 = 69.00%], test : [loss = 1.242, top1 = 69.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.98%], valid : [loss = 2.273, top1 = 42.57%], test : [loss = 2.314, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.61%], valid : [loss = 0.520, top1 = 82.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2325/15625) 002325-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.232, top1 = 92.16%], valid : [loss = 0.563, top1 = 82.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10        train : [loss = 0.222, top1 = 92.38%], test  : [loss = 0.409, top1 = 86.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 1.286, top1 = 63.45%], valid : [loss = 1.575, top1 = 56.58%], test : [loss = 1.595, top1 = 56.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 2.730, top1 = 32.08%], valid : [loss = 2.750, top1 = 32.43%], test : [loss = 2.786, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 66.88%], valid : [loss = 0.972, top1 = 65.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2326/15625) 002326-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.597, top1 = 88.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.07 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.362, top1 = 92.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.79 ms.
cifar100       train : [loss = 0.147, top1 = 96.88%], valid : [loss = 1.485, top1 = 66.24%], test : [loss = 1.459, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.004, top1 = 47.45%], valid : [loss = 2.458, top1 = 38.73%], test : [loss = 2.453, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.81%], valid : [loss = 0.795, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2327/15625) 002327-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.14%], valid : [loss = 0.600, top1 = 85.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.074, top1 = 97.73%], test  : [loss = 0.397, top1 = 88.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.06 ms.
cifar100       train : [loss = 0.722, top1 = 79.11%], valid : [loss = 1.420, top1 = 62.48%], test : [loss = 1.368, top1 = 63.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.96%], valid : [loss = 2.667, top1 = 32.87%], test : [loss = 2.693, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2328/15625) 002328-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.46%], valid : [loss = 0.482, top1 = 85.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.339, top1 = 89.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.58 ms.
cifar100       train : [loss = 1.001, top1 = 71.50%], valid : [loss = 1.369, top1 = 61.38%], test : [loss = 1.353, top1 = 62.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.59%], valid : [loss = 2.671, top1 = 32.83%], test : [loss = 2.694, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2329/15625) 002329-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.40 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.64%], valid : [loss = 0.560, top1 = 87.94%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.90 ms.
cifar10        train : [loss = 0.023, top1 = 99.32%], test  : [loss = 0.364, top1 = 91.47%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=24.10 ms.
cifar100       train : [loss = 0.281, top1 = 92.38%], valid : [loss = 1.374, top1 = 66.06%], test : [loss = 1.433, top1 = 65.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 30.88%], valid : [loss = 2.819, top1 = 29.33%], test : [loss = 2.799, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.996, top1 = 63.92%], valid : [loss = 1.024, top1 = 63.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2330/15625) 002330-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.78%], valid : [loss = 0.563, top1 = 85.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.064, top1 = 98.11%], test  : [loss = 0.372, top1 = 89.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.618, top1 = 82.14%], valid : [loss = 1.369, top1 = 64.20%], test : [loss = 1.363, top1 = 64.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.53%], valid : [loss = 2.502, top1 = 36.91%], test : [loss = 2.521, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 71.89%], valid : [loss = 0.836, top1 = 70.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2331/15625) 002331-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.49%], valid : [loss = 0.610, top1 = 84.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.07 ms.
cifar10        train : [loss = 0.087, top1 = 97.15%], test  : [loss = 0.419, top1 = 88.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.14 ms.
cifar100       train : [loss = 0.677, top1 = 80.14%], valid : [loss = 1.569, top1 = 59.96%], test : [loss = 1.534, top1 = 61.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 3.227, top1 = 21.45%], valid : [loss = 3.237, top1 = 21.60%], test : [loss = 3.259, top1 = 21.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.72%], valid : [loss = 1.051, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2332/15625) 002332-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.18%], valid : [loss = 0.460, top1 = 86.83%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=15.21 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.327, top1 = 89.64%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=14.77 ms.
cifar100       train : [loss = 0.864, top1 = 75.48%], valid : [loss = 1.292, top1 = 64.33%], test : [loss = 1.294, top1 = 63.54%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.52%], valid : [loss = 2.623, top1 = 34.00%], test : [loss = 2.666, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2333/15625) 002333-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.575, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.384, top1 = 91.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.67 ms.
cifar100       train : [loss = 0.208, top1 = 94.83%], valid : [loss = 1.450, top1 = 66.67%], test : [loss = 1.442, top1 = 66.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.36%], valid : [loss = 2.433, top1 = 39.16%], test : [loss = 2.459, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.98%], valid : [loss = 0.734, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2334/15625) 002334-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.93%], valid : [loss = 0.600, top1 = 85.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.76 ms.
cifar10        train : [loss = 0.090, top1 = 97.03%], test  : [loss = 0.436, top1 = 87.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.01 ms.
cifar100       train : [loss = 0.689, top1 = 79.44%], valid : [loss = 1.550, top1 = 60.64%], test : [loss = 1.533, top1 = 60.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 3.220, top1 = 21.62%], valid : [loss = 3.203, top1 = 21.80%], test : [loss = 3.253, top1 = 21.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.061, top1 = 61.75%], valid : [loss = 1.088, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2335/15625) 002335-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.25 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.71%], valid : [loss = 0.456, top1 = 86.66%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.43 ms.
cifar10        train : [loss = 0.122, top1 = 96.13%], test  : [loss = 0.336, top1 = 89.38%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.93 ms.
cifar100       train : [loss = 0.806, top1 = 77.17%], valid : [loss = 1.279, top1 = 64.33%], test : [loss = 1.285, top1 = 64.36%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.22%], valid : [loss = 2.599, top1 = 35.01%], test : [loss = 2.620, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.22%], valid : [loss = 0.759, top1 = 73.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2336/15625) 002336-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.14%], valid : [loss = 0.864, top1 = 71.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.70 ms.
cifar10        train : [loss = 0.573, top1 = 80.05%], test  : [loss = 0.718, top1 = 75.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.20 ms.
cifar100       train : [loss = 1.776, top1 = 52.01%], valid : [loss = 2.041, top1 = 46.60%], test : [loss = 2.065, top1 = 46.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 16.87%], valid : [loss = 3.631, top1 = 16.73%], test : [loss = 3.656, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2337/15625) 002337-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.93 ms.
cifar10-valid  train : [loss = 0.244, top1 = 91.66%], valid : [loss = 0.558, top1 = 82.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.226, top1 = 92.25%], test  : [loss = 0.404, top1 = 87.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.59 ms.
cifar100       train : [loss = 1.320, top1 = 62.45%], valid : [loss = 1.611, top1 = 56.02%], test : [loss = 1.625, top1 = 56.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.777, top1 = 31.02%], valid : [loss = 2.821, top1 = 30.87%], test : [loss = 2.861, top1 = 29.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 65.58%], valid : [loss = 1.002, top1 = 64.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2338/15625) 002338-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.74 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.549, top1 = 88.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=16.62 ms.
cifar10        train : [loss = 0.027, top1 = 99.19%], test  : [loss = 0.352, top1 = 91.13%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.50 ms.
cifar100       train : [loss = 0.406, top1 = 88.13%], valid : [loss = 1.300, top1 = 66.64%], test : [loss = 1.251, top1 = 67.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 2.218, top1 = 42.61%], valid : [loss = 2.409, top1 = 39.10%], test : [loss = 2.440, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.69%], valid : [loss = 0.818, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2339/15625) 002339-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.27%], valid : [loss = 0.624, top1 = 85.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10        train : [loss = 0.104, top1 = 96.45%], test  : [loss = 0.411, top1 = 88.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.62 ms.
cifar100       train : [loss = 0.812, top1 = 75.86%], valid : [loss = 1.452, top1 = 61.80%], test : [loss = 1.455, top1 = 61.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.36%], valid : [loss = 2.743, top1 = 31.43%], test : [loss = 2.772, top1 = 31.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.40%], valid : [loss = 0.708, top1 = 75.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2340/15625) 002340-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.98%], valid : [loss = 0.726, top1 = 75.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.01 ms.
cifar10        train : [loss = 0.554, top1 = 80.84%], test  : [loss = 0.608, top1 = 79.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.05 ms.
cifar100       train : [loss = 1.949, top1 = 47.48%], valid : [loss = 2.073, top1 = 44.87%], test : [loss = 2.059, top1 = 44.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.43 ms.
ImageNet16-120 train : [loss = 3.245, top1 = 22.07%], valid : [loss = 3.225, top1 = 22.91%], test : [loss = 3.282, top1 = 21.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 54.01%], valid : [loss = 1.347, top1 = 51.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2341/15625) 002341-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.59%], valid : [loss = 0.855, top1 = 71.94%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.547, top1 = 80.83%], test  : [loss = 0.702, top1 = 76.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.40 ms.
cifar100       train : [loss = 1.767, top1 = 52.48%], valid : [loss = 2.041, top1 = 47.25%], test : [loss = 2.063, top1 = 46.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.91%], valid : [loss = 3.643, top1 = 16.73%], test : [loss = 3.670, top1 = 15.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2342/15625) 002342-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.498, top1 = 88.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.327, top1 = 91.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.05 ms.
cifar100       train : [loss = 0.330, top1 = 91.11%], valid : [loss = 1.279, top1 = 67.25%], test : [loss = 1.271, top1 = 67.33%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 45.02%], valid : [loss = 2.409, top1 = 38.94%], test : [loss = 2.425, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.41%], valid : [loss = 0.652, top1 = 77.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2343/15625) 002343-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.472, top1 = 89.17%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.98 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.306, top1 = 92.42%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.53 ms.
cifar100       train : [loss = 0.253, top1 = 93.67%], valid : [loss = 1.248, top1 = 68.30%], test : [loss = 1.244, top1 = 68.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.87%], valid : [loss = 2.261, top1 = 42.24%], test : [loss = 2.265, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.21%], valid : [loss = 0.624, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2344/15625) 002344-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.29%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.320, top1 = 92.42%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.35 ms.
cifar100       train : [loss = 0.117, top1 = 97.91%], valid : [loss = 1.298, top1 = 69.07%], test : [loss = 1.270, top1 = 70.07%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.59 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.12%], valid : [loss = 2.223, top1 = 43.44%], test : [loss = 2.232, top1 = 43.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.78%], valid : [loss = 0.683, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2345/15625) 002345-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.65 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.21%], valid : [loss = 0.852, top1 = 72.00%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10        train : [loss = 0.559, top1 = 80.47%], test  : [loss = 0.722, top1 = 75.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.95 ms.
cifar100       train : [loss = 1.783, top1 = 51.85%], valid : [loss = 2.066, top1 = 46.95%], test : [loss = 2.062, top1 = 46.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.64 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.77%], valid : [loss = 3.641, top1 = 16.09%], test : [loss = 3.663, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2346/15625) 002346-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.309, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.319, top1 = 91.42%], valid : [loss = 1.259, top1 = 67.67%], test : [loss = 1.258, top1 = 68.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.57%], valid : [loss = 2.327, top1 = 40.37%], test : [loss = 2.345, top1 = 40.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.88%], valid : [loss = 0.559, top1 = 81.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2347/15625) 002347-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.17%], valid : [loss = 0.880, top1 = 74.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.28 ms.
cifar10        train : [loss = 0.311, top1 = 89.21%], test  : [loss = 0.632, top1 = 80.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.37 ms.
cifar100       train : [loss = 1.350, top1 = 62.08%], valid : [loss = 1.919, top1 = 50.30%], test : [loss = 1.926, top1 = 50.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 3.477, top1 = 17.76%], valid : [loss = 3.509, top1 = 17.84%], test : [loss = 3.503, top1 = 17.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2348/15625) 002348-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.46 ms.
cifar10-valid  train : [loss = 0.227, top1 = 92.24%], valid : [loss = 0.549, top1 = 83.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10        train : [loss = 0.226, top1 = 92.32%], test  : [loss = 0.403, top1 = 87.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.93 ms.
cifar100       train : [loss = 1.302, top1 = 63.10%], valid : [loss = 1.589, top1 = 56.63%], test : [loss = 1.598, top1 = 56.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.784, top1 = 31.00%], valid : [loss = 2.800, top1 = 30.89%], test : [loss = 2.834, top1 = 30.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.33%], valid : [loss = 1.005, top1 = 64.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2349/15625) 002349-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.40%], valid : [loss = 0.766, top1 = 73.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.567, top1 = 80.18%], test  : [loss = 0.640, top1 = 78.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.969, top1 = 46.23%], valid : [loss = 2.093, top1 = 43.95%], test : [loss = 2.090, top1 = 44.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 25.72%], valid : [loss = 3.027, top1 = 26.33%], test : [loss = 3.048, top1 = 25.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.137, top1 = 58.45%], valid : [loss = 1.183, top1 = 57.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2350/15625) 002350-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.091, top1 = 97.44%], valid : [loss = 0.453, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.00 ms.
cifar10        train : [loss = 0.128, top1 = 95.93%], test  : [loss = 0.338, top1 = 89.32%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.86 ms.
cifar100       train : [loss = 0.810, top1 = 77.21%], valid : [loss = 1.294, top1 = 63.92%], test : [loss = 1.287, top1 = 63.85%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.78%], valid : [loss = 2.578, top1 = 34.72%], test : [loss = 2.611, top1 = 34.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.46%], valid : [loss = 0.813, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2351/15625) 002351-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.18 ms.
cifar10-valid  train : [loss = 0.315, top1 = 88.98%], valid : [loss = 0.577, top1 = 81.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.273, top1 = 90.61%], test  : [loss = 0.420, top1 = 86.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 1.406, top1 = 60.56%], valid : [loss = 1.673, top1 = 55.13%], test : [loss = 1.636, top1 = 55.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.48%], valid : [loss = 2.906, top1 = 29.02%], test : [loss = 2.966, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.36%], valid : [loss = 0.985, top1 = 64.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2352/15625) 002352-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.511, top1 = 89.88%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.74 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.346, top1 = 93.15%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.07 ms.
cifar100       train : [loss = 0.026, top1 = 99.82%], valid : [loss = 1.372, top1 = 71.10%], test : [loss = 1.364, top1 = 70.97%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.16 ms.
ImageNet16-120 train : [loss = 1.455, top1 = 60.55%], valid : [loss = 2.382, top1 = 42.27%], test : [loss = 2.377, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.66%], valid : [loss = 0.663, top1 = 77.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2353/15625) 002353-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.476, top1 = 89.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.303, top1 = 92.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.54 ms.
cifar100       train : [loss = 0.335, top1 = 90.92%], valid : [loss = 1.267, top1 = 67.83%], test : [loss = 1.255, top1 = 67.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.72%], valid : [loss = 2.305, top1 = 40.61%], test : [loss = 2.330, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.55%], valid : [loss = 0.590, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2354/15625) 002354-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.516, top1 = 89.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.65 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.374, top1 = 92.38%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.68 ms.
cifar100       train : [loss = 0.078, top1 = 98.68%], valid : [loss = 1.530, top1 = 67.57%], test : [loss = 1.500, top1 = 67.72%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.57%], valid : [loss = 2.363, top1 = 40.80%], test : [loss = 2.379, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.79%], valid : [loss = 0.745, top1 = 74.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2355/15625) 002355-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.583, top1 = 87.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.397, top1 = 90.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.95 ms.
cifar100       train : [loss = 0.435, top1 = 87.53%], valid : [loss = 1.408, top1 = 64.65%], test : [loss = 1.383, top1 = 65.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.09%], valid : [loss = 2.519, top1 = 36.69%], test : [loss = 2.546, top1 = 36.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.18%], valid : [loss = 0.817, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2356/15625) 002356-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.75%], valid : [loss = 0.615, top1 = 86.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.407, top1 = 90.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.501, top1 = 85.36%], valid : [loss = 1.384, top1 = 64.87%], test : [loss = 1.376, top1 = 64.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.23%], valid : [loss = 2.538, top1 = 36.09%], test : [loss = 2.583, top1 = 35.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.86%], valid : [loss = 0.839, top1 = 70.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2357/15625) 002357-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.53%], valid : [loss = 0.557, top1 = 82.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10        train : [loss = 0.263, top1 = 90.97%], test  : [loss = 0.416, top1 = 86.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 1.376, top1 = 61.27%], valid : [loss = 1.656, top1 = 55.22%], test : [loss = 1.630, top1 = 55.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.940, top1 = 28.01%], valid : [loss = 2.934, top1 = 28.09%], test : [loss = 2.997, top1 = 26.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 65.34%], valid : [loss = 1.025, top1 = 63.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2358/15625) 002358-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.543, top1 = 87.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.356, top1 = 91.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.02 ms.
cifar100       train : [loss = 0.415, top1 = 88.00%], valid : [loss = 1.270, top1 = 67.01%], test : [loss = 1.267, top1 = 66.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.09 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.16%], valid : [loss = 2.404, top1 = 38.82%], test : [loss = 2.448, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 70.87%], valid : [loss = 0.866, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2359/15625) 002359-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.53%], valid : [loss = 0.856, top1 = 72.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.549, top1 = 80.76%], test  : [loss = 0.712, top1 = 75.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 1.776, top1 = 52.15%], valid : [loss = 2.051, top1 = 46.67%], test : [loss = 2.069, top1 = 46.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.84%], valid : [loss = 3.635, top1 = 16.71%], test : [loss = 3.661, top1 = 15.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2360/15625) 002360-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.485, top1 = 89.37%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.303, top1 = 92.66%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.14 ms.
cifar100       train : [loss = 0.293, top1 = 92.14%], valid : [loss = 1.235, top1 = 68.49%], test : [loss = 1.244, top1 = 68.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.91%], valid : [loss = 2.218, top1 = 42.89%], test : [loss = 2.236, top1 = 42.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.609, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2361/15625) 002361-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.48%], valid : [loss = 0.850, top1 = 71.03%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.18 ms.
cifar10        train : [loss = 0.689, top1 = 75.78%], test  : [loss = 0.776, top1 = 73.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.92 ms.
cifar100       train : [loss = 1.972, top1 = 47.44%], valid : [loss = 2.150, top1 = 44.35%], test : [loss = 2.171, top1 = 44.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.45 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.69%], valid : [loss = 3.677, top1 = 15.84%], test : [loss = 3.690, top1 = 14.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2362/15625) 002362-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.05%], valid : [loss = 0.860, top1 = 71.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.68 ms.
cifar10        train : [loss = 0.555, top1 = 80.71%], test  : [loss = 0.710, top1 = 75.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.71 ms.
cifar100       train : [loss = 1.788, top1 = 51.80%], valid : [loss = 2.067, top1 = 46.55%], test : [loss = 2.070, top1 = 46.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.22 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.73%], valid : [loss = 3.642, top1 = 16.43%], test : [loss = 3.666, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2363/15625) 002363-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.99 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.02%], valid : [loss = 0.868, top1 = 71.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.20 ms.
cifar10        train : [loss = 0.572, top1 = 80.02%], test  : [loss = 0.731, top1 = 75.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.86 ms.
cifar100       train : [loss = 1.778, top1 = 52.08%], valid : [loss = 2.059, top1 = 46.81%], test : [loss = 2.053, top1 = 46.47%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.85 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.80%], valid : [loss = 3.640, top1 = 16.58%], test : [loss = 3.674, top1 = 15.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2364/15625) 002364-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.638, top1 = 87.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.46 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.406, top1 = 91.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.18 ms.
cifar100       train : [loss = 0.199, top1 = 95.12%], valid : [loss = 1.549, top1 = 64.95%], test : [loss = 1.508, top1 = 65.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.14%], valid : [loss = 2.517, top1 = 37.08%], test : [loss = 2.533, top1 = 37.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.92%], valid : [loss = 0.834, top1 = 70.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2365/15625) 002365-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.91%], valid : [loss = 0.865, top1 = 71.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.554, top1 = 80.81%], test  : [loss = 0.710, top1 = 75.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 1.771, top1 = 52.38%], valid : [loss = 2.046, top1 = 46.97%], test : [loss = 2.056, top1 = 47.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.81%], valid : [loss = 3.642, top1 = 16.74%], test : [loss = 3.672, top1 = 15.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2366/15625) 002366-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.595, top1 = 87.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.414, top1 = 90.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.80 ms.
cifar100       train : [loss = 0.220, top1 = 94.45%], valid : [loss = 1.492, top1 = 65.39%], test : [loss = 1.482, top1 = 65.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.095, top1 = 45.50%], valid : [loss = 2.471, top1 = 37.59%], test : [loss = 2.464, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.46%], valid : [loss = 0.771, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2367/15625) 002367-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.558, top1 = 88.13%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.349, top1 = 91.86%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.85 ms.
cifar100       train : [loss = 0.295, top1 = 91.71%], valid : [loss = 1.318, top1 = 67.17%], test : [loss = 1.345, top1 = 67.59%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.24%], valid : [loss = 2.427, top1 = 38.33%], test : [loss = 2.431, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 68.98%], valid : [loss = 0.892, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2368/15625) 002368-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.542, top1 = 88.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.379, top1 = 91.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.09 ms.
cifar100       train : [loss = 0.380, top1 = 89.40%], valid : [loss = 1.411, top1 = 65.01%], test : [loss = 1.391, top1 = 65.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.85%], valid : [loss = 2.479, top1 = 37.39%], test : [loss = 2.502, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.64%], valid : [loss = 0.764, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2369/15625) 002369-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.423, top1 = 90.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.278, top1 = 93.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.160, top1 = 96.37%], valid : [loss = 1.253, top1 = 70.25%], test : [loss = 1.259, top1 = 70.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 1.777, top1 = 52.65%], valid : [loss = 2.223, top1 = 43.77%], test : [loss = 2.256, top1 = 43.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.383, top1 = 86.84%], valid : [loss = 0.497, top1 = 83.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2370/15625) 002370-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.538, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.65 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.343, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.55 ms.
cifar100       train : [loss = 0.070, top1 = 99.02%], valid : [loss = 1.445, top1 = 68.67%], test : [loss = 1.445, top1 = 68.83%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.47 ms.
ImageNet16-120 train : [loss = 1.764, top1 = 53.04%], valid : [loss = 2.371, top1 = 40.48%], test : [loss = 2.402, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.59%], valid : [loss = 0.705, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2371/15625) 002371-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.437, top1 = 89.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.291, top1 = 92.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.209, top1 = 95.06%], valid : [loss = 1.284, top1 = 68.73%], test : [loss = 1.267, top1 = 69.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.75%], valid : [loss = 2.265, top1 = 42.61%], test : [loss = 2.286, top1 = 42.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2372/15625) 002372-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.617, top1 = 87.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.417, top1 = 91.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.94 ms.
cifar100       train : [loss = 0.111, top1 = 97.76%], valid : [loss = 1.572, top1 = 66.21%], test : [loss = 1.567, top1 = 66.35%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.39%], valid : [loss = 2.464, top1 = 38.17%], test : [loss = 2.459, top1 = 39.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.34%], valid : [loss = 0.754, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2373/15625) 002373-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.57%], valid : [loss = 0.528, top1 = 83.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.69 ms.
cifar10        train : [loss = 0.242, top1 = 91.74%], test  : [loss = 0.387, top1 = 87.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.95 ms.
cifar100       train : [loss = 1.317, top1 = 62.78%], valid : [loss = 1.585, top1 = 56.73%], test : [loss = 1.566, top1 = 57.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 2.853, top1 = 29.66%], valid : [loss = 2.862, top1 = 29.98%], test : [loss = 2.923, top1 = 28.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2374/15625) 002374-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.514, top1 = 88.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.355, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.289, top1 = 92.06%], valid : [loss = 1.359, top1 = 66.93%], test : [loss = 1.341, top1 = 67.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.61%], valid : [loss = 2.383, top1 = 39.67%], test : [loss = 2.393, top1 = 40.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.71%], valid : [loss = 0.670, top1 = 76.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2375/15625) 002375-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.586, top1 = 88.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.93 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.386, top1 = 91.95%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.01 ms.
cifar100       train : [loss = 0.117, top1 = 97.78%], valid : [loss = 1.545, top1 = 66.37%], test : [loss = 1.520, top1 = 67.15%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.84%], valid : [loss = 2.395, top1 = 40.31%], test : [loss = 2.406, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.779, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2376/15625) 002376-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.47%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.340, top1 = 92.74%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.45 ms.
cifar100       train : [loss = 0.076, top1 = 98.60%], valid : [loss = 1.428, top1 = 68.96%], test : [loss = 1.432, top1 = 68.83%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.75 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.41%], valid : [loss = 2.307, top1 = 41.17%], test : [loss = 2.296, top1 = 41.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.47%], valid : [loss = 0.768, top1 = 73.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2377/15625) 002377-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.534, top1 = 87.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.62 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.375, top1 = 90.62%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.71 ms.
cifar100       train : [loss = 0.453, top1 = 87.04%], valid : [loss = 1.333, top1 = 66.47%], test : [loss = 1.333, top1 = 65.87%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.82%], valid : [loss = 2.414, top1 = 38.73%], test : [loss = 2.471, top1 = 37.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.18%], valid : [loss = 0.630, top1 = 78.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2378/15625) 002378-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.300, top1 = 89.61%], valid : [loss = 0.562, top1 = 82.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.265, top1 = 90.96%], test  : [loss = 0.412, top1 = 86.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 1.493, top1 = 58.17%], valid : [loss = 1.743, top1 = 53.26%], test : [loss = 1.719, top1 = 53.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.37%], valid : [loss = 2.940, top1 = 28.31%], test : [loss = 2.985, top1 = 27.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2379/15625) 002379-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.32%], valid : [loss = 0.738, top1 = 81.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10        train : [loss = 0.157, top1 = 94.67%], test  : [loss = 0.481, top1 = 85.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 0.971, top1 = 71.77%], valid : [loss = 1.622, top1 = 57.19%], test : [loss = 1.635, top1 = 56.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.046, top1 = 25.42%], valid : [loss = 3.129, top1 = 24.54%], test : [loss = 3.156, top1 = 23.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2380/15625) 002380-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.43%], valid : [loss = 0.571, top1 = 87.06%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.20 ms.
cifar10        train : [loss = 0.045, top1 = 98.63%], test  : [loss = 0.384, top1 = 89.93%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.22 ms.
cifar100       train : [loss = 0.514, top1 = 85.05%], valid : [loss = 1.304, top1 = 65.49%], test : [loss = 1.290, top1 = 66.05%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.25%], valid : [loss = 2.439, top1 = 38.23%], test : [loss = 2.463, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.19%], valid : [loss = 0.790, top1 = 72.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2381/15625) 002381-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.330, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.333, top1 = 90.94%], valid : [loss = 1.267, top1 = 67.35%], test : [loss = 1.269, top1 = 67.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.11%], valid : [loss = 2.393, top1 = 39.53%], test : [loss = 2.405, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.07%], valid : [loss = 0.643, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2382/15625) 002382-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.02 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2383/15625) 002383-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.479, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.301, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.87 ms.
cifar100       train : [loss = 0.316, top1 = 91.49%], valid : [loss = 1.253, top1 = 67.47%], test : [loss = 1.258, top1 = 67.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.73%], valid : [loss = 2.318, top1 = 40.88%], test : [loss = 2.323, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.93%], valid : [loss = 0.600, top1 = 79.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2384/15625) 002384-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.68 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.29 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.69 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2385/15625) 002385-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.92%], valid : [loss = 0.482, top1 = 84.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.298, top1 = 90.04%], test  : [loss = 0.395, top1 = 86.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 1.324, top1 = 63.32%], valid : [loss = 1.520, top1 = 58.12%], test : [loss = 1.514, top1 = 57.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.53%], valid : [loss = 2.897, top1 = 29.49%], test : [loss = 2.957, top1 = 28.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2386/15625) 002386-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.40%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.80 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.368, top1 = 92.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.51 ms.
cifar100       train : [loss = 0.078, top1 = 98.82%], valid : [loss = 1.443, top1 = 68.11%], test : [loss = 1.449, top1 = 68.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.01 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.26%], valid : [loss = 2.360, top1 = 40.93%], test : [loss = 2.379, top1 = 41.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.08%], valid : [loss = 0.653, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2387/15625) 002387-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.494, top1 = 90.12%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.312, top1 = 93.37%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.14 ms.
cifar100       train : [loss = 0.060, top1 = 99.17%], valid : [loss = 1.314, top1 = 70.55%], test : [loss = 1.315, top1 = 70.55%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.91 ms.
ImageNet16-120 train : [loss = 1.579, top1 = 57.36%], valid : [loss = 2.156, top1 = 44.84%], test : [loss = 2.188, top1 = 45.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.58%], valid : [loss = 0.614, top1 = 78.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2388/15625) 002388-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.25%], valid : [loss = 0.615, top1 = 85.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10        train : [loss = 0.072, top1 = 97.82%], test  : [loss = 0.397, top1 = 89.03%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.71 ms.
cifar100       train : [loss = 0.722, top1 = 79.09%], valid : [loss = 1.383, top1 = 63.55%], test : [loss = 1.370, top1 = 63.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.97%], valid : [loss = 2.660, top1 = 33.81%], test : [loss = 2.697, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2389/15625) 002389-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.530, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.334, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.25 ms.
cifar100       train : [loss = 0.160, top1 = 96.42%], valid : [loss = 1.325, top1 = 69.12%], test : [loss = 1.330, top1 = 68.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.78%], valid : [loss = 2.325, top1 = 40.80%], test : [loss = 2.314, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.94%], valid : [loss = 0.742, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2390/15625) 002390-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.246, top1 = 91.70%], valid : [loss = 0.530, top1 = 83.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.241, top1 = 91.70%], test  : [loss = 0.391, top1 = 87.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.30 ms.
cifar100       train : [loss = 1.334, top1 = 62.36%], valid : [loss = 1.601, top1 = 56.36%], test : [loss = 1.587, top1 = 56.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 2.870, top1 = 29.31%], valid : [loss = 2.908, top1 = 28.90%], test : [loss = 2.948, top1 = 28.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2391/15625) 002391-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.64%], valid : [loss = 0.545, top1 = 83.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.203, top1 = 93.11%], test  : [loss = 0.391, top1 = 87.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.23 ms.
cifar100       train : [loss = 1.275, top1 = 63.84%], valid : [loss = 1.568, top1 = 57.07%], test : [loss = 1.561, top1 = 57.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.693, top1 = 32.75%], valid : [loss = 2.725, top1 = 32.80%], test : [loss = 2.762, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.06%], valid : [loss = 0.966, top1 = 65.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2392/15625) 002392-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.534, top1 = 88.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.331, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.343, top1 = 90.67%], valid : [loss = 1.265, top1 = 66.70%], test : [loss = 1.280, top1 = 67.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.66%], valid : [loss = 2.408, top1 = 38.82%], test : [loss = 2.419, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.70%], valid : [loss = 0.626, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2393/15625) 002393-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.45%], valid : [loss = 0.559, top1 = 87.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.371, top1 = 90.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.16 ms.
cifar100       train : [loss = 0.483, top1 = 86.21%], valid : [loss = 1.325, top1 = 65.47%], test : [loss = 1.335, top1 = 65.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.506, top1 = 36.08%], valid : [loss = 2.596, top1 = 34.29%], test : [loss = 2.615, top1 = 34.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.61%], valid : [loss = 0.972, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2394/15625) 002394-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.565, top1 = 88.27%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.46 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.375, top1 = 91.70%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.26 ms.
cifar100       train : [loss = 0.154, top1 = 96.86%], valid : [loss = 1.476, top1 = 66.37%], test : [loss = 1.462, top1 = 67.01%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.08 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.82%], valid : [loss = 2.414, top1 = 39.47%], test : [loss = 2.422, top1 = 40.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.44%], valid : [loss = 0.698, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2395/15625) 002395-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.99%], valid : [loss = 0.640, top1 = 84.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.05 ms.
cifar10        train : [loss = 0.054, top1 = 98.33%], test  : [loss = 0.418, top1 = 89.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.25 ms.
cifar100       train : [loss = 0.682, top1 = 79.87%], valid : [loss = 1.484, top1 = 61.19%], test : [loss = 1.498, top1 = 61.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.99%], valid : [loss = 2.563, top1 = 35.16%], test : [loss = 2.594, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.90%], valid : [loss = 0.928, top1 = 66.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2396/15625) 002396-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.446, top1 = 89.63%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.310, top1 = 92.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.23 ms.
cifar100       train : [loss = 0.207, top1 = 95.09%], valid : [loss = 1.238, top1 = 69.39%], test : [loss = 1.270, top1 = 68.97%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.87%], valid : [loss = 2.264, top1 = 42.39%], test : [loss = 2.296, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.403, top1 = 86.13%], valid : [loss = 0.526, top1 = 82.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2397/15625) 002397-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.44%], valid : [loss = 0.617, top1 = 85.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.042, top1 = 98.80%], test  : [loss = 0.402, top1 = 89.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 0.611, top1 = 82.02%], valid : [loss = 1.429, top1 = 62.97%], test : [loss = 1.415, top1 = 63.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.447, top1 = 37.77%], valid : [loss = 2.616, top1 = 34.42%], test : [loss = 2.643, top1 = 34.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.57%], valid : [loss = 0.825, top1 = 71.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2398/15625) 002398-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.21%], valid : [loss = 0.457, top1 = 86.19%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.40 ms.
cifar10        train : [loss = 0.160, top1 = 94.69%], test  : [loss = 0.345, top1 = 88.74%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.78 ms.
cifar100       train : [loss = 1.001, top1 = 71.63%], valid : [loss = 1.357, top1 = 62.03%], test : [loss = 1.357, top1 = 61.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.39%], valid : [loss = 2.700, top1 = 32.22%], test : [loss = 2.724, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.00%], valid : [loss = 0.791, top1 = 71.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2399/15625) 002399-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.56%], valid : [loss = 0.855, top1 = 71.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.548, top1 = 80.89%], test  : [loss = 0.717, top1 = 75.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.783, top1 = 52.01%], valid : [loss = 2.058, top1 = 46.67%], test : [loss = 2.077, top1 = 46.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.82%], valid : [loss = 3.626, top1 = 16.66%], test : [loss = 3.673, top1 = 15.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2400/15625) 002400-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.52%], valid : [loss = 0.447, top1 = 87.62%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.75 ms.
cifar10        train : [loss = 0.058, top1 = 98.54%], test  : [loss = 0.317, top1 = 90.41%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.59 ms.
cifar100       train : [loss = 0.552, top1 = 85.03%], valid : [loss = 1.220, top1 = 67.38%], test : [loss = 1.212, top1 = 67.27%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.267, top1 = 41.86%], valid : [loss = 2.470, top1 = 37.69%], test : [loss = 2.493, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.40%], valid : [loss = 0.631, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2401/15625) 002401-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.508, top1 = 89.78%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.44 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.331, top1 = 93.09%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.24 ms.
cifar100       train : [loss = 0.076, top1 = 98.82%], valid : [loss = 1.384, top1 = 68.96%], test : [loss = 1.386, top1 = 69.13%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.75%], valid : [loss = 2.382, top1 = 39.57%], test : [loss = 2.408, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.16%], valid : [loss = 0.989, top1 = 64.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2402/15625) 002402-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.51%], valid : [loss = 0.603, top1 = 86.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.051, top1 = 98.53%], test  : [loss = 0.409, top1 = 89.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.24 ms.
cifar100       train : [loss = 0.615, top1 = 82.04%], valid : [loss = 1.382, top1 = 63.93%], test : [loss = 1.366, top1 = 64.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 2.402, top1 = 38.93%], valid : [loss = 2.554, top1 = 35.51%], test : [loss = 2.576, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.22%], valid : [loss = 0.775, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2403/15625) 002403-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.603, top1 = 87.83%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.38 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.393, top1 = 91.96%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.58 ms.
cifar100       train : [loss = 0.118, top1 = 97.73%], valid : [loss = 1.589, top1 = 65.46%], test : [loss = 1.573, top1 = 65.75%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.19%], valid : [loss = 2.397, top1 = 40.48%], test : [loss = 2.411, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.44%], valid : [loss = 0.795, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2404/15625) 002404-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.69%], valid : [loss = 0.571, top1 = 82.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.250, top1 = 91.47%], test  : [loss = 0.424, top1 = 86.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 1.384, top1 = 60.96%], valid : [loss = 1.669, top1 = 54.58%], test : [loss = 1.658, top1 = 54.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.826, top1 = 30.21%], valid : [loss = 2.859, top1 = 29.62%], test : [loss = 2.893, top1 = 29.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 64.76%], valid : [loss = 1.025, top1 = 63.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2405/15625) 002405-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.541, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.347, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.209, top1 = 94.65%], valid : [loss = 1.312, top1 = 67.70%], test : [loss = 1.348, top1 = 67.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.004, top1 = 47.44%], valid : [loss = 2.332, top1 = 40.27%], test : [loss = 2.343, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.62%], valid : [loss = 0.813, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2406/15625) 002406-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.586, top1 = 88.52%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.382, top1 = 92.08%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.19 ms.
cifar100       train : [loss = 0.102, top1 = 98.13%], valid : [loss = 1.474, top1 = 67.87%], test : [loss = 1.479, top1 = 67.97%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.35%], valid : [loss = 2.434, top1 = 39.34%], test : [loss = 2.439, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 74.52%], valid : [loss = 0.784, top1 = 72.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2407/15625) 002407-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.490, top1 = 89.59%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.89 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.323, top1 = 92.66%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.51 ms.
cifar100       train : [loss = 0.176, top1 = 95.84%], valid : [loss = 1.254, top1 = 69.70%], test : [loss = 1.271, top1 = 69.40%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.787, top1 = 52.39%], valid : [loss = 2.184, top1 = 43.52%], test : [loss = 2.211, top1 = 43.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.45%], valid : [loss = 0.728, top1 = 75.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2408/15625) 002408-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.00 ms.
cifar10-valid  train : [loss = 0.951, top1 = 66.46%], valid : [loss = 0.990, top1 = 65.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10        train : [loss = 0.886, top1 = 69.33%], test  : [loss = 0.880, top1 = 69.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.20 ms.
cifar100       train : [loss = 2.369, top1 = 39.39%], valid : [loss = 2.445, top1 = 37.51%], test : [loss = 2.429, top1 = 38.13%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.36 ms.
ImageNet16-120 train : [loss = 3.638, top1 = 15.90%], valid : [loss = 3.607, top1 = 16.84%], test : [loss = 3.641, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.604, top1 = 39.67%], valid : [loss = 1.620, top1 = 38.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2409/15625) 002409-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.563, top1 = 88.73%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.80 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.368, top1 = 92.60%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.38 ms.
cifar100       train : [loss = 0.043, top1 = 99.47%], valid : [loss = 1.525, top1 = 68.33%], test : [loss = 1.529, top1 = 68.49%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.44 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.56%], valid : [loss = 2.390, top1 = 40.78%], test : [loss = 2.416, top1 = 40.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.87%], valid : [loss = 0.700, top1 = 75.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2410/15625) 002410-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.307, top1 = 89.41%], valid : [loss = 0.556, top1 = 82.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.289, top1 = 90.11%], test  : [loss = 0.426, top1 = 86.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 1.457, top1 = 59.16%], valid : [loss = 1.689, top1 = 54.49%], test : [loss = 1.685, top1 = 54.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 3.013, top1 = 26.57%], valid : [loss = 3.013, top1 = 27.07%], test : [loss = 3.079, top1 = 25.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.36%], valid : [loss = 1.009, top1 = 64.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2411/15625) 002411-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.77%], valid : [loss = 0.661, top1 = 85.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10        train : [loss = 0.029, top1 = 99.25%], test  : [loss = 0.436, top1 = 89.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 0.436, top1 = 87.67%], valid : [loss = 1.475, top1 = 63.27%], test : [loss = 1.465, top1 = 63.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.39%], valid : [loss = 2.585, top1 = 35.54%], test : [loss = 2.622, top1 = 35.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.93%], valid : [loss = 0.786, top1 = 72.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2412/15625) 002412-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.78 ms.
cifar10-valid  train : [loss = 0.217, top1 = 92.68%], valid : [loss = 0.536, top1 = 83.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10        train : [loss = 0.197, top1 = 93.32%], test  : [loss = 0.372, top1 = 87.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.63 ms.
cifar100       train : [loss = 1.231, top1 = 65.15%], valid : [loss = 1.533, top1 = 57.87%], test : [loss = 1.520, top1 = 58.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.715, top1 = 32.32%], valid : [loss = 2.728, top1 = 31.64%], test : [loss = 2.769, top1 = 31.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 65.35%], valid : [loss = 1.021, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2413/15625) 002413-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.27%], valid : [loss = 0.534, top1 = 85.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.079, top1 = 97.58%], test  : [loss = 0.337, top1 = 90.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.31 ms.
cifar100       train : [loss = 0.704, top1 = 79.60%], valid : [loss = 1.311, top1 = 64.55%], test : [loss = 1.296, top1 = 65.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.43%], valid : [loss = 2.492, top1 = 37.31%], test : [loss = 2.518, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.60%], valid : [loss = 0.912, top1 = 67.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2414/15625) 002414-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.61%], valid : [loss = 0.545, top1 = 82.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.67 ms.
cifar10        train : [loss = 0.268, top1 = 90.81%], test  : [loss = 0.426, top1 = 86.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 1.497, top1 = 58.16%], valid : [loss = 1.739, top1 = 52.97%], test : [loss = 1.734, top1 = 53.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 27.96%], valid : [loss = 2.947, top1 = 28.00%], test : [loss = 3.015, top1 = 27.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2415/15625) 002415-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.41%], valid : [loss = 0.855, top1 = 71.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10        train : [loss = 0.560, top1 = 80.41%], test  : [loss = 0.714, top1 = 75.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.34 ms.
cifar100       train : [loss = 1.781, top1 = 52.15%], valid : [loss = 2.065, top1 = 46.61%], test : [loss = 2.068, top1 = 46.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.74 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.77%], valid : [loss = 3.643, top1 = 16.38%], test : [loss = 3.666, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2416/15625) 002416-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.470, top1 = 89.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.63 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.300, top1 = 92.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.98 ms.
cifar100       train : [loss = 0.315, top1 = 91.54%], valid : [loss = 1.260, top1 = 67.71%], test : [loss = 1.235, top1 = 68.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.60%], valid : [loss = 2.310, top1 = 41.04%], test : [loss = 2.332, top1 = 41.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.39%], valid : [loss = 0.605, top1 = 79.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2417/15625) 002417-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.06%], valid : [loss = 0.476, top1 = 84.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.302, top1 = 89.80%], test  : [loss = 0.397, top1 = 86.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.45 ms.
cifar100       train : [loss = 1.331, top1 = 63.10%], valid : [loss = 1.542, top1 = 57.46%], test : [loss = 1.513, top1 = 58.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.76%], valid : [loss = 2.914, top1 = 28.87%], test : [loss = 2.952, top1 = 27.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2418/15625) 002418-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.14%], valid : [loss = 0.459, top1 = 86.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.161, top1 = 94.73%], test  : [loss = 0.352, top1 = 88.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 1.000, top1 = 71.60%], valid : [loss = 1.364, top1 = 62.14%], test : [loss = 1.356, top1 = 62.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.71%], valid : [loss = 2.693, top1 = 32.86%], test : [loss = 2.715, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2419/15625) 002419-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.533, top1 = 89.37%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.333, top1 = 92.81%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.22 ms.
cifar100       train : [loss = 0.075, top1 = 98.61%], valid : [loss = 1.377, top1 = 69.53%], test : [loss = 1.418, top1 = 69.45%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.06%], valid : [loss = 2.375, top1 = 39.40%], test : [loss = 2.374, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.42%], valid : [loss = 0.905, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2420/15625) 002420-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.563, top1 = 87.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.382, top1 = 91.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.96 ms.
cifar100       train : [loss = 0.395, top1 = 88.72%], valid : [loss = 1.414, top1 = 65.13%], test : [loss = 1.384, top1 = 65.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.82%], valid : [loss = 2.526, top1 = 36.68%], test : [loss = 2.549, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2421/15625) 002421-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.568, top1 = 88.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.58 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.378, top1 = 91.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.91 ms.
cifar100       train : [loss = 0.219, top1 = 94.79%], valid : [loss = 1.410, top1 = 67.04%], test : [loss = 1.397, top1 = 67.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.73%], valid : [loss = 2.441, top1 = 38.80%], test : [loss = 2.470, top1 = 39.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.37%], valid : [loss = 0.734, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2422/15625) 002422-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.484, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.327, top1 = 91.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.95 ms.
cifar100       train : [loss = 0.334, top1 = 90.70%], valid : [loss = 1.320, top1 = 67.16%], test : [loss = 1.309, top1 = 67.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.97%], valid : [loss = 2.353, top1 = 40.38%], test : [loss = 2.375, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.71%], valid : [loss = 0.606, top1 = 79.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2423/15625) 002423-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.93%], valid : [loss = 0.538, top1 = 85.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10        train : [loss = 0.134, top1 = 95.52%], test  : [loss = 0.367, top1 = 88.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.97 ms.
cifar100       train : [loss = 0.847, top1 = 75.34%], valid : [loss = 1.415, top1 = 62.18%], test : [loss = 1.394, top1 = 61.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 34.89%], valid : [loss = 2.645, top1 = 33.89%], test : [loss = 2.683, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.48%], valid : [loss = 0.946, top1 = 66.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2424/15625) 002424-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.511, top1 = 89.69%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=20.90 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.325, top1 = 93.30%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=22.47 ms.
cifar100       train : [loss = 0.065, top1 = 99.10%], valid : [loss = 1.371, top1 = 69.47%], test : [loss = 1.363, top1 = 69.84%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=21.15 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.96%], valid : [loss = 2.299, top1 = 41.69%], test : [loss = 2.294, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.56%], valid : [loss = 0.658, top1 = 77.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2425/15625) 002425-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.617, top1 = 87.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.408, top1 = 91.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.207, top1 = 95.17%], valid : [loss = 1.447, top1 = 66.49%], test : [loss = 1.472, top1 = 65.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.95%], valid : [loss = 2.501, top1 = 37.59%], test : [loss = 2.513, top1 = 38.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2426/15625) 002426-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.01%], valid : [loss = 0.641, top1 = 78.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.507, top1 = 82.45%], test  : [loss = 0.584, top1 = 80.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.54 ms.
cifar100       train : [loss = 1.689, top1 = 54.08%], valid : [loss = 1.845, top1 = 50.81%], test : [loss = 1.873, top1 = 50.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.49 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.25%], valid : [loss = 3.315, top1 = 21.58%], test : [loss = 3.342, top1 = 21.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2427/15625) 002427-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.517, top1 = 88.14%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.350, top1 = 90.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.38 ms.
cifar100       train : [loss = 0.477, top1 = 85.94%], valid : [loss = 1.338, top1 = 66.01%], test : [loss = 1.364, top1 = 65.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 40.01%], valid : [loss = 2.526, top1 = 36.26%], test : [loss = 2.554, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.88%], valid : [loss = 0.661, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2428/15625) 002428-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.328, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.63 ms.
cifar100       train : [loss = 0.327, top1 = 91.18%], valid : [loss = 1.264, top1 = 67.76%], test : [loss = 1.280, top1 = 67.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.72%], valid : [loss = 2.315, top1 = 40.71%], test : [loss = 2.341, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2429/15625) 002429-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.512, top1 = 89.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.05 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.339, top1 = 92.13%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.53 ms.
cifar100       train : [loss = 0.217, top1 = 94.66%], valid : [loss = 1.281, top1 = 68.53%], test : [loss = 1.273, top1 = 69.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.50%], valid : [loss = 2.351, top1 = 39.94%], test : [loss = 2.336, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 74.84%], valid : [loss = 0.767, top1 = 73.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2430/15625) 002430-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.77 ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.59%], valid : [loss = 0.746, top1 = 74.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.534, top1 = 81.35%], test  : [loss = 0.617, top1 = 79.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.57 ms.
cifar100       train : [loss = 1.983, top1 = 46.46%], valid : [loss = 2.113, top1 = 44.24%], test : [loss = 2.119, top1 = 43.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.33 ms.
ImageNet16-120 train : [loss = 2.980, top1 = 27.07%], valid : [loss = 2.964, top1 = 27.57%], test : [loss = 2.981, top1 = 27.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.78%], valid : [loss = 1.192, top1 = 57.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2431/15625) 002431-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.33%], valid : [loss = 0.459, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.158, top1 = 94.81%], test  : [loss = 0.342, top1 = 88.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.45 ms.
cifar100       train : [loss = 0.988, top1 = 71.97%], valid : [loss = 1.350, top1 = 62.45%], test : [loss = 1.345, top1 = 62.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 33.88%], valid : [loss = 2.675, top1 = 33.09%], test : [loss = 2.708, top1 = 31.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2432/15625) 002432-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.558, top1 = 88.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 0.014, top1 = 99.62%], test  : [loss = 0.351, top1 = 92.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.255, top1 = 93.15%], valid : [loss = 1.348, top1 = 67.01%], test : [loss = 1.378, top1 = 67.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 2.467, top1 = 36.74%], valid : [loss = 2.585, top1 = 34.23%], test : [loss = 2.608, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.80%], valid : [loss = 0.889, top1 = 67.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2433/15625) 002433-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.563, top1 = 88.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.374, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.93 ms.
cifar100       train : [loss = 0.101, top1 = 98.22%], valid : [loss = 1.455, top1 = 67.91%], test : [loss = 1.458, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.88%], valid : [loss = 2.400, top1 = 40.09%], test : [loss = 2.429, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.38%], valid : [loss = 0.687, top1 = 76.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2434/15625) 002434-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.64%], valid : [loss = 0.993, top1 = 65.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.799, top1 = 71.86%], test  : [loss = 0.879, top1 = 69.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.39 ms.
cifar100       train : [loss = 2.150, top1 = 43.63%], valid : [loss = 2.327, top1 = 40.52%], test : [loss = 2.336, top1 = 40.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 3.756, top1 = 14.01%], valid : [loss = 3.777, top1 = 14.31%], test : [loss = 3.790, top1 = 13.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 47.11%], valid : [loss = 1.468, top1 = 46.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2435/15625) 002435-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.567, top1 = 87.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.374, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 0.406, top1 = 88.41%], valid : [loss = 1.384, top1 = 65.49%], test : [loss = 1.379, top1 = 65.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.68%], valid : [loss = 2.529, top1 = 36.48%], test : [loss = 2.548, top1 = 36.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2436/15625) 002436-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.539, top1 = 89.42%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.55 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.351, top1 = 92.64%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.22 ms.
cifar100       train : [loss = 0.106, top1 = 97.81%], valid : [loss = 1.346, top1 = 69.73%], test : [loss = 1.357, top1 = 69.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.00%], valid : [loss = 2.230, top1 = 42.93%], test : [loss = 2.232, top1 = 43.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.14%], valid : [loss = 0.779, top1 = 72.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2437/15625) 002437-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.22%], valid : [loss = 0.607, top1 = 83.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.163, top1 = 94.63%], test  : [loss = 0.412, top1 = 87.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.18 ms.
cifar100       train : [loss = 1.117, top1 = 67.90%], valid : [loss = 1.520, top1 = 58.51%], test : [loss = 1.535, top1 = 57.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.603, top1 = 34.49%], valid : [loss = 2.667, top1 = 32.87%], test : [loss = 2.696, top1 = 32.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.36%], valid : [loss = 0.907, top1 = 67.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2438/15625) 002438-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.514, top1 = 88.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.324, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.29 ms.
cifar100       train : [loss = 0.331, top1 = 91.04%], valid : [loss = 1.289, top1 = 66.67%], test : [loss = 1.286, top1 = 67.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.09%], valid : [loss = 2.409, top1 = 38.83%], test : [loss = 2.404, top1 = 39.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2439/15625) 002439-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.570, top1 = 87.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.391, top1 = 90.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.396, top1 = 88.77%], valid : [loss = 1.368, top1 = 65.91%], test : [loss = 1.362, top1 = 65.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 41.04%], valid : [loss = 2.500, top1 = 37.04%], test : [loss = 2.531, top1 = 37.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.20%], valid : [loss = 0.783, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2440/15625) 002440-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.12%], valid : [loss = 0.456, top1 = 86.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.19 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.339, top1 = 89.32%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.17 ms.
cifar100       train : [loss = 0.853, top1 = 75.68%], valid : [loss = 1.307, top1 = 63.70%], test : [loss = 1.286, top1 = 63.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.74%], valid : [loss = 2.614, top1 = 35.02%], test : [loss = 2.655, top1 = 34.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 80.02%], valid : [loss = 0.652, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2441/15625) 002441-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.518, top1 = 88.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.321, top1 = 92.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.86 ms.
cifar100       train : [loss = 0.345, top1 = 90.59%], valid : [loss = 1.278, top1 = 67.45%], test : [loss = 1.297, top1 = 66.97%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.73%], valid : [loss = 2.403, top1 = 39.27%], test : [loss = 2.418, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2442/15625) 002442-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.56%], valid : [loss = 0.851, top1 = 75.57%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.303, top1 = 89.42%], test  : [loss = 0.629, top1 = 80.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.34 ms.
cifar100       train : [loss = 1.342, top1 = 62.18%], valid : [loss = 1.893, top1 = 50.90%], test : [loss = 1.884, top1 = 51.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 3.463, top1 = 17.95%], valid : [loss = 3.489, top1 = 18.23%], test : [loss = 3.498, top1 = 16.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.30%], valid : [loss = 1.275, top1 = 53.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2443/15625) 002443-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.44%], valid : [loss = 0.463, top1 = 86.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.157, top1 = 94.91%], test  : [loss = 0.350, top1 = 88.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 0.993, top1 = 71.78%], valid : [loss = 1.355, top1 = 62.30%], test : [loss = 1.344, top1 = 62.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.62%], valid : [loss = 2.701, top1 = 33.18%], test : [loss = 2.720, top1 = 32.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2444/15625) 002444-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.595, top1 = 87.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.377, top1 = 91.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.54 ms.
cifar100       train : [loss = 0.375, top1 = 89.46%], valid : [loss = 1.441, top1 = 64.70%], test : [loss = 1.444, top1 = 65.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.65 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.21%], valid : [loss = 2.482, top1 = 37.20%], test : [loss = 2.492, top1 = 37.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.21%], valid : [loss = 0.869, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2445/15625) 002445-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.142, top1 = 95.55%], valid : [loss = 0.526, top1 = 84.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.119, top1 = 96.11%], test  : [loss = 0.365, top1 = 88.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 0.817, top1 = 76.43%], valid : [loss = 1.383, top1 = 62.89%], test : [loss = 1.381, top1 = 62.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 35.03%], valid : [loss = 2.641, top1 = 33.81%], test : [loss = 2.696, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.46%], valid : [loss = 0.953, top1 = 66.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2446/15625) 002446-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.72%], valid : [loss = 0.559, top1 = 82.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.266, top1 = 90.83%], test  : [loss = 0.423, top1 = 86.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 1.382, top1 = 61.12%], valid : [loss = 1.629, top1 = 55.58%], test : [loss = 1.632, top1 = 55.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.809, top1 = 30.42%], valid : [loss = 2.816, top1 = 30.02%], test : [loss = 2.870, top1 = 29.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.32%], valid : [loss = 1.018, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2447/15625) 002447-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.46%], valid : [loss = 0.460, top1 = 86.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.345, top1 = 88.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.53 ms.
cifar100       train : [loss = 0.992, top1 = 71.82%], valid : [loss = 1.355, top1 = 62.01%], test : [loss = 1.357, top1 = 61.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.70%], valid : [loss = 2.691, top1 = 33.13%], test : [loss = 2.719, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2448/15625) 002448-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.23%], valid : [loss = 0.608, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.070, top1 = 97.86%], test  : [loss = 0.409, top1 = 88.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.83 ms.
cifar100       train : [loss = 0.710, top1 = 79.33%], valid : [loss = 1.397, top1 = 62.85%], test : [loss = 1.354, top1 = 63.81%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.20 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.90%], valid : [loss = 2.653, top1 = 33.71%], test : [loss = 2.705, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2449/15625) 002449-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.621, top1 = 87.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.413, top1 = 90.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.28 ms.
cifar100       train : [loss = 0.203, top1 = 95.20%], valid : [loss = 1.469, top1 = 66.01%], test : [loss = 1.475, top1 = 66.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.38%], valid : [loss = 2.480, top1 = 37.80%], test : [loss = 2.498, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.00%], valid : [loss = 0.825, top1 = 70.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2450/15625) 002450-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.26%], valid : [loss = 0.462, top1 = 86.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.84 ms.
cifar10        train : [loss = 0.162, top1 = 94.66%], test  : [loss = 0.352, top1 = 88.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 1.018, top1 = 70.99%], valid : [loss = 1.369, top1 = 61.87%], test : [loss = 1.379, top1 = 61.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.74%], valid : [loss = 2.705, top1 = 32.17%], test : [loss = 2.732, top1 = 31.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2451/15625) 002451-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.35%], valid : [loss = 0.533, top1 = 82.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.09 ms.
cifar10        train : [loss = 0.405, top1 = 86.22%], test  : [loss = 0.473, top1 = 83.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 1.529, top1 = 58.00%], valid : [loss = 1.660, top1 = 54.35%], test : [loss = 1.637, top1 = 55.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.29%], valid : [loss = 3.016, top1 = 27.19%], test : [loss = 3.055, top1 = 26.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.134, top1 = 59.92%], valid : [loss = 1.146, top1 = 59.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2452/15625) 002452-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.130, top1 = 95.73%], valid : [loss = 0.757, top1 = 80.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.163, top1 = 94.40%], test  : [loss = 0.536, top1 = 84.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 0.870, top1 = 74.49%], valid : [loss = 1.645, top1 = 58.10%], test : [loss = 1.670, top1 = 56.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 3.353, top1 = 19.64%], valid : [loss = 3.364, top1 = 19.86%], test : [loss = 3.379, top1 = 19.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.215, top1 = 55.70%], valid : [loss = 1.252, top1 = 54.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2453/15625) 002453-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.77 ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.81%], valid : [loss = 0.864, top1 = 71.58%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.57 ms.
cifar10        train : [loss = 0.559, top1 = 80.48%], test  : [loss = 0.719, top1 = 75.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.18 ms.
cifar100       train : [loss = 1.784, top1 = 52.07%], valid : [loss = 2.061, top1 = 47.07%], test : [loss = 2.060, top1 = 46.69%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.45 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.76%], valid : [loss = 3.653, top1 = 16.57%], test : [loss = 3.672, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2454/15625) 002454-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10-valid  train : [loss = 0.480, top1 = 83.28%], valid : [loss = 0.646, top1 = 78.32%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 0.505, top1 = 82.50%], test  : [loss = 0.590, top1 = 79.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.24 ms.
cifar100       train : [loss = 1.671, top1 = 54.60%], valid : [loss = 1.833, top1 = 51.24%], test : [loss = 1.858, top1 = 50.89%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.75 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.28%], valid : [loss = 3.321, top1 = 21.64%], test : [loss = 3.352, top1 = 21.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2455/15625) 002455-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.45%], valid : [loss = 0.514, top1 = 84.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10        train : [loss = 0.189, top1 = 93.60%], test  : [loss = 0.382, top1 = 87.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 1.202, top1 = 65.81%], valid : [loss = 1.524, top1 = 58.69%], test : [loss = 1.492, top1 = 59.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.760, top1 = 31.47%], valid : [loss = 2.786, top1 = 31.14%], test : [loss = 2.833, top1 = 29.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.051, top1 = 62.19%], valid : [loss = 1.093, top1 = 61.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2456/15625) 002456-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.563, top1 = 88.47%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.386, top1 = 91.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.37 ms.
cifar100       train : [loss = 0.149, top1 = 96.91%], valid : [loss = 1.477, top1 = 66.29%], test : [loss = 1.487, top1 = 66.25%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.23 ms.
ImageNet16-120 train : [loss = 1.955, top1 = 48.54%], valid : [loss = 2.408, top1 = 38.99%], test : [loss = 2.412, top1 = 40.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.74%], valid : [loss = 0.764, top1 = 73.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2457/15625) 002457-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.94%], valid : [loss = 0.526, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10        train : [loss = 0.073, top1 = 97.66%], test  : [loss = 0.363, top1 = 89.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.33 ms.
cifar100       train : [loss = 0.716, top1 = 78.89%], valid : [loss = 1.342, top1 = 64.09%], test : [loss = 1.340, top1 = 64.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.15%], valid : [loss = 2.637, top1 = 34.06%], test : [loss = 2.667, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.678, top1 = 76.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2458/15625) 002458-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.315, top1 = 89.17%], valid : [loss = 0.566, top1 = 81.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.309, top1 = 89.38%], test  : [loss = 0.427, top1 = 85.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.20 ms.
cifar100       train : [loss = 1.308, top1 = 63.19%], valid : [loss = 1.585, top1 = 56.93%], test : [loss = 1.576, top1 = 56.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 3.062, top1 = 25.91%], valid : [loss = 3.074, top1 = 25.77%], test : [loss = 3.131, top1 = 25.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.18%], valid : [loss = 1.248, top1 = 54.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2459/15625) 002459-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.410, top1 = 85.57%], valid : [loss = 0.632, top1 = 79.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.329, top1 = 88.66%], test  : [loss = 0.475, top1 = 84.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.33 ms.
cifar100       train : [loss = 1.667, top1 = 53.88%], valid : [loss = 1.875, top1 = 49.56%], test : [loss = 1.876, top1 = 49.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 3.176, top1 = 23.38%], valid : [loss = 3.182, top1 = 23.37%], test : [loss = 3.235, top1 = 22.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.35%], valid : [loss = 1.046, top1 = 62.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2460/15625) 002460-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.65%], valid : [loss = 0.717, top1 = 80.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.185, top1 = 93.59%], test  : [loss = 0.529, top1 = 84.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.21 ms.
cifar100       train : [loss = 0.884, top1 = 74.22%], valid : [loss = 1.648, top1 = 57.33%], test : [loss = 1.665, top1 = 57.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 3.517, top1 = 16.55%], valid : [loss = 3.528, top1 = 16.37%], test : [loss = 3.521, top1 = 16.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.63%], valid : [loss = 1.283, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2461/15625) 002461-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.529, top1 = 88.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.339, top1 = 91.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.88 ms.
cifar100       train : [loss = 0.342, top1 = 90.74%], valid : [loss = 1.279, top1 = 67.20%], test : [loss = 1.278, top1 = 67.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.72%], valid : [loss = 2.406, top1 = 38.90%], test : [loss = 2.408, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2462/15625) 002462-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.506, top1 = 90.05%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.322, top1 = 93.34%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.00 ms.
cifar100       train : [loss = 0.040, top1 = 99.48%], valid : [loss = 1.372, top1 = 70.42%], test : [loss = 1.384, top1 = 70.45%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 1.676, top1 = 55.13%], valid : [loss = 2.285, top1 = 43.00%], test : [loss = 2.269, top1 = 43.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.25%], valid : [loss = 0.679, top1 = 76.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2463/15625) 002463-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.171, top1 = 94.24%], valid : [loss = 0.731, top1 = 79.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.172, top1 = 94.10%], test  : [loss = 0.516, top1 = 84.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.91 ms.
cifar100       train : [loss = 0.863, top1 = 74.77%], valid : [loss = 1.645, top1 = 57.63%], test : [loss = 1.659, top1 = 57.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 3.443, top1 = 17.87%], valid : [loss = 3.447, top1 = 18.28%], test : [loss = 3.468, top1 = 17.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.254, top1 = 53.92%], valid : [loss = 1.278, top1 = 53.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2464/15625) 002464-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.512, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.334, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.14 ms.
cifar100       train : [loss = 0.350, top1 = 90.42%], valid : [loss = 1.280, top1 = 67.17%], test : [loss = 1.288, top1 = 67.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.59%], valid : [loss = 2.414, top1 = 39.07%], test : [loss = 2.414, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2465/15625) 002465-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.13%], valid : [loss = 0.558, top1 = 86.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.065, top1 = 97.88%], test  : [loss = 0.356, top1 = 90.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.696, top1 = 79.52%], valid : [loss = 1.330, top1 = 63.91%], test : [loss = 1.332, top1 = 63.53%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.85%], valid : [loss = 2.516, top1 = 36.74%], test : [loss = 2.548, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.05%], valid : [loss = 0.838, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2466/15625) 002466-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.74 ms.
cifar10-valid  train : [loss = 0.220, top1 = 92.56%], valid : [loss = 0.497, top1 = 84.25%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.79 ms.
cifar10        train : [loss = 0.226, top1 = 92.43%], test  : [loss = 0.381, top1 = 87.65%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.26 ms.
cifar100       train : [loss = 1.374, top1 = 61.64%], valid : [loss = 1.622, top1 = 55.73%], test : [loss = 1.609, top1 = 55.31%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 3.379, top1 = 19.96%], valid : [loss = 3.371, top1 = 20.36%], test : [loss = 3.392, top1 = 19.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 60.58%], valid : [loss = 1.109, top1 = 60.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2467/15625) 002467-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.232, top1 = 92.14%], valid : [loss = 0.519, top1 = 83.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.233, top1 = 92.05%], test  : [loss = 0.387, top1 = 87.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 1.298, top1 = 63.40%], valid : [loss = 1.574, top1 = 56.57%], test : [loss = 1.559, top1 = 57.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.755, top1 = 31.63%], valid : [loss = 2.765, top1 = 31.47%], test : [loss = 2.805, top1 = 30.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.65%], valid : [loss = 1.005, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2468/15625) 002468-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.31%], valid : [loss = 0.833, top1 = 79.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.135, top1 = 95.48%], test  : [loss = 0.551, top1 = 84.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.894, top1 = 74.00%], valid : [loss = 1.694, top1 = 57.03%], test : [loss = 1.702, top1 = 57.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.28%], valid : [loss = 3.171, top1 = 24.34%], test : [loss = 3.222, top1 = 23.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 62.64%], valid : [loss = 1.096, top1 = 60.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2469/15625) 002469-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.547, top1 = 88.11%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.31 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.336, top1 = 91.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.30 ms.
cifar100       train : [loss = 0.291, top1 = 92.08%], valid : [loss = 1.248, top1 = 68.27%], test : [loss = 1.292, top1 = 67.97%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.64%], valid : [loss = 2.430, top1 = 38.42%], test : [loss = 2.427, top1 = 38.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.86%], valid : [loss = 0.855, top1 = 69.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2470/15625) 002470-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.565, top1 = 87.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.76 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.386, top1 = 91.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 0.405, top1 = 88.55%], valid : [loss = 1.399, top1 = 65.17%], test : [loss = 1.417, top1 = 65.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.75%], valid : [loss = 2.512, top1 = 36.81%], test : [loss = 2.531, top1 = 37.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2471/15625) 002471-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.545, top1 = 88.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.347, top1 = 91.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.67 ms.
cifar100       train : [loss = 0.439, top1 = 87.17%], valid : [loss = 1.265, top1 = 66.73%], test : [loss = 1.271, top1 = 67.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.50%], valid : [loss = 2.366, top1 = 39.70%], test : [loss = 2.380, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2472/15625) 002472-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.441, top1 = 90.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.289, top1 = 93.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.059, top1 = 99.19%], valid : [loss = 1.339, top1 = 70.49%], test : [loss = 1.340, top1 = 70.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 1.511, top1 = 59.08%], valid : [loss = 2.244, top1 = 43.64%], test : [loss = 2.254, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.54%], valid : [loss = 0.498, top1 = 83.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2473/15625) 002473-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.334, top1 = 91.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.94 ms.
cifar100       train : [loss = 0.338, top1 = 90.76%], valid : [loss = 1.286, top1 = 66.97%], test : [loss = 1.290, top1 = 67.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.70%], valid : [loss = 2.418, top1 = 38.50%], test : [loss = 2.428, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2474/15625) 002474-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.11%], valid : [loss = 0.534, top1 = 84.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.177, top1 = 94.03%], test  : [loss = 0.383, top1 = 88.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 1.183, top1 = 66.29%], valid : [loss = 1.502, top1 = 59.09%], test : [loss = 1.482, top1 = 59.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.94%], valid : [loss = 2.677, top1 = 33.37%], test : [loss = 2.721, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.34%], valid : [loss = 0.956, top1 = 66.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2475/15625) 002475-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.59%], valid : [loss = 0.524, top1 = 87.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10        train : [loss = 0.084, top1 = 97.29%], test  : [loss = 0.342, top1 = 90.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.47 ms.
cifar100       train : [loss = 0.618, top1 = 82.20%], valid : [loss = 1.198, top1 = 66.95%], test : [loss = 1.190, top1 = 67.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.84%], valid : [loss = 2.429, top1 = 38.67%], test : [loss = 2.442, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 69.38%], valid : [loss = 0.916, top1 = 67.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2476/15625) 002476-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.445, top1 = 90.09%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.67 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.295, top1 = 92.81%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.46 ms.
cifar100       train : [loss = 0.128, top1 = 97.46%], valid : [loss = 1.279, top1 = 69.96%], test : [loss = 1.270, top1 = 70.29%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 1.702, top1 = 54.46%], valid : [loss = 2.206, top1 = 43.90%], test : [loss = 2.214, top1 = 44.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.58%], valid : [loss = 0.538, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2477/15625) 002477-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.621, top1 = 87.55%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.09 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.433, top1 = 91.06%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.43 ms.
cifar100       train : [loss = 0.139, top1 = 97.06%], valid : [loss = 1.584, top1 = 65.52%], test : [loss = 1.627, top1 = 64.91%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.91%], valid : [loss = 2.613, top1 = 35.23%], test : [loss = 2.645, top1 = 35.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.44%], valid : [loss = 0.807, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2478/15625) 002478-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.468, top1 = 89.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.309, top1 = 92.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.53 ms.
cifar100       train : [loss = 0.267, top1 = 93.20%], valid : [loss = 1.206, top1 = 68.77%], test : [loss = 1.205, top1 = 69.19%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.45%], valid : [loss = 2.211, top1 = 43.13%], test : [loss = 2.232, top1 = 43.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.60%], valid : [loss = 0.601, top1 = 79.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2479/15625) 002479-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.583, top1 = 87.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.391, top1 = 91.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 0.400, top1 = 88.67%], valid : [loss = 1.417, top1 = 65.06%], test : [loss = 1.401, top1 = 65.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.98%], valid : [loss = 2.503, top1 = 36.81%], test : [loss = 2.538, top1 = 36.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2480/15625) 002480-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.12%], valid : [loss = 0.566, top1 = 86.70%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.10 ms.
cifar10        train : [loss = 0.056, top1 = 98.22%], test  : [loss = 0.376, top1 = 89.76%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.79 ms.
cifar100       train : [loss = 0.538, top1 = 84.49%], valid : [loss = 1.368, top1 = 64.38%], test : [loss = 1.364, top1 = 64.64%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.75 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.11%], valid : [loss = 2.496, top1 = 36.96%], test : [loss = 2.515, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.28%], valid : [loss = 0.860, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2481/15625) 002481-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.19%], valid : [loss = 0.476, top1 = 84.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.26 ms.
cifar10        train : [loss = 0.298, top1 = 90.09%], test  : [loss = 0.401, top1 = 86.50%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.90 ms.
cifar100       train : [loss = 1.322, top1 = 63.29%], valid : [loss = 1.519, top1 = 58.25%], test : [loss = 1.497, top1 = 58.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.56 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.94%], valid : [loss = 2.900, top1 = 29.58%], test : [loss = 2.944, top1 = 28.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2482/15625) 002482-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.605, top1 = 87.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.409, top1 = 91.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.76 ms.
cifar100       train : [loss = 0.140, top1 = 96.91%], valid : [loss = 1.552, top1 = 65.89%], test : [loss = 1.548, top1 = 66.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.026, top1 = 47.08%], valid : [loss = 2.474, top1 = 38.06%], test : [loss = 2.501, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.74%], valid : [loss = 0.797, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2483/15625) 002483-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.95%], valid : [loss = 0.700, top1 = 76.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.08 ms.
cifar10        train : [loss = 0.528, top1 = 81.62%], test  : [loss = 0.589, top1 = 79.71%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.08 ms.
cifar100       train : [loss = 1.731, top1 = 53.01%], valid : [loss = 1.897, top1 = 49.31%], test : [loss = 1.901, top1 = 49.73%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 3.391, top1 = 20.00%], valid : [loss = 3.379, top1 = 20.52%], test : [loss = 3.414, top1 = 19.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2484/15625) 002484-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.57%], valid : [loss = 0.589, top1 = 86.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.19 ms.
cifar10        train : [loss = 0.044, top1 = 98.66%], test  : [loss = 0.405, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 0.566, top1 = 83.20%], valid : [loss = 1.405, top1 = 64.10%], test : [loss = 1.397, top1 = 64.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.499, top1 = 36.67%], valid : [loss = 2.634, top1 = 33.67%], test : [loss = 2.676, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.86%], valid : [loss = 0.737, top1 = 74.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2485/15625) 002485-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.07%], valid : [loss = 0.478, top1 = 84.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10        train : [loss = 0.295, top1 = 90.26%], test  : [loss = 0.397, top1 = 86.70%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.71 ms.
cifar100       train : [loss = 1.320, top1 = 63.39%], valid : [loss = 1.540, top1 = 57.77%], test : [loss = 1.508, top1 = 58.17%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.90%], valid : [loss = 2.913, top1 = 29.50%], test : [loss = 2.944, top1 = 28.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2486/15625) 002486-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.37%], valid : [loss = 1.105, top1 = 63.18%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10        train : [loss = 0.780, top1 = 72.64%], test  : [loss = 0.921, top1 = 68.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.20 ms.
cifar100       train : [loss = 2.126, top1 = 44.23%], valid : [loss = 2.410, top1 = 39.73%], test : [loss = 2.409, top1 = 39.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 3.756, top1 = 14.06%], valid : [loss = 3.810, top1 = 13.86%], test : [loss = 3.824, top1 = 13.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2487/15625) 002487-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.570, top1 = 87.77%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.80 ms.
cifar10        train : [loss = 0.015, top1 = 99.59%], test  : [loss = 0.362, top1 = 91.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.23 ms.
cifar100       train : [loss = 0.175, top1 = 95.63%], valid : [loss = 1.341, top1 = 68.53%], test : [loss = 1.372, top1 = 68.23%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 32.43%], valid : [loss = 2.788, top1 = 30.11%], test : [loss = 2.796, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 65.94%], valid : [loss = 0.982, top1 = 65.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2488/15625) 002488-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.83%], valid : [loss = 0.836, top1 = 71.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 0.678, top1 = 76.31%], test  : [loss = 0.769, top1 = 73.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.70 ms.
cifar100       train : [loss = 1.957, top1 = 47.85%], valid : [loss = 2.131, top1 = 44.31%], test : [loss = 2.152, top1 = 44.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.82%], valid : [loss = 3.677, top1 = 15.53%], test : [loss = 3.689, top1 = 14.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.69%], valid : [loss = 1.407, top1 = 49.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2489/15625) 002489-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.588, top1 = 87.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.387, top1 = 91.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.04 ms.
cifar100       train : [loss = 0.370, top1 = 89.59%], valid : [loss = 1.402, top1 = 65.17%], test : [loss = 1.405, top1 = 65.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.47%], valid : [loss = 2.447, top1 = 37.90%], test : [loss = 2.477, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.73%], valid : [loss = 0.841, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2490/15625) 002490-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.99 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2491/15625) 002491-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.93%], valid : [loss = 0.521, top1 = 87.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10        train : [loss = 0.075, top1 = 97.64%], test  : [loss = 0.358, top1 = 89.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.28 ms.
cifar100       train : [loss = 0.703, top1 = 79.22%], valid : [loss = 1.341, top1 = 64.83%], test : [loss = 1.359, top1 = 63.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.19%], valid : [loss = 2.626, top1 = 33.96%], test : [loss = 2.675, top1 = 33.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2492/15625) 002492-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.37%], valid : [loss = 0.533, top1 = 86.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.073, top1 = 97.78%], test  : [loss = 0.351, top1 = 89.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.18 ms.
cifar100       train : [loss = 0.622, top1 = 81.98%], valid : [loss = 1.343, top1 = 64.47%], test : [loss = 1.325, top1 = 65.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 2.320, top1 = 40.34%], valid : [loss = 2.460, top1 = 37.11%], test : [loss = 2.477, top1 = 37.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.94%], valid : [loss = 0.894, top1 = 68.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2493/15625) 002493-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.30%], valid : [loss = 0.481, top1 = 84.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10        train : [loss = 0.293, top1 = 90.20%], test  : [loss = 0.399, top1 = 86.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 1.318, top1 = 63.35%], valid : [loss = 1.530, top1 = 57.83%], test : [loss = 1.500, top1 = 58.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.69%], valid : [loss = 2.911, top1 = 29.78%], test : [loss = 2.950, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2494/15625) 002494-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.05 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2495/15625) 002495-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.515, top1 = 88.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10        train : [loss = 0.025, top1 = 99.30%], test  : [loss = 0.343, top1 = 91.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.444, top1 = 87.11%], valid : [loss = 1.255, top1 = 67.25%], test : [loss = 1.268, top1 = 67.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.40%], valid : [loss = 2.380, top1 = 39.61%], test : [loss = 2.395, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.85%], valid : [loss = 0.722, top1 = 75.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2496/15625) 002496-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.514, top1 = 88.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.354, top1 = 91.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 0.478, top1 = 85.99%], valid : [loss = 1.343, top1 = 65.68%], test : [loss = 1.326, top1 = 66.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.29%], valid : [loss = 2.534, top1 = 36.36%], test : [loss = 2.574, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2497/15625) 002497-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.25%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.47 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.325, top1 = 92.73%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.37 ms.
cifar100       train : [loss = 0.145, top1 = 97.04%], valid : [loss = 1.313, top1 = 68.38%], test : [loss = 1.320, top1 = 68.97%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.81 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.67%], valid : [loss = 2.316, top1 = 41.44%], test : [loss = 2.314, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.88%], valid : [loss = 0.624, top1 = 78.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2498/15625) 002498-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.584, top1 = 87.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.390, top1 = 90.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 0.388, top1 = 89.02%], valid : [loss = 1.395, top1 = 65.38%], test : [loss = 1.392, top1 = 65.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.91%], valid : [loss = 2.519, top1 = 36.37%], test : [loss = 2.533, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2499/15625) 002499-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.05%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.33 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.319, top1 = 92.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.62 ms.
cifar100       train : [loss = 0.225, top1 = 94.51%], valid : [loss = 1.223, top1 = 68.93%], test : [loss = 1.250, top1 = 68.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.77%], valid : [loss = 2.218, top1 = 42.48%], test : [loss = 2.263, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.46%], valid : [loss = 0.607, top1 = 79.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2500/15625) 002500-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.549, top1 = 89.31%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.45 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.345, top1 = 92.79%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.12 ms.
cifar100       train : [loss = 0.070, top1 = 98.71%], valid : [loss = 1.433, top1 = 69.04%], test : [loss = 1.421, top1 = 69.27%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.99 ms.
ImageNet16-120 train : [loss = 2.026, top1 = 46.77%], valid : [loss = 2.358, top1 = 39.90%], test : [loss = 2.362, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.02%], valid : [loss = 0.826, top1 = 70.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2501/15625) 002501-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.57%], valid : [loss = 0.846, top1 = 79.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10        train : [loss = 0.133, top1 = 95.49%], test  : [loss = 0.559, top1 = 84.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.10 ms.
cifar100       train : [loss = 0.859, top1 = 75.10%], valid : [loss = 1.672, top1 = 57.49%], test : [loss = 1.685, top1 = 57.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.29%], valid : [loss = 3.195, top1 = 23.47%], test : [loss = 3.209, top1 = 23.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2502/15625) 002502-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 0.682, top1 = 75.98%], valid : [loss = 0.856, top1 = 70.91%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10        train : [loss = 0.660, top1 = 76.92%], test  : [loss = 0.751, top1 = 74.13%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.34 ms.
cifar100       train : [loss = 1.942, top1 = 48.26%], valid : [loss = 2.119, top1 = 45.07%], test : [loss = 2.146, top1 = 44.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.54 ms.
ImageNet16-120 train : [loss = 3.644, top1 = 15.81%], valid : [loss = 3.664, top1 = 16.14%], test : [loss = 3.696, top1 = 14.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2503/15625) 002503-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.462, top1 = 89.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.74 ms.
cifar100       train : [loss = 0.313, top1 = 91.48%], valid : [loss = 1.313, top1 = 67.43%], test : [loss = 1.320, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.39%], valid : [loss = 2.361, top1 = 39.97%], test : [loss = 2.391, top1 = 40.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.91%], valid : [loss = 0.595, top1 = 79.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2504/15625) 002504-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.575, top1 = 88.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.353, top1 = 92.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.273, top1 = 92.63%], valid : [loss = 1.341, top1 = 67.23%], test : [loss = 1.341, top1 = 67.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.87%], valid : [loss = 2.419, top1 = 38.72%], test : [loss = 2.409, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 62.28%], valid : [loss = 1.056, top1 = 61.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2505/15625) 002505-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.98%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.15 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.324, top1 = 92.51%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.84 ms.
cifar100       train : [loss = 0.177, top1 = 95.98%], valid : [loss = 1.229, top1 = 69.99%], test : [loss = 1.215, top1 = 70.03%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.752, top1 = 53.31%], valid : [loss = 2.182, top1 = 43.93%], test : [loss = 2.203, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.67%], valid : [loss = 0.736, top1 = 74.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2506/15625) 002506-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.450, top1 = 90.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.300, top1 = 93.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.57 ms.
cifar100       train : [loss = 0.089, top1 = 98.31%], valid : [loss = 1.341, top1 = 69.89%], test : [loss = 1.323, top1 = 70.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 1.634, top1 = 56.12%], valid : [loss = 2.199, top1 = 44.40%], test : [loss = 2.229, top1 = 44.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 84.86%], valid : [loss = 0.559, top1 = 81.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2507/15625) 002507-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.506, top1 = 89.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.324, top1 = 93.10%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.33 ms.
cifar100       train : [loss = 0.067, top1 = 99.01%], valid : [loss = 1.342, top1 = 70.06%], test : [loss = 1.365, top1 = 70.03%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.70%], valid : [loss = 2.366, top1 = 39.57%], test : [loss = 2.362, top1 = 39.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.84%], valid : [loss = 0.698, top1 = 75.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2508/15625) 002508-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.89%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.279, top1 = 93.86%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.90 ms.
cifar100       train : [loss = 0.049, top1 = 99.40%], valid : [loss = 1.264, top1 = 71.87%], test : [loss = 1.254, top1 = 71.81%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 1.390, top1 = 62.10%], valid : [loss = 2.169, top1 = 45.57%], test : [loss = 2.224, top1 = 45.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.74%], valid : [loss = 0.500, top1 = 83.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2509/15625) 002509-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10-valid  train : [loss = 1.260, top1 = 54.68%], valid : [loss = 1.311, top1 = 53.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 1.200, top1 = 57.10%], test  : [loss = 1.203, top1 = 56.72%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.83 ms.
cifar100       train : [loss = 2.756, top1 = 31.21%], valid : [loss = 2.848, top1 = 29.75%], test : [loss = 2.830, top1 = 30.17%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.97 ms.
ImageNet16-120 train : [loss = 3.909, top1 = 11.84%], valid : [loss = 3.906, top1 = 12.37%], test : [loss = 3.927, top1 = 11.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.736, top1 = 34.44%], valid : [loss = 1.737, top1 = 34.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2510/15625) 002510-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.96%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.42 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.276, top1 = 93.89%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.00 ms.
cifar100       train : [loss = 0.041, top1 = 99.56%], valid : [loss = 1.332, top1 = 70.96%], test : [loss = 1.344, top1 = 70.75%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.427, top1 = 61.08%], valid : [loss = 2.241, top1 = 44.21%], test : [loss = 2.260, top1 = 44.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.40%], valid : [loss = 0.474, top1 = 84.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2511/15625) 002511-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.83%], valid : [loss = 0.510, top1 = 85.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.149, top1 = 94.95%], test  : [loss = 0.378, top1 = 88.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.999, top1 = 71.08%], valid : [loss = 1.402, top1 = 61.49%], test : [loss = 1.382, top1 = 61.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.26%], valid : [loss = 2.592, top1 = 35.34%], test : [loss = 2.613, top1 = 35.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 1.000, top1 = 64.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2512/15625) 002512-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.290, top1 = 90.18%], valid : [loss = 0.469, top1 = 84.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10        train : [loss = 0.264, top1 = 91.12%], test  : [loss = 0.367, top1 = 87.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.65 ms.
cifar100       train : [loss = 1.302, top1 = 63.52%], valid : [loss = 1.492, top1 = 58.42%], test : [loss = 1.492, top1 = 58.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 2.823, top1 = 30.40%], valid : [loss = 2.811, top1 = 31.23%], test : [loss = 2.849, top1 = 29.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.34%], valid : [loss = 1.010, top1 = 64.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2513/15625) 002513-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.541, top1 = 89.09%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.349, top1 = 92.65%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.71 ms.
cifar100       train : [loss = 0.098, top1 = 97.98%], valid : [loss = 1.427, top1 = 68.34%], test : [loss = 1.440, top1 = 68.73%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.35%], valid : [loss = 2.426, top1 = 38.17%], test : [loss = 2.415, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.898, top1 = 67.59%], valid : [loss = 0.926, top1 = 66.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2514/15625) 002514-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.527, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.335, top1 = 92.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.24 ms.
cifar100       train : [loss = 0.158, top1 = 96.63%], valid : [loss = 1.302, top1 = 68.51%], test : [loss = 1.314, top1 = 68.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 48.00%], valid : [loss = 2.322, top1 = 40.66%], test : [loss = 2.321, top1 = 41.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.18%], valid : [loss = 0.871, top1 = 68.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2515/15625) 002515-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.490, top1 = 90.22%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.306, top1 = 93.36%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.39 ms.
cifar100       train : [loss = 0.063, top1 = 99.18%], valid : [loss = 1.314, top1 = 70.10%], test : [loss = 1.298, top1 = 70.59%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.43 ms.
ImageNet16-120 train : [loss = 1.656, top1 = 55.58%], valid : [loss = 2.176, top1 = 44.39%], test : [loss = 2.176, top1 = 44.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.45%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2516/15625) 002516-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.599, top1 = 86.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10        train : [loss = 0.027, top1 = 99.24%], test  : [loss = 0.395, top1 = 90.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.492, top1 = 85.67%], valid : [loss = 1.416, top1 = 64.55%], test : [loss = 1.433, top1 = 63.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.23%], valid : [loss = 2.566, top1 = 35.57%], test : [loss = 2.585, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.39%], valid : [loss = 0.857, top1 = 69.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2517/15625) 002517-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.17%], valid : [loss = 0.847, top1 = 72.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.562, top1 = 80.44%], test  : [loss = 0.713, top1 = 75.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.27 ms.
cifar100       train : [loss = 1.787, top1 = 51.91%], valid : [loss = 2.059, top1 = 47.14%], test : [loss = 2.048, top1 = 46.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.75%], valid : [loss = 3.640, top1 = 16.21%], test : [loss = 3.672, top1 = 15.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2518/15625) 002518-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.03%], valid : [loss = 0.483, top1 = 84.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10        train : [loss = 0.295, top1 = 90.11%], test  : [loss = 0.399, top1 = 86.41%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.69 ms.
cifar100       train : [loss = 1.325, top1 = 63.21%], valid : [loss = 1.534, top1 = 57.67%], test : [loss = 1.520, top1 = 57.71%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.98 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.92%], valid : [loss = 2.892, top1 = 29.72%], test : [loss = 2.937, top1 = 28.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2519/15625) 002519-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.511, top1 = 89.85%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.05 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.322, top1 = 93.15%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.24 ms.
cifar100       train : [loss = 0.088, top1 = 98.53%], valid : [loss = 1.307, top1 = 70.05%], test : [loss = 1.306, top1 = 69.79%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.81 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.89%], valid : [loss = 2.222, top1 = 43.29%], test : [loss = 2.225, top1 = 43.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.42%], valid : [loss = 0.695, top1 = 76.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2520/15625) 002520-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.68 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.45 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.94 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.31 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2521/15625) 002521-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.602, top1 = 87.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.404, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.206, top1 = 95.15%], valid : [loss = 1.454, top1 = 66.24%], test : [loss = 1.450, top1 = 65.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.15%], valid : [loss = 2.484, top1 = 37.81%], test : [loss = 2.522, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2522/15625) 002522-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.538, top1 = 88.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.341, top1 = 91.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.28 ms.
cifar100       train : [loss = 0.328, top1 = 91.06%], valid : [loss = 1.298, top1 = 67.07%], test : [loss = 1.297, top1 = 67.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.05%], valid : [loss = 2.414, top1 = 38.48%], test : [loss = 2.435, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2523/15625) 002523-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.536, top1 = 88.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.346, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 0.328, top1 = 91.00%], valid : [loss = 1.305, top1 = 66.99%], test : [loss = 1.300, top1 = 66.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.23%], valid : [loss = 2.411, top1 = 38.77%], test : [loss = 2.437, top1 = 38.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2524/15625) 002524-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.03 ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.66%], valid : [loss = 0.727, top1 = 75.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.47 ms.
cifar10        train : [loss = 0.498, top1 = 82.81%], test  : [loss = 0.573, top1 = 80.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.60 ms.
cifar100       train : [loss = 1.924, top1 = 48.05%], valid : [loss = 2.046, top1 = 45.65%], test : [loss = 2.064, top1 = 45.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 2.984, top1 = 27.01%], valid : [loss = 2.969, top1 = 27.57%], test : [loss = 3.006, top1 = 26.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 59.54%], valid : [loss = 1.178, top1 = 57.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2525/15625) 002525-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.570, top1 = 87.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10        train : [loss = 0.022, top1 = 99.36%], test  : [loss = 0.372, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.70 ms.
cifar100       train : [loss = 0.314, top1 = 91.25%], valid : [loss = 1.309, top1 = 66.74%], test : [loss = 1.296, top1 = 67.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.23%], valid : [loss = 2.391, top1 = 39.70%], test : [loss = 2.402, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.00%], valid : [loss = 0.917, top1 = 67.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2526/15625) 002526-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.474, top1 = 83.56%], valid : [loss = 0.643, top1 = 78.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.10 ms.
cifar10        train : [loss = 0.503, top1 = 82.63%], test  : [loss = 0.588, top1 = 80.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.68 ms.
cifar100       train : [loss = 1.694, top1 = 54.07%], valid : [loss = 1.860, top1 = 50.58%], test : [loss = 1.873, top1 = 50.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.29%], valid : [loss = 3.314, top1 = 21.50%], test : [loss = 3.351, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.62%], valid : [loss = 1.304, top1 = 53.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2527/15625) 002527-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.13%], valid : [loss = 0.564, top1 = 87.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.046, top1 = 98.52%], test  : [loss = 0.392, top1 = 90.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.01 ms.
cifar100       train : [loss = 0.539, top1 = 84.15%], valid : [loss = 1.348, top1 = 64.51%], test : [loss = 1.357, top1 = 64.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 2.444, top1 = 37.58%], valid : [loss = 2.558, top1 = 35.12%], test : [loss = 2.565, top1 = 35.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.32%], valid : [loss = 0.903, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2528/15625) 002528-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.441, top1 = 90.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.51%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.48 ms.
cifar100       train : [loss = 0.063, top1 = 99.09%], valid : [loss = 1.352, top1 = 70.36%], test : [loss = 1.360, top1 = 70.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 1.536, top1 = 58.47%], valid : [loss = 2.251, top1 = 43.50%], test : [loss = 2.273, top1 = 43.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2529/15625) 002529-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.577, top1 = 87.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.367, top1 = 91.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.60 ms.
cifar100       train : [loss = 0.276, top1 = 92.62%], valid : [loss = 1.296, top1 = 67.72%], test : [loss = 1.323, top1 = 67.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.58%], valid : [loss = 2.432, top1 = 38.20%], test : [loss = 2.462, top1 = 38.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 73.13%], valid : [loss = 0.807, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2530/15625) 002530-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.570, top1 = 88.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.349, top1 = 92.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.292, top1 = 91.84%], valid : [loss = 1.339, top1 = 67.38%], test : [loss = 1.353, top1 = 67.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.51%], valid : [loss = 2.419, top1 = 38.30%], test : [loss = 2.428, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.65%], valid : [loss = 0.833, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2531/15625) 002531-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.29 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.339, top1 = 92.46%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.81 ms.
cifar100       train : [loss = 0.101, top1 = 97.99%], valid : [loss = 1.355, top1 = 69.31%], test : [loss = 1.353, top1 = 69.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.776, top1 = 52.79%], valid : [loss = 2.236, top1 = 43.26%], test : [loss = 2.232, top1 = 43.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.65%], valid : [loss = 0.729, top1 = 74.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2532/15625) 002532-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.493, top1 = 89.79%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.21 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 92.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.32 ms.
cifar100       train : [loss = 0.135, top1 = 97.22%], valid : [loss = 1.296, top1 = 68.98%], test : [loss = 1.324, top1 = 69.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.88 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.63%], valid : [loss = 2.283, top1 = 42.37%], test : [loss = 2.275, top1 = 42.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 81.00%], valid : [loss = 0.629, top1 = 78.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2533/15625) 002533-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.23%], valid : [loss = 0.454, top1 = 87.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.113, top1 = 96.46%], test  : [loss = 0.332, top1 = 89.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.35 ms.
cifar100       train : [loss = 0.855, top1 = 75.64%], valid : [loss = 1.286, top1 = 63.98%], test : [loss = 1.289, top1 = 63.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.65%], valid : [loss = 2.621, top1 = 34.94%], test : [loss = 2.653, top1 = 33.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2534/15625) 002534-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.68%], valid : [loss = 0.462, top1 = 86.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10        train : [loss = 0.153, top1 = 95.09%], test  : [loss = 0.342, top1 = 88.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 0.972, top1 = 72.35%], valid : [loss = 1.337, top1 = 62.53%], test : [loss = 1.337, top1 = 62.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.08%], valid : [loss = 2.675, top1 = 32.86%], test : [loss = 2.692, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2535/15625) 002535-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.534, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.344, top1 = 91.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 0.323, top1 = 91.12%], valid : [loss = 1.298, top1 = 67.24%], test : [loss = 1.306, top1 = 67.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.22%], valid : [loss = 2.408, top1 = 38.90%], test : [loss = 2.433, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2536/15625) 002536-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.490, top1 = 89.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.342, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 0.232, top1 = 93.94%], valid : [loss = 1.332, top1 = 68.27%], test : [loss = 1.336, top1 = 67.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.66%], valid : [loss = 2.292, top1 = 42.04%], test : [loss = 2.334, top1 = 41.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.10%], valid : [loss = 0.602, top1 = 79.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2537/15625) 002537-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.510, top1 = 88.80%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.344, top1 = 91.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.36 ms.
cifar100       train : [loss = 0.329, top1 = 91.08%], valid : [loss = 1.276, top1 = 67.19%], test : [loss = 1.271, top1 = 67.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.65%], valid : [loss = 2.407, top1 = 38.54%], test : [loss = 2.424, top1 = 38.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2538/15625) 002538-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.457, top1 = 90.77%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.298, top1 = 93.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.00 ms.
cifar100       train : [loss = 0.049, top1 = 99.36%], valid : [loss = 1.339, top1 = 70.96%], test : [loss = 1.323, top1 = 71.49%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.90 ms.
ImageNet16-120 train : [loss = 1.428, top1 = 61.13%], valid : [loss = 2.201, top1 = 45.06%], test : [loss = 2.222, top1 = 45.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.32%], valid : [loss = 0.510, top1 = 82.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2539/15625) 002539-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.53%], valid : [loss = 0.550, top1 = 83.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.195, top1 = 93.40%], test  : [loss = 0.405, top1 = 87.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.17 ms.
cifar100       train : [loss = 1.247, top1 = 64.60%], valid : [loss = 1.539, top1 = 58.12%], test : [loss = 1.542, top1 = 57.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.704, top1 = 32.53%], valid : [loss = 2.718, top1 = 32.37%], test : [loss = 2.785, top1 = 31.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2540/15625) 002540-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.92%], valid : [loss = 0.467, top1 = 86.07%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.05 ms.
cifar10        train : [loss = 0.146, top1 = 95.34%], test  : [loss = 0.340, top1 = 89.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.47 ms.
cifar100       train : [loss = 0.946, top1 = 73.01%], valid : [loss = 1.327, top1 = 62.88%], test : [loss = 1.325, top1 = 62.89%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 34.36%], valid : [loss = 2.668, top1 = 33.40%], test : [loss = 2.686, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.96%], valid : [loss = 0.766, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2541/15625) 002541-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.488, top1 = 89.13%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.314, top1 = 92.13%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.25 ms.
cifar100       train : [loss = 0.294, top1 = 92.36%], valid : [loss = 1.260, top1 = 67.78%], test : [loss = 1.253, top1 = 68.35%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.80 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.34%], valid : [loss = 2.220, top1 = 43.22%], test : [loss = 2.244, top1 = 42.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.30%], valid : [loss = 0.677, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2542/15625) 002542-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.15 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2543/15625) 002543-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.27%], valid : [loss = 0.681, top1 = 76.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.547, top1 = 80.92%], test  : [loss = 0.610, top1 = 79.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.95 ms.
cifar100       train : [loss = 1.729, top1 = 53.14%], valid : [loss = 1.896, top1 = 49.50%], test : [loss = 1.907, top1 = 49.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 3.387, top1 = 20.16%], valid : [loss = 3.368, top1 = 20.37%], test : [loss = 3.412, top1 = 19.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 50.89%], valid : [loss = 1.373, top1 = 50.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2544/15625) 002544-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.181, top1 = 93.95%], valid : [loss = 0.555, top1 = 83.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.77 ms.
cifar10        train : [loss = 0.191, top1 = 93.53%], test  : [loss = 0.396, top1 = 87.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.58 ms.
cifar100       train : [loss = 1.221, top1 = 65.19%], valid : [loss = 1.542, top1 = 58.21%], test : [loss = 1.534, top1 = 57.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 32.98%], valid : [loss = 2.717, top1 = 31.69%], test : [loss = 2.763, top1 = 31.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.45%], valid : [loss = 0.962, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2545/15625) 002545-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.61%], valid : [loss = 0.572, top1 = 83.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.178, top1 = 94.04%], test  : [loss = 0.399, top1 = 87.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 1.170, top1 = 66.55%], valid : [loss = 1.520, top1 = 58.45%], test : [loss = 1.506, top1 = 58.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.720, top1 = 32.15%], valid : [loss = 2.731, top1 = 31.59%], test : [loss = 2.799, top1 = 30.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.899, top1 = 67.71%], valid : [loss = 0.960, top1 = 65.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2546/15625) 002546-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.572, top1 = 87.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.386, top1 = 91.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.68 ms.
cifar100       train : [loss = 0.403, top1 = 88.57%], valid : [loss = 1.404, top1 = 65.29%], test : [loss = 1.401, top1 = 65.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 41.06%], valid : [loss = 2.515, top1 = 36.76%], test : [loss = 2.536, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2547/15625) 002547-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.443, top1 = 90.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.289, top1 = 93.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.179, top1 = 95.76%], valid : [loss = 1.305, top1 = 69.11%], test : [loss = 1.298, top1 = 69.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.55%], valid : [loss = 2.264, top1 = 42.30%], test : [loss = 2.285, top1 = 42.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.31%], valid : [loss = 0.540, top1 = 81.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2548/15625) 002548-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.48%], valid : [loss = 0.850, top1 = 71.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.557, top1 = 80.64%], test  : [loss = 0.708, top1 = 75.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 1.782, top1 = 51.96%], valid : [loss = 2.056, top1 = 46.88%], test : [loss = 2.059, top1 = 47.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.81%], valid : [loss = 3.645, top1 = 16.36%], test : [loss = 3.674, top1 = 15.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2549/15625) 002549-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.485, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.334, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.34 ms.
cifar100       train : [loss = 0.242, top1 = 93.69%], valid : [loss = 1.322, top1 = 67.60%], test : [loss = 1.308, top1 = 68.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.55%], valid : [loss = 2.308, top1 = 41.57%], test : [loss = 2.321, top1 = 40.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.20%], valid : [loss = 0.570, top1 = 80.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2550/15625) 002550-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.644, top1 = 86.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.435, top1 = 90.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.95 ms.
cifar100       train : [loss = 0.235, top1 = 94.13%], valid : [loss = 1.494, top1 = 65.02%], test : [loss = 1.481, top1 = 65.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.85%], valid : [loss = 2.546, top1 = 36.49%], test : [loss = 2.582, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.26%], valid : [loss = 0.772, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2551/15625) 002551-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.600, top1 = 87.19%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.58 ms.
cifar10        train : [loss = 0.014, top1 = 99.60%], test  : [loss = 0.392, top1 = 91.32%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.06 ms.
cifar100       train : [loss = 0.327, top1 = 90.88%], valid : [loss = 1.440, top1 = 64.46%], test : [loss = 1.436, top1 = 64.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.766, top1 = 30.44%], valid : [loss = 2.856, top1 = 28.56%], test : [loss = 2.854, top1 = 29.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 56.94%], valid : [loss = 1.194, top1 = 56.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2552/15625) 002552-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.471, top1 = 90.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.286, top1 = 93.39%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.04 ms.
cifar100       train : [loss = 0.114, top1 = 97.90%], valid : [loss = 1.266, top1 = 69.43%], test : [loss = 1.258, top1 = 70.19%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.40%], valid : [loss = 2.157, top1 = 44.80%], test : [loss = 2.179, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.44%], valid : [loss = 0.577, top1 = 80.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2553/15625) 002553-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.525, top1 = 89.58%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.50 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.330, top1 = 93.14%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.85 ms.
cifar100       train : [loss = 0.071, top1 = 98.96%], valid : [loss = 1.335, top1 = 69.51%], test : [loss = 1.374, top1 = 69.20%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.19%], valid : [loss = 2.368, top1 = 39.64%], test : [loss = 2.372, top1 = 39.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2554/15625) 002554-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.490, top1 = 89.93%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.15 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.317, top1 = 93.43%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.23 ms.
cifar100       train : [loss = 0.055, top1 = 99.15%], valid : [loss = 1.324, top1 = 71.07%], test : [loss = 1.306, top1 = 71.19%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.53 ms.
ImageNet16-120 train : [loss = 1.665, top1 = 55.44%], valid : [loss = 2.178, top1 = 44.38%], test : [loss = 2.162, top1 = 45.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.70%], valid : [loss = 0.827, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2555/15625) 002555-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.15%], valid : [loss = 0.455, top1 = 87.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10        train : [loss = 0.112, top1 = 96.51%], test  : [loss = 0.323, top1 = 89.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.31 ms.
cifar100       train : [loss = 0.854, top1 = 75.73%], valid : [loss = 1.284, top1 = 64.26%], test : [loss = 1.279, top1 = 64.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.86%], valid : [loss = 2.620, top1 = 34.24%], test : [loss = 2.653, top1 = 33.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.09%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2556/15625) 002556-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.19%], valid : [loss = 0.849, top1 = 71.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.665, top1 = 76.81%], test  : [loss = 0.756, top1 = 73.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.87 ms.
cifar100       train : [loss = 1.947, top1 = 48.37%], valid : [loss = 2.114, top1 = 45.39%], test : [loss = 2.151, top1 = 44.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 3.643, top1 = 15.86%], valid : [loss = 3.663, top1 = 15.58%], test : [loss = 3.690, top1 = 15.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2557/15625) 002557-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.67%], valid : [loss = 0.465, top1 = 86.47%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.83 ms.
cifar10        train : [loss = 0.119, top1 = 96.31%], test  : [loss = 0.336, top1 = 89.31%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.47 ms.
cifar100       train : [loss = 0.733, top1 = 79.45%], valid : [loss = 1.266, top1 = 64.87%], test : [loss = 1.259, top1 = 65.19%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.97%], valid : [loss = 2.583, top1 = 34.31%], test : [loss = 2.617, top1 = 34.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2558/15625) 002558-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.504, top1 = 89.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.63 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.330, top1 = 92.39%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.23 ms.
cifar100       train : [loss = 0.239, top1 = 93.86%], valid : [loss = 1.274, top1 = 68.37%], test : [loss = 1.274, top1 = 68.41%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.18 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 50.93%], valid : [loss = 2.203, top1 = 43.10%], test : [loss = 2.210, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.52%], valid : [loss = 0.738, top1 = 74.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2559/15625) 002559-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.44%], valid : [loss = 0.846, top1 = 71.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.670, top1 = 76.50%], test  : [loss = 0.762, top1 = 73.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 1.938, top1 = 48.51%], valid : [loss = 2.106, top1 = 45.51%], test : [loss = 2.145, top1 = 44.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 3.644, top1 = 15.85%], valid : [loss = 3.668, top1 = 15.69%], test : [loss = 3.689, top1 = 15.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2560/15625) 002560-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.09%], valid : [loss = 0.477, top1 = 84.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.298, top1 = 90.07%], test  : [loss = 0.405, top1 = 86.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.05 ms.
cifar100       train : [loss = 1.324, top1 = 63.29%], valid : [loss = 1.543, top1 = 57.41%], test : [loss = 1.516, top1 = 58.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.80%], valid : [loss = 2.912, top1 = 29.30%], test : [loss = 2.951, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2561/15625) 002561-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.296, top1 = 93.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.16 ms.
cifar100       train : [loss = 0.109, top1 = 98.07%], valid : [loss = 1.305, top1 = 69.66%], test : [loss = 1.297, top1 = 70.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.685, top1 = 54.93%], valid : [loss = 2.226, top1 = 43.91%], test : [loss = 2.230, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 85.86%], valid : [loss = 0.516, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2562/15625) 002562-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.151, top1 = 94.99%], valid : [loss = 0.871, top1 = 77.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.195, top1 = 93.31%], test  : [loss = 0.571, top1 = 83.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.12 ms.
cifar100       train : [loss = 1.013, top1 = 70.86%], valid : [loss = 1.770, top1 = 54.69%], test : [loss = 1.740, top1 = 55.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 3.115, top1 = 24.91%], valid : [loss = 3.238, top1 = 22.93%], test : [loss = 3.252, top1 = 22.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.82%], valid : [loss = 1.198, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2563/15625) 002563-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.23%], valid : [loss = 0.610, top1 = 85.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.068, top1 = 97.98%], test  : [loss = 0.411, top1 = 88.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 0.712, top1 = 79.24%], valid : [loss = 1.398, top1 = 62.89%], test : [loss = 1.367, top1 = 63.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.92%], valid : [loss = 2.662, top1 = 33.27%], test : [loss = 2.695, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2564/15625) 002564-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.481, top1 = 89.28%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.306, top1 = 92.31%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.77 ms.
cifar100       train : [loss = 0.195, top1 = 95.46%], valid : [loss = 1.243, top1 = 69.32%], test : [loss = 1.246, top1 = 69.45%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.86 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.85%], valid : [loss = 2.196, top1 = 43.58%], test : [loss = 2.211, top1 = 43.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.54%], valid : [loss = 0.641, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2565/15625) 002565-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.38 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.45 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.90 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.95 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.85%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2566/15625) 002566-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.428, top1 = 91.03%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.91 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.293, top1 = 93.62%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.00 ms.
cifar100       train : [loss = 0.065, top1 = 99.04%], valid : [loss = 1.339, top1 = 70.75%], test : [loss = 1.324, top1 = 71.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 1.535, top1 = 58.55%], valid : [loss = 2.252, top1 = 43.90%], test : [loss = 2.263, top1 = 43.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.338, top1 = 88.62%], valid : [loss = 0.480, top1 = 84.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2567/15625) 002567-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.50%], valid : [loss = 0.449, top1 = 86.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.49 ms.
cifar10        train : [loss = 0.150, top1 = 95.20%], test  : [loss = 0.346, top1 = 88.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.92 ms.
cifar100       train : [loss = 0.977, top1 = 72.36%], valid : [loss = 1.351, top1 = 62.15%], test : [loss = 1.338, top1 = 62.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.17%], valid : [loss = 2.672, top1 = 33.37%], test : [loss = 2.701, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2568/15625) 002568-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.140, top1 = 95.56%], valid : [loss = 0.541, top1 = 84.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.158, top1 = 94.71%], test  : [loss = 0.390, top1 = 88.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 1.106, top1 = 68.34%], valid : [loss = 1.466, top1 = 59.75%], test : [loss = 1.466, top1 = 59.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.575, top1 = 35.26%], valid : [loss = 2.629, top1 = 34.44%], test : [loss = 2.659, top1 = 33.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.32%], valid : [loss = 0.970, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2569/15625) 002569-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.08%], valid : [loss = 0.535, top1 = 84.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.171, top1 = 94.27%], test  : [loss = 0.375, top1 = 88.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 1.167, top1 = 66.85%], valid : [loss = 1.510, top1 = 58.74%], test : [loss = 1.486, top1 = 59.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.74%], valid : [loss = 2.695, top1 = 32.87%], test : [loss = 2.736, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.42%], valid : [loss = 0.958, top1 = 66.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2570/15625) 002570-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.523, top1 = 89.33%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.329, top1 = 92.96%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.36 ms.
cifar100       train : [loss = 0.112, top1 = 97.82%], valid : [loss = 1.293, top1 = 69.97%], test : [loss = 1.276, top1 = 70.05%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.24 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.84%], valid : [loss = 2.321, top1 = 41.21%], test : [loss = 2.339, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.30%], valid : [loss = 0.813, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2571/15625) 002571-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.49%], valid : [loss = 0.572, top1 = 83.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.172, top1 = 94.23%], test  : [loss = 0.392, top1 = 87.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.63 ms.
cifar100       train : [loss = 1.177, top1 = 66.32%], valid : [loss = 1.531, top1 = 58.35%], test : [loss = 1.518, top1 = 58.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.709, top1 = 32.41%], valid : [loss = 2.735, top1 = 31.99%], test : [loss = 2.771, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.72%], valid : [loss = 0.959, top1 = 66.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2572/15625) 002572-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.53 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2573/15625) 002573-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.563, top1 = 87.65%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.373, top1 = 91.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.57 ms.
cifar100       train : [loss = 0.374, top1 = 89.44%], valid : [loss = 1.422, top1 = 65.41%], test : [loss = 1.396, top1 = 65.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.28%], valid : [loss = 2.497, top1 = 37.63%], test : [loss = 2.518, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.97%], valid : [loss = 0.774, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2574/15625) 002574-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.512, top1 = 89.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.333, top1 = 92.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.00 ms.
cifar100       train : [loss = 0.125, top1 = 97.37%], valid : [loss = 1.332, top1 = 68.78%], test : [loss = 1.336, top1 = 69.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.03%], valid : [loss = 2.337, top1 = 40.80%], test : [loss = 2.325, top1 = 41.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.14%], valid : [loss = 0.808, top1 = 71.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2575/15625) 002575-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.21%], valid : [loss = 0.608, top1 = 85.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.069, top1 = 97.90%], test  : [loss = 0.403, top1 = 88.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 0.715, top1 = 79.13%], valid : [loss = 1.403, top1 = 62.87%], test : [loss = 1.375, top1 = 63.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.14%], valid : [loss = 2.646, top1 = 33.62%], test : [loss = 2.688, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2576/15625) 002576-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.522, top1 = 88.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.348, top1 = 91.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.33 ms.
cifar100       train : [loss = 0.473, top1 = 86.14%], valid : [loss = 1.338, top1 = 65.65%], test : [loss = 1.334, top1 = 65.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.11%], valid : [loss = 2.510, top1 = 36.60%], test : [loss = 2.571, top1 = 35.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.28%], valid : [loss = 0.679, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2577/15625) 002577-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.541, top1 = 89.41%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.344, top1 = 93.02%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.27 ms.
cifar100       train : [loss = 0.032, top1 = 99.69%], valid : [loss = 1.436, top1 = 69.85%], test : [loss = 1.487, top1 = 69.31%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 1.609, top1 = 56.81%], valid : [loss = 2.413, top1 = 40.74%], test : [loss = 2.404, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.28%], valid : [loss = 0.690, top1 = 76.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2578/15625) 002578-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.428, top1 = 90.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.290, top1 = 92.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.76 ms.
cifar100       train : [loss = 0.189, top1 = 95.55%], valid : [loss = 1.282, top1 = 69.02%], test : [loss = 1.297, top1 = 68.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.53%], valid : [loss = 2.296, top1 = 42.44%], test : [loss = 2.297, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.40%], valid : [loss = 0.512, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2579/15625) 002579-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.87%], valid : [loss = 0.754, top1 = 82.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.085, top1 = 97.27%], test  : [loss = 0.490, top1 = 86.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.829, top1 = 75.79%], valid : [loss = 1.583, top1 = 59.46%], test : [loss = 1.555, top1 = 59.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.811, top1 = 30.40%], valid : [loss = 2.929, top1 = 28.19%], test : [loss = 2.984, top1 = 27.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.09%], valid : [loss = 0.883, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2580/15625) 002580-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.418, top1 = 90.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.274, top1 = 93.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.47 ms.
cifar100       train : [loss = 0.072, top1 = 98.87%], valid : [loss = 1.287, top1 = 71.09%], test : [loss = 1.285, top1 = 71.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 1.522, top1 = 58.83%], valid : [loss = 2.211, top1 = 44.96%], test : [loss = 2.240, top1 = 44.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 88.04%], valid : [loss = 0.489, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2581/15625) 002581-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.15 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.421, top1 = 91.53%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.90 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.282, top1 = 94.22%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.65 ms.
cifar100       train : [loss = 0.015, top1 = 99.90%], valid : [loss = 1.260, top1 = 73.13%], test : [loss = 1.232, top1 = 73.17%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.08 ms.
ImageNet16-120 train : [loss = 1.044, top1 = 70.80%], valid : [loss = 2.252, top1 = 46.32%], test : [loss = 2.247, top1 = 46.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.40%], valid : [loss = 0.472, top1 = 84.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2582/15625) 002582-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.26%], valid : [loss = 0.876, top1 = 70.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.670, top1 = 76.44%], test  : [loss = 0.765, top1 = 73.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.82 ms.
cifar100       train : [loss = 1.968, top1 = 47.76%], valid : [loss = 2.146, top1 = 44.47%], test : [loss = 2.164, top1 = 44.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 3.653, top1 = 15.72%], valid : [loss = 3.674, top1 = 15.84%], test : [loss = 3.696, top1 = 15.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2583/15625) 002583-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.565, top1 = 87.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.389, top1 = 91.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 0.401, top1 = 88.62%], valid : [loss = 1.404, top1 = 65.63%], test : [loss = 1.386, top1 = 65.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.88%], valid : [loss = 2.519, top1 = 36.54%], test : [loss = 2.533, top1 = 36.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2584/15625) 002584-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.25%], valid : [loss = 0.449, top1 = 87.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.07 ms.
cifar10        train : [loss = 0.114, top1 = 96.50%], test  : [loss = 0.327, top1 = 89.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.70 ms.
cifar100       train : [loss = 0.858, top1 = 75.60%], valid : [loss = 1.284, top1 = 64.35%], test : [loss = 1.284, top1 = 64.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.84%], valid : [loss = 2.617, top1 = 35.06%], test : [loss = 2.651, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.99%], valid : [loss = 0.651, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2585/15625) 002585-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.564, top1 = 87.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.390, top1 = 91.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.57 ms.
cifar100       train : [loss = 0.403, top1 = 88.61%], valid : [loss = 1.396, top1 = 65.23%], test : [loss = 1.387, top1 = 65.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.82%], valid : [loss = 2.493, top1 = 37.29%], test : [loss = 2.535, top1 = 36.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.57%], valid : [loss = 0.823, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2586/15625) 002586-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.443, top1 = 89.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.301, top1 = 92.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 0.197, top1 = 95.37%], valid : [loss = 1.264, top1 = 69.63%], test : [loss = 1.255, top1 = 69.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.31%], valid : [loss = 2.225, top1 = 43.12%], test : [loss = 2.289, top1 = 42.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2587/15625) 002587-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.67 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2588/15625) 002588-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2589/15625) 002589-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.516, top1 = 88.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.363, top1 = 91.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 0.476, top1 = 86.08%], valid : [loss = 1.344, top1 = 65.66%], test : [loss = 1.340, top1 = 65.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.25%], valid : [loss = 2.513, top1 = 37.31%], test : [loss = 2.540, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2590/15625) 002590-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.301, top1 = 93.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.12 ms.
cifar100       train : [loss = 0.186, top1 = 95.54%], valid : [loss = 1.312, top1 = 68.68%], test : [loss = 1.292, top1 = 69.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.66%], valid : [loss = 2.271, top1 = 41.74%], test : [loss = 2.288, top1 = 42.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.05%], valid : [loss = 0.550, top1 = 81.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2591/15625) 002591-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.53%], valid : [loss = 0.459, top1 = 86.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.152, top1 = 95.04%], test  : [loss = 0.343, top1 = 88.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.28 ms.
cifar100       train : [loss = 0.968, top1 = 72.62%], valid : [loss = 1.349, top1 = 62.57%], test : [loss = 1.342, top1 = 62.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.05%], valid : [loss = 2.680, top1 = 33.09%], test : [loss = 2.699, top1 = 32.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2592/15625) 002592-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.83%], valid : [loss = 0.550, top1 = 88.71%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.25 ms.
cifar10        train : [loss = 0.014, top1 = 99.61%], test  : [loss = 0.376, top1 = 91.63%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.52 ms.
cifar100       train : [loss = 0.230, top1 = 94.09%], valid : [loss = 1.303, top1 = 67.67%], test : [loss = 1.303, top1 = 67.82%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.54 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.22%], valid : [loss = 2.237, top1 = 42.62%], test : [loss = 2.252, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.12%], valid : [loss = 0.725, top1 = 74.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2593/15625) 002593-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.27%], valid : [loss = 0.715, top1 = 82.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10        train : [loss = 0.092, top1 = 97.02%], test  : [loss = 0.451, top1 = 87.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.37 ms.
cifar100       train : [loss = 0.794, top1 = 76.75%], valid : [loss = 1.589, top1 = 59.03%], test : [loss = 1.567, top1 = 59.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.752, top1 = 31.61%], valid : [loss = 2.880, top1 = 28.97%], test : [loss = 2.924, top1 = 29.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.87%], valid : [loss = 0.921, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2594/15625) 002594-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 90.55%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.90 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.312, top1 = 93.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.38 ms.
cifar100       train : [loss = 0.059, top1 = 99.12%], valid : [loss = 1.423, top1 = 69.21%], test : [loss = 1.412, top1 = 69.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 1.571, top1 = 57.68%], valid : [loss = 2.275, top1 = 43.70%], test : [loss = 2.282, top1 = 43.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.84%], valid : [loss = 0.585, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2595/15625) 002595-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.22%], valid : [loss = 0.474, top1 = 84.55%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.70 ms.
cifar10        train : [loss = 0.298, top1 = 90.08%], test  : [loss = 0.397, top1 = 86.59%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.68 ms.
cifar100       train : [loss = 1.323, top1 = 63.25%], valid : [loss = 1.524, top1 = 58.26%], test : [loss = 1.507, top1 = 58.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.59 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.86%], valid : [loss = 2.880, top1 = 29.98%], test : [loss = 2.949, top1 = 28.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2596/15625) 002596-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.69%], valid : [loss = 0.481, top1 = 84.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.13 ms.
cifar10        train : [loss = 0.225, top1 = 92.39%], test  : [loss = 0.387, top1 = 87.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.41 ms.
cifar100       train : [loss = 1.242, top1 = 65.14%], valid : [loss = 1.527, top1 = 57.75%], test : [loss = 1.521, top1 = 57.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.940, top1 = 27.53%], valid : [loss = 2.946, top1 = 27.42%], test : [loss = 2.962, top1 = 26.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2597/15625) 002597-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.57%], valid : [loss = 0.630, top1 = 85.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10        train : [loss = 0.049, top1 = 98.56%], test  : [loss = 0.431, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.78 ms.
cifar100       train : [loss = 0.516, top1 = 85.03%], valid : [loss = 1.453, top1 = 63.30%], test : [loss = 1.463, top1 = 62.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.459, top1 = 37.60%], valid : [loss = 2.698, top1 = 33.28%], test : [loss = 2.748, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.97%], valid : [loss = 0.668, top1 = 77.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2598/15625) 002598-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.74%], valid : [loss = 0.463, top1 = 86.53%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.68 ms.
cifar10        train : [loss = 0.120, top1 = 96.25%], test  : [loss = 0.333, top1 = 89.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.84 ms.
cifar100       train : [loss = 0.734, top1 = 79.42%], valid : [loss = 1.266, top1 = 64.99%], test : [loss = 1.263, top1 = 65.29%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 37.01%], valid : [loss = 2.583, top1 = 34.72%], test : [loss = 2.597, top1 = 34.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2599/15625) 002599-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.530, top1 = 88.30%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.90 ms.
cifar10        train : [loss = 0.024, top1 = 99.33%], test  : [loss = 0.357, top1 = 91.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.18 ms.
cifar100       train : [loss = 0.404, top1 = 88.25%], valid : [loss = 1.276, top1 = 66.90%], test : [loss = 1.285, top1 = 66.87%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.62 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.66%], valid : [loss = 2.422, top1 = 38.69%], test : [loss = 2.449, top1 = 37.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.03%], valid : [loss = 0.762, top1 = 73.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2600/15625) 002600-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.509, top1 = 88.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.331, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.83 ms.
cifar100       train : [loss = 0.325, top1 = 91.29%], valid : [loss = 1.285, top1 = 67.00%], test : [loss = 1.278, top1 = 67.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.22%], valid : [loss = 2.389, top1 = 39.41%], test : [loss = 2.412, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2601/15625) 002601-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.507, top1 = 89.85%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.329, top1 = 93.27%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.54 ms.
cifar100       train : [loss = 0.076, top1 = 98.80%], valid : [loss = 1.389, top1 = 68.83%], test : [loss = 1.381, top1 = 69.73%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.89 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.65%], valid : [loss = 2.365, top1 = 39.54%], test : [loss = 2.357, top1 = 40.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 78.01%], valid : [loss = 0.694, top1 = 76.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2602/15625) 002602-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.559, top1 = 87.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10        train : [loss = 0.032, top1 = 99.03%], test  : [loss = 0.382, top1 = 90.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.536, top1 = 84.49%], valid : [loss = 1.376, top1 = 64.02%], test : [loss = 1.368, top1 = 64.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.576, top1 = 34.46%], valid : [loss = 2.645, top1 = 32.61%], test : [loss = 2.675, top1 = 32.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.45%], valid : [loss = 0.868, top1 = 69.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2603/15625) 002603-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.467, top1 = 89.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.302, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.11 ms.
cifar100       train : [loss = 0.257, top1 = 93.31%], valid : [loss = 1.223, top1 = 69.18%], test : [loss = 1.213, top1 = 69.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.96 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.32%], valid : [loss = 2.221, top1 = 43.26%], test : [loss = 2.221, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2604/15625) 002604-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.561, top1 = 88.77%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.378, top1 = 92.38%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.49 ms.
cifar100       train : [loss = 0.080, top1 = 98.71%], valid : [loss = 1.469, top1 = 67.81%], test : [loss = 1.483, top1 = 68.07%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.63%], valid : [loss = 2.427, top1 = 39.83%], test : [loss = 2.447, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.96%], valid : [loss = 0.713, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2605/15625) 002605-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.58%], valid : [loss = 0.737, top1 = 79.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10        train : [loss = 0.208, top1 = 92.83%], test  : [loss = 0.532, top1 = 83.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.956, top1 = 72.16%], valid : [loss = 1.684, top1 = 56.52%], test : [loss = 1.683, top1 = 56.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 3.434, top1 = 17.98%], valid : [loss = 3.441, top1 = 18.26%], test : [loss = 3.454, top1 = 17.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.231, top1 = 55.45%], valid : [loss = 1.260, top1 = 54.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2606/15625) 002606-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.524, top1 = 88.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.347, top1 = 92.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.226, top1 = 94.41%], valid : [loss = 1.305, top1 = 67.73%], test : [loss = 1.328, top1 = 68.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 47.97%], valid : [loss = 2.348, top1 = 40.46%], test : [loss = 2.339, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.90%], valid : [loss = 0.778, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2607/15625) 002607-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.539, top1 = 88.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.025, top1 = 99.28%], test  : [loss = 0.341, top1 = 91.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 0.408, top1 = 88.19%], valid : [loss = 1.245, top1 = 66.79%], test : [loss = 1.278, top1 = 66.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.26%], valid : [loss = 2.403, top1 = 38.99%], test : [loss = 2.427, top1 = 38.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2608/15625) 002608-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.58%], valid : [loss = 0.460, top1 = 86.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.152, top1 = 95.03%], test  : [loss = 0.342, top1 = 88.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 0.970, top1 = 72.51%], valid : [loss = 1.351, top1 = 62.49%], test : [loss = 1.345, top1 = 62.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.14%], valid : [loss = 2.683, top1 = 32.84%], test : [loss = 2.699, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2609/15625) 002609-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.602, top1 = 85.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10        train : [loss = 0.071, top1 = 97.82%], test  : [loss = 0.398, top1 = 88.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 0.722, top1 = 79.03%], valid : [loss = 1.400, top1 = 62.99%], test : [loss = 1.370, top1 = 63.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.08%], valid : [loss = 2.655, top1 = 33.70%], test : [loss = 2.688, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2610/15625) 002610-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.568, top1 = 87.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.387, top1 = 91.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.47 ms.
cifar100       train : [loss = 0.401, top1 = 88.63%], valid : [loss = 1.416, top1 = 65.33%], test : [loss = 1.396, top1 = 65.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.86%], valid : [loss = 2.511, top1 = 36.67%], test : [loss = 2.536, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2611/15625) 002611-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.66%], valid : [loss = 0.506, top1 = 88.05%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.58 ms.
cifar10        train : [loss = 0.041, top1 = 98.87%], test  : [loss = 0.356, top1 = 90.41%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.00 ms.
cifar100       train : [loss = 0.486, top1 = 86.07%], valid : [loss = 1.300, top1 = 66.39%], test : [loss = 1.279, top1 = 66.72%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.81%], valid : [loss = 2.420, top1 = 38.87%], test : [loss = 2.449, top1 = 38.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.91%], valid : [loss = 0.600, top1 = 79.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2612/15625) 002612-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.46%], valid : [loss = 0.724, top1 = 81.52%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10        train : [loss = 0.145, top1 = 95.08%], test  : [loss = 0.453, top1 = 86.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.08 ms.
cifar100       train : [loss = 0.935, top1 = 72.86%], valid : [loss = 1.627, top1 = 57.27%], test : [loss = 1.610, top1 = 57.65%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 3.033, top1 = 25.70%], valid : [loss = 3.125, top1 = 24.68%], test : [loss = 3.138, top1 = 23.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.66%], valid : [loss = 1.053, top1 = 62.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2613/15625) 002613-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.568, top1 = 88.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.367, top1 = 92.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.16 ms.
cifar100       train : [loss = 0.097, top1 = 98.31%], valid : [loss = 1.423, top1 = 68.41%], test : [loss = 1.446, top1 = 68.35%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.68%], valid : [loss = 2.445, top1 = 39.14%], test : [loss = 2.456, top1 = 39.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2614/15625) 002614-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.497, top1 = 88.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.333, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.72 ms.
cifar100       train : [loss = 0.328, top1 = 91.11%], valid : [loss = 1.286, top1 = 67.29%], test : [loss = 1.293, top1 = 67.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 45.02%], valid : [loss = 2.409, top1 = 38.72%], test : [loss = 2.412, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.79%], valid : [loss = 0.648, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2615/15625) 002615-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.592, top1 = 87.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.391, top1 = 91.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.226, top1 = 94.44%], valid : [loss = 1.449, top1 = 66.21%], test : [loss = 1.447, top1 = 66.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.90%], valid : [loss = 2.476, top1 = 38.30%], test : [loss = 2.512, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.18%], valid : [loss = 0.716, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2616/15625) 002616-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.477, top1 = 89.70%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.301, top1 = 92.77%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.84 ms.
cifar100       train : [loss = 0.292, top1 = 92.19%], valid : [loss = 1.240, top1 = 68.36%], test : [loss = 1.246, top1 = 68.77%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.28%], valid : [loss = 2.211, top1 = 42.87%], test : [loss = 2.214, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.58%], valid : [loss = 0.634, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2617/15625) 002617-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.89%], valid : [loss = 0.974, top1 = 66.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10        train : [loss = 0.784, top1 = 72.40%], test  : [loss = 0.865, top1 = 69.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.70 ms.
cifar100       train : [loss = 2.145, top1 = 43.68%], valid : [loss = 2.317, top1 = 40.74%], test : [loss = 2.346, top1 = 40.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 3.746, top1 = 14.16%], valid : [loss = 3.779, top1 = 14.43%], test : [loss = 3.780, top1 = 13.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.424, top1 = 48.10%], valid : [loss = 1.452, top1 = 46.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2618/15625) 002618-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.557, top1 = 87.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.355, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.90 ms.
cifar100       train : [loss = 0.540, top1 = 84.53%], valid : [loss = 1.381, top1 = 64.28%], test : [loss = 1.355, top1 = 64.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.14%], valid : [loss = 2.601, top1 = 34.83%], test : [loss = 2.614, top1 = 34.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.22%], valid : [loss = 0.905, top1 = 67.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2619/15625) 002619-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.44%], valid : [loss = 0.830, top1 = 79.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.134, top1 = 95.50%], test  : [loss = 0.554, top1 = 84.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.99 ms.
cifar100       train : [loss = 0.868, top1 = 74.76%], valid : [loss = 1.676, top1 = 57.53%], test : [loss = 1.668, top1 = 57.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 3.053, top1 = 26.09%], valid : [loss = 3.192, top1 = 23.73%], test : [loss = 3.217, top1 = 23.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 61.73%], valid : [loss = 1.121, top1 = 59.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2620/15625) 002620-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.141, top1 = 95.55%], valid : [loss = 0.630, top1 = 82.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.156, top1 = 94.81%], test  : [loss = 0.436, top1 = 86.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.47 ms.
cifar100       train : [loss = 0.874, top1 = 74.80%], valid : [loss = 1.531, top1 = 59.77%], test : [loss = 1.550, top1 = 59.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.851, top1 = 29.72%], valid : [loss = 2.907, top1 = 28.73%], test : [loss = 2.929, top1 = 28.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.54%], valid : [loss = 1.034, top1 = 63.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2621/15625) 002621-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.605, top1 = 85.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.403, top1 = 88.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 0.713, top1 = 79.28%], valid : [loss = 1.401, top1 = 63.07%], test : [loss = 1.368, top1 = 63.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.05%], valid : [loss = 2.655, top1 = 33.40%], test : [loss = 2.697, top1 = 33.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2622/15625) 002622-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.582, top1 = 87.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.381, top1 = 91.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 0.398, top1 = 88.75%], valid : [loss = 1.395, top1 = 65.52%], test : [loss = 1.384, top1 = 65.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.89 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.89%], valid : [loss = 2.521, top1 = 36.27%], test : [loss = 2.549, top1 = 36.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2623/15625) 002623-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.66%], valid : [loss = 0.678, top1 = 78.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.368, top1 = 87.18%], test  : [loss = 0.515, top1 = 82.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.80 ms.
cifar100       train : [loss = 1.556, top1 = 56.89%], valid : [loss = 1.831, top1 = 51.26%], test : [loss = 1.823, top1 = 51.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 3.275, top1 = 21.87%], valid : [loss = 3.286, top1 = 21.97%], test : [loss = 3.308, top1 = 21.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.167, top1 = 57.74%], valid : [loss = 1.225, top1 = 56.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2624/15625) 002624-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.556, top1 = 88.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.381, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.165, top1 = 96.44%], valid : [loss = 1.405, top1 = 67.15%], test : [loss = 1.414, top1 = 67.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.12%], valid : [loss = 2.474, top1 = 38.54%], test : [loss = 2.470, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2625/15625) 002625-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.81%], valid : [loss = 0.715, top1 = 75.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.00 ms.
cifar10        train : [loss = 0.586, top1 = 79.53%], test  : [loss = 0.640, top1 = 78.08%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 1.869, top1 = 49.65%], valid : [loss = 2.023, top1 = 46.80%], test : [loss = 2.044, top1 = 46.63%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.77 ms.
ImageNet16-120 train : [loss = 3.440, top1 = 19.09%], valid : [loss = 3.426, top1 = 20.17%], test : [loss = 3.457, top1 = 17.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.440, top1 = 46.98%], valid : [loss = 1.462, top1 = 46.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2626/15625) 002626-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.70%], valid : [loss = 0.466, top1 = 86.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.20 ms.
cifar10        train : [loss = 0.116, top1 = 96.38%], test  : [loss = 0.336, top1 = 89.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.26 ms.
cifar100       train : [loss = 0.738, top1 = 79.39%], valid : [loss = 1.262, top1 = 65.05%], test : [loss = 1.259, top1 = 64.85%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 37.02%], valid : [loss = 2.586, top1 = 34.91%], test : [loss = 2.612, top1 = 34.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.80%], valid : [loss = 0.890, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2627/15625) 002627-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.457, top1 = 89.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.332, top1 = 91.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.36 ms.
cifar100       train : [loss = 0.323, top1 = 91.21%], valid : [loss = 1.285, top1 = 67.33%], test : [loss = 1.287, top1 = 67.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.42%], valid : [loss = 2.345, top1 = 40.51%], test : [loss = 2.399, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.23%], valid : [loss = 0.557, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2628/15625) 002628-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.94%], valid : [loss = 0.526, top1 = 87.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.075, top1 = 97.64%], test  : [loss = 0.369, top1 = 89.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.35 ms.
cifar100       train : [loss = 0.706, top1 = 79.22%], valid : [loss = 1.355, top1 = 64.24%], test : [loss = 1.322, top1 = 64.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.520, top1 = 36.26%], valid : [loss = 2.624, top1 = 34.00%], test : [loss = 2.683, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2629/15625) 002629-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.504, top1 = 89.83%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.317, top1 = 93.13%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.33 ms.
cifar100       train : [loss = 0.051, top1 = 99.27%], valid : [loss = 1.393, top1 = 69.15%], test : [loss = 1.423, top1 = 69.33%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.40%], valid : [loss = 2.389, top1 = 39.52%], test : [loss = 2.374, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.36%], valid : [loss = 1.002, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2630/15625) 002630-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.544, top1 = 88.91%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.88 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.349, top1 = 92.54%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.11 ms.
cifar100       train : [loss = 0.098, top1 = 97.89%], valid : [loss = 1.495, top1 = 67.03%], test : [loss = 1.512, top1 = 67.44%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.47%], valid : [loss = 2.672, top1 = 32.64%], test : [loss = 2.704, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.123, top1 = 59.32%], valid : [loss = 1.133, top1 = 58.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2631/15625) 002631-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.82%], valid : [loss = 0.593, top1 = 85.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10        train : [loss = 0.083, top1 = 97.33%], test  : [loss = 0.388, top1 = 88.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.22 ms.
cifar100       train : [loss = 0.754, top1 = 77.84%], valid : [loss = 1.413, top1 = 62.51%], test : [loss = 1.403, top1 = 62.81%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.585, top1 = 34.93%], valid : [loss = 2.697, top1 = 32.69%], test : [loss = 2.713, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.60%], valid : [loss = 0.834, top1 = 70.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2632/15625) 002632-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.479, top1 = 90.19%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.319, top1 = 93.36%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.60 ms.
cifar100       train : [loss = 0.074, top1 = 98.84%], valid : [loss = 1.326, top1 = 70.01%], test : [loss = 1.309, top1 = 69.95%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.33 ms.
ImageNet16-120 train : [loss = 1.723, top1 = 54.03%], valid : [loss = 2.170, top1 = 44.44%], test : [loss = 2.188, top1 = 44.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.27%], valid : [loss = 0.790, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2633/15625) 002633-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.544, top1 = 88.95%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.40 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.359, top1 = 92.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.85 ms.
cifar100       train : [loss = 0.184, top1 = 95.68%], valid : [loss = 1.343, top1 = 67.41%], test : [loss = 1.362, top1 = 67.79%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.78%], valid : [loss = 2.383, top1 = 38.71%], test : [loss = 2.392, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.55%], valid : [loss = 0.936, top1 = 66.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2634/15625) 002634-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.580, top1 = 87.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.381, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.402, top1 = 88.64%], valid : [loss = 1.387, top1 = 65.41%], test : [loss = 1.380, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.94%], valid : [loss = 2.505, top1 = 36.93%], test : [loss = 2.522, top1 = 37.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2635/15625) 002635-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.490, top1 = 88.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.315, top1 = 92.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.97 ms.
cifar100       train : [loss = 0.228, top1 = 94.43%], valid : [loss = 1.229, top1 = 68.78%], test : [loss = 1.267, top1 = 68.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.40%], valid : [loss = 2.266, top1 = 41.43%], test : [loss = 2.282, top1 = 41.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2636/15625) 002636-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.19%], valid : [loss = 0.595, top1 = 85.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.389, top1 = 88.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.79 ms.
cifar100       train : [loss = 0.705, top1 = 79.53%], valid : [loss = 1.368, top1 = 63.59%], test : [loss = 1.377, top1 = 62.99%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.95%], valid : [loss = 2.647, top1 = 34.13%], test : [loss = 2.692, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.26%], valid : [loss = 0.776, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2637/15625) 002637-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.34%], valid : [loss = 0.598, top1 = 86.17%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.34 ms.
cifar10        train : [loss = 0.053, top1 = 98.33%], test  : [loss = 0.392, top1 = 89.61%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.28 ms.
cifar100       train : [loss = 0.459, top1 = 86.72%], valid : [loss = 1.392, top1 = 64.78%], test : [loss = 1.367, top1 = 64.89%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.75%], valid : [loss = 2.481, top1 = 37.44%], test : [loss = 2.495, top1 = 36.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.10%], valid : [loss = 0.958, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2638/15625) 002638-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.099, top1 = 96.86%], valid : [loss = 0.756, top1 = 80.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.129, top1 = 95.65%], test  : [loss = 0.437, top1 = 87.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 0.949, top1 = 72.38%], valid : [loss = 1.702, top1 = 56.06%], test : [loss = 1.679, top1 = 56.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.799, top1 = 30.66%], valid : [loss = 2.937, top1 = 27.89%], test : [loss = 2.989, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.06%], valid : [loss = 0.978, top1 = 65.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2639/15625) 002639-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.536, top1 = 88.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 0.025, top1 = 99.28%], test  : [loss = 0.349, top1 = 91.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.68 ms.
cifar100       train : [loss = 0.405, top1 = 88.27%], valid : [loss = 1.253, top1 = 66.84%], test : [loss = 1.281, top1 = 66.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.25%], valid : [loss = 2.410, top1 = 38.86%], test : [loss = 2.441, top1 = 38.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2640/15625) 002640-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.87%], valid : [loss = 0.722, top1 = 83.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.084, top1 = 97.32%], test  : [loss = 0.486, top1 = 86.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.97 ms.
cifar100       train : [loss = 0.814, top1 = 76.22%], valid : [loss = 1.577, top1 = 59.51%], test : [loss = 1.534, top1 = 59.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.821, top1 = 30.30%], valid : [loss = 2.969, top1 = 27.92%], test : [loss = 2.995, top1 = 27.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.02%], valid : [loss = 0.848, top1 = 70.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2641/15625) 002641-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.580, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.32 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.379, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.84 ms.
cifar100       train : [loss = 0.090, top1 = 98.33%], valid : [loss = 1.500, top1 = 67.73%], test : [loss = 1.494, top1 = 67.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.88%], valid : [loss = 2.358, top1 = 39.92%], test : [loss = 2.352, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.65%], valid : [loss = 0.686, top1 = 76.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2642/15625) 002642-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.507, top1 = 88.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.331, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.05 ms.
cifar100       train : [loss = 0.344, top1 = 90.61%], valid : [loss = 1.293, top1 = 67.09%], test : [loss = 1.290, top1 = 67.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.82%], valid : [loss = 2.390, top1 = 39.34%], test : [loss = 2.403, top1 = 39.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2643/15625) 002643-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.560, top1 = 87.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.62 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.357, top1 = 91.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.94 ms.
cifar100       train : [loss = 0.559, top1 = 83.98%], valid : [loss = 1.377, top1 = 63.57%], test : [loss = 1.368, top1 = 64.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.34%], valid : [loss = 2.597, top1 = 34.82%], test : [loss = 2.620, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 70.42%], valid : [loss = 0.871, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2644/15625) 002644-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.65%], valid : [loss = 0.654, top1 = 84.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.15 ms.
cifar10        train : [loss = 0.073, top1 = 97.69%], test  : [loss = 0.407, top1 = 88.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.83 ms.
cifar100       train : [loss = 0.770, top1 = 77.37%], valid : [loss = 1.439, top1 = 62.00%], test : [loss = 1.429, top1 = 61.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.562, top1 = 35.35%], valid : [loss = 2.679, top1 = 32.60%], test : [loss = 2.704, top1 = 32.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.79%], valid : [loss = 0.863, top1 = 69.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2645/15625) 002645-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.73 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.66%], valid : [loss = 0.630, top1 = 86.67%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.85 ms.
cifar10        train : [loss = 0.017, top1 = 99.50%], test  : [loss = 0.407, top1 = 91.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.54 ms.
cifar100       train : [loss = 0.365, top1 = 89.68%], valid : [loss = 1.501, top1 = 62.93%], test : [loss = 1.507, top1 = 63.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 3.189, top1 = 22.00%], valid : [loss = 3.183, top1 = 22.47%], test : [loss = 3.194, top1 = 22.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.83%], valid : [loss = 1.205, top1 = 56.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2646/15625) 002646-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.035, top1 = 98.98%], valid : [loss = 0.567, top1 = 86.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10        train : [loss = 0.061, top1 = 98.04%], test  : [loss = 0.380, top1 = 89.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.33 ms.
cifar100       train : [loss = 0.677, top1 = 80.03%], valid : [loss = 1.352, top1 = 64.14%], test : [loss = 1.336, top1 = 64.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.83%], valid : [loss = 2.489, top1 = 36.57%], test : [loss = 2.509, top1 = 36.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2647/15625) 002647-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.532, top1 = 87.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10        train : [loss = 0.032, top1 = 99.12%], test  : [loss = 0.363, top1 = 90.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.15 ms.
cifar100       train : [loss = 0.471, top1 = 86.16%], valid : [loss = 1.339, top1 = 65.66%], test : [loss = 1.310, top1 = 66.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.78%], valid : [loss = 2.478, top1 = 37.84%], test : [loss = 2.499, top1 = 37.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.30%], valid : [loss = 0.650, top1 = 78.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2648/15625) 002648-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.430, top1 = 90.48%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.287, top1 = 93.25%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.26 ms.
cifar100       train : [loss = 0.175, top1 = 95.92%], valid : [loss = 1.275, top1 = 69.45%], test : [loss = 1.267, top1 = 69.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.14%], valid : [loss = 2.240, top1 = 43.00%], test : [loss = 2.275, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.363, top1 = 87.64%], valid : [loss = 0.494, top1 = 83.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2649/15625) 002649-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.21%], valid : [loss = 0.445, top1 = 87.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.114, top1 = 96.44%], test  : [loss = 0.330, top1 = 89.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.854, top1 = 75.69%], valid : [loss = 1.299, top1 = 63.98%], test : [loss = 1.266, top1 = 64.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.68%], valid : [loss = 2.636, top1 = 34.23%], test : [loss = 2.653, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.76%], valid : [loss = 0.649, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2650/15625) 002650-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.444, top1 = 89.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.298, top1 = 92.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.195, top1 = 95.46%], valid : [loss = 1.265, top1 = 69.52%], test : [loss = 1.259, top1 = 69.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.28%], valid : [loss = 2.227, top1 = 42.86%], test : [loss = 2.294, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2651/15625) 002651-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.524, top1 = 88.83%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.343, top1 = 92.10%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.74 ms.
cifar100       train : [loss = 0.288, top1 = 92.26%], valid : [loss = 1.296, top1 = 67.19%], test : [loss = 1.297, top1 = 67.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.67 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.71%], valid : [loss = 2.381, top1 = 39.06%], test : [loss = 2.375, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.26%], valid : [loss = 0.723, top1 = 74.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2652/15625) 002652-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.586, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.392, top1 = 91.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.36 ms.
cifar100       train : [loss = 0.162, top1 = 96.67%], valid : [loss = 1.434, top1 = 67.14%], test : [loss = 1.430, top1 = 66.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.77%], valid : [loss = 2.514, top1 = 38.02%], test : [loss = 2.509, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.59%], valid : [loss = 0.707, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2653/15625) 002653-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.66 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.93%], valid : [loss = 0.732, top1 = 83.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.79 ms.
cifar10        train : [loss = 0.084, top1 = 97.30%], test  : [loss = 0.489, top1 = 86.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.18 ms.
cifar100       train : [loss = 0.795, top1 = 76.74%], valid : [loss = 1.530, top1 = 60.28%], test : [loss = 1.517, top1 = 60.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.816, top1 = 30.30%], valid : [loss = 2.943, top1 = 28.00%], test : [loss = 3.000, top1 = 27.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2654/15625) 002654-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.604, top1 = 87.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.400, top1 = 91.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.39 ms.
cifar100       train : [loss = 0.209, top1 = 94.95%], valid : [loss = 1.564, top1 = 64.83%], test : [loss = 1.562, top1 = 64.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.089, top1 = 45.55%], valid : [loss = 2.513, top1 = 37.03%], test : [loss = 2.562, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.23%], valid : [loss = 0.780, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2655/15625) 002655-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.526, top1 = 88.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.355, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 0.328, top1 = 91.03%], valid : [loss = 1.277, top1 = 67.34%], test : [loss = 1.312, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.30%], valid : [loss = 2.419, top1 = 38.10%], test : [loss = 2.426, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2656/15625) 002656-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.16 ms.
cifar10-valid  train : [loss = 1.218, top1 = 56.29%], valid : [loss = 1.254, top1 = 55.22%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.91 ms.
cifar10        train : [loss = 1.139, top1 = 59.37%], test  : [loss = 1.148, top1 = 58.90%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.12 ms.
cifar100       train : [loss = 2.700, top1 = 32.34%], valid : [loss = 2.781, top1 = 31.27%], test : [loss = 2.762, top1 = 31.51%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.32 ms.
ImageNet16-120 train : [loss = 3.871, top1 = 12.39%], valid : [loss = 3.871, top1 = 12.80%], test : [loss = 3.891, top1 = 12.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2657/15625) 002657-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.506, top1 = 89.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.317, top1 = 92.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.153, top1 = 96.79%], valid : [loss = 1.293, top1 = 68.93%], test : [loss = 1.299, top1 = 69.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.67%], valid : [loss = 2.319, top1 = 41.39%], test : [loss = 2.307, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.33%], valid : [loss = 0.662, top1 = 77.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2658/15625) 002658-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.541, top1 = 89.36%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.92 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.344, top1 = 92.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.09 ms.
cifar100       train : [loss = 0.084, top1 = 98.63%], valid : [loss = 1.374, top1 = 68.71%], test : [loss = 1.419, top1 = 68.37%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.088, top1 = 45.37%], valid : [loss = 2.401, top1 = 38.47%], test : [loss = 2.418, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.802, top1 = 71.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2659/15625) 002659-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.71%], valid : [loss = 0.670, top1 = 85.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.036, top1 = 99.04%], test  : [loss = 0.434, top1 = 89.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.35 ms.
cifar100       train : [loss = 0.420, top1 = 88.40%], valid : [loss = 1.405, top1 = 64.53%], test : [loss = 1.401, top1 = 64.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.38%], valid : [loss = 2.629, top1 = 35.46%], test : [loss = 2.645, top1 = 34.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 73.83%], valid : [loss = 0.793, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2660/15625) 002660-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.557, top1 = 88.31%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.359, top1 = 91.87%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.03 ms.
cifar100       train : [loss = 0.232, top1 = 93.98%], valid : [loss = 1.298, top1 = 67.87%], test : [loss = 1.343, top1 = 67.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 2.211, top1 = 42.57%], valid : [loss = 2.464, top1 = 37.34%], test : [loss = 2.467, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.996, top1 = 63.88%], valid : [loss = 1.020, top1 = 63.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2661/15625) 002661-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.604, top1 = 85.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.067, top1 = 97.96%], test  : [loss = 0.406, top1 = 88.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.74 ms.
cifar100       train : [loss = 0.712, top1 = 79.20%], valid : [loss = 1.391, top1 = 63.16%], test : [loss = 1.369, top1 = 63.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 2.524, top1 = 36.30%], valid : [loss = 2.651, top1 = 33.69%], test : [loss = 2.679, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2662/15625) 002662-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.553, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.032, top1 = 99.03%], test  : [loss = 0.368, top1 = 90.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.441, top1 = 87.14%], valid : [loss = 1.264, top1 = 67.15%], test : [loss = 1.252, top1 = 67.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.85%], valid : [loss = 2.383, top1 = 39.30%], test : [loss = 2.419, top1 = 38.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.20%], valid : [loss = 0.876, top1 = 68.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2663/15625) 002663-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.485, top1 = 89.11%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.07 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.302, top1 = 92.60%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.81 ms.
cifar100       train : [loss = 0.267, top1 = 93.14%], valid : [loss = 1.195, top1 = 68.99%], test : [loss = 1.208, top1 = 69.25%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.71 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.00%], valid : [loss = 2.204, top1 = 42.73%], test : [loss = 2.236, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.32%], valid : [loss = 0.613, top1 = 78.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2664/15625) 002664-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.514, top1 = 88.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.331, top1 = 91.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.12 ms.
cifar100       train : [loss = 0.333, top1 = 90.93%], valid : [loss = 1.291, top1 = 66.89%], test : [loss = 1.284, top1 = 67.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.94%], valid : [loss = 2.412, top1 = 38.93%], test : [loss = 2.418, top1 = 38.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2665/15625) 002665-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.42%], valid : [loss = 0.701, top1 = 84.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10        train : [loss = 0.049, top1 = 98.51%], test  : [loss = 0.437, top1 = 88.71%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.43 ms.
cifar100       train : [loss = 0.609, top1 = 82.14%], valid : [loss = 1.540, top1 = 60.91%], test : [loss = 1.494, top1 = 61.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.91%], valid : [loss = 2.784, top1 = 31.07%], test : [loss = 2.842, top1 = 30.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.66%], valid : [loss = 0.941, top1 = 66.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2666/15625) 002666-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.21 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.89%], valid : [loss = 0.461, top1 = 86.57%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.40 ms.
cifar10        train : [loss = 0.117, top1 = 96.38%], test  : [loss = 0.341, top1 = 89.20%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.10 ms.
cifar100       train : [loss = 0.740, top1 = 79.26%], valid : [loss = 1.270, top1 = 65.15%], test : [loss = 1.254, top1 = 65.55%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 2.481, top1 = 37.13%], valid : [loss = 2.562, top1 = 35.24%], test : [loss = 2.587, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.18%], valid : [loss = 0.819, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2667/15625) 002667-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.512, top1 = 88.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.331, top1 = 92.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.313, top1 = 91.59%], valid : [loss = 1.260, top1 = 67.97%], test : [loss = 1.253, top1 = 68.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.67%], valid : [loss = 2.322, top1 = 40.77%], test : [loss = 2.355, top1 = 40.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.72%], valid : [loss = 0.721, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2668/15625) 002668-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2669/15625) 002669-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.51%], valid : [loss = 0.727, top1 = 83.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10        train : [loss = 0.054, top1 = 98.38%], test  : [loss = 0.446, top1 = 88.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.56 ms.
cifar100       train : [loss = 0.502, top1 = 85.70%], valid : [loss = 1.583, top1 = 61.01%], test : [loss = 1.580, top1 = 61.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.402, top1 = 38.62%], valid : [loss = 2.709, top1 = 32.23%], test : [loss = 2.726, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.30%], valid : [loss = 0.847, top1 = 69.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2670/15625) 002670-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.555, top1 = 87.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.381, top1 = 91.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.17 ms.
cifar100       train : [loss = 0.399, top1 = 88.63%], valid : [loss = 1.381, top1 = 65.89%], test : [loss = 1.401, top1 = 65.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.92%], valid : [loss = 2.468, top1 = 37.59%], test : [loss = 2.495, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.42%], valid : [loss = 0.765, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2671/15625) 002671-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.64%], valid : [loss = 0.627, top1 = 85.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.034, top1 = 99.06%], test  : [loss = 0.409, top1 = 90.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.67 ms.
cifar100       train : [loss = 0.526, top1 = 84.61%], valid : [loss = 1.432, top1 = 63.47%], test : [loss = 1.420, top1 = 64.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.434, top1 = 38.05%], valid : [loss = 2.588, top1 = 34.78%], test : [loss = 2.638, top1 = 34.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.22%], valid : [loss = 0.859, top1 = 69.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2672/15625) 002672-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.491, top1 = 89.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.308, top1 = 92.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.25 ms.
cifar100       train : [loss = 0.271, top1 = 92.82%], valid : [loss = 1.230, top1 = 68.96%], test : [loss = 1.256, top1 = 68.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.32%], valid : [loss = 2.206, top1 = 42.68%], test : [loss = 2.210, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.56%], valid : [loss = 0.654, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2673/15625) 002673-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.86%], valid : [loss = 0.779, top1 = 73.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.44 ms.
cifar10        train : [loss = 0.555, top1 = 80.64%], test  : [loss = 0.606, top1 = 79.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 2.061, top1 = 44.32%], valid : [loss = 2.168, top1 = 42.35%], test : [loss = 2.154, top1 = 43.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 3.262, top1 = 21.61%], valid : [loss = 3.230, top1 = 22.41%], test : [loss = 3.264, top1 = 21.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.197, top1 = 56.65%], valid : [loss = 1.245, top1 = 55.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2674/15625) 002674-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.547, top1 = 88.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.357, top1 = 91.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.273, top1 = 92.43%], valid : [loss = 1.332, top1 = 67.51%], test : [loss = 1.357, top1 = 67.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.10%], valid : [loss = 2.450, top1 = 38.02%], test : [loss = 2.440, top1 = 38.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.32%], valid : [loss = 0.956, top1 = 66.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2675/15625) 002675-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.313, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.36 ms.
cifar100       train : [loss = 0.328, top1 = 91.10%], valid : [loss = 1.306, top1 = 66.79%], test : [loss = 1.304, top1 = 67.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.08%], valid : [loss = 2.384, top1 = 40.14%], test : [loss = 2.418, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2676/15625) 002676-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.428, top1 = 90.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.288, top1 = 93.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.345, top1 = 70.25%], test : [loss = 1.325, top1 = 70.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 1.529, top1 = 58.63%], valid : [loss = 2.226, top1 = 44.07%], test : [loss = 2.269, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.48%], valid : [loss = 0.508, top1 = 83.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2677/15625) 002677-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.88 ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.30%], valid : [loss = 1.098, top1 = 63.36%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.50 ms.
cifar10        train : [loss = 0.784, top1 = 72.31%], test  : [loss = 0.930, top1 = 67.68%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.80 ms.
cifar100       train : [loss = 2.135, top1 = 43.99%], valid : [loss = 2.417, top1 = 39.09%], test : [loss = 2.430, top1 = 39.20%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.41 ms.
ImageNet16-120 train : [loss = 3.753, top1 = 14.04%], valid : [loss = 3.814, top1 = 13.70%], test : [loss = 3.827, top1 = 13.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2678/15625) 002678-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.83%], valid : [loss = 0.521, top1 = 86.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.095, top1 = 97.00%], test  : [loss = 0.355, top1 = 89.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.712, top1 = 79.40%], valid : [loss = 1.316, top1 = 64.23%], test : [loss = 1.311, top1 = 65.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.42%], valid : [loss = 2.539, top1 = 35.62%], test : [loss = 2.561, top1 = 35.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.60%], valid : [loss = 0.884, top1 = 68.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2679/15625) 002679-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.64%], valid : [loss = 0.554, top1 = 83.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.211, top1 = 92.75%], test  : [loss = 0.407, top1 = 87.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.08 ms.
cifar100       train : [loss = 1.303, top1 = 63.06%], valid : [loss = 1.584, top1 = 56.61%], test : [loss = 1.586, top1 = 56.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 2.731, top1 = 32.02%], valid : [loss = 2.765, top1 = 31.19%], test : [loss = 2.801, top1 = 31.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.08%], valid : [loss = 0.995, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2680/15625) 002680-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.229, top1 = 92.22%], valid : [loss = 0.552, top1 = 83.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10        train : [loss = 0.226, top1 = 92.27%], test  : [loss = 0.408, top1 = 86.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.224, top1 = 65.20%], valid : [loss = 1.590, top1 = 56.95%], test : [loss = 1.583, top1 = 57.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.940, top1 = 28.31%], valid : [loss = 2.978, top1 = 27.79%], test : [loss = 3.027, top1 = 26.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.132, top1 = 59.30%], valid : [loss = 1.177, top1 = 57.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2681/15625) 002681-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.49%], valid : [loss = 0.590, top1 = 81.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10        train : [loss = 0.270, top1 = 90.65%], test  : [loss = 0.443, top1 = 85.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 1.360, top1 = 61.52%], valid : [loss = 1.683, top1 = 54.98%], test : [loss = 1.665, top1 = 55.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.986, top1 = 27.24%], valid : [loss = 3.020, top1 = 26.91%], test : [loss = 3.080, top1 = 26.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.36%], valid : [loss = 1.210, top1 = 56.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2682/15625) 002682-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.99%], valid : [loss = 0.515, top1 = 87.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.072, top1 = 97.75%], test  : [loss = 0.357, top1 = 89.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.712, top1 = 78.94%], valid : [loss = 1.330, top1 = 64.27%], test : [loss = 1.332, top1 = 64.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.29%], valid : [loss = 2.627, top1 = 34.43%], test : [loss = 2.672, top1 = 33.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.68%], valid : [loss = 0.685, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2683/15625) 002683-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.601, top1 = 85.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10        train : [loss = 0.071, top1 = 97.86%], test  : [loss = 0.399, top1 = 88.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.713, top1 = 79.26%], valid : [loss = 1.378, top1 = 64.01%], test : [loss = 1.376, top1 = 63.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 36.03%], valid : [loss = 2.661, top1 = 33.97%], test : [loss = 2.688, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.36%], valid : [loss = 0.792, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2684/15625) 002684-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.568, top1 = 88.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.373, top1 = 92.40%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.100, top1 = 98.23%], valid : [loss = 1.462, top1 = 67.62%], test : [loss = 1.443, top1 = 67.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.43%], valid : [loss = 2.430, top1 = 39.41%], test : [loss = 2.452, top1 = 39.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2685/15625) 002685-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.25%], valid : [loss = 0.601, top1 = 85.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.069, top1 = 97.89%], test  : [loss = 0.408, top1 = 88.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.02 ms.
cifar100       train : [loss = 0.720, top1 = 79.03%], valid : [loss = 1.392, top1 = 63.25%], test : [loss = 1.369, top1 = 63.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.14%], valid : [loss = 2.658, top1 = 33.61%], test : [loss = 2.694, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2686/15625) 002686-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.65%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.66 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.314, top1 = 93.21%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.21 ms.
cifar100       train : [loss = 0.070, top1 = 98.93%], valid : [loss = 1.358, top1 = 69.45%], test : [loss = 1.361, top1 = 69.33%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.09%], valid : [loss = 2.346, top1 = 40.10%], test : [loss = 2.365, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.90%], valid : [loss = 0.702, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2687/15625) 002687-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.561, top1 = 88.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.34 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.369, top1 = 92.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.89 ms.
cifar100       train : [loss = 0.108, top1 = 97.96%], valid : [loss = 1.484, top1 = 67.54%], test : [loss = 1.474, top1 = 67.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.83%], valid : [loss = 2.441, top1 = 39.43%], test : [loss = 2.448, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.70%], valid : [loss = 0.698, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2688/15625) 002688-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.82 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2689/15625) 002689-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.64%], valid : [loss = 0.576, top1 = 87.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.43 ms.
cifar10        train : [loss = 0.030, top1 = 99.11%], test  : [loss = 0.374, top1 = 91.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.98 ms.
cifar100       train : [loss = 0.415, top1 = 88.11%], valid : [loss = 1.386, top1 = 65.15%], test : [loss = 1.386, top1 = 65.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.567, top1 = 34.55%], valid : [loss = 2.646, top1 = 33.00%], test : [loss = 2.667, top1 = 32.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.037, top1 = 62.79%], valid : [loss = 1.057, top1 = 62.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2690/15625) 002690-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.97 ms.
cifar10-valid  train : [loss = 1.090, top1 = 61.38%], valid : [loss = 1.148, top1 = 59.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10        train : [loss = 1.043, top1 = 63.19%], test  : [loss = 1.046, top1 = 63.03%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.71 ms.
cifar100       train : [loss = 2.586, top1 = 34.84%], valid : [loss = 2.655, top1 = 33.73%], test : [loss = 2.634, top1 = 34.40%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.45 ms.
ImageNet16-120 train : [loss = 3.781, top1 = 13.71%], valid : [loss = 3.764, top1 = 14.66%], test : [loss = 3.782, top1 = 13.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2691/15625) 002691-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.511, top1 = 88.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.358, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.90 ms.
cifar100       train : [loss = 0.475, top1 = 86.08%], valid : [loss = 1.336, top1 = 66.15%], test : [loss = 1.320, top1 = 66.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.24%], valid : [loss = 2.518, top1 = 36.93%], test : [loss = 2.550, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.96%], valid : [loss = 0.663, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2692/15625) 002692-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.05%], valid : [loss = 0.569, top1 = 84.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10        train : [loss = 0.189, top1 = 93.63%], test  : [loss = 0.397, top1 = 87.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 1.014, top1 = 70.71%], valid : [loss = 1.478, top1 = 60.34%], test : [loss = 1.452, top1 = 59.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.725, top1 = 31.97%], valid : [loss = 2.784, top1 = 31.12%], test : [loss = 2.826, top1 = 29.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.53%], valid : [loss = 0.947, top1 = 66.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2693/15625) 002693-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.99 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.488, top1 = 90.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.44 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.322, top1 = 93.07%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.50 ms.
cifar100       train : [loss = 0.112, top1 = 97.82%], valid : [loss = 1.310, top1 = 69.28%], test : [loss = 1.302, top1 = 69.36%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.24%], valid : [loss = 2.177, top1 = 43.64%], test : [loss = 2.186, top1 = 43.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.94%], valid : [loss = 0.646, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2694/15625) 002694-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.065, top1 = 98.40%], valid : [loss = 0.456, top1 = 86.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.110, top1 = 96.64%], test  : [loss = 0.319, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 0.848, top1 = 75.80%], valid : [loss = 1.288, top1 = 64.25%], test : [loss = 1.268, top1 = 64.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 35.96%], valid : [loss = 2.612, top1 = 34.84%], test : [loss = 2.638, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.06%], valid : [loss = 0.664, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2695/15625) 002695-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.324, top1 = 88.74%], valid : [loss = 0.585, top1 = 81.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.298, top1 = 89.65%], test  : [loss = 0.447, top1 = 85.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 1.577, top1 = 56.13%], valid : [loss = 1.796, top1 = 51.67%], test : [loss = 1.778, top1 = 51.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 3.109, top1 = 24.83%], valid : [loss = 3.125, top1 = 24.06%], test : [loss = 3.168, top1 = 23.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.40%], valid : [loss = 1.014, top1 = 63.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2696/15625) 002696-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.22%], valid : [loss = 0.569, top1 = 86.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10        train : [loss = 0.059, top1 = 98.17%], test  : [loss = 0.373, top1 = 89.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.47 ms.
cifar100       train : [loss = 0.662, top1 = 80.47%], valid : [loss = 1.324, top1 = 64.53%], test : [loss = 1.330, top1 = 63.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.25%], valid : [loss = 2.500, top1 = 36.82%], test : [loss = 2.538, top1 = 35.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.81%], valid : [loss = 0.800, top1 = 72.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2697/15625) 002697-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.345, top1 = 91.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.338, top1 = 90.90%], valid : [loss = 1.306, top1 = 66.78%], test : [loss = 1.304, top1 = 67.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 45.04%], valid : [loss = 2.392, top1 = 39.01%], test : [loss = 2.425, top1 = 38.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2698/15625) 002698-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.90 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.36%], valid : [loss = 0.577, top1 = 84.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.125, top1 = 95.98%], test  : [loss = 0.382, top1 = 88.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.975, top1 = 71.89%], valid : [loss = 1.440, top1 = 60.95%], test : [loss = 1.435, top1 = 60.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.509, top1 = 36.49%], valid : [loss = 2.578, top1 = 34.93%], test : [loss = 2.612, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.39%], valid : [loss = 0.915, top1 = 67.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2699/15625) 002699-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.504, top1 = 89.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.32 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.318, top1 = 92.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.93 ms.
cifar100       train : [loss = 0.200, top1 = 94.89%], valid : [loss = 1.249, top1 = 69.43%], test : [loss = 1.245, top1 = 69.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.10 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.72%], valid : [loss = 2.194, top1 = 43.26%], test : [loss = 2.202, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.06%], valid : [loss = 0.675, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2700/15625) 002700-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.533, top1 = 89.62%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.78 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.337, top1 = 93.06%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.01 ms.
cifar100       train : [loss = 0.068, top1 = 98.86%], valid : [loss = 1.336, top1 = 69.92%], test : [loss = 1.368, top1 = 69.99%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 1.632, top1 = 56.13%], valid : [loss = 2.192, top1 = 43.87%], test : [loss = 2.175, top1 = 45.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.90%], valid : [loss = 0.699, top1 = 75.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2701/15625) 002701-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.520, top1 = 90.16%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.326, top1 = 93.50%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.90 ms.
cifar100       train : [loss = 0.048, top1 = 99.30%], valid : [loss = 1.395, top1 = 69.66%], test : [loss = 1.387, top1 = 69.81%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.557, top1 = 57.99%], valid : [loss = 2.210, top1 = 44.34%], test : [loss = 2.207, top1 = 44.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.53%], valid : [loss = 0.703, top1 = 75.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2702/15625) 002702-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.16 ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.47%], valid : [loss = 0.735, top1 = 75.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.487, top1 = 83.32%], test  : [loss = 0.566, top1 = 80.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.50 ms.
cifar100       train : [loss = 1.822, top1 = 50.56%], valid : [loss = 1.936, top1 = 47.83%], test : [loss = 1.923, top1 = 48.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.01%], valid : [loss = 3.004, top1 = 27.10%], test : [loss = 3.034, top1 = 25.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.169, top1 = 58.09%], valid : [loss = 1.203, top1 = 56.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2703/15625) 002703-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.95%], valid : [loss = 0.526, top1 = 86.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.070, top1 = 97.93%], test  : [loss = 0.344, top1 = 89.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.33 ms.
cifar100       train : [loss = 0.555, top1 = 84.10%], valid : [loss = 1.304, top1 = 65.53%], test : [loss = 1.306, top1 = 65.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.275, top1 = 41.39%], valid : [loss = 2.435, top1 = 38.06%], test : [loss = 2.460, top1 = 38.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.13%], valid : [loss = 0.883, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2704/15625) 002704-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.430, top1 = 90.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.34 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.283, top1 = 93.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.56 ms.
cifar100       train : [loss = 0.052, top1 = 99.33%], valid : [loss = 1.327, top1 = 70.86%], test : [loss = 1.333, top1 = 70.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 1.473, top1 = 60.04%], valid : [loss = 2.243, top1 = 44.07%], test : [loss = 2.245, top1 = 43.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.386, top1 = 86.76%], valid : [loss = 0.523, top1 = 82.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2705/15625) 002705-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.76%], valid : [loss = 0.457, top1 = 86.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10        train : [loss = 0.154, top1 = 95.02%], test  : [loss = 0.345, top1 = 88.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.978, top1 = 72.17%], valid : [loss = 1.352, top1 = 62.54%], test : [loss = 1.341, top1 = 62.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.29%], valid : [loss = 2.658, top1 = 33.47%], test : [loss = 2.684, top1 = 32.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2706/15625) 002706-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.580, top1 = 88.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.392, top1 = 91.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.15 ms.
cifar100       train : [loss = 0.204, top1 = 95.34%], valid : [loss = 1.427, top1 = 66.60%], test : [loss = 1.414, top1 = 66.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.44%], valid : [loss = 2.478, top1 = 38.01%], test : [loss = 2.517, top1 = 37.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.73%], valid : [loss = 0.704, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2707/15625) 002707-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.25%], valid : [loss = 0.477, top1 = 84.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10        train : [loss = 0.297, top1 = 90.07%], test  : [loss = 0.400, top1 = 86.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.46 ms.
cifar100       train : [loss = 1.330, top1 = 63.13%], valid : [loss = 1.538, top1 = 58.27%], test : [loss = 1.513, top1 = 58.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.81%], valid : [loss = 2.896, top1 = 29.08%], test : [loss = 2.955, top1 = 28.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2708/15625) 002708-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.86%], valid : [loss = 0.643, top1 = 86.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.22 ms.
cifar10        train : [loss = 0.029, top1 = 99.25%], test  : [loss = 0.423, top1 = 89.53%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.34 ms.
cifar100       train : [loss = 0.364, top1 = 90.20%], valid : [loss = 1.438, top1 = 64.90%], test : [loss = 1.441, top1 = 64.81%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.16%], valid : [loss = 2.557, top1 = 35.87%], test : [loss = 2.584, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.74%], valid : [loss = 0.770, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2709/15625) 002709-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.510, top1 = 88.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.331, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 0.340, top1 = 90.64%], valid : [loss = 1.258, top1 = 67.40%], test : [loss = 1.261, top1 = 67.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.94%], valid : [loss = 2.401, top1 = 38.77%], test : [loss = 2.405, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2710/15625) 002710-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.608, top1 = 85.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.071, top1 = 97.84%], test  : [loss = 0.408, top1 = 88.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.20 ms.
cifar100       train : [loss = 0.724, top1 = 78.85%], valid : [loss = 1.408, top1 = 62.69%], test : [loss = 1.370, top1 = 63.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 35.97%], valid : [loss = 2.656, top1 = 33.92%], test : [loss = 2.694, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2711/15625) 002711-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.01 ms.
cifar10-valid  train : [loss = 1.192, top1 = 57.38%], valid : [loss = 1.231, top1 = 56.18%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 1.147, top1 = 59.04%], test  : [loss = 1.155, top1 = 58.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.65 ms.
cifar100       train : [loss = 2.707, top1 = 32.23%], valid : [loss = 2.783, top1 = 31.23%], test : [loss = 2.763, top1 = 31.67%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.53 ms.
ImageNet16-120 train : [loss = 3.876, top1 = 12.33%], valid : [loss = 3.874, top1 = 12.71%], test : [loss = 3.892, top1 = 12.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2712/15625) 002712-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.36%], valid : [loss = 0.852, top1 = 72.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10        train : [loss = 0.553, top1 = 80.57%], test  : [loss = 0.716, top1 = 75.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.54 ms.
cifar100       train : [loss = 1.765, top1 = 52.30%], valid : [loss = 2.049, top1 = 47.02%], test : [loss = 2.058, top1 = 47.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.78%], valid : [loss = 3.633, top1 = 16.66%], test : [loss = 3.658, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2713/15625) 002713-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.38%], valid : [loss = 1.101, top1 = 63.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.783, top1 = 72.56%], test  : [loss = 0.920, top1 = 68.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.61 ms.
cifar100       train : [loss = 2.121, top1 = 44.22%], valid : [loss = 2.374, top1 = 39.96%], test : [loss = 2.399, top1 = 39.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.89%], valid : [loss = 3.821, top1 = 13.66%], test : [loss = 3.832, top1 = 13.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.346, top1 = 51.14%], valid : [loss = 1.388, top1 = 50.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2714/15625) 002714-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.491, top1 = 88.96%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.03 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.326, top1 = 92.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.01 ms.
cifar100       train : [loss = 0.231, top1 = 94.42%], valid : [loss = 1.240, top1 = 68.53%], test : [loss = 1.252, top1 = 68.98%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.69%], valid : [loss = 2.273, top1 = 42.08%], test : [loss = 2.275, top1 = 42.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.81%], valid : [loss = 0.648, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2715/15625) 002715-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.37 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.45%], valid : [loss = 0.534, top1 = 85.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.197, top1 = 93.40%], test  : [loss = 0.390, top1 = 87.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.89 ms.
cifar100       train : [loss = 1.020, top1 = 70.65%], valid : [loss = 1.397, top1 = 61.75%], test : [loss = 1.390, top1 = 61.43%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.704, top1 = 32.42%], valid : [loss = 2.745, top1 = 31.53%], test : [loss = 2.796, top1 = 30.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 66.02%], valid : [loss = 1.017, top1 = 64.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2716/15625) 002716-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.56%], valid : [loss = 0.869, top1 = 71.51%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10        train : [loss = 0.549, top1 = 80.81%], test  : [loss = 0.712, top1 = 75.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.91 ms.
cifar100       train : [loss = 1.772, top1 = 52.29%], valid : [loss = 2.062, top1 = 47.05%], test : [loss = 2.058, top1 = 46.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.87%], valid : [loss = 3.622, top1 = 16.96%], test : [loss = 3.659, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2717/15625) 002717-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.93%], valid : [loss = 0.569, top1 = 83.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.182, top1 = 93.81%], test  : [loss = 0.401, top1 = 87.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 1.223, top1 = 65.20%], valid : [loss = 1.549, top1 = 57.74%], test : [loss = 1.551, top1 = 57.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.686, top1 = 32.89%], valid : [loss = 2.734, top1 = 32.11%], test : [loss = 2.765, top1 = 31.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.42%], valid : [loss = 0.926, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2718/15625) 002718-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.539, top1 = 88.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.025, top1 = 99.27%], test  : [loss = 0.349, top1 = 91.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.411, top1 = 88.15%], valid : [loss = 1.259, top1 = 66.95%], test : [loss = 1.290, top1 = 66.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.21%], valid : [loss = 2.399, top1 = 39.06%], test : [loss = 2.433, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2719/15625) 002719-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.36%], valid : [loss = 0.594, top1 = 85.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.401, top1 = 88.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.37 ms.
cifar100       train : [loss = 0.705, top1 = 79.59%], valid : [loss = 1.372, top1 = 63.96%], test : [loss = 1.357, top1 = 63.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.09%], valid : [loss = 2.650, top1 = 33.89%], test : [loss = 2.705, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 74.94%], valid : [loss = 0.769, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2720/15625) 002720-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.489, top1 = 90.03%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.99 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 93.09%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.35 ms.
cifar100       train : [loss = 0.089, top1 = 98.44%], valid : [loss = 1.284, top1 = 70.40%], test : [loss = 1.300, top1 = 70.13%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 1.594, top1 = 57.09%], valid : [loss = 2.150, top1 = 45.11%], test : [loss = 2.133, top1 = 45.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.34%], valid : [loss = 0.621, top1 = 78.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2721/15625) 002721-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.32%], valid : [loss = 0.764, top1 = 73.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.564, top1 = 80.40%], test  : [loss = 0.637, top1 = 78.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 2.012, top1 = 45.52%], valid : [loss = 2.121, top1 = 43.47%], test : [loss = 2.135, top1 = 43.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 25.69%], valid : [loss = 3.042, top1 = 26.18%], test : [loss = 3.070, top1 = 25.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.173, top1 = 57.44%], valid : [loss = 1.222, top1 = 56.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2722/15625) 002722-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.44%], valid : [loss = 0.452, top1 = 86.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10        train : [loss = 0.154, top1 = 95.05%], test  : [loss = 0.346, top1 = 89.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.15 ms.
cifar100       train : [loss = 0.997, top1 = 71.61%], valid : [loss = 1.356, top1 = 62.05%], test : [loss = 1.342, top1 = 62.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.85%], valid : [loss = 2.676, top1 = 33.16%], test : [loss = 2.715, top1 = 32.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2723/15625) 002723-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.43%], valid : [loss = 0.745, top1 = 74.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.570, top1 = 80.22%], test  : [loss = 0.627, top1 = 78.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.95 ms.
cifar100       train : [loss = 1.973, top1 = 46.84%], valid : [loss = 2.122, top1 = 43.73%], test : [loss = 2.116, top1 = 44.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.56%], valid : [loss = 3.240, top1 = 22.82%], test : [loss = 3.256, top1 = 22.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.277, top1 = 53.78%], valid : [loss = 1.327, top1 = 52.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2724/15625) 002724-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.257, top1 = 91.19%], valid : [loss = 0.531, top1 = 83.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.53 ms.
cifar10        train : [loss = 0.235, top1 = 92.00%], test  : [loss = 0.388, top1 = 87.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 1.348, top1 = 62.22%], valid : [loss = 1.607, top1 = 56.59%], test : [loss = 1.597, top1 = 56.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.864, top1 = 29.45%], valid : [loss = 2.866, top1 = 29.90%], test : [loss = 2.926, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.49%], valid : [loss = 1.030, top1 = 63.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2725/15625) 002725-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.499, top1 = 90.11%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.27 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.309, top1 = 93.52%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.45 ms.
cifar100       train : [loss = 0.060, top1 = 99.24%], valid : [loss = 1.308, top1 = 70.57%], test : [loss = 1.287, top1 = 71.37%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.54 ms.
ImageNet16-120 train : [loss = 1.593, top1 = 57.13%], valid : [loss = 2.172, top1 = 44.18%], test : [loss = 2.181, top1 = 44.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.59%], valid : [loss = 0.591, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2726/15625) 002726-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.22%], valid : [loss = 0.581, top1 = 85.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 0.107, top1 = 96.43%], test  : [loss = 0.388, top1 = 88.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.51 ms.
cifar100       train : [loss = 0.816, top1 = 76.03%], valid : [loss = 1.403, top1 = 62.47%], test : [loss = 1.388, top1 = 62.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.07%], valid : [loss = 2.761, top1 = 31.18%], test : [loss = 2.816, top1 = 31.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2727/15625) 002727-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.528, top1 = 88.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.333, top1 = 92.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.36 ms.
cifar100       train : [loss = 0.345, top1 = 90.54%], valid : [loss = 1.287, top1 = 66.94%], test : [loss = 1.295, top1 = 67.07%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 45.01%], valid : [loss = 2.380, top1 = 39.57%], test : [loss = 2.398, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2728/15625) 002728-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.578, top1 = 88.08%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.85 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.368, top1 = 91.51%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.97 ms.
cifar100       train : [loss = 0.241, top1 = 93.78%], valid : [loss = 1.360, top1 = 67.41%], test : [loss = 1.343, top1 = 67.37%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.07 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.22%], valid : [loss = 2.414, top1 = 38.91%], test : [loss = 2.418, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.12%], valid : [loss = 0.988, top1 = 64.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2729/15625) 002729-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.546, top1 = 88.65%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.08 ms.
cifar10        train : [loss = 0.015, top1 = 99.60%], test  : [loss = 0.365, top1 = 91.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.89 ms.
cifar100       train : [loss = 0.235, top1 = 93.89%], valid : [loss = 1.300, top1 = 68.47%], test : [loss = 1.308, top1 = 67.91%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 2.021, top1 = 47.08%], valid : [loss = 2.263, top1 = 41.94%], test : [loss = 2.286, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.71%], valid : [loss = 0.885, top1 = 68.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2730/15625) 002730-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.28 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.29%], valid : [loss = 0.869, top1 = 71.55%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10        train : [loss = 0.557, top1 = 80.56%], test  : [loss = 0.718, top1 = 75.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.49 ms.
cifar100       train : [loss = 1.795, top1 = 51.75%], valid : [loss = 2.064, top1 = 46.85%], test : [loss = 2.098, top1 = 46.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.29 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.82%], valid : [loss = 3.644, top1 = 17.02%], test : [loss = 3.673, top1 = 15.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2731/15625) 002731-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.92 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.569, top1 = 87.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.405, top1 = 90.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.86 ms.
cifar100       train : [loss = 0.399, top1 = 88.72%], valid : [loss = 1.417, top1 = 65.01%], test : [loss = 1.415, top1 = 64.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.79%], valid : [loss = 2.480, top1 = 37.10%], test : [loss = 2.482, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.43%], valid : [loss = 0.841, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2732/15625) 002732-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=20.84 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.99%], valid : [loss = 0.464, top1 = 86.46%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=22.17 ms.
cifar10        train : [loss = 0.109, top1 = 96.67%], test  : [loss = 0.340, top1 = 89.51%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=20.82 ms.
cifar100       train : [loss = 0.647, top1 = 82.22%], valid : [loss = 1.259, top1 = 65.47%], test : [loss = 1.278, top1 = 64.97%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=20.21 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 37.24%], valid : [loss = 2.583, top1 = 35.12%], test : [loss = 2.584, top1 = 34.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 65.96%], valid : [loss = 0.973, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2733/15625) 002733-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.577, top1 = 87.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.038, top1 = 98.88%], test  : [loss = 0.402, top1 = 89.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.13 ms.
cifar100       train : [loss = 0.547, top1 = 83.96%], valid : [loss = 1.403, top1 = 64.24%], test : [loss = 1.412, top1 = 63.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 37.03%], valid : [loss = 2.604, top1 = 34.04%], test : [loss = 2.668, top1 = 33.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.27%], valid : [loss = 0.707, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2734/15625) 002734-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.523, top1 = 88.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.334, top1 = 92.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.340, top1 = 90.66%], valid : [loss = 1.292, top1 = 66.97%], test : [loss = 1.298, top1 = 67.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.83%], valid : [loss = 2.387, top1 = 39.17%], test : [loss = 2.428, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2735/15625) 002735-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.53%], valid : [loss = 0.651, top1 = 85.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.035, top1 = 98.96%], test  : [loss = 0.396, top1 = 90.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.07 ms.
cifar100       train : [loss = 0.544, top1 = 84.09%], valid : [loss = 1.416, top1 = 63.62%], test : [loss = 1.434, top1 = 63.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 40.08%], valid : [loss = 2.542, top1 = 36.21%], test : [loss = 2.555, top1 = 36.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.65%], valid : [loss = 0.925, top1 = 66.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2736/15625) 002736-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.03%], valid : [loss = 0.535, top1 = 85.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.093, top1 = 97.16%], test  : [loss = 0.364, top1 = 89.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.85 ms.
cifar100       train : [loss = 0.780, top1 = 77.31%], valid : [loss = 1.371, top1 = 63.23%], test : [loss = 1.370, top1 = 63.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.03%], valid : [loss = 2.590, top1 = 34.91%], test : [loss = 2.613, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.43%], valid : [loss = 0.872, top1 = 69.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2737/15625) 002737-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.522, top1 = 88.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.30 ms.
cifar10        train : [loss = 0.019, top1 = 99.54%], test  : [loss = 0.355, top1 = 91.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.10 ms.
cifar100       train : [loss = 0.398, top1 = 88.64%], valid : [loss = 1.364, top1 = 65.94%], test : [loss = 1.333, top1 = 66.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.88%], valid : [loss = 2.433, top1 = 38.32%], test : [loss = 2.460, top1 = 38.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.45%], valid : [loss = 0.611, top1 = 79.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2738/15625) 002738-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.52%], valid : [loss = 0.607, top1 = 84.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.094, top1 = 96.92%], test  : [loss = 0.401, top1 = 88.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.57 ms.
cifar100       train : [loss = 0.792, top1 = 76.77%], valid : [loss = 1.418, top1 = 62.37%], test : [loss = 1.410, top1 = 61.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 34.08%], valid : [loss = 2.753, top1 = 32.13%], test : [loss = 2.780, top1 = 31.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.81%], valid : [loss = 0.858, top1 = 70.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2739/15625) 002739-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.44%], valid : [loss = 0.468, top1 = 85.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.154, top1 = 95.02%], test  : [loss = 0.334, top1 = 89.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.976, top1 = 72.29%], valid : [loss = 1.340, top1 = 62.77%], test : [loss = 1.329, top1 = 62.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.616, top1 = 34.17%], valid : [loss = 2.670, top1 = 33.24%], test : [loss = 2.692, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.42%], valid : [loss = 0.775, top1 = 72.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2740/15625) 002740-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.20%], valid : [loss = 0.455, top1 = 86.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10        train : [loss = 0.115, top1 = 96.49%], test  : [loss = 0.335, top1 = 89.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.26 ms.
cifar100       train : [loss = 0.861, top1 = 75.56%], valid : [loss = 1.310, top1 = 63.63%], test : [loss = 1.275, top1 = 64.43%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.69%], valid : [loss = 2.624, top1 = 33.90%], test : [loss = 2.650, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2741/15625) 002741-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.40 ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.33%], valid : [loss = 1.101, top1 = 63.50%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10        train : [loss = 0.781, top1 = 72.58%], test  : [loss = 0.919, top1 = 68.07%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.08 ms.
cifar100       train : [loss = 2.122, top1 = 44.37%], valid : [loss = 2.412, top1 = 40.00%], test : [loss = 2.416, top1 = 39.47%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.85 ms.
ImageNet16-120 train : [loss = 3.760, top1 = 13.97%], valid : [loss = 3.824, top1 = 13.46%], test : [loss = 3.832, top1 = 13.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2742/15625) 002742-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.77%], valid : [loss = 0.605, top1 = 86.52%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.02 ms.
cifar10        train : [loss = 0.031, top1 = 99.23%], test  : [loss = 0.402, top1 = 89.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.47 ms.
cifar100       train : [loss = 0.375, top1 = 89.85%], valid : [loss = 1.372, top1 = 65.62%], test : [loss = 1.361, top1 = 66.15%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.81%], valid : [loss = 2.507, top1 = 36.99%], test : [loss = 2.543, top1 = 36.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.84%], valid : [loss = 0.748, top1 = 73.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2743/15625) 002743-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.491, top1 = 90.32%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.92 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.323, top1 = 93.49%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.59 ms.
cifar100       train : [loss = 0.048, top1 = 99.34%], valid : [loss = 1.349, top1 = 70.37%], test : [loss = 1.326, top1 = 70.67%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 1.483, top1 = 59.75%], valid : [loss = 2.154, top1 = 45.17%], test : [loss = 2.149, top1 = 45.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.08%], valid : [loss = 0.571, top1 = 80.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2744/15625) 002744-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.589, top1 = 86.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10        train : [loss = 0.044, top1 = 98.64%], test  : [loss = 0.392, top1 = 89.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 0.572, top1 = 83.12%], valid : [loss = 1.418, top1 = 63.80%], test : [loss = 1.392, top1 = 64.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.81%], valid : [loss = 2.614, top1 = 34.21%], test : [loss = 2.666, top1 = 33.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.70%], valid : [loss = 0.760, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2745/15625) 002745-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.67%], valid : [loss = 0.822, top1 = 80.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.129, top1 = 95.67%], test  : [loss = 0.544, top1 = 84.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.87 ms.
cifar100       train : [loss = 0.848, top1 = 75.42%], valid : [loss = 1.690, top1 = 57.21%], test : [loss = 1.697, top1 = 57.77%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 3.039, top1 = 26.34%], valid : [loss = 3.185, top1 = 23.99%], test : [loss = 3.215, top1 = 23.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 59.68%], valid : [loss = 1.154, top1 = 58.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2746/15625) 002746-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.61%], valid : [loss = 0.983, top1 = 66.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.760, top1 = 73.38%], test  : [loss = 0.843, top1 = 70.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 2.132, top1 = 43.94%], valid : [loss = 2.309, top1 = 41.45%], test : [loss = 2.331, top1 = 40.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 3.749, top1 = 14.10%], valid : [loss = 3.773, top1 = 14.41%], test : [loss = 3.777, top1 = 13.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.437, top1 = 47.34%], valid : [loss = 1.465, top1 = 46.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2747/15625) 002747-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.86%], valid : [loss = 0.476, top1 = 84.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.299, top1 = 89.97%], test  : [loss = 0.399, top1 = 86.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 1.328, top1 = 63.14%], valid : [loss = 1.541, top1 = 57.79%], test : [loss = 1.510, top1 = 58.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.76%], valid : [loss = 2.896, top1 = 29.87%], test : [loss = 2.953, top1 = 28.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2748/15625) 002748-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.567, top1 = 87.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.383, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.29 ms.
cifar100       train : [loss = 0.391, top1 = 88.93%], valid : [loss = 1.389, top1 = 65.70%], test : [loss = 1.383, top1 = 65.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.89%], valid : [loss = 2.517, top1 = 37.06%], test : [loss = 2.551, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2749/15625) 002749-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.554, top1 = 88.08%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.44 ms.
cifar10        train : [loss = 0.023, top1 = 99.36%], test  : [loss = 0.380, top1 = 90.73%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.85 ms.
cifar100       train : [loss = 0.329, top1 = 90.87%], valid : [loss = 1.321, top1 = 66.68%], test : [loss = 1.332, top1 = 66.59%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.02 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.41%], valid : [loss = 2.338, top1 = 40.46%], test : [loss = 2.324, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.25%], valid : [loss = 0.880, top1 = 68.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2750/15625) 002750-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.69%], valid : [loss = 0.731, top1 = 80.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10        train : [loss = 0.176, top1 = 93.89%], test  : [loss = 0.514, top1 = 84.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.43 ms.
cifar100       train : [loss = 0.892, top1 = 73.98%], valid : [loss = 1.646, top1 = 57.35%], test : [loss = 1.673, top1 = 56.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 3.490, top1 = 17.05%], valid : [loss = 3.487, top1 = 17.54%], test : [loss = 3.505, top1 = 17.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.254, top1 = 54.33%], valid : [loss = 1.278, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2751/15625) 002751-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.69%], valid : [loss = 0.663, top1 = 78.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.377, top1 = 86.97%], test  : [loss = 0.528, top1 = 82.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.77 ms.
cifar100       train : [loss = 1.568, top1 = 56.60%], valid : [loss = 1.846, top1 = 50.92%], test : [loss = 1.833, top1 = 51.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 3.283, top1 = 21.77%], valid : [loss = 3.299, top1 = 22.30%], test : [loss = 3.323, top1 = 20.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.159, top1 = 58.40%], valid : [loss = 1.199, top1 = 57.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2752/15625) 002752-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.87 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.64%], valid : [loss = 0.631, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.407, top1 = 89.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.515, top1 = 84.88%], valid : [loss = 1.392, top1 = 64.11%], test : [loss = 1.381, top1 = 64.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 2.429, top1 = 38.19%], valid : [loss = 2.586, top1 = 35.34%], test : [loss = 2.613, top1 = 34.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.88%], valid : [loss = 0.852, top1 = 70.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2753/15625) 002753-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.101, top1 = 96.94%], valid : [loss = 0.533, top1 = 85.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.117, top1 = 96.19%], test  : [loss = 0.364, top1 = 89.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.852, top1 = 75.18%], valid : [loss = 1.394, top1 = 62.92%], test : [loss = 1.392, top1 = 62.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.89%], valid : [loss = 2.701, top1 = 32.42%], test : [loss = 2.725, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 67.89%], valid : [loss = 0.951, top1 = 66.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2754/15625) 002754-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.637, top1 = 85.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.403, top1 = 90.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.512, top1 = 85.05%], valid : [loss = 1.417, top1 = 63.85%], test : [loss = 1.441, top1 = 63.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.98%], valid : [loss = 2.539, top1 = 36.12%], test : [loss = 2.560, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.47%], valid : [loss = 0.886, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2755/15625) 002755-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.556, top1 = 88.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.342, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.42 ms.
cifar100       train : [loss = 0.228, top1 = 94.01%], valid : [loss = 1.288, top1 = 68.17%], test : [loss = 1.326, top1 = 67.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.46 ms.
ImageNet16-120 train : [loss = 1.966, top1 = 48.28%], valid : [loss = 2.286, top1 = 41.62%], test : [loss = 2.301, top1 = 41.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.76%], valid : [loss = 0.848, top1 = 70.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2756/15625) 002756-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.21%], valid : [loss = 0.619, top1 = 85.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10        train : [loss = 0.073, top1 = 97.77%], test  : [loss = 0.404, top1 = 88.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.74 ms.
cifar100       train : [loss = 0.720, top1 = 78.95%], valid : [loss = 1.390, top1 = 63.13%], test : [loss = 1.366, top1 = 63.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.85%], valid : [loss = 2.661, top1 = 33.77%], test : [loss = 2.694, top1 = 32.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.94%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2757/15625) 002757-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.518, top1 = 88.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.028, top1 = 99.25%], test  : [loss = 0.352, top1 = 91.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 0.478, top1 = 86.01%], valid : [loss = 1.352, top1 = 65.99%], test : [loss = 1.351, top1 = 65.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.08%], valid : [loss = 2.524, top1 = 36.09%], test : [loss = 2.562, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2758/15625) 002758-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.51 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.508, top1 = 89.18%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.45 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.333, top1 = 92.43%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.71 ms.
cifar100       train : [loss = 0.129, top1 = 97.48%], valid : [loss = 1.249, top1 = 69.77%], test : [loss = 1.239, top1 = 70.07%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.90 ms.
ImageNet16-120 train : [loss = 1.680, top1 = 54.98%], valid : [loss = 2.168, top1 = 44.70%], test : [loss = 2.186, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.59%], valid : [loss = 0.712, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2759/15625) 002759-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.526, top1 = 89.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.324, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.09 ms.
cifar100       train : [loss = 0.143, top1 = 97.00%], valid : [loss = 1.294, top1 = 69.20%], test : [loss = 1.292, top1 = 69.27%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 1.780, top1 = 52.67%], valid : [loss = 2.187, top1 = 43.59%], test : [loss = 2.208, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.76%], valid : [loss = 0.642, top1 = 77.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2760/15625) 002760-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.46 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.554, top1 = 87.75%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.77 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.351, top1 = 91.41%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.75 ms.
cifar100       train : [loss = 0.349, top1 = 90.69%], valid : [loss = 1.280, top1 = 66.81%], test : [loss = 1.299, top1 = 67.11%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=23.75 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 44.93%], valid : [loss = 2.332, top1 = 40.36%], test : [loss = 2.342, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 73.07%], valid : [loss = 0.823, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2761/15625) 002761-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.18%], valid : [loss = 0.497, top1 = 84.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.44 ms.
cifar10        train : [loss = 0.228, top1 = 92.31%], test  : [loss = 0.385, top1 = 87.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.28 ms.
cifar100       train : [loss = 1.255, top1 = 64.64%], valid : [loss = 1.536, top1 = 57.33%], test : [loss = 1.538, top1 = 57.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.990, top1 = 26.50%], valid : [loss = 2.991, top1 = 26.68%], test : [loss = 3.012, top1 = 26.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2762/15625) 002762-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.78%], valid : [loss = 0.612, top1 = 84.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10        train : [loss = 0.087, top1 = 97.11%], test  : [loss = 0.412, top1 = 88.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.55 ms.
cifar100       train : [loss = 0.718, top1 = 78.90%], valid : [loss = 1.543, top1 = 59.81%], test : [loss = 1.547, top1 = 60.35%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.206, top1 = 21.86%], valid : [loss = 3.212, top1 = 21.79%], test : [loss = 3.246, top1 = 21.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.065, top1 = 61.71%], valid : [loss = 1.070, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2763/15625) 002763-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.30%], valid : [loss = 0.471, top1 = 85.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.161, top1 = 94.79%], test  : [loss = 0.346, top1 = 88.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.39 ms.
cifar100       train : [loss = 1.013, top1 = 71.14%], valid : [loss = 1.360, top1 = 61.67%], test : [loss = 1.340, top1 = 62.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.45%], valid : [loss = 2.702, top1 = 32.79%], test : [loss = 2.730, top1 = 31.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2764/15625) 002764-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.88%], valid : [loss = 0.759, top1 = 82.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10        train : [loss = 0.101, top1 = 96.65%], test  : [loss = 0.516, top1 = 85.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.16 ms.
cifar100       train : [loss = 0.807, top1 = 76.61%], valid : [loss = 1.532, top1 = 60.02%], test : [loss = 1.538, top1 = 59.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.816, top1 = 30.36%], valid : [loss = 2.942, top1 = 28.29%], test : [loss = 2.998, top1 = 26.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.85%], valid : [loss = 0.881, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2765/15625) 002765-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.577, top1 = 87.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.56 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.392, top1 = 91.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.12 ms.
cifar100       train : [loss = 0.130, top1 = 97.17%], valid : [loss = 1.505, top1 = 66.55%], test : [loss = 1.492, top1 = 66.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.36%], valid : [loss = 2.434, top1 = 38.97%], test : [loss = 2.477, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.93%], valid : [loss = 0.766, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2766/15625) 002766-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.02%], valid : [loss = 0.536, top1 = 87.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10        train : [loss = 0.076, top1 = 97.56%], test  : [loss = 0.380, top1 = 89.40%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.68 ms.
cifar100       train : [loss = 0.717, top1 = 78.89%], valid : [loss = 1.349, top1 = 64.23%], test : [loss = 1.339, top1 = 64.61%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.522, top1 = 36.24%], valid : [loss = 2.636, top1 = 33.80%], test : [loss = 2.680, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2767/15625) 002767-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.549, top1 = 88.85%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.11 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.346, top1 = 92.46%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.80 ms.
cifar100       train : [loss = 0.074, top1 = 98.60%], valid : [loss = 1.398, top1 = 69.56%], test : [loss = 1.447, top1 = 69.03%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 40.69%], valid : [loss = 2.504, top1 = 36.38%], test : [loss = 2.518, top1 = 36.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.98%], valid : [loss = 0.881, top1 = 68.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2768/15625) 002768-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.42%], valid : [loss = 0.630, top1 = 85.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10        train : [loss = 0.054, top1 = 98.35%], test  : [loss = 0.408, top1 = 89.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.54 ms.
cifar100       train : [loss = 0.655, top1 = 80.90%], valid : [loss = 1.395, top1 = 63.16%], test : [loss = 1.367, top1 = 64.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 37.27%], valid : [loss = 2.610, top1 = 34.86%], test : [loss = 2.637, top1 = 33.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.58%], valid : [loss = 0.825, top1 = 71.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2769/15625) 002769-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.525, top1 = 89.38%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.78 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.346, top1 = 92.82%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.40 ms.
cifar100       train : [loss = 0.080, top1 = 98.49%], valid : [loss = 1.405, top1 = 69.35%], test : [loss = 1.387, top1 = 69.49%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.20%], valid : [loss = 2.343, top1 = 40.58%], test : [loss = 2.334, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.28%], valid : [loss = 0.858, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2770/15625) 002770-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.63%], valid : [loss = 0.855, top1 = 70.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.59 ms.
cifar10        train : [loss = 0.699, top1 = 75.54%], test  : [loss = 0.780, top1 = 73.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.14 ms.
cifar100       train : [loss = 1.977, top1 = 47.46%], valid : [loss = 2.143, top1 = 44.35%], test : [loss = 2.170, top1 = 43.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 3.658, top1 = 15.58%], valid : [loss = 3.677, top1 = 15.79%], test : [loss = 3.702, top1 = 14.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.380, top1 = 49.95%], valid : [loss = 1.405, top1 = 49.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2771/15625) 002771-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.577, top1 = 87.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.382, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 0.382, top1 = 89.04%], valid : [loss = 1.407, top1 = 65.05%], test : [loss = 1.409, top1 = 65.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.29%], valid : [loss = 2.514, top1 = 37.07%], test : [loss = 2.525, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.53%], valid : [loss = 0.839, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2772/15625) 002772-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.440, top1 = 91.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.277, top1 = 93.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.11 ms.
cifar100       train : [loss = 0.051, top1 = 99.39%], valid : [loss = 1.308, top1 = 71.42%], test : [loss = 1.301, top1 = 71.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 1.445, top1 = 60.69%], valid : [loss = 2.205, top1 = 45.13%], test : [loss = 2.230, top1 = 44.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.351, top1 = 88.17%], valid : [loss = 0.498, top1 = 83.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2773/15625) 002773-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.10%], valid : [loss = 0.482, top1 = 84.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.297, top1 = 90.11%], test  : [loss = 0.400, top1 = 86.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 1.334, top1 = 63.01%], valid : [loss = 1.544, top1 = 57.44%], test : [loss = 1.508, top1 = 58.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.64%], valid : [loss = 2.904, top1 = 29.19%], test : [loss = 2.957, top1 = 28.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2774/15625) 002774-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.14 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2775/15625) 002775-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.481, top1 = 88.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.301, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.312, top1 = 91.61%], valid : [loss = 1.235, top1 = 68.25%], test : [loss = 1.237, top1 = 68.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.58%], valid : [loss = 2.316, top1 = 40.18%], test : [loss = 2.334, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.55%], valid : [loss = 0.636, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2776/15625) 002776-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.444, top1 = 90.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.286, top1 = 93.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.60 ms.
cifar100       train : [loss = 0.065, top1 = 99.08%], valid : [loss = 1.342, top1 = 70.00%], test : [loss = 1.320, top1 = 70.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 1.554, top1 = 58.04%], valid : [loss = 2.284, top1 = 43.14%], test : [loss = 2.269, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.24%], valid : [loss = 0.499, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2777/15625) 002777-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.513, top1 = 88.83%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.79 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.328, top1 = 92.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.72 ms.
cifar100       train : [loss = 0.175, top1 = 96.05%], valid : [loss = 1.307, top1 = 68.63%], test : [loss = 1.309, top1 = 68.71%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.70%], valid : [loss = 2.311, top1 = 41.11%], test : [loss = 2.308, top1 = 41.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.92%], valid : [loss = 0.648, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2778/15625) 002778-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.001, top1 = 100.00%], valid : [loss = 0.457, top1 = 91.12%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.23 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.292, top1 = 94.02%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.24 ms.
cifar100       train : [loss = 0.020, top1 = 99.84%], valid : [loss = 1.336, top1 = 72.17%], test : [loss = 1.276, top1 = 72.99%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=22.16 ms.
ImageNet16-120 train : [loss = 1.153, top1 = 68.08%], valid : [loss = 2.243, top1 = 44.99%], test : [loss = 2.269, top1 = 45.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.316, top1 = 89.27%], valid : [loss = 0.475, top1 = 84.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2779/15625) 002779-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.59%], valid : [loss = 0.447, top1 = 87.72%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.92 ms.
cifar10        train : [loss = 0.056, top1 = 98.65%], test  : [loss = 0.306, top1 = 90.81%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.98 ms.
cifar100       train : [loss = 0.588, top1 = 83.85%], valid : [loss = 1.233, top1 = 66.79%], test : [loss = 1.208, top1 = 66.77%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.23%], valid : [loss = 2.462, top1 = 37.87%], test : [loss = 2.499, top1 = 37.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.47%], valid : [loss = 0.632, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2780/15625) 002780-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.541, top1 = 88.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.65 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.347, top1 = 91.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.68 ms.
cifar100       train : [loss = 0.185, top1 = 95.60%], valid : [loss = 1.327, top1 = 68.37%], test : [loss = 1.313, top1 = 68.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.75%], valid : [loss = 2.372, top1 = 39.28%], test : [loss = 2.372, top1 = 40.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.29%], valid : [loss = 0.877, top1 = 68.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2781/15625) 002781-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.505, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.356, top1 = 91.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.98 ms.
cifar100       train : [loss = 0.491, top1 = 85.63%], valid : [loss = 1.350, top1 = 65.31%], test : [loss = 1.344, top1 = 65.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.18%], valid : [loss = 2.503, top1 = 36.82%], test : [loss = 2.562, top1 = 35.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.61%], valid : [loss = 0.661, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2782/15625) 002782-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.556, top1 = 88.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.367, top1 = 91.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.73 ms.
cifar100       train : [loss = 0.247, top1 = 93.40%], valid : [loss = 1.331, top1 = 67.31%], test : [loss = 1.331, top1 = 67.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.05%], valid : [loss = 2.421, top1 = 38.24%], test : [loss = 2.453, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2783/15625) 002783-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.57%], valid : [loss = 0.659, top1 = 78.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 0.376, top1 = 86.98%], test  : [loss = 0.519, top1 = 82.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 1.613, top1 = 55.52%], valid : [loss = 1.849, top1 = 51.00%], test : [loss = 1.859, top1 = 50.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 3.280, top1 = 21.80%], valid : [loss = 3.296, top1 = 21.91%], test : [loss = 3.324, top1 = 21.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.01%], valid : [loss = 1.222, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2784/15625) 002784-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.42%], valid : [loss = 0.699, top1 = 84.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.437, top1 = 88.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 0.637, top1 = 81.43%], valid : [loss = 1.512, top1 = 61.65%], test : [loss = 1.501, top1 = 62.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.22%], valid : [loss = 2.836, top1 = 30.58%], test : [loss = 2.881, top1 = 29.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2785/15625) 002785-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.20 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.608, top1 = 85.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10        train : [loss = 0.074, top1 = 97.72%], test  : [loss = 0.390, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.20 ms.
cifar100       train : [loss = 0.713, top1 = 79.38%], valid : [loss = 1.386, top1 = 63.18%], test : [loss = 1.367, top1 = 63.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.47 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.98%], valid : [loss = 2.641, top1 = 34.07%], test : [loss = 2.687, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2786/15625) 002786-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.57%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.14 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.305, top1 = 93.22%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.58 ms.
cifar100       train : [loss = 0.073, top1 = 98.92%], valid : [loss = 1.334, top1 = 69.74%], test : [loss = 1.325, top1 = 69.71%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 1.602, top1 = 56.87%], valid : [loss = 2.206, top1 = 43.94%], test : [loss = 2.212, top1 = 44.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.68%], valid : [loss = 0.657, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2787/15625) 002787-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.581, top1 = 88.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.401, top1 = 91.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.70 ms.
cifar100       train : [loss = 0.149, top1 = 96.89%], valid : [loss = 1.505, top1 = 66.33%], test : [loss = 1.496, top1 = 66.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.008, top1 = 47.38%], valid : [loss = 2.464, top1 = 38.70%], test : [loss = 2.499, top1 = 38.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.11%], valid : [loss = 0.763, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2788/15625) 002788-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.47%], valid : [loss = 0.534, top1 = 87.25%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.63 ms.
cifar10        train : [loss = 0.053, top1 = 98.42%], test  : [loss = 0.369, top1 = 89.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.40 ms.
cifar100       train : [loss = 0.611, top1 = 82.08%], valid : [loss = 1.326, top1 = 65.23%], test : [loss = 1.317, top1 = 65.01%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.20%], valid : [loss = 2.519, top1 = 36.92%], test : [loss = 2.546, top1 = 36.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.49%], valid : [loss = 0.678, top1 = 76.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2789/15625) 002789-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.518, top1 = 88.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.336, top1 = 91.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.15 ms.
cifar100       train : [loss = 0.335, top1 = 90.84%], valid : [loss = 1.277, top1 = 67.41%], test : [loss = 1.295, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.83%], valid : [loss = 2.412, top1 = 39.32%], test : [loss = 2.420, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2790/15625) 002790-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.479, top1 = 89.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.308, top1 = 92.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.140, top1 = 97.16%], valid : [loss = 1.287, top1 = 69.05%], test : [loss = 1.291, top1 = 69.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 1.764, top1 = 53.02%], valid : [loss = 2.207, top1 = 43.24%], test : [loss = 2.215, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.22%], valid : [loss = 0.628, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2791/15625) 002791-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.571, top1 = 88.36%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.16 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.392, top1 = 91.57%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.27 ms.
cifar100       train : [loss = 0.082, top1 = 98.91%], valid : [loss = 1.451, top1 = 68.29%], test : [loss = 1.436, top1 = 67.96%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.20%], valid : [loss = 2.454, top1 = 38.87%], test : [loss = 2.451, top1 = 40.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.25%], valid : [loss = 0.737, top1 = 74.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2792/15625) 002792-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.31%], valid : [loss = 0.850, top1 = 72.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.568, top1 = 80.08%], test  : [loss = 0.722, top1 = 75.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 1.774, top1 = 52.27%], valid : [loss = 2.039, top1 = 46.77%], test : [loss = 2.050, top1 = 47.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.78%], valid : [loss = 3.650, top1 = 16.36%], test : [loss = 3.678, top1 = 15.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.189, top1 = 57.35%], valid : [loss = 1.249, top1 = 55.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2793/15625) 002793-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.58%], valid : [loss = 0.469, top1 = 85.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.158, top1 = 94.87%], test  : [loss = 0.347, top1 = 88.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.973, top1 = 72.43%], valid : [loss = 1.349, top1 = 62.25%], test : [loss = 1.339, top1 = 62.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.22%], valid : [loss = 2.671, top1 = 33.24%], test : [loss = 2.698, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2794/15625) 002794-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.88%], valid : [loss = 0.532, top1 = 85.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.090, top1 = 97.17%], test  : [loss = 0.359, top1 = 89.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.70 ms.
cifar100       train : [loss = 0.776, top1 = 77.43%], valid : [loss = 1.398, top1 = 63.05%], test : [loss = 1.378, top1 = 62.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.482, top1 = 36.86%], valid : [loss = 2.593, top1 = 34.78%], test : [loss = 2.617, top1 = 34.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.03%], valid : [loss = 0.862, top1 = 69.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2795/15625) 002795-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.467, top1 = 90.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.316, top1 = 93.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.25 ms.
cifar100       train : [loss = 0.069, top1 = 98.87%], valid : [loss = 1.386, top1 = 70.15%], test : [loss = 1.377, top1 = 70.03%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.570, top1 = 57.70%], valid : [loss = 2.220, top1 = 44.42%], test : [loss = 2.233, top1 = 44.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 85.90%], valid : [loss = 0.536, top1 = 82.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2796/15625) 002796-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.25 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.51 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2797/15625) 002797-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2798/15625) 002798-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.485, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.323, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.91 ms.
cifar100       train : [loss = 0.321, top1 = 91.49%], valid : [loss = 1.249, top1 = 67.52%], test : [loss = 1.254, top1 = 67.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.77%], valid : [loss = 2.304, top1 = 40.84%], test : [loss = 2.347, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.17%], valid : [loss = 0.600, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2799/15625) 002799-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.05%], valid : [loss = 0.859, top1 = 71.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.564, top1 = 80.28%], test  : [loss = 0.711, top1 = 75.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.49 ms.
cifar100       train : [loss = 1.775, top1 = 52.28%], valid : [loss = 2.039, top1 = 47.44%], test : [loss = 2.063, top1 = 47.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.24 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.76%], valid : [loss = 3.642, top1 = 16.42%], test : [loss = 3.672, top1 = 15.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2800/15625) 002800-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.74%], valid : [loss = 0.558, top1 = 85.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.099, top1 = 96.90%], test  : [loss = 0.364, top1 = 89.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.10 ms.
cifar100       train : [loss = 0.731, top1 = 78.67%], valid : [loss = 1.390, top1 = 62.95%], test : [loss = 1.359, top1 = 63.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.18%], valid : [loss = 2.626, top1 = 33.59%], test : [loss = 2.642, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.47%], valid : [loss = 0.894, top1 = 68.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2801/15625) 002801-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.17%], valid : [loss = 0.462, top1 = 86.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.163, top1 = 94.68%], test  : [loss = 0.346, top1 = 88.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 1.008, top1 = 71.26%], valid : [loss = 1.372, top1 = 61.73%], test : [loss = 1.350, top1 = 61.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.74%], valid : [loss = 2.682, top1 = 33.37%], test : [loss = 2.715, top1 = 32.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2802/15625) 002802-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.550, top1 = 88.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.349, top1 = 91.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.290, top1 = 91.88%], valid : [loss = 1.310, top1 = 67.96%], test : [loss = 1.323, top1 = 67.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.78%], valid : [loss = 2.435, top1 = 39.10%], test : [loss = 2.431, top1 = 38.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2803/15625) 002803-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.03%], valid : [loss = 0.480, top1 = 84.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.299, top1 = 90.00%], test  : [loss = 0.395, top1 = 86.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.28 ms.
cifar100       train : [loss = 1.322, top1 = 63.30%], valid : [loss = 1.527, top1 = 58.03%], test : [loss = 1.501, top1 = 58.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.65%], valid : [loss = 2.897, top1 = 29.86%], test : [loss = 2.949, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2804/15625) 002804-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.504, top1 = 89.65%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.87 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.320, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.79 ms.
cifar100       train : [loss = 0.125, top1 = 97.52%], valid : [loss = 1.301, top1 = 68.85%], test : [loss = 1.295, top1 = 69.49%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.75%], valid : [loss = 2.315, top1 = 41.51%], test : [loss = 2.279, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.72%], valid : [loss = 0.700, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2805/15625) 002805-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.322, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.48 ms.
cifar100       train : [loss = 0.324, top1 = 91.27%], valid : [loss = 1.308, top1 = 67.11%], test : [loss = 1.316, top1 = 66.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.18%], valid : [loss = 2.373, top1 = 39.98%], test : [loss = 2.414, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2806/15625) 002806-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.611, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.411, top1 = 91.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 0.211, top1 = 95.01%], valid : [loss = 1.440, top1 = 66.48%], test : [loss = 1.425, top1 = 66.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.96%], valid : [loss = 2.487, top1 = 37.51%], test : [loss = 2.506, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2807/15625) 002807-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.497, top1 = 90.04%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.99 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.314, top1 = 93.37%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.23 ms.
cifar100       train : [loss = 0.076, top1 = 98.76%], valid : [loss = 1.331, top1 = 70.23%], test : [loss = 1.296, top1 = 70.69%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.02 ms.
ImageNet16-120 train : [loss = 1.574, top1 = 57.50%], valid : [loss = 2.163, top1 = 44.69%], test : [loss = 2.155, top1 = 45.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.44%], valid : [loss = 0.651, top1 = 77.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2808/15625) 002808-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.19%], valid : [loss = 0.776, top1 = 80.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10        train : [loss = 0.127, top1 = 95.70%], test  : [loss = 0.509, top1 = 85.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.20 ms.
cifar100       train : [loss = 0.797, top1 = 76.86%], valid : [loss = 1.691, top1 = 56.67%], test : [loss = 1.686, top1 = 57.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.865, top1 = 29.15%], valid : [loss = 3.018, top1 = 26.66%], test : [loss = 3.044, top1 = 25.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.22%], valid : [loss = 1.052, top1 = 62.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2809/15625) 002809-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.523, top1 = 88.57%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.87 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.319, top1 = 92.13%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.56 ms.
cifar100       train : [loss = 0.330, top1 = 91.05%], valid : [loss = 1.275, top1 = 67.11%], test : [loss = 1.263, top1 = 67.37%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.07%], valid : [loss = 2.409, top1 = 39.32%], test : [loss = 2.407, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.17%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2810/15625) 002810-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.89%], valid : [loss = 0.517, top1 = 87.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.078, top1 = 97.49%], test  : [loss = 0.352, top1 = 89.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.713, top1 = 79.07%], valid : [loss = 1.335, top1 = 64.80%], test : [loss = 1.331, top1 = 64.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.14%], valid : [loss = 2.634, top1 = 34.14%], test : [loss = 2.676, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.38%], valid : [loss = 0.686, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2811/15625) 002811-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.52%], valid : [loss = 0.622, top1 = 85.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10        train : [loss = 0.076, top1 = 97.57%], test  : [loss = 0.428, top1 = 88.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.639, top1 = 81.16%], valid : [loss = 1.548, top1 = 61.05%], test : [loss = 1.512, top1 = 61.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.939, top1 = 27.25%], valid : [loss = 2.979, top1 = 26.60%], test : [loss = 3.006, top1 = 26.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.019, top1 = 63.16%], valid : [loss = 1.049, top1 = 62.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2812/15625) 002812-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.71 ms.
cifar10-valid  train : [loss = 1.831, top1 = 33.85%], valid : [loss = 1.849, top1 = 33.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.98 ms.
cifar10        train : [loss = 1.287, top1 = 53.60%], test  : [loss = 1.285, top1 = 53.46%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.53 ms.
cifar100       train : [loss = 3.822, top1 = 11.50%], valid : [loss = 3.886, top1 = 10.30%], test : [loss = 3.881, top1 = 10.99%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.74 ms.
ImageNet16-120 train : [loss = 3.876, top1 = 12.30%], valid : [loss = 3.854, top1 = 13.02%], test : [loss = 3.870, top1 = 12.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2813/15625) 002813-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.316, top1 = 93.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.23 ms.
cifar100       train : [loss = 0.127, top1 = 97.51%], valid : [loss = 1.302, top1 = 69.08%], test : [loss = 1.304, top1 = 69.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.05%], valid : [loss = 2.295, top1 = 41.91%], test : [loss = 2.278, top1 = 42.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2814/15625) 002814-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.544, top1 = 88.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.355, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.33 ms.
cifar100       train : [loss = 0.248, top1 = 93.35%], valid : [loss = 1.326, top1 = 67.51%], test : [loss = 1.323, top1 = 67.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.28%], valid : [loss = 2.435, top1 = 38.40%], test : [loss = 2.431, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.921, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2815/15625) 002815-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.570, top1 = 88.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.381, top1 = 91.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.72 ms.
cifar100       train : [loss = 0.132, top1 = 97.51%], valid : [loss = 1.420, top1 = 67.71%], test : [loss = 1.416, top1 = 67.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.31%], valid : [loss = 2.412, top1 = 39.20%], test : [loss = 2.430, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.00%], valid : [loss = 0.680, top1 = 76.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2816/15625) 002816-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.00%], valid : [loss = 0.553, top1 = 87.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10        train : [loss = 0.064, top1 = 97.94%], test  : [loss = 0.375, top1 = 90.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.42 ms.
cifar100       train : [loss = 0.665, top1 = 80.35%], valid : [loss = 1.325, top1 = 64.32%], test : [loss = 1.324, top1 = 64.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 39.91%], valid : [loss = 2.487, top1 = 36.80%], test : [loss = 2.490, top1 = 37.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2817/15625) 002817-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.33%], valid : [loss = 0.451, top1 = 87.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.111, top1 = 96.53%], test  : [loss = 0.328, top1 = 89.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.860, top1 = 75.52%], valid : [loss = 1.294, top1 = 64.28%], test : [loss = 1.274, top1 = 64.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.67%], valid : [loss = 2.630, top1 = 34.06%], test : [loss = 2.660, top1 = 34.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2818/15625) 002818-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.25%], valid : [loss = 0.520, top1 = 84.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.188, top1 = 93.63%], test  : [loss = 0.396, top1 = 87.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 1.219, top1 = 65.42%], valid : [loss = 1.523, top1 = 58.54%], test : [loss = 1.512, top1 = 58.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.88%], valid : [loss = 2.695, top1 = 32.98%], test : [loss = 2.729, top1 = 32.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.22%], valid : [loss = 0.958, top1 = 65.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2819/15625) 002819-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.542, top1 = 89.24%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.356, top1 = 92.57%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.00 ms.
cifar100       train : [loss = 0.134, top1 = 97.17%], valid : [loss = 1.347, top1 = 68.61%], test : [loss = 1.340, top1 = 68.87%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.32%], valid : [loss = 2.330, top1 = 41.31%], test : [loss = 2.324, top1 = 41.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.14%], valid : [loss = 0.859, top1 = 69.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2820/15625) 002820-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.524, top1 = 88.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.334, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.25 ms.
cifar100       train : [loss = 0.338, top1 = 90.80%], valid : [loss = 1.285, top1 = 66.46%], test : [loss = 1.296, top1 = 67.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.58%], valid : [loss = 2.405, top1 = 38.74%], test : [loss = 2.405, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2821/15625) 002821-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.15%], valid : [loss = 0.648, top1 = 85.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.054, top1 = 98.34%], test  : [loss = 0.399, top1 = 89.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 0.663, top1 = 80.44%], valid : [loss = 1.452, top1 = 62.39%], test : [loss = 1.448, top1 = 62.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 37.11%], valid : [loss = 2.636, top1 = 34.38%], test : [loss = 2.659, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.02%], valid : [loss = 0.897, top1 = 68.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2822/15625) 002822-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.87%], valid : [loss = 0.865, top1 = 71.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.563, top1 = 80.44%], test  : [loss = 0.719, top1 = 75.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.55 ms.
cifar100       train : [loss = 1.782, top1 = 51.93%], valid : [loss = 2.056, top1 = 47.08%], test : [loss = 2.068, top1 = 47.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.80%], valid : [loss = 3.641, top1 = 16.03%], test : [loss = 3.667, top1 = 15.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2823/15625) 002823-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.662, top1 = 86.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.020, top1 = 99.46%], test  : [loss = 0.432, top1 = 90.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.291, top1 = 92.16%], valid : [loss = 1.533, top1 = 63.97%], test : [loss = 1.532, top1 = 64.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.52%], valid : [loss = 2.583, top1 = 35.71%], test : [loss = 2.615, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 71.93%], valid : [loss = 0.846, top1 = 70.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2824/15625) 002824-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.564, top1 = 87.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.360, top1 = 90.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.503, top1 = 85.59%], valid : [loss = 1.309, top1 = 65.64%], test : [loss = 1.306, top1 = 65.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 35.56%], valid : [loss = 2.629, top1 = 33.64%], test : [loss = 2.653, top1 = 33.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.80%], valid : [loss = 0.906, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2825/15625) 002825-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.50%], valid : [loss = 0.555, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.363, top1 = 90.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.48 ms.
cifar100       train : [loss = 0.554, top1 = 84.14%], valid : [loss = 1.365, top1 = 64.25%], test : [loss = 1.347, top1 = 64.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.586, top1 = 34.32%], valid : [loss = 2.673, top1 = 32.66%], test : [loss = 2.668, top1 = 32.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2826/15625) 002826-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.82%], valid : [loss = 0.562, top1 = 83.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.209, top1 = 92.94%], test  : [loss = 0.394, top1 = 87.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 1.219, top1 = 65.13%], valid : [loss = 1.555, top1 = 57.45%], test : [loss = 1.535, top1 = 57.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.749, top1 = 31.54%], valid : [loss = 2.766, top1 = 30.46%], test : [loss = 2.830, top1 = 30.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 66.89%], valid : [loss = 0.969, top1 = 65.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2827/15625) 002827-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.29%], valid : [loss = 0.452, top1 = 86.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.111, top1 = 96.57%], test  : [loss = 0.326, top1 = 89.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.867, top1 = 75.21%], valid : [loss = 1.298, top1 = 64.03%], test : [loss = 1.299, top1 = 63.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.64%], valid : [loss = 2.626, top1 = 34.46%], test : [loss = 2.660, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2828/15625) 002828-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.578, top1 = 87.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.386, top1 = 91.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.71 ms.
cifar100       train : [loss = 0.413, top1 = 88.21%], valid : [loss = 1.424, top1 = 64.69%], test : [loss = 1.418, top1 = 64.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.14%], valid : [loss = 2.488, top1 = 37.24%], test : [loss = 2.502, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.51%], valid : [loss = 0.846, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2829/15625) 002829-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.15%], valid : [loss = 0.549, top1 = 85.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.118, top1 = 96.16%], test  : [loss = 0.378, top1 = 88.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.791, top1 = 76.93%], valid : [loss = 1.379, top1 = 63.19%], test : [loss = 1.370, top1 = 63.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.46%], valid : [loss = 2.629, top1 = 33.63%], test : [loss = 2.659, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.76%], valid : [loss = 0.897, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2830/15625) 002830-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.506, top1 = 88.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10        train : [loss = 0.027, top1 = 99.26%], test  : [loss = 0.358, top1 = 91.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.71 ms.
cifar100       train : [loss = 0.478, top1 = 85.93%], valid : [loss = 1.340, top1 = 65.58%], test : [loss = 1.355, top1 = 65.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.23%], valid : [loss = 2.526, top1 = 36.60%], test : [loss = 2.564, top1 = 35.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2831/15625) 002831-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.23%], valid : [loss = 0.458, top1 = 86.19%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.33 ms.
cifar10        train : [loss = 0.160, top1 = 94.82%], test  : [loss = 0.349, top1 = 88.66%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.85 ms.
cifar100       train : [loss = 1.002, top1 = 71.45%], valid : [loss = 1.362, top1 = 62.09%], test : [loss = 1.351, top1 = 61.77%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.76%], valid : [loss = 2.684, top1 = 32.90%], test : [loss = 2.717, top1 = 32.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.30%], valid : [loss = 0.777, top1 = 72.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2832/15625) 002832-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.505, top1 = 88.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.323, top1 = 92.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.310, top1 = 91.64%], valid : [loss = 1.273, top1 = 67.28%], test : [loss = 1.272, top1 = 67.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.79%], valid : [loss = 2.368, top1 = 39.49%], test : [loss = 2.379, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.24%], valid : [loss = 0.677, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2833/15625) 002833-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.73%], valid : [loss = 0.547, top1 = 86.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.067, top1 = 97.85%], test  : [loss = 0.374, top1 = 89.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.09 ms.
cifar100       train : [loss = 0.689, top1 = 79.71%], valid : [loss = 1.351, top1 = 63.68%], test : [loss = 1.342, top1 = 64.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.80%], valid : [loss = 2.530, top1 = 36.60%], test : [loss = 2.550, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.20%], valid : [loss = 0.889, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2834/15625) 002834-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.497, top1 = 90.07%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.323, top1 = 93.09%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.09 ms.
cifar100       train : [loss = 0.115, top1 = 97.75%], valid : [loss = 1.287, top1 = 69.33%], test : [loss = 1.290, top1 = 69.97%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.51 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.75%], valid : [loss = 2.199, top1 = 44.13%], test : [loss = 2.194, top1 = 44.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.94%], valid : [loss = 0.646, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2835/15625) 002835-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.48%], valid : [loss = 0.448, top1 = 87.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10        train : [loss = 0.055, top1 = 98.65%], test  : [loss = 0.324, top1 = 90.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.81 ms.
cifar100       train : [loss = 0.585, top1 = 83.89%], valid : [loss = 1.221, top1 = 67.07%], test : [loss = 1.204, top1 = 66.87%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 41.07%], valid : [loss = 2.458, top1 = 38.02%], test : [loss = 2.490, top1 = 38.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2836/15625) 002836-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.556, top1 = 87.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.382, top1 = 91.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.370, top1 = 89.54%], valid : [loss = 1.400, top1 = 65.52%], test : [loss = 1.393, top1 = 65.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.73%], valid : [loss = 2.475, top1 = 37.13%], test : [loss = 2.494, top1 = 38.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.87%], valid : [loss = 0.771, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2837/15625) 002837-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.452, top1 = 89.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.317, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 0.335, top1 = 90.85%], valid : [loss = 1.297, top1 = 67.65%], test : [loss = 1.303, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.02%], valid : [loss = 2.352, top1 = 40.18%], test : [loss = 2.385, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.81%], valid : [loss = 0.567, top1 = 80.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2838/15625) 002838-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.80%], valid : [loss = 0.607, top1 = 86.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.19 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.404, top1 = 90.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 0.501, top1 = 85.32%], valid : [loss = 1.393, top1 = 64.39%], test : [loss = 1.405, top1 = 64.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.28%], valid : [loss = 2.558, top1 = 35.98%], test : [loss = 2.592, top1 = 35.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.28%], valid : [loss = 0.843, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2839/15625) 002839-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.29%], valid : [loss = 0.889, top1 = 74.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.67 ms.
cifar10        train : [loss = 0.301, top1 = 89.50%], test  : [loss = 0.623, top1 = 80.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.09 ms.
cifar100       train : [loss = 1.382, top1 = 61.28%], valid : [loss = 1.930, top1 = 50.17%], test : [loss = 1.946, top1 = 49.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 3.485, top1 = 17.63%], valid : [loss = 3.518, top1 = 17.96%], test : [loss = 3.523, top1 = 16.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2840/15625) 002840-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2841/15625) 002841-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.562, top1 = 88.61%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.53 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.363, top1 = 92.35%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.05 ms.
cifar100       train : [loss = 0.102, top1 = 97.99%], valid : [loss = 1.538, top1 = 65.95%], test : [loss = 1.516, top1 = 66.77%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.37 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.05%], valid : [loss = 2.787, top1 = 30.04%], test : [loss = 2.801, top1 = 30.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 56.96%], valid : [loss = 1.186, top1 = 56.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2842/15625) 002842-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.467, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.314, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.314, top1 = 91.60%], valid : [loss = 1.244, top1 = 68.07%], test : [loss = 1.237, top1 = 68.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.64%], valid : [loss = 2.325, top1 = 41.01%], test : [loss = 2.347, top1 = 40.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2843/15625) 002843-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.22%], valid : [loss = 0.906, top1 = 76.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10        train : [loss = 0.225, top1 = 92.21%], test  : [loss = 0.616, top1 = 81.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.53 ms.
cifar100       train : [loss = 1.158, top1 = 67.04%], valid : [loss = 1.759, top1 = 54.45%], test : [loss = 1.777, top1 = 54.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 3.226, top1 = 22.78%], valid : [loss = 3.317, top1 = 21.39%], test : [loss = 3.370, top1 = 20.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.046, top1 = 62.50%], valid : [loss = 1.100, top1 = 61.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2844/15625) 002844-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.17%], valid : [loss = 0.587, top1 = 85.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.108, top1 = 96.46%], test  : [loss = 0.396, top1 = 88.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.07 ms.
cifar100       train : [loss = 0.810, top1 = 76.13%], valid : [loss = 1.415, top1 = 62.49%], test : [loss = 1.416, top1 = 62.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.02%], valid : [loss = 2.759, top1 = 31.66%], test : [loss = 2.822, top1 = 30.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2845/15625) 002845-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.482, top1 = 90.20%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.317, top1 = 93.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.00 ms.
cifar100       train : [loss = 0.119, top1 = 97.64%], valid : [loss = 1.282, top1 = 69.67%], test : [loss = 1.286, top1 = 69.85%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.87 ms.
ImageNet16-120 train : [loss = 1.689, top1 = 54.69%], valid : [loss = 2.182, top1 = 43.89%], test : [loss = 2.201, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.24%], valid : [loss = 0.633, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2846/15625) 002846-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.65 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2847/15625) 002847-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.538, top1 = 88.83%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.34 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.345, top1 = 92.28%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.66 ms.
cifar100       train : [loss = 0.290, top1 = 92.01%], valid : [loss = 1.325, top1 = 67.28%], test : [loss = 1.327, top1 = 67.38%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.34%], valid : [loss = 2.408, top1 = 38.52%], test : [loss = 2.419, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.84%], valid : [loss = 0.725, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2848/15625) 002848-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.62 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.560, top1 = 88.12%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.18 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.350, top1 = 91.93%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.86 ms.
cifar100       train : [loss = 0.201, top1 = 95.08%], valid : [loss = 1.310, top1 = 68.03%], test : [loss = 1.346, top1 = 67.73%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.61 ms.
ImageNet16-120 train : [loss = 2.004, top1 = 47.32%], valid : [loss = 2.353, top1 = 40.62%], test : [loss = 2.363, top1 = 40.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.33%], valid : [loss = 0.832, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2849/15625) 002849-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.43%], valid : [loss = 0.701, top1 = 84.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10        train : [loss = 0.052, top1 = 98.40%], test  : [loss = 0.436, top1 = 88.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 0.625, top1 = 81.69%], valid : [loss = 1.522, top1 = 61.38%], test : [loss = 1.503, top1 = 61.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.28%], valid : [loss = 2.820, top1 = 30.59%], test : [loss = 2.872, top1 = 30.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.08%], valid : [loss = 0.886, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2850/15625) 002850-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.604, top1 = 87.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.388, top1 = 91.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.27 ms.
cifar100       train : [loss = 0.201, top1 = 95.26%], valid : [loss = 1.443, top1 = 66.17%], test : [loss = 1.432, top1 = 66.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.15%], valid : [loss = 2.497, top1 = 37.66%], test : [loss = 2.502, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.45%], valid : [loss = 0.769, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2851/15625) 002851-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.50%], valid : [loss = 0.552, top1 = 87.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10        train : [loss = 0.034, top1 = 98.98%], test  : [loss = 0.367, top1 = 90.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.85 ms.
cifar100       train : [loss = 0.567, top1 = 83.53%], valid : [loss = 1.394, top1 = 63.69%], test : [loss = 1.413, top1 = 63.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.599, top1 = 34.03%], valid : [loss = 2.673, top1 = 33.17%], test : [loss = 2.696, top1 = 32.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2852/15625) 002852-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.493, top1 = 89.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.98 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.313, top1 = 92.39%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.72 ms.
cifar100       train : [loss = 0.225, top1 = 94.53%], valid : [loss = 1.261, top1 = 68.33%], test : [loss = 1.247, top1 = 68.85%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.57%], valid : [loss = 2.271, top1 = 42.04%], test : [loss = 2.274, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.33%], valid : [loss = 0.649, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2853/15625) 002853-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.631, top1 = 86.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.394, top1 = 90.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.71 ms.
cifar100       train : [loss = 0.550, top1 = 83.94%], valid : [loss = 1.418, top1 = 63.87%], test : [loss = 1.423, top1 = 63.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.12%], valid : [loss = 2.584, top1 = 35.23%], test : [loss = 2.575, top1 = 35.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.33%], valid : [loss = 0.886, top1 = 68.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2854/15625) 002854-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.490, top1 = 89.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.336, top1 = 92.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.61 ms.
cifar100       train : [loss = 0.167, top1 = 95.96%], valid : [loss = 1.437, top1 = 67.41%], test : [loss = 1.389, top1 = 68.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.48%], valid : [loss = 2.319, top1 = 41.81%], test : [loss = 2.322, top1 = 41.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.07%], valid : [loss = 0.618, top1 = 78.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2855/15625) 002855-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.548, top1 = 88.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.23 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.355, top1 = 91.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.02 ms.
cifar100       train : [loss = 0.282, top1 = 92.47%], valid : [loss = 1.250, top1 = 68.50%], test : [loss = 1.262, top1 = 68.33%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.36%], valid : [loss = 2.316, top1 = 40.76%], test : [loss = 2.330, top1 = 41.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.56%], valid : [loss = 0.791, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2856/15625) 002856-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.532, top1 = 89.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.349, top1 = 92.86%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.67 ms.
cifar100       train : [loss = 0.037, top1 = 99.66%], valid : [loss = 1.453, top1 = 69.55%], test : [loss = 1.444, top1 = 69.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 55.18%], valid : [loss = 2.367, top1 = 41.38%], test : [loss = 2.347, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.21%], valid : [loss = 0.620, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2857/15625) 002857-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.30%], valid : [loss = 0.456, top1 = 86.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.153, top1 = 95.02%], test  : [loss = 0.341, top1 = 88.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.29 ms.
cifar100       train : [loss = 0.996, top1 = 71.66%], valid : [loss = 1.363, top1 = 62.32%], test : [loss = 1.364, top1 = 61.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.78%], valid : [loss = 2.687, top1 = 32.64%], test : [loss = 2.719, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.25%], valid : [loss = 0.797, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2858/15625) 002858-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.52%], valid : [loss = 0.464, top1 = 86.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10        train : [loss = 0.156, top1 = 94.94%], test  : [loss = 0.349, top1 = 88.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 0.991, top1 = 71.93%], valid : [loss = 1.358, top1 = 61.77%], test : [loss = 1.352, top1 = 62.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.17%], valid : [loss = 2.689, top1 = 32.92%], test : [loss = 2.686, top1 = 33.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2859/15625) 002859-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.34%], valid : [loss = 0.850, top1 = 71.96%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10        train : [loss = 0.562, top1 = 80.33%], test  : [loss = 0.715, top1 = 75.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 1.778, top1 = 52.04%], valid : [loss = 2.043, top1 = 46.90%], test : [loss = 2.062, top1 = 46.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.81%], valid : [loss = 3.635, top1 = 16.28%], test : [loss = 3.669, top1 = 15.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2860/15625) 002860-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.23%], valid : [loss = 0.588, top1 = 85.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10        train : [loss = 0.107, top1 = 96.52%], test  : [loss = 0.384, top1 = 88.74%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.67 ms.
cifar100       train : [loss = 0.818, top1 = 75.90%], valid : [loss = 1.414, top1 = 61.87%], test : [loss = 1.404, top1 = 62.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 32.94%], valid : [loss = 2.742, top1 = 32.57%], test : [loss = 2.810, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.06%], valid : [loss = 0.700, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2861/15625) 002861-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.507, top1 = 88.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.337, top1 = 92.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.83 ms.
cifar100       train : [loss = 0.325, top1 = 91.19%], valid : [loss = 1.291, top1 = 66.87%], test : [loss = 1.275, top1 = 67.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.20%], valid : [loss = 2.382, top1 = 39.56%], test : [loss = 2.407, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2862/15625) 002862-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.19%], valid : [loss = 0.451, top1 = 87.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10        train : [loss = 0.115, top1 = 96.41%], test  : [loss = 0.322, top1 = 90.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.20 ms.
cifar100       train : [loss = 0.859, top1 = 75.57%], valid : [loss = 1.287, top1 = 64.02%], test : [loss = 1.270, top1 = 64.51%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.75%], valid : [loss = 2.615, top1 = 34.94%], test : [loss = 2.647, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.30%], valid : [loss = 0.658, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2863/15625) 002863-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.825, top1 = 83.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.020, top1 = 99.48%], test  : [loss = 0.558, top1 = 87.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.49 ms.
cifar100       train : [loss = 0.252, top1 = 93.76%], valid : [loss = 1.745, top1 = 61.09%], test : [loss = 1.790, top1 = 60.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.484, top1 = 37.36%], valid : [loss = 2.910, top1 = 29.70%], test : [loss = 2.936, top1 = 30.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.52%], valid : [loss = 1.010, top1 = 64.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2864/15625) 002864-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.45%], valid : [loss = 0.455, top1 = 86.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10        train : [loss = 0.154, top1 = 95.00%], test  : [loss = 0.347, top1 = 88.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.46 ms.
cifar100       train : [loss = 1.001, top1 = 71.53%], valid : [loss = 1.354, top1 = 61.73%], test : [loss = 1.370, top1 = 61.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.90%], valid : [loss = 2.681, top1 = 33.41%], test : [loss = 2.702, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2865/15625) 002865-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.71%], valid : [loss = 0.461, top1 = 86.49%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.37 ms.
cifar10        train : [loss = 0.124, top1 = 96.11%], test  : [loss = 0.331, top1 = 89.40%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.25 ms.
cifar100       train : [loss = 0.805, top1 = 77.26%], valid : [loss = 1.280, top1 = 64.45%], test : [loss = 1.288, top1 = 64.40%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.94 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 36.35%], valid : [loss = 2.610, top1 = 34.83%], test : [loss = 2.617, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.26%], valid : [loss = 0.780, top1 = 72.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2866/15625) 002866-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.78%], valid : [loss = 0.465, top1 = 86.60%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.27 ms.
cifar10        train : [loss = 0.118, top1 = 96.35%], test  : [loss = 0.334, top1 = 89.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.72 ms.
cifar100       train : [loss = 0.744, top1 = 79.20%], valid : [loss = 1.263, top1 = 65.13%], test : [loss = 1.280, top1 = 64.61%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 2.480, top1 = 37.12%], valid : [loss = 2.579, top1 = 35.36%], test : [loss = 2.596, top1 = 34.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.76%], valid : [loss = 0.859, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2867/15625) 002867-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.24%], valid : [loss = 0.608, top1 = 85.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.068, top1 = 97.95%], test  : [loss = 0.402, top1 = 88.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 0.715, top1 = 79.18%], valid : [loss = 1.401, top1 = 63.22%], test : [loss = 1.377, top1 = 63.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.89%], valid : [loss = 2.660, top1 = 33.57%], test : [loss = 2.705, top1 = 33.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2868/15625) 002868-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.01%], valid : [loss = 0.973, top1 = 66.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.764, top1 = 73.19%], test  : [loss = 0.849, top1 = 70.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.24 ms.
cifar100       train : [loss = 2.128, top1 = 44.12%], valid : [loss = 2.296, top1 = 41.09%], test : [loss = 2.330, top1 = 41.11%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 3.736, top1 = 14.40%], valid : [loss = 3.764, top1 = 14.58%], test : [loss = 3.773, top1 = 13.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.451, top1 = 46.48%], valid : [loss = 1.481, top1 = 45.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2869/15625) 002869-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.586, top1 = 87.38%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.414, top1 = 90.56%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.89 ms.
cifar100       train : [loss = 0.139, top1 = 97.72%], valid : [loss = 1.493, top1 = 65.73%], test : [loss = 1.488, top1 = 65.98%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.76%], valid : [loss = 2.522, top1 = 37.53%], test : [loss = 2.544, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.89%], valid : [loss = 0.748, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2870/15625) 002870-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.412, top1 = 90.77%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.58 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.280, top1 = 93.41%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.68 ms.
cifar100       train : [loss = 0.093, top1 = 98.40%], valid : [loss = 1.281, top1 = 70.45%], test : [loss = 1.261, top1 = 70.53%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 1.623, top1 = 56.37%], valid : [loss = 2.206, top1 = 44.13%], test : [loss = 2.223, top1 = 44.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.44%], valid : [loss = 0.501, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2871/15625) 002871-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.65%], valid : [loss = 0.601, top1 = 86.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.035, top1 = 98.97%], test  : [loss = 0.391, top1 = 89.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.563, top1 = 83.56%], valid : [loss = 1.418, top1 = 63.57%], test : [loss = 1.430, top1 = 63.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.12%], valid : [loss = 2.584, top1 = 35.11%], test : [loss = 2.584, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.90%], valid : [loss = 0.822, top1 = 71.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2872/15625) 002872-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.469, top1 = 89.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.304, top1 = 92.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.05 ms.
cifar100       train : [loss = 0.310, top1 = 91.67%], valid : [loss = 1.251, top1 = 68.22%], test : [loss = 1.270, top1 = 67.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.22%], valid : [loss = 2.269, top1 = 41.68%], test : [loss = 2.299, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.14%], valid : [loss = 0.595, top1 = 79.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2873/15625) 002873-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.63%], valid : [loss = 0.447, top1 = 86.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10        train : [loss = 0.153, top1 = 95.00%], test  : [loss = 0.336, top1 = 89.17%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.34 ms.
cifar100       train : [loss = 0.977, top1 = 72.19%], valid : [loss = 1.349, top1 = 62.27%], test : [loss = 1.346, top1 = 61.91%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 33.99%], valid : [loss = 2.693, top1 = 32.22%], test : [loss = 2.700, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2874/15625) 002874-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.24%], valid : [loss = 0.563, top1 = 86.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.58 ms.
cifar10        train : [loss = 0.061, top1 = 98.06%], test  : [loss = 0.356, top1 = 90.22%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.07 ms.
cifar100       train : [loss = 0.672, top1 = 80.20%], valid : [loss = 1.321, top1 = 64.51%], test : [loss = 1.332, top1 = 64.59%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.22%], valid : [loss = 2.509, top1 = 36.62%], test : [loss = 2.540, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.67%], valid : [loss = 0.831, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2875/15625) 002875-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.529, top1 = 89.46%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.329, top1 = 93.14%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.50 ms.
cifar100       train : [loss = 0.069, top1 = 99.00%], valid : [loss = 1.333, top1 = 69.60%], test : [loss = 1.347, top1 = 69.55%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.60%], valid : [loss = 2.378, top1 = 39.32%], test : [loss = 2.382, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2876/15625) 002876-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.504, top1 = 88.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.326, top1 = 92.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.40 ms.
cifar100       train : [loss = 0.306, top1 = 91.80%], valid : [loss = 1.264, top1 = 67.53%], test : [loss = 1.256, top1 = 68.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.30%], valid : [loss = 2.369, top1 = 39.76%], test : [loss = 2.384, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.56%], valid : [loss = 0.684, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2877/15625) 002877-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.505, top1 = 89.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.345, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 0.276, top1 = 92.42%], valid : [loss = 1.368, top1 = 67.13%], test : [loss = 1.358, top1 = 67.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.49%], valid : [loss = 2.368, top1 = 39.66%], test : [loss = 2.389, top1 = 40.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.70%], valid : [loss = 0.554, top1 = 81.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2878/15625) 002878-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.550, top1 = 88.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.388, top1 = 91.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 0.392, top1 = 88.93%], valid : [loss = 1.414, top1 = 65.22%], test : [loss = 1.391, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.82%], valid : [loss = 2.472, top1 = 38.01%], test : [loss = 2.505, top1 = 37.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.40%], valid : [loss = 0.755, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2879/15625) 002879-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.514, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.329, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.328, top1 = 91.11%], valid : [loss = 1.281, top1 = 67.20%], test : [loss = 1.279, top1 = 67.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.89%], valid : [loss = 2.415, top1 = 38.74%], test : [loss = 2.424, top1 = 38.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2880/15625) 002880-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.00 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.56%], valid : [loss = 0.436, top1 = 88.03%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.33 ms.
cifar10        train : [loss = 0.052, top1 = 98.78%], test  : [loss = 0.311, top1 = 90.82%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.18 ms.
cifar100       train : [loss = 0.559, top1 = 84.65%], valid : [loss = 1.203, top1 = 67.09%], test : [loss = 1.189, top1 = 67.47%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.79%], valid : [loss = 2.467, top1 = 37.67%], test : [loss = 2.479, top1 = 37.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.61%], valid : [loss = 0.625, top1 = 78.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2881/15625) 002881-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.59%], valid : [loss = 0.560, top1 = 87.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.029, top1 = 99.18%], test  : [loss = 0.372, top1 = 90.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.88 ms.
cifar100       train : [loss = 0.536, top1 = 84.62%], valid : [loss = 1.374, top1 = 63.86%], test : [loss = 1.362, top1 = 64.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.04 ms.
ImageNet16-120 train : [loss = 2.452, top1 = 37.37%], valid : [loss = 2.562, top1 = 35.13%], test : [loss = 2.570, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.61%], valid : [loss = 0.972, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2882/15625) 002882-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.526, top1 = 88.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.351, top1 = 92.11%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.61 ms.
cifar100       train : [loss = 0.197, top1 = 95.49%], valid : [loss = 1.317, top1 = 67.70%], test : [loss = 1.314, top1 = 68.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.00 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.14%], valid : [loss = 2.433, top1 = 37.93%], test : [loss = 2.442, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.06%], valid : [loss = 0.843, top1 = 70.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2883/15625) 002883-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.27%], valid : [loss = 0.543, top1 = 83.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.206, top1 = 93.03%], test  : [loss = 0.398, top1 = 87.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 1.283, top1 = 63.61%], valid : [loss = 1.559, top1 = 57.45%], test : [loss = 1.558, top1 = 57.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.717, top1 = 32.30%], valid : [loss = 2.745, top1 = 31.41%], test : [loss = 2.789, top1 = 32.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 65.41%], valid : [loss = 1.002, top1 = 64.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2884/15625) 002884-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.50%], valid : [loss = 0.533, top1 = 83.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10        train : [loss = 0.232, top1 = 92.14%], test  : [loss = 0.388, top1 = 87.31%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.28 ms.
cifar100       train : [loss = 1.370, top1 = 61.71%], valid : [loss = 1.636, top1 = 55.39%], test : [loss = 1.608, top1 = 55.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.859, top1 = 29.53%], valid : [loss = 2.868, top1 = 29.83%], test : [loss = 2.927, top1 = 28.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.985, top1 = 64.78%], valid : [loss = 1.025, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2885/15625) 002885-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.67%], valid : [loss = 0.852, top1 = 71.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.29 ms.
cifar10        train : [loss = 0.556, top1 = 80.65%], test  : [loss = 0.709, top1 = 75.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 1.780, top1 = 51.97%], valid : [loss = 2.050, top1 = 46.85%], test : [loss = 2.063, top1 = 46.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.90%], valid : [loss = 3.641, top1 = 15.77%], test : [loss = 3.660, top1 = 16.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2886/15625) 002886-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.38%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.308, top1 = 92.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.00 ms.
cifar100       train : [loss = 0.216, top1 = 94.97%], valid : [loss = 1.223, top1 = 69.44%], test : [loss = 1.237, top1 = 68.91%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.79%], valid : [loss = 2.238, top1 = 42.07%], test : [loss = 2.258, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.94%], valid : [loss = 0.669, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2887/15625) 002887-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.96%], valid : [loss = 0.738, top1 = 83.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.084, top1 = 97.34%], test  : [loss = 0.472, top1 = 87.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.61 ms.
cifar100       train : [loss = 0.793, top1 = 76.86%], valid : [loss = 1.518, top1 = 60.75%], test : [loss = 1.507, top1 = 60.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.817, top1 = 30.26%], valid : [loss = 2.941, top1 = 28.34%], test : [loss = 3.007, top1 = 27.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2888/15625) 002888-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.514, top1 = 88.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.317, top1 = 92.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.70 ms.
cifar100       train : [loss = 0.323, top1 = 91.31%], valid : [loss = 1.286, top1 = 67.33%], test : [loss = 1.290, top1 = 67.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.87%], valid : [loss = 2.418, top1 = 39.07%], test : [loss = 2.413, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2889/15625) 002889-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=23.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.503, top1 = 90.02%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.82 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.22%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.02 ms.
cifar100       train : [loss = 0.056, top1 = 99.32%], valid : [loss = 1.259, top1 = 71.11%], test : [loss = 1.259, top1 = 71.23%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=20.44 ms.
ImageNet16-120 train : [loss = 1.613, top1 = 56.64%], valid : [loss = 2.139, top1 = 44.87%], test : [loss = 2.143, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.34%], valid : [loss = 0.764, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2890/15625) 002890-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.33 ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.38%], valid : [loss = 1.081, top1 = 63.14%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.10 ms.
cifar10        train : [loss = 0.857, top1 = 69.90%], test  : [loss = 0.937, top1 = 67.06%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.96 ms.
cifar100       train : [loss = 2.274, top1 = 40.94%], valid : [loss = 2.465, top1 = 37.80%], test : [loss = 2.486, top1 = 37.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 3.796, top1 = 13.40%], valid : [loss = 3.823, top1 = 13.57%], test : [loss = 3.830, top1 = 13.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.500, top1 = 44.85%], valid : [loss = 1.517, top1 = 44.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2891/15625) 002891-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.589, top1 = 87.72%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.12 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.389, top1 = 91.20%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.04 ms.
cifar100       train : [loss = 0.207, top1 = 95.23%], valid : [loss = 1.469, top1 = 65.91%], test : [loss = 1.456, top1 = 65.75%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.87 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.17%], valid : [loss = 2.484, top1 = 38.03%], test : [loss = 2.526, top1 = 37.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 76.88%], valid : [loss = 0.743, top1 = 74.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2892/15625) 002892-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.509, top1 = 89.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.323, top1 = 93.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.117, top1 = 97.74%], valid : [loss = 1.296, top1 = 69.81%], test : [loss = 1.293, top1 = 69.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 1.719, top1 = 53.98%], valid : [loss = 2.177, top1 = 44.69%], test : [loss = 2.192, top1 = 44.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2893/15625) 002893-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.11%], valid : [loss = 0.715, top1 = 83.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.066, top1 = 97.96%], test  : [loss = 0.447, top1 = 88.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.55 ms.
cifar100       train : [loss = 0.665, top1 = 80.58%], valid : [loss = 1.512, top1 = 61.03%], test : [loss = 1.496, top1 = 61.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.714, top1 = 32.46%], valid : [loss = 2.880, top1 = 29.38%], test : [loss = 2.925, top1 = 28.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.49%], valid : [loss = 0.899, top1 = 68.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2894/15625) 002894-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.15%], valid : [loss = 0.478, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.296, top1 = 90.06%], test  : [loss = 0.397, top1 = 86.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.74 ms.
cifar100       train : [loss = 1.326, top1 = 63.26%], valid : [loss = 1.541, top1 = 57.88%], test : [loss = 1.501, top1 = 58.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.90%], valid : [loss = 2.880, top1 = 29.57%], test : [loss = 2.958, top1 = 28.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2895/15625) 002895-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.550, top1 = 88.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.370, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.47 ms.
cifar100       train : [loss = 0.144, top1 = 97.11%], valid : [loss = 1.421, top1 = 67.73%], test : [loss = 1.432, top1 = 67.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.87%], valid : [loss = 2.464, top1 = 39.12%], test : [loss = 2.484, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.52%], valid : [loss = 0.691, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2896/15625) 002896-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.455, top1 = 89.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.303, top1 = 92.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.228, top1 = 94.37%], valid : [loss = 1.232, top1 = 69.26%], test : [loss = 1.247, top1 = 69.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.26%], valid : [loss = 2.265, top1 = 42.56%], test : [loss = 2.279, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.36%], valid : [loss = 0.532, top1 = 81.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2897/15625) 002897-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.579, top1 = 88.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.401, top1 = 91.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.61 ms.
cifar100       train : [loss = 0.202, top1 = 95.35%], valid : [loss = 1.426, top1 = 66.75%], test : [loss = 1.434, top1 = 66.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.55%], valid : [loss = 2.465, top1 = 38.01%], test : [loss = 2.504, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.21%], valid : [loss = 0.712, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2898/15625) 002898-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.574, top1 = 87.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.385, top1 = 91.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.95 ms.
cifar100       train : [loss = 0.383, top1 = 89.14%], valid : [loss = 1.416, top1 = 65.25%], test : [loss = 1.417, top1 = 64.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.39%], valid : [loss = 2.493, top1 = 37.03%], test : [loss = 2.526, top1 = 37.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.59%], valid : [loss = 0.841, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2899/15625) 002899-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.470, top1 = 89.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.288, top1 = 93.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.04 ms.
cifar100       train : [loss = 0.283, top1 = 92.45%], valid : [loss = 1.236, top1 = 68.39%], test : [loss = 1.240, top1 = 68.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.38%], valid : [loss = 2.213, top1 = 42.89%], test : [loss = 2.223, top1 = 43.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2900/15625) 002900-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.427, top1 = 90.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.292, top1 = 93.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.153, top1 = 96.62%], valid : [loss = 1.280, top1 = 70.08%], test : [loss = 1.286, top1 = 69.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.11%], valid : [loss = 2.215, top1 = 43.44%], test : [loss = 2.256, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.383, top1 = 86.84%], valid : [loss = 0.497, top1 = 83.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2901/15625) 002901-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.544, top1 = 88.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.97 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.339, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.38 ms.
cifar100       train : [loss = 0.318, top1 = 91.12%], valid : [loss = 1.306, top1 = 66.95%], test : [loss = 1.322, top1 = 67.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.41%], valid : [loss = 2.431, top1 = 38.36%], test : [loss = 2.446, top1 = 37.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.70%], valid : [loss = 0.836, top1 = 70.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2902/15625) 002902-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.572, top1 = 87.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.380, top1 = 91.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.86 ms.
cifar100       train : [loss = 0.399, top1 = 88.69%], valid : [loss = 1.404, top1 = 65.61%], test : [loss = 1.385, top1 = 65.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.97%], valid : [loss = 2.513, top1 = 36.89%], test : [loss = 2.535, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2903/15625) 002903-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.44%], valid : [loss = 0.687, top1 = 82.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10        train : [loss = 0.095, top1 = 96.89%], test  : [loss = 0.436, top1 = 87.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.44 ms.
cifar100       train : [loss = 0.663, top1 = 80.43%], valid : [loss = 1.493, top1 = 61.69%], test : [loss = 1.487, top1 = 61.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 3.106, top1 = 23.89%], valid : [loss = 3.152, top1 = 23.81%], test : [loss = 3.178, top1 = 22.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.52%], valid : [loss = 1.073, top1 = 61.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2904/15625) 002904-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.432, top1 = 90.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.287, top1 = 93.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.176, top1 = 95.83%], valid : [loss = 1.259, top1 = 69.82%], test : [loss = 1.279, top1 = 69.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.09%], valid : [loss = 2.247, top1 = 42.72%], test : [loss = 2.274, top1 = 42.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2905/15625) 002905-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.77%], valid : [loss = 0.863, top1 = 71.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.546, top1 = 80.98%], test  : [loss = 0.709, top1 = 76.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.18 ms.
cifar100       train : [loss = 1.768, top1 = 52.38%], valid : [loss = 2.039, top1 = 47.58%], test : [loss = 2.057, top1 = 46.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 16.95%], valid : [loss = 3.635, top1 = 16.41%], test : [loss = 3.674, top1 = 15.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2906/15625) 002906-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.514, top1 = 89.78%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.77 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.338, top1 = 93.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.81 ms.
cifar100       train : [loss = 0.075, top1 = 98.77%], valid : [loss = 1.360, top1 = 69.11%], test : [loss = 1.352, top1 = 69.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 1.630, top1 = 56.20%], valid : [loss = 2.193, top1 = 44.14%], test : [loss = 2.195, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.93%], valid : [loss = 0.641, top1 = 77.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2907/15625) 002907-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.19%], valid : [loss = 0.734, top1 = 75.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10        train : [loss = 0.493, top1 = 82.93%], test  : [loss = 0.567, top1 = 80.48%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.96 ms.
cifar100       train : [loss = 1.988, top1 = 46.10%], valid : [loss = 2.110, top1 = 43.91%], test : [loss = 2.120, top1 = 43.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 3.021, top1 = 26.18%], valid : [loss = 3.008, top1 = 26.54%], test : [loss = 3.044, top1 = 26.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2908/15625) 002908-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.89 ms.
cifar100       train : [loss = 0.321, top1 = 91.35%], valid : [loss = 1.285, top1 = 67.43%], test : [loss = 1.324, top1 = 66.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.69 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.37%], valid : [loss = 2.354, top1 = 40.48%], test : [loss = 2.394, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2909/15625) 002909-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.539, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.377, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.40 ms.
cifar100       train : [loss = 0.104, top1 = 98.14%], valid : [loss = 1.506, top1 = 67.35%], test : [loss = 1.477, top1 = 67.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.74%], valid : [loss = 2.457, top1 = 39.31%], test : [loss = 2.473, top1 = 38.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.41%], valid : [loss = 0.775, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2910/15625) 002910-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.610, top1 = 86.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.16 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.399, top1 = 90.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.29 ms.
cifar100       train : [loss = 0.514, top1 = 84.92%], valid : [loss = 1.425, top1 = 63.53%], test : [loss = 1.431, top1 = 64.21%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.31%], valid : [loss = 2.530, top1 = 36.31%], test : [loss = 2.561, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.83%], valid : [loss = 0.879, top1 = 69.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2911/15625) 002911-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.131, top1 = 95.88%], valid : [loss = 0.541, top1 = 84.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.138, top1 = 95.40%], test  : [loss = 0.381, top1 = 88.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.879, top1 = 74.62%], valid : [loss = 1.430, top1 = 61.56%], test : [loss = 1.420, top1 = 61.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.33%], valid : [loss = 2.682, top1 = 33.07%], test : [loss = 2.720, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.96%], valid : [loss = 0.979, top1 = 65.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2912/15625) 002912-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.430, top1 = 90.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.283, top1 = 93.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.176, top1 = 95.88%], valid : [loss = 1.296, top1 = 69.53%], test : [loss = 1.281, top1 = 69.53%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.09%], valid : [loss = 2.252, top1 = 42.96%], test : [loss = 2.273, top1 = 43.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.44%], valid : [loss = 0.509, top1 = 83.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2913/15625) 002913-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10-valid  train : [loss = 1.311, top1 = 52.65%], valid : [loss = 1.365, top1 = 51.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.03 ms.
cifar10        train : [loss = 1.312, top1 = 52.87%], test  : [loss = 1.323, top1 = 52.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.92 ms.
cifar100       train : [loss = 2.850, top1 = 29.08%], valid : [loss = 2.966, top1 = 27.21%], test : [loss = 2.961, top1 = 27.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.41 ms.
ImageNet16-120 train : [loss = 4.011, top1 = 10.16%], valid : [loss = 4.021, top1 = 10.77%], test : [loss = 4.040, top1 = 10.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.901, top1 = 30.11%], valid : [loss = 1.868, top1 = 30.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2914/15625) 002914-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.95%], valid : [loss = 0.689, top1 = 83.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.088, top1 = 97.16%], test  : [loss = 0.482, top1 = 86.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.06 ms.
cifar100       train : [loss = 0.826, top1 = 75.99%], valid : [loss = 1.543, top1 = 59.48%], test : [loss = 1.511, top1 = 60.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 30.42%], valid : [loss = 2.932, top1 = 28.27%], test : [loss = 2.988, top1 = 27.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.28%], valid : [loss = 0.914, top1 = 67.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2915/15625) 002915-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.491, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.31 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.317, top1 = 92.55%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.18 ms.
cifar100       train : [loss = 0.166, top1 = 96.42%], valid : [loss = 1.284, top1 = 68.85%], test : [loss = 1.299, top1 = 69.05%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.72%], valid : [loss = 2.255, top1 = 42.13%], test : [loss = 2.240, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.577, top1 = 79.82%], valid : [loss = 0.656, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2916/15625) 002916-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.592, top1 = 86.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.044, top1 = 98.66%], test  : [loss = 0.404, top1 = 89.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.565, top1 = 83.24%], valid : [loss = 1.396, top1 = 64.39%], test : [loss = 1.402, top1 = 63.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.73%], valid : [loss = 2.627, top1 = 33.87%], test : [loss = 2.669, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.47%], valid : [loss = 0.769, top1 = 73.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2917/15625) 002917-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.563, top1 = 88.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.364, top1 = 91.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.304, top1 = 91.50%], valid : [loss = 1.298, top1 = 67.39%], test : [loss = 1.336, top1 = 66.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.097, top1 = 45.33%], valid : [loss = 2.344, top1 = 40.10%], test : [loss = 2.367, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.50%], valid : [loss = 0.887, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2918/15625) 002918-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.54%], valid : [loss = 0.440, top1 = 87.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.20 ms.
cifar10        train : [loss = 0.055, top1 = 98.64%], test  : [loss = 0.311, top1 = 90.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.54 ms.
cifar100       train : [loss = 0.564, top1 = 84.45%], valid : [loss = 1.220, top1 = 66.59%], test : [loss = 1.215, top1 = 66.79%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.75%], valid : [loss = 2.453, top1 = 38.09%], test : [loss = 2.466, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.71%], valid : [loss = 0.659, top1 = 76.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2919/15625) 002919-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.559, top1 = 87.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.384, top1 = 91.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.54 ms.
cifar100       train : [loss = 0.402, top1 = 88.50%], valid : [loss = 1.387, top1 = 65.59%], test : [loss = 1.389, top1 = 65.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.77%], valid : [loss = 2.508, top1 = 36.58%], test : [loss = 2.526, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.93%], valid : [loss = 0.777, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2920/15625) 002920-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.03%], valid : [loss = 0.612, top1 = 84.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10        train : [loss = 0.088, top1 = 97.11%], test  : [loss = 0.420, top1 = 88.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.50 ms.
cifar100       train : [loss = 0.676, top1 = 80.00%], valid : [loss = 1.518, top1 = 60.48%], test : [loss = 1.517, top1 = 61.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.25 ms.
ImageNet16-120 train : [loss = 3.155, top1 = 22.91%], valid : [loss = 3.169, top1 = 23.18%], test : [loss = 3.204, top1 = 22.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.075, top1 = 60.74%], valid : [loss = 1.110, top1 = 59.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2921/15625) 002921-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.494, top1 = 89.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.314, top1 = 92.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.79 ms.
cifar100       train : [loss = 0.230, top1 = 94.45%], valid : [loss = 1.239, top1 = 69.00%], test : [loss = 1.258, top1 = 68.19%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.88 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.42%], valid : [loss = 2.284, top1 = 41.13%], test : [loss = 2.283, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.08%], valid : [loss = 0.633, top1 = 78.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2922/15625) 002922-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.32%], valid : [loss = 0.843, top1 = 72.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.559, top1 = 80.49%], test  : [loss = 0.713, top1 = 75.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.28 ms.
cifar100       train : [loss = 1.791, top1 = 52.04%], valid : [loss = 2.061, top1 = 46.56%], test : [loss = 2.057, top1 = 46.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.71%], valid : [loss = 3.637, top1 = 16.17%], test : [loss = 3.670, top1 = 15.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.80%], valid : [loss = 1.231, top1 = 56.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2923/15625) 002923-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.293, top1 = 89.66%], valid : [loss = 0.788, top1 = 76.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 0.280, top1 = 90.31%], test  : [loss = 0.555, top1 = 82.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 1.070, top1 = 69.20%], valid : [loss = 1.770, top1 = 53.90%], test : [loss = 1.791, top1 = 53.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 3.666, top1 = 14.28%], valid : [loss = 3.671, top1 = 14.44%], test : [loss = 3.663, top1 = 13.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.364, top1 = 49.63%], valid : [loss = 1.386, top1 = 49.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2924/15625) 002924-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.516, top1 = 88.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.327, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 0.330, top1 = 90.99%], valid : [loss = 1.278, top1 = 67.23%], test : [loss = 1.282, top1 = 67.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.90%], valid : [loss = 2.412, top1 = 39.02%], test : [loss = 2.418, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2925/15625) 002925-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.554, top1 = 88.37%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.85 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.387, top1 = 91.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.39 ms.
cifar100       train : [loss = 0.173, top1 = 96.19%], valid : [loss = 1.423, top1 = 66.99%], test : [loss = 1.423, top1 = 67.10%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.29%], valid : [loss = 2.414, top1 = 39.34%], test : [loss = 2.439, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.11%], valid : [loss = 0.659, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2926/15625) 002926-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.450, top1 = 89.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.305, top1 = 92.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.13 ms.
cifar100       train : [loss = 0.182, top1 = 95.82%], valid : [loss = 1.279, top1 = 69.29%], test : [loss = 1.272, top1 = 69.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.13%], valid : [loss = 2.240, top1 = 42.87%], test : [loss = 2.252, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.408, top1 = 85.98%], valid : [loss = 0.531, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2927/15625) 002927-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.542, top1 = 88.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.360, top1 = 91.71%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.09 ms.
cifar100       train : [loss = 0.201, top1 = 94.91%], valid : [loss = 1.371, top1 = 67.35%], test : [loss = 1.366, top1 = 67.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.70 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.42%], valid : [loss = 2.429, top1 = 38.68%], test : [loss = 2.419, top1 = 38.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 68.08%], valid : [loss = 0.944, top1 = 66.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2928/15625) 002928-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.516, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.335, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.330, top1 = 91.16%], valid : [loss = 1.274, top1 = 67.25%], test : [loss = 1.287, top1 = 67.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.90%], valid : [loss = 2.397, top1 = 39.01%], test : [loss = 2.417, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.16%], valid : [loss = 0.723, top1 = 75.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2929/15625) 002929-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.13 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2930/15625) 002930-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.336, top1 = 92.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.35 ms.
cifar100       train : [loss = 0.327, top1 = 91.16%], valid : [loss = 1.294, top1 = 66.97%], test : [loss = 1.280, top1 = 67.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.99%], valid : [loss = 2.407, top1 = 39.14%], test : [loss = 2.413, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.79%], valid : [loss = 0.648, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2931/15625) 002931-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.553, top1 = 89.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.356, top1 = 92.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.98 ms.
cifar100       train : [loss = 0.059, top1 = 99.29%], valid : [loss = 1.460, top1 = 68.72%], test : [loss = 1.451, top1 = 68.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.65 ms.
ImageNet16-120 train : [loss = 1.767, top1 = 52.96%], valid : [loss = 2.385, top1 = 40.41%], test : [loss = 2.409, top1 = 40.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.54%], valid : [loss = 0.690, top1 = 76.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2932/15625) 002932-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.09%], valid : [loss = 0.515, top1 = 87.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.075, top1 = 97.61%], test  : [loss = 0.363, top1 = 89.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.92 ms.
cifar100       train : [loss = 0.712, top1 = 79.02%], valid : [loss = 1.347, top1 = 64.59%], test : [loss = 1.354, top1 = 64.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.22%], valid : [loss = 2.645, top1 = 33.86%], test : [loss = 2.672, top1 = 33.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.60%], valid : [loss = 0.690, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2933/15625) 002933-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.458, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.82%], test  : [loss = 0.307, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.32 ms.
cifar100       train : [loss = 0.323, top1 = 91.25%], valid : [loss = 1.292, top1 = 67.47%], test : [loss = 1.278, top1 = 67.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.53%], valid : [loss = 2.362, top1 = 40.41%], test : [loss = 2.402, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.423, top1 = 85.41%], valid : [loss = 0.531, top1 = 82.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2934/15625) 002934-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.484, top1 = 90.40%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.318, top1 = 93.40%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.76 ms.
cifar100       train : [loss = 0.065, top1 = 99.02%], valid : [loss = 1.298, top1 = 70.42%], test : [loss = 1.314, top1 = 70.75%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.53 ms.
ImageNet16-120 train : [loss = 1.557, top1 = 57.98%], valid : [loss = 2.128, top1 = 45.49%], test : [loss = 2.151, top1 = 45.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.95%], valid : [loss = 0.579, top1 = 80.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2935/15625) 002935-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.505, top1 = 88.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.349, top1 = 91.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.480, top1 = 85.98%], valid : [loss = 1.363, top1 = 65.74%], test : [loss = 1.339, top1 = 66.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.08%], valid : [loss = 2.512, top1 = 36.80%], test : [loss = 2.553, top1 = 35.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.61%], valid : [loss = 0.697, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2936/15625) 002936-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.540, top1 = 88.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.345, top1 = 92.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.85 ms.
cifar100       train : [loss = 0.281, top1 = 92.61%], valid : [loss = 1.387, top1 = 65.31%], test : [loss = 1.380, top1 = 66.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 41.88%], valid : [loss = 2.454, top1 = 37.59%], test : [loss = 2.456, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.92%], valid : [loss = 0.854, top1 = 69.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2937/15625) 002937-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.514, top1 = 88.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.322, top1 = 92.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.82 ms.
cifar100       train : [loss = 0.329, top1 = 91.09%], valid : [loss = 1.285, top1 = 67.01%], test : [loss = 1.294, top1 = 67.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.84%], valid : [loss = 2.408, top1 = 39.19%], test : [loss = 2.418, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2938/15625) 002938-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=23.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.475, top1 = 89.26%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.19 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.299, top1 = 92.49%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.84 ms.
cifar100       train : [loss = 0.187, top1 = 95.87%], valid : [loss = 1.202, top1 = 69.66%], test : [loss = 1.207, top1 = 70.05%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.01 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.57%], valid : [loss = 2.176, top1 = 43.83%], test : [loss = 2.183, top1 = 44.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.50%], valid : [loss = 0.640, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2939/15625) 002939-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.86 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.478, top1 = 89.13%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.09 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.310, top1 = 92.33%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.13 ms.
cifar100       train : [loss = 0.257, top1 = 93.52%], valid : [loss = 1.222, top1 = 68.77%], test : [loss = 1.226, top1 = 68.92%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.55 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.10%], valid : [loss = 2.210, top1 = 42.98%], test : [loss = 2.229, top1 = 43.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.44%], valid : [loss = 0.634, top1 = 78.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2940/15625) 002940-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.584, top1 = 87.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.385, top1 = 91.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.90 ms.
cifar100       train : [loss = 0.412, top1 = 88.16%], valid : [loss = 1.417, top1 = 64.91%], test : [loss = 1.401, top1 = 65.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.34%], valid : [loss = 2.477, top1 = 37.49%], test : [loss = 2.518, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.96%], valid : [loss = 0.856, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2941/15625) 002941-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.560, top1 = 89.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.366, top1 = 92.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.83 ms.
cifar100       train : [loss = 0.115, top1 = 97.54%], valid : [loss = 1.389, top1 = 68.70%], test : [loss = 1.380, top1 = 69.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.19%], valid : [loss = 2.329, top1 = 40.92%], test : [loss = 2.323, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.92%], valid : [loss = 0.787, top1 = 72.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2942/15625) 002942-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.59%], valid : [loss = 0.850, top1 = 71.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10        train : [loss = 0.556, top1 = 80.65%], test  : [loss = 0.717, top1 = 75.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.51 ms.
cifar100       train : [loss = 1.779, top1 = 52.07%], valid : [loss = 2.050, top1 = 46.97%], test : [loss = 2.060, top1 = 46.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.88%], valid : [loss = 3.641, top1 = 15.88%], test : [loss = 3.663, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2943/15625) 002943-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.527, top1 = 89.52%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.333, top1 = 93.05%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.36 ms.
cifar100       train : [loss = 0.071, top1 = 98.94%], valid : [loss = 1.332, top1 = 69.32%], test : [loss = 1.361, top1 = 69.43%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.26%], valid : [loss = 2.366, top1 = 39.74%], test : [loss = 2.383, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2944/15625) 002944-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.481, top1 = 89.50%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.295, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.13 ms.
cifar100       train : [loss = 0.256, top1 = 93.34%], valid : [loss = 1.218, top1 = 69.11%], test : [loss = 1.224, top1 = 69.19%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.27%], valid : [loss = 2.216, top1 = 42.66%], test : [loss = 2.226, top1 = 42.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.71%], valid : [loss = 0.611, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2945/15625) 002945-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.562, top1 = 87.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.385, top1 = 91.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.33 ms.
cifar100       train : [loss = 0.401, top1 = 88.60%], valid : [loss = 1.412, top1 = 65.00%], test : [loss = 1.387, top1 = 65.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.09%], valid : [loss = 2.502, top1 = 37.19%], test : [loss = 2.508, top1 = 37.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2946/15625) 002946-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.528, top1 = 88.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.027, top1 = 99.26%], test  : [loss = 0.352, top1 = 91.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.09 ms.
cifar100       train : [loss = 0.478, top1 = 86.00%], valid : [loss = 1.351, top1 = 65.26%], test : [loss = 1.340, top1 = 65.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.24%], valid : [loss = 2.521, top1 = 36.17%], test : [loss = 2.547, top1 = 35.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.93%], valid : [loss = 0.709, top1 = 75.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2947/15625) 002947-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.559, top1 = 88.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.375, top1 = 92.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.18 ms.
cifar100       train : [loss = 0.108, top1 = 97.92%], valid : [loss = 1.479, top1 = 67.53%], test : [loss = 1.474, top1 = 67.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.81%], valid : [loss = 2.430, top1 = 39.42%], test : [loss = 2.428, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.70%], valid : [loss = 0.698, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2948/15625) 002948-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.02%], valid : [loss = 0.694, top1 = 84.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.085, top1 = 97.24%], test  : [loss = 0.475, top1 = 87.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.99 ms.
cifar100       train : [loss = 0.797, top1 = 76.66%], valid : [loss = 1.533, top1 = 60.50%], test : [loss = 1.507, top1 = 60.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.800, top1 = 30.60%], valid : [loss = 2.926, top1 = 28.33%], test : [loss = 2.978, top1 = 27.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2949/15625) 002949-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.37%], valid : [loss = 0.533, top1 = 87.51%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.29 ms.
cifar10        train : [loss = 0.042, top1 = 98.67%], test  : [loss = 0.360, top1 = 90.66%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.50 ms.
cifar100       train : [loss = 0.502, top1 = 85.18%], valid : [loss = 1.294, top1 = 65.72%], test : [loss = 1.297, top1 = 66.03%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.75%], valid : [loss = 2.397, top1 = 39.09%], test : [loss = 2.419, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.24%], valid : [loss = 0.755, top1 = 73.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2950/15625) 002950-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.90%], valid : [loss = 0.504, top1 = 85.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10        train : [loss = 0.181, top1 = 93.93%], test  : [loss = 0.377, top1 = 88.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.61 ms.
cifar100       train : [loss = 1.009, top1 = 70.98%], valid : [loss = 1.379, top1 = 62.30%], test : [loss = 1.369, top1 = 62.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.663, top1 = 33.38%], valid : [loss = 2.704, top1 = 32.90%], test : [loss = 2.759, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.64%], valid : [loss = 1.003, top1 = 64.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2951/15625) 002951-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.472, top1 = 89.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.320, top1 = 92.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.21 ms.
cifar100       train : [loss = 0.198, top1 = 95.07%], valid : [loss = 1.377, top1 = 68.00%], test : [loss = 1.391, top1 = 67.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 49.00%], valid : [loss = 2.340, top1 = 39.90%], test : [loss = 2.397, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.457, top1 = 84.11%], valid : [loss = 0.566, top1 = 80.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2952/15625) 002952-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.404, top1 = 90.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.289, top1 = 93.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.70 ms.
cifar100       train : [loss = 0.190, top1 = 95.40%], valid : [loss = 1.254, top1 = 69.80%], test : [loss = 1.285, top1 = 69.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.51%], valid : [loss = 2.241, top1 = 43.27%], test : [loss = 2.259, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2953/15625) 002953-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.536, top1 = 89.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.342, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.08 ms.
cifar100       train : [loss = 0.223, top1 = 94.17%], valid : [loss = 1.287, top1 = 68.36%], test : [loss = 1.314, top1 = 68.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.90 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.68%], valid : [loss = 2.290, top1 = 41.66%], test : [loss = 2.293, top1 = 41.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.06%], valid : [loss = 0.809, top1 = 71.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2954/15625) 002954-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=22.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.502, top1 = 89.90%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=20.77 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.312, top1 = 93.45%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=22.06 ms.
cifar100       train : [loss = 0.038, top1 = 99.65%], valid : [loss = 1.330, top1 = 70.70%], test : [loss = 1.363, top1 = 70.70%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=20.10 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.31%], valid : [loss = 2.272, top1 = 42.03%], test : [loss = 2.255, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.47%], valid : [loss = 0.827, top1 = 70.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2955/15625) 002955-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.44%], valid : [loss = 0.578, top1 = 87.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.02 ms.
cifar10        train : [loss = 0.034, top1 = 98.95%], test  : [loss = 0.354, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.37 ms.
cifar100       train : [loss = 0.608, top1 = 82.43%], valid : [loss = 1.424, top1 = 63.20%], test : [loss = 1.413, top1 = 62.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.717, top1 = 31.28%], valid : [loss = 2.771, top1 = 30.07%], test : [loss = 2.766, top1 = 30.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 0.963, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2956/15625) 002956-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.79%], valid : [loss = 0.474, top1 = 85.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10        train : [loss = 0.164, top1 = 94.63%], test  : [loss = 0.347, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.12 ms.
cifar100       train : [loss = 0.982, top1 = 72.28%], valid : [loss = 1.351, top1 = 62.64%], test : [loss = 1.363, top1 = 61.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.39%], valid : [loss = 2.667, top1 = 33.22%], test : [loss = 2.702, top1 = 31.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.25%], valid : [loss = 0.915, top1 = 67.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2957/15625) 002957-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.453, top1 = 89.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.277, top1 = 92.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.195, top1 = 95.59%], valid : [loss = 1.248, top1 = 69.38%], test : [loss = 1.240, top1 = 69.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.73 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 51.08%], valid : [loss = 2.283, top1 = 41.87%], test : [loss = 2.283, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.40%], valid : [loss = 0.517, top1 = 82.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2958/15625) 002958-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.79%], valid : [loss = 0.499, top1 = 83.98%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=14.02 ms.
cifar10        train : [loss = 0.269, top1 = 90.94%], test  : [loss = 0.374, top1 = 87.47%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=13.46 ms.
cifar100       train : [loss = 1.286, top1 = 63.98%], valid : [loss = 1.490, top1 = 58.54%], test : [loss = 1.472, top1 = 58.39%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.820, top1 = 30.55%], valid : [loss = 2.821, top1 = 30.28%], test : [loss = 2.858, top1 = 29.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.067, top1 = 62.19%], valid : [loss = 1.095, top1 = 61.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2959/15625) 002959-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.452, top1 = 89.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.14 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.316, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.96 ms.
cifar100       train : [loss = 0.315, top1 = 91.61%], valid : [loss = 1.311, top1 = 66.96%], test : [loss = 1.301, top1 = 67.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.24%], valid : [loss = 2.374, top1 = 39.57%], test : [loss = 2.408, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.553, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2960/15625) 002960-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.81%], valid : [loss = 0.528, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.40 ms.
cifar10        train : [loss = 0.170, top1 = 94.36%], test  : [loss = 0.378, top1 = 87.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.82 ms.
cifar100       train : [loss = 1.015, top1 = 70.84%], valid : [loss = 1.375, top1 = 61.91%], test : [loss = 1.378, top1 = 61.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.54%], valid : [loss = 2.683, top1 = 33.45%], test : [loss = 2.758, top1 = 32.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.69%], valid : [loss = 0.993, top1 = 64.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2961/15625) 002961-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.622, top1 = 86.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.74 ms.
cifar10        train : [loss = 0.029, top1 = 99.29%], test  : [loss = 0.453, top1 = 89.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.20 ms.
cifar100       train : [loss = 0.385, top1 = 89.66%], valid : [loss = 1.447, top1 = 64.58%], test : [loss = 1.466, top1 = 63.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.42%], valid : [loss = 2.618, top1 = 35.10%], test : [loss = 2.659, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.42%], valid : [loss = 0.769, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2962/15625) 002962-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.05 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.99%], valid : [loss = 0.421, top1 = 90.07%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.293, top1 = 92.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.78 ms.
cifar100       train : [loss = 0.153, top1 = 96.93%], valid : [loss = 1.220, top1 = 71.02%], test : [loss = 1.271, top1 = 70.36%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 1.790, top1 = 52.46%], valid : [loss = 2.212, top1 = 43.37%], test : [loss = 2.265, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.425, top1 = 85.44%], valid : [loss = 0.537, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2963/15625) 002963-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.496, top1 = 89.30%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.68 ms.
cifar10        train : [loss = 0.010, top1 = 99.86%], test  : [loss = 0.304, top1 = 92.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.61 ms.
cifar100       train : [loss = 0.264, top1 = 93.35%], valid : [loss = 1.264, top1 = 68.60%], test : [loss = 1.249, top1 = 68.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.82%], valid : [loss = 2.210, top1 = 42.13%], test : [loss = 2.240, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.94%], valid : [loss = 0.584, top1 = 80.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2964/15625) 002964-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.310, top1 = 89.16%], valid : [loss = 0.600, top1 = 80.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.99 ms.
cifar10        train : [loss = 0.249, top1 = 91.47%], test  : [loss = 0.402, top1 = 87.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 1.413, top1 = 60.31%], valid : [loss = 1.662, top1 = 54.96%], test : [loss = 1.662, top1 = 54.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.836, top1 = 29.94%], valid : [loss = 2.877, top1 = 29.37%], test : [loss = 2.900, top1 = 29.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.62%], valid : [loss = 1.014, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2965/15625) 002965-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.544, top1 = 88.58%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.09 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.322, top1 = 92.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.99 ms.
cifar100       train : [loss = 0.284, top1 = 92.41%], valid : [loss = 1.279, top1 = 67.52%], test : [loss = 1.317, top1 = 67.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.66 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 47.36%], valid : [loss = 2.345, top1 = 39.90%], test : [loss = 2.355, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.44%], valid : [loss = 0.810, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2966/15625) 002966-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.474, top1 = 90.32%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.13 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.334, top1 = 93.10%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.40 ms.
cifar100       train : [loss = 0.129, top1 = 97.35%], valid : [loss = 1.304, top1 = 69.06%], test : [loss = 1.306, top1 = 69.44%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.44%], valid : [loss = 2.193, top1 = 44.00%], test : [loss = 2.198, top1 = 43.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.30%], valid : [loss = 0.616, top1 = 78.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2967/15625) 002967-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.426, top1 = 90.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.006, top1 = 99.94%], test  : [loss = 0.285, top1 = 93.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.114, top1 = 97.90%], valid : [loss = 1.292, top1 = 69.62%], test : [loss = 1.287, top1 = 69.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.84%], valid : [loss = 2.215, top1 = 44.12%], test : [loss = 2.239, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 85.86%], valid : [loss = 0.516, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2968/15625) 002968-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.65%], valid : [loss = 0.594, top1 = 86.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.69 ms.
cifar10        train : [loss = 0.043, top1 = 98.63%], test  : [loss = 0.411, top1 = 89.73%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.61 ms.
cifar100       train : [loss = 0.536, top1 = 84.17%], valid : [loss = 1.438, top1 = 63.20%], test : [loss = 1.433, top1 = 64.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.481, top1 = 37.14%], valid : [loss = 2.625, top1 = 34.67%], test : [loss = 2.672, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.39%], valid : [loss = 0.862, top1 = 70.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2969/15625) 002969-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.541, top1 = 88.75%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.22 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.362, top1 = 92.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.70 ms.
cifar100       train : [loss = 0.119, top1 = 97.44%], valid : [loss = 1.423, top1 = 67.28%], test : [loss = 1.421, top1 = 68.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 33.86%], valid : [loss = 2.719, top1 = 31.13%], test : [loss = 2.733, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 66.70%], valid : [loss = 0.950, top1 = 65.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2970/15625) 002970-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.45%], valid : [loss = 0.942, top1 = 75.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10        train : [loss = 0.230, top1 = 92.04%], test  : [loss = 0.606, top1 = 81.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.50 ms.
cifar100       train : [loss = 1.175, top1 = 66.66%], valid : [loss = 1.744, top1 = 54.40%], test : [loss = 1.743, top1 = 54.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 3.231, top1 = 22.67%], valid : [loss = 3.323, top1 = 21.63%], test : [loss = 3.372, top1 = 20.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.06%], valid : [loss = 1.079, top1 = 61.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2971/15625) 002971-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.17 ms.
cifar100       train : [loss = 0.324, top1 = 91.17%], valid : [loss = 1.303, top1 = 67.05%], test : [loss = 1.322, top1 = 67.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.31%], valid : [loss = 2.366, top1 = 39.76%], test : [loss = 2.418, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 84.91%], valid : [loss = 0.547, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2972/15625) 002972-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.24%], valid : [loss = 0.604, top1 = 85.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.069, top1 = 97.86%], test  : [loss = 0.414, top1 = 88.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.08 ms.
cifar100       train : [loss = 0.732, top1 = 78.57%], valid : [loss = 1.406, top1 = 62.28%], test : [loss = 1.392, top1 = 63.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.03%], valid : [loss = 2.648, top1 = 34.43%], test : [loss = 2.697, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2973/15625) 002973-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.84%], valid : [loss = 0.602, top1 = 86.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.61 ms.
cifar10        train : [loss = 0.029, top1 = 99.24%], test  : [loss = 0.430, top1 = 89.63%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.79 ms.
cifar100       train : [loss = 0.351, top1 = 90.74%], valid : [loss = 1.388, top1 = 65.48%], test : [loss = 1.371, top1 = 65.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.23%], valid : [loss = 2.558, top1 = 37.30%], test : [loss = 2.551, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.13%], valid : [loss = 0.747, top1 = 74.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2974/15625) 002974-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.46 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.474, top1 = 89.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.339, top1 = 91.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.37 ms.
cifar100       train : [loss = 0.362, top1 = 89.85%], valid : [loss = 1.301, top1 = 67.08%], test : [loss = 1.309, top1 = 67.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.89%], valid : [loss = 2.395, top1 = 39.22%], test : [loss = 2.435, top1 = 38.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.84%], valid : [loss = 0.640, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2975/15625) 002975-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.540, top1 = 88.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.81 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.348, top1 = 91.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.58 ms.
cifar100       train : [loss = 0.307, top1 = 91.36%], valid : [loss = 1.349, top1 = 66.62%], test : [loss = 1.329, top1 = 66.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.58%], valid : [loss = 2.493, top1 = 36.30%], test : [loss = 2.499, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.958, top1 = 66.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2976/15625) 002976-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.711, top1 = 85.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.426, top1 = 89.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.54 ms.
cifar100       train : [loss = 0.380, top1 = 89.49%], valid : [loss = 1.632, top1 = 62.04%], test : [loss = 1.655, top1 = 60.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.272, top1 = 41.66%], valid : [loss = 2.595, top1 = 35.07%], test : [loss = 2.598, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.63%], valid : [loss = 0.866, top1 = 69.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2977/15625) 002977-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.11%], valid : [loss = 0.548, top1 = 86.98%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.69 ms.
cifar10        train : [loss = 0.059, top1 = 98.15%], test  : [loss = 0.361, top1 = 89.77%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=21.24 ms.
cifar100       train : [loss = 0.651, top1 = 80.80%], valid : [loss = 1.316, top1 = 65.34%], test : [loss = 1.350, top1 = 64.16%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.48%], valid : [loss = 2.491, top1 = 37.20%], test : [loss = 2.513, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.49%], valid : [loss = 0.866, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2978/15625) 002978-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.34 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.546, top1 = 89.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.349, top1 = 93.27%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.58 ms.
cifar100       train : [loss = 0.027, top1 = 99.78%], valid : [loss = 1.350, top1 = 71.00%], test : [loss = 1.348, top1 = 71.22%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.70 ms.
ImageNet16-120 train : [loss = 1.464, top1 = 60.36%], valid : [loss = 2.359, top1 = 41.20%], test : [loss = 2.361, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.52%], valid : [loss = 0.642, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2979/15625) 002979-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.171, top1 = 94.24%], valid : [loss = 0.544, top1 = 84.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 0.170, top1 = 94.35%], test  : [loss = 0.378, top1 = 88.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.60 ms.
cifar100       train : [loss = 1.167, top1 = 66.90%], valid : [loss = 1.520, top1 = 59.44%], test : [loss = 1.509, top1 = 58.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 34.96%], valid : [loss = 2.647, top1 = 33.80%], test : [loss = 2.697, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 66.14%], valid : [loss = 0.996, top1 = 64.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2980/15625) 002980-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.506, top1 = 88.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.324, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.14 ms.
cifar100       train : [loss = 0.348, top1 = 90.57%], valid : [loss = 1.276, top1 = 67.06%], test : [loss = 1.284, top1 = 66.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.27%], valid : [loss = 2.414, top1 = 38.13%], test : [loss = 2.444, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.70%], valid : [loss = 0.626, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2981/15625) 002981-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.566, top1 = 88.40%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.356, top1 = 92.44%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.10 ms.
cifar100       train : [loss = 0.115, top1 = 97.87%], valid : [loss = 1.474, top1 = 67.08%], test : [loss = 1.456, top1 = 67.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.98%], valid : [loss = 2.434, top1 = 40.03%], test : [loss = 2.424, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.35%], valid : [loss = 0.727, top1 = 74.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2982/15625) 002982-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.490, top1 = 90.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.308, top1 = 93.38%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.13 ms.
cifar100       train : [loss = 0.062, top1 = 99.17%], valid : [loss = 1.285, top1 = 71.46%], test : [loss = 1.325, top1 = 70.36%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.33 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.15%], valid : [loss = 2.170, top1 = 44.07%], test : [loss = 2.184, top1 = 44.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.14%], valid : [loss = 0.640, top1 = 77.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2983/15625) 002983-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.92 ms.
cifar10-valid  train : [loss = 1.834, top1 = 33.72%], valid : [loss = 1.856, top1 = 32.80%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10        train : [loss = 1.218, top1 = 56.21%], test  : [loss = 1.219, top1 = 55.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.40 ms.
cifar100       train : [loss = 3.820, top1 = 11.56%], valid : [loss = 3.914, top1 = 10.12%], test : [loss = 3.913, top1 = 10.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.69 ms.
ImageNet16-120 train : [loss = 3.861, top1 = 12.32%], valid : [loss = 3.825, top1 = 12.77%], test : [loss = 3.851, top1 = 12.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.965, top1 = 27.36%], valid : [loss = 1.966, top1 = 27.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2984/15625) 002984-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.38%], valid : [loss = 0.718, top1 = 84.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.051, top1 = 98.44%], test  : [loss = 0.453, top1 = 88.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 0.637, top1 = 81.27%], valid : [loss = 1.500, top1 = 62.88%], test : [loss = 1.483, top1 = 61.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 33.05%], valid : [loss = 2.824, top1 = 30.83%], test : [loss = 2.842, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.61%], valid : [loss = 0.887, top1 = 68.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2985/15625) 002985-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.279, top1 = 90.61%], valid : [loss = 0.477, top1 = 84.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.297, top1 = 89.99%], test  : [loss = 0.396, top1 = 86.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 1.331, top1 = 63.27%], valid : [loss = 1.550, top1 = 57.66%], test : [loss = 1.503, top1 = 58.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.79%], valid : [loss = 2.895, top1 = 29.90%], test : [loss = 2.969, top1 = 27.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2986/15625) 002986-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.527, top1 = 88.97%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.328, top1 = 92.70%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.82 ms.
cifar100       train : [loss = 0.160, top1 = 96.58%], valid : [loss = 1.309, top1 = 68.24%], test : [loss = 1.310, top1 = 69.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 48.92%], valid : [loss = 2.338, top1 = 40.47%], test : [loss = 2.297, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.45%], valid : [loss = 0.729, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2987/15625) 002987-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.54%], valid : [loss = 0.623, top1 = 86.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.84 ms.
cifar10        train : [loss = 0.034, top1 = 99.07%], test  : [loss = 0.374, top1 = 90.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.07 ms.
cifar100       train : [loss = 0.545, top1 = 84.09%], valid : [loss = 1.391, top1 = 64.48%], test : [loss = 1.436, top1 = 63.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.96%], valid : [loss = 2.556, top1 = 35.47%], test : [loss = 2.602, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.48%], valid : [loss = 0.854, top1 = 69.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2988/15625) 002988-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.76%], valid : [loss = 0.532, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.027, top1 = 99.24%], test  : [loss = 0.373, top1 = 90.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.89 ms.
cifar100       train : [loss = 0.453, top1 = 86.71%], valid : [loss = 1.380, top1 = 65.40%], test : [loss = 1.356, top1 = 65.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.99%], valid : [loss = 2.486, top1 = 36.40%], test : [loss = 2.544, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.00%], valid : [loss = 0.730, top1 = 74.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2989/15625) 002989-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.128, top1 = 95.78%], valid : [loss = 0.701, top1 = 81.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.62 ms.
cifar10        train : [loss = 0.137, top1 = 95.44%], test  : [loss = 0.469, top1 = 86.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.905, top1 = 73.60%], valid : [loss = 1.696, top1 = 56.34%], test : [loss = 1.693, top1 = 55.88%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 3.069, top1 = 24.77%], valid : [loss = 3.133, top1 = 24.30%], test : [loss = 3.178, top1 = 23.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.147, top1 = 57.84%], valid : [loss = 1.179, top1 = 57.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2990/15625) 002990-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.74 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.83%], valid : [loss = 0.527, top1 = 87.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10        train : [loss = 0.074, top1 = 97.62%], test  : [loss = 0.365, top1 = 89.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.30 ms.
cifar100       train : [loss = 0.723, top1 = 78.71%], valid : [loss = 1.348, top1 = 64.36%], test : [loss = 1.345, top1 = 64.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.02%], valid : [loss = 2.615, top1 = 34.40%], test : [loss = 2.694, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2991/15625) 002991-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.33%], valid : [loss = 0.535, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.038, top1 = 98.81%], test  : [loss = 0.342, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.97 ms.
cifar100       train : [loss = 0.485, top1 = 85.71%], valid : [loss = 1.262, top1 = 66.62%], test : [loss = 1.295, top1 = 66.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.247, top1 = 42.09%], valid : [loss = 2.380, top1 = 39.03%], test : [loss = 2.411, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.957, top1 = 65.72%], valid : [loss = 0.989, top1 = 64.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2992/15625) 002992-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.22%], valid : [loss = 0.474, top1 = 85.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.351, top1 = 88.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 0.985, top1 = 71.99%], valid : [loss = 1.350, top1 = 62.56%], test : [loss = 1.338, top1 = 62.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.68%], valid : [loss = 2.689, top1 = 32.57%], test : [loss = 2.710, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2993/15625) 002993-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.36%], valid : [loss = 0.751, top1 = 82.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.03 ms.
cifar10        train : [loss = 0.094, top1 = 96.92%], test  : [loss = 0.458, top1 = 87.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.18 ms.
cifar100       train : [loss = 0.794, top1 = 76.80%], valid : [loss = 1.605, top1 = 58.54%], test : [loss = 1.593, top1 = 58.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.731, top1 = 32.13%], valid : [loss = 2.872, top1 = 29.07%], test : [loss = 2.895, top1 = 29.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.70%], valid : [loss = 0.957, top1 = 66.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2994/15625) 002994-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.483, top1 = 89.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.324, top1 = 92.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.23 ms.
cifar100       train : [loss = 0.173, top1 = 96.14%], valid : [loss = 1.270, top1 = 69.10%], test : [loss = 1.276, top1 = 68.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.72 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.48%], valid : [loss = 2.232, top1 = 43.00%], test : [loss = 2.243, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.33%], valid : [loss = 0.612, top1 = 79.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2995/15625) 002995-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.207, top1 = 93.08%], valid : [loss = 0.541, top1 = 83.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.35 ms.
cifar10        train : [loss = 0.205, top1 = 93.10%], test  : [loss = 0.401, top1 = 87.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 1.211, top1 = 65.50%], valid : [loss = 1.541, top1 = 57.78%], test : [loss = 1.532, top1 = 57.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.45 ms.
ImageNet16-120 train : [loss = 2.700, top1 = 32.58%], valid : [loss = 2.741, top1 = 31.03%], test : [loss = 2.782, top1 = 31.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2996/15625) 002996-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.529, top1 = 89.13%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.68 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.361, top1 = 92.39%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.80 ms.
cifar100       train : [loss = 0.109, top1 = 97.76%], valid : [loss = 1.338, top1 = 68.84%], test : [loss = 1.361, top1 = 68.88%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.70%], valid : [loss = 2.347, top1 = 40.50%], test : [loss = 2.326, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.72%], valid : [loss = 0.885, top1 = 68.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2997/15625) 002997-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.478, top1 = 89.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 0.324, top1 = 91.23%], valid : [loss = 1.259, top1 = 67.39%], test : [loss = 1.271, top1 = 67.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.56%], valid : [loss = 2.316, top1 = 41.12%], test : [loss = 2.336, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2998/15625) 002998-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.58%], valid : [loss = 0.688, top1 = 83.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.076, top1 = 97.55%], test  : [loss = 0.411, top1 = 88.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.58 ms.
cifar100       train : [loss = 0.777, top1 = 77.25%], valid : [loss = 1.451, top1 = 61.52%], test : [loss = 1.446, top1 = 61.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 35.15%], valid : [loss = 2.714, top1 = 32.58%], test : [loss = 2.727, top1 = 32.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.46%], valid : [loss = 0.854, top1 = 69.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 2999/15625) 002999-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.571, top1 = 87.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.382, top1 = 91.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.97 ms.
cifar100       train : [loss = 0.397, top1 = 88.78%], valid : [loss = 1.386, top1 = 65.37%], test : [loss = 1.384, top1 = 65.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.31%], valid : [loss = 2.478, top1 = 37.67%], test : [loss = 2.509, top1 = 37.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.37%], valid : [loss = 0.759, top1 = 73.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3000/15625) 003000-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.08%], valid : [loss = 0.690, top1 = 81.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10        train : [loss = 0.154, top1 = 94.78%], test  : [loss = 0.473, top1 = 86.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.99 ms.
cifar100       train : [loss = 0.945, top1 = 72.40%], valid : [loss = 1.608, top1 = 57.12%], test : [loss = 1.596, top1 = 57.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.055, top1 = 25.37%], valid : [loss = 3.125, top1 = 24.77%], test : [loss = 3.167, top1 = 23.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3001/15625) 003001-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.486, top1 = 89.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.323, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.15 ms.
cifar100       train : [loss = 0.216, top1 = 94.62%], valid : [loss = 1.341, top1 = 67.82%], test : [loss = 1.357, top1 = 67.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.74%], valid : [loss = 2.323, top1 = 40.53%], test : [loss = 2.388, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.58%], valid : [loss = 0.626, top1 = 78.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3002/15625) 003002-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.563, top1 = 87.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.48 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.407, top1 = 90.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.364, top1 = 89.93%], valid : [loss = 1.441, top1 = 64.56%], test : [loss = 1.437, top1 = 64.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.84%], valid : [loss = 2.500, top1 = 37.77%], test : [loss = 2.514, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.23%], valid : [loss = 0.849, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3003/15625) 003003-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.556, top1 = 88.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.365, top1 = 91.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.00 ms.
cifar100       train : [loss = 0.252, top1 = 93.41%], valid : [loss = 1.290, top1 = 68.52%], test : [loss = 1.281, top1 = 67.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.23%], valid : [loss = 2.413, top1 = 38.87%], test : [loss = 2.415, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.22%], valid : [loss = 0.816, top1 = 71.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3004/15625) 003004-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.24 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.83%], valid : [loss = 0.522, top1 = 87.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10        train : [loss = 0.074, top1 = 97.60%], test  : [loss = 0.358, top1 = 90.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 0.707, top1 = 79.22%], valid : [loss = 1.346, top1 = 63.84%], test : [loss = 1.346, top1 = 64.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.25%], valid : [loss = 2.632, top1 = 33.90%], test : [loss = 2.674, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.04%], valid : [loss = 0.668, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3005/15625) 003005-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.484, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.287, top1 = 92.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.40 ms.
cifar100       train : [loss = 0.223, top1 = 94.72%], valid : [loss = 1.254, top1 = 68.34%], test : [loss = 1.270, top1 = 68.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.09%], valid : [loss = 2.250, top1 = 41.93%], test : [loss = 2.274, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.86%], valid : [loss = 0.624, top1 = 78.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3006/15625) 003006-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.62 ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.84%], valid : [loss = 0.655, top1 = 77.90%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.14 ms.
cifar10        train : [loss = 0.512, top1 = 82.28%], test  : [loss = 0.590, top1 = 80.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.89 ms.
cifar100       train : [loss = 1.694, top1 = 54.02%], valid : [loss = 1.853, top1 = 50.76%], test : [loss = 1.864, top1 = 51.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.95 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.19%], valid : [loss = 3.320, top1 = 21.74%], test : [loss = 3.348, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3007/15625) 003007-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.60 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.542, top1 = 88.56%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.27 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.368, top1 = 91.53%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.49 ms.
cifar100       train : [loss = 0.279, top1 = 92.54%], valid : [loss = 1.294, top1 = 66.98%], test : [loss = 1.292, top1 = 67.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.64%], valid : [loss = 2.295, top1 = 41.97%], test : [loss = 2.261, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.56%], valid : [loss = 0.797, top1 = 72.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3008/15625) 003008-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.559, top1 = 88.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.368, top1 = 91.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.332, top1 = 90.83%], valid : [loss = 1.273, top1 = 67.54%], test : [loss = 1.271, top1 = 67.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.26%], valid : [loss = 2.352, top1 = 40.03%], test : [loss = 2.405, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.93%], valid : [loss = 0.765, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3009/15625) 003009-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.513, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.345, top1 = 91.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.89 ms.
cifar100       train : [loss = 0.205, top1 = 94.62%], valid : [loss = 1.343, top1 = 67.90%], test : [loss = 1.374, top1 = 68.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.01%], valid : [loss = 2.397, top1 = 39.63%], test : [loss = 2.395, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.12%], valid : [loss = 0.910, top1 = 67.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3010/15625) 003010-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.523, top1 = 88.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.320, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.350, top1 = 90.54%], valid : [loss = 1.290, top1 = 66.78%], test : [loss = 1.305, top1 = 66.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.53%], valid : [loss = 2.409, top1 = 38.73%], test : [loss = 2.399, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3011/15625) 003011-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.520, top1 = 88.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.342, top1 = 91.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.32 ms.
cifar100       train : [loss = 0.362, top1 = 90.04%], valid : [loss = 1.247, top1 = 67.82%], test : [loss = 1.307, top1 = 66.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.80%], valid : [loss = 2.416, top1 = 38.90%], test : [loss = 2.417, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.12%], valid : [loss = 0.713, top1 = 75.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3012/15625) 003012-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.25 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.06%], valid : [loss = 0.864, top1 = 71.61%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10        train : [loss = 0.557, top1 = 80.61%], test  : [loss = 0.722, top1 = 75.86%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.58 ms.
cifar100       train : [loss = 1.762, top1 = 52.46%], valid : [loss = 2.036, top1 = 47.62%], test : [loss = 2.037, top1 = 47.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.17 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.75%], valid : [loss = 3.638, top1 = 16.93%], test : [loss = 3.688, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3013/15625) 003013-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.529, top1 = 88.58%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=16.73 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.313, top1 = 92.30%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.61 ms.
cifar100       train : [loss = 0.186, top1 = 95.64%], valid : [loss = 1.269, top1 = 68.10%], test : [loss = 1.267, top1 = 69.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.73%], valid : [loss = 2.194, top1 = 43.27%], test : [loss = 2.212, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.45%], valid : [loss = 0.634, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3014/15625) 003014-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.489, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.306, top1 = 92.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.39 ms.
cifar100       train : [loss = 0.312, top1 = 91.67%], valid : [loss = 1.236, top1 = 68.12%], test : [loss = 1.272, top1 = 67.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.75%], valid : [loss = 2.305, top1 = 41.03%], test : [loss = 2.345, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.70%], valid : [loss = 0.606, top1 = 79.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3015/15625) 003015-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.513, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.327, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.344, top1 = 90.58%], valid : [loss = 1.279, top1 = 67.58%], test : [loss = 1.273, top1 = 67.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.70%], valid : [loss = 2.418, top1 = 39.12%], test : [loss = 2.424, top1 = 38.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3016/15625) 003016-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.28%], valid : [loss = 0.452, top1 = 87.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.42 ms.
cifar10        train : [loss = 0.111, top1 = 96.59%], test  : [loss = 0.334, top1 = 89.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 0.858, top1 = 75.63%], valid : [loss = 1.305, top1 = 64.03%], test : [loss = 1.278, top1 = 64.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.80%], valid : [loss = 2.610, top1 = 34.80%], test : [loss = 2.639, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.09%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3017/15625) 003017-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.580, top1 = 87.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.389, top1 = 91.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.47 ms.
cifar100       train : [loss = 0.394, top1 = 88.87%], valid : [loss = 1.384, top1 = 65.61%], test : [loss = 1.379, top1 = 65.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.96%], valid : [loss = 2.522, top1 = 36.82%], test : [loss = 2.528, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3018/15625) 003018-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.07%], valid : [loss = 0.828, top1 = 73.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.75 ms.
cifar10        train : [loss = 0.545, top1 = 80.98%], test  : [loss = 0.705, top1 = 76.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.84 ms.
cifar100       train : [loss = 1.760, top1 = 52.51%], valid : [loss = 2.044, top1 = 47.46%], test : [loss = 2.062, top1 = 46.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.83 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.75%], valid : [loss = 3.623, top1 = 16.53%], test : [loss = 3.672, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3019/15625) 003019-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.457, top1 = 89.51%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.21 ms.
cifar10        train : [loss = 0.007, top1 = 99.92%], test  : [loss = 0.305, top1 = 92.47%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.98 ms.
cifar100       train : [loss = 0.138, top1 = 97.05%], valid : [loss = 1.305, top1 = 69.50%], test : [loss = 1.296, top1 = 69.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.50%], valid : [loss = 2.225, top1 = 43.90%], test : [loss = 2.297, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.64%], valid : [loss = 0.535, top1 = 82.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3020/15625) 003020-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.412, top1 = 85.64%], valid : [loss = 0.765, top1 = 76.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.37 ms.
cifar10        train : [loss = 0.386, top1 = 86.64%], test  : [loss = 0.622, top1 = 79.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 1.249, top1 = 64.45%], valid : [loss = 1.887, top1 = 51.26%], test : [loss = 1.879, top1 = 50.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 3.675, top1 = 14.14%], valid : [loss = 3.676, top1 = 14.37%], test : [loss = 3.660, top1 = 13.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.28%], valid : [loss = 1.386, top1 = 49.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3021/15625) 003021-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.71%], valid : [loss = 0.577, top1 = 85.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.370, top1 = 89.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.64 ms.
cifar100       train : [loss = 0.637, top1 = 81.61%], valid : [loss = 1.369, top1 = 64.17%], test : [loss = 1.370, top1 = 63.97%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.95%], valid : [loss = 2.554, top1 = 35.85%], test : [loss = 2.566, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.50%], valid : [loss = 0.867, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3022/15625) 003022-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.11%], valid : [loss = 0.473, top1 = 84.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.297, top1 = 89.98%], test  : [loss = 0.396, top1 = 86.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.22 ms.
cifar100       train : [loss = 1.346, top1 = 62.67%], valid : [loss = 1.535, top1 = 57.70%], test : [loss = 1.525, top1 = 57.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.75%], valid : [loss = 2.899, top1 = 29.67%], test : [loss = 2.943, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3023/15625) 003023-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.74 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3024/15625) 003024-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.24 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.72%], valid : [loss = 0.470, top1 = 86.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10        train : [loss = 0.151, top1 = 95.04%], test  : [loss = 0.339, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.63 ms.
cifar100       train : [loss = 0.975, top1 = 72.27%], valid : [loss = 1.346, top1 = 62.07%], test : [loss = 1.348, top1 = 62.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.28%], valid : [loss = 2.664, top1 = 33.19%], test : [loss = 2.691, top1 = 32.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3025/15625) 003025-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.26%], valid : [loss = 0.857, top1 = 71.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.557, top1 = 80.54%], test  : [loss = 0.721, top1 = 75.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.60 ms.
cifar100       train : [loss = 1.765, top1 = 52.42%], valid : [loss = 2.044, top1 = 47.28%], test : [loss = 2.039, top1 = 47.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.65%], valid : [loss = 3.631, top1 = 17.33%], test : [loss = 3.662, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3026/15625) 003026-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.59%], valid : [loss = 0.659, top1 = 85.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.398, top1 = 90.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.26 ms.
cifar100       train : [loss = 0.505, top1 = 85.16%], valid : [loss = 1.383, top1 = 65.22%], test : [loss = 1.379, top1 = 64.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 2.395, top1 = 38.97%], valid : [loss = 2.575, top1 = 35.53%], test : [loss = 2.613, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.78%], valid : [loss = 0.858, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3027/15625) 003027-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.29%], valid : [loss = 0.454, top1 = 87.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.29 ms.
cifar10        train : [loss = 0.111, top1 = 96.59%], test  : [loss = 0.325, top1 = 89.74%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.66 ms.
cifar100       train : [loss = 0.857, top1 = 75.61%], valid : [loss = 1.266, top1 = 64.64%], test : [loss = 1.283, top1 = 63.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.78%], valid : [loss = 2.629, top1 = 34.13%], test : [loss = 2.637, top1 = 34.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.04%], valid : [loss = 0.648, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3028/15625) 003028-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.451, top1 = 89.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.28 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.340, top1 = 91.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.98 ms.
cifar100       train : [loss = 0.184, top1 = 95.70%], valid : [loss = 1.345, top1 = 68.54%], test : [loss = 1.333, top1 = 68.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 1.841, top1 = 51.23%], valid : [loss = 2.278, top1 = 42.27%], test : [loss = 2.300, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.412, top1 = 85.78%], valid : [loss = 0.524, top1 = 82.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3029/15625) 003029-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.32%], valid : [loss = 0.581, top1 = 85.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10        train : [loss = 0.114, top1 = 96.20%], test  : [loss = 0.400, top1 = 88.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.06 ms.
cifar100       train : [loss = 0.831, top1 = 75.81%], valid : [loss = 1.435, top1 = 62.26%], test : [loss = 1.416, top1 = 62.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.03%], valid : [loss = 2.752, top1 = 32.27%], test : [loss = 2.819, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.96%], valid : [loss = 0.687, top1 = 76.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3030/15625) 003030-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.515, top1 = 89.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.44 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.325, top1 = 92.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.70 ms.
cifar100       train : [loss = 0.209, top1 = 94.74%], valid : [loss = 1.248, top1 = 69.58%], test : [loss = 1.258, top1 = 69.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.18%], valid : [loss = 2.211, top1 = 44.27%], test : [loss = 2.229, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.76%], valid : [loss = 0.798, top1 = 72.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3031/15625) 003031-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.30%], valid : [loss = 0.610, top1 = 85.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.408, top1 = 88.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 0.712, top1 = 79.51%], valid : [loss = 1.390, top1 = 63.50%], test : [loss = 1.376, top1 = 63.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.08%], valid : [loss = 2.666, top1 = 33.20%], test : [loss = 2.692, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3032/15625) 003032-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.60%], valid : [loss = 0.862, top1 = 71.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=17.26 ms.
cifar10        train : [loss = 0.559, top1 = 80.38%], test  : [loss = 0.719, top1 = 75.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.29 ms.
cifar100       train : [loss = 1.783, top1 = 51.69%], valid : [loss = 2.027, top1 = 47.40%], test : [loss = 2.064, top1 = 47.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.94%], valid : [loss = 3.632, top1 = 16.83%], test : [loss = 3.670, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3033/15625) 003033-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.447, top1 = 90.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.291, top1 = 93.48%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.30 ms.
cifar100       train : [loss = 0.130, top1 = 97.44%], valid : [loss = 1.286, top1 = 69.34%], test : [loss = 1.240, top1 = 70.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.24%], valid : [loss = 2.145, top1 = 43.90%], test : [loss = 2.171, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.65%], valid : [loss = 0.634, top1 = 78.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3034/15625) 003034-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.35%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=17.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.317, top1 = 92.01%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=15.74 ms.
cifar100       train : [loss = 0.338, top1 = 90.75%], valid : [loss = 1.284, top1 = 67.56%], test : [loss = 1.291, top1 = 67.27%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 45.97%], valid : [loss = 2.361, top1 = 40.17%], test : [loss = 2.386, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 83.92%], valid : [loss = 0.556, top1 = 80.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3035/15625) 003035-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.435, top1 = 90.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.278, top1 = 93.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.03 ms.
cifar100       train : [loss = 0.064, top1 = 99.06%], valid : [loss = 1.333, top1 = 70.92%], test : [loss = 1.323, top1 = 71.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 1.527, top1 = 58.70%], valid : [loss = 2.246, top1 = 43.60%], test : [loss = 2.258, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.44%], valid : [loss = 0.491, top1 = 83.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3036/15625) 003036-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.592, top1 = 87.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.396, top1 = 91.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.207, top1 = 95.08%], valid : [loss = 1.510, top1 = 64.82%], test : [loss = 1.463, top1 = 65.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.88%], valid : [loss = 2.542, top1 = 36.60%], test : [loss = 2.553, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.48%], valid : [loss = 0.756, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3037/15625) 003037-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.87%], valid : [loss = 0.631, top1 = 86.23%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.75 ms.
cifar10        train : [loss = 0.028, top1 = 99.33%], test  : [loss = 0.427, top1 = 89.33%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.66 ms.
cifar100       train : [loss = 0.381, top1 = 89.81%], valid : [loss = 1.441, top1 = 64.84%], test : [loss = 1.468, top1 = 64.56%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.14%], valid : [loss = 2.640, top1 = 33.60%], test : [loss = 2.634, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.27%], valid : [loss = 0.765, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3038/15625) 003038-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.576, top1 = 88.55%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.25 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.362, top1 = 92.48%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.13 ms.
cifar100       train : [loss = 0.084, top1 = 98.59%], valid : [loss = 1.511, top1 = 68.16%], test : [loss = 1.463, top1 = 67.88%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 51.06%], valid : [loss = 2.407, top1 = 40.20%], test : [loss = 2.452, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.51%], valid : [loss = 0.721, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3039/15625) 003039-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.131, top1 = 96.02%], valid : [loss = 0.469, top1 = 85.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.169, top1 = 94.53%], test  : [loss = 0.342, top1 = 88.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.90 ms.
cifar100       train : [loss = 1.022, top1 = 70.85%], valid : [loss = 1.354, top1 = 61.96%], test : [loss = 1.344, top1 = 61.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.83%], valid : [loss = 2.682, top1 = 32.13%], test : [loss = 2.710, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.20%], valid : [loss = 0.756, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3040/15625) 003040-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.52%], valid : [loss = 0.871, top1 = 71.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.24 ms.
cifar10        train : [loss = 0.560, top1 = 80.43%], test  : [loss = 0.709, top1 = 75.60%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.00 ms.
cifar100       train : [loss = 1.794, top1 = 51.67%], valid : [loss = 2.043, top1 = 46.86%], test : [loss = 2.073, top1 = 47.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.64 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.71%], valid : [loss = 3.654, top1 = 16.43%], test : [loss = 3.670, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3041/15625) 003041-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.152, top1 = 95.06%], valid : [loss = 0.532, top1 = 84.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.176, top1 = 94.07%], test  : [loss = 0.384, top1 = 88.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.36 ms.
cifar100       train : [loss = 1.170, top1 = 66.86%], valid : [loss = 1.503, top1 = 59.08%], test : [loss = 1.500, top1 = 58.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.49%], valid : [loss = 2.702, top1 = 33.10%], test : [loss = 2.754, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.09%], valid : [loss = 0.964, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3042/15625) 003042-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.08 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.57%], valid : [loss = 0.853, top1 = 72.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 0.571, top1 = 80.08%], test  : [loss = 0.726, top1 = 75.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.51 ms.
cifar100       train : [loss = 1.774, top1 = 52.20%], valid : [loss = 2.066, top1 = 46.46%], test : [loss = 2.085, top1 = 47.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.95%], valid : [loss = 3.636, top1 = 17.03%], test : [loss = 3.654, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.189, top1 = 57.35%], valid : [loss = 1.249, top1 = 55.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3043/15625) 003043-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.49%], valid : [loss = 0.452, top1 = 86.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10        train : [loss = 0.158, top1 = 94.79%], test  : [loss = 0.361, top1 = 88.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.83 ms.
cifar100       train : [loss = 1.009, top1 = 71.52%], valid : [loss = 1.378, top1 = 61.98%], test : [loss = 1.378, top1 = 61.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.61%], valid : [loss = 2.720, top1 = 32.97%], test : [loss = 2.701, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3044/15625) 003044-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.85 ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.43%], valid : [loss = 0.855, top1 = 70.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.83 ms.
cifar10        train : [loss = 0.687, top1 = 75.85%], test  : [loss = 0.777, top1 = 73.57%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.13 ms.
cifar100       train : [loss = 1.972, top1 = 47.52%], valid : [loss = 2.131, top1 = 45.04%], test : [loss = 2.164, top1 = 44.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.57 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.80%], valid : [loss = 3.678, top1 = 15.60%], test : [loss = 3.683, top1 = 14.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3045/15625) 003045-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.420, top1 = 90.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.92 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.264, top1 = 93.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.61 ms.
cifar100       train : [loss = 0.169, top1 = 96.17%], valid : [loss = 1.277, top1 = 69.18%], test : [loss = 1.295, top1 = 70.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 1.785, top1 = 52.40%], valid : [loss = 2.239, top1 = 42.87%], test : [loss = 2.280, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.40%], valid : [loss = 0.513, top1 = 82.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3046/15625) 003046-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.545, top1 = 89.20%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.08 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.319, top1 = 93.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.80 ms.
cifar100       train : [loss = 0.097, top1 = 98.18%], valid : [loss = 1.384, top1 = 69.08%], test : [loss = 1.350, top1 = 69.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.84 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.17%], valid : [loss = 2.318, top1 = 41.67%], test : [loss = 2.266, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.69%], valid : [loss = 0.801, top1 = 71.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3047/15625) 003047-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.558, top1 = 87.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10        train : [loss = 0.037, top1 = 98.87%], test  : [loss = 0.385, top1 = 90.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.352, top1 = 89.81%], valid : [loss = 1.335, top1 = 67.20%], test : [loss = 1.318, top1 = 66.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 40.81%], valid : [loss = 2.471, top1 = 37.30%], test : [loss = 2.496, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.55%], valid : [loss = 0.964, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3048/15625) 003048-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.460, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.315, top1 = 91.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 0.327, top1 = 91.10%], valid : [loss = 1.328, top1 = 66.70%], test : [loss = 1.311, top1 = 66.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 46.02%], valid : [loss = 2.384, top1 = 40.03%], test : [loss = 2.403, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.33%], valid : [loss = 0.557, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3049/15625) 003049-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.631, top1 = 86.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.030, top1 = 99.22%], test  : [loss = 0.390, top1 = 90.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.05 ms.
cifar100       train : [loss = 0.399, top1 = 89.12%], valid : [loss = 1.382, top1 = 65.62%], test : [loss = 1.392, top1 = 64.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.98 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.68%], valid : [loss = 2.646, top1 = 34.50%], test : [loss = 2.640, top1 = 34.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.42%], valid : [loss = 0.769, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3050/15625) 003050-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.55%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.92 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.312, top1 = 93.35%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.98 ms.
cifar100       train : [loss = 0.061, top1 = 99.12%], valid : [loss = 1.367, top1 = 69.72%], test : [loss = 1.349, top1 = 70.06%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.14 ms.
ImageNet16-120 train : [loss = 1.713, top1 = 54.15%], valid : [loss = 2.264, top1 = 42.60%], test : [loss = 2.269, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 79.02%], valid : [loss = 0.661, top1 = 77.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3051/15625) 003051-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.291, top1 = 89.72%], valid : [loss = 0.832, top1 = 75.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10        train : [loss = 0.342, top1 = 87.98%], test  : [loss = 0.626, top1 = 80.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 1.400, top1 = 60.71%], valid : [loss = 1.893, top1 = 50.64%], test : [loss = 1.918, top1 = 50.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 15.88%], valid : [loss = 3.581, top1 = 16.37%], test : [loss = 3.563, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.245, top1 = 54.68%], valid : [loss = 1.276, top1 = 53.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3052/15625) 003052-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10-valid  train : [loss = 1.230, top1 = 55.77%], valid : [loss = 1.280, top1 = 54.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 1.188, top1 = 57.53%], test  : [loss = 1.189, top1 = 57.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.46 ms.
cifar100       train : [loss = 2.726, top1 = 31.89%], valid : [loss = 2.799, top1 = 31.18%], test : [loss = 2.783, top1 = 30.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 3.865, top1 = 12.41%], valid : [loss = 3.858, top1 = 12.73%], test : [loss = 3.859, top1 = 12.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.711, top1 = 35.38%], valid : [loss = 1.722, top1 = 34.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3053/15625) 003053-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.508, top1 = 89.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.334, top1 = 92.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.31 ms.
cifar100       train : [loss = 0.122, top1 = 97.57%], valid : [loss = 1.302, top1 = 69.08%], test : [loss = 1.290, top1 = 70.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.11%], valid : [loss = 2.183, top1 = 43.37%], test : [loss = 2.201, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.89%], valid : [loss = 0.666, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3054/15625) 003054-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.291, top1 = 89.99%], valid : [loss = 0.823, top1 = 76.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.305, top1 = 89.36%], test  : [loss = 0.615, top1 = 80.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.55 ms.
cifar100       train : [loss = 1.393, top1 = 60.70%], valid : [loss = 1.923, top1 = 50.24%], test : [loss = 1.935, top1 = 50.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 3.513, top1 = 17.01%], valid : [loss = 3.519, top1 = 17.37%], test : [loss = 3.532, top1 = 16.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.263, top1 = 53.88%], valid : [loss = 1.311, top1 = 52.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3055/15625) 003055-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.543, top1 = 88.87%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.345, top1 = 93.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.64 ms.
cifar100       train : [loss = 0.052, top1 = 99.35%], valid : [loss = 1.480, top1 = 68.60%], test : [loss = 1.483, top1 = 68.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.721, top1 = 53.85%], valid : [loss = 2.363, top1 = 40.97%], test : [loss = 2.369, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.98%], valid : [loss = 0.671, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3056/15625) 003056-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.06%], valid : [loss = 0.858, top1 = 71.92%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10        train : [loss = 0.559, top1 = 80.47%], test  : [loss = 0.716, top1 = 75.65%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 1.772, top1 = 52.25%], valid : [loss = 2.041, top1 = 47.47%], test : [loss = 2.052, top1 = 47.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.12 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.72%], valid : [loss = 3.644, top1 = 16.60%], test : [loss = 3.661, top1 = 15.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3057/15625) 003057-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.623, top1 = 86.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10        train : [loss = 0.033, top1 = 99.09%], test  : [loss = 0.385, top1 = 90.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 0.507, top1 = 85.28%], valid : [loss = 1.427, top1 = 63.52%], test : [loss = 1.451, top1 = 63.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.19%], valid : [loss = 2.556, top1 = 35.33%], test : [loss = 2.625, top1 = 34.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3058/15625) 003058-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.537, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.360, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.75 ms.
cifar100       train : [loss = 0.153, top1 = 96.68%], valid : [loss = 1.306, top1 = 69.08%], test : [loss = 1.327, top1 = 69.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 1.961, top1 = 48.43%], valid : [loss = 2.293, top1 = 42.17%], test : [loss = 2.315, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.80%], valid : [loss = 0.684, top1 = 76.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3059/15625) 003059-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.530, top1 = 89.19%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.91 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.363, top1 = 92.29%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=17.69 ms.
cifar100       train : [loss = 0.041, top1 = 99.68%], valid : [loss = 1.445, top1 = 69.22%], test : [loss = 1.384, top1 = 69.36%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.79 ms.
ImageNet16-120 train : [loss = 1.565, top1 = 57.78%], valid : [loss = 2.369, top1 = 41.67%], test : [loss = 2.419, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.94%], valid : [loss = 0.684, top1 = 76.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3060/15625) 003060-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.13%], valid : [loss = 0.924, top1 = 72.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10        train : [loss = 0.434, top1 = 84.79%], test  : [loss = 0.694, top1 = 77.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 1.573, top1 = 56.63%], valid : [loss = 2.092, top1 = 46.04%], test : [loss = 2.056, top1 = 47.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 3.669, top1 = 14.57%], valid : [loss = 3.692, top1 = 14.50%], test : [loss = 3.688, top1 = 14.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.307, top1 = 52.13%], valid : [loss = 1.361, top1 = 50.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3061/15625) 003061-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.31%], valid : [loss = 0.704, top1 = 84.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.054, top1 = 98.35%], test  : [loss = 0.440, top1 = 88.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.69 ms.
cifar100       train : [loss = 0.642, top1 = 81.09%], valid : [loss = 1.499, top1 = 62.28%], test : [loss = 1.504, top1 = 61.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.42%], valid : [loss = 2.822, top1 = 31.07%], test : [loss = 2.867, top1 = 30.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.85%], valid : [loss = 0.853, top1 = 70.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3062/15625) 003062-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.504, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.85 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.307, top1 = 92.86%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.52 ms.
cifar100       train : [loss = 0.150, top1 = 96.88%], valid : [loss = 1.311, top1 = 68.32%], test : [loss = 1.258, top1 = 69.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.46%], valid : [loss = 2.262, top1 = 42.40%], test : [loss = 2.274, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.49%], valid : [loss = 0.664, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3063/15625) 003063-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.439, top1 = 89.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.295, top1 = 92.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.43 ms.
cifar100       train : [loss = 0.157, top1 = 96.57%], valid : [loss = 1.306, top1 = 68.76%], test : [loss = 1.307, top1 = 69.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.63 ms.
ImageNet16-120 train : [loss = 1.771, top1 = 52.90%], valid : [loss = 2.253, top1 = 43.33%], test : [loss = 2.265, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.18%], valid : [loss = 0.540, top1 = 81.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3064/15625) 003064-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.24%], valid : [loss = 0.561, top1 = 84.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.38 ms.
cifar10        train : [loss = 0.188, top1 = 93.54%], test  : [loss = 0.400, top1 = 87.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.38 ms.
cifar100       train : [loss = 1.018, top1 = 70.57%], valid : [loss = 1.429, top1 = 61.44%], test : [loss = 1.406, top1 = 61.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.691, top1 = 32.83%], valid : [loss = 2.740, top1 = 33.03%], test : [loss = 2.826, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.70%], valid : [loss = 1.011, top1 = 64.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3065/15625) 003065-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.70%], valid : [loss = 0.860, top1 = 71.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.67 ms.
cifar10        train : [loss = 0.553, top1 = 80.54%], test  : [loss = 0.716, top1 = 75.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.13 ms.
cifar100       train : [loss = 1.752, top1 = 52.68%], valid : [loss = 2.019, top1 = 47.56%], test : [loss = 2.041, top1 = 47.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.87%], valid : [loss = 3.623, top1 = 16.60%], test : [loss = 3.657, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3066/15625) 003066-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.253, top1 = 91.33%], valid : [loss = 0.529, top1 = 83.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.62 ms.
cifar10        train : [loss = 0.256, top1 = 91.21%], test  : [loss = 0.403, top1 = 86.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 1.409, top1 = 60.63%], valid : [loss = 1.668, top1 = 54.73%], test : [loss = 1.644, top1 = 55.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.930, top1 = 28.19%], valid : [loss = 2.949, top1 = 27.96%], test : [loss = 3.017, top1 = 27.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.74%], valid : [loss = 1.002, top1 = 64.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3067/15625) 003067-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.129, top1 = 95.68%], valid : [loss = 0.640, top1 = 82.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.87 ms.
cifar10        train : [loss = 0.174, top1 = 94.02%], test  : [loss = 0.477, top1 = 85.79%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.33 ms.
cifar100       train : [loss = 0.987, top1 = 71.39%], valid : [loss = 1.619, top1 = 57.42%], test : [loss = 1.641, top1 = 57.02%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 3.173, top1 = 22.75%], valid : [loss = 3.200, top1 = 23.43%], test : [loss = 3.248, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.996, top1 = 64.46%], valid : [loss = 1.033, top1 = 63.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3068/15625) 003068-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.44%], valid : [loss = 0.646, top1 = 85.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10        train : [loss = 0.058, top1 = 98.18%], test  : [loss = 0.434, top1 = 88.78%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.59 ms.
cifar100       train : [loss = 0.652, top1 = 80.85%], valid : [loss = 1.382, top1 = 63.54%], test : [loss = 1.378, top1 = 64.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.77%], valid : [loss = 2.617, top1 = 34.27%], test : [loss = 2.649, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.05%], valid : [loss = 0.840, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3069/15625) 003069-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.61%], valid : [loss = 0.536, top1 = 88.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.024, top1 = 99.29%], test  : [loss = 0.364, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.401, top1 = 88.63%], valid : [loss = 1.286, top1 = 65.96%], test : [loss = 1.285, top1 = 67.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.199, top1 = 42.97%], valid : [loss = 2.413, top1 = 39.73%], test : [loss = 2.417, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.14%], valid : [loss = 0.820, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3070/15625) 003070-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.68%], valid : [loss = 0.523, top1 = 82.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10        train : [loss = 0.398, top1 = 86.41%], test  : [loss = 0.462, top1 = 84.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 1.520, top1 = 58.15%], valid : [loss = 1.658, top1 = 54.49%], test : [loss = 1.638, top1 = 55.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 26.16%], valid : [loss = 3.041, top1 = 26.95%], test : [loss = 3.064, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.78%], valid : [loss = 1.138, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3071/15625) 003071-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.47 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.22 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.27 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3072/15625) 003072-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.18%], valid : [loss = 0.613, top1 = 85.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10        train : [loss = 0.071, top1 = 97.84%], test  : [loss = 0.403, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.36 ms.
cifar100       train : [loss = 0.720, top1 = 79.11%], valid : [loss = 1.401, top1 = 62.94%], test : [loss = 1.391, top1 = 62.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.81%], valid : [loss = 2.670, top1 = 33.13%], test : [loss = 2.699, top1 = 33.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3073/15625) 003073-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.22%], valid : [loss = 0.465, top1 = 86.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.19 ms.
cifar10        train : [loss = 0.158, top1 = 94.92%], test  : [loss = 0.350, top1 = 88.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.47 ms.
cifar100       train : [loss = 0.989, top1 = 71.69%], valid : [loss = 1.377, top1 = 61.56%], test : [loss = 1.360, top1 = 62.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=18.52 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.82%], valid : [loss = 2.663, top1 = 33.50%], test : [loss = 2.688, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3074/15625) 003074-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.539, top1 = 88.12%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.53 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.369, top1 = 91.35%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.19 ms.
cifar100       train : [loss = 0.364, top1 = 89.83%], valid : [loss = 1.421, top1 = 65.30%], test : [loss = 1.460, top1 = 64.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.77%], valid : [loss = 2.486, top1 = 37.37%], test : [loss = 2.503, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 71.94%], valid : [loss = 0.853, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3075/15625) 003075-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.563, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.011, top1 = 99.69%], test  : [loss = 0.366, top1 = 92.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.67 ms.
cifar100       train : [loss = 0.177, top1 = 95.65%], valid : [loss = 1.361, top1 = 68.20%], test : [loss = 1.345, top1 = 68.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 45.94%], valid : [loss = 2.372, top1 = 38.87%], test : [loss = 2.337, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.95%], valid : [loss = 0.909, top1 = 67.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3076/15625) 003076-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.79%], valid : [loss = 0.479, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.47 ms.
cifar10        train : [loss = 0.292, top1 = 90.30%], test  : [loss = 0.396, top1 = 86.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.12 ms.
cifar100       train : [loss = 1.333, top1 = 62.91%], valid : [loss = 1.532, top1 = 57.82%], test : [loss = 1.502, top1 = 58.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.65%], valid : [loss = 2.901, top1 = 28.53%], test : [loss = 2.962, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3077/15625) 003077-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.535, top1 = 89.34%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=19.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.354, top1 = 92.72%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=17.77 ms.
cifar100       train : [loss = 0.079, top1 = 98.73%], valid : [loss = 1.446, top1 = 68.31%], test : [loss = 1.444, top1 = 68.45%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=18.90 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.71%], valid : [loss = 2.365, top1 = 41.02%], test : [loss = 2.407, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.38%], valid : [loss = 0.688, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3078/15625) 003078-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.30%], valid : [loss = 0.459, top1 = 86.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.165, top1 = 94.67%], test  : [loss = 0.358, top1 = 88.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 1.001, top1 = 71.30%], valid : [loss = 1.384, top1 = 61.38%], test : [loss = 1.368, top1 = 61.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.66%], valid : [loss = 2.719, top1 = 31.93%], test : [loss = 2.700, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3079/15625) 003079-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.542, top1 = 89.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.363, top1 = 92.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.48 ms.
cifar100       train : [loss = 0.097, top1 = 98.26%], valid : [loss = 1.442, top1 = 68.18%], test : [loss = 1.427, top1 = 69.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.52 ms.
ImageNet16-120 train : [loss = 1.862, top1 = 50.66%], valid : [loss = 2.424, top1 = 40.67%], test : [loss = 2.463, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.44%], valid : [loss = 0.732, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3080/15625) 003080-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.560, top1 = 87.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.369, top1 = 91.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 0.389, top1 = 89.08%], valid : [loss = 1.405, top1 = 64.91%], test : [loss = 1.393, top1 = 65.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.72%], valid : [loss = 2.491, top1 = 37.18%], test : [loss = 2.486, top1 = 37.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.40%], valid : [loss = 0.755, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3081/15625) 003081-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10-valid  train : [loss = 1.837, top1 = 33.44%], valid : [loss = 1.854, top1 = 32.68%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10        train : [loss = 1.304, top1 = 52.77%], test  : [loss = 1.301, top1 = 52.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.23 ms.
cifar100       train : [loss = 3.848, top1 = 11.01%], valid : [loss = 3.883, top1 = 10.28%], test : [loss = 3.878, top1 = 10.91%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.85 ms.
ImageNet16-120 train : [loss = 3.903, top1 = 11.81%], valid : [loss = 3.882, top1 = 12.33%], test : [loss = 3.895, top1 = 12.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3082/15625) 003082-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.530, top1 = 89.44%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.311, top1 = 93.16%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.61 ms.
cifar100       train : [loss = 0.062, top1 = 99.09%], valid : [loss = 1.351, top1 = 70.34%], test : [loss = 1.362, top1 = 70.52%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.85%], valid : [loss = 2.327, top1 = 41.73%], test : [loss = 2.291, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 74.12%], valid : [loss = 0.785, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3083/15625) 003083-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.478, top1 = 89.04%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.98 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.299, top1 = 92.20%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.53 ms.
cifar100       train : [loss = 0.289, top1 = 92.69%], valid : [loss = 1.196, top1 = 69.52%], test : [loss = 1.214, top1 = 68.94%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.92 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.65%], valid : [loss = 2.238, top1 = 43.10%], test : [loss = 2.252, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.13%], valid : [loss = 0.666, top1 = 76.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3084/15625) 003084-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.570, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.378, top1 = 91.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.32 ms.
cifar100       train : [loss = 0.180, top1 = 96.09%], valid : [loss = 1.419, top1 = 66.58%], test : [loss = 1.430, top1 = 67.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 48.06%], valid : [loss = 2.423, top1 = 38.67%], test : [loss = 2.431, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.87%], valid : [loss = 0.699, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3085/15625) 003085-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.73%], valid : [loss = 1.100, top1 = 63.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10        train : [loss = 0.785, top1 = 72.28%], test  : [loss = 0.919, top1 = 67.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.65 ms.
cifar100       train : [loss = 2.110, top1 = 44.31%], valid : [loss = 2.408, top1 = 39.32%], test : [loss = 2.395, top1 = 39.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 3.765, top1 = 13.98%], valid : [loss = 3.824, top1 = 13.63%], test : [loss = 3.838, top1 = 13.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.346, top1 = 51.14%], valid : [loss = 1.388, top1 = 50.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3086/15625) 003086-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.355, top1 = 92.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.109, top1 = 98.04%], valid : [loss = 1.444, top1 = 68.12%], test : [loss = 1.438, top1 = 68.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.84%], valid : [loss = 2.448, top1 = 39.07%], test : [loss = 2.432, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.18%], valid : [loss = 0.718, top1 = 75.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3087/15625) 003087-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.31%], valid : [loss = 0.457, top1 = 86.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.348, top1 = 88.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 1.013, top1 = 71.29%], valid : [loss = 1.359, top1 = 61.86%], test : [loss = 1.376, top1 = 61.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.70%], valid : [loss = 2.693, top1 = 32.47%], test : [loss = 2.721, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3088/15625) 003088-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.589, top1 = 88.43%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.81 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.377, top1 = 92.52%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.91 ms.
cifar100       train : [loss = 0.068, top1 = 98.95%], valid : [loss = 1.549, top1 = 67.58%], test : [loss = 1.595, top1 = 66.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.73%], valid : [loss = 2.460, top1 = 38.27%], test : [loss = 2.448, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.67%], valid : [loss = 0.706, top1 = 75.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3089/15625) 003089-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.71%], valid : [loss = 0.860, top1 = 71.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.39 ms.
cifar10        train : [loss = 0.552, top1 = 80.76%], test  : [loss = 0.708, top1 = 75.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.92 ms.
cifar100       train : [loss = 1.777, top1 = 51.99%], valid : [loss = 2.066, top1 = 46.82%], test : [loss = 2.031, top1 = 46.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.69%], valid : [loss = 3.640, top1 = 16.60%], test : [loss = 3.663, top1 = 16.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3090/15625) 003090-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.92%], valid : [loss = 0.866, top1 = 71.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10        train : [loss = 0.561, top1 = 80.39%], test  : [loss = 0.715, top1 = 75.67%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.06 ms.
cifar100       train : [loss = 1.780, top1 = 51.87%], valid : [loss = 2.044, top1 = 47.09%], test : [loss = 2.070, top1 = 46.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.74 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.72%], valid : [loss = 3.648, top1 = 16.52%], test : [loss = 3.671, top1 = 15.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3091/15625) 003091-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.15 ms.
cifar10-valid  train : [loss = 1.229, top1 = 56.01%], valid : [loss = 1.273, top1 = 54.46%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10        train : [loss = 1.259, top1 = 54.83%], test  : [loss = 1.254, top1 = 54.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.86 ms.
cifar100       train : [loss = 2.766, top1 = 31.05%], valid : [loss = 2.853, top1 = 29.82%], test : [loss = 2.837, top1 = 29.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.10 ms.
ImageNet16-120 train : [loss = 3.902, top1 = 11.89%], valid : [loss = 3.907, top1 = 12.17%], test : [loss = 3.928, top1 = 12.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.734, top1 = 34.67%], valid : [loss = 1.724, top1 = 34.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3092/15625) 003092-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.537, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.367, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.81 ms.
cifar100       train : [loss = 0.221, top1 = 94.84%], valid : [loss = 1.404, top1 = 66.50%], test : [loss = 1.384, top1 = 67.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.49%], valid : [loss = 2.428, top1 = 38.62%], test : [loss = 2.437, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.73%], valid : [loss = 0.717, top1 = 75.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3093/15625) 003093-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.312, top1 = 92.25%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.73 ms.
cifar100       train : [loss = 0.319, top1 = 91.46%], valid : [loss = 1.244, top1 = 67.91%], test : [loss = 1.230, top1 = 68.34%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.79%], valid : [loss = 2.328, top1 = 39.61%], test : [loss = 2.339, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.17%], valid : [loss = 0.598, top1 = 79.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3094/15625) 003094-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.550, top1 = 89.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.62 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.347, top1 = 92.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.23 ms.
cifar100       train : [loss = 0.059, top1 = 99.37%], valid : [loss = 1.512, top1 = 67.88%], test : [loss = 1.496, top1 = 68.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 1.704, top1 = 54.50%], valid : [loss = 2.439, top1 = 40.13%], test : [loss = 2.474, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.87%], valid : [loss = 0.717, top1 = 75.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3095/15625) 003095-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.78 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.78 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3096/15625) 003096-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.554, top1 = 88.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.359, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.57 ms.
cifar100       train : [loss = 0.129, top1 = 97.50%], valid : [loss = 1.452, top1 = 67.19%], test : [loss = 1.454, top1 = 66.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.45%], valid : [loss = 2.408, top1 = 39.24%], test : [loss = 2.435, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.48%], valid : [loss = 0.706, top1 = 75.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3097/15625) 003097-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.570, top1 = 88.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.349, top1 = 92.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.14 ms.
cifar100       train : [loss = 0.123, top1 = 97.21%], valid : [loss = 1.421, top1 = 68.22%], test : [loss = 1.421, top1 = 68.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.352, top1 = 39.37%], valid : [loss = 2.536, top1 = 35.07%], test : [loss = 2.556, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.00%], valid : [loss = 0.898, top1 = 68.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3098/15625) 003098-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.554, top1 = 88.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.382, top1 = 91.92%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.01 ms.
cifar100       train : [loss = 0.072, top1 = 99.13%], valid : [loss = 1.446, top1 = 67.90%], test : [loss = 1.366, top1 = 70.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.41%], valid : [loss = 2.408, top1 = 41.03%], test : [loss = 2.374, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.75%], valid : [loss = 0.645, top1 = 78.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3099/15625) 003099-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.329, top1 = 92.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.250, top1 = 93.67%], valid : [loss = 1.255, top1 = 68.32%], test : [loss = 1.257, top1 = 68.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.53 ms.
ImageNet16-120 train : [loss = 1.964, top1 = 48.21%], valid : [loss = 2.289, top1 = 41.43%], test : [loss = 2.302, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.50%], valid : [loss = 0.629, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3100/15625) 003100-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 0.818, top1 = 71.04%], valid : [loss = 0.989, top1 = 66.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.32 ms.
cifar10        train : [loss = 0.768, top1 = 72.99%], test  : [loss = 0.860, top1 = 70.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.35 ms.
cifar100       train : [loss = 2.138, top1 = 43.95%], valid : [loss = 2.314, top1 = 40.51%], test : [loss = 2.337, top1 = 40.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.22 ms.
ImageNet16-120 train : [loss = 3.737, top1 = 14.36%], valid : [loss = 3.766, top1 = 14.77%], test : [loss = 3.772, top1 = 13.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3101/15625) 003101-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.044, top1 = 99.01%], valid : [loss = 0.527, top1 = 86.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.27 ms.
cifar10        train : [loss = 0.054, top1 = 98.51%], test  : [loss = 0.363, top1 = 90.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.61 ms.
cifar100       train : [loss = 0.576, top1 = 83.40%], valid : [loss = 1.321, top1 = 65.56%], test : [loss = 1.308, top1 = 66.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.266, top1 = 41.72%], valid : [loss = 2.421, top1 = 38.57%], test : [loss = 2.440, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 70.19%], valid : [loss = 0.895, top1 = 68.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3102/15625) 003102-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.89%], valid : [loss = 0.547, top1 = 87.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.064, top1 = 97.94%], test  : [loss = 0.390, top1 = 89.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 0.650, top1 = 80.91%], valid : [loss = 1.331, top1 = 65.00%], test : [loss = 1.323, top1 = 64.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.02%], valid : [loss = 2.474, top1 = 36.93%], test : [loss = 2.496, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3103/15625) 003103-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.425 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.547, top1 = 88.85%]
cifar10        FLOP= 58.90 M, Params=0.425 MB, latency=16.49 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.366, top1 = 92.01%]
cifar100       FLOP= 58.91 M, Params=0.431 MB, latency=16.58 ms.
cifar100       train : [loss = 0.163, top1 = 96.42%], valid : [loss = 1.404, top1 = 67.78%], test : [loss = 1.410, top1 = 67.62%]
ImageNet16-120 FLOP= 14.73 M, Params=0.433 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.37%], valid : [loss = 2.411, top1 = 39.42%], test : [loss = 2.457, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.09%], valid : [loss = 0.723, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3104/15625) 003104-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.519, top1 = 88.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.316, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.89 ms.
cifar100       train : [loss = 0.357, top1 = 90.14%], valid : [loss = 1.281, top1 = 66.56%], test : [loss = 1.305, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.28%], valid : [loss = 2.418, top1 = 37.80%], test : [loss = 2.443, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3105/15625) 003105-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.268, top1 = 90.97%], valid : [loss = 0.490, top1 = 84.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10        train : [loss = 0.300, top1 = 90.03%], test  : [loss = 0.407, top1 = 86.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.93 ms.
cifar100       train : [loss = 1.333, top1 = 63.03%], valid : [loss = 1.523, top1 = 57.88%], test : [loss = 1.515, top1 = 58.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.76%], valid : [loss = 2.901, top1 = 30.93%], test : [loss = 2.954, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3106/15625) 003106-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.597, top1 = 86.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.021, top1 = 99.45%], test  : [loss = 0.427, top1 = 90.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 0.284, top1 = 92.39%], valid : [loss = 1.429, top1 = 66.04%], test : [loss = 1.436, top1 = 65.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 42.01%], valid : [loss = 2.575, top1 = 36.00%], test : [loss = 2.622, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.44%], valid : [loss = 0.671, top1 = 76.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3107/15625) 003107-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.246, top1 = 91.78%], valid : [loss = 0.560, top1 = 82.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.232, top1 = 91.93%], test  : [loss = 0.430, top1 = 85.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.23 ms.
cifar100       train : [loss = 1.286, top1 = 63.60%], valid : [loss = 1.656, top1 = 55.56%], test : [loss = 1.628, top1 = 56.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.958, top1 = 27.84%], valid : [loss = 2.980, top1 = 27.93%], test : [loss = 3.053, top1 = 27.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.179, top1 = 57.24%], valid : [loss = 1.225, top1 = 55.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3108/15625) 003108-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.525, top1 = 87.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.023, top1 = 99.35%], test  : [loss = 0.343, top1 = 91.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.67 ms.
cifar100       train : [loss = 0.424, top1 = 87.84%], valid : [loss = 1.222, top1 = 67.84%], test : [loss = 1.289, top1 = 67.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.203, top1 = 42.90%], valid : [loss = 2.385, top1 = 38.67%], test : [loss = 2.399, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.67%], valid : [loss = 0.864, top1 = 69.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3109/15625) 003109-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.84%], valid : [loss = 0.483, top1 = 84.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.82 ms.
cifar10        train : [loss = 0.220, top1 = 92.61%], test  : [loss = 0.386, top1 = 87.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.00 ms.
cifar100       train : [loss = 1.277, top1 = 63.89%], valid : [loss = 1.537, top1 = 56.76%], test : [loss = 1.537, top1 = 57.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.995, top1 = 26.51%], valid : [loss = 2.975, top1 = 26.67%], test : [loss = 3.011, top1 = 25.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.52%], valid : [loss = 1.052, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3110/15625) 003110-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.649, top1 = 86.48%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.78 ms.
cifar10        train : [loss = 0.022, top1 = 99.42%], test  : [loss = 0.466, top1 = 89.37%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.98 ms.
cifar100       train : [loss = 0.344, top1 = 90.82%], valid : [loss = 1.484, top1 = 64.16%], test : [loss = 1.485, top1 = 64.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.59%], valid : [loss = 2.611, top1 = 34.37%], test : [loss = 2.619, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.61%], valid : [loss = 0.817, top1 = 71.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3111/15625) 003111-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.64%], valid : [loss = 0.852, top1 = 72.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.546, top1 = 80.88%], test  : [loss = 0.703, top1 = 76.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.31 ms.
cifar100       train : [loss = 1.776, top1 = 52.19%], valid : [loss = 2.062, top1 = 47.02%], test : [loss = 2.076, top1 = 46.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.85%], valid : [loss = 3.641, top1 = 16.62%], test : [loss = 3.670, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3112/15625) 003112-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.572, top1 = 87.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.368, top1 = 91.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.55 ms.
cifar100       train : [loss = 0.354, top1 = 90.18%], valid : [loss = 1.372, top1 = 66.10%], test : [loss = 1.378, top1 = 66.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.40%], valid : [loss = 2.451, top1 = 38.47%], test : [loss = 2.514, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 74.04%], valid : [loss = 0.792, top1 = 72.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3113/15625) 003113-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=11.59 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.587, top1 = 87.29%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=11.65 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.386, top1 = 91.06%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=11.08 ms.
cifar100       train : [loss = 0.395, top1 = 88.77%], valid : [loss = 1.417, top1 = 65.35%], test : [loss = 1.398, top1 = 65.51%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.81%], valid : [loss = 2.513, top1 = 36.94%], test : [loss = 2.554, top1 = 36.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3114/15625) 003114-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.37%], valid : [loss = 0.657, top1 = 78.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.362, top1 = 87.56%], test  : [loss = 0.486, top1 = 83.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.50 ms.
cifar100       train : [loss = 1.637, top1 = 54.68%], valid : [loss = 1.876, top1 = 49.60%], test : [loss = 1.849, top1 = 50.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 22.80%], valid : [loss = 3.223, top1 = 23.00%], test : [loss = 3.263, top1 = 21.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.035, top1 = 63.00%], valid : [loss = 1.096, top1 = 61.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3115/15625) 003115-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.348, top1 = 87.87%], valid : [loss = 0.596, top1 = 80.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 0.291, top1 = 90.02%], test  : [loss = 0.433, top1 = 85.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 1.549, top1 = 56.83%], valid : [loss = 1.794, top1 = 51.33%], test : [loss = 1.781, top1 = 51.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.60%], valid : [loss = 2.980, top1 = 27.06%], test : [loss = 3.015, top1 = 26.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.49%], valid : [loss = 1.027, top1 = 63.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3116/15625) 003116-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.13%], valid : [loss = 0.570, top1 = 85.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.91 ms.
cifar10        train : [loss = 0.108, top1 = 96.37%], test  : [loss = 0.407, top1 = 88.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.91 ms.
cifar100       train : [loss = 0.816, top1 = 76.08%], valid : [loss = 1.413, top1 = 62.52%], test : [loss = 1.441, top1 = 62.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.74%], valid : [loss = 2.747, top1 = 32.23%], test : [loss = 2.826, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.33%], valid : [loss = 0.736, top1 = 75.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3117/15625) 003117-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.17%], valid : [loss = 0.575, top1 = 86.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10        train : [loss = 0.067, top1 = 97.81%], test  : [loss = 0.365, top1 = 90.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.24 ms.
cifar100       train : [loss = 0.647, top1 = 81.06%], valid : [loss = 1.323, top1 = 64.46%], test : [loss = 1.295, top1 = 65.24%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.348, top1 = 39.71%], valid : [loss = 2.488, top1 = 37.37%], test : [loss = 2.508, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.08%], valid : [loss = 0.761, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3118/15625) 003118-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.28%], valid : [loss = 0.650, top1 = 84.88%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.86 ms.
cifar10        train : [loss = 0.035, top1 = 99.02%], test  : [loss = 0.387, top1 = 90.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.77 ms.
cifar100       train : [loss = 0.539, top1 = 84.17%], valid : [loss = 1.444, top1 = 62.96%], test : [loss = 1.434, top1 = 63.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.19%], valid : [loss = 2.525, top1 = 36.33%], test : [loss = 2.553, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.05%], valid : [loss = 0.871, top1 = 69.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3119/15625) 003119-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.527, top1 = 89.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.90 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.314, top1 = 93.24%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.03 ms.
cifar100       train : [loss = 0.082, top1 = 98.34%], valid : [loss = 1.443, top1 = 68.84%], test : [loss = 1.416, top1 = 69.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.72 ms.
ImageNet16-120 train : [loss = 1.712, top1 = 54.12%], valid : [loss = 2.191, top1 = 43.83%], test : [loss = 2.155, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.46%], valid : [loss = 0.792, top1 = 72.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3120/15625) 003120-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.76%], valid : [loss = 0.783, top1 = 82.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.087, top1 = 97.24%], test  : [loss = 0.486, top1 = 86.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 0.808, top1 = 76.36%], valid : [loss = 1.530, top1 = 60.47%], test : [loss = 1.523, top1 = 60.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.822, top1 = 30.25%], valid : [loss = 2.951, top1 = 27.84%], test : [loss = 3.003, top1 = 26.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3121/15625) 003121-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.468, top1 = 90.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.330, top1 = 93.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.088, top1 = 98.28%], valid : [loss = 1.434, top1 = 68.65%], test : [loss = 1.419, top1 = 69.33%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 1.667, top1 = 55.48%], valid : [loss = 2.286, top1 = 42.49%], test : [loss = 2.290, top1 = 42.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.72%], valid : [loss = 0.602, top1 = 79.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3122/15625) 003122-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.39%], valid : [loss = 0.467, top1 = 85.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10        train : [loss = 0.156, top1 = 94.87%], test  : [loss = 0.341, top1 = 88.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.994, top1 = 71.70%], valid : [loss = 1.353, top1 = 62.23%], test : [loss = 1.354, top1 = 62.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.71%], valid : [loss = 2.707, top1 = 32.30%], test : [loss = 2.714, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3123/15625) 003123-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.501, top1 = 89.31%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.50 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.327, top1 = 92.75%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.95 ms.
cifar100       train : [loss = 0.104, top1 = 97.61%], valid : [loss = 1.393, top1 = 69.01%], test : [loss = 1.397, top1 = 69.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.53 ms.
ImageNet16-120 train : [loss = 1.801, top1 = 52.11%], valid : [loss = 2.215, top1 = 43.00%], test : [loss = 2.207, top1 = 43.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.34%], valid : [loss = 0.895, top1 = 68.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3124/15625) 003124-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.608, top1 = 86.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.410, top1 = 90.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 0.497, top1 = 85.45%], valid : [loss = 1.423, top1 = 63.90%], test : [loss = 1.392, top1 = 64.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 39.18%], valid : [loss = 2.563, top1 = 35.98%], test : [loss = 2.610, top1 = 35.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.82%], valid : [loss = 0.805, top1 = 71.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3125/15625) 003125-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.63%], valid : [loss = 0.457, top1 = 86.27%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.04 ms.
cifar10        train : [loss = 0.151, top1 = 95.04%], test  : [loss = 0.344, top1 = 88.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.70 ms.
cifar100       train : [loss = 0.965, top1 = 72.43%], valid : [loss = 1.341, top1 = 62.61%], test : [loss = 1.332, top1 = 62.53%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.11%], valid : [loss = 2.662, top1 = 33.36%], test : [loss = 2.713, top1 = 32.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3126/15625) 003126-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.67%], valid : [loss = 0.449, top1 = 86.49%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.05 ms.
cifar10        train : [loss = 0.153, top1 = 95.04%], test  : [loss = 0.344, top1 = 88.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.89 ms.
cifar100       train : [loss = 0.977, top1 = 72.25%], valid : [loss = 1.353, top1 = 62.28%], test : [loss = 1.345, top1 = 62.55%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.12%], valid : [loss = 2.680, top1 = 32.79%], test : [loss = 2.698, top1 = 32.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.40%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3127/15625) 003127-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.33%], valid : [loss = 0.513, top1 = 86.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.079, top1 = 97.58%], test  : [loss = 0.344, top1 = 90.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 0.723, top1 = 78.93%], valid : [loss = 1.318, top1 = 64.57%], test : [loss = 1.304, top1 = 64.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.23%], valid : [loss = 2.502, top1 = 36.98%], test : [loss = 2.530, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.87%], valid : [loss = 0.925, top1 = 67.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3128/15625) 003128-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.496, top1 = 88.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.88 ms.
cifar100       train : [loss = 0.317, top1 = 91.49%], valid : [loss = 1.267, top1 = 67.77%], test : [loss = 1.266, top1 = 67.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.64%], valid : [loss = 2.317, top1 = 40.18%], test : [loss = 2.358, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.585, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3129/15625) 003129-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.469, top1 = 89.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.64 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.321, top1 = 92.52%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.22 ms.
cifar100       train : [loss = 0.197, top1 = 95.10%], valid : [loss = 1.377, top1 = 67.57%], test : [loss = 1.364, top1 = 67.73%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.71%], valid : [loss = 2.323, top1 = 41.49%], test : [loss = 2.353, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.92%], valid : [loss = 0.568, top1 = 80.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3130/15625) 003130-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.68%], valid : [loss = 0.850, top1 = 79.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.129, top1 = 95.67%], test  : [loss = 0.537, top1 = 85.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.94 ms.
cifar100       train : [loss = 0.853, top1 = 75.17%], valid : [loss = 1.682, top1 = 57.51%], test : [loss = 1.668, top1 = 57.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.39%], valid : [loss = 3.169, top1 = 24.30%], test : [loss = 3.206, top1 = 23.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3131/15625) 003131-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.503, top1 = 89.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.348, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.65 ms.
cifar100       train : [loss = 0.198, top1 = 95.08%], valid : [loss = 1.340, top1 = 67.93%], test : [loss = 1.343, top1 = 68.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.94%], valid : [loss = 2.276, top1 = 41.61%], test : [loss = 2.294, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.75%], valid : [loss = 0.584, top1 = 79.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3132/15625) 003132-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.491, top1 = 89.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.312, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.72 ms.
cifar100       train : [loss = 0.317, top1 = 91.46%], valid : [loss = 1.256, top1 = 67.87%], test : [loss = 1.235, top1 = 68.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.70%], valid : [loss = 2.317, top1 = 40.98%], test : [loss = 2.331, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.585, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3133/15625) 003133-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.43%], valid : [loss = 0.664, top1 = 77.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10        train : [loss = 0.499, top1 = 82.78%], test  : [loss = 0.580, top1 = 80.27%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 1.698, top1 = 53.88%], valid : [loss = 1.866, top1 = 50.79%], test : [loss = 1.875, top1 = 49.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.29%], valid : [loss = 3.305, top1 = 21.22%], test : [loss = 3.347, top1 = 21.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3134/15625) 003134-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.481, top1 = 89.54%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.68 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.299, top1 = 92.78%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.93 ms.
cifar100       train : [loss = 0.152, top1 = 96.87%], valid : [loss = 1.287, top1 = 69.03%], test : [loss = 1.256, top1 = 69.88%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.50%], valid : [loss = 2.175, top1 = 43.08%], test : [loss = 2.192, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.45%], valid : [loss = 0.653, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3135/15625) 003135-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.475, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.324, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.318, top1 = 91.49%], valid : [loss = 1.229, top1 = 67.81%], test : [loss = 1.248, top1 = 68.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.59%], valid : [loss = 2.320, top1 = 40.60%], test : [loss = 2.320, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3136/15625) 003136-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.325, top1 = 88.69%], valid : [loss = 0.565, top1 = 81.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.275, top1 = 90.58%], test  : [loss = 0.429, top1 = 85.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.58 ms.
cifar100       train : [loss = 1.412, top1 = 60.36%], valid : [loss = 1.718, top1 = 53.82%], test : [loss = 1.703, top1 = 54.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 3.019, top1 = 26.57%], valid : [loss = 3.037, top1 = 26.48%], test : [loss = 3.094, top1 = 25.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.193, top1 = 56.67%], valid : [loss = 1.249, top1 = 55.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3137/15625) 003137-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.535, top1 = 88.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.350, top1 = 91.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.24 ms.
cifar100       train : [loss = 0.325, top1 = 91.11%], valid : [loss = 1.289, top1 = 67.13%], test : [loss = 1.299, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.93%], valid : [loss = 2.415, top1 = 37.87%], test : [loss = 2.438, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3138/15625) 003138-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.73%], valid : [loss = 0.625, top1 = 84.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.084, top1 = 97.34%], test  : [loss = 0.400, top1 = 88.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.47 ms.
cifar100       train : [loss = 0.777, top1 = 77.27%], valid : [loss = 1.426, top1 = 61.91%], test : [loss = 1.414, top1 = 61.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.35%], valid : [loss = 2.737, top1 = 32.11%], test : [loss = 2.765, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3139/15625) 003139-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.78%], valid : [loss = 0.883, top1 = 69.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.686, top1 = 76.06%], test  : [loss = 0.771, top1 = 73.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 1.967, top1 = 47.61%], valid : [loss = 2.140, top1 = 44.53%], test : [loss = 2.161, top1 = 44.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 3.657, top1 = 15.67%], valid : [loss = 3.675, top1 = 15.84%], test : [loss = 3.697, top1 = 14.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3140/15625) 003140-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.10%], valid : [loss = 0.518, top1 = 86.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.099, top1 = 96.86%], test  : [loss = 0.349, top1 = 89.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.45 ms.
cifar100       train : [loss = 0.735, top1 = 78.81%], valid : [loss = 1.304, top1 = 64.47%], test : [loss = 1.306, top1 = 64.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 37.22%], valid : [loss = 2.545, top1 = 35.49%], test : [loss = 2.579, top1 = 34.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.64%], valid : [loss = 0.944, top1 = 66.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3141/15625) 003141-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.495, top1 = 89.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.331, top1 = 93.13%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.91 ms.
cifar100       train : [loss = 0.087, top1 = 98.49%], valid : [loss = 1.319, top1 = 69.92%], test : [loss = 1.312, top1 = 69.73%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 1.631, top1 = 56.17%], valid : [loss = 2.185, top1 = 44.12%], test : [loss = 2.171, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.22%], valid : [loss = 0.663, top1 = 77.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3142/15625) 003142-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.406, top1 = 85.59%], valid : [loss = 0.641, top1 = 78.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10        train : [loss = 0.332, top1 = 88.56%], test  : [loss = 0.463, top1 = 84.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.77 ms.
cifar100       train : [loss = 1.595, top1 = 55.71%], valid : [loss = 1.840, top1 = 50.57%], test : [loss = 1.823, top1 = 50.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.35%], valid : [loss = 2.947, top1 = 27.79%], test : [loss = 2.960, top1 = 27.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 62.26%], valid : [loss = 1.120, top1 = 59.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3143/15625) 003143-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.50%], valid : [loss = 0.541, top1 = 84.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.63 ms.
cifar10        train : [loss = 0.183, top1 = 93.88%], test  : [loss = 0.392, top1 = 87.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.76 ms.
cifar100       train : [loss = 1.223, top1 = 65.35%], valid : [loss = 1.519, top1 = 58.51%], test : [loss = 1.519, top1 = 58.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.26%], valid : [loss = 2.677, top1 = 33.01%], test : [loss = 2.718, top1 = 32.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 68.25%], valid : [loss = 0.946, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3144/15625) 003144-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.487, top1 = 82.92%], valid : [loss = 0.651, top1 = 78.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.494, top1 = 82.96%], test  : [loss = 0.577, top1 = 80.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 1.710, top1 = 53.76%], valid : [loss = 1.855, top1 = 50.93%], test : [loss = 1.876, top1 = 50.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.32%], valid : [loss = 3.300, top1 = 21.60%], test : [loss = 3.335, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3145/15625) 003145-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.33%], valid : [loss = 0.459, top1 = 86.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.160, top1 = 94.73%], test  : [loss = 0.344, top1 = 88.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.998, top1 = 71.60%], valid : [loss = 1.342, top1 = 62.33%], test : [loss = 1.336, top1 = 62.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.01%], valid : [loss = 2.667, top1 = 32.89%], test : [loss = 2.701, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3146/15625) 003146-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.12%], valid : [loss = 0.452, top1 = 87.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.32 ms.
cifar10        train : [loss = 0.110, top1 = 96.69%], test  : [loss = 0.318, top1 = 89.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.94 ms.
cifar100       train : [loss = 0.864, top1 = 75.35%], valid : [loss = 1.288, top1 = 64.03%], test : [loss = 1.277, top1 = 64.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.68%], valid : [loss = 2.608, top1 = 34.52%], test : [loss = 2.653, top1 = 33.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.43%], valid : [loss = 0.664, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3147/15625) 003147-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.500, top1 = 89.59%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.07 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.310, top1 = 92.88%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.97 ms.
cifar100       train : [loss = 0.084, top1 = 98.77%], valid : [loss = 1.297, top1 = 69.64%], test : [loss = 1.294, top1 = 69.65%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.31 ms.
ImageNet16-120 train : [loss = 1.813, top1 = 51.88%], valid : [loss = 2.283, top1 = 42.00%], test : [loss = 2.280, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.00%], valid : [loss = 0.693, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3148/15625) 003148-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.60%], valid : [loss = 0.528, top1 = 86.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.100, top1 = 96.84%], test  : [loss = 0.361, top1 = 89.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.721, top1 = 79.18%], valid : [loss = 1.326, top1 = 64.02%], test : [loss = 1.306, top1 = 64.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.27%], valid : [loss = 2.546, top1 = 35.58%], test : [loss = 2.574, top1 = 35.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.66%], valid : [loss = 0.868, top1 = 69.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3149/15625) 003149-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.25%], valid : [loss = 0.610, top1 = 85.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.072, top1 = 97.77%], test  : [loss = 0.405, top1 = 88.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.720, top1 = 79.02%], valid : [loss = 1.396, top1 = 63.28%], test : [loss = 1.377, top1 = 63.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.74%], valid : [loss = 2.662, top1 = 34.09%], test : [loss = 2.687, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.59%], valid : [loss = 0.817, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3150/15625) 003150-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.70%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.326, top1 = 92.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.63 ms.
cifar100       train : [loss = 0.334, top1 = 90.91%], valid : [loss = 1.280, top1 = 67.30%], test : [loss = 1.286, top1 = 67.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.80%], valid : [loss = 2.420, top1 = 38.83%], test : [loss = 2.420, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3151/15625) 003151-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.544, top1 = 87.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.62 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.371, top1 = 90.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.497, top1 = 85.40%], valid : [loss = 1.359, top1 = 65.21%], test : [loss = 1.358, top1 = 64.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.42%], valid : [loss = 2.489, top1 = 37.74%], test : [loss = 2.515, top1 = 36.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.84%], valid : [loss = 0.713, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3152/15625) 003152-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.96%], valid : [loss = 0.537, top1 = 86.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10        train : [loss = 0.074, top1 = 97.65%], test  : [loss = 0.366, top1 = 89.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 0.709, top1 = 79.04%], valid : [loss = 1.359, top1 = 63.58%], test : [loss = 1.337, top1 = 64.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.11%], valid : [loss = 2.646, top1 = 34.04%], test : [loss = 2.671, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3153/15625) 003153-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.83%], valid : [loss = 0.585, top1 = 86.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.049, top1 = 98.48%], test  : [loss = 0.380, top1 = 89.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.26 ms.
cifar100       train : [loss = 0.422, top1 = 87.58%], valid : [loss = 1.359, top1 = 65.70%], test : [loss = 1.365, top1 = 65.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.886, top1 = 27.94%], valid : [loss = 2.938, top1 = 27.01%], test : [loss = 2.952, top1 = 26.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.012, top1 = 63.32%], valid : [loss = 1.036, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3154/15625) 003154-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.325, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.48 ms.
cifar100       train : [loss = 0.344, top1 = 90.54%], valid : [loss = 1.277, top1 = 67.18%], test : [loss = 1.278, top1 = 67.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.40%], valid : [loss = 2.410, top1 = 38.91%], test : [loss = 2.437, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.27%], valid : [loss = 0.642, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3155/15625) 003155-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.25%], valid : [loss = 0.555, top1 = 82.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10        train : [loss = 0.296, top1 = 89.77%], test  : [loss = 0.425, top1 = 85.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 1.303, top1 = 63.21%], valid : [loss = 1.580, top1 = 56.72%], test : [loss = 1.582, top1 = 57.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 3.062, top1 = 25.88%], valid : [loss = 3.074, top1 = 26.12%], test : [loss = 3.120, top1 = 25.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.219, top1 = 55.87%], valid : [loss = 1.253, top1 = 54.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3156/15625) 003156-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.616, top1 = 86.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10        train : [loss = 0.040, top1 = 98.90%], test  : [loss = 0.411, top1 = 89.28%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 0.423, top1 = 88.36%], valid : [loss = 1.392, top1 = 64.65%], test : [loss = 1.375, top1 = 65.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.82%], valid : [loss = 2.561, top1 = 36.01%], test : [loss = 2.602, top1 = 36.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.11%], valid : [loss = 0.751, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3157/15625) 003157-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.05%], valid : [loss = 0.475, top1 = 84.41%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10        train : [loss = 0.298, top1 = 90.06%], test  : [loss = 0.398, top1 = 86.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.06 ms.
cifar100       train : [loss = 1.322, top1 = 63.30%], valid : [loss = 1.531, top1 = 57.84%], test : [loss = 1.495, top1 = 58.47%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.92 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.65%], valid : [loss = 2.905, top1 = 29.57%], test : [loss = 2.961, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3158/15625) 003158-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.559, top1 = 88.68%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.21 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.356, top1 = 92.17%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.85 ms.
cifar100       train : [loss = 0.231, top1 = 94.00%], valid : [loss = 1.325, top1 = 67.60%], test : [loss = 1.335, top1 = 67.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.75%], valid : [loss = 2.385, top1 = 39.34%], test : [loss = 2.403, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.62%], valid : [loss = 0.786, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3159/15625) 003159-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.47%], valid : [loss = 0.531, top1 = 87.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10        train : [loss = 0.052, top1 = 98.44%], test  : [loss = 0.370, top1 = 89.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 0.603, top1 = 82.35%], valid : [loss = 1.311, top1 = 65.23%], test : [loss = 1.309, top1 = 65.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.45%], valid : [loss = 2.514, top1 = 36.34%], test : [loss = 2.560, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.71%], valid : [loss = 0.644, top1 = 78.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3160/15625) 003160-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.552, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.369, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.51 ms.
cifar100       train : [loss = 0.100, top1 = 98.19%], valid : [loss = 1.475, top1 = 67.83%], test : [loss = 1.449, top1 = 67.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.94%], valid : [loss = 2.415, top1 = 40.09%], test : [loss = 2.428, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.38%], valid : [loss = 0.687, top1 = 76.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3161/15625) 003161-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.76%], valid : [loss = 0.517, top1 = 86.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.075, top1 = 97.78%], test  : [loss = 0.347, top1 = 89.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.669, top1 = 80.61%], valid : [loss = 1.296, top1 = 65.35%], test : [loss = 1.287, top1 = 65.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.24%], valid : [loss = 2.496, top1 = 36.48%], test : [loss = 2.524, top1 = 36.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 71.13%], valid : [loss = 0.869, top1 = 69.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3162/15625) 003162-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.412, top1 = 90.67%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.283, top1 = 93.11%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.93 ms.
cifar100       train : [loss = 0.188, top1 = 95.51%], valid : [loss = 1.283, top1 = 69.21%], test : [loss = 1.240, top1 = 69.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.58%], valid : [loss = 2.247, top1 = 42.62%], test : [loss = 2.290, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.76%], valid : [loss = 0.486, top1 = 83.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3163/15625) 003163-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.76%], valid : [loss = 0.871, top1 = 71.31%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10        train : [loss = 0.558, top1 = 80.61%], test  : [loss = 0.716, top1 = 75.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.61 ms.
cifar100       train : [loss = 1.781, top1 = 52.00%], valid : [loss = 2.055, top1 = 46.79%], test : [loss = 2.061, top1 = 46.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.39 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.85%], valid : [loss = 3.636, top1 = 16.36%], test : [loss = 3.668, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3164/15625) 003164-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.460, top1 = 83.94%], valid : [loss = 0.700, top1 = 76.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10        train : [loss = 0.385, top1 = 86.65%], test  : [loss = 0.518, top1 = 82.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 1.593, top1 = 55.88%], valid : [loss = 1.839, top1 = 51.16%], test : [loss = 1.842, top1 = 50.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 3.297, top1 = 21.44%], valid : [loss = 3.309, top1 = 21.54%], test : [loss = 3.331, top1 = 20.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.176, top1 = 57.14%], valid : [loss = 1.229, top1 = 55.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3165/15625) 003165-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.582, top1 = 87.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.377, top1 = 91.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.69 ms.
cifar100       train : [loss = 0.399, top1 = 88.62%], valid : [loss = 1.385, top1 = 65.83%], test : [loss = 1.369, top1 = 65.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.49%], valid : [loss = 2.498, top1 = 37.20%], test : [loss = 2.491, top1 = 37.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.22%], valid : [loss = 0.733, top1 = 74.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3166/15625) 003166-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.418, top1 = 90.42%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.62 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.276, top1 = 93.50%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.83 ms.
cifar100       train : [loss = 0.089, top1 = 98.57%], valid : [loss = 1.283, top1 = 70.37%], test : [loss = 1.281, top1 = 70.83%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 1.614, top1 = 56.55%], valid : [loss = 2.214, top1 = 44.11%], test : [loss = 2.236, top1 = 44.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.374, top1 = 87.20%], valid : [loss = 0.502, top1 = 83.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3167/15625) 003167-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.473, top1 = 89.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.314, top1 = 92.55%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.57 ms.
cifar100       train : [loss = 0.289, top1 = 92.38%], valid : [loss = 1.250, top1 = 68.27%], test : [loss = 1.254, top1 = 68.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.39 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.56%], valid : [loss = 2.216, top1 = 43.02%], test : [loss = 2.238, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.78%], valid : [loss = 0.641, top1 = 77.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3168/15625) 003168-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.57%], valid : [loss = 0.446, top1 = 87.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.058, top1 = 98.55%], test  : [loss = 0.312, top1 = 90.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.34 ms.
cifar100       train : [loss = 0.585, top1 = 83.81%], valid : [loss = 1.204, top1 = 66.85%], test : [loss = 1.200, top1 = 67.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.03%], valid : [loss = 2.469, top1 = 37.87%], test : [loss = 2.478, top1 = 37.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.49%], valid : [loss = 0.635, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3169/15625) 003169-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.541, top1 = 88.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.376, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.38 ms.
cifar100       train : [loss = 0.134, top1 = 97.36%], valid : [loss = 1.457, top1 = 67.27%], test : [loss = 1.441, top1 = 67.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.21%], valid : [loss = 2.413, top1 = 39.67%], test : [loss = 2.435, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.20%], valid : [loss = 0.715, top1 = 75.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3170/15625) 003170-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.495, top1 = 90.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.320, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.72 ms.
cifar100       train : [loss = 0.097, top1 = 98.02%], valid : [loss = 1.358, top1 = 69.18%], test : [loss = 1.345, top1 = 69.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 1.643, top1 = 55.83%], valid : [loss = 2.183, top1 = 44.14%], test : [loss = 2.200, top1 = 44.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.38%], valid : [loss = 0.672, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3171/15625) 003171-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.584, top1 = 87.92%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.382, top1 = 91.51%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.65 ms.
cifar100       train : [loss = 0.125, top1 = 97.90%], valid : [loss = 1.416, top1 = 67.55%], test : [loss = 1.442, top1 = 67.14%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.37 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.87%], valid : [loss = 2.438, top1 = 39.40%], test : [loss = 2.443, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.30%], valid : [loss = 0.747, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3172/15625) 003172-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.807, top1 = 83.20%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10        train : [loss = 0.034, top1 = 99.10%], test  : [loss = 0.467, top1 = 88.51%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.58 ms.
cifar100       train : [loss = 0.452, top1 = 87.47%], valid : [loss = 1.665, top1 = 60.19%], test : [loss = 1.670, top1 = 59.85%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 2.355, top1 = 39.66%], valid : [loss = 2.659, top1 = 33.39%], test : [loss = 2.661, top1 = 34.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.30%], valid : [loss = 0.848, top1 = 69.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3173/15625) 003173-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.544, top1 = 88.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.364, top1 = 91.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.304, top1 = 91.68%], valid : [loss = 1.300, top1 = 67.49%], test : [loss = 1.302, top1 = 67.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.06%], valid : [loss = 2.448, top1 = 38.32%], test : [loss = 2.452, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 69.08%], valid : [loss = 0.902, top1 = 68.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3174/15625) 003174-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.497, top1 = 89.99%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 92.97%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.40 ms.
cifar100       train : [loss = 0.096, top1 = 98.27%], valid : [loss = 1.263, top1 = 70.32%], test : [loss = 1.291, top1 = 70.04%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.94 ms.
ImageNet16-120 train : [loss = 1.630, top1 = 56.14%], valid : [loss = 2.159, top1 = 44.57%], test : [loss = 2.179, top1 = 44.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.42%], valid : [loss = 0.615, top1 = 79.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3175/15625) 003175-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.536, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.359, top1 = 92.24%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.74 ms.
cifar100       train : [loss = 0.107, top1 = 97.65%], valid : [loss = 1.440, top1 = 68.07%], test : [loss = 1.415, top1 = 68.63%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 2.165, top1 = 43.67%], valid : [loss = 2.397, top1 = 39.49%], test : [loss = 2.430, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.80%], valid : [loss = 0.983, top1 = 64.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3176/15625) 003176-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.64%], valid : [loss = 0.720, top1 = 80.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 0.178, top1 = 93.89%], test  : [loss = 0.509, top1 = 85.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.30 ms.
cifar100       train : [loss = 0.892, top1 = 74.05%], valid : [loss = 1.637, top1 = 57.27%], test : [loss = 1.663, top1 = 57.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 3.510, top1 = 16.68%], valid : [loss = 3.518, top1 = 16.69%], test : [loss = 3.531, top1 = 16.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3177/15625) 003177-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.54 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.310, top1 = 92.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.00 ms.
cifar100       train : [loss = 0.322, top1 = 91.31%], valid : [loss = 1.304, top1 = 67.29%], test : [loss = 1.325, top1 = 66.97%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.25%], valid : [loss = 2.374, top1 = 39.66%], test : [loss = 2.397, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3178/15625) 003178-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.72%], valid : [loss = 0.535, top1 = 88.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.352, top1 = 91.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.61 ms.
cifar100       train : [loss = 0.419, top1 = 87.77%], valid : [loss = 1.295, top1 = 66.36%], test : [loss = 1.292, top1 = 67.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.25%], valid : [loss = 2.406, top1 = 39.47%], test : [loss = 2.434, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3179/15625) 003179-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.590, top1 = 88.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.380, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.078, top1 = 98.72%], valid : [loss = 1.553, top1 = 67.47%], test : [loss = 1.531, top1 = 67.35%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.66%], valid : [loss = 2.452, top1 = 39.20%], test : [loss = 2.489, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.78%], valid : [loss = 0.695, top1 = 75.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3180/15625) 003180-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.06%], valid : [loss = 1.117, top1 = 63.01%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10        train : [loss = 0.780, top1 = 72.53%], test  : [loss = 0.917, top1 = 68.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.80 ms.
cifar100       train : [loss = 2.136, top1 = 44.14%], valid : [loss = 2.399, top1 = 39.59%], test : [loss = 2.426, top1 = 39.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 3.763, top1 = 13.91%], valid : [loss = 3.819, top1 = 14.22%], test : [loss = 3.836, top1 = 13.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3181/15625) 003181-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.480, top1 = 89.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.317, top1 = 91.49%], valid : [loss = 1.257, top1 = 67.52%], test : [loss = 1.268, top1 = 67.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.83%], valid : [loss = 2.318, top1 = 40.53%], test : [loss = 2.336, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3182/15625) 003182-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.61%], valid : [loss = 0.556, top1 = 82.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10        train : [loss = 0.258, top1 = 91.10%], test  : [loss = 0.414, top1 = 86.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.68 ms.
cifar100       train : [loss = 1.433, top1 = 59.74%], valid : [loss = 1.686, top1 = 53.73%], test : [loss = 1.666, top1 = 54.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.876, top1 = 29.02%], valid : [loss = 2.906, top1 = 28.89%], test : [loss = 2.952, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 66.00%], valid : [loss = 0.998, top1 = 64.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3183/15625) 003183-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.42 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.44%], valid : [loss = 0.563, top1 = 87.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.76 ms.
cifar10        train : [loss = 0.033, top1 = 99.00%], test  : [loss = 0.371, top1 = 91.01%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.28 ms.
cifar100       train : [loss = 0.480, top1 = 86.13%], valid : [loss = 1.325, top1 = 65.83%], test : [loss = 1.324, top1 = 65.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 33.94%], valid : [loss = 2.665, top1 = 32.41%], test : [loss = 2.693, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.64%], valid : [loss = 0.988, top1 = 64.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3184/15625) 003184-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.42%], valid : [loss = 0.909, top1 = 68.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10        train : [loss = 0.751, top1 = 73.32%], test  : [loss = 0.794, top1 = 72.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.99 ms.
cifar100       train : [loss = 2.334, top1 = 38.75%], valid : [loss = 2.428, top1 = 37.42%], test : [loss = 2.419, top1 = 37.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 3.574, top1 = 16.48%], valid : [loss = 3.563, top1 = 16.91%], test : [loss = 3.563, top1 = 16.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.10%], valid : [loss = 1.410, top1 = 48.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3185/15625) 003185-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.196, top1 = 93.39%], valid : [loss = 0.528, top1 = 84.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.209, top1 = 92.90%], test  : [loss = 0.403, top1 = 87.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 1.274, top1 = 63.86%], valid : [loss = 1.551, top1 = 57.44%], test : [loss = 1.565, top1 = 57.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.692, top1 = 32.71%], valid : [loss = 2.732, top1 = 31.64%], test : [loss = 2.775, top1 = 31.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.22%], valid : [loss = 0.961, top1 = 66.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3186/15625) 003186-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.46%], valid : [loss = 0.457, top1 = 86.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.157, top1 = 94.97%], test  : [loss = 0.346, top1 = 88.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.65 ms.
cifar100       train : [loss = 0.992, top1 = 71.77%], valid : [loss = 1.356, top1 = 62.05%], test : [loss = 1.340, top1 = 62.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.67%], valid : [loss = 2.692, top1 = 32.57%], test : [loss = 2.716, top1 = 31.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3187/15625) 003187-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.86%], valid : [loss = 0.863, top1 = 71.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.554, top1 = 80.74%], test  : [loss = 0.715, top1 = 75.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 1.779, top1 = 52.18%], valid : [loss = 2.054, top1 = 47.01%], test : [loss = 2.069, top1 = 46.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.80%], valid : [loss = 3.643, top1 = 16.17%], test : [loss = 3.663, top1 = 16.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3188/15625) 003188-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.608, top1 = 86.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.031, top1 = 99.15%], test  : [loss = 0.404, top1 = 90.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.62 ms.
cifar100       train : [loss = 0.537, top1 = 84.29%], valid : [loss = 1.430, top1 = 63.78%], test : [loss = 1.432, top1 = 63.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.47%], valid : [loss = 2.555, top1 = 35.38%], test : [loss = 2.567, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.74%], valid : [loss = 0.849, top1 = 70.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3189/15625) 003189-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.54%], valid : [loss = 0.461, top1 = 86.51%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10        train : [loss = 0.123, top1 = 96.19%], test  : [loss = 0.339, top1 = 89.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.64 ms.
cifar100       train : [loss = 0.755, top1 = 78.87%], valid : [loss = 1.278, top1 = 64.10%], test : [loss = 1.277, top1 = 64.73%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 36.52%], valid : [loss = 2.598, top1 = 35.02%], test : [loss = 2.615, top1 = 34.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3190/15625) 003190-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.07%], valid : [loss = 0.464, top1 = 86.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.159, top1 = 94.79%], test  : [loss = 0.348, top1 = 88.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.87 ms.
cifar100       train : [loss = 1.007, top1 = 71.42%], valid : [loss = 1.360, top1 = 61.92%], test : [loss = 1.368, top1 = 61.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.76%], valid : [loss = 2.693, top1 = 32.61%], test : [loss = 2.728, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3191/15625) 003191-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.38%], valid : [loss = 0.463, top1 = 86.00%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.90 ms.
cifar10        train : [loss = 0.163, top1 = 94.69%], test  : [loss = 0.360, top1 = 88.35%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.02 ms.
cifar100       train : [loss = 0.983, top1 = 72.19%], valid : [loss = 1.397, top1 = 61.07%], test : [loss = 1.397, top1 = 61.39%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 2.750, top1 = 31.47%], valid : [loss = 2.798, top1 = 30.57%], test : [loss = 2.818, top1 = 30.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.35%], valid : [loss = 0.960, top1 = 65.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3192/15625) 003192-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.415, top1 = 90.66%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.05 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.279, top1 = 93.28%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.53 ms.
cifar100       train : [loss = 0.096, top1 = 98.34%], valid : [loss = 1.256, top1 = 70.82%], test : [loss = 1.232, top1 = 71.13%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.47 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.85%], valid : [loss = 2.149, top1 = 45.67%], test : [loss = 2.169, top1 = 45.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.74%], valid : [loss = 0.519, top1 = 82.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3193/15625) 003193-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.526, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.028, top1 = 99.19%], test  : [loss = 0.350, top1 = 91.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.436, top1 = 87.32%], valid : [loss = 1.230, top1 = 67.66%], test : [loss = 1.246, top1 = 67.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.189, top1 = 43.37%], valid : [loss = 2.369, top1 = 40.01%], test : [loss = 2.399, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3194/15625) 003194-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.79%], valid : [loss = 0.618, top1 = 86.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.419, top1 = 90.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.316, top1 = 91.35%], valid : [loss = 1.546, top1 = 63.51%], test : [loss = 1.530, top1 = 63.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.196, top1 = 43.15%], valid : [loss = 2.517, top1 = 36.99%], test : [loss = 2.528, top1 = 36.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.15%], valid : [loss = 0.842, top1 = 70.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3195/15625) 003195-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.16%], valid : [loss = 0.844, top1 = 72.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.563, top1 = 80.27%], test  : [loss = 0.721, top1 = 75.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.24 ms.
cifar100       train : [loss = 1.782, top1 = 52.18%], valid : [loss = 2.055, top1 = 46.89%], test : [loss = 2.056, top1 = 46.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.90%], valid : [loss = 3.641, top1 = 16.72%], test : [loss = 3.660, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3196/15625) 003196-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.570, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.356, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.177, top1 = 96.02%], valid : [loss = 1.413, top1 = 67.41%], test : [loss = 1.434, top1 = 67.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.69%], valid : [loss = 2.468, top1 = 38.06%], test : [loss = 2.491, top1 = 38.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3197/15625) 003197-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.466, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.23 ms.
cifar100       train : [loss = 0.317, top1 = 91.58%], valid : [loss = 1.255, top1 = 67.77%], test : [loss = 1.244, top1 = 68.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.58%], valid : [loss = 2.309, top1 = 40.59%], test : [loss = 2.334, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.29%], valid : [loss = 0.587, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3198/15625) 003198-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.450, top1 = 89.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.54 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.317, top1 = 92.55%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.14 ms.
cifar100       train : [loss = 0.143, top1 = 96.96%], valid : [loss = 1.298, top1 = 69.24%], test : [loss = 1.280, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 1.735, top1 = 53.68%], valid : [loss = 2.215, top1 = 43.51%], test : [loss = 2.233, top1 = 43.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.07%], valid : [loss = 0.569, top1 = 80.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3199/15625) 003199-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.35%], valid : [loss = 0.627, top1 = 85.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.071, top1 = 97.84%], test  : [loss = 0.397, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.720, top1 = 78.99%], valid : [loss = 1.399, top1 = 62.75%], test : [loss = 1.388, top1 = 63.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.94%], valid : [loss = 2.659, top1 = 33.87%], test : [loss = 2.699, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3200/15625) 003200-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.559, top1 = 87.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.019, top1 = 99.46%], test  : [loss = 0.366, top1 = 91.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.298, top1 = 91.56%], valid : [loss = 1.325, top1 = 67.45%], test : [loss = 1.344, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 2.319, top1 = 40.27%], valid : [loss = 2.504, top1 = 36.68%], test : [loss = 2.514, top1 = 35.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.66%], valid : [loss = 0.984, top1 = 64.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3201/15625) 003201-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.64%], valid : [loss = 0.743, top1 = 74.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.507, top1 = 82.44%], test  : [loss = 0.582, top1 = 80.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.64 ms.
cifar100       train : [loss = 1.991, top1 = 46.18%], valid : [loss = 2.113, top1 = 43.92%], test : [loss = 2.123, top1 = 43.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.61 ms.
ImageNet16-120 train : [loss = 2.989, top1 = 26.87%], valid : [loss = 2.974, top1 = 27.13%], test : [loss = 3.014, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.73%], valid : [loss = 1.201, top1 = 57.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3202/15625) 003202-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.498, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.330, top1 = 92.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.67 ms.
cifar100       train : [loss = 0.355, top1 = 90.20%], valid : [loss = 1.293, top1 = 66.52%], test : [loss = 1.282, top1 = 67.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.66%], valid : [loss = 2.397, top1 = 38.99%], test : [loss = 2.424, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3203/15625) 003203-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.603, top1 = 87.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.387, top1 = 90.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.42 ms.
cifar100       train : [loss = 0.265, top1 = 93.19%], valid : [loss = 1.511, top1 = 64.52%], test : [loss = 1.527, top1 = 64.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.77%], valid : [loss = 2.507, top1 = 37.01%], test : [loss = 2.498, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.84%], valid : [loss = 0.778, top1 = 72.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3204/15625) 003204-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.80%], valid : [loss = 0.727, top1 = 83.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.088, top1 = 97.22%], test  : [loss = 0.499, top1 = 86.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.823, top1 = 75.96%], valid : [loss = 1.555, top1 = 59.40%], test : [loss = 1.547, top1 = 59.79%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.829, top1 = 30.04%], valid : [loss = 2.958, top1 = 28.12%], test : [loss = 2.997, top1 = 27.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.83%], valid : [loss = 0.883, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3205/15625) 003205-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.34%], valid : [loss = 0.582, top1 = 85.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10        train : [loss = 0.071, top1 = 97.64%], test  : [loss = 0.383, top1 = 89.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.613, top1 = 81.90%], valid : [loss = 1.367, top1 = 63.95%], test : [loss = 1.394, top1 = 63.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.742, top1 = 31.09%], valid : [loss = 2.781, top1 = 30.08%], test : [loss = 2.806, top1 = 30.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.088, top1 = 60.83%], valid : [loss = 1.112, top1 = 60.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3206/15625) 003206-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.17%], valid : [loss = 0.561, top1 = 86.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10        train : [loss = 0.059, top1 = 98.12%], test  : [loss = 0.378, top1 = 89.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.21 ms.
cifar100       train : [loss = 0.674, top1 = 80.19%], valid : [loss = 1.316, top1 = 64.22%], test : [loss = 1.337, top1 = 63.81%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 38.85%], valid : [loss = 2.522, top1 = 36.41%], test : [loss = 2.549, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.63%], valid : [loss = 0.843, top1 = 70.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3207/15625) 003207-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.41%], valid : [loss = 0.753, top1 = 74.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10        train : [loss = 0.556, top1 = 80.72%], test  : [loss = 0.616, top1 = 79.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.99 ms.
cifar100       train : [loss = 1.921, top1 = 48.31%], valid : [loss = 2.048, top1 = 45.92%], test : [loss = 2.051, top1 = 45.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.74 ms.
ImageNet16-120 train : [loss = 3.277, top1 = 21.61%], valid : [loss = 3.246, top1 = 23.06%], test : [loss = 3.298, top1 = 21.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.317, top1 = 51.88%], valid : [loss = 1.366, top1 = 51.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3208/15625) 003208-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.69 ms.
cifar10-valid  train : [loss = 1.005, top1 = 64.50%], valid : [loss = 1.043, top1 = 63.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.20 ms.
cifar10        train : [loss = 0.981, top1 = 65.55%], test  : [loss = 0.989, top1 = 64.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.68 ms.
cifar100       train : [loss = 2.427, top1 = 37.82%], valid : [loss = 2.512, top1 = 36.11%], test : [loss = 2.489, top1 = 36.27%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.25 ms.
ImageNet16-120 train : [loss = 3.641, top1 = 15.65%], valid : [loss = 3.609, top1 = 17.09%], test : [loss = 3.639, top1 = 15.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.596, top1 = 40.44%], valid : [loss = 1.651, top1 = 37.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3209/15625) 003209-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.451, top1 = 89.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.310, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.228, top1 = 94.40%], valid : [loss = 1.269, top1 = 68.71%], test : [loss = 1.285, top1 = 68.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.28%], valid : [loss = 2.279, top1 = 42.01%], test : [loss = 2.285, top1 = 42.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.89%], valid : [loss = 0.541, top1 = 81.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3210/15625) 003210-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.36%], valid : [loss = 0.859, top1 = 71.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10        train : [loss = 0.547, top1 = 80.78%], test  : [loss = 0.713, top1 = 75.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.87 ms.
cifar100       train : [loss = 1.764, top1 = 52.47%], valid : [loss = 2.037, top1 = 47.18%], test : [loss = 2.049, top1 = 47.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 16.96%], valid : [loss = 3.619, top1 = 16.68%], test : [loss = 3.664, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3211/15625) 003211-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.17%], valid : [loss = 0.650, top1 = 84.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.052, top1 = 98.44%], test  : [loss = 0.411, top1 = 89.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.630, top1 = 81.52%], valid : [loss = 1.449, top1 = 62.58%], test : [loss = 1.426, top1 = 63.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.471, top1 = 37.27%], valid : [loss = 2.624, top1 = 34.43%], test : [loss = 2.646, top1 = 34.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.38%], valid : [loss = 0.888, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3212/15625) 003212-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.86%], valid : [loss = 0.762, top1 = 82.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10        train : [loss = 0.089, top1 = 97.15%], test  : [loss = 0.498, top1 = 86.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.12 ms.
cifar100       train : [loss = 0.815, top1 = 76.35%], valid : [loss = 1.538, top1 = 59.96%], test : [loss = 1.517, top1 = 60.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.805, top1 = 30.55%], valid : [loss = 2.919, top1 = 29.03%], test : [loss = 2.985, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.55%], valid : [loss = 0.867, top1 = 69.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3213/15625) 003213-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.13 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.35 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3214/15625) 003214-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.83%], valid : [loss = 0.612, top1 = 84.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.085, top1 = 97.21%], test  : [loss = 0.411, top1 = 88.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.15 ms.
cifar100       train : [loss = 0.691, top1 = 79.69%], valid : [loss = 1.499, top1 = 61.00%], test : [loss = 1.510, top1 = 61.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 3.189, top1 = 22.16%], valid : [loss = 3.210, top1 = 22.00%], test : [loss = 3.235, top1 = 21.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 62.06%], valid : [loss = 1.066, top1 = 61.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3215/15625) 003215-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.32%], valid : [loss = 0.575, top1 = 86.93%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.67 ms.
cifar10        train : [loss = 0.057, top1 = 98.23%], test  : [loss = 0.375, top1 = 89.96%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.43 ms.
cifar100       train : [loss = 0.577, top1 = 83.17%], valid : [loss = 1.292, top1 = 65.97%], test : [loss = 1.303, top1 = 65.45%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.21%], valid : [loss = 2.438, top1 = 38.38%], test : [loss = 2.435, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.92%], valid : [loss = 0.735, top1 = 74.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3216/15625) 003216-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.58%], valid : [loss = 0.861, top1 = 71.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.551, top1 = 80.79%], test  : [loss = 0.717, top1 = 75.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 1.771, top1 = 52.35%], valid : [loss = 2.050, top1 = 46.99%], test : [loss = 2.067, top1 = 46.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.84%], valid : [loss = 3.646, top1 = 16.24%], test : [loss = 3.670, top1 = 15.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3217/15625) 003217-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.61 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.38%], valid : [loss = 0.454, top1 = 86.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.113, top1 = 96.53%], test  : [loss = 0.329, top1 = 89.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 0.857, top1 = 75.54%], valid : [loss = 1.300, top1 = 64.28%], test : [loss = 1.274, top1 = 64.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.41 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.60%], valid : [loss = 2.634, top1 = 34.38%], test : [loss = 2.658, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3218/15625) 003218-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.495, top1 = 88.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.318, top1 = 91.47%], valid : [loss = 1.263, top1 = 67.42%], test : [loss = 1.266, top1 = 67.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.028, top1 = 46.90%], valid : [loss = 2.310, top1 = 40.36%], test : [loss = 2.337, top1 = 41.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.29%], valid : [loss = 0.617, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3219/15625) 003219-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.38%], valid : [loss = 0.911, top1 = 76.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.229, top1 = 92.11%], test  : [loss = 0.599, top1 = 82.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.51 ms.
cifar100       train : [loss = 1.177, top1 = 66.73%], valid : [loss = 1.791, top1 = 53.37%], test : [loss = 1.769, top1 = 54.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 3.222, top1 = 22.81%], valid : [loss = 3.311, top1 = 21.71%], test : [loss = 3.353, top1 = 20.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.54%], valid : [loss = 1.076, top1 = 61.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3220/15625) 003220-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.00%], valid : [loss = 0.648, top1 = 78.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.511, top1 = 82.34%], test  : [loss = 0.586, top1 = 80.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 1.686, top1 = 54.25%], valid : [loss = 1.850, top1 = 50.52%], test : [loss = 1.861, top1 = 50.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.33%], valid : [loss = 3.315, top1 = 21.19%], test : [loss = 3.338, top1 = 21.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3221/15625) 003221-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.38%], valid : [loss = 1.108, top1 = 63.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10        train : [loss = 0.777, top1 = 72.65%], test  : [loss = 0.919, top1 = 68.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.32 ms.
cifar100       train : [loss = 2.126, top1 = 44.14%], valid : [loss = 2.411, top1 = 39.35%], test : [loss = 2.423, top1 = 39.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 3.759, top1 = 14.01%], valid : [loss = 3.821, top1 = 13.67%], test : [loss = 3.825, top1 = 13.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 50.71%], valid : [loss = 1.405, top1 = 48.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3222/15625) 003222-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.06 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.45%], valid : [loss = 0.470, top1 = 85.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10        train : [loss = 0.151, top1 = 95.16%], test  : [loss = 0.341, top1 = 89.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.80 ms.
cifar100       train : [loss = 0.983, top1 = 72.17%], valid : [loss = 1.345, top1 = 62.47%], test : [loss = 1.340, top1 = 62.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.00%], valid : [loss = 2.690, top1 = 32.72%], test : [loss = 2.699, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3223/15625) 003223-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.90 ms.
cifar10-valid  train : [loss = 1.084, top1 = 61.60%], valid : [loss = 1.134, top1 = 60.04%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.87 ms.
cifar10        train : [loss = 1.034, top1 = 63.55%], test  : [loss = 1.034, top1 = 63.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.88 ms.
cifar100       train : [loss = 2.576, top1 = 34.94%], valid : [loss = 2.656, top1 = 33.25%], test : [loss = 2.628, top1 = 34.19%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.31 ms.
ImageNet16-120 train : [loss = 3.785, top1 = 13.66%], valid : [loss = 3.775, top1 = 14.09%], test : [loss = 3.787, top1 = 13.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3224/15625) 003224-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10-valid  train : [loss = 0.489, top1 = 83.05%], valid : [loss = 0.653, top1 = 78.09%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10        train : [loss = 0.510, top1 = 82.33%], test  : [loss = 0.587, top1 = 79.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.22 ms.
cifar100       train : [loss = 1.684, top1 = 54.34%], valid : [loss = 1.853, top1 = 50.79%], test : [loss = 1.866, top1 = 50.81%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.85 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.26%], valid : [loss = 3.316, top1 = 21.49%], test : [loss = 3.350, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3225/15625) 003225-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.607, top1 = 87.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.410, top1 = 90.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.21 ms.
cifar100       train : [loss = 0.205, top1 = 95.25%], valid : [loss = 1.437, top1 = 66.47%], test : [loss = 1.439, top1 = 66.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.92%], valid : [loss = 2.484, top1 = 38.30%], test : [loss = 2.521, top1 = 37.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3226/15625) 003226-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.534, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.342, top1 = 91.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.324, top1 = 91.15%], valid : [loss = 1.246, top1 = 67.99%], test : [loss = 1.263, top1 = 67.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.17%], valid : [loss = 2.344, top1 = 40.01%], test : [loss = 2.365, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.11%], valid : [loss = 0.779, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3227/15625) 003227-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.49%], valid : [loss = 0.570, top1 = 84.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.105, top1 = 96.63%], test  : [loss = 0.376, top1 = 89.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.834, top1 = 75.55%], valid : [loss = 1.418, top1 = 62.19%], test : [loss = 1.419, top1 = 61.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.515, top1 = 36.20%], valid : [loss = 2.616, top1 = 34.02%], test : [loss = 2.636, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.20%], valid : [loss = 0.857, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3228/15625) 003228-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.351, top1 = 87.63%], valid : [loss = 0.590, top1 = 80.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10        train : [loss = 0.289, top1 = 90.02%], test  : [loss = 0.427, top1 = 85.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.54 ms.
cifar100       train : [loss = 1.543, top1 = 56.79%], valid : [loss = 1.787, top1 = 51.71%], test : [loss = 1.784, top1 = 51.51%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.15%], valid : [loss = 2.924, top1 = 28.31%], test : [loss = 2.982, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.028, top1 = 62.96%], valid : [loss = 1.080, top1 = 61.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3229/15625) 003229-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.26%], valid : [loss = 0.457, top1 = 86.82%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.83 ms.
cifar10        train : [loss = 0.112, top1 = 96.51%], test  : [loss = 0.324, top1 = 89.67%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.13 ms.
cifar100       train : [loss = 0.855, top1 = 75.71%], valid : [loss = 1.285, top1 = 64.13%], test : [loss = 1.287, top1 = 63.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.69%], valid : [loss = 2.631, top1 = 33.66%], test : [loss = 2.668, top1 = 33.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.40%], valid : [loss = 0.679, top1 = 76.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3230/15625) 003230-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.53%], valid : [loss = 0.559, top1 = 87.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.030, top1 = 99.12%], test  : [loss = 0.366, top1 = 90.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.509, top1 = 85.24%], valid : [loss = 1.347, top1 = 64.72%], test : [loss = 1.344, top1 = 64.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.34%], valid : [loss = 2.630, top1 = 33.82%], test : [loss = 2.656, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3231/15625) 003231-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.59%], valid : [loss = 0.704, top1 = 75.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.18 ms.
cifar10        train : [loss = 0.542, top1 = 81.43%], test  : [loss = 0.604, top1 = 79.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.27 ms.
cifar100       train : [loss = 1.946, top1 = 47.78%], valid : [loss = 2.075, top1 = 45.18%], test : [loss = 2.053, top1 = 45.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.47%], valid : [loss = 3.201, top1 = 22.94%], test : [loss = 3.233, top1 = 22.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.279, top1 = 53.96%], valid : [loss = 1.368, top1 = 50.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3232/15625) 003232-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.32%], valid : [loss = 0.594, top1 = 85.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.071, top1 = 97.82%], test  : [loss = 0.393, top1 = 89.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.723, top1 = 79.04%], valid : [loss = 1.389, top1 = 63.28%], test : [loss = 1.357, top1 = 63.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 36.01%], valid : [loss = 2.657, top1 = 33.47%], test : [loss = 2.682, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.24%], valid : [loss = 0.786, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3233/15625) 003233-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.480, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.26 ms.
cifar100       train : [loss = 0.316, top1 = 91.54%], valid : [loss = 1.247, top1 = 67.87%], test : [loss = 1.253, top1 = 67.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.76%], valid : [loss = 2.307, top1 = 40.99%], test : [loss = 2.330, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.97%], valid : [loss = 0.596, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3234/15625) 003234-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.536, top1 = 88.96%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.54 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.345, top1 = 92.59%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.62 ms.
cifar100       train : [loss = 0.140, top1 = 96.78%], valid : [loss = 1.375, top1 = 68.55%], test : [loss = 1.387, top1 = 68.13%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.88%], valid : [loss = 2.336, top1 = 40.42%], test : [loss = 2.337, top1 = 41.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.98%], valid : [loss = 0.873, top1 = 68.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3235/15625) 003235-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.506, top1 = 88.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.335, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.60 ms.
cifar100       train : [loss = 0.339, top1 = 90.76%], valid : [loss = 1.277, top1 = 67.43%], test : [loss = 1.283, top1 = 67.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.58%], valid : [loss = 2.407, top1 = 38.87%], test : [loss = 2.395, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3236/15625) 003236-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.321, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.23 ms.
cifar100       train : [loss = 0.321, top1 = 91.33%], valid : [loss = 1.305, top1 = 67.29%], test : [loss = 1.329, top1 = 66.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.37%], valid : [loss = 2.352, top1 = 40.02%], test : [loss = 2.384, top1 = 40.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3237/15625) 003237-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.492, top1 = 89.23%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.61 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.294, top1 = 92.83%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.42 ms.
cifar100       train : [loss = 0.246, top1 = 93.68%], valid : [loss = 1.229, top1 = 68.84%], test : [loss = 1.238, top1 = 69.13%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.41%], valid : [loss = 2.193, top1 = 43.32%], test : [loss = 2.230, top1 = 43.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.47%], valid : [loss = 0.641, top1 = 77.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3238/15625) 003238-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.554, top1 = 87.19%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.45 ms.
cifar10        train : [loss = 0.041, top1 = 98.81%], test  : [loss = 0.366, top1 = 90.39%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.26 ms.
cifar100       train : [loss = 0.526, top1 = 84.75%], valid : [loss = 1.303, top1 = 65.53%], test : [loss = 1.296, top1 = 65.85%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.39 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.08%], valid : [loss = 2.421, top1 = 38.07%], test : [loss = 2.436, top1 = 38.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.00%], valid : [loss = 0.746, top1 = 74.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3239/15625) 003239-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.71%], valid : [loss = 0.547, top1 = 83.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10        train : [loss = 0.209, top1 = 92.94%], test  : [loss = 0.399, top1 = 87.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 1.277, top1 = 63.63%], valid : [loss = 1.563, top1 = 57.10%], test : [loss = 1.562, top1 = 56.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.701, top1 = 32.54%], valid : [loss = 2.726, top1 = 31.94%], test : [loss = 2.773, top1 = 31.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 65.76%], valid : [loss = 1.006, top1 = 64.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3240/15625) 003240-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.552, top1 = 88.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.026, top1 = 99.28%], test  : [loss = 0.361, top1 = 91.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.49 ms.
cifar100       train : [loss = 0.416, top1 = 87.83%], valid : [loss = 1.261, top1 = 67.29%], test : [loss = 1.252, top1 = 67.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.47%], valid : [loss = 2.381, top1 = 39.42%], test : [loss = 2.396, top1 = 39.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.06%], valid : [loss = 0.857, top1 = 69.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3241/15625) 003241-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.16%], valid : [loss = 0.560, top1 = 82.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.39 ms.
cifar10        train : [loss = 0.228, top1 = 92.22%], test  : [loss = 0.404, top1 = 87.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 1.324, top1 = 62.31%], valid : [loss = 1.604, top1 = 55.97%], test : [loss = 1.589, top1 = 56.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.755, top1 = 31.48%], valid : [loss = 2.792, top1 = 30.78%], test : [loss = 2.811, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.75%], valid : [loss = 1.007, top1 = 64.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3242/15625) 003242-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.150, top1 = 95.09%], valid : [loss = 0.507, top1 = 85.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.165, top1 = 94.49%], test  : [loss = 0.387, top1 = 88.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 1.082, top1 = 69.13%], valid : [loss = 1.450, top1 = 60.05%], test : [loss = 1.435, top1 = 60.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.21%], valid : [loss = 2.671, top1 = 33.64%], test : [loss = 2.706, top1 = 33.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.52%], valid : [loss = 0.955, top1 = 66.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3243/15625) 003243-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.62 ms.
cifar10-valid  train : [loss = 0.480, top1 = 83.21%], valid : [loss = 0.649, top1 = 78.16%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10        train : [loss = 0.512, top1 = 82.34%], test  : [loss = 0.596, top1 = 79.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.36 ms.
cifar100       train : [loss = 1.683, top1 = 54.26%], valid : [loss = 1.858, top1 = 50.61%], test : [loss = 1.864, top1 = 50.75%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.20 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 21.42%], valid : [loss = 3.312, top1 = 21.69%], test : [loss = 3.351, top1 = 21.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3244/15625) 003244-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.98%], valid : [loss = 0.450, top1 = 86.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.51 ms.
cifar10        train : [loss = 0.150, top1 = 95.09%], test  : [loss = 0.344, top1 = 88.75%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.34 ms.
cifar100       train : [loss = 0.961, top1 = 72.62%], valid : [loss = 1.333, top1 = 62.91%], test : [loss = 1.329, top1 = 62.99%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.32%], valid : [loss = 2.668, top1 = 33.26%], test : [loss = 2.694, top1 = 32.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.51%], valid : [loss = 0.738, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3245/15625) 003245-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.06%], valid : [loss = 0.676, top1 = 77.00%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.594, top1 = 79.34%], test  : [loss = 0.649, top1 = 77.89%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.96 ms.
cifar100       train : [loss = 1.749, top1 = 52.36%], valid : [loss = 1.896, top1 = 50.16%], test : [loss = 1.922, top1 = 49.22%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.36 ms.
ImageNet16-120 train : [loss = 3.389, top1 = 20.06%], valid : [loss = 3.368, top1 = 20.28%], test : [loss = 3.415, top1 = 19.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3246/15625) 003246-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.622, top1 = 86.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.398, top1 = 89.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.44 ms.
cifar100       train : [loss = 0.516, top1 = 84.90%], valid : [loss = 1.442, top1 = 63.68%], test : [loss = 1.422, top1 = 64.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 38.99%], valid : [loss = 2.540, top1 = 35.98%], test : [loss = 2.585, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.38%], valid : [loss = 0.843, top1 = 70.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3247/15625) 003247-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.425, top1 = 90.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.291, top1 = 93.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.82 ms.
cifar100       train : [loss = 0.135, top1 = 97.21%], valid : [loss = 1.279, top1 = 70.05%], test : [loss = 1.292, top1 = 69.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 1.739, top1 = 53.62%], valid : [loss = 2.242, top1 = 43.34%], test : [loss = 2.271, top1 = 43.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.29%], valid : [loss = 0.535, top1 = 81.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3248/15625) 003248-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.81%], valid : [loss = 0.548, top1 = 88.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.362, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.04 ms.
cifar100       train : [loss = 0.251, top1 = 93.19%], valid : [loss = 1.331, top1 = 67.58%], test : [loss = 1.362, top1 = 67.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.27%], valid : [loss = 2.478, top1 = 37.19%], test : [loss = 2.500, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 67.83%], valid : [loss = 0.912, top1 = 67.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3249/15625) 003249-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.53%], valid : [loss = 0.461, top1 = 86.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.153, top1 = 95.00%], test  : [loss = 0.340, top1 = 88.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.979, top1 = 72.04%], valid : [loss = 1.356, top1 = 61.87%], test : [loss = 1.346, top1 = 62.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 33.94%], valid : [loss = 2.691, top1 = 32.64%], test : [loss = 2.706, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3250/15625) 003250-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.517, top1 = 89.53%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.03 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.316, top1 = 93.28%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.46 ms.
cifar100       train : [loss = 0.058, top1 = 99.14%], valid : [loss = 1.392, top1 = 69.70%], test : [loss = 1.358, top1 = 70.55%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.46%], valid : [loss = 2.354, top1 = 39.90%], test : [loss = 2.367, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.28%], valid : [loss = 0.784, top1 = 72.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3251/15625) 003251-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.565, top1 = 87.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.381, top1 = 91.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.15 ms.
cifar100       train : [loss = 0.343, top1 = 90.46%], valid : [loss = 1.422, top1 = 65.29%], test : [loss = 1.426, top1 = 65.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.10%], valid : [loss = 2.475, top1 = 37.67%], test : [loss = 2.507, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.68%], valid : [loss = 0.828, top1 = 70.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3252/15625) 003252-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.498, top1 = 88.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.48 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.333, top1 = 92.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.37 ms.
cifar100       train : [loss = 0.326, top1 = 91.21%], valid : [loss = 1.293, top1 = 66.84%], test : [loss = 1.279, top1 = 67.79%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.22%], valid : [loss = 2.403, top1 = 39.00%], test : [loss = 2.415, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3253/15625) 003253-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.68%], valid : [loss = 0.845, top1 = 71.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.672, top1 = 76.48%], test  : [loss = 0.758, top1 = 73.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 1.945, top1 = 48.41%], valid : [loss = 2.107, top1 = 45.59%], test : [loss = 2.154, top1 = 44.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 3.642, top1 = 15.91%], valid : [loss = 3.665, top1 = 15.82%], test : [loss = 3.692, top1 = 14.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3254/15625) 003254-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.514, top1 = 89.80%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.334, top1 = 92.92%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.34 ms.
cifar100       train : [loss = 0.117, top1 = 97.48%], valid : [loss = 1.365, top1 = 68.85%], test : [loss = 1.356, top1 = 69.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 1.694, top1 = 54.72%], valid : [loss = 2.163, top1 = 44.32%], test : [loss = 2.153, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.01%], valid : [loss = 0.784, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3255/15625) 003255-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.423, top1 = 91.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.280, top1 = 93.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.63 ms.
cifar100       train : [loss = 0.064, top1 = 99.05%], valid : [loss = 1.339, top1 = 70.49%], test : [loss = 1.321, top1 = 70.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 1.511, top1 = 59.12%], valid : [loss = 2.208, top1 = 43.98%], test : [loss = 2.221, top1 = 44.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 88.12%], valid : [loss = 0.496, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3256/15625) 003256-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.430, top1 = 90.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.281, top1 = 93.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.97 ms.
cifar100       train : [loss = 0.171, top1 = 96.00%], valid : [loss = 1.248, top1 = 69.98%], test : [loss = 1.262, top1 = 70.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.12%], valid : [loss = 2.233, top1 = 43.29%], test : [loss = 2.284, top1 = 42.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.10%], valid : [loss = 0.496, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3257/15625) 003257-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.73%], valid : [loss = 0.636, top1 = 84.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.087, top1 = 97.22%], test  : [loss = 0.402, top1 = 88.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.795, top1 = 76.70%], valid : [loss = 1.425, top1 = 61.95%], test : [loss = 1.408, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.78%], valid : [loss = 2.733, top1 = 32.69%], test : [loss = 2.769, top1 = 31.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.10%], valid : [loss = 0.833, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3258/15625) 003258-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.66%], valid : [loss = 0.850, top1 = 72.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 0.560, top1 = 80.46%], test  : [loss = 0.718, top1 = 75.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 1.777, top1 = 52.14%], valid : [loss = 2.055, top1 = 46.93%], test : [loss = 2.055, top1 = 46.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.79%], valid : [loss = 3.649, top1 = 16.20%], test : [loss = 3.667, top1 = 15.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.197, top1 = 56.94%], valid : [loss = 1.261, top1 = 54.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3259/15625) 003259-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.46%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.327, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.57 ms.
cifar100       train : [loss = 0.121, top1 = 97.62%], valid : [loss = 1.310, top1 = 69.51%], test : [loss = 1.295, top1 = 69.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.71%], valid : [loss = 2.267, top1 = 42.14%], test : [loss = 2.245, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.00%], valid : [loss = 0.662, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3260/15625) 003260-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.35%], valid : [loss = 0.645, top1 = 84.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.058, top1 = 98.11%], test  : [loss = 0.426, top1 = 89.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 0.536, top1 = 84.34%], valid : [loss = 1.572, top1 = 60.78%], test : [loss = 1.581, top1 = 60.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.826, top1 = 29.75%], valid : [loss = 2.928, top1 = 28.13%], test : [loss = 2.970, top1 = 27.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.21%], valid : [loss = 1.049, top1 = 62.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3261/15625) 003261-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.432, top1 = 90.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.296, top1 = 92.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.12 ms.
cifar100       train : [loss = 0.188, top1 = 95.59%], valid : [loss = 1.294, top1 = 68.77%], test : [loss = 1.278, top1 = 69.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.40%], valid : [loss = 2.267, top1 = 42.37%], test : [loss = 2.268, top1 = 43.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.93%], valid : [loss = 0.531, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3262/15625) 003262-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.49%], valid : [loss = 0.565, top1 = 87.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.035, top1 = 99.00%], test  : [loss = 0.369, top1 = 90.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 0.467, top1 = 86.33%], valid : [loss = 1.319, top1 = 65.58%], test : [loss = 1.336, top1 = 65.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 2.683, top1 = 32.36%], valid : [loss = 2.742, top1 = 30.70%], test : [loss = 2.758, top1 = 30.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.122, top1 = 59.16%], valid : [loss = 1.147, top1 = 58.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3263/15625) 003263-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.498, top1 = 89.56%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.317, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.84 ms.
cifar100       train : [loss = 0.144, top1 = 96.98%], valid : [loss = 1.293, top1 = 68.97%], test : [loss = 1.283, top1 = 69.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.772, top1 = 52.77%], valid : [loss = 2.213, top1 = 43.31%], test : [loss = 2.189, top1 = 44.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.29%], valid : [loss = 0.608, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3264/15625) 003264-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.470, top1 = 89.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.297, top1 = 92.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.317, top1 = 91.55%], valid : [loss = 1.254, top1 = 67.41%], test : [loss = 1.255, top1 = 67.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.77%], valid : [loss = 2.307, top1 = 40.67%], test : [loss = 2.350, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3265/15625) 003265-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.61%], valid : [loss = 0.909, top1 = 76.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.212, top1 = 92.73%], test  : [loss = 0.597, top1 = 82.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.89 ms.
cifar100       train : [loss = 1.160, top1 = 66.95%], valid : [loss = 1.784, top1 = 53.82%], test : [loss = 1.762, top1 = 54.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 3.217, top1 = 22.93%], valid : [loss = 3.322, top1 = 21.31%], test : [loss = 3.369, top1 = 20.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.046, top1 = 62.50%], valid : [loss = 1.100, top1 = 61.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3266/15625) 003266-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.535, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.348, top1 = 91.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 0.298, top1 = 91.85%], valid : [loss = 1.312, top1 = 67.35%], test : [loss = 1.314, top1 = 67.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.86%], valid : [loss = 2.425, top1 = 38.57%], test : [loss = 2.443, top1 = 38.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.32%], valid : [loss = 0.897, top1 = 68.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3267/15625) 003267-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.500, top1 = 89.05%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.92 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.321, top1 = 92.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.56 ms.
cifar100       train : [loss = 0.189, top1 = 95.57%], valid : [loss = 1.238, top1 = 69.15%], test : [loss = 1.246, top1 = 69.61%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.35 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.61%], valid : [loss = 2.275, top1 = 41.80%], test : [loss = 2.306, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.45%], valid : [loss = 0.773, top1 = 73.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3268/15625) 003268-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.288, top1 = 90.19%], valid : [loss = 0.558, top1 = 82.34%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.33 ms.
cifar10        train : [loss = 0.272, top1 = 90.71%], test  : [loss = 0.420, top1 = 86.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.80 ms.
cifar100       train : [loss = 1.401, top1 = 60.79%], valid : [loss = 1.664, top1 = 55.09%], test : [loss = 1.667, top1 = 55.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 3.015, top1 = 26.63%], valid : [loss = 3.024, top1 = 26.63%], test : [loss = 3.095, top1 = 25.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.083, top1 = 60.98%], valid : [loss = 1.115, top1 = 60.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3269/15625) 003269-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.324, top1 = 88.76%], valid : [loss = 0.583, top1 = 81.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10        train : [loss = 0.268, top1 = 90.84%], test  : [loss = 0.437, top1 = 85.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.65 ms.
cifar100       train : [loss = 1.353, top1 = 61.75%], valid : [loss = 1.686, top1 = 54.92%], test : [loss = 1.676, top1 = 54.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.979, top1 = 27.39%], valid : [loss = 3.014, top1 = 26.83%], test : [loss = 3.068, top1 = 26.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.36%], valid : [loss = 1.210, top1 = 56.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3270/15625) 003270-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.89%], valid : [loss = 0.540, top1 = 83.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.274, top1 = 90.63%], test  : [loss = 0.422, top1 = 86.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.376, top1 = 61.30%], valid : [loss = 1.609, top1 = 55.61%], test : [loss = 1.603, top1 = 56.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.900, top1 = 28.79%], valid : [loss = 2.907, top1 = 28.56%], test : [loss = 2.958, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.64%], valid : [loss = 1.018, top1 = 63.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3271/15625) 003271-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.74%], valid : [loss = 0.447, top1 = 86.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10        train : [loss = 0.146, top1 = 95.32%], test  : [loss = 0.343, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 0.962, top1 = 72.64%], valid : [loss = 1.338, top1 = 62.61%], test : [loss = 1.333, top1 = 62.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.36%], valid : [loss = 2.669, top1 = 33.24%], test : [loss = 2.701, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3272/15625) 003272-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.499, top1 = 90.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.12 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.337, top1 = 93.13%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.63 ms.
cifar100       train : [loss = 0.071, top1 = 98.94%], valid : [loss = 1.299, top1 = 70.37%], test : [loss = 1.337, top1 = 69.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.52 ms.
ImageNet16-120 train : [loss = 1.632, top1 = 56.16%], valid : [loss = 2.196, top1 = 43.99%], test : [loss = 2.194, top1 = 44.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.493, top1 = 83.04%], valid : [loss = 0.588, top1 = 79.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3273/15625) 003273-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.481, top1 = 89.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.49 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.330, top1 = 92.31%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.10 ms.
cifar100       train : [loss = 0.214, top1 = 94.59%], valid : [loss = 1.370, top1 = 67.40%], test : [loss = 1.341, top1 = 67.99%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.39%], valid : [loss = 2.308, top1 = 41.62%], test : [loss = 2.352, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.55%], valid : [loss = 0.679, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3274/15625) 003274-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.330, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.35 ms.
cifar100       train : [loss = 0.337, top1 = 90.75%], valid : [loss = 1.281, top1 = 67.25%], test : [loss = 1.293, top1 = 67.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.91%], valid : [loss = 2.384, top1 = 39.98%], test : [loss = 2.403, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3275/15625) 003275-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.483, top1 = 90.20%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.317, top1 = 93.29%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.77 ms.
cifar100       train : [loss = 0.063, top1 = 99.14%], valid : [loss = 1.315, top1 = 70.59%], test : [loss = 1.310, top1 = 70.35%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.556, top1 = 58.03%], valid : [loss = 2.182, top1 = 44.37%], test : [loss = 2.167, top1 = 45.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.59%], valid : [loss = 0.662, top1 = 77.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3276/15625) 003276-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.618, top1 = 87.43%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.46 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.390, top1 = 91.68%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.50 ms.
cifar100       train : [loss = 0.136, top1 = 97.03%], valid : [loss = 1.576, top1 = 65.08%], test : [loss = 1.563, top1 = 65.15%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.86%], valid : [loss = 2.404, top1 = 39.86%], test : [loss = 2.425, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.44%], valid : [loss = 0.809, top1 = 71.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3277/15625) 003277-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.327, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.15 ms.
cifar100       train : [loss = 0.149, top1 = 96.95%], valid : [loss = 1.319, top1 = 68.95%], test : [loss = 1.295, top1 = 68.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.10%], valid : [loss = 2.307, top1 = 41.26%], test : [loss = 2.299, top1 = 41.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.70%], valid : [loss = 0.750, top1 = 73.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3278/15625) 003278-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.21%], valid : [loss = 0.593, top1 = 85.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.069, top1 = 97.94%], test  : [loss = 0.410, top1 = 88.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.64 ms.
cifar100       train : [loss = 0.718, top1 = 79.13%], valid : [loss = 1.407, top1 = 62.80%], test : [loss = 1.380, top1 = 63.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.21%], valid : [loss = 2.655, top1 = 33.81%], test : [loss = 2.689, top1 = 33.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3279/15625) 003279-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.63%], valid : [loss = 0.575, top1 = 87.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.039, top1 = 98.87%], test  : [loss = 0.403, top1 = 89.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.546, top1 = 83.93%], valid : [loss = 1.397, top1 = 64.63%], test : [loss = 1.377, top1 = 64.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.472, top1 = 37.32%], valid : [loss = 2.611, top1 = 34.11%], test : [loss = 2.662, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.17%], valid : [loss = 0.642, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3280/15625) 003280-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.458, top1 = 89.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.313, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.51 ms.
cifar100       train : [loss = 0.325, top1 = 91.19%], valid : [loss = 1.301, top1 = 67.43%], test : [loss = 1.296, top1 = 67.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.46%], valid : [loss = 2.359, top1 = 40.70%], test : [loss = 2.401, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.445, top1 = 84.64%], valid : [loss = 0.544, top1 = 81.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3281/15625) 003281-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.78%], valid : [loss = 0.886, top1 = 77.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 0.229, top1 = 92.06%], test  : [loss = 0.575, top1 = 82.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 1.162, top1 = 66.95%], valid : [loss = 1.816, top1 = 53.04%], test : [loss = 1.793, top1 = 54.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.230, top1 = 22.70%], valid : [loss = 3.325, top1 = 21.23%], test : [loss = 3.368, top1 = 20.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3282/15625) 003282-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.561, top1 = 87.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.28 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.390, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.25 ms.
cifar100       train : [loss = 0.408, top1 = 88.45%], valid : [loss = 1.386, top1 = 65.20%], test : [loss = 1.389, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.75%], valid : [loss = 2.498, top1 = 36.93%], test : [loss = 2.542, top1 = 36.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.67%], valid : [loss = 0.790, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3283/15625) 003283-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.71%], valid : [loss = 0.862, top1 = 72.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.548, top1 = 80.78%], test  : [loss = 0.709, top1 = 75.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.95 ms.
cifar100       train : [loss = 1.765, top1 = 52.47%], valid : [loss = 2.050, top1 = 46.85%], test : [loss = 2.057, top1 = 46.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.93%], valid : [loss = 3.626, top1 = 16.50%], test : [loss = 3.665, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3284/15625) 003284-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.611, top1 = 85.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10        train : [loss = 0.073, top1 = 97.77%], test  : [loss = 0.399, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.82 ms.
cifar100       train : [loss = 0.702, top1 = 79.69%], valid : [loss = 1.362, top1 = 63.94%], test : [loss = 1.360, top1 = 63.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 36.07%], valid : [loss = 2.658, top1 = 33.57%], test : [loss = 2.704, top1 = 32.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.26%], valid : [loss = 0.776, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3285/15625) 003285-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.85%], valid : [loss = 0.516, top1 = 82.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.395, top1 = 86.57%], test  : [loss = 0.457, top1 = 84.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.97 ms.
cifar100       train : [loss = 1.517, top1 = 58.22%], valid : [loss = 1.644, top1 = 54.85%], test : [loss = 1.637, top1 = 54.97%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 26.47%], valid : [loss = 3.010, top1 = 26.87%], test : [loss = 3.046, top1 = 26.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.118, top1 = 59.97%], valid : [loss = 1.149, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3286/15625) 003286-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.294, top1 = 90.07%], valid : [loss = 0.473, top1 = 84.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.51 ms.
cifar10        train : [loss = 0.268, top1 = 91.06%], test  : [loss = 0.373, top1 = 87.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.282, top1 = 64.11%], valid : [loss = 1.477, top1 = 58.80%], test : [loss = 1.467, top1 = 59.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.16 ms.
ImageNet16-120 train : [loss = 2.823, top1 = 30.40%], valid : [loss = 2.815, top1 = 30.56%], test : [loss = 2.857, top1 = 29.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.58%], valid : [loss = 1.003, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3287/15625) 003287-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10-valid  train : [loss = 1.269, top1 = 54.39%], valid : [loss = 1.325, top1 = 52.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.08 ms.
cifar10        train : [loss = 1.242, top1 = 55.37%], test  : [loss = 1.251, top1 = 55.03%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 2.764, top1 = 30.88%], valid : [loss = 2.871, top1 = 29.59%], test : [loss = 2.858, top1 = 29.59%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.47 ms.
ImageNet16-120 train : [loss = 3.941, top1 = 11.24%], valid : [loss = 3.934, top1 = 11.72%], test : [loss = 3.957, top1 = 11.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.761, top1 = 33.83%], valid : [loss = 1.747, top1 = 34.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3288/15625) 003288-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.99 ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.49%], valid : [loss = 0.525, top1 = 82.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.67 ms.
cifar10        train : [loss = 0.400, top1 = 86.36%], test  : [loss = 0.465, top1 = 84.16%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.70 ms.
cifar100       train : [loss = 1.550, top1 = 57.34%], valid : [loss = 1.669, top1 = 54.57%], test : [loss = 1.657, top1 = 54.64%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.81 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.46%], valid : [loss = 3.002, top1 = 27.17%], test : [loss = 3.047, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3289/15625) 003289-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.462, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.328, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 0.329, top1 = 91.05%], valid : [loss = 1.301, top1 = 67.22%], test : [loss = 1.309, top1 = 67.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.32%], valid : [loss = 2.388, top1 = 39.72%], test : [loss = 2.380, top1 = 39.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 84.28%], valid : [loss = 0.561, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3290/15625) 003290-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.87%], valid : [loss = 1.099, top1 = 63.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10        train : [loss = 0.779, top1 = 72.68%], test  : [loss = 0.923, top1 = 68.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 2.116, top1 = 44.20%], valid : [loss = 2.399, top1 = 39.80%], test : [loss = 2.400, top1 = 39.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.755, top1 = 14.14%], valid : [loss = 3.821, top1 = 13.73%], test : [loss = 3.830, top1 = 12.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 50.71%], valid : [loss = 1.405, top1 = 48.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3291/15625) 003291-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.464, top1 = 89.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 0.331, top1 = 91.03%], valid : [loss = 1.314, top1 = 67.03%], test : [loss = 1.319, top1 = 66.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.20%], valid : [loss = 2.369, top1 = 40.05%], test : [loss = 2.386, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.33%], valid : [loss = 0.557, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3292/15625) 003292-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.563, top1 = 88.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.390, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 0.166, top1 = 96.44%], valid : [loss = 1.418, top1 = 66.60%], test : [loss = 1.435, top1 = 67.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.10%], valid : [loss = 2.477, top1 = 37.93%], test : [loss = 2.483, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3293/15625) 003293-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.36%], valid : [loss = 0.516, top1 = 87.21%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.46 ms.
cifar10        train : [loss = 0.044, top1 = 98.82%], test  : [loss = 0.359, top1 = 90.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.48 ms.
cifar100       train : [loss = 0.491, top1 = 86.12%], valid : [loss = 1.299, top1 = 66.31%], test : [loss = 1.276, top1 = 66.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.91%], valid : [loss = 2.432, top1 = 38.27%], test : [loss = 2.439, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.25%], valid : [loss = 0.844, top1 = 70.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3294/15625) 003294-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.29%], valid : [loss = 0.478, top1 = 84.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.295, top1 = 90.14%], test  : [loss = 0.401, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.75 ms.
cifar100       train : [loss = 1.318, top1 = 63.41%], valid : [loss = 1.530, top1 = 58.00%], test : [loss = 1.506, top1 = 58.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.96%], valid : [loss = 2.886, top1 = 30.33%], test : [loss = 2.939, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3295/15625) 003295-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.523, top1 = 89.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.75 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.331, top1 = 92.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.93 ms.
cifar100       train : [loss = 0.190, top1 = 95.38%], valid : [loss = 1.278, top1 = 68.33%], test : [loss = 1.303, top1 = 68.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.47%], valid : [loss = 2.287, top1 = 41.88%], test : [loss = 2.276, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.96%], valid : [loss = 0.700, top1 = 75.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3296/15625) 003296-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.488, top1 = 90.09%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.12 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.344, top1 = 92.81%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.07 ms.
cifar100       train : [loss = 0.036, top1 = 99.69%], valid : [loss = 1.404, top1 = 69.98%], test : [loss = 1.384, top1 = 70.11%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.94 ms.
ImageNet16-120 train : [loss = 1.546, top1 = 58.28%], valid : [loss = 2.434, top1 = 40.68%], test : [loss = 2.444, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.10%], valid : [loss = 0.677, top1 = 76.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3297/15625) 003297-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.25%], valid : [loss = 0.551, top1 = 87.38%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.68 ms.
cifar10        train : [loss = 0.054, top1 = 98.25%], test  : [loss = 0.369, top1 = 90.22%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.63 ms.
cifar100       train : [loss = 0.555, top1 = 83.71%], valid : [loss = 1.330, top1 = 64.97%], test : [loss = 1.308, top1 = 65.64%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.11%], valid : [loss = 2.429, top1 = 38.38%], test : [loss = 2.449, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.77%], valid : [loss = 0.771, top1 = 73.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3298/15625) 003298-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.19%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.355, top1 = 92.69%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.11 ms.
cifar100       train : [loss = 0.070, top1 = 98.99%], valid : [loss = 1.453, top1 = 68.97%], test : [loss = 1.420, top1 = 69.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 1.753, top1 = 53.37%], valid : [loss = 2.377, top1 = 40.93%], test : [loss = 2.367, top1 = 41.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 78.88%], valid : [loss = 0.702, top1 = 75.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3299/15625) 003299-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.480, top1 = 89.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.48 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.318, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.82 ms.
cifar100       train : [loss = 0.312, top1 = 91.71%], valid : [loss = 1.261, top1 = 67.81%], test : [loss = 1.247, top1 = 68.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.79%], valid : [loss = 2.322, top1 = 40.90%], test : [loss = 2.326, top1 = 41.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.585, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3300/15625) 003300-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 89.05 M, Params=0.634 MB, latency=22.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.513, top1 = 89.78%]
cifar10        FLOP= 89.05 M, Params=0.634 MB, latency=21.05 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.308, top1 = 93.29%]
cifar100       FLOP= 89.05 M, Params=0.640 MB, latency=20.05 ms.
cifar100       train : [loss = 0.110, top1 = 97.90%], valid : [loss = 1.300, top1 = 69.87%], test : [loss = 1.282, top1 = 70.18%]
ImageNet16-120 FLOP= 22.27 M, Params=0.641 MB, latency=21.50 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.33%], valid : [loss = 2.161, top1 = 44.38%], test : [loss = 2.182, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.48%], valid : [loss = 0.581, top1 = 80.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3301/15625) 003301-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.695, top1 = 85.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.16 ms.
cifar10        train : [loss = 0.022, top1 = 99.42%], test  : [loss = 0.482, top1 = 89.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.265, top1 = 93.07%], valid : [loss = 1.718, top1 = 61.35%], test : [loss = 1.674, top1 = 61.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.407, top1 = 38.88%], valid : [loss = 2.771, top1 = 31.90%], test : [loss = 2.836, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.12%], valid : [loss = 0.852, top1 = 70.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3302/15625) 003302-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.06%], valid : [loss = 0.518, top1 = 87.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.074, top1 = 97.73%], test  : [loss = 0.358, top1 = 89.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.714, top1 = 78.91%], valid : [loss = 1.361, top1 = 64.06%], test : [loss = 1.334, top1 = 64.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.17%], valid : [loss = 2.646, top1 = 34.03%], test : [loss = 2.662, top1 = 33.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.38%], valid : [loss = 0.686, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3303/15625) 003303-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.41%], valid : [loss = 0.457, top1 = 86.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.153, top1 = 95.07%], test  : [loss = 0.349, top1 = 88.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 1.003, top1 = 71.56%], valid : [loss = 1.354, top1 = 61.86%], test : [loss = 1.356, top1 = 62.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.85%], valid : [loss = 2.675, top1 = 33.08%], test : [loss = 2.716, top1 = 32.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3304/15625) 003304-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.529, top1 = 89.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.349, top1 = 92.97%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.27 ms.
cifar100       train : [loss = 0.088, top1 = 98.39%], valid : [loss = 1.348, top1 = 69.47%], test : [loss = 1.356, top1 = 69.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.07 ms.
ImageNet16-120 train : [loss = 1.652, top1 = 55.57%], valid : [loss = 2.190, top1 = 43.80%], test : [loss = 2.208, top1 = 43.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.36%], valid : [loss = 0.601, top1 = 79.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3305/15625) 003305-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.547, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.342, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.158, top1 = 96.07%], valid : [loss = 1.364, top1 = 68.20%], test : [loss = 1.407, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.33 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.27%], valid : [loss = 2.264, top1 = 42.08%], test : [loss = 2.253, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.72%], valid : [loss = 0.901, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3306/15625) 003306-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.61%], valid : [loss = 0.607, top1 = 87.07%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.94 ms.
cifar10        train : [loss = 0.021, top1 = 99.40%], test  : [loss = 0.414, top1 = 90.69%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.80 ms.
cifar100       train : [loss = 0.345, top1 = 90.45%], valid : [loss = 1.471, top1 = 63.58%], test : [loss = 1.460, top1 = 64.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 3.262, top1 = 20.27%], valid : [loss = 3.254, top1 = 20.57%], test : [loss = 3.249, top1 = 19.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.83%], valid : [loss = 1.205, top1 = 56.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3307/15625) 003307-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.68%], valid : [loss = 0.455, top1 = 86.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10        train : [loss = 0.155, top1 = 94.89%], test  : [loss = 0.341, top1 = 89.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 0.963, top1 = 72.64%], valid : [loss = 1.342, top1 = 62.50%], test : [loss = 1.337, top1 = 62.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.86%], valid : [loss = 2.687, top1 = 32.52%], test : [loss = 2.704, top1 = 31.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3308/15625) 003308-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.461, top1 = 89.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.327, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.52 ms.
cifar100       train : [loss = 0.279, top1 = 92.56%], valid : [loss = 1.323, top1 = 67.41%], test : [loss = 1.317, top1 = 67.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.31%], valid : [loss = 2.345, top1 = 40.25%], test : [loss = 2.363, top1 = 41.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.15%], valid : [loss = 0.601, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3309/15625) 003309-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.542, top1 = 88.89%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.349, top1 = 92.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.59 ms.
cifar100       train : [loss = 0.141, top1 = 97.09%], valid : [loss = 1.395, top1 = 68.21%], test : [loss = 1.407, top1 = 67.77%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.64%], valid : [loss = 2.391, top1 = 40.53%], test : [loss = 2.401, top1 = 40.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.71%], valid : [loss = 0.711, top1 = 75.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3310/15625) 003310-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.534, top1 = 89.44%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.05 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.318, top1 = 93.41%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.57 ms.
cifar100       train : [loss = 0.044, top1 = 99.33%], valid : [loss = 1.403, top1 = 70.04%], test : [loss = 1.427, top1 = 70.08%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.74%], valid : [loss = 2.264, top1 = 42.75%], test : [loss = 2.277, top1 = 41.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.65%], valid : [loss = 0.783, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3311/15625) 003311-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.89%], valid : [loss = 0.707, top1 = 83.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.087, top1 = 97.17%], test  : [loss = 0.474, top1 = 87.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.20 ms.
cifar100       train : [loss = 0.818, top1 = 76.11%], valid : [loss = 1.536, top1 = 60.07%], test : [loss = 1.534, top1 = 60.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.814, top1 = 30.29%], valid : [loss = 2.937, top1 = 28.02%], test : [loss = 2.977, top1 = 28.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3312/15625) 003312-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.460, top1 = 89.39%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.41 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.303, top1 = 92.33%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.97 ms.
cifar100       train : [loss = 0.205, top1 = 95.27%], valid : [loss = 1.221, top1 = 69.67%], test : [loss = 1.206, top1 = 69.67%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=21.62 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.88%], valid : [loss = 2.214, top1 = 43.20%], test : [loss = 2.227, top1 = 43.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.47%], valid : [loss = 0.633, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3313/15625) 003313-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.57%], valid : [loss = 0.742, top1 = 74.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.54 ms.
cifar10        train : [loss = 0.514, top1 = 82.07%], test  : [loss = 0.586, top1 = 79.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 1.948, top1 = 46.71%], valid : [loss = 2.072, top1 = 44.06%], test : [loss = 2.099, top1 = 43.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 3.066, top1 = 25.24%], valid : [loss = 3.053, top1 = 25.43%], test : [loss = 3.085, top1 = 25.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.44%], valid : [loss = 1.206, top1 = 56.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3314/15625) 003314-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.15%], valid : [loss = 0.676, top1 = 77.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.495, top1 = 82.79%], test  : [loss = 0.575, top1 = 80.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 1.726, top1 = 53.17%], valid : [loss = 1.885, top1 = 50.27%], test : [loss = 1.905, top1 = 49.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.36%], valid : [loss = 3.321, top1 = 21.57%], test : [loss = 3.330, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.62%], valid : [loss = 1.304, top1 = 53.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3315/15625) 003315-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.61%], valid : [loss = 0.549, top1 = 87.84%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10        train : [loss = 0.030, top1 = 99.13%], test  : [loss = 0.369, top1 = 90.84%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.68 ms.
cifar100       train : [loss = 0.594, top1 = 82.76%], valid : [loss = 1.425, top1 = 62.79%], test : [loss = 1.396, top1 = 63.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.11 ms.
ImageNet16-120 train : [loss = 2.460, top1 = 37.06%], valid : [loss = 2.565, top1 = 34.88%], test : [loss = 2.580, top1 = 34.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.997, top1 = 64.30%], valid : [loss = 1.018, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3316/15625) 003316-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.541, top1 = 87.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.72 ms.
cifar10        train : [loss = 0.036, top1 = 98.96%], test  : [loss = 0.364, top1 = 90.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.64 ms.
cifar100       train : [loss = 0.428, top1 = 88.03%], valid : [loss = 1.287, top1 = 66.70%], test : [loss = 1.306, top1 = 66.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.37%], valid : [loss = 2.390, top1 = 39.12%], test : [loss = 2.407, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.88%], valid : [loss = 0.602, top1 = 79.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3317/15625) 003317-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.503, top1 = 88.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.342, top1 = 91.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 0.340, top1 = 90.74%], valid : [loss = 1.282, top1 = 67.34%], test : [loss = 1.263, top1 = 67.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.13%], valid : [loss = 2.397, top1 = 39.50%], test : [loss = 2.396, top1 = 40.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3318/15625) 003318-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.18%], valid : [loss = 0.612, top1 = 85.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.72 ms.
cifar10        train : [loss = 0.074, top1 = 97.75%], test  : [loss = 0.406, top1 = 88.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.00 ms.
cifar100       train : [loss = 0.727, top1 = 78.95%], valid : [loss = 1.396, top1 = 63.02%], test : [loss = 1.385, top1 = 63.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.76%], valid : [loss = 2.662, top1 = 33.67%], test : [loss = 2.690, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.94%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3319/15625) 003319-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.469, top1 = 89.40%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.74 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.308, top1 = 92.48%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.13 ms.
cifar100       train : [loss = 0.198, top1 = 95.49%], valid : [loss = 1.207, top1 = 70.08%], test : [loss = 1.215, top1 = 69.72%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.47%], valid : [loss = 2.203, top1 = 43.80%], test : [loss = 2.217, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.01%], valid : [loss = 0.606, top1 = 79.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3320/15625) 003320-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.648, top1 = 86.17%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.55 ms.
cifar10        train : [loss = 0.026, top1 = 99.31%], test  : [loss = 0.426, top1 = 89.66%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.75 ms.
cifar100       train : [loss = 0.328, top1 = 91.27%], valid : [loss = 1.495, top1 = 63.84%], test : [loss = 1.493, top1 = 64.46%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.25%], valid : [loss = 2.595, top1 = 35.17%], test : [loss = 2.623, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.53%], valid : [loss = 0.844, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3321/15625) 003321-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.522, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.341, top1 = 91.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.69 ms.
cifar100       train : [loss = 0.322, top1 = 91.34%], valid : [loss = 1.278, top1 = 67.19%], test : [loss = 1.281, top1 = 67.03%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.14%], valid : [loss = 2.390, top1 = 39.23%], test : [loss = 2.400, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3322/15625) 003322-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.125, top1 = 95.97%], valid : [loss = 0.758, top1 = 80.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.146, top1 = 95.05%], test  : [loss = 0.473, top1 = 86.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.59 ms.
cifar100       train : [loss = 0.945, top1 = 72.47%], valid : [loss = 1.632, top1 = 57.03%], test : [loss = 1.649, top1 = 57.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 25.65%], valid : [loss = 3.110, top1 = 24.97%], test : [loss = 3.152, top1 = 23.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3323/15625) 003323-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.62%], valid : [loss = 0.849, top1 = 71.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10        train : [loss = 0.556, top1 = 80.63%], test  : [loss = 0.716, top1 = 75.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.47 ms.
cifar100       train : [loss = 1.789, top1 = 51.78%], valid : [loss = 2.055, top1 = 46.79%], test : [loss = 2.054, top1 = 46.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.81%], valid : [loss = 3.634, top1 = 16.35%], test : [loss = 3.665, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3324/15625) 003324-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.51%], valid : [loss = 0.984, top1 = 66.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 0.793, top1 = 72.01%], test  : [loss = 0.877, top1 = 69.22%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.83 ms.
cifar100       train : [loss = 2.134, top1 = 44.03%], valid : [loss = 2.310, top1 = 40.23%], test : [loss = 2.324, top1 = 41.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.42 ms.
ImageNet16-120 train : [loss = 3.734, top1 = 14.39%], valid : [loss = 3.771, top1 = 14.52%], test : [loss = 3.771, top1 = 13.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3325/15625) 003325-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.51%], valid : [loss = 0.824, top1 = 82.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.062, top1 = 98.12%], test  : [loss = 0.590, top1 = 85.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.76 ms.
cifar100       train : [loss = 0.535, top1 = 84.92%], valid : [loss = 1.769, top1 = 58.02%], test : [loss = 1.738, top1 = 58.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.76%], valid : [loss = 2.958, top1 = 28.87%], test : [loss = 3.017, top1 = 28.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.28%], valid : [loss = 0.896, top1 = 68.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3326/15625) 003326-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.57%], valid : [loss = 0.559, top1 = 87.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.030, top1 = 99.11%], test  : [loss = 0.378, top1 = 90.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.572, top1 = 83.31%], valid : [loss = 1.380, top1 = 63.64%], test : [loss = 1.379, top1 = 63.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.34%], valid : [loss = 2.621, top1 = 33.48%], test : [loss = 2.645, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3327/15625) 003327-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.29%], valid : [loss = 0.751, top1 = 74.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10        train : [loss = 0.571, top1 = 80.13%], test  : [loss = 0.628, top1 = 78.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 1.984, top1 = 46.65%], valid : [loss = 2.130, top1 = 43.63%], test : [loss = 2.124, top1 = 43.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.226, top1 = 22.39%], valid : [loss = 3.235, top1 = 22.57%], test : [loss = 3.255, top1 = 22.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.41%], valid : [loss = 1.316, top1 = 52.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3328/15625) 003328-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.32%], valid : [loss = 0.597, top1 = 85.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.068, top1 = 98.05%], test  : [loss = 0.402, top1 = 88.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.94 ms.
cifar100       train : [loss = 0.722, top1 = 79.00%], valid : [loss = 1.385, top1 = 62.66%], test : [loss = 1.377, top1 = 63.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.30%], valid : [loss = 2.650, top1 = 34.30%], test : [loss = 2.675, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3329/15625) 003329-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.514, top1 = 88.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.325, top1 = 92.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.84 ms.
cifar100       train : [loss = 0.326, top1 = 91.07%], valid : [loss = 1.275, top1 = 66.64%], test : [loss = 1.245, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.56 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.20%], valid : [loss = 2.398, top1 = 39.20%], test : [loss = 2.417, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.07%], valid : [loss = 0.643, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3330/15625) 003330-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.530, top1 = 88.45%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.35 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.321, top1 = 92.07%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.66 ms.
cifar100       train : [loss = 0.262, top1 = 93.30%], valid : [loss = 1.210, top1 = 68.34%], test : [loss = 1.205, top1 = 69.38%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.47%], valid : [loss = 2.206, top1 = 43.23%], test : [loss = 2.218, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 82.14%], valid : [loss = 0.607, top1 = 79.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3331/15625) 003331-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.542, top1 = 89.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.342, top1 = 92.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.69 ms.
cifar100       train : [loss = 0.161, top1 = 96.28%], valid : [loss = 1.426, top1 = 67.36%], test : [loss = 1.387, top1 = 68.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.41 ms.
ImageNet16-120 train : [loss = 1.959, top1 = 48.42%], valid : [loss = 2.356, top1 = 40.63%], test : [loss = 2.325, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.61%], valid : [loss = 0.746, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3332/15625) 003332-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.16 ms.
cifar10-valid  train : [loss = 0.035, top1 = 98.97%], valid : [loss = 0.575, top1 = 86.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.066, top1 = 97.85%], test  : [loss = 0.367, top1 = 90.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.05 ms.
cifar100       train : [loss = 0.649, top1 = 80.88%], valid : [loss = 1.295, top1 = 66.24%], test : [loss = 1.284, top1 = 65.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 39.92%], valid : [loss = 2.485, top1 = 37.20%], test : [loss = 2.502, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.58%], valid : [loss = 0.783, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3333/15625) 003333-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.96%], valid : [loss = 0.449, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.321, top1 = 91.35%], valid : [loss = 1.297, top1 = 66.12%], test : [loss = 1.286, top1 = 67.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.52 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 46.03%], valid : [loss = 2.365, top1 = 40.13%], test : [loss = 2.417, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.448, top1 = 84.62%], valid : [loss = 0.549, top1 = 81.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3334/15625) 003334-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.529, top1 = 88.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.367, top1 = 90.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.70 ms.
cifar100       train : [loss = 0.484, top1 = 85.86%], valid : [loss = 1.391, top1 = 65.22%], test : [loss = 1.349, top1 = 65.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.18%], valid : [loss = 2.516, top1 = 36.43%], test : [loss = 2.549, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.17%], valid : [loss = 0.646, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3335/15625) 003335-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.37%], valid : [loss = 0.657, top1 = 85.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10        train : [loss = 0.049, top1 = 98.56%], test  : [loss = 0.431, top1 = 88.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.69 ms.
cifar100       train : [loss = 0.620, top1 = 82.11%], valid : [loss = 1.417, top1 = 62.58%], test : [loss = 1.433, top1 = 63.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.458, top1 = 37.65%], valid : [loss = 2.595, top1 = 34.50%], test : [loss = 2.645, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.45%], valid : [loss = 0.800, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3336/15625) 003336-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.537, top1 = 88.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.54 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.342, top1 = 92.04%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.62 ms.
cifar100       train : [loss = 0.219, top1 = 94.16%], valid : [loss = 1.290, top1 = 68.08%], test : [loss = 1.310, top1 = 68.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.95%], valid : [loss = 2.306, top1 = 40.87%], test : [loss = 2.277, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.45%], valid : [loss = 0.844, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3337/15625) 003337-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.53%], valid : [loss = 0.459, top1 = 86.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.157, top1 = 94.88%], test  : [loss = 0.353, top1 = 88.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 1.023, top1 = 70.85%], valid : [loss = 1.370, top1 = 61.34%], test : [loss = 1.377, top1 = 60.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.66%], valid : [loss = 2.693, top1 = 33.00%], test : [loss = 2.725, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3338/15625) 003338-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.88%], valid : [loss = 0.870, top1 = 71.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.561, top1 = 80.60%], test  : [loss = 0.718, top1 = 75.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 1.760, top1 = 52.18%], valid : [loss = 2.036, top1 = 47.92%], test : [loss = 2.060, top1 = 46.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.79%], valid : [loss = 3.644, top1 = 16.07%], test : [loss = 3.671, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3339/15625) 003339-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.13%], valid : [loss = 0.451, top1 = 86.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.07 ms.
cifar10        train : [loss = 0.158, top1 = 94.85%], test  : [loss = 0.334, top1 = 89.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.52 ms.
cifar100       train : [loss = 1.009, top1 = 71.34%], valid : [loss = 1.380, top1 = 61.62%], test : [loss = 1.320, top1 = 61.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.71%], valid : [loss = 2.680, top1 = 32.77%], test : [loss = 2.709, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3340/15625) 003340-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.040, top1 = 99.24%], valid : [loss = 0.493, top1 = 86.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.41 ms.
cifar10        train : [loss = 0.063, top1 = 98.19%], test  : [loss = 0.334, top1 = 90.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 0.557, top1 = 84.01%], valid : [loss = 1.253, top1 = 66.50%], test : [loss = 1.245, top1 = 66.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.29%], valid : [loss = 2.324, top1 = 40.77%], test : [loss = 2.400, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.92%], valid : [loss = 0.848, top1 = 70.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3341/15625) 003341-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.08 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3342/15625) 003342-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.465, top1 = 88.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.00 ms.
cifar10        train : [loss = 0.025, top1 = 99.35%], test  : [loss = 0.346, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.28 ms.
cifar100       train : [loss = 0.487, top1 = 85.64%], valid : [loss = 1.301, top1 = 66.80%], test : [loss = 1.321, top1 = 66.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.20%], valid : [loss = 2.422, top1 = 39.63%], test : [loss = 2.455, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.63%], valid : [loss = 0.693, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3343/15625) 003343-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.486, top1 = 89.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.346, top1 = 91.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.73 ms.
cifar100       train : [loss = 0.232, top1 = 93.99%], valid : [loss = 1.354, top1 = 67.54%], test : [loss = 1.355, top1 = 67.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.82%], valid : [loss = 2.287, top1 = 42.04%], test : [loss = 2.331, top1 = 41.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.90%], valid : [loss = 0.615, top1 = 79.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3344/15625) 003344-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.474, top1 = 89.10%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.90 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.313, top1 = 92.51%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.16 ms.
cifar100       train : [loss = 0.273, top1 = 93.05%], valid : [loss = 1.277, top1 = 68.26%], test : [loss = 1.277, top1 = 67.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.69 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.38%], valid : [loss = 2.274, top1 = 42.27%], test : [loss = 2.290, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.76%], valid : [loss = 0.650, top1 = 77.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3345/15625) 003345-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.07%], valid : [loss = 0.576, top1 = 86.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.11 ms.
cifar10        train : [loss = 0.067, top1 = 97.81%], test  : [loss = 0.392, top1 = 89.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.49 ms.
cifar100       train : [loss = 0.666, top1 = 80.29%], valid : [loss = 1.352, top1 = 64.40%], test : [loss = 1.322, top1 = 64.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.82 ms.
ImageNet16-120 train : [loss = 2.348, top1 = 39.62%], valid : [loss = 2.479, top1 = 36.40%], test : [loss = 2.509, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.02%], valid : [loss = 0.763, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3346/15625) 003346-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.557, top1 = 87.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.371, top1 = 90.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.404, top1 = 88.22%], valid : [loss = 1.336, top1 = 65.88%], test : [loss = 1.342, top1 = 66.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.857, top1 = 28.37%], valid : [loss = 2.926, top1 = 28.07%], test : [loss = 2.905, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.46%], valid : [loss = 0.958, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3347/15625) 003347-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.19%], valid : [loss = 0.473, top1 = 84.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10        train : [loss = 0.300, top1 = 89.91%], test  : [loss = 0.403, top1 = 86.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.02 ms.
cifar100       train : [loss = 1.323, top1 = 63.35%], valid : [loss = 1.533, top1 = 58.42%], test : [loss = 1.518, top1 = 57.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.67%], valid : [loss = 2.902, top1 = 29.63%], test : [loss = 2.952, top1 = 28.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.13%], valid : [loss = 0.731, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3348/15625) 003348-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.413, top1 = 90.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.285, top1 = 93.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.91 ms.
cifar100       train : [loss = 0.105, top1 = 98.00%], valid : [loss = 1.283, top1 = 70.40%], test : [loss = 1.272, top1 = 70.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 1.684, top1 = 54.89%], valid : [loss = 2.190, top1 = 44.63%], test : [loss = 2.245, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.59%], valid : [loss = 0.528, top1 = 82.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3349/15625) 003349-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.49%], valid : [loss = 0.845, top1 = 72.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.04 ms.
cifar10        train : [loss = 0.581, top1 = 79.53%], test  : [loss = 0.730, top1 = 75.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.47 ms.
cifar100       train : [loss = 1.798, top1 = 51.39%], valid : [loss = 2.044, top1 = 46.56%], test : [loss = 2.067, top1 = 46.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.70%], valid : [loss = 3.642, top1 = 16.83%], test : [loss = 3.652, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.20%], valid : [loss = 1.254, top1 = 55.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3350/15625) 003350-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.95%], valid : [loss = 0.545, top1 = 85.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.91 ms.
cifar10        train : [loss = 0.118, top1 = 96.17%], test  : [loss = 0.373, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 0.826, top1 = 75.87%], valid : [loss = 1.380, top1 = 63.10%], test : [loss = 1.388, top1 = 62.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.62%], valid : [loss = 2.621, top1 = 34.29%], test : [loss = 2.640, top1 = 34.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.59%], valid : [loss = 0.895, top1 = 68.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3351/15625) 003351-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3352/15625) 003352-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.72%], valid : [loss = 0.763, top1 = 73.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10        train : [loss = 0.575, top1 = 79.99%], test  : [loss = 0.636, top1 = 78.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 2.050, top1 = 45.00%], valid : [loss = 2.187, top1 = 42.27%], test : [loss = 2.178, top1 = 42.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 20.62%], valid : [loss = 3.322, top1 = 20.88%], test : [loss = 3.363, top1 = 20.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 54.38%], valid : [loss = 1.327, top1 = 52.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3353/15625) 003353-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.28%], valid : [loss = 0.661, top1 = 84.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=14.96 ms.
cifar10        train : [loss = 0.051, top1 = 98.48%], test  : [loss = 0.450, top1 = 88.35%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.81 ms.
cifar100       train : [loss = 0.603, top1 = 82.35%], valid : [loss = 1.557, top1 = 60.82%], test : [loss = 1.511, top1 = 62.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.08%], valid : [loss = 2.787, top1 = 29.93%], test : [loss = 2.854, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.92%], valid : [loss = 0.921, top1 = 67.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3354/15625) 003354-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.62%], valid : [loss = 0.562, top1 = 86.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10        train : [loss = 0.059, top1 = 98.07%], test  : [loss = 0.362, top1 = 90.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.66 ms.
cifar100       train : [loss = 0.566, top1 = 83.38%], valid : [loss = 1.325, top1 = 64.56%], test : [loss = 1.334, top1 = 64.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.06%], valid : [loss = 2.502, top1 = 35.83%], test : [loss = 2.514, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.39%], valid : [loss = 0.935, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3355/15625) 003355-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.581, top1 = 87.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.62 ms.
cifar10        train : [loss = 0.030, top1 = 99.09%], test  : [loss = 0.352, top1 = 91.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.420, top1 = 87.78%], valid : [loss = 1.290, top1 = 66.50%], test : [loss = 1.298, top1 = 66.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.12%], valid : [loss = 2.424, top1 = 39.73%], test : [loss = 2.444, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.20%], valid : [loss = 0.882, top1 = 68.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3356/15625) 003356-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.34%], valid : [loss = 0.606, top1 = 86.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10        train : [loss = 0.047, top1 = 98.52%], test  : [loss = 0.388, top1 = 89.87%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.89 ms.
cifar100       train : [loss = 0.505, top1 = 85.24%], valid : [loss = 1.401, top1 = 63.92%], test : [loss = 1.384, top1 = 64.40%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.64 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.72%], valid : [loss = 2.473, top1 = 37.70%], test : [loss = 2.503, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.16%], valid : [loss = 0.858, top1 = 69.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3357/15625) 003357-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.37%], valid : [loss = 0.448, top1 = 87.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.112, top1 = 96.45%], test  : [loss = 0.333, top1 = 89.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.876, top1 = 75.22%], valid : [loss = 1.290, top1 = 63.56%], test : [loss = 1.283, top1 = 64.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.44%], valid : [loss = 2.641, top1 = 33.97%], test : [loss = 2.666, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3358/15625) 003358-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.54%], valid : [loss = 0.531, top1 = 87.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.78 ms.
cifar10        train : [loss = 0.082, top1 = 97.31%], test  : [loss = 0.345, top1 = 90.30%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.10 ms.
cifar100       train : [loss = 0.712, top1 = 78.88%], valid : [loss = 1.373, top1 = 63.40%], test : [loss = 1.343, top1 = 64.24%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.32%], valid : [loss = 2.491, top1 = 36.77%], test : [loss = 2.537, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.17%], valid : [loss = 0.878, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3359/15625) 003359-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.252, top1 = 91.43%], valid : [loss = 0.546, top1 = 82.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10        train : [loss = 0.220, top1 = 92.50%], test  : [loss = 0.406, top1 = 87.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 1.307, top1 = 62.91%], valid : [loss = 1.597, top1 = 56.60%], test : [loss = 1.590, top1 = 56.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.750, top1 = 31.55%], valid : [loss = 2.772, top1 = 31.93%], test : [loss = 2.836, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.77%], valid : [loss = 0.970, top1 = 65.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3360/15625) 003360-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.19 ms.
cifar10-valid  train : [loss = 0.093, top1 = 97.30%], valid : [loss = 0.469, top1 = 86.30%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.64 ms.
cifar10        train : [loss = 0.124, top1 = 96.07%], test  : [loss = 0.349, top1 = 88.84%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.54 ms.
cifar100       train : [loss = 0.787, top1 = 78.06%], valid : [loss = 1.299, top1 = 63.86%], test : [loss = 1.299, top1 = 64.14%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.06 ms.
ImageNet16-120 train : [loss = 2.507, top1 = 36.59%], valid : [loss = 2.603, top1 = 35.13%], test : [loss = 2.630, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 70.98%], valid : [loss = 0.857, top1 = 69.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3361/15625) 003361-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.431, top1 = 90.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.294, top1 = 93.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.20 ms.
cifar100       train : [loss = 0.127, top1 = 97.35%], valid : [loss = 1.269, top1 = 70.88%], test : [loss = 1.261, top1 = 70.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.43%], valid : [loss = 2.222, top1 = 43.60%], test : [loss = 2.222, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.425, top1 = 85.44%], valid : [loss = 0.545, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3362/15625) 003362-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 0.264, top1 = 90.97%], valid : [loss = 0.839, top1 = 75.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10        train : [loss = 0.327, top1 = 88.48%], test  : [loss = 0.661, top1 = 79.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 1.324, top1 = 62.62%], valid : [loss = 1.878, top1 = 51.58%], test : [loss = 1.863, top1 = 51.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 3.490, top1 = 17.58%], valid : [loss = 3.509, top1 = 17.30%], test : [loss = 3.516, top1 = 17.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3363/15625) 003363-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.77%], valid : [loss = 0.892, top1 = 78.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10        train : [loss = 0.148, top1 = 94.98%], test  : [loss = 0.533, top1 = 84.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.91 ms.
cifar100       train : [loss = 1.015, top1 = 70.62%], valid : [loss = 1.686, top1 = 55.78%], test : [loss = 1.687, top1 = 55.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 3.019, top1 = 26.43%], valid : [loss = 3.114, top1 = 24.27%], test : [loss = 3.175, top1 = 24.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.69%], valid : [loss = 0.959, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3364/15625) 003364-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.135, top1 = 95.49%], valid : [loss = 0.727, top1 = 81.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.197, top1 = 93.23%], test  : [loss = 0.502, top1 = 84.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.13 ms.
cifar100       train : [loss = 0.891, top1 = 73.79%], valid : [loss = 1.630, top1 = 57.88%], test : [loss = 1.656, top1 = 57.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 3.534, top1 = 16.30%], valid : [loss = 3.534, top1 = 16.07%], test : [loss = 3.533, top1 = 16.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.302, top1 = 52.16%], valid : [loss = 1.305, top1 = 52.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3365/15625) 003365-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.517, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.353, top1 = 92.62%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.69 ms.
cifar100       train : [loss = 0.102, top1 = 98.26%], valid : [loss = 1.457, top1 = 67.97%], test : [loss = 1.448, top1 = 67.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.52%], valid : [loss = 2.361, top1 = 40.76%], test : [loss = 2.385, top1 = 41.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.64%], valid : [loss = 0.687, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3366/15625) 003366-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.537, top1 = 88.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.90 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.347, top1 = 91.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.59 ms.
cifar100       train : [loss = 0.283, top1 = 92.66%], valid : [loss = 1.303, top1 = 66.66%], test : [loss = 1.331, top1 = 66.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.29 ms.
ImageNet16-120 train : [loss = 2.426, top1 = 37.74%], valid : [loss = 2.520, top1 = 35.37%], test : [loss = 2.562, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 70.07%], valid : [loss = 0.871, top1 = 69.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3367/15625) 003367-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.551, top1 = 87.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.354, top1 = 91.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.439, top1 = 87.34%], valid : [loss = 1.269, top1 = 67.52%], test : [loss = 1.258, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.42%], valid : [loss = 2.356, top1 = 40.13%], test : [loss = 2.398, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.31%], valid : [loss = 0.784, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3368/15625) 003368-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.73%], valid : [loss = 0.501, top1 = 83.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10        train : [loss = 0.272, top1 = 90.83%], test  : [loss = 0.383, top1 = 87.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.84 ms.
cifar100       train : [loss = 1.285, top1 = 63.95%], valid : [loss = 1.508, top1 = 58.45%], test : [loss = 1.502, top1 = 58.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 2.828, top1 = 30.31%], valid : [loss = 2.831, top1 = 30.54%], test : [loss = 2.868, top1 = 29.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.982, top1 = 65.10%], valid : [loss = 1.007, top1 = 64.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3369/15625) 003369-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.458, top1 = 89.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.83 ms.
cifar100       train : [loss = 0.329, top1 = 91.13%], valid : [loss = 1.317, top1 = 66.64%], test : [loss = 1.317, top1 = 67.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.30%], valid : [loss = 2.381, top1 = 40.16%], test : [loss = 2.396, top1 = 39.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3370/15625) 003370-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.624, top1 = 86.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.393, top1 = 91.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.64 ms.
cifar100       train : [loss = 0.204, top1 = 95.29%], valid : [loss = 1.608, top1 = 63.52%], test : [loss = 1.593, top1 = 64.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.028, top1 = 46.87%], valid : [loss = 2.479, top1 = 38.13%], test : [loss = 2.475, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.73%], valid : [loss = 0.763, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3371/15625) 003371-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.64%], valid : [loss = 0.610, top1 = 86.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.030, top1 = 99.22%], test  : [loss = 0.399, top1 = 90.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.94 ms.
cifar100       train : [loss = 0.535, top1 = 84.33%], valid : [loss = 1.416, top1 = 64.08%], test : [loss = 1.417, top1 = 63.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.16%], valid : [loss = 2.546, top1 = 36.23%], test : [loss = 2.589, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.32%], valid : [loss = 0.859, top1 = 69.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3372/15625) 003372-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.33%], valid : [loss = 0.445, top1 = 87.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.110, top1 = 96.65%], test  : [loss = 0.328, top1 = 89.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.866, top1 = 75.33%], valid : [loss = 1.299, top1 = 64.38%], test : [loss = 1.290, top1 = 63.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.68%], valid : [loss = 2.592, top1 = 34.77%], test : [loss = 2.662, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.06%], valid : [loss = 0.664, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3373/15625) 003373-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.472, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.322, top1 = 92.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.77 ms.
cifar100       train : [loss = 0.236, top1 = 94.27%], valid : [loss = 1.238, top1 = 69.38%], test : [loss = 1.229, top1 = 69.50%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.26%], valid : [loss = 2.286, top1 = 41.70%], test : [loss = 2.285, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.90%], valid : [loss = 0.615, top1 = 78.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3374/15625) 003374-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.62%], valid : [loss = 0.476, top1 = 84.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.70 ms.
cifar10        train : [loss = 0.301, top1 = 89.93%], test  : [loss = 0.403, top1 = 86.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 1.328, top1 = 63.36%], valid : [loss = 1.532, top1 = 57.68%], test : [loss = 1.525, top1 = 57.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.93%], valid : [loss = 2.909, top1 = 29.13%], test : [loss = 2.982, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3375/15625) 003375-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.34%], valid : [loss = 0.855, top1 = 71.42%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10        train : [loss = 0.559, top1 = 80.39%], test  : [loss = 0.713, top1 = 75.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 1.789, top1 = 51.88%], valid : [loss = 2.062, top1 = 47.80%], test : [loss = 2.067, top1 = 46.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.73%], valid : [loss = 3.639, top1 = 16.30%], test : [loss = 3.657, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3376/15625) 003376-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.65%], valid : [loss = 0.651, top1 = 85.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.78 ms.
cifar10        train : [loss = 0.035, top1 = 98.97%], test  : [loss = 0.424, top1 = 89.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.91 ms.
cifar100       train : [loss = 0.492, top1 = 85.67%], valid : [loss = 1.416, top1 = 64.78%], test : [loss = 1.412, top1 = 64.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 2.443, top1 = 37.85%], valid : [loss = 2.601, top1 = 34.90%], test : [loss = 2.653, top1 = 34.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.94%], valid : [loss = 0.898, top1 = 68.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3377/15625) 003377-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.54%], valid : [loss = 0.568, top1 = 87.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.88 ms.
cifar10        train : [loss = 0.023, top1 = 99.32%], test  : [loss = 0.364, top1 = 91.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.93 ms.
cifar100       train : [loss = 0.437, top1 = 87.71%], valid : [loss = 1.481, top1 = 62.44%], test : [loss = 1.467, top1 = 63.46%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.482, top1 = 36.40%], valid : [loss = 2.606, top1 = 34.00%], test : [loss = 2.641, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.085, top1 = 61.26%], valid : [loss = 1.100, top1 = 60.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3378/15625) 003378-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.614, top1 = 87.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.06 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.427, top1 = 90.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.203, top1 = 95.32%], valid : [loss = 1.475, top1 = 66.30%], test : [loss = 1.503, top1 = 65.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 45.94%], valid : [loss = 2.481, top1 = 37.50%], test : [loss = 2.518, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.70%], valid : [loss = 0.733, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3379/15625) 003379-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.511, top1 = 88.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.346, top1 = 91.68%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.91 ms.
cifar100       train : [loss = 0.340, top1 = 90.74%], valid : [loss = 1.283, top1 = 67.04%], test : [loss = 1.297, top1 = 67.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.41%], valid : [loss = 2.448, top1 = 37.40%], test : [loss = 2.423, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.68%], valid : [loss = 0.746, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3380/15625) 003380-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.530, top1 = 89.63%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.317, top1 = 93.44%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.96 ms.
cifar100       train : [loss = 0.081, top1 = 98.42%], valid : [loss = 1.343, top1 = 69.60%], test : [loss = 1.387, top1 = 68.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.38 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.12%], valid : [loss = 2.382, top1 = 39.53%], test : [loss = 2.393, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.98%], valid : [loss = 0.782, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3381/15625) 003381-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.528, top1 = 88.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.10 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.339, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.222, top1 = 94.11%], valid : [loss = 1.320, top1 = 68.10%], test : [loss = 1.351, top1 = 68.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.94%], valid : [loss = 2.373, top1 = 39.63%], test : [loss = 2.403, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.52%], valid : [loss = 0.904, top1 = 67.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3382/15625) 003382-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.33%], valid : [loss = 0.810, top1 = 72.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.579, top1 = 79.64%], test  : [loss = 0.668, top1 = 76.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.40 ms.
cifar100       train : [loss = 2.007, top1 = 46.12%], valid : [loss = 2.200, top1 = 42.82%], test : [loss = 2.202, top1 = 43.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 3.542, top1 = 17.07%], valid : [loss = 3.545, top1 = 17.37%], test : [loss = 3.572, top1 = 16.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.238, top1 = 55.22%], valid : [loss = 1.267, top1 = 54.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3383/15625) 003383-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.452, top1 = 90.73%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.12 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.295, top1 = 93.60%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=13.55 ms.
cifar100       train : [loss = 0.051, top1 = 99.24%], valid : [loss = 1.345, top1 = 70.96%], test : [loss = 1.325, top1 = 71.12%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.483, top1 = 59.77%], valid : [loss = 2.223, top1 = 43.73%], test : [loss = 2.247, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.419, top1 = 85.53%], valid : [loss = 0.545, top1 = 81.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3384/15625) 003384-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.498, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.304, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.56 ms.
cifar100       train : [loss = 0.315, top1 = 91.58%], valid : [loss = 1.240, top1 = 67.79%], test : [loss = 1.249, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.83%], valid : [loss = 2.337, top1 = 40.62%], test : [loss = 2.325, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.22%], valid : [loss = 0.615, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3385/15625) 003385-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.394, top1 = 90.94%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.89 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.250, top1 = 93.99%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.88 ms.
cifar100       train : [loss = 0.050, top1 = 99.53%], valid : [loss = 1.267, top1 = 71.36%], test : [loss = 1.220, top1 = 72.38%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=24.58 ms.
ImageNet16-120 train : [loss = 1.420, top1 = 61.25%], valid : [loss = 2.171, top1 = 45.63%], test : [loss = 2.190, top1 = 46.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.58%], valid : [loss = 0.518, top1 = 82.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3386/15625) 003386-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.38 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.98%], valid : [loss = 0.548, top1 = 86.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.075, top1 = 97.53%], test  : [loss = 0.371, top1 = 89.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.91 ms.
cifar100       train : [loss = 0.722, top1 = 78.71%], valid : [loss = 1.365, top1 = 64.26%], test : [loss = 1.322, top1 = 64.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 35.89%], valid : [loss = 2.644, top1 = 34.63%], test : [loss = 2.682, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3387/15625) 003387-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.11%], valid : [loss = 0.848, top1 = 72.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.76 ms.
cifar10        train : [loss = 0.558, top1 = 80.48%], test  : [loss = 0.721, top1 = 75.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.05 ms.
cifar100       train : [loss = 1.764, top1 = 52.41%], valid : [loss = 2.043, top1 = 47.52%], test : [loss = 2.081, top1 = 47.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.67%], valid : [loss = 3.641, top1 = 16.83%], test : [loss = 3.677, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3388/15625) 003388-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.60%], valid : [loss = 0.840, top1 = 79.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.05 ms.
cifar10        train : [loss = 0.138, top1 = 95.27%], test  : [loss = 0.541, top1 = 85.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.10 ms.
cifar100       train : [loss = 0.847, top1 = 75.34%], valid : [loss = 1.654, top1 = 57.22%], test : [loss = 1.677, top1 = 57.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 3.054, top1 = 26.05%], valid : [loss = 3.195, top1 = 23.63%], test : [loss = 3.207, top1 = 23.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 63.12%], valid : [loss = 1.095, top1 = 60.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3389/15625) 003389-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.502, top1 = 89.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.332, top1 = 92.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.43 ms.
cifar100       train : [loss = 0.148, top1 = 96.64%], valid : [loss = 1.323, top1 = 69.80%], test : [loss = 1.342, top1 = 69.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 1.795, top1 = 52.28%], valid : [loss = 2.216, top1 = 43.90%], test : [loss = 2.255, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.53%], valid : [loss = 0.639, top1 = 78.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3390/15625) 003390-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.598, top1 = 87.10%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.394, top1 = 90.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 0.389, top1 = 89.19%], valid : [loss = 1.405, top1 = 65.08%], test : [loss = 1.376, top1 = 65.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.64 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.11%], valid : [loss = 2.496, top1 = 37.10%], test : [loss = 2.533, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3391/15625) 003391-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.597, top1 = 87.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.415, top1 = 90.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.72 ms.
cifar100       train : [loss = 0.205, top1 = 94.82%], valid : [loss = 1.511, top1 = 65.56%], test : [loss = 1.521, top1 = 65.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.193, top1 = 43.38%], valid : [loss = 2.564, top1 = 35.97%], test : [loss = 2.600, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.36%], valid : [loss = 0.645, top1 = 78.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3392/15625) 003392-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.348, top1 = 87.87%], valid : [loss = 0.596, top1 = 80.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10        train : [loss = 0.291, top1 = 90.02%], test  : [loss = 0.433, top1 = 85.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.47 ms.
cifar100       train : [loss = 1.549, top1 = 56.83%], valid : [loss = 1.794, top1 = 51.33%], test : [loss = 1.781, top1 = 51.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.60%], valid : [loss = 2.980, top1 = 27.06%], test : [loss = 3.015, top1 = 26.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.54%], valid : [loss = 1.026, top1 = 63.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3393/15625) 003393-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.15%], valid : [loss = 0.473, top1 = 84.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.301, top1 = 89.88%], test  : [loss = 0.405, top1 = 86.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.66 ms.
cifar100       train : [loss = 1.332, top1 = 63.10%], valid : [loss = 1.520, top1 = 57.60%], test : [loss = 1.514, top1 = 58.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.54%], valid : [loss = 2.903, top1 = 29.17%], test : [loss = 2.958, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3394/15625) 003394-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10-valid  train : [loss = 0.315, top1 = 89.06%], valid : [loss = 0.568, top1 = 81.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10        train : [loss = 0.298, top1 = 89.73%], test  : [loss = 0.425, top1 = 85.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.26 ms.
cifar100       train : [loss = 1.311, top1 = 63.07%], valid : [loss = 1.585, top1 = 56.83%], test : [loss = 1.579, top1 = 57.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.14 ms.
ImageNet16-120 train : [loss = 3.074, top1 = 25.68%], valid : [loss = 3.075, top1 = 25.68%], test : [loss = 3.140, top1 = 24.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.210, top1 = 56.20%], valid : [loss = 1.259, top1 = 54.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3395/15625) 003395-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.462, top1 = 89.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.308, top1 = 92.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.42 ms.
cifar100       train : [loss = 0.220, top1 = 94.65%], valid : [loss = 1.299, top1 = 68.50%], test : [loss = 1.261, top1 = 69.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.77%], valid : [loss = 2.283, top1 = 41.53%], test : [loss = 2.320, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.19%], valid : [loss = 0.531, top1 = 82.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3396/15625) 003396-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.56 ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.14%], valid : [loss = 0.784, top1 = 73.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.51 ms.
cifar10        train : [loss = 0.670, top1 = 76.96%], test  : [loss = 0.708, top1 = 75.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 2.055, top1 = 45.42%], valid : [loss = 2.195, top1 = 41.84%], test : [loss = 2.176, top1 = 43.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 3.414, top1 = 19.32%], valid : [loss = 3.410, top1 = 20.10%], test : [loss = 3.432, top1 = 18.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.425, top1 = 47.82%], valid : [loss = 1.483, top1 = 45.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3397/15625) 003397-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.571, top1 = 88.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.382, top1 = 92.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.179, top1 = 96.04%], valid : [loss = 1.409, top1 = 67.64%], test : [loss = 1.439, top1 = 66.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 48.04%], valid : [loss = 2.475, top1 = 37.87%], test : [loss = 2.486, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.52%], valid : [loss = 0.715, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3398/15625) 003398-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.47%], valid : [loss = 0.464, top1 = 86.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.157, top1 = 94.84%], test  : [loss = 0.342, top1 = 88.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 0.979, top1 = 72.14%], valid : [loss = 1.357, top1 = 62.20%], test : [loss = 1.352, top1 = 62.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.02%], valid : [loss = 2.682, top1 = 32.89%], test : [loss = 2.703, top1 = 32.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3399/15625) 003399-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.427, top1 = 90.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.285, top1 = 93.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.17 ms.
cifar100       train : [loss = 0.099, top1 = 98.38%], valid : [loss = 1.310, top1 = 70.04%], test : [loss = 1.322, top1 = 69.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 1.659, top1 = 55.63%], valid : [loss = 2.211, top1 = 44.13%], test : [loss = 2.269, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 85.82%], valid : [loss = 0.528, top1 = 82.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3400/15625) 003400-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.640, top1 = 85.93%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.92 ms.
cifar10        train : [loss = 0.038, top1 = 98.94%], test  : [loss = 0.436, top1 = 89.31%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=17.16 ms.
cifar100       train : [loss = 0.463, top1 = 86.99%], valid : [loss = 1.449, top1 = 63.70%], test : [loss = 1.419, top1 = 64.32%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.52%], valid : [loss = 2.589, top1 = 35.27%], test : [loss = 2.612, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.92%], valid : [loss = 0.785, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3401/15625) 003401-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.463, top1 = 89.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.327, top1 = 92.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.82 ms.
cifar100       train : [loss = 0.194, top1 = 95.38%], valid : [loss = 1.346, top1 = 68.35%], test : [loss = 1.315, top1 = 68.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.44%], valid : [loss = 2.301, top1 = 41.26%], test : [loss = 2.306, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.68%], valid : [loss = 0.572, top1 = 80.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3402/15625) 003402-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.78%], valid : [loss = 0.654, top1 = 84.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.059, top1 = 98.22%], test  : [loss = 0.391, top1 = 89.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.04 ms.
cifar100       train : [loss = 0.690, top1 = 79.74%], valid : [loss = 1.467, top1 = 61.90%], test : [loss = 1.452, top1 = 61.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.45 ms.
ImageNet16-120 train : [loss = 2.459, top1 = 37.43%], valid : [loss = 2.600, top1 = 34.20%], test : [loss = 2.630, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.65%], valid : [loss = 0.892, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3403/15625) 003403-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.44%], valid : [loss = 0.701, top1 = 81.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10        train : [loss = 0.134, top1 = 95.48%], test  : [loss = 0.495, top1 = 85.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.34 ms.
cifar100       train : [loss = 0.647, top1 = 80.81%], valid : [loss = 1.681, top1 = 58.12%], test : [loss = 1.678, top1 = 58.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 3.316, top1 = 20.17%], valid : [loss = 3.353, top1 = 20.03%], test : [loss = 3.375, top1 = 19.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.241, top1 = 54.43%], valid : [loss = 1.267, top1 = 54.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3404/15625) 003404-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.521, top1 = 88.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.340, top1 = 91.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.91 ms.
cifar100       train : [loss = 0.362, top1 = 90.15%], valid : [loss = 1.260, top1 = 66.86%], test : [loss = 1.313, top1 = 67.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.68%], valid : [loss = 2.391, top1 = 39.30%], test : [loss = 2.426, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.04%], valid : [loss = 0.627, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3405/15625) 003405-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.557, top1 = 88.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.60 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.358, top1 = 91.76%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.79 ms.
cifar100       train : [loss = 0.251, top1 = 93.26%], valid : [loss = 1.292, top1 = 68.30%], test : [loss = 1.332, top1 = 67.48%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.36%], valid : [loss = 2.426, top1 = 38.57%], test : [loss = 2.431, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.938, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3406/15625) 003406-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.313, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.29 ms.
cifar100       train : [loss = 0.326, top1 = 91.15%], valid : [loss = 1.294, top1 = 67.57%], test : [loss = 1.302, top1 = 66.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.37%], valid : [loss = 2.353, top1 = 40.00%], test : [loss = 2.393, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.46%], valid : [loss = 0.541, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3407/15625) 003407-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.537, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.347, top1 = 91.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.298, top1 = 91.94%], valid : [loss = 1.248, top1 = 67.50%], test : [loss = 1.272, top1 = 68.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.70 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.62%], valid : [loss = 2.399, top1 = 39.60%], test : [loss = 2.424, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.06%], valid : [loss = 0.857, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3408/15625) 003408-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.25%], valid : [loss = 0.456, top1 = 87.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.114, top1 = 96.55%], test  : [loss = 0.337, top1 = 89.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.43 ms.
cifar100       train : [loss = 0.870, top1 = 75.35%], valid : [loss = 1.306, top1 = 64.17%], test : [loss = 1.287, top1 = 63.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.59%], valid : [loss = 2.626, top1 = 33.80%], test : [loss = 2.658, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3409/15625) 003409-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.76%], valid : [loss = 0.456, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.51 ms.
cifar10        train : [loss = 0.159, top1 = 94.74%], test  : [loss = 0.352, top1 = 88.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 1.001, top1 = 71.65%], valid : [loss = 1.363, top1 = 62.52%], test : [loss = 1.358, top1 = 62.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.61%], valid : [loss = 2.690, top1 = 33.17%], test : [loss = 2.722, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.25%], valid : [loss = 0.797, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3410/15625) 003410-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.80%], valid : [loss = 0.815, top1 = 78.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.220, top1 = 92.46%], test  : [loss = 0.573, top1 = 83.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 1.141, top1 = 67.75%], valid : [loss = 1.719, top1 = 54.62%], test : [loss = 1.747, top1 = 54.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 3.220, top1 = 22.89%], valid : [loss = 3.316, top1 = 22.33%], test : [loss = 3.375, top1 = 20.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.59%], valid : [loss = 1.120, top1 = 60.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3411/15625) 003411-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.92%], valid : [loss = 0.681, top1 = 84.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.47 ms.
cifar10        train : [loss = 0.084, top1 = 97.33%], test  : [loss = 0.459, top1 = 87.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.45 ms.
cifar100       train : [loss = 0.793, top1 = 76.88%], valid : [loss = 1.535, top1 = 60.76%], test : [loss = 1.507, top1 = 60.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.725, top1 = 31.96%], valid : [loss = 2.859, top1 = 30.03%], test : [loss = 2.907, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.04%], valid : [loss = 0.851, top1 = 70.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3412/15625) 003412-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.601, top1 = 87.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.381, top1 = 91.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.380, top1 = 89.31%], valid : [loss = 1.383, top1 = 65.38%], test : [loss = 1.384, top1 = 65.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.31%], valid : [loss = 2.516, top1 = 36.80%], test : [loss = 2.528, top1 = 36.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.31%], valid : [loss = 0.837, top1 = 70.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3413/15625) 003413-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.02 ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.74%], valid : [loss = 0.875, top1 = 71.41%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.11 ms.
cifar10        train : [loss = 0.567, top1 = 80.39%], test  : [loss = 0.721, top1 = 75.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.24 ms.
cifar100       train : [loss = 1.783, top1 = 51.92%], valid : [loss = 2.032, top1 = 46.74%], test : [loss = 2.063, top1 = 46.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.30 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.63%], valid : [loss = 3.641, top1 = 16.67%], test : [loss = 3.680, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3414/15625) 003414-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.20%], valid : [loss = 0.491, top1 = 87.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.31 ms.
cifar10        train : [loss = 0.055, top1 = 98.34%], test  : [loss = 0.355, top1 = 90.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.08 ms.
cifar100       train : [loss = 0.586, top1 = 82.96%], valid : [loss = 1.230, top1 = 66.30%], test : [loss = 1.228, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.70%], valid : [loss = 2.353, top1 = 40.50%], test : [loss = 2.376, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.33%], valid : [loss = 0.891, top1 = 68.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3415/15625) 003415-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.557, top1 = 87.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.49 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.383, top1 = 90.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.415, top1 = 88.32%], valid : [loss = 1.406, top1 = 65.34%], test : [loss = 1.426, top1 = 64.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.82%], valid : [loss = 2.498, top1 = 36.60%], test : [loss = 2.501, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3416/15625) 003416-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.594, top1 = 86.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.407, top1 = 90.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.487, top1 = 85.86%], valid : [loss = 1.403, top1 = 64.98%], test : [loss = 1.380, top1 = 64.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.369, top1 = 39.60%], valid : [loss = 2.532, top1 = 36.00%], test : [loss = 2.564, top1 = 35.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 73.94%], valid : [loss = 0.790, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3417/15625) 003417-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.042, top1 = 99.10%], valid : [loss = 0.558, top1 = 86.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.11 ms.
cifar10        train : [loss = 0.058, top1 = 98.45%], test  : [loss = 0.358, top1 = 89.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.572, top1 = 83.64%], valid : [loss = 1.295, top1 = 65.16%], test : [loss = 1.329, top1 = 65.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.92%], valid : [loss = 2.419, top1 = 39.00%], test : [loss = 2.443, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 70.92%], valid : [loss = 0.880, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3418/15625) 003418-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.55 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.68%], valid : [loss = 0.657, top1 = 77.70%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10        train : [loss = 0.517, top1 = 82.17%], test  : [loss = 0.581, top1 = 80.34%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.29 ms.
cifar100       train : [loss = 1.759, top1 = 52.28%], valid : [loss = 1.907, top1 = 48.70%], test : [loss = 1.917, top1 = 49.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 3.396, top1 = 19.93%], valid : [loss = 3.395, top1 = 20.20%], test : [loss = 3.408, top1 = 19.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3419/15625) 003419-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.471, top1 = 90.28%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.23 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.310, top1 = 93.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.12 ms.
cifar100       train : [loss = 0.116, top1 = 97.75%], valid : [loss = 1.285, top1 = 69.94%], test : [loss = 1.273, top1 = 69.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.35%], valid : [loss = 2.172, top1 = 43.73%], test : [loss = 2.214, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.70%], valid : [loss = 0.608, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3420/15625) 003420-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.442, top1 = 89.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10        train : [loss = 0.009, top1 = 99.89%], test  : [loss = 0.303, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.27 ms.
cifar100       train : [loss = 0.206, top1 = 95.25%], valid : [loss = 1.250, top1 = 69.84%], test : [loss = 1.284, top1 = 68.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.41 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.98%], valid : [loss = 2.254, top1 = 41.93%], test : [loss = 2.285, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.10%], valid : [loss = 0.523, top1 = 82.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3421/15625) 003421-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.238, top1 = 91.77%], valid : [loss = 0.515, top1 = 83.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10        train : [loss = 0.238, top1 = 91.78%], test  : [loss = 0.377, top1 = 87.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.96 ms.
cifar100       train : [loss = 1.268, top1 = 63.99%], valid : [loss = 1.542, top1 = 57.68%], test : [loss = 1.533, top1 = 57.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.848, top1 = 29.59%], valid : [loss = 2.861, top1 = 29.77%], test : [loss = 2.910, top1 = 28.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3422/15625) 003422-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.74%], valid : [loss = 0.973, top1 = 66.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.01 ms.
cifar10        train : [loss = 0.785, top1 = 72.39%], test  : [loss = 0.860, top1 = 69.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 2.130, top1 = 43.85%], valid : [loss = 2.301, top1 = 41.24%], test : [loss = 2.321, top1 = 41.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.32%], valid : [loss = 3.769, top1 = 13.80%], test : [loss = 3.773, top1 = 13.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.462, top1 = 46.22%], valid : [loss = 1.477, top1 = 46.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3423/15625) 003423-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.51%], valid : [loss = 0.920, top1 = 68.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.67 ms.
cifar10        train : [loss = 0.765, top1 = 72.96%], test  : [loss = 0.823, top1 = 71.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.30 ms.
cifar100       train : [loss = 2.353, top1 = 38.47%], valid : [loss = 2.483, top1 = 35.94%], test : [loss = 2.477, top1 = 36.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 3.565, top1 = 16.69%], valid : [loss = 3.552, top1 = 17.00%], test : [loss = 3.578, top1 = 16.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.456, top1 = 46.40%], valid : [loss = 1.497, top1 = 45.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3424/15625) 003424-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.477, top1 = 90.33%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.34 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.298, top1 = 93.50%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.39 ms.
cifar100       train : [loss = 0.098, top1 = 98.31%], valid : [loss = 1.279, top1 = 70.48%], test : [loss = 1.281, top1 = 70.28%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 55.89%], valid : [loss = 2.150, top1 = 44.70%], test : [loss = 2.133, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.98%], valid : [loss = 0.650, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3425/15625) 003425-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.90 ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.55%], valid : [loss = 0.661, top1 = 77.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10        train : [loss = 0.520, top1 = 81.89%], test  : [loss = 0.603, top1 = 79.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.79 ms.
cifar100       train : [loss = 1.719, top1 = 53.50%], valid : [loss = 1.887, top1 = 50.41%], test : [loss = 1.891, top1 = 50.12%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.75 ms.
ImageNet16-120 train : [loss = 3.331, top1 = 21.15%], valid : [loss = 3.324, top1 = 20.87%], test : [loss = 3.370, top1 = 20.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3426/15625) 003426-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.19 ms.
cifar10-valid  train : [loss = 1.835, top1 = 33.66%], valid : [loss = 1.855, top1 = 33.05%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.83 ms.
cifar10        train : [loss = 1.403, top1 = 48.60%], test  : [loss = 1.402, top1 = 48.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 3.800, top1 = 11.95%], valid : [loss = 3.902, top1 = 10.31%], test : [loss = 3.896, top1 = 10.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.58 ms.
ImageNet16-120 train : [loss = 3.949, top1 = 11.09%], valid : [loss = 3.928, top1 = 11.68%], test : [loss = 3.932, top1 = 11.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.53%], valid : [loss = 1.967, top1 = 27.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3427/15625) 003427-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.639, top1 = 85.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10        train : [loss = 0.072, top1 = 97.74%], test  : [loss = 0.428, top1 = 88.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.08 ms.
cifar100       train : [loss = 0.736, top1 = 78.64%], valid : [loss = 1.417, top1 = 63.00%], test : [loss = 1.370, top1 = 63.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.60%], valid : [loss = 2.675, top1 = 33.80%], test : [loss = 2.711, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.16%], valid : [loss = 0.783, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3428/15625) 003428-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.501, top1 = 89.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.40 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.317, top1 = 93.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.91 ms.
cifar100       train : [loss = 0.117, top1 = 97.68%], valid : [loss = 1.310, top1 = 69.38%], test : [loss = 1.264, top1 = 70.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 1.705, top1 = 54.41%], valid : [loss = 2.183, top1 = 44.37%], test : [loss = 2.192, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.00%], valid : [loss = 0.656, top1 = 77.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3429/15625) 003429-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.54%], valid : [loss = 0.586, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.395, top1 = 90.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.541, top1 = 84.61%], valid : [loss = 1.362, top1 = 63.90%], test : [loss = 1.365, top1 = 64.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.588, top1 = 34.22%], valid : [loss = 2.673, top1 = 32.23%], test : [loss = 2.698, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3430/15625) 003430-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.526, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.60 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.351, top1 = 92.67%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.36 ms.
cifar100       train : [loss = 0.096, top1 = 98.36%], valid : [loss = 1.444, top1 = 69.14%], test : [loss = 1.474, top1 = 68.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.95 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.60%], valid : [loss = 2.397, top1 = 40.87%], test : [loss = 2.385, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.39%], valid : [loss = 0.681, top1 = 76.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3431/15625) 003431-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.16%], valid : [loss = 0.453, top1 = 86.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10        train : [loss = 0.156, top1 = 94.89%], test  : [loss = 0.336, top1 = 89.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.53 ms.
cifar100       train : [loss = 1.021, top1 = 70.73%], valid : [loss = 1.383, top1 = 61.04%], test : [loss = 1.364, top1 = 61.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.29 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 33.98%], valid : [loss = 2.673, top1 = 33.70%], test : [loss = 2.673, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3432/15625) 003432-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.23%], valid : [loss = 0.494, top1 = 84.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.275, top1 = 90.64%], test  : [loss = 0.429, top1 = 85.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.92 ms.
cifar100       train : [loss = 1.283, top1 = 63.93%], valid : [loss = 1.558, top1 = 56.06%], test : [loss = 1.552, top1 = 57.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.34 ms.
ImageNet16-120 train : [loss = 3.491, top1 = 17.85%], valid : [loss = 3.477, top1 = 18.17%], test : [loss = 3.518, top1 = 17.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.55%], valid : [loss = 1.052, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3433/15625) 003433-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.43%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.19 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.358, top1 = 92.73%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.18 ms.
cifar100       train : [loss = 0.101, top1 = 98.06%], valid : [loss = 1.440, top1 = 68.26%], test : [loss = 1.446, top1 = 68.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.78 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.52%], valid : [loss = 2.388, top1 = 39.93%], test : [loss = 2.419, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.64%], valid : [loss = 0.713, top1 = 75.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3434/15625) 003434-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=137.54 M, Params=0.964 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.533, top1 = 89.34%]
cifar10        FLOP=137.54 M, Params=0.964 MB, latency=18.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.357, top1 = 92.84%]
cifar100       FLOP=137.55 M, Params=0.970 MB, latency=17.75 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.447, top1 = 68.46%], test : [loss = 1.456, top1 = 68.47%]
ImageNet16-120 FLOP= 34.39 M, Params=0.972 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.749, top1 = 53.40%], valid : [loss = 2.378, top1 = 40.47%], test : [loss = 2.390, top1 = 41.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.92%], valid : [loss = 0.667, top1 = 77.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3435/15625) 003435-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.450, top1 = 89.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.314, top1 = 92.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.30 ms.
cifar100       train : [loss = 0.223, top1 = 94.55%], valid : [loss = 1.313, top1 = 68.25%], test : [loss = 1.302, top1 = 68.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.74%], valid : [loss = 2.296, top1 = 41.44%], test : [loss = 2.333, top1 = 41.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.92%], valid : [loss = 0.550, top1 = 81.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3436/15625) 003436-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.70%], valid : [loss = 0.460, top1 = 86.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.137, top1 = 95.57%], test  : [loss = 0.331, top1 = 89.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.65 ms.
cifar100       train : [loss = 0.972, top1 = 72.49%], valid : [loss = 1.341, top1 = 61.98%], test : [loss = 1.349, top1 = 62.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.07%], valid : [loss = 2.674, top1 = 33.10%], test : [loss = 2.692, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3437/15625) 003437-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.62 ms.
cifar10-valid  train : [loss = 0.955, top1 = 66.47%], valid : [loss = 0.999, top1 = 65.43%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10        train : [loss = 0.884, top1 = 69.30%], test  : [loss = 0.886, top1 = 69.02%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.56 ms.
cifar100       train : [loss = 2.377, top1 = 39.06%], valid : [loss = 2.440, top1 = 37.76%], test : [loss = 2.433, top1 = 38.17%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.62 ms.
ImageNet16-120 train : [loss = 3.631, top1 = 15.96%], valid : [loss = 3.603, top1 = 16.71%], test : [loss = 3.625, top1 = 16.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.610, top1 = 39.64%], valid : [loss = 1.669, top1 = 36.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3438/15625) 003438-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.93%], valid : [loss = 0.477, top1 = 84.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10        train : [loss = 0.301, top1 = 89.82%], test  : [loss = 0.398, top1 = 86.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 1.322, top1 = 63.55%], valid : [loss = 1.531, top1 = 57.98%], test : [loss = 1.505, top1 = 59.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.51%], valid : [loss = 2.899, top1 = 30.10%], test : [loss = 2.957, top1 = 27.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.81%], valid : [loss = 0.768, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3439/15625) 003439-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.319, top1 = 92.57%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.08 ms.
cifar100       train : [loss = 0.113, top1 = 97.72%], valid : [loss = 1.305, top1 = 69.14%], test : [loss = 1.286, top1 = 70.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.68%], valid : [loss = 2.302, top1 = 41.30%], test : [loss = 2.296, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 78.01%], valid : [loss = 0.699, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3440/15625) 003440-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.76%], valid : [loss = 0.591, top1 = 86.54%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.92 ms.
cifar10        train : [loss = 0.036, top1 = 99.02%], test  : [loss = 0.413, top1 = 89.44%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.24 ms.
cifar100       train : [loss = 0.399, top1 = 89.08%], valid : [loss = 1.398, top1 = 65.51%], test : [loss = 1.402, top1 = 65.01%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.10%], valid : [loss = 2.570, top1 = 35.47%], test : [loss = 2.579, top1 = 36.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.94%], valid : [loss = 0.757, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3441/15625) 003441-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.41%], valid : [loss = 0.576, top1 = 87.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.60 ms.
cifar10        train : [loss = 0.050, top1 = 98.51%], test  : [loss = 0.379, top1 = 90.14%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.26 ms.
cifar100       train : [loss = 0.535, top1 = 84.34%], valid : [loss = 1.324, top1 = 65.74%], test : [loss = 1.285, top1 = 65.72%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.49%], valid : [loss = 2.414, top1 = 39.00%], test : [loss = 2.416, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.26%], valid : [loss = 0.754, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3442/15625) 003442-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.05 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.78%], valid : [loss = 0.477, top1 = 84.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.89 ms.
cifar10        train : [loss = 0.304, top1 = 89.85%], test  : [loss = 0.406, top1 = 86.26%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.94 ms.
cifar100       train : [loss = 1.347, top1 = 62.97%], valid : [loss = 1.538, top1 = 57.00%], test : [loss = 1.524, top1 = 57.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.59 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.54%], valid : [loss = 2.916, top1 = 29.33%], test : [loss = 2.960, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3443/15625) 003443-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.16%], valid : [loss = 0.853, top1 = 72.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.569, top1 = 79.87%], test  : [loss = 0.721, top1 = 75.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.99 ms.
cifar100       train : [loss = 1.777, top1 = 52.07%], valid : [loss = 2.037, top1 = 47.76%], test : [loss = 2.046, top1 = 46.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.73%], valid : [loss = 3.642, top1 = 15.73%], test : [loss = 3.665, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3444/15625) 003444-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.83 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.93%], valid : [loss = 0.563, top1 = 86.49%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.42 ms.
cifar10        train : [loss = 0.060, top1 = 98.14%], test  : [loss = 0.366, top1 = 90.07%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.94 ms.
cifar100       train : [loss = 0.639, top1 = 81.02%], valid : [loss = 1.337, top1 = 64.52%], test : [loss = 1.325, top1 = 65.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.27%], valid : [loss = 2.501, top1 = 36.37%], test : [loss = 2.537, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.10%], valid : [loss = 0.805, top1 = 72.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3445/15625) 003445-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.97 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.37%], valid : [loss = 0.562, top1 = 87.30%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.86 ms.
cifar10        train : [loss = 0.048, top1 = 98.57%], test  : [loss = 0.381, top1 = 90.28%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=21.11 ms.
cifar100       train : [loss = 0.455, top1 = 86.97%], valid : [loss = 1.304, top1 = 66.86%], test : [loss = 1.295, top1 = 66.60%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 43.98%], valid : [loss = 2.383, top1 = 39.47%], test : [loss = 2.385, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.24%], valid : [loss = 0.813, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3446/15625) 003446-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.42%], valid : [loss = 0.769, top1 = 73.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.581, top1 = 79.76%], test  : [loss = 0.648, top1 = 77.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.28 ms.
cifar100       train : [loss = 2.005, top1 = 45.70%], valid : [loss = 2.153, top1 = 43.80%], test : [loss = 2.143, top1 = 43.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 3.220, top1 = 22.55%], valid : [loss = 3.221, top1 = 22.97%], test : [loss = 3.239, top1 = 23.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.305, top1 = 52.72%], valid : [loss = 1.370, top1 = 50.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3447/15625) 003447-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.457, top1 = 89.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10        train : [loss = 0.012, top1 = 99.82%], test  : [loss = 0.323, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.71 ms.
cifar100       train : [loss = 0.316, top1 = 91.33%], valid : [loss = 1.319, top1 = 66.78%], test : [loss = 1.313, top1 = 67.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.22%], valid : [loss = 2.331, top1 = 40.00%], test : [loss = 2.397, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.57%], valid : [loss = 0.590, top1 = 80.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3448/15625) 003448-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10-valid  train : [loss = 1.849, top1 = 33.13%], valid : [loss = 1.863, top1 = 32.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.00 ms.
cifar10        train : [loss = 1.396, top1 = 48.61%], test  : [loss = 1.398, top1 = 48.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.65 ms.
cifar100       train : [loss = 3.911, top1 = 9.84%], valid : [loss = 3.909, top1 = 9.83%], test : [loss = 3.909, top1 = 10.15%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.47 ms.
ImageNet16-120 train : [loss = 3.962, top1 = 11.02%], valid : [loss = 3.953, top1 = 11.62%], test : [loss = 3.969, top1 = 11.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.970, top1 = 27.07%], valid : [loss = 1.970, top1 = 27.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3449/15625) 003449-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.95%], valid : [loss = 0.478, top1 = 84.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.303, top1 = 89.81%], test  : [loss = 0.401, top1 = 86.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.78 ms.
cifar100       train : [loss = 1.331, top1 = 63.05%], valid : [loss = 1.538, top1 = 57.34%], test : [loss = 1.510, top1 = 58.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.933, top1 = 28.36%], valid : [loss = 2.904, top1 = 28.97%], test : [loss = 2.956, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3450/15625) 003450-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.21%], valid : [loss = 0.558, top1 = 87.18%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.89 ms.
cifar10        train : [loss = 0.063, top1 = 97.99%], test  : [loss = 0.372, top1 = 90.31%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.79 ms.
cifar100       train : [loss = 0.515, top1 = 85.10%], valid : [loss = 1.318, top1 = 65.94%], test : [loss = 1.307, top1 = 64.98%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 2.275, top1 = 41.36%], valid : [loss = 2.442, top1 = 38.20%], test : [loss = 2.474, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.00%], valid : [loss = 0.892, top1 = 68.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3451/15625) 003451-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.574, top1 = 87.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.36 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.363, top1 = 91.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.25 ms.
cifar100       train : [loss = 0.215, top1 = 94.91%], valid : [loss = 1.398, top1 = 66.48%], test : [loss = 1.386, top1 = 66.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.31%], valid : [loss = 2.405, top1 = 39.33%], test : [loss = 2.429, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.53%], valid : [loss = 0.691, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3452/15625) 003452-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.503, top1 = 88.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.76 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.331, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.07 ms.
cifar100       train : [loss = 0.368, top1 = 89.97%], valid : [loss = 1.291, top1 = 66.76%], test : [loss = 1.280, top1 = 66.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.29%], valid : [loss = 2.446, top1 = 38.47%], test : [loss = 2.435, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3453/15625) 003453-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.26%], valid : [loss = 0.596, top1 = 85.72%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.067, top1 = 97.97%], test  : [loss = 0.406, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.74 ms.
cifar100       train : [loss = 0.698, top1 = 79.71%], valid : [loss = 1.375, top1 = 63.35%], test : [loss = 1.358, top1 = 63.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.08%], valid : [loss = 2.659, top1 = 33.71%], test : [loss = 2.680, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.00%], valid : [loss = 0.772, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3454/15625) 003454-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.588, top1 = 86.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.65 ms.
cifar10        train : [loss = 0.042, top1 = 98.69%], test  : [loss = 0.411, top1 = 89.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.17 ms.
cifar100       train : [loss = 0.546, top1 = 83.96%], valid : [loss = 1.406, top1 = 64.06%], test : [loss = 1.441, top1 = 62.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 36.94%], valid : [loss = 2.642, top1 = 33.60%], test : [loss = 2.667, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3455/15625) 003455-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.68%], valid : [loss = 0.675, top1 = 77.10%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.550, top1 = 80.72%], test  : [loss = 0.611, top1 = 79.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.89 ms.
cifar100       train : [loss = 1.747, top1 = 52.54%], valid : [loss = 1.889, top1 = 49.36%], test : [loss = 1.930, top1 = 49.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 3.383, top1 = 20.28%], valid : [loss = 3.370, top1 = 20.90%], test : [loss = 3.400, top1 = 19.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 51.09%], valid : [loss = 1.361, top1 = 51.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3456/15625) 003456-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.20 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.430, top1 = 91.16%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.23 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.276, top1 = 94.13%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.18 ms.
cifar100       train : [loss = 0.021, top1 = 99.82%], valid : [loss = 1.317, top1 = 72.42%], test : [loss = 1.321, top1 = 72.22%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.181, top1 = 67.10%], valid : [loss = 2.228, top1 = 44.87%], test : [loss = 2.230, top1 = 45.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.334, top1 = 88.62%], valid : [loss = 0.474, top1 = 84.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3457/15625) 003457-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.77%], valid : [loss = 0.552, top1 = 87.50%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.22 ms.
cifar10        train : [loss = 0.025, top1 = 99.33%], test  : [loss = 0.366, top1 = 90.85%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.14 ms.
cifar100       train : [loss = 0.403, top1 = 88.41%], valid : [loss = 1.373, top1 = 65.56%], test : [loss = 1.358, top1 = 66.16%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.44%], valid : [loss = 2.454, top1 = 38.67%], test : [loss = 2.456, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.577, top1 = 79.91%], valid : [loss = 0.658, top1 = 77.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3458/15625) 003458-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.494, top1 = 89.54%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.71 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.293, top1 = 93.29%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.93 ms.
cifar100       train : [loss = 0.120, top1 = 97.82%], valid : [loss = 1.236, top1 = 70.44%], test : [loss = 1.238, top1 = 70.72%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.45 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.09%], valid : [loss = 2.140, top1 = 43.97%], test : [loss = 2.145, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.55%], valid : [loss = 0.621, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3459/15625) 003459-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.557, top1 = 87.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.399, top1 = 90.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.55 ms.
cifar100       train : [loss = 0.380, top1 = 89.31%], valid : [loss = 1.381, top1 = 65.36%], test : [loss = 1.391, top1 = 65.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.84%], valid : [loss = 2.521, top1 = 37.00%], test : [loss = 2.521, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.80%], valid : [loss = 0.839, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3460/15625) 003460-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.95%], valid : [loss = 0.855, top1 = 71.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10        train : [loss = 0.684, top1 = 76.01%], test  : [loss = 0.769, top1 = 73.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.08 ms.
cifar100       train : [loss = 1.957, top1 = 47.98%], valid : [loss = 2.130, top1 = 44.77%], test : [loss = 2.161, top1 = 44.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.77%], valid : [loss = 3.676, top1 = 16.22%], test : [loss = 3.695, top1 = 15.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3461/15625) 003461-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.529, top1 = 89.62%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.65 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.330, top1 = 93.20%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.92 ms.
cifar100       train : [loss = 0.127, top1 = 97.50%], valid : [loss = 1.356, top1 = 68.26%], test : [loss = 1.338, top1 = 68.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.81%], valid : [loss = 2.203, top1 = 43.37%], test : [loss = 2.192, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.59%], valid : [loss = 0.774, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3462/15625) 003462-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.474, top1 = 89.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.35 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.339, top1 = 92.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.158, top1 = 96.40%], valid : [loss = 1.444, top1 = 68.40%], test : [loss = 1.411, top1 = 67.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.51%], valid : [loss = 2.392, top1 = 40.10%], test : [loss = 2.387, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.10%], valid : [loss = 0.628, top1 = 78.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3463/15625) 003463-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.78%], valid : [loss = 0.853, top1 = 72.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.549, top1 = 80.72%], test  : [loss = 0.714, top1 = 75.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.779, top1 = 52.09%], valid : [loss = 2.062, top1 = 46.42%], test : [loss = 2.074, top1 = 46.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.88%], valid : [loss = 3.634, top1 = 16.67%], test : [loss = 3.667, top1 = 15.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3464/15625) 003464-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.516, top1 = 89.76%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.52 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.364, top1 = 92.84%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.19 ms.
cifar100       train : [loss = 0.049, top1 = 99.34%], valid : [loss = 1.382, top1 = 69.84%], test : [loss = 1.396, top1 = 69.60%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.67%], valid : [loss = 2.394, top1 = 39.37%], test : [loss = 2.424, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.08%], valid : [loss = 0.806, top1 = 71.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3465/15625) 003465-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.47%], valid : [loss = 0.552, top1 = 83.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.225, top1 = 92.24%], test  : [loss = 0.411, top1 = 86.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.55 ms.
cifar100       train : [loss = 1.209, top1 = 65.69%], valid : [loss = 1.583, top1 = 57.64%], test : [loss = 1.568, top1 = 57.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.51%], valid : [loss = 2.961, top1 = 28.27%], test : [loss = 3.014, top1 = 27.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.32%], valid : [loss = 1.211, top1 = 56.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3466/15625) 003466-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.453, top1 = 89.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.315, top1 = 92.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.17 ms.
cifar100       train : [loss = 0.325, top1 = 91.20%], valid : [loss = 1.286, top1 = 67.22%], test : [loss = 1.296, top1 = 67.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.21%], valid : [loss = 2.370, top1 = 40.27%], test : [loss = 2.395, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.80%], valid : [loss = 0.562, top1 = 80.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3467/15625) 003467-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.49 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.305, top1 = 93.08%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.35 ms.
cifar100       train : [loss = 0.068, top1 = 98.99%], valid : [loss = 1.352, top1 = 69.92%], test : [loss = 1.307, top1 = 70.80%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.553, top1 = 58.08%], valid : [loss = 2.260, top1 = 43.57%], test : [loss = 2.277, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.96%], valid : [loss = 0.495, top1 = 83.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3468/15625) 003468-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.00%], valid : [loss = 0.579, top1 = 86.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.61 ms.
cifar10        train : [loss = 0.068, top1 = 97.79%], test  : [loss = 0.378, top1 = 90.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.92 ms.
cifar100       train : [loss = 0.656, top1 = 80.53%], valid : [loss = 1.285, top1 = 65.58%], test : [loss = 1.306, top1 = 65.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.07%], valid : [loss = 2.504, top1 = 36.13%], test : [loss = 2.502, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.16%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3469/15625) 003469-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.502, top1 = 89.09%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.93 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.329, top1 = 92.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.02 ms.
cifar100       train : [loss = 0.182, top1 = 95.76%], valid : [loss = 1.318, top1 = 69.42%], test : [loss = 1.356, top1 = 68.32%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.31%], valid : [loss = 2.296, top1 = 40.93%], test : [loss = 2.319, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.02%], valid : [loss = 0.617, top1 = 78.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3470/15625) 003470-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.280, top1 = 93.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.185, top1 = 95.58%], valid : [loss = 1.266, top1 = 69.76%], test : [loss = 1.294, top1 = 69.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.58%], valid : [loss = 2.273, top1 = 42.20%], test : [loss = 2.297, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.03%], valid : [loss = 0.504, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3471/15625) 003471-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.35 ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.16%], valid : [loss = 0.921, top1 = 67.94%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.725, top1 = 74.57%], test  : [loss = 0.768, top1 = 73.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.96 ms.
cifar100       train : [loss = 2.239, top1 = 40.55%], valid : [loss = 2.359, top1 = 38.38%], test : [loss = 2.337, top1 = 38.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 3.505, top1 = 17.71%], valid : [loss = 3.476, top1 = 18.40%], test : [loss = 3.505, top1 = 17.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.359, top1 = 50.25%], valid : [loss = 1.396, top1 = 49.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3472/15625) 003472-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.09 ms.
cifar10-valid  train : [loss = 0.492, top1 = 83.03%], valid : [loss = 0.641, top1 = 78.43%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.62 ms.
cifar10        train : [loss = 0.535, top1 = 81.39%], test  : [loss = 0.617, top1 = 79.21%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.60 ms.
cifar100       train : [loss = 1.680, top1 = 54.35%], valid : [loss = 1.843, top1 = 51.28%], test : [loss = 1.856, top1 = 50.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.42 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.24%], valid : [loss = 3.320, top1 = 20.93%], test : [loss = 3.358, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3473/15625) 003473-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.522, top1 = 89.32%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.374, top1 = 92.50%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.58 ms.
cifar100       train : [loss = 0.067, top1 = 99.04%], valid : [loss = 1.424, top1 = 68.58%], test : [loss = 1.355, top1 = 69.78%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.64%], valid : [loss = 2.396, top1 = 40.23%], test : [loss = 2.384, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.82%], valid : [loss = 0.679, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3474/15625) 003474-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.400, top1 = 90.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.281, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.82 ms.
cifar100       train : [loss = 0.095, top1 = 98.42%], valid : [loss = 1.266, top1 = 69.92%], test : [loss = 1.265, top1 = 70.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 1.624, top1 = 56.19%], valid : [loss = 2.229, top1 = 43.50%], test : [loss = 2.218, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.38%], valid : [loss = 0.507, top1 = 83.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3475/15625) 003475-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.612, top1 = 88.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.408, top1 = 91.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.88 ms.
cifar100       train : [loss = 0.169, top1 = 96.27%], valid : [loss = 1.457, top1 = 66.56%], test : [loss = 1.461, top1 = 67.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.48 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.37%], valid : [loss = 2.437, top1 = 37.87%], test : [loss = 2.484, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.56%], valid : [loss = 0.744, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3476/15625) 003476-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.94 ms.
cifar10-valid  train : [loss = 0.655, top1 = 77.11%], valid : [loss = 0.828, top1 = 71.66%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.06 ms.
cifar10        train : [loss = 0.695, top1 = 75.64%], test  : [loss = 0.784, top1 = 73.21%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.97 ms.
cifar100       train : [loss = 1.966, top1 = 47.72%], valid : [loss = 2.130, top1 = 44.44%], test : [loss = 2.149, top1 = 44.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.86 ms.
ImageNet16-120 train : [loss = 3.652, top1 = 15.72%], valid : [loss = 3.675, top1 = 15.57%], test : [loss = 3.696, top1 = 14.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3477/15625) 003477-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.544, top1 = 89.43%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.50 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.349, top1 = 92.81%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.44 ms.
cifar100       train : [loss = 0.085, top1 = 98.50%], valid : [loss = 1.402, top1 = 68.44%], test : [loss = 1.403, top1 = 68.24%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.76%], valid : [loss = 2.327, top1 = 40.07%], test : [loss = 2.284, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.60%], valid : [loss = 0.659, top1 = 77.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3478/15625) 003478-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.474, top1 = 83.36%], valid : [loss = 0.719, top1 = 76.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.403, top1 = 86.02%], test  : [loss = 0.534, top1 = 82.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.58 ms.
cifar100       train : [loss = 1.659, top1 = 54.11%], valid : [loss = 1.880, top1 = 49.78%], test : [loss = 1.901, top1 = 49.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 3.307, top1 = 21.24%], valid : [loss = 3.314, top1 = 21.97%], test : [loss = 3.326, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.192, top1 = 56.44%], valid : [loss = 1.251, top1 = 55.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3479/15625) 003479-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.035, top1 = 98.99%], valid : [loss = 0.543, top1 = 87.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.70 ms.
cifar10        train : [loss = 0.059, top1 = 98.18%], test  : [loss = 0.362, top1 = 90.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.97 ms.
cifar100       train : [loss = 0.655, top1 = 80.70%], valid : [loss = 1.313, top1 = 64.96%], test : [loss = 1.283, top1 = 65.62%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.408, top1 = 38.54%], valid : [loss = 2.546, top1 = 35.43%], test : [loss = 2.553, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3480/15625) 003480-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.60%], valid : [loss = 0.813, top1 = 81.65%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.66 ms.
cifar10        train : [loss = 0.088, top1 = 97.11%], test  : [loss = 0.462, top1 = 87.34%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.98 ms.
cifar100       train : [loss = 0.571, top1 = 83.65%], valid : [loss = 1.685, top1 = 58.76%], test : [loss = 1.730, top1 = 57.58%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 27.88%], valid : [loss = 3.031, top1 = 26.50%], test : [loss = 3.043, top1 = 25.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.28%], valid : [loss = 0.999, top1 = 64.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3481/15625) 003481-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.545, top1 = 87.53%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10        train : [loss = 0.034, top1 = 99.09%], test  : [loss = 0.356, top1 = 90.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.14 ms.
cifar100       train : [loss = 0.519, top1 = 84.80%], valid : [loss = 1.329, top1 = 65.24%], test : [loss = 1.301, top1 = 66.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.56%], valid : [loss = 2.447, top1 = 38.57%], test : [loss = 2.481, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.15%], valid : [loss = 0.635, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3482/15625) 003482-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.19%], valid : [loss = 0.646, top1 = 78.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.507, top1 = 82.51%], test  : [loss = 0.588, top1 = 80.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 1.702, top1 = 54.00%], valid : [loss = 1.875, top1 = 50.19%], test : [loss = 1.877, top1 = 50.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 3.331, top1 = 21.23%], valid : [loss = 3.321, top1 = 21.50%], test : [loss = 3.345, top1 = 21.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.62%], valid : [loss = 1.304, top1 = 53.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3483/15625) 003483-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.44%], valid : [loss = 0.517, top1 = 86.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10        train : [loss = 0.089, top1 = 97.06%], test  : [loss = 0.346, top1 = 90.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 0.661, top1 = 80.86%], valid : [loss = 1.215, top1 = 67.26%], test : [loss = 1.199, top1 = 66.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.370, top1 = 39.37%], valid : [loss = 2.481, top1 = 36.03%], test : [loss = 2.517, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.61%], valid : [loss = 0.908, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3484/15625) 003484-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.590, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.34 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.400, top1 = 91.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.96 ms.
cifar100       train : [loss = 0.228, top1 = 94.36%], valid : [loss = 1.436, top1 = 67.00%], test : [loss = 1.396, top1 = 66.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.15%], valid : [loss = 2.482, top1 = 37.90%], test : [loss = 2.473, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.47%], valid : [loss = 0.696, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3485/15625) 003485-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.605, top1 = 86.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.84 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.379, top1 = 91.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.29 ms.
cifar100       train : [loss = 0.365, top1 = 89.61%], valid : [loss = 1.429, top1 = 65.30%], test : [loss = 1.410, top1 = 66.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.32%], valid : [loss = 2.521, top1 = 36.87%], test : [loss = 2.506, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.47%], valid : [loss = 0.860, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3486/15625) 003486-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.490, top1 = 90.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.08 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.324, top1 = 93.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.96 ms.
cifar100       train : [loss = 0.107, top1 = 97.99%], valid : [loss = 1.312, top1 = 69.75%], test : [loss = 1.290, top1 = 69.81%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 1.676, top1 = 54.98%], valid : [loss = 2.150, top1 = 44.92%], test : [loss = 2.196, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.96%], valid : [loss = 0.567, top1 = 80.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3487/15625) 003487-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.411, top1 = 90.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.280, top1 = 93.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.187, top1 = 95.58%], valid : [loss = 1.271, top1 = 69.13%], test : [loss = 1.249, top1 = 70.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.60%], valid : [loss = 2.260, top1 = 42.39%], test : [loss = 2.265, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3488/15625) 003488-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.494, top1 = 88.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.334, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.331, top1 = 91.04%], valid : [loss = 1.243, top1 = 68.32%], test : [loss = 1.250, top1 = 67.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.75%], valid : [loss = 2.297, top1 = 41.27%], test : [loss = 2.339, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3489/15625) 003489-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.504, top1 = 88.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.325, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.28 ms.
cifar100       train : [loss = 0.349, top1 = 90.46%], valid : [loss = 1.303, top1 = 66.40%], test : [loss = 1.278, top1 = 67.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.28%], valid : [loss = 2.396, top1 = 38.10%], test : [loss = 2.422, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3490/15625) 003490-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.469, top1 = 89.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.311, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.03 ms.
cifar100       train : [loss = 0.308, top1 = 91.88%], valid : [loss = 1.232, top1 = 67.90%], test : [loss = 1.238, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.31%], valid : [loss = 2.258, top1 = 42.27%], test : [loss = 2.300, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.13%], valid : [loss = 0.643, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3491/15625) 003491-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.421, top1 = 90.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.274, top1 = 93.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 0.200, top1 = 95.18%], valid : [loss = 1.256, top1 = 69.54%], test : [loss = 1.264, top1 = 69.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.33%], valid : [loss = 2.254, top1 = 42.13%], test : [loss = 2.281, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3492/15625) 003492-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.20%], valid : [loss = 0.611, top1 = 85.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10        train : [loss = 0.072, top1 = 97.81%], test  : [loss = 0.393, top1 = 88.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.77 ms.
cifar100       train : [loss = 0.723, top1 = 78.99%], valid : [loss = 1.404, top1 = 63.00%], test : [loss = 1.383, top1 = 62.93%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.91%], valid : [loss = 2.676, top1 = 33.56%], test : [loss = 2.700, top1 = 32.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3493/15625) 003493-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.58%], valid : [loss = 0.645, top1 = 85.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10        train : [loss = 0.033, top1 = 99.08%], test  : [loss = 0.386, top1 = 90.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.55 ms.
cifar100       train : [loss = 0.559, top1 = 83.82%], valid : [loss = 1.391, top1 = 64.28%], test : [loss = 1.420, top1 = 63.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.24%], valid : [loss = 2.554, top1 = 35.33%], test : [loss = 2.589, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 70.97%], valid : [loss = 0.880, top1 = 69.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3494/15625) 003494-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.63%], valid : [loss = 0.462, top1 = 86.34%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.50 ms.
cifar10        train : [loss = 0.129, top1 = 95.96%], test  : [loss = 0.333, top1 = 89.65%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.29 ms.
cifar100       train : [loss = 0.763, top1 = 78.66%], valid : [loss = 1.269, top1 = 64.64%], test : [loss = 1.275, top1 = 64.68%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 36.93%], valid : [loss = 2.579, top1 = 35.07%], test : [loss = 2.611, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3495/15625) 003495-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.79%], valid : [loss = 0.484, top1 = 84.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.296, top1 = 89.99%], test  : [loss = 0.400, top1 = 86.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.63 ms.
cifar100       train : [loss = 1.317, top1 = 63.56%], valid : [loss = 1.510, top1 = 58.30%], test : [loss = 1.499, top1 = 58.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.58%], valid : [loss = 2.899, top1 = 29.77%], test : [loss = 2.979, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3496/15625) 003496-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.22%], valid : [loss = 0.450, top1 = 87.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10        train : [loss = 0.112, top1 = 96.61%], test  : [loss = 0.323, top1 = 89.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.49 ms.
cifar100       train : [loss = 0.870, top1 = 75.18%], valid : [loss = 1.308, top1 = 63.75%], test : [loss = 1.290, top1 = 63.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.81 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.79%], valid : [loss = 2.610, top1 = 34.54%], test : [loss = 2.656, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3497/15625) 003497-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.69%], valid : [loss = 0.518, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.026, top1 = 99.20%], test  : [loss = 0.351, top1 = 91.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.68 ms.
cifar100       train : [loss = 0.431, top1 = 87.52%], valid : [loss = 1.251, top1 = 67.60%], test : [loss = 1.269, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.13 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.29%], valid : [loss = 2.374, top1 = 39.57%], test : [loss = 2.366, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.72%], valid : [loss = 0.787, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3498/15625) 003498-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.49 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.58%], valid : [loss = 0.440, top1 = 87.70%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.91 ms.
cifar10        train : [loss = 0.053, top1 = 98.75%], test  : [loss = 0.304, top1 = 90.87%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.63 ms.
cifar100       train : [loss = 0.574, top1 = 84.13%], valid : [loss = 1.219, top1 = 66.34%], test : [loss = 1.218, top1 = 66.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.86 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.51%], valid : [loss = 2.453, top1 = 37.90%], test : [loss = 2.441, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.92%], valid : [loss = 0.633, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3499/15625) 003499-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.67%], valid : [loss = 0.649, top1 = 84.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.17 ms.
cifar10        train : [loss = 0.075, top1 = 97.59%], test  : [loss = 0.413, top1 = 88.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.34 ms.
cifar100       train : [loss = 0.799, top1 = 76.57%], valid : [loss = 1.517, top1 = 59.98%], test : [loss = 1.479, top1 = 60.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.575, top1 = 35.15%], valid : [loss = 2.726, top1 = 31.53%], test : [loss = 2.777, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.40%], valid : [loss = 0.895, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3500/15625) 003500-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.54%], valid : [loss = 0.541, top1 = 87.55%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.00 ms.
cifar10        train : [loss = 0.037, top1 = 98.90%], test  : [loss = 0.354, top1 = 91.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.07 ms.
cifar100       train : [loss = 0.635, top1 = 81.70%], valid : [loss = 1.445, top1 = 61.74%], test : [loss = 1.447, top1 = 61.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.18%], valid : [loss = 2.464, top1 = 36.50%], test : [loss = 2.471, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.63%], valid : [loss = 0.939, top1 = 66.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3501/15625) 003501-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.84 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.74%], valid : [loss = 0.477, top1 = 84.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10        train : [loss = 0.301, top1 = 89.96%], test  : [loss = 0.406, top1 = 86.63%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.50 ms.
cifar100       train : [loss = 1.325, top1 = 63.24%], valid : [loss = 1.541, top1 = 57.64%], test : [loss = 1.517, top1 = 57.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.78%], valid : [loss = 2.884, top1 = 29.63%], test : [loss = 2.943, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3502/15625) 003502-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.627, top1 = 85.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.068, top1 = 97.90%], test  : [loss = 0.382, top1 = 89.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.735, top1 = 78.47%], valid : [loss = 1.394, top1 = 62.72%], test : [loss = 1.368, top1 = 62.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 2.566, top1 = 35.32%], valid : [loss = 2.673, top1 = 34.07%], test : [loss = 2.714, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.18%], valid : [loss = 0.787, top1 = 72.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3503/15625) 003503-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.471, top1 = 89.22%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.99 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.323, top1 = 92.16%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.54 ms.
cifar100       train : [loss = 0.258, top1 = 93.54%], valid : [loss = 1.254, top1 = 68.16%], test : [loss = 1.269, top1 = 68.56%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.35%], valid : [loss = 2.288, top1 = 41.07%], test : [loss = 2.291, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.98%], valid : [loss = 0.691, top1 = 76.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3504/15625) 003504-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.609, top1 = 87.40%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.406, top1 = 91.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.24 ms.
cifar100       train : [loss = 0.156, top1 = 96.73%], valid : [loss = 1.566, top1 = 65.38%], test : [loss = 1.552, top1 = 65.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.11%], valid : [loss = 2.510, top1 = 38.03%], test : [loss = 2.530, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 72.86%], valid : [loss = 0.811, top1 = 71.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3505/15625) 003505-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.519, top1 = 88.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.339, top1 = 91.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.341, top1 = 90.67%], valid : [loss = 1.272, top1 = 66.63%], test : [loss = 1.287, top1 = 67.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.61%], valid : [loss = 2.419, top1 = 38.89%], test : [loss = 2.416, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3506/15625) 003506-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.537, top1 = 89.22%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.97 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.345, top1 = 92.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.56 ms.
cifar100       train : [loss = 0.080, top1 = 98.55%], valid : [loss = 1.364, top1 = 70.18%], test : [loss = 1.391, top1 = 69.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 1.957, top1 = 48.43%], valid : [loss = 2.338, top1 = 39.73%], test : [loss = 2.332, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.28%], valid : [loss = 0.858, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3507/15625) 003507-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.520, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.324, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.276, top1 = 92.49%], valid : [loss = 1.276, top1 = 67.89%], test : [loss = 1.266, top1 = 67.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 1.992, top1 = 47.69%], valid : [loss = 2.301, top1 = 40.76%], test : [loss = 2.304, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.38%], valid : [loss = 0.807, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3508/15625) 003508-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.56%], valid : [loss = 0.843, top1 = 72.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10        train : [loss = 0.556, top1 = 80.66%], test  : [loss = 0.722, top1 = 75.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 1.763, top1 = 52.33%], valid : [loss = 2.048, top1 = 47.56%], test : [loss = 2.075, top1 = 47.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.77%], valid : [loss = 3.626, top1 = 16.20%], test : [loss = 3.669, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3509/15625) 003509-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.223, top1 = 92.39%], valid : [loss = 0.545, top1 = 83.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.24 ms.
cifar10        train : [loss = 0.204, top1 = 93.00%], test  : [loss = 0.383, top1 = 88.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.96 ms.
cifar100       train : [loss = 1.297, top1 = 63.22%], valid : [loss = 1.584, top1 = 57.34%], test : [loss = 1.598, top1 = 56.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.742, top1 = 31.81%], valid : [loss = 2.804, top1 = 30.90%], test : [loss = 2.809, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.38%], valid : [loss = 1.001, top1 = 64.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3510/15625) 003510-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.066, top1 = 97.91%], valid : [loss = 0.558, top1 = 85.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.42 ms.
cifar10        train : [loss = 0.096, top1 = 96.82%], test  : [loss = 0.394, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.08 ms.
cifar100       train : [loss = 0.742, top1 = 78.25%], valid : [loss = 1.374, top1 = 62.83%], test : [loss = 1.378, top1 = 63.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 37.75%], valid : [loss = 2.556, top1 = 35.29%], test : [loss = 2.583, top1 = 34.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.83%], valid : [loss = 0.929, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3511/15625) 003511-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.447, top1 = 89.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.95 ms.
cifar100       train : [loss = 0.327, top1 = 91.13%], valid : [loss = 1.314, top1 = 67.10%], test : [loss = 1.329, top1 = 67.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.89 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.19%], valid : [loss = 2.381, top1 = 40.08%], test : [loss = 2.403, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3512/15625) 003512-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.39%], valid : [loss = 0.553, top1 = 85.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.33 ms.
cifar10        train : [loss = 0.086, top1 = 97.29%], test  : [loss = 0.363, top1 = 89.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.08 ms.
cifar100       train : [loss = 0.775, top1 = 77.38%], valid : [loss = 1.391, top1 = 62.52%], test : [loss = 1.371, top1 = 63.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 37.49%], valid : [loss = 2.576, top1 = 35.04%], test : [loss = 2.607, top1 = 34.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.19%], valid : [loss = 0.894, top1 = 68.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3513/15625) 003513-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.26%], valid : [loss = 0.480, top1 = 84.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10        train : [loss = 0.254, top1 = 91.38%], test  : [loss = 0.417, top1 = 86.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.93 ms.
cifar100       train : [loss = 1.260, top1 = 64.65%], valid : [loss = 1.542, top1 = 57.43%], test : [loss = 1.540, top1 = 57.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.977, top1 = 26.79%], valid : [loss = 2.982, top1 = 26.94%], test : [loss = 3.016, top1 = 26.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3514/15625) 003514-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.70%], valid : [loss = 0.681, top1 = 83.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.13 ms.
cifar10        train : [loss = 0.076, top1 = 97.56%], test  : [loss = 0.414, top1 = 88.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.89 ms.
cifar100       train : [loss = 0.753, top1 = 77.92%], valid : [loss = 1.457, top1 = 61.54%], test : [loss = 1.450, top1 = 61.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 35.11%], valid : [loss = 2.718, top1 = 32.04%], test : [loss = 2.748, top1 = 32.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.83%], valid : [loss = 0.911, top1 = 67.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3515/15625) 003515-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.49%], valid : [loss = 0.873, top1 = 71.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.561, top1 = 80.37%], test  : [loss = 0.719, top1 = 75.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.60 ms.
cifar100       train : [loss = 1.776, top1 = 52.16%], valid : [loss = 2.062, top1 = 46.87%], test : [loss = 2.061, top1 = 46.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.90%], valid : [loss = 3.638, top1 = 16.51%], test : [loss = 3.671, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3516/15625) 003516-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.142, top1 = 95.46%], valid : [loss = 0.579, top1 = 83.91%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.155, top1 = 94.88%], test  : [loss = 0.398, top1 = 87.80%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 1.082, top1 = 68.85%], valid : [loss = 1.494, top1 = 59.51%], test : [loss = 1.499, top1 = 59.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.587, top1 = 34.81%], valid : [loss = 2.642, top1 = 33.77%], test : [loss = 2.672, top1 = 33.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.45%], valid : [loss = 0.914, top1 = 67.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3517/15625) 003517-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.83 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.571, top1 = 87.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.023, top1 = 99.43%], test  : [loss = 0.391, top1 = 90.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.455, top1 = 86.87%], valid : [loss = 1.395, top1 = 64.92%], test : [loss = 1.386, top1 = 65.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.18%], valid : [loss = 2.479, top1 = 37.66%], test : [loss = 2.510, top1 = 37.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.78%], valid : [loss = 0.808, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3518/15625) 003518-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.620, top1 = 86.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10        train : [loss = 0.023, top1 = 99.42%], test  : [loss = 0.433, top1 = 89.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.58 ms.
cifar100       train : [loss = 0.324, top1 = 91.62%], valid : [loss = 1.420, top1 = 65.41%], test : [loss = 1.401, top1 = 65.48%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.88%], valid : [loss = 2.509, top1 = 36.87%], test : [loss = 2.548, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.19%], valid : [loss = 0.777, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3519/15625) 003519-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.76%], valid : [loss = 0.737, top1 = 80.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 0.179, top1 = 93.79%], test  : [loss = 0.513, top1 = 84.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.96 ms.
cifar100       train : [loss = 0.892, top1 = 73.91%], valid : [loss = 1.627, top1 = 57.12%], test : [loss = 1.673, top1 = 57.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.467, top1 = 17.48%], valid : [loss = 3.467, top1 = 17.43%], test : [loss = 3.479, top1 = 17.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3520/15625) 003520-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.244, top1 = 91.66%], valid : [loss = 0.520, top1 = 83.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.03 ms.
cifar10        train : [loss = 0.247, top1 = 91.61%], test  : [loss = 0.388, top1 = 87.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 1.312, top1 = 62.84%], valid : [loss = 1.575, top1 = 57.43%], test : [loss = 1.560, top1 = 56.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.32 ms.
ImageNet16-120 train : [loss = 2.859, top1 = 29.53%], valid : [loss = 2.877, top1 = 30.02%], test : [loss = 2.935, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3521/15625) 003521-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.96%], valid : [loss = 0.470, top1 = 84.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10        train : [loss = 0.297, top1 = 90.11%], test  : [loss = 0.400, top1 = 86.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.324, top1 = 63.32%], valid : [loss = 1.529, top1 = 57.99%], test : [loss = 1.509, top1 = 58.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.80%], valid : [loss = 2.903, top1 = 29.38%], test : [loss = 2.947, top1 = 28.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3522/15625) 003522-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.570, top1 = 87.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.40 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.391, top1 = 91.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 0.393, top1 = 88.84%], valid : [loss = 1.391, top1 = 65.35%], test : [loss = 1.396, top1 = 65.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.88%], valid : [loss = 2.497, top1 = 37.19%], test : [loss = 2.547, top1 = 36.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3523/15625) 003523-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.292, top1 = 89.96%], valid : [loss = 0.568, top1 = 82.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.258, top1 = 91.13%], test  : [loss = 0.406, top1 = 86.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 1.367, top1 = 61.42%], valid : [loss = 1.635, top1 = 55.27%], test : [loss = 1.648, top1 = 54.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.847, top1 = 29.63%], valid : [loss = 2.858, top1 = 29.91%], test : [loss = 2.901, top1 = 28.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.08%], valid : [loss = 1.019, top1 = 63.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3524/15625) 003524-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.482, top1 = 88.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.312, top1 = 92.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.329, top1 = 91.16%], valid : [loss = 1.234, top1 = 67.88%], test : [loss = 1.239, top1 = 68.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.74%], valid : [loss = 2.296, top1 = 40.88%], test : [loss = 2.337, top1 = 40.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 81.92%], valid : [loss = 0.593, top1 = 79.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3525/15625) 003525-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.480, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.19 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.313, top1 = 92.23%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.72 ms.
cifar100       train : [loss = 0.321, top1 = 91.37%], valid : [loss = 1.250, top1 = 67.81%], test : [loss = 1.251, top1 = 67.85%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.86%], valid : [loss = 2.321, top1 = 40.41%], test : [loss = 2.336, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.35%], valid : [loss = 0.602, top1 = 79.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3526/15625) 003526-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.488, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.334, top1 = 91.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.30 ms.
cifar100       train : [loss = 0.281, top1 = 92.62%], valid : [loss = 1.216, top1 = 68.45%], test : [loss = 1.222, top1 = 68.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 48.91%], valid : [loss = 2.266, top1 = 42.02%], test : [loss = 2.274, top1 = 42.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.12%], valid : [loss = 0.626, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3527/15625) 003527-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.472, top1 = 89.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.300, top1 = 92.42%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.48 ms.
cifar100       train : [loss = 0.318, top1 = 91.49%], valid : [loss = 1.249, top1 = 67.67%], test : [loss = 1.256, top1 = 67.47%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.79 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.75%], valid : [loss = 2.311, top1 = 40.88%], test : [loss = 2.342, top1 = 40.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.78%], valid : [loss = 0.585, top1 = 80.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3528/15625) 003528-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.563, top1 = 87.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.034, top1 = 99.01%], test  : [loss = 0.354, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.12 ms.
cifar100       train : [loss = 0.540, top1 = 84.48%], valid : [loss = 1.346, top1 = 64.49%], test : [loss = 1.338, top1 = 64.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 35.61%], valid : [loss = 2.612, top1 = 33.70%], test : [loss = 2.633, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.12%], valid : [loss = 0.951, top1 = 65.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3529/15625) 003529-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.60%], valid : [loss = 0.555, top1 = 83.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.232, top1 = 92.07%], test  : [loss = 0.420, top1 = 86.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.02 ms.
cifar100       train : [loss = 1.239, top1 = 64.80%], valid : [loss = 1.579, top1 = 57.05%], test : [loss = 1.591, top1 = 57.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.976, top1 = 27.51%], valid : [loss = 2.990, top1 = 27.09%], test : [loss = 3.064, top1 = 26.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.27%], valid : [loss = 1.201, top1 = 56.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3530/15625) 003530-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.482, top1 = 89.51%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.89 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.307, top1 = 92.62%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.26 ms.
cifar100       train : [loss = 0.267, top1 = 92.96%], valid : [loss = 1.224, top1 = 68.87%], test : [loss = 1.222, top1 = 69.03%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.99%], valid : [loss = 2.222, top1 = 42.81%], test : [loss = 2.227, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.577, top1 = 79.84%], valid : [loss = 0.651, top1 = 77.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3531/15625) 003531-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.03%], valid : [loss = 0.694, top1 = 76.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.550, top1 = 80.90%], test  : [loss = 0.607, top1 = 79.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.17 ms.
cifar100       train : [loss = 1.777, top1 = 51.97%], valid : [loss = 1.927, top1 = 49.09%], test : [loss = 1.940, top1 = 48.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 3.402, top1 = 19.88%], valid : [loss = 3.372, top1 = 20.94%], test : [loss = 3.424, top1 = 18.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.377, top1 = 50.02%], valid : [loss = 1.389, top1 = 49.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3532/15625) 003532-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.37%], valid : [loss = 0.699, top1 = 83.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10        train : [loss = 0.094, top1 = 96.90%], test  : [loss = 0.460, top1 = 87.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.86 ms.
cifar100       train : [loss = 0.792, top1 = 76.90%], valid : [loss = 1.583, top1 = 59.15%], test : [loss = 1.569, top1 = 59.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.32 ms.
ImageNet16-120 train : [loss = 2.763, top1 = 31.50%], valid : [loss = 2.901, top1 = 29.03%], test : [loss = 2.957, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.87%], valid : [loss = 0.921, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3533/15625) 003533-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.93 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.539, top1 = 89.10%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.57 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.345, top1 = 92.39%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.86 ms.
cifar100       train : [loss = 0.114, top1 = 97.47%], valid : [loss = 1.388, top1 = 68.30%], test : [loss = 1.405, top1 = 68.33%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 2.421, top1 = 37.93%], valid : [loss = 2.614, top1 = 33.72%], test : [loss = 2.622, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.025, top1 = 63.06%], valid : [loss = 1.050, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3534/15625) 003534-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.57 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.38%], valid : [loss = 0.727, top1 = 82.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10        train : [loss = 0.111, top1 = 96.41%], test  : [loss = 0.461, top1 = 86.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.75 ms.
cifar100       train : [loss = 0.882, top1 = 74.46%], valid : [loss = 1.535, top1 = 59.62%], test : [loss = 1.500, top1 = 60.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.768, top1 = 31.38%], valid : [loss = 2.881, top1 = 29.51%], test : [loss = 2.932, top1 = 28.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.79%], valid : [loss = 0.960, top1 = 66.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3535/15625) 003535-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.19%], valid : [loss = 0.568, top1 = 86.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10        train : [loss = 0.056, top1 = 98.22%], test  : [loss = 0.375, top1 = 89.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 0.619, top1 = 81.85%], valid : [loss = 1.352, top1 = 63.95%], test : [loss = 1.360, top1 = 63.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.65%], valid : [loss = 2.461, top1 = 37.46%], test : [loss = 2.490, top1 = 37.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.36%], valid : [loss = 0.822, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3536/15625) 003536-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.692, top1 = 84.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.054, top1 = 98.38%], test  : [loss = 0.440, top1 = 88.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 0.634, top1 = 81.48%], valid : [loss = 1.518, top1 = 61.27%], test : [loss = 1.486, top1 = 62.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.25%], valid : [loss = 2.836, top1 = 29.67%], test : [loss = 2.882, top1 = 30.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3537/15625) 003537-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.614, top1 = 87.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.394, top1 = 91.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.27 ms.
cifar100       train : [loss = 0.201, top1 = 94.85%], valid : [loss = 1.452, top1 = 65.89%], test : [loss = 1.470, top1 = 66.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 41.82%], valid : [loss = 2.499, top1 = 36.41%], test : [loss = 2.522, top1 = 36.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.108, top1 = 59.42%], valid : [loss = 1.141, top1 = 59.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3538/15625) 003538-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 93.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.73 ms.
cifar100       train : [loss = 0.119, top1 = 97.69%], valid : [loss = 1.304, top1 = 69.18%], test : [loss = 1.294, top1 = 69.34%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.690, top1 = 54.72%], valid : [loss = 2.161, top1 = 44.49%], test : [loss = 2.169, top1 = 44.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.64%], valid : [loss = 0.611, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3539/15625) 003539-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.546, top1 = 88.37%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.355, top1 = 91.77%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.57 ms.
cifar100       train : [loss = 0.300, top1 = 91.65%], valid : [loss = 1.309, top1 = 67.19%], test : [loss = 1.345, top1 = 67.01%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.29%], valid : [loss = 2.431, top1 = 38.76%], test : [loss = 2.434, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 68.98%], valid : [loss = 0.892, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3540/15625) 003540-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 91.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.271, top1 = 93.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.66 ms.
cifar100       train : [loss = 0.058, top1 = 99.30%], valid : [loss = 1.288, top1 = 71.03%], test : [loss = 1.237, top1 = 71.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 1.472, top1 = 59.99%], valid : [loss = 2.187, top1 = 44.97%], test : [loss = 2.223, top1 = 45.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.32%], valid : [loss = 0.515, top1 = 82.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3541/15625) 003541-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.516, top1 = 88.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.027, top1 = 99.25%], test  : [loss = 0.351, top1 = 91.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 0.477, top1 = 86.07%], valid : [loss = 1.349, top1 = 65.56%], test : [loss = 1.342, top1 = 65.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.28%], valid : [loss = 2.515, top1 = 36.59%], test : [loss = 2.555, top1 = 36.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3542/15625) 003542-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.96 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3543/15625) 003543-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.589, top1 = 87.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.394, top1 = 91.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.97 ms.
cifar100       train : [loss = 0.201, top1 = 95.31%], valid : [loss = 1.456, top1 = 66.10%], test : [loss = 1.465, top1 = 66.57%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.81%], valid : [loss = 2.440, top1 = 39.16%], test : [loss = 2.468, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.66%], valid : [loss = 0.694, top1 = 75.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3544/15625) 003544-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.297, top1 = 89.74%], valid : [loss = 0.561, top1 = 82.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10        train : [loss = 0.270, top1 = 90.81%], test  : [loss = 0.424, top1 = 85.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 1.369, top1 = 61.40%], valid : [loss = 1.628, top1 = 56.07%], test : [loss = 1.616, top1 = 55.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.953, top1 = 27.79%], valid : [loss = 2.944, top1 = 28.68%], test : [loss = 2.998, top1 = 26.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.69%], valid : [loss = 1.040, top1 = 63.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3545/15625) 003545-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10-valid  train : [loss = 1.311, top1 = 52.76%], valid : [loss = 1.354, top1 = 51.46%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.37 ms.
cifar10        train : [loss = 1.249, top1 = 55.16%], test  : [loss = 1.258, top1 = 54.71%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.74 ms.
cifar100       train : [loss = 2.816, top1 = 29.89%], valid : [loss = 2.906, top1 = 28.29%], test : [loss = 2.901, top1 = 28.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.87 ms.
ImageNet16-120 train : [loss = 3.942, top1 = 11.32%], valid : [loss = 3.941, top1 = 12.03%], test : [loss = 3.957, top1 = 11.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.763, top1 = 33.43%], valid : [loss = 1.754, top1 = 33.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3546/15625) 003546-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.44%], valid : [loss = 0.693, top1 = 84.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.051, top1 = 98.48%], test  : [loss = 0.455, top1 = 88.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.644, top1 = 81.17%], valid : [loss = 1.516, top1 = 61.04%], test : [loss = 1.517, top1 = 61.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 33.27%], valid : [loss = 2.840, top1 = 30.36%], test : [loss = 2.881, top1 = 30.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.06%], valid : [loss = 0.864, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3547/15625) 003547-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.545, top1 = 88.54%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.98 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.343, top1 = 92.31%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.95 ms.
cifar100       train : [loss = 0.257, top1 = 93.07%], valid : [loss = 1.311, top1 = 67.91%], test : [loss = 1.313, top1 = 68.05%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.56 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.75%], valid : [loss = 2.435, top1 = 38.20%], test : [loss = 2.446, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 68.93%], valid : [loss = 0.894, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3548/15625) 003548-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.20%], valid : [loss = 0.559, top1 = 87.05%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.97 ms.
cifar10        train : [loss = 0.059, top1 = 98.08%], test  : [loss = 0.374, top1 = 90.04%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.27 ms.
cifar100       train : [loss = 0.573, top1 = 83.23%], valid : [loss = 1.318, top1 = 65.37%], test : [loss = 1.332, top1 = 65.25%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.08%], valid : [loss = 2.427, top1 = 38.18%], test : [loss = 2.442, top1 = 38.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 74.82%], valid : [loss = 0.753, top1 = 73.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3549/15625) 003549-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.584, top1 = 87.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.37 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.377, top1 = 91.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.03 ms.
cifar100       train : [loss = 0.397, top1 = 88.85%], valid : [loss = 1.418, top1 = 64.76%], test : [loss = 1.399, top1 = 64.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.83%], valid : [loss = 2.496, top1 = 37.41%], test : [loss = 2.541, top1 = 36.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3550/15625) 003550-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.629, top1 = 87.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.417, top1 = 91.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.71 ms.
cifar100       train : [loss = 0.202, top1 = 95.30%], valid : [loss = 1.490, top1 = 66.12%], test : [loss = 1.481, top1 = 65.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.31%], valid : [loss = 2.480, top1 = 37.50%], test : [loss = 2.502, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.25%], valid : [loss = 0.796, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3551/15625) 003551-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.553, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.364, top1 = 91.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.250, top1 = 93.47%], valid : [loss = 1.307, top1 = 67.53%], test : [loss = 1.308, top1 = 67.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.204, top1 = 42.79%], valid : [loss = 2.449, top1 = 37.38%], test : [loss = 2.468, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.30%], valid : [loss = 0.870, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3552/15625) 003552-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.600, top1 = 87.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.385, top1 = 91.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.88 ms.
cifar100       train : [loss = 0.153, top1 = 96.73%], valid : [loss = 1.480, top1 = 67.05%], test : [loss = 1.491, top1 = 66.49%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 47.32%], valid : [loss = 2.455, top1 = 38.58%], test : [loss = 2.484, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.40%], valid : [loss = 0.754, top1 = 73.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3553/15625) 003553-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.87 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.75 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3554/15625) 003554-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.36%], valid : [loss = 0.656, top1 = 83.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.070, top1 = 97.74%], test  : [loss = 0.406, top1 = 88.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.753, top1 = 77.91%], valid : [loss = 1.517, top1 = 60.43%], test : [loss = 1.501, top1 = 60.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 2.499, top1 = 36.69%], valid : [loss = 2.636, top1 = 34.20%], test : [loss = 2.679, top1 = 33.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.33%], valid : [loss = 0.914, top1 = 67.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3555/15625) 003555-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.473, top1 = 89.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.319, top1 = 92.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.75 ms.
cifar100       train : [loss = 0.258, top1 = 93.23%], valid : [loss = 1.347, top1 = 67.15%], test : [loss = 1.352, top1 = 67.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.62%], valid : [loss = 2.334, top1 = 41.14%], test : [loss = 2.356, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.56%], valid : [loss = 0.576, top1 = 80.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3556/15625) 003556-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.51%], valid : [loss = 0.885, top1 = 69.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.85 ms.
cifar10        train : [loss = 0.729, top1 = 74.40%], test  : [loss = 0.774, top1 = 73.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.14 ms.
cifar100       train : [loss = 2.276, top1 = 40.30%], valid : [loss = 2.386, top1 = 38.36%], test : [loss = 2.378, top1 = 38.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 3.531, top1 = 17.50%], valid : [loss = 3.518, top1 = 18.18%], test : [loss = 3.530, top1 = 17.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 46.90%], valid : [loss = 1.500, top1 = 45.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3557/15625) 003557-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.511, top1 = 88.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.362, top1 = 91.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.57 ms.
cifar100       train : [loss = 0.309, top1 = 91.36%], valid : [loss = 1.399, top1 = 65.91%], test : [loss = 1.398, top1 = 65.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.189, top1 = 43.41%], valid : [loss = 2.455, top1 = 38.01%], test : [loss = 2.510, top1 = 37.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 79.23%], valid : [loss = 0.692, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3558/15625) 003558-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.36 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.494, top1 = 90.09%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.22 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.298, top1 = 93.63%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.30 ms.
cifar100       train : [loss = 0.062, top1 = 99.20%], valid : [loss = 1.288, top1 = 70.54%], test : [loss = 1.281, top1 = 70.60%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 1.568, top1 = 57.66%], valid : [loss = 2.161, top1 = 44.83%], test : [loss = 2.153, top1 = 45.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.20%], valid : [loss = 0.590, top1 = 79.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3559/15625) 003559-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.467, top1 = 90.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.308, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.28 ms.
cifar100       train : [loss = 0.085, top1 = 98.54%], valid : [loss = 1.366, top1 = 69.95%], test : [loss = 1.347, top1 = 69.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.89%], valid : [loss = 2.253, top1 = 43.98%], test : [loss = 2.300, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.88%], valid : [loss = 0.514, top1 = 82.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3560/15625) 003560-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.567, top1 = 87.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.386, top1 = 91.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 0.393, top1 = 88.88%], valid : [loss = 1.408, top1 = 65.21%], test : [loss = 1.392, top1 = 65.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.84%], valid : [loss = 2.503, top1 = 36.27%], test : [loss = 2.544, top1 = 36.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3561/15625) 003561-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.606, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.405, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.95 ms.
cifar100       train : [loss = 0.210, top1 = 95.09%], valid : [loss = 1.436, top1 = 66.78%], test : [loss = 1.431, top1 = 66.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.74%], valid : [loss = 2.515, top1 = 37.67%], test : [loss = 2.532, top1 = 37.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3562/15625) 003562-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.463, top1 = 89.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.323, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.88 ms.
cifar100       train : [loss = 0.202, top1 = 95.09%], valid : [loss = 1.301, top1 = 69.11%], test : [loss = 1.303, top1 = 68.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.36%], valid : [loss = 2.254, top1 = 42.60%], test : [loss = 2.277, top1 = 43.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.454, top1 = 84.33%], valid : [loss = 0.561, top1 = 80.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3563/15625) 003563-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.87 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.96%], valid : [loss = 0.534, top1 = 86.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.076, top1 = 97.63%], test  : [loss = 0.369, top1 = 89.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.07 ms.
cifar100       train : [loss = 0.711, top1 = 79.03%], valid : [loss = 1.351, top1 = 64.27%], test : [loss = 1.341, top1 = 64.31%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.08%], valid : [loss = 2.633, top1 = 34.29%], test : [loss = 2.698, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3564/15625) 003564-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.24%], valid : [loss = 0.856, top1 = 71.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.82 ms.
cifar10        train : [loss = 0.558, top1 = 80.54%], test  : [loss = 0.714, top1 = 75.67%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.37 ms.
cifar100       train : [loss = 1.785, top1 = 51.85%], valid : [loss = 2.061, top1 = 46.70%], test : [loss = 2.061, top1 = 46.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.37 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.74%], valid : [loss = 3.646, top1 = 16.29%], test : [loss = 3.663, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3565/15625) 003565-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.589, top1 = 86.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.14 ms.
cifar10        train : [loss = 0.027, top1 = 99.24%], test  : [loss = 0.386, top1 = 90.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.52 ms.
cifar100       train : [loss = 0.501, top1 = 85.38%], valid : [loss = 1.415, top1 = 64.47%], test : [loss = 1.429, top1 = 63.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.17%], valid : [loss = 2.489, top1 = 37.01%], test : [loss = 2.526, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.32%], valid : [loss = 0.876, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3566/15625) 003566-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.520, top1 = 88.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.335, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.45 ms.
cifar100       train : [loss = 0.346, top1 = 90.59%], valid : [loss = 1.283, top1 = 67.07%], test : [loss = 1.292, top1 = 67.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.43%], valid : [loss = 2.402, top1 = 38.73%], test : [loss = 2.412, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3567/15625) 003567-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.39%], valid : [loss = 0.687, top1 = 84.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.446, top1 = 88.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 0.634, top1 = 81.54%], valid : [loss = 1.512, top1 = 61.70%], test : [loss = 1.483, top1 = 62.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.44%], valid : [loss = 2.808, top1 = 30.77%], test : [loss = 2.859, top1 = 30.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.06%], valid : [loss = 0.864, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3568/15625) 003568-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.617, top1 = 87.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.395, top1 = 91.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.209, top1 = 95.14%], valid : [loss = 1.426, top1 = 66.58%], test : [loss = 1.455, top1 = 66.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.83%], valid : [loss = 2.495, top1 = 37.74%], test : [loss = 2.521, top1 = 37.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.62%], valid : [loss = 0.751, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3569/15625) 003569-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.74 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.549, top1 = 88.03%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.25 ms.
cifar10        train : [loss = 0.018, top1 = 99.51%], test  : [loss = 0.352, top1 = 91.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.43 ms.
cifar100       train : [loss = 0.340, top1 = 90.60%], valid : [loss = 1.301, top1 = 67.24%], test : [loss = 1.305, top1 = 67.11%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.63 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.09%], valid : [loss = 2.314, top1 = 40.27%], test : [loss = 2.338, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.34%], valid : [loss = 0.844, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3570/15625) 003570-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.618, top1 = 86.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.408, top1 = 90.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.36 ms.
cifar100       train : [loss = 0.522, top1 = 84.85%], valid : [loss = 1.432, top1 = 63.46%], test : [loss = 1.433, top1 = 63.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.22%], valid : [loss = 2.550, top1 = 36.53%], test : [loss = 2.578, top1 = 35.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.03%], valid : [loss = 0.849, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3571/15625) 003571-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.590, top1 = 86.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.041, top1 = 98.76%], test  : [loss = 0.403, top1 = 89.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.08 ms.
cifar100       train : [loss = 0.555, top1 = 83.73%], valid : [loss = 1.414, top1 = 63.77%], test : [loss = 1.420, top1 = 63.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.85%], valid : [loss = 2.623, top1 = 33.48%], test : [loss = 2.666, top1 = 33.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.52%], valid : [loss = 0.627, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3572/15625) 003572-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.680, top1 = 84.80%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.65 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.415, top1 = 89.13%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.47 ms.
cifar100       train : [loss = 0.644, top1 = 81.22%], valid : [loss = 1.514, top1 = 61.52%], test : [loss = 1.494, top1 = 61.84%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.40%], valid : [loss = 2.812, top1 = 30.30%], test : [loss = 2.881, top1 = 29.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.89%], valid : [loss = 0.846, top1 = 70.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3573/15625) 003573-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.76%], valid : [loss = 0.635, top1 = 84.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10        train : [loss = 0.086, top1 = 97.24%], test  : [loss = 0.410, top1 = 88.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.50 ms.
cifar100       train : [loss = 0.772, top1 = 77.40%], valid : [loss = 1.405, top1 = 62.43%], test : [loss = 1.398, top1 = 62.63%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.24%], valid : [loss = 2.728, top1 = 31.99%], test : [loss = 2.750, top1 = 31.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.42%], valid : [loss = 0.844, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3574/15625) 003574-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.32%], valid : [loss = 0.453, top1 = 87.48%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.20 ms.
cifar10        train : [loss = 0.066, top1 = 98.27%], test  : [loss = 0.335, top1 = 90.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.56 ms.
cifar100       train : [loss = 0.595, top1 = 83.63%], valid : [loss = 1.236, top1 = 66.37%], test : [loss = 1.221, top1 = 66.53%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 41.04%], valid : [loss = 2.496, top1 = 37.34%], test : [loss = 2.497, top1 = 36.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.66%], valid : [loss = 0.642, top1 = 77.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3575/15625) 003575-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.513, top1 = 89.67%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.333, top1 = 93.15%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.16 ms.
cifar100       train : [loss = 0.054, top1 = 99.24%], valid : [loss = 1.392, top1 = 69.81%], test : [loss = 1.374, top1 = 69.99%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.60%], valid : [loss = 2.411, top1 = 38.71%], test : [loss = 2.427, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.34%], valid : [loss = 0.863, top1 = 68.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3576/15625) 003576-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.525, top1 = 88.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.019, top1 = 99.52%], test  : [loss = 0.361, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.386, top1 = 88.95%], valid : [loss = 1.328, top1 = 66.48%], test : [loss = 1.344, top1 = 66.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.88%], valid : [loss = 2.419, top1 = 38.54%], test : [loss = 2.472, top1 = 38.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.40%], valid : [loss = 0.609, top1 = 79.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3577/15625) 003577-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.459, top1 = 89.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.22 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.307, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.46 ms.
cifar100       train : [loss = 0.144, top1 = 96.92%], valid : [loss = 1.322, top1 = 69.10%], test : [loss = 1.346, top1 = 68.87%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.67 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.29%], valid : [loss = 2.223, top1 = 43.18%], test : [loss = 2.254, top1 = 43.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.425, top1 = 85.18%], valid : [loss = 0.536, top1 = 81.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3578/15625) 003578-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.495, top1 = 89.38%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.308, top1 = 92.84%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.43 ms.
cifar100       train : [loss = 0.145, top1 = 97.10%], valid : [loss = 1.243, top1 = 69.63%], test : [loss = 1.245, top1 = 69.97%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.55%], valid : [loss = 2.189, top1 = 43.64%], test : [loss = 2.209, top1 = 44.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.98%], valid : [loss = 0.606, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3579/15625) 003579-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.12%], valid : [loss = 0.658, top1 = 84.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10        train : [loss = 0.081, top1 = 97.44%], test  : [loss = 0.439, top1 = 88.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.31 ms.
cifar100       train : [loss = 0.751, top1 = 78.16%], valid : [loss = 1.459, top1 = 61.66%], test : [loss = 1.451, top1 = 61.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.698, top1 = 32.69%], valid : [loss = 2.813, top1 = 30.58%], test : [loss = 2.873, top1 = 30.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.32%], valid : [loss = 0.826, top1 = 71.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3580/15625) 003580-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.458, top1 = 90.04%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.42 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.303, top1 = 93.05%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.66 ms.
cifar100       train : [loss = 0.114, top1 = 97.97%], valid : [loss = 1.206, top1 = 70.88%], test : [loss = 1.229, top1 = 70.42%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.50 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.78%], valid : [loss = 2.114, top1 = 44.91%], test : [loss = 2.124, top1 = 45.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.28%], valid : [loss = 0.692, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3581/15625) 003581-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.561, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.336, top1 = 92.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.83 ms.
cifar100       train : [loss = 0.123, top1 = 97.25%], valid : [loss = 1.355, top1 = 69.19%], test : [loss = 1.348, top1 = 68.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 1.747, top1 = 53.38%], valid : [loss = 2.218, top1 = 43.63%], test : [loss = 2.207, top1 = 43.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.34%], valid : [loss = 0.786, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3582/15625) 003582-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.623, top1 = 87.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.441, top1 = 90.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.39 ms.
cifar100       train : [loss = 0.197, top1 = 95.22%], valid : [loss = 1.576, top1 = 64.64%], test : [loss = 1.590, top1 = 64.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.61%], valid : [loss = 2.537, top1 = 36.32%], test : [loss = 2.540, top1 = 36.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3583/15625) 003583-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.41%], valid : [loss = 0.486, top1 = 84.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10        train : [loss = 0.233, top1 = 92.10%], test  : [loss = 0.392, top1 = 87.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.19 ms.
cifar100       train : [loss = 1.269, top1 = 64.32%], valid : [loss = 1.555, top1 = 56.85%], test : [loss = 1.558, top1 = 56.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 3.689, top1 = 16.20%], valid : [loss = 3.683, top1 = 16.59%], test : [loss = 3.704, top1 = 16.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3584/15625) 003584-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.06%], valid : [loss = 0.868, top1 = 71.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.551, top1 = 80.68%], test  : [loss = 0.711, top1 = 75.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.98 ms.
cifar100       train : [loss = 1.769, top1 = 52.32%], valid : [loss = 2.046, top1 = 47.03%], test : [loss = 2.063, top1 = 46.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.79%], valid : [loss = 3.639, top1 = 16.44%], test : [loss = 3.666, top1 = 15.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3585/15625) 003585-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.11%], valid : [loss = 0.707, top1 = 76.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.420, top1 = 85.48%], test  : [loss = 0.554, top1 = 81.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.62 ms.
cifar100       train : [loss = 1.683, top1 = 53.88%], valid : [loss = 1.905, top1 = 49.71%], test : [loss = 1.911, top1 = 48.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 20.98%], valid : [loss = 3.330, top1 = 21.32%], test : [loss = 3.361, top1 = 20.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 57.19%], valid : [loss = 1.224, top1 = 56.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3586/15625) 003586-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.709, top1 = 85.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10        train : [loss = 0.017, top1 = 99.53%], test  : [loss = 0.451, top1 = 90.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.03 ms.
cifar100       train : [loss = 0.233, top1 = 94.06%], valid : [loss = 1.603, top1 = 63.21%], test : [loss = 1.614, top1 = 63.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.56%], valid : [loss = 2.528, top1 = 36.23%], test : [loss = 2.545, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.06%], valid : [loss = 0.839, top1 = 70.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3587/15625) 003587-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.538, top1 = 88.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.340, top1 = 92.47%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.65 ms.
cifar100       train : [loss = 0.161, top1 = 96.23%], valid : [loss = 1.278, top1 = 69.31%], test : [loss = 1.291, top1 = 69.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.31 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.57%], valid : [loss = 2.194, top1 = 43.33%], test : [loss = 2.193, top1 = 43.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.91%], valid : [loss = 0.738, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3588/15625) 003588-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.91%], valid : [loss = 0.555, top1 = 86.03%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.98 ms.
cifar10        train : [loss = 0.060, top1 = 98.30%], test  : [loss = 0.360, top1 = 90.12%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.42 ms.
cifar100       train : [loss = 0.596, top1 = 82.66%], valid : [loss = 1.347, top1 = 64.95%], test : [loss = 1.353, top1 = 64.19%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.57%], valid : [loss = 2.455, top1 = 37.84%], test : [loss = 2.478, top1 = 37.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.25%], valid : [loss = 0.852, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3589/15625) 003589-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.463, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.313, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.77 ms.
cifar100       train : [loss = 0.326, top1 = 91.24%], valid : [loss = 1.256, top1 = 67.55%], test : [loss = 1.250, top1 = 67.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.55%], valid : [loss = 2.315, top1 = 40.47%], test : [loss = 2.328, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.58%], valid : [loss = 0.576, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3590/15625) 003590-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.86%], valid : [loss = 0.636, top1 = 82.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10        train : [loss = 0.175, top1 = 94.11%], test  : [loss = 0.449, top1 = 86.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.02 ms.
cifar100       train : [loss = 0.882, top1 = 74.52%], valid : [loss = 1.539, top1 = 59.51%], test : [loss = 1.531, top1 = 59.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.902, top1 = 28.73%], valid : [loss = 2.960, top1 = 27.60%], test : [loss = 2.984, top1 = 27.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.951, top1 = 66.03%], valid : [loss = 1.000, top1 = 64.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3591/15625) 003591-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.452, top1 = 89.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.317, top1 = 91.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.33 ms.
cifar100       train : [loss = 0.324, top1 = 91.19%], valid : [loss = 1.315, top1 = 67.04%], test : [loss = 1.312, top1 = 66.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.34%], valid : [loss = 2.379, top1 = 39.66%], test : [loss = 2.420, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3592/15625) 003592-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.561, top1 = 88.39%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.86 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.361, top1 = 92.08%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.40 ms.
cifar100       train : [loss = 0.156, top1 = 96.22%], valid : [loss = 1.382, top1 = 67.79%], test : [loss = 1.368, top1 = 68.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.14%], valid : [loss = 2.406, top1 = 39.28%], test : [loss = 2.403, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.25%], valid : [loss = 0.908, top1 = 67.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3593/15625) 003593-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.08%], valid : [loss = 0.462, top1 = 85.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10        train : [loss = 0.160, top1 = 94.83%], test  : [loss = 0.346, top1 = 88.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 1.011, top1 = 71.13%], valid : [loss = 1.372, top1 = 61.87%], test : [loss = 1.368, top1 = 61.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.46%], valid : [loss = 2.690, top1 = 32.83%], test : [loss = 2.727, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3594/15625) 003594-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.209, top1 = 92.83%], valid : [loss = 0.725, top1 = 79.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.214, top1 = 92.57%], test  : [loss = 0.515, top1 = 84.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 0.928, top1 = 72.90%], valid : [loss = 1.657, top1 = 56.95%], test : [loss = 1.676, top1 = 56.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 3.447, top1 = 17.67%], valid : [loss = 3.455, top1 = 17.78%], test : [loss = 3.479, top1 = 17.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.256, top1 = 54.38%], valid : [loss = 1.296, top1 = 52.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3595/15625) 003595-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.574, top1 = 87.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10        train : [loss = 0.042, top1 = 98.79%], test  : [loss = 0.385, top1 = 90.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.59 ms.
cifar100       train : [loss = 0.556, top1 = 83.65%], valid : [loss = 1.393, top1 = 64.07%], test : [loss = 1.389, top1 = 64.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.98%], valid : [loss = 2.610, top1 = 34.03%], test : [loss = 2.666, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.87%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3596/15625) 003596-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.096, top1 = 97.19%], valid : [loss = 0.507, top1 = 85.82%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.80 ms.
cifar10        train : [loss = 0.164, top1 = 94.51%], test  : [loss = 0.376, top1 = 88.16%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.06 ms.
cifar100       train : [loss = 0.944, top1 = 72.83%], valid : [loss = 1.386, top1 = 62.09%], test : [loss = 1.373, top1 = 62.05%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.85 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.88%], valid : [loss = 2.703, top1 = 32.82%], test : [loss = 2.748, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.886, top1 = 68.22%], valid : [loss = 0.922, top1 = 67.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3597/15625) 003597-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.457, top1 = 89.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.86 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.317, top1 = 92.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.95 ms.
cifar100       train : [loss = 0.252, top1 = 93.49%], valid : [loss = 1.332, top1 = 67.61%], test : [loss = 1.328, top1 = 67.77%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 1.964, top1 = 48.38%], valid : [loss = 2.350, top1 = 40.81%], test : [loss = 2.359, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.73%], valid : [loss = 0.565, top1 = 80.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3598/15625) 003598-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.532, top1 = 89.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.332, top1 = 92.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.13 ms.
cifar100       train : [loss = 0.118, top1 = 97.60%], valid : [loss = 1.334, top1 = 69.27%], test : [loss = 1.315, top1 = 69.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 1.717, top1 = 54.17%], valid : [loss = 2.216, top1 = 43.57%], test : [loss = 2.202, top1 = 44.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.25%], valid : [loss = 0.591, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3599/15625) 003599-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.47%], valid : [loss = 0.561, top1 = 81.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.283, top1 = 90.29%], test  : [loss = 0.430, top1 = 85.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.18 ms.
cifar100       train : [loss = 1.465, top1 = 58.97%], valid : [loss = 1.695, top1 = 53.77%], test : [loss = 1.687, top1 = 53.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.946, top1 = 27.78%], valid : [loss = 2.968, top1 = 27.50%], test : [loss = 3.007, top1 = 26.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.66%], valid : [loss = 1.027, top1 = 63.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3600/15625) 003600-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.548, top1 = 88.56%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.359, top1 = 92.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.41 ms.
cifar100       train : [loss = 0.136, top1 = 97.29%], valid : [loss = 1.444, top1 = 67.11%], test : [loss = 1.458, top1 = 67.21%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 1.937, top1 = 49.02%], valid : [loss = 2.406, top1 = 39.77%], test : [loss = 2.416, top1 = 40.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.32%], valid : [loss = 0.719, top1 = 75.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3601/15625) 003601-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.66%], valid : [loss = 0.561, top1 = 82.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.300, top1 = 89.67%], test  : [loss = 0.427, top1 = 85.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.53 ms.
cifar100       train : [loss = 1.306, top1 = 63.27%], valid : [loss = 1.596, top1 = 56.69%], test : [loss = 1.586, top1 = 56.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.73 ms.
ImageNet16-120 train : [loss = 3.066, top1 = 25.79%], valid : [loss = 3.055, top1 = 25.82%], test : [loss = 3.140, top1 = 25.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.215, top1 = 56.12%], valid : [loss = 1.257, top1 = 54.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3602/15625) 003602-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.154, top1 = 94.88%], valid : [loss = 0.725, top1 = 80.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.172, top1 = 94.04%], test  : [loss = 0.510, top1 = 85.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 0.879, top1 = 74.31%], valid : [loss = 1.628, top1 = 57.60%], test : [loss = 1.659, top1 = 56.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.466, top1 = 17.43%], valid : [loss = 3.478, top1 = 17.70%], test : [loss = 3.486, top1 = 16.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3603/15625) 003603-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.465, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.316, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.89 ms.
cifar100       train : [loss = 0.324, top1 = 91.11%], valid : [loss = 1.323, top1 = 66.60%], test : [loss = 1.327, top1 = 66.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.45%], valid : [loss = 2.359, top1 = 39.82%], test : [loss = 2.407, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 84.91%], valid : [loss = 0.547, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3604/15625) 003604-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.569, top1 = 87.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.383, top1 = 91.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.52 ms.
cifar100       train : [loss = 0.400, top1 = 88.64%], valid : [loss = 1.397, top1 = 65.07%], test : [loss = 1.386, top1 = 65.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.93%], valid : [loss = 2.513, top1 = 36.58%], test : [loss = 2.521, top1 = 37.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3605/15625) 003605-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.593, top1 = 87.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.396, top1 = 91.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.153, top1 = 96.59%], valid : [loss = 1.518, top1 = 65.94%], test : [loss = 1.516, top1 = 66.57%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.007, top1 = 47.58%], valid : [loss = 2.477, top1 = 37.79%], test : [loss = 2.474, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.06%], valid : [loss = 0.709, top1 = 75.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3606/15625) 003606-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.46 ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.50%], valid : [loss = 0.736, top1 = 74.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.521, top1 = 82.08%], test  : [loss = 0.573, top1 = 80.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.74 ms.
cifar100       train : [loss = 2.014, top1 = 46.07%], valid : [loss = 2.112, top1 = 44.12%], test : [loss = 2.112, top1 = 44.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.182, top1 = 23.30%], valid : [loss = 3.142, top1 = 24.60%], test : [loss = 3.188, top1 = 23.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.142, top1 = 58.86%], valid : [loss = 1.188, top1 = 57.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3607/15625) 003607-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.498, top1 = 89.40%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.298, top1 = 93.07%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.22 ms.
cifar100       train : [loss = 0.148, top1 = 97.00%], valid : [loss = 1.261, top1 = 69.45%], test : [loss = 1.258, top1 = 69.47%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.08 ms.
ImageNet16-120 train : [loss = 1.753, top1 = 53.31%], valid : [loss = 2.179, top1 = 43.31%], test : [loss = 2.181, top1 = 44.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.45%], valid : [loss = 0.629, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3608/15625) 003608-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.63%], valid : [loss = 0.462, top1 = 86.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.153, top1 = 95.01%], test  : [loss = 0.341, top1 = 88.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 0.962, top1 = 72.71%], valid : [loss = 1.343, top1 = 62.77%], test : [loss = 1.340, top1 = 62.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.16%], valid : [loss = 2.681, top1 = 33.01%], test : [loss = 2.702, top1 = 32.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3609/15625) 003609-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.21%], valid : [loss = 0.554, top1 = 86.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.28 ms.
cifar10        train : [loss = 0.061, top1 = 98.06%], test  : [loss = 0.381, top1 = 89.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.09 ms.
cifar100       train : [loss = 0.659, top1 = 80.61%], valid : [loss = 1.314, top1 = 64.39%], test : [loss = 1.314, top1 = 64.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.35%], valid : [loss = 2.504, top1 = 36.66%], test : [loss = 2.535, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.05%], valid : [loss = 0.838, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3610/15625) 003610-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.10%], valid : [loss = 0.477, top1 = 84.20%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.50 ms.
cifar10        train : [loss = 0.298, top1 = 90.04%], test  : [loss = 0.403, top1 = 86.44%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.73 ms.
cifar100       train : [loss = 1.321, top1 = 63.36%], valid : [loss = 1.539, top1 = 57.76%], test : [loss = 1.506, top1 = 58.09%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.60%], valid : [loss = 2.894, top1 = 29.29%], test : [loss = 2.957, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.40%], valid : [loss = 0.766, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3611/15625) 003611-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.469, top1 = 88.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.326, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.367, top1 = 89.59%], valid : [loss = 1.322, top1 = 66.69%], test : [loss = 1.321, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.72%], valid : [loss = 2.374, top1 = 39.71%], test : [loss = 2.409, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.02%], valid : [loss = 0.665, top1 = 77.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3612/15625) 003612-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.527, top1 = 88.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.358, top1 = 91.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.13 ms.
cifar100       train : [loss = 0.423, top1 = 87.77%], valid : [loss = 1.261, top1 = 67.16%], test : [loss = 1.264, top1 = 67.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.57%], valid : [loss = 2.378, top1 = 38.81%], test : [loss = 2.369, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.72%], valid : [loss = 0.787, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3613/15625) 003613-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.58%], valid : [loss = 0.463, top1 = 86.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.55 ms.
cifar10        train : [loss = 0.153, top1 = 94.97%], test  : [loss = 0.342, top1 = 88.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.974, top1 = 72.13%], valid : [loss = 1.345, top1 = 62.18%], test : [loss = 1.332, top1 = 62.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.05%], valid : [loss = 2.690, top1 = 32.72%], test : [loss = 2.698, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3614/15625) 003614-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.22%], valid : [loss = 0.464, top1 = 86.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.107, top1 = 96.79%], test  : [loss = 0.327, top1 = 89.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.21 ms.
cifar100       train : [loss = 0.866, top1 = 75.33%], valid : [loss = 1.299, top1 = 64.10%], test : [loss = 1.278, top1 = 64.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.71%], valid : [loss = 2.627, top1 = 34.03%], test : [loss = 2.651, top1 = 33.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3615/15625) 003615-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.332, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.98 ms.
cifar100       train : [loss = 0.338, top1 = 90.78%], valid : [loss = 1.272, top1 = 66.91%], test : [loss = 1.270, top1 = 67.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.94%], valid : [loss = 2.404, top1 = 38.87%], test : [loss = 2.412, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3616/15625) 003616-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.40%], valid : [loss = 0.663, top1 = 77.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 0.515, top1 = 82.17%], test  : [loss = 0.595, top1 = 79.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.85 ms.
cifar100       train : [loss = 1.706, top1 = 53.70%], valid : [loss = 1.866, top1 = 50.33%], test : [loss = 1.879, top1 = 50.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.26%], valid : [loss = 3.319, top1 = 21.12%], test : [loss = 3.340, top1 = 21.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.58%], valid : [loss = 1.306, top1 = 53.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3617/15625) 003617-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.481, top1 = 89.15%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.14 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.310, top1 = 92.55%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.96 ms.
cifar100       train : [loss = 0.241, top1 = 93.95%], valid : [loss = 1.255, top1 = 68.64%], test : [loss = 1.256, top1 = 68.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.81%], valid : [loss = 2.245, top1 = 42.08%], test : [loss = 2.257, top1 = 42.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.87%], valid : [loss = 0.584, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3618/15625) 003618-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.531, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.335, top1 = 92.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.76 ms.
cifar100       train : [loss = 0.168, top1 = 96.14%], valid : [loss = 1.274, top1 = 69.20%], test : [loss = 1.288, top1 = 69.03%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.34%], valid : [loss = 2.253, top1 = 42.58%], test : [loss = 2.267, top1 = 42.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 73.99%], valid : [loss = 0.793, top1 = 72.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3619/15625) 003619-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.591, top1 = 88.21%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.41 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.391, top1 = 91.69%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.17 ms.
cifar100       train : [loss = 0.111, top1 = 97.90%], valid : [loss = 1.550, top1 = 66.45%], test : [loss = 1.549, top1 = 66.43%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.63%], valid : [loss = 2.468, top1 = 37.97%], test : [loss = 2.508, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.39%], valid : [loss = 0.782, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3620/15625) 003620-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.82%], valid : [loss = 0.708, top1 = 75.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.44 ms.
cifar10        train : [loss = 0.554, top1 = 80.86%], test  : [loss = 0.605, top1 = 79.11%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.13 ms.
cifar100       train : [loss = 1.940, top1 = 47.77%], valid : [loss = 2.079, top1 = 44.86%], test : [loss = 2.070, top1 = 44.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.98 ms.
ImageNet16-120 train : [loss = 3.219, top1 = 22.62%], valid : [loss = 3.212, top1 = 22.80%], test : [loss = 3.239, top1 = 22.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.49%], valid : [loss = 1.351, top1 = 51.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3621/15625) 003621-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=23.65 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.485, top1 = 90.46%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=21.85 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.297, top1 = 93.89%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=22.75 ms.
cifar100       train : [loss = 0.046, top1 = 99.43%], valid : [loss = 1.263, top1 = 71.45%], test : [loss = 1.263, top1 = 71.71%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=22.93 ms.
ImageNet16-120 train : [loss = 1.574, top1 = 57.52%], valid : [loss = 2.114, top1 = 45.53%], test : [loss = 2.110, top1 = 45.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.31%], valid : [loss = 0.672, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3622/15625) 003622-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.460, top1 = 89.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.311, top1 = 92.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.23 ms.
cifar100       train : [loss = 0.272, top1 = 92.85%], valid : [loss = 1.250, top1 = 68.79%], test : [loss = 1.254, top1 = 68.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.97 ms.
ImageNet16-120 train : [loss = 1.870, top1 = 50.39%], valid : [loss = 2.200, top1 = 43.09%], test : [loss = 2.226, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.47%], valid : [loss = 0.649, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3623/15625) 003623-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.21%], valid : [loss = 0.845, top1 = 72.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.72 ms.
cifar10        train : [loss = 0.563, top1 = 80.30%], test  : [loss = 0.721, top1 = 75.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 1.781, top1 = 52.10%], valid : [loss = 2.045, top1 = 47.35%], test : [loss = 2.065, top1 = 46.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.88%], valid : [loss = 3.635, top1 = 16.53%], test : [loss = 3.665, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3624/15625) 003624-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.14%], valid : [loss = 0.575, top1 = 86.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10        train : [loss = 0.063, top1 = 98.00%], test  : [loss = 0.391, top1 = 89.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.39 ms.
cifar100       train : [loss = 0.659, top1 = 80.51%], valid : [loss = 1.334, top1 = 64.37%], test : [loss = 1.328, top1 = 64.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.00%], valid : [loss = 2.480, top1 = 36.89%], test : [loss = 2.503, top1 = 37.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.58%], valid : [loss = 0.783, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3625/15625) 003625-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.421, top1 = 90.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.274, top1 = 93.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.72 ms.
cifar100       train : [loss = 0.171, top1 = 96.04%], valid : [loss = 1.264, top1 = 69.81%], test : [loss = 1.281, top1 = 69.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 1.791, top1 = 52.37%], valid : [loss = 2.222, top1 = 43.87%], test : [loss = 2.259, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.14%], valid : [loss = 0.520, top1 = 82.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3626/15625) 003626-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.608, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.400, top1 = 91.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.214, top1 = 94.75%], valid : [loss = 1.498, top1 = 65.70%], test : [loss = 1.490, top1 = 65.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 45.07%], valid : [loss = 2.525, top1 = 36.92%], test : [loss = 2.549, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.48%], valid : [loss = 0.756, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3627/15625) 003627-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.540, top1 = 88.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.339, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.74 ms.
cifar100       train : [loss = 0.230, top1 = 94.09%], valid : [loss = 1.292, top1 = 68.33%], test : [loss = 1.315, top1 = 68.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.075, top1 = 45.77%], valid : [loss = 2.381, top1 = 39.28%], test : [loss = 2.380, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 65.87%], valid : [loss = 0.972, top1 = 65.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3628/15625) 003628-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.553, top1 = 88.92%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.358, top1 = 92.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.62 ms.
cifar100       train : [loss = 0.184, top1 = 95.44%], valid : [loss = 1.384, top1 = 67.22%], test : [loss = 1.380, top1 = 67.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.196, top1 = 43.01%], valid : [loss = 2.484, top1 = 36.83%], test : [loss = 2.472, top1 = 37.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.43%], valid : [loss = 0.898, top1 = 67.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3629/15625) 003629-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.49%], valid : [loss = 0.851, top1 = 75.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.277, top1 = 90.39%], test  : [loss = 0.598, top1 = 81.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.72 ms.
cifar100       train : [loss = 1.305, top1 = 63.21%], valid : [loss = 1.889, top1 = 50.76%], test : [loss = 1.909, top1 = 51.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 3.459, top1 = 17.93%], valid : [loss = 3.493, top1 = 17.91%], test : [loss = 3.496, top1 = 17.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.176, top1 = 57.23%], valid : [loss = 1.220, top1 = 55.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3630/15625) 003630-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.229, top1 = 92.15%], valid : [loss = 0.528, top1 = 83.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10        train : [loss = 0.215, top1 = 92.65%], test  : [loss = 0.386, top1 = 87.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.21 ms.
cifar100       train : [loss = 1.318, top1 = 62.89%], valid : [loss = 1.602, top1 = 56.33%], test : [loss = 1.585, top1 = 56.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.783, top1 = 30.97%], valid : [loss = 2.826, top1 = 30.12%], test : [loss = 2.857, top1 = 29.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.53%], valid : [loss = 1.021, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3631/15625) 003631-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.503, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.336, top1 = 92.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.12 ms.
cifar100       train : [loss = 0.325, top1 = 91.20%], valid : [loss = 1.289, top1 = 67.23%], test : [loss = 1.289, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.18%], valid : [loss = 2.379, top1 = 39.89%], test : [loss = 2.406, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3632/15625) 003632-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.604, top1 = 87.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.413, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 0.234, top1 = 94.21%], valid : [loss = 1.473, top1 = 65.65%], test : [loss = 1.464, top1 = 65.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.64%], valid : [loss = 2.526, top1 = 37.49%], test : [loss = 2.540, top1 = 37.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.10%], valid : [loss = 0.751, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3633/15625) 003633-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.16 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3634/15625) 003634-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.303, top1 = 89.50%], valid : [loss = 0.581, top1 = 81.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.266, top1 = 90.88%], test  : [loss = 0.422, top1 = 86.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.80 ms.
cifar100       train : [loss = 1.467, top1 = 58.88%], valid : [loss = 1.699, top1 = 54.33%], test : [loss = 1.702, top1 = 53.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.932, top1 = 27.85%], valid : [loss = 2.945, top1 = 28.13%], test : [loss = 3.010, top1 = 26.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3635/15625) 003635-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.519, top1 = 88.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.020, top1 = 99.48%], test  : [loss = 0.350, top1 = 91.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 0.380, top1 = 89.12%], valid : [loss = 1.351, top1 = 66.20%], test : [loss = 1.361, top1 = 66.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.32%], valid : [loss = 2.399, top1 = 39.09%], test : [loss = 2.414, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.65%], valid : [loss = 0.606, top1 = 79.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3636/15625) 003636-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.65 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.633, top1 = 86.31%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.00 ms.
cifar10        train : [loss = 0.021, top1 = 99.50%], test  : [loss = 0.423, top1 = 90.07%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.11 ms.
cifar100       train : [loss = 0.278, top1 = 92.98%], valid : [loss = 1.476, top1 = 64.82%], test : [loss = 1.454, top1 = 65.14%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=21.22 ms.
ImageNet16-120 train : [loss = 2.220, top1 = 42.63%], valid : [loss = 2.578, top1 = 35.84%], test : [loss = 2.601, top1 = 36.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.84%], valid : [loss = 0.782, top1 = 73.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3637/15625) 003637-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.529, top1 = 88.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.55 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.344, top1 = 91.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.71 ms.
cifar100       train : [loss = 0.325, top1 = 91.02%], valid : [loss = 1.292, top1 = 66.94%], test : [loss = 1.293, top1 = 67.47%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.59%], valid : [loss = 2.427, top1 = 38.32%], test : [loss = 2.432, top1 = 38.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.24%], valid : [loss = 0.863, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3638/15625) 003638-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.348, top1 = 92.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.12 ms.
cifar100       train : [loss = 0.102, top1 = 98.24%], valid : [loss = 1.433, top1 = 68.13%], test : [loss = 1.418, top1 = 68.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.35%], valid : [loss = 2.391, top1 = 40.23%], test : [loss = 2.393, top1 = 41.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.71%], valid : [loss = 0.708, top1 = 75.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3639/15625) 003639-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.54%], valid : [loss = 0.687, top1 = 77.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10        train : [loss = 0.365, top1 = 87.34%], test  : [loss = 0.494, top1 = 83.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.75 ms.
cifar100       train : [loss = 1.690, top1 = 53.54%], valid : [loss = 1.899, top1 = 49.39%], test : [loss = 1.918, top1 = 49.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 3.233, top1 = 22.58%], valid : [loss = 3.248, top1 = 22.54%], test : [loss = 3.300, top1 = 21.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.222, top1 = 56.01%], valid : [loss = 1.254, top1 = 54.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3640/15625) 003640-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.325, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.02 ms.
cifar100       train : [loss = 0.150, top1 = 96.81%], valid : [loss = 1.283, top1 = 69.31%], test : [loss = 1.286, top1 = 69.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.13%], valid : [loss = 2.302, top1 = 41.67%], test : [loss = 2.300, top1 = 41.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3641/15625) 003641-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.91%], valid : [loss = 0.881, top1 = 77.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.227, top1 = 92.19%], test  : [loss = 0.588, top1 = 82.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 1.185, top1 = 66.38%], valid : [loss = 1.825, top1 = 52.86%], test : [loss = 1.817, top1 = 53.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.82%], valid : [loss = 3.327, top1 = 21.31%], test : [loss = 3.355, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3642/15625) 003642-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.474, top1 = 89.47%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.293, top1 = 92.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.281, top1 = 92.50%], valid : [loss = 1.237, top1 = 68.09%], test : [loss = 1.238, top1 = 68.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.14%], valid : [loss = 2.205, top1 = 43.08%], test : [loss = 2.224, top1 = 43.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3643/15625) 003643-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.55%], valid : [loss = 0.637, top1 = 85.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.044, top1 = 98.69%], test  : [loss = 0.407, top1 = 89.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.05 ms.
cifar100       train : [loss = 0.556, top1 = 83.67%], valid : [loss = 1.419, top1 = 63.73%], test : [loss = 1.418, top1 = 63.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.39%], valid : [loss = 2.597, top1 = 34.91%], test : [loss = 2.654, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.85%], valid : [loss = 0.930, top1 = 67.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3644/15625) 003644-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.37%], valid : [loss = 0.455, top1 = 86.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.39 ms.
cifar10        train : [loss = 0.151, top1 = 95.08%], test  : [loss = 0.346, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.47 ms.
cifar100       train : [loss = 0.992, top1 = 71.75%], valid : [loss = 1.352, top1 = 61.95%], test : [loss = 1.358, top1 = 61.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.01%], valid : [loss = 2.678, top1 = 32.97%], test : [loss = 2.698, top1 = 33.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3645/15625) 003645-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.503, top1 = 88.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.324, top1 = 92.15%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.53 ms.
cifar100       train : [loss = 0.331, top1 = 91.04%], valid : [loss = 1.287, top1 = 67.13%], test : [loss = 1.280, top1 = 67.31%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.21%], valid : [loss = 2.392, top1 = 38.82%], test : [loss = 2.404, top1 = 38.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.82%], valid : [loss = 0.622, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3646/15625) 003646-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.497, top1 = 89.74%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.313, top1 = 93.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.72 ms.
cifar100       train : [loss = 0.130, top1 = 97.39%], valid : [loss = 1.287, top1 = 69.08%], test : [loss = 1.311, top1 = 68.93%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.15%], valid : [loss = 2.289, top1 = 42.27%], test : [loss = 2.270, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.99%], valid : [loss = 0.682, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3647/15625) 003647-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.550, top1 = 88.63%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.72 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.359, top1 = 92.04%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.32 ms.
cifar100       train : [loss = 0.066, top1 = 99.29%], valid : [loss = 1.433, top1 = 68.51%], test : [loss = 1.405, top1 = 68.77%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.09 ms.
ImageNet16-120 train : [loss = 1.721, top1 = 54.22%], valid : [loss = 2.435, top1 = 39.74%], test : [loss = 2.450, top1 = 40.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.31%], valid : [loss = 0.716, top1 = 75.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3648/15625) 003648-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.520, top1 = 88.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.019, top1 = 99.55%], test  : [loss = 0.362, top1 = 91.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.385, top1 = 89.01%], valid : [loss = 1.347, top1 = 65.99%], test : [loss = 1.351, top1 = 66.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 43.15%], valid : [loss = 2.405, top1 = 38.91%], test : [loss = 2.453, top1 = 37.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.15%], valid : [loss = 0.627, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3649/15625) 003649-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.12%], valid : [loss = 0.885, top1 = 71.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.27 ms.
cifar10        train : [loss = 0.546, top1 = 80.81%], test  : [loss = 0.714, top1 = 75.80%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.89 ms.
cifar100       train : [loss = 1.763, top1 = 52.49%], valid : [loss = 2.047, top1 = 46.87%], test : [loss = 2.068, top1 = 46.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.93%], valid : [loss = 3.634, top1 = 16.81%], test : [loss = 3.660, top1 = 16.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3650/15625) 003650-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.472, top1 = 89.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.284, top1 = 92.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.38 ms.
cifar100       train : [loss = 0.285, top1 = 92.30%], valid : [loss = 1.243, top1 = 68.45%], test : [loss = 1.244, top1 = 68.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.26%], valid : [loss = 2.206, top1 = 42.70%], test : [loss = 2.219, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3651/15625) 003651-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.534, top1 = 88.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.332, top1 = 92.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.87 ms.
cifar100       train : [loss = 0.289, top1 = 92.25%], valid : [loss = 1.304, top1 = 67.67%], test : [loss = 1.303, top1 = 67.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.91 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.06%], valid : [loss = 2.423, top1 = 39.10%], test : [loss = 2.412, top1 = 39.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.74%], valid : [loss = 0.862, top1 = 69.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3652/15625) 003652-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.32%], valid : [loss = 0.624, top1 = 86.83%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.37 ms.
cifar10        train : [loss = 0.049, top1 = 98.47%], test  : [loss = 0.400, top1 = 89.93%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.47 ms.
cifar100       train : [loss = 0.477, top1 = 86.16%], valid : [loss = 1.369, top1 = 65.10%], test : [loss = 1.373, top1 = 64.89%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 2.232, top1 = 42.25%], valid : [loss = 2.414, top1 = 38.68%], test : [loss = 2.435, top1 = 38.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 69.07%], valid : [loss = 0.911, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3653/15625) 003653-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.68%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.38 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.332, top1 = 93.10%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.82 ms.
cifar100       train : [loss = 0.070, top1 = 98.93%], valid : [loss = 1.349, top1 = 69.76%], test : [loss = 1.386, top1 = 69.36%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.78 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.54%], valid : [loss = 2.394, top1 = 39.32%], test : [loss = 2.400, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.92%], valid : [loss = 0.777, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3654/15625) 003654-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.549, top1 = 88.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.28 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.348, top1 = 92.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.248, top1 = 93.30%], valid : [loss = 1.295, top1 = 68.21%], test : [loss = 1.342, top1 = 67.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.09%], valid : [loss = 2.409, top1 = 39.47%], test : [loss = 2.396, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3655/15625) 003655-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.455, top1 = 89.90%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.79 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.320, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.90 ms.
cifar100       train : [loss = 0.115, top1 = 97.87%], valid : [loss = 1.277, top1 = 69.54%], test : [loss = 1.294, top1 = 69.92%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.48%], valid : [loss = 2.231, top1 = 43.93%], test : [loss = 2.269, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 84.15%], valid : [loss = 0.575, top1 = 80.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3656/15625) 003656-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.34%], valid : [loss = 0.541, top1 = 84.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.179, top1 = 93.99%], test  : [loss = 0.386, top1 = 88.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.16 ms.
cifar100       train : [loss = 1.201, top1 = 65.89%], valid : [loss = 1.518, top1 = 58.53%], test : [loss = 1.501, top1 = 58.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.64%], valid : [loss = 2.656, top1 = 33.27%], test : [loss = 2.692, top1 = 32.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.61%], valid : [loss = 0.938, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3657/15625) 003657-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.25%], valid : [loss = 0.538, top1 = 84.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10        train : [loss = 0.187, top1 = 93.66%], test  : [loss = 0.388, top1 = 88.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 1.191, top1 = 66.08%], valid : [loss = 1.525, top1 = 58.08%], test : [loss = 1.483, top1 = 59.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.87 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.76%], valid : [loss = 2.699, top1 = 33.05%], test : [loss = 2.754, top1 = 32.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3658/15625) 003658-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.539, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.025, top1 = 99.34%], test  : [loss = 0.356, top1 = 91.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.83 ms.
cifar100       train : [loss = 0.413, top1 = 88.03%], valid : [loss = 1.257, top1 = 67.00%], test : [loss = 1.247, top1 = 67.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.54%], valid : [loss = 2.356, top1 = 40.97%], test : [loss = 2.399, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.80%], valid : [loss = 0.715, top1 = 75.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3659/15625) 003659-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.339, top1 = 88.26%], valid : [loss = 0.570, top1 = 81.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.49 ms.
cifar10        train : [loss = 0.278, top1 = 90.49%], test  : [loss = 0.429, top1 = 86.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 1.558, top1 = 56.73%], valid : [loss = 1.792, top1 = 51.30%], test : [loss = 1.800, top1 = 51.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.66 ms.
ImageNet16-120 train : [loss = 2.992, top1 = 26.79%], valid : [loss = 3.024, top1 = 27.50%], test : [loss = 3.061, top1 = 25.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.48%], valid : [loss = 1.021, top1 = 63.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3660/15625) 003660-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.587, top1 = 87.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.391, top1 = 91.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.63 ms.
cifar100       train : [loss = 0.179, top1 = 95.85%], valid : [loss = 1.542, top1 = 65.40%], test : [loss = 1.543, top1 = 65.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.48%], valid : [loss = 2.423, top1 = 39.00%], test : [loss = 2.461, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.83%], valid : [loss = 0.814, top1 = 71.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3661/15625) 003661-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.43%], valid : [loss = 0.870, top1 = 71.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10        train : [loss = 0.572, top1 = 80.20%], test  : [loss = 0.724, top1 = 75.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.97 ms.
cifar100       train : [loss = 1.814, top1 = 50.97%], valid : [loss = 2.062, top1 = 47.20%], test : [loss = 2.083, top1 = 46.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 3.597, top1 = 16.62%], valid : [loss = 3.639, top1 = 16.20%], test : [loss = 3.663, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.196, top1 = 57.09%], valid : [loss = 1.262, top1 = 54.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3662/15625) 003662-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.63%], valid : [loss = 0.608, top1 = 79.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.350, top1 = 88.17%], test  : [loss = 0.482, top1 = 84.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 1.609, top1 = 55.36%], valid : [loss = 1.844, top1 = 49.86%], test : [loss = 1.832, top1 = 50.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 3.033, top1 = 25.93%], valid : [loss = 3.032, top1 = 26.30%], test : [loss = 3.101, top1 = 24.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.40%], valid : [loss = 1.032, top1 = 63.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3663/15625) 003663-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.431, top1 = 89.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.58 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.299, top1 = 92.55%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.90 ms.
cifar100       train : [loss = 0.200, top1 = 95.31%], valid : [loss = 1.286, top1 = 68.79%], test : [loss = 1.268, top1 = 69.19%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.16%], valid : [loss = 2.256, top1 = 42.42%], test : [loss = 2.283, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.423, top1 = 85.52%], valid : [loss = 0.532, top1 = 82.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3664/15625) 003664-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=23.11 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.533, top1 = 89.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.329, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.23 ms.
cifar100       train : [loss = 0.100, top1 = 98.12%], valid : [loss = 1.335, top1 = 69.54%], test : [loss = 1.349, top1 = 69.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.78 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.36%], valid : [loss = 2.268, top1 = 42.37%], test : [loss = 2.269, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 74.94%], valid : [loss = 0.772, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3665/15625) 003665-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.12%], valid : [loss = 0.483, top1 = 84.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10        train : [loss = 0.304, top1 = 89.76%], test  : [loss = 0.406, top1 = 86.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.67 ms.
cifar100       train : [loss = 1.326, top1 = 63.27%], valid : [loss = 1.530, top1 = 58.08%], test : [loss = 1.523, top1 = 58.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.71%], valid : [loss = 2.890, top1 = 29.53%], test : [loss = 2.955, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3666/15625) 003666-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.326, top1 = 88.90%], valid : [loss = 0.566, top1 = 81.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.56 ms.
cifar10        train : [loss = 0.278, top1 = 90.50%], test  : [loss = 0.438, top1 = 85.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.31 ms.
cifar100       train : [loss = 1.449, top1 = 59.51%], valid : [loss = 1.688, top1 = 53.88%], test : [loss = 1.687, top1 = 53.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.933, top1 = 27.83%], valid : [loss = 2.934, top1 = 28.07%], test : [loss = 2.982, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.003, top1 = 63.87%], valid : [loss = 1.061, top1 = 62.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3667/15625) 003667-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.628, top1 = 87.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.371, top1 = 92.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.63 ms.
cifar100       train : [loss = 0.102, top1 = 98.15%], valid : [loss = 1.493, top1 = 67.06%], test : [loss = 1.502, top1 = 67.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 1.936, top1 = 49.11%], valid : [loss = 2.440, top1 = 39.20%], test : [loss = 2.457, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.10%], valid : [loss = 0.725, top1 = 74.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3668/15625) 003668-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.591, top1 = 87.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.83 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.406, top1 = 90.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.11 ms.
cifar100       train : [loss = 0.208, top1 = 95.16%], valid : [loss = 1.405, top1 = 66.72%], test : [loss = 1.426, top1 = 67.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.23%], valid : [loss = 2.478, top1 = 38.40%], test : [loss = 2.494, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.94%], valid : [loss = 0.736, top1 = 74.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3669/15625) 003669-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.535, top1 = 88.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.74 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.352, top1 = 91.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.93 ms.
cifar100       train : [loss = 0.205, top1 = 94.77%], valid : [loss = 1.329, top1 = 67.66%], test : [loss = 1.356, top1 = 66.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.008, top1 = 47.45%], valid : [loss = 2.366, top1 = 39.57%], test : [loss = 2.353, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.16%], valid : [loss = 0.765, top1 = 73.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3670/15625) 003670-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.516, top1 = 88.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.324, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.92 ms.
cifar100       train : [loss = 0.330, top1 = 91.19%], valid : [loss = 1.297, top1 = 67.28%], test : [loss = 1.254, top1 = 67.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.00%], valid : [loss = 2.405, top1 = 39.33%], test : [loss = 2.408, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3671/15625) 003671-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.148, top1 = 95.12%], valid : [loss = 0.740, top1 = 80.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.189, top1 = 93.42%], test  : [loss = 0.513, top1 = 84.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 0.912, top1 = 73.41%], valid : [loss = 1.671, top1 = 56.82%], test : [loss = 1.694, top1 = 56.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 3.530, top1 = 16.29%], valid : [loss = 3.521, top1 = 16.47%], test : [loss = 3.530, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.346, top1 = 50.66%], valid : [loss = 1.367, top1 = 49.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3672/15625) 003672-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.539, top1 = 88.35%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.351, top1 = 91.72%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.26 ms.
cifar100       train : [loss = 0.288, top1 = 92.35%], valid : [loss = 1.279, top1 = 67.44%], test : [loss = 1.324, top1 = 67.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.37%], valid : [loss = 2.406, top1 = 38.87%], test : [loss = 2.389, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.02%], valid : [loss = 0.861, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3673/15625) 003673-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.504, top1 = 88.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.332, top1 = 91.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.85 ms.
cifar100       train : [loss = 0.346, top1 = 90.56%], valid : [loss = 1.299, top1 = 66.50%], test : [loss = 1.296, top1 = 67.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.44%], valid : [loss = 2.436, top1 = 39.03%], test : [loss = 2.399, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3674/15625) 003674-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.555, top1 = 87.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.381, top1 = 91.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 0.399, top1 = 88.63%], valid : [loss = 1.381, top1 = 65.89%], test : [loss = 1.401, top1 = 65.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.92%], valid : [loss = 2.468, top1 = 37.59%], test : [loss = 2.495, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.66%], valid : [loss = 0.778, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3675/15625) 003675-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.13 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.465, top1 = 89.31%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.80 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.287, top1 = 92.63%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.61 ms.
cifar100       train : [loss = 0.202, top1 = 95.41%], valid : [loss = 1.228, top1 = 69.58%], test : [loss = 1.199, top1 = 69.56%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.92%], valid : [loss = 2.200, top1 = 42.37%], test : [loss = 2.259, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.85%], valid : [loss = 0.648, top1 = 77.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3676/15625) 003676-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.259, top1 = 91.01%], valid : [loss = 0.524, top1 = 83.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.259, top1 = 90.96%], test  : [loss = 0.404, top1 = 86.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 1.400, top1 = 60.62%], valid : [loss = 1.675, top1 = 55.28%], test : [loss = 1.663, top1 = 55.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.853, top1 = 29.68%], valid : [loss = 2.890, top1 = 29.63%], test : [loss = 2.899, top1 = 29.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.14%], valid : [loss = 1.027, top1 = 63.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3677/15625) 003677-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.545, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.32 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.366, top1 = 91.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.94 ms.
cifar100       train : [loss = 0.138, top1 = 97.33%], valid : [loss = 1.420, top1 = 67.20%], test : [loss = 1.421, top1 = 67.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.27%], valid : [loss = 2.389, top1 = 40.00%], test : [loss = 2.414, top1 = 41.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.10%], valid : [loss = 0.664, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3678/15625) 003678-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.450, top1 = 90.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.316, top1 = 93.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.79 ms.
cifar100       train : [loss = 0.075, top1 = 98.83%], valid : [loss = 1.360, top1 = 69.60%], test : [loss = 1.341, top1 = 70.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 1.577, top1 = 57.42%], valid : [loss = 2.277, top1 = 43.97%], test : [loss = 2.253, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.52%], valid : [loss = 0.494, top1 = 83.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3679/15625) 003679-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.00 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.84%], valid : [loss = 0.480, top1 = 84.30%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10        train : [loss = 0.300, top1 = 89.98%], test  : [loss = 0.399, top1 = 86.55%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 1.344, top1 = 62.91%], valid : [loss = 1.531, top1 = 58.12%], test : [loss = 1.535, top1 = 57.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.01 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.52%], valid : [loss = 2.906, top1 = 29.70%], test : [loss = 2.969, top1 = 27.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3680/15625) 003680-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.30%], valid : [loss = 0.581, top1 = 85.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.05 ms.
cifar10        train : [loss = 0.105, top1 = 96.55%], test  : [loss = 0.382, top1 = 88.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 0.822, top1 = 75.70%], valid : [loss = 1.433, top1 = 61.90%], test : [loss = 1.405, top1 = 62.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 32.98%], valid : [loss = 2.772, top1 = 31.77%], test : [loss = 2.827, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3681/15625) 003681-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=11.47 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.12%], valid : [loss = 0.448, top1 = 87.17%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=12.56 ms.
cifar10        train : [loss = 0.116, top1 = 96.38%], test  : [loss = 0.325, top1 = 89.67%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=10.70 ms.
cifar100       train : [loss = 0.869, top1 = 75.17%], valid : [loss = 1.300, top1 = 63.89%], test : [loss = 1.286, top1 = 63.99%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.75%], valid : [loss = 2.614, top1 = 33.86%], test : [loss = 2.666, top1 = 33.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3682/15625) 003682-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.556, top1 = 88.88%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.17 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.348, top1 = 92.43%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.33 ms.
cifar100       train : [loss = 0.106, top1 = 97.67%], valid : [loss = 1.456, top1 = 68.20%], test : [loss = 1.474, top1 = 68.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.44%], valid : [loss = 2.720, top1 = 32.47%], test : [loss = 2.740, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.067, top1 = 61.29%], valid : [loss = 1.080, top1 = 61.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3683/15625) 003683-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.608, top1 = 86.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.65 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.413, top1 = 89.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.87 ms.
cifar100       train : [loss = 0.353, top1 = 90.59%], valid : [loss = 1.404, top1 = 64.96%], test : [loss = 1.379, top1 = 66.28%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.57 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.65%], valid : [loss = 2.539, top1 = 36.17%], test : [loss = 2.553, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.28%], valid : [loss = 0.767, top1 = 73.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3684/15625) 003684-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.46 ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.30%], valid : [loss = 0.646, top1 = 78.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10        train : [loss = 0.523, top1 = 81.82%], test  : [loss = 0.598, top1 = 79.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.51 ms.
cifar100       train : [loss = 1.707, top1 = 53.78%], valid : [loss = 1.868, top1 = 50.36%], test : [loss = 1.875, top1 = 50.59%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.21 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 21.36%], valid : [loss = 3.312, top1 = 21.53%], test : [loss = 3.345, top1 = 21.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3685/15625) 003685-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.64%], valid : [loss = 0.976, top1 = 72.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 0.291, top1 = 89.84%], test  : [loss = 0.630, top1 = 80.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 1.341, top1 = 62.06%], valid : [loss = 1.974, top1 = 49.94%], test : [loss = 1.981, top1 = 49.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 3.342, top1 = 20.68%], valid : [loss = 3.468, top1 = 18.27%], test : [loss = 3.484, top1 = 18.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.146, top1 = 58.84%], valid : [loss = 1.206, top1 = 57.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3686/15625) 003686-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.80%], valid : [loss = 0.478, top1 = 84.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10        train : [loss = 0.305, top1 = 89.84%], test  : [loss = 0.402, top1 = 86.29%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 1.316, top1 = 63.68%], valid : [loss = 1.494, top1 = 58.68%], test : [loss = 1.498, top1 = 58.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.76%], valid : [loss = 2.896, top1 = 29.10%], test : [loss = 2.942, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3687/15625) 003687-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.27%], valid : [loss = 0.449, top1 = 87.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.110, top1 = 96.59%], test  : [loss = 0.326, top1 = 89.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.28 ms.
cifar100       train : [loss = 0.868, top1 = 75.11%], valid : [loss = 1.283, top1 = 64.04%], test : [loss = 1.265, top1 = 64.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.562, top1 = 35.50%], valid : [loss = 2.623, top1 = 35.47%], test : [loss = 2.644, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3688/15625) 003688-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.522, top1 = 88.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.339, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.47 ms.
cifar100       train : [loss = 0.332, top1 = 90.95%], valid : [loss = 1.295, top1 = 65.94%], test : [loss = 1.311, top1 = 66.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.80%], valid : [loss = 2.405, top1 = 39.27%], test : [loss = 2.432, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.85%], valid : [loss = 0.723, top1 = 74.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3689/15625) 003689-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.64%], valid : [loss = 0.469, top1 = 86.34%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.55 ms.
cifar10        train : [loss = 0.124, top1 = 96.07%], test  : [loss = 0.351, top1 = 89.07%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.59 ms.
cifar100       train : [loss = 0.790, top1 = 77.85%], valid : [loss = 1.316, top1 = 64.30%], test : [loss = 1.303, top1 = 64.02%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.24%], valid : [loss = 2.556, top1 = 35.67%], test : [loss = 2.578, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.69%], valid : [loss = 0.835, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3690/15625) 003690-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.492, top1 = 89.17%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.46 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.323, top1 = 92.24%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.72 ms.
cifar100       train : [loss = 0.276, top1 = 92.92%], valid : [loss = 1.302, top1 = 68.14%], test : [loss = 1.252, top1 = 68.32%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.69%], valid : [loss = 2.240, top1 = 42.50%], test : [loss = 2.276, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.34%], valid : [loss = 0.658, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3691/15625) 003691-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.72%], valid : [loss = 0.466, top1 = 84.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10        train : [loss = 0.301, top1 = 90.05%], test  : [loss = 0.394, top1 = 86.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 1.343, top1 = 62.74%], valid : [loss = 1.546, top1 = 57.52%], test : [loss = 1.512, top1 = 57.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.83 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.61%], valid : [loss = 2.928, top1 = 28.50%], test : [loss = 2.942, top1 = 28.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3692/15625) 003692-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.554, top1 = 89.02%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.97 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.359, top1 = 92.43%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.58 ms.
cifar100       train : [loss = 0.128, top1 = 97.35%], valid : [loss = 1.576, top1 = 64.92%], test : [loss = 1.542, top1 = 65.04%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 40.44%], valid : [loss = 2.471, top1 = 36.70%], test : [loss = 2.509, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 59.68%], valid : [loss = 1.154, top1 = 58.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3693/15625) 003693-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.18%], valid : [loss = 0.789, top1 = 80.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.01 ms.
cifar10        train : [loss = 0.150, top1 = 94.90%], test  : [loss = 0.468, top1 = 86.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.33 ms.
cifar100       train : [loss = 0.943, top1 = 72.65%], valid : [loss = 1.619, top1 = 57.56%], test : [loss = 1.615, top1 = 57.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 25.63%], valid : [loss = 3.103, top1 = 25.30%], test : [loss = 3.168, top1 = 23.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.15%], valid : [loss = 1.050, top1 = 62.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3694/15625) 003694-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.68%], valid : [loss = 0.553, top1 = 88.10%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.10 ms.
cifar10        train : [loss = 0.020, top1 = 99.43%], test  : [loss = 0.351, top1 = 91.76%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.68 ms.
cifar100       train : [loss = 0.148, top1 = 96.35%], valid : [loss = 1.325, top1 = 69.46%], test : [loss = 1.341, top1 = 69.20%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.08%], valid : [loss = 2.711, top1 = 31.93%], test : [loss = 2.726, top1 = 31.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.70%], valid : [loss = 0.964, top1 = 65.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3695/15625) 003695-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.20%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.61 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.311, top1 = 93.13%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.48 ms.
cifar100       train : [loss = 0.080, top1 = 98.66%], valid : [loss = 1.289, top1 = 70.28%], test : [loss = 1.329, top1 = 69.60%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.54 ms.
ImageNet16-120 train : [loss = 1.704, top1 = 54.34%], valid : [loss = 2.237, top1 = 43.80%], test : [loss = 2.215, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.30%], valid : [loss = 0.697, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3696/15625) 003696-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.610, top1 = 87.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.58 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.383, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.199, top1 = 95.23%], valid : [loss = 1.465, top1 = 66.28%], test : [loss = 1.469, top1 = 66.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 46.03%], valid : [loss = 2.516, top1 = 37.60%], test : [loss = 2.524, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.45%], valid : [loss = 0.769, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3697/15625) 003697-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.474, top1 = 90.24%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.310, top1 = 93.54%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.72 ms.
cifar100       train : [loss = 0.063, top1 = 99.00%], valid : [loss = 1.348, top1 = 70.54%], test : [loss = 1.345, top1 = 70.68%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.63 ms.
ImageNet16-120 train : [loss = 1.580, top1 = 57.57%], valid : [loss = 2.189, top1 = 44.37%], test : [loss = 2.229, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.480, top1 = 83.26%], valid : [loss = 0.593, top1 = 80.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3698/15625) 003698-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.252, top1 = 91.39%], valid : [loss = 0.572, top1 = 82.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.31 ms.
cifar10        train : [loss = 0.247, top1 = 91.54%], test  : [loss = 0.423, top1 = 86.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.04 ms.
cifar100       train : [loss = 1.322, top1 = 62.49%], valid : [loss = 1.602, top1 = 56.64%], test : [loss = 1.583, top1 = 56.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.811, top1 = 30.34%], valid : [loss = 2.821, top1 = 30.57%], test : [loss = 2.860, top1 = 28.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 65.21%], valid : [loss = 1.018, top1 = 64.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3699/15625) 003699-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.630, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.18 ms.
cifar10        train : [loss = 0.036, top1 = 99.04%], test  : [loss = 0.450, top1 = 89.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.07 ms.
cifar100       train : [loss = 0.432, top1 = 88.12%], valid : [loss = 1.421, top1 = 64.36%], test : [loss = 1.396, top1 = 64.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.35%], valid : [loss = 2.638, top1 = 35.00%], test : [loss = 2.662, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.50%], valid : [loss = 0.799, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3700/15625) 003700-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.565, top1 = 87.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.342, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.39 ms.
cifar100       train : [loss = 0.308, top1 = 91.68%], valid : [loss = 1.285, top1 = 67.80%], test : [loss = 1.304, top1 = 67.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.41%], valid : [loss = 2.460, top1 = 37.47%], test : [loss = 2.415, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3701/15625) 003701-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.588, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.398, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 0.238, top1 = 93.97%], valid : [loss = 1.503, top1 = 65.11%], test : [loss = 1.470, top1 = 65.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 45.11%], valid : [loss = 2.498, top1 = 37.53%], test : [loss = 2.502, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 76.88%], valid : [loss = 0.732, top1 = 74.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3702/15625) 003702-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.439, top1 = 89.86%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.83 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.312, top1 = 92.37%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.49 ms.
cifar100       train : [loss = 0.196, top1 = 95.43%], valid : [loss = 1.266, top1 = 69.36%], test : [loss = 1.289, top1 = 69.00%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.76%], valid : [loss = 2.232, top1 = 43.87%], test : [loss = 2.245, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 85.14%], valid : [loss = 0.541, top1 = 81.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3703/15625) 003703-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.550, top1 = 88.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.384, top1 = 92.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.23 ms.
cifar100       train : [loss = 0.117, top1 = 97.65%], valid : [loss = 1.518, top1 = 66.56%], test : [loss = 1.505, top1 = 67.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.98%], valid : [loss = 2.403, top1 = 39.87%], test : [loss = 2.454, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.97%], valid : [loss = 0.752, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3704/15625) 003704-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.618, top1 = 85.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10        train : [loss = 0.063, top1 = 98.16%], test  : [loss = 0.403, top1 = 88.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.64 ms.
cifar100       train : [loss = 0.721, top1 = 79.09%], valid : [loss = 1.382, top1 = 63.42%], test : [loss = 1.374, top1 = 63.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.86%], valid : [loss = 2.652, top1 = 34.13%], test : [loss = 2.696, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3705/15625) 003705-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.66%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.44 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.341, top1 = 92.93%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.01 ms.
cifar100       train : [loss = 0.143, top1 = 96.85%], valid : [loss = 1.359, top1 = 68.50%], test : [loss = 1.333, top1 = 69.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.90 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.18%], valid : [loss = 2.331, top1 = 40.30%], test : [loss = 2.334, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.96%], valid : [loss = 0.737, top1 = 74.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3706/15625) 003706-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.436, top1 = 90.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.301, top1 = 93.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.10 ms.
cifar100       train : [loss = 0.082, top1 = 98.61%], valid : [loss = 1.351, top1 = 69.82%], test : [loss = 1.327, top1 = 70.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 1.616, top1 = 56.64%], valid : [loss = 2.239, top1 = 43.60%], test : [loss = 2.251, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.425, top1 = 85.36%], valid : [loss = 0.538, top1 = 81.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3707/15625) 003707-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.460, top1 = 89.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.313, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 0.336, top1 = 90.79%], valid : [loss = 1.302, top1 = 67.21%], test : [loss = 1.301, top1 = 67.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.08%], valid : [loss = 2.388, top1 = 39.62%], test : [loss = 2.428, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3708/15625) 003708-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.485, top1 = 89.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.337, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.96 ms.
cifar100       train : [loss = 0.211, top1 = 94.60%], valid : [loss = 1.345, top1 = 68.03%], test : [loss = 1.355, top1 = 67.57%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.56%], valid : [loss = 2.280, top1 = 41.83%], test : [loss = 2.317, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.487, top1 = 83.21%], valid : [loss = 0.590, top1 = 79.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3709/15625) 003709-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.55%], valid : [loss = 0.964, top1 = 80.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10        train : [loss = 0.044, top1 = 98.80%], test  : [loss = 0.655, top1 = 85.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.477, top1 = 86.83%], valid : [loss = 1.897, top1 = 56.54%], test : [loss = 1.890, top1 = 56.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.06 ms.
ImageNet16-120 train : [loss = 2.790, top1 = 31.05%], valid : [loss = 3.112, top1 = 25.30%], test : [loss = 3.143, top1 = 25.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.19%], valid : [loss = 1.048, top1 = 62.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3710/15625) 003710-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.553, top1 = 88.94%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.366, top1 = 92.68%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.77 ms.
cifar100       train : [loss = 0.098, top1 = 98.22%], valid : [loss = 1.415, top1 = 69.24%], test : [loss = 1.423, top1 = 67.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.98%], valid : [loss = 2.446, top1 = 39.60%], test : [loss = 2.452, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.00%], valid : [loss = 0.715, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3711/15625) 003711-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.530, top1 = 88.84%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.61 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.361, top1 = 91.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.87 ms.
cifar100       train : [loss = 0.178, top1 = 95.88%], valid : [loss = 1.321, top1 = 68.40%], test : [loss = 1.350, top1 = 68.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 2.228, top1 = 42.19%], valid : [loss = 2.438, top1 = 38.37%], test : [loss = 2.411, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.64%], valid : [loss = 0.883, top1 = 68.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3712/15625) 003712-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.32%], valid : [loss = 0.639, top1 = 78.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.28 ms.
cifar10        train : [loss = 0.509, top1 = 82.35%], test  : [loss = 0.590, top1 = 79.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.83 ms.
cifar100       train : [loss = 1.686, top1 = 54.34%], valid : [loss = 1.857, top1 = 50.82%], test : [loss = 1.864, top1 = 50.66%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.30%], valid : [loss = 3.327, top1 = 21.60%], test : [loss = 3.335, top1 = 21.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3713/15625) 003713-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.93%], valid : [loss = 0.523, top1 = 85.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.60 ms.
cifar10        train : [loss = 0.153, top1 = 94.90%], test  : [loss = 0.361, top1 = 88.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.955, top1 = 72.38%], valid : [loss = 1.364, top1 = 62.44%], test : [loss = 1.358, top1 = 62.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 32.99%], valid : [loss = 2.708, top1 = 33.00%], test : [loss = 2.767, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.88%], valid : [loss = 0.944, top1 = 66.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3714/15625) 003714-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.41 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.82%], valid : [loss = 0.864, top1 = 71.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.24 ms.
cifar10        train : [loss = 0.560, top1 = 80.60%], test  : [loss = 0.716, top1 = 75.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.91 ms.
cifar100       train : [loss = 1.782, top1 = 51.97%], valid : [loss = 2.048, top1 = 47.14%], test : [loss = 2.068, top1 = 46.57%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.94 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.75%], valid : [loss = 3.638, top1 = 16.18%], test : [loss = 3.657, top1 = 15.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3715/15625) 003715-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.550, top1 = 89.00%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.52 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.353, top1 = 92.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.43 ms.
cifar100       train : [loss = 0.071, top1 = 98.92%], valid : [loss = 1.439, top1 = 68.38%], test : [loss = 1.509, top1 = 68.20%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.85 ms.
ImageNet16-120 train : [loss = 1.790, top1 = 52.40%], valid : [loss = 2.368, top1 = 41.50%], test : [loss = 2.426, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 77.98%], valid : [loss = 0.719, top1 = 75.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3716/15625) 003716-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.88%], valid : [loss = 0.772, top1 = 73.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10        train : [loss = 0.536, top1 = 81.40%], test  : [loss = 0.598, top1 = 79.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 2.034, top1 = 45.19%], valid : [loss = 2.145, top1 = 42.94%], test : [loss = 2.143, top1 = 43.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 3.232, top1 = 22.27%], valid : [loss = 3.198, top1 = 23.29%], test : [loss = 3.242, top1 = 22.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.09%], valid : [loss = 1.198, top1 = 57.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3717/15625) 003717-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.527, top1 = 88.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.026, top1 = 99.22%], test  : [loss = 0.355, top1 = 91.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 0.435, top1 = 87.31%], valid : [loss = 1.293, top1 = 66.22%], test : [loss = 1.299, top1 = 65.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.26%], valid : [loss = 2.373, top1 = 39.87%], test : [loss = 2.386, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3718/15625) 003718-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.65%], valid : [loss = 0.621, top1 = 86.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.88 ms.
cifar10        train : [loss = 0.033, top1 = 99.14%], test  : [loss = 0.400, top1 = 90.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.63 ms.
cifar100       train : [loss = 0.511, top1 = 85.06%], valid : [loss = 1.454, top1 = 63.58%], test : [loss = 1.444, top1 = 63.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.26%], valid : [loss = 2.509, top1 = 37.73%], test : [loss = 2.529, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.57%], valid : [loss = 0.884, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3719/15625) 003719-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.513, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.49 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.331, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.63 ms.
cifar100       train : [loss = 0.348, top1 = 90.47%], valid : [loss = 1.268, top1 = 66.68%], test : [loss = 1.268, top1 = 67.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.48%], valid : [loss = 2.407, top1 = 38.60%], test : [loss = 2.413, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3720/15625) 003720-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.452, top1 = 89.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.329, top1 = 91.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.38 ms.
cifar100       train : [loss = 0.327, top1 = 91.08%], valid : [loss = 1.301, top1 = 67.14%], test : [loss = 1.306, top1 = 66.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.99 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.36%], valid : [loss = 2.386, top1 = 39.66%], test : [loss = 2.410, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3721/15625) 003721-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.541, top1 = 88.92%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.89 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.368, top1 = 92.31%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=13.92 ms.
cifar100       train : [loss = 0.082, top1 = 98.65%], valid : [loss = 1.471, top1 = 67.90%], test : [loss = 1.437, top1 = 68.68%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.33%], valid : [loss = 2.444, top1 = 39.00%], test : [loss = 2.407, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.93%], valid : [loss = 0.734, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3722/15625) 003722-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.604, top1 = 87.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.396, top1 = 90.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.65 ms.
cifar100       train : [loss = 0.409, top1 = 88.30%], valid : [loss = 1.397, top1 = 65.17%], test : [loss = 1.406, top1 = 65.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.97%], valid : [loss = 2.505, top1 = 37.13%], test : [loss = 2.539, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.58%], valid : [loss = 0.858, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3723/15625) 003723-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.33%], valid : [loss = 0.838, top1 = 72.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.571, top1 = 80.13%], test  : [loss = 0.727, top1 = 75.41%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.23 ms.
cifar100       train : [loss = 1.814, top1 = 51.09%], valid : [loss = 2.058, top1 = 46.68%], test : [loss = 2.078, top1 = 46.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 17.03%], valid : [loss = 3.623, top1 = 16.50%], test : [loss = 3.651, top1 = 16.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.22%], valid : [loss = 1.258, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3724/15625) 003724-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.093, top1 = 97.36%], valid : [loss = 0.457, top1 = 86.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.07 ms.
cifar10        train : [loss = 0.128, top1 = 95.98%], test  : [loss = 0.342, top1 = 89.08%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.22 ms.
cifar100       train : [loss = 0.807, top1 = 77.30%], valid : [loss = 1.283, top1 = 64.34%], test : [loss = 1.275, top1 = 64.06%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.487, top1 = 36.92%], valid : [loss = 2.583, top1 = 35.03%], test : [loss = 2.612, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.46%], valid : [loss = 0.813, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3725/15625) 003725-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.547, top1 = 88.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.55 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.346, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.40 ms.
cifar100       train : [loss = 0.280, top1 = 92.53%], valid : [loss = 1.438, top1 = 65.54%], test : [loss = 1.463, top1 = 64.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.32 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.51%], valid : [loss = 2.538, top1 = 35.97%], test : [loss = 2.560, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.36%], valid : [loss = 0.934, top1 = 66.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3726/15625) 003726-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.581, top1 = 87.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.388, top1 = 91.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.393, top1 = 88.82%], valid : [loss = 1.391, top1 = 65.73%], test : [loss = 1.397, top1 = 65.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.251, top1 = 42.01%], valid : [loss = 2.459, top1 = 37.69%], test : [loss = 2.503, top1 = 37.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.09%], valid : [loss = 0.778, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3727/15625) 003727-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.822, top1 = 83.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.532, top1 = 88.40%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=18.02 ms.
cifar100       train : [loss = 0.262, top1 = 93.48%], valid : [loss = 1.741, top1 = 60.68%], test : [loss = 1.771, top1 = 60.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 36.24%], valid : [loss = 2.976, top1 = 29.10%], test : [loss = 3.018, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.921, top1 = 67.23%], valid : [loss = 1.001, top1 = 64.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3728/15625) 003728-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.81%], valid : [loss = 0.482, top1 = 83.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10        train : [loss = 0.300, top1 = 90.03%], test  : [loss = 0.408, top1 = 86.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.74 ms.
cifar100       train : [loss = 1.326, top1 = 63.14%], valid : [loss = 1.513, top1 = 58.08%], test : [loss = 1.506, top1 = 58.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.66%], valid : [loss = 2.896, top1 = 30.10%], test : [loss = 2.951, top1 = 28.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3729/15625) 003729-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.49 ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.12%], valid : [loss = 0.737, top1 = 75.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.75 ms.
cifar10        train : [loss = 0.522, top1 = 81.90%], test  : [loss = 0.597, top1 = 79.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.32 ms.
cifar100       train : [loss = 2.005, top1 = 45.90%], valid : [loss = 2.136, top1 = 43.69%], test : [loss = 2.126, top1 = 43.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 2.998, top1 = 26.71%], valid : [loss = 2.992, top1 = 26.91%], test : [loss = 3.020, top1 = 26.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.56%], valid : [loss = 1.196, top1 = 57.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3730/15625) 003730-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.574, top1 = 87.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.375, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.09 ms.
cifar100       train : [loss = 0.414, top1 = 88.13%], valid : [loss = 1.413, top1 = 65.29%], test : [loss = 1.403, top1 = 65.03%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.35%], valid : [loss = 2.526, top1 = 36.43%], test : [loss = 2.540, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.79%], valid : [loss = 0.829, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3731/15625) 003731-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.420, top1 = 91.44%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.16 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.268, top1 = 94.34%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.04 ms.
cifar100       train : [loss = 0.025, top1 = 99.77%], valid : [loss = 1.281, top1 = 72.74%], test : [loss = 1.278, top1 = 72.75%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.11 ms.
ImageNet16-120 train : [loss = 1.200, top1 = 66.83%], valid : [loss = 2.173, top1 = 46.56%], test : [loss = 2.195, top1 = 46.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.50%], valid : [loss = 0.468, top1 = 84.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3732/15625) 003732-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.481, top1 = 89.22%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.40 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.343, top1 = 91.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.76 ms.
cifar100       train : [loss = 0.330, top1 = 90.99%], valid : [loss = 1.232, top1 = 68.16%], test : [loss = 1.267, top1 = 67.84%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.03%], valid : [loss = 2.382, top1 = 38.90%], test : [loss = 2.393, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.42%], valid : [loss = 0.610, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3733/15625) 003733-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.77 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.559, top1 = 88.87%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.97 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.368, top1 = 92.14%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.65 ms.
cifar100       train : [loss = 0.074, top1 = 99.09%], valid : [loss = 1.418, top1 = 69.00%], test : [loss = 1.411, top1 = 68.32%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.90 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.29%], valid : [loss = 2.389, top1 = 40.63%], test : [loss = 2.438, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 78.78%], valid : [loss = 0.697, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3734/15625) 003734-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.196, top1 = 93.41%], valid : [loss = 0.544, top1 = 83.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.190, top1 = 93.57%], test  : [loss = 0.395, top1 = 87.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 1.244, top1 = 64.63%], valid : [loss = 1.545, top1 = 57.65%], test : [loss = 1.540, top1 = 57.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.32%], valid : [loss = 2.711, top1 = 32.57%], test : [loss = 2.751, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.43%], valid : [loss = 0.956, top1 = 66.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3735/15625) 003735-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.21 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.76%], valid : [loss = 0.561, top1 = 88.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.64 ms.
cifar10        train : [loss = 0.020, top1 = 99.46%], test  : [loss = 0.336, top1 = 91.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.87 ms.
cifar100       train : [loss = 0.423, top1 = 88.06%], valid : [loss = 1.457, top1 = 63.44%], test : [loss = 1.445, top1 = 63.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.597, top1 = 33.77%], valid : [loss = 2.698, top1 = 30.77%], test : [loss = 2.700, top1 = 31.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.57%], valid : [loss = 1.213, top1 = 56.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3736/15625) 003736-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.16 ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.15%], valid : [loss = 0.645, top1 = 78.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10        train : [loss = 0.515, top1 = 82.27%], test  : [loss = 0.596, top1 = 79.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.92 ms.
cifar100       train : [loss = 1.686, top1 = 54.35%], valid : [loss = 1.845, top1 = 50.77%], test : [loss = 1.870, top1 = 50.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.26%], valid : [loss = 3.320, top1 = 21.28%], test : [loss = 3.341, top1 = 21.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3737/15625) 003737-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.528, top1 = 89.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=20.06 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.317, top1 = 92.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.75 ms.
cifar100       train : [loss = 0.134, top1 = 97.32%], valid : [loss = 1.291, top1 = 68.58%], test : [loss = 1.275, top1 = 69.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.78 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.68%], valid : [loss = 2.270, top1 = 42.07%], test : [loss = 2.300, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3738/15625) 003738-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.493, top1 = 90.26%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.343, top1 = 93.21%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.45 ms.
cifar100       train : [loss = 0.068, top1 = 98.79%], valid : [loss = 1.311, top1 = 70.72%], test : [loss = 1.325, top1 = 70.60%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 1.552, top1 = 58.11%], valid : [loss = 2.177, top1 = 45.40%], test : [loss = 2.167, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.94%], valid : [loss = 0.635, top1 = 78.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3739/15625) 003739-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.86%], valid : [loss = 0.520, top1 = 86.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.075, top1 = 97.71%], test  : [loss = 0.365, top1 = 89.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.656, top1 = 81.10%], valid : [loss = 1.292, top1 = 65.30%], test : [loss = 1.287, top1 = 65.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.50 ms.
ImageNet16-120 train : [loss = 2.362, top1 = 39.46%], valid : [loss = 2.484, top1 = 37.37%], test : [loss = 2.473, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.31%], valid : [loss = 0.985, top1 = 65.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3740/15625) 003740-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.478, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.326, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.09 ms.
cifar100       train : [loss = 0.317, top1 = 91.41%], valid : [loss = 1.267, top1 = 67.26%], test : [loss = 1.260, top1 = 67.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.66 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.72%], valid : [loss = 2.329, top1 = 41.27%], test : [loss = 2.354, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 81.92%], valid : [loss = 0.593, top1 = 79.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3741/15625) 003741-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.66%], valid : [loss = 0.673, top1 = 83.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10        train : [loss = 0.082, top1 = 97.48%], test  : [loss = 0.399, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.95 ms.
cifar100       train : [loss = 0.793, top1 = 76.93%], valid : [loss = 1.433, top1 = 61.58%], test : [loss = 1.428, top1 = 61.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.41%], valid : [loss = 2.737, top1 = 32.30%], test : [loss = 2.761, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3742/15625) 003742-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.11%], valid : [loss = 0.555, top1 = 87.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.00 ms.
cifar10        train : [loss = 0.058, top1 = 98.13%], test  : [loss = 0.369, top1 = 90.30%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.44 ms.
cifar100       train : [loss = 0.605, top1 = 81.90%], valid : [loss = 1.333, top1 = 64.40%], test : [loss = 1.305, top1 = 65.58%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.47%], valid : [loss = 2.472, top1 = 36.77%], test : [loss = 2.502, top1 = 36.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.83%], valid : [loss = 0.860, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3743/15625) 003743-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.46%], valid : [loss = 0.879, top1 = 75.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.295, top1 = 89.59%], test  : [loss = 0.637, top1 = 80.13%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.63 ms.
cifar100       train : [loss = 1.394, top1 = 60.85%], valid : [loss = 1.932, top1 = 49.18%], test : [loss = 1.952, top1 = 49.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 3.508, top1 = 17.05%], valid : [loss = 3.541, top1 = 17.07%], test : [loss = 3.535, top1 = 17.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3744/15625) 003744-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.568, top1 = 87.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10        train : [loss = 0.034, top1 = 98.91%], test  : [loss = 0.384, top1 = 90.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.433, top1 = 87.44%], valid : [loss = 1.339, top1 = 65.64%], test : [loss = 1.330, top1 = 65.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.26 ms.
ImageNet16-120 train : [loss = 2.579, top1 = 34.41%], valid : [loss = 2.633, top1 = 33.03%], test : [loss = 2.656, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.095, top1 = 60.37%], valid : [loss = 1.106, top1 = 60.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3745/15625) 003745-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.477, top1 = 89.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.09 ms.
cifar100       train : [loss = 0.258, top1 = 93.22%], valid : [loss = 1.221, top1 = 68.58%], test : [loss = 1.232, top1 = 69.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.52%], valid : [loss = 2.214, top1 = 43.27%], test : [loss = 2.230, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3746/15625) 003746-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.27%], valid : [loss = 0.481, top1 = 84.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.298, top1 = 90.10%], test  : [loss = 0.393, top1 = 86.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.30 ms.
cifar100       train : [loss = 1.330, top1 = 63.26%], valid : [loss = 1.547, top1 = 57.56%], test : [loss = 1.515, top1 = 57.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.90%], valid : [loss = 2.893, top1 = 29.33%], test : [loss = 2.927, top1 = 28.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3747/15625) 003747-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.64%], valid : [loss = 0.843, top1 = 71.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10        train : [loss = 0.669, top1 = 76.60%], test  : [loss = 0.762, top1 = 73.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.00 ms.
cifar100       train : [loss = 1.975, top1 = 47.56%], valid : [loss = 2.149, top1 = 44.30%], test : [loss = 2.169, top1 = 44.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.646, top1 = 15.80%], valid : [loss = 3.670, top1 = 16.00%], test : [loss = 3.692, top1 = 14.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3748/15625) 003748-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.496, top1 = 89.62%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.90 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.313, top1 = 92.85%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=23.05 ms.
cifar100       train : [loss = 0.144, top1 = 97.00%], valid : [loss = 1.270, top1 = 70.00%], test : [loss = 1.302, top1 = 68.86%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.00 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.90%], valid : [loss = 2.285, top1 = 41.37%], test : [loss = 2.298, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.67%], valid : [loss = 0.652, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3749/15625) 003749-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.636, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10        train : [loss = 0.030, top1 = 99.18%], test  : [loss = 0.385, top1 = 90.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.498, top1 = 85.39%], valid : [loss = 1.406, top1 = 64.24%], test : [loss = 1.366, top1 = 65.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 39.07%], valid : [loss = 2.583, top1 = 35.53%], test : [loss = 2.604, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.08%], valid : [loss = 0.827, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3750/15625) 003750-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.21%], valid : [loss = 0.889, top1 = 79.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.129, top1 = 95.72%], test  : [loss = 0.541, top1 = 85.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.836, top1 = 75.73%], valid : [loss = 1.699, top1 = 56.90%], test : [loss = 1.687, top1 = 57.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 3.011, top1 = 26.86%], valid : [loss = 3.190, top1 = 24.10%], test : [loss = 3.196, top1 = 24.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.122, top1 = 59.48%], valid : [loss = 1.172, top1 = 58.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3751/15625) 003751-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.486, top1 = 89.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.55 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.332, top1 = 92.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.32 ms.
cifar100       train : [loss = 0.144, top1 = 96.93%], valid : [loss = 1.301, top1 = 69.32%], test : [loss = 1.301, top1 = 69.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.81 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.55%], valid : [loss = 2.278, top1 = 42.80%], test : [loss = 2.307, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.46%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3752/15625) 003752-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.100, top1 = 97.14%], valid : [loss = 0.461, top1 = 86.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10        train : [loss = 0.138, top1 = 95.58%], test  : [loss = 0.338, top1 = 89.22%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.16 ms.
cifar100       train : [loss = 0.804, top1 = 77.42%], valid : [loss = 1.304, top1 = 63.75%], test : [loss = 1.300, top1 = 64.09%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.10%], valid : [loss = 2.612, top1 = 34.42%], test : [loss = 2.632, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.76%], valid : [loss = 0.838, top1 = 70.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3753/15625) 003753-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.53%], valid : [loss = 0.624, top1 = 86.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.390, top1 = 90.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.526, top1 = 84.72%], valid : [loss = 1.459, top1 = 63.60%], test : [loss = 1.423, top1 = 64.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.28%], valid : [loss = 2.547, top1 = 35.50%], test : [loss = 2.609, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.70%], valid : [loss = 0.887, top1 = 68.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3754/15625) 003754-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.88%], valid : [loss = 0.559, top1 = 88.48%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.339, top1 = 92.29%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.14 ms.
cifar100       train : [loss = 0.085, top1 = 98.27%], valid : [loss = 1.395, top1 = 69.86%], test : [loss = 1.461, top1 = 68.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 45.82%], valid : [loss = 2.390, top1 = 38.87%], test : [loss = 2.370, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.61%], valid : [loss = 0.844, top1 = 70.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3755/15625) 003755-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.554, top1 = 88.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10        train : [loss = 0.010, top1 = 99.74%], test  : [loss = 0.334, top1 = 92.52%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.32 ms.
cifar100       train : [loss = 0.241, top1 = 93.55%], valid : [loss = 1.322, top1 = 68.00%], test : [loss = 1.371, top1 = 67.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.78%], valid : [loss = 2.336, top1 = 40.00%], test : [loss = 2.372, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.997, top1 = 63.67%], valid : [loss = 1.003, top1 = 63.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3756/15625) 003756-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.19%], valid : [loss = 0.559, top1 = 87.08%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.42 ms.
cifar10        train : [loss = 0.061, top1 = 98.08%], test  : [loss = 0.373, top1 = 90.42%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.65 ms.
cifar100       train : [loss = 0.658, top1 = 80.37%], valid : [loss = 1.364, top1 = 64.94%], test : [loss = 1.320, top1 = 65.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.71%], valid : [loss = 2.466, top1 = 38.13%], test : [loss = 2.529, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.94%], valid : [loss = 0.735, top1 = 74.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3757/15625) 003757-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.587, top1 = 87.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.385, top1 = 91.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.48 ms.
cifar100       train : [loss = 0.207, top1 = 94.93%], valid : [loss = 1.473, top1 = 65.20%], test : [loss = 1.483, top1 = 66.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.97 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.95%], valid : [loss = 2.490, top1 = 36.87%], test : [loss = 2.504, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.34%], valid : [loss = 0.820, top1 = 71.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3758/15625) 003758-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.89%], valid : [loss = 0.598, top1 = 86.44%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.025, top1 = 99.42%], test  : [loss = 0.439, top1 = 89.35%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.82 ms.
cifar100       train : [loss = 0.381, top1 = 89.89%], valid : [loss = 1.468, top1 = 64.30%], test : [loss = 1.406, top1 = 64.26%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.03%], valid : [loss = 2.609, top1 = 35.87%], test : [loss = 2.637, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.69%], valid : [loss = 0.790, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3759/15625) 003759-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.458, top1 = 89.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.18 ms.
cifar100       train : [loss = 0.328, top1 = 91.08%], valid : [loss = 1.308, top1 = 67.33%], test : [loss = 1.308, top1 = 67.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.39%], valid : [loss = 2.357, top1 = 40.36%], test : [loss = 2.397, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.83%], valid : [loss = 0.564, top1 = 81.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3760/15625) 003760-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.576, top1 = 88.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.354, top1 = 92.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.252, top1 = 93.25%], valid : [loss = 1.327, top1 = 67.86%], test : [loss = 1.329, top1 = 67.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.54%], valid : [loss = 2.409, top1 = 39.63%], test : [loss = 2.418, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.84%], valid : [loss = 0.896, top1 = 68.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3761/15625) 003761-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.77%], valid : [loss = 0.583, top1 = 86.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.59 ms.
cifar10        train : [loss = 0.024, top1 = 99.33%], test  : [loss = 0.377, top1 = 90.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 0.502, top1 = 85.37%], valid : [loss = 1.415, top1 = 64.20%], test : [loss = 1.400, top1 = 64.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.20%], valid : [loss = 2.501, top1 = 36.87%], test : [loss = 2.538, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 72.89%], valid : [loss = 0.819, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3762/15625) 003762-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.323, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.39 ms.
cifar100       train : [loss = 0.328, top1 = 91.07%], valid : [loss = 1.251, top1 = 67.58%], test : [loss = 1.236, top1 = 68.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.70%], valid : [loss = 2.338, top1 = 39.83%], test : [loss = 2.334, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.17%], valid : [loss = 0.600, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3763/15625) 003763-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.27%], valid : [loss = 0.662, top1 = 77.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.515, top1 = 82.23%], test  : [loss = 0.594, top1 = 79.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.02 ms.
cifar100       train : [loss = 1.742, top1 = 52.79%], valid : [loss = 1.899, top1 = 49.01%], test : [loss = 1.903, top1 = 50.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 3.335, top1 = 21.13%], valid : [loss = 3.329, top1 = 21.58%], test : [loss = 3.362, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.14%], valid : [loss = 1.299, top1 = 53.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3764/15625) 003764-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.26%], valid : [loss = 0.615, top1 = 85.36%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10        train : [loss = 0.069, top1 = 97.93%], test  : [loss = 0.400, top1 = 89.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.62 ms.
cifar100       train : [loss = 0.719, top1 = 78.75%], valid : [loss = 1.356, top1 = 63.48%], test : [loss = 1.345, top1 = 63.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.29%], valid : [loss = 2.656, top1 = 32.53%], test : [loss = 2.686, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.00%], valid : [loss = 0.772, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3765/15625) 003765-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.540, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.378, top1 = 91.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.89 ms.
cifar100       train : [loss = 0.091, top1 = 98.39%], valid : [loss = 1.539, top1 = 67.02%], test : [loss = 1.502, top1 = 67.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.52%], valid : [loss = 2.340, top1 = 41.03%], test : [loss = 2.405, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.17%], valid : [loss = 0.681, top1 = 76.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3766/15625) 003766-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.31 ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.15%], valid : [loss = 0.729, top1 = 75.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.83 ms.
cifar10        train : [loss = 0.539, top1 = 81.30%], test  : [loss = 0.622, top1 = 78.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.53 ms.
cifar100       train : [loss = 1.990, top1 = 46.33%], valid : [loss = 2.122, top1 = 44.14%], test : [loss = 2.122, top1 = 43.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 2.998, top1 = 26.72%], valid : [loss = 2.990, top1 = 26.90%], test : [loss = 3.018, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.56%], valid : [loss = 1.196, top1 = 57.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3767/15625) 003767-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=24.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.84%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=23.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.314, top1 = 93.34%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=20.81 ms.
cifar100       train : [loss = 0.041, top1 = 99.60%], valid : [loss = 1.368, top1 = 69.18%], test : [loss = 1.351, top1 = 70.30%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=21.39 ms.
ImageNet16-120 train : [loss = 1.978, top1 = 47.79%], valid : [loss = 2.301, top1 = 40.73%], test : [loss = 2.312, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 73.90%], valid : [loss = 0.789, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3768/15625) 003768-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.16%], valid : [loss = 0.578, top1 = 81.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.257, top1 = 91.20%], test  : [loss = 0.396, top1 = 86.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.21 ms.
cifar100       train : [loss = 1.503, top1 = 57.98%], valid : [loss = 1.755, top1 = 52.83%], test : [loss = 1.748, top1 = 52.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.60%], valid : [loss = 2.960, top1 = 27.24%], test : [loss = 3.017, top1 = 26.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3769/15625) 003769-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.495, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.325, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.45 ms.
cifar100       train : [loss = 0.344, top1 = 90.53%], valid : [loss = 1.224, top1 = 68.19%], test : [loss = 1.239, top1 = 68.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.08%], valid : [loss = 2.311, top1 = 40.73%], test : [loss = 2.331, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.10%], valid : [loss = 0.634, top1 = 78.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3770/15625) 003770-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.210, top1 = 92.96%], valid : [loss = 0.493, top1 = 84.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.90 ms.
cifar10        train : [loss = 0.220, top1 = 92.61%], test  : [loss = 0.385, top1 = 87.46%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.13 ms.
cifar100       train : [loss = 1.291, top1 = 63.54%], valid : [loss = 1.550, top1 = 56.56%], test : [loss = 1.543, top1 = 56.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.986, top1 = 26.62%], valid : [loss = 2.971, top1 = 26.37%], test : [loss = 3.012, top1 = 25.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3771/15625) 003771-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.537, top1 = 89.40%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.78 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.19%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=17.78 ms.
cifar100       train : [loss = 0.051, top1 = 99.24%], valid : [loss = 1.342, top1 = 70.94%], test : [loss = 1.307, top1 = 71.20%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 1.561, top1 = 57.87%], valid : [loss = 2.158, top1 = 44.70%], test : [loss = 2.205, top1 = 44.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.60%], valid : [loss = 0.737, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3772/15625) 003772-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.496, top1 = 88.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.354, top1 = 91.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.242, top1 = 93.81%], valid : [loss = 1.360, top1 = 66.82%], test : [loss = 1.315, top1 = 68.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.92%], valid : [loss = 2.413, top1 = 38.77%], test : [loss = 2.429, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.491, top1 = 82.88%], valid : [loss = 0.597, top1 = 79.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3773/15625) 003773-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.31%], valid : [loss = 0.751, top1 = 74.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.475, top1 = 83.43%], test  : [loss = 0.552, top1 = 81.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.51 ms.
cifar100       train : [loss = 1.936, top1 = 47.03%], valid : [loss = 2.056, top1 = 44.74%], test : [loss = 2.059, top1 = 44.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 3.007, top1 = 26.45%], valid : [loss = 2.995, top1 = 26.87%], test : [loss = 3.033, top1 = 25.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.156, top1 = 58.27%], valid : [loss = 1.191, top1 = 57.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3774/15625) 003774-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.334, top1 = 88.42%], valid : [loss = 0.566, top1 = 81.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10        train : [loss = 0.297, top1 = 89.79%], test  : [loss = 0.444, top1 = 85.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.78 ms.
cifar100       train : [loss = 1.548, top1 = 56.78%], valid : [loss = 1.761, top1 = 52.27%], test : [loss = 1.773, top1 = 51.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.955, top1 = 27.50%], valid : [loss = 2.986, top1 = 27.06%], test : [loss = 3.017, top1 = 26.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.63%], valid : [loss = 1.049, top1 = 62.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3775/15625) 003775-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.551, top1 = 89.08%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.385, top1 = 92.35%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.29 ms.
cifar100       train : [loss = 0.044, top1 = 99.48%], valid : [loss = 1.455, top1 = 69.16%], test : [loss = 1.478, top1 = 68.38%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.69%], valid : [loss = 2.400, top1 = 40.50%], test : [loss = 2.378, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.69%], valid : [loss = 0.686, top1 = 76.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3776/15625) 003776-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.46%], valid : [loss = 0.451, top1 = 87.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.055, top1 = 98.69%], test  : [loss = 0.313, top1 = 90.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.601, top1 = 83.45%], valid : [loss = 1.212, top1 = 66.36%], test : [loss = 1.195, top1 = 66.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 41.00%], valid : [loss = 2.496, top1 = 37.77%], test : [loss = 2.511, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.49%], valid : [loss = 0.635, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3777/15625) 003777-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.345, top1 = 88.00%], valid : [loss = 0.578, top1 = 81.36%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10        train : [loss = 0.296, top1 = 89.90%], test  : [loss = 0.454, top1 = 85.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 1.571, top1 = 56.35%], valid : [loss = 1.808, top1 = 51.23%], test : [loss = 1.789, top1 = 51.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.109, top1 = 24.65%], valid : [loss = 3.108, top1 = 24.72%], test : [loss = 3.167, top1 = 24.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.33%], valid : [loss = 1.054, top1 = 62.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3778/15625) 003778-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.488, top1 = 88.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.323, top1 = 91.29%], valid : [loss = 1.253, top1 = 67.49%], test : [loss = 1.261, top1 = 67.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.71%], valid : [loss = 2.322, top1 = 40.74%], test : [loss = 2.342, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3779/15625) 003779-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=23.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.537, top1 = 89.16%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.29 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.329, top1 = 92.87%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.92 ms.
cifar100       train : [loss = 0.127, top1 = 97.33%], valid : [loss = 1.279, top1 = 69.98%], test : [loss = 1.296, top1 = 69.56%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.65 ms.
ImageNet16-120 train : [loss = 1.768, top1 = 52.93%], valid : [loss = 2.143, top1 = 44.47%], test : [loss = 2.163, top1 = 44.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.07%], valid : [loss = 0.806, top1 = 71.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3780/15625) 003780-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.552, top1 = 88.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.08 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.366, top1 = 92.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.20 ms.
cifar100       train : [loss = 0.069, top1 = 99.24%], valid : [loss = 1.416, top1 = 68.16%], test : [loss = 1.407, top1 = 69.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.55 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.96%], valid : [loss = 2.378, top1 = 40.27%], test : [loss = 2.429, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.00%], valid : [loss = 0.685, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3781/15625) 003781-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.243, top1 = 91.83%], valid : [loss = 0.647, top1 = 81.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.51 ms.
cifar10        train : [loss = 0.197, top1 = 93.29%], test  : [loss = 0.465, top1 = 85.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.68 ms.
cifar100       train : [loss = 0.905, top1 = 73.76%], valid : [loss = 1.694, top1 = 56.34%], test : [loss = 1.698, top1 = 56.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 4.519, top1 = 3.20%], valid : [loss = 4.498, top1 = 3.43%], test : [loss = 4.507, top1 = 3.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.496, top1 = 43.81%], valid : [loss = 1.495, top1 = 44.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3782/15625) 003782-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.431, top1 = 89.97%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.63 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.304, top1 = 92.39%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.30 ms.
cifar100       train : [loss = 0.213, top1 = 94.91%], valid : [loss = 1.273, top1 = 68.58%], test : [loss = 1.275, top1 = 69.34%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.95%], valid : [loss = 2.254, top1 = 41.97%], test : [loss = 2.293, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 85.86%], valid : [loss = 0.519, top1 = 82.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3783/15625) 003783-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.60%], valid : [loss = 0.635, top1 = 86.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10        train : [loss = 0.036, top1 = 98.95%], test  : [loss = 0.396, top1 = 90.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.14 ms.
cifar100       train : [loss = 0.529, top1 = 84.57%], valid : [loss = 1.475, top1 = 62.92%], test : [loss = 1.474, top1 = 62.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.360, top1 = 39.62%], valid : [loss = 2.528, top1 = 36.53%], test : [loss = 2.543, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.10%], valid : [loss = 0.885, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3784/15625) 003784-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.26%], valid : [loss = 0.528, top1 = 84.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.182, top1 = 93.85%], test  : [loss = 0.384, top1 = 87.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 1.207, top1 = 65.74%], valid : [loss = 1.523, top1 = 58.11%], test : [loss = 1.517, top1 = 58.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.89%], valid : [loss = 2.685, top1 = 33.20%], test : [loss = 2.726, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 66.86%], valid : [loss = 0.962, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3785/15625) 003785-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.76%], valid : [loss = 0.499, top1 = 84.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10        train : [loss = 0.201, top1 = 93.28%], test  : [loss = 0.372, top1 = 88.18%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 1.182, top1 = 66.32%], valid : [loss = 1.481, top1 = 59.46%], test : [loss = 1.481, top1 = 59.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.96%], valid : [loss = 2.780, top1 = 30.87%], test : [loss = 2.810, top1 = 31.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 69.00%], valid : [loss = 0.902, top1 = 67.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3786/15625) 003786-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.528, top1 = 88.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.362, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.11 ms.
cifar100       train : [loss = 0.336, top1 = 90.76%], valid : [loss = 1.273, top1 = 67.76%], test : [loss = 1.267, top1 = 67.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.83%], valid : [loss = 2.414, top1 = 39.07%], test : [loss = 2.417, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.50%], valid : [loss = 0.832, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3787/15625) 003787-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.320, top1 = 93.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.61 ms.
cifar100       train : [loss = 0.068, top1 = 98.95%], valid : [loss = 1.359, top1 = 69.21%], test : [loss = 1.332, top1 = 70.09%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.87%], valid : [loss = 2.298, top1 = 41.66%], test : [loss = 2.289, top1 = 42.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.09%], valid : [loss = 0.688, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3788/15625) 003788-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.572, top1 = 87.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.350, top1 = 92.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.23 ms.
cifar100       train : [loss = 0.266, top1 = 92.90%], valid : [loss = 1.286, top1 = 68.00%], test : [loss = 1.279, top1 = 68.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.99%], valid : [loss = 2.244, top1 = 41.97%], test : [loss = 2.265, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.97%], valid : [loss = 0.695, top1 = 76.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3789/15625) 003789-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.171, top1 = 94.56%], valid : [loss = 0.912, top1 = 76.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10        train : [loss = 0.212, top1 = 92.80%], test  : [loss = 0.619, top1 = 82.13%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.60 ms.
cifar100       train : [loss = 1.225, top1 = 65.40%], valid : [loss = 1.826, top1 = 53.30%], test : [loss = 1.813, top1 = 52.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.57%], valid : [loss = 3.329, top1 = 21.00%], test : [loss = 3.389, top1 = 19.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3790/15625) 003790-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.222, top1 = 92.60%], valid : [loss = 0.553, top1 = 83.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.56 ms.
cifar10        train : [loss = 0.206, top1 = 93.05%], test  : [loss = 0.398, top1 = 87.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.71 ms.
cifar100       train : [loss = 1.246, top1 = 64.77%], valid : [loss = 1.553, top1 = 57.68%], test : [loss = 1.513, top1 = 58.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.78 ms.
ImageNet16-120 train : [loss = 2.746, top1 = 31.83%], valid : [loss = 2.782, top1 = 30.87%], test : [loss = 2.800, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.54%], valid : [loss = 1.009, top1 = 64.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3791/15625) 003791-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.90%], valid : [loss = 0.496, top1 = 84.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10        train : [loss = 0.274, top1 = 90.73%], test  : [loss = 0.422, top1 = 85.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.00 ms.
cifar100       train : [loss = 1.272, top1 = 64.14%], valid : [loss = 1.543, top1 = 57.16%], test : [loss = 1.549, top1 = 57.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 3.470, top1 = 18.10%], valid : [loss = 3.454, top1 = 18.10%], test : [loss = 3.465, top1 = 18.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.52%], valid : [loss = 1.052, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3792/15625) 003792-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.452, top1 = 89.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.329, top1 = 91.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 0.327, top1 = 91.08%], valid : [loss = 1.301, top1 = 67.14%], test : [loss = 1.306, top1 = 66.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.36%], valid : [loss = 2.386, top1 = 39.66%], test : [loss = 2.410, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3793/15625) 003793-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.04%], valid : [loss = 0.483, top1 = 84.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.91 ms.
cifar10        train : [loss = 0.302, top1 = 89.91%], test  : [loss = 0.406, top1 = 86.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 1.316, top1 = 63.51%], valid : [loss = 1.527, top1 = 57.70%], test : [loss = 1.491, top1 = 58.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 28.56%], valid : [loss = 2.899, top1 = 29.80%], test : [loss = 2.972, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3794/15625) 003794-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=23.53 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.474, top1 = 89.18%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.85 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.301, top1 = 92.25%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.14 ms.
cifar100       train : [loss = 0.189, top1 = 95.77%], valid : [loss = 1.250, top1 = 69.24%], test : [loss = 1.234, top1 = 69.62%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.84 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.15%], valid : [loss = 2.175, top1 = 43.53%], test : [loss = 2.205, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.68%], valid : [loss = 0.812, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3795/15625) 003795-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.49%], valid : [loss = 0.865, top1 = 82.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.81 ms.
cifar10        train : [loss = 0.042, top1 = 98.77%], test  : [loss = 0.640, top1 = 85.55%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.89 ms.
cifar100       train : [loss = 0.358, top1 = 90.44%], valid : [loss = 1.888, top1 = 57.74%], test : [loss = 1.921, top1 = 58.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.69%], valid : [loss = 2.986, top1 = 28.17%], test : [loss = 3.023, top1 = 27.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.59%], valid : [loss = 0.993, top1 = 64.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3796/15625) 003796-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.225, top1 = 92.33%], valid : [loss = 0.531, top1 = 83.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10        train : [loss = 0.224, top1 = 92.32%], test  : [loss = 0.418, top1 = 86.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.71 ms.
cifar100       train : [loss = 1.198, top1 = 65.85%], valid : [loss = 1.552, top1 = 58.32%], test : [loss = 1.529, top1 = 57.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.946, top1 = 28.16%], valid : [loss = 2.983, top1 = 27.13%], test : [loss = 3.011, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.30%], valid : [loss = 1.191, top1 = 57.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3797/15625) 003797-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.586, top1 = 86.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.041, top1 = 98.78%], test  : [loss = 0.410, top1 = 89.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.47 ms.
cifar100       train : [loss = 0.550, top1 = 83.85%], valid : [loss = 1.410, top1 = 63.88%], test : [loss = 1.422, top1 = 63.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.82%], valid : [loss = 2.622, top1 = 34.67%], test : [loss = 2.666, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3798/15625) 003798-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.48%], valid : [loss = 0.859, top1 = 79.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.129, top1 = 95.63%], test  : [loss = 0.524, top1 = 85.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.89 ms.
cifar100       train : [loss = 0.853, top1 = 75.09%], valid : [loss = 1.678, top1 = 57.45%], test : [loss = 1.667, top1 = 57.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.49%], valid : [loss = 3.167, top1 = 24.24%], test : [loss = 3.205, top1 = 23.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3799/15625) 003799-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.26%], valid : [loss = 0.564, top1 = 82.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.243, top1 = 91.76%], test  : [loss = 0.389, top1 = 87.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.27 ms.
cifar100       train : [loss = 1.426, top1 = 59.82%], valid : [loss = 1.671, top1 = 53.50%], test : [loss = 1.654, top1 = 54.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.33 ms.
ImageNet16-120 train : [loss = 2.946, top1 = 27.99%], valid : [loss = 2.971, top1 = 27.47%], test : [loss = 3.027, top1 = 26.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.54%], valid : [loss = 1.003, top1 = 64.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3800/15625) 003800-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.61%], valid : [loss = 0.722, top1 = 75.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.69 ms.
cifar10        train : [loss = 0.586, top1 = 79.63%], test  : [loss = 0.653, top1 = 77.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.09 ms.
cifar100       train : [loss = 1.754, top1 = 52.35%], valid : [loss = 1.903, top1 = 49.36%], test : [loss = 1.933, top1 = 48.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 3.396, top1 = 19.94%], valid : [loss = 3.375, top1 = 20.03%], test : [loss = 3.405, top1 = 19.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.378, top1 = 49.92%], valid : [loss = 1.393, top1 = 49.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3801/15625) 003801-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.74%], valid : [loss = 0.542, top1 = 86.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.79 ms.
cifar10        train : [loss = 0.083, top1 = 97.28%], test  : [loss = 0.361, top1 = 89.85%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.23 ms.
cifar100       train : [loss = 0.739, top1 = 78.23%], valid : [loss = 1.309, top1 = 64.79%], test : [loss = 1.314, top1 = 64.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.458, top1 = 37.40%], valid : [loss = 2.551, top1 = 35.49%], test : [loss = 2.601, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.28%], valid : [loss = 0.715, top1 = 75.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3802/15625) 003802-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.495, top1 = 88.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.299, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.03 ms.
cifar100       train : [loss = 0.321, top1 = 91.31%], valid : [loss = 1.236, top1 = 67.46%], test : [loss = 1.244, top1 = 67.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=22.15 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.80%], valid : [loss = 2.322, top1 = 40.10%], test : [loss = 2.354, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 81.92%], valid : [loss = 0.593, top1 = 79.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3803/15625) 003803-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.485, top1 = 90.37%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.309, top1 = 93.58%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.49 ms.
cifar100       train : [loss = 0.057, top1 = 99.28%], valid : [loss = 1.223, top1 = 71.04%], test : [loss = 1.251, top1 = 70.30%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=25.56 ms.
ImageNet16-120 train : [loss = 1.491, top1 = 59.48%], valid : [loss = 2.129, top1 = 45.33%], test : [loss = 2.145, top1 = 44.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.27%], valid : [loss = 0.639, top1 = 78.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3804/15625) 003804-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.608, top1 = 86.30%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10        train : [loss = 0.029, top1 = 99.25%], test  : [loss = 0.418, top1 = 89.69%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.15 ms.
cifar100       train : [loss = 0.362, top1 = 90.30%], valid : [loss = 1.465, top1 = 64.10%], test : [loss = 1.460, top1 = 64.24%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.64 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.57%], valid : [loss = 2.624, top1 = 33.77%], test : [loss = 2.634, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.45%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3805/15625) 003805-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.539, top1 = 89.20%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.41 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.00%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.24 ms.
cifar100       train : [loss = 0.061, top1 = 99.14%], valid : [loss = 1.388, top1 = 69.52%], test : [loss = 1.383, top1 = 70.04%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=21.45 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.29%], valid : [loss = 2.386, top1 = 39.23%], test : [loss = 2.377, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 70.84%], valid : [loss = 0.859, top1 = 69.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3806/15625) 003806-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.550, top1 = 87.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.54 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.343, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.39 ms.
cifar100       train : [loss = 0.300, top1 = 91.77%], valid : [loss = 1.297, top1 = 67.06%], test : [loss = 1.301, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.35%], valid : [loss = 2.455, top1 = 38.13%], test : [loss = 2.443, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3807/15625) 003807-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.24%], valid : [loss = 0.666, top1 = 83.91%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.075, top1 = 97.59%], test  : [loss = 0.434, top1 = 88.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.13 ms.
cifar100       train : [loss = 0.766, top1 = 77.66%], valid : [loss = 1.434, top1 = 62.28%], test : [loss = 1.429, top1 = 61.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.34%], valid : [loss = 2.715, top1 = 32.10%], test : [loss = 2.738, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.61%], valid : [loss = 0.929, top1 = 67.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3808/15625) 003808-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.56 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3809/15625) 003809-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.71 ms.
cifar10-valid  train : [loss = 0.230, top1 = 92.09%], valid : [loss = 0.551, top1 = 83.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.226, top1 = 92.33%], test  : [loss = 0.421, top1 = 86.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.19 ms.
cifar100       train : [loss = 1.205, top1 = 66.03%], valid : [loss = 1.570, top1 = 57.54%], test : [loss = 1.561, top1 = 58.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.98%], valid : [loss = 2.970, top1 = 27.17%], test : [loss = 3.002, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.30%], valid : [loss = 1.191, top1 = 57.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3810/15625) 003810-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.11 ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.72%], valid : [loss = 0.828, top1 = 71.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10        train : [loss = 0.669, top1 = 76.51%], test  : [loss = 0.756, top1 = 73.98%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.07 ms.
cifar100       train : [loss = 1.974, top1 = 47.56%], valid : [loss = 2.146, top1 = 45.02%], test : [loss = 2.152, top1 = 44.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.95 ms.
ImageNet16-120 train : [loss = 3.658, top1 = 15.65%], valid : [loss = 3.665, top1 = 15.73%], test : [loss = 3.689, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3811/15625) 003811-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.428, top1 = 90.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.54 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.295, top1 = 92.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.07 ms.
cifar100       train : [loss = 0.182, top1 = 95.67%], valid : [loss = 1.243, top1 = 69.42%], test : [loss = 1.271, top1 = 69.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.51%], valid : [loss = 2.276, top1 = 42.13%], test : [loss = 2.298, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.95%], valid : [loss = 0.500, top1 = 83.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3812/15625) 003812-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.61 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.50%], valid : [loss = 0.590, top1 = 87.15%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.47 ms.
cifar10        train : [loss = 0.031, top1 = 99.11%], test  : [loss = 0.383, top1 = 90.53%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.85 ms.
cifar100       train : [loss = 0.425, top1 = 87.85%], valid : [loss = 1.329, top1 = 66.46%], test : [loss = 1.345, top1 = 65.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 31.84%], valid : [loss = 2.747, top1 = 30.30%], test : [loss = 2.753, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 55.39%], valid : [loss = 1.242, top1 = 54.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3813/15625) 003813-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.290, top1 = 90.03%], valid : [loss = 0.544, top1 = 82.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10        train : [loss = 0.238, top1 = 91.89%], test  : [loss = 0.389, top1 = 87.28%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.22 ms.
cifar100       train : [loss = 1.376, top1 = 61.32%], valid : [loss = 1.629, top1 = 55.45%], test : [loss = 1.624, top1 = 55.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.838, top1 = 29.99%], valid : [loss = 2.861, top1 = 29.67%], test : [loss = 2.899, top1 = 29.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.000, top1 = 64.08%], valid : [loss = 1.037, top1 = 63.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3814/15625) 003814-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.236, top1 = 91.79%], valid : [loss = 0.556, top1 = 83.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10        train : [loss = 0.226, top1 = 92.28%], test  : [loss = 0.406, top1 = 86.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.85 ms.
cifar100       train : [loss = 1.306, top1 = 62.85%], valid : [loss = 1.586, top1 = 56.19%], test : [loss = 1.583, top1 = 56.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.756, top1 = 31.39%], valid : [loss = 2.784, top1 = 30.75%], test : [loss = 2.813, top1 = 30.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.970, top1 = 64.90%], valid : [loss = 1.030, top1 = 63.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3815/15625) 003815-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.580, top1 = 87.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10        train : [loss = 0.019, top1 = 99.49%], test  : [loss = 0.375, top1 = 91.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.94 ms.
cifar100       train : [loss = 0.303, top1 = 91.64%], valid : [loss = 1.341, top1 = 66.88%], test : [loss = 1.314, top1 = 67.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.11%], valid : [loss = 2.335, top1 = 39.50%], test : [loss = 2.384, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.23%], valid : [loss = 0.857, top1 = 69.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3816/15625) 003816-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.465, top1 = 89.39%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.007, top1 = 99.92%], test  : [loss = 0.316, top1 = 92.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.62 ms.
cifar100       train : [loss = 0.195, top1 = 95.00%], valid : [loss = 1.339, top1 = 68.06%], test : [loss = 1.345, top1 = 68.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.49%], valid : [loss = 2.339, top1 = 40.90%], test : [loss = 2.331, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.26%], valid : [loss = 0.590, top1 = 80.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3817/15625) 003817-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.27%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.38 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.362, top1 = 92.13%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.93 ms.
cifar100       train : [loss = 0.078, top1 = 99.00%], valid : [loss = 1.452, top1 = 67.52%], test : [loss = 1.415, top1 = 69.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 1.801, top1 = 52.21%], valid : [loss = 2.465, top1 = 38.80%], test : [loss = 2.438, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.42%], valid : [loss = 0.700, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3818/15625) 003818-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.468, top1 = 89.76%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.82 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.313, top1 = 92.60%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.23 ms.
cifar100       train : [loss = 0.104, top1 = 98.25%], valid : [loss = 1.273, top1 = 70.18%], test : [loss = 1.277, top1 = 69.96%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.01 ms.
ImageNet16-120 train : [loss = 1.672, top1 = 55.07%], valid : [loss = 2.198, top1 = 43.70%], test : [loss = 2.174, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.52%], valid : [loss = 0.669, top1 = 77.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3819/15625) 003819-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.58%], valid : [loss = 0.581, top1 = 87.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10        train : [loss = 0.032, top1 = 99.04%], test  : [loss = 0.355, top1 = 91.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.52 ms.
cifar100       train : [loss = 0.363, top1 = 89.74%], valid : [loss = 1.301, top1 = 66.86%], test : [loss = 1.355, top1 = 66.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.73 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.35%], valid : [loss = 2.458, top1 = 37.80%], test : [loss = 2.454, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.52%], valid : [loss = 0.838, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3820/15625) 003820-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.459, top1 = 89.51%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.304, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.59 ms.
cifar100       train : [loss = 0.121, top1 = 97.73%], valid : [loss = 1.283, top1 = 69.34%], test : [loss = 1.278, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.27 ms.
ImageNet16-120 train : [loss = 1.734, top1 = 53.81%], valid : [loss = 2.262, top1 = 42.47%], test : [loss = 2.250, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.447, top1 = 84.54%], valid : [loss = 0.543, top1 = 81.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3821/15625) 003821-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.550, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.339, top1 = 92.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.73 ms.
cifar100       train : [loss = 0.279, top1 = 92.50%], valid : [loss = 1.318, top1 = 67.88%], test : [loss = 1.385, top1 = 66.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.15%], valid : [loss = 2.331, top1 = 40.33%], test : [loss = 2.396, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 69.21%], valid : [loss = 0.899, top1 = 68.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3822/15625) 003822-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.28%], valid : [loss = 0.922, top1 = 80.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.067, top1 = 97.86%], test  : [loss = 0.566, top1 = 86.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.473, top1 = 86.69%], valid : [loss = 1.861, top1 = 57.44%], test : [loss = 1.805, top1 = 58.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 2.783, top1 = 31.38%], valid : [loss = 3.087, top1 = 26.00%], test : [loss = 3.104, top1 = 25.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.58%], valid : [loss = 1.065, top1 = 62.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3823/15625) 003823-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.500, top1 = 89.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.326, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.37 ms.
cifar100       train : [loss = 0.149, top1 = 96.85%], valid : [loss = 1.289, top1 = 69.28%], test : [loss = 1.285, top1 = 68.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.845, top1 = 51.13%], valid : [loss = 2.279, top1 = 42.70%], test : [loss = 2.283, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3824/15625) 003824-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.03%], valid : [loss = 0.528, top1 = 87.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10        train : [loss = 0.076, top1 = 97.60%], test  : [loss = 0.376, top1 = 89.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 0.723, top1 = 78.72%], valid : [loss = 1.354, top1 = 64.01%], test : [loss = 1.341, top1 = 64.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.18%], valid : [loss = 2.644, top1 = 33.78%], test : [loss = 2.679, top1 = 33.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3825/15625) 003825-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.446, top1 = 89.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.311, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.74 ms.
cifar100       train : [loss = 0.211, top1 = 94.80%], valid : [loss = 1.283, top1 = 68.71%], test : [loss = 1.330, top1 = 68.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.36%], valid : [loss = 2.288, top1 = 42.13%], test : [loss = 2.315, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.76%], valid : [loss = 0.544, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3826/15625) 003826-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.584, top1 = 87.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.383, top1 = 91.40%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.28 ms.
cifar100       train : [loss = 0.395, top1 = 88.70%], valid : [loss = 1.428, top1 = 65.14%], test : [loss = 1.371, top1 = 65.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.10%], valid : [loss = 2.526, top1 = 37.00%], test : [loss = 2.563, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.51%], valid : [loss = 0.846, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3827/15625) 003827-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.634, top1 = 86.51%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.69 ms.
cifar10        train : [loss = 0.018, top1 = 99.64%], test  : [loss = 0.441, top1 = 89.48%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=15.29 ms.
cifar100       train : [loss = 0.224, top1 = 95.02%], valid : [loss = 1.446, top1 = 66.14%], test : [loss = 1.434, top1 = 65.82%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 44.06%], valid : [loss = 2.606, top1 = 34.23%], test : [loss = 2.612, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.58%], valid : [loss = 0.786, top1 = 72.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3828/15625) 003828-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.47%], valid : [loss = 0.604, top1 = 84.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10        train : [loss = 0.108, top1 = 96.37%], test  : [loss = 0.423, top1 = 88.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 0.713, top1 = 79.04%], valid : [loss = 1.536, top1 = 59.56%], test : [loss = 1.558, top1 = 60.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 3.181, top1 = 22.44%], valid : [loss = 3.201, top1 = 21.87%], test : [loss = 3.213, top1 = 21.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3829/15625) 003829-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.491, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.312, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.20 ms.
cifar100       train : [loss = 0.328, top1 = 91.11%], valid : [loss = 1.239, top1 = 67.47%], test : [loss = 1.250, top1 = 68.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.65%], valid : [loss = 2.315, top1 = 40.57%], test : [loss = 2.340, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3830/15625) 003830-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.491, top1 = 89.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.07 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.300, top1 = 93.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.38 ms.
cifar100       train : [loss = 0.149, top1 = 97.02%], valid : [loss = 1.228, top1 = 69.86%], test : [loss = 1.229, top1 = 70.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.93 ms.
ImageNet16-120 train : [loss = 1.753, top1 = 53.31%], valid : [loss = 2.185, top1 = 42.73%], test : [loss = 2.213, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.00%], valid : [loss = 0.611, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3831/15625) 003831-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.58%], valid : [loss = 0.866, top1 = 71.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10        train : [loss = 0.561, top1 = 80.52%], test  : [loss = 0.710, top1 = 75.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.47 ms.
cifar100       train : [loss = 1.783, top1 = 51.88%], valid : [loss = 2.048, top1 = 47.78%], test : [loss = 2.065, top1 = 46.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.63%], valid : [loss = 3.655, top1 = 16.70%], test : [loss = 3.679, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3832/15625) 003832-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.519, top1 = 89.30%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.39 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.323, top1 = 93.07%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.21 ms.
cifar100       train : [loss = 0.232, top1 = 93.94%], valid : [loss = 1.264, top1 = 68.82%], test : [loss = 1.256, top1 = 69.16%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.79%], valid : [loss = 2.213, top1 = 43.17%], test : [loss = 2.223, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.40%], valid : [loss = 0.730, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3833/15625) 003833-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.528, top1 = 88.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.342, top1 = 92.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.22 ms.
cifar100       train : [loss = 0.347, top1 = 90.47%], valid : [loss = 1.281, top1 = 66.72%], test : [loss = 1.270, top1 = 67.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.42%], valid : [loss = 2.442, top1 = 37.63%], test : [loss = 2.418, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3834/15625) 003834-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.317, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.19 ms.
cifar100       train : [loss = 0.327, top1 = 91.12%], valid : [loss = 1.290, top1 = 67.25%], test : [loss = 1.296, top1 = 67.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.21%], valid : [loss = 2.365, top1 = 40.11%], test : [loss = 2.398, top1 = 39.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.69%], valid : [loss = 0.563, top1 = 80.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3835/15625) 003835-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.593, top1 = 87.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.379, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.65 ms.
cifar100       train : [loss = 0.161, top1 = 96.48%], valid : [loss = 1.499, top1 = 66.21%], test : [loss = 1.524, top1 = 65.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 47.02%], valid : [loss = 2.445, top1 = 38.56%], test : [loss = 2.454, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.57%], valid : [loss = 0.718, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3836/15625) 003836-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.522, top1 = 88.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.322, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.15 ms.
cifar100       train : [loss = 0.352, top1 = 90.50%], valid : [loss = 1.308, top1 = 65.96%], test : [loss = 1.288, top1 = 67.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.78%], valid : [loss = 2.421, top1 = 38.70%], test : [loss = 2.403, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3837/15625) 003837-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.39%], valid : [loss = 0.863, top1 = 70.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.97 ms.
cifar10        train : [loss = 0.661, top1 = 76.92%], test  : [loss = 0.751, top1 = 73.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.85 ms.
cifar100       train : [loss = 2.019, top1 = 46.61%], valid : [loss = 2.169, top1 = 43.92%], test : [loss = 2.191, top1 = 43.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 3.658, top1 = 15.52%], valid : [loss = 3.661, top1 = 16.67%], test : [loss = 3.694, top1 = 14.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.417, top1 = 48.42%], valid : [loss = 1.432, top1 = 47.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3838/15625) 003838-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.629, top1 = 86.38%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.72 ms.
cifar10        train : [loss = 0.027, top1 = 99.32%], test  : [loss = 0.420, top1 = 89.75%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.22 ms.
cifar100       train : [loss = 0.376, top1 = 90.06%], valid : [loss = 1.461, top1 = 64.14%], test : [loss = 1.389, top1 = 65.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 40.99%], valid : [loss = 2.597, top1 = 35.53%], test : [loss = 2.647, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.74%], valid : [loss = 0.772, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3839/15625) 003839-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.21%], valid : [loss = 0.661, top1 = 77.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10        train : [loss = 0.522, top1 = 81.93%], test  : [loss = 0.592, top1 = 79.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.59 ms.
cifar100       train : [loss = 1.679, top1 = 54.59%], valid : [loss = 1.856, top1 = 50.42%], test : [loss = 1.854, top1 = 51.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.34%], valid : [loss = 3.312, top1 = 21.20%], test : [loss = 3.352, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3840/15625) 003840-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.09 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.22 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3841/15625) 003841-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.41%], valid : [loss = 0.585, top1 = 84.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.186, top1 = 93.74%], test  : [loss = 0.377, top1 = 88.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.53 ms.
cifar100       train : [loss = 0.986, top1 = 71.69%], valid : [loss = 1.378, top1 = 61.94%], test : [loss = 1.321, top1 = 63.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 34.19%], valid : [loss = 2.681, top1 = 33.33%], test : [loss = 2.739, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.77%], valid : [loss = 1.012, top1 = 64.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3842/15625) 003842-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.28%], valid : [loss = 0.517, top1 = 85.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10        train : [loss = 0.158, top1 = 94.73%], test  : [loss = 0.373, top1 = 88.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.83 ms.
cifar100       train : [loss = 0.870, top1 = 74.76%], valid : [loss = 1.338, top1 = 63.36%], test : [loss = 1.334, top1 = 63.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.52%], valid : [loss = 2.622, top1 = 34.87%], test : [loss = 2.688, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.99%], valid : [loss = 0.908, top1 = 67.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3843/15625) 003843-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.266, top1 = 90.72%], valid : [loss = 0.553, top1 = 82.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.240, top1 = 91.89%], test  : [loss = 0.392, top1 = 86.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.48 ms.
cifar100       train : [loss = 1.360, top1 = 61.90%], valid : [loss = 1.664, top1 = 55.08%], test : [loss = 1.626, top1 = 56.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.842, top1 = 29.95%], valid : [loss = 2.840, top1 = 30.90%], test : [loss = 2.878, top1 = 29.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.32%], valid : [loss = 1.033, top1 = 63.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3844/15625) 003844-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.537, top1 = 88.69%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.08 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.334, top1 = 92.00%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.93 ms.
cifar100       train : [loss = 0.186, top1 = 95.54%], valid : [loss = 1.320, top1 = 68.54%], test : [loss = 1.309, top1 = 68.48%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.24%], valid : [loss = 2.291, top1 = 40.87%], test : [loss = 2.287, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.16%], valid : [loss = 0.799, top1 = 72.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3845/15625) 003845-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.70%], valid : [loss = 0.617, top1 = 86.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.28 ms.
cifar10        train : [loss = 0.035, top1 = 98.97%], test  : [loss = 0.398, top1 = 89.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.57 ms.
cifar100       train : [loss = 0.510, top1 = 85.09%], valid : [loss = 1.418, top1 = 64.48%], test : [loss = 1.397, top1 = 64.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.37 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.45%], valid : [loss = 2.552, top1 = 36.20%], test : [loss = 2.595, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.59%], valid : [loss = 0.832, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3846/15625) 003846-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.08%], valid : [loss = 0.718, top1 = 82.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10        train : [loss = 0.085, top1 = 97.23%], test  : [loss = 0.482, top1 = 87.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.496, top1 = 85.78%], valid : [loss = 1.640, top1 = 60.04%], test : [loss = 1.737, top1 = 59.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 3.160, top1 = 23.08%], valid : [loss = 3.198, top1 = 22.70%], test : [loss = 3.220, top1 = 22.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.171, top1 = 57.42%], valid : [loss = 1.195, top1 = 56.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3847/15625) 003847-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.338, top1 = 91.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.71 ms.
cifar100       train : [loss = 0.339, top1 = 90.61%], valid : [loss = 1.297, top1 = 66.84%], test : [loss = 1.295, top1 = 66.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.27%], valid : [loss = 2.407, top1 = 38.90%], test : [loss = 2.428, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3848/15625) 003848-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.44%], valid : [loss = 0.722, top1 = 76.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.437, top1 = 84.72%], test  : [loss = 0.572, top1 = 80.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.63 ms.
cifar100       train : [loss = 1.819, top1 = 50.50%], valid : [loss = 2.016, top1 = 46.76%], test : [loss = 2.001, top1 = 46.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 3.447, top1 = 18.75%], valid : [loss = 3.443, top1 = 19.09%], test : [loss = 3.470, top1 = 17.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.235, top1 = 55.19%], valid : [loss = 1.277, top1 = 53.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3849/15625) 003849-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.02 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.505, top1 = 89.77%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.09 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.294, top1 = 93.56%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.75 ms.
cifar100       train : [loss = 0.067, top1 = 98.83%], valid : [loss = 1.411, top1 = 69.62%], test : [loss = 1.366, top1 = 70.04%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 47.99%], valid : [loss = 2.302, top1 = 40.57%], test : [loss = 2.297, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.70%], valid : [loss = 0.846, top1 = 70.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3850/15625) 003850-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.612, top1 = 85.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10        train : [loss = 0.078, top1 = 97.59%], test  : [loss = 0.394, top1 = 88.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.714, top1 = 79.34%], valid : [loss = 1.385, top1 = 63.12%], test : [loss = 1.353, top1 = 63.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.66%], valid : [loss = 2.662, top1 = 34.03%], test : [loss = 2.718, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3851/15625) 003851-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.550, top1 = 88.78%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.360, top1 = 92.26%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.79 ms.
cifar100       train : [loss = 0.067, top1 = 99.18%], valid : [loss = 1.347, top1 = 68.98%], test : [loss = 1.374, top1 = 68.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 1.723, top1 = 54.01%], valid : [loss = 2.412, top1 = 40.90%], test : [loss = 2.424, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 80.94%], valid : [loss = 0.660, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3852/15625) 003852-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.448, top1 = 89.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.24 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.323, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.38 ms.
cifar100       train : [loss = 0.314, top1 = 91.59%], valid : [loss = 1.276, top1 = 67.38%], test : [loss = 1.315, top1 = 67.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.22%], valid : [loss = 2.369, top1 = 39.59%], test : [loss = 2.399, top1 = 40.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.26%], valid : [loss = 0.547, top1 = 81.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3853/15625) 003853-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.600, top1 = 87.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.385, top1 = 91.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.57 ms.
cifar100       train : [loss = 0.143, top1 = 97.18%], valid : [loss = 1.522, top1 = 66.40%], test : [loss = 1.490, top1 = 66.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.68%], valid : [loss = 2.456, top1 = 38.73%], test : [loss = 2.492, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.40%], valid : [loss = 0.726, top1 = 74.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3854/15625) 003854-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3855/15625) 003855-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.484, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.307, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.316, top1 = 91.56%], valid : [loss = 1.255, top1 = 67.33%], test : [loss = 1.270, top1 = 67.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.82%], valid : [loss = 2.309, top1 = 40.79%], test : [loss = 2.328, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.64%], valid : [loss = 0.642, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3856/15625) 003856-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.534, top1 = 88.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.349, top1 = 91.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.300, top1 = 91.91%], valid : [loss = 1.267, top1 = 67.64%], test : [loss = 1.290, top1 = 67.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.81%], valid : [loss = 2.446, top1 = 39.07%], test : [loss = 2.430, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.859, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3857/15625) 003857-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.343, top1 = 91.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.51 ms.
cifar100       train : [loss = 0.334, top1 = 90.86%], valid : [loss = 1.290, top1 = 67.11%], test : [loss = 1.295, top1 = 67.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.57%], valid : [loss = 2.397, top1 = 38.43%], test : [loss = 2.398, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.658, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3858/15625) 003858-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.446, top1 = 90.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.302, top1 = 93.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.75 ms.
cifar100       train : [loss = 0.082, top1 = 98.60%], valid : [loss = 1.367, top1 = 69.46%], test : [loss = 1.369, top1 = 69.61%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 1.582, top1 = 57.47%], valid : [loss = 2.272, top1 = 43.47%], test : [loss = 2.293, top1 = 43.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.59%], valid : [loss = 0.505, top1 = 82.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3859/15625) 003859-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.451, top1 = 89.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10        train : [loss = 0.014, top1 = 99.80%], test  : [loss = 0.315, top1 = 91.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 0.326, top1 = 91.35%], valid : [loss = 1.308, top1 = 67.36%], test : [loss = 1.308, top1 = 67.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.31%], valid : [loss = 2.371, top1 = 40.43%], test : [loss = 2.394, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.83%], valid : [loss = 0.564, top1 = 81.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3860/15625) 003860-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.444, top1 = 89.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.304, top1 = 92.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.19 ms.
cifar100       train : [loss = 0.196, top1 = 95.59%], valid : [loss = 1.255, top1 = 69.74%], test : [loss = 1.237, top1 = 69.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.46 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.45%], valid : [loss = 2.252, top1 = 42.77%], test : [loss = 2.287, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.25%], valid : [loss = 0.536, top1 = 81.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3861/15625) 003861-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.52%], valid : [loss = 0.641, top1 = 85.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.399, top1 = 90.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.576, top1 = 83.07%], valid : [loss = 1.446, top1 = 63.04%], test : [loss = 1.500, top1 = 61.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.410, top1 = 38.54%], valid : [loss = 2.577, top1 = 34.77%], test : [loss = 2.613, top1 = 34.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.18%], valid : [loss = 0.870, top1 = 69.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3862/15625) 003862-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.600, top1 = 87.87%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.30 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.411, top1 = 91.41%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.77 ms.
cifar100       train : [loss = 0.134, top1 = 97.21%], valid : [loss = 1.562, top1 = 66.04%], test : [loss = 1.562, top1 = 65.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.66 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.77%], valid : [loss = 2.406, top1 = 39.00%], test : [loss = 2.420, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.59%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3863/15625) 003863-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.58%], valid : [loss = 0.776, top1 = 74.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.467, top1 = 83.74%], test  : [loss = 0.593, top1 = 80.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.17 ms.
cifar100       train : [loss = 1.723, top1 = 52.96%], valid : [loss = 1.972, top1 = 47.90%], test : [loss = 1.952, top1 = 48.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.414, top1 = 19.46%], valid : [loss = 3.434, top1 = 19.07%], test : [loss = 3.436, top1 = 19.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.229, top1 = 55.74%], valid : [loss = 1.281, top1 = 54.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3864/15625) 003864-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.547, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.337, top1 = 92.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.140, top1 = 96.87%], valid : [loss = 1.326, top1 = 69.40%], test : [loss = 1.319, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.82%], valid : [loss = 2.411, top1 = 38.97%], test : [loss = 2.444, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.86%], valid : [loss = 0.917, top1 = 67.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3865/15625) 003865-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.620, top1 = 85.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.415, top1 = 89.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.512, top1 = 85.05%], valid : [loss = 1.451, top1 = 64.04%], test : [loss = 1.365, top1 = 64.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 39.06%], valid : [loss = 2.570, top1 = 35.50%], test : [loss = 2.598, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.80%], valid : [loss = 0.833, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3866/15625) 003866-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10-valid  train : [loss = 0.307, top1 = 89.51%], valid : [loss = 0.558, top1 = 81.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.296, top1 = 90.03%], test  : [loss = 0.429, top1 = 85.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.03 ms.
cifar100       train : [loss = 1.322, top1 = 62.66%], valid : [loss = 1.597, top1 = 56.66%], test : [loss = 1.613, top1 = 56.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 3.066, top1 = 25.92%], valid : [loss = 3.076, top1 = 25.07%], test : [loss = 3.144, top1 = 25.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.18%], valid : [loss = 1.248, top1 = 54.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3867/15625) 003867-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.90%], valid : [loss = 0.851, top1 = 71.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10        train : [loss = 0.574, top1 = 79.97%], test  : [loss = 0.713, top1 = 75.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.81 ms.
cifar100       train : [loss = 1.773, top1 = 52.25%], valid : [loss = 2.043, top1 = 46.96%], test : [loss = 2.074, top1 = 46.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.77%], valid : [loss = 3.634, top1 = 17.17%], test : [loss = 3.666, top1 = 15.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3868/15625) 003868-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.57%], valid : [loss = 0.545, top1 = 88.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.78 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.383, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 0.369, top1 = 89.35%], valid : [loss = 1.312, top1 = 66.46%], test : [loss = 1.318, top1 = 67.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.22%], valid : [loss = 2.495, top1 = 36.93%], test : [loss = 2.497, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.12%], valid : [loss = 0.868, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3869/15625) 003869-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.558, top1 = 88.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.379, top1 = 91.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.249, top1 = 93.27%], valid : [loss = 1.344, top1 = 67.92%], test : [loss = 1.326, top1 = 68.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.48%], valid : [loss = 2.383, top1 = 39.53%], test : [loss = 2.391, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 67.74%], valid : [loss = 0.921, top1 = 67.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3870/15625) 003870-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.64%], valid : [loss = 0.876, top1 = 70.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 0.569, top1 = 79.96%], test  : [loss = 0.716, top1 = 75.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.68 ms.
cifar100       train : [loss = 1.791, top1 = 52.17%], valid : [loss = 2.085, top1 = 46.38%], test : [loss = 2.071, top1 = 46.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.85%], valid : [loss = 3.625, top1 = 16.73%], test : [loss = 3.647, top1 = 15.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3871/15625) 003871-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.541, top1 = 88.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.90 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.347, top1 = 92.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.43 ms.
cifar100       train : [loss = 0.293, top1 = 92.11%], valid : [loss = 1.300, top1 = 67.28%], test : [loss = 1.315, top1 = 66.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 43.85%], valid : [loss = 2.431, top1 = 38.50%], test : [loss = 2.425, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 71.03%], valid : [loss = 0.870, top1 = 69.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3872/15625) 003872-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.525, top1 = 88.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.339, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 0.295, top1 = 92.03%], valid : [loss = 1.278, top1 = 67.27%], test : [loss = 1.308, top1 = 67.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.89%], valid : [loss = 2.397, top1 = 39.30%], test : [loss = 2.402, top1 = 39.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.29%], valid : [loss = 0.809, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3873/15625) 003873-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.313, top1 = 89.16%], valid : [loss = 0.562, top1 = 82.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.291, top1 = 90.02%], test  : [loss = 0.433, top1 = 85.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 1.470, top1 = 58.97%], valid : [loss = 1.705, top1 = 53.99%], test : [loss = 1.694, top1 = 53.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 3.002, top1 = 26.81%], valid : [loss = 2.999, top1 = 27.11%], test : [loss = 3.051, top1 = 26.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.10%], valid : [loss = 0.992, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3874/15625) 003874-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.127, top1 = 95.93%], valid : [loss = 0.469, top1 = 85.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10        train : [loss = 0.153, top1 = 95.02%], test  : [loss = 0.356, top1 = 88.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.40 ms.
cifar100       train : [loss = 1.008, top1 = 71.41%], valid : [loss = 1.354, top1 = 62.48%], test : [loss = 1.359, top1 = 61.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.91%], valid : [loss = 2.659, top1 = 33.00%], test : [loss = 2.717, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3875/15625) 003875-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.449, top1 = 89.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.309, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 0.331, top1 = 90.87%], valid : [loss = 1.313, top1 = 67.00%], test : [loss = 1.326, top1 = 66.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.36%], valid : [loss = 2.373, top1 = 39.57%], test : [loss = 2.399, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 84.28%], valid : [loss = 0.561, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3876/15625) 003876-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.496, top1 = 89.02%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.313, top1 = 92.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.54 ms.
cifar100       train : [loss = 0.321, top1 = 91.45%], valid : [loss = 1.253, top1 = 67.12%], test : [loss = 1.215, top1 = 68.10%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.48%], valid : [loss = 2.242, top1 = 42.13%], test : [loss = 2.244, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.62%], valid : [loss = 0.733, top1 = 74.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3877/15625) 003877-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.538, top1 = 89.56%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.66 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.361, top1 = 92.45%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.21 ms.
cifar100       train : [loss = 0.050, top1 = 99.50%], valid : [loss = 1.440, top1 = 68.88%], test : [loss = 1.443, top1 = 69.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 1.713, top1 = 54.26%], valid : [loss = 2.399, top1 = 40.20%], test : [loss = 2.408, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.36%], valid : [loss = 0.694, top1 = 76.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3878/15625) 003878-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.38%], valid : [loss = 0.847, top1 = 71.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.569, top1 = 79.94%], test  : [loss = 0.724, top1 = 75.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.52 ms.
cifar100       train : [loss = 1.769, top1 = 52.20%], valid : [loss = 2.023, top1 = 48.50%], test : [loss = 2.037, top1 = 46.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.93%], valid : [loss = 3.634, top1 = 15.63%], test : [loss = 3.672, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3879/15625) 003879-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.615, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.410, top1 = 90.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 0.243, top1 = 94.02%], valid : [loss = 1.485, top1 = 65.36%], test : [loss = 1.457, top1 = 65.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.39%], valid : [loss = 2.513, top1 = 37.20%], test : [loss = 2.518, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.10%], valid : [loss = 0.751, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3880/15625) 003880-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.344, top1 = 88.18%], valid : [loss = 0.617, top1 = 80.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10        train : [loss = 0.292, top1 = 89.98%], test  : [loss = 0.446, top1 = 85.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.59 ms.
cifar100       train : [loss = 1.538, top1 = 57.00%], valid : [loss = 1.765, top1 = 52.49%], test : [loss = 1.771, top1 = 51.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 27.76%], valid : [loss = 2.953, top1 = 28.27%], test : [loss = 2.989, top1 = 26.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.73%], valid : [loss = 1.062, top1 = 62.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3881/15625) 003881-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.524, top1 = 88.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.328, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.63 ms.
cifar100       train : [loss = 0.327, top1 = 91.03%], valid : [loss = 1.292, top1 = 66.70%], test : [loss = 1.299, top1 = 66.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.21%], valid : [loss = 2.429, top1 = 39.33%], test : [loss = 2.413, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.68%], valid : [loss = 0.746, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3882/15625) 003882-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.500, top1 = 89.80%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.315, top1 = 93.13%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=17.10 ms.
cifar100       train : [loss = 0.127, top1 = 97.52%], valid : [loss = 1.277, top1 = 69.32%], test : [loss = 1.268, top1 = 70.02%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.28 ms.
ImageNet16-120 train : [loss = 1.813, top1 = 52.02%], valid : [loss = 2.253, top1 = 43.17%], test : [loss = 2.275, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 78.01%], valid : [loss = 0.690, top1 = 76.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3883/15625) 003883-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.480, top1 = 89.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.299, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.00 ms.
cifar100       train : [loss = 0.331, top1 = 91.19%], valid : [loss = 1.257, top1 = 67.70%], test : [loss = 1.270, top1 = 66.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.09%], valid : [loss = 2.200, top1 = 42.73%], test : [loss = 2.244, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.629, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3884/15625) 003884-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.543, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.341, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 0.298, top1 = 91.88%], valid : [loss = 1.295, top1 = 67.15%], test : [loss = 1.307, top1 = 67.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.165, top1 = 43.74%], valid : [loss = 2.421, top1 = 38.36%], test : [loss = 2.443, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3885/15625) 003885-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.19%], valid : [loss = 0.472, top1 = 84.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10        train : [loss = 0.302, top1 = 89.77%], test  : [loss = 0.396, top1 = 86.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 1.335, top1 = 63.04%], valid : [loss = 1.551, top1 = 57.26%], test : [loss = 1.498, top1 = 58.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.14 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 28.34%], valid : [loss = 2.915, top1 = 29.53%], test : [loss = 2.959, top1 = 28.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3886/15625) 003886-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.566, top1 = 87.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.373, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.98 ms.
cifar100       train : [loss = 0.394, top1 = 88.82%], valid : [loss = 1.392, top1 = 65.67%], test : [loss = 1.392, top1 = 65.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.266, top1 = 41.65%], valid : [loss = 2.476, top1 = 37.63%], test : [loss = 2.530, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.756, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3887/15625) 003887-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.60%], valid : [loss = 0.447, top1 = 87.74%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.14 ms.
cifar10        train : [loss = 0.052, top1 = 98.74%], test  : [loss = 0.319, top1 = 90.64%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.25 ms.
cifar100       train : [loss = 0.590, top1 = 83.61%], valid : [loss = 1.245, top1 = 66.02%], test : [loss = 1.220, top1 = 66.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.86%], valid : [loss = 2.466, top1 = 37.43%], test : [loss = 2.491, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.47%], valid : [loss = 0.632, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3888/15625) 003888-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.389, top1 = 91.42%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.260, top1 = 93.81%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.33 ms.
cifar100       train : [loss = 0.039, top1 = 99.65%], valid : [loss = 1.237, top1 = 72.40%], test : [loss = 1.198, top1 = 73.26%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.48 ms.
ImageNet16-120 train : [loss = 1.315, top1 = 63.87%], valid : [loss = 2.170, top1 = 46.50%], test : [loss = 2.166, top1 = 46.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.362, top1 = 87.78%], valid : [loss = 0.505, top1 = 83.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3889/15625) 003889-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.464, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.320, top1 = 91.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.95 ms.
cifar100       train : [loss = 0.329, top1 = 91.08%], valid : [loss = 1.294, top1 = 67.27%], test : [loss = 1.302, top1 = 67.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.17%], valid : [loss = 2.364, top1 = 40.48%], test : [loss = 2.419, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3890/15625) 003890-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.75%], valid : [loss = 0.629, top1 = 86.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10        train : [loss = 0.041, top1 = 98.91%], test  : [loss = 0.401, top1 = 89.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 0.437, top1 = 87.99%], valid : [loss = 1.365, top1 = 65.88%], test : [loss = 1.365, top1 = 65.62%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.99%], valid : [loss = 2.580, top1 = 34.83%], test : [loss = 2.605, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.11%], valid : [loss = 0.751, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3891/15625) 003891-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.654, top1 = 86.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.460, top1 = 90.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.39 ms.
cifar100       train : [loss = 0.253, top1 = 93.54%], valid : [loss = 1.574, top1 = 63.90%], test : [loss = 1.595, top1 = 64.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 40.19%], valid : [loss = 2.734, top1 = 32.93%], test : [loss = 2.733, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.09%], valid : [loss = 0.816, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3892/15625) 003892-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.62%], valid : [loss = 0.633, top1 = 84.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10        train : [loss = 0.090, top1 = 97.01%], test  : [loss = 0.367, top1 = 88.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.00 ms.
cifar100       train : [loss = 0.792, top1 = 76.98%], valid : [loss = 1.415, top1 = 61.92%], test : [loss = 1.437, top1 = 61.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.73%], valid : [loss = 2.740, top1 = 32.43%], test : [loss = 2.757, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.42%], valid : [loss = 0.842, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3893/15625) 003893-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.187, top1 = 93.86%], valid : [loss = 0.553, top1 = 83.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10        train : [loss = 0.196, top1 = 93.42%], test  : [loss = 0.398, top1 = 87.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 1.223, top1 = 65.15%], valid : [loss = 1.555, top1 = 57.37%], test : [loss = 1.540, top1 = 57.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.89%], valid : [loss = 2.723, top1 = 32.12%], test : [loss = 2.758, top1 = 31.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.30%], valid : [loss = 0.987, top1 = 65.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3894/15625) 003894-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.72 ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.49%], valid : [loss = 0.525, top1 = 82.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.15 ms.
cifar10        train : [loss = 0.400, top1 = 86.36%], test  : [loss = 0.465, top1 = 84.16%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.22 ms.
cifar100       train : [loss = 1.550, top1 = 57.34%], valid : [loss = 1.669, top1 = 54.57%], test : [loss = 1.657, top1 = 54.64%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.14 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.46%], valid : [loss = 3.002, top1 = 27.17%], test : [loss = 3.047, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3895/15625) 003895-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.552, top1 = 88.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.335, top1 = 91.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.51 ms.
cifar100       train : [loss = 0.313, top1 = 91.63%], valid : [loss = 1.296, top1 = 66.66%], test : [loss = 1.300, top1 = 67.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.65%], valid : [loss = 2.358, top1 = 39.78%], test : [loss = 2.376, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.63%], valid : [loss = 0.871, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3896/15625) 003896-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.513, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 0.018, top1 = 99.61%], test  : [loss = 0.360, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.380, top1 = 89.06%], valid : [loss = 1.312, top1 = 66.90%], test : [loss = 1.330, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.84%], valid : [loss = 2.431, top1 = 38.37%], test : [loss = 2.449, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.83%], valid : [loss = 0.652, top1 = 77.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3897/15625) 003897-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.47%], valid : [loss = 0.643, top1 = 78.52%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 0.501, top1 = 82.66%], test  : [loss = 0.573, top1 = 80.79%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.71 ms.
cifar100       train : [loss = 1.703, top1 = 54.04%], valid : [loss = 1.866, top1 = 51.16%], test : [loss = 1.882, top1 = 50.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 3.317, top1 = 21.44%], valid : [loss = 3.301, top1 = 21.20%], test : [loss = 3.333, top1 = 21.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3898/15625) 003898-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.503, top1 = 88.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.330, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 0.338, top1 = 90.78%], valid : [loss = 1.263, top1 = 67.21%], test : [loss = 1.256, top1 = 67.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.95%], valid : [loss = 2.395, top1 = 39.16%], test : [loss = 2.390, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3899/15625) 003899-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.640 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.79%]
cifar10        FLOP= 90.36 M, Params=0.640 MB, latency=17.60 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.340, top1 = 91.91%]
cifar100       FLOP= 90.36 M, Params=0.646 MB, latency=17.25 ms.
cifar100       train : [loss = 0.325, top1 = 91.18%], valid : [loss = 1.295, top1 = 66.80%], test : [loss = 1.296, top1 = 67.11%]
ImageNet16-120 FLOP= 22.60 M, Params=0.648 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.02%], valid : [loss = 2.407, top1 = 38.78%], test : [loss = 2.412, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3900/15625) 003900-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.447, top1 = 89.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.314, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.21 ms.
cifar100       train : [loss = 0.320, top1 = 91.40%], valid : [loss = 1.308, top1 = 67.51%], test : [loss = 1.298, top1 = 67.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.49%], valid : [loss = 2.369, top1 = 39.03%], test : [loss = 2.392, top1 = 40.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.34%], valid : [loss = 0.572, top1 = 80.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3901/15625) 003901-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.59 ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.12%], valid : [loss = 0.787, top1 = 73.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10        train : [loss = 0.529, top1 = 81.65%], test  : [loss = 0.608, top1 = 79.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.04 ms.
cifar100       train : [loss = 1.985, top1 = 46.32%], valid : [loss = 2.119, top1 = 43.95%], test : [loss = 2.125, top1 = 43.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 2.984, top1 = 26.90%], valid : [loss = 2.978, top1 = 27.17%], test : [loss = 2.991, top1 = 26.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.48%], valid : [loss = 1.186, top1 = 57.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3902/15625) 003902-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.454, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.77 ms.
cifar100       train : [loss = 0.325, top1 = 91.16%], valid : [loss = 1.305, top1 = 67.43%], test : [loss = 1.289, top1 = 67.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.31%], valid : [loss = 2.364, top1 = 39.68%], test : [loss = 2.374, top1 = 40.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 84.09%], valid : [loss = 0.555, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3903/15625) 003903-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.545, top1 = 88.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.344, top1 = 92.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.61 ms.
cifar100       train : [loss = 0.295, top1 = 91.70%], valid : [loss = 1.337, top1 = 67.35%], test : [loss = 1.332, top1 = 67.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.13%], valid : [loss = 2.420, top1 = 38.60%], test : [loss = 2.433, top1 = 38.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.28%], valid : [loss = 0.900, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3904/15625) 003904-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.73 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.582, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.374, top1 = 91.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.403, top1 = 88.60%], valid : [loss = 1.423, top1 = 65.02%], test : [loss = 1.418, top1 = 65.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.92%], valid : [loss = 2.510, top1 = 36.83%], test : [loss = 2.542, top1 = 36.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 74.00%], valid : [loss = 0.812, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3905/15625) 003905-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.06%], valid : [loss = 0.567, top1 = 86.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.065, top1 = 97.90%], test  : [loss = 0.375, top1 = 89.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.69 ms.
cifar100       train : [loss = 0.658, top1 = 80.55%], valid : [loss = 1.308, top1 = 65.14%], test : [loss = 1.297, top1 = 65.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.14%], valid : [loss = 2.459, top1 = 37.82%], test : [loss = 2.511, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3906/15625) 003906-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.57%], valid : [loss = 0.544, top1 = 84.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10        train : [loss = 0.126, top1 = 95.87%], test  : [loss = 0.372, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.898, top1 = 73.93%], valid : [loss = 1.423, top1 = 61.38%], test : [loss = 1.421, top1 = 61.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.728, top1 = 31.89%], valid : [loss = 2.777, top1 = 31.24%], test : [loss = 2.807, top1 = 30.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.32%], valid : [loss = 0.939, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3907/15625) 003907-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.439, top1 = 90.92%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.66 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.291, top1 = 93.55%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.14 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.343, top1 = 70.64%], test : [loss = 1.336, top1 = 70.30%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 1.550, top1 = 58.23%], valid : [loss = 2.230, top1 = 43.91%], test : [loss = 2.298, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.362, top1 = 87.56%], valid : [loss = 0.499, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3908/15625) 003908-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.35%], valid : [loss = 0.694, top1 = 77.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.413, top1 = 85.56%], test  : [loss = 0.543, top1 = 81.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 1.671, top1 = 54.01%], valid : [loss = 1.901, top1 = 49.33%], test : [loss = 1.901, top1 = 49.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 20.91%], valid : [loss = 3.329, top1 = 21.36%], test : [loss = 3.363, top1 = 19.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.208, top1 = 56.40%], valid : [loss = 1.275, top1 = 54.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3909/15625) 003909-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.56%], valid : [loss = 0.557, top1 = 86.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.20 ms.
cifar10        train : [loss = 0.085, top1 = 97.16%], test  : [loss = 0.369, top1 = 89.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.44 ms.
cifar100       train : [loss = 0.757, top1 = 77.74%], valid : [loss = 1.325, top1 = 64.33%], test : [loss = 1.329, top1 = 64.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.462, top1 = 37.22%], valid : [loss = 2.565, top1 = 35.24%], test : [loss = 2.596, top1 = 34.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.72%], valid : [loss = 0.746, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3910/15625) 003910-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.05 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.65%], valid : [loss = 0.855, top1 = 72.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.550, top1 = 80.73%], test  : [loss = 0.709, top1 = 75.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.27 ms.
cifar100       train : [loss = 1.775, top1 = 52.07%], valid : [loss = 2.052, top1 = 47.17%], test : [loss = 2.065, top1 = 46.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.85%], valid : [loss = 3.636, top1 = 16.47%], test : [loss = 3.661, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3911/15625) 003911-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.71%], valid : [loss = 0.983, top1 = 66.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10        train : [loss = 0.771, top1 = 72.80%], test  : [loss = 0.857, top1 = 70.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.32 ms.
cifar100       train : [loss = 2.153, top1 = 43.58%], valid : [loss = 2.335, top1 = 40.87%], test : [loss = 2.354, top1 = 40.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.82 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.27%], valid : [loss = 3.766, top1 = 14.51%], test : [loss = 3.775, top1 = 13.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3912/15625) 003912-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.538, top1 = 88.86%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.356, top1 = 92.09%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.61 ms.
cifar100       train : [loss = 0.187, top1 = 95.61%], valid : [loss = 1.308, top1 = 68.27%], test : [loss = 1.313, top1 = 68.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.95%], valid : [loss = 2.262, top1 = 41.87%], test : [loss = 2.307, top1 = 41.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.50%], valid : [loss = 0.850, top1 = 69.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3913/15625) 003913-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.422, top1 = 89.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.54 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.285, top1 = 92.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.88 ms.
cifar100       train : [loss = 0.106, top1 = 98.24%], valid : [loss = 1.265, top1 = 70.21%], test : [loss = 1.281, top1 = 70.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 1.620, top1 = 56.44%], valid : [loss = 2.219, top1 = 43.58%], test : [loss = 2.228, top1 = 44.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.86%], valid : [loss = 0.509, top1 = 83.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3914/15625) 003914-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.66%], valid : [loss = 0.845, top1 = 79.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.72 ms.
cifar10        train : [loss = 0.126, top1 = 95.79%], test  : [loss = 0.528, top1 = 85.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.03 ms.
cifar100       train : [loss = 0.846, top1 = 75.47%], valid : [loss = 1.672, top1 = 57.87%], test : [loss = 1.679, top1 = 57.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 26.49%], valid : [loss = 3.179, top1 = 23.71%], test : [loss = 3.204, top1 = 23.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3915/15625) 003915-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.472, top1 = 89.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.311, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.322, top1 = 91.30%], valid : [loss = 1.241, top1 = 68.13%], test : [loss = 1.255, top1 = 67.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.71%], valid : [loss = 2.314, top1 = 40.93%], test : [loss = 2.350, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3916/15625) 003916-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.25%], valid : [loss = 0.558, top1 = 86.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.063, top1 = 97.96%], test  : [loss = 0.365, top1 = 89.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.12 ms.
cifar100       train : [loss = 0.653, top1 = 80.62%], valid : [loss = 1.317, top1 = 64.50%], test : [loss = 1.322, top1 = 64.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.07%], valid : [loss = 2.522, top1 = 36.26%], test : [loss = 2.537, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3917/15625) 003917-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.510, top1 = 89.15%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.12 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.330, top1 = 92.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.82 ms.
cifar100       train : [loss = 0.214, top1 = 94.78%], valid : [loss = 1.213, top1 = 69.39%], test : [loss = 1.217, top1 = 69.67%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.90 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.74%], valid : [loss = 2.203, top1 = 43.57%], test : [loss = 2.208, top1 = 43.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.94%], valid : [loss = 0.698, top1 = 75.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3918/15625) 003918-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.74%], valid : [loss = 0.648, top1 = 78.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.522, top1 = 81.96%], test  : [loss = 0.595, top1 = 79.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.28 ms.
cifar100       train : [loss = 1.693, top1 = 54.15%], valid : [loss = 1.861, top1 = 50.15%], test : [loss = 1.871, top1 = 50.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.21%], valid : [loss = 3.319, top1 = 21.33%], test : [loss = 3.356, top1 = 20.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3919/15625) 003919-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.578, top1 = 88.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.015, top1 = 99.59%], test  : [loss = 0.380, top1 = 91.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.00 ms.
cifar100       train : [loss = 0.349, top1 = 90.29%], valid : [loss = 1.466, top1 = 63.99%], test : [loss = 1.441, top1 = 64.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.15%], valid : [loss = 2.610, top1 = 33.60%], test : [loss = 2.638, top1 = 34.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 63.13%], valid : [loss = 1.066, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3920/15625) 003920-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.447, top1 = 90.25%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.98 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.299, top1 = 92.98%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.98 ms.
cifar100       train : [loss = 0.130, top1 = 97.36%], valid : [loss = 1.301, top1 = 70.29%], test : [loss = 1.299, top1 = 69.87%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.78%], valid : [loss = 2.230, top1 = 43.96%], test : [loss = 2.244, top1 = 43.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.04%], valid : [loss = 0.614, top1 = 79.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3921/15625) 003921-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.524, top1 = 88.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.336, top1 = 91.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.46 ms.
cifar100       train : [loss = 0.335, top1 = 90.98%], valid : [loss = 1.296, top1 = 66.75%], test : [loss = 1.285, top1 = 66.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.81%], valid : [loss = 2.399, top1 = 39.10%], test : [loss = 2.435, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3922/15625) 003922-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.75%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.56 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.368, top1 = 92.41%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.44 ms.
cifar100       train : [loss = 0.100, top1 = 98.18%], valid : [loss = 1.422, top1 = 68.29%], test : [loss = 1.458, top1 = 68.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.56%], valid : [loss = 2.435, top1 = 39.06%], test : [loss = 2.453, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.32%], valid : [loss = 0.696, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3923/15625) 003923-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.562, top1 = 87.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.393, top1 = 91.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 0.394, top1 = 88.85%], valid : [loss = 1.394, top1 = 65.57%], test : [loss = 1.379, top1 = 65.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.80%], valid : [loss = 2.525, top1 = 36.38%], test : [loss = 2.541, top1 = 36.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3924/15625) 003924-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.43%], valid : [loss = 0.531, top1 = 86.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10        train : [loss = 0.095, top1 = 96.91%], test  : [loss = 0.357, top1 = 89.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.17 ms.
cifar100       train : [loss = 0.791, top1 = 76.81%], valid : [loss = 1.354, top1 = 63.30%], test : [loss = 1.358, top1 = 63.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 2.567, top1 = 35.18%], valid : [loss = 2.661, top1 = 33.68%], test : [loss = 2.700, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 78.01%], valid : [loss = 0.698, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3925/15625) 003925-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.212, top1 = 92.93%], valid : [loss = 0.490, top1 = 84.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10        train : [loss = 0.252, top1 = 91.48%], test  : [loss = 0.409, top1 = 86.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 1.325, top1 = 62.85%], valid : [loss = 1.591, top1 = 56.17%], test : [loss = 1.583, top1 = 56.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 3.026, top1 = 25.95%], valid : [loss = 3.032, top1 = 25.26%], test : [loss = 3.042, top1 = 25.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.63%], valid : [loss = 1.028, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3926/15625) 003926-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.73%], valid : [loss = 0.534, top1 = 87.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.08 ms.
cifar10        train : [loss = 0.038, top1 = 98.95%], test  : [loss = 0.365, top1 = 90.70%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.06 ms.
cifar100       train : [loss = 0.468, top1 = 86.59%], valid : [loss = 1.315, top1 = 66.11%], test : [loss = 1.300, top1 = 66.87%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.200, top1 = 43.15%], valid : [loss = 2.410, top1 = 39.23%], test : [loss = 2.471, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.88%], valid : [loss = 0.608, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3927/15625) 003927-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.288, top1 = 93.63%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.55 ms.
cifar100       train : [loss = 0.065, top1 = 99.08%], valid : [loss = 1.317, top1 = 70.37%], test : [loss = 1.344, top1 = 70.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 1.552, top1 = 58.10%], valid : [loss = 2.275, top1 = 42.81%], test : [loss = 2.277, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3928/15625) 003928-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.477, top1 = 90.41%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.304, top1 = 93.61%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.22 ms.
cifar100       train : [loss = 0.035, top1 = 99.68%], valid : [loss = 1.280, top1 = 71.16%], test : [loss = 1.298, top1 = 71.16%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.58 ms.
ImageNet16-120 train : [loss = 1.586, top1 = 57.19%], valid : [loss = 2.160, top1 = 45.17%], test : [loss = 2.166, top1 = 45.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.20%], valid : [loss = 0.622, top1 = 78.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3929/15625) 003929-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.50%], valid : [loss = 0.445, top1 = 87.70%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.48 ms.
cifar10        train : [loss = 0.061, top1 = 98.45%], test  : [loss = 0.334, top1 = 89.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.82 ms.
cifar100       train : [loss = 0.546, top1 = 85.17%], valid : [loss = 1.236, top1 = 66.37%], test : [loss = 1.225, top1 = 66.69%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.98%], valid : [loss = 2.484, top1 = 37.66%], test : [loss = 2.486, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.86%], valid : [loss = 0.683, top1 = 76.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3930/15625) 003930-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.66%], valid : [loss = 0.450, top1 = 86.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10        train : [loss = 0.152, top1 = 95.00%], test  : [loss = 0.344, top1 = 88.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.65 ms.
cifar100       train : [loss = 0.984, top1 = 72.02%], valid : [loss = 1.348, top1 = 62.11%], test : [loss = 1.337, top1 = 62.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.03%], valid : [loss = 2.675, top1 = 32.98%], test : [loss = 2.713, top1 = 31.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.787, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3931/15625) 003931-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.495, top1 = 89.39%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.48 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.304, top1 = 93.07%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.64 ms.
cifar100       train : [loss = 0.153, top1 = 96.85%], valid : [loss = 1.243, top1 = 69.94%], test : [loss = 1.235, top1 = 69.95%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.56 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.04%], valid : [loss = 2.189, top1 = 43.77%], test : [loss = 2.210, top1 = 43.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.74%], valid : [loss = 0.585, top1 = 80.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3932/15625) 003932-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.339, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.24 ms.
cifar100       train : [loss = 0.319, top1 = 91.30%], valid : [loss = 1.296, top1 = 66.91%], test : [loss = 1.280, top1 = 67.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.87%], valid : [loss = 2.408, top1 = 38.81%], test : [loss = 2.406, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.85%], valid : [loss = 0.723, top1 = 74.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3933/15625) 003933-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.524, top1 = 89.33%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.63 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.322, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.94 ms.
cifar100       train : [loss = 0.152, top1 = 96.38%], valid : [loss = 1.309, top1 = 69.19%], test : [loss = 1.301, top1 = 69.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.36%], valid : [loss = 2.205, top1 = 43.42%], test : [loss = 2.192, top1 = 43.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.06%], valid : [loss = 0.875, top1 = 68.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3934/15625) 003934-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.475, top1 = 89.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.307, top1 = 93.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.01 ms.
cifar100       train : [loss = 0.127, top1 = 97.49%], valid : [loss = 1.283, top1 = 69.41%], test : [loss = 1.309, top1 = 69.08%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.80 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.79%], valid : [loss = 2.172, top1 = 43.73%], test : [loss = 2.175, top1 = 45.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.18%], valid : [loss = 0.596, top1 = 79.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3935/15625) 003935-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.533, top1 = 88.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.393, top1 = 91.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.31 ms.
cifar100       train : [loss = 0.262, top1 = 92.71%], valid : [loss = 1.430, top1 = 66.55%], test : [loss = 1.453, top1 = 66.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.31%], valid : [loss = 2.434, top1 = 38.28%], test : [loss = 2.487, top1 = 37.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.66%], valid : [loss = 0.701, top1 = 75.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3936/15625) 003936-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.67%], valid : [loss = 0.557, top1 = 85.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.095, top1 = 97.03%], test  : [loss = 0.360, top1 = 89.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.822, top1 = 76.07%], valid : [loss = 1.392, top1 = 62.03%], test : [loss = 1.399, top1 = 62.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.71%], valid : [loss = 2.596, top1 = 35.23%], test : [loss = 2.620, top1 = 34.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.10%], valid : [loss = 0.986, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3937/15625) 003937-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.480, top1 = 89.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.321, top1 = 92.40%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.68 ms.
cifar100       train : [loss = 0.275, top1 = 92.79%], valid : [loss = 1.230, top1 = 68.32%], test : [loss = 1.219, top1 = 68.93%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.63%], valid : [loss = 2.217, top1 = 42.68%], test : [loss = 2.219, top1 = 42.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.28%], valid : [loss = 0.683, top1 = 76.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3938/15625) 003938-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.51%], valid : [loss = 0.629, top1 = 85.82%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.82 ms.
cifar10        train : [loss = 0.049, top1 = 98.54%], test  : [loss = 0.420, top1 = 89.09%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.50 ms.
cifar100       train : [loss = 0.589, top1 = 82.80%], valid : [loss = 1.418, top1 = 63.09%], test : [loss = 1.380, top1 = 64.26%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.424, top1 = 38.23%], valid : [loss = 2.570, top1 = 34.94%], test : [loss = 2.620, top1 = 34.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.26%], valid : [loss = 0.863, top1 = 69.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3939/15625) 003939-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.604, top1 = 85.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10        train : [loss = 0.071, top1 = 97.85%], test  : [loss = 0.404, top1 = 88.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.699, top1 = 79.64%], valid : [loss = 1.389, top1 = 62.97%], test : [loss = 1.348, top1 = 63.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.23%], valid : [loss = 2.642, top1 = 33.80%], test : [loss = 2.685, top1 = 33.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3940/15625) 003940-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.40%], valid : [loss = 0.675, top1 = 84.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.061, top1 = 98.14%], test  : [loss = 0.458, top1 = 87.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.665, top1 = 80.49%], valid : [loss = 1.497, top1 = 62.09%], test : [loss = 1.464, top1 = 62.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.30%], valid : [loss = 2.827, top1 = 30.60%], test : [loss = 2.840, top1 = 30.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.91%], valid : [loss = 0.881, top1 = 69.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3941/15625) 003941-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.02%], valid : [loss = 0.564, top1 = 86.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10        train : [loss = 0.060, top1 = 98.06%], test  : [loss = 0.371, top1 = 89.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.05 ms.
cifar100       train : [loss = 0.674, top1 = 80.22%], valid : [loss = 1.308, top1 = 64.76%], test : [loss = 1.313, top1 = 64.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.401, top1 = 38.67%], valid : [loss = 2.534, top1 = 36.41%], test : [loss = 2.540, top1 = 36.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3942/15625) 003942-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.27%], valid : [loss = 0.465, top1 = 86.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10        train : [loss = 0.158, top1 = 94.83%], test  : [loss = 0.342, top1 = 88.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.16 ms.
cifar100       train : [loss = 0.997, top1 = 71.59%], valid : [loss = 1.354, top1 = 62.13%], test : [loss = 1.349, top1 = 61.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.75%], valid : [loss = 2.689, top1 = 33.20%], test : [loss = 2.716, top1 = 31.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3943/15625) 003943-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.90 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.93 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3944/15625) 003944-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.50%], valid : [loss = 0.837, top1 = 80.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10        train : [loss = 0.127, top1 = 95.76%], test  : [loss = 0.537, top1 = 84.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 0.850, top1 = 75.26%], valid : [loss = 1.654, top1 = 57.67%], test : [loss = 1.663, top1 = 57.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.59 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.44%], valid : [loss = 3.170, top1 = 24.38%], test : [loss = 3.196, top1 = 23.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3945/15625) 003945-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.38%], valid : [loss = 0.463, top1 = 86.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.159, top1 = 94.83%], test  : [loss = 0.348, top1 = 88.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.08 ms.
cifar100       train : [loss = 1.010, top1 = 71.24%], valid : [loss = 1.367, top1 = 62.15%], test : [loss = 1.351, top1 = 62.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.80%], valid : [loss = 2.693, top1 = 32.98%], test : [loss = 2.712, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3946/15625) 003946-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.29%], valid : [loss = 0.620, top1 = 85.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.075, top1 = 97.69%], test  : [loss = 0.403, top1 = 88.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.13 ms.
cifar100       train : [loss = 0.717, top1 = 79.14%], valid : [loss = 1.377, top1 = 63.73%], test : [loss = 1.356, top1 = 63.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.16%], valid : [loss = 2.655, top1 = 34.13%], test : [loss = 2.676, top1 = 33.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3947/15625) 003947-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.572, top1 = 88.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.362, top1 = 92.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.155, top1 = 96.74%], valid : [loss = 1.424, top1 = 67.25%], test : [loss = 1.404, top1 = 67.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.87%], valid : [loss = 2.418, top1 = 39.51%], test : [loss = 2.414, top1 = 39.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.42%], valid : [loss = 0.658, top1 = 77.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3948/15625) 003948-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.97 ms.
cifar10-valid  train : [loss = 1.853, top1 = 32.72%], valid : [loss = 1.863, top1 = 32.59%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10        train : [loss = 1.329, top1 = 51.74%], test  : [loss = 1.328, top1 = 51.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.09 ms.
cifar100       train : [loss = 3.850, top1 = 10.94%], valid : [loss = 3.917, top1 = 9.83%], test : [loss = 3.913, top1 = 10.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.53 ms.
ImageNet16-120 train : [loss = 4.012, top1 = 10.14%], valid : [loss = 4.001, top1 = 10.29%], test : [loss = 4.006, top1 = 10.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.970, top1 = 27.12%], valid : [loss = 1.970, top1 = 27.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3949/15625) 003949-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.479, top1 = 89.60%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.306, top1 = 92.51%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.28 ms.
cifar100       train : [loss = 0.300, top1 = 91.92%], valid : [loss = 1.253, top1 = 67.66%], test : [loss = 1.247, top1 = 68.29%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.05%], valid : [loss = 2.205, top1 = 42.79%], test : [loss = 2.214, top1 = 43.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.84%], valid : [loss = 0.586, top1 = 80.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3950/15625) 003950-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.80%], valid : [loss = 0.458, top1 = 86.24%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.88 ms.
cifar10        train : [loss = 0.151, top1 = 95.13%], test  : [loss = 0.338, top1 = 89.16%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.35 ms.
cifar100       train : [loss = 0.967, top1 = 72.43%], valid : [loss = 1.343, top1 = 62.52%], test : [loss = 1.343, top1 = 62.25%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.11%], valid : [loss = 2.681, top1 = 33.04%], test : [loss = 2.704, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3951/15625) 003951-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.224, top1 = 92.48%], valid : [loss = 0.550, top1 = 83.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.226, top1 = 92.21%], test  : [loss = 0.412, top1 = 86.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.27 ms.
cifar100       train : [loss = 1.229, top1 = 65.16%], valid : [loss = 1.590, top1 = 57.01%], test : [loss = 1.573, top1 = 57.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.952, top1 = 28.03%], valid : [loss = 2.987, top1 = 27.27%], test : [loss = 3.042, top1 = 26.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.132, top1 = 59.30%], valid : [loss = 1.177, top1 = 57.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3952/15625) 003952-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.535, top1 = 88.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.332, top1 = 91.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.46 ms.
cifar100       train : [loss = 0.237, top1 = 94.02%], valid : [loss = 1.290, top1 = 68.06%], test : [loss = 1.289, top1 = 68.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 47.94%], valid : [loss = 2.301, top1 = 41.09%], test : [loss = 2.311, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 74.08%], valid : [loss = 0.799, top1 = 72.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3953/15625) 003953-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.31%], valid : [loss = 0.469, top1 = 85.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.154, top1 = 94.99%], test  : [loss = 0.343, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.25 ms.
cifar100       train : [loss = 0.988, top1 = 71.84%], valid : [loss = 1.342, top1 = 62.41%], test : [loss = 1.349, top1 = 62.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.03%], valid : [loss = 2.656, top1 = 33.12%], test : [loss = 2.706, top1 = 32.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3954/15625) 003954-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.321, top1 = 88.90%], valid : [loss = 0.570, top1 = 81.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 0.357, top1 = 87.73%], test  : [loss = 0.465, top1 = 84.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 1.384, top1 = 61.27%], valid : [loss = 1.644, top1 = 55.25%], test : [loss = 1.652, top1 = 55.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 3.117, top1 = 24.86%], valid : [loss = 3.129, top1 = 24.46%], test : [loss = 3.173, top1 = 24.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.02%], valid : [loss = 1.227, top1 = 55.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3955/15625) 003955-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.30%], valid : [loss = 0.473, top1 = 85.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10        train : [loss = 0.160, top1 = 94.81%], test  : [loss = 0.349, top1 = 88.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.72 ms.
cifar100       train : [loss = 0.998, top1 = 71.65%], valid : [loss = 1.369, top1 = 61.85%], test : [loss = 1.358, top1 = 62.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.69%], valid : [loss = 2.701, top1 = 32.24%], test : [loss = 2.709, top1 = 32.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3956/15625) 003956-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.27 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3957/15625) 003957-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.11%], valid : [loss = 0.614, top1 = 85.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.071, top1 = 97.80%], test  : [loss = 0.405, top1 = 88.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.34 ms.
cifar100       train : [loss = 0.721, top1 = 78.98%], valid : [loss = 1.394, top1 = 63.05%], test : [loss = 1.387, top1 = 63.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.25 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.81%], valid : [loss = 2.656, top1 = 33.67%], test : [loss = 2.699, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.94%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3958/15625) 003958-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.264, top1 = 90.88%], valid : [loss = 0.877, top1 = 75.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.91 ms.
cifar10        train : [loss = 0.314, top1 = 89.06%], test  : [loss = 0.649, top1 = 79.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.92 ms.
cifar100       train : [loss = 1.384, top1 = 61.12%], valid : [loss = 1.932, top1 = 49.71%], test : [loss = 1.950, top1 = 49.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 3.489, top1 = 17.55%], valid : [loss = 3.525, top1 = 17.79%], test : [loss = 3.520, top1 = 16.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.30%], valid : [loss = 1.275, top1 = 53.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3959/15625) 003959-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.29%], valid : [loss = 0.610, top1 = 85.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10        train : [loss = 0.069, top1 = 97.93%], test  : [loss = 0.410, top1 = 88.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.720, top1 = 79.11%], valid : [loss = 1.399, top1 = 62.86%], test : [loss = 1.374, top1 = 63.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.61%], valid : [loss = 2.667, top1 = 33.13%], test : [loss = 2.698, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3960/15625) 003960-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.58%], valid : [loss = 0.439, top1 = 88.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.04 ms.
cifar10        train : [loss = 0.055, top1 = 98.63%], test  : [loss = 0.308, top1 = 90.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.37 ms.
cifar100       train : [loss = 0.578, top1 = 84.07%], valid : [loss = 1.223, top1 = 66.71%], test : [loss = 1.216, top1 = 66.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.31%], valid : [loss = 2.457, top1 = 37.81%], test : [loss = 2.489, top1 = 37.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3961/15625) 003961-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.521, top1 = 88.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.42 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.327, top1 = 92.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 0.328, top1 = 91.19%], valid : [loss = 1.274, top1 = 67.09%], test : [loss = 1.279, top1 = 67.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.79%], valid : [loss = 2.393, top1 = 39.06%], test : [loss = 2.415, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3962/15625) 003962-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.70%], valid : [loss = 0.655, top1 = 84.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.075, top1 = 97.56%], test  : [loss = 0.436, top1 = 88.30%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.58 ms.
cifar100       train : [loss = 0.765, top1 = 77.57%], valid : [loss = 1.446, top1 = 61.63%], test : [loss = 1.429, top1 = 62.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.565, top1 = 35.33%], valid : [loss = 2.682, top1 = 32.69%], test : [loss = 2.735, top1 = 31.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.39%], valid : [loss = 0.892, top1 = 68.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3963/15625) 003963-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.539, top1 = 88.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.341, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.67 ms.
cifar100       train : [loss = 0.300, top1 = 91.88%], valid : [loss = 1.310, top1 = 67.36%], test : [loss = 1.294, top1 = 67.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.84%], valid : [loss = 2.419, top1 = 38.64%], test : [loss = 2.431, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3964/15625) 003964-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.53%], valid : [loss = 0.854, top1 = 79.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10        train : [loss = 0.132, top1 = 95.58%], test  : [loss = 0.546, top1 = 84.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.853, top1 = 75.19%], valid : [loss = 1.664, top1 = 57.69%], test : [loss = 1.658, top1 = 58.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.28%], valid : [loss = 3.176, top1 = 24.51%], test : [loss = 3.218, top1 = 23.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.42%], valid : [loss = 1.128, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3965/15625) 003965-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.454, top1 = 89.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.324, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.43 ms.
cifar100       train : [loss = 0.322, top1 = 91.27%], valid : [loss = 1.318, top1 = 67.33%], test : [loss = 1.314, top1 = 67.33%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.24%], valid : [loss = 2.370, top1 = 40.18%], test : [loss = 2.396, top1 = 39.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3966/15625) 003966-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.07%], valid : [loss = 0.624, top1 = 85.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.053, top1 = 98.36%], test  : [loss = 0.407, top1 = 89.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.655, top1 = 80.79%], valid : [loss = 1.448, top1 = 62.30%], test : [loss = 1.452, top1 = 61.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.474, top1 = 37.28%], valid : [loss = 2.618, top1 = 34.12%], test : [loss = 2.647, top1 = 34.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.80%], valid : [loss = 0.853, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3967/15625) 003967-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.83%], valid : [loss = 0.563, top1 = 88.55%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.64%], test  : [loss = 0.380, top1 = 91.80%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.65 ms.
cifar100       train : [loss = 0.264, top1 = 93.08%], valid : [loss = 1.379, top1 = 66.14%], test : [loss = 1.371, top1 = 66.25%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.33 ms.
ImageNet16-120 train : [loss = 2.446, top1 = 37.11%], valid : [loss = 2.581, top1 = 34.24%], test : [loss = 2.603, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.122, top1 = 59.65%], valid : [loss = 1.147, top1 = 59.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3968/15625) 003968-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.523, top1 = 89.30%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.48 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.342, top1 = 92.91%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.29 ms.
cifar100       train : [loss = 0.091, top1 = 98.35%], valid : [loss = 1.305, top1 = 69.95%], test : [loss = 1.305, top1 = 70.27%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.95%], valid : [loss = 2.325, top1 = 40.82%], test : [loss = 2.297, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.03%], valid : [loss = 0.846, top1 = 69.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3969/15625) 003969-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.516, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.327, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.88 ms.
cifar100       train : [loss = 0.171, top1 = 96.18%], valid : [loss = 1.302, top1 = 68.48%], test : [loss = 1.310, top1 = 68.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.66%], valid : [loss = 2.285, top1 = 41.68%], test : [loss = 2.312, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.88%], valid : [loss = 0.672, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3970/15625) 003970-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.608, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.402, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.07 ms.
cifar100       train : [loss = 0.204, top1 = 95.29%], valid : [loss = 1.430, top1 = 66.50%], test : [loss = 1.435, top1 = 66.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.17%], valid : [loss = 2.479, top1 = 38.14%], test : [loss = 2.505, top1 = 38.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3971/15625) 003971-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.551, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.361, top1 = 92.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.088, top1 = 98.52%], valid : [loss = 1.433, top1 = 68.28%], test : [loss = 1.443, top1 = 68.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 1.813, top1 = 51.95%], valid : [loss = 2.395, top1 = 40.17%], test : [loss = 2.382, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.50%], valid : [loss = 0.677, top1 = 76.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3972/15625) 003972-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.473, top1 = 90.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.309, top1 = 93.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.10 ms.
cifar100       train : [loss = 0.084, top1 = 98.49%], valid : [loss = 1.427, top1 = 68.98%], test : [loss = 1.402, top1 = 69.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 1.666, top1 = 55.42%], valid : [loss = 2.301, top1 = 42.90%], test : [loss = 2.342, top1 = 41.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.91%], valid : [loss = 0.536, top1 = 82.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3973/15625) 003973-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.31%], valid : [loss = 0.512, top1 = 82.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10        train : [loss = 0.396, top1 = 86.51%], test  : [loss = 0.462, top1 = 84.40%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.13 ms.
cifar100       train : [loss = 1.528, top1 = 57.97%], valid : [loss = 1.658, top1 = 54.44%], test : [loss = 1.652, top1 = 54.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 3.025, top1 = 26.63%], valid : [loss = 2.989, top1 = 27.58%], test : [loss = 3.055, top1 = 26.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.112, top1 = 60.00%], valid : [loss = 1.132, top1 = 60.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3974/15625) 003974-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.55%], valid : [loss = 0.622, top1 = 86.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.62 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.399, top1 = 90.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.65 ms.
cifar100       train : [loss = 0.544, top1 = 84.00%], valid : [loss = 1.438, top1 = 63.13%], test : [loss = 1.427, top1 = 63.55%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.28%], valid : [loss = 2.538, top1 = 36.44%], test : [loss = 2.585, top1 = 35.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.55%], valid : [loss = 0.907, top1 = 67.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3975/15625) 003975-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.489, top1 = 88.94%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.17 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.315, top1 = 92.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.97 ms.
cifar100       train : [loss = 0.322, top1 = 91.26%], valid : [loss = 1.263, top1 = 67.76%], test : [loss = 1.285, top1 = 67.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.83 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.97%], valid : [loss = 2.412, top1 = 38.92%], test : [loss = 2.403, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.26%], valid : [loss = 0.633, top1 = 78.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3976/15625) 003976-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.80%], valid : [loss = 0.506, top1 = 86.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.55 ms.
cifar10        train : [loss = 0.066, top1 = 98.08%], test  : [loss = 0.352, top1 = 90.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.46 ms.
cifar100       train : [loss = 0.570, top1 = 83.57%], valid : [loss = 1.303, top1 = 65.38%], test : [loss = 1.272, top1 = 66.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.42%], valid : [loss = 2.427, top1 = 38.23%], test : [loss = 2.459, top1 = 38.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.90%], valid : [loss = 0.854, top1 = 69.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3977/15625) 003977-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.458, top1 = 89.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.295, top1 = 92.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.82 ms.
cifar100       train : [loss = 0.121, top1 = 97.75%], valid : [loss = 1.252, top1 = 69.87%], test : [loss = 1.258, top1 = 69.61%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 1.685, top1 = 54.80%], valid : [loss = 2.190, top1 = 44.03%], test : [loss = 2.204, top1 = 44.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.54%], valid : [loss = 0.571, top1 = 80.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3978/15625) 003978-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.560, top1 = 87.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.350, top1 = 91.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.63 ms.
cifar100       train : [loss = 0.329, top1 = 90.98%], valid : [loss = 1.301, top1 = 67.20%], test : [loss = 1.313, top1 = 67.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.22%], valid : [loss = 2.444, top1 = 38.38%], test : [loss = 2.448, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.40%], valid : [loss = 0.823, top1 = 70.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3979/15625) 003979-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.337, top1 = 88.19%], valid : [loss = 0.603, top1 = 80.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10        train : [loss = 0.264, top1 = 90.95%], test  : [loss = 0.437, top1 = 85.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.77 ms.
cifar100       train : [loss = 1.352, top1 = 62.02%], valid : [loss = 1.684, top1 = 54.85%], test : [loss = 1.671, top1 = 55.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 3.003, top1 = 26.86%], valid : [loss = 3.042, top1 = 25.77%], test : [loss = 3.078, top1 = 25.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.148, top1 = 58.96%], valid : [loss = 1.199, top1 = 57.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3980/15625) 003980-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.613, top1 = 85.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.070, top1 = 97.90%], test  : [loss = 0.405, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 0.716, top1 = 79.25%], valid : [loss = 1.402, top1 = 62.56%], test : [loss = 1.401, top1 = 63.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.14%], valid : [loss = 2.639, top1 = 33.81%], test : [loss = 2.665, top1 = 34.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3981/15625) 003981-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.519, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.332, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.335, top1 = 90.95%], valid : [loss = 1.291, top1 = 66.87%], test : [loss = 1.307, top1 = 66.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.68%], valid : [loss = 2.404, top1 = 39.36%], test : [loss = 2.418, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3982/15625) 003982-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.434, top1 = 91.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.288, top1 = 93.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.062, top1 = 99.14%], valid : [loss = 1.284, top1 = 71.21%], test : [loss = 1.285, top1 = 71.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 1.468, top1 = 60.14%], valid : [loss = 2.179, top1 = 44.98%], test : [loss = 2.195, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.344, top1 = 88.16%], valid : [loss = 0.494, top1 = 83.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3983/15625) 003983-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.70 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.16%], valid : [loss = 0.451, top1 = 87.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.326, top1 = 89.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 0.859, top1 = 75.55%], valid : [loss = 1.293, top1 = 64.17%], test : [loss = 1.273, top1 = 64.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.88%], valid : [loss = 2.603, top1 = 34.30%], test : [loss = 2.658, top1 = 33.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3984/15625) 003984-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.63%], valid : [loss = 0.458, top1 = 86.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.149, top1 = 95.20%], test  : [loss = 0.342, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.970, top1 = 72.43%], valid : [loss = 1.337, top1 = 62.81%], test : [loss = 1.332, top1 = 62.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.23%], valid : [loss = 2.686, top1 = 33.16%], test : [loss = 2.696, top1 = 32.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3985/15625) 003985-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.495, top1 = 88.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.329, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.08 ms.
cifar100       train : [loss = 0.319, top1 = 91.35%], valid : [loss = 1.287, top1 = 67.85%], test : [loss = 1.289, top1 = 67.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.06%], valid : [loss = 2.384, top1 = 39.87%], test : [loss = 2.411, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3986/15625) 003986-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 90.90%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.25 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.284, top1 = 93.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.07 ms.
cifar100       train : [loss = 0.042, top1 = 99.56%], valid : [loss = 1.337, top1 = 70.78%], test : [loss = 1.334, top1 = 70.79%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 1.426, top1 = 61.19%], valid : [loss = 2.257, top1 = 43.53%], test : [loss = 2.245, top1 = 44.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.66%], valid : [loss = 0.498, top1 = 83.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3987/15625) 003987-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.15%], valid : [loss = 0.738, top1 = 79.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10        train : [loss = 0.180, top1 = 93.79%], test  : [loss = 0.519, top1 = 84.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.83 ms.
cifar100       train : [loss = 0.881, top1 = 74.30%], valid : [loss = 1.622, top1 = 57.69%], test : [loss = 1.666, top1 = 56.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 3.466, top1 = 17.41%], valid : [loss = 3.472, top1 = 17.70%], test : [loss = 3.480, top1 = 17.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3988/15625) 003988-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.595, top1 = 87.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.395, top1 = 91.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.14 ms.
cifar100       train : [loss = 0.142, top1 = 96.95%], valid : [loss = 1.529, top1 = 66.45%], test : [loss = 1.530, top1 = 66.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.90%], valid : [loss = 2.415, top1 = 39.88%], test : [loss = 2.414, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 73.90%], valid : [loss = 0.801, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3989/15625) 003989-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.42%], valid : [loss = 0.586, top1 = 83.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.98 ms.
cifar10        train : [loss = 0.174, top1 = 94.10%], test  : [loss = 0.415, top1 = 87.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.68 ms.
cifar100       train : [loss = 0.778, top1 = 77.13%], valid : [loss = 1.650, top1 = 57.78%], test : [loss = 1.677, top1 = 57.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 3.787, top1 = 12.03%], valid : [loss = 3.752, top1 = 12.91%], test : [loss = 3.774, top1 = 11.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.454, top1 = 46.04%], valid : [loss = 1.452, top1 = 45.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3990/15625) 003990-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.05 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.495, top1 = 90.12%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.317, top1 = 93.29%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.11 ms.
cifar100       train : [loss = 0.065, top1 = 99.04%], valid : [loss = 1.347, top1 = 69.45%], test : [loss = 1.330, top1 = 70.31%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.43 ms.
ImageNet16-120 train : [loss = 1.578, top1 = 57.51%], valid : [loss = 2.191, top1 = 44.43%], test : [loss = 2.196, top1 = 44.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.89%], valid : [loss = 0.696, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3991/15625) 003991-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.582, top1 = 87.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.385, top1 = 91.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 0.403, top1 = 88.63%], valid : [loss = 1.407, top1 = 65.01%], test : [loss = 1.404, top1 = 65.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.93%], valid : [loss = 2.498, top1 = 37.26%], test : [loss = 2.527, top1 = 36.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3992/15625) 003992-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.19%], valid : [loss = 0.574, top1 = 86.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10        train : [loss = 0.064, top1 = 97.99%], test  : [loss = 0.391, top1 = 89.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.87 ms.
cifar100       train : [loss = 0.648, top1 = 80.89%], valid : [loss = 1.327, top1 = 64.93%], test : [loss = 1.287, top1 = 65.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 2.346, top1 = 39.75%], valid : [loss = 2.470, top1 = 37.44%], test : [loss = 2.504, top1 = 36.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.16%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3993/15625) 003993-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.517, top1 = 88.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.323, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.332, top1 = 90.98%], valid : [loss = 1.288, top1 = 67.07%], test : [loss = 1.280, top1 = 66.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.83%], valid : [loss = 2.402, top1 = 39.07%], test : [loss = 2.398, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.45%], valid : [loss = 0.730, top1 = 74.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3994/15625) 003994-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.472, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.311, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.88 ms.
cifar100       train : [loss = 0.263, top1 = 93.29%], valid : [loss = 1.201, top1 = 69.07%], test : [loss = 1.206, top1 = 69.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.91%], valid : [loss = 2.230, top1 = 42.57%], test : [loss = 2.239, top1 = 42.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3995/15625) 003995-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.228, top1 = 92.23%], valid : [loss = 0.512, top1 = 83.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.241, top1 = 91.77%], test  : [loss = 0.403, top1 = 86.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.15 ms.
cifar100       train : [loss = 1.368, top1 = 61.59%], valid : [loss = 1.625, top1 = 55.60%], test : [loss = 1.614, top1 = 55.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 2.858, top1 = 29.53%], valid : [loss = 2.869, top1 = 29.69%], test : [loss = 2.928, top1 = 28.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 0.979, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3996/15625) 003996-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.76%], valid : [loss = 0.480, top1 = 84.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10        train : [loss = 0.235, top1 = 92.04%], test  : [loss = 0.395, top1 = 87.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 1.292, top1 = 63.74%], valid : [loss = 1.571, top1 = 56.38%], test : [loss = 1.562, top1 = 56.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 27.79%], valid : [loss = 2.935, top1 = 27.44%], test : [loss = 2.947, top1 = 27.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.78%], valid : [loss = 1.013, top1 = 63.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3997/15625) 003997-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.430, top1 = 89.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.45 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.304, top1 = 92.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.65 ms.
cifar100       train : [loss = 0.199, top1 = 95.33%], valid : [loss = 1.274, top1 = 68.96%], test : [loss = 1.270, top1 = 69.03%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 1.850, top1 = 51.13%], valid : [loss = 2.246, top1 = 42.48%], test : [loss = 2.285, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.419, top1 = 85.58%], valid : [loss = 0.527, top1 = 82.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3998/15625) 003998-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.551, top1 = 88.39%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.16 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.337, top1 = 92.17%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.59 ms.
cifar100       train : [loss = 0.225, top1 = 94.39%], valid : [loss = 1.287, top1 = 68.27%], test : [loss = 1.285, top1 = 68.52%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 1.982, top1 = 47.94%], valid : [loss = 2.310, top1 = 40.94%], test : [loss = 2.322, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.76%], valid : [loss = 0.771, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 3999/15625) 003999-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10-valid  train : [loss = 1.324, top1 = 52.20%], valid : [loss = 1.363, top1 = 51.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10        train : [loss = 1.296, top1 = 53.38%], test  : [loss = 1.303, top1 = 53.09%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.73 ms.
cifar100       train : [loss = 2.822, top1 = 29.71%], valid : [loss = 2.918, top1 = 28.16%], test : [loss = 2.910, top1 = 28.34%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.75 ms.
ImageNet16-120 train : [loss = 3.971, top1 = 10.77%], valid : [loss = 3.976, top1 = 10.91%], test : [loss = 3.991, top1 = 10.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.860, top1 = 30.96%], valid : [loss = 1.828, top1 = 31.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4000/15625) 004000-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.521, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.31 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.328, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.39 ms.
cifar100       train : [loss = 0.156, top1 = 96.65%], valid : [loss = 1.301, top1 = 68.71%], test : [loss = 1.316, top1 = 68.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 2.006, top1 = 47.36%], valid : [loss = 2.329, top1 = 40.52%], test : [loss = 2.334, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.38%], valid : [loss = 0.883, top1 = 68.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4001/15625) 004001-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.18%], valid : [loss = 0.967, top1 = 74.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 0.242, top1 = 91.65%], test  : [loss = 0.597, top1 = 81.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.13 ms.
cifar100       train : [loss = 1.151, top1 = 67.32%], valid : [loss = 1.856, top1 = 52.38%], test : [loss = 1.844, top1 = 53.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 3.208, top1 = 23.17%], valid : [loss = 3.328, top1 = 21.47%], test : [loss = 3.364, top1 = 20.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.179, top1 = 57.16%], valid : [loss = 1.248, top1 = 54.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4002/15625) 004002-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.452, top1 = 89.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.20 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.309, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.320, top1 = 91.35%], valid : [loss = 1.303, top1 = 67.26%], test : [loss = 1.303, top1 = 67.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.30%], valid : [loss = 2.370, top1 = 39.76%], test : [loss = 2.405, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.86%], valid : [loss = 0.540, top1 = 81.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4003/15625) 004003-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.440, top1 = 89.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.297, top1 = 92.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.22 ms.
cifar100       train : [loss = 0.201, top1 = 95.32%], valid : [loss = 1.235, top1 = 69.52%], test : [loss = 1.251, top1 = 69.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.51%], valid : [loss = 2.251, top1 = 42.67%], test : [loss = 2.274, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.14%], valid : [loss = 0.548, top1 = 81.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4004/15625) 004004-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.430, top1 = 90.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.286, top1 = 93.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.68 ms.
cifar100       train : [loss = 0.176, top1 = 95.94%], valid : [loss = 1.259, top1 = 69.83%], test : [loss = 1.279, top1 = 69.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.04%], valid : [loss = 2.251, top1 = 42.93%], test : [loss = 2.270, top1 = 42.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4005/15625) 004005-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.48%], valid : [loss = 0.574, top1 = 87.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10        train : [loss = 0.035, top1 = 98.93%], test  : [loss = 0.391, top1 = 90.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.98 ms.
cifar100       train : [loss = 0.421, top1 = 88.00%], valid : [loss = 1.437, top1 = 64.43%], test : [loss = 1.406, top1 = 64.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.471, top1 = 36.83%], valid : [loss = 2.608, top1 = 34.42%], test : [loss = 2.634, top1 = 33.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.46%], valid : [loss = 1.006, top1 = 63.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4006/15625) 004006-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.511, top1 = 88.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.333, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.330, top1 = 91.03%], valid : [loss = 1.271, top1 = 67.35%], test : [loss = 1.274, top1 = 67.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.85%], valid : [loss = 2.425, top1 = 38.92%], test : [loss = 2.421, top1 = 38.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4007/15625) 004007-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.451, top1 = 89.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.317, top1 = 92.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.21 ms.
cifar100       train : [loss = 0.219, top1 = 94.69%], valid : [loss = 1.315, top1 = 68.19%], test : [loss = 1.315, top1 = 68.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.74%], valid : [loss = 2.294, top1 = 41.29%], test : [loss = 2.320, top1 = 41.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.04%], valid : [loss = 0.562, top1 = 80.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4008/15625) 004008-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.478, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.308, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.23 ms.
cifar100       train : [loss = 0.260, top1 = 93.40%], valid : [loss = 1.209, top1 = 69.13%], test : [loss = 1.206, top1 = 69.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.94%], valid : [loss = 2.220, top1 = 43.12%], test : [loss = 2.232, top1 = 43.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4009/15625) 004009-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.29%], valid : [loss = 0.872, top1 = 79.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.136, top1 = 95.40%], test  : [loss = 0.557, top1 = 84.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.864, top1 = 74.96%], valid : [loss = 1.680, top1 = 57.28%], test : [loss = 1.665, top1 = 57.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.36%], valid : [loss = 3.159, top1 = 24.30%], test : [loss = 3.194, top1 = 23.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 61.94%], valid : [loss = 1.110, top1 = 60.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4010/15625) 004010-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.14%], valid : [loss = 0.477, top1 = 84.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.296, top1 = 90.06%], test  : [loss = 0.402, top1 = 86.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.36 ms.
cifar100       train : [loss = 1.318, top1 = 63.37%], valid : [loss = 1.529, top1 = 57.75%], test : [loss = 1.515, top1 = 58.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.90%], valid : [loss = 2.899, top1 = 29.84%], test : [loss = 2.944, top1 = 28.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4011/15625) 004011-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.574, top1 = 88.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.392, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.17 ms.
cifar100       train : [loss = 0.116, top1 = 97.72%], valid : [loss = 1.456, top1 = 67.31%], test : [loss = 1.447, top1 = 67.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.92%], valid : [loss = 2.443, top1 = 38.62%], test : [loss = 2.458, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.02%], valid : [loss = 0.777, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4012/15625) 004012-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.125, top1 = 95.97%], valid : [loss = 0.570, top1 = 84.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10        train : [loss = 0.189, top1 = 93.66%], test  : [loss = 0.414, top1 = 87.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 1.028, top1 = 70.39%], valid : [loss = 1.446, top1 = 60.82%], test : [loss = 1.454, top1 = 60.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.839, top1 = 29.79%], valid : [loss = 2.899, top1 = 28.82%], test : [loss = 2.943, top1 = 28.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.982, top1 = 64.90%], valid : [loss = 1.050, top1 = 62.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4013/15625) 004013-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.501, top1 = 90.01%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.307, top1 = 93.26%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.66 ms.
cifar100       train : [loss = 0.092, top1 = 98.36%], valid : [loss = 1.286, top1 = 70.35%], test : [loss = 1.288, top1 = 69.79%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.34 ms.
ImageNet16-120 train : [loss = 1.608, top1 = 56.65%], valid : [loss = 2.113, top1 = 45.50%], test : [loss = 2.123, top1 = 45.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.78%], valid : [loss = 0.651, top1 = 77.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4014/15625) 004014-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.65%], valid : [loss = 0.856, top1 = 72.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10        train : [loss = 0.548, top1 = 80.86%], test  : [loss = 0.707, top1 = 75.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 1.761, top1 = 52.37%], valid : [loss = 2.045, top1 = 47.19%], test : [loss = 2.052, top1 = 47.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.77%], valid : [loss = 3.635, top1 = 16.89%], test : [loss = 3.656, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4015/15625) 004015-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.544, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.346, top1 = 92.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.06 ms.
cifar100       train : [loss = 0.161, top1 = 96.19%], valid : [loss = 1.380, top1 = 68.15%], test : [loss = 1.391, top1 = 67.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 1.964, top1 = 48.45%], valid : [loss = 2.325, top1 = 40.60%], test : [loss = 2.335, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.76%], valid : [loss = 0.875, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4016/15625) 004016-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.53%], valid : [loss = 0.447, top1 = 87.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.03 ms.
cifar10        train : [loss = 0.055, top1 = 98.70%], test  : [loss = 0.323, top1 = 90.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.580, top1 = 84.05%], valid : [loss = 1.222, top1 = 67.02%], test : [loss = 1.200, top1 = 66.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.76%], valid : [loss = 2.519, top1 = 37.03%], test : [loss = 2.516, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.16%], valid : [loss = 0.650, top1 = 78.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4017/15625) 004017-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.482, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.326, top1 = 91.26%], valid : [loss = 1.254, top1 = 67.50%], test : [loss = 1.280, top1 = 67.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.69%], valid : [loss = 2.321, top1 = 41.10%], test : [loss = 2.368, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4018/15625) 004018-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10-valid  train : [loss = 0.682, top1 = 75.95%], valid : [loss = 0.855, top1 = 70.85%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10        train : [loss = 0.685, top1 = 76.07%], test  : [loss = 0.768, top1 = 73.46%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.51 ms.
cifar100       train : [loss = 1.963, top1 = 47.86%], valid : [loss = 2.133, top1 = 44.57%], test : [loss = 2.154, top1 = 44.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.25 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.79%], valid : [loss = 3.663, top1 = 15.74%], test : [loss = 3.694, top1 = 15.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4019/15625) 004019-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.472, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.79 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.329, top1 = 92.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.290, top1 = 92.18%], valid : [loss = 1.349, top1 = 66.71%], test : [loss = 1.325, top1 = 67.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.006, top1 = 47.47%], valid : [loss = 2.344, top1 = 39.96%], test : [loss = 2.369, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.66%], valid : [loss = 0.592, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4020/15625) 004020-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.84%], valid : [loss = 0.655, top1 = 77.90%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.79 ms.
cifar10        train : [loss = 0.512, top1 = 82.28%], test  : [loss = 0.590, top1 = 80.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 1.694, top1 = 54.02%], valid : [loss = 1.853, top1 = 50.76%], test : [loss = 1.864, top1 = 51.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.51 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.19%], valid : [loss = 3.320, top1 = 21.74%], test : [loss = 3.348, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4021/15625) 004021-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.86%], valid : [loss = 0.511, top1 = 85.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.169, top1 = 94.38%], test  : [loss = 0.363, top1 = 88.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.58 ms.
cifar100       train : [loss = 1.118, top1 = 68.00%], valid : [loss = 1.440, top1 = 60.04%], test : [loss = 1.441, top1 = 60.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.96 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.21%], valid : [loss = 2.658, top1 = 34.33%], test : [loss = 2.718, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 68.10%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4022/15625) 004022-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.33%], valid : [loss = 0.847, top1 = 72.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10        train : [loss = 0.572, top1 = 80.04%], test  : [loss = 0.724, top1 = 75.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 1.788, top1 = 51.90%], valid : [loss = 2.046, top1 = 47.02%], test : [loss = 2.082, top1 = 46.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.93%], valid : [loss = 3.629, top1 = 16.07%], test : [loss = 3.643, top1 = 16.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4023/15625) 004023-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.535, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.341, top1 = 92.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.96 ms.
cifar100       train : [loss = 0.246, top1 = 93.65%], valid : [loss = 1.310, top1 = 67.58%], test : [loss = 1.321, top1 = 67.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.17 ms.
ImageNet16-120 train : [loss = 2.246, top1 = 42.08%], valid : [loss = 2.443, top1 = 37.77%], test : [loss = 2.482, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 69.76%], valid : [loss = 0.876, top1 = 68.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4024/15625) 004024-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.453 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.423, top1 = 90.48%]
cifar10        FLOP= 62.83 M, Params=0.453 MB, latency=18.84 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.278, top1 = 93.31%]
cifar100       FLOP= 62.84 M, Params=0.459 MB, latency=17.58 ms.
cifar100       train : [loss = 0.151, top1 = 96.72%], valid : [loss = 1.279, top1 = 69.33%], test : [loss = 1.292, top1 = 69.57%]
ImageNet16-120 FLOP= 15.72 M, Params=0.461 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.52%], valid : [loss = 2.219, top1 = 43.13%], test : [loss = 2.269, top1 = 42.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.60%], valid : [loss = 0.496, top1 = 83.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4025/15625) 004025-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.47%], valid : [loss = 0.483, top1 = 85.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.85 ms.
cifar10        train : [loss = 0.159, top1 = 94.81%], test  : [loss = 0.341, top1 = 88.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.90 ms.
cifar100       train : [loss = 1.005, top1 = 71.31%], valid : [loss = 1.368, top1 = 62.28%], test : [loss = 1.341, top1 = 61.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.76%], valid : [loss = 2.686, top1 = 32.63%], test : [loss = 2.696, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4026/15625) 004026-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.33%], valid : [loss = 0.570, top1 = 81.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.320, top1 = 88.89%], test  : [loss = 0.469, top1 = 84.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.25 ms.
cifar100       train : [loss = 1.573, top1 = 56.39%], valid : [loss = 1.781, top1 = 52.10%], test : [loss = 1.779, top1 = 51.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 3.099, top1 = 24.92%], valid : [loss = 3.117, top1 = 25.57%], test : [loss = 3.162, top1 = 23.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.40%], valid : [loss = 1.079, top1 = 61.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4027/15625) 004027-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.76%], valid : [loss = 0.774, top1 = 73.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.601, top1 = 78.97%], test  : [loss = 0.665, top1 = 77.18%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.11 ms.
cifar100       train : [loss = 2.113, top1 = 43.27%], valid : [loss = 2.218, top1 = 41.46%], test : [loss = 2.190, top1 = 42.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.25 ms.
ImageNet16-120 train : [loss = 3.205, top1 = 22.84%], valid : [loss = 3.179, top1 = 23.93%], test : [loss = 3.217, top1 = 22.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.184, top1 = 57.06%], valid : [loss = 1.244, top1 = 55.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4028/15625) 004028-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.80%], valid : [loss = 0.472, top1 = 84.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10        train : [loss = 0.302, top1 = 89.92%], test  : [loss = 0.391, top1 = 86.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.70 ms.
cifar100       train : [loss = 1.326, top1 = 63.25%], valid : [loss = 1.529, top1 = 57.28%], test : [loss = 1.507, top1 = 58.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.57%], valid : [loss = 2.892, top1 = 29.77%], test : [loss = 2.954, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4029/15625) 004029-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.656, top1 = 86.18%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.95 ms.
cifar10        train : [loss = 0.023, top1 = 99.42%], test  : [loss = 0.442, top1 = 89.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.48 ms.
cifar100       train : [loss = 0.342, top1 = 91.00%], valid : [loss = 1.470, top1 = 64.98%], test : [loss = 1.481, top1 = 64.46%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 43.01%], valid : [loss = 2.553, top1 = 35.60%], test : [loss = 2.547, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.96%], valid : [loss = 0.814, top1 = 71.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4030/15625) 004030-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.449, top1 = 89.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.300, top1 = 92.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.62 ms.
cifar100       train : [loss = 0.327, top1 = 91.04%], valid : [loss = 1.294, top1 = 67.42%], test : [loss = 1.332, top1 = 67.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.24%], valid : [loss = 2.389, top1 = 39.77%], test : [loss = 2.392, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.63%], valid : [loss = 0.557, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4031/15625) 004031-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.23%], valid : [loss = 0.465, top1 = 84.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10        train : [loss = 0.296, top1 = 90.07%], test  : [loss = 0.396, top1 = 86.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.54 ms.
cifar100       train : [loss = 1.309, top1 = 63.72%], valid : [loss = 1.530, top1 = 57.98%], test : [loss = 1.504, top1 = 58.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.53%], valid : [loss = 2.910, top1 = 28.33%], test : [loss = 2.979, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4032/15625) 004032-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.485, top1 = 89.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.296, top1 = 92.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.22 ms.
cifar100       train : [loss = 0.336, top1 = 90.98%], valid : [loss = 1.253, top1 = 67.78%], test : [loss = 1.250, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.56%], valid : [loss = 2.208, top1 = 42.47%], test : [loss = 2.230, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4033/15625) 004033-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.67 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4034/15625) 004034-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.06 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.42%], valid : [loss = 0.546, top1 = 86.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.76 ms.
cifar10        train : [loss = 0.053, top1 = 98.41%], test  : [loss = 0.364, top1 = 90.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.51 ms.
cifar100       train : [loss = 0.615, top1 = 81.98%], valid : [loss = 1.344, top1 = 65.17%], test : [loss = 1.334, top1 = 64.57%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.56%], valid : [loss = 2.534, top1 = 36.04%], test : [loss = 2.563, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.64%], valid : [loss = 0.653, top1 = 77.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4035/15625) 004035-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.26 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.62%], valid : [loss = 0.460, top1 = 86.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10        train : [loss = 0.117, top1 = 96.33%], test  : [loss = 0.325, top1 = 89.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.46 ms.
cifar100       train : [loss = 0.872, top1 = 75.31%], valid : [loss = 1.305, top1 = 64.22%], test : [loss = 1.318, top1 = 63.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.44%], valid : [loss = 2.641, top1 = 33.33%], test : [loss = 2.651, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4036/15625) 004036-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.616, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10        train : [loss = 0.068, top1 = 97.94%], test  : [loss = 0.399, top1 = 89.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 0.714, top1 = 79.28%], valid : [loss = 1.388, top1 = 63.20%], test : [loss = 1.368, top1 = 63.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.19%], valid : [loss = 2.655, top1 = 33.82%], test : [loss = 2.685, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4037/15625) 004037-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=21.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.531, top1 = 89.70%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.23 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.336, top1 = 92.93%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.27 ms.
cifar100       train : [loss = 0.070, top1 = 98.90%], valid : [loss = 1.398, top1 = 69.02%], test : [loss = 1.382, top1 = 69.78%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.82%], valid : [loss = 2.309, top1 = 40.60%], test : [loss = 2.276, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.94%], valid : [loss = 0.768, top1 = 73.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4038/15625) 004038-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.09%], valid : [loss = 0.502, top1 = 87.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10        train : [loss = 0.073, top1 = 97.76%], test  : [loss = 0.342, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.23 ms.
cifar100       train : [loss = 0.706, top1 = 79.48%], valid : [loss = 1.307, top1 = 64.89%], test : [loss = 1.294, top1 = 65.03%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.428, top1 = 38.17%], valid : [loss = 2.556, top1 = 35.69%], test : [loss = 2.580, top1 = 35.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.81%], valid : [loss = 0.630, top1 = 78.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4039/15625) 004039-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4040/15625) 004040-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.77 ms.
cifar10-valid  train : [loss = 0.881, top1 = 69.57%], valid : [loss = 0.920, top1 = 68.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.94 ms.
cifar10        train : [loss = 0.833, top1 = 71.62%], test  : [loss = 0.838, top1 = 70.90%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.58 ms.
cifar100       train : [loss = 2.319, top1 = 40.75%], valid : [loss = 2.381, top1 = 38.53%], test : [loss = 2.371, top1 = 39.25%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.47 ms.
ImageNet16-120 train : [loss = 3.489, top1 = 18.50%], valid : [loss = 3.477, top1 = 18.77%], test : [loss = 3.485, top1 = 18.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.717, top1 = 36.06%], valid : [loss = 1.723, top1 = 35.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4041/15625) 004041-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.503, top1 = 89.97%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.08 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.323, top1 = 93.42%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.88 ms.
cifar100       train : [loss = 0.080, top1 = 98.64%], valid : [loss = 1.375, top1 = 69.08%], test : [loss = 1.320, top1 = 69.92%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.70 ms.
ImageNet16-120 train : [loss = 1.610, top1 = 56.56%], valid : [loss = 2.173, top1 = 44.50%], test : [loss = 2.173, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.67%], valid : [loss = 0.819, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4042/15625) 004042-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.81%], valid : [loss = 0.586, top1 = 87.97%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10        train : [loss = 0.021, top1 = 99.43%], test  : [loss = 0.401, top1 = 90.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.76 ms.
cifar100       train : [loss = 0.372, top1 = 89.63%], valid : [loss = 1.473, top1 = 63.98%], test : [loss = 1.493, top1 = 63.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.75 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 30.58%], valid : [loss = 2.810, top1 = 28.80%], test : [loss = 2.827, top1 = 28.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4043/15625) 004043-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.73%], valid : [loss = 0.839, top1 = 76.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 0.263, top1 = 90.79%], test  : [loss = 0.647, top1 = 80.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.80 ms.
cifar100       train : [loss = 1.307, top1 = 63.02%], valid : [loss = 2.010, top1 = 48.24%], test : [loss = 2.019, top1 = 49.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.453, top1 = 17.96%], valid : [loss = 3.472, top1 = 18.20%], test : [loss = 3.491, top1 = 17.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.325, top1 = 51.37%], valid : [loss = 1.350, top1 = 50.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4044/15625) 004044-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.471, top1 = 89.24%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.86 ms.
cifar10        train : [loss = 0.016, top1 = 99.66%], test  : [loss = 0.320, top1 = 92.11%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.23 ms.
cifar100       train : [loss = 0.279, top1 = 92.82%], valid : [loss = 1.189, top1 = 69.62%], test : [loss = 1.186, top1 = 68.94%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 49.98%], valid : [loss = 2.189, top1 = 43.57%], test : [loss = 2.244, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.10%], valid : [loss = 0.624, top1 = 78.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4045/15625) 004045-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.72%], valid : [loss = 0.452, top1 = 86.57%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.141, top1 = 95.54%], test  : [loss = 0.336, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.13 ms.
cifar100       train : [loss = 1.001, top1 = 71.73%], valid : [loss = 1.376, top1 = 62.08%], test : [loss = 1.363, top1 = 61.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.14%], valid : [loss = 2.672, top1 = 33.30%], test : [loss = 2.702, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4046/15625) 004046-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.504, top1 = 90.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.325, top1 = 93.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.87 ms.
cifar100       train : [loss = 0.109, top1 = 97.89%], valid : [loss = 1.283, top1 = 70.20%], test : [loss = 1.270, top1 = 70.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.58%], valid : [loss = 2.193, top1 = 44.97%], test : [loss = 2.213, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4047/15625) 004047-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.537, top1 = 89.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.24 ms.
cifar10        train : [loss = 0.011, top1 = 99.70%], test  : [loss = 0.373, top1 = 92.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.35 ms.
cifar100       train : [loss = 0.190, top1 = 95.21%], valid : [loss = 1.438, top1 = 66.62%], test : [loss = 1.468, top1 = 66.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.91%], valid : [loss = 2.294, top1 = 41.43%], test : [loss = 2.334, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.53%], valid : [loss = 0.918, top1 = 67.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4048/15625) 004048-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.75%], valid : [loss = 0.468, top1 = 86.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10        train : [loss = 0.149, top1 = 95.09%], test  : [loss = 0.337, top1 = 89.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.26 ms.
cifar100       train : [loss = 0.969, top1 = 72.44%], valid : [loss = 1.345, top1 = 62.24%], test : [loss = 1.345, top1 = 62.39%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.22%], valid : [loss = 2.666, top1 = 33.18%], test : [loss = 2.699, top1 = 32.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4049/15625) 004049-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.334, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.49 ms.
cifar100       train : [loss = 0.248, top1 = 93.44%], valid : [loss = 1.242, top1 = 68.89%], test : [loss = 1.239, top1 = 68.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.11%], valid : [loss = 2.219, top1 = 43.03%], test : [loss = 2.257, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.25%], valid : [loss = 0.639, top1 = 78.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4050/15625) 004050-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.517, top1 = 89.71%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.63 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.332, top1 = 93.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=22.54 ms.
cifar100       train : [loss = 0.057, top1 = 99.17%], valid : [loss = 1.365, top1 = 69.50%], test : [loss = 1.359, top1 = 69.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.46%], valid : [loss = 2.319, top1 = 41.37%], test : [loss = 2.305, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.38%], valid : [loss = 0.679, top1 = 76.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4051/15625) 004051-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.13%], valid : [loss = 0.590, top1 = 80.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10        train : [loss = 0.320, top1 = 88.98%], test  : [loss = 0.451, top1 = 84.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.07 ms.
cifar100       train : [loss = 1.498, top1 = 58.13%], valid : [loss = 1.731, top1 = 53.00%], test : [loss = 1.719, top1 = 53.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 3.088, top1 = 25.19%], valid : [loss = 3.090, top1 = 25.10%], test : [loss = 3.141, top1 = 24.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 65.21%], valid : [loss = 1.028, top1 = 63.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4052/15625) 004052-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.538, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.355, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.74 ms.
cifar100       train : [loss = 0.114, top1 = 97.86%], valid : [loss = 1.418, top1 = 68.07%], test : [loss = 1.437, top1 = 67.53%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 50.01%], valid : [loss = 2.402, top1 = 40.03%], test : [loss = 2.412, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.34%], valid : [loss = 0.713, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4053/15625) 004053-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.593, top1 = 85.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.066, top1 = 98.06%], test  : [loss = 0.401, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.99 ms.
cifar100       train : [loss = 0.701, top1 = 79.66%], valid : [loss = 1.395, top1 = 62.99%], test : [loss = 1.363, top1 = 63.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.26%], valid : [loss = 2.627, top1 = 34.48%], test : [loss = 2.676, top1 = 33.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4054/15625) 004054-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.09%], valid : [loss = 0.478, top1 = 84.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.299, top1 = 90.00%], test  : [loss = 0.398, top1 = 86.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.18 ms.
cifar100       train : [loss = 1.337, top1 = 62.91%], valid : [loss = 1.536, top1 = 57.75%], test : [loss = 1.510, top1 = 58.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.66%], valid : [loss = 2.907, top1 = 29.10%], test : [loss = 2.959, top1 = 28.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4055/15625) 004055-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.69%], valid : [loss = 0.716, top1 = 75.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.561, top1 = 80.66%], test  : [loss = 0.621, top1 = 78.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.09 ms.
cifar100       train : [loss = 1.952, top1 = 47.66%], valid : [loss = 2.091, top1 = 44.93%], test : [loss = 2.078, top1 = 45.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.34%], valid : [loss = 3.218, top1 = 22.73%], test : [loss = 3.245, top1 = 22.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.88%], valid : [loss = 1.336, top1 = 52.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4056/15625) 004056-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.592, top1 = 87.95%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.410, top1 = 91.83%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.55 ms.
cifar100       train : [loss = 0.120, top1 = 97.63%], valid : [loss = 1.563, top1 = 66.40%], test : [loss = 1.537, top1 = 66.34%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 47.92%], valid : [loss = 2.480, top1 = 38.27%], test : [loss = 2.512, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.15%], valid : [loss = 0.779, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4057/15625) 004057-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.36%], valid : [loss = 0.579, top1 = 85.89%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10        train : [loss = 0.111, top1 = 96.39%], test  : [loss = 0.383, top1 = 88.81%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.35 ms.
cifar100       train : [loss = 0.820, top1 = 75.93%], valid : [loss = 1.461, top1 = 61.70%], test : [loss = 1.403, top1 = 62.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.25%], valid : [loss = 2.749, top1 = 32.20%], test : [loss = 2.795, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.64%], valid : [loss = 0.704, top1 = 75.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4058/15625) 004058-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.11%], valid : [loss = 0.654, top1 = 84.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10        train : [loss = 0.067, top1 = 98.04%], test  : [loss = 0.406, top1 = 88.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.68 ms.
cifar100       train : [loss = 0.709, top1 = 79.42%], valid : [loss = 1.389, top1 = 63.62%], test : [loss = 1.401, top1 = 61.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 36.07%], valid : [loss = 2.662, top1 = 34.23%], test : [loss = 2.684, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.16%], valid : [loss = 0.781, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4059/15625) 004059-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.26%], valid : [loss = 0.848, top1 = 72.54%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.04 ms.
cifar10        train : [loss = 0.557, top1 = 80.49%], test  : [loss = 0.710, top1 = 75.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 1.792, top1 = 51.75%], valid : [loss = 2.090, top1 = 46.00%], test : [loss = 2.086, top1 = 46.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.84%], valid : [loss = 3.621, top1 = 16.67%], test : [loss = 3.648, top1 = 16.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4060/15625) 004060-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.80%], valid : [loss = 0.674, top1 = 84.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.063, top1 = 98.06%], test  : [loss = 0.400, top1 = 89.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.686, top1 = 79.77%], valid : [loss = 1.498, top1 = 61.44%], test : [loss = 1.495, top1 = 61.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.85%], valid : [loss = 2.647, top1 = 33.13%], test : [loss = 2.669, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.57%], valid : [loss = 0.891, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4061/15625) 004061-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.572, top1 = 87.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.377, top1 = 91.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.86 ms.
cifar100       train : [loss = 0.376, top1 = 89.42%], valid : [loss = 1.376, top1 = 66.34%], test : [loss = 1.381, top1 = 66.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.84%], valid : [loss = 2.474, top1 = 37.56%], test : [loss = 2.510, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.86%], valid : [loss = 0.762, top1 = 73.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4062/15625) 004062-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.446, top1 = 91.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.36 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.299, top1 = 93.93%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.40 ms.
cifar100       train : [loss = 0.028, top1 = 99.73%], valid : [loss = 1.307, top1 = 72.64%], test : [loss = 1.289, top1 = 71.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 1.240, top1 = 65.89%], valid : [loss = 2.168, top1 = 46.03%], test : [loss = 2.196, top1 = 46.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.321, top1 = 89.07%], valid : [loss = 0.470, top1 = 84.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4063/15625) 004063-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.495, top1 = 89.89%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.319, top1 = 93.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.92 ms.
cifar100       train : [loss = 0.148, top1 = 96.68%], valid : [loss = 1.259, top1 = 69.82%], test : [loss = 1.266, top1 = 69.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 1.788, top1 = 52.37%], valid : [loss = 2.162, top1 = 44.90%], test : [loss = 2.184, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.08%], valid : [loss = 0.723, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4064/15625) 004064-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.25%], valid : [loss = 0.469, top1 = 85.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.158, top1 = 94.80%], test  : [loss = 0.352, top1 = 88.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 0.980, top1 = 72.05%], valid : [loss = 1.348, top1 = 62.45%], test : [loss = 1.345, top1 = 62.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.82%], valid : [loss = 2.683, top1 = 33.06%], test : [loss = 2.720, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4065/15625) 004065-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.573, top1 = 87.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.039, top1 = 98.85%], test  : [loss = 0.405, top1 = 89.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 0.558, top1 = 83.62%], valid : [loss = 1.398, top1 = 63.91%], test : [loss = 1.408, top1 = 63.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 37.00%], valid : [loss = 2.619, top1 = 34.41%], test : [loss = 2.655, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4066/15625) 004066-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.584, top1 = 87.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.390, top1 = 91.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.86 ms.
cifar100       train : [loss = 0.387, top1 = 89.07%], valid : [loss = 1.414, top1 = 65.07%], test : [loss = 1.396, top1 = 65.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 41.01%], valid : [loss = 2.494, top1 = 37.20%], test : [loss = 2.517, top1 = 37.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4067/15625) 004067-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.446, top1 = 89.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.307, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.56 ms.
cifar100       train : [loss = 0.316, top1 = 91.54%], valid : [loss = 1.315, top1 = 67.36%], test : [loss = 1.303, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.31%], valid : [loss = 2.369, top1 = 39.60%], test : [loss = 2.407, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.32%], valid : [loss = 0.559, top1 = 80.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4068/15625) 004068-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.38%], valid : [loss = 0.458, top1 = 86.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.81 ms.
cifar10        train : [loss = 0.154, top1 = 94.97%], test  : [loss = 0.347, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.26 ms.
cifar100       train : [loss = 0.999, top1 = 71.54%], valid : [loss = 1.350, top1 = 61.77%], test : [loss = 1.355, top1 = 61.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.98%], valid : [loss = 2.684, top1 = 33.23%], test : [loss = 2.698, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4069/15625) 004069-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=22.33 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.349, top1 = 92.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.40 ms.
cifar100       train : [loss = 0.117, top1 = 97.67%], valid : [loss = 1.366, top1 = 68.28%], test : [loss = 1.308, top1 = 69.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.38%], valid : [loss = 2.295, top1 = 41.13%], test : [loss = 2.287, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.07%], valid : [loss = 0.866, top1 = 69.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4070/15625) 004070-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 16.96 M, Params=0.139 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.30%], valid : [loss = 0.452, top1 = 87.11%]
cifar10        FLOP= 16.96 M, Params=0.139 MB, latency=16.59 ms.
cifar10        train : [loss = 0.113, top1 = 96.48%], test  : [loss = 0.326, top1 = 89.58%]
cifar100       FLOP= 16.96 M, Params=0.144 MB, latency=14.74 ms.
cifar100       train : [loss = 0.861, top1 = 75.35%], valid : [loss = 1.293, top1 = 63.67%], test : [loss = 1.278, top1 = 64.03%]
ImageNet16-120 FLOP=  4.25 M, Params=0.146 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.58%], valid : [loss = 2.630, top1 = 34.48%], test : [loss = 2.663, top1 = 34.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.77%], valid : [loss = 0.649, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4071/15625) 004071-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.65 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4072/15625) 004072-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.74%], valid : [loss = 0.677, top1 = 83.49%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.26 ms.
cifar10        train : [loss = 0.076, top1 = 97.53%], test  : [loss = 0.418, top1 = 88.30%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.76 ms.
cifar100       train : [loss = 0.810, top1 = 76.34%], valid : [loss = 1.527, top1 = 59.92%], test : [loss = 1.519, top1 = 60.22%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.522, top1 = 35.96%], valid : [loss = 2.690, top1 = 32.83%], test : [loss = 2.694, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.82%], valid : [loss = 0.901, top1 = 68.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4073/15625) 004073-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.07 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.52%], valid : [loss = 0.702, top1 = 80.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10        train : [loss = 0.184, top1 = 93.60%], test  : [loss = 0.509, top1 = 84.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.90 ms.
cifar100       train : [loss = 0.884, top1 = 74.09%], valid : [loss = 1.641, top1 = 57.84%], test : [loss = 1.644, top1 = 57.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 3.463, top1 = 17.53%], valid : [loss = 3.462, top1 = 17.73%], test : [loss = 3.477, top1 = 17.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4074/15625) 004074-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.594, top1 = 86.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.375, top1 = 91.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 0.383, top1 = 89.16%], valid : [loss = 1.426, top1 = 65.72%], test : [loss = 1.404, top1 = 65.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.04%], valid : [loss = 2.498, top1 = 37.33%], test : [loss = 2.554, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.80%], valid : [loss = 0.839, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4075/15625) 004075-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.559, top1 = 88.31%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.16 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.350, top1 = 92.09%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.60 ms.
cifar100       train : [loss = 0.259, top1 = 93.00%], valid : [loss = 1.289, top1 = 68.44%], test : [loss = 1.342, top1 = 67.68%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.203, top1 = 42.91%], valid : [loss = 2.439, top1 = 37.67%], test : [loss = 2.457, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.872, top1 = 68.81%], valid : [loss = 0.896, top1 = 68.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4076/15625) 004076-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.675, top1 = 85.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.22 ms.
cifar10        train : [loss = 0.024, top1 = 99.40%], test  : [loss = 0.430, top1 = 89.96%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.03 ms.
cifar100       train : [loss = 0.344, top1 = 90.78%], valid : [loss = 1.491, top1 = 63.68%], test : [loss = 1.479, top1 = 64.04%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 42.03%], valid : [loss = 2.567, top1 = 36.13%], test : [loss = 2.559, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.30%], valid : [loss = 0.783, top1 = 72.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4077/15625) 004077-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.39%], valid : [loss = 0.449, top1 = 86.52%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.11 ms.
cifar10        train : [loss = 0.154, top1 = 94.95%], test  : [loss = 0.339, top1 = 89.08%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=23.52 ms.
cifar100       train : [loss = 1.026, top1 = 70.78%], valid : [loss = 1.366, top1 = 61.20%], test : [loss = 1.356, top1 = 62.12%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.93%], valid : [loss = 2.674, top1 = 33.20%], test : [loss = 2.711, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.94%], valid : [loss = 0.789, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4078/15625) 004078-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.21%], valid : [loss = 0.457, top1 = 86.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10        train : [loss = 0.112, top1 = 96.52%], test  : [loss = 0.332, top1 = 89.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.65 ms.
cifar100       train : [loss = 0.866, top1 = 75.24%], valid : [loss = 1.301, top1 = 64.03%], test : [loss = 1.287, top1 = 63.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.64%], valid : [loss = 2.636, top1 = 34.23%], test : [loss = 2.674, top1 = 32.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4079/15625) 004079-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.497, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.331, top1 = 92.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.15 ms.
cifar100       train : [loss = 0.256, top1 = 93.22%], valid : [loss = 1.294, top1 = 67.76%], test : [loss = 1.284, top1 = 68.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 48.93%], valid : [loss = 2.294, top1 = 41.23%], test : [loss = 2.276, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.90%], valid : [loss = 0.588, top1 = 79.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4080/15625) 004080-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.555, top1 = 88.62%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.41 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.351, top1 = 92.07%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.75 ms.
cifar100       train : [loss = 0.283, top1 = 92.66%], valid : [loss = 1.493, top1 = 63.52%], test : [loss = 1.473, top1 = 63.82%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.16 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 41.52%], valid : [loss = 2.442, top1 = 37.53%], test : [loss = 2.472, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.954, top1 = 65.81%], valid : [loss = 0.988, top1 = 64.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4081/15625) 004081-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.349, top1 = 87.99%], valid : [loss = 0.597, top1 = 80.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.278, top1 = 90.48%], test  : [loss = 0.436, top1 = 85.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.75 ms.
cifar100       train : [loss = 1.359, top1 = 61.72%], valid : [loss = 1.698, top1 = 54.60%], test : [loss = 1.682, top1 = 54.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.990, top1 = 27.01%], valid : [loss = 3.004, top1 = 26.83%], test : [loss = 3.084, top1 = 25.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 56.84%], valid : [loss = 1.230, top1 = 55.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4082/15625) 004082-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.338, top1 = 91.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.80 ms.
cifar100       train : [loss = 0.337, top1 = 91.02%], valid : [loss = 1.301, top1 = 66.78%], test : [loss = 1.283, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.66%], valid : [loss = 2.413, top1 = 37.73%], test : [loss = 2.421, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4083/15625) 004083-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.548, top1 = 88.79%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.67 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.349, top1 = 92.31%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.41 ms.
cifar100       train : [loss = 0.171, top1 = 95.83%], valid : [loss = 1.349, top1 = 68.62%], test : [loss = 1.313, top1 = 69.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.38 ms.
ImageNet16-120 train : [loss = 2.091, top1 = 45.36%], valid : [loss = 2.384, top1 = 39.10%], test : [loss = 2.393, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.98%], valid : [loss = 0.842, top1 = 70.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4084/15625) 004084-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.91%], valid : [loss = 0.627, top1 = 86.26%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10        train : [loss = 0.028, top1 = 99.29%], test  : [loss = 0.422, top1 = 89.53%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.09 ms.
cifar100       train : [loss = 0.369, top1 = 90.15%], valid : [loss = 1.435, top1 = 64.78%], test : [loss = 1.384, top1 = 65.02%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.19%], valid : [loss = 2.625, top1 = 33.50%], test : [loss = 2.663, top1 = 34.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.92%], valid : [loss = 0.757, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4085/15625) 004085-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.596, top1 = 87.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.396, top1 = 91.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.10 ms.
cifar100       train : [loss = 0.224, top1 = 94.54%], valid : [loss = 1.396, top1 = 66.42%], test : [loss = 1.384, top1 = 67.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.17%], valid : [loss = 2.407, top1 = 39.47%], test : [loss = 2.455, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.14%], valid : [loss = 0.748, top1 = 74.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4086/15625) 004086-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.72 ms.
cifar10-valid  train : [loss = 0.933, top1 = 67.35%], valid : [loss = 0.983, top1 = 66.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.95 ms.
cifar10        train : [loss = 0.907, top1 = 68.60%], test  : [loss = 0.904, top1 = 67.57%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.59 ms.
cifar100       train : [loss = 2.406, top1 = 38.67%], valid : [loss = 2.460, top1 = 37.44%], test : [loss = 2.454, top1 = 37.76%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.83 ms.
ImageNet16-120 train : [loss = 3.634, top1 = 15.85%], valid : [loss = 3.588, top1 = 16.73%], test : [loss = 3.635, top1 = 16.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.607, top1 = 39.57%], valid : [loss = 1.631, top1 = 38.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4087/15625) 004087-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.475, top1 = 89.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.321, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.94 ms.
cifar100       train : [loss = 0.168, top1 = 96.10%], valid : [loss = 1.342, top1 = 68.48%], test : [loss = 1.295, top1 = 69.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 1.771, top1 = 52.94%], valid : [loss = 2.245, top1 = 43.37%], test : [loss = 2.269, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.63%], valid : [loss = 0.535, top1 = 82.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4088/15625) 004088-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.522, top1 = 88.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.338, top1 = 91.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.347, top1 = 90.52%], valid : [loss = 1.291, top1 = 66.70%], test : [loss = 1.295, top1 = 67.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.42%], valid : [loss = 2.409, top1 = 37.83%], test : [loss = 2.421, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4089/15625) 004089-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.62%], valid : [loss = 0.777, top1 = 73.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.584, top1 = 79.68%], test  : [loss = 0.646, top1 = 77.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.76 ms.
cifar100       train : [loss = 2.022, top1 = 45.58%], valid : [loss = 2.172, top1 = 42.35%], test : [loss = 2.156, top1 = 43.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.40%], valid : [loss = 3.230, top1 = 22.71%], test : [loss = 3.261, top1 = 22.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.280, top1 = 53.56%], valid : [loss = 1.322, top1 = 52.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4090/15625) 004090-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.550, top1 = 88.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.357, top1 = 92.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.88 ms.
cifar100       train : [loss = 0.127, top1 = 97.59%], valid : [loss = 1.420, top1 = 68.20%], test : [loss = 1.452, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.65%], valid : [loss = 2.385, top1 = 39.90%], test : [loss = 2.430, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.23%], valid : [loss = 0.718, top1 = 75.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4091/15625) 004091-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.94%], valid : [loss = 0.700, top1 = 83.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10        train : [loss = 0.089, top1 = 97.13%], test  : [loss = 0.499, top1 = 86.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.53 ms.
cifar100       train : [loss = 0.794, top1 = 76.77%], valid : [loss = 1.529, top1 = 60.02%], test : [loss = 1.522, top1 = 60.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.817, top1 = 30.31%], valid : [loss = 2.943, top1 = 27.50%], test : [loss = 3.020, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.52%], valid : [loss = 0.894, top1 = 68.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4092/15625) 004092-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.24%], valid : [loss = 0.550, top1 = 84.75%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.86 ms.
cifar10        train : [loss = 0.193, top1 = 93.45%], test  : [loss = 0.401, top1 = 87.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.93 ms.
cifar100       train : [loss = 0.978, top1 = 71.81%], valid : [loss = 1.448, top1 = 61.22%], test : [loss = 1.435, top1 = 60.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.719, top1 = 32.16%], valid : [loss = 2.777, top1 = 30.90%], test : [loss = 2.831, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.34%], valid : [loss = 0.925, top1 = 67.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4093/15625) 004093-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.100, top1 = 97.00%], valid : [loss = 0.850, top1 = 78.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.143, top1 = 95.16%], test  : [loss = 0.526, top1 = 84.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.858, top1 = 74.88%], valid : [loss = 1.684, top1 = 57.36%], test : [loss = 1.681, top1 = 57.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 3.046, top1 = 26.25%], valid : [loss = 3.187, top1 = 23.30%], test : [loss = 3.219, top1 = 23.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 62.96%], valid : [loss = 1.092, top1 = 61.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4094/15625) 004094-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4095/15625) 004095-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.473, top1 = 89.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.327, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 0.312, top1 = 91.57%], valid : [loss = 1.239, top1 = 68.56%], test : [loss = 1.239, top1 = 68.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.67%], valid : [loss = 2.305, top1 = 41.23%], test : [loss = 2.328, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4096/15625) 004096-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.80%], valid : [loss = 0.547, top1 = 83.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10        train : [loss = 0.183, top1 = 93.94%], test  : [loss = 0.390, top1 = 87.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.87 ms.
cifar100       train : [loss = 1.249, top1 = 64.40%], valid : [loss = 1.539, top1 = 58.26%], test : [loss = 1.533, top1 = 57.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.63%], valid : [loss = 2.715, top1 = 32.03%], test : [loss = 2.731, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.33%], valid : [loss = 0.989, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4097/15625) 004097-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.571, top1 = 87.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.47 ms.
cifar10        train : [loss = 0.015, top1 = 99.60%], test  : [loss = 0.385, top1 = 91.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.14 ms.
cifar100       train : [loss = 0.384, top1 = 89.23%], valid : [loss = 1.413, top1 = 65.32%], test : [loss = 1.369, top1 = 65.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.93%], valid : [loss = 2.506, top1 = 37.30%], test : [loss = 2.522, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4098/15625) 004098-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.12%], valid : [loss = 0.460, top1 = 86.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.52 ms.
cifar10        train : [loss = 0.157, top1 = 94.85%], test  : [loss = 0.346, top1 = 88.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.22 ms.
cifar100       train : [loss = 1.019, top1 = 70.92%], valid : [loss = 1.395, top1 = 60.92%], test : [loss = 1.370, top1 = 62.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.80%], valid : [loss = 2.700, top1 = 32.30%], test : [loss = 2.698, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.69%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4099/15625) 004099-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.441, top1 = 90.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.49 ms.
cifar100       train : [loss = 0.064, top1 = 99.14%], valid : [loss = 1.379, top1 = 69.64%], test : [loss = 1.343, top1 = 70.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.71 ms.
ImageNet16-120 train : [loss = 1.553, top1 = 58.21%], valid : [loss = 2.239, top1 = 44.00%], test : [loss = 2.261, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.43%], valid : [loss = 0.499, top1 = 83.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4100/15625) 004100-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.62%], valid : [loss = 0.485, top1 = 83.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10        train : [loss = 0.300, top1 = 89.84%], test  : [loss = 0.402, top1 = 86.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.61 ms.
cifar100       train : [loss = 1.338, top1 = 63.10%], valid : [loss = 1.552, top1 = 57.54%], test : [loss = 1.525, top1 = 57.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.82 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.72%], valid : [loss = 2.909, top1 = 28.73%], test : [loss = 2.966, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4101/15625) 004101-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.12%], valid : [loss = 0.642, top1 = 78.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10        train : [loss = 0.664, top1 = 76.91%], test  : [loss = 0.709, top1 = 75.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.36 ms.
cifar100       train : [loss = 1.685, top1 = 54.30%], valid : [loss = 1.859, top1 = 50.05%], test : [loss = 1.872, top1 = 50.61%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 3.340, top1 = 21.07%], valid : [loss = 3.315, top1 = 21.58%], test : [loss = 3.367, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.292, top1 = 53.12%], valid : [loss = 1.304, top1 = 53.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4102/15625) 004102-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.540, top1 = 89.48%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.45 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.320, top1 = 93.30%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.32 ms.
cifar100       train : [loss = 0.074, top1 = 98.81%], valid : [loss = 1.329, top1 = 69.50%], test : [loss = 1.384, top1 = 69.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.49 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.76%], valid : [loss = 2.374, top1 = 38.87%], test : [loss = 2.387, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4103/15625) 004103-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.621, top1 = 86.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.413, top1 = 89.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.27 ms.
cifar100       train : [loss = 0.515, top1 = 84.93%], valid : [loss = 1.448, top1 = 63.86%], test : [loss = 1.429, top1 = 64.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.33%], valid : [loss = 2.577, top1 = 34.73%], test : [loss = 2.582, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4104/15625) 004104-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.552, top1 = 88.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.347, top1 = 91.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.68 ms.
cifar100       train : [loss = 0.279, top1 = 92.59%], valid : [loss = 1.310, top1 = 67.56%], test : [loss = 1.312, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.88%], valid : [loss = 2.410, top1 = 39.10%], test : [loss = 2.424, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.99%], valid : [loss = 0.873, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4105/15625) 004105-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.475, top1 = 89.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.35 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.311, top1 = 92.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.273, top1 = 92.75%], valid : [loss = 1.214, top1 = 69.20%], test : [loss = 1.214, top1 = 69.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.79%], valid : [loss = 2.226, top1 = 42.93%], test : [loss = 2.240, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4106/15625) 004106-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.371, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.144, top1 = 97.09%], valid : [loss = 1.419, top1 = 67.64%], test : [loss = 1.389, top1 = 67.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.42%], valid : [loss = 2.374, top1 = 40.07%], test : [loss = 2.413, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.707, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4107/15625) 004107-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.81%], valid : [loss = 0.473, top1 = 88.60%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.14 ms.
cifar10        train : [loss = 0.023, top1 = 99.45%], test  : [loss = 0.309, top1 = 91.73%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.70 ms.
cifar100       train : [loss = 0.290, top1 = 92.30%], valid : [loss = 1.188, top1 = 68.82%], test : [loss = 1.203, top1 = 68.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 48.96%], valid : [loss = 2.274, top1 = 41.77%], test : [loss = 2.221, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.53%], valid : [loss = 0.674, top1 = 76.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4108/15625) 004108-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.474, top1 = 89.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.339, top1 = 91.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.89 ms.
cifar100       train : [loss = 0.362, top1 = 89.85%], valid : [loss = 1.301, top1 = 67.08%], test : [loss = 1.309, top1 = 67.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.86 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.89%], valid : [loss = 2.395, top1 = 39.22%], test : [loss = 2.435, top1 = 38.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.84%], valid : [loss = 0.640, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4109/15625) 004109-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.232, top1 = 92.13%], valid : [loss = 0.548, top1 = 82.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.225, top1 = 92.24%], test  : [loss = 0.414, top1 = 86.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.10 ms.
cifar100       train : [loss = 1.333, top1 = 62.26%], valid : [loss = 1.597, top1 = 56.88%], test : [loss = 1.610, top1 = 55.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.733, top1 = 31.97%], valid : [loss = 2.757, top1 = 31.47%], test : [loss = 2.803, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 66.90%], valid : [loss = 0.953, top1 = 66.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4110/15625) 004110-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.586, top1 = 87.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.383, top1 = 91.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 0.387, top1 = 89.12%], valid : [loss = 1.383, top1 = 65.36%], test : [loss = 1.402, top1 = 65.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.97%], valid : [loss = 2.488, top1 = 36.23%], test : [loss = 2.540, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4111/15625) 004111-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.509, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.87 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.333, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.60 ms.
cifar100       train : [loss = 0.350, top1 = 90.23%], valid : [loss = 1.244, top1 = 67.52%], test : [loss = 1.253, top1 = 67.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.91%], valid : [loss = 2.296, top1 = 41.93%], test : [loss = 2.355, top1 = 39.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.29%], valid : [loss = 0.730, top1 = 74.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4112/15625) 004112-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.31%], valid : [loss = 0.453, top1 = 87.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.114, top1 = 96.48%], test  : [loss = 0.324, top1 = 89.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.16 ms.
cifar100       train : [loss = 0.867, top1 = 75.18%], valid : [loss = 1.321, top1 = 63.34%], test : [loss = 1.275, top1 = 63.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.68%], valid : [loss = 2.634, top1 = 34.37%], test : [loss = 2.664, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.76%], valid : [loss = 0.671, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4113/15625) 004113-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.498, top1 = 89.01%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.63 ms.
cifar10        train : [loss = 0.016, top1 = 99.68%], test  : [loss = 0.313, top1 = 92.26%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.38 ms.
cifar100       train : [loss = 0.279, top1 = 92.80%], valid : [loss = 1.208, top1 = 68.28%], test : [loss = 1.221, top1 = 68.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.06%], valid : [loss = 2.224, top1 = 42.97%], test : [loss = 2.246, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.18%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4114/15625) 004114-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.482, top1 = 90.34%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.324, top1 = 93.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.99 ms.
cifar100       train : [loss = 0.076, top1 = 98.86%], valid : [loss = 1.335, top1 = 70.40%], test : [loss = 1.318, top1 = 70.20%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.34 ms.
ImageNet16-120 train : [loss = 1.638, top1 = 55.97%], valid : [loss = 2.183, top1 = 45.03%], test : [loss = 2.174, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.76%], valid : [loss = 0.590, top1 = 79.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4115/15625) 004115-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.26%], valid : [loss = 0.696, top1 = 76.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10        train : [loss = 0.544, top1 = 81.04%], test  : [loss = 0.604, top1 = 79.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.62 ms.
cifar100       train : [loss = 1.703, top1 = 53.95%], valid : [loss = 1.876, top1 = 49.80%], test : [loss = 1.902, top1 = 50.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.20 ms.
ImageNet16-120 train : [loss = 3.380, top1 = 20.35%], valid : [loss = 3.357, top1 = 21.07%], test : [loss = 3.381, top1 = 19.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.349, top1 = 51.06%], valid : [loss = 1.374, top1 = 50.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4116/15625) 004116-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.23%], valid : [loss = 0.647, top1 = 85.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.415, top1 = 89.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.622, top1 = 81.75%], valid : [loss = 1.443, top1 = 62.72%], test : [loss = 1.427, top1 = 63.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.467, top1 = 37.38%], valid : [loss = 2.624, top1 = 34.31%], test : [loss = 2.659, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.38%], valid : [loss = 0.888, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4117/15625) 004117-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.499, top1 = 88.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.341, top1 = 91.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 0.384, top1 = 89.08%], valid : [loss = 1.351, top1 = 66.03%], test : [loss = 1.356, top1 = 66.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.67%], valid : [loss = 2.391, top1 = 39.74%], test : [loss = 2.425, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.24%], valid : [loss = 0.620, top1 = 78.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4118/15625) 004118-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.15%], valid : [loss = 0.551, top1 = 87.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.68 ms.
cifar10        train : [loss = 0.064, top1 = 97.95%], test  : [loss = 0.347, top1 = 90.35%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.33 ms.
cifar100       train : [loss = 0.624, top1 = 81.72%], valid : [loss = 1.311, top1 = 64.46%], test : [loss = 1.298, top1 = 64.88%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.54%], valid : [loss = 2.512, top1 = 37.17%], test : [loss = 2.525, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.25%], valid : [loss = 0.827, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4119/15625) 004119-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.553, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.53 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.387, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.24 ms.
cifar100       train : [loss = 0.184, top1 = 95.82%], valid : [loss = 1.427, top1 = 67.18%], test : [loss = 1.439, top1 = 67.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.13%], valid : [loss = 2.428, top1 = 37.90%], test : [loss = 2.451, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.06%], valid : [loss = 0.698, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4120/15625) 004120-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.587, top1 = 87.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10        train : [loss = 0.032, top1 = 99.12%], test  : [loss = 0.398, top1 = 90.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.26 ms.
cifar100       train : [loss = 0.473, top1 = 86.30%], valid : [loss = 1.421, top1 = 64.56%], test : [loss = 1.456, top1 = 63.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 40.13%], valid : [loss = 2.611, top1 = 34.67%], test : [loss = 2.620, top1 = 34.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.99%], valid : [loss = 0.639, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4121/15625) 004121-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.547, top1 = 88.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.388, top1 = 91.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.03 ms.
cifar100       train : [loss = 0.212, top1 = 95.00%], valid : [loss = 1.356, top1 = 67.32%], test : [loss = 1.381, top1 = 67.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 47.04%], valid : [loss = 2.409, top1 = 39.63%], test : [loss = 2.420, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.84%], valid : [loss = 0.728, top1 = 74.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4122/15625) 004122-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.596, top1 = 87.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.419, top1 = 90.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.59 ms.
cifar100       train : [loss = 0.236, top1 = 94.23%], valid : [loss = 1.466, top1 = 65.34%], test : [loss = 1.443, top1 = 65.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.65%], valid : [loss = 2.537, top1 = 36.43%], test : [loss = 2.537, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.10%], valid : [loss = 0.751, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4123/15625) 004123-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.466, top1 = 89.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.312, top1 = 92.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.45 ms.
cifar100       train : [loss = 0.176, top1 = 95.83%], valid : [loss = 1.309, top1 = 68.88%], test : [loss = 1.303, top1 = 68.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 1.799, top1 = 52.18%], valid : [loss = 2.228, top1 = 43.37%], test : [loss = 2.279, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.27%], valid : [loss = 0.551, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4124/15625) 004124-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.65%], valid : [loss = 0.581, top1 = 87.51%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10        train : [loss = 0.024, top1 = 99.35%], test  : [loss = 0.362, top1 = 91.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.70 ms.
cifar100       train : [loss = 0.351, top1 = 90.62%], valid : [loss = 1.352, top1 = 66.12%], test : [loss = 1.355, top1 = 65.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 39.68%], valid : [loss = 2.492, top1 = 37.20%], test : [loss = 2.492, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.025, top1 = 63.02%], valid : [loss = 1.042, top1 = 62.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4125/15625) 004125-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=22.17 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.488, top1 = 89.96%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.321, top1 = 93.13%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=23.91 ms.
cifar100       train : [loss = 0.073, top1 = 98.88%], valid : [loss = 1.397, top1 = 68.46%], test : [loss = 1.369, top1 = 68.82%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=21.50 ms.
ImageNet16-120 train : [loss = 1.685, top1 = 54.84%], valid : [loss = 2.229, top1 = 43.40%], test : [loss = 2.195, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.17%], valid : [loss = 0.723, top1 = 74.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4126/15625) 004126-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.26%], valid : [loss = 0.456, top1 = 86.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.163, top1 = 94.62%], test  : [loss = 0.346, top1 = 88.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.36 ms.
cifar100       train : [loss = 0.993, top1 = 71.80%], valid : [loss = 1.342, top1 = 63.36%], test : [loss = 1.336, top1 = 62.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.81%], valid : [loss = 2.683, top1 = 32.90%], test : [loss = 2.740, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4127/15625) 004127-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.58%], valid : [loss = 0.591, top1 = 86.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.042, top1 = 98.74%], test  : [loss = 0.384, top1 = 90.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.563, top1 = 83.29%], valid : [loss = 1.400, top1 = 63.58%], test : [loss = 1.413, top1 = 63.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.499, top1 = 36.81%], valid : [loss = 2.621, top1 = 34.23%], test : [loss = 2.674, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 76.03%], valid : [loss = 0.754, top1 = 73.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4128/15625) 004128-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.18 ms.
cifar10-valid  train : [loss = 0.238, top1 = 91.88%], valid : [loss = 0.737, top1 = 78.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10        train : [loss = 0.245, top1 = 91.55%], test  : [loss = 0.518, top1 = 84.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.19 ms.
cifar100       train : [loss = 0.894, top1 = 73.96%], valid : [loss = 1.608, top1 = 57.42%], test : [loss = 1.644, top1 = 56.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 3.523, top1 = 16.42%], valid : [loss = 3.527, top1 = 16.23%], test : [loss = 3.543, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.03%], valid : [loss = 1.304, top1 = 52.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4129/15625) 004129-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.550, top1 = 88.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.366, top1 = 91.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.04 ms.
cifar100       train : [loss = 0.264, top1 = 92.86%], valid : [loss = 1.301, top1 = 68.08%], test : [loss = 1.296, top1 = 68.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.69%], valid : [loss = 2.321, top1 = 40.37%], test : [loss = 2.327, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.66%], valid : [loss = 0.757, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4130/15625) 004130-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.16%], valid : [loss = 0.560, top1 = 86.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10        train : [loss = 0.063, top1 = 98.00%], test  : [loss = 0.369, top1 = 89.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.34 ms.
cifar100       train : [loss = 0.652, top1 = 80.82%], valid : [loss = 1.296, top1 = 65.50%], test : [loss = 1.305, top1 = 64.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.30%], valid : [loss = 2.504, top1 = 36.49%], test : [loss = 2.548, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4131/15625) 004131-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.562, top1 = 87.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.358, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.39 ms.
cifar100       train : [loss = 0.304, top1 = 91.42%], valid : [loss = 1.329, top1 = 68.06%], test : [loss = 1.313, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.40%], valid : [loss = 2.427, top1 = 38.37%], test : [loss = 2.418, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.60%], valid : [loss = 0.922, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4132/15625) 004132-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.618, top1 = 86.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.404, top1 = 90.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 0.276, top1 = 92.76%], valid : [loss = 1.481, top1 = 64.38%], test : [loss = 1.520, top1 = 64.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 44.07%], valid : [loss = 2.518, top1 = 37.63%], test : [loss = 2.583, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.30%], valid : [loss = 0.740, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4133/15625) 004133-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.516, top1 = 89.72%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.60 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.326, top1 = 92.99%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.84 ms.
cifar100       train : [loss = 0.089, top1 = 98.43%], valid : [loss = 1.259, top1 = 71.00%], test : [loss = 1.266, top1 = 70.98%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.54 ms.
ImageNet16-120 train : [loss = 1.676, top1 = 55.22%], valid : [loss = 2.178, top1 = 44.80%], test : [loss = 2.121, top1 = 45.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 71.94%], valid : [loss = 0.838, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4134/15625) 004134-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.70%], valid : [loss = 0.599, top1 = 87.63%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.48 ms.
cifar10        train : [loss = 0.023, top1 = 99.31%], test  : [loss = 0.396, top1 = 90.85%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.58 ms.
cifar100       train : [loss = 0.332, top1 = 90.86%], valid : [loss = 1.506, top1 = 63.22%], test : [loss = 1.483, top1 = 63.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.96 ms.
ImageNet16-120 train : [loss = 2.760, top1 = 30.33%], valid : [loss = 2.839, top1 = 29.47%], test : [loss = 2.847, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.38%], valid : [loss = 1.167, top1 = 57.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4135/15625) 004135-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=23.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.489, top1 = 89.92%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.81 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 93.33%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.91 ms.
cifar100       train : [loss = 0.095, top1 = 98.35%], valid : [loss = 1.308, top1 = 69.96%], test : [loss = 1.332, top1 = 69.94%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.32 ms.
ImageNet16-120 train : [loss = 1.625, top1 = 56.18%], valid : [loss = 2.132, top1 = 44.67%], test : [loss = 2.143, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.66%], valid : [loss = 0.627, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4136/15625) 004136-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.516, top1 = 89.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.341, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.26 ms.
cifar100       train : [loss = 0.193, top1 = 95.21%], valid : [loss = 1.324, top1 = 68.00%], test : [loss = 1.353, top1 = 67.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.73%], valid : [loss = 2.300, top1 = 41.20%], test : [loss = 2.300, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.40%], valid : [loss = 0.683, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4137/15625) 004137-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.640 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.545, top1 = 89.02%]
cifar10        FLOP= 90.36 M, Params=0.640 MB, latency=18.46 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.363, top1 = 92.58%]
cifar100       FLOP= 90.36 M, Params=0.646 MB, latency=15.98 ms.
cifar100       train : [loss = 0.094, top1 = 98.29%], valid : [loss = 1.456, top1 = 67.99%], test : [loss = 1.468, top1 = 68.27%]
ImageNet16-120 FLOP= 22.60 M, Params=0.648 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 50.91%], valid : [loss = 2.407, top1 = 39.73%], test : [loss = 2.404, top1 = 40.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 79.92%], valid : [loss = 0.672, top1 = 77.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4138/15625) 004138-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.33 ms.
cifar10-valid  train : [loss = 0.235, top1 = 91.93%], valid : [loss = 0.532, top1 = 83.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.226, top1 = 92.24%], test  : [loss = 0.403, top1 = 87.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 1.282, top1 = 63.72%], valid : [loss = 1.546, top1 = 57.86%], test : [loss = 1.549, top1 = 57.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.733, top1 = 31.85%], valid : [loss = 2.746, top1 = 32.40%], test : [loss = 2.775, top1 = 30.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.948, top1 = 65.95%], valid : [loss = 0.994, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4139/15625) 004139-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.45%], valid : [loss = 0.693, top1 = 84.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10        train : [loss = 0.054, top1 = 98.33%], test  : [loss = 0.429, top1 = 89.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.84 ms.
cifar100       train : [loss = 0.632, top1 = 81.44%], valid : [loss = 1.551, top1 = 60.58%], test : [loss = 1.520, top1 = 61.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.24%], valid : [loss = 2.838, top1 = 30.50%], test : [loss = 2.881, top1 = 29.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4140/15625) 004140-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.581, top1 = 87.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.382, top1 = 91.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 0.395, top1 = 88.96%], valid : [loss = 1.422, top1 = 65.96%], test : [loss = 1.397, top1 = 65.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.89%], valid : [loss = 2.505, top1 = 36.67%], test : [loss = 2.528, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.20%], valid : [loss = 0.783, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4141/15625) 004141-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.85%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.32 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.75%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.01 ms.
cifar100       train : [loss = 0.045, top1 = 99.50%], valid : [loss = 1.340, top1 = 71.00%], test : [loss = 1.285, top1 = 72.20%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=22.42 ms.
ImageNet16-120 train : [loss = 1.449, top1 = 60.46%], valid : [loss = 2.203, top1 = 44.43%], test : [loss = 2.263, top1 = 45.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.369, top1 = 87.29%], valid : [loss = 0.489, top1 = 83.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4142/15625) 004142-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4143/15625) 004143-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.353, top1 = 92.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.42 ms.
cifar100       train : [loss = 0.074, top1 = 98.88%], valid : [loss = 1.459, top1 = 68.78%], test : [loss = 1.365, top1 = 69.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 1.727, top1 = 54.05%], valid : [loss = 2.350, top1 = 42.13%], test : [loss = 2.403, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.96%], valid : [loss = 0.671, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4144/15625) 004144-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.262, top1 = 90.98%], valid : [loss = 0.546, top1 = 83.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.16 ms.
cifar10        train : [loss = 0.237, top1 = 91.89%], test  : [loss = 0.429, top1 = 86.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 1.253, top1 = 64.54%], valid : [loss = 1.626, top1 = 56.70%], test : [loss = 1.619, top1 = 56.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.952, top1 = 28.01%], valid : [loss = 2.978, top1 = 27.17%], test : [loss = 3.041, top1 = 26.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.26%], valid : [loss = 1.225, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4145/15625) 004145-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.02%], valid : [loss = 0.672, top1 = 77.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.522, top1 = 81.92%], test  : [loss = 0.600, top1 = 79.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.701, top1 = 53.86%], valid : [loss = 1.868, top1 = 50.25%], test : [loss = 1.881, top1 = 50.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 3.333, top1 = 21.11%], valid : [loss = 3.321, top1 = 21.98%], test : [loss = 3.352, top1 = 20.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.71%], valid : [loss = 1.305, top1 = 53.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4146/15625) 004146-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.13%], valid : [loss = 0.529, top1 = 84.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10        train : [loss = 0.184, top1 = 93.83%], test  : [loss = 0.383, top1 = 88.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 1.189, top1 = 66.19%], valid : [loss = 1.506, top1 = 58.78%], test : [loss = 1.493, top1 = 59.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.70%], valid : [loss = 2.705, top1 = 32.61%], test : [loss = 2.736, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4147/15625) 004147-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.82%], valid : [loss = 0.461, top1 = 86.64%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.74 ms.
cifar10        train : [loss = 0.119, top1 = 96.38%], test  : [loss = 0.330, top1 = 89.60%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.85 ms.
cifar100       train : [loss = 0.744, top1 = 79.26%], valid : [loss = 1.265, top1 = 64.60%], test : [loss = 1.268, top1 = 65.22%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.03%], valid : [loss = 2.583, top1 = 35.23%], test : [loss = 2.600, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.41%], valid : [loss = 0.845, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4148/15625) 004148-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.629, top1 = 87.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.393, top1 = 91.45%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.52 ms.
cifar100       train : [loss = 0.177, top1 = 95.92%], valid : [loss = 1.515, top1 = 66.54%], test : [loss = 1.496, top1 = 66.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.50%], valid : [loss = 2.460, top1 = 39.43%], test : [loss = 2.501, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.11%], valid : [loss = 0.786, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4149/15625) 004149-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.12 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.10%], valid : [loss = 0.445, top1 = 87.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.113, top1 = 96.57%], test  : [loss = 0.319, top1 = 90.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.38 ms.
cifar100       train : [loss = 0.875, top1 = 74.99%], valid : [loss = 1.283, top1 = 64.08%], test : [loss = 1.278, top1 = 64.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.64%], valid : [loss = 2.636, top1 = 34.03%], test : [loss = 2.653, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.12%], valid : [loss = 0.663, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4150/15625) 004150-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.519, top1 = 89.39%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.93 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.334, top1 = 93.04%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.57 ms.
cifar100       train : [loss = 0.044, top1 = 99.43%], valid : [loss = 1.502, top1 = 68.78%], test : [loss = 1.462, top1 = 69.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.84%], valid : [loss = 2.382, top1 = 41.33%], test : [loss = 2.376, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.18%], valid : [loss = 0.651, top1 = 77.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4151/15625) 004151-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.12%], valid : [loss = 0.622, top1 = 85.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.062, top1 = 97.92%], test  : [loss = 0.424, top1 = 88.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.11 ms.
cifar100       train : [loss = 0.443, top1 = 87.29%], valid : [loss = 1.592, top1 = 61.74%], test : [loss = 1.550, top1 = 61.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.901, top1 = 27.95%], valid : [loss = 2.931, top1 = 27.93%], test : [loss = 2.947, top1 = 26.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.19%], valid : [loss = 1.019, top1 = 63.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4152/15625) 004152-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.10 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4153/15625) 004153-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.333, top1 = 92.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 0.336, top1 = 90.85%], valid : [loss = 1.277, top1 = 66.79%], test : [loss = 1.281, top1 = 67.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.71%], valid : [loss = 2.415, top1 = 39.20%], test : [loss = 2.399, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4154/15625) 004154-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.432, top1 = 90.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10        train : [loss = 0.007, top1 = 99.92%], test  : [loss = 0.295, top1 = 93.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.173, top1 = 96.06%], valid : [loss = 1.280, top1 = 69.78%], test : [loss = 1.242, top1 = 69.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 1.797, top1 = 52.26%], valid : [loss = 2.236, top1 = 43.10%], test : [loss = 2.322, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.447, top1 = 84.57%], valid : [loss = 0.555, top1 = 81.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4155/15625) 004155-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.41%], valid : [loss = 0.458, top1 = 86.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10        train : [loss = 0.158, top1 = 94.83%], test  : [loss = 0.350, top1 = 88.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.25 ms.
cifar100       train : [loss = 0.981, top1 = 71.98%], valid : [loss = 1.344, top1 = 62.51%], test : [loss = 1.341, top1 = 62.31%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.91%], valid : [loss = 2.671, top1 = 33.10%], test : [loss = 2.697, top1 = 32.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4156/15625) 004156-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.499, top1 = 88.67%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.341, top1 = 91.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.61 ms.
cifar100       train : [loss = 0.333, top1 = 91.02%], valid : [loss = 1.249, top1 = 68.00%], test : [loss = 1.284, top1 = 67.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.21%], valid : [loss = 2.387, top1 = 39.40%], test : [loss = 2.411, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.17%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4157/15625) 004157-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.252, top1 = 91.55%], valid : [loss = 0.574, top1 = 82.39%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10        train : [loss = 0.236, top1 = 91.97%], test  : [loss = 0.439, top1 = 86.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.45 ms.
cifar100       train : [loss = 1.230, top1 = 65.06%], valid : [loss = 1.607, top1 = 56.48%], test : [loss = 1.603, top1 = 57.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.987, top1 = 27.32%], valid : [loss = 3.041, top1 = 25.93%], test : [loss = 3.082, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 57.40%], valid : [loss = 1.228, top1 = 56.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4158/15625) 004158-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.00 ms.
cifar10-valid  train : [loss = 1.124, top1 = 60.21%], valid : [loss = 1.165, top1 = 58.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10        train : [loss = 1.067, top1 = 62.41%], test  : [loss = 1.067, top1 = 61.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.93 ms.
cifar100       train : [loss = 2.575, top1 = 34.97%], valid : [loss = 2.650, top1 = 34.22%], test : [loss = 2.628, top1 = 34.25%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.40 ms.
ImageNet16-120 train : [loss = 3.795, top1 = 13.52%], valid : [loss = 3.773, top1 = 14.50%], test : [loss = 3.795, top1 = 13.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4159/15625) 004159-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.94 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.16 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.75 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4160/15625) 004160-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.500, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.331, top1 = 92.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.45 ms.
cifar100       train : [loss = 0.331, top1 = 91.13%], valid : [loss = 1.306, top1 = 67.20%], test : [loss = 1.278, top1 = 67.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.80%], valid : [loss = 2.388, top1 = 38.87%], test : [loss = 2.405, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4161/15625) 004161-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.56%], valid : [loss = 0.461, top1 = 86.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10        train : [loss = 0.162, top1 = 94.74%], test  : [loss = 0.344, top1 = 89.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.20 ms.
cifar100       train : [loss = 0.994, top1 = 71.89%], valid : [loss = 1.352, top1 = 62.30%], test : [loss = 1.345, top1 = 61.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.76%], valid : [loss = 2.691, top1 = 33.10%], test : [loss = 2.692, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4162/15625) 004162-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.505, top1 = 89.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.335, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.53 ms.
cifar100       train : [loss = 0.260, top1 = 93.03%], valid : [loss = 1.264, top1 = 68.14%], test : [loss = 1.264, top1 = 68.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.20%], valid : [loss = 2.218, top1 = 43.37%], test : [loss = 2.265, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.29%], valid : [loss = 0.734, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4163/15625) 004163-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.544, top1 = 88.56%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.59 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.357, top1 = 91.90%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.79 ms.
cifar100       train : [loss = 0.304, top1 = 91.50%], valid : [loss = 1.329, top1 = 66.66%], test : [loss = 1.350, top1 = 67.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.28%], valid : [loss = 2.400, top1 = 38.87%], test : [loss = 2.466, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.70%], valid : [loss = 0.873, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4164/15625) 004164-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.92%], valid : [loss = 0.748, top1 = 74.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=9.94 ms.
cifar10        train : [loss = 0.613, top1 = 78.53%], test  : [loss = 0.686, top1 = 76.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.80 ms.
cifar100       train : [loss = 1.955, top1 = 46.79%], valid : [loss = 2.091, top1 = 44.56%], test : [loss = 2.099, top1 = 44.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 25.94%], valid : [loss = 3.010, top1 = 26.17%], test : [loss = 3.056, top1 = 25.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.137, top1 = 58.45%], valid : [loss = 1.183, top1 = 57.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4165/15625) 004165-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.34%], valid : [loss = 0.644, top1 = 85.26%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=14.55 ms.
cifar10        train : [loss = 0.061, top1 = 98.15%], test  : [loss = 0.408, top1 = 89.06%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=14.90 ms.
cifar100       train : [loss = 0.699, top1 = 79.65%], valid : [loss = 1.437, top1 = 62.37%], test : [loss = 1.420, top1 = 62.70%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.62%], valid : [loss = 2.683, top1 = 33.19%], test : [loss = 2.733, top1 = 32.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 73.01%], valid : [loss = 0.823, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4166/15625) 004166-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.563, top1 = 87.92%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.18 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.388, top1 = 91.05%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.62 ms.
cifar100       train : [loss = 0.409, top1 = 88.51%], valid : [loss = 1.377, top1 = 65.48%], test : [loss = 1.355, top1 = 66.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.68%], valid : [loss = 2.531, top1 = 36.10%], test : [loss = 2.538, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.63%], valid : [loss = 0.781, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4167/15625) 004167-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.552, top1 = 88.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.368, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.89 ms.
cifar100       train : [loss = 0.148, top1 = 96.60%], valid : [loss = 1.367, top1 = 68.68%], test : [loss = 1.333, top1 = 69.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.54 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.16%], valid : [loss = 2.318, top1 = 41.03%], test : [loss = 2.346, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.45%], valid : [loss = 0.836, top1 = 70.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4168/15625) 004168-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.27 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.533, top1 = 88.15%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.16 ms.
cifar10        train : [loss = 0.022, top1 = 99.38%], test  : [loss = 0.383, top1 = 90.92%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.86 ms.
cifar100       train : [loss = 0.259, top1 = 92.95%], valid : [loss = 1.327, top1 = 67.26%], test : [loss = 1.370, top1 = 66.38%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.75%], valid : [loss = 2.389, top1 = 38.57%], test : [loss = 2.406, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.85%], valid : [loss = 0.909, top1 = 67.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4169/15625) 004169-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.43%], valid : [loss = 0.840, top1 = 71.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.700, top1 = 75.31%], test  : [loss = 0.786, top1 = 72.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 1.955, top1 = 48.02%], valid : [loss = 2.141, top1 = 44.55%], test : [loss = 2.155, top1 = 44.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.76%], valid : [loss = 3.671, top1 = 16.12%], test : [loss = 3.702, top1 = 14.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4170/15625) 004170-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.36%], valid : [loss = 0.634, top1 = 78.85%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10        train : [loss = 0.525, top1 = 81.80%], test  : [loss = 0.611, top1 = 79.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.33 ms.
cifar100       train : [loss = 1.706, top1 = 53.78%], valid : [loss = 1.859, top1 = 50.62%], test : [loss = 1.869, top1 = 50.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.72 ms.
ImageNet16-120 train : [loss = 3.331, top1 = 21.20%], valid : [loss = 3.304, top1 = 21.60%], test : [loss = 3.345, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4171/15625) 004171-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.433, top1 = 90.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.300, top1 = 93.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.51 ms.
cifar100       train : [loss = 0.087, top1 = 98.66%], valid : [loss = 1.370, top1 = 69.38%], test : [loss = 1.342, top1 = 69.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 1.625, top1 = 56.25%], valid : [loss = 2.238, top1 = 43.50%], test : [loss = 2.250, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.57%], valid : [loss = 0.518, top1 = 82.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4172/15625) 004172-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.38%], valid : [loss = 0.458, top1 = 86.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.154, top1 = 94.97%], test  : [loss = 0.347, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.97 ms.
cifar100       train : [loss = 0.999, top1 = 71.54%], valid : [loss = 1.350, top1 = 61.77%], test : [loss = 1.355, top1 = 61.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.98%], valid : [loss = 2.684, top1 = 33.23%], test : [loss = 2.698, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.32%], valid : [loss = 0.770, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4173/15625) 004173-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.685, top1 = 84.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.055, top1 = 98.34%], test  : [loss = 0.467, top1 = 88.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.643, top1 = 81.18%], valid : [loss = 1.546, top1 = 60.88%], test : [loss = 1.494, top1 = 62.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.25%], valid : [loss = 2.823, top1 = 30.23%], test : [loss = 2.884, top1 = 29.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.81%], valid : [loss = 0.900, top1 = 67.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4174/15625) 004174-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.18%], valid : [loss = 0.460, top1 = 86.83%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=15.26 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.327, top1 = 89.64%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=13.28 ms.
cifar100       train : [loss = 0.864, top1 = 75.48%], valid : [loss = 1.292, top1 = 64.33%], test : [loss = 1.294, top1 = 63.54%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.52%], valid : [loss = 2.623, top1 = 34.00%], test : [loss = 2.666, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4175/15625) 004175-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.29 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.49 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4176/15625) 004176-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.543, top1 = 88.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.028, top1 = 99.15%], test  : [loss = 0.346, top1 = 91.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.418, top1 = 88.01%], valid : [loss = 1.276, top1 = 66.38%], test : [loss = 1.263, top1 = 67.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.12%], valid : [loss = 2.443, top1 = 38.27%], test : [loss = 2.438, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.21%], valid : [loss = 0.826, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4177/15625) 004177-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.93 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.62 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4178/15625) 004178-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.59 ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.85%], valid : [loss = 0.522, top1 = 82.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.80 ms.
cifar10        train : [loss = 0.407, top1 = 86.31%], test  : [loss = 0.470, top1 = 84.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.26 ms.
cifar100       train : [loss = 1.529, top1 = 57.84%], valid : [loss = 1.638, top1 = 55.28%], test : [loss = 1.642, top1 = 54.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.30%], valid : [loss = 3.019, top1 = 26.67%], test : [loss = 3.042, top1 = 26.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.134, top1 = 59.92%], valid : [loss = 1.146, top1 = 59.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4179/15625) 004179-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.525, top1 = 87.91%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.033, top1 = 99.17%], test  : [loss = 0.374, top1 = 90.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.83 ms.
cifar100       train : [loss = 0.443, top1 = 87.39%], valid : [loss = 1.281, top1 = 66.94%], test : [loss = 1.260, top1 = 66.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.170, top1 = 43.74%], valid : [loss = 2.432, top1 = 38.53%], test : [loss = 2.430, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.63%], valid : [loss = 0.609, top1 = 79.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4180/15625) 004180-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.453, top1 = 89.67%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.81 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.315, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.88 ms.
cifar100       train : [loss = 0.247, top1 = 93.85%], valid : [loss = 1.269, top1 = 68.32%], test : [loss = 1.244, top1 = 68.78%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.47 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.89%], valid : [loss = 2.206, top1 = 43.17%], test : [loss = 2.210, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.72%], valid : [loss = 0.589, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4181/15625) 004181-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.411, top1 = 90.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.270, top1 = 93.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.05 ms.
cifar100       train : [loss = 0.156, top1 = 96.53%], valid : [loss = 1.278, top1 = 69.70%], test : [loss = 1.286, top1 = 69.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 52.94%], valid : [loss = 2.251, top1 = 43.53%], test : [loss = 2.253, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 87.01%], valid : [loss = 0.501, top1 = 83.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4182/15625) 004182-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.503, top1 = 88.95%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.92 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.316, top1 = 92.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.23 ms.
cifar100       train : [loss = 0.328, top1 = 91.02%], valid : [loss = 1.270, top1 = 67.49%], test : [loss = 1.300, top1 = 67.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.96%], valid : [loss = 2.428, top1 = 38.87%], test : [loss = 2.430, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 80.98%], valid : [loss = 0.620, top1 = 78.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4183/15625) 004183-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.590, top1 = 85.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10        train : [loss = 0.069, top1 = 97.95%], test  : [loss = 0.409, top1 = 88.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 0.720, top1 = 79.07%], valid : [loss = 1.394, top1 = 62.93%], test : [loss = 1.382, top1 = 63.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.12%], valid : [loss = 2.659, top1 = 33.54%], test : [loss = 2.688, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4184/15625) 004184-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.61%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.53 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.307, top1 = 93.37%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=23.56 ms.
cifar100       train : [loss = 0.066, top1 = 99.08%], valid : [loss = 1.353, top1 = 70.28%], test : [loss = 1.313, top1 = 70.36%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.77 ms.
ImageNet16-120 train : [loss = 1.780, top1 = 52.55%], valid : [loss = 2.300, top1 = 41.30%], test : [loss = 2.271, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.56%], valid : [loss = 0.684, top1 = 76.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4185/15625) 004185-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.14%], valid : [loss = 0.464, top1 = 86.17%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.34 ms.
cifar10        train : [loss = 0.155, top1 = 94.90%], test  : [loss = 0.338, top1 = 88.90%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.62 ms.
cifar100       train : [loss = 0.990, top1 = 71.80%], valid : [loss = 1.349, top1 = 62.12%], test : [loss = 1.369, top1 = 61.50%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.99 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.62%], valid : [loss = 2.704, top1 = 32.70%], test : [loss = 2.724, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4186/15625) 004186-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.16%], valid : [loss = 0.904, top1 = 80.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.068, top1 = 97.78%], test  : [loss = 0.623, top1 = 84.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.521, top1 = 85.11%], valid : [loss = 1.818, top1 = 57.34%], test : [loss = 1.811, top1 = 57.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.819, top1 = 30.78%], valid : [loss = 3.113, top1 = 25.20%], test : [loss = 3.172, top1 = 24.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.84%], valid : [loss = 1.014, top1 = 63.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4187/15625) 004187-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.635, top1 = 87.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.414, top1 = 90.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.164, top1 = 96.33%], valid : [loss = 1.596, top1 = 64.52%], test : [loss = 1.565, top1 = 65.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 44.14%], valid : [loss = 2.635, top1 = 34.50%], test : [loss = 2.666, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.16%], valid : [loss = 0.795, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4188/15625) 004188-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.480, top1 = 89.37%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=23.29 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.314, top1 = 92.04%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.30 ms.
cifar100       train : [loss = 0.268, top1 = 92.90%], valid : [loss = 1.213, top1 = 68.90%], test : [loss = 1.238, top1 = 68.56%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.19 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.15%], valid : [loss = 2.225, top1 = 43.27%], test : [loss = 2.228, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.48%], valid : [loss = 0.688, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4189/15625) 004189-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.36 ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.36%], valid : [loss = 0.861, top1 = 71.32%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10        train : [loss = 0.562, top1 = 80.41%], test  : [loss = 0.735, top1 = 75.30%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.87 ms.
cifar100       train : [loss = 1.782, top1 = 52.06%], valid : [loss = 2.044, top1 = 47.22%], test : [loss = 2.066, top1 = 46.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.22 ms.
ImageNet16-120 train : [loss = 3.592, top1 = 16.72%], valid : [loss = 3.635, top1 = 16.83%], test : [loss = 3.649, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4190/15625) 004190-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.537, top1 = 88.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.384, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.29 ms.
cifar100       train : [loss = 0.395, top1 = 88.82%], valid : [loss = 1.395, top1 = 65.43%], test : [loss = 1.387, top1 = 65.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.94%], valid : [loss = 2.460, top1 = 38.37%], test : [loss = 2.519, top1 = 37.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.66%], valid : [loss = 0.778, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4191/15625) 004191-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.510, top1 = 89.67%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.07 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.20%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.08 ms.
cifar100       train : [loss = 0.075, top1 = 98.84%], valid : [loss = 1.360, top1 = 69.09%], test : [loss = 1.320, top1 = 70.28%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 1.609, top1 = 56.72%], valid : [loss = 2.183, top1 = 44.20%], test : [loss = 2.183, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.58%], valid : [loss = 0.592, top1 = 79.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4192/15625) 004192-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.537, top1 = 89.18%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.351, top1 = 92.76%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.79 ms.
cifar100       train : [loss = 0.041, top1 = 99.67%], valid : [loss = 1.430, top1 = 69.56%], test : [loss = 1.401, top1 = 70.34%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.70 ms.
ImageNet16-120 train : [loss = 1.609, top1 = 56.84%], valid : [loss = 2.397, top1 = 41.07%], test : [loss = 2.422, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.12%], valid : [loss = 0.673, top1 = 76.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4193/15625) 004193-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.558, top1 = 88.81%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=18.05 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.349, top1 = 92.96%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.05 ms.
cifar100       train : [loss = 0.037, top1 = 99.68%], valid : [loss = 1.395, top1 = 70.62%], test : [loss = 1.407, top1 = 69.30%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.27 ms.
ImageNet16-120 train : [loss = 1.565, top1 = 57.72%], valid : [loss = 2.352, top1 = 42.57%], test : [loss = 2.387, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.54%], valid : [loss = 0.643, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4194/15625) 004194-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.518, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.332, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.03 ms.
cifar100       train : [loss = 0.337, top1 = 90.83%], valid : [loss = 1.290, top1 = 66.36%], test : [loss = 1.277, top1 = 67.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 45.00%], valid : [loss = 2.383, top1 = 39.23%], test : [loss = 2.427, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4195/15625) 004195-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.57%], valid : [loss = 0.466, top1 = 85.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.156, top1 = 94.82%], test  : [loss = 0.351, top1 = 88.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.996, top1 = 71.70%], valid : [loss = 1.352, top1 = 62.32%], test : [loss = 1.349, top1 = 62.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.75 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.92%], valid : [loss = 2.671, top1 = 32.90%], test : [loss = 2.702, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4196/15625) 004196-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.26%], valid : [loss = 0.560, top1 = 87.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.50 ms.
cifar10        train : [loss = 0.049, top1 = 98.45%], test  : [loss = 0.380, top1 = 90.05%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.14 ms.
cifar100       train : [loss = 0.590, top1 = 82.85%], valid : [loss = 1.327, top1 = 64.02%], test : [loss = 1.349, top1 = 64.78%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 2.438, top1 = 37.71%], valid : [loss = 2.553, top1 = 34.97%], test : [loss = 2.586, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.88%], valid : [loss = 0.951, top1 = 66.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4197/15625) 004197-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=23.23 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.519, top1 = 89.45%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.315, top1 = 92.99%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.12 ms.
cifar100       train : [loss = 0.106, top1 = 97.89%], valid : [loss = 1.357, top1 = 69.42%], test : [loss = 1.348, top1 = 70.04%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.33%], valid : [loss = 2.340, top1 = 40.17%], test : [loss = 2.288, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.86%], valid : [loss = 0.860, top1 = 69.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4198/15625) 004198-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.284, top1 = 90.21%], valid : [loss = 0.524, top1 = 83.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.272, top1 = 90.70%], test  : [loss = 0.431, top1 = 86.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.36 ms.
cifar100       train : [loss = 1.459, top1 = 59.42%], valid : [loss = 1.698, top1 = 54.18%], test : [loss = 1.705, top1 = 54.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.963, top1 = 27.52%], valid : [loss = 2.972, top1 = 27.30%], test : [loss = 3.021, top1 = 26.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.87%], valid : [loss = 1.064, top1 = 62.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4199/15625) 004199-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.494, top1 = 90.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.308, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.94 ms.
cifar100       train : [loss = 0.112, top1 = 97.83%], valid : [loss = 1.280, top1 = 70.05%], test : [loss = 1.294, top1 = 69.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.84%], valid : [loss = 2.188, top1 = 44.13%], test : [loss = 2.207, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4200/15625) 004200-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.84%], valid : [loss = 0.839, top1 = 72.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10        train : [loss = 0.559, top1 = 80.51%], test  : [loss = 0.719, top1 = 75.60%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.00 ms.
cifar100       train : [loss = 1.780, top1 = 51.89%], valid : [loss = 2.053, top1 = 47.28%], test : [loss = 2.076, top1 = 46.76%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.96 ms.
ImageNet16-120 train : [loss = 3.596, top1 = 16.66%], valid : [loss = 3.637, top1 = 16.50%], test : [loss = 3.665, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4201/15625) 004201-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.499, top1 = 89.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.90 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.317, top1 = 92.91%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.13 ms.
cifar100       train : [loss = 0.131, top1 = 97.33%], valid : [loss = 1.354, top1 = 68.44%], test : [loss = 1.340, top1 = 68.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 1.785, top1 = 52.48%], valid : [loss = 2.303, top1 = 41.43%], test : [loss = 2.299, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.56%], valid : [loss = 0.593, top1 = 79.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4202/15625) 004202-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.471, top1 = 89.68%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.64 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.330, top1 = 92.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.49 ms.
cifar100       train : [loss = 0.135, top1 = 97.12%], valid : [loss = 1.310, top1 = 68.62%], test : [loss = 1.339, top1 = 69.82%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.42 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.89%], valid : [loss = 2.220, top1 = 43.60%], test : [loss = 2.262, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.72%], valid : [loss = 0.597, top1 = 79.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4203/15625) 004203-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.478, top1 = 89.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.350, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.47 ms.
cifar100       train : [loss = 0.126, top1 = 97.13%], valid : [loss = 1.336, top1 = 70.36%], test : [loss = 1.341, top1 = 69.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.69 ms.
ImageNet16-120 train : [loss = 1.737, top1 = 53.67%], valid : [loss = 2.224, top1 = 44.07%], test : [loss = 2.206, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.56%], valid : [loss = 0.790, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4204/15625) 004204-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.517, top1 = 81.90%], valid : [loss = 0.663, top1 = 77.89%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.73 ms.
cifar10        train : [loss = 0.530, top1 = 81.68%], test  : [loss = 0.599, top1 = 79.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.17 ms.
cifar100       train : [loss = 1.698, top1 = 53.88%], valid : [loss = 1.877, top1 = 50.32%], test : [loss = 1.883, top1 = 50.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.09%], valid : [loss = 3.316, top1 = 21.37%], test : [loss = 3.341, top1 = 21.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4205/15625) 004205-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.44%], valid : [loss = 1.063, top1 = 63.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10        train : [loss = 0.805, top1 = 71.80%], test  : [loss = 0.876, top1 = 69.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.25 ms.
cifar100       train : [loss = 2.147, top1 = 43.82%], valid : [loss = 2.324, top1 = 40.96%], test : [loss = 2.351, top1 = 40.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.27%], valid : [loss = 3.776, top1 = 14.97%], test : [loss = 3.766, top1 = 13.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.464, top1 = 46.46%], valid : [loss = 1.479, top1 = 46.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4206/15625) 004206-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.04%], valid : [loss = 0.552, top1 = 85.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.07 ms.
cifar10        train : [loss = 0.110, top1 = 96.40%], test  : [loss = 0.406, top1 = 88.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.24 ms.
cifar100       train : [loss = 0.837, top1 = 75.34%], valid : [loss = 1.418, top1 = 62.24%], test : [loss = 1.410, top1 = 61.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 32.88%], valid : [loss = 2.745, top1 = 32.10%], test : [loss = 2.814, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4207/15625) 004207-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.29%], valid : [loss = 0.461, top1 = 87.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10        train : [loss = 0.075, top1 = 97.98%], test  : [loss = 0.322, top1 = 90.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.97 ms.
cifar100       train : [loss = 0.628, top1 = 82.64%], valid : [loss = 1.259, top1 = 65.56%], test : [loss = 1.214, top1 = 65.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.322, top1 = 40.54%], valid : [loss = 2.509, top1 = 37.00%], test : [loss = 2.505, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.28%], valid : [loss = 0.637, top1 = 78.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4208/15625) 004208-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.71 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.427, top1 = 91.14%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.05 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.282, top1 = 93.74%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.02 ms.
cifar100       train : [loss = 0.039, top1 = 99.59%], valid : [loss = 1.265, top1 = 71.94%], test : [loss = 1.260, top1 = 72.16%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.17 ms.
ImageNet16-120 train : [loss = 1.370, top1 = 62.40%], valid : [loss = 2.167, top1 = 45.70%], test : [loss = 2.161, top1 = 45.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.64%], valid : [loss = 0.471, top1 = 84.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4209/15625) 004209-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.482, top1 = 89.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.91 ms.
cifar100       train : [loss = 0.137, top1 = 97.28%], valid : [loss = 1.265, top1 = 69.80%], test : [loss = 1.269, top1 = 69.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.19%], valid : [loss = 2.185, top1 = 43.89%], test : [loss = 2.175, top1 = 44.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.20%], valid : [loss = 0.579, top1 = 80.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4210/15625) 004210-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.42%], valid : [loss = 0.456, top1 = 86.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.154, top1 = 95.00%], test  : [loss = 0.337, top1 = 89.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.41 ms.
cifar100       train : [loss = 1.007, top1 = 71.31%], valid : [loss = 1.349, top1 = 62.12%], test : [loss = 1.339, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.59%], valid : [loss = 2.691, top1 = 32.67%], test : [loss = 2.723, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4211/15625) 004211-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.523, top1 = 88.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.90 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.324, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.49 ms.
cifar100       train : [loss = 0.328, top1 = 91.12%], valid : [loss = 1.284, top1 = 67.40%], test : [loss = 1.280, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 45.00%], valid : [loss = 2.411, top1 = 38.17%], test : [loss = 2.407, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4212/15625) 004212-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.536, top1 = 89.64%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.316, top1 = 93.48%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.23 ms.
cifar100       train : [loss = 0.085, top1 = 98.48%], valid : [loss = 1.341, top1 = 70.46%], test : [loss = 1.324, top1 = 69.82%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.594, top1 = 57.00%], valid : [loss = 2.139, top1 = 45.27%], test : [loss = 2.127, top1 = 45.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.49%], valid : [loss = 0.772, top1 = 73.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4213/15625) 004213-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.16%], valid : [loss = 0.552, top1 = 85.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.121, top1 = 96.04%], test  : [loss = 0.385, top1 = 88.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.78 ms.
cifar100       train : [loss = 0.824, top1 = 75.96%], valid : [loss = 1.368, top1 = 62.74%], test : [loss = 1.390, top1 = 62.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.568, top1 = 35.21%], valid : [loss = 2.636, top1 = 34.13%], test : [loss = 2.655, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.886, top1 = 68.00%], valid : [loss = 0.926, top1 = 67.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4214/15625) 004214-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.98%], valid : [loss = 0.442, top1 = 89.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.309, top1 = 92.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.18 ms.
cifar100       train : [loss = 0.211, top1 = 95.02%], valid : [loss = 1.288, top1 = 68.26%], test : [loss = 1.259, top1 = 68.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.64%], valid : [loss = 2.248, top1 = 42.60%], test : [loss = 2.287, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.21%], valid : [loss = 0.534, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4215/15625) 004215-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.581, top1 = 86.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.378, top1 = 90.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.501, top1 = 85.42%], valid : [loss = 1.403, top1 = 63.76%], test : [loss = 1.389, top1 = 64.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.19%], valid : [loss = 2.514, top1 = 37.03%], test : [loss = 2.575, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 72.95%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4216/15625) 004216-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.72%], valid : [loss = 0.490, top1 = 86.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.105, top1 = 96.56%], test  : [loss = 0.333, top1 = 89.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.743, top1 = 78.47%], valid : [loss = 1.268, top1 = 65.46%], test : [loss = 1.264, top1 = 65.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.85%], valid : [loss = 2.425, top1 = 38.17%], test : [loss = 2.456, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.02%], valid : [loss = 0.934, top1 = 66.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4217/15625) 004217-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.471, top1 = 89.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.94 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.317, top1 = 92.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.78 ms.
cifar100       train : [loss = 0.258, top1 = 93.22%], valid : [loss = 1.345, top1 = 66.97%], test : [loss = 1.328, top1 = 67.21%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 1.955, top1 = 48.54%], valid : [loss = 2.341, top1 = 41.22%], test : [loss = 2.355, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.56%], valid : [loss = 0.576, top1 = 80.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4218/15625) 004218-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.517, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.86 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.349, top1 = 92.64%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.15 ms.
cifar100       train : [loss = 0.102, top1 = 98.28%], valid : [loss = 1.455, top1 = 67.82%], test : [loss = 1.433, top1 = 67.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.70%], valid : [loss = 2.366, top1 = 40.79%], test : [loss = 2.376, top1 = 41.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.02%], valid : [loss = 0.687, top1 = 76.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4219/15625) 004219-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.379, top1 = 87.01%], valid : [loss = 0.515, top1 = 82.80%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.406, top1 = 86.16%], test  : [loss = 0.478, top1 = 83.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.60 ms.
cifar100       train : [loss = 1.523, top1 = 58.22%], valid : [loss = 1.641, top1 = 54.80%], test : [loss = 1.640, top1 = 55.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 26.40%], valid : [loss = 3.020, top1 = 26.85%], test : [loss = 3.050, top1 = 26.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 60.45%], valid : [loss = 1.137, top1 = 59.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4220/15625) 004220-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.68%], valid : [loss = 0.508, top1 = 86.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.093, top1 = 97.09%], test  : [loss = 0.366, top1 = 89.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 0.773, top1 = 77.59%], valid : [loss = 1.331, top1 = 63.85%], test : [loss = 1.323, top1 = 64.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.58%], valid : [loss = 2.645, top1 = 34.10%], test : [loss = 2.685, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.83%], valid : [loss = 0.653, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4221/15625) 004221-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.41%], valid : [loss = 0.453, top1 = 86.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10        train : [loss = 0.114, top1 = 96.56%], test  : [loss = 0.339, top1 = 89.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.39 ms.
cifar100       train : [loss = 0.854, top1 = 75.61%], valid : [loss = 1.276, top1 = 64.16%], test : [loss = 1.271, top1 = 64.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.88%], valid : [loss = 2.618, top1 = 35.17%], test : [loss = 2.657, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.30%], valid : [loss = 0.658, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4222/15625) 004222-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.515, top1 = 88.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.323, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.42 ms.
cifar100       train : [loss = 0.347, top1 = 90.35%], valid : [loss = 1.294, top1 = 66.50%], test : [loss = 1.266, top1 = 67.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.34%], valid : [loss = 2.414, top1 = 39.10%], test : [loss = 2.417, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4223/15625) 004223-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.10%], valid : [loss = 0.538, top1 = 86.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.39 ms.
cifar10        train : [loss = 0.095, top1 = 96.74%], test  : [loss = 0.374, top1 = 89.60%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.30 ms.
cifar100       train : [loss = 0.814, top1 = 76.11%], valid : [loss = 1.414, top1 = 62.08%], test : [loss = 1.458, top1 = 60.90%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.06%], valid : [loss = 2.636, top1 = 33.80%], test : [loss = 2.663, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.34%], valid : [loss = 1.057, top1 = 62.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4224/15625) 004224-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.47%], valid : [loss = 1.009, top1 = 77.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10        train : [loss = 0.096, top1 = 96.99%], test  : [loss = 0.674, top1 = 82.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.02 ms.
cifar100       train : [loss = 0.663, top1 = 81.30%], valid : [loss = 1.960, top1 = 53.76%], test : [loss = 1.955, top1 = 54.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 3.006, top1 = 27.03%], valid : [loss = 3.298, top1 = 22.67%], test : [loss = 3.337, top1 = 22.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.003, top1 = 64.26%], valid : [loss = 1.066, top1 = 62.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4225/15625) 004225-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.78%], valid : [loss = 0.787, top1 = 76.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.98 ms.
cifar10        train : [loss = 0.373, top1 = 87.14%], test  : [loss = 0.662, top1 = 78.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.57 ms.
cifar100       train : [loss = 1.742, top1 = 52.44%], valid : [loss = 2.232, top1 = 43.58%], test : [loss = 2.205, top1 = 42.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 3.672, top1 = 14.00%], valid : [loss = 3.650, top1 = 14.70%], test : [loss = 3.641, top1 = 14.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.443, top1 = 46.54%], valid : [loss = 1.459, top1 = 46.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4226/15625) 004226-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.67%], valid : [loss = 0.596, top1 = 87.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.028, top1 = 99.18%], test  : [loss = 0.394, top1 = 90.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.98 ms.
cifar100       train : [loss = 0.365, top1 = 89.79%], valid : [loss = 1.477, top1 = 63.80%], test : [loss = 1.469, top1 = 64.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.695, top1 = 31.57%], valid : [loss = 2.770, top1 = 29.90%], test : [loss = 2.779, top1 = 30.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 56.70%], valid : [loss = 1.179, top1 = 56.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4227/15625) 004227-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.18%], valid : [loss = 0.460, top1 = 86.83%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=11.64 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.327, top1 = 89.64%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=12.00 ms.
cifar100       train : [loss = 0.864, top1 = 75.48%], valid : [loss = 1.292, top1 = 64.33%], test : [loss = 1.294, top1 = 63.54%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=10.32 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.52%], valid : [loss = 2.623, top1 = 34.00%], test : [loss = 2.666, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4228/15625) 004228-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.527, top1 = 89.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.35 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.334, top1 = 92.97%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.54 ms.
cifar100       train : [loss = 0.123, top1 = 97.37%], valid : [loss = 1.340, top1 = 68.82%], test : [loss = 1.332, top1 = 69.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.83%], valid : [loss = 2.244, top1 = 43.13%], test : [loss = 2.250, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.20%], valid : [loss = 0.729, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4229/15625) 004229-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.540, top1 = 88.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.18 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.355, top1 = 92.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.87 ms.
cifar100       train : [loss = 0.208, top1 = 94.88%], valid : [loss = 1.335, top1 = 67.34%], test : [loss = 1.355, top1 = 67.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.16%], valid : [loss = 2.507, top1 = 36.70%], test : [loss = 2.518, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.14%], valid : [loss = 0.849, top1 = 69.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4230/15625) 004230-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.64%], valid : [loss = 0.751, top1 = 74.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.41 ms.
cifar10        train : [loss = 0.573, top1 = 80.01%], test  : [loss = 0.635, top1 = 78.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 2.035, top1 = 45.28%], valid : [loss = 2.179, top1 = 42.67%], test : [loss = 2.173, top1 = 42.77%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.49%], valid : [loss = 3.228, top1 = 22.81%], test : [loss = 3.238, top1 = 22.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.87%], valid : [loss = 1.348, top1 = 52.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4231/15625) 004231-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.148, top1 = 95.12%], valid : [loss = 0.838, top1 = 78.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.99 ms.
cifar10        train : [loss = 0.184, top1 = 93.84%], test  : [loss = 0.568, top1 = 83.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.03 ms.
cifar100       train : [loss = 1.055, top1 = 69.78%], valid : [loss = 1.796, top1 = 54.34%], test : [loss = 1.796, top1 = 54.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 3.106, top1 = 24.98%], valid : [loss = 3.244, top1 = 22.60%], test : [loss = 3.246, top1 = 22.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 59.28%], valid : [loss = 1.184, top1 = 57.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4232/15625) 004232-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.444, top1 = 90.45%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.61 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.294, top1 = 93.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.34 ms.
cifar100       train : [loss = 0.123, top1 = 97.48%], valid : [loss = 1.271, top1 = 70.46%], test : [loss = 1.254, top1 = 71.08%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 1.680, top1 = 55.04%], valid : [loss = 2.201, top1 = 43.33%], test : [loss = 2.222, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.30%], valid : [loss = 0.519, top1 = 82.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4233/15625) 004233-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.531, top1 = 88.56%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.15 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.342, top1 = 92.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.39 ms.
cifar100       train : [loss = 0.305, top1 = 91.55%], valid : [loss = 1.297, top1 = 67.94%], test : [loss = 1.316, top1 = 68.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.170, top1 = 43.70%], valid : [loss = 2.463, top1 = 37.93%], test : [loss = 2.433, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.73%], valid : [loss = 0.836, top1 = 70.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4234/15625) 004234-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.516, top1 = 88.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.339, top1 = 91.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.80 ms.
cifar100       train : [loss = 0.321, top1 = 91.30%], valid : [loss = 1.288, top1 = 67.25%], test : [loss = 1.291, top1 = 67.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.83%], valid : [loss = 2.405, top1 = 38.83%], test : [loss = 2.411, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.54%], valid : [loss = 0.683, top1 = 76.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4235/15625) 004235-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.484, top1 = 90.18%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.91 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.326, top1 = 92.92%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.74 ms.
cifar100       train : [loss = 0.116, top1 = 97.60%], valid : [loss = 1.336, top1 = 69.14%], test : [loss = 1.319, top1 = 69.62%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.78 ms.
ImageNet16-120 train : [loss = 1.700, top1 = 54.49%], valid : [loss = 2.168, top1 = 44.60%], test : [loss = 2.184, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.69%], valid : [loss = 0.639, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4236/15625) 004236-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.34%], valid : [loss = 0.628, top1 = 84.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.072, top1 = 97.66%], test  : [loss = 0.439, top1 = 88.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.659, top1 = 80.60%], valid : [loss = 1.520, top1 = 60.60%], test : [loss = 1.541, top1 = 61.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 27.71%], valid : [loss = 2.971, top1 = 27.17%], test : [loss = 3.026, top1 = 26.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.003, top1 = 63.84%], valid : [loss = 1.040, top1 = 63.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4237/15625) 004237-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.417, top1 = 91.42%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.32 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.266, top1 = 94.22%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.82 ms.
cifar100       train : [loss = 0.026, top1 = 99.76%], valid : [loss = 1.292, top1 = 72.95%], test : [loss = 1.277, top1 = 73.07%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.63 ms.
ImageNet16-120 train : [loss = 1.230, top1 = 66.07%], valid : [loss = 2.199, top1 = 46.22%], test : [loss = 2.230, top1 = 46.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.76%], valid : [loss = 0.482, top1 = 83.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4238/15625) 004238-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.226, top1 = 92.46%], valid : [loss = 0.553, top1 = 83.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10        train : [loss = 0.213, top1 = 92.75%], test  : [loss = 0.392, top1 = 87.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.23 ms.
cifar100       train : [loss = 1.268, top1 = 63.80%], valid : [loss = 1.569, top1 = 57.36%], test : [loss = 1.592, top1 = 56.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.695, top1 = 32.71%], valid : [loss = 2.724, top1 = 32.40%], test : [loss = 2.749, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.61%], valid : [loss = 1.020, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4239/15625) 004239-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.87%], valid : [loss = 0.577, top1 = 85.80%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.13 ms.
cifar10        train : [loss = 0.069, top1 = 97.99%], test  : [loss = 0.368, top1 = 89.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.01 ms.
cifar100       train : [loss = 0.614, top1 = 82.16%], valid : [loss = 1.371, top1 = 64.46%], test : [loss = 1.355, top1 = 64.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.406, top1 = 38.62%], valid : [loss = 2.517, top1 = 36.33%], test : [loss = 2.536, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.62%], valid : [loss = 0.854, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4240/15625) 004240-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.93%], valid : [loss = 0.632, top1 = 78.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.17 ms.
cifar10        train : [loss = 0.492, top1 = 82.90%], test  : [loss = 0.574, top1 = 80.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.03 ms.
cifar100       train : [loss = 1.676, top1 = 54.33%], valid : [loss = 1.855, top1 = 50.24%], test : [loss = 1.866, top1 = 50.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 3.336, top1 = 21.02%], valid : [loss = 3.324, top1 = 21.00%], test : [loss = 3.352, top1 = 20.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.29%], valid : [loss = 1.283, top1 = 53.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4241/15625) 004241-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.465, top1 = 88.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.10 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.331, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.24 ms.
cifar100       train : [loss = 0.331, top1 = 90.92%], valid : [loss = 1.300, top1 = 66.56%], test : [loss = 1.295, top1 = 67.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.45%], valid : [loss = 2.354, top1 = 41.67%], test : [loss = 2.385, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.20%], valid : [loss = 0.532, top1 = 82.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4242/15625) 004242-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.38%], valid : [loss = 0.667, top1 = 77.41%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.59 ms.
cifar10        train : [loss = 0.545, top1 = 80.83%], test  : [loss = 0.606, top1 = 79.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.17 ms.
cifar100       train : [loss = 1.808, top1 = 51.41%], valid : [loss = 1.973, top1 = 48.38%], test : [loss = 1.999, top1 = 47.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 3.395, top1 = 19.99%], valid : [loss = 3.357, top1 = 20.97%], test : [loss = 3.404, top1 = 19.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4243/15625) 004243-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.40 ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.44%], valid : [loss = 0.868, top1 = 71.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10        train : [loss = 0.570, top1 = 80.03%], test  : [loss = 0.725, top1 = 75.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.01 ms.
cifar100       train : [loss = 1.783, top1 = 52.08%], valid : [loss = 2.040, top1 = 47.00%], test : [loss = 2.076, top1 = 46.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.32 ms.
ImageNet16-120 train : [loss = 3.596, top1 = 16.63%], valid : [loss = 3.676, top1 = 15.43%], test : [loss = 3.672, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4244/15625) 004244-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.407, top1 = 91.34%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.80 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.274, top1 = 94.00%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=17.75 ms.
cifar100       train : [loss = 0.026, top1 = 99.80%], valid : [loss = 1.237, top1 = 72.98%], test : [loss = 1.222, top1 = 72.48%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.82 ms.
ImageNet16-120 train : [loss = 1.199, top1 = 66.74%], valid : [loss = 2.232, top1 = 45.23%], test : [loss = 2.238, top1 = 46.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.90%], valid : [loss = 0.490, top1 = 83.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4245/15625) 004245-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.586, top1 = 88.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.388, top1 = 91.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.91 ms.
cifar100       train : [loss = 0.206, top1 = 95.29%], valid : [loss = 1.405, top1 = 66.30%], test : [loss = 1.409, top1 = 66.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.01 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.20%], valid : [loss = 2.495, top1 = 37.67%], test : [loss = 2.525, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.42%], valid : [loss = 0.758, top1 = 73.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4246/15625) 004246-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.30%], valid : [loss = 0.758, top1 = 74.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10        train : [loss = 0.551, top1 = 80.88%], test  : [loss = 0.602, top1 = 79.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.03 ms.
cifar100       train : [loss = 1.747, top1 = 52.54%], valid : [loss = 1.896, top1 = 49.10%], test : [loss = 1.907, top1 = 49.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 3.397, top1 = 20.00%], valid : [loss = 3.353, top1 = 20.40%], test : [loss = 3.424, top1 = 18.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 50.07%], valid : [loss = 1.411, top1 = 48.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4247/15625) 004247-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.567, top1 = 88.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.75 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.391, top1 = 91.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.95 ms.
cifar100       train : [loss = 0.150, top1 = 96.73%], valid : [loss = 1.506, top1 = 66.64%], test : [loss = 1.490, top1 = 65.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.47 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.81%], valid : [loss = 2.444, top1 = 38.57%], test : [loss = 2.465, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.36%], valid : [loss = 0.778, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4248/15625) 004248-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.343, top1 = 88.09%], valid : [loss = 0.581, top1 = 81.14%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=14.37 ms.
cifar10        train : [loss = 0.282, top1 = 90.31%], test  : [loss = 0.431, top1 = 85.95%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=13.94 ms.
cifar100       train : [loss = 1.530, top1 = 57.33%], valid : [loss = 1.764, top1 = 52.49%], test : [loss = 1.756, top1 = 52.60%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.989, top1 = 26.96%], valid : [loss = 2.975, top1 = 27.73%], test : [loss = 3.031, top1 = 26.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.19%], valid : [loss = 1.074, top1 = 61.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4249/15625) 004249-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.84%], valid : [loss = 0.519, top1 = 86.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.081, top1 = 97.52%], test  : [loss = 0.349, top1 = 89.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.05 ms.
cifar100       train : [loss = 0.732, top1 = 78.72%], valid : [loss = 1.298, top1 = 64.80%], test : [loss = 1.279, top1 = 65.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.65 ms.
ImageNet16-120 train : [loss = 2.501, top1 = 36.60%], valid : [loss = 2.611, top1 = 35.23%], test : [loss = 2.643, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.56%], valid : [loss = 0.672, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4250/15625) 004250-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.56%], valid : [loss = 0.620, top1 = 84.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10        train : [loss = 0.071, top1 = 97.74%], test  : [loss = 0.411, top1 = 88.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.693, top1 = 79.51%], valid : [loss = 1.539, top1 = 60.58%], test : [loss = 1.528, top1 = 61.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.868, top1 = 28.93%], valid : [loss = 2.947, top1 = 26.63%], test : [loss = 2.986, top1 = 27.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.06%], valid : [loss = 0.986, top1 = 64.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4251/15625) 004251-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=10.95 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.02%], valid : [loss = 0.833, top1 = 72.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10        train : [loss = 0.546, top1 = 81.02%], test  : [loss = 0.706, top1 = 76.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 1.764, top1 = 52.57%], valid : [loss = 2.027, top1 = 47.12%], test : [loss = 2.073, top1 = 47.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.70%], valid : [loss = 3.639, top1 = 16.70%], test : [loss = 3.663, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4252/15625) 004252-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.524, top1 = 89.34%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.323, top1 = 92.79%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.77 ms.
cifar100       train : [loss = 0.099, top1 = 98.19%], valid : [loss = 1.307, top1 = 69.82%], test : [loss = 1.395, top1 = 68.62%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.57 ms.
ImageNet16-120 train : [loss = 1.752, top1 = 53.39%], valid : [loss = 2.222, top1 = 43.27%], test : [loss = 2.218, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.80%], valid : [loss = 0.747, top1 = 74.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4253/15625) 004253-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.69%], valid : [loss = 0.659, top1 = 77.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.503, top1 = 82.73%], test  : [loss = 0.584, top1 = 80.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.61 ms.
cifar100       train : [loss = 1.702, top1 = 53.44%], valid : [loss = 1.882, top1 = 50.38%], test : [loss = 1.888, top1 = 50.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 3.347, top1 = 20.91%], valid : [loss = 3.330, top1 = 21.87%], test : [loss = 3.362, top1 = 20.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4254/15625) 004254-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.64%], valid : [loss = 0.620, top1 = 86.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.035, top1 = 99.01%], test  : [loss = 0.401, top1 = 89.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.510, top1 = 84.90%], valid : [loss = 1.397, top1 = 65.46%], test : [loss = 1.393, top1 = 64.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.412, top1 = 38.53%], valid : [loss = 2.559, top1 = 36.07%], test : [loss = 2.609, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.81%], valid : [loss = 0.857, top1 = 70.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4255/15625) 004255-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.09%], valid : [loss = 0.462, top1 = 85.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10        train : [loss = 0.154, top1 = 94.98%], test  : [loss = 0.342, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.87 ms.
cifar100       train : [loss = 0.995, top1 = 71.68%], valid : [loss = 1.332, top1 = 62.68%], test : [loss = 1.340, top1 = 61.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.84%], valid : [loss = 2.696, top1 = 33.27%], test : [loss = 2.716, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.69%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4256/15625) 004256-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.94%], valid : [loss = 0.565, top1 = 86.70%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.060, top1 = 98.08%], test  : [loss = 0.366, top1 = 90.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.60 ms.
cifar100       train : [loss = 0.684, top1 = 79.98%], valid : [loss = 1.306, top1 = 64.64%], test : [loss = 1.317, top1 = 64.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.406, top1 = 38.61%], valid : [loss = 2.519, top1 = 36.63%], test : [loss = 2.554, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4257/15625) 004257-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.04%], valid : [loss = 0.539, top1 = 85.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10        train : [loss = 0.188, top1 = 93.66%], test  : [loss = 0.399, top1 = 87.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 1.015, top1 = 70.74%], valid : [loss = 1.398, top1 = 61.80%], test : [loss = 1.411, top1 = 60.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.737, top1 = 31.73%], valid : [loss = 2.795, top1 = 31.37%], test : [loss = 2.857, top1 = 29.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.64%], valid : [loss = 0.920, top1 = 67.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4258/15625) 004258-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.530, top1 = 89.06%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.54 ms.
cifar10        train : [loss = 0.007, top1 = 99.82%], test  : [loss = 0.344, top1 = 92.74%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.26 ms.
cifar100       train : [loss = 0.108, top1 = 97.59%], valid : [loss = 1.419, top1 = 67.88%], test : [loss = 1.434, top1 = 68.34%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.37%], valid : [loss = 2.439, top1 = 38.03%], test : [loss = 2.428, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 66.40%], valid : [loss = 0.947, top1 = 66.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4259/15625) 004259-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.503, top1 = 88.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.37 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.337, top1 = 91.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 0.479, top1 = 85.87%], valid : [loss = 1.346, top1 = 65.94%], test : [loss = 1.342, top1 = 65.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.37%], valid : [loss = 2.500, top1 = 36.13%], test : [loss = 2.552, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4260/15625) 004260-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.52%], valid : [loss = 0.616, top1 = 86.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.393, top1 = 90.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.481, top1 = 86.08%], valid : [loss = 1.423, top1 = 64.16%], test : [loss = 1.393, top1 = 64.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.369, top1 = 39.52%], valid : [loss = 2.539, top1 = 36.30%], test : [loss = 2.584, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.30%], valid : [loss = 0.865, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4261/15625) 004261-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.242, top1 = 91.80%], valid : [loss = 0.991, top1 = 73.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10        train : [loss = 0.283, top1 = 90.06%], test  : [loss = 0.607, top1 = 80.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 1.308, top1 = 63.05%], valid : [loss = 1.914, top1 = 51.20%], test : [loss = 1.882, top1 = 50.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 3.263, top1 = 22.08%], valid : [loss = 3.369, top1 = 20.53%], test : [loss = 3.380, top1 = 19.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.102, top1 = 60.05%], valid : [loss = 1.150, top1 = 58.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4262/15625) 004262-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.495, top1 = 88.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.342, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.54 ms.
cifar100       train : [loss = 0.355, top1 = 90.23%], valid : [loss = 1.273, top1 = 66.74%], test : [loss = 1.268, top1 = 67.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.74%], valid : [loss = 2.409, top1 = 38.23%], test : [loss = 2.410, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.08%], valid : [loss = 0.659, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4263/15625) 004263-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.72%], valid : [loss = 0.603, top1 = 87.35%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.57 ms.
cifar10        train : [loss = 0.016, top1 = 99.51%], test  : [loss = 0.409, top1 = 91.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.93 ms.
cifar100       train : [loss = 0.352, top1 = 89.96%], valid : [loss = 1.479, top1 = 63.88%], test : [loss = 1.465, top1 = 64.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 2.662, top1 = 32.52%], valid : [loss = 2.744, top1 = 30.03%], test : [loss = 2.781, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.02%], valid : [loss = 1.200, top1 = 56.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4264/15625) 004264-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.529, top1 = 89.56%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.96 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.335, top1 = 93.08%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.65 ms.
cifar100       train : [loss = 0.083, top1 = 98.33%], valid : [loss = 1.418, top1 = 68.50%], test : [loss = 1.471, top1 = 67.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.09 ms.
ImageNet16-120 train : [loss = 1.668, top1 = 55.30%], valid : [loss = 2.172, top1 = 44.40%], test : [loss = 2.183, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.69%], valid : [loss = 0.643, top1 = 78.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4265/15625) 004265-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.471, top1 = 89.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.357, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 0.253, top1 = 93.23%], valid : [loss = 1.417, top1 = 66.20%], test : [loss = 1.410, top1 = 66.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.61%], valid : [loss = 2.371, top1 = 40.93%], test : [loss = 2.381, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 82.02%], valid : [loss = 0.610, top1 = 79.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4266/15625) 004266-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.537, top1 = 89.27%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.358, top1 = 92.81%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.69 ms.
cifar100       train : [loss = 0.065, top1 = 99.10%], valid : [loss = 1.448, top1 = 68.84%], test : [loss = 1.462, top1 = 68.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.68 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.26%], valid : [loss = 2.415, top1 = 40.43%], test : [loss = 2.402, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.82%], valid : [loss = 0.679, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4267/15625) 004267-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.557, top1 = 89.21%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.16 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.338, top1 = 92.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.56 ms.
cifar100       train : [loss = 0.175, top1 = 95.96%], valid : [loss = 1.294, top1 = 69.02%], test : [loss = 1.279, top1 = 69.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.85 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.61%], valid : [loss = 2.286, top1 = 41.57%], test : [loss = 2.258, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.16%], valid : [loss = 0.743, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4268/15625) 004268-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.584, top1 = 88.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.390, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.94 ms.
cifar100       train : [loss = 0.115, top1 = 97.93%], valid : [loss = 1.514, top1 = 67.38%], test : [loss = 1.484, top1 = 67.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.34%], valid : [loss = 2.456, top1 = 38.13%], test : [loss = 2.453, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.70%], valid : [loss = 0.769, top1 = 73.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4269/15625) 004269-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.490, top1 = 90.30%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.65 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.319, top1 = 93.24%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.60 ms.
cifar100       train : [loss = 0.066, top1 = 99.00%], valid : [loss = 1.302, top1 = 70.88%], test : [loss = 1.321, top1 = 70.72%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.56%], valid : [loss = 2.140, top1 = 44.47%], test : [loss = 2.150, top1 = 45.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.62%], valid : [loss = 0.921, top1 = 67.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4270/15625) 004270-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.98%], valid : [loss = 0.725, top1 = 75.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.35 ms.
cifar10        train : [loss = 0.550, top1 = 81.04%], test  : [loss = 0.601, top1 = 79.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 2.009, top1 = 46.37%], valid : [loss = 2.125, top1 = 44.49%], test : [loss = 2.105, top1 = 44.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.52%], valid : [loss = 3.203, top1 = 23.46%], test : [loss = 3.230, top1 = 22.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 53.41%], valid : [loss = 1.355, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4271/15625) 004271-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.591, top1 = 87.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.382, top1 = 91.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.92 ms.
cifar100       train : [loss = 0.159, top1 = 95.88%], valid : [loss = 1.459, top1 = 66.98%], test : [loss = 1.417, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.357, top1 = 39.20%], valid : [loss = 2.498, top1 = 36.27%], test : [loss = 2.549, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.957, top1 = 65.54%], valid : [loss = 0.980, top1 = 64.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4272/15625) 004272-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.475, top1 = 89.16%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.65 ms.
cifar10        train : [loss = 0.015, top1 = 99.70%], test  : [loss = 0.308, top1 = 92.41%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.45 ms.
cifar100       train : [loss = 0.267, top1 = 93.14%], valid : [loss = 1.209, top1 = 68.88%], test : [loss = 1.244, top1 = 68.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.92%], valid : [loss = 2.261, top1 = 42.13%], test : [loss = 2.220, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.29%], valid : [loss = 0.666, top1 = 77.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4273/15625) 004273-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.72%], valid : [loss = 0.844, top1 = 79.91%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.121, top1 = 95.96%], test  : [loss = 0.534, top1 = 85.52%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 0.856, top1 = 75.25%], valid : [loss = 1.671, top1 = 57.18%], test : [loss = 1.695, top1 = 57.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.42%], valid : [loss = 3.181, top1 = 23.67%], test : [loss = 3.192, top1 = 23.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4274/15625) 004274-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.515, top1 = 88.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.339, top1 = 91.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.08 ms.
cifar100       train : [loss = 0.338, top1 = 90.81%], valid : [loss = 1.278, top1 = 67.15%], test : [loss = 1.296, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.80%], valid : [loss = 2.420, top1 = 39.12%], test : [loss = 2.428, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4275/15625) 004275-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.491, top1 = 90.10%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.89 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 93.39%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.20 ms.
cifar100       train : [loss = 0.093, top1 = 98.38%], valid : [loss = 1.321, top1 = 69.16%], test : [loss = 1.297, top1 = 69.48%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.640, top1 = 56.01%], valid : [loss = 2.114, top1 = 45.97%], test : [loss = 2.140, top1 = 45.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.64%], valid : [loss = 0.631, top1 = 78.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4276/15625) 004276-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.607, top1 = 86.24%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10        train : [loss = 0.030, top1 = 99.27%], test  : [loss = 0.431, top1 = 89.50%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.51 ms.
cifar100       train : [loss = 0.383, top1 = 89.91%], valid : [loss = 1.398, top1 = 65.84%], test : [loss = 1.408, top1 = 65.14%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.26%], valid : [loss = 2.613, top1 = 35.40%], test : [loss = 2.632, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.14%], valid : [loss = 0.750, top1 = 74.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4277/15625) 004277-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.154, top1 = 95.01%], valid : [loss = 0.915, top1 = 76.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10        train : [loss = 0.211, top1 = 92.74%], test  : [loss = 0.606, top1 = 82.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.96 ms.
cifar100       train : [loss = 1.144, top1 = 67.32%], valid : [loss = 1.746, top1 = 53.76%], test : [loss = 1.769, top1 = 54.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 3.236, top1 = 22.56%], valid : [loss = 3.341, top1 = 21.43%], test : [loss = 3.384, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.86%], valid : [loss = 1.081, top1 = 61.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4278/15625) 004278-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.499, top1 = 89.93%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.85 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.307, top1 = 93.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.74 ms.
cifar100       train : [loss = 0.127, top1 = 97.28%], valid : [loss = 1.343, top1 = 68.40%], test : [loss = 1.328, top1 = 69.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=24.39 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.26%], valid : [loss = 2.235, top1 = 42.57%], test : [loss = 2.229, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.78%], valid : [loss = 0.831, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4279/15625) 004279-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.44%], valid : [loss = 0.532, top1 = 84.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.172, top1 = 94.26%], test  : [loss = 0.379, top1 = 87.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 1.160, top1 = 66.75%], valid : [loss = 1.508, top1 = 58.70%], test : [loss = 1.474, top1 = 59.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.83%], valid : [loss = 2.693, top1 = 32.92%], test : [loss = 2.719, top1 = 32.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.09%], valid : [loss = 0.964, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4280/15625) 004280-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.543, top1 = 88.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.60 ms.
cifar10        train : [loss = 0.019, top1 = 99.44%], test  : [loss = 0.367, top1 = 91.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.62 ms.
cifar100       train : [loss = 0.299, top1 = 91.76%], valid : [loss = 1.328, top1 = 66.64%], test : [loss = 1.320, top1 = 67.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.098, top1 = 45.14%], valid : [loss = 2.367, top1 = 39.33%], test : [loss = 2.362, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.35%], valid : [loss = 0.834, top1 = 70.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4281/15625) 004281-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.506, top1 = 89.78%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.45 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.323, top1 = 93.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.81 ms.
cifar100       train : [loss = 0.067, top1 = 99.00%], valid : [loss = 1.356, top1 = 69.50%], test : [loss = 1.331, top1 = 70.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.85 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.60%], valid : [loss = 2.375, top1 = 38.67%], test : [loss = 2.373, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.78%], valid : [loss = 0.765, top1 = 73.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4282/15625) 004282-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.76%], valid : [loss = 0.464, top1 = 85.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.95 ms.
cifar10        train : [loss = 0.163, top1 = 94.63%], test  : [loss = 0.360, top1 = 88.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.72 ms.
cifar100       train : [loss = 1.006, top1 = 71.14%], valid : [loss = 1.364, top1 = 62.24%], test : [loss = 1.362, top1 = 61.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.56%], valid : [loss = 2.680, top1 = 32.17%], test : [loss = 2.708, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4283/15625) 004283-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.438, top1 = 89.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.11 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.301, top1 = 92.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.90 ms.
cifar100       train : [loss = 0.197, top1 = 95.49%], valid : [loss = 1.286, top1 = 68.46%], test : [loss = 1.271, top1 = 69.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.28%], valid : [loss = 2.251, top1 = 43.05%], test : [loss = 2.268, top1 = 42.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.405, top1 = 86.08%], valid : [loss = 0.522, top1 = 82.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4284/15625) 004284-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.531, top1 = 88.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10        train : [loss = 0.014, top1 = 99.62%], test  : [loss = 0.351, top1 = 91.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.98 ms.
cifar100       train : [loss = 0.288, top1 = 92.03%], valid : [loss = 1.345, top1 = 67.00%], test : [loss = 1.309, top1 = 67.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 43.98%], valid : [loss = 2.413, top1 = 39.40%], test : [loss = 2.412, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.54%], valid : [loss = 1.006, top1 = 63.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4285/15625) 004285-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.573, top1 = 87.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.47 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.393, top1 = 90.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 0.412, top1 = 88.27%], valid : [loss = 1.380, top1 = 65.44%], test : [loss = 1.354, top1 = 65.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.67%], valid : [loss = 2.509, top1 = 37.13%], test : [loss = 2.550, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4286/15625) 004286-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.37%], valid : [loss = 0.464, top1 = 86.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10        train : [loss = 0.160, top1 = 94.83%], test  : [loss = 0.346, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.69 ms.
cifar100       train : [loss = 0.995, top1 = 71.62%], valid : [loss = 1.368, top1 = 61.46%], test : [loss = 1.359, top1 = 62.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.15%], valid : [loss = 2.693, top1 = 33.33%], test : [loss = 2.705, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4287/15625) 004287-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.27%], valid : [loss = 0.623, top1 = 85.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10        train : [loss = 0.042, top1 = 98.73%], test  : [loss = 0.405, top1 = 89.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.32 ms.
cifar100       train : [loss = 0.395, top1 = 88.85%], valid : [loss = 1.604, top1 = 61.60%], test : [loss = 1.617, top1 = 61.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.03 ms.
ImageNet16-120 train : [loss = 2.836, top1 = 29.26%], valid : [loss = 2.921, top1 = 27.83%], test : [loss = 2.942, top1 = 27.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.37%], valid : [loss = 1.051, top1 = 62.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4288/15625) 004288-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.50%], valid : [loss = 1.004, top1 = 74.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.29 ms.
cifar10        train : [loss = 0.215, top1 = 92.59%], test  : [loss = 0.596, top1 = 82.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.89 ms.
cifar100       train : [loss = 1.119, top1 = 68.16%], valid : [loss = 1.789, top1 = 53.54%], test : [loss = 1.784, top1 = 53.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 3.217, top1 = 23.05%], valid : [loss = 3.299, top1 = 21.83%], test : [loss = 3.364, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.92%], valid : [loss = 1.068, top1 = 62.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4289/15625) 004289-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.514, top1 = 88.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.325, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.11 ms.
cifar100       train : [loss = 0.309, top1 = 91.70%], valid : [loss = 1.270, top1 = 67.63%], test : [loss = 1.271, top1 = 67.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.076, top1 = 45.75%], valid : [loss = 2.380, top1 = 39.54%], test : [loss = 2.394, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.82%], valid : [loss = 0.717, top1 = 75.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4290/15625) 004290-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.510, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.22 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.349, top1 = 92.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.18 ms.
cifar100       train : [loss = 0.118, top1 = 97.71%], valid : [loss = 1.450, top1 = 67.58%], test : [loss = 1.454, top1 = 67.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.55%], valid : [loss = 2.364, top1 = 40.41%], test : [loss = 2.379, top1 = 40.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.27%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4291/15625) 004291-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.32%], valid : [loss = 0.520, top1 = 87.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10        train : [loss = 0.058, top1 = 98.24%], test  : [loss = 0.364, top1 = 90.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.55 ms.
cifar100       train : [loss = 0.636, top1 = 81.29%], valid : [loss = 1.321, top1 = 65.12%], test : [loss = 1.304, top1 = 65.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.34%], valid : [loss = 2.506, top1 = 36.28%], test : [loss = 2.550, top1 = 35.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.79%], valid : [loss = 0.611, top1 = 79.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4292/15625) 004292-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.28%], valid : [loss = 0.606, top1 = 85.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10        train : [loss = 0.068, top1 = 97.93%], test  : [loss = 0.394, top1 = 88.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.00 ms.
cifar100       train : [loss = 0.716, top1 = 79.24%], valid : [loss = 1.387, top1 = 63.05%], test : [loss = 1.360, top1 = 63.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.62%], valid : [loss = 2.661, top1 = 33.52%], test : [loss = 2.708, top1 = 32.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4293/15625) 004293-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.59%], valid : [loss = 0.854, top1 = 72.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10        train : [loss = 0.550, top1 = 80.77%], test  : [loss = 0.705, top1 = 75.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.61 ms.
cifar100       train : [loss = 1.796, top1 = 51.83%], valid : [loss = 2.071, top1 = 46.38%], test : [loss = 2.083, top1 = 46.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.87%], valid : [loss = 3.626, top1 = 16.79%], test : [loss = 3.667, top1 = 15.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4294/15625) 004294-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.52%], valid : [loss = 0.515, top1 = 86.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.085, top1 = 97.27%], test  : [loss = 0.355, top1 = 90.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.26 ms.
cifar100       train : [loss = 0.649, top1 = 81.11%], valid : [loss = 1.218, top1 = 66.53%], test : [loss = 1.212, top1 = 66.57%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.08%], valid : [loss = 2.441, top1 = 38.24%], test : [loss = 2.455, top1 = 38.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 68.93%], valid : [loss = 0.895, top1 = 67.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4295/15625) 004295-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.29%], valid : [loss = 0.454, top1 = 86.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.157, top1 = 94.90%], test  : [loss = 0.346, top1 = 88.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 1.003, top1 = 71.60%], valid : [loss = 1.363, top1 = 61.93%], test : [loss = 1.358, top1 = 61.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.68%], valid : [loss = 2.695, top1 = 33.02%], test : [loss = 2.712, top1 = 32.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.32%], valid : [loss = 0.770, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4296/15625) 004296-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.73%], valid : [loss = 0.459, top1 = 86.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.146, top1 = 95.36%], test  : [loss = 0.339, top1 = 89.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.11 ms.
cifar100       train : [loss = 0.962, top1 = 72.55%], valid : [loss = 1.335, top1 = 62.64%], test : [loss = 1.336, top1 = 62.43%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.28%], valid : [loss = 2.682, top1 = 33.00%], test : [loss = 2.693, top1 = 32.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4297/15625) 004297-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.506, top1 = 89.19%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.337, top1 = 92.09%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.05 ms.
cifar100       train : [loss = 0.229, top1 = 94.08%], valid : [loss = 1.271, top1 = 68.73%], test : [loss = 1.269, top1 = 68.95%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.79%], valid : [loss = 2.232, top1 = 42.91%], test : [loss = 2.229, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.687, top1 = 76.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4298/15625) 004298-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.571, top1 = 88.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.364, top1 = 91.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.15 ms.
cifar100       train : [loss = 0.312, top1 = 91.52%], valid : [loss = 1.310, top1 = 67.23%], test : [loss = 1.339, top1 = 67.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.65%], valid : [loss = 2.340, top1 = 40.30%], test : [loss = 2.328, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.28%], valid : [loss = 0.797, top1 = 71.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4299/15625) 004299-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.639, top1 = 86.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.019, top1 = 99.49%], test  : [loss = 0.452, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.53 ms.
cifar100       train : [loss = 0.287, top1 = 92.34%], valid : [loss = 1.492, top1 = 64.84%], test : [loss = 1.486, top1 = 65.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.43%], valid : [loss = 2.595, top1 = 35.31%], test : [loss = 2.619, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.10%], valid : [loss = 0.788, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4300/15625) 004300-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.31%], valid : [loss = 0.450, top1 = 87.13%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.28 ms.
cifar10        train : [loss = 0.114, top1 = 96.51%], test  : [loss = 0.323, top1 = 89.83%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.91 ms.
cifar100       train : [loss = 0.869, top1 = 75.33%], valid : [loss = 1.302, top1 = 63.47%], test : [loss = 1.302, top1 = 63.61%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.49%], valid : [loss = 2.639, top1 = 33.99%], test : [loss = 2.654, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.14%], valid : [loss = 0.642, top1 = 77.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4301/15625) 004301-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.616, top1 = 87.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.392, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 0.208, top1 = 95.14%], valid : [loss = 1.426, top1 = 66.24%], test : [loss = 1.424, top1 = 66.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.98%], valid : [loss = 2.485, top1 = 37.92%], test : [loss = 2.518, top1 = 38.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4302/15625) 004302-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.80%], valid : [loss = 0.856, top1 = 72.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10        train : [loss = 0.549, top1 = 80.79%], test  : [loss = 0.706, top1 = 76.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.73 ms.
cifar100       train : [loss = 1.777, top1 = 52.20%], valid : [loss = 2.056, top1 = 47.12%], test : [loss = 2.068, top1 = 46.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.87%], valid : [loss = 3.643, top1 = 16.64%], test : [loss = 3.675, top1 = 15.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4303/15625) 004303-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10-valid  train : [loss = 0.815, top1 = 71.18%], valid : [loss = 0.992, top1 = 66.01%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10        train : [loss = 0.770, top1 = 73.03%], test  : [loss = 0.846, top1 = 70.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.95 ms.
cifar100       train : [loss = 2.127, top1 = 44.16%], valid : [loss = 2.306, top1 = 41.35%], test : [loss = 2.327, top1 = 41.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.61 ms.
ImageNet16-120 train : [loss = 3.743, top1 = 14.22%], valid : [loss = 3.773, top1 = 14.30%], test : [loss = 3.779, top1 = 13.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4304/15625) 004304-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.25%], valid : [loss = 0.464, top1 = 86.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.94 ms.
cifar10        train : [loss = 0.159, top1 = 94.83%], test  : [loss = 0.343, top1 = 88.94%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.21 ms.
cifar100       train : [loss = 0.991, top1 = 71.80%], valid : [loss = 1.350, top1 = 62.66%], test : [loss = 1.342, top1 = 62.25%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.65%], valid : [loss = 2.697, top1 = 32.70%], test : [loss = 2.726, top1 = 32.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.93%], valid : [loss = 0.766, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4305/15625) 004305-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.591, top1 = 87.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.10 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.390, top1 = 90.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 0.330, top1 = 90.82%], valid : [loss = 1.419, top1 = 65.01%], test : [loss = 1.417, top1 = 65.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.24%], valid : [loss = 2.472, top1 = 37.61%], test : [loss = 2.477, top1 = 37.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.02%], valid : [loss = 0.843, top1 = 70.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4306/15625) 004306-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.08%], valid : [loss = 0.572, top1 = 86.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10        train : [loss = 0.064, top1 = 97.92%], test  : [loss = 0.373, top1 = 89.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.94 ms.
cifar100       train : [loss = 0.677, top1 = 80.00%], valid : [loss = 1.317, top1 = 64.85%], test : [loss = 1.321, top1 = 64.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.87%], valid : [loss = 2.458, top1 = 37.28%], test : [loss = 2.506, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4307/15625) 004307-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.522, top1 = 88.73%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.28 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.326, top1 = 92.25%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.49 ms.
cifar100       train : [loss = 0.195, top1 = 95.33%], valid : [loss = 1.264, top1 = 68.79%], test : [loss = 1.266, top1 = 69.31%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.52%], valid : [loss = 2.270, top1 = 41.96%], test : [loss = 2.284, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.771, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4308/15625) 004308-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.41%], valid : [loss = 0.848, top1 = 72.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10        train : [loss = 0.557, top1 = 80.57%], test  : [loss = 0.716, top1 = 75.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.45 ms.
cifar100       train : [loss = 1.791, top1 = 51.75%], valid : [loss = 2.058, top1 = 46.76%], test : [loss = 2.058, top1 = 46.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.76%], valid : [loss = 3.648, top1 = 16.46%], test : [loss = 3.673, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4309/15625) 004309-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.04%], valid : [loss = 0.554, top1 = 86.87%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.22 ms.
cifar10        train : [loss = 0.063, top1 = 97.97%], test  : [loss = 0.382, top1 = 89.73%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.33 ms.
cifar100       train : [loss = 0.661, top1 = 80.47%], valid : [loss = 1.334, top1 = 64.15%], test : [loss = 1.345, top1 = 64.51%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.405, top1 = 38.54%], valid : [loss = 2.537, top1 = 35.73%], test : [loss = 2.563, top1 = 35.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.20%], valid : [loss = 0.885, top1 = 68.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4310/15625) 004310-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.659, top1 = 86.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.446, top1 = 90.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.72 ms.
cifar100       train : [loss = 0.210, top1 = 94.94%], valid : [loss = 1.631, top1 = 63.88%], test : [loss = 1.640, top1 = 63.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.45%], valid : [loss = 2.497, top1 = 37.57%], test : [loss = 2.519, top1 = 37.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.12%], valid : [loss = 0.811, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4311/15625) 004311-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.417, top1 = 85.43%], valid : [loss = 0.630, top1 = 79.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.355, top1 = 87.66%], test  : [loss = 0.485, top1 = 83.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.83 ms.
cifar100       train : [loss = 1.688, top1 = 53.40%], valid : [loss = 1.903, top1 = 49.35%], test : [loss = 1.891, top1 = 49.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.95 ms.
ImageNet16-120 train : [loss = 3.156, top1 = 23.78%], valid : [loss = 3.136, top1 = 24.02%], test : [loss = 3.204, top1 = 23.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.148, top1 = 58.27%], valid : [loss = 1.197, top1 = 57.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4312/15625) 004312-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.563, top1 = 88.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.363, top1 = 92.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 0.154, top1 = 96.74%], valid : [loss = 1.410, top1 = 67.97%], test : [loss = 1.428, top1 = 67.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.60%], valid : [loss = 2.412, top1 = 39.66%], test : [loss = 2.439, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.82%], valid : [loss = 0.737, top1 = 74.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4313/15625) 004313-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.614, top1 = 86.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.031, top1 = 99.15%], test  : [loss = 0.391, top1 = 90.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.519, top1 = 84.90%], valid : [loss = 1.422, top1 = 64.19%], test : [loss = 1.425, top1 = 63.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.22%], valid : [loss = 2.511, top1 = 36.61%], test : [loss = 2.547, top1 = 36.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.807, top1 = 71.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4314/15625) 004314-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.05%], valid : [loss = 0.482, top1 = 84.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10        train : [loss = 0.299, top1 = 89.94%], test  : [loss = 0.397, top1 = 86.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.41 ms.
cifar100       train : [loss = 1.329, top1 = 63.12%], valid : [loss = 1.537, top1 = 57.85%], test : [loss = 1.514, top1 = 58.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.64%], valid : [loss = 2.909, top1 = 29.14%], test : [loss = 2.951, top1 = 28.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4315/15625) 004315-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.51%], valid : [loss = 1.112, top1 = 63.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.19 ms.
cifar10        train : [loss = 0.774, top1 = 72.72%], test  : [loss = 0.915, top1 = 68.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.15 ms.
cifar100       train : [loss = 2.119, top1 = 44.30%], valid : [loss = 2.396, top1 = 39.83%], test : [loss = 2.409, top1 = 39.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 3.755, top1 = 14.00%], valid : [loss = 3.813, top1 = 13.43%], test : [loss = 3.827, top1 = 13.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.380, top1 = 49.66%], valid : [loss = 1.437, top1 = 48.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4316/15625) 004316-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.76%], valid : [loss = 0.469, top1 = 86.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.58 ms.
cifar10        train : [loss = 0.152, top1 = 95.09%], test  : [loss = 0.343, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 0.971, top1 = 72.44%], valid : [loss = 1.360, top1 = 62.25%], test : [loss = 1.340, top1 = 62.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.14%], valid : [loss = 2.688, top1 = 32.92%], test : [loss = 2.698, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4317/15625) 004317-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 31.38 M, Params=0.241 MB, latency=22.63 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.13%], valid : [loss = 0.470, top1 = 86.51%]
cifar10        FLOP= 31.38 M, Params=0.241 MB, latency=22.65 ms.
cifar10        train : [loss = 0.098, top1 = 97.07%], test  : [loss = 0.340, top1 = 89.37%]
cifar100       FLOP= 31.38 M, Params=0.247 MB, latency=21.61 ms.
cifar100       train : [loss = 0.586, top1 = 84.28%], valid : [loss = 1.258, top1 = 65.40%], test : [loss = 1.274, top1 = 65.71%]
ImageNet16-120 FLOP=  7.85 M, Params=0.248 MB, latency=21.04 ms.
ImageNet16-120 train : [loss = 2.440, top1 = 38.04%], valid : [loss = 2.561, top1 = 35.32%], test : [loss = 2.569, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 31.38 M, Params=0.241 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.33%], valid : [loss = 0.951, top1 = 66.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4318/15625) 004318-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.14%], valid : [loss = 0.526, top1 = 83.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10        train : [loss = 0.237, top1 = 91.85%], test  : [loss = 0.388, top1 = 87.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 1.305, top1 = 63.20%], valid : [loss = 1.579, top1 = 57.04%], test : [loss = 1.567, top1 = 57.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 2.850, top1 = 29.75%], valid : [loss = 2.862, top1 = 30.06%], test : [loss = 2.928, top1 = 28.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4319/15625) 004319-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.72%], valid : [loss = 0.864, top1 = 71.81%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10        train : [loss = 0.555, top1 = 80.60%], test  : [loss = 0.714, top1 = 75.85%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.87 ms.
cifar100       train : [loss = 1.781, top1 = 52.02%], valid : [loss = 2.057, top1 = 47.17%], test : [loss = 2.079, top1 = 46.96%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.06 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.78%], valid : [loss = 3.640, top1 = 16.69%], test : [loss = 3.680, top1 = 15.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4320/15625) 004320-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.619, top1 = 86.30%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10        train : [loss = 0.027, top1 = 99.34%], test  : [loss = 0.419, top1 = 89.62%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.32 ms.
cifar100       train : [loss = 0.355, top1 = 90.72%], valid : [loss = 1.447, top1 = 64.41%], test : [loss = 1.415, top1 = 64.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.37%], valid : [loss = 2.614, top1 = 34.87%], test : [loss = 2.645, top1 = 35.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.93%], valid : [loss = 0.759, top1 = 73.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4321/15625) 004321-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.25%], valid : [loss = 0.452, top1 = 86.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.156, top1 = 94.95%], test  : [loss = 0.347, top1 = 88.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.69 ms.
cifar100       train : [loss = 0.996, top1 = 71.57%], valid : [loss = 1.352, top1 = 62.22%], test : [loss = 1.343, top1 = 62.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.85%], valid : [loss = 2.678, top1 = 33.01%], test : [loss = 2.712, top1 = 32.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4322/15625) 004322-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.571, top1 = 87.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.391, top1 = 91.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.53 ms.
cifar100       train : [loss = 0.410, top1 = 88.35%], valid : [loss = 1.406, top1 = 65.55%], test : [loss = 1.388, top1 = 65.63%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.80%], valid : [loss = 2.520, top1 = 36.43%], test : [loss = 2.532, top1 = 36.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4323/15625) 004323-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.526, top1 = 89.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.347, top1 = 92.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.118, top1 = 97.53%], valid : [loss = 1.356, top1 = 68.83%], test : [loss = 1.347, top1 = 69.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.49%], valid : [loss = 2.196, top1 = 43.46%], test : [loss = 2.221, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.90%], valid : [loss = 0.655, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4324/15625) 004324-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.28%], valid : [loss = 0.841, top1 = 72.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.29 ms.
cifar10        train : [loss = 0.566, top1 = 80.22%], test  : [loss = 0.718, top1 = 75.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.46 ms.
cifar100       train : [loss = 1.796, top1 = 51.68%], valid : [loss = 2.055, top1 = 47.03%], test : [loss = 2.068, top1 = 46.41%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.71%], valid : [loss = 3.635, top1 = 16.61%], test : [loss = 3.666, top1 = 15.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.09%], valid : [loss = 1.257, top1 = 55.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4325/15625) 004325-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.53%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.321, top1 = 93.06%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.42 ms.
cifar100       train : [loss = 0.110, top1 = 97.97%], valid : [loss = 1.300, top1 = 69.48%], test : [loss = 1.300, top1 = 70.25%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.43 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.21%], valid : [loss = 2.302, top1 = 42.13%], test : [loss = 2.295, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.55%], valid : [loss = 0.749, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4326/15625) 004326-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.87%], valid : [loss = 0.469, top1 = 84.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.43 ms.
cifar10        train : [loss = 0.302, top1 = 89.95%], test  : [loss = 0.397, top1 = 86.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.30 ms.
cifar100       train : [loss = 1.327, top1 = 63.12%], valid : [loss = 1.533, top1 = 57.69%], test : [loss = 1.507, top1 = 58.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.64%], valid : [loss = 2.906, top1 = 29.14%], test : [loss = 2.967, top1 = 28.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.81%], valid : [loss = 0.768, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4327/15625) 004327-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.22%], valid : [loss = 0.449, top1 = 87.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10        train : [loss = 0.115, top1 = 96.46%], test  : [loss = 0.323, top1 = 89.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.09 ms.
cifar100       train : [loss = 0.862, top1 = 75.42%], valid : [loss = 1.302, top1 = 63.57%], test : [loss = 1.286, top1 = 63.93%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.68%], valid : [loss = 2.618, top1 = 34.73%], test : [loss = 2.658, top1 = 33.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.89%], valid : [loss = 0.659, top1 = 77.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4328/15625) 004328-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.27%], valid : [loss = 0.455, top1 = 86.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.159, top1 = 94.80%], test  : [loss = 0.351, top1 = 88.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.91 ms.
cifar100       train : [loss = 1.001, top1 = 71.51%], valid : [loss = 1.365, top1 = 61.40%], test : [loss = 1.357, top1 = 61.67%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.89%], valid : [loss = 2.690, top1 = 33.16%], test : [loss = 2.704, top1 = 32.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4329/15625) 004329-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.678, top1 = 85.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.055, top1 = 98.27%], test  : [loss = 0.440, top1 = 88.63%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.42 ms.
cifar100       train : [loss = 0.630, top1 = 81.59%], valid : [loss = 1.499, top1 = 62.23%], test : [loss = 1.494, top1 = 62.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.661, top1 = 33.50%], valid : [loss = 2.811, top1 = 30.84%], test : [loss = 2.861, top1 = 29.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.890, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4330/15625) 004330-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.500, top1 = 88.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.320, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.42 ms.
cifar100       train : [loss = 0.324, top1 = 91.20%], valid : [loss = 1.279, top1 = 67.31%], test : [loss = 1.294, top1 = 67.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.26%], valid : [loss = 2.392, top1 = 39.26%], test : [loss = 2.400, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4331/15625) 004331-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.97%], valid : [loss = 0.530, top1 = 86.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10        train : [loss = 0.074, top1 = 97.69%], test  : [loss = 0.362, top1 = 89.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 0.701, top1 = 79.22%], valid : [loss = 1.362, top1 = 64.37%], test : [loss = 1.340, top1 = 64.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.05%], valid : [loss = 2.641, top1 = 34.24%], test : [loss = 2.673, top1 = 33.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4332/15625) 004332-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.529, top1 = 88.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.336, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.339, top1 = 90.62%], valid : [loss = 1.295, top1 = 66.59%], test : [loss = 1.293, top1 = 66.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.78%], valid : [loss = 2.409, top1 = 39.06%], test : [loss = 2.400, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4333/15625) 004333-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.183, top1 = 93.76%], valid : [loss = 0.729, top1 = 79.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10        train : [loss = 0.184, top1 = 93.66%], test  : [loss = 0.505, top1 = 84.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.36 ms.
cifar100       train : [loss = 0.878, top1 = 74.35%], valid : [loss = 1.634, top1 = 57.77%], test : [loss = 1.654, top1 = 57.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 3.499, top1 = 16.74%], valid : [loss = 3.481, top1 = 16.93%], test : [loss = 3.500, top1 = 16.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.63%], valid : [loss = 1.283, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4334/15625) 004334-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.615, top1 = 87.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.13 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.402, top1 = 91.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.60 ms.
cifar100       train : [loss = 0.236, top1 = 93.93%], valid : [loss = 1.563, top1 = 63.81%], test : [loss = 1.573, top1 = 64.03%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.17%], valid : [loss = 2.461, top1 = 38.30%], test : [loss = 2.484, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.20%], valid : [loss = 0.834, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4335/15625) 004335-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.05%], valid : [loss = 0.509, top1 = 86.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.101, top1 = 96.80%], test  : [loss = 0.357, top1 = 89.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 0.739, top1 = 78.63%], valid : [loss = 1.307, top1 = 64.30%], test : [loss = 1.302, top1 = 64.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 37.00%], valid : [loss = 2.551, top1 = 35.66%], test : [loss = 2.589, top1 = 34.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.67%], valid : [loss = 0.907, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4336/15625) 004336-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.614, top1 = 87.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.407, top1 = 91.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.206, top1 = 95.20%], valid : [loss = 1.447, top1 = 66.65%], test : [loss = 1.444, top1 = 66.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.74%], valid : [loss = 2.502, top1 = 37.53%], test : [loss = 2.513, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4337/15625) 004337-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.71%], valid : [loss = 0.767, top1 = 82.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10        train : [loss = 0.092, top1 = 97.02%], test  : [loss = 0.487, top1 = 86.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.86 ms.
cifar100       train : [loss = 0.810, top1 = 76.38%], valid : [loss = 1.513, top1 = 60.35%], test : [loss = 1.488, top1 = 60.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.814, top1 = 30.35%], valid : [loss = 2.927, top1 = 28.19%], test : [loss = 2.986, top1 = 27.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.28%], valid : [loss = 0.864, top1 = 70.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4338/15625) 004338-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.662, top1 = 87.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.438, top1 = 91.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.60 ms.
cifar100       train : [loss = 0.157, top1 = 96.62%], valid : [loss = 1.575, top1 = 65.30%], test : [loss = 1.601, top1 = 64.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.45%], valid : [loss = 2.627, top1 = 34.79%], test : [loss = 2.669, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.93%], valid : [loss = 0.785, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4339/15625) 004339-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.595, top1 = 88.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.411, top1 = 91.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.28 ms.
cifar100       train : [loss = 0.096, top1 = 98.26%], valid : [loss = 1.564, top1 = 66.38%], test : [loss = 1.550, top1 = 66.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.25 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 49.02%], valid : [loss = 2.412, top1 = 39.09%], test : [loss = 2.405, top1 = 40.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.61%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4340/15625) 004340-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.485, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.314, top1 = 91.61%], valid : [loss = 1.236, top1 = 67.94%], test : [loss = 1.254, top1 = 67.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.69%], valid : [loss = 2.344, top1 = 40.19%], test : [loss = 2.360, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.18%], valid : [loss = 0.595, top1 = 79.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4341/15625) 004341-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.875, top1 = 82.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.581, top1 = 87.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.365, top1 = 90.22%], valid : [loss = 1.786, top1 = 59.63%], test : [loss = 1.794, top1 = 59.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 34.28%], valid : [loss = 3.024, top1 = 27.20%], test : [loss = 3.043, top1 = 27.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.863, top1 = 69.30%], valid : [loss = 0.940, top1 = 66.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4342/15625) 004342-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.484, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.311, top1 = 92.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.327, top1 = 91.20%], valid : [loss = 1.246, top1 = 68.24%], test : [loss = 1.261, top1 = 67.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.66%], valid : [loss = 2.305, top1 = 41.11%], test : [loss = 2.318, top1 = 40.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4343/15625) 004343-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.42%], valid : [loss = 0.590, top1 = 87.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.93 ms.
cifar10        train : [loss = 0.022, top1 = 99.37%], test  : [loss = 0.395, top1 = 90.97%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.43 ms.
cifar100       train : [loss = 0.391, top1 = 88.79%], valid : [loss = 1.485, top1 = 63.51%], test : [loss = 1.464, top1 = 63.96%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 3.002, top1 = 25.45%], valid : [loss = 3.064, top1 = 24.19%], test : [loss = 3.063, top1 = 23.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 53.30%], valid : [loss = 1.261, top1 = 54.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4344/15625) 004344-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.88%], valid : [loss = 0.665, top1 = 84.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10        train : [loss = 0.065, top1 = 97.95%], test  : [loss = 0.404, top1 = 89.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 0.689, top1 = 79.77%], valid : [loss = 1.482, top1 = 61.16%], test : [loss = 1.456, top1 = 62.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.73%], valid : [loss = 2.682, top1 = 32.72%], test : [loss = 2.721, top1 = 32.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 65.01%], valid : [loss = 1.028, top1 = 63.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4345/15625) 004345-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4346/15625) 004346-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.586, top1 = 87.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.30 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.374, top1 = 91.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.75 ms.
cifar100       train : [loss = 0.409, top1 = 88.46%], valid : [loss = 1.412, top1 = 64.93%], test : [loss = 1.393, top1 = 66.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.75%], valid : [loss = 2.518, top1 = 37.04%], test : [loss = 2.533, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.63%], valid : [loss = 0.829, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4347/15625) 004347-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.17%], valid : [loss = 0.463, top1 = 86.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.17 ms.
cifar10        train : [loss = 0.167, top1 = 94.53%], test  : [loss = 0.345, top1 = 88.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.76 ms.
cifar100       train : [loss = 1.015, top1 = 71.10%], valid : [loss = 1.369, top1 = 61.75%], test : [loss = 1.357, top1 = 61.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.95 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.55%], valid : [loss = 2.694, top1 = 32.63%], test : [loss = 2.726, top1 = 32.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.90%], valid : [loss = 0.786, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4348/15625) 004348-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.234, top1 = 92.10%], valid : [loss = 0.943, top1 = 74.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.44 ms.
cifar10        train : [loss = 0.288, top1 = 90.01%], test  : [loss = 0.621, top1 = 80.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.94 ms.
cifar100       train : [loss = 1.300, top1 = 63.35%], valid : [loss = 1.921, top1 = 50.30%], test : [loss = 1.910, top1 = 51.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 3.260, top1 = 22.03%], valid : [loss = 3.378, top1 = 20.41%], test : [loss = 3.401, top1 = 19.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.10%], valid : [loss = 1.224, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4349/15625) 004349-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.583, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.67 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.377, top1 = 91.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.06 ms.
cifar100       train : [loss = 0.128, top1 = 97.68%], valid : [loss = 1.387, top1 = 68.19%], test : [loss = 1.405, top1 = 67.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.13%], valid : [loss = 2.488, top1 = 37.64%], test : [loss = 2.505, top1 = 38.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.76%], valid : [loss = 0.730, top1 = 74.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4350/15625) 004350-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.504, top1 = 88.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.348, top1 = 91.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.20 ms.
cifar100       train : [loss = 0.479, top1 = 86.00%], valid : [loss = 1.349, top1 = 65.21%], test : [loss = 1.362, top1 = 65.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.25%], valid : [loss = 2.511, top1 = 36.57%], test : [loss = 2.560, top1 = 35.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4351/15625) 004351-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.497, top1 = 89.89%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.75 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.325, top1 = 93.05%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.88 ms.
cifar100       train : [loss = 0.113, top1 = 97.80%], valid : [loss = 1.287, top1 = 69.83%], test : [loss = 1.309, top1 = 69.63%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.694, top1 = 54.63%], valid : [loss = 2.186, top1 = 43.19%], test : [loss = 2.194, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.98%], valid : [loss = 0.621, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4352/15625) 004352-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.569, top1 = 88.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.377, top1 = 92.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.21 ms.
cifar100       train : [loss = 0.101, top1 = 98.15%], valid : [loss = 1.468, top1 = 67.63%], test : [loss = 1.458, top1 = 67.81%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.39%], valid : [loss = 2.435, top1 = 39.21%], test : [loss = 2.464, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4353/15625) 004353-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.47 ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.55%], valid : [loss = 0.860, top1 = 70.59%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10        train : [loss = 0.683, top1 = 76.08%], test  : [loss = 0.764, top1 = 73.61%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.09 ms.
cifar100       train : [loss = 1.950, top1 = 48.10%], valid : [loss = 2.124, top1 = 44.74%], test : [loss = 2.145, top1 = 44.65%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.51 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.81%], valid : [loss = 3.670, top1 = 15.63%], test : [loss = 3.697, top1 = 15.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4354/15625) 004354-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.441, top1 = 90.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.301, top1 = 93.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.83 ms.
cifar100       train : [loss = 0.066, top1 = 98.98%], valid : [loss = 1.373, top1 = 69.89%], test : [loss = 1.344, top1 = 70.35%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 1.531, top1 = 58.62%], valid : [loss = 2.248, top1 = 43.73%], test : [loss = 2.245, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.36%], valid : [loss = 0.528, top1 = 81.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4355/15625) 004355-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.46%], valid : [loss = 0.641, top1 = 84.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.060, top1 = 98.08%], test  : [loss = 0.433, top1 = 88.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.36 ms.
cifar100       train : [loss = 0.532, top1 = 84.42%], valid : [loss = 1.530, top1 = 61.31%], test : [loss = 1.538, top1 = 61.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.847, top1 = 29.35%], valid : [loss = 2.949, top1 = 27.59%], test : [loss = 2.983, top1 = 27.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.26%], valid : [loss = 1.023, top1 = 63.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4356/15625) 004356-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.463, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.323, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.327, top1 = 91.11%], valid : [loss = 1.334, top1 = 66.76%], test : [loss = 1.310, top1 = 67.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.27%], valid : [loss = 2.356, top1 = 40.06%], test : [loss = 2.401, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.40%], valid : [loss = 0.565, top1 = 80.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4357/15625) 004357-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.495, top1 = 88.94%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.321, top1 = 92.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.07 ms.
cifar100       train : [loss = 0.227, top1 = 94.45%], valid : [loss = 1.254, top1 = 68.32%], test : [loss = 1.254, top1 = 68.69%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.83%], valid : [loss = 2.263, top1 = 42.21%], test : [loss = 2.263, top1 = 42.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.42%], valid : [loss = 0.656, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4358/15625) 004358-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.583, top1 = 88.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.74 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.401, top1 = 91.71%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.40 ms.
cifar100       train : [loss = 0.108, top1 = 97.99%], valid : [loss = 1.537, top1 = 66.53%], test : [loss = 1.519, top1 = 66.97%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.36 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.32%], valid : [loss = 2.380, top1 = 39.43%], test : [loss = 2.408, top1 = 40.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.01%], valid : [loss = 0.774, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4359/15625) 004359-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.454, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10        train : [loss = 0.111, top1 = 96.57%], test  : [loss = 0.329, top1 = 89.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.62 ms.
cifar100       train : [loss = 0.859, top1 = 75.55%], valid : [loss = 1.295, top1 = 64.81%], test : [loss = 1.279, top1 = 64.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.60%], valid : [loss = 2.631, top1 = 34.00%], test : [loss = 2.664, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4360/15625) 004360-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.293, top1 = 89.99%], valid : [loss = 0.520, top1 = 83.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10        train : [loss = 0.292, top1 = 90.12%], test  : [loss = 0.408, top1 = 86.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.83 ms.
cifar100       train : [loss = 1.307, top1 = 63.26%], valid : [loss = 1.539, top1 = 57.69%], test : [loss = 1.531, top1 = 58.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 2.874, top1 = 29.36%], valid : [loss = 2.886, top1 = 29.60%], test : [loss = 2.921, top1 = 28.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 66.31%], valid : [loss = 0.963, top1 = 65.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4361/15625) 004361-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.422, top1 = 91.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.75 ms.
cifar100       train : [loss = 0.041, top1 = 99.55%], valid : [loss = 1.294, top1 = 71.77%], test : [loss = 1.294, top1 = 71.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 1.388, top1 = 62.05%], valid : [loss = 2.179, top1 = 45.38%], test : [loss = 2.223, top1 = 45.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.80%], valid : [loss = 0.488, top1 = 83.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4362/15625) 004362-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.47%], valid : [loss = 0.458, top1 = 86.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10        train : [loss = 0.153, top1 = 95.04%], test  : [loss = 0.349, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 1.002, top1 = 71.59%], valid : [loss = 1.364, top1 = 61.89%], test : [loss = 1.366, top1 = 61.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.02%], valid : [loss = 2.677, top1 = 33.16%], test : [loss = 2.700, top1 = 33.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4363/15625) 004363-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.84%], valid : [loss = 0.513, top1 = 86.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10        train : [loss = 0.067, top1 = 98.08%], test  : [loss = 0.329, top1 = 90.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.96 ms.
cifar100       train : [loss = 0.632, top1 = 81.76%], valid : [loss = 1.307, top1 = 65.17%], test : [loss = 1.278, top1 = 65.53%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.47%], valid : [loss = 2.491, top1 = 36.82%], test : [loss = 2.536, top1 = 36.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 69.97%], valid : [loss = 0.882, top1 = 68.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4364/15625) 004364-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.467, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.324, top1 = 91.16%], valid : [loss = 1.329, top1 = 66.83%], test : [loss = 1.310, top1 = 67.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.39%], valid : [loss = 2.365, top1 = 39.89%], test : [loss = 2.414, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 84.91%], valid : [loss = 0.547, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4365/15625) 004365-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.453, top1 = 89.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.312, top1 = 92.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.193, top1 = 95.53%], valid : [loss = 1.263, top1 = 69.53%], test : [loss = 1.264, top1 = 69.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.798, top1 = 52.28%], valid : [loss = 2.249, top1 = 43.27%], test : [loss = 2.270, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.430, top1 = 85.02%], valid : [loss = 0.556, top1 = 81.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4366/15625) 004366-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.23%], valid : [loss = 0.558, top1 = 84.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10        train : [loss = 0.180, top1 = 93.93%], test  : [loss = 0.386, top1 = 87.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.76 ms.
cifar100       train : [loss = 0.993, top1 = 71.34%], valid : [loss = 1.424, top1 = 61.33%], test : [loss = 1.425, top1 = 60.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.685, top1 = 32.80%], valid : [loss = 2.751, top1 = 31.72%], test : [loss = 2.797, top1 = 30.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.957, top1 = 65.77%], valid : [loss = 1.031, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4367/15625) 004367-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.537, top1 = 88.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.354, top1 = 91.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.88 ms.
cifar100       train : [loss = 0.438, top1 = 87.19%], valid : [loss = 1.245, top1 = 66.97%], test : [loss = 1.257, top1 = 67.03%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.57%], valid : [loss = 2.374, top1 = 39.48%], test : [loss = 2.383, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.33%], valid : [loss = 0.802, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4368/15625) 004368-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.569, top1 = 87.78%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.75 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.382, top1 = 91.27%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.08 ms.
cifar100       train : [loss = 0.397, top1 = 88.75%], valid : [loss = 1.423, top1 = 64.41%], test : [loss = 1.408, top1 = 65.63%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.88%], valid : [loss = 2.518, top1 = 37.02%], test : [loss = 2.532, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.61%], valid : [loss = 0.785, top1 = 72.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4369/15625) 004369-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.128, top1 = 95.73%], valid : [loss = 0.755, top1 = 80.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.161, top1 = 94.46%], test  : [loss = 0.519, top1 = 85.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 0.861, top1 = 74.78%], valid : [loss = 1.625, top1 = 58.17%], test : [loss = 1.646, top1 = 57.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 3.334, top1 = 20.10%], valid : [loss = 3.343, top1 = 20.32%], test : [loss = 3.370, top1 = 19.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.249, top1 = 54.31%], valid : [loss = 1.279, top1 = 53.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4370/15625) 004370-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.516, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.333, top1 = 91.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.337, top1 = 90.78%], valid : [loss = 1.268, top1 = 67.16%], test : [loss = 1.287, top1 = 67.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.74%], valid : [loss = 2.404, top1 = 39.12%], test : [loss = 2.432, top1 = 38.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.41%], valid : [loss = 0.727, top1 = 74.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4371/15625) 004371-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.28%], valid : [loss = 0.860, top1 = 79.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.134, top1 = 95.46%], test  : [loss = 0.535, top1 = 84.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.59 ms.
cifar100       train : [loss = 0.844, top1 = 75.32%], valid : [loss = 1.677, top1 = 57.49%], test : [loss = 1.684, top1 = 57.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.42%], valid : [loss = 3.169, top1 = 24.43%], test : [loss = 3.193, top1 = 23.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4372/15625) 004372-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.553, top1 = 88.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.361, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.35 ms.
cifar100       train : [loss = 0.160, top1 = 96.59%], valid : [loss = 1.426, top1 = 67.07%], test : [loss = 1.425, top1 = 67.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.77%], valid : [loss = 2.442, top1 = 38.84%], test : [loss = 2.458, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.08%], valid : [loss = 0.720, top1 = 75.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4373/15625) 004373-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.19%], valid : [loss = 0.758, top1 = 81.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.78 ms.
cifar10        train : [loss = 0.126, top1 = 95.74%], test  : [loss = 0.470, top1 = 86.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.16 ms.
cifar100       train : [loss = 0.846, top1 = 75.27%], valid : [loss = 1.646, top1 = 57.83%], test : [loss = 1.648, top1 = 57.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.954, top1 = 26.89%], valid : [loss = 3.057, top1 = 25.48%], test : [loss = 3.065, top1 = 24.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.068, top1 = 61.16%], valid : [loss = 1.099, top1 = 60.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4374/15625) 004374-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.19%], valid : [loss = 0.581, top1 = 85.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.108, top1 = 96.35%], test  : [loss = 0.390, top1 = 88.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 0.811, top1 = 76.16%], valid : [loss = 1.408, top1 = 62.64%], test : [loss = 1.399, top1 = 62.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.88 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.10%], valid : [loss = 2.760, top1 = 31.10%], test : [loss = 2.803, top1 = 31.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4375/15625) 004375-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.398, top1 = 86.01%], valid : [loss = 0.635, top1 = 79.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10        train : [loss = 0.320, top1 = 88.98%], test  : [loss = 0.463, top1 = 84.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 1.637, top1 = 54.83%], valid : [loss = 1.849, top1 = 50.88%], test : [loss = 1.851, top1 = 49.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 3.177, top1 = 23.46%], valid : [loss = 3.177, top1 = 23.39%], test : [loss = 3.231, top1 = 22.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.025, top1 = 62.94%], valid : [loss = 1.060, top1 = 62.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4376/15625) 004376-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.296, top1 = 92.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.143, top1 = 96.99%], valid : [loss = 1.362, top1 = 68.11%], test : [loss = 1.355, top1 = 68.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 1.767, top1 = 53.07%], valid : [loss = 2.279, top1 = 42.46%], test : [loss = 2.284, top1 = 42.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.27%], valid : [loss = 0.535, top1 = 82.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4377/15625) 004377-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.439, top1 = 90.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.304, top1 = 93.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.32 ms.
cifar100       train : [loss = 0.073, top1 = 98.87%], valid : [loss = 1.369, top1 = 69.39%], test : [loss = 1.378, top1 = 69.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 1.570, top1 = 57.59%], valid : [loss = 2.251, top1 = 43.64%], test : [loss = 2.264, top1 = 44.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.69%], valid : [loss = 0.516, top1 = 82.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4378/15625) 004378-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.46%], valid : [loss = 0.593, top1 = 86.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10        train : [loss = 0.053, top1 = 98.35%], test  : [loss = 0.400, top1 = 89.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.00 ms.
cifar100       train : [loss = 0.596, top1 = 82.28%], valid : [loss = 1.449, top1 = 63.05%], test : [loss = 1.437, top1 = 63.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.38%], valid : [loss = 2.640, top1 = 34.02%], test : [loss = 2.682, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.44%], valid : [loss = 0.768, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4379/15625) 004379-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.82%], valid : [loss = 0.521, top1 = 83.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.193, top1 = 93.51%], test  : [loss = 0.377, top1 = 87.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 1.203, top1 = 65.80%], valid : [loss = 1.531, top1 = 58.17%], test : [loss = 1.528, top1 = 58.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.743, top1 = 31.79%], valid : [loss = 2.781, top1 = 31.00%], test : [loss = 2.832, top1 = 30.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.59%], valid : [loss = 0.969, top1 = 65.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4380/15625) 004380-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.540, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.335, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.80 ms.
cifar100       train : [loss = 0.260, top1 = 92.98%], valid : [loss = 1.237, top1 = 68.91%], test : [loss = 1.251, top1 = 69.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.81%], valid : [loss = 2.250, top1 = 42.72%], test : [loss = 2.274, top1 = 42.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.52%], valid : [loss = 0.758, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4381/15625) 004381-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.27%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.326, top1 = 92.51%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.99 ms.
cifar100       train : [loss = 0.151, top1 = 96.87%], valid : [loss = 1.302, top1 = 68.71%], test : [loss = 1.279, top1 = 69.47%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.42 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.38%], valid : [loss = 2.325, top1 = 40.58%], test : [loss = 2.314, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.57%], valid : [loss = 0.714, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4382/15625) 004382-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.612, top1 = 86.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.72 ms.
cifar10        train : [loss = 0.031, top1 = 99.13%], test  : [loss = 0.399, top1 = 90.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.52 ms.
cifar100       train : [loss = 0.481, top1 = 85.97%], valid : [loss = 1.401, top1 = 64.43%], test : [loss = 1.379, top1 = 64.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.65%], valid : [loss = 2.543, top1 = 36.18%], test : [loss = 2.575, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.74%], valid : [loss = 0.831, top1 = 70.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4383/15625) 004383-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.515, top1 = 88.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.354, top1 = 91.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 0.489, top1 = 85.70%], valid : [loss = 1.341, top1 = 65.89%], test : [loss = 1.345, top1 = 65.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 40.06%], valid : [loss = 2.517, top1 = 36.46%], test : [loss = 2.555, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.17%], valid : [loss = 0.679, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4384/15625) 004384-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.21%], valid : [loss = 0.474, top1 = 84.49%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 0.299, top1 = 90.10%], test  : [loss = 0.393, top1 = 86.80%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.02 ms.
cifar100       train : [loss = 1.327, top1 = 63.26%], valid : [loss = 1.537, top1 = 57.91%], test : [loss = 1.516, top1 = 58.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.62 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.80%], valid : [loss = 2.885, top1 = 29.61%], test : [loss = 2.952, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4385/15625) 004385-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.418, top1 = 91.16%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.62 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.285, top1 = 93.83%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.91 ms.
cifar100       train : [loss = 0.042, top1 = 99.58%], valid : [loss = 1.326, top1 = 70.87%], test : [loss = 1.329, top1 = 70.86%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 1.430, top1 = 61.09%], valid : [loss = 2.268, top1 = 43.29%], test : [loss = 2.244, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.66%], valid : [loss = 0.498, top1 = 83.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4386/15625) 004386-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.41%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.82 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.335, top1 = 92.57%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.82 ms.
cifar100       train : [loss = 0.147, top1 = 96.80%], valid : [loss = 1.213, top1 = 70.13%], test : [loss = 1.238, top1 = 70.21%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.56 ms.
ImageNet16-120 train : [loss = 1.789, top1 = 52.45%], valid : [loss = 2.185, top1 = 43.76%], test : [loss = 2.185, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.765, top1 = 73.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4387/15625) 004387-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.331, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.344, top1 = 90.57%], valid : [loss = 1.266, top1 = 67.25%], test : [loss = 1.269, top1 = 67.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.10%], valid : [loss = 2.390, top1 = 39.31%], test : [loss = 2.401, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4388/15625) 004388-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.563, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.379, top1 = 90.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.426, top1 = 87.86%], valid : [loss = 1.388, top1 = 65.04%], test : [loss = 1.354, top1 = 65.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.320, top1 = 40.51%], valid : [loss = 2.519, top1 = 36.80%], test : [loss = 2.552, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.17%], valid : [loss = 0.824, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4389/15625) 004389-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.35%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.91 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.321, top1 = 92.76%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.64 ms.
cifar100       train : [loss = 0.148, top1 = 96.92%], valid : [loss = 1.286, top1 = 69.19%], test : [loss = 1.291, top1 = 69.26%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.80 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.03%], valid : [loss = 2.312, top1 = 41.30%], test : [loss = 2.312, top1 = 41.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.45%], valid : [loss = 0.729, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4390/15625) 004390-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.592, top1 = 87.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.392, top1 = 90.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.61 ms.
cifar100       train : [loss = 0.406, top1 = 88.44%], valid : [loss = 1.427, top1 = 64.99%], test : [loss = 1.403, top1 = 65.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.89%], valid : [loss = 2.512, top1 = 36.83%], test : [loss = 2.527, top1 = 36.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.07%], valid : [loss = 0.822, top1 = 70.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4391/15625) 004391-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.56%], valid : [loss = 0.467, top1 = 86.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10        train : [loss = 0.152, top1 = 95.02%], test  : [loss = 0.351, top1 = 88.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.29 ms.
cifar100       train : [loss = 0.993, top1 = 71.76%], valid : [loss = 1.355, top1 = 61.92%], test : [loss = 1.365, top1 = 61.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.95%], valid : [loss = 2.677, top1 = 33.04%], test : [loss = 2.698, top1 = 32.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4392/15625) 004392-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.648, top1 = 86.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.418, top1 = 90.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.62 ms.
cifar100       train : [loss = 0.259, top1 = 93.47%], valid : [loss = 1.660, top1 = 62.32%], test : [loss = 1.650, top1 = 62.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 45.08%], valid : [loss = 2.520, top1 = 36.14%], test : [loss = 2.558, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 72.98%], valid : [loss = 0.815, top1 = 71.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4393/15625) 004393-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.579, top1 = 87.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.391, top1 = 91.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.97 ms.
cifar100       train : [loss = 0.172, top1 = 95.93%], valid : [loss = 1.550, top1 = 65.22%], test : [loss = 1.549, top1 = 65.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.09%], valid : [loss = 2.432, top1 = 38.86%], test : [loss = 2.466, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.83%], valid : [loss = 0.799, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4394/15625) 004394-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.37%], valid : [loss = 0.856, top1 = 71.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10        train : [loss = 0.560, top1 = 80.39%], test  : [loss = 0.723, top1 = 75.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.30 ms.
cifar100       train : [loss = 1.771, top1 = 52.14%], valid : [loss = 2.041, top1 = 47.14%], test : [loss = 2.050, top1 = 47.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.83%], valid : [loss = 3.640, top1 = 16.54%], test : [loss = 3.657, top1 = 16.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4395/15625) 004395-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.516, top1 = 89.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.330, top1 = 92.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.34 ms.
cifar100       train : [loss = 0.125, top1 = 97.37%], valid : [loss = 1.331, top1 = 68.85%], test : [loss = 1.341, top1 = 69.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.97%], valid : [loss = 2.338, top1 = 40.61%], test : [loss = 2.333, top1 = 41.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.14%], valid : [loss = 0.808, top1 = 71.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4396/15625) 004396-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.29%], valid : [loss = 0.701, top1 = 76.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10        train : [loss = 0.541, top1 = 81.09%], test  : [loss = 0.604, top1 = 79.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.54 ms.
cifar100       train : [loss = 1.742, top1 = 52.67%], valid : [loss = 1.890, top1 = 49.79%], test : [loss = 1.918, top1 = 49.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 3.385, top1 = 20.14%], valid : [loss = 3.357, top1 = 21.34%], test : [loss = 3.402, top1 = 19.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.351, top1 = 51.46%], valid : [loss = 1.399, top1 = 49.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4397/15625) 004397-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.523, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.335, top1 = 91.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.251, top1 = 93.53%], valid : [loss = 1.243, top1 = 68.65%], test : [loss = 1.253, top1 = 68.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.86%], valid : [loss = 2.244, top1 = 42.50%], test : [loss = 2.277, top1 = 42.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.33%], valid : [loss = 0.639, top1 = 77.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4398/15625) 004398-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.523, top1 = 88.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.339, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.95 ms.
cifar100       train : [loss = 0.338, top1 = 90.85%], valid : [loss = 1.291, top1 = 66.83%], test : [loss = 1.290, top1 = 67.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 45.01%], valid : [loss = 2.393, top1 = 39.20%], test : [loss = 2.413, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4399/15625) 004399-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.55%], valid : [loss = 0.857, top1 = 79.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10        train : [loss = 0.126, top1 = 95.79%], test  : [loss = 0.538, top1 = 85.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.23 ms.
cifar100       train : [loss = 0.833, top1 = 75.75%], valid : [loss = 1.658, top1 = 57.44%], test : [loss = 1.670, top1 = 58.13%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 3.024, top1 = 26.63%], valid : [loss = 3.165, top1 = 24.03%], test : [loss = 3.197, top1 = 23.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.044, top1 = 62.28%], valid : [loss = 1.106, top1 = 60.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4400/15625) 004400-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.147, top1 = 95.29%], valid : [loss = 0.508, top1 = 85.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10        train : [loss = 0.166, top1 = 94.41%], test  : [loss = 0.375, top1 = 88.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.94 ms.
cifar100       train : [loss = 1.023, top1 = 70.56%], valid : [loss = 1.395, top1 = 61.58%], test : [loss = 1.384, top1 = 61.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.605, top1 = 34.65%], valid : [loss = 2.673, top1 = 33.69%], test : [loss = 2.689, top1 = 32.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.54%], valid : [loss = 0.900, top1 = 68.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4401/15625) 004401-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.437, top1 = 90.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.301, top1 = 92.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.127, top1 = 97.57%], valid : [loss = 1.296, top1 = 69.33%], test : [loss = 1.284, top1 = 69.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.26%], valid : [loss = 2.248, top1 = 43.01%], test : [loss = 2.245, top1 = 43.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.33%], valid : [loss = 0.533, top1 = 81.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4402/15625) 004402-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.82%], valid : [loss = 0.587, top1 = 85.10%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10        train : [loss = 0.104, top1 = 96.59%], test  : [loss = 0.415, top1 = 88.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.82 ms.
cifar100       train : [loss = 0.820, top1 = 76.13%], valid : [loss = 1.539, top1 = 59.89%], test : [loss = 1.513, top1 = 60.12%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 34.92%], valid : [loss = 2.699, top1 = 32.58%], test : [loss = 2.703, top1 = 32.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 60.32%], valid : [loss = 1.120, top1 = 59.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4403/15625) 004403-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.539, top1 = 89.47%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.81 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.339, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.14 ms.
cifar100       train : [loss = 0.101, top1 = 98.04%], valid : [loss = 1.317, top1 = 69.68%], test : [loss = 1.343, top1 = 69.61%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 1.978, top1 = 47.97%], valid : [loss = 2.345, top1 = 40.18%], test : [loss = 2.317, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 68.86%], valid : [loss = 0.903, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4404/15625) 004404-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=22.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.513, top1 = 90.02%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=22.43 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.313, top1 = 93.28%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=22.72 ms.
cifar100       train : [loss = 0.054, top1 = 99.29%], valid : [loss = 1.386, top1 = 69.07%], test : [loss = 1.363, top1 = 70.16%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=24.58 ms.
ImageNet16-120 train : [loss = 1.631, top1 = 56.25%], valid : [loss = 2.186, top1 = 43.63%], test : [loss = 2.184, top1 = 44.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.47%], valid : [loss = 0.642, top1 = 77.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4405/15625) 004405-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.88%], valid : [loss = 0.571, top1 = 86.36%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.11 ms.
cifar10        train : [loss = 0.076, top1 = 97.52%], test  : [loss = 0.388, top1 = 89.41%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.76 ms.
cifar100       train : [loss = 0.585, top1 = 82.96%], valid : [loss = 1.372, top1 = 64.30%], test : [loss = 1.372, top1 = 63.87%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.16%], valid : [loss = 2.509, top1 = 36.61%], test : [loss = 2.536, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.33%], valid : [loss = 0.863, top1 = 69.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4406/15625) 004406-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.39 ms.
cifar10-valid  train : [loss = 0.290, top1 = 90.08%], valid : [loss = 0.465, top1 = 84.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.51 ms.
cifar10        train : [loss = 0.268, top1 = 91.00%], test  : [loss = 0.372, top1 = 87.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.03 ms.
cifar100       train : [loss = 1.279, top1 = 64.19%], valid : [loss = 1.484, top1 = 58.45%], test : [loss = 1.461, top1 = 59.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.96 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.37%], valid : [loss = 2.823, top1 = 30.68%], test : [loss = 2.850, top1 = 29.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 63.06%], valid : [loss = 1.056, top1 = 62.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4407/15625) 004407-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.503, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.329, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.17 ms.
cifar100       train : [loss = 0.323, top1 = 91.34%], valid : [loss = 1.280, top1 = 67.01%], test : [loss = 1.275, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.19%], valid : [loss = 2.382, top1 = 39.89%], test : [loss = 2.402, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4408/15625) 004408-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.535, top1 = 88.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10        train : [loss = 0.030, top1 = 99.12%], test  : [loss = 0.336, top1 = 91.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.13 ms.
cifar100       train : [loss = 0.415, top1 = 87.74%], valid : [loss = 1.271, top1 = 67.05%], test : [loss = 1.267, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 2.196, top1 = 43.09%], valid : [loss = 2.374, top1 = 40.06%], test : [loss = 2.391, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.45%], valid : [loss = 1.005, top1 = 64.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4409/15625) 004409-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.55%], valid : [loss = 0.438, top1 = 88.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.65 ms.
cifar10        train : [loss = 0.056, top1 = 98.65%], test  : [loss = 0.311, top1 = 90.59%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.57 ms.
cifar100       train : [loss = 0.564, top1 = 84.50%], valid : [loss = 1.229, top1 = 66.67%], test : [loss = 1.203, top1 = 67.17%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.44%], valid : [loss = 2.473, top1 = 37.92%], test : [loss = 2.490, top1 = 37.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.47%], valid : [loss = 0.632, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4410/15625) 004410-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.319, top1 = 89.03%], valid : [loss = 0.604, top1 = 80.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.257, top1 = 91.15%], test  : [loss = 0.413, top1 = 86.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.39 ms.
cifar100       train : [loss = 1.453, top1 = 59.34%], valid : [loss = 1.698, top1 = 53.96%], test : [loss = 1.700, top1 = 53.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 27.85%], valid : [loss = 2.965, top1 = 28.16%], test : [loss = 3.011, top1 = 26.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4411/15625) 004411-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.55%], valid : [loss = 0.618, top1 = 86.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.396, top1 = 90.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.00 ms.
cifar100       train : [loss = 0.552, top1 = 83.84%], valid : [loss = 1.455, top1 = 63.33%], test : [loss = 1.402, top1 = 63.69%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.14%], valid : [loss = 2.572, top1 = 35.53%], test : [loss = 2.583, top1 = 35.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.33%], valid : [loss = 0.886, top1 = 68.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4412/15625) 004412-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.544, top1 = 88.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.345, top1 = 92.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.82 ms.
cifar100       train : [loss = 0.249, top1 = 93.34%], valid : [loss = 1.331, top1 = 67.59%], test : [loss = 1.332, top1 = 67.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.215, top1 = 42.69%], valid : [loss = 2.431, top1 = 38.68%], test : [loss = 2.439, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4413/15625) 004413-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.234, top1 = 91.98%], valid : [loss = 0.509, top1 = 83.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10        train : [loss = 0.241, top1 = 91.77%], test  : [loss = 0.396, top1 = 86.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.06 ms.
cifar100       train : [loss = 1.367, top1 = 61.62%], valid : [loss = 1.631, top1 = 55.82%], test : [loss = 1.625, top1 = 56.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 2.857, top1 = 29.54%], valid : [loss = 2.864, top1 = 29.80%], test : [loss = 2.927, top1 = 28.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 0.979, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4414/15625) 004414-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.266, top1 = 90.85%], valid : [loss = 0.841, top1 = 76.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10        train : [loss = 0.304, top1 = 89.43%], test  : [loss = 0.617, top1 = 80.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 1.322, top1 = 62.72%], valid : [loss = 1.889, top1 = 51.06%], test : [loss = 1.879, top1 = 51.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 3.498, top1 = 17.30%], valid : [loss = 3.517, top1 = 17.56%], test : [loss = 3.516, top1 = 16.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.258, top1 = 53.80%], valid : [loss = 1.308, top1 = 52.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4415/15625) 004415-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.514, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.312, top1 = 93.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.127, top1 = 97.50%], valid : [loss = 1.294, top1 = 69.51%], test : [loss = 1.287, top1 = 69.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.05%], valid : [loss = 2.291, top1 = 41.83%], test : [loss = 2.272, top1 = 41.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4416/15625) 004416-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.571, top1 = 87.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.382, top1 = 90.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.89 ms.
cifar100       train : [loss = 0.414, top1 = 88.14%], valid : [loss = 1.401, top1 = 65.26%], test : [loss = 1.409, top1 = 65.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.55%], valid : [loss = 2.513, top1 = 37.18%], test : [loss = 2.528, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.38%], valid : [loss = 0.835, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4417/15625) 004417-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.564, top1 = 87.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.376, top1 = 90.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.97 ms.
cifar100       train : [loss = 0.467, top1 = 86.41%], valid : [loss = 1.323, top1 = 65.50%], test : [loss = 1.340, top1 = 65.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.34%], valid : [loss = 2.748, top1 = 30.80%], test : [loss = 2.760, top1 = 30.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.122, top1 = 59.16%], valid : [loss = 1.147, top1 = 58.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4418/15625) 004418-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.422, top1 = 91.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.61 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.277, top1 = 93.95%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.85 ms.
cifar100       train : [loss = 0.027, top1 = 99.83%], valid : [loss = 1.264, top1 = 72.27%], test : [loss = 1.248, top1 = 72.75%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.96 ms.
ImageNet16-120 train : [loss = 1.222, top1 = 66.29%], valid : [loss = 2.222, top1 = 45.18%], test : [loss = 2.246, top1 = 45.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 87.93%], valid : [loss = 0.499, top1 = 83.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4419/15625) 004419-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.569, top1 = 87.89%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.365, top1 = 91.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.77 ms.
cifar100       train : [loss = 0.273, top1 = 92.41%], valid : [loss = 1.354, top1 = 67.13%], test : [loss = 1.346, top1 = 67.23%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.83 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.20%], valid : [loss = 2.472, top1 = 37.22%], test : [loss = 2.490, top1 = 37.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.02%], valid : [loss = 0.950, top1 = 66.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4420/15625) 004420-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.658, top1 = 87.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.434, top1 = 91.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.76 ms.
cifar100       train : [loss = 0.150, top1 = 96.80%], valid : [loss = 1.572, top1 = 65.01%], test : [loss = 1.576, top1 = 65.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.68%], valid : [loss = 2.624, top1 = 35.68%], test : [loss = 2.669, top1 = 34.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.10%], valid : [loss = 0.779, top1 = 72.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4421/15625) 004421-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.190, top1 = 93.64%], valid : [loss = 0.517, top1 = 84.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.195, top1 = 93.44%], test  : [loss = 0.367, top1 = 88.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.42 ms.
cifar100       train : [loss = 1.191, top1 = 66.19%], valid : [loss = 1.525, top1 = 58.27%], test : [loss = 1.513, top1 = 58.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.755, top1 = 31.57%], valid : [loss = 2.797, top1 = 30.83%], test : [loss = 2.820, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.31%], valid : [loss = 0.981, top1 = 65.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4422/15625) 004422-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.514, top1 = 89.69%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.84 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.322, top1 = 93.27%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.49 ms.
cifar100       train : [loss = 0.063, top1 = 99.19%], valid : [loss = 1.308, top1 = 70.39%], test : [loss = 1.302, top1 = 70.33%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.54%], valid : [loss = 2.278, top1 = 41.81%], test : [loss = 2.273, top1 = 42.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 78.08%], valid : [loss = 0.695, top1 = 76.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4423/15625) 004423-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.454, top1 = 89.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.303, top1 = 92.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.67 ms.
cifar100       train : [loss = 0.181, top1 = 95.89%], valid : [loss = 1.281, top1 = 69.23%], test : [loss = 1.276, top1 = 69.57%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.16%], valid : [loss = 2.227, top1 = 43.23%], test : [loss = 2.256, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.408, top1 = 85.98%], valid : [loss = 0.531, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4424/15625) 004424-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.508, top1 = 89.55%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.09 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.309, top1 = 92.98%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.54 ms.
cifar100       train : [loss = 0.119, top1 = 97.86%], valid : [loss = 1.261, top1 = 69.83%], test : [loss = 1.240, top1 = 69.89%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.28 ms.
ImageNet16-120 train : [loss = 1.673, top1 = 55.10%], valid : [loss = 2.139, top1 = 45.04%], test : [loss = 2.145, top1 = 45.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.58%], valid : [loss = 0.690, top1 = 76.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4425/15625) 004425-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.38%], valid : [loss = 0.849, top1 = 72.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.69 ms.
cifar10        train : [loss = 0.546, top1 = 80.89%], test  : [loss = 0.712, top1 = 75.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 1.767, top1 = 52.47%], valid : [loss = 2.053, top1 = 47.12%], test : [loss = 2.060, top1 = 46.81%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.94%], valid : [loss = 3.631, top1 = 16.74%], test : [loss = 3.661, top1 = 16.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4426/15625) 004426-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.68%], valid : [loss = 0.618, top1 = 79.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10        train : [loss = 0.331, top1 = 88.49%], test  : [loss = 0.466, top1 = 84.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.27 ms.
cifar100       train : [loss = 1.647, top1 = 54.30%], valid : [loss = 1.862, top1 = 49.58%], test : [loss = 1.850, top1 = 50.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 3.206, top1 = 22.87%], valid : [loss = 3.199, top1 = 23.01%], test : [loss = 3.259, top1 = 22.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.86%], valid : [loss = 1.073, top1 = 61.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4427/15625) 004427-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.151, top1 = 94.93%], valid : [loss = 0.878, top1 = 77.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.224, top1 = 92.31%], test  : [loss = 0.582, top1 = 82.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 1.150, top1 = 67.28%], valid : [loss = 1.799, top1 = 53.58%], test : [loss = 1.776, top1 = 54.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.82%], valid : [loss = 3.323, top1 = 21.31%], test : [loss = 3.353, top1 = 20.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4428/15625) 004428-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.580, top1 = 88.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.019, top1 = 99.44%], test  : [loss = 0.377, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.269, top1 = 92.73%], valid : [loss = 1.339, top1 = 67.00%], test : [loss = 1.375, top1 = 66.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.09%], valid : [loss = 2.341, top1 = 40.38%], test : [loss = 2.360, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.31%], valid : [loss = 0.876, top1 = 69.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4429/15625) 004429-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.47%], valid : [loss = 0.873, top1 = 70.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.670, top1 = 76.58%], test  : [loss = 0.756, top1 = 73.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 1.975, top1 = 47.47%], valid : [loss = 2.136, top1 = 44.91%], test : [loss = 2.166, top1 = 44.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 3.656, top1 = 15.72%], valid : [loss = 3.674, top1 = 15.70%], test : [loss = 3.702, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.381, top1 = 49.87%], valid : [loss = 1.401, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4430/15625) 004430-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.69 ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.26%], valid : [loss = 0.877, top1 = 69.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10        train : [loss = 0.728, top1 = 74.44%], test  : [loss = 0.778, top1 = 72.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.14 ms.
cifar100       train : [loss = 2.384, top1 = 37.75%], valid : [loss = 2.508, top1 = 35.57%], test : [loss = 2.499, top1 = 35.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.25 ms.
ImageNet16-120 train : [loss = 3.538, top1 = 17.32%], valid : [loss = 3.521, top1 = 18.01%], test : [loss = 3.548, top1 = 17.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 46.56%], valid : [loss = 1.501, top1 = 44.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4431/15625) 004431-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.72%], valid : [loss = 0.523, top1 = 88.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.338, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.322, top1 = 90.93%], valid : [loss = 1.232, top1 = 67.98%], test : [loss = 1.260, top1 = 68.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.85%], valid : [loss = 2.307, top1 = 41.09%], test : [loss = 2.329, top1 = 41.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.42%], valid : [loss = 0.941, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4432/15625) 004432-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.52%], valid : [loss = 0.437, top1 = 87.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.056, top1 = 98.57%], test  : [loss = 0.308, top1 = 90.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.86 ms.
cifar100       train : [loss = 0.572, top1 = 84.26%], valid : [loss = 1.220, top1 = 66.77%], test : [loss = 1.214, top1 = 66.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.50%], valid : [loss = 2.463, top1 = 37.67%], test : [loss = 2.475, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4433/15625) 004433-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.473, top1 = 89.37%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.17 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.296, top1 = 92.69%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.82 ms.
cifar100       train : [loss = 0.210, top1 = 94.88%], valid : [loss = 1.218, top1 = 69.11%], test : [loss = 1.228, top1 = 69.79%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.52 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.44%], valid : [loss = 2.197, top1 = 43.42%], test : [loss = 2.223, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.08%], valid : [loss = 0.676, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4434/15625) 004434-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.52%], valid : [loss = 0.848, top1 = 72.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10        train : [loss = 0.560, top1 = 80.46%], test  : [loss = 0.722, top1 = 75.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 1.774, top1 = 52.10%], valid : [loss = 2.051, top1 = 47.07%], test : [loss = 2.066, top1 = 46.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.79%], valid : [loss = 3.644, top1 = 16.38%], test : [loss = 3.664, top1 = 15.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4435/15625) 004435-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.703, top1 = 84.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 0.055, top1 = 98.32%], test  : [loss = 0.438, top1 = 88.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.03 ms.
cifar100       train : [loss = 0.633, top1 = 81.49%], valid : [loss = 1.530, top1 = 61.31%], test : [loss = 1.487, top1 = 61.97%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.33%], valid : [loss = 2.811, top1 = 30.96%], test : [loss = 2.865, top1 = 29.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4436/15625) 004436-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.24%], valid : [loss = 0.536, top1 = 86.51%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10        train : [loss = 0.052, top1 = 98.60%], test  : [loss = 0.357, top1 = 90.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.05 ms.
cifar100       train : [loss = 0.535, top1 = 84.69%], valid : [loss = 1.309, top1 = 65.91%], test : [loss = 1.297, top1 = 65.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.14%], valid : [loss = 2.421, top1 = 38.80%], test : [loss = 2.443, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.50%], valid : [loss = 0.867, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4437/15625) 004437-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.471, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.321, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.348, top1 = 90.29%], valid : [loss = 1.310, top1 = 66.79%], test : [loss = 1.290, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.090, top1 = 45.53%], valid : [loss = 2.365, top1 = 40.01%], test : [loss = 2.398, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.26%], valid : [loss = 0.624, top1 = 78.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4438/15625) 004438-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.513, top1 = 88.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.319, top1 = 92.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.24 ms.
cifar100       train : [loss = 0.327, top1 = 91.17%], valid : [loss = 1.285, top1 = 67.07%], test : [loss = 1.294, top1 = 67.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.81%], valid : [loss = 2.400, top1 = 39.24%], test : [loss = 2.402, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4439/15625) 004439-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.31%], valid : [loss = 0.586, top1 = 85.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.071, top1 = 97.87%], test  : [loss = 0.397, top1 = 89.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.77 ms.
cifar100       train : [loss = 0.700, top1 = 79.70%], valid : [loss = 1.381, top1 = 63.52%], test : [loss = 1.365, top1 = 63.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 36.47%], valid : [loss = 2.643, top1 = 33.97%], test : [loss = 2.672, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.86%], valid : [loss = 0.770, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4440/15625) 004440-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.587, top1 = 87.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.401, top1 = 90.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.420, top1 = 88.01%], valid : [loss = 1.424, top1 = 65.17%], test : [loss = 1.392, top1 = 65.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.91%], valid : [loss = 2.520, top1 = 36.41%], test : [loss = 2.525, top1 = 36.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 72.80%], valid : [loss = 0.803, top1 = 71.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4441/15625) 004441-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.487, top1 = 89.73%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.95 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.307, top1 = 93.11%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.23 ms.
cifar100       train : [loss = 0.120, top1 = 97.73%], valid : [loss = 1.281, top1 = 69.93%], test : [loss = 1.273, top1 = 69.95%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 1.734, top1 = 53.73%], valid : [loss = 2.246, top1 = 42.53%], test : [loss = 2.226, top1 = 43.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.36%], valid : [loss = 0.604, top1 = 79.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4442/15625) 004442-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.462, top1 = 89.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.307, top1 = 92.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.163, top1 = 96.21%], valid : [loss = 1.327, top1 = 68.97%], test : [loss = 1.301, top1 = 69.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 1.776, top1 = 52.75%], valid : [loss = 2.222, top1 = 43.18%], test : [loss = 2.235, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.38%], valid : [loss = 0.520, top1 = 82.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4443/15625) 004443-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.576, top1 = 87.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.379, top1 = 91.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.81 ms.
cifar100       train : [loss = 0.117, top1 = 97.59%], valid : [loss = 1.547, top1 = 66.52%], test : [loss = 1.533, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 48.03%], valid : [loss = 2.412, top1 = 39.73%], test : [loss = 2.445, top1 = 39.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.16%], valid : [loss = 0.781, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4444/15625) 004444-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.537, top1 = 88.37%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.349, top1 = 91.83%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.55 ms.
cifar100       train : [loss = 0.288, top1 = 92.26%], valid : [loss = 1.288, top1 = 67.37%], test : [loss = 1.279, top1 = 67.95%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.99 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.02%], valid : [loss = 2.407, top1 = 38.20%], test : [loss = 2.421, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.54%], valid : [loss = 0.872, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4445/15625) 004445-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.05%], valid : [loss = 0.524, top1 = 87.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10        train : [loss = 0.071, top1 = 97.73%], test  : [loss = 0.353, top1 = 89.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.08 ms.
cifar100       train : [loss = 0.707, top1 = 79.20%], valid : [loss = 1.363, top1 = 64.33%], test : [loss = 1.355, top1 = 64.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.28%], valid : [loss = 2.631, top1 = 34.50%], test : [loss = 2.671, top1 = 33.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.93%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4446/15625) 004446-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.26%], valid : [loss = 0.755, top1 = 80.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10        train : [loss = 0.146, top1 = 95.07%], test  : [loss = 0.456, top1 = 86.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.59 ms.
cifar100       train : [loss = 0.934, top1 = 72.86%], valid : [loss = 1.649, top1 = 56.79%], test : [loss = 1.627, top1 = 57.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 3.098, top1 = 24.29%], valid : [loss = 3.154, top1 = 24.17%], test : [loss = 3.186, top1 = 22.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 64.92%], valid : [loss = 1.020, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4447/15625) 004447-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.547, top1 = 87.57%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.48 ms.
cifar10        train : [loss = 0.038, top1 = 98.85%], test  : [loss = 0.376, top1 = 90.62%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.56 ms.
cifar100       train : [loss = 0.438, top1 = 87.59%], valid : [loss = 1.270, top1 = 66.59%], test : [loss = 1.286, top1 = 66.83%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.39%], valid : [loss = 2.366, top1 = 39.39%], test : [loss = 2.396, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.92%], valid : [loss = 0.764, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4448/15625) 004448-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.471, top1 = 89.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.310, top1 = 92.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.198, top1 = 95.21%], valid : [loss = 1.346, top1 = 68.30%], test : [loss = 1.313, top1 = 68.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.61%], valid : [loss = 2.307, top1 = 42.11%], test : [loss = 2.322, top1 = 42.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.91%], valid : [loss = 0.576, top1 = 80.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4449/15625) 004449-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.549, top1 = 88.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.347, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.93 ms.
cifar100       train : [loss = 0.211, top1 = 94.45%], valid : [loss = 1.377, top1 = 67.42%], test : [loss = 1.392, top1 = 67.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.81%], valid : [loss = 2.280, top1 = 41.93%], test : [loss = 2.295, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.64%], valid : [loss = 0.766, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4450/15625) 004450-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.12 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.46%], valid : [loss = 0.860, top1 = 71.91%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.53 ms.
cifar10        train : [loss = 0.555, top1 = 80.71%], test  : [loss = 0.715, top1 = 75.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.96 ms.
cifar100       train : [loss = 1.769, top1 = 52.30%], valid : [loss = 2.050, top1 = 47.28%], test : [loss = 2.085, top1 = 46.26%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.89%], valid : [loss = 3.636, top1 = 16.44%], test : [loss = 3.658, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4451/15625) 004451-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.67%], valid : [loss = 0.456, top1 = 86.52%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.49 ms.
cifar10        train : [loss = 0.118, top1 = 96.34%], test  : [loss = 0.335, top1 = 89.48%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.26 ms.
cifar100       train : [loss = 0.769, top1 = 78.34%], valid : [loss = 1.288, top1 = 64.56%], test : [loss = 1.289, top1 = 64.25%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.96 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.82%], valid : [loss = 2.580, top1 = 34.89%], test : [loss = 2.605, top1 = 34.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.15%], valid : [loss = 0.852, top1 = 69.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4452/15625) 004452-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.553, top1 = 89.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.369, top1 = 92.64%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.60 ms.
cifar100       train : [loss = 0.046, top1 = 99.44%], valid : [loss = 1.488, top1 = 68.49%], test : [loss = 1.470, top1 = 69.25%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 1.679, top1 = 55.09%], valid : [loss = 2.424, top1 = 40.16%], test : [loss = 2.427, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.11%], valid : [loss = 0.710, top1 = 75.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4453/15625) 004453-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.516, top1 = 89.76%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.62 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.341, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.27 ms.
cifar100       train : [loss = 0.070, top1 = 98.91%], valid : [loss = 1.327, top1 = 70.17%], test : [loss = 1.350, top1 = 69.73%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.00 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.71%], valid : [loss = 2.324, top1 = 40.90%], test : [loss = 2.312, top1 = 41.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 71.95%], valid : [loss = 0.828, top1 = 70.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4454/15625) 004454-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.487, top1 = 90.08%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.316, top1 = 93.50%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.75 ms.
cifar100       train : [loss = 0.040, top1 = 99.41%], valid : [loss = 1.350, top1 = 70.48%], test : [loss = 1.407, top1 = 70.76%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.42 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.17%], valid : [loss = 2.303, top1 = 41.40%], test : [loss = 2.306, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.19%], valid : [loss = 0.781, top1 = 72.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4455/15625) 004455-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.547, top1 = 89.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.10 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.361, top1 = 92.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.09 ms.
cifar100       train : [loss = 0.129, top1 = 97.14%], valid : [loss = 1.369, top1 = 68.28%], test : [loss = 1.342, top1 = 69.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.37 ms.
ImageNet16-120 train : [loss = 1.813, top1 = 51.81%], valid : [loss = 2.258, top1 = 42.70%], test : [loss = 2.243, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.50%], valid : [loss = 0.704, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4456/15625) 004456-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.453, top1 = 89.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.67 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.307, top1 = 92.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.24 ms.
cifar100       train : [loss = 0.181, top1 = 95.94%], valid : [loss = 1.318, top1 = 68.76%], test : [loss = 1.281, top1 = 69.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.01%], valid : [loss = 2.205, top1 = 42.90%], test : [loss = 2.273, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.47%], valid : [loss = 0.540, top1 = 81.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4457/15625) 004457-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.541, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.346, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.07 ms.
cifar100       train : [loss = 0.309, top1 = 91.55%], valid : [loss = 1.307, top1 = 67.00%], test : [loss = 1.308, top1 = 67.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.69%], valid : [loss = 2.465, top1 = 37.57%], test : [loss = 2.486, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.22%], valid : [loss = 0.857, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4458/15625) 004458-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.590, top1 = 87.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.397, top1 = 91.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.36 ms.
cifar100       train : [loss = 0.187, top1 = 95.71%], valid : [loss = 1.417, top1 = 67.06%], test : [loss = 1.453, top1 = 66.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.51%], valid : [loss = 2.467, top1 = 38.83%], test : [loss = 2.477, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.07%], valid : [loss = 0.773, top1 = 73.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4459/15625) 004459-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.01%], valid : [loss = 0.585, top1 = 86.42%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.01 ms.
cifar10        train : [loss = 0.064, top1 = 97.93%], test  : [loss = 0.352, top1 = 90.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.69 ms.
cifar100       train : [loss = 0.637, top1 = 81.21%], valid : [loss = 1.327, top1 = 65.66%], test : [loss = 1.304, top1 = 64.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.68%], valid : [loss = 2.505, top1 = 36.80%], test : [loss = 2.473, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.08%], valid : [loss = 0.761, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4460/15625) 004460-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.32%], valid : [loss = 0.579, top1 = 81.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.61 ms.
cifar10        train : [loss = 0.221, top1 = 92.49%], test  : [loss = 0.391, top1 = 87.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.83 ms.
cifar100       train : [loss = 1.311, top1 = 62.79%], valid : [loss = 1.580, top1 = 57.54%], test : [loss = 1.558, top1 = 57.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 2.783, top1 = 30.95%], valid : [loss = 2.824, top1 = 30.17%], test : [loss = 2.876, top1 = 29.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.30%], valid : [loss = 0.998, top1 = 64.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4461/15625) 004461-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.242, top1 = 91.71%], valid : [loss = 0.517, top1 = 83.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10        train : [loss = 0.239, top1 = 91.81%], test  : [loss = 0.385, top1 = 87.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 1.360, top1 = 61.66%], valid : [loss = 1.619, top1 = 56.14%], test : [loss = 1.626, top1 = 55.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.857, top1 = 29.64%], valid : [loss = 2.866, top1 = 29.68%], test : [loss = 2.914, top1 = 28.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4462/15625) 004462-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.33%], valid : [loss = 0.592, top1 = 86.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10        train : [loss = 0.028, top1 = 99.16%], test  : [loss = 0.387, top1 = 90.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.328, top1 = 90.53%], valid : [loss = 1.448, top1 = 64.48%], test : [loss = 1.470, top1 = 64.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 3.054, top1 = 24.61%], valid : [loss = 3.116, top1 = 22.53%], test : [loss = 3.125, top1 = 23.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.206, top1 = 55.63%], valid : [loss = 1.212, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4463/15625) 004463-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.78%], valid : [loss = 0.550, top1 = 88.42%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.93 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.362, top1 = 92.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.31 ms.
cifar100       train : [loss = 0.136, top1 = 96.73%], valid : [loss = 1.420, top1 = 67.10%], test : [loss = 1.396, top1 = 68.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.73 ms.
ImageNet16-120 train : [loss = 2.751, top1 = 31.00%], valid : [loss = 2.858, top1 = 28.63%], test : [loss = 2.903, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.12%], valid : [loss = 1.029, top1 = 62.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4464/15625) 004464-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.185, top1 = 93.91%], valid : [loss = 0.536, top1 = 84.12%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=14.39 ms.
cifar10        train : [loss = 0.192, top1 = 93.50%], test  : [loss = 0.398, top1 = 87.54%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=14.49 ms.
cifar100       train : [loss = 1.206, top1 = 65.73%], valid : [loss = 1.522, top1 = 58.49%], test : [loss = 1.499, top1 = 58.87%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 34.11%], valid : [loss = 2.673, top1 = 33.36%], test : [loss = 2.723, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 67.06%], valid : [loss = 0.978, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4465/15625) 004465-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.18 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.376, top1 = 92.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.95 ms.
cifar100       train : [loss = 0.166, top1 = 96.50%], valid : [loss = 1.421, top1 = 67.36%], test : [loss = 1.411, top1 = 66.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 1.977, top1 = 48.06%], valid : [loss = 2.488, top1 = 38.40%], test : [loss = 2.471, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.84%], valid : [loss = 0.691, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4466/15625) 004466-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.05 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.23%], valid : [loss = 0.568, top1 = 82.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.21 ms.
cifar10        train : [loss = 0.261, top1 = 91.06%], test  : [loss = 0.416, top1 = 86.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.47 ms.
cifar100       train : [loss = 1.401, top1 = 60.50%], valid : [loss = 1.644, top1 = 55.54%], test : [loss = 1.624, top1 = 55.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.66 ms.
ImageNet16-120 train : [loss = 2.978, top1 = 27.23%], valid : [loss = 2.990, top1 = 26.63%], test : [loss = 3.031, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.70%], valid : [loss = 1.033, top1 = 63.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4467/15625) 004467-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.555, top1 = 88.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.353, top1 = 91.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 0.315, top1 = 90.89%], valid : [loss = 1.349, top1 = 66.74%], test : [loss = 1.328, top1 = 67.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.271, top1 = 41.47%], valid : [loss = 2.484, top1 = 37.37%], test : [loss = 2.489, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.948, top1 = 65.97%], valid : [loss = 0.990, top1 = 64.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4468/15625) 004468-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.471, top1 = 89.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.38 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.319, top1 = 92.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.198, top1 = 95.07%], valid : [loss = 1.352, top1 = 67.80%], test : [loss = 1.361, top1 = 67.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.43%], valid : [loss = 2.332, top1 = 40.50%], test : [loss = 2.346, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.97%], valid : [loss = 0.584, top1 = 80.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4469/15625) 004469-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.00%], valid : [loss = 0.835, top1 = 72.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10        train : [loss = 0.555, top1 = 80.54%], test  : [loss = 0.716, top1 = 75.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 1.776, top1 = 52.03%], valid : [loss = 2.036, top1 = 47.18%], test : [loss = 2.069, top1 = 46.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 3.600, top1 = 16.52%], valid : [loss = 3.643, top1 = 16.63%], test : [loss = 3.671, top1 = 16.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4470/15625) 004470-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.75%], valid : [loss = 0.582, top1 = 87.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10        train : [loss = 0.022, top1 = 99.35%], test  : [loss = 0.403, top1 = 90.75%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.73 ms.
cifar100       train : [loss = 0.301, top1 = 91.70%], valid : [loss = 1.429, top1 = 64.74%], test : [loss = 1.408, top1 = 65.20%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 24.82%], valid : [loss = 3.082, top1 = 23.53%], test : [loss = 3.086, top1 = 23.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 56.94%], valid : [loss = 1.194, top1 = 56.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4471/15625) 004471-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.580, top1 = 88.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.367, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.92 ms.
cifar100       train : [loss = 0.173, top1 = 96.17%], valid : [loss = 1.443, top1 = 66.30%], test : [loss = 1.426, top1 = 66.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.98%], valid : [loss = 2.465, top1 = 38.93%], test : [loss = 2.487, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.64%], valid : [loss = 0.762, top1 = 73.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4472/15625) 004472-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.490, top1 = 88.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.324, top1 = 92.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.265, top1 = 93.27%], valid : [loss = 1.247, top1 = 68.06%], test : [loss = 1.220, top1 = 68.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.26%], valid : [loss = 2.219, top1 = 42.47%], test : [loss = 2.274, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4473/15625) 004473-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.320, top1 = 92.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.01 ms.
cifar100       train : [loss = 0.328, top1 = 91.15%], valid : [loss = 1.258, top1 = 67.53%], test : [loss = 1.253, top1 = 68.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.69%], valid : [loss = 2.328, top1 = 40.63%], test : [loss = 2.341, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4474/15625) 004474-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.490, top1 = 90.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.87 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.324, top1 = 93.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.73 ms.
cifar100       train : [loss = 0.107, top1 = 97.99%], valid : [loss = 1.312, top1 = 69.75%], test : [loss = 1.290, top1 = 69.81%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.35 ms.
ImageNet16-120 train : [loss = 1.676, top1 = 54.98%], valid : [loss = 2.150, top1 = 44.92%], test : [loss = 2.196, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.99%], valid : [loss = 0.570, top1 = 80.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4475/15625) 004475-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.515, top1 = 88.44%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.15 ms.
cifar10        train : [loss = 0.023, top1 = 99.42%], test  : [loss = 0.341, top1 = 91.41%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.09 ms.
cifar100       train : [loss = 0.352, top1 = 90.39%], valid : [loss = 1.339, top1 = 66.10%], test : [loss = 1.328, top1 = 66.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.022, top1 = 46.96%], valid : [loss = 2.269, top1 = 42.00%], test : [loss = 2.289, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.56%], valid : [loss = 0.779, top1 = 72.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4476/15625) 004476-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.85%], valid : [loss = 0.568, top1 = 85.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10        train : [loss = 0.110, top1 = 96.39%], test  : [loss = 0.402, top1 = 88.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.05 ms.
cifar100       train : [loss = 0.814, top1 = 76.07%], valid : [loss = 1.439, top1 = 62.14%], test : [loss = 1.416, top1 = 62.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.20%], valid : [loss = 2.772, top1 = 30.87%], test : [loss = 2.805, top1 = 31.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4477/15625) 004477-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.532, top1 = 88.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.13 ms.
cifar10        train : [loss = 0.021, top1 = 99.49%], test  : [loss = 0.349, top1 = 91.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.67 ms.
cifar100       train : [loss = 0.389, top1 = 88.89%], valid : [loss = 1.320, top1 = 66.56%], test : [loss = 1.351, top1 = 66.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.79%], valid : [loss = 2.402, top1 = 38.80%], test : [loss = 2.478, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.38%], valid : [loss = 0.620, top1 = 79.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4478/15625) 004478-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.06 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.75 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.15 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4479/15625) 004479-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.510, top1 = 89.67%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.79 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.20%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.74 ms.
cifar100       train : [loss = 0.075, top1 = 98.84%], valid : [loss = 1.360, top1 = 69.09%], test : [loss = 1.320, top1 = 70.28%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.609, top1 = 56.72%], valid : [loss = 2.183, top1 = 44.20%], test : [loss = 2.183, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.75%], valid : [loss = 0.567, top1 = 80.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4480/15625) 004480-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 1.975, top1 = 25.48%], valid : [loss = 1.983, top1 = 24.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.785, top1 = 72.50%], test  : [loss = 0.860, top1 = 69.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.31 ms.
cifar100       train : [loss = 2.152, top1 = 43.55%], valid : [loss = 2.339, top1 = 39.42%], test : [loss = 2.348, top1 = 39.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 3.754, top1 = 14.04%], valid : [loss = 3.780, top1 = 13.70%], test : [loss = 3.786, top1 = 13.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.449, top1 = 47.06%], valid : [loss = 1.471, top1 = 46.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4481/15625) 004481-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.276, top1 = 91.00%], valid : [loss = 0.483, top1 = 84.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10        train : [loss = 0.300, top1 = 89.87%], test  : [loss = 0.407, top1 = 86.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.83 ms.
cifar100       train : [loss = 1.342, top1 = 62.90%], valid : [loss = 1.540, top1 = 57.72%], test : [loss = 1.525, top1 = 58.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.87 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.54%], valid : [loss = 2.897, top1 = 28.90%], test : [loss = 2.951, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4482/15625) 004482-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.29%], valid : [loss = 0.610, top1 = 85.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10        train : [loss = 0.067, top1 = 97.98%], test  : [loss = 0.398, top1 = 88.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 0.714, top1 = 79.25%], valid : [loss = 1.391, top1 = 62.75%], test : [loss = 1.378, top1 = 63.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.29%], valid : [loss = 2.639, top1 = 34.21%], test : [loss = 2.664, top1 = 33.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4483/15625) 004483-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.504, top1 = 88.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.328, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.24 ms.
cifar100       train : [loss = 0.364, top1 = 90.02%], valid : [loss = 1.323, top1 = 65.80%], test : [loss = 1.307, top1 = 67.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.40%], valid : [loss = 2.422, top1 = 38.63%], test : [loss = 2.439, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4484/15625) 004484-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.533, top1 = 88.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.334, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.09 ms.
cifar100       train : [loss = 0.339, top1 = 90.80%], valid : [loss = 1.274, top1 = 67.07%], test : [loss = 1.287, top1 = 67.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.69%], valid : [loss = 2.403, top1 = 38.93%], test : [loss = 2.427, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4485/15625) 004485-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.501, top1 = 89.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.307, top1 = 93.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.30 ms.
cifar100       train : [loss = 0.123, top1 = 97.67%], valid : [loss = 1.296, top1 = 69.11%], test : [loss = 1.296, top1 = 69.65%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.56 ms.
ImageNet16-120 train : [loss = 1.765, top1 = 52.98%], valid : [loss = 2.240, top1 = 42.99%], test : [loss = 2.228, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.84%], valid : [loss = 0.628, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4486/15625) 004486-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.500, top1 = 88.90%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.320, top1 = 92.30%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.29 ms.
cifar100       train : [loss = 0.320, top1 = 91.38%], valid : [loss = 1.299, top1 = 66.96%], test : [loss = 1.310, top1 = 67.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.91 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.15%], valid : [loss = 2.411, top1 = 38.30%], test : [loss = 2.402, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.57%], valid : [loss = 0.606, top1 = 79.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4487/15625) 004487-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.59%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.35 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.330, top1 = 93.14%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.25 ms.
cifar100       train : [loss = 0.067, top1 = 99.02%], valid : [loss = 1.363, top1 = 69.32%], test : [loss = 1.337, top1 = 70.04%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.94 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 46.90%], valid : [loss = 2.366, top1 = 39.43%], test : [loss = 2.374, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.07%], valid : [loss = 0.775, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4488/15625) 004488-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.77 ms.
cifar10-valid  train : [loss = 0.996, top1 = 64.50%], valid : [loss = 1.167, top1 = 59.74%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.00 ms.
cifar10        train : [loss = 0.988, top1 = 64.92%], test  : [loss = 1.058, top1 = 62.88%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.44 ms.
cifar100       train : [loss = 2.426, top1 = 37.61%], valid : [loss = 2.643, top1 = 34.12%], test : [loss = 2.609, top1 = 35.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.70 ms.
ImageNet16-120 train : [loss = 3.865, top1 = 12.31%], valid : [loss = 3.887, top1 = 13.10%], test : [loss = 3.893, top1 = 12.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.524, top1 = 44.23%], valid : [loss = 1.541, top1 = 43.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4489/15625) 004489-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.67%], valid : [loss = 0.844, top1 = 72.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.77 ms.
cifar10        train : [loss = 0.552, top1 = 80.70%], test  : [loss = 0.708, top1 = 75.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.19 ms.
cifar100       train : [loss = 1.786, top1 = 51.97%], valid : [loss = 2.078, top1 = 46.76%], test : [loss = 2.085, top1 = 46.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.96%], valid : [loss = 3.622, top1 = 16.43%], test : [loss = 3.648, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.36%], valid : [loss = 1.272, top1 = 54.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4490/15625) 004490-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.54 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.519, top1 = 89.09%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.317, top1 = 93.05%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.73 ms.
cifar100       train : [loss = 0.097, top1 = 98.04%], valid : [loss = 1.419, top1 = 68.50%], test : [loss = 1.439, top1 = 68.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.09 ms.
ImageNet16-120 train : [loss = 2.093, top1 = 45.24%], valid : [loss = 2.425, top1 = 38.70%], test : [loss = 2.396, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.39%], valid : [loss = 0.916, top1 = 67.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4491/15625) 004491-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.456, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.307, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.331, top1 = 90.96%], valid : [loss = 1.286, top1 = 67.53%], test : [loss = 1.298, top1 = 67.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.42%], valid : [loss = 2.372, top1 = 39.78%], test : [loss = 2.370, top1 = 39.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.462, top1 = 83.89%], valid : [loss = 0.557, top1 = 81.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4492/15625) 004492-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.02 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.69 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4493/15625) 004493-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.82 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.82%], valid : [loss = 0.864, top1 = 71.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.83 ms.
cifar10        train : [loss = 0.560, top1 = 80.60%], test  : [loss = 0.716, top1 = 75.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.62 ms.
cifar100       train : [loss = 1.782, top1 = 51.97%], valid : [loss = 2.048, top1 = 47.14%], test : [loss = 2.068, top1 = 46.57%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.80 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.75%], valid : [loss = 3.638, top1 = 16.18%], test : [loss = 3.657, top1 = 15.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4494/15625) 004494-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.84%], valid : [loss = 0.522, top1 = 83.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10        train : [loss = 0.248, top1 = 91.63%], test  : [loss = 0.413, top1 = 86.46%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.31 ms.
cifar100       train : [loss = 1.464, top1 = 58.85%], valid : [loss = 1.728, top1 = 53.30%], test : [loss = 1.680, top1 = 54.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.965, top1 = 27.30%], valid : [loss = 2.969, top1 = 27.47%], test : [loss = 3.021, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.15%], valid : [loss = 1.036, top1 = 63.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4495/15625) 004495-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.46 ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.48%], valid : [loss = 0.956, top1 = 67.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10        train : [loss = 0.796, top1 = 72.13%], test  : [loss = 0.879, top1 = 69.43%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.90 ms.
cifar100       train : [loss = 2.114, top1 = 44.35%], valid : [loss = 2.278, top1 = 41.74%], test : [loss = 2.319, top1 = 40.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.46 ms.
ImageNet16-120 train : [loss = 3.746, top1 = 14.19%], valid : [loss = 3.762, top1 = 14.23%], test : [loss = 3.783, top1 = 13.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4496/15625) 004496-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.514, top1 = 89.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.322, top1 = 93.03%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.28 ms.
cifar100       train : [loss = 0.092, top1 = 98.15%], valid : [loss = 1.394, top1 = 69.16%], test : [loss = 1.342, top1 = 70.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 1.683, top1 = 54.93%], valid : [loss = 2.186, top1 = 44.23%], test : [loss = 2.155, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.11%], valid : [loss = 0.751, top1 = 73.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4497/15625) 004497-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.68%], valid : [loss = 0.726, top1 = 74.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.574, top1 = 79.97%], test  : [loss = 0.626, top1 = 78.27%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.61 ms.
cifar100       train : [loss = 1.997, top1 = 46.26%], valid : [loss = 2.120, top1 = 44.00%], test : [loss = 2.115, top1 = 44.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 3.245, top1 = 22.12%], valid : [loss = 3.224, top1 = 22.97%], test : [loss = 3.271, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.251, top1 = 55.00%], valid : [loss = 1.312, top1 = 52.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4498/15625) 004498-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.25%], valid : [loss = 0.460, top1 = 86.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10        train : [loss = 0.113, top1 = 96.48%], test  : [loss = 0.330, top1 = 89.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.09 ms.
cifar100       train : [loss = 0.861, top1 = 75.51%], valid : [loss = 1.301, top1 = 63.60%], test : [loss = 1.287, top1 = 64.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.69%], valid : [loss = 2.628, top1 = 33.84%], test : [loss = 2.652, top1 = 33.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4499/15625) 004499-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.76 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.89%], valid : [loss = 0.838, top1 = 72.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.552, top1 = 80.84%], test  : [loss = 0.714, top1 = 75.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 1.779, top1 = 52.11%], valid : [loss = 2.039, top1 = 47.34%], test : [loss = 2.044, top1 = 47.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.98 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.90%], valid : [loss = 3.637, top1 = 16.73%], test : [loss = 3.656, top1 = 16.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4500/15625) 004500-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.86%], valid : [loss = 0.625, top1 = 86.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10        train : [loss = 0.029, top1 = 99.26%], test  : [loss = 0.427, top1 = 89.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.50 ms.
cifar100       train : [loss = 0.408, top1 = 89.04%], valid : [loss = 1.493, top1 = 63.34%], test : [loss = 1.482, top1 = 62.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.27%], valid : [loss = 2.576, top1 = 35.57%], test : [loss = 2.642, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.42%], valid : [loss = 0.769, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4501/15625) 004501-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.548, top1 = 89.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.368, top1 = 92.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.96 ms.
cifar100       train : [loss = 0.100, top1 = 98.17%], valid : [loss = 1.503, top1 = 67.52%], test : [loss = 1.492, top1 = 67.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.89%], valid : [loss = 2.426, top1 = 39.90%], test : [loss = 2.431, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4502/15625) 004502-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.12%], valid : [loss = 0.587, top1 = 80.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.336, top1 = 88.50%], test  : [loss = 0.484, top1 = 84.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.09 ms.
cifar100       train : [loss = 1.681, top1 = 53.60%], valid : [loss = 1.880, top1 = 50.04%], test : [loss = 1.881, top1 = 49.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.39%], valid : [loss = 3.227, top1 = 22.37%], test : [loss = 3.287, top1 = 22.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.062, top1 = 61.60%], valid : [loss = 1.099, top1 = 60.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4503/15625) 004503-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.26%], valid : [loss = 0.610, top1 = 85.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.02 ms.
cifar10        train : [loss = 0.048, top1 = 98.51%], test  : [loss = 0.395, top1 = 89.77%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.61 ms.
cifar100       train : [loss = 0.664, top1 = 80.42%], valid : [loss = 1.533, top1 = 61.60%], test : [loss = 1.500, top1 = 61.78%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.32%], valid : [loss = 2.544, top1 = 35.70%], test : [loss = 2.617, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.48%], valid : [loss = 0.902, top1 = 67.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4504/15625) 004504-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.00%], valid : [loss = 0.833, top1 = 72.26%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10        train : [loss = 0.571, top1 = 79.86%], test  : [loss = 0.713, top1 = 76.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.17 ms.
cifar100       train : [loss = 1.788, top1 = 51.70%], valid : [loss = 2.038, top1 = 47.08%], test : [loss = 2.072, top1 = 46.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.89%], valid : [loss = 3.630, top1 = 16.30%], test : [loss = 3.648, top1 = 15.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4505/15625) 004505-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.507, top1 = 89.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.366, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.88 ms.
cifar100       train : [loss = 0.073, top1 = 98.86%], valid : [loss = 1.494, top1 = 67.94%], test : [loss = 1.463, top1 = 68.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.96%], valid : [loss = 2.408, top1 = 40.07%], test : [loss = 2.401, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.91%], valid : [loss = 0.699, top1 = 75.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4506/15625) 004506-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.62%], valid : [loss = 0.471, top1 = 84.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.302, top1 = 89.87%], test  : [loss = 0.392, top1 = 86.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 1.333, top1 = 63.02%], valid : [loss = 1.532, top1 = 57.72%], test : [loss = 1.514, top1 = 58.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.62%], valid : [loss = 2.915, top1 = 30.03%], test : [loss = 2.944, top1 = 29.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4507/15625) 004507-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.581, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.373, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.19 ms.
cifar100       train : [loss = 0.120, top1 = 97.66%], valid : [loss = 1.474, top1 = 67.60%], test : [loss = 1.436, top1 = 68.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.87%], valid : [loss = 2.448, top1 = 38.40%], test : [loss = 2.445, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.14%], valid : [loss = 0.741, top1 = 74.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4508/15625) 004508-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.37%], valid : [loss = 0.577, top1 = 81.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.262, top1 = 91.01%], test  : [loss = 0.403, top1 = 86.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 1.491, top1 = 58.26%], valid : [loss = 1.735, top1 = 52.99%], test : [loss = 1.725, top1 = 53.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.964, top1 = 27.34%], valid : [loss = 2.984, top1 = 27.26%], test : [loss = 3.020, top1 = 26.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4509/15625) 004509-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.93%], valid : [loss = 0.882, top1 = 71.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.565, top1 = 80.36%], test  : [loss = 0.718, top1 = 75.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 1.767, top1 = 52.24%], valid : [loss = 2.054, top1 = 47.10%], test : [loss = 2.076, top1 = 45.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 3.596, top1 = 16.64%], valid : [loss = 3.642, top1 = 16.77%], test : [loss = 3.677, top1 = 16.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4510/15625) 004510-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.538, top1 = 89.18%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.55 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.321, top1 = 93.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.51 ms.
cifar100       train : [loss = 0.115, top1 = 97.70%], valid : [loss = 1.338, top1 = 70.30%], test : [loss = 1.340, top1 = 69.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 1.783, top1 = 52.46%], valid : [loss = 2.282, top1 = 41.30%], test : [loss = 2.261, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 76.23%], valid : [loss = 0.731, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4511/15625) 004511-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.490, top1 = 89.93%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.320, top1 = 93.38%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.84 ms.
cifar100       train : [loss = 0.066, top1 = 98.96%], valid : [loss = 1.313, top1 = 70.38%], test : [loss = 1.293, top1 = 70.52%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.00 ms.
ImageNet16-120 train : [loss = 1.682, top1 = 55.12%], valid : [loss = 2.187, top1 = 44.30%], test : [loss = 2.196, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.56%], valid : [loss = 0.763, top1 = 73.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4512/15625) 004512-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.02%], valid : [loss = 0.492, top1 = 84.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10        train : [loss = 0.303, top1 = 89.79%], test  : [loss = 0.420, top1 = 85.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 1.334, top1 = 63.20%], valid : [loss = 1.527, top1 = 58.00%], test : [loss = 1.500, top1 = 58.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.78%], valid : [loss = 2.893, top1 = 29.67%], test : [loss = 2.962, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4513/15625) 004513-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.477, top1 = 89.89%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.02 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.293, top1 = 93.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.45 ms.
cifar100       train : [loss = 0.109, top1 = 98.04%], valid : [loss = 1.269, top1 = 70.32%], test : [loss = 1.260, top1 = 70.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.58%], valid : [loss = 2.203, top1 = 43.77%], test : [loss = 2.208, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 82.04%], valid : [loss = 0.617, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4514/15625) 004514-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.66%], valid : [loss = 0.941, top1 = 75.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.217, top1 = 92.59%], test  : [loss = 0.577, top1 = 82.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.41 ms.
cifar100       train : [loss = 1.163, top1 = 66.84%], valid : [loss = 1.746, top1 = 54.38%], test : [loss = 1.771, top1 = 54.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 3.230, top1 = 22.71%], valid : [loss = 3.333, top1 = 21.20%], test : [loss = 3.338, top1 = 20.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.063, top1 = 62.04%], valid : [loss = 1.117, top1 = 60.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4515/15625) 004515-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=20.30 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.572, top1 = 87.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10        train : [loss = 0.030, top1 = 99.13%], test  : [loss = 0.355, top1 = 91.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.72 ms.
cifar100       train : [loss = 0.441, top1 = 87.24%], valid : [loss = 1.225, top1 = 67.02%], test : [loss = 1.212, top1 = 68.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.67 ms.
ImageNet16-120 train : [loss = 2.202, top1 = 42.99%], valid : [loss = 2.364, top1 = 40.13%], test : [loss = 2.401, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.54%], valid : [loss = 0.814, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4516/15625) 004516-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4517/15625) 004517-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.81%], valid : [loss = 0.647, top1 = 78.18%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10        train : [loss = 0.512, top1 = 82.23%], test  : [loss = 0.588, top1 = 80.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.24 ms.
cifar100       train : [loss = 1.677, top1 = 54.52%], valid : [loss = 1.851, top1 = 51.00%], test : [loss = 1.851, top1 = 50.82%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.07 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.27%], valid : [loss = 3.297, top1 = 21.37%], test : [loss = 3.367, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4518/15625) 004518-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.482, top1 = 89.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.301, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.65 ms.
cifar100       train : [loss = 0.317, top1 = 91.52%], valid : [loss = 1.259, top1 = 67.10%], test : [loss = 1.285, top1 = 67.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.79%], valid : [loss = 2.326, top1 = 40.62%], test : [loss = 2.363, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.55%], valid : [loss = 0.636, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4519/15625) 004519-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.474, top1 = 89.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.322, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.331, top1 = 90.85%], valid : [loss = 1.325, top1 = 67.29%], test : [loss = 1.299, top1 = 67.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 46.01%], valid : [loss = 2.354, top1 = 40.07%], test : [loss = 2.372, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.59%], valid : [loss = 0.612, top1 = 79.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4520/15625) 004520-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.28%], valid : [loss = 0.850, top1 = 72.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.561, top1 = 80.24%], test  : [loss = 0.705, top1 = 76.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.16 ms.
cifar100       train : [loss = 1.785, top1 = 51.71%], valid : [loss = 2.033, top1 = 46.76%], test : [loss = 2.037, top1 = 46.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.67%], valid : [loss = 3.647, top1 = 16.43%], test : [loss = 3.680, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.197, top1 = 56.94%], valid : [loss = 1.261, top1 = 54.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4521/15625) 004521-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.573, top1 = 88.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.342, top1 = 92.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.49 ms.
cifar100       train : [loss = 0.151, top1 = 96.59%], valid : [loss = 1.348, top1 = 67.86%], test : [loss = 1.356, top1 = 68.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.23%], valid : [loss = 2.345, top1 = 39.80%], test : [loss = 2.324, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.93%], valid : [loss = 0.833, top1 = 70.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4522/15625) 004522-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.550, top1 = 88.74%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.75 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.359, top1 = 92.01%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.41 ms.
cifar100       train : [loss = 0.231, top1 = 94.27%], valid : [loss = 1.262, top1 = 67.82%], test : [loss = 1.270, top1 = 68.78%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.13%], valid : [loss = 2.184, top1 = 43.73%], test : [loss = 2.209, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.48%], valid : [loss = 0.748, top1 = 73.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4523/15625) 004523-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.481, top1 = 88.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.69 ms.
cifar10        train : [loss = 0.016, top1 = 99.67%], test  : [loss = 0.317, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.378, top1 = 89.12%], valid : [loss = 1.295, top1 = 67.60%], test : [loss = 1.317, top1 = 66.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.71%], valid : [loss = 2.344, top1 = 40.30%], test : [loss = 2.398, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.16%], valid : [loss = 0.703, top1 = 75.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4524/15625) 004524-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.88%], valid : [loss = 0.655, top1 = 78.09%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10        train : [loss = 0.510, top1 = 82.35%], test  : [loss = 0.595, top1 = 80.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.71 ms.
cifar100       train : [loss = 1.681, top1 = 54.37%], valid : [loss = 1.846, top1 = 50.53%], test : [loss = 1.847, top1 = 51.05%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.68 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.33%], valid : [loss = 3.309, top1 = 21.47%], test : [loss = 3.344, top1 = 21.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4525/15625) 004525-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.91%], valid : [loss = 0.749, top1 = 83.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10        train : [loss = 0.087, top1 = 97.27%], test  : [loss = 0.488, top1 = 86.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.46 ms.
cifar100       train : [loss = 0.823, top1 = 76.13%], valid : [loss = 1.588, top1 = 59.05%], test : [loss = 1.558, top1 = 59.61%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.823, top1 = 30.17%], valid : [loss = 2.942, top1 = 28.56%], test : [loss = 3.004, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 71.00%], valid : [loss = 0.872, top1 = 69.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4526/15625) 004526-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.91%], valid : [loss = 0.750, top1 = 74.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.54 ms.
cifar10        train : [loss = 0.512, top1 = 82.32%], test  : [loss = 0.596, top1 = 79.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.31 ms.
cifar100       train : [loss = 1.947, top1 = 47.65%], valid : [loss = 2.081, top1 = 44.91%], test : [loss = 2.088, top1 = 44.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 3.003, top1 = 26.59%], valid : [loss = 2.987, top1 = 27.29%], test : [loss = 3.018, top1 = 26.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.129, top1 = 59.56%], valid : [loss = 1.176, top1 = 58.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4527/15625) 004527-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.065, top1 = 98.14%], valid : [loss = 0.579, top1 = 85.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10        train : [loss = 0.103, top1 = 96.66%], test  : [loss = 0.408, top1 = 88.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.90 ms.
cifar100       train : [loss = 0.827, top1 = 75.63%], valid : [loss = 1.396, top1 = 62.78%], test : [loss = 1.399, top1 = 62.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.22%], valid : [loss = 2.748, top1 = 32.30%], test : [loss = 2.815, top1 = 31.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4528/15625) 004528-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.28%], valid : [loss = 0.476, top1 = 85.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.87 ms.
cifar10        train : [loss = 0.154, top1 = 94.98%], test  : [loss = 0.352, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.80 ms.
cifar100       train : [loss = 1.005, top1 = 71.37%], valid : [loss = 1.365, top1 = 61.08%], test : [loss = 1.344, top1 = 62.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.663, top1 = 33.30%], valid : [loss = 2.723, top1 = 32.53%], test : [loss = 2.724, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4529/15625) 004529-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.553, top1 = 88.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.384, top1 = 91.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.397, top1 = 88.72%], valid : [loss = 1.408, top1 = 65.22%], test : [loss = 1.380, top1 = 65.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.74%], valid : [loss = 2.473, top1 = 37.87%], test : [loss = 2.490, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.64%], valid : [loss = 0.764, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4530/15625) 004530-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.569, top1 = 87.45%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.93 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.381, top1 = 91.18%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.90 ms.
cifar100       train : [loss = 0.398, top1 = 88.78%], valid : [loss = 1.401, top1 = 65.52%], test : [loss = 1.413, top1 = 65.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.90 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.79%], valid : [loss = 2.506, top1 = 37.03%], test : [loss = 2.525, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.27%], valid : [loss = 0.799, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4531/15625) 004531-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.556, top1 = 88.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.341, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.44 ms.
cifar100       train : [loss = 0.247, top1 = 93.12%], valid : [loss = 1.354, top1 = 67.02%], test : [loss = 1.352, top1 = 67.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.592, top1 = 33.91%], valid : [loss = 2.682, top1 = 31.67%], test : [loss = 2.693, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.42%], valid : [loss = 1.008, top1 = 64.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4532/15625) 004532-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.336, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.333, top1 = 90.86%], valid : [loss = 1.302, top1 = 66.82%], test : [loss = 1.275, top1 = 68.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.64%], valid : [loss = 2.395, top1 = 39.27%], test : [loss = 2.431, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4533/15625) 004533-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.510, top1 = 89.70%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.85 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.322, top1 = 93.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.49 ms.
cifar100       train : [loss = 0.075, top1 = 98.77%], valid : [loss = 1.388, top1 = 69.44%], test : [loss = 1.358, top1 = 69.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.69 ms.
ImageNet16-120 train : [loss = 2.022, top1 = 46.87%], valid : [loss = 2.377, top1 = 39.33%], test : [loss = 2.398, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4534/15625) 004534-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.29%], valid : [loss = 0.457, top1 = 86.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.03 ms.
cifar10        train : [loss = 0.117, top1 = 96.38%], test  : [loss = 0.333, top1 = 89.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.16 ms.
cifar100       train : [loss = 0.856, top1 = 75.59%], valid : [loss = 1.289, top1 = 64.18%], test : [loss = 1.274, top1 = 63.93%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.85%], valid : [loss = 2.614, top1 = 34.24%], test : [loss = 2.651, top1 = 33.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.17%], valid : [loss = 0.666, top1 = 77.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4535/15625) 004535-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.10%], valid : [loss = 0.465, top1 = 86.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.157, top1 = 94.88%], test  : [loss = 0.350, top1 = 88.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.16 ms.
cifar100       train : [loss = 0.998, top1 = 71.74%], valid : [loss = 1.344, top1 = 62.52%], test : [loss = 1.357, top1 = 62.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.72 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.53%], valid : [loss = 2.703, top1 = 33.03%], test : [loss = 2.746, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4536/15625) 004536-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.511, top1 = 89.74%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=16.85 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.305, top1 = 93.48%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.34 ms.
cifar100       train : [loss = 0.093, top1 = 98.33%], valid : [loss = 1.462, top1 = 66.80%], test : [loss = 1.438, top1 = 67.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 2.097, top1 = 45.07%], valid : [loss = 2.392, top1 = 39.60%], test : [loss = 2.424, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.84%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4537/15625) 004537-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.27%], valid : [loss = 0.440, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.113, top1 = 96.46%], test  : [loss = 0.319, top1 = 90.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.31 ms.
cifar100       train : [loss = 0.856, top1 = 75.60%], valid : [loss = 1.284, top1 = 64.08%], test : [loss = 1.279, top1 = 64.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.56%], valid : [loss = 2.637, top1 = 34.17%], test : [loss = 2.651, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4538/15625) 004538-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.16%], valid : [loss = 0.611, top1 = 85.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.98 ms.
cifar10        train : [loss = 0.070, top1 = 97.79%], test  : [loss = 0.383, top1 = 89.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.29 ms.
cifar100       train : [loss = 0.715, top1 = 79.37%], valid : [loss = 1.384, top1 = 63.22%], test : [loss = 1.361, top1 = 62.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.83%], valid : [loss = 2.660, top1 = 34.00%], test : [loss = 2.726, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.68%], valid : [loss = 0.800, top1 = 72.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4539/15625) 004539-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.583, top1 = 88.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.408, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.73 ms.
cifar100       train : [loss = 0.232, top1 = 94.29%], valid : [loss = 1.451, top1 = 66.42%], test : [loss = 1.421, top1 = 65.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.91%], valid : [loss = 2.479, top1 = 37.37%], test : [loss = 2.505, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.20%], valid : [loss = 0.742, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4540/15625) 004540-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.31%], valid : [loss = 0.681, top1 = 84.30%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.06 ms.
cifar10        train : [loss = 0.056, top1 = 98.24%], test  : [loss = 0.433, top1 = 88.76%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.92 ms.
cifar100       train : [loss = 0.638, top1 = 81.50%], valid : [loss = 1.408, top1 = 63.74%], test : [loss = 1.397, top1 = 63.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.507, top1 = 36.46%], valid : [loss = 2.649, top1 = 33.87%], test : [loss = 2.667, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.52%], valid : [loss = 0.844, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4541/15625) 004541-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.598, top1 = 88.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.374, top1 = 92.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.06 ms.
cifar100       train : [loss = 0.099, top1 = 98.22%], valid : [loss = 1.497, top1 = 67.38%], test : [loss = 1.486, top1 = 67.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 1.870, top1 = 50.53%], valid : [loss = 2.426, top1 = 39.63%], test : [loss = 2.490, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.06%], valid : [loss = 0.765, top1 = 73.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4542/15625) 004542-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.698, top1 = 86.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.65 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.487, top1 = 89.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.67 ms.
cifar100       train : [loss = 0.253, top1 = 93.60%], valid : [loss = 1.678, top1 = 62.40%], test : [loss = 1.640, top1 = 62.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.372, top1 = 39.60%], valid : [loss = 2.786, top1 = 31.67%], test : [loss = 2.838, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.30%], valid : [loss = 0.859, top1 = 69.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4543/15625) 004543-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.88%], valid : [loss = 0.449, top1 = 86.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.25 ms.
cifar10        train : [loss = 0.141, top1 = 95.51%], test  : [loss = 0.328, top1 = 89.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.29 ms.
cifar100       train : [loss = 0.901, top1 = 74.35%], valid : [loss = 1.327, top1 = 63.32%], test : [loss = 1.301, top1 = 63.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.67%], valid : [loss = 2.609, top1 = 34.77%], test : [loss = 2.638, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.65%], valid : [loss = 0.794, top1 = 72.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4544/15625) 004544-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.558, top1 = 88.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.76 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.352, top1 = 92.31%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.81 ms.
cifar100       train : [loss = 0.132, top1 = 96.93%], valid : [loss = 1.418, top1 = 68.02%], test : [loss = 1.470, top1 = 67.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.66%], valid : [loss = 2.396, top1 = 38.57%], test : [loss = 2.431, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.66%], valid : [loss = 0.892, top1 = 68.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4545/15625) 004545-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.48%], valid : [loss = 0.707, top1 = 75.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.594, top1 = 79.25%], test  : [loss = 0.642, top1 = 78.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.40 ms.
cifar100       train : [loss = 1.738, top1 = 52.93%], valid : [loss = 1.899, top1 = 49.72%], test : [loss = 1.897, top1 = 50.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 3.401, top1 = 19.82%], valid : [loss = 3.378, top1 = 21.07%], test : [loss = 3.414, top1 = 19.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 50.89%], valid : [loss = 1.373, top1 = 50.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4546/15625) 004546-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.30%], valid : [loss = 0.566, top1 = 85.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.104, top1 = 96.52%], test  : [loss = 0.387, top1 = 88.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.828, top1 = 75.35%], valid : [loss = 1.441, top1 = 62.32%], test : [loss = 1.422, top1 = 62.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.05%], valid : [loss = 2.767, top1 = 31.83%], test : [loss = 2.781, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4547/15625) 004547-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.564, top1 = 87.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.374, top1 = 91.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.68 ms.
cifar100       train : [loss = 0.385, top1 = 89.22%], valid : [loss = 1.422, top1 = 65.30%], test : [loss = 1.372, top1 = 66.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.94%], valid : [loss = 2.506, top1 = 36.97%], test : [loss = 2.528, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4548/15625) 004548-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.454, top1 = 89.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.324, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.23 ms.
cifar100       train : [loss = 0.326, top1 = 91.24%], valid : [loss = 1.318, top1 = 66.97%], test : [loss = 1.347, top1 = 66.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.39%], valid : [loss = 2.363, top1 = 39.63%], test : [loss = 2.399, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4549/15625) 004549-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.815, top1 = 71.33%], valid : [loss = 0.988, top1 = 66.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.778, top1 = 72.61%], test  : [loss = 0.853, top1 = 70.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 2.184, top1 = 42.89%], valid : [loss = 2.380, top1 = 40.28%], test : [loss = 2.376, top1 = 39.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 3.758, top1 = 14.02%], valid : [loss = 3.772, top1 = 14.60%], test : [loss = 3.801, top1 = 13.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 47.11%], valid : [loss = 1.468, top1 = 46.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4550/15625) 004550-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=16.68 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.350, top1 = 92.68%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.82 ms.
cifar100       train : [loss = 0.162, top1 = 96.34%], valid : [loss = 1.552, top1 = 65.36%], test : [loss = 1.533, top1 = 64.76%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.330, top1 = 39.57%], valid : [loss = 2.534, top1 = 35.57%], test : [loss = 2.537, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.921, top1 = 67.03%], valid : [loss = 0.957, top1 = 65.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4551/15625) 004551-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.42%], valid : [loss = 0.644, top1 = 78.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.27 ms.
cifar10        train : [loss = 0.506, top1 = 82.54%], test  : [loss = 0.587, top1 = 79.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.17 ms.
cifar100       train : [loss = 1.684, top1 = 54.30%], valid : [loss = 1.863, top1 = 50.41%], test : [loss = 1.865, top1 = 51.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.29%], valid : [loss = 3.330, top1 = 21.57%], test : [loss = 3.341, top1 = 20.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.295, top1 = 53.24%], valid : [loss = 1.331, top1 = 52.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4552/15625) 004552-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.619, top1 = 86.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.17 ms.
cifar10        train : [loss = 0.031, top1 = 99.24%], test  : [loss = 0.397, top1 = 89.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=17.53 ms.
cifar100       train : [loss = 0.377, top1 = 89.97%], valid : [loss = 1.447, top1 = 63.94%], test : [loss = 1.444, top1 = 64.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.08%], valid : [loss = 2.623, top1 = 35.00%], test : [loss = 2.632, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4553/15625) 004553-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.520, top1 = 89.21%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.19 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.365, top1 = 92.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.37 ms.
cifar100       train : [loss = 0.078, top1 = 99.06%], valid : [loss = 1.439, top1 = 68.18%], test : [loss = 1.397, top1 = 68.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.44%], valid : [loss = 2.376, top1 = 40.83%], test : [loss = 2.417, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 81.99%], valid : [loss = 0.613, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4554/15625) 004554-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.98%], valid : [loss = 0.484, top1 = 84.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.294, top1 = 90.22%], test  : [loss = 0.398, top1 = 86.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 1.340, top1 = 62.53%], valid : [loss = 1.547, top1 = 56.98%], test : [loss = 1.524, top1 = 58.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.64%], valid : [loss = 2.906, top1 = 29.53%], test : [loss = 2.981, top1 = 27.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4555/15625) 004555-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.132, top1 = 95.93%], valid : [loss = 0.457, top1 = 86.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10        train : [loss = 0.169, top1 = 94.44%], test  : [loss = 0.352, top1 = 88.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 1.021, top1 = 70.67%], valid : [loss = 1.386, top1 = 60.76%], test : [loss = 1.386, top1 = 61.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.58%], valid : [loss = 2.713, top1 = 32.13%], test : [loss = 2.729, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.25%], valid : [loss = 0.797, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4556/15625) 004556-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.278, top1 = 91.02%], valid : [loss = 0.464, top1 = 84.67%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.70 ms.
cifar10        train : [loss = 0.303, top1 = 89.97%], test  : [loss = 0.401, top1 = 86.09%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.77 ms.
cifar100       train : [loss = 1.332, top1 = 63.04%], valid : [loss = 1.534, top1 = 57.42%], test : [loss = 1.508, top1 = 58.66%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.52%], valid : [loss = 2.909, top1 = 29.40%], test : [loss = 2.973, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 75.00%], valid : [loss = 0.749, top1 = 73.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4557/15625) 004557-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.500, top1 = 90.42%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.03 ms.
cifar10        train : [loss = 0.002, top1 = 99.96%], test  : [loss = 0.298, top1 = 93.97%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.23 ms.
cifar100       train : [loss = 0.036, top1 = 99.66%], valid : [loss = 1.339, top1 = 70.26%], test : [loss = 1.301, top1 = 71.28%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.21 ms.
ImageNet16-120 train : [loss = 1.478, top1 = 59.99%], valid : [loss = 2.172, top1 = 46.20%], test : [loss = 2.171, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 82.10%], valid : [loss = 0.611, top1 = 79.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4558/15625) 004558-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.22%], valid : [loss = 0.482, top1 = 85.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.65 ms.
cifar10        train : [loss = 0.159, top1 = 94.83%], test  : [loss = 0.343, top1 = 88.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 1.003, top1 = 71.71%], valid : [loss = 1.370, top1 = 61.58%], test : [loss = 1.344, top1 = 62.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.64%], valid : [loss = 2.708, top1 = 32.47%], test : [loss = 2.715, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4559/15625) 004559-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.94%], valid : [loss = 0.482, top1 = 84.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.301, top1 = 90.12%], test  : [loss = 0.404, top1 = 86.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.73 ms.
cifar100       train : [loss = 1.333, top1 = 62.90%], valid : [loss = 1.525, top1 = 57.62%], test : [loss = 1.516, top1 = 58.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.66 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.65%], valid : [loss = 2.905, top1 = 28.63%], test : [loss = 2.942, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4560/15625) 004560-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.521, top1 = 88.92%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.38 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.345, top1 = 92.00%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.99 ms.
cifar100       train : [loss = 0.246, top1 = 93.49%], valid : [loss = 1.322, top1 = 67.90%], test : [loss = 1.333, top1 = 68.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.82%], valid : [loss = 2.411, top1 = 38.83%], test : [loss = 2.403, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.14%], valid : [loss = 0.924, top1 = 67.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4561/15625) 004561-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.130, top1 = 96.11%], valid : [loss = 0.469, top1 = 85.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10        train : [loss = 0.163, top1 = 94.69%], test  : [loss = 0.349, top1 = 88.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.41 ms.
cifar100       train : [loss = 1.014, top1 = 71.29%], valid : [loss = 1.360, top1 = 62.26%], test : [loss = 1.373, top1 = 61.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.78%], valid : [loss = 2.716, top1 = 32.20%], test : [loss = 2.728, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4562/15625) 004562-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.400, top1 = 91.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.31 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.257, top1 = 94.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.40 ms.
cifar100       train : [loss = 0.050, top1 = 99.34%], valid : [loss = 1.300, top1 = 71.42%], test : [loss = 1.326, top1 = 71.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.91 ms.
ImageNet16-120 train : [loss = 1.418, top1 = 61.31%], valid : [loss = 2.239, top1 = 45.47%], test : [loss = 2.218, top1 = 45.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 87.92%], valid : [loss = 0.496, top1 = 83.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4563/15625) 004563-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.632, top1 = 86.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.408, top1 = 90.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.62 ms.
cifar100       train : [loss = 0.524, top1 = 84.82%], valid : [loss = 1.436, top1 = 63.10%], test : [loss = 1.443, top1 = 63.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 39.12%], valid : [loss = 2.575, top1 = 35.67%], test : [loss = 2.601, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4564/15625) 004564-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.308, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.18 ms.
cifar100       train : [loss = 0.206, top1 = 95.17%], valid : [loss = 1.278, top1 = 68.33%], test : [loss = 1.270, top1 = 69.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.862, top1 = 50.71%], valid : [loss = 2.253, top1 = 42.79%], test : [loss = 2.296, top1 = 41.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.418, top1 = 85.70%], valid : [loss = 0.528, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4565/15625) 004565-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.19 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4566/15625) 004566-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.531, top1 = 88.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.327, top1 = 91.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.61 ms.
cifar100       train : [loss = 0.437, top1 = 87.20%], valid : [loss = 1.254, top1 = 66.92%], test : [loss = 1.233, top1 = 67.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.35%], valid : [loss = 2.379, top1 = 39.77%], test : [loss = 2.390, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4567/15625) 004567-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.20%], valid : [loss = 0.458, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.167, top1 = 94.58%], test  : [loss = 0.362, top1 = 88.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.96 ms.
cifar100       train : [loss = 0.997, top1 = 71.79%], valid : [loss = 1.372, top1 = 61.68%], test : [loss = 1.367, top1 = 61.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.20%], valid : [loss = 2.719, top1 = 33.30%], test : [loss = 2.739, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4568/15625) 004568-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.71%], valid : [loss = 0.840, top1 = 71.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.684, top1 = 76.06%], test  : [loss = 0.765, top1 = 73.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.06 ms.
cifar100       train : [loss = 1.940, top1 = 48.21%], valid : [loss = 2.112, top1 = 45.38%], test : [loss = 2.134, top1 = 44.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 3.639, top1 = 15.88%], valid : [loss = 3.663, top1 = 16.17%], test : [loss = 3.686, top1 = 15.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4569/15625) 004569-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.76 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.16%], valid : [loss = 0.685, top1 = 76.86%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.89 ms.
cifar10        train : [loss = 0.550, top1 = 80.93%], test  : [loss = 0.606, top1 = 79.24%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.84 ms.
cifar100       train : [loss = 1.726, top1 = 53.09%], valid : [loss = 1.882, top1 = 49.76%], test : [loss = 1.914, top1 = 49.70%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.33 ms.
ImageNet16-120 train : [loss = 3.388, top1 = 20.11%], valid : [loss = 3.363, top1 = 21.57%], test : [loss = 3.419, top1 = 19.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4570/15625) 004570-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.329, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.45 ms.
cifar100       train : [loss = 0.272, top1 = 92.90%], valid : [loss = 1.364, top1 = 67.18%], test : [loss = 1.316, top1 = 67.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.41%], valid : [loss = 2.382, top1 = 39.70%], test : [loss = 2.398, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.17%], valid : [loss = 0.576, top1 = 80.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4571/15625) 004571-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.528, top1 = 89.55%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.343, top1 = 93.03%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.23 ms.
cifar100       train : [loss = 0.047, top1 = 99.50%], valid : [loss = 1.398, top1 = 69.00%], test : [loss = 1.444, top1 = 68.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 56.03%], valid : [loss = 2.416, top1 = 40.43%], test : [loss = 2.411, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.19%], valid : [loss = 0.674, top1 = 76.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4572/15625) 004572-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.552, top1 = 89.35%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.362, top1 = 92.70%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.28 ms.
cifar100       train : [loss = 0.094, top1 = 98.32%], valid : [loss = 1.426, top1 = 67.88%], test : [loss = 1.464, top1 = 67.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.83 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.03%], valid : [loss = 2.388, top1 = 38.97%], test : [loss = 2.399, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 77.04%], valid : [loss = 0.710, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4573/15625) 004573-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.40%], valid : [loss = 0.554, top1 = 87.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.17 ms.
cifar10        train : [loss = 0.037, top1 = 98.85%], test  : [loss = 0.358, top1 = 90.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.68 ms.
cifar100       train : [loss = 0.493, top1 = 86.18%], valid : [loss = 1.294, top1 = 66.44%], test : [loss = 1.286, top1 = 65.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.511, top1 = 35.89%], valid : [loss = 2.593, top1 = 33.83%], test : [loss = 2.635, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.06%], valid : [loss = 0.861, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4574/15625) 004574-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.141, top1 = 95.32%], valid : [loss = 0.752, top1 = 80.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.27 ms.
cifar10        train : [loss = 0.170, top1 = 94.19%], test  : [loss = 0.468, top1 = 86.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 1.011, top1 = 70.69%], valid : [loss = 1.643, top1 = 56.70%], test : [loss = 1.609, top1 = 57.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 3.117, top1 = 23.87%], valid : [loss = 3.156, top1 = 24.23%], test : [loss = 3.189, top1 = 23.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.66%], valid : [loss = 0.986, top1 = 65.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4575/15625) 004575-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.550, top1 = 87.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.029, top1 = 99.11%], test  : [loss = 0.355, top1 = 91.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.451, top1 = 86.66%], valid : [loss = 1.264, top1 = 67.86%], test : [loss = 1.282, top1 = 66.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.219, top1 = 42.64%], valid : [loss = 2.378, top1 = 39.73%], test : [loss = 2.384, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 66.84%], valid : [loss = 0.945, top1 = 65.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4576/15625) 004576-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.50%], valid : [loss = 0.537, top1 = 83.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.199, top1 = 93.23%], test  : [loss = 0.403, top1 = 87.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 1.233, top1 = 64.98%], valid : [loss = 1.544, top1 = 57.97%], test : [loss = 1.548, top1 = 57.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.696, top1 = 32.61%], valid : [loss = 2.743, top1 = 32.22%], test : [loss = 2.779, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.81%], valid : [loss = 0.975, top1 = 65.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4577/15625) 004577-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.472, top1 = 89.58%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.19 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.306, top1 = 92.55%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.50 ms.
cifar100       train : [loss = 0.248, top1 = 93.58%], valid : [loss = 1.235, top1 = 68.69%], test : [loss = 1.234, top1 = 68.97%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.18%], valid : [loss = 2.225, top1 = 42.15%], test : [loss = 2.223, top1 = 42.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.31%], valid : [loss = 0.588, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4578/15625) 004578-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.12%], valid : [loss = 0.451, top1 = 87.07%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=14.97 ms.
cifar10        train : [loss = 0.116, top1 = 96.40%], test  : [loss = 0.325, top1 = 89.67%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=13.61 ms.
cifar100       train : [loss = 0.871, top1 = 75.08%], valid : [loss = 1.297, top1 = 63.88%], test : [loss = 1.285, top1 = 64.03%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.562, top1 = 35.48%], valid : [loss = 2.625, top1 = 33.63%], test : [loss = 2.674, top1 = 33.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4579/15625) 004579-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.499, top1 = 89.21%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.22 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.306, top1 = 92.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.22 ms.
cifar100       train : [loss = 0.334, top1 = 90.73%], valid : [loss = 1.271, top1 = 68.22%], test : [loss = 1.296, top1 = 67.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.73 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.79%], valid : [loss = 2.206, top1 = 42.27%], test : [loss = 2.252, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.76%], valid : [loss = 0.635, top1 = 78.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4580/15625) 004580-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.511, top1 = 89.87%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.30 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.351, top1 = 93.17%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.14 ms.
cifar100       train : [loss = 0.026, top1 = 99.81%], valid : [loss = 1.336, top1 = 71.36%], test : [loss = 1.391, top1 = 70.24%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.502, top1 = 59.34%], valid : [loss = 2.386, top1 = 42.07%], test : [loss = 2.368, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.13%], valid : [loss = 0.681, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4581/15625) 004581-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.618, top1 = 87.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.420, top1 = 90.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.67 ms.
cifar100       train : [loss = 0.198, top1 = 95.20%], valid : [loss = 1.526, top1 = 64.74%], test : [loss = 1.565, top1 = 65.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.69%], valid : [loss = 2.501, top1 = 36.80%], test : [loss = 2.513, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 72.73%], valid : [loss = 0.825, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4582/15625) 004582-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.53%], valid : [loss = 0.527, top1 = 85.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.089, top1 = 97.19%], test  : [loss = 0.356, top1 = 89.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.63 ms.
cifar100       train : [loss = 0.820, top1 = 75.91%], valid : [loss = 1.391, top1 = 63.44%], test : [loss = 1.406, top1 = 62.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.424, top1 = 38.34%], valid : [loss = 2.515, top1 = 37.13%], test : [loss = 2.563, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 67.13%], valid : [loss = 0.981, top1 = 65.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4583/15625) 004583-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.511, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.329, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.20 ms.
cifar100       train : [loss = 0.117, top1 = 97.48%], valid : [loss = 1.342, top1 = 68.88%], test : [loss = 1.338, top1 = 69.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.91 ms.
ImageNet16-120 train : [loss = 1.785, top1 = 52.54%], valid : [loss = 2.266, top1 = 41.67%], test : [loss = 2.265, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.15%], valid : [loss = 0.773, top1 = 73.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4584/15625) 004584-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.37%], valid : [loss = 0.583, top1 = 87.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.51 ms.
cifar10        train : [loss = 0.039, top1 = 98.75%], test  : [loss = 0.393, top1 = 90.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.99 ms.
cifar100       train : [loss = 0.486, top1 = 86.15%], valid : [loss = 1.361, top1 = 65.24%], test : [loss = 1.364, top1 = 64.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.25 ms.
ImageNet16-120 train : [loss = 2.441, top1 = 37.59%], valid : [loss = 2.568, top1 = 35.40%], test : [loss = 2.575, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.22%], valid : [loss = 0.973, top1 = 65.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4585/15625) 004585-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.509, top1 = 89.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.315, top1 = 92.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.71 ms.
cifar100       train : [loss = 0.146, top1 = 97.00%], valid : [loss = 1.268, top1 = 69.86%], test : [loss = 1.235, top1 = 70.34%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.43 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.57%], valid : [loss = 2.212, top1 = 43.13%], test : [loss = 2.210, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.52%], valid : [loss = 0.620, top1 = 78.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4586/15625) 004586-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.75%], valid : [loss = 0.644, top1 = 84.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.397, top1 = 88.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.07 ms.
cifar100       train : [loss = 0.785, top1 = 77.05%], valid : [loss = 1.436, top1 = 61.65%], test : [loss = 1.411, top1 = 62.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.18%], valid : [loss = 2.730, top1 = 32.41%], test : [loss = 2.755, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4587/15625) 004587-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.70%], valid : [loss = 0.487, top1 = 83.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10        train : [loss = 0.296, top1 = 90.07%], test  : [loss = 0.399, top1 = 86.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.43 ms.
cifar100       train : [loss = 1.326, top1 = 63.43%], valid : [loss = 1.540, top1 = 57.68%], test : [loss = 1.495, top1 = 58.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.68%], valid : [loss = 2.913, top1 = 28.63%], test : [loss = 2.961, top1 = 28.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4588/15625) 004588-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.532, top1 = 89.67%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.89 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.303, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.08 ms.
cifar100       train : [loss = 0.111, top1 = 97.69%], valid : [loss = 1.317, top1 = 70.10%], test : [loss = 1.305, top1 = 69.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 1.751, top1 = 53.30%], valid : [loss = 2.190, top1 = 43.77%], test : [loss = 2.169, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.40%], valid : [loss = 0.624, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4589/15625) 004589-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.494, top1 = 89.64%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.65 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.332, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.138, top1 = 97.22%], valid : [loss = 1.341, top1 = 69.04%], test : [loss = 1.288, top1 = 70.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.70%], valid : [loss = 2.306, top1 = 41.93%], test : [loss = 2.255, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 81.00%], valid : [loss = 0.629, top1 = 78.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4590/15625) 004590-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.80%], valid : [loss = 0.659, top1 = 85.95%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.90 ms.
cifar10        train : [loss = 0.030, top1 = 99.23%], test  : [loss = 0.457, top1 = 88.77%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.81 ms.
cifar100       train : [loss = 0.380, top1 = 89.57%], valid : [loss = 1.456, top1 = 63.96%], test : [loss = 1.427, top1 = 64.18%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.26%], valid : [loss = 2.629, top1 = 33.87%], test : [loss = 2.634, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.71%], valid : [loss = 0.791, top1 = 72.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4591/15625) 004591-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.83%], valid : [loss = 0.521, top1 = 86.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.071, top1 = 97.92%], test  : [loss = 0.344, top1 = 90.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.14 ms.
cifar100       train : [loss = 0.656, top1 = 81.13%], valid : [loss = 1.308, top1 = 64.82%], test : [loss = 1.304, top1 = 64.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.74%], valid : [loss = 2.475, top1 = 37.08%], test : [loss = 2.504, top1 = 37.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.88%], valid : [loss = 0.901, top1 = 68.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4592/15625) 004592-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.517, top1 = 88.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.333, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.60 ms.
cifar100       train : [loss = 0.209, top1 = 94.86%], valid : [loss = 1.277, top1 = 68.54%], test : [loss = 1.292, top1 = 68.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 1.997, top1 = 47.65%], valid : [loss = 2.340, top1 = 40.50%], test : [loss = 2.345, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.90%], valid : [loss = 0.778, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4593/15625) 004593-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.504, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.329, top1 = 91.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.20 ms.
cifar100       train : [loss = 0.344, top1 = 90.70%], valid : [loss = 1.253, top1 = 67.24%], test : [loss = 1.246, top1 = 67.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.45%], valid : [loss = 2.215, top1 = 42.17%], test : [loss = 2.258, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.32%], valid : [loss = 0.647, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4594/15625) 004594-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.49%], valid : [loss = 0.659, top1 = 77.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.508, top1 = 82.35%], test  : [loss = 0.575, top1 = 80.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.02 ms.
cifar100       train : [loss = 1.680, top1 = 54.19%], valid : [loss = 1.860, top1 = 50.74%], test : [loss = 1.862, top1 = 51.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.23%], valid : [loss = 3.300, top1 = 21.57%], test : [loss = 3.357, top1 = 20.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4595/15625) 004595-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.463, top1 = 89.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.319, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.51 ms.
cifar100       train : [loss = 0.173, top1 = 96.10%], valid : [loss = 1.310, top1 = 69.60%], test : [loss = 1.273, top1 = 69.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.31%], valid : [loss = 2.248, top1 = 42.27%], test : [loss = 2.287, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.96%], valid : [loss = 0.551, top1 = 81.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4596/15625) 004596-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.235, top1 = 92.06%], valid : [loss = 0.553, top1 = 83.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.223, top1 = 92.31%], test  : [loss = 0.409, top1 = 86.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.68 ms.
cifar100       train : [loss = 1.321, top1 = 62.48%], valid : [loss = 1.587, top1 = 56.14%], test : [loss = 1.610, top1 = 55.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.760, top1 = 31.36%], valid : [loss = 2.757, top1 = 31.57%], test : [loss = 2.845, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.24%], valid : [loss = 0.993, top1 = 64.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4597/15625) 004597-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.574, top1 = 87.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.039, top1 = 98.87%], test  : [loss = 0.391, top1 = 90.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.69 ms.
cifar100       train : [loss = 0.538, top1 = 84.20%], valid : [loss = 1.412, top1 = 63.84%], test : [loss = 1.408, top1 = 63.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 37.31%], valid : [loss = 2.603, top1 = 34.03%], test : [loss = 2.640, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.38%], valid : [loss = 0.711, top1 = 75.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4598/15625) 004598-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.34%], valid : [loss = 0.541, top1 = 84.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.179, top1 = 93.99%], test  : [loss = 0.386, top1 = 88.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.33 ms.
cifar100       train : [loss = 1.201, top1 = 65.89%], valid : [loss = 1.518, top1 = 58.53%], test : [loss = 1.501, top1 = 58.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.64%], valid : [loss = 2.656, top1 = 33.27%], test : [loss = 2.692, top1 = 32.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.76%], valid : [loss = 0.922, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4599/15625) 004599-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.20 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.634, top1 = 86.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.06 ms.
cifar10        train : [loss = 0.027, top1 = 99.41%], test  : [loss = 0.418, top1 = 89.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.81 ms.
cifar100       train : [loss = 0.391, top1 = 89.50%], valid : [loss = 1.400, top1 = 64.82%], test : [loss = 1.393, top1 = 64.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.80%], valid : [loss = 2.609, top1 = 34.53%], test : [loss = 2.620, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.74%], valid : [loss = 0.773, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4600/15625) 004600-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.83%], valid : [loss = 0.972, top1 = 66.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.793, top1 = 72.21%], test  : [loss = 0.871, top1 = 69.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.63 ms.
cifar100       train : [loss = 2.116, top1 = 44.43%], valid : [loss = 2.291, top1 = 41.66%], test : [loss = 2.306, top1 = 41.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 3.752, top1 = 14.08%], valid : [loss = 3.771, top1 = 14.67%], test : [loss = 3.787, top1 = 13.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 47.04%], valid : [loss = 1.486, top1 = 46.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4601/15625) 004601-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.493, top1 = 89.68%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.88 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.324, top1 = 92.87%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.35 ms.
cifar100       train : [loss = 0.129, top1 = 97.42%], valid : [loss = 1.307, top1 = 68.60%], test : [loss = 1.307, top1 = 68.52%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.87 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.41%], valid : [loss = 2.274, top1 = 41.50%], test : [loss = 2.261, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.74%], valid : [loss = 0.679, top1 = 76.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4602/15625) 004602-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.69%], valid : [loss = 0.446, top1 = 87.97%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.11 ms.
cifar10        train : [loss = 0.046, top1 = 98.89%], test  : [loss = 0.316, top1 = 90.36%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.17 ms.
cifar100       train : [loss = 0.462, top1 = 87.84%], valid : [loss = 1.231, top1 = 66.68%], test : [loss = 1.222, top1 = 67.04%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.45%], valid : [loss = 2.446, top1 = 38.43%], test : [loss = 2.441, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.80%], valid : [loss = 0.657, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4603/15625) 004603-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.26 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.84%], valid : [loss = 0.490, top1 = 84.08%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.75 ms.
cifar10        train : [loss = 0.299, top1 = 90.06%], test  : [loss = 0.405, top1 = 86.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.23 ms.
cifar100       train : [loss = 1.338, top1 = 63.00%], valid : [loss = 1.541, top1 = 57.60%], test : [loss = 1.518, top1 = 57.72%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.89 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.73%], valid : [loss = 2.893, top1 = 30.67%], test : [loss = 2.957, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4604/15625) 004604-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.522, top1 = 89.67%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.71 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.293, top1 = 93.65%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.32 ms.
cifar100       train : [loss = 0.114, top1 = 97.71%], valid : [loss = 1.288, top1 = 69.76%], test : [loss = 1.275, top1 = 70.22%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.45 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 55.15%], valid : [loss = 2.164, top1 = 43.83%], test : [loss = 2.179, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.82%], valid : [loss = 0.645, top1 = 77.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4605/15625) 004605-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.600, top1 = 86.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.20 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.373, top1 = 91.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.56 ms.
cifar100       train : [loss = 0.341, top1 = 90.40%], valid : [loss = 1.435, top1 = 65.22%], test : [loss = 1.424, top1 = 65.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.232, top1 = 42.38%], valid : [loss = 2.470, top1 = 38.17%], test : [loss = 2.472, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.30%], valid : [loss = 0.861, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4606/15625) 004606-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.096, top1 = 96.90%], valid : [loss = 0.677, top1 = 83.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10        train : [loss = 0.146, top1 = 95.02%], test  : [loss = 0.471, top1 = 86.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.30 ms.
cifar100       train : [loss = 0.951, top1 = 72.39%], valid : [loss = 1.617, top1 = 56.62%], test : [loss = 1.612, top1 = 57.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 3.023, top1 = 25.92%], valid : [loss = 3.114, top1 = 24.27%], test : [loss = 3.148, top1 = 23.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4607/15625) 004607-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.81%], valid : [loss = 0.477, top1 = 84.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.25 ms.
cifar10        train : [loss = 0.298, top1 = 90.03%], test  : [loss = 0.402, top1 = 86.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 1.331, top1 = 62.99%], valid : [loss = 1.532, top1 = 58.50%], test : [loss = 1.495, top1 = 58.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.71%], valid : [loss = 2.924, top1 = 29.13%], test : [loss = 2.966, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4608/15625) 004608-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.515, top1 = 89.75%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.76 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.329, top1 = 92.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.19 ms.
cifar100       train : [loss = 0.114, top1 = 97.78%], valid : [loss = 1.302, top1 = 69.76%], test : [loss = 1.290, top1 = 69.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.48 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.70%], valid : [loss = 2.190, top1 = 43.13%], test : [loss = 2.217, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.98%], valid : [loss = 0.621, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4609/15625) 004609-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.501, top1 = 88.80%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.319, top1 = 91.93%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.94 ms.
cifar100       train : [loss = 0.365, top1 = 89.88%], valid : [loss = 1.281, top1 = 67.36%], test : [loss = 1.305, top1 = 66.52%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.38%], valid : [loss = 2.427, top1 = 39.07%], test : [loss = 2.451, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.58%], valid : [loss = 0.656, top1 = 77.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4610/15625) 004610-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10-valid  train : [loss = 1.852, top1 = 32.78%], valid : [loss = 1.864, top1 = 32.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.06 ms.
cifar10        train : [loss = 1.322, top1 = 52.28%], test  : [loss = 1.317, top1 = 52.06%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.06 ms.
cifar100       train : [loss = 3.909, top1 = 9.83%], valid : [loss = 3.908, top1 = 9.88%], test : [loss = 3.908, top1 = 10.22%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.14 ms.
ImageNet16-120 train : [loss = 3.944, top1 = 11.22%], valid : [loss = 3.930, top1 = 11.90%], test : [loss = 3.941, top1 = 11.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.969, top1 = 27.06%], valid : [loss = 1.968, top1 = 27.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4611/15625) 004611-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.587, top1 = 85.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.069, top1 = 97.93%], test  : [loss = 0.411, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.43 ms.
cifar100       train : [loss = 0.714, top1 = 79.13%], valid : [loss = 1.376, top1 = 63.42%], test : [loss = 1.384, top1 = 63.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.17%], valid : [loss = 2.633, top1 = 33.63%], test : [loss = 2.663, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4612/15625) 004612-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.456, top1 = 86.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.116, top1 = 96.40%], test  : [loss = 0.332, top1 = 89.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.67 ms.
cifar100       train : [loss = 0.867, top1 = 75.39%], valid : [loss = 1.298, top1 = 64.03%], test : [loss = 1.286, top1 = 63.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.46%], valid : [loss = 2.629, top1 = 33.94%], test : [loss = 2.650, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4613/15625) 004613-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.504, top1 = 89.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.351, top1 = 92.25%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.62 ms.
cifar100       train : [loss = 0.216, top1 = 94.63%], valid : [loss = 1.257, top1 = 68.58%], test : [loss = 1.243, top1 = 69.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.55%], valid : [loss = 2.197, top1 = 44.40%], test : [loss = 2.192, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.25%], valid : [loss = 0.700, top1 = 75.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4614/15625) 004614-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.53 ms.
cifar10-valid  train : [loss = 0.238, top1 = 91.93%], valid : [loss = 0.525, top1 = 83.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10        train : [loss = 0.233, top1 = 92.09%], test  : [loss = 0.404, top1 = 86.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.62 ms.
cifar100       train : [loss = 1.280, top1 = 63.67%], valid : [loss = 1.578, top1 = 57.30%], test : [loss = 1.567, top1 = 57.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.869, top1 = 29.40%], valid : [loss = 2.867, top1 = 29.47%], test : [loss = 2.923, top1 = 28.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.72%], valid : [loss = 1.094, top1 = 61.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4615/15625) 004615-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.594, top1 = 85.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.53 ms.
cifar10        train : [loss = 0.069, top1 = 97.95%], test  : [loss = 0.409, top1 = 88.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.65 ms.
cifar100       train : [loss = 0.720, top1 = 79.03%], valid : [loss = 1.403, top1 = 62.93%], test : [loss = 1.387, top1 = 63.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.22%], valid : [loss = 2.657, top1 = 33.61%], test : [loss = 2.686, top1 = 33.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4616/15625) 004616-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.623, top1 = 85.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.03 ms.
cifar10        train : [loss = 0.048, top1 = 98.51%], test  : [loss = 0.412, top1 = 89.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.91 ms.
cifar100       train : [loss = 0.618, top1 = 81.85%], valid : [loss = 1.438, top1 = 62.76%], test : [loss = 1.404, top1 = 63.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.450, top1 = 37.72%], valid : [loss = 2.614, top1 = 33.97%], test : [loss = 2.649, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.54%], valid : [loss = 0.846, top1 = 70.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4617/15625) 004617-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.632, top1 = 86.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10        train : [loss = 0.017, top1 = 99.54%], test  : [loss = 0.421, top1 = 90.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.82 ms.
cifar100       train : [loss = 0.271, top1 = 92.85%], valid : [loss = 1.612, top1 = 62.92%], test : [loss = 1.575, top1 = 63.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.151, top1 = 44.21%], valid : [loss = 2.476, top1 = 38.37%], test : [loss = 2.504, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.30%], valid : [loss = 0.867, top1 = 69.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4618/15625) 004618-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.15 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.93%], valid : [loss = 0.476, top1 = 84.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10        train : [loss = 0.301, top1 = 89.90%], test  : [loss = 0.403, top1 = 86.41%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.79 ms.
cifar100       train : [loss = 1.329, top1 = 63.13%], valid : [loss = 1.537, top1 = 57.74%], test : [loss = 1.507, top1 = 58.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.31 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.55%], valid : [loss = 2.918, top1 = 28.91%], test : [loss = 2.955, top1 = 28.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4619/15625) 004619-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.16%], valid : [loss = 0.466, top1 = 86.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10        train : [loss = 0.111, top1 = 96.56%], test  : [loss = 0.334, top1 = 89.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.76 ms.
cifar100       train : [loss = 0.875, top1 = 75.22%], valid : [loss = 1.302, top1 = 63.88%], test : [loss = 1.282, top1 = 64.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.58%], valid : [loss = 2.629, top1 = 34.90%], test : [loss = 2.660, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4620/15625) 004620-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.499, top1 = 88.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.020, top1 = 99.53%], test  : [loss = 0.319, top1 = 91.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.409, top1 = 88.12%], valid : [loss = 1.306, top1 = 67.12%], test : [loss = 1.303, top1 = 67.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.56%], valid : [loss = 2.388, top1 = 39.97%], test : [loss = 2.468, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.41%], valid : [loss = 0.670, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4621/15625) 004621-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.575, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.402, top1 = 90.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.72 ms.
cifar100       train : [loss = 0.193, top1 = 95.57%], valid : [loss = 1.472, top1 = 65.64%], test : [loss = 1.430, top1 = 67.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.63%], valid : [loss = 2.489, top1 = 37.10%], test : [loss = 2.511, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.67%], valid : [loss = 0.745, top1 = 73.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4622/15625) 004622-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.564, top1 = 87.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.344, top1 = 91.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.76 ms.
cifar100       train : [loss = 0.295, top1 = 92.05%], valid : [loss = 1.312, top1 = 67.08%], test : [loss = 1.330, top1 = 66.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.29 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.78%], valid : [loss = 2.441, top1 = 38.00%], test : [loss = 2.441, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.82%], valid : [loss = 0.894, top1 = 68.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4623/15625) 004623-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.537, top1 = 88.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.386, top1 = 91.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.228, top1 = 94.62%], valid : [loss = 1.432, top1 = 66.14%], test : [loss = 1.425, top1 = 66.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.40%], valid : [loss = 2.401, top1 = 39.20%], test : [loss = 2.446, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.53%], valid : [loss = 0.691, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4624/15625) 004624-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.564, top1 = 88.80%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.28 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.359, top1 = 92.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.04 ms.
cifar100       train : [loss = 0.140, top1 = 96.81%], valid : [loss = 1.325, top1 = 68.12%], test : [loss = 1.362, top1 = 69.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.44%], valid : [loss = 2.345, top1 = 40.80%], test : [loss = 2.342, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.15%], valid : [loss = 0.808, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4625/15625) 004625-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.38%], valid : [loss = 0.459, top1 = 86.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.93 ms.
cifar10        train : [loss = 0.161, top1 = 94.72%], test  : [loss = 0.344, top1 = 88.39%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.29 ms.
cifar100       train : [loss = 1.037, top1 = 70.47%], valid : [loss = 1.406, top1 = 60.86%], test : [loss = 1.373, top1 = 61.08%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.01 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 34.00%], valid : [loss = 2.664, top1 = 32.83%], test : [loss = 2.727, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.02%], valid : [loss = 0.802, top1 = 71.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4626/15625) 004626-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.67%], valid : [loss = 0.602, top1 = 87.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.57 ms.
cifar10        train : [loss = 0.024, top1 = 99.29%], test  : [loss = 0.383, top1 = 90.88%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.45 ms.
cifar100       train : [loss = 0.268, top1 = 92.93%], valid : [loss = 1.454, top1 = 65.12%], test : [loss = 1.457, top1 = 65.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.91 ms.
ImageNet16-120 train : [loss = 2.966, top1 = 26.26%], valid : [loss = 3.043, top1 = 24.60%], test : [loss = 3.053, top1 = 25.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.365, top1 = 50.30%], valid : [loss = 1.370, top1 = 49.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4627/15625) 004627-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.286, top1 = 93.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.179, top1 = 95.88%], valid : [loss = 1.260, top1 = 69.96%], test : [loss = 1.237, top1 = 69.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.811, top1 = 51.84%], valid : [loss = 2.266, top1 = 42.27%], test : [loss = 2.297, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.33%], valid : [loss = 0.505, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4628/15625) 004628-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.279, top1 = 90.48%], valid : [loss = 0.553, top1 = 82.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.252, top1 = 91.32%], test  : [loss = 0.396, top1 = 86.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.74 ms.
cifar100       train : [loss = 1.499, top1 = 58.00%], valid : [loss = 1.748, top1 = 53.04%], test : [loss = 1.747, top1 = 52.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 2.952, top1 = 27.68%], valid : [loss = 2.969, top1 = 27.83%], test : [loss = 3.010, top1 = 26.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 65.06%], valid : [loss = 1.003, top1 = 64.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4629/15625) 004629-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.596, top1 = 87.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.401, top1 = 91.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.223, top1 = 94.60%], valid : [loss = 1.532, top1 = 65.14%], test : [loss = 1.511, top1 = 65.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.47%], valid : [loss = 2.514, top1 = 36.03%], test : [loss = 2.524, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4630/15625) 004630-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.551, top1 = 88.39%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.68 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.369, top1 = 92.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.44 ms.
cifar100       train : [loss = 0.135, top1 = 97.33%], valid : [loss = 1.413, top1 = 67.66%], test : [loss = 1.473, top1 = 66.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.54%], valid : [loss = 2.397, top1 = 39.73%], test : [loss = 2.392, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.42%], valid : [loss = 0.693, top1 = 75.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4631/15625) 004631-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.86%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.19 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.303, top1 = 93.31%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.88 ms.
cifar100       train : [loss = 0.134, top1 = 97.24%], valid : [loss = 1.318, top1 = 68.02%], test : [loss = 1.284, top1 = 69.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.79%], valid : [loss = 2.188, top1 = 43.47%], test : [loss = 2.176, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.73%], valid : [loss = 0.676, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4632/15625) 004632-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.07%], valid : [loss = 0.459, top1 = 86.09%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.20 ms.
cifar10        train : [loss = 0.166, top1 = 94.50%], test  : [loss = 0.352, top1 = 88.73%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.44 ms.
cifar100       train : [loss = 0.995, top1 = 71.62%], valid : [loss = 1.360, top1 = 62.10%], test : [loss = 1.345, top1 = 62.36%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.96 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.67%], valid : [loss = 2.697, top1 = 34.10%], test : [loss = 2.723, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.00%], valid : [loss = 0.791, top1 = 71.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4633/15625) 004633-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.575, top1 = 87.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.398, top1 = 90.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.421, top1 = 88.06%], valid : [loss = 1.424, top1 = 64.04%], test : [loss = 1.384, top1 = 65.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.41%], valid : [loss = 2.530, top1 = 35.93%], test : [loss = 2.560, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.96%], valid : [loss = 0.838, top1 = 70.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4634/15625) 004634-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.85%], valid : [loss = 0.514, top1 = 87.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.29 ms.
cifar10        train : [loss = 0.074, top1 = 97.67%], test  : [loss = 0.362, top1 = 89.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.88 ms.
cifar100       train : [loss = 0.722, top1 = 78.76%], valid : [loss = 1.348, top1 = 64.04%], test : [loss = 1.332, top1 = 64.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.80%], valid : [loss = 2.664, top1 = 34.23%], test : [loss = 2.689, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.95%], valid : [loss = 0.679, top1 = 77.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4635/15625) 004635-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.433, top1 = 89.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.296, top1 = 92.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.56 ms.
cifar100       train : [loss = 0.145, top1 = 96.95%], valid : [loss = 1.342, top1 = 68.75%], test : [loss = 1.323, top1 = 68.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 1.772, top1 = 52.96%], valid : [loss = 2.258, top1 = 42.89%], test : [loss = 2.300, top1 = 42.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.96%], valid : [loss = 0.543, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4636/15625) 004636-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.099, top1 = 97.18%], valid : [loss = 0.475, top1 = 86.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.99 ms.
cifar10        train : [loss = 0.136, top1 = 95.55%], test  : [loss = 0.337, top1 = 89.34%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.22 ms.
cifar100       train : [loss = 0.816, top1 = 77.22%], valid : [loss = 1.308, top1 = 63.54%], test : [loss = 1.325, top1 = 63.58%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 2.579, top1 = 35.14%], valid : [loss = 2.654, top1 = 32.90%], test : [loss = 2.686, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.21%], valid : [loss = 1.011, top1 = 63.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4637/15625) 004637-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.58%], valid : [loss = 0.523, top1 = 87.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.030, top1 = 99.16%], test  : [loss = 0.360, top1 = 90.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.39 ms.
cifar100       train : [loss = 0.489, top1 = 85.97%], valid : [loss = 1.256, top1 = 66.74%], test : [loss = 1.299, top1 = 65.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.322, top1 = 40.23%], valid : [loss = 2.468, top1 = 36.77%], test : [loss = 2.487, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 72.06%], valid : [loss = 0.834, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4638/15625) 004638-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.518, top1 = 89.62%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.69 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.332, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.33 ms.
cifar100       train : [loss = 0.083, top1 = 98.60%], valid : [loss = 1.392, top1 = 68.72%], test : [loss = 1.398, top1 = 69.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.62 ms.
ImageNet16-120 train : [loss = 1.998, top1 = 47.32%], valid : [loss = 2.362, top1 = 39.77%], test : [loss = 2.323, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.50%], valid : [loss = 0.831, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4639/15625) 004639-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.549, top1 = 88.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.48 ms.
cifar10        train : [loss = 0.036, top1 = 98.88%], test  : [loss = 0.362, top1 = 90.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.53 ms.
cifar100       train : [loss = 0.508, top1 = 85.32%], valid : [loss = 1.306, top1 = 64.92%], test : [loss = 1.296, top1 = 65.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.28 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.03%], valid : [loss = 2.415, top1 = 38.30%], test : [loss = 2.439, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.87%], valid : [loss = 0.830, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4640/15625) 004640-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.35%], valid : [loss = 0.656, top1 = 85.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.047, top1 = 98.60%], test  : [loss = 0.395, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 0.602, top1 = 82.39%], valid : [loss = 1.445, top1 = 62.72%], test : [loss = 1.437, top1 = 63.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.86%], valid : [loss = 2.578, top1 = 35.33%], test : [loss = 2.599, top1 = 35.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.16%], valid : [loss = 0.866, top1 = 69.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4641/15625) 004641-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.496, top1 = 90.10%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.17 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.299, top1 = 93.57%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=23.11 ms.
cifar100       train : [loss = 0.102, top1 = 98.23%], valid : [loss = 1.216, top1 = 70.30%], test : [loss = 1.222, top1 = 70.78%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.76%], valid : [loss = 2.139, top1 = 45.17%], test : [loss = 2.179, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.81%], valid : [loss = 0.647, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4642/15625) 004642-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.62%], valid : [loss = 0.556, top1 = 87.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10        train : [loss = 0.032, top1 = 99.04%], test  : [loss = 0.351, top1 = 91.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.47 ms.
cifar100       train : [loss = 0.440, top1 = 87.12%], valid : [loss = 1.241, top1 = 66.76%], test : [loss = 1.280, top1 = 66.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.59 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.79%], valid : [loss = 2.375, top1 = 39.13%], test : [loss = 2.409, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.37%], valid : [loss = 0.928, top1 = 66.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4643/15625) 004643-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.79 ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.14%], valid : [loss = 1.112, top1 = 63.18%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10        train : [loss = 0.805, top1 = 71.67%], test  : [loss = 0.948, top1 = 67.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.65 ms.
cifar100       train : [loss = 2.185, top1 = 43.05%], valid : [loss = 2.448, top1 = 38.48%], test : [loss = 2.464, top1 = 38.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.96%], valid : [loss = 3.818, top1 = 13.13%], test : [loss = 3.846, top1 = 12.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4644/15625) 004644-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.543, top1 = 88.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.85 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.359, top1 = 91.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.334, top1 = 90.76%], valid : [loss = 1.313, top1 = 67.06%], test : [loss = 1.298, top1 = 67.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.80%], valid : [loss = 2.419, top1 = 38.70%], test : [loss = 2.438, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4645/15625) 004645-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.542, top1 = 87.36%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10        train : [loss = 0.035, top1 = 99.05%], test  : [loss = 0.383, top1 = 90.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.30 ms.
cifar100       train : [loss = 0.474, top1 = 86.34%], valid : [loss = 1.371, top1 = 65.04%], test : [loss = 1.355, top1 = 65.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.41%], valid : [loss = 2.593, top1 = 34.20%], test : [loss = 2.623, top1 = 34.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.53%], valid : [loss = 0.653, top1 = 77.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4646/15625) 004646-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.85%], valid : [loss = 0.847, top1 = 71.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10        train : [loss = 0.564, top1 = 80.34%], test  : [loss = 0.714, top1 = 75.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.88 ms.
cifar100       train : [loss = 1.788, top1 = 52.06%], valid : [loss = 2.054, top1 = 46.71%], test : [loss = 2.069, top1 = 46.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.76%], valid : [loss = 3.643, top1 = 16.57%], test : [loss = 3.664, top1 = 16.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4647/15625) 004647-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.16%], valid : [loss = 0.861, top1 = 71.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.54 ms.
cifar10        train : [loss = 0.544, top1 = 81.04%], test  : [loss = 0.702, top1 = 75.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 1.771, top1 = 52.28%], valid : [loss = 2.048, top1 = 47.16%], test : [loss = 2.070, top1 = 47.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.89%], valid : [loss = 3.630, top1 = 16.63%], test : [loss = 3.669, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4648/15625) 004648-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.20%], valid : [loss = 0.555, top1 = 86.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.06 ms.
cifar10        train : [loss = 0.061, top1 = 98.02%], test  : [loss = 0.382, top1 = 89.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.77 ms.
cifar100       train : [loss = 0.682, top1 = 79.84%], valid : [loss = 1.330, top1 = 63.84%], test : [loss = 1.329, top1 = 64.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.403, top1 = 38.57%], valid : [loss = 2.559, top1 = 35.13%], test : [loss = 2.555, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4649/15625) 004649-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.90%], valid : [loss = 0.513, top1 = 87.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.069, top1 = 97.89%], test  : [loss = 0.367, top1 = 89.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.724, top1 = 78.60%], valid : [loss = 1.343, top1 = 64.38%], test : [loss = 1.340, top1 = 64.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.21%], valid : [loss = 2.623, top1 = 34.50%], test : [loss = 2.664, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.98%], valid : [loss = 0.676, top1 = 76.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4650/15625) 004650-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.490, top1 = 88.79%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.316, top1 = 92.03%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=14.20 ms.
cifar100       train : [loss = 0.324, top1 = 91.24%], valid : [loss = 1.260, top1 = 67.61%], test : [loss = 1.251, top1 = 68.07%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.70%], valid : [loss = 2.326, top1 = 40.90%], test : [loss = 2.342, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4651/15625) 004651-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.635, top1 = 86.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10        train : [loss = 0.037, top1 = 99.02%], test  : [loss = 0.416, top1 = 89.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.81 ms.
cifar100       train : [loss = 0.449, top1 = 87.44%], valid : [loss = 1.412, top1 = 63.85%], test : [loss = 1.417, top1 = 64.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.24%], valid : [loss = 2.607, top1 = 35.32%], test : [loss = 2.640, top1 = 35.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.42%], valid : [loss = 0.794, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4652/15625) 004652-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.90%], valid : [loss = 0.643, top1 = 86.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.62 ms.
cifar10        train : [loss = 0.026, top1 = 99.36%], test  : [loss = 0.434, top1 = 89.66%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.69 ms.
cifar100       train : [loss = 0.379, top1 = 90.00%], valid : [loss = 1.401, top1 = 64.62%], test : [loss = 1.405, top1 = 64.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.13%], valid : [loss = 2.600, top1 = 35.00%], test : [loss = 2.611, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.57%], valid : [loss = 0.781, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4653/15625) 004653-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.545, top1 = 88.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.337, top1 = 91.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.288, top1 = 67.12%], test : [loss = 1.314, top1 = 66.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.88%], valid : [loss = 2.412, top1 = 38.60%], test : [loss = 2.438, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4654/15625) 004654-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.53%], valid : [loss = 0.558, top1 = 84.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10        train : [loss = 0.132, top1 = 95.76%], test  : [loss = 0.392, top1 = 88.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.90 ms.
cifar100       train : [loss = 0.999, top1 = 71.27%], valid : [loss = 1.433, top1 = 60.81%], test : [loss = 1.448, top1 = 60.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.73%], valid : [loss = 2.598, top1 = 34.86%], test : [loss = 2.623, top1 = 34.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.03%], valid : [loss = 0.922, top1 = 67.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4655/15625) 004655-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.535, top1 = 89.32%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=23.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.305, top1 = 93.47%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.20 ms.
cifar100       train : [loss = 0.041, top1 = 99.56%], valid : [loss = 1.320, top1 = 70.86%], test : [loss = 1.340, top1 = 70.70%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.53 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.66%], valid : [loss = 2.324, top1 = 40.53%], test : [loss = 2.327, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.52%], valid : [loss = 0.704, top1 = 75.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4656/15625) 004656-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.06%], valid : [loss = 0.822, top1 = 72.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.83 ms.
cifar10        train : [loss = 0.541, top1 = 81.02%], test  : [loss = 0.667, top1 = 77.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.44 ms.
cifar100       train : [loss = 1.831, top1 = 50.52%], valid : [loss = 2.069, top1 = 46.54%], test : [loss = 2.062, top1 = 46.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 3.490, top1 = 18.12%], valid : [loss = 3.512, top1 = 18.40%], test : [loss = 3.539, top1 = 17.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.267, top1 = 54.06%], valid : [loss = 1.315, top1 = 52.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4657/15625) 004657-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.460, top1 = 88.91%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.297, top1 = 92.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.69 ms.
cifar100       train : [loss = 0.333, top1 = 90.96%], valid : [loss = 1.305, top1 = 67.32%], test : [loss = 1.330, top1 = 66.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.00%], valid : [loss = 2.410, top1 = 39.23%], test : [loss = 2.397, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4658/15625) 004658-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.92%], valid : [loss = 0.701, top1 = 83.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.074, top1 = 97.68%], test  : [loss = 0.403, top1 = 88.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 0.682, top1 = 79.88%], valid : [loss = 1.454, top1 = 62.08%], test : [loss = 1.439, top1 = 62.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.587, top1 = 34.87%], valid : [loss = 2.733, top1 = 32.77%], test : [loss = 2.745, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.97%], valid : [loss = 0.959, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4659/15625) 004659-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.416, top1 = 90.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.279, top1 = 93.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.76 ms.
cifar100       train : [loss = 0.189, top1 = 95.59%], valid : [loss = 1.271, top1 = 69.10%], test : [loss = 1.251, top1 = 70.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.45%], valid : [loss = 2.250, top1 = 42.72%], test : [loss = 2.277, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4660/15625) 004660-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.01%], valid : [loss = 0.873, top1 = 70.44%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10        train : [loss = 0.678, top1 = 76.17%], test  : [loss = 0.761, top1 = 73.70%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.78 ms.
cifar100       train : [loss = 2.011, top1 = 46.57%], valid : [loss = 2.175, top1 = 43.74%], test : [loss = 2.204, top1 = 43.51%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.12 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.72%], valid : [loss = 3.667, top1 = 15.93%], test : [loss = 3.695, top1 = 14.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4661/15625) 004661-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.097, top1 = 97.03%], valid : [loss = 0.871, top1 = 79.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10        train : [loss = 0.132, top1 = 95.51%], test  : [loss = 0.548, top1 = 84.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.03 ms.
cifar100       train : [loss = 0.846, top1 = 75.42%], valid : [loss = 1.693, top1 = 58.20%], test : [loss = 1.642, top1 = 58.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.030, top1 = 26.49%], valid : [loss = 3.140, top1 = 24.53%], test : [loss = 3.171, top1 = 23.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4662/15625) 004662-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.553, top1 = 88.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.36 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.354, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.27 ms.
cifar100       train : [loss = 0.150, top1 = 96.36%], valid : [loss = 1.453, top1 = 67.32%], test : [loss = 1.412, top1 = 67.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.63%], valid : [loss = 2.432, top1 = 38.27%], test : [loss = 2.418, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.980, top1 = 64.87%], valid : [loss = 1.003, top1 = 64.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4663/15625) 004663-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.61%], valid : [loss = 0.577, top1 = 87.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10        train : [loss = 0.020, top1 = 99.44%], test  : [loss = 0.381, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.01 ms.
cifar100       train : [loss = 0.298, top1 = 91.59%], valid : [loss = 1.396, top1 = 66.05%], test : [loss = 1.424, top1 = 65.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 29.59%], valid : [loss = 2.903, top1 = 27.83%], test : [loss = 2.896, top1 = 27.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 60.09%], valid : [loss = 1.102, top1 = 59.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4664/15625) 004664-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.65%], valid : [loss = 0.588, top1 = 87.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10        train : [loss = 0.023, top1 = 99.34%], test  : [loss = 0.367, top1 = 91.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.05 ms.
cifar100       train : [loss = 0.239, top1 = 93.43%], valid : [loss = 1.335, top1 = 67.24%], test : [loss = 1.358, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 33.55%], valid : [loss = 2.706, top1 = 31.30%], test : [loss = 2.749, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.05%], valid : [loss = 0.933, top1 = 66.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4665/15625) 004665-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.50%], valid : [loss = 0.711, top1 = 84.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10        train : [loss = 0.050, top1 = 98.48%], test  : [loss = 0.441, top1 = 88.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.38 ms.
cifar100       train : [loss = 0.631, top1 = 81.81%], valid : [loss = 1.508, top1 = 61.66%], test : [loss = 1.534, top1 = 61.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.54%], valid : [loss = 2.809, top1 = 30.53%], test : [loss = 2.853, top1 = 30.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4666/15625) 004666-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=24.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.485, top1 = 88.96%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=24.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.310, top1 = 92.24%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.46 ms.
cifar100       train : [loss = 0.291, top1 = 92.50%], valid : [loss = 1.235, top1 = 68.46%], test : [loss = 1.244, top1 = 68.12%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.39%], valid : [loss = 2.252, top1 = 42.13%], test : [loss = 2.258, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.32%], valid : [loss = 0.613, top1 = 78.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4667/15625) 004667-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.15%], valid : [loss = 0.599, top1 = 85.47%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.33 ms.
cifar10        train : [loss = 0.077, top1 = 97.62%], test  : [loss = 0.378, top1 = 89.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.73 ms.
cifar100       train : [loss = 0.698, top1 = 79.86%], valid : [loss = 1.361, top1 = 63.66%], test : [loss = 1.378, top1 = 63.12%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 2.564, top1 = 35.40%], valid : [loss = 2.683, top1 = 33.10%], test : [loss = 2.720, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.69%], valid : [loss = 0.817, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4668/15625) 004668-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.604, top1 = 87.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.404, top1 = 90.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.207, top1 = 95.08%], valid : [loss = 1.403, top1 = 67.46%], test : [loss = 1.414, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.083, top1 = 45.60%], valid : [loss = 2.503, top1 = 38.27%], test : [loss = 2.524, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.62%], valid : [loss = 0.751, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4669/15625) 004669-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.614, top1 = 86.68%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.64 ms.
cifar10        train : [loss = 0.025, top1 = 99.37%], test  : [loss = 0.446, top1 = 89.44%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.76 ms.
cifar100       train : [loss = 0.340, top1 = 90.99%], valid : [loss = 1.432, top1 = 64.74%], test : [loss = 1.449, top1 = 64.72%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.71%], valid : [loss = 2.588, top1 = 35.07%], test : [loss = 2.660, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.40%], valid : [loss = 0.793, top1 = 72.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4670/15625) 004670-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10-valid  train : [loss = 1.843, top1 = 33.35%], valid : [loss = 1.857, top1 = 32.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.89 ms.
cifar10        train : [loss = 1.273, top1 = 54.14%], test  : [loss = 1.276, top1 = 53.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.94 ms.
cifar100       train : [loss = 3.871, top1 = 10.61%], valid : [loss = 3.870, top1 = 10.41%], test : [loss = 3.866, top1 = 11.04%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.04 ms.
ImageNet16-120 train : [loss = 3.876, top1 = 12.30%], valid : [loss = 3.851, top1 = 13.05%], test : [loss = 3.861, top1 = 11.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4671/15625) 004671-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.13 ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.89%], valid : [loss = 0.719, top1 = 75.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.48 ms.
cifar10        train : [loss = 0.543, top1 = 81.41%], test  : [loss = 0.605, top1 = 79.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.80 ms.
cifar100       train : [loss = 1.945, top1 = 47.85%], valid : [loss = 2.063, top1 = 45.19%], test : [loss = 2.049, top1 = 45.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 3.227, top1 = 22.43%], valid : [loss = 3.197, top1 = 23.10%], test : [loss = 3.238, top1 = 22.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.279, top1 = 53.96%], valid : [loss = 1.368, top1 = 50.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4672/15625) 004672-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.78%], valid : [loss = 0.464, top1 = 86.54%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.26 ms.
cifar10        train : [loss = 0.124, top1 = 96.05%], test  : [loss = 0.336, top1 = 89.40%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.54 ms.
cifar100       train : [loss = 0.746, top1 = 79.11%], valid : [loss = 1.282, top1 = 64.54%], test : [loss = 1.273, top1 = 64.60%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.94%], valid : [loss = 2.609, top1 = 33.87%], test : [loss = 2.589, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.52%], valid : [loss = 0.870, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4673/15625) 004673-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.210, top1 = 93.17%], valid : [loss = 0.495, top1 = 84.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.210, top1 = 92.89%], test  : [loss = 0.365, top1 = 88.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 1.313, top1 = 63.47%], valid : [loss = 1.581, top1 = 56.32%], test : [loss = 1.577, top1 = 56.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.966, top1 = 26.90%], valid : [loss = 2.974, top1 = 27.10%], test : [loss = 2.995, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.63%], valid : [loss = 1.028, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4674/15625) 004674-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.499, top1 = 89.77%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.320, top1 = 92.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.71 ms.
cifar100       train : [loss = 0.147, top1 = 96.87%], valid : [loss = 1.240, top1 = 69.90%], test : [loss = 1.241, top1 = 70.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.88 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.16%], valid : [loss = 2.177, top1 = 44.50%], test : [loss = 2.205, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 76.98%], valid : [loss = 0.708, top1 = 75.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4675/15625) 004675-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.36%], valid : [loss = 0.459, top1 = 86.10%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.41 ms.
cifar10        train : [loss = 0.160, top1 = 94.85%], test  : [loss = 0.342, top1 = 89.20%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.22 ms.
cifar100       train : [loss = 1.023, top1 = 70.92%], valid : [loss = 1.403, top1 = 60.88%], test : [loss = 1.385, top1 = 61.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.12 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.59%], valid : [loss = 2.693, top1 = 32.60%], test : [loss = 2.706, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.43%], valid : [loss = 0.798, top1 = 71.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4676/15625) 004676-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.54 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.40%], valid : [loss = 0.618, top1 = 85.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 0.069, top1 = 97.92%], test  : [loss = 0.408, top1 = 88.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 0.707, top1 = 79.33%], valid : [loss = 1.392, top1 = 63.14%], test : [loss = 1.339, top1 = 64.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.05%], valid : [loss = 2.633, top1 = 33.80%], test : [loss = 2.670, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4677/15625) 004677-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.624, top1 = 87.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.398, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.11 ms.
cifar100       train : [loss = 0.192, top1 = 95.60%], valid : [loss = 1.496, top1 = 65.68%], test : [loss = 1.457, top1 = 65.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.63%], valid : [loss = 2.487, top1 = 38.27%], test : [loss = 2.494, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.92%], valid : [loss = 0.792, top1 = 72.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4678/15625) 004678-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.477, top1 = 88.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 91.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.20 ms.
cifar100       train : [loss = 0.318, top1 = 91.50%], valid : [loss = 1.258, top1 = 67.66%], test : [loss = 1.277, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.06 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.70%], valid : [loss = 2.332, top1 = 41.27%], test : [loss = 2.363, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.88%], valid : [loss = 0.617, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4679/15625) 004679-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.63%], valid : [loss = 0.458, top1 = 86.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.53 ms.
cifar10        train : [loss = 0.152, top1 = 95.03%], test  : [loss = 0.343, top1 = 89.07%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=13.55 ms.
cifar100       train : [loss = 0.968, top1 = 72.26%], valid : [loss = 1.331, top1 = 62.78%], test : [loss = 1.331, top1 = 62.50%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.82%], valid : [loss = 2.706, top1 = 32.23%], test : [loss = 2.701, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.755, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4680/15625) 004680-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.321, top1 = 91.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.27 ms.
cifar100       train : [loss = 0.328, top1 = 91.00%], valid : [loss = 1.299, top1 = 67.12%], test : [loss = 1.307, top1 = 67.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.26%], valid : [loss = 2.361, top1 = 40.23%], test : [loss = 2.416, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4681/15625) 004681-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=24.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.477, top1 = 90.20%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.27 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.294, top1 = 93.61%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.45 ms.
cifar100       train : [loss = 0.063, top1 = 99.15%], valid : [loss = 1.320, top1 = 69.75%], test : [loss = 1.332, top1 = 69.82%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=22.26 ms.
ImageNet16-120 train : [loss = 1.634, top1 = 56.07%], valid : [loss = 2.155, top1 = 44.11%], test : [loss = 2.145, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.83%], valid : [loss = 0.686, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4682/15625) 004682-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.494, top1 = 89.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.318, top1 = 92.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.57 ms.
cifar100       train : [loss = 0.242, top1 = 94.01%], valid : [loss = 1.245, top1 = 68.49%], test : [loss = 1.252, top1 = 68.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.26%], valid : [loss = 2.266, top1 = 42.09%], test : [loss = 2.305, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4683/15625) 004683-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.23%], valid : [loss = 0.889, top1 = 76.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.231, top1 = 91.96%], test  : [loss = 0.578, top1 = 82.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 1.181, top1 = 66.63%], valid : [loss = 1.806, top1 = 53.15%], test : [loss = 1.806, top1 = 53.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 3.218, top1 = 22.89%], valid : [loss = 3.316, top1 = 21.72%], test : [loss = 3.361, top1 = 20.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.50%], valid : [loss = 1.089, top1 = 61.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4684/15625) 004684-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.571, top1 = 87.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.388, top1 = 91.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.22 ms.
cifar100       train : [loss = 0.379, top1 = 89.31%], valid : [loss = 1.414, top1 = 65.29%], test : [loss = 1.404, top1 = 65.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.22%], valid : [loss = 2.518, top1 = 37.02%], test : [loss = 2.507, top1 = 36.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.18%], valid : [loss = 0.796, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4685/15625) 004685-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.07%], valid : [loss = 0.540, top1 = 83.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10        train : [loss = 0.201, top1 = 93.13%], test  : [loss = 0.394, top1 = 87.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.22 ms.
cifar100       train : [loss = 1.269, top1 = 64.05%], valid : [loss = 1.569, top1 = 57.19%], test : [loss = 1.548, top1 = 57.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.708, top1 = 32.49%], valid : [loss = 2.725, top1 = 31.70%], test : [loss = 2.791, top1 = 31.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4686/15625) 004686-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.26%], valid : [loss = 0.474, top1 = 84.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.299, top1 = 89.98%], test  : [loss = 0.403, top1 = 86.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.03 ms.
cifar100       train : [loss = 1.329, top1 = 63.03%], valid : [loss = 1.532, top1 = 57.91%], test : [loss = 1.506, top1 = 58.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.59%], valid : [loss = 2.903, top1 = 29.48%], test : [loss = 2.954, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4687/15625) 004687-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.520, top1 = 88.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.335, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 0.335, top1 = 90.92%], valid : [loss = 1.283, top1 = 67.12%], test : [loss = 1.297, top1 = 67.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.64%], valid : [loss = 2.420, top1 = 38.32%], test : [loss = 2.445, top1 = 39.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4688/15625) 004688-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.34%], valid : [loss = 0.633, top1 = 85.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.055, top1 = 98.35%], test  : [loss = 0.417, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.60 ms.
cifar100       train : [loss = 0.671, top1 = 80.46%], valid : [loss = 1.408, top1 = 62.75%], test : [loss = 1.394, top1 = 63.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.474, top1 = 37.21%], valid : [loss = 2.601, top1 = 35.10%], test : [loss = 2.643, top1 = 34.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.88%], valid : [loss = 0.826, top1 = 71.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4689/15625) 004689-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.53%], valid : [loss = 0.459, top1 = 87.64%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.01 ms.
cifar10        train : [loss = 0.056, top1 = 98.65%], test  : [loss = 0.314, top1 = 90.72%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.75 ms.
cifar100       train : [loss = 0.584, top1 = 83.86%], valid : [loss = 1.228, top1 = 66.72%], test : [loss = 1.210, top1 = 66.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.24%], valid : [loss = 2.468, top1 = 37.36%], test : [loss = 2.485, top1 = 37.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.30%], valid : [loss = 0.645, top1 = 78.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4690/15625) 004690-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.43%], valid : [loss = 0.630, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.052, top1 = 98.44%], test  : [loss = 0.412, top1 = 89.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.627, top1 = 81.52%], valid : [loss = 1.456, top1 = 62.32%], test : [loss = 1.435, top1 = 63.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.464, top1 = 37.38%], valid : [loss = 2.635, top1 = 34.67%], test : [loss = 2.648, top1 = 34.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.80%], valid : [loss = 0.864, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4691/15625) 004691-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.69%], valid : [loss = 0.597, top1 = 87.47%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.80 ms.
cifar10        train : [loss = 0.022, top1 = 99.35%], test  : [loss = 0.401, top1 = 90.79%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.49 ms.
cifar100       train : [loss = 0.370, top1 = 89.50%], valid : [loss = 1.463, top1 = 63.99%], test : [loss = 1.465, top1 = 64.39%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 2.972, top1 = 26.04%], valid : [loss = 3.004, top1 = 25.48%], test : [loss = 3.006, top1 = 25.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.321, top1 = 51.68%], valid : [loss = 1.335, top1 = 51.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4692/15625) 004692-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.485, top1 = 89.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.311, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.05 ms.
cifar100       train : [loss = 0.325, top1 = 91.25%], valid : [loss = 1.259, top1 = 67.35%], test : [loss = 1.236, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.74%], valid : [loss = 2.313, top1 = 41.30%], test : [loss = 2.325, top1 = 41.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.28%], valid : [loss = 0.609, top1 = 79.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4693/15625) 004693-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.533, top1 = 89.61%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.21 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.347, top1 = 92.79%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.77 ms.
cifar100       train : [loss = 0.062, top1 = 99.05%], valid : [loss = 1.398, top1 = 69.82%], test : [loss = 1.393, top1 = 69.83%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 45.84%], valid : [loss = 2.394, top1 = 39.29%], test : [loss = 2.401, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.46%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4694/15625) 004694-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.569, top1 = 87.61%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.384, top1 = 91.30%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.62 ms.
cifar100       train : [loss = 0.319, top1 = 91.21%], valid : [loss = 1.408, top1 = 65.54%], test : [loss = 1.407, top1 = 66.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.55%], valid : [loss = 2.471, top1 = 37.38%], test : [loss = 2.491, top1 = 38.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.93%], valid : [loss = 0.817, top1 = 71.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4695/15625) 004695-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.537, top1 = 88.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.350, top1 = 91.58%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.53 ms.
cifar100       train : [loss = 0.322, top1 = 90.89%], valid : [loss = 1.350, top1 = 66.77%], test : [loss = 1.320, top1 = 67.63%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.482, top1 = 36.57%], valid : [loss = 2.596, top1 = 34.30%], test : [loss = 2.612, top1 = 33.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.92%], valid : [loss = 1.004, top1 = 63.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4696/15625) 004696-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.32 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.31%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.37 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.324, top1 = 92.63%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.45 ms.
cifar100       train : [loss = 0.155, top1 = 96.76%], valid : [loss = 1.312, top1 = 68.63%], test : [loss = 1.281, top1 = 69.52%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.26 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.78%], valid : [loss = 2.321, top1 = 41.21%], test : [loss = 2.302, top1 = 42.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.02%], valid : [loss = 0.724, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4697/15625) 004697-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.35%], valid : [loss = 0.464, top1 = 86.06%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.90 ms.
cifar10        train : [loss = 0.155, top1 = 94.95%], test  : [loss = 0.343, top1 = 88.90%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.15 ms.
cifar100       train : [loss = 1.010, top1 = 71.32%], valid : [loss = 1.354, top1 = 61.97%], test : [loss = 1.348, top1 = 61.75%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.52%], valid : [loss = 2.696, top1 = 32.77%], test : [loss = 2.731, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.33%], valid : [loss = 0.795, top1 = 72.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4698/15625) 004698-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.503, top1 = 89.63%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.46 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.318, top1 = 92.96%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.95 ms.
cifar100       train : [loss = 0.118, top1 = 97.70%], valid : [loss = 1.301, top1 = 69.57%], test : [loss = 1.292, top1 = 69.71%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.93 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.05%], valid : [loss = 2.281, top1 = 42.61%], test : [loss = 2.280, top1 = 42.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.46%], valid : [loss = 0.638, top1 = 78.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4699/15625) 004699-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.347, top1 = 87.85%], valid : [loss = 0.603, top1 = 80.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.304, top1 = 89.52%], test  : [loss = 0.434, top1 = 85.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 1.481, top1 = 58.56%], valid : [loss = 1.728, top1 = 53.25%], test : [loss = 1.712, top1 = 53.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 3.012, top1 = 26.57%], valid : [loss = 3.002, top1 = 27.27%], test : [loss = 3.047, top1 = 26.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 63.92%], valid : [loss = 1.055, top1 = 62.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4700/15625) 004700-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.23%], valid : [loss = 0.861, top1 = 71.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10        train : [loss = 0.554, top1 = 80.74%], test  : [loss = 0.719, top1 = 75.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.72 ms.
cifar100       train : [loss = 1.776, top1 = 52.34%], valid : [loss = 2.046, top1 = 47.11%], test : [loss = 2.050, top1 = 47.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.83%], valid : [loss = 3.639, top1 = 16.80%], test : [loss = 3.668, top1 = 16.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4701/15625) 004701-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.521, top1 = 88.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.016, top1 = 99.66%], test  : [loss = 0.333, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.371, top1 = 89.52%], valid : [loss = 1.393, top1 = 65.77%], test : [loss = 1.350, top1 = 66.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.98%], valid : [loss = 2.374, top1 = 39.82%], test : [loss = 2.424, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.92%], valid : [loss = 0.631, top1 = 78.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4702/15625) 004702-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.22%], valid : [loss = 0.452, top1 = 87.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.325, top1 = 89.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 0.859, top1 = 75.48%], valid : [loss = 1.300, top1 = 63.85%], test : [loss = 1.288, top1 = 64.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.57%], valid : [loss = 2.631, top1 = 34.32%], test : [loss = 2.667, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4703/15625) 004703-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.57%], valid : [loss = 0.567, top1 = 86.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.067, top1 = 97.84%], test  : [loss = 0.383, top1 = 89.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.558, top1 = 83.45%], valid : [loss = 1.341, top1 = 64.55%], test : [loss = 1.358, top1 = 64.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 31.04%], valid : [loss = 2.787, top1 = 29.66%], test : [loss = 2.797, top1 = 29.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.35%], valid : [loss = 1.163, top1 = 58.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4704/15625) 004704-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.57%], valid : [loss = 0.674, top1 = 82.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.153, top1 = 94.83%], test  : [loss = 0.460, top1 = 86.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.982, top1 = 71.46%], valid : [loss = 1.660, top1 = 56.66%], test : [loss = 1.660, top1 = 56.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 3.059, top1 = 25.29%], valid : [loss = 3.116, top1 = 24.89%], test : [loss = 3.160, top1 = 23.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.62%], valid : [loss = 1.007, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4705/15625) 004705-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.26%], valid : [loss = 0.603, top1 = 85.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.40 ms.
cifar10        train : [loss = 0.072, top1 = 97.78%], test  : [loss = 0.404, top1 = 88.98%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.84 ms.
cifar100       train : [loss = 0.714, top1 = 79.30%], valid : [loss = 1.384, top1 = 63.10%], test : [loss = 1.366, top1 = 63.11%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.87%], valid : [loss = 2.665, top1 = 34.01%], test : [loss = 2.690, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.55%], valid : [loss = 0.786, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4706/15625) 004706-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.454, top1 = 84.24%], valid : [loss = 0.692, top1 = 77.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.406, top1 = 85.86%], test  : [loss = 0.546, top1 = 81.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 1.660, top1 = 54.26%], valid : [loss = 1.890, top1 = 49.71%], test : [loss = 1.883, top1 = 49.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 3.311, top1 = 21.19%], valid : [loss = 3.305, top1 = 21.61%], test : [loss = 3.347, top1 = 20.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.195, top1 = 56.69%], valid : [loss = 1.254, top1 = 55.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4707/15625) 004707-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.511, top1 = 89.77%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.45 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.299, top1 = 93.34%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.92 ms.
cifar100       train : [loss = 0.093, top1 = 98.24%], valid : [loss = 1.333, top1 = 69.87%], test : [loss = 1.337, top1 = 69.90%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 1.695, top1 = 54.71%], valid : [loss = 2.143, top1 = 44.62%], test : [loss = 2.153, top1 = 45.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.55%], valid : [loss = 0.699, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4708/15625) 004708-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.512, top1 = 89.66%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.340, top1 = 92.85%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.70 ms.
cifar100       train : [loss = 0.087, top1 = 98.35%], valid : [loss = 1.364, top1 = 69.21%], test : [loss = 1.382, top1 = 69.33%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 1.737, top1 = 53.62%], valid : [loss = 2.206, top1 = 44.08%], test : [loss = 2.218, top1 = 43.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 73.76%], valid : [loss = 0.792, top1 = 72.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4709/15625) 004709-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.520, top1 = 88.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.322, top1 = 92.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.65 ms.
cifar100       train : [loss = 0.342, top1 = 90.66%], valid : [loss = 1.278, top1 = 66.94%], test : [loss = 1.280, top1 = 67.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.65%], valid : [loss = 2.412, top1 = 38.71%], test : [loss = 2.422, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4710/15625) 004710-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.313, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 0.328, top1 = 90.96%], valid : [loss = 1.307, top1 = 67.06%], test : [loss = 1.310, top1 = 67.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.12%], valid : [loss = 2.367, top1 = 40.00%], test : [loss = 2.408, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.26%], valid : [loss = 0.555, top1 = 81.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4711/15625) 004711-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.85%], valid : [loss = 0.508, top1 = 87.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.081, top1 = 97.47%], test  : [loss = 0.352, top1 = 89.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.42 ms.
cifar100       train : [loss = 0.729, top1 = 78.82%], valid : [loss = 1.308, top1 = 65.11%], test : [loss = 1.284, top1 = 64.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.87 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.88%], valid : [loss = 2.587, top1 = 35.41%], test : [loss = 2.620, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.35%], valid : [loss = 0.648, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4712/15625) 004712-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.38%], valid : [loss = 0.536, top1 = 84.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.176, top1 = 94.10%], test  : [loss = 0.377, top1 = 88.18%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.13 ms.
cifar100       train : [loss = 1.193, top1 = 66.15%], valid : [loss = 1.507, top1 = 58.83%], test : [loss = 1.502, top1 = 58.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.58%], valid : [loss = 2.707, top1 = 32.56%], test : [loss = 2.746, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4713/15625) 004713-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.435, top1 = 90.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.292, top1 = 93.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.99 ms.
cifar100       train : [loss = 0.168, top1 = 96.22%], valid : [loss = 1.294, top1 = 69.01%], test : [loss = 1.276, top1 = 69.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.793, top1 = 52.21%], valid : [loss = 2.231, top1 = 43.08%], test : [loss = 2.299, top1 = 42.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.89%], valid : [loss = 0.506, top1 = 83.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4714/15625) 004714-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.638, top1 = 86.56%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.33 ms.
cifar10        train : [loss = 0.022, top1 = 99.46%], test  : [loss = 0.453, top1 = 89.63%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.50 ms.
cifar100       train : [loss = 0.300, top1 = 92.19%], valid : [loss = 1.485, top1 = 64.34%], test : [loss = 1.512, top1 = 64.13%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.76%], valid : [loss = 2.564, top1 = 36.51%], test : [loss = 2.607, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.76%], valid : [loss = 0.784, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4715/15625) 004715-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.854, top1 = 82.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.585, top1 = 86.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 0.364, top1 = 90.33%], valid : [loss = 1.759, top1 = 60.09%], test : [loss = 1.757, top1 = 59.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 34.15%], valid : [loss = 3.031, top1 = 27.11%], test : [loss = 3.041, top1 = 27.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.92%], valid : [loss = 0.947, top1 = 66.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4716/15625) 004716-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.639, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.056, top1 = 98.29%], test  : [loss = 0.414, top1 = 89.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.626, top1 = 81.69%], valid : [loss = 1.403, top1 = 63.22%], test : [loss = 1.399, top1 = 63.43%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.450, top1 = 37.76%], valid : [loss = 2.591, top1 = 34.88%], test : [loss = 2.614, top1 = 34.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.65%], valid : [loss = 0.838, top1 = 71.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4717/15625) 004717-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.94 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.528, top1 = 88.65%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.64 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.329, top1 = 92.25%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.14 ms.
cifar100       train : [loss = 0.219, top1 = 94.66%], valid : [loss = 1.276, top1 = 68.47%], test : [loss = 1.251, top1 = 68.99%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.930, top1 = 49.18%], valid : [loss = 2.288, top1 = 41.54%], test : [loss = 2.304, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.74%], valid : [loss = 0.685, top1 = 76.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4718/15625) 004718-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.52 ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.77%], valid : [loss = 1.117, top1 = 62.65%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.54 ms.
cifar10        train : [loss = 0.782, top1 = 72.51%], test  : [loss = 0.917, top1 = 68.44%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.40 ms.
cifar100       train : [loss = 2.118, top1 = 44.29%], valid : [loss = 2.395, top1 = 39.20%], test : [loss = 2.397, top1 = 39.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.73 ms.
ImageNet16-120 train : [loss = 3.763, top1 = 13.93%], valid : [loss = 3.817, top1 = 14.00%], test : [loss = 3.833, top1 = 13.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4719/15625) 004719-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.559, top1 = 87.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.378, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.381, top1 = 89.22%], valid : [loss = 1.384, top1 = 65.71%], test : [loss = 1.428, top1 = 65.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 41.92%], valid : [loss = 2.466, top1 = 37.98%], test : [loss = 2.496, top1 = 37.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.01%], valid : [loss = 0.768, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4720/15625) 004720-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.27%], valid : [loss = 0.615, top1 = 85.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10        train : [loss = 0.069, top1 = 97.90%], test  : [loss = 0.408, top1 = 88.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.20 ms.
cifar100       train : [loss = 0.718, top1 = 79.07%], valid : [loss = 1.377, top1 = 63.35%], test : [loss = 1.364, top1 = 63.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.20%], valid : [loss = 2.633, top1 = 34.33%], test : [loss = 2.668, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4721/15625) 004721-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.486, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.303, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.93 ms.
cifar100       train : [loss = 0.316, top1 = 91.59%], valid : [loss = 1.263, top1 = 67.49%], test : [loss = 1.268, top1 = 67.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.85%], valid : [loss = 2.313, top1 = 40.78%], test : [loss = 2.335, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.82%], valid : [loss = 0.621, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4722/15625) 004722-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.65%], valid : [loss = 0.860, top1 = 70.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.674, top1 = 76.38%], test  : [loss = 0.761, top1 = 73.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 1.968, top1 = 47.67%], valid : [loss = 2.145, top1 = 44.51%], test : [loss = 2.161, top1 = 44.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.74%], valid : [loss = 3.667, top1 = 15.99%], test : [loss = 3.694, top1 = 15.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.376, top1 = 49.82%], valid : [loss = 1.395, top1 = 49.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4723/15625) 004723-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.332, top1 = 91.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.86 ms.
cifar100       train : [loss = 0.320, top1 = 91.42%], valid : [loss = 1.275, top1 = 67.01%], test : [loss = 1.300, top1 = 67.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.09%], valid : [loss = 2.400, top1 = 39.46%], test : [loss = 2.407, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4724/15625) 004724-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.41%], valid : [loss = 0.551, top1 = 86.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.96 ms.
cifar10        train : [loss = 0.080, top1 = 97.33%], test  : [loss = 0.383, top1 = 89.21%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.82 ms.
cifar100       train : [loss = 0.674, top1 = 80.14%], valid : [loss = 1.349, top1 = 63.67%], test : [loss = 1.343, top1 = 64.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.01%], valid : [loss = 2.510, top1 = 35.96%], test : [loss = 2.524, top1 = 35.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 68.98%], valid : [loss = 0.904, top1 = 67.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4725/15625) 004725-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.618, top1 = 86.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.386, top1 = 90.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.89 ms.
cifar100       train : [loss = 0.507, top1 = 85.22%], valid : [loss = 1.408, top1 = 64.27%], test : [loss = 1.420, top1 = 64.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.20%], valid : [loss = 2.583, top1 = 35.41%], test : [loss = 2.590, top1 = 34.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4726/15625) 004726-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.599, top1 = 87.83%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.11 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.386, top1 = 91.83%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.47 ms.
cifar100       train : [loss = 0.094, top1 = 98.52%], valid : [loss = 1.505, top1 = 67.32%], test : [loss = 1.506, top1 = 67.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.42%], valid : [loss = 2.462, top1 = 38.86%], test : [loss = 2.470, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.29%], valid : [loss = 0.722, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4727/15625) 004727-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.463, top1 = 89.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.328, top1 = 92.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.20 ms.
cifar100       train : [loss = 0.124, top1 = 97.38%], valid : [loss = 1.418, top1 = 68.16%], test : [loss = 1.436, top1 = 68.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 1.798, top1 = 52.24%], valid : [loss = 2.311, top1 = 41.72%], test : [loss = 2.335, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 84.08%], valid : [loss = 0.565, top1 = 80.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4728/15625) 004728-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.478, top1 = 89.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.322, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.32 ms.
cifar100       train : [loss = 0.247, top1 = 93.76%], valid : [loss = 1.253, top1 = 68.61%], test : [loss = 1.265, top1 = 68.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.89%], valid : [loss = 2.232, top1 = 42.44%], test : [loss = 2.263, top1 = 42.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.76%], valid : [loss = 0.614, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4729/15625) 004729-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.493, top1 = 89.72%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.46 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.301, top1 = 93.30%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.74 ms.
cifar100       train : [loss = 0.080, top1 = 98.81%], valid : [loss = 1.300, top1 = 69.65%], test : [loss = 1.309, top1 = 69.57%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.15 ms.
ImageNet16-120 train : [loss = 1.702, top1 = 54.53%], valid : [loss = 2.204, top1 = 43.67%], test : [loss = 2.227, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.30%], valid : [loss = 0.676, top1 = 76.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4730/15625) 004730-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.63%], valid : [loss = 0.461, top1 = 86.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.153, top1 = 95.02%], test  : [loss = 0.345, top1 = 88.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.972, top1 = 72.53%], valid : [loss = 1.359, top1 = 62.15%], test : [loss = 1.334, top1 = 62.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.97%], valid : [loss = 2.671, top1 = 33.11%], test : [loss = 2.710, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4731/15625) 004731-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.51%], valid : [loss = 0.443, top1 = 87.86%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.49 ms.
cifar10        train : [loss = 0.056, top1 = 98.61%], test  : [loss = 0.319, top1 = 90.36%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.54 ms.
cifar100       train : [loss = 0.590, top1 = 83.83%], valid : [loss = 1.221, top1 = 66.97%], test : [loss = 1.198, top1 = 67.05%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.93%], valid : [loss = 2.468, top1 = 38.00%], test : [loss = 2.488, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.14%], valid : [loss = 0.652, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4732/15625) 004732-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.64%], valid : [loss = 0.739, top1 = 74.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.47 ms.
cifar10        train : [loss = 0.484, top1 = 83.40%], test  : [loss = 0.568, top1 = 80.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.64 ms.
cifar100       train : [loss = 1.814, top1 = 50.73%], valid : [loss = 1.921, top1 = 48.24%], test : [loss = 1.915, top1 = 47.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.22 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 26.14%], valid : [loss = 3.005, top1 = 27.31%], test : [loss = 3.034, top1 = 25.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.169, top1 = 58.09%], valid : [loss = 1.203, top1 = 56.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4733/15625) 004733-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.39%], valid : [loss = 0.491, top1 = 84.60%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.40 ms.
cifar10        train : [loss = 0.263, top1 = 91.11%], test  : [loss = 0.414, top1 = 86.31%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.96 ms.
cifar100       train : [loss = 1.264, top1 = 64.41%], valid : [loss = 1.537, top1 = 57.63%], test : [loss = 1.536, top1 = 57.25%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.21 ms.
ImageNet16-120 train : [loss = 3.115, top1 = 24.51%], valid : [loss = 3.127, top1 = 23.87%], test : [loss = 3.136, top1 = 23.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 1.058, top1 = 61.89%], valid : [loss = 1.063, top1 = 61.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4734/15625) 004734-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.40%], valid : [loss = 0.540, top1 = 83.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.203, top1 = 93.12%], test  : [loss = 0.396, top1 = 87.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 1.285, top1 = 63.54%], valid : [loss = 1.579, top1 = 57.05%], test : [loss = 1.585, top1 = 56.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.711, top1 = 32.38%], valid : [loss = 2.748, top1 = 31.73%], test : [loss = 2.799, top1 = 30.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.88%], valid : [loss = 0.967, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4735/15625) 004735-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.17%], valid : [loss = 0.489, top1 = 84.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10        train : [loss = 0.231, top1 = 92.20%], test  : [loss = 0.388, top1 = 87.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.96 ms.
cifar100       train : [loss = 1.304, top1 = 63.52%], valid : [loss = 1.575, top1 = 56.41%], test : [loss = 1.578, top1 = 55.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 3.160, top1 = 23.56%], valid : [loss = 3.146, top1 = 23.89%], test : [loss = 3.161, top1 = 23.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.55%], valid : [loss = 1.052, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4736/15625) 004736-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.220, top1 = 92.63%], valid : [loss = 0.503, top1 = 84.18%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10        train : [loss = 0.248, top1 = 91.58%], test  : [loss = 0.402, top1 = 86.69%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.86 ms.
cifar100       train : [loss = 1.367, top1 = 61.85%], valid : [loss = 1.620, top1 = 55.58%], test : [loss = 1.604, top1 = 55.73%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 3.415, top1 = 19.10%], valid : [loss = 3.427, top1 = 18.89%], test : [loss = 3.451, top1 = 18.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.44%], valid : [loss = 1.046, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4737/15625) 004737-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10-valid  train : [loss = 1.056, top1 = 62.11%], valid : [loss = 1.183, top1 = 58.43%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10        train : [loss = 0.913, top1 = 67.70%], test  : [loss = 0.979, top1 = 65.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.94 ms.
cifar100       train : [loss = 2.273, top1 = 40.96%], valid : [loss = 2.468, top1 = 37.71%], test : [loss = 2.472, top1 = 38.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.03 ms.
ImageNet16-120 train : [loss = 3.796, top1 = 13.39%], valid : [loss = 3.823, top1 = 13.74%], test : [loss = 3.825, top1 = 13.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.502, top1 = 44.56%], valid : [loss = 1.526, top1 = 44.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4738/15625) 004738-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.523, top1 = 88.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.331, top1 = 92.03%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.68 ms.
cifar100       train : [loss = 0.355, top1 = 90.24%], valid : [loss = 1.299, top1 = 66.53%], test : [loss = 1.284, top1 = 66.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.50%], valid : [loss = 2.396, top1 = 39.20%], test : [loss = 2.438, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.79%], valid : [loss = 0.720, top1 = 74.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4739/15625) 004739-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.76%], valid : [loss = 0.478, top1 = 84.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.301, top1 = 89.92%], test  : [loss = 0.393, top1 = 86.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 1.334, top1 = 63.05%], valid : [loss = 1.533, top1 = 58.07%], test : [loss = 1.521, top1 = 58.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.74%], valid : [loss = 2.912, top1 = 28.80%], test : [loss = 2.958, top1 = 27.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4740/15625) 004740-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.49%], valid : [loss = 0.601, top1 = 87.10%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.37 ms.
cifar10        train : [loss = 0.020, top1 = 99.41%], test  : [loss = 0.415, top1 = 90.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.53 ms.
cifar100       train : [loss = 0.354, top1 = 90.00%], valid : [loss = 1.459, top1 = 63.74%], test : [loss = 1.464, top1 = 64.22%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 3.202, top1 = 21.61%], valid : [loss = 3.194, top1 = 22.13%], test : [loss = 3.211, top1 = 21.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.00%], valid : [loss = 1.206, top1 = 56.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4741/15625) 004741-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10-valid  train : [loss = 1.166, top1 = 58.42%], valid : [loss = 1.215, top1 = 57.01%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 1.137, top1 = 59.64%], test  : [loss = 1.136, top1 = 59.57%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.52 ms.
cifar100       train : [loss = 2.660, top1 = 33.11%], valid : [loss = 2.740, top1 = 32.03%], test : [loss = 2.716, top1 = 32.11%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 3.824, top1 = 13.07%], valid : [loss = 3.815, top1 = 13.64%], test : [loss = 3.836, top1 = 13.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.670, top1 = 37.32%], valid : [loss = 1.694, top1 = 35.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4742/15625) 004742-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.521, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.334, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.59 ms.
cifar100       train : [loss = 0.350, top1 = 90.39%], valid : [loss = 1.285, top1 = 66.69%], test : [loss = 1.297, top1 = 66.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.57%], valid : [loss = 2.405, top1 = 39.38%], test : [loss = 2.425, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.82%], valid : [loss = 0.691, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4743/15625) 004743-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.478, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.303, top1 = 92.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.53 ms.
cifar100       train : [loss = 0.313, top1 = 91.62%], valid : [loss = 1.262, top1 = 67.37%], test : [loss = 1.278, top1 = 67.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.85%], valid : [loss = 2.318, top1 = 40.50%], test : [loss = 2.360, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.52%], valid : [loss = 0.621, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4744/15625) 004744-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.220, top1 = 92.73%], valid : [loss = 0.504, top1 = 83.94%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.26 ms.
cifar10        train : [loss = 0.239, top1 = 91.86%], test  : [loss = 0.397, top1 = 86.96%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.78 ms.
cifar100       train : [loss = 1.264, top1 = 64.50%], valid : [loss = 1.546, top1 = 56.79%], test : [loss = 1.544, top1 = 56.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 3.428, top1 = 19.10%], valid : [loss = 3.433, top1 = 18.76%], test : [loss = 3.444, top1 = 18.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 59.28%], valid : [loss = 1.150, top1 = 58.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4745/15625) 004745-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.525, top1 = 89.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.336, top1 = 92.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.92 ms.
cifar100       train : [loss = 0.123, top1 = 97.53%], valid : [loss = 1.339, top1 = 68.51%], test : [loss = 1.357, top1 = 68.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.42%], valid : [loss = 2.313, top1 = 41.29%], test : [loss = 2.313, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.96%], valid : [loss = 0.717, top1 = 75.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4746/15625) 004746-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.19%], valid : [loss = 0.530, top1 = 84.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10        train : [loss = 0.175, top1 = 94.11%], test  : [loss = 0.379, top1 = 88.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 1.237, top1 = 65.09%], valid : [loss = 1.536, top1 = 57.77%], test : [loss = 1.528, top1 = 58.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 34.76%], valid : [loss = 2.671, top1 = 33.33%], test : [loss = 2.692, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 1.000, top1 = 64.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4747/15625) 004747-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.421, top1 = 91.15%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.84 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.279, top1 = 93.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.76 ms.
cifar100       train : [loss = 0.028, top1 = 99.77%], valid : [loss = 1.261, top1 = 72.59%], test : [loss = 1.237, top1 = 72.17%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 1.240, top1 = 65.79%], valid : [loss = 2.221, top1 = 45.70%], test : [loss = 2.230, top1 = 45.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.50%], valid : [loss = 0.492, top1 = 83.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4748/15625) 004748-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.13%], valid : [loss = 0.645, top1 = 84.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.086, top1 = 97.11%], test  : [loss = 0.441, top1 = 88.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.68 ms.
cifar100       train : [loss = 0.639, top1 = 81.21%], valid : [loss = 1.601, top1 = 59.75%], test : [loss = 1.598, top1 = 60.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.970, top1 = 26.77%], valid : [loss = 3.015, top1 = 25.83%], test : [loss = 3.048, top1 = 25.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.148, top1 = 58.30%], valid : [loss = 1.172, top1 = 57.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4749/15625) 004749-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.04 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.593, top1 = 87.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10        train : [loss = 0.020, top1 = 99.50%], test  : [loss = 0.395, top1 = 91.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.02 ms.
cifar100       train : [loss = 0.422, top1 = 87.96%], valid : [loss = 1.413, top1 = 65.29%], test : [loss = 1.416, top1 = 65.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.317, top1 = 40.49%], valid : [loss = 2.524, top1 = 36.40%], test : [loss = 2.534, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.38%], valid : [loss = 0.835, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4750/15625) 004750-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.529, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.353, top1 = 92.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.75 ms.
cifar100       train : [loss = 0.151, top1 = 96.66%], valid : [loss = 1.326, top1 = 68.20%], test : [loss = 1.334, top1 = 68.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 1.947, top1 = 48.63%], valid : [loss = 2.295, top1 = 41.24%], test : [loss = 2.298, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.60%], valid : [loss = 0.657, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4751/15625) 004751-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.094, top1 = 97.33%], valid : [loss = 0.462, top1 = 86.33%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.62 ms.
cifar10        train : [loss = 0.124, top1 = 96.07%], test  : [loss = 0.344, top1 = 89.23%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.86 ms.
cifar100       train : [loss = 0.775, top1 = 78.23%], valid : [loss = 1.284, top1 = 64.24%], test : [loss = 1.277, top1 = 64.41%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.517, top1 = 36.23%], valid : [loss = 2.600, top1 = 34.73%], test : [loss = 2.618, top1 = 34.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.28%], valid : [loss = 0.961, top1 = 65.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4752/15625) 004752-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.78%], valid : [loss = 0.474, top1 = 84.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.301, top1 = 89.90%], test  : [loss = 0.396, top1 = 86.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.60 ms.
cifar100       train : [loss = 1.341, top1 = 62.82%], valid : [loss = 1.545, top1 = 57.19%], test : [loss = 1.517, top1 = 57.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.50%], valid : [loss = 2.920, top1 = 28.80%], test : [loss = 2.972, top1 = 27.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.09%], valid : [loss = 0.764, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4753/15625) 004753-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.42%], valid : [loss = 0.858, top1 = 71.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.553, top1 = 80.69%], test  : [loss = 0.714, top1 = 75.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 1.780, top1 = 52.17%], valid : [loss = 2.053, top1 = 47.11%], test : [loss = 2.067, top1 = 46.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.87%], valid : [loss = 3.639, top1 = 16.18%], test : [loss = 3.665, top1 = 15.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4754/15625) 004754-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.90%], valid : [loss = 0.477, top1 = 84.36%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10        train : [loss = 0.299, top1 = 89.97%], test  : [loss = 0.408, top1 = 86.27%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.45 ms.
cifar100       train : [loss = 1.334, top1 = 62.98%], valid : [loss = 1.533, top1 = 58.02%], test : [loss = 1.517, top1 = 58.22%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.25 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.59%], valid : [loss = 2.904, top1 = 29.61%], test : [loss = 2.953, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4755/15625) 004755-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.36%], valid : [loss = 0.458, top1 = 86.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.162, top1 = 94.76%], test  : [loss = 0.356, top1 = 88.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.996, top1 = 71.67%], valid : [loss = 1.357, top1 = 61.95%], test : [loss = 1.344, top1 = 62.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.74%], valid : [loss = 2.684, top1 = 32.79%], test : [loss = 2.715, top1 = 32.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4756/15625) 004756-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.682, top1 = 85.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.036, top1 = 98.96%], test  : [loss = 0.460, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 0.449, top1 = 87.46%], valid : [loss = 1.469, top1 = 63.41%], test : [loss = 1.469, top1 = 63.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.26%], valid : [loss = 2.656, top1 = 33.67%], test : [loss = 2.699, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.19%], valid : [loss = 0.839, top1 = 70.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4757/15625) 004757-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.879, top1 = 82.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.038, top1 = 98.95%], test  : [loss = 0.535, top1 = 87.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.90 ms.
cifar100       train : [loss = 0.476, top1 = 86.84%], valid : [loss = 1.728, top1 = 59.11%], test : [loss = 1.720, top1 = 59.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.11%], valid : [loss = 2.951, top1 = 28.69%], test : [loss = 3.015, top1 = 27.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.13%], valid : [loss = 0.906, top1 = 67.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4758/15625) 004758-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.444, top1 = 90.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.295, top1 = 93.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.101, top1 = 98.12%], valid : [loss = 1.367, top1 = 68.84%], test : [loss = 1.356, top1 = 69.03%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 55.04%], valid : [loss = 2.256, top1 = 43.46%], test : [loss = 2.272, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.24%], valid : [loss = 0.541, top1 = 81.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4759/15625) 004759-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.63%], valid : [loss = 0.641, top1 = 86.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.392, top1 = 90.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.62 ms.
cifar100       train : [loss = 0.509, top1 = 85.16%], valid : [loss = 1.417, top1 = 63.81%], test : [loss = 1.408, top1 = 64.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.28%], valid : [loss = 2.549, top1 = 35.97%], test : [loss = 2.601, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4760/15625) 004760-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.492, top1 = 89.04%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.43 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.311, top1 = 92.50%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.74 ms.
cifar100       train : [loss = 0.237, top1 = 94.14%], valid : [loss = 1.236, top1 = 68.97%], test : [loss = 1.233, top1 = 68.99%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.16%], valid : [loss = 2.198, top1 = 43.09%], test : [loss = 2.219, top1 = 43.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.23%], valid : [loss = 0.609, top1 = 79.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4761/15625) 004761-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.541, top1 = 89.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.334, top1 = 93.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.99 ms.
cifar100       train : [loss = 0.118, top1 = 97.50%], valid : [loss = 1.359, top1 = 68.83%], test : [loss = 1.361, top1 = 68.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.753, top1 = 53.21%], valid : [loss = 2.224, top1 = 42.81%], test : [loss = 2.228, top1 = 42.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.74%], valid : [loss = 0.686, top1 = 76.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4762/15625) 004762-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.41%], valid : [loss = 0.735, top1 = 82.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10        train : [loss = 0.108, top1 = 96.49%], test  : [loss = 0.459, top1 = 87.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.11 ms.
cifar100       train : [loss = 0.886, top1 = 74.42%], valid : [loss = 1.531, top1 = 59.17%], test : [loss = 1.507, top1 = 60.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 2.735, top1 = 31.90%], valid : [loss = 2.836, top1 = 30.13%], test : [loss = 2.867, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.98%], valid : [loss = 0.919, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4763/15625) 004763-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.358, top1 = 92.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.79 ms.
cifar100       train : [loss = 0.150, top1 = 96.45%], valid : [loss = 1.473, top1 = 66.79%], test : [loss = 1.445, top1 = 67.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.38%], valid : [loss = 2.441, top1 = 38.91%], test : [loss = 2.494, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.11%], valid : [loss = 0.689, top1 = 76.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4764/15625) 004764-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.59%], valid : [loss = 0.627, top1 = 82.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.184, top1 = 93.79%], test  : [loss = 0.422, top1 = 86.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.901, top1 = 73.91%], valid : [loss = 1.490, top1 = 60.52%], test : [loss = 1.504, top1 = 60.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.818, top1 = 30.62%], valid : [loss = 2.875, top1 = 29.70%], test : [loss = 2.930, top1 = 29.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.037, top1 = 62.73%], valid : [loss = 1.107, top1 = 61.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4765/15625) 004765-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.20%], valid : [loss = 0.525, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.103, top1 = 96.72%], test  : [loss = 0.365, top1 = 89.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 0.740, top1 = 78.57%], valid : [loss = 1.326, top1 = 64.31%], test : [loss = 1.312, top1 = 64.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.80%], valid : [loss = 2.558, top1 = 35.20%], test : [loss = 2.605, top1 = 34.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 70.09%], valid : [loss = 0.894, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4766/15625) 004766-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.498, top1 = 90.21%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.338, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.81 ms.
cifar100       train : [loss = 0.128, top1 = 97.21%], valid : [loss = 1.282, top1 = 69.81%], test : [loss = 1.288, top1 = 70.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.79 ms.
ImageNet16-120 train : [loss = 1.747, top1 = 53.27%], valid : [loss = 2.172, top1 = 44.20%], test : [loss = 2.195, top1 = 44.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.82%], valid : [loss = 0.688, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4767/15625) 004767-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.47%], valid : [loss = 0.861, top1 = 79.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10        train : [loss = 0.125, top1 = 95.85%], test  : [loss = 0.555, top1 = 84.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.09 ms.
cifar100       train : [loss = 0.852, top1 = 75.32%], valid : [loss = 1.667, top1 = 57.33%], test : [loss = 1.687, top1 = 57.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.40%], valid : [loss = 3.165, top1 = 24.59%], test : [loss = 3.207, top1 = 23.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4768/15625) 004768-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.03%], valid : [loss = 0.537, top1 = 86.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.072, top1 = 97.72%], test  : [loss = 0.362, top1 = 89.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.12 ms.
cifar100       train : [loss = 0.716, top1 = 78.91%], valid : [loss = 1.350, top1 = 63.99%], test : [loss = 1.352, top1 = 64.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.15%], valid : [loss = 2.645, top1 = 34.12%], test : [loss = 2.683, top1 = 32.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4769/15625) 004769-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.231, top1 = 92.14%], valid : [loss = 0.560, top1 = 82.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.89 ms.
cifar10        train : [loss = 0.218, top1 = 92.56%], test  : [loss = 0.410, top1 = 87.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 1.298, top1 = 63.03%], valid : [loss = 1.579, top1 = 56.92%], test : [loss = 1.582, top1 = 56.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.727, top1 = 32.07%], valid : [loss = 2.762, top1 = 31.72%], test : [loss = 2.811, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 64.90%], valid : [loss = 1.025, top1 = 63.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4770/15625) 004770-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.515, top1 = 89.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.18 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.337, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.60 ms.
cifar100       train : [loss = 0.195, top1 = 95.11%], valid : [loss = 1.269, top1 = 68.89%], test : [loss = 1.263, top1 = 69.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.54%], valid : [loss = 2.215, top1 = 43.22%], test : [loss = 2.222, top1 = 43.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.64%], valid : [loss = 0.656, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4771/15625) 004771-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.06%], valid : [loss = 0.449, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.110, top1 = 96.63%], test  : [loss = 0.330, top1 = 89.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.68 ms.
cifar100       train : [loss = 0.866, top1 = 75.35%], valid : [loss = 1.302, top1 = 63.77%], test : [loss = 1.293, top1 = 63.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.67%], valid : [loss = 2.639, top1 = 33.97%], test : [loss = 2.656, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4772/15625) 004772-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.92%], valid : [loss = 0.780, top1 = 82.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10        train : [loss = 0.087, top1 = 97.18%], test  : [loss = 0.483, top1 = 86.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 0.809, top1 = 76.46%], valid : [loss = 1.549, top1 = 59.50%], test : [loss = 1.514, top1 = 60.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 2.841, top1 = 29.87%], valid : [loss = 2.984, top1 = 27.32%], test : [loss = 3.005, top1 = 27.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4773/15625) 004773-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.555, top1 = 87.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.372, top1 = 91.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.378, top1 = 89.38%], valid : [loss = 1.406, top1 = 65.41%], test : [loss = 1.417, top1 = 65.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.99 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.89%], valid : [loss = 2.485, top1 = 37.57%], test : [loss = 2.498, top1 = 37.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.63%], valid : [loss = 0.741, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4774/15625) 004774-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.618, top1 = 86.19%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.60 ms.
cifar10        train : [loss = 0.045, top1 = 98.71%], test  : [loss = 0.430, top1 = 89.09%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.58 ms.
cifar100       train : [loss = 0.432, top1 = 87.84%], valid : [loss = 1.433, top1 = 64.29%], test : [loss = 1.427, top1 = 64.37%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.417, top1 = 38.52%], valid : [loss = 2.680, top1 = 34.14%], test : [loss = 2.740, top1 = 33.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.83%], valid : [loss = 0.737, top1 = 74.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4775/15625) 004775-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.506, top1 = 88.82%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.326, top1 = 92.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.82 ms.
cifar100       train : [loss = 0.326, top1 = 91.13%], valid : [loss = 1.273, top1 = 67.17%], test : [loss = 1.293, top1 = 67.19%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.95%], valid : [loss = 2.408, top1 = 38.22%], test : [loss = 2.416, top1 = 39.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.17%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4776/15625) 004776-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.10%], valid : [loss = 0.609, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10        train : [loss = 0.070, top1 = 97.91%], test  : [loss = 0.411, top1 = 88.63%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 0.706, top1 = 79.51%], valid : [loss = 1.352, top1 = 63.79%], test : [loss = 1.354, top1 = 63.89%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.82%], valid : [loss = 2.645, top1 = 33.96%], test : [loss = 2.688, top1 = 33.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4777/15625) 004777-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.463, top1 = 89.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.317, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.26 ms.
cifar100       train : [loss = 0.316, top1 = 91.54%], valid : [loss = 1.254, top1 = 67.32%], test : [loss = 1.258, top1 = 68.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.66%], valid : [loss = 2.303, top1 = 40.93%], test : [loss = 2.325, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.88%], valid : [loss = 0.559, top1 = 81.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4778/15625) 004778-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.533, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.344, top1 = 91.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.53 ms.
cifar100       train : [loss = 0.303, top1 = 91.70%], valid : [loss = 1.303, top1 = 67.29%], test : [loss = 1.309, top1 = 67.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.85%], valid : [loss = 2.416, top1 = 38.82%], test : [loss = 2.422, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4779/15625) 004779-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.69%], valid : [loss = 0.545, top1 = 88.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.021, top1 = 99.43%], test  : [loss = 0.351, top1 = 91.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.339, top1 = 90.36%], valid : [loss = 1.275, top1 = 67.15%], test : [loss = 1.298, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.96%], valid : [loss = 2.341, top1 = 40.14%], test : [loss = 2.362, top1 = 39.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.65%], valid : [loss = 0.884, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4780/15625) 004780-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.603, top1 = 87.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.411, top1 = 91.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.195, top1 = 95.29%], valid : [loss = 1.581, top1 = 64.55%], test : [loss = 1.587, top1 = 64.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.085, top1 = 45.69%], valid : [loss = 2.461, top1 = 38.04%], test : [loss = 2.487, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.36%], valid : [loss = 0.799, top1 = 71.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4781/15625) 004781-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.95%], valid : [loss = 0.842, top1 = 72.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10        train : [loss = 0.565, top1 = 80.24%], test  : [loss = 0.715, top1 = 75.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.50 ms.
cifar100       train : [loss = 1.798, top1 = 51.60%], valid : [loss = 2.052, top1 = 47.11%], test : [loss = 2.069, top1 = 47.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 3.599, top1 = 16.56%], valid : [loss = 3.650, top1 = 15.86%], test : [loss = 3.675, top1 = 15.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.195, top1 = 57.00%], valid : [loss = 1.245, top1 = 55.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4782/15625) 004782-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.516, top1 = 89.40%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.327, top1 = 92.85%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.09 ms.
cifar100       train : [loss = 0.148, top1 = 96.66%], valid : [loss = 1.290, top1 = 69.97%], test : [loss = 1.288, top1 = 69.71%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.65%], valid : [loss = 2.194, top1 = 43.47%], test : [loss = 2.188, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 71.99%], valid : [loss = 0.837, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4783/15625) 004783-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.575, top1 = 87.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.039, top1 = 98.84%], test  : [loss = 0.396, top1 = 90.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.93 ms.
cifar100       train : [loss = 0.552, top1 = 83.70%], valid : [loss = 1.425, top1 = 63.77%], test : [loss = 1.415, top1 = 64.25%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.00%], valid : [loss = 2.609, top1 = 34.44%], test : [loss = 2.646, top1 = 34.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.98%], valid : [loss = 0.716, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4784/15625) 004784-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.676, top1 = 85.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.020, top1 = 99.45%], test  : [loss = 0.439, top1 = 89.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.309, top1 = 91.69%], valid : [loss = 1.607, top1 = 62.73%], test : [loss = 1.617, top1 = 62.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.81%], valid : [loss = 2.588, top1 = 35.14%], test : [loss = 2.586, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.83%], valid : [loss = 0.806, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4785/15625) 004785-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.32%], valid : [loss = 0.454, top1 = 86.40%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10        train : [loss = 0.158, top1 = 94.86%], test  : [loss = 0.346, top1 = 88.86%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.03 ms.
cifar100       train : [loss = 0.993, top1 = 71.80%], valid : [loss = 1.357, top1 = 62.46%], test : [loss = 1.351, top1 = 61.97%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.94%], valid : [loss = 2.681, top1 = 33.00%], test : [loss = 2.694, top1 = 32.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.94%], valid : [loss = 0.789, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4786/15625) 004786-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.507, top1 = 88.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.325, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.96 ms.
cifar100       train : [loss = 0.324, top1 = 91.27%], valid : [loss = 1.275, top1 = 67.14%], test : [loss = 1.267, top1 = 67.73%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.14%], valid : [loss = 2.392, top1 = 39.18%], test : [loss = 2.415, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4787/15625) 004787-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=23.40 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.469, top1 = 89.71%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=22.73 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.302, top1 = 92.74%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=20.93 ms.
cifar100       train : [loss = 0.124, top1 = 97.78%], valid : [loss = 1.265, top1 = 69.62%], test : [loss = 1.240, top1 = 69.86%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=20.42 ms.
ImageNet16-120 train : [loss = 1.668, top1 = 55.24%], valid : [loss = 2.141, top1 = 44.82%], test : [loss = 2.186, top1 = 44.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.90%], valid : [loss = 0.642, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4788/15625) 004788-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.510, top1 = 89.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.324, top1 = 92.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.83 ms.
cifar100       train : [loss = 0.148, top1 = 96.95%], valid : [loss = 1.303, top1 = 68.84%], test : [loss = 1.313, top1 = 69.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.43%], valid : [loss = 2.304, top1 = 41.72%], test : [loss = 2.290, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4789/15625) 004789-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.571, top1 = 88.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.364, top1 = 92.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.123, top1 = 97.49%], valid : [loss = 1.540, top1 = 66.84%], test : [loss = 1.530, top1 = 66.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 48.01%], valid : [loss = 2.422, top1 = 39.83%], test : [loss = 2.439, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.02%], valid : [loss = 0.735, top1 = 74.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4790/15625) 004790-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.17 ms.
cifar10-valid  train : [loss = 0.096, top1 = 97.05%], valid : [loss = 0.504, top1 = 86.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.097, top1 = 96.88%], test  : [loss = 0.335, top1 = 89.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 0.668, top1 = 80.76%], valid : [loss = 1.233, top1 = 65.69%], test : [loss = 1.218, top1 = 66.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.90%], valid : [loss = 2.447, top1 = 38.27%], test : [loss = 2.475, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.05%], valid : [loss = 0.921, top1 = 67.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4791/15625) 004791-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.327, top1 = 91.10%], valid : [loss = 1.305, top1 = 67.42%], test : [loss = 1.310, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.28%], valid : [loss = 2.367, top1 = 40.31%], test : [loss = 2.384, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.07%], valid : [loss = 0.561, top1 = 80.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4792/15625) 004792-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.42%], valid : [loss = 0.469, top1 = 85.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10        train : [loss = 0.161, top1 = 94.68%], test  : [loss = 0.345, top1 = 88.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 1.000, top1 = 71.51%], valid : [loss = 1.351, top1 = 62.23%], test : [loss = 1.352, top1 = 62.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.47%], valid : [loss = 2.689, top1 = 32.90%], test : [loss = 2.727, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4793/15625) 004793-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.515, top1 = 88.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.336, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.338, top1 = 90.80%], valid : [loss = 1.270, top1 = 67.11%], test : [loss = 1.292, top1 = 67.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.49%], valid : [loss = 2.407, top1 = 38.98%], test : [loss = 2.431, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.658, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4794/15625) 004794-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.146, top1 = 95.25%], valid : [loss = 0.964, top1 = 75.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10        train : [loss = 0.203, top1 = 93.05%], test  : [loss = 0.608, top1 = 82.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.044, top1 = 70.07%], valid : [loss = 1.807, top1 = 53.89%], test : [loss = 1.810, top1 = 54.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.82%], valid : [loss = 3.375, top1 = 20.78%], test : [loss = 3.411, top1 = 20.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.186, top1 = 57.00%], valid : [loss = 1.243, top1 = 55.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4795/15625) 004795-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.80 ms.
cifar10        train : [loss = 0.014, top1 = 99.75%], test  : [loss = 0.309, top1 = 92.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.14 ms.
cifar100       train : [loss = 0.335, top1 = 90.77%], valid : [loss = 1.291, top1 = 67.27%], test : [loss = 1.305, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.21%], valid : [loss = 2.364, top1 = 40.20%], test : [loss = 2.377, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.81%], valid : [loss = 0.567, top1 = 80.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4796/15625) 004796-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.19 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.509, top1 = 89.90%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.45 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.322, top1 = 93.39%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.73 ms.
cifar100       train : [loss = 0.048, top1 = 99.37%], valid : [loss = 1.376, top1 = 69.80%], test : [loss = 1.400, top1 = 69.75%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.36%], valid : [loss = 2.358, top1 = 40.36%], test : [loss = 2.371, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.81%], valid : [loss = 0.864, top1 = 69.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4797/15625) 004797-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.333, top1 = 93.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.91 ms.
cifar100       train : [loss = 0.071, top1 = 98.90%], valid : [loss = 1.380, top1 = 69.08%], test : [loss = 1.381, top1 = 69.19%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.67%], valid : [loss = 2.342, top1 = 40.53%], test : [loss = 2.348, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4798/15625) 004798-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.94%], valid : [loss = 0.579, top1 = 86.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 0.071, top1 = 97.72%], test  : [loss = 0.367, top1 = 89.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.77 ms.
cifar100       train : [loss = 0.692, top1 = 79.43%], valid : [loss = 1.362, top1 = 63.73%], test : [loss = 1.327, top1 = 64.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.395, top1 = 38.74%], valid : [loss = 2.532, top1 = 36.55%], test : [loss = 2.549, top1 = 35.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.20%], valid : [loss = 0.889, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4799/15625) 004799-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10-valid  train : [loss = 1.852, top1 = 32.50%], valid : [loss = 1.857, top1 = 32.36%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.19 ms.
cifar10        train : [loss = 1.314, top1 = 52.42%], test  : [loss = 1.319, top1 = 52.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.87 ms.
cifar100       train : [loss = 3.871, top1 = 10.55%], valid : [loss = 3.918, top1 = 9.74%], test : [loss = 3.916, top1 = 10.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.69 ms.
ImageNet16-120 train : [loss = 4.013, top1 = 10.12%], valid : [loss = 4.003, top1 = 10.32%], test : [loss = 4.005, top1 = 10.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.977, top1 = 26.47%], valid : [loss = 1.975, top1 = 27.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4800/15625) 004800-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.464, top1 = 90.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.297, top1 = 93.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.18 ms.
cifar100       train : [loss = 0.064, top1 = 99.04%], valid : [loss = 1.315, top1 = 70.93%], test : [loss = 1.358, top1 = 70.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.524, top1 = 58.69%], valid : [loss = 2.268, top1 = 43.38%], test : [loss = 2.294, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.415, top1 = 85.52%], valid : [loss = 0.544, top1 = 81.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4801/15625) 004801-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.561, top1 = 88.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.362, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.57 ms.
cifar100       train : [loss = 0.133, top1 = 97.39%], valid : [loss = 1.443, top1 = 67.21%], test : [loss = 1.453, top1 = 66.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.39%], valid : [loss = 2.406, top1 = 39.84%], test : [loss = 2.424, top1 = 39.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.23%], valid : [loss = 0.718, top1 = 75.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4802/15625) 004802-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.625, top1 = 87.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.18 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.404, top1 = 91.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.149, top1 = 96.78%], valid : [loss = 1.480, top1 = 66.14%], test : [loss = 1.461, top1 = 66.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.11%], valid : [loss = 2.479, top1 = 37.92%], test : [loss = 2.470, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.20%], valid : [loss = 0.775, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4803/15625) 004803-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.129, top1 = 95.99%], valid : [loss = 0.466, top1 = 85.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.161, top1 = 94.74%], test  : [loss = 0.351, top1 = 88.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.40 ms.
cifar100       train : [loss = 1.023, top1 = 70.80%], valid : [loss = 1.378, top1 = 61.39%], test : [loss = 1.388, top1 = 61.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.67%], valid : [loss = 2.701, top1 = 32.36%], test : [loss = 2.725, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4804/15625) 004804-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.44%], valid : [loss = 0.614, top1 = 86.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.044, top1 = 98.68%], test  : [loss = 0.400, top1 = 89.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 0.613, top1 = 82.00%], valid : [loss = 1.463, top1 = 62.89%], test : [loss = 1.463, top1 = 62.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.415, top1 = 38.39%], valid : [loss = 2.603, top1 = 34.77%], test : [loss = 2.626, top1 = 35.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.21%], valid : [loss = 0.892, top1 = 68.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4805/15625) 004805-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.519, top1 = 88.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.366, top1 = 90.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.22 ms.
cifar100       train : [loss = 0.466, top1 = 86.37%], valid : [loss = 1.372, top1 = 65.37%], test : [loss = 1.384, top1 = 65.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.24%], valid : [loss = 2.510, top1 = 36.82%], test : [loss = 2.556, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.76%], valid : [loss = 0.666, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4806/15625) 004806-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.64%], valid : [loss = 0.464, top1 = 86.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10        train : [loss = 0.154, top1 = 95.01%], test  : [loss = 0.343, top1 = 89.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.86 ms.
cifar100       train : [loss = 0.987, top1 = 72.02%], valid : [loss = 1.347, top1 = 62.05%], test : [loss = 1.338, top1 = 62.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.11%], valid : [loss = 2.682, top1 = 32.70%], test : [loss = 2.703, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4807/15625) 004807-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.513, top1 = 89.85%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.311, top1 = 93.44%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.55 ms.
cifar100       train : [loss = 0.067, top1 = 99.09%], valid : [loss = 1.348, top1 = 69.58%], test : [loss = 1.334, top1 = 69.61%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.797, top1 = 52.20%], valid : [loss = 2.226, top1 = 43.42%], test : [loss = 2.217, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.69%], valid : [loss = 0.637, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4808/15625) 004808-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.99%], valid : [loss = 0.700, top1 = 83.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.061, top1 = 98.12%], test  : [loss = 0.416, top1 = 88.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.632, top1 = 81.62%], valid : [loss = 1.517, top1 = 61.57%], test : [loss = 1.507, top1 = 61.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.22%], valid : [loss = 2.858, top1 = 29.37%], test : [loss = 2.887, top1 = 29.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 69.06%], valid : [loss = 0.932, top1 = 67.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4809/15625) 004809-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.62%], valid : [loss = 0.585, top1 = 86.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.030, top1 = 99.18%], test  : [loss = 0.409, top1 = 89.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 0.498, top1 = 85.53%], valid : [loss = 1.421, top1 = 63.98%], test : [loss = 1.433, top1 = 64.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.28%], valid : [loss = 2.569, top1 = 36.52%], test : [loss = 2.600, top1 = 35.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.29%], valid : [loss = 0.845, top1 = 70.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4810/15625) 004810-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.78%], valid : [loss = 0.492, top1 = 87.35%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.080, top1 = 97.53%], test  : [loss = 0.329, top1 = 90.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.44 ms.
cifar100       train : [loss = 0.721, top1 = 79.06%], valid : [loss = 1.312, top1 = 64.83%], test : [loss = 1.312, top1 = 64.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.455, top1 = 37.60%], valid : [loss = 2.563, top1 = 36.02%], test : [loss = 2.601, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.20%], valid : [loss = 0.618, top1 = 79.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4811/15625) 004811-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.99%], valid : [loss = 0.460, top1 = 86.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.70 ms.
cifar10        train : [loss = 0.146, top1 = 95.19%], test  : [loss = 0.340, top1 = 89.17%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.27 ms.
cifar100       train : [loss = 0.964, top1 = 72.48%], valid : [loss = 1.343, top1 = 62.30%], test : [loss = 1.327, top1 = 62.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.18%], valid : [loss = 2.671, top1 = 33.80%], test : [loss = 2.704, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.16%], valid : [loss = 0.783, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4812/15625) 004812-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.48%], valid : [loss = 0.628, top1 = 85.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.27 ms.
cifar10        train : [loss = 0.051, top1 = 98.46%], test  : [loss = 0.421, top1 = 89.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 0.602, top1 = 82.48%], valid : [loss = 1.417, top1 = 63.24%], test : [loss = 1.404, top1 = 63.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 37.67%], valid : [loss = 2.614, top1 = 34.17%], test : [loss = 2.635, top1 = 34.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.81%], valid : [loss = 0.824, top1 = 71.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4813/15625) 004813-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.54%], valid : [loss = 0.548, top1 = 87.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.20 ms.
cifar10        train : [loss = 0.032, top1 = 99.02%], test  : [loss = 0.341, top1 = 91.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.08 ms.
cifar100       train : [loss = 0.405, top1 = 88.27%], valid : [loss = 1.240, top1 = 67.19%], test : [loss = 1.266, top1 = 66.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.77%], valid : [loss = 2.426, top1 = 38.88%], test : [loss = 2.450, top1 = 38.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.00%], valid : [loss = 1.001, top1 = 64.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4814/15625) 004814-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.493, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.320, top1 = 92.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.99 ms.
cifar100       train : [loss = 0.304, top1 = 91.87%], valid : [loss = 1.271, top1 = 67.77%], test : [loss = 1.262, top1 = 67.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.40%], valid : [loss = 2.357, top1 = 40.06%], test : [loss = 2.371, top1 = 40.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.62%], valid : [loss = 0.650, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4815/15625) 004815-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.21%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=14.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.03%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=14.90 ms.
cifar100       train : [loss = 0.324, top1 = 91.33%], valid : [loss = 1.292, top1 = 67.21%], test : [loss = 1.325, top1 = 66.98%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.36%], valid : [loss = 2.364, top1 = 40.19%], test : [loss = 2.403, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4816/15625) 004816-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.530, top1 = 88.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.353, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.292, top1 = 92.24%], valid : [loss = 1.298, top1 = 67.57%], test : [loss = 1.290, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.03%], valid : [loss = 2.440, top1 = 38.03%], test : [loss = 2.413, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.60%], valid : [loss = 0.791, top1 = 72.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4817/15625) 004817-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.00 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.27 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4818/15625) 004818-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.03%], valid : [loss = 0.540, top1 = 83.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.219, top1 = 92.48%], test  : [loss = 0.404, top1 = 86.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.88 ms.
cifar100       train : [loss = 1.215, top1 = 65.52%], valid : [loss = 1.566, top1 = 57.45%], test : [loss = 1.565, top1 = 57.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 2.936, top1 = 28.26%], valid : [loss = 2.982, top1 = 27.40%], test : [loss = 3.020, top1 = 27.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.36%], valid : [loss = 1.209, top1 = 56.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4819/15625) 004819-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.77%], valid : [loss = 0.536, top1 = 86.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.97 ms.
cifar10        train : [loss = 0.093, top1 = 97.10%], test  : [loss = 0.360, top1 = 89.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.688, top1 = 80.29%], valid : [loss = 1.294, top1 = 65.06%], test : [loss = 1.287, top1 = 65.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.423, top1 = 38.38%], valid : [loss = 2.533, top1 = 36.33%], test : [loss = 2.535, top1 = 36.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.00%], valid : [loss = 0.875, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4820/15625) 004820-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.433, top1 = 89.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.009, top1 = 99.89%], test  : [loss = 0.293, top1 = 92.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.210, top1 = 95.04%], valid : [loss = 1.280, top1 = 68.83%], test : [loss = 1.249, top1 = 69.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.59%], valid : [loss = 2.287, top1 = 41.97%], test : [loss = 2.300, top1 = 42.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4821/15625) 004821-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.453, top1 = 89.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 0.325, top1 = 91.23%], valid : [loss = 1.302, top1 = 67.25%], test : [loss = 1.314, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.25%], valid : [loss = 2.365, top1 = 39.64%], test : [loss = 2.384, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.68%], valid : [loss = 0.563, top1 = 80.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4822/15625) 004822-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.97%], valid : [loss = 0.513, top1 = 82.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.399, top1 = 86.45%], test  : [loss = 0.467, top1 = 84.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.13 ms.
cifar100       train : [loss = 1.525, top1 = 58.11%], valid : [loss = 1.666, top1 = 54.63%], test : [loss = 1.650, top1 = 55.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 3.039, top1 = 26.28%], valid : [loss = 3.009, top1 = 26.93%], test : [loss = 3.055, top1 = 26.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.54%], valid : [loss = 1.147, top1 = 59.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4823/15625) 004823-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10-valid  train : [loss = 1.007, top1 = 64.51%], valid : [loss = 1.056, top1 = 63.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.16 ms.
cifar10        train : [loss = 0.960, top1 = 66.40%], test  : [loss = 0.959, top1 = 66.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.29 ms.
cifar100       train : [loss = 2.438, top1 = 37.68%], valid : [loss = 2.505, top1 = 36.15%], test : [loss = 2.489, top1 = 36.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.47 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.56%], valid : [loss = 3.621, top1 = 17.15%], test : [loss = 3.643, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.620, top1 = 39.34%], valid : [loss = 1.667, top1 = 36.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4824/15625) 004824-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.550, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.379, top1 = 92.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.29 ms.
cifar100       train : [loss = 0.094, top1 = 98.35%], valid : [loss = 1.502, top1 = 67.42%], test : [loss = 1.506, top1 = 67.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.31%], valid : [loss = 2.448, top1 = 39.07%], test : [loss = 2.435, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.97%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4825/15625) 004825-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.539, top1 = 88.98%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.87 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.348, top1 = 92.05%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.32 ms.
cifar100       train : [loss = 0.188, top1 = 95.43%], valid : [loss = 1.347, top1 = 68.25%], test : [loss = 1.330, top1 = 67.60%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.40 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 50.08%], valid : [loss = 2.222, top1 = 43.10%], test : [loss = 2.222, top1 = 43.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.40%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4826/15625) 004826-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.584, top1 = 87.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.404, top1 = 90.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.61 ms.
cifar100       train : [loss = 0.406, top1 = 88.53%], valid : [loss = 1.384, top1 = 65.25%], test : [loss = 1.393, top1 = 65.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.10%], valid : [loss = 2.527, top1 = 36.92%], test : [loss = 2.529, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.782, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4827/15625) 004827-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.293, top1 = 89.78%], valid : [loss = 0.557, top1 = 82.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10        train : [loss = 0.278, top1 = 90.48%], test  : [loss = 0.434, top1 = 85.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 1.421, top1 = 59.95%], valid : [loss = 1.672, top1 = 54.51%], test : [loss = 1.668, top1 = 54.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.993, top1 = 26.94%], valid : [loss = 2.987, top1 = 27.15%], test : [loss = 3.042, top1 = 25.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.43%], valid : [loss = 1.040, top1 = 63.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4828/15625) 004828-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.64%], valid : [loss = 0.842, top1 = 71.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.688, top1 = 75.90%], test  : [loss = 0.773, top1 = 73.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.00 ms.
cifar100       train : [loss = 1.972, top1 = 47.67%], valid : [loss = 2.148, top1 = 44.40%], test : [loss = 2.158, top1 = 44.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.78%], valid : [loss = 3.670, top1 = 16.07%], test : [loss = 3.697, top1 = 15.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.386, top1 = 49.77%], valid : [loss = 1.406, top1 = 49.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4829/15625) 004829-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.065, top1 = 98.42%], valid : [loss = 0.452, top1 = 87.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10        train : [loss = 0.114, top1 = 96.48%], test  : [loss = 0.335, top1 = 89.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.61 ms.
cifar100       train : [loss = 0.874, top1 = 75.24%], valid : [loss = 1.296, top1 = 63.86%], test : [loss = 1.287, top1 = 63.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.89%], valid : [loss = 2.609, top1 = 34.62%], test : [loss = 2.632, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4830/15625) 004830-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.439, top1 = 89.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.292, top1 = 92.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.196, top1 = 95.42%], valid : [loss = 1.266, top1 = 69.17%], test : [loss = 1.245, top1 = 69.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.31%], valid : [loss = 2.281, top1 = 42.27%], test : [loss = 2.296, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4831/15625) 004831-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.36%], valid : [loss = 0.465, top1 = 85.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.161, top1 = 94.74%], test  : [loss = 0.351, top1 = 88.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.87 ms.
cifar100       train : [loss = 1.007, top1 = 71.40%], valid : [loss = 1.372, top1 = 61.35%], test : [loss = 1.362, top1 = 62.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.02%], valid : [loss = 2.693, top1 = 32.73%], test : [loss = 2.700, top1 = 32.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4832/15625) 004832-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.610, top1 = 85.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10        train : [loss = 0.072, top1 = 97.77%], test  : [loss = 0.405, top1 = 88.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.83 ms.
cifar100       train : [loss = 0.718, top1 = 79.10%], valid : [loss = 1.404, top1 = 63.25%], test : [loss = 1.372, top1 = 63.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 36.01%], valid : [loss = 2.657, top1 = 33.42%], test : [loss = 2.696, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4833/15625) 004833-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.521, top1 = 88.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.345, top1 = 91.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.87 ms.
cifar100       train : [loss = 0.344, top1 = 90.56%], valid : [loss = 1.306, top1 = 66.61%], test : [loss = 1.285, top1 = 67.53%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.47%], valid : [loss = 2.408, top1 = 38.28%], test : [loss = 2.423, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.02%], valid : [loss = 0.633, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4834/15625) 004834-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.75%], valid : [loss = 0.532, top1 = 86.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.098, top1 = 96.92%], test  : [loss = 0.358, top1 = 89.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.56 ms.
cifar100       train : [loss = 0.709, top1 = 79.53%], valid : [loss = 1.313, top1 = 64.58%], test : [loss = 1.317, top1 = 64.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.11%], valid : [loss = 2.556, top1 = 36.02%], test : [loss = 2.573, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.72%], valid : [loss = 0.872, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4835/15625) 004835-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.461, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.307, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.330, top1 = 90.96%], valid : [loss = 1.278, top1 = 67.51%], test : [loss = 1.307, top1 = 67.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.32%], valid : [loss = 2.365, top1 = 39.69%], test : [loss = 2.362, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.23%], valid : [loss = 0.557, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4836/15625) 004836-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.36%], valid : [loss = 0.559, top1 = 86.90%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10        train : [loss = 0.056, top1 = 98.21%], test  : [loss = 0.360, top1 = 90.08%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.15 ms.
cifar100       train : [loss = 0.625, top1 = 81.58%], valid : [loss = 1.281, top1 = 65.43%], test : [loss = 1.291, top1 = 65.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.353, top1 = 39.70%], valid : [loss = 2.490, top1 = 37.30%], test : [loss = 2.535, top1 = 35.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.38%], valid : [loss = 0.753, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4837/15625) 004837-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.560, top1 = 88.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.369, top1 = 92.21%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.18 ms.
cifar100       train : [loss = 0.099, top1 = 98.26%], valid : [loss = 1.451, top1 = 67.96%], test : [loss = 1.440, top1 = 67.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.51 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.82%], valid : [loss = 2.373, top1 = 40.33%], test : [loss = 2.389, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.72%], valid : [loss = 0.725, top1 = 74.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4838/15625) 004838-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.473, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.41%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.32 ms.
cifar100       train : [loss = 0.335, top1 = 90.98%], valid : [loss = 1.266, top1 = 67.37%], test : [loss = 1.270, top1 = 67.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.028, top1 = 46.90%], valid : [loss = 2.332, top1 = 40.07%], test : [loss = 2.325, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.46%], valid : [loss = 0.604, top1 = 79.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4839/15625) 004839-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.90 ms.
cifar10-valid  train : [loss = 0.228, top1 = 92.23%], valid : [loss = 0.503, top1 = 84.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.234, top1 = 91.96%], test  : [loss = 0.389, top1 = 87.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.77 ms.
cifar100       train : [loss = 1.153, top1 = 67.09%], valid : [loss = 1.447, top1 = 60.05%], test : [loss = 1.437, top1 = 60.17%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.685, top1 = 33.13%], valid : [loss = 2.713, top1 = 33.17%], test : [loss = 2.760, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 66.04%], valid : [loss = 0.976, top1 = 65.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4840/15625) 004840-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.481, top1 = 88.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.314, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.328, top1 = 91.17%], valid : [loss = 1.249, top1 = 67.80%], test : [loss = 1.256, top1 = 67.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.56%], valid : [loss = 2.309, top1 = 41.57%], test : [loss = 2.349, top1 = 40.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.93%], valid : [loss = 0.608, top1 = 79.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4841/15625) 004841-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.554, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.381, top1 = 91.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.49 ms.
cifar100       train : [loss = 0.216, top1 = 94.89%], valid : [loss = 1.415, top1 = 66.62%], test : [loss = 1.403, top1 = 66.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 45.88%], valid : [loss = 2.448, top1 = 38.57%], test : [loss = 2.460, top1 = 39.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.98%], valid : [loss = 0.726, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4842/15625) 004842-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.555, top1 = 87.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.405, top1 = 90.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.36 ms.
cifar100       train : [loss = 0.400, top1 = 88.66%], valid : [loss = 1.386, top1 = 65.45%], test : [loss = 1.387, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.83%], valid : [loss = 2.522, top1 = 36.33%], test : [loss = 2.557, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4843/15625) 004843-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.526, top1 = 89.41%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.19 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.318, top1 = 93.38%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.22 ms.
cifar100       train : [loss = 0.070, top1 = 98.92%], valid : [loss = 1.361, top1 = 69.26%], test : [loss = 1.332, top1 = 70.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.65%], valid : [loss = 2.331, top1 = 40.62%], test : [loss = 2.328, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.29%], valid : [loss = 0.734, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4844/15625) 004844-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.482, top1 = 88.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.82 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.310, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.88 ms.
cifar100       train : [loss = 0.313, top1 = 91.60%], valid : [loss = 1.232, top1 = 68.05%], test : [loss = 1.244, top1 = 68.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.85%], valid : [loss = 2.310, top1 = 40.95%], test : [loss = 2.353, top1 = 40.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.25%], valid : [loss = 0.620, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4845/15625) 004845-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.00%], valid : [loss = 0.548, top1 = 85.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.098, top1 = 96.91%], test  : [loss = 0.373, top1 = 89.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.65 ms.
cifar100       train : [loss = 0.705, top1 = 79.51%], valid : [loss = 1.365, top1 = 63.33%], test : [loss = 1.409, top1 = 62.69%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.589, top1 = 34.81%], valid : [loss = 2.673, top1 = 32.42%], test : [loss = 2.714, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.14%], valid : [loss = 0.843, top1 = 70.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4846/15625) 004846-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.439, top1 = 89.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.306, top1 = 92.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.41 ms.
cifar100       train : [loss = 0.204, top1 = 95.19%], valid : [loss = 1.246, top1 = 69.36%], test : [loss = 1.246, top1 = 69.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.41%], valid : [loss = 2.260, top1 = 43.15%], test : [loss = 2.268, top1 = 42.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.81%], valid : [loss = 0.544, top1 = 81.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4847/15625) 004847-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.483, top1 = 89.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.310, top1 = 92.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.08 ms.
cifar100       train : [loss = 0.204, top1 = 94.90%], valid : [loss = 1.270, top1 = 68.63%], test : [loss = 1.287, top1 = 68.57%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.24%], valid : [loss = 2.225, top1 = 42.97%], test : [loss = 2.251, top1 = 42.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.511, top1 = 82.26%], valid : [loss = 0.592, top1 = 79.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4848/15625) 004848-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.454, top1 = 89.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.304, top1 = 92.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.13 ms.
cifar100       train : [loss = 0.186, top1 = 95.72%], valid : [loss = 1.262, top1 = 69.53%], test : [loss = 1.258, top1 = 69.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.76%], valid : [loss = 2.253, top1 = 42.90%], test : [loss = 2.279, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 85.05%], valid : [loss = 0.546, top1 = 81.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4849/15625) 004849-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.44%], valid : [loss = 0.696, top1 = 81.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.149, top1 = 94.91%], test  : [loss = 0.480, top1 = 86.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.80 ms.
cifar100       train : [loss = 0.971, top1 = 71.76%], valid : [loss = 1.680, top1 = 56.37%], test : [loss = 1.660, top1 = 56.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 25.56%], valid : [loss = 3.136, top1 = 24.87%], test : [loss = 3.158, top1 = 23.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.62%], valid : [loss = 1.007, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4850/15625) 004850-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.06%], valid : [loss = 0.625, top1 = 85.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.03 ms.
cifar10        train : [loss = 0.049, top1 = 98.43%], test  : [loss = 0.381, top1 = 90.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.646, top1 = 81.06%], valid : [loss = 1.464, top1 = 62.11%], test : [loss = 1.462, top1 = 62.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.399, top1 = 38.85%], valid : [loss = 2.574, top1 = 35.18%], test : [loss = 2.603, top1 = 35.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.31%], valid : [loss = 0.912, top1 = 67.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4851/15625) 004851-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.00%], valid : [loss = 0.859, top1 = 71.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10        train : [loss = 0.563, top1 = 80.33%], test  : [loss = 0.722, top1 = 75.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.93 ms.
cifar100       train : [loss = 1.787, top1 = 51.81%], valid : [loss = 2.055, top1 = 46.54%], test : [loss = 2.070, top1 = 46.56%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.59 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.74%], valid : [loss = 3.633, top1 = 16.78%], test : [loss = 3.670, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4852/15625) 004852-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.555, top1 = 87.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.381, top1 = 91.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.377, top1 = 89.43%], valid : [loss = 1.402, top1 = 65.85%], test : [loss = 1.414, top1 = 65.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.80%], valid : [loss = 2.490, top1 = 36.86%], test : [loss = 2.505, top1 = 37.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.94%], valid : [loss = 0.734, top1 = 74.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4853/15625) 004853-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.521, top1 = 89.21%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.318, top1 = 92.84%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.93 ms.
cifar100       train : [loss = 0.139, top1 = 97.21%], valid : [loss = 1.311, top1 = 68.78%], test : [loss = 1.310, top1 = 69.01%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.01%], valid : [loss = 2.265, top1 = 42.68%], test : [loss = 2.277, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.89%], valid : [loss = 0.702, top1 = 76.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4854/15625) 004854-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.57 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.25%], valid : [loss = 0.564, top1 = 82.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10        train : [loss = 0.266, top1 = 90.91%], test  : [loss = 0.406, top1 = 86.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 1.400, top1 = 60.67%], valid : [loss = 1.665, top1 = 55.12%], test : [loss = 1.635, top1 = 55.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 2.998, top1 = 26.88%], valid : [loss = 3.010, top1 = 26.88%], test : [loss = 3.080, top1 = 25.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.049, top1 = 62.64%], valid : [loss = 1.065, top1 = 61.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4855/15625) 004855-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.549, top1 = 88.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.343, top1 = 91.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.90 ms.
cifar100       train : [loss = 0.294, top1 = 91.79%], valid : [loss = 1.311, top1 = 67.11%], test : [loss = 1.327, top1 = 67.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.80%], valid : [loss = 2.422, top1 = 37.90%], test : [loss = 2.430, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4856/15625) 004856-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.475, top1 = 89.21%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.39 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.323, top1 = 91.82%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.29 ms.
cifar100       train : [loss = 0.194, top1 = 95.57%], valid : [loss = 1.188, top1 = 69.57%], test : [loss = 1.188, top1 = 70.00%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.36%], valid : [loss = 2.165, top1 = 43.68%], test : [loss = 2.200, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.30%], valid : [loss = 0.674, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4857/15625) 004857-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.573, top1 = 88.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.382, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.129, top1 = 97.53%], valid : [loss = 1.435, top1 = 67.86%], test : [loss = 1.437, top1 = 67.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.62%], valid : [loss = 2.418, top1 = 39.98%], test : [loss = 2.421, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.02%], valid : [loss = 0.738, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4858/15625) 004858-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.562, top1 = 88.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.378, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.96 ms.
cifar100       train : [loss = 0.227, top1 = 94.33%], valid : [loss = 1.427, top1 = 66.17%], test : [loss = 1.430, top1 = 66.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.094, top1 = 45.45%], valid : [loss = 2.405, top1 = 39.40%], test : [loss = 2.435, top1 = 39.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.42%], valid : [loss = 0.738, top1 = 74.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4859/15625) 004859-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.544, top1 = 88.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.365, top1 = 91.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.60 ms.
cifar100       train : [loss = 0.323, top1 = 91.22%], valid : [loss = 1.312, top1 = 66.96%], test : [loss = 1.309, top1 = 67.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.149, top1 = 44.20%], valid : [loss = 2.422, top1 = 38.13%], test : [loss = 2.427, top1 = 38.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4860/15625) 004860-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.528, top1 = 87.74%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.033, top1 = 99.14%], test  : [loss = 0.374, top1 = 90.57%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.59 ms.
cifar100       train : [loss = 0.439, top1 = 87.25%], valid : [loss = 1.368, top1 = 65.49%], test : [loss = 1.354, top1 = 66.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.36%], valid : [loss = 2.458, top1 = 38.27%], test : [loss = 2.504, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.66%], valid : [loss = 0.655, top1 = 77.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4861/15625) 004861-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.479, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.299, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.25 ms.
cifar100       train : [loss = 0.317, top1 = 91.41%], valid : [loss = 1.258, top1 = 67.66%], test : [loss = 1.257, top1 = 67.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.57%], valid : [loss = 2.296, top1 = 41.12%], test : [loss = 2.337, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4862/15625) 004862-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.21 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4863/15625) 004863-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.331, top1 = 92.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.17 ms.
cifar100       train : [loss = 0.333, top1 = 90.94%], valid : [loss = 1.277, top1 = 67.17%], test : [loss = 1.296, top1 = 67.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.14 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.02%], valid : [loss = 2.420, top1 = 38.85%], test : [loss = 2.403, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4864/15625) 004864-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.647, top1 = 86.33%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10        train : [loss = 0.025, top1 = 99.35%], test  : [loss = 0.446, top1 = 89.53%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.29 ms.
cifar100       train : [loss = 0.328, top1 = 91.40%], valid : [loss = 1.468, top1 = 64.31%], test : [loss = 1.458, top1 = 64.13%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.21%], valid : [loss = 2.562, top1 = 35.97%], test : [loss = 2.587, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.46%], valid : [loss = 0.775, top1 = 73.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4865/15625) 004865-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.32%], valid : [loss = 0.511, top1 = 83.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10        train : [loss = 0.232, top1 = 92.12%], test  : [loss = 0.388, top1 = 87.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.95 ms.
cifar100       train : [loss = 1.211, top1 = 65.56%], valid : [loss = 1.504, top1 = 58.67%], test : [loss = 1.489, top1 = 58.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.771, top1 = 31.33%], valid : [loss = 2.783, top1 = 31.42%], test : [loss = 2.836, top1 = 29.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 65.66%], valid : [loss = 0.999, top1 = 64.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4866/15625) 004866-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.563, top1 = 88.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.37 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.367, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.92 ms.
cifar100       train : [loss = 0.158, top1 = 96.66%], valid : [loss = 1.413, top1 = 67.14%], test : [loss = 1.387, top1 = 67.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.32%], valid : [loss = 2.429, top1 = 39.80%], test : [loss = 2.434, top1 = 40.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.06%], valid : [loss = 0.681, top1 = 76.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4867/15625) 004867-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.602, top1 = 87.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.387, top1 = 91.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.12 ms.
cifar100       train : [loss = 0.209, top1 = 95.08%], valid : [loss = 1.409, top1 = 66.41%], test : [loss = 1.409, top1 = 67.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 46.03%], valid : [loss = 2.519, top1 = 37.25%], test : [loss = 2.527, top1 = 37.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.87%], valid : [loss = 0.744, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4868/15625) 004868-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.606, top1 = 85.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10        train : [loss = 0.071, top1 = 97.88%], test  : [loss = 0.411, top1 = 88.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.85 ms.
cifar100       train : [loss = 0.715, top1 = 79.31%], valid : [loss = 1.394, top1 = 63.38%], test : [loss = 1.365, top1 = 63.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.20%], valid : [loss = 2.655, top1 = 33.00%], test : [loss = 2.687, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4869/15625) 004869-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.567, top1 = 87.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.72 ms.
cifar10        train : [loss = 0.025, top1 = 99.29%], test  : [loss = 0.373, top1 = 91.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.424, top1 = 87.86%], valid : [loss = 1.288, top1 = 65.92%], test : [loss = 1.268, top1 = 67.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.38%], valid : [loss = 2.423, top1 = 38.50%], test : [loss = 2.472, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.86%], valid : [loss = 0.850, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4870/15625) 004870-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.35%], valid : [loss = 0.562, top1 = 85.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.05 ms.
cifar10        train : [loss = 0.079, top1 = 97.60%], test  : [loss = 0.372, top1 = 89.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.53 ms.
cifar100       train : [loss = 0.649, top1 = 81.33%], valid : [loss = 1.355, top1 = 64.16%], test : [loss = 1.392, top1 = 63.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.429, top1 = 37.98%], valid : [loss = 2.524, top1 = 37.27%], test : [loss = 2.551, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.84%], valid : [loss = 0.912, top1 = 68.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4871/15625) 004871-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.616, top1 = 86.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.031, top1 = 99.16%], test  : [loss = 0.409, top1 = 90.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.61 ms.
cifar100       train : [loss = 0.505, top1 = 85.29%], valid : [loss = 1.445, top1 = 63.25%], test : [loss = 1.443, top1 = 63.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.15%], valid : [loss = 2.567, top1 = 35.10%], test : [loss = 2.586, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4872/15625) 004872-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.82%], valid : [loss = 0.601, top1 = 86.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.60 ms.
cifar10        train : [loss = 0.027, top1 = 99.16%], test  : [loss = 0.390, top1 = 90.85%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.77 ms.
cifar100       train : [loss = 0.364, top1 = 89.48%], valid : [loss = 1.510, top1 = 63.68%], test : [loss = 1.476, top1 = 64.30%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 3.410, top1 = 17.71%], valid : [loss = 3.379, top1 = 18.53%], test : [loss = 3.397, top1 = 17.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.32%], valid : [loss = 1.251, top1 = 54.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4873/15625) 004873-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.74 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.00%], valid : [loss = 0.511, top1 = 87.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.076, top1 = 97.60%], test  : [loss = 0.369, top1 = 89.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.35 ms.
cifar100       train : [loss = 0.714, top1 = 79.06%], valid : [loss = 1.348, top1 = 64.46%], test : [loss = 1.345, top1 = 63.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.04%], valid : [loss = 2.631, top1 = 34.27%], test : [loss = 2.686, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4874/15625) 004874-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.477, top1 = 89.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.302, top1 = 92.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.66 ms.
cifar100       train : [loss = 0.321, top1 = 91.38%], valid : [loss = 1.240, top1 = 67.62%], test : [loss = 1.264, top1 = 67.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.63%], valid : [loss = 2.318, top1 = 40.80%], test : [loss = 2.361, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4875/15625) 004875-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.37%], valid : [loss = 0.458, top1 = 86.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.159, top1 = 94.81%], test  : [loss = 0.352, top1 = 88.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 0.999, top1 = 71.60%], valid : [loss = 1.363, top1 = 62.22%], test : [loss = 1.354, top1 = 62.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.77%], valid : [loss = 2.690, top1 = 32.39%], test : [loss = 2.710, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4876/15625) 004876-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.506, top1 = 88.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.338, top1 = 92.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 0.325, top1 = 91.12%], valid : [loss = 1.276, top1 = 66.84%], test : [loss = 1.304, top1 = 67.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.01%], valid : [loss = 2.394, top1 = 39.50%], test : [loss = 2.399, top1 = 39.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.24%], valid : [loss = 0.707, top1 = 75.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4877/15625) 004877-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.26%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.307, top1 = 92.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 0.329, top1 = 91.02%], valid : [loss = 1.319, top1 = 67.16%], test : [loss = 1.318, top1 = 67.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.24%], valid : [loss = 2.360, top1 = 39.90%], test : [loss = 2.404, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4878/15625) 004878-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.624, top1 = 86.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.033, top1 = 99.08%], test  : [loss = 0.379, top1 = 90.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.557, top1 = 83.65%], valid : [loss = 1.431, top1 = 63.45%], test : [loss = 1.435, top1 = 63.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.86%], valid : [loss = 2.584, top1 = 35.50%], test : [loss = 2.607, top1 = 34.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.18%], valid : [loss = 0.870, top1 = 69.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4879/15625) 004879-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.55%], valid : [loss = 0.666, top1 = 83.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.07 ms.
cifar10        train : [loss = 0.092, top1 = 96.95%], test  : [loss = 0.413, top1 = 88.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.06 ms.
cifar100       train : [loss = 0.796, top1 = 76.74%], valid : [loss = 1.486, top1 = 60.88%], test : [loss = 1.480, top1 = 60.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.596, top1 = 34.62%], valid : [loss = 2.710, top1 = 33.30%], test : [loss = 2.730, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.26%], valid : [loss = 0.885, top1 = 68.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4880/15625) 004880-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.497, top1 = 88.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.314, top1 = 92.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.03 ms.
cifar100       train : [loss = 0.319, top1 = 91.39%], valid : [loss = 1.241, top1 = 67.74%], test : [loss = 1.256, top1 = 66.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.85%], valid : [loss = 2.304, top1 = 41.40%], test : [loss = 2.336, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.54%], valid : [loss = 0.689, top1 = 76.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4881/15625) 004881-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.661, top1 = 86.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.453, top1 = 90.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.219, top1 = 94.78%], valid : [loss = 1.614, top1 = 63.94%], test : [loss = 1.578, top1 = 63.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 2.271, top1 = 41.72%], valid : [loss = 2.658, top1 = 34.53%], test : [loss = 2.704, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.56%], valid : [loss = 0.809, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4882/15625) 004882-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.582, top1 = 87.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.372, top1 = 91.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.411, top1 = 88.18%], valid : [loss = 1.370, top1 = 65.58%], test : [loss = 1.396, top1 = 66.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.87%], valid : [loss = 2.519, top1 = 36.07%], test : [loss = 2.528, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.71%], valid : [loss = 0.833, top1 = 70.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4883/15625) 004883-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.489, top1 = 88.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.320, top1 = 91.36%], valid : [loss = 1.249, top1 = 67.91%], test : [loss = 1.266, top1 = 67.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.89%], valid : [loss = 2.306, top1 = 40.94%], test : [loss = 2.350, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 80.86%], valid : [loss = 0.627, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4884/15625) 004884-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.03%], valid : [loss = 0.655, top1 = 77.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10        train : [loss = 0.510, top1 = 82.39%], test  : [loss = 0.592, top1 = 79.86%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.98 ms.
cifar100       train : [loss = 1.683, top1 = 54.23%], valid : [loss = 1.848, top1 = 50.82%], test : [loss = 1.854, top1 = 51.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.79 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.35%], valid : [loss = 3.319, top1 = 21.93%], test : [loss = 3.363, top1 = 21.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4885/15625) 004885-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.578, top1 = 86.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.040, top1 = 98.88%], test  : [loss = 0.392, top1 = 90.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.02 ms.
cifar100       train : [loss = 0.554, top1 = 83.64%], valid : [loss = 1.416, top1 = 64.36%], test : [loss = 1.404, top1 = 63.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 37.13%], valid : [loss = 2.603, top1 = 34.80%], test : [loss = 2.658, top1 = 34.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.11%], valid : [loss = 0.656, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4886/15625) 004886-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.525, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.350, top1 = 92.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.86 ms.
cifar100       train : [loss = 0.108, top1 = 98.10%], valid : [loss = 1.406, top1 = 68.80%], test : [loss = 1.390, top1 = 68.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.26%], valid : [loss = 2.382, top1 = 40.17%], test : [loss = 2.397, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.18%], valid : [loss = 0.718, top1 = 75.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4887/15625) 004887-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.555, top1 = 88.84%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.36 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.353, top1 = 92.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=15.72 ms.
cifar100       train : [loss = 0.185, top1 = 95.41%], valid : [loss = 1.253, top1 = 69.48%], test : [loss = 1.319, top1 = 67.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.42 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.24%], valid : [loss = 2.226, top1 = 42.97%], test : [loss = 2.232, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.62%], valid : [loss = 0.726, top1 = 74.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4888/15625) 004888-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.01%], valid : [loss = 0.562, top1 = 86.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.97 ms.
cifar10        train : [loss = 0.069, top1 = 97.77%], test  : [loss = 0.373, top1 = 90.11%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.94 ms.
cifar100       train : [loss = 0.639, top1 = 81.11%], valid : [loss = 1.310, top1 = 65.26%], test : [loss = 1.318, top1 = 65.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 39.97%], valid : [loss = 2.478, top1 = 36.27%], test : [loss = 2.504, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.08%], valid : [loss = 0.761, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4889/15625) 004889-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.541, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.333, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.10 ms.
cifar100       train : [loss = 0.159, top1 = 96.53%], valid : [loss = 1.306, top1 = 68.36%], test : [loss = 1.321, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.86%], valid : [loss = 2.313, top1 = 40.70%], test : [loss = 2.314, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.62%], valid : [loss = 0.706, top1 = 75.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4890/15625) 004890-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.29 ms.
cifar10-valid  train : [loss = 0.290, top1 = 89.93%], valid : [loss = 0.494, top1 = 84.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.284, top1 = 90.31%], test  : [loss = 0.398, top1 = 86.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.21 ms.
cifar100       train : [loss = 1.338, top1 = 62.38%], valid : [loss = 1.529, top1 = 57.26%], test : [loss = 1.527, top1 = 57.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.19 ms.
ImageNet16-120 train : [loss = 2.867, top1 = 29.63%], valid : [loss = 2.862, top1 = 30.10%], test : [loss = 2.904, top1 = 29.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.949, top1 = 66.03%], valid : [loss = 0.957, top1 = 65.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4891/15625) 004891-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.56 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4892/15625) 004892-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.427, top1 = 90.86%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.62 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.299, top1 = 93.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.63 ms.
cifar100       train : [loss = 0.050, top1 = 99.40%], valid : [loss = 1.335, top1 = 70.77%], test : [loss = 1.341, top1 = 70.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 1.478, top1 = 59.87%], valid : [loss = 2.245, top1 = 44.22%], test : [loss = 2.247, top1 = 44.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.85%], valid : [loss = 0.528, top1 = 82.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4893/15625) 004893-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.71%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.332, top1 = 92.85%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.91 ms.
cifar100       train : [loss = 0.067, top1 = 99.02%], valid : [loss = 1.354, top1 = 69.76%], test : [loss = 1.335, top1 = 70.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.76 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.52%], valid : [loss = 2.386, top1 = 39.97%], test : [loss = 2.408, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4894/15625) 004894-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.73 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4895/15625) 004895-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.82%], valid : [loss = 0.452, top1 = 86.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.95 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.350, top1 = 88.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 1.029, top1 = 70.75%], valid : [loss = 1.382, top1 = 61.46%], test : [loss = 1.385, top1 = 61.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.65 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.88%], valid : [loss = 2.678, top1 = 32.57%], test : [loss = 2.707, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4896/15625) 004896-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.575, top1 = 88.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.353, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.32 ms.
cifar100       train : [loss = 0.303, top1 = 91.49%], valid : [loss = 1.319, top1 = 67.96%], test : [loss = 1.358, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.65%], valid : [loss = 2.407, top1 = 38.77%], test : [loss = 2.432, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.73%], valid : [loss = 0.895, top1 = 68.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4897/15625) 004897-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.20%], valid : [loss = 0.849, top1 = 72.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10        train : [loss = 0.558, top1 = 80.36%], test  : [loss = 0.706, top1 = 75.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.08 ms.
cifar100       train : [loss = 1.783, top1 = 52.11%], valid : [loss = 2.038, top1 = 47.44%], test : [loss = 2.071, top1 = 46.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.85%], valid : [loss = 3.636, top1 = 16.40%], test : [loss = 3.663, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.09%], valid : [loss = 1.257, top1 = 55.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4898/15625) 004898-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.46%], valid : [loss = 0.612, top1 = 85.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.65 ms.
cifar10        train : [loss = 0.068, top1 = 97.92%], test  : [loss = 0.399, top1 = 88.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.91 ms.
cifar100       train : [loss = 0.722, top1 = 79.10%], valid : [loss = 1.394, top1 = 63.36%], test : [loss = 1.354, top1 = 63.26%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.72%], valid : [loss = 2.692, top1 = 33.73%], test : [loss = 2.713, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.55%], valid : [loss = 0.786, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4899/15625) 004899-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.543, top1 = 88.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.337, top1 = 92.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.18 ms.
cifar100       train : [loss = 0.140, top1 = 97.27%], valid : [loss = 1.347, top1 = 68.34%], test : [loss = 1.376, top1 = 68.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.25%], valid : [loss = 2.453, top1 = 39.87%], test : [loss = 2.440, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 78.98%], valid : [loss = 0.690, top1 = 76.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4900/15625) 004900-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.513, top1 = 88.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.343, top1 = 91.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.02 ms.
cifar100       train : [loss = 0.321, top1 = 90.99%], valid : [loss = 1.312, top1 = 66.92%], test : [loss = 1.328, top1 = 66.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.206, top1 = 42.92%], valid : [loss = 2.439, top1 = 38.43%], test : [loss = 2.459, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.06%], valid : [loss = 0.853, top1 = 69.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4901/15625) 004901-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.520, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.324, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.276, top1 = 92.49%], valid : [loss = 1.276, top1 = 67.89%], test : [loss = 1.266, top1 = 67.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 1.992, top1 = 47.69%], valid : [loss = 2.301, top1 = 40.76%], test : [loss = 2.304, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.55%], valid : [loss = 0.725, top1 = 74.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4902/15625) 004902-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.429, top1 = 91.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.61 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.292, top1 = 93.80%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.21 ms.
cifar100       train : [loss = 0.055, top1 = 99.19%], valid : [loss = 1.363, top1 = 70.24%], test : [loss = 1.300, top1 = 70.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.452, top1 = 60.50%], valid : [loss = 2.179, top1 = 44.53%], test : [loss = 2.219, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.365, top1 = 87.47%], valid : [loss = 0.505, top1 = 83.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4903/15625) 004903-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.100, top1 = 97.26%], valid : [loss = 0.477, top1 = 85.73%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.02 ms.
cifar10        train : [loss = 0.138, top1 = 95.50%], test  : [loss = 0.341, top1 = 89.19%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.92 ms.
cifar100       train : [loss = 0.783, top1 = 77.98%], valid : [loss = 1.274, top1 = 63.64%], test : [loss = 1.273, top1 = 63.98%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.08%], valid : [loss = 2.612, top1 = 34.17%], test : [loss = 2.617, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.64%], valid : [loss = 0.854, top1 = 69.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4904/15625) 004904-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.601, top1 = 85.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.392, top1 = 88.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.70 ms.
cifar100       train : [loss = 0.712, top1 = 79.38%], valid : [loss = 1.371, top1 = 63.35%], test : [loss = 1.359, top1 = 63.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.00 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.06%], valid : [loss = 2.640, top1 = 33.77%], test : [loss = 2.678, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4905/15625) 004905-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.43%], valid : [loss = 0.881, top1 = 76.86%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10        train : [loss = 0.207, top1 = 92.95%], test  : [loss = 0.603, top1 = 82.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.63 ms.
cifar100       train : [loss = 1.117, top1 = 68.04%], valid : [loss = 1.734, top1 = 54.56%], test : [loss = 1.742, top1 = 54.16%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.63 ms.
ImageNet16-120 train : [loss = 3.236, top1 = 22.51%], valid : [loss = 3.327, top1 = 21.67%], test : [loss = 3.382, top1 = 21.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 63.08%], valid : [loss = 1.081, top1 = 61.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4906/15625) 004906-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.597, top1 = 85.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10        train : [loss = 0.068, top1 = 97.92%], test  : [loss = 0.399, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.19 ms.
cifar100       train : [loss = 0.701, top1 = 79.68%], valid : [loss = 1.362, top1 = 63.81%], test : [loss = 1.350, top1 = 63.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.05%], valid : [loss = 2.663, top1 = 34.08%], test : [loss = 2.691, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.36%], valid : [loss = 0.758, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4907/15625) 004907-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.449, top1 = 91.10%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.64 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.307, top1 = 93.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.57 ms.
cifar100       train : [loss = 0.034, top1 = 99.59%], valid : [loss = 1.401, top1 = 70.12%], test : [loss = 1.360, top1 = 70.84%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.60 ms.
ImageNet16-120 train : [loss = 1.369, top1 = 62.61%], valid : [loss = 2.212, top1 = 45.10%], test : [loss = 2.297, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.96%], valid : [loss = 0.499, top1 = 83.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4908/15625) 004908-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.08%], valid : [loss = 0.941, top1 = 75.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10        train : [loss = 0.210, top1 = 92.78%], test  : [loss = 0.597, top1 = 82.27%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 1.198, top1 = 65.96%], valid : [loss = 1.807, top1 = 53.38%], test : [loss = 1.793, top1 = 53.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 3.247, top1 = 22.41%], valid : [loss = 3.357, top1 = 21.13%], test : [loss = 3.399, top1 = 19.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4909/15625) 004909-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.439, top1 = 90.22%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.46 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.296, top1 = 93.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=15.95 ms.
cifar100       train : [loss = 0.126, top1 = 97.45%], valid : [loss = 1.288, top1 = 69.98%], test : [loss = 1.248, top1 = 70.32%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.08%], valid : [loss = 2.229, top1 = 43.23%], test : [loss = 2.217, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.381, top1 = 86.90%], valid : [loss = 0.520, top1 = 82.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4910/15625) 004910-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.543, top1 = 88.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.91 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.369, top1 = 91.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.15 ms.
cifar100       train : [loss = 0.262, top1 = 93.04%], valid : [loss = 1.313, top1 = 68.04%], test : [loss = 1.340, top1 = 67.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.16 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.43%], valid : [loss = 2.453, top1 = 37.73%], test : [loss = 2.463, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.44%], valid : [loss = 0.978, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4911/15625) 004911-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.564, top1 = 89.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.40 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.375, top1 = 92.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.47 ms.
cifar100       train : [loss = 0.104, top1 = 98.16%], valid : [loss = 1.488, top1 = 67.22%], test : [loss = 1.491, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.63%], valid : [loss = 2.442, top1 = 39.27%], test : [loss = 2.436, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4912/15625) 004912-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.97%], valid : [loss = 0.449, top1 = 89.74%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.70 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.308, top1 = 92.48%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.81 ms.
cifar100       train : [loss = 0.345, top1 = 90.55%], valid : [loss = 1.294, top1 = 66.92%], test : [loss = 1.264, top1 = 67.86%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.28 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.66%], valid : [loss = 2.293, top1 = 40.90%], test : [loss = 2.325, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.60%], valid : [loss = 0.581, top1 = 80.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4913/15625) 004913-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.448, top1 = 90.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.307, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.41 ms.
cifar100       train : [loss = 0.085, top1 = 98.57%], valid : [loss = 1.388, top1 = 69.04%], test : [loss = 1.343, top1 = 70.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 1.595, top1 = 57.19%], valid : [loss = 2.278, top1 = 43.70%], test : [loss = 2.271, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 86.10%], valid : [loss = 0.533, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4914/15625) 004914-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.57 ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.22%], valid : [loss = 1.106, top1 = 63.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10        train : [loss = 0.814, top1 = 71.47%], test  : [loss = 0.944, top1 = 67.16%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.51 ms.
cifar100       train : [loss = 2.134, top1 = 44.21%], valid : [loss = 2.394, top1 = 39.22%], test : [loss = 2.407, top1 = 39.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.99%], valid : [loss = 3.819, top1 = 12.97%], test : [loss = 3.829, top1 = 13.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4915/15625) 004915-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.74%], valid : [loss = 0.511, top1 = 86.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.088, top1 = 97.27%], test  : [loss = 0.344, top1 = 90.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.00 ms.
cifar100       train : [loss = 0.733, top1 = 78.69%], valid : [loss = 1.361, top1 = 63.80%], test : [loss = 1.339, top1 = 63.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.410, top1 = 38.56%], valid : [loss = 2.519, top1 = 36.40%], test : [loss = 2.564, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.29%], valid : [loss = 0.937, top1 = 67.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4916/15625) 004916-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.463, top1 = 89.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.323, top1 = 91.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.271, top1 = 92.80%], valid : [loss = 1.322, top1 = 67.38%], test : [loss = 1.337, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 1.992, top1 = 47.74%], valid : [loss = 2.351, top1 = 40.87%], test : [loss = 2.404, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.17%], valid : [loss = 0.576, top1 = 80.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4917/15625) 004917-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.19%], valid : [loss = 0.587, top1 = 85.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10        train : [loss = 0.074, top1 = 97.80%], test  : [loss = 0.392, top1 = 89.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.74 ms.
cifar100       train : [loss = 0.737, top1 = 78.68%], valid : [loss = 1.406, top1 = 63.54%], test : [loss = 1.376, top1 = 63.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.71%], valid : [loss = 2.666, top1 = 34.27%], test : [loss = 2.718, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.16%], valid : [loss = 0.786, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4918/15625) 004918-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.503, top1 = 89.39%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.32 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.311, top1 = 92.51%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.08 ms.
cifar100       train : [loss = 0.218, top1 = 94.56%], valid : [loss = 1.209, top1 = 69.24%], test : [loss = 1.241, top1 = 68.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.33 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.59%], valid : [loss = 2.214, top1 = 42.27%], test : [loss = 2.219, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.24%], valid : [loss = 0.678, top1 = 76.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4919/15625) 004919-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.68%], valid : [loss = 0.523, top1 = 82.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.398, top1 = 86.41%], test  : [loss = 0.462, top1 = 84.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.57 ms.
cifar100       train : [loss = 1.520, top1 = 58.15%], valid : [loss = 1.658, top1 = 54.49%], test : [loss = 1.638, top1 = 55.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 26.16%], valid : [loss = 3.041, top1 = 26.95%], test : [loss = 3.064, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.78%], valid : [loss = 1.138, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4920/15625) 004920-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.17%], valid : [loss = 0.450, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.113, top1 = 96.44%], test  : [loss = 0.320, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 0.866, top1 = 75.33%], valid : [loss = 1.306, top1 = 64.17%], test : [loss = 1.285, top1 = 64.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.62%], valid : [loss = 2.625, top1 = 34.67%], test : [loss = 2.658, top1 = 33.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4921/15625) 004921-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.365, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.52 ms.
cifar100       train : [loss = 0.081, top1 = 98.75%], valid : [loss = 1.409, top1 = 69.56%], test : [loss = 1.403, top1 = 69.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 1.746, top1 = 53.61%], valid : [loss = 2.361, top1 = 41.90%], test : [loss = 2.373, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.53%], valid : [loss = 0.688, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4922/15625) 004922-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.798, top1 = 72.06%], valid : [loss = 1.115, top1 = 63.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10        train : [loss = 0.775, top1 = 72.76%], test  : [loss = 0.905, top1 = 68.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.04 ms.
cifar100       train : [loss = 2.128, top1 = 43.98%], valid : [loss = 2.387, top1 = 40.18%], test : [loss = 2.415, top1 = 39.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.32 ms.
ImageNet16-120 train : [loss = 3.761, top1 = 13.95%], valid : [loss = 3.820, top1 = 13.43%], test : [loss = 3.838, top1 = 13.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 50.71%], valid : [loss = 1.405, top1 = 48.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4923/15625) 004923-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.544, top1 = 80.84%], valid : [loss = 0.868, top1 = 71.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10        train : [loss = 0.559, top1 = 80.43%], test  : [loss = 0.706, top1 = 75.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.35 ms.
cifar100       train : [loss = 1.775, top1 = 51.99%], valid : [loss = 2.045, top1 = 46.92%], test : [loss = 2.052, top1 = 46.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.07 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.95%], valid : [loss = 3.627, top1 = 16.77%], test : [loss = 3.661, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4924/15625) 004924-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.50%], valid : [loss = 0.562, top1 = 86.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.050, top1 = 98.55%], test  : [loss = 0.371, top1 = 89.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.72 ms.
cifar100       train : [loss = 0.614, top1 = 82.09%], valid : [loss = 1.341, top1 = 64.70%], test : [loss = 1.319, top1 = 64.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.51%], valid : [loss = 2.519, top1 = 36.83%], test : [loss = 2.544, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.44%], valid : [loss = 0.619, top1 = 78.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4925/15625) 004925-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.21 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.75%], valid : [loss = 0.452, top1 = 86.35%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.70 ms.
cifar10        train : [loss = 0.152, top1 = 95.04%], test  : [loss = 0.341, top1 = 88.86%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.46 ms.
cifar100       train : [loss = 0.960, top1 = 72.64%], valid : [loss = 1.318, top1 = 63.04%], test : [loss = 1.323, top1 = 62.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.05%], valid : [loss = 2.654, top1 = 33.13%], test : [loss = 2.676, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.38%], valid : [loss = 0.787, top1 = 72.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4926/15625) 004926-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.46 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.464, top1 = 90.50%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.302, top1 = 93.47%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.60 ms.
cifar100       train : [loss = 0.063, top1 = 99.15%], valid : [loss = 1.284, top1 = 71.14%], test : [loss = 1.259, top1 = 71.92%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.49 ms.
ImageNet16-120 train : [loss = 1.515, top1 = 59.05%], valid : [loss = 2.142, top1 = 44.97%], test : [loss = 2.153, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.16%], valid : [loss = 0.625, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4927/15625) 004927-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.539, top1 = 89.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.344, top1 = 93.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.57 ms.
cifar100       train : [loss = 0.070, top1 = 98.98%], valid : [loss = 1.442, top1 = 68.78%], test : [loss = 1.461, top1 = 68.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 1.722, top1 = 54.03%], valid : [loss = 2.401, top1 = 41.07%], test : [loss = 2.399, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.52%], valid : [loss = 0.700, top1 = 76.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4928/15625) 004928-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.616, top1 = 87.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.401, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.212, top1 = 95.03%], valid : [loss = 1.446, top1 = 66.29%], test : [loss = 1.415, top1 = 66.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.02%], valid : [loss = 2.485, top1 = 37.46%], test : [loss = 2.505, top1 = 37.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4929/15625) 004929-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.29%], valid : [loss = 0.588, top1 = 85.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.46 ms.
cifar10        train : [loss = 0.076, top1 = 97.56%], test  : [loss = 0.394, top1 = 88.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.733, top1 = 78.69%], valid : [loss = 1.409, top1 = 62.48%], test : [loss = 1.355, top1 = 63.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.35%], valid : [loss = 2.630, top1 = 34.00%], test : [loss = 2.689, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.03%], valid : [loss = 0.792, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4930/15625) 004930-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.32%], valid : [loss = 0.450, top1 = 87.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.116, top1 = 96.36%], test  : [loss = 0.324, top1 = 89.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.65 ms.
cifar100       train : [loss = 0.859, top1 = 75.51%], valid : [loss = 1.291, top1 = 63.78%], test : [loss = 1.288, top1 = 63.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.76%], valid : [loss = 2.618, top1 = 34.27%], test : [loss = 2.655, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.09%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4931/15625) 004931-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.64%], valid : [loss = 0.527, top1 = 84.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.185, top1 = 93.67%], test  : [loss = 0.375, top1 = 88.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.95 ms.
cifar100       train : [loss = 1.241, top1 = 64.68%], valid : [loss = 1.537, top1 = 57.60%], test : [loss = 1.531, top1 = 57.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.33%], valid : [loss = 2.729, top1 = 32.53%], test : [loss = 2.743, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 66.87%], valid : [loss = 0.964, top1 = 66.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4932/15625) 004932-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.26%], valid : [loss = 0.455, top1 = 87.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.55 ms.
cifar10        train : [loss = 0.071, top1 = 98.07%], test  : [loss = 0.321, top1 = 90.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.95 ms.
cifar100       train : [loss = 0.635, top1 = 82.35%], valid : [loss = 1.227, top1 = 66.20%], test : [loss = 1.217, top1 = 66.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.49%], valid : [loss = 2.505, top1 = 37.07%], test : [loss = 2.525, top1 = 36.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.52%], valid : [loss = 0.641, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4933/15625) 004933-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.542, top1 = 88.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.024, top1 = 99.39%], test  : [loss = 0.378, top1 = 91.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 0.417, top1 = 88.05%], valid : [loss = 1.342, top1 = 65.80%], test : [loss = 1.353, top1 = 65.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.86 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.24%], valid : [loss = 2.493, top1 = 36.30%], test : [loss = 2.552, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.28%], valid : [loss = 0.692, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4934/15625) 004934-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.32%], valid : [loss = 0.841, top1 = 71.46%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10        train : [loss = 0.669, top1 = 76.63%], test  : [loss = 0.759, top1 = 73.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.75 ms.
cifar100       train : [loss = 1.945, top1 = 48.35%], valid : [loss = 2.122, top1 = 45.78%], test : [loss = 2.131, top1 = 45.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.63 ms.
ImageNet16-120 train : [loss = 3.654, top1 = 15.73%], valid : [loss = 3.677, top1 = 14.90%], test : [loss = 3.701, top1 = 14.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4935/15625) 004935-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.56%], valid : [loss = 0.518, top1 = 85.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10        train : [loss = 0.187, top1 = 93.75%], test  : [loss = 0.388, top1 = 87.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.27 ms.
cifar100       train : [loss = 1.013, top1 = 70.97%], valid : [loss = 1.417, top1 = 60.97%], test : [loss = 1.400, top1 = 61.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.27%], valid : [loss = 2.729, top1 = 32.29%], test : [loss = 2.782, top1 = 31.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.32%], valid : [loss = 0.949, top1 = 66.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4936/15625) 004936-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.96%], valid : [loss = 0.544, top1 = 87.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.061, top1 = 98.09%], test  : [loss = 0.376, top1 = 90.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 0.669, top1 = 80.20%], valid : [loss = 1.301, top1 = 65.80%], test : [loss = 1.344, top1 = 64.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.04%], valid : [loss = 2.450, top1 = 38.50%], test : [loss = 2.508, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4937/15625) 004937-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.502, top1 = 88.94%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.333, top1 = 92.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.33 ms.
cifar100       train : [loss = 0.373, top1 = 89.77%], valid : [loss = 1.280, top1 = 66.78%], test : [loss = 1.298, top1 = 66.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.18 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.45%], valid : [loss = 2.420, top1 = 38.53%], test : [loss = 2.427, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.14%], valid : [loss = 0.626, top1 = 78.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4938/15625) 004938-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.30%], valid : [loss = 0.866, top1 = 71.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.51 ms.
cifar10        train : [loss = 0.567, top1 = 80.21%], test  : [loss = 0.719, top1 = 75.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.46 ms.
cifar100       train : [loss = 1.787, top1 = 51.73%], valid : [loss = 2.058, top1 = 47.56%], test : [loss = 2.073, top1 = 46.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.90%], valid : [loss = 3.621, top1 = 17.13%], test : [loss = 3.652, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4939/15625) 004939-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.211, top1 = 93.07%], valid : [loss = 0.483, top1 = 84.58%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.37 ms.
cifar10        train : [loss = 0.229, top1 = 92.23%], test  : [loss = 0.401, top1 = 87.14%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.87 ms.
cifar100       train : [loss = 1.288, top1 = 63.83%], valid : [loss = 1.568, top1 = 56.90%], test : [loss = 1.567, top1 = 56.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.955, top1 = 27.24%], valid : [loss = 2.974, top1 = 27.70%], test : [loss = 2.960, top1 = 26.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.44%], valid : [loss = 1.046, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4940/15625) 004940-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.97%], valid : [loss = 0.513, top1 = 86.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.077, top1 = 97.65%], test  : [loss = 0.354, top1 = 89.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 0.704, top1 = 79.40%], valid : [loss = 1.313, top1 = 65.06%], test : [loss = 1.309, top1 = 65.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.19%], valid : [loss = 2.513, top1 = 36.37%], test : [loss = 2.538, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.89%], valid : [loss = 0.927, top1 = 67.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4941/15625) 004941-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.541, top1 = 88.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.372, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.09 ms.
cifar100       train : [loss = 0.093, top1 = 98.30%], valid : [loss = 1.492, top1 = 67.59%], test : [loss = 1.482, top1 = 67.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.35%], valid : [loss = 2.366, top1 = 41.07%], test : [loss = 2.389, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.69%], valid : [loss = 0.669, top1 = 76.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4942/15625) 004942-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.492, top1 = 90.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.323, top1 = 93.17%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.28 ms.
cifar100       train : [loss = 0.075, top1 = 98.78%], valid : [loss = 1.280, top1 = 70.98%], test : [loss = 1.318, top1 = 70.64%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 1.617, top1 = 56.36%], valid : [loss = 2.161, top1 = 44.37%], test : [loss = 2.178, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.60%], valid : [loss = 0.811, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4943/15625) 004943-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.25%], valid : [loss = 0.452, top1 = 86.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.154, top1 = 94.90%], test  : [loss = 0.345, top1 = 88.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.87 ms.
cifar100       train : [loss = 1.028, top1 = 70.95%], valid : [loss = 1.382, top1 = 61.30%], test : [loss = 1.338, top1 = 62.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.92%], valid : [loss = 2.692, top1 = 32.67%], test : [loss = 2.699, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.22%], valid : [loss = 0.782, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4944/15625) 004944-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.76%], valid : [loss = 0.616, top1 = 80.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10        train : [loss = 0.289, top1 = 90.00%], test  : [loss = 0.436, top1 = 85.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.43 ms.
cifar100       train : [loss = 1.536, top1 = 56.96%], valid : [loss = 1.780, top1 = 51.96%], test : [loss = 1.753, top1 = 52.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.953, top1 = 27.54%], valid : [loss = 2.990, top1 = 27.23%], test : [loss = 3.022, top1 = 26.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.89%], valid : [loss = 1.020, top1 = 63.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4945/15625) 004945-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.412, top1 = 90.57%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.273, top1 = 93.42%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.20 ms.
cifar100       train : [loss = 0.132, top1 = 97.35%], valid : [loss = 1.255, top1 = 70.56%], test : [loss = 1.269, top1 = 69.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.685, top1 = 54.83%], valid : [loss = 2.199, top1 = 44.60%], test : [loss = 2.225, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.28%], valid : [loss = 0.512, top1 = 82.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4946/15625) 004946-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 91.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.19 ms.
cifar100       train : [loss = 0.065, top1 = 99.05%], valid : [loss = 1.387, top1 = 69.64%], test : [loss = 1.373, top1 = 70.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 1.543, top1 = 58.40%], valid : [loss = 2.214, top1 = 44.80%], test : [loss = 2.244, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4947/15625) 004947-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.532, top1 = 88.10%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.76 ms.
cifar10        train : [loss = 0.018, top1 = 99.59%], test  : [loss = 0.318, top1 = 91.95%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.96 ms.
cifar100       train : [loss = 0.323, top1 = 91.49%], valid : [loss = 1.225, top1 = 67.68%], test : [loss = 1.231, top1 = 67.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.30%], valid : [loss = 2.280, top1 = 40.47%], test : [loss = 2.295, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.86%], valid : [loss = 0.811, top1 = 71.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4948/15625) 004948-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.98%], valid : [loss = 0.426, top1 = 89.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.288, top1 = 92.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.208, top1 = 95.18%], valid : [loss = 1.275, top1 = 68.40%], test : [loss = 1.251, top1 = 68.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.57%], valid : [loss = 2.258, top1 = 43.10%], test : [loss = 2.291, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4949/15625) 004949-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10-valid  train : [loss = 1.088, top1 = 61.62%], valid : [loss = 1.140, top1 = 60.03%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10        train : [loss = 1.062, top1 = 62.43%], test  : [loss = 1.057, top1 = 62.63%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.91 ms.
cifar100       train : [loss = 2.570, top1 = 35.05%], valid : [loss = 2.642, top1 = 34.24%], test : [loss = 2.635, top1 = 33.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.06 ms.
ImageNet16-120 train : [loss = 3.787, top1 = 13.61%], valid : [loss = 3.771, top1 = 14.33%], test : [loss = 3.784, top1 = 14.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4950/15625) 004950-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.33%], valid : [loss = 0.802, top1 = 79.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10        train : [loss = 0.152, top1 = 94.82%], test  : [loss = 0.463, top1 = 86.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.984, top1 = 71.50%], valid : [loss = 1.643, top1 = 56.98%], test : [loss = 1.644, top1 = 56.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 3.054, top1 = 25.37%], valid : [loss = 3.148, top1 = 24.07%], test : [loss = 3.160, top1 = 23.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.62%], valid : [loss = 1.007, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4951/15625) 004951-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.544, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.338, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.61 ms.
cifar100       train : [loss = 0.091, top1 = 98.50%], valid : [loss = 1.488, top1 = 67.16%], test : [loss = 1.409, top1 = 68.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.66 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.19%], valid : [loss = 2.410, top1 = 41.07%], test : [loss = 2.439, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.06%], valid : [loss = 0.713, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4952/15625) 004952-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.562, top1 = 88.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.369, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.68 ms.
cifar100       train : [loss = 0.116, top1 = 97.87%], valid : [loss = 1.492, top1 = 67.62%], test : [loss = 1.506, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.30 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.92%], valid : [loss = 2.483, top1 = 38.90%], test : [loss = 2.476, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.60%], valid : [loss = 0.756, top1 = 74.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4953/15625) 004953-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.522, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.020, top1 = 99.52%], test  : [loss = 0.350, top1 = 91.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.02 ms.
cifar100       train : [loss = 0.406, top1 = 88.25%], valid : [loss = 1.350, top1 = 65.94%], test : [loss = 1.352, top1 = 65.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.65%], valid : [loss = 2.511, top1 = 37.20%], test : [loss = 2.530, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.36%], valid : [loss = 0.734, top1 = 74.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4954/15625) 004954-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.434, top1 = 91.19%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.71 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.276, top1 = 94.07%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.07 ms.
cifar100       train : [loss = 0.019, top1 = 99.90%], valid : [loss = 1.262, top1 = 72.54%], test : [loss = 1.228, top1 = 73.00%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.45 ms.
ImageNet16-120 train : [loss = 1.111, top1 = 69.19%], valid : [loss = 2.301, top1 = 44.70%], test : [loss = 2.297, top1 = 45.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.323, top1 = 89.16%], valid : [loss = 0.469, top1 = 84.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4955/15625) 004955-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.68 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.82%], valid : [loss = 0.864, top1 = 71.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.98 ms.
cifar10        train : [loss = 0.560, top1 = 80.60%], test  : [loss = 0.716, top1 = 75.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.62 ms.
cifar100       train : [loss = 1.782, top1 = 51.97%], valid : [loss = 2.048, top1 = 47.14%], test : [loss = 2.068, top1 = 46.57%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.75%], valid : [loss = 3.638, top1 = 16.18%], test : [loss = 3.657, top1 = 15.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4956/15625) 004956-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.84%], valid : [loss = 0.655, top1 = 77.90%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10        train : [loss = 0.512, top1 = 82.28%], test  : [loss = 0.590, top1 = 80.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.90 ms.
cifar100       train : [loss = 1.694, top1 = 54.02%], valid : [loss = 1.853, top1 = 50.76%], test : [loss = 1.864, top1 = 51.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.38 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.19%], valid : [loss = 3.320, top1 = 21.74%], test : [loss = 3.348, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4957/15625) 004957-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.519, top1 = 89.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.04 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.333, top1 = 92.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.48 ms.
cifar100       train : [loss = 0.177, top1 = 95.80%], valid : [loss = 1.331, top1 = 67.90%], test : [loss = 1.304, top1 = 68.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.81%], valid : [loss = 2.288, top1 = 41.30%], test : [loss = 2.262, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.67%], valid : [loss = 0.751, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4958/15625) 004958-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.492, top1 = 88.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.021, top1 = 99.48%], test  : [loss = 0.339, top1 = 91.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.79 ms.
cifar100       train : [loss = 0.407, top1 = 88.32%], valid : [loss = 1.300, top1 = 66.67%], test : [loss = 1.318, top1 = 66.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.52%], valid : [loss = 2.413, top1 = 38.90%], test : [loss = 2.435, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.50%], valid : [loss = 0.634, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4959/15625) 004959-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.469, top1 = 89.64%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.292, top1 = 92.89%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.78 ms.
cifar100       train : [loss = 0.266, top1 = 92.97%], valid : [loss = 1.202, top1 = 69.00%], test : [loss = 1.234, top1 = 69.16%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.12%], valid : [loss = 2.227, top1 = 43.17%], test : [loss = 2.241, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.09%], valid : [loss = 0.609, top1 = 79.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4960/15625) 004960-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.196, top1 = 93.37%], valid : [loss = 0.536, top1 = 84.02%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.197, top1 = 93.31%], test  : [loss = 0.404, top1 = 87.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 1.268, top1 = 63.98%], valid : [loss = 1.568, top1 = 57.59%], test : [loss = 1.553, top1 = 57.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.83 ms.
ImageNet16-120 train : [loss = 2.687, top1 = 32.77%], valid : [loss = 2.720, top1 = 32.29%], test : [loss = 2.747, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4961/15625) 004961-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.56%], valid : [loss = 0.604, top1 = 86.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10        train : [loss = 0.032, top1 = 99.10%], test  : [loss = 0.388, top1 = 90.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.542, top1 = 84.26%], valid : [loss = 1.449, top1 = 63.38%], test : [loss = 1.415, top1 = 63.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.410, top1 = 38.66%], valid : [loss = 2.579, top1 = 33.87%], test : [loss = 2.627, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.48%], valid : [loss = 0.865, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4962/15625) 004962-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.55 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.56%], valid : [loss = 0.510, top1 = 84.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.91 ms.
cifar10        train : [loss = 0.191, top1 = 93.55%], test  : [loss = 0.384, top1 = 87.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.229, top1 = 65.16%], valid : [loss = 1.550, top1 = 58.01%], test : [loss = 1.527, top1 = 58.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 2.735, top1 = 31.93%], valid : [loss = 2.753, top1 = 31.77%], test : [loss = 2.798, top1 = 30.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.038, top1 = 62.88%], valid : [loss = 1.078, top1 = 62.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4963/15625) 004963-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.451, top1 = 89.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.290, top1 = 92.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.209, top1 = 95.00%], valid : [loss = 1.287, top1 = 68.56%], test : [loss = 1.255, top1 = 69.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 50.94%], valid : [loss = 2.263, top1 = 42.57%], test : [loss = 2.283, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4964/15625) 004964-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.444, top1 = 89.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.008, top1 = 99.92%], test  : [loss = 0.318, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.93 ms.
cifar100       train : [loss = 0.169, top1 = 96.33%], valid : [loss = 1.287, top1 = 68.56%], test : [loss = 1.278, top1 = 69.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 1.775, top1 = 52.71%], valid : [loss = 2.214, top1 = 43.93%], test : [loss = 2.256, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.415, top1 = 85.84%], valid : [loss = 0.531, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4965/15625) 004965-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.86%], valid : [loss = 0.467, top1 = 86.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10        train : [loss = 0.150, top1 = 95.20%], test  : [loss = 0.348, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.86 ms.
cifar100       train : [loss = 0.968, top1 = 72.46%], valid : [loss = 1.334, top1 = 62.72%], test : [loss = 1.323, top1 = 62.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.16%], valid : [loss = 2.676, top1 = 33.36%], test : [loss = 2.696, top1 = 32.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4966/15625) 004966-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.44%], valid : [loss = 0.700, top1 = 77.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.352, top1 = 87.67%], test  : [loss = 0.511, top1 = 83.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 1.508, top1 = 58.06%], valid : [loss = 1.804, top1 = 51.46%], test : [loss = 1.776, top1 = 52.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 3.233, top1 = 22.55%], valid : [loss = 3.228, top1 = 22.80%], test : [loss = 3.281, top1 = 21.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.58%], valid : [loss = 1.213, top1 = 56.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4967/15625) 004967-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.563, top1 = 88.19%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.14 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.351, top1 = 92.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.16 ms.
cifar100       train : [loss = 0.299, top1 = 91.69%], valid : [loss = 1.373, top1 = 66.36%], test : [loss = 1.330, top1 = 67.72%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 44.01%], valid : [loss = 2.412, top1 = 39.43%], test : [loss = 2.456, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.04%], valid : [loss = 0.869, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4968/15625) 004968-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.34%], valid : [loss = 0.546, top1 = 87.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10        train : [loss = 0.054, top1 = 98.35%], test  : [loss = 0.370, top1 = 90.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.59 ms.
cifar100       train : [loss = 0.613, top1 = 81.90%], valid : [loss = 1.328, top1 = 65.38%], test : [loss = 1.352, top1 = 64.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.363, top1 = 39.70%], valid : [loss = 2.520, top1 = 37.33%], test : [loss = 2.541, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.60%], valid : [loss = 0.667, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4969/15625) 004969-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.97%], valid : [loss = 0.544, top1 = 86.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10        train : [loss = 0.060, top1 = 98.27%], test  : [loss = 0.352, top1 = 90.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.28 ms.
cifar100       train : [loss = 0.615, top1 = 82.06%], valid : [loss = 1.325, top1 = 65.18%], test : [loss = 1.331, top1 = 65.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.363, top1 = 39.39%], valid : [loss = 2.476, top1 = 37.27%], test : [loss = 2.496, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.08%], valid : [loss = 0.856, top1 = 70.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4970/15625) 004970-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.485, top1 = 88.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.330, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.74 ms.
cifar100       train : [loss = 0.314, top1 = 91.64%], valid : [loss = 1.258, top1 = 67.56%], test : [loss = 1.261, top1 = 68.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.44%], valid : [loss = 2.325, top1 = 40.73%], test : [loss = 2.354, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4971/15625) 004971-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.12%], valid : [loss = 0.461, top1 = 86.83%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.65 ms.
cifar10        train : [loss = 0.114, top1 = 96.49%], test  : [loss = 0.335, top1 = 89.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.23 ms.
cifar100       train : [loss = 0.855, top1 = 75.79%], valid : [loss = 1.297, top1 = 63.89%], test : [loss = 1.286, top1 = 63.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.65%], valid : [loss = 2.629, top1 = 34.42%], test : [loss = 2.648, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.86%], valid : [loss = 0.650, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4972/15625) 004972-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.818, top1 = 71.07%], valid : [loss = 0.918, top1 = 67.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10        train : [loss = 0.741, top1 = 73.91%], test  : [loss = 0.794, top1 = 72.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.49 ms.
cifar100       train : [loss = 2.310, top1 = 39.28%], valid : [loss = 2.404, top1 = 38.26%], test : [loss = 2.405, top1 = 37.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 3.547, top1 = 16.95%], valid : [loss = 3.518, top1 = 18.10%], test : [loss = 3.538, top1 = 16.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.369, top1 = 50.15%], valid : [loss = 1.412, top1 = 48.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4973/15625) 004973-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.513, top1 = 90.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.38 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.308, top1 = 93.20%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.36 ms.
cifar100       train : [loss = 0.108, top1 = 97.72%], valid : [loss = 1.343, top1 = 69.32%], test : [loss = 1.339, top1 = 69.54%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 1.726, top1 = 53.77%], valid : [loss = 2.206, top1 = 43.77%], test : [loss = 2.213, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.680, top1 = 76.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4974/15625) 004974-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.530, top1 = 89.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.325, top1 = 93.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.66 ms.
cifar100       train : [loss = 0.139, top1 = 96.83%], valid : [loss = 1.337, top1 = 68.50%], test : [loss = 1.332, top1 = 69.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.85 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.59%], valid : [loss = 2.217, top1 = 43.43%], test : [loss = 2.234, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.48%], valid : [loss = 0.648, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4975/15625) 004975-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.632, top1 = 86.45%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.74 ms.
cifar10        train : [loss = 0.034, top1 = 99.10%], test  : [loss = 0.406, top1 = 90.08%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.92 ms.
cifar100       train : [loss = 0.387, top1 = 89.60%], valid : [loss = 1.407, top1 = 64.90%], test : [loss = 1.425, top1 = 64.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.21%], valid : [loss = 2.598, top1 = 34.43%], test : [loss = 2.613, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.74%], valid : [loss = 0.772, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4976/15625) 004976-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.486, top1 = 88.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.319, top1 = 91.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.70 ms.
cifar100       train : [loss = 0.230, top1 = 94.49%], valid : [loss = 1.236, top1 = 68.36%], test : [loss = 1.235, top1 = 68.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.936, top1 = 49.13%], valid : [loss = 2.291, top1 = 41.13%], test : [loss = 2.308, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4977/15625) 004977-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.78%], valid : [loss = 0.459, top1 = 86.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10        train : [loss = 0.160, top1 = 94.80%], test  : [loss = 0.359, top1 = 88.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.61 ms.
cifar100       train : [loss = 0.975, top1 = 72.35%], valid : [loss = 1.351, top1 = 62.06%], test : [loss = 1.330, top1 = 63.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.73%], valid : [loss = 2.676, top1 = 32.33%], test : [loss = 2.710, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4978/15625) 004978-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.08%], valid : [loss = 0.503, top1 = 87.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.26 ms.
cifar10        train : [loss = 0.075, top1 = 97.69%], test  : [loss = 0.341, top1 = 90.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.54 ms.
cifar100       train : [loss = 0.708, top1 = 79.43%], valid : [loss = 1.316, top1 = 64.59%], test : [loss = 1.286, top1 = 65.53%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.430, top1 = 38.15%], valid : [loss = 2.550, top1 = 35.72%], test : [loss = 2.572, top1 = 35.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.80%], valid : [loss = 0.627, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4979/15625) 004979-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.72%], valid : [loss = 0.752, top1 = 74.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10        train : [loss = 0.508, top1 = 82.55%], test  : [loss = 0.562, top1 = 80.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.46 ms.
cifar100       train : [loss = 2.078, top1 = 43.66%], valid : [loss = 2.181, top1 = 41.60%], test : [loss = 2.174, top1 = 42.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 3.292, top1 = 21.06%], valid : [loss = 3.256, top1 = 21.80%], test : [loss = 3.309, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.163, top1 = 57.51%], valid : [loss = 1.205, top1 = 56.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4980/15625) 004980-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.325, top1 = 88.74%], valid : [loss = 0.583, top1 = 81.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10        train : [loss = 0.271, top1 = 90.69%], test  : [loss = 0.425, top1 = 85.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.11 ms.
cifar100       train : [loss = 1.510, top1 = 57.67%], valid : [loss = 1.749, top1 = 52.43%], test : [loss = 1.742, top1 = 52.51%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 28.01%], valid : [loss = 2.960, top1 = 27.73%], test : [loss = 2.988, top1 = 26.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 63.92%], valid : [loss = 1.048, top1 = 62.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4981/15625) 004981-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.36%], valid : [loss = 0.842, top1 = 79.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.98 ms.
cifar10        train : [loss = 0.136, top1 = 95.34%], test  : [loss = 0.525, top1 = 85.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.58 ms.
cifar100       train : [loss = 0.861, top1 = 74.87%], valid : [loss = 1.683, top1 = 57.22%], test : [loss = 1.664, top1 = 57.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.33%], valid : [loss = 3.181, top1 = 23.90%], test : [loss = 3.203, top1 = 23.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 59.76%], valid : [loss = 1.161, top1 = 58.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4982/15625) 004982-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.608, top1 = 86.28%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=17.46 ms.
cifar10        train : [loss = 0.032, top1 = 99.07%], test  : [loss = 0.384, top1 = 90.38%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=16.52 ms.
cifar100       train : [loss = 0.559, top1 = 83.66%], valid : [loss = 1.428, top1 = 63.63%], test : [loss = 1.432, top1 = 63.40%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.24%], valid : [loss = 2.575, top1 = 35.56%], test : [loss = 2.578, top1 = 35.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.29%], valid : [loss = 0.809, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4983/15625) 004983-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.433, top1 = 90.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.87 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.287, top1 = 93.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=20.46 ms.
cifar100       train : [loss = 0.066, top1 = 99.04%], valid : [loss = 1.339, top1 = 70.32%], test : [loss = 1.332, top1 = 69.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 1.543, top1 = 58.28%], valid : [loss = 2.225, top1 = 43.97%], test : [loss = 2.243, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.77%], valid : [loss = 0.541, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4984/15625) 004984-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.511, top1 = 88.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.322, top1 = 92.08%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.94 ms.
cifar100       train : [loss = 0.251, top1 = 93.43%], valid : [loss = 1.217, top1 = 69.80%], test : [loss = 1.254, top1 = 68.70%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.78 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.21%], valid : [loss = 2.230, top1 = 42.67%], test : [loss = 2.256, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.31%], valid : [loss = 0.619, top1 = 78.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4985/15625) 004985-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.529, top1 = 88.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.358, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.29 ms.
cifar100       train : [loss = 0.360, top1 = 89.66%], valid : [loss = 1.276, top1 = 66.70%], test : [loss = 1.251, top1 = 67.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.29%], valid : [loss = 2.342, top1 = 40.63%], test : [loss = 2.355, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.04%], valid : [loss = 0.843, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4986/15625) 004986-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.488, top1 = 90.21%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.307, top1 = 93.36%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.77 ms.
cifar100       train : [loss = 0.063, top1 = 99.17%], valid : [loss = 1.323, top1 = 70.53%], test : [loss = 1.310, top1 = 70.59%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.581, top1 = 57.36%], valid : [loss = 2.161, top1 = 44.82%], test : [loss = 2.170, top1 = 45.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.48%], valid : [loss = 0.599, top1 = 79.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4987/15625) 004987-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.180, top1 = 94.02%], valid : [loss = 0.866, top1 = 77.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.97 ms.
cifar10        train : [loss = 0.223, top1 = 92.41%], test  : [loss = 0.577, top1 = 82.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.35 ms.
cifar100       train : [loss = 1.144, top1 = 67.32%], valid : [loss = 1.787, top1 = 53.98%], test : [loss = 1.733, top1 = 54.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 3.249, top1 = 22.30%], valid : [loss = 3.334, top1 = 21.60%], test : [loss = 3.398, top1 = 20.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.063, top1 = 62.04%], valid : [loss = 1.117, top1 = 60.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4988/15625) 004988-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.74%], valid : [loss = 0.498, top1 = 83.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 0.305, top1 = 89.80%], test  : [loss = 0.409, top1 = 86.07%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.09 ms.
cifar100       train : [loss = 1.339, top1 = 63.04%], valid : [loss = 1.529, top1 = 58.38%], test : [loss = 1.528, top1 = 57.76%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.50 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.73%], valid : [loss = 2.878, top1 = 29.83%], test : [loss = 2.934, top1 = 28.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4989/15625) 004989-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.511, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.353, top1 = 91.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.69 ms.
cifar100       train : [loss = 0.230, top1 = 93.86%], valid : [loss = 1.259, top1 = 69.56%], test : [loss = 1.299, top1 = 68.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.78%], valid : [loss = 2.226, top1 = 42.23%], test : [loss = 2.273, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.60%], valid : [loss = 0.692, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4990/15625) 004990-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.56 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.35%], valid : [loss = 0.851, top1 = 72.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10        train : [loss = 0.566, top1 = 80.13%], test  : [loss = 0.716, top1 = 75.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 1.772, top1 = 52.04%], valid : [loss = 2.058, top1 = 46.26%], test : [loss = 2.059, top1 = 46.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 16.64%], valid : [loss = 3.650, top1 = 16.50%], test : [loss = 3.657, top1 = 16.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4991/15625) 004991-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4992/15625) 004992-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.335, top1 = 88.48%], valid : [loss = 0.550, top1 = 81.72%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.19 ms.
cifar10        train : [loss = 0.433, top1 = 85.06%], test  : [loss = 0.523, top1 = 82.04%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.30 ms.
cifar100       train : [loss = 1.830, top1 = 50.48%], valid : [loss = 1.961, top1 = 47.36%], test : [loss = 1.929, top1 = 47.62%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.436, top1 = 47.40%], valid : [loss = 1.422, top1 = 47.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4993/15625) 004993-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.32%], valid : [loss = 0.615, top1 = 85.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 0.069, top1 = 97.93%], test  : [loss = 0.408, top1 = 88.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.62 ms.
cifar100       train : [loss = 0.712, top1 = 79.24%], valid : [loss = 1.384, top1 = 63.30%], test : [loss = 1.389, top1 = 63.81%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.22%], valid : [loss = 2.641, top1 = 33.25%], test : [loss = 2.698, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4994/15625) 004994-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.56%], valid : [loss = 0.482, top1 = 85.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.153, top1 = 95.05%], test  : [loss = 0.352, top1 = 88.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.54 ms.
cifar100       train : [loss = 0.973, top1 = 72.24%], valid : [loss = 1.346, top1 = 62.30%], test : [loss = 1.333, top1 = 62.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.38%], valid : [loss = 2.701, top1 = 32.47%], test : [loss = 2.752, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4995/15625) 004995-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.419, top1 = 89.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.298, top1 = 92.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.16 ms.
cifar100       train : [loss = 0.203, top1 = 95.29%], valid : [loss = 1.286, top1 = 68.22%], test : [loss = 1.264, top1 = 68.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.60%], valid : [loss = 2.295, top1 = 41.77%], test : [loss = 2.312, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4996/15625) 004996-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.24%], valid : [loss = 0.557, top1 = 86.69%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.99 ms.
cifar10        train : [loss = 0.072, top1 = 97.68%], test  : [loss = 0.389, top1 = 89.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.01 ms.
cifar100       train : [loss = 0.558, top1 = 83.88%], valid : [loss = 1.335, top1 = 64.98%], test : [loss = 1.346, top1 = 64.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.33%], valid : [loss = 2.507, top1 = 36.80%], test : [loss = 2.531, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.42%], valid : [loss = 0.858, top1 = 69.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4997/15625) 004997-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.558, top1 = 88.50%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.362, top1 = 92.63%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.04 ms.
cifar100       train : [loss = 0.081, top1 = 98.72%], valid : [loss = 1.501, top1 = 67.64%], test : [loss = 1.492, top1 = 68.56%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.29%], valid : [loss = 2.450, top1 = 37.80%], test : [loss = 2.420, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.57%], valid : [loss = 0.774, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4998/15625) 004998-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.85%], valid : [loss = 0.473, top1 = 84.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.299, top1 = 89.82%], test  : [loss = 0.399, top1 = 86.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 1.322, top1 = 63.33%], valid : [loss = 1.528, top1 = 58.08%], test : [loss = 1.505, top1 = 57.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.59%], valid : [loss = 2.884, top1 = 29.23%], test : [loss = 2.957, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 4999/15625) 004999-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.334, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.40 ms.
cifar100       train : [loss = 0.338, top1 = 90.81%], valid : [loss = 1.284, top1 = 67.26%], test : [loss = 1.281, top1 = 67.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.76%], valid : [loss = 2.422, top1 = 39.24%], test : [loss = 2.422, top1 = 38.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5000/15625) 005000-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.515, top1 = 89.67%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.35 ms.
cifar10        train : [loss = 0.002, top1 = 99.96%], test  : [loss = 0.314, top1 = 93.52%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.48 ms.
cifar100       train : [loss = 0.028, top1 = 99.77%], valid : [loss = 1.405, top1 = 70.44%], test : [loss = 1.417, top1 = 69.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.47 ms.
ImageNet16-120 train : [loss = 1.548, top1 = 58.21%], valid : [loss = 2.393, top1 = 41.23%], test : [loss = 2.396, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.77%], valid : [loss = 0.681, top1 = 76.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5001/15625) 005001-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.212, top1 = 92.70%], valid : [loss = 0.549, top1 = 83.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.219, top1 = 92.55%], test  : [loss = 0.408, top1 = 87.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.307, top1 = 63.04%], valid : [loss = 1.584, top1 = 56.87%], test : [loss = 1.587, top1 = 56.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.729, top1 = 31.93%], valid : [loss = 2.764, top1 = 31.37%], test : [loss = 2.801, top1 = 30.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.30%], valid : [loss = 0.959, top1 = 66.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5002/15625) 005002-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.45 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.491, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.00 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.360, top1 = 91.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.218, top1 = 94.42%], valid : [loss = 1.356, top1 = 68.26%], test : [loss = 1.370, top1 = 68.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.55%], valid : [loss = 2.318, top1 = 41.30%], test : [loss = 2.339, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 80.83%], valid : [loss = 0.632, top1 = 78.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5003/15625) 005003-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.508, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.350, top1 = 92.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.117, top1 = 97.72%], valid : [loss = 1.453, top1 = 67.69%], test : [loss = 1.448, top1 = 67.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.58%], valid : [loss = 2.357, top1 = 40.33%], test : [loss = 2.379, top1 = 40.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.27%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5004/15625) 005004-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.64%], valid : [loss = 0.517, top1 = 88.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.355, top1 = 90.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 0.410, top1 = 87.95%], valid : [loss = 1.289, top1 = 67.26%], test : [loss = 1.273, top1 = 66.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.08%], valid : [loss = 2.397, top1 = 39.33%], test : [loss = 2.444, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5005/15625) 005005-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.603, top1 = 87.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.384, top1 = 91.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.37 ms.
cifar100       train : [loss = 0.131, top1 = 97.37%], valid : [loss = 1.461, top1 = 66.70%], test : [loss = 1.486, top1 = 68.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 1.931, top1 = 49.26%], valid : [loss = 2.450, top1 = 38.97%], test : [loss = 2.439, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 75.87%], valid : [loss = 0.751, top1 = 73.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5006/15625) 005006-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.26%], valid : [loss = 0.989, top1 = 78.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.46 ms.
cifar10        train : [loss = 0.069, top1 = 97.99%], test  : [loss = 0.681, top1 = 83.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.93 ms.
cifar100       train : [loss = 0.631, top1 = 82.38%], valid : [loss = 1.873, top1 = 55.64%], test : [loss = 1.858, top1 = 55.90%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.981, top1 = 27.58%], valid : [loss = 3.281, top1 = 22.47%], test : [loss = 3.345, top1 = 22.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.985, top1 = 64.85%], valid : [loss = 1.055, top1 = 62.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5007/15625) 005007-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.80%], valid : [loss = 0.482, top1 = 84.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.99 ms.
cifar10        train : [loss = 0.302, top1 = 89.92%], test  : [loss = 0.402, top1 = 86.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.12 ms.
cifar100       train : [loss = 1.327, top1 = 63.18%], valid : [loss = 1.535, top1 = 57.91%], test : [loss = 1.500, top1 = 58.15%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.89 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.63%], valid : [loss = 2.904, top1 = 29.70%], test : [loss = 2.962, top1 = 28.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5008/15625) 005008-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.30%], valid : [loss = 0.447, top1 = 86.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.167, top1 = 94.55%], test  : [loss = 0.345, top1 = 88.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.54 ms.
cifar100       train : [loss = 0.987, top1 = 71.92%], valid : [loss = 1.349, top1 = 62.20%], test : [loss = 1.339, top1 = 62.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.11 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.84%], valid : [loss = 2.698, top1 = 32.70%], test : [loss = 2.717, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.76%], valid : [loss = 0.787, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5009/15625) 005009-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.473, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.333, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.12 ms.
cifar100       train : [loss = 0.295, top1 = 91.98%], valid : [loss = 1.345, top1 = 66.87%], test : [loss = 1.324, top1 = 67.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.31%], valid : [loss = 2.348, top1 = 39.90%], test : [loss = 2.382, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.19%], valid : [loss = 0.576, top1 = 80.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5010/15625) 005010-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.67%], valid : [loss = 0.456, top1 = 86.27%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=15.42 ms.
cifar10        train : [loss = 0.149, top1 = 95.17%], test  : [loss = 0.341, top1 = 89.08%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=13.70 ms.
cifar100       train : [loss = 0.977, top1 = 72.29%], valid : [loss = 1.358, top1 = 61.98%], test : [loss = 1.354, top1 = 61.98%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.03%], valid : [loss = 2.680, top1 = 33.11%], test : [loss = 2.702, top1 = 32.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5011/15625) 005011-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.494, top1 = 90.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.308, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.112, top1 = 97.83%], valid : [loss = 1.280, top1 = 70.05%], test : [loss = 1.294, top1 = 69.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.84%], valid : [loss = 2.188, top1 = 44.13%], test : [loss = 2.207, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5012/15625) 005012-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.570, top1 = 87.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.388, top1 = 91.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 0.402, top1 = 88.61%], valid : [loss = 1.392, top1 = 65.38%], test : [loss = 1.367, top1 = 65.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.76%], valid : [loss = 2.524, top1 = 36.73%], test : [loss = 2.534, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5013/15625) 005013-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.13%], valid : [loss = 0.466, top1 = 85.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.97 ms.
cifar10        train : [loss = 0.163, top1 = 94.65%], test  : [loss = 0.344, top1 = 88.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 1.007, top1 = 71.30%], valid : [loss = 1.360, top1 = 62.30%], test : [loss = 1.348, top1 = 62.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.53%], valid : [loss = 2.678, top1 = 32.73%], test : [loss = 2.721, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5014/15625) 005014-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.554, top1 = 88.52%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.361, top1 = 91.92%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.09 ms.
cifar100       train : [loss = 0.209, top1 = 94.83%], valid : [loss = 1.302, top1 = 68.24%], test : [loss = 1.300, top1 = 68.70%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.45 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.70%], valid : [loss = 2.206, top1 = 42.30%], test : [loss = 2.229, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 74.86%], valid : [loss = 0.762, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5015/15625) 005015-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.41%], valid : [loss = 0.752, top1 = 79.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.178, top1 = 93.99%], test  : [loss = 0.510, top1 = 84.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 0.892, top1 = 73.98%], valid : [loss = 1.656, top1 = 57.22%], test : [loss = 1.659, top1 = 57.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 3.529, top1 = 16.37%], valid : [loss = 3.533, top1 = 16.20%], test : [loss = 3.536, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5016/15625) 005016-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.81%], valid : [loss = 0.464, top1 = 86.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10        train : [loss = 0.154, top1 = 95.10%], test  : [loss = 0.345, top1 = 88.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.989, top1 = 71.88%], valid : [loss = 1.346, top1 = 62.98%], test : [loss = 1.371, top1 = 61.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.81%], valid : [loss = 2.703, top1 = 32.57%], test : [loss = 2.728, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5017/15625) 005017-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.43%], valid : [loss = 0.774, top1 = 78.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.196, top1 = 93.15%], test  : [loss = 0.519, top1 = 84.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.83 ms.
cifar100       train : [loss = 0.945, top1 = 72.46%], valid : [loss = 1.664, top1 = 56.10%], test : [loss = 1.673, top1 = 56.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 3.415, top1 = 18.41%], valid : [loss = 3.416, top1 = 18.53%], test : [loss = 3.435, top1 = 18.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.258, top1 = 53.70%], valid : [loss = 1.294, top1 = 53.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5018/15625) 005018-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.566, top1 = 87.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.24 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.387, top1 = 91.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.89 ms.
cifar100       train : [loss = 0.412, top1 = 88.26%], valid : [loss = 1.376, top1 = 65.56%], test : [loss = 1.355, top1 = 65.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.21%], valid : [loss = 2.483, top1 = 37.63%], test : [loss = 2.532, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.60%], valid : [loss = 0.823, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5019/15625) 005019-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.88%], valid : [loss = 0.475, top1 = 84.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10        train : [loss = 0.300, top1 = 89.98%], test  : [loss = 0.400, top1 = 86.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.17 ms.
cifar100       train : [loss = 1.339, top1 = 62.90%], valid : [loss = 1.545, top1 = 57.94%], test : [loss = 1.508, top1 = 58.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.66%], valid : [loss = 2.898, top1 = 29.87%], test : [loss = 2.979, top1 = 27.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 74.93%], valid : [loss = 0.755, top1 = 73.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5020/15625) 005020-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.72%], valid : [loss = 0.600, top1 = 86.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=13.99 ms.
cifar10        train : [loss = 0.015, top1 = 99.55%], test  : [loss = 0.413, top1 = 90.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.65 ms.
cifar100       train : [loss = 0.133, top1 = 96.69%], valid : [loss = 1.496, top1 = 67.28%], test : [loss = 1.507, top1 = 67.12%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 33.92%], valid : [loss = 2.743, top1 = 31.00%], test : [loss = 2.765, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.52%], valid : [loss = 0.945, top1 = 66.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5021/15625) 005021-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.95%], valid : [loss = 0.515, top1 = 87.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.078, top1 = 97.51%], test  : [loss = 0.357, top1 = 89.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.722, top1 = 78.78%], valid : [loss = 1.341, top1 = 63.84%], test : [loss = 1.355, top1 = 63.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.09%], valid : [loss = 2.616, top1 = 34.33%], test : [loss = 2.672, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.65%], valid : [loss = 0.653, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5022/15625) 005022-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.52 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.89%], valid : [loss = 0.482, top1 = 84.08%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.14 ms.
cifar10        train : [loss = 0.302, top1 = 89.92%], test  : [loss = 0.406, top1 = 86.22%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 1.334, top1 = 62.83%], valid : [loss = 1.531, top1 = 57.81%], test : [loss = 1.510, top1 = 57.99%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.39 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.60%], valid : [loss = 2.909, top1 = 29.24%], test : [loss = 2.959, top1 = 27.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5023/15625) 005023-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.70%], valid : [loss = 0.841, top1 = 72.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.24 ms.
cifar10        train : [loss = 0.570, top1 = 80.03%], test  : [loss = 0.724, top1 = 75.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.49 ms.
cifar100       train : [loss = 1.793, top1 = 51.81%], valid : [loss = 2.048, top1 = 46.74%], test : [loss = 2.066, top1 = 47.12%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.80%], valid : [loss = 3.656, top1 = 16.03%], test : [loss = 3.678, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.168, top1 = 58.09%], valid : [loss = 1.242, top1 = 55.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5024/15625) 005024-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.457, top1 = 90.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.308, top1 = 93.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 0.082, top1 = 98.64%], valid : [loss = 1.370, top1 = 69.50%], test : [loss = 1.372, top1 = 68.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.85%], valid : [loss = 2.283, top1 = 42.80%], test : [loss = 2.289, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.34%], valid : [loss = 0.505, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5025/15625) 005025-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.535, top1 = 89.39%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.363, top1 = 92.47%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.06 ms.
cifar100       train : [loss = 0.071, top1 = 98.99%], valid : [loss = 1.497, top1 = 67.90%], test : [loss = 1.439, top1 = 68.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.08 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.10%], valid : [loss = 2.422, top1 = 40.83%], test : [loss = 2.413, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 77.96%], valid : [loss = 0.712, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5026/15625) 005026-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.57%], valid : [loss = 0.663, top1 = 85.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.048, top1 = 98.61%], test  : [loss = 0.419, top1 = 89.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.621, top1 = 81.85%], valid : [loss = 1.514, top1 = 61.98%], test : [loss = 1.463, top1 = 62.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.509, top1 = 36.43%], valid : [loss = 2.635, top1 = 33.37%], test : [loss = 2.698, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.54%], valid : [loss = 0.859, top1 = 70.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5027/15625) 005027-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.22 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.68%], valid : [loss = 0.860, top1 = 71.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.20 ms.
cifar10        train : [loss = 0.565, top1 = 80.19%], test  : [loss = 0.725, top1 = 75.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.63 ms.
cifar100       train : [loss = 1.799, top1 = 51.52%], valid : [loss = 2.064, top1 = 47.24%], test : [loss = 2.080, top1 = 46.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 3.597, top1 = 16.59%], valid : [loss = 3.665, top1 = 16.80%], test : [loss = 3.680, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5028/15625) 005028-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.544, top1 = 89.35%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.344, top1 = 93.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.93 ms.
cifar100       train : [loss = 0.060, top1 = 99.20%], valid : [loss = 1.432, top1 = 69.10%], test : [loss = 1.515, top1 = 68.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.08 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.37%], valid : [loss = 2.367, top1 = 42.10%], test : [loss = 2.372, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.06%], valid : [loss = 0.661, top1 = 77.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5029/15625) 005029-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.535, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.326, top1 = 93.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.04 ms.
cifar100       train : [loss = 0.103, top1 = 97.81%], valid : [loss = 1.334, top1 = 69.86%], test : [loss = 1.379, top1 = 69.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 1.739, top1 = 53.41%], valid : [loss = 2.192, top1 = 43.43%], test : [loss = 2.207, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.31%], valid : [loss = 0.830, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5030/15625) 005030-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.02%], valid : [loss = 0.476, top1 = 84.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.300, top1 = 90.05%], test  : [loss = 0.399, top1 = 86.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.35 ms.
cifar100       train : [loss = 1.329, top1 = 63.18%], valid : [loss = 1.538, top1 = 57.62%], test : [loss = 1.507, top1 = 58.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.57%], valid : [loss = 2.907, top1 = 29.00%], test : [loss = 2.968, top1 = 28.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5031/15625) 005031-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.569, top1 = 87.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.375, top1 = 91.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.18 ms.
cifar100       train : [loss = 0.379, top1 = 89.18%], valid : [loss = 1.423, top1 = 65.52%], test : [loss = 1.416, top1 = 65.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.10%], valid : [loss = 2.480, top1 = 39.03%], test : [loss = 2.520, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.97%], valid : [loss = 0.774, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5032/15625) 005032-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.25 ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.79%], valid : [loss = 1.127, top1 = 62.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10        train : [loss = 0.788, top1 = 72.35%], test  : [loss = 0.914, top1 = 68.07%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.35 ms.
cifar100       train : [loss = 2.117, top1 = 44.43%], valid : [loss = 2.376, top1 = 40.00%], test : [loss = 2.380, top1 = 40.20%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.09 ms.
ImageNet16-120 train : [loss = 3.761, top1 = 14.05%], valid : [loss = 3.818, top1 = 13.97%], test : [loss = 3.827, top1 = 13.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5033/15625) 005033-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.97%], valid : [loss = 0.472, top1 = 84.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10        train : [loss = 0.298, top1 = 90.05%], test  : [loss = 0.401, top1 = 86.59%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.57 ms.
cifar100       train : [loss = 1.327, top1 = 63.17%], valid : [loss = 1.520, top1 = 57.78%], test : [loss = 1.499, top1 = 59.06%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.27 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.42%], valid : [loss = 2.915, top1 = 28.70%], test : [loss = 2.993, top1 = 26.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5034/15625) 005034-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.81%], valid : [loss = 0.477, top1 = 84.32%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.306, top1 = 89.88%], test  : [loss = 0.403, top1 = 86.30%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.09 ms.
cifar100       train : [loss = 1.345, top1 = 62.81%], valid : [loss = 1.544, top1 = 57.50%], test : [loss = 1.520, top1 = 57.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.82 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.66%], valid : [loss = 2.909, top1 = 29.80%], test : [loss = 2.963, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5035/15625) 005035-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.581, top1 = 87.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.394, top1 = 90.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 0.397, top1 = 88.73%], valid : [loss = 1.416, top1 = 64.98%], test : [loss = 1.393, top1 = 65.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.82%], valid : [loss = 2.515, top1 = 36.53%], test : [loss = 2.540, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5036/15625) 005036-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.34%], valid : [loss = 0.461, top1 = 86.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.28 ms.
cifar10        train : [loss = 0.122, top1 = 96.18%], test  : [loss = 0.340, top1 = 89.43%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.87 ms.
cifar100       train : [loss = 0.744, top1 = 79.28%], valid : [loss = 1.257, top1 = 65.08%], test : [loss = 1.252, top1 = 64.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.69%], valid : [loss = 2.598, top1 = 35.17%], test : [loss = 2.613, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5037/15625) 005037-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.25%], valid : [loss = 0.854, top1 = 72.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.574, top1 = 79.95%], test  : [loss = 0.725, top1 = 75.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 1.782, top1 = 51.78%], valid : [loss = 2.045, top1 = 46.90%], test : [loss = 2.072, top1 = 46.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.95%], valid : [loss = 3.636, top1 = 16.80%], test : [loss = 3.666, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5038/15625) 005038-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.156, top1 = 95.01%], valid : [loss = 0.509, top1 = 85.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.15 ms.
cifar10        train : [loss = 0.168, top1 = 94.36%], test  : [loss = 0.380, top1 = 88.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.47 ms.
cifar100       train : [loss = 1.011, top1 = 70.86%], valid : [loss = 1.383, top1 = 61.83%], test : [loss = 1.370, top1 = 61.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.43%], valid : [loss = 2.673, top1 = 33.59%], test : [loss = 2.696, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.54%], valid : [loss = 0.900, top1 = 68.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5039/15625) 005039-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.15 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5040/15625) 005040-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.66%], valid : [loss = 0.742, top1 = 80.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.188, top1 = 93.43%], test  : [loss = 0.503, top1 = 84.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=17.28 ms.
cifar100       train : [loss = 0.903, top1 = 73.62%], valid : [loss = 1.648, top1 = 57.42%], test : [loss = 1.668, top1 = 56.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 3.529, top1 = 16.30%], valid : [loss = 3.514, top1 = 17.30%], test : [loss = 3.524, top1 = 16.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.90%], valid : [loss = 1.293, top1 = 52.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5041/15625) 005041-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.68 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5042/15625) 005042-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.556, top1 = 88.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.371, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.36 ms.
cifar100       train : [loss = 0.158, top1 = 96.55%], valid : [loss = 1.411, top1 = 68.00%], test : [loss = 1.395, top1 = 67.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.31 ms.
ImageNet16-120 train : [loss = 1.969, top1 = 48.41%], valid : [loss = 2.419, top1 = 38.60%], test : [loss = 2.437, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.17%], valid : [loss = 0.751, top1 = 73.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5043/15625) 005043-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.525, top1 = 88.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.332, top1 = 92.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 0.342, top1 = 90.69%], valid : [loss = 1.278, top1 = 66.64%], test : [loss = 1.313, top1 = 66.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.34 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.64%], valid : [loss = 2.408, top1 = 39.87%], test : [loss = 2.413, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5044/15625) 005044-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.259, top1 = 91.19%], valid : [loss = 0.527, top1 = 83.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.99 ms.
cifar10        train : [loss = 0.230, top1 = 92.19%], test  : [loss = 0.385, top1 = 87.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.80 ms.
cifar100       train : [loss = 1.370, top1 = 61.43%], valid : [loss = 1.603, top1 = 56.64%], test : [loss = 1.637, top1 = 55.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 2.880, top1 = 29.07%], valid : [loss = 2.890, top1 = 29.73%], test : [loss = 2.926, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5045/15625) 005045-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=10.85 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.08%], valid : [loss = 0.671, top1 = 77.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.536, top1 = 81.52%], test  : [loss = 0.595, top1 = 79.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.728, top1 = 53.05%], valid : [loss = 1.903, top1 = 49.36%], test : [loss = 1.945, top1 = 49.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 3.373, top1 = 20.31%], valid : [loss = 3.333, top1 = 21.10%], test : [loss = 3.404, top1 = 19.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.349, top1 = 51.06%], valid : [loss = 1.374, top1 = 50.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5046/15625) 005046-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.586, top1 = 87.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.405, top1 = 90.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.34 ms.
cifar100       train : [loss = 0.210, top1 = 94.89%], valid : [loss = 1.530, top1 = 65.06%], test : [loss = 1.519, top1 = 65.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 2.170, top1 = 43.94%], valid : [loss = 2.508, top1 = 37.53%], test : [loss = 2.548, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.10%], valid : [loss = 0.796, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5047/15625) 005047-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.40 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.35 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.23 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5048/15625) 005048-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.548, top1 = 88.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.344, top1 = 92.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.80 ms.
cifar100       train : [loss = 0.249, top1 = 93.38%], valid : [loss = 1.322, top1 = 67.44%], test : [loss = 1.318, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.71%], valid : [loss = 2.408, top1 = 39.40%], test : [loss = 2.438, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5049/15625) 005049-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.20%], valid : [loss = 0.542, top1 = 83.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.78 ms.
cifar10        train : [loss = 0.190, top1 = 93.56%], test  : [loss = 0.401, top1 = 87.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 1.248, top1 = 64.48%], valid : [loss = 1.560, top1 = 57.57%], test : [loss = 1.542, top1 = 57.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.708, top1 = 32.48%], valid : [loss = 2.724, top1 = 32.54%], test : [loss = 2.795, top1 = 31.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5050/15625) 005050-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10-valid  train : [loss = 1.236, top1 = 55.41%], valid : [loss = 1.287, top1 = 54.14%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10        train : [loss = 1.227, top1 = 55.85%], test  : [loss = 1.219, top1 = 56.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.46 ms.
cifar100       train : [loss = 2.704, top1 = 32.08%], valid : [loss = 2.775, top1 = 30.94%], test : [loss = 2.774, top1 = 31.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.16 ms.
ImageNet16-120 train : [loss = 3.888, top1 = 11.97%], valid : [loss = 3.882, top1 = 12.50%], test : [loss = 3.892, top1 = 12.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.711, top1 = 35.38%], valid : [loss = 1.722, top1 = 34.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5051/15625) 005051-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.80%], valid : [loss = 0.861, top1 = 70.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.685, top1 = 75.93%], test  : [loss = 0.764, top1 = 73.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.32 ms.
cifar100       train : [loss = 1.975, top1 = 47.53%], valid : [loss = 2.139, top1 = 45.10%], test : [loss = 2.159, top1 = 44.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.20 ms.
ImageNet16-120 train : [loss = 3.659, top1 = 15.69%], valid : [loss = 3.684, top1 = 16.17%], test : [loss = 3.706, top1 = 14.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5052/15625) 005052-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.77 ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.20%], valid : [loss = 0.640, top1 = 78.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.71 ms.
cifar10        train : [loss = 0.513, top1 = 82.15%], test  : [loss = 0.593, top1 = 80.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.25 ms.
cifar100       train : [loss = 1.676, top1 = 54.47%], valid : [loss = 1.842, top1 = 50.75%], test : [loss = 1.870, top1 = 50.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.40 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.26%], valid : [loss = 3.318, top1 = 21.07%], test : [loss = 3.352, top1 = 21.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5053/15625) 005053-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.86%], valid : [loss = 0.459, top1 = 86.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 0.162, top1 = 94.74%], test  : [loss = 0.355, top1 = 88.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.63 ms.
cifar100       train : [loss = 0.939, top1 = 73.27%], valid : [loss = 1.340, top1 = 62.48%], test : [loss = 1.332, top1 = 62.81%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.61%], valid : [loss = 2.660, top1 = 33.37%], test : [loss = 2.703, top1 = 32.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.19%], valid : [loss = 0.916, top1 = 67.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5054/15625) 005054-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.32%], valid : [loss = 0.445, top1 = 87.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.04 ms.
cifar10        train : [loss = 0.113, top1 = 96.53%], test  : [loss = 0.329, top1 = 89.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.35 ms.
cifar100       train : [loss = 0.853, top1 = 75.77%], valid : [loss = 1.299, top1 = 64.12%], test : [loss = 1.293, top1 = 64.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.51%], valid : [loss = 2.645, top1 = 33.20%], test : [loss = 2.659, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.676, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5055/15625) 005055-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.751, top1 = 84.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10        train : [loss = 0.031, top1 = 99.10%], test  : [loss = 0.516, top1 = 88.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.393, top1 = 89.16%], valid : [loss = 1.685, top1 = 60.66%], test : [loss = 1.644, top1 = 61.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.34%], valid : [loss = 2.869, top1 = 28.53%], test : [loss = 2.902, top1 = 30.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.01%], valid : [loss = 0.849, top1 = 70.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5056/15625) 005056-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.32%], valid : [loss = 0.623, top1 = 85.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.068, top1 = 97.97%], test  : [loss = 0.403, top1 = 88.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 0.727, top1 = 78.90%], valid : [loss = 1.356, top1 = 63.22%], test : [loss = 1.396, top1 = 63.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.15%], valid : [loss = 2.643, top1 = 34.20%], test : [loss = 2.694, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5057/15625) 005057-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.27%], valid : [loss = 0.612, top1 = 85.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10        train : [loss = 0.072, top1 = 97.79%], test  : [loss = 0.390, top1 = 88.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 0.711, top1 = 79.42%], valid : [loss = 1.371, top1 = 63.53%], test : [loss = 1.361, top1 = 63.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.41 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.05%], valid : [loss = 2.645, top1 = 33.66%], test : [loss = 2.686, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5058/15625) 005058-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.78%], valid : [loss = 0.616, top1 = 85.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10        train : [loss = 0.085, top1 = 97.31%], test  : [loss = 0.423, top1 = 87.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 0.793, top1 = 76.75%], valid : [loss = 1.419, top1 = 62.68%], test : [loss = 1.446, top1 = 61.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.38%], valid : [loss = 2.720, top1 = 32.90%], test : [loss = 2.784, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5059/15625) 005059-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.551, top1 = 89.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.26 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.362, top1 = 92.90%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.14 ms.
cifar100       train : [loss = 0.075, top1 = 98.77%], valid : [loss = 1.391, top1 = 69.00%], test : [loss = 1.394, top1 = 69.16%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.59 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.60%], valid : [loss = 2.435, top1 = 38.33%], test : [loss = 2.471, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.15%], valid : [loss = 0.866, top1 = 69.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5060/15625) 005060-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.573, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.371, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 0.387, top1 = 89.04%], valid : [loss = 1.375, top1 = 66.04%], test : [loss = 1.389, top1 = 65.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.83%], valid : [loss = 2.474, top1 = 37.81%], test : [loss = 2.503, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.64%], valid : [loss = 0.764, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5061/15625) 005061-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.42%], valid : [loss = 0.665, top1 = 84.69%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10        train : [loss = 0.055, top1 = 98.28%], test  : [loss = 0.439, top1 = 88.85%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.86 ms.
cifar100       train : [loss = 0.613, top1 = 82.08%], valid : [loss = 1.415, top1 = 63.30%], test : [loss = 1.392, top1 = 63.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.438, top1 = 37.97%], valid : [loss = 2.588, top1 = 35.10%], test : [loss = 2.622, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 71.14%], valid : [loss = 0.866, top1 = 70.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5062/15625) 005062-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.490, top1 = 88.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.312, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.322, top1 = 91.24%], valid : [loss = 1.258, top1 = 67.49%], test : [loss = 1.256, top1 = 68.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.65%], valid : [loss = 2.326, top1 = 40.88%], test : [loss = 2.346, top1 = 40.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5063/15625) 005063-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.05 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.484, top1 = 90.52%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.30 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.324, top1 = 93.26%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.09 ms.
cifar100       train : [loss = 0.084, top1 = 98.59%], valid : [loss = 1.361, top1 = 68.44%], test : [loss = 1.359, top1 = 69.34%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=24.45 ms.
ImageNet16-120 train : [loss = 1.610, top1 = 56.55%], valid : [loss = 2.144, top1 = 44.67%], test : [loss = 2.134, top1 = 46.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.80%], valid : [loss = 0.662, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5064/15625) 005064-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.15%], valid : [loss = 0.477, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.302, top1 = 89.91%], test  : [loss = 0.401, top1 = 86.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.328, top1 = 63.19%], valid : [loss = 1.533, top1 = 57.85%], test : [loss = 1.511, top1 = 58.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.52%], valid : [loss = 2.918, top1 = 29.02%], test : [loss = 2.973, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5065/15625) 005065-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=131.65 M, Params=0.924 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.488, top1 = 88.86%]
cifar10        FLOP=131.65 M, Params=0.924 MB, latency=17.38 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.318, top1 = 92.25%]
cifar100       FLOP=131.65 M, Params=0.930 MB, latency=14.90 ms.
cifar100       train : [loss = 0.321, top1 = 91.38%], valid : [loss = 1.296, top1 = 67.39%], test : [loss = 1.281, top1 = 67.41%]
ImageNet16-120 FLOP= 32.92 M, Params=0.931 MB, latency=19.23 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.06%], valid : [loss = 2.404, top1 = 38.62%], test : [loss = 2.405, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.17%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5066/15625) 005066-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.538, top1 = 88.78%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.13 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.351, top1 = 91.89%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.19 ms.
cifar100       train : [loss = 0.244, top1 = 93.82%], valid : [loss = 1.271, top1 = 68.28%], test : [loss = 1.241, top1 = 68.46%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=23.24 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.45%], valid : [loss = 2.214, top1 = 43.43%], test : [loss = 2.189, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.95%], valid : [loss = 0.795, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5067/15625) 005067-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.556, top1 = 88.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.372, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.173, top1 = 96.36%], valid : [loss = 1.393, top1 = 67.70%], test : [loss = 1.421, top1 = 67.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.87%], valid : [loss = 2.484, top1 = 38.17%], test : [loss = 2.485, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.58%], valid : [loss = 0.708, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5068/15625) 005068-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.43%], valid : [loss = 0.686, top1 = 84.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.051, top1 = 98.45%], test  : [loss = 0.448, top1 = 88.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.41 ms.
cifar100       train : [loss = 0.635, top1 = 81.47%], valid : [loss = 1.520, top1 = 61.76%], test : [loss = 1.489, top1 = 61.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.28%], valid : [loss = 2.822, top1 = 29.70%], test : [loss = 2.880, top1 = 29.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 70.04%], valid : [loss = 0.883, top1 = 68.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5069/15625) 005069-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.503, top1 = 89.77%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.62 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.302, top1 = 93.00%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.79 ms.
cifar100       train : [loss = 0.127, top1 = 97.61%], valid : [loss = 1.295, top1 = 69.62%], test : [loss = 1.307, top1 = 68.98%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=25.99 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 52.03%], valid : [loss = 2.256, top1 = 42.90%], test : [loss = 2.263, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.09%], valid : [loss = 0.650, top1 = 77.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5070/15625) 005070-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.43%], valid : [loss = 0.685, top1 = 84.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10        train : [loss = 0.052, top1 = 98.43%], test  : [loss = 0.436, top1 = 88.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 0.632, top1 = 81.43%], valid : [loss = 1.513, top1 = 61.74%], test : [loss = 1.492, top1 = 62.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.26%], valid : [loss = 2.843, top1 = 29.61%], test : [loss = 2.881, top1 = 29.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5071/15625) 005071-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.552, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.27 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.360, top1 = 92.67%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.78 ms.
cifar100       train : [loss = 0.069, top1 = 98.98%], valid : [loss = 1.464, top1 = 68.63%], test : [loss = 1.450, top1 = 68.50%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 1.762, top1 = 53.17%], valid : [loss = 2.374, top1 = 41.08%], test : [loss = 2.401, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.57%], valid : [loss = 0.751, top1 = 73.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5072/15625) 005072-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.446, top1 = 89.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.306, top1 = 92.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.05 ms.
cifar100       train : [loss = 0.203, top1 = 94.98%], valid : [loss = 1.324, top1 = 68.23%], test : [loss = 1.365, top1 = 68.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.59%], valid : [loss = 2.304, top1 = 41.48%], test : [loss = 2.321, top1 = 41.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.91%], valid : [loss = 0.576, top1 = 80.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5073/15625) 005073-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.53%], valid : [loss = 0.449, top1 = 87.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.058, top1 = 98.56%], test  : [loss = 0.333, top1 = 90.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.02 ms.
cifar100       train : [loss = 0.588, top1 = 83.80%], valid : [loss = 1.205, top1 = 66.93%], test : [loss = 1.182, top1 = 67.09%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.17%], valid : [loss = 2.457, top1 = 38.42%], test : [loss = 2.479, top1 = 37.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.16%], valid : [loss = 0.650, top1 = 78.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5074/15625) 005074-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.288, top1 = 90.09%], valid : [loss = 0.821, top1 = 76.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.326, top1 = 88.65%], test  : [loss = 0.629, top1 = 80.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 1.412, top1 = 60.56%], valid : [loss = 1.947, top1 = 49.57%], test : [loss = 1.954, top1 = 49.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 3.509, top1 = 17.08%], valid : [loss = 3.530, top1 = 17.41%], test : [loss = 3.535, top1 = 17.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 53.28%], valid : [loss = 1.309, top1 = 52.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5075/15625) 005075-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.49%], valid : [loss = 0.454, top1 = 86.57%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.80 ms.
cifar10        train : [loss = 0.127, top1 = 95.99%], test  : [loss = 0.338, top1 = 89.34%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.33 ms.
cifar100       train : [loss = 0.759, top1 = 78.88%], valid : [loss = 1.312, top1 = 63.56%], test : [loss = 1.294, top1 = 64.13%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.74%], valid : [loss = 2.665, top1 = 33.37%], test : [loss = 2.683, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.896, top1 = 68.22%], valid : [loss = 0.920, top1 = 67.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5076/15625) 005076-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.488, top1 = 89.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.59 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.338, top1 = 92.48%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.25 ms.
cifar100       train : [loss = 0.173, top1 = 95.72%], valid : [loss = 1.402, top1 = 67.97%], test : [loss = 1.408, top1 = 67.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.33%], valid : [loss = 2.289, top1 = 42.03%], test : [loss = 2.316, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.487, top1 = 83.06%], valid : [loss = 0.580, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5077/15625) 005077-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.42%], valid : [loss = 0.623, top1 = 85.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.423, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.61 ms.
cifar100       train : [loss = 0.660, top1 = 80.68%], valid : [loss = 1.404, top1 = 63.11%], test : [loss = 1.378, top1 = 63.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.474, top1 = 37.12%], valid : [loss = 2.614, top1 = 34.84%], test : [loss = 2.636, top1 = 34.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.58%], valid : [loss = 0.825, top1 = 71.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5078/15625) 005078-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5079/15625) 005079-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.81%], valid : [loss = 0.463, top1 = 86.40%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.70 ms.
cifar10        train : [loss = 0.122, top1 = 96.20%], test  : [loss = 0.336, top1 = 89.28%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.15 ms.
cifar100       train : [loss = 0.749, top1 = 79.10%], valid : [loss = 1.279, top1 = 64.76%], test : [loss = 1.273, top1 = 64.74%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 37.02%], valid : [loss = 2.572, top1 = 35.37%], test : [loss = 2.596, top1 = 34.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.60%], valid : [loss = 0.857, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5080/15625) 005080-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.543, top1 = 88.67%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.47 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.360, top1 = 91.69%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.74 ms.
cifar100       train : [loss = 0.311, top1 = 91.40%], valid : [loss = 1.419, top1 = 65.69%], test : [loss = 1.406, top1 = 66.21%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.92 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.33%], valid : [loss = 2.362, top1 = 39.53%], test : [loss = 2.365, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.37%], valid : [loss = 0.943, top1 = 66.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5081/15625) 005081-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.87%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.54 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.337, top1 = 93.12%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.08 ms.
cifar100       train : [loss = 0.070, top1 = 98.81%], valid : [loss = 1.382, top1 = 69.71%], test : [loss = 1.395, top1 = 69.15%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.51 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.88%], valid : [loss = 2.208, top1 = 43.37%], test : [loss = 2.196, top1 = 44.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.51%], valid : [loss = 0.707, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5082/15625) 005082-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.642, top1 = 86.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.411, top1 = 90.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.314, top1 = 91.62%], valid : [loss = 1.580, top1 = 63.42%], test : [loss = 1.609, top1 = 62.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.52%], valid : [loss = 2.585, top1 = 35.44%], test : [loss = 2.604, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.19%], valid : [loss = 0.870, top1 = 69.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5083/15625) 005083-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.529, top1 = 88.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.95 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.340, top1 = 91.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.22 ms.
cifar100       train : [loss = 0.330, top1 = 91.05%], valid : [loss = 1.281, top1 = 67.05%], test : [loss = 1.272, top1 = 67.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.09%], valid : [loss = 2.327, top1 = 40.19%], test : [loss = 2.336, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.92%], valid : [loss = 0.778, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5084/15625) 005084-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.03%], valid : [loss = 0.480, top1 = 84.17%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.92 ms.
cifar10        train : [loss = 0.300, top1 = 89.91%], test  : [loss = 0.404, top1 = 86.45%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.87 ms.
cifar100       train : [loss = 1.331, top1 = 63.05%], valid : [loss = 1.531, top1 = 58.11%], test : [loss = 1.504, top1 = 58.81%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.12 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.72%], valid : [loss = 2.908, top1 = 29.41%], test : [loss = 2.960, top1 = 27.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5085/15625) 005085-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.304, top1 = 89.49%], valid : [loss = 0.553, top1 = 82.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10        train : [loss = 0.298, top1 = 89.79%], test  : [loss = 0.426, top1 = 85.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.86 ms.
cifar100       train : [loss = 1.336, top1 = 62.45%], valid : [loss = 1.618, top1 = 55.95%], test : [loss = 1.606, top1 = 56.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 3.065, top1 = 25.81%], valid : [loss = 3.062, top1 = 25.99%], test : [loss = 3.144, top1 = 25.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.214, top1 = 56.09%], valid : [loss = 1.242, top1 = 55.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5086/15625) 005086-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.16%], valid : [loss = 0.461, top1 = 85.95%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.57 ms.
cifar10        train : [loss = 0.161, top1 = 94.66%], test  : [loss = 0.339, top1 = 88.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.77 ms.
cifar100       train : [loss = 1.012, top1 = 71.08%], valid : [loss = 1.355, top1 = 61.83%], test : [loss = 1.354, top1 = 61.69%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.55%], valid : [loss = 2.703, top1 = 32.34%], test : [loss = 2.720, top1 = 32.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.61%], valid : [loss = 0.746, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5087/15625) 005087-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.442, top1 = 90.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.20 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.287, top1 = 93.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.058, top1 = 99.25%], valid : [loss = 1.330, top1 = 70.65%], test : [loss = 1.318, top1 = 70.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 1.510, top1 = 59.08%], valid : [loss = 2.248, top1 = 44.24%], test : [loss = 2.276, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 88.00%], valid : [loss = 0.494, top1 = 83.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5088/15625) 005088-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.588, top1 = 87.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.041, top1 = 98.80%], test  : [loss = 0.397, top1 = 90.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.21 ms.
cifar100       train : [loss = 0.555, top1 = 83.65%], valid : [loss = 1.416, top1 = 63.57%], test : [loss = 1.402, top1 = 64.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.99%], valid : [loss = 2.626, top1 = 34.03%], test : [loss = 2.673, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 77.01%], valid : [loss = 0.728, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5089/15625) 005089-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.538, top1 = 89.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.355, top1 = 92.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.87 ms.
cifar100       train : [loss = 0.102, top1 = 98.23%], valid : [loss = 1.475, top1 = 67.91%], test : [loss = 1.476, top1 = 67.33%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.85%], valid : [loss = 2.417, top1 = 40.33%], test : [loss = 2.427, top1 = 40.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.68%], valid : [loss = 0.745, top1 = 74.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5090/15625) 005090-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.46%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.90 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.318, top1 = 92.86%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.17 ms.
cifar100       train : [loss = 0.110, top1 = 98.05%], valid : [loss = 1.324, top1 = 68.79%], test : [loss = 1.327, top1 = 69.49%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.78 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.20%], valid : [loss = 2.244, top1 = 42.80%], test : [loss = 2.243, top1 = 42.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.28%], valid : [loss = 0.738, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5091/15625) 005091-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.576, top1 = 87.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.383, top1 = 91.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.74 ms.
cifar100       train : [loss = 0.409, top1 = 88.48%], valid : [loss = 1.395, top1 = 65.25%], test : [loss = 1.384, top1 = 65.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.75%], valid : [loss = 2.513, top1 = 36.92%], test : [loss = 2.536, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.60%], valid : [loss = 0.823, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5092/15625) 005092-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.521, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.343, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.92 ms.
cifar100       train : [loss = 0.127, top1 = 97.31%], valid : [loss = 1.333, top1 = 68.69%], test : [loss = 1.333, top1 = 69.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.72%], valid : [loss = 2.321, top1 = 40.61%], test : [loss = 2.310, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.53%], valid : [loss = 0.784, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5093/15625) 005093-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.49%], valid : [loss = 0.703, top1 = 84.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10        train : [loss = 0.052, top1 = 98.44%], test  : [loss = 0.458, top1 = 88.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.63 ms.
cifar100       train : [loss = 0.484, top1 = 86.19%], valid : [loss = 1.584, top1 = 61.06%], test : [loss = 1.578, top1 = 60.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.399, top1 = 38.70%], valid : [loss = 2.708, top1 = 32.46%], test : [loss = 2.743, top1 = 33.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.67%], valid : [loss = 0.835, top1 = 70.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5094/15625) 005094-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.307, top1 = 89.29%], valid : [loss = 0.557, top1 = 82.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.295, top1 = 89.93%], test  : [loss = 0.432, top1 = 85.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.95 ms.
cifar100       train : [loss = 1.440, top1 = 59.67%], valid : [loss = 1.679, top1 = 54.63%], test : [loss = 1.662, top1 = 54.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 2.970, top1 = 27.39%], valid : [loss = 2.970, top1 = 27.74%], test : [loss = 3.017, top1 = 27.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.46%], valid : [loss = 1.040, top1 = 63.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5095/15625) 005095-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.510, top1 = 90.02%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.30 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.306, top1 = 93.79%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.12 ms.
cifar100       train : [loss = 0.021, top1 = 99.87%], valid : [loss = 1.375, top1 = 71.12%], test : [loss = 1.380, top1 = 70.95%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.388, top1 = 62.17%], valid : [loss = 2.405, top1 = 42.47%], test : [loss = 2.426, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.06%], valid : [loss = 0.660, top1 = 77.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5096/15625) 005096-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.523, top1 = 88.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.322, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.322, top1 = 91.20%], valid : [loss = 1.303, top1 = 66.91%], test : [loss = 1.286, top1 = 67.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.87%], valid : [loss = 2.408, top1 = 38.89%], test : [loss = 2.415, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.38%], valid : [loss = 0.724, top1 = 74.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5097/15625) 005097-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.481, top1 = 89.25%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.317, top1 = 92.21%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.02 ms.
cifar100       train : [loss = 0.282, top1 = 92.67%], valid : [loss = 1.227, top1 = 68.47%], test : [loss = 1.221, top1 = 68.38%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.61%], valid : [loss = 2.235, top1 = 42.10%], test : [loss = 2.259, top1 = 42.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.18%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5098/15625) 005098-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.517, top1 = 88.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.351, top1 = 91.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 0.478, top1 = 85.97%], valid : [loss = 1.329, top1 = 66.16%], test : [loss = 1.342, top1 = 65.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.34%], valid : [loss = 2.523, top1 = 36.41%], test : [loss = 2.548, top1 = 36.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5099/15625) 005099-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.538, top1 = 88.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.339, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.77 ms.
cifar100       train : [loss = 0.247, top1 = 93.48%], valid : [loss = 1.276, top1 = 68.29%], test : [loss = 1.263, top1 = 68.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.15%], valid : [loss = 2.237, top1 = 42.47%], test : [loss = 2.261, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.29%], valid : [loss = 0.734, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5100/15625) 005100-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.18 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5101/15625) 005101-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.596, top1 = 87.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.21 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.388, top1 = 91.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.37 ms.
cifar100       train : [loss = 0.174, top1 = 95.85%], valid : [loss = 1.504, top1 = 66.25%], test : [loss = 1.523, top1 = 66.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.06%], valid : [loss = 2.441, top1 = 38.67%], test : [loss = 2.463, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.83%], valid : [loss = 0.799, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5102/15625) 005102-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.65%], valid : [loss = 0.616, top1 = 84.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10        train : [loss = 0.091, top1 = 96.99%], test  : [loss = 0.417, top1 = 88.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 0.693, top1 = 79.57%], valid : [loss = 1.533, top1 = 60.38%], test : [loss = 1.521, top1 = 60.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 21.90%], valid : [loss = 3.199, top1 = 22.03%], test : [loss = 3.250, top1 = 21.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5103/15625) 005103-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.545, top1 = 88.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.353, top1 = 91.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.13 ms.
cifar100       train : [loss = 0.446, top1 = 87.04%], valid : [loss = 1.255, top1 = 66.83%], test : [loss = 1.250, top1 = 67.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.42%], valid : [loss = 2.369, top1 = 39.54%], test : [loss = 2.383, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.72%], valid : [loss = 0.787, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5104/15625) 005104-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.56%], valid : [loss = 0.691, top1 = 83.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.072, top1 = 97.67%], test  : [loss = 0.469, top1 = 87.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.20 ms.
cifar100       train : [loss = 0.444, top1 = 87.18%], valid : [loss = 1.614, top1 = 60.89%], test : [loss = 1.652, top1 = 60.45%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 3.050, top1 = 25.28%], valid : [loss = 3.123, top1 = 24.58%], test : [loss = 3.140, top1 = 23.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 59.57%], valid : [loss = 1.157, top1 = 58.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5105/15625) 005105-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.515, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.58 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.336, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.99 ms.
cifar100       train : [loss = 0.292, top1 = 92.15%], valid : [loss = 1.269, top1 = 67.89%], test : [loss = 1.298, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 44.99%], valid : [loss = 2.391, top1 = 39.14%], test : [loss = 2.406, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.34%], valid : [loss = 0.783, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5106/15625) 005106-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.92%], valid : [loss = 0.645, top1 = 84.60%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.41 ms.
cifar10        train : [loss = 0.070, top1 = 97.78%], test  : [loss = 0.410, top1 = 88.85%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.35 ms.
cifar100       train : [loss = 0.757, top1 = 77.69%], valid : [loss = 1.446, top1 = 61.86%], test : [loss = 1.418, top1 = 62.17%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.33%], valid : [loss = 2.681, top1 = 33.51%], test : [loss = 2.705, top1 = 32.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.20%], valid : [loss = 0.847, top1 = 70.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5107/15625) 005107-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.602, top1 = 87.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.416, top1 = 90.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.79 ms.
cifar100       train : [loss = 0.210, top1 = 95.13%], valid : [loss = 1.439, top1 = 66.39%], test : [loss = 1.412, top1 = 66.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.80%], valid : [loss = 2.506, top1 = 37.17%], test : [loss = 2.511, top1 = 38.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.62%], valid : [loss = 0.751, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5108/15625) 005108-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.427, top1 = 90.49%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.80 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.289, top1 = 93.10%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.25 ms.
cifar100       train : [loss = 0.130, top1 = 97.34%], valid : [loss = 1.283, top1 = 69.93%], test : [loss = 1.258, top1 = 70.29%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 1.648, top1 = 55.73%], valid : [loss = 2.177, top1 = 44.78%], test : [loss = 2.195, top1 = 44.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.68%], valid : [loss = 0.539, top1 = 81.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5109/15625) 005109-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.567, top1 = 88.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.015, top1 = 99.58%], test  : [loss = 0.376, top1 = 91.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.70 ms.
cifar100       train : [loss = 0.201, top1 = 94.89%], valid : [loss = 1.334, top1 = 68.18%], test : [loss = 1.328, top1 = 68.53%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.69%], valid : [loss = 2.284, top1 = 41.54%], test : [loss = 2.296, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.82%], valid : [loss = 0.925, top1 = 67.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5110/15625) 005110-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.12%], valid : [loss = 0.458, top1 = 86.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10        train : [loss = 0.155, top1 = 94.99%], test  : [loss = 0.348, top1 = 88.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.99 ms.
cifar100       train : [loss = 0.995, top1 = 71.57%], valid : [loss = 1.356, top1 = 62.17%], test : [loss = 1.346, top1 = 62.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.70%], valid : [loss = 2.697, top1 = 32.62%], test : [loss = 2.710, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5111/15625) 005111-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.420, top1 = 91.34%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.263, top1 = 94.31%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.66 ms.
cifar100       train : [loss = 0.039, top1 = 99.51%], valid : [loss = 1.306, top1 = 71.66%], test : [loss = 1.284, top1 = 72.37%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.85 ms.
ImageNet16-120 train : [loss = 1.355, top1 = 62.91%], valid : [loss = 2.154, top1 = 46.49%], test : [loss = 2.180, top1 = 46.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.323, top1 = 89.08%], valid : [loss = 0.469, top1 = 84.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5112/15625) 005112-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.48 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.319, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.11 ms.
cifar100       train : [loss = 0.326, top1 = 91.12%], valid : [loss = 1.296, top1 = 67.31%], test : [loss = 1.300, top1 = 67.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.26%], valid : [loss = 2.368, top1 = 39.79%], test : [loss = 2.407, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.63%], valid : [loss = 0.557, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5113/15625) 005113-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.619, top1 = 86.51%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.403, top1 = 90.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.89 ms.
cifar100       train : [loss = 0.514, top1 = 84.95%], valid : [loss = 1.451, top1 = 63.49%], test : [loss = 1.435, top1 = 63.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.35%], valid : [loss = 2.542, top1 = 36.08%], test : [loss = 2.590, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.47%], valid : [loss = 0.856, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5114/15625) 005114-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.552, top1 = 88.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.355, top1 = 91.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.65 ms.
cifar100       train : [loss = 0.332, top1 = 90.88%], valid : [loss = 1.300, top1 = 67.24%], test : [loss = 1.319, top1 = 66.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.66%], valid : [loss = 2.453, top1 = 37.83%], test : [loss = 2.452, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.75%], valid : [loss = 0.833, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5115/15625) 005115-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=21.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.485, top1 = 90.36%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=22.77 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.303, top1 = 93.67%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=21.47 ms.
cifar100       train : [loss = 0.035, top1 = 99.69%], valid : [loss = 1.279, top1 = 71.05%], test : [loss = 1.268, top1 = 71.55%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=20.95 ms.
ImageNet16-120 train : [loss = 1.681, top1 = 54.87%], valid : [loss = 2.205, top1 = 43.03%], test : [loss = 2.193, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.40%], valid : [loss = 0.743, top1 = 74.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5116/15625) 005116-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.553, top1 = 89.11%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.368, top1 = 92.60%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.41 ms.
cifar100       train : [loss = 0.047, top1 = 99.39%], valid : [loss = 1.467, top1 = 69.11%], test : [loss = 1.500, top1 = 69.20%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.85 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 54.02%], valid : [loss = 2.429, top1 = 39.94%], test : [loss = 2.439, top1 = 40.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.84%], valid : [loss = 0.707, top1 = 75.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5117/15625) 005117-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.57 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.52%], valid : [loss = 0.462, top1 = 86.45%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.71 ms.
cifar10        train : [loss = 0.117, top1 = 96.34%], test  : [loss = 0.337, top1 = 89.10%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.12 ms.
cifar100       train : [loss = 0.777, top1 = 78.18%], valid : [loss = 1.298, top1 = 64.58%], test : [loss = 1.291, top1 = 64.27%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.26 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.73%], valid : [loss = 2.584, top1 = 34.97%], test : [loss = 2.606, top1 = 34.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.12%], valid : [loss = 0.852, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5118/15625) 005118-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.78%], valid : [loss = 0.672, top1 = 77.42%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10        train : [loss = 0.534, top1 = 81.47%], test  : [loss = 0.602, top1 = 79.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.36 ms.
cifar100       train : [loss = 1.694, top1 = 54.05%], valid : [loss = 1.848, top1 = 50.53%], test : [loss = 1.866, top1 = 50.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 3.336, top1 = 21.13%], valid : [loss = 3.317, top1 = 21.47%], test : [loss = 3.347, top1 = 21.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5119/15625) 005119-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.57%], valid : [loss = 0.819, top1 = 81.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10        train : [loss = 0.093, top1 = 97.03%], test  : [loss = 0.496, top1 = 86.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 0.814, top1 = 76.23%], valid : [loss = 1.558, top1 = 59.77%], test : [loss = 1.521, top1 = 60.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.841, top1 = 29.85%], valid : [loss = 2.970, top1 = 27.51%], test : [loss = 3.013, top1 = 27.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.98%], valid : [loss = 0.877, top1 = 69.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5120/15625) 005120-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.464, top1 = 90.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.301, top1 = 93.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.106, top1 = 97.87%], valid : [loss = 1.338, top1 = 70.20%], test : [loss = 1.318, top1 = 70.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.687, top1 = 54.84%], valid : [loss = 2.223, top1 = 43.49%], test : [loss = 2.277, top1 = 43.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.78%], valid : [loss = 0.543, top1 = 81.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5121/15625) 005121-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.47%], valid : [loss = 0.573, top1 = 87.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.44 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.360, top1 = 91.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.514, top1 = 85.16%], valid : [loss = 1.348, top1 = 64.86%], test : [loss = 1.367, top1 = 64.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 34.96%], valid : [loss = 2.648, top1 = 32.54%], test : [loss = 2.666, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 67.42%], valid : [loss = 0.959, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5122/15625) 005122-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.611, top1 = 86.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.405, top1 = 90.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.17 ms.
cifar100       train : [loss = 0.509, top1 = 85.13%], valid : [loss = 1.408, top1 = 64.51%], test : [loss = 1.411, top1 = 64.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.14%], valid : [loss = 2.547, top1 = 35.44%], test : [loss = 2.563, top1 = 36.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.55%], valid : [loss = 0.835, top1 = 70.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5123/15625) 005123-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.85 ms.
cifar10-valid  train : [loss = 1.114, top1 = 60.33%], valid : [loss = 1.157, top1 = 59.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10        train : [loss = 1.046, top1 = 63.17%], test  : [loss = 1.050, top1 = 62.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 2.573, top1 = 35.03%], valid : [loss = 2.652, top1 = 33.59%], test : [loss = 2.627, top1 = 34.27%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.91 ms.
ImageNet16-120 train : [loss = 3.787, top1 = 13.65%], valid : [loss = 3.776, top1 = 14.00%], test : [loss = 3.791, top1 = 14.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5124/15625) 005124-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.16%], valid : [loss = 0.529, top1 = 84.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10        train : [loss = 0.180, top1 = 93.91%], test  : [loss = 0.378, top1 = 87.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 1.205, top1 = 65.76%], valid : [loss = 1.513, top1 = 58.31%], test : [loss = 1.506, top1 = 58.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.87%], valid : [loss = 2.687, top1 = 33.31%], test : [loss = 2.752, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.44%], valid : [loss = 0.973, top1 = 65.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5125/15625) 005125-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.58%], valid : [loss = 0.714, top1 = 76.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.438, top1 = 84.62%], test  : [loss = 0.577, top1 = 80.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 1.807, top1 = 50.90%], valid : [loss = 1.989, top1 = 47.31%], test : [loss = 1.985, top1 = 47.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.25 ms.
ImageNet16-120 train : [loss = 3.455, top1 = 18.63%], valid : [loss = 3.450, top1 = 19.39%], test : [loss = 3.485, top1 = 17.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.233, top1 = 55.32%], valid : [loss = 1.265, top1 = 54.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5126/15625) 005126-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.788, top1 = 83.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.469, top1 = 88.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.54 ms.
cifar100       train : [loss = 0.366, top1 = 90.14%], valid : [loss = 1.707, top1 = 60.65%], test : [loss = 1.708, top1 = 60.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.62%], valid : [loss = 2.649, top1 = 33.79%], test : [loss = 2.669, top1 = 34.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.54%], valid : [loss = 0.860, top1 = 69.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5127/15625) 005127-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.541, top1 = 88.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.348, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.67 ms.
cifar100       train : [loss = 0.172, top1 = 96.20%], valid : [loss = 1.296, top1 = 68.49%], test : [loss = 1.313, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 2.020, top1 = 47.00%], valid : [loss = 2.344, top1 = 40.26%], test : [loss = 2.330, top1 = 40.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 77.12%], valid : [loss = 0.725, top1 = 75.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5128/15625) 005128-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.602, top1 = 87.49%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.36 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.399, top1 = 91.05%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.81 ms.
cifar100       train : [loss = 0.217, top1 = 94.69%], valid : [loss = 1.598, top1 = 64.03%], test : [loss = 1.581, top1 = 64.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.50 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.16%], valid : [loss = 2.473, top1 = 37.83%], test : [loss = 2.477, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.52%], valid : [loss = 0.799, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5129/15625) 005129-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.613, top1 = 86.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.402, top1 = 90.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.66 ms.
cifar100       train : [loss = 0.517, top1 = 84.86%], valid : [loss = 1.435, top1 = 63.64%], test : [loss = 1.411, top1 = 64.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.397, top1 = 38.91%], valid : [loss = 2.568, top1 = 35.36%], test : [loss = 2.595, top1 = 34.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.98%], valid : [loss = 0.852, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5130/15625) 005130-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.550, top1 = 87.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 0.032, top1 = 98.99%], test  : [loss = 0.359, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.08 ms.
cifar100       train : [loss = 0.424, top1 = 87.75%], valid : [loss = 1.286, top1 = 66.47%], test : [loss = 1.291, top1 = 66.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 43.88%], valid : [loss = 2.360, top1 = 40.33%], test : [loss = 2.377, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.00%], valid : [loss = 0.817, top1 = 70.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5131/15625) 005131-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.166, top1 = 94.57%], valid : [loss = 0.526, top1 = 84.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.173, top1 = 94.21%], test  : [loss = 0.377, top1 = 88.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 1.201, top1 = 65.88%], valid : [loss = 1.505, top1 = 58.85%], test : [loss = 1.509, top1 = 58.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.33 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.84%], valid : [loss = 2.682, top1 = 32.87%], test : [loss = 2.719, top1 = 31.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.42%], valid : [loss = 0.958, top1 = 66.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5132/15625) 005132-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.63 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.23%], valid : [loss = 0.459, top1 = 86.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.113, top1 = 96.52%], test  : [loss = 0.332, top1 = 89.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.60 ms.
cifar100       train : [loss = 0.860, top1 = 75.62%], valid : [loss = 1.306, top1 = 63.76%], test : [loss = 1.290, top1 = 63.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.96 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.74%], valid : [loss = 2.625, top1 = 34.21%], test : [loss = 2.648, top1 = 33.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5133/15625) 005133-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.580, top1 = 87.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.30 ms.
cifar10        train : [loss = 0.019, top1 = 99.54%], test  : [loss = 0.391, top1 = 91.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.20 ms.
cifar100       train : [loss = 0.414, top1 = 88.18%], valid : [loss = 1.402, top1 = 65.03%], test : [loss = 1.399, top1 = 65.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.322, top1 = 40.47%], valid : [loss = 2.522, top1 = 36.71%], test : [loss = 2.546, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.54%], valid : [loss = 0.842, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5134/15625) 005134-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.49%], valid : [loss = 0.630, top1 = 86.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10        train : [loss = 0.033, top1 = 99.08%], test  : [loss = 0.410, top1 = 89.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.09 ms.
cifar100       train : [loss = 0.541, top1 = 84.11%], valid : [loss = 1.429, top1 = 63.49%], test : [loss = 1.419, top1 = 63.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.50%], valid : [loss = 2.552, top1 = 36.10%], test : [loss = 2.591, top1 = 35.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.14%], valid : [loss = 0.889, top1 = 68.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5135/15625) 005135-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.284, top1 = 90.15%], valid : [loss = 0.852, top1 = 75.38%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.10 ms.
cifar10        train : [loss = 0.322, top1 = 88.80%], test  : [loss = 0.616, top1 = 80.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.07 ms.
cifar100       train : [loss = 1.384, top1 = 61.25%], valid : [loss = 1.929, top1 = 49.81%], test : [loss = 1.932, top1 = 49.82%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 3.550, top1 = 16.37%], valid : [loss = 3.561, top1 = 16.82%], test : [loss = 3.559, top1 = 16.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.252, top1 = 54.24%], valid : [loss = 1.289, top1 = 53.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5136/15625) 005136-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.43%], valid : [loss = 0.462, top1 = 86.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.160, top1 = 94.73%], test  : [loss = 0.347, top1 = 88.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.41 ms.
cifar100       train : [loss = 1.018, top1 = 71.17%], valid : [loss = 1.377, top1 = 61.73%], test : [loss = 1.354, top1 = 61.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.71%], valid : [loss = 2.691, top1 = 32.67%], test : [loss = 2.704, top1 = 32.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5137/15625) 005137-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.579, top1 = 87.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.389, top1 = 91.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 0.347, top1 = 90.28%], valid : [loss = 1.438, top1 = 65.05%], test : [loss = 1.420, top1 = 65.55%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.14%], valid : [loss = 2.494, top1 = 37.41%], test : [loss = 2.498, top1 = 37.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.48%], valid : [loss = 0.852, top1 = 70.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5138/15625) 005138-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.527, top1 = 88.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.345, top1 = 91.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.42 ms.
cifar100       train : [loss = 0.339, top1 = 90.74%], valid : [loss = 1.277, top1 = 66.93%], test : [loss = 1.298, top1 = 66.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.39%], valid : [loss = 2.413, top1 = 38.68%], test : [loss = 2.410, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5139/15625) 005139-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.605, top1 = 86.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.027, top1 = 99.23%], test  : [loss = 0.394, top1 = 90.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.37 ms.
cifar100       train : [loss = 0.291, top1 = 91.81%], valid : [loss = 1.553, top1 = 64.19%], test : [loss = 1.569, top1 = 63.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 32.46%], valid : [loss = 2.774, top1 = 30.56%], test : [loss = 2.779, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 64.73%], valid : [loss = 1.010, top1 = 64.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5140/15625) 005140-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.517, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.349, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.86 ms.
cifar100       train : [loss = 0.236, top1 = 94.00%], valid : [loss = 1.375, top1 = 67.30%], test : [loss = 1.369, top1 = 67.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.003, top1 = 47.55%], valid : [loss = 2.385, top1 = 39.91%], test : [loss = 2.412, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.77%], valid : [loss = 0.620, top1 = 79.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5141/15625) 005141-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.25%], valid : [loss = 0.674, top1 = 83.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10        train : [loss = 0.085, top1 = 97.21%], test  : [loss = 0.403, top1 = 88.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.38 ms.
cifar100       train : [loss = 0.742, top1 = 78.17%], valid : [loss = 1.470, top1 = 61.43%], test : [loss = 1.457, top1 = 61.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.60%], valid : [loss = 2.700, top1 = 32.14%], test : [loss = 2.731, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.67%], valid : [loss = 1.047, top1 = 62.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5142/15625) 005142-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.55%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.99 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.319, top1 = 92.73%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.80 ms.
cifar100       train : [loss = 0.124, top1 = 97.65%], valid : [loss = 1.287, top1 = 69.53%], test : [loss = 1.315, top1 = 69.28%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.43 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.43%], valid : [loss = 2.246, top1 = 42.63%], test : [loss = 2.235, top1 = 43.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.87%], valid : [loss = 0.655, top1 = 77.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5143/15625) 005143-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.66%], valid : [loss = 0.548, top1 = 83.40%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.200, top1 = 93.22%], test  : [loss = 0.398, top1 = 87.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.21 ms.
cifar100       train : [loss = 1.244, top1 = 64.61%], valid : [loss = 1.566, top1 = 57.49%], test : [loss = 1.556, top1 = 57.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.86 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.87%], valid : [loss = 2.717, top1 = 32.41%], test : [loss = 2.742, top1 = 31.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 64.85%], valid : [loss = 1.015, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5144/15625) 005144-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.450, top1 = 90.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.290, top1 = 93.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.147, top1 = 96.79%], valid : [loss = 1.318, top1 = 69.43%], test : [loss = 1.299, top1 = 69.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 53.06%], valid : [loss = 2.263, top1 = 42.86%], test : [loss = 2.302, top1 = 42.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.408, top1 = 85.94%], valid : [loss = 0.541, top1 = 82.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5145/15625) 005145-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.17 ms.
cifar10-valid  train : [loss = 0.268, top1 = 90.67%], valid : [loss = 0.537, top1 = 83.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.249, top1 = 91.37%], test  : [loss = 0.406, top1 = 86.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.335, top1 = 62.17%], valid : [loss = 1.604, top1 = 56.33%], test : [loss = 1.607, top1 = 56.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.810, top1 = 30.47%], valid : [loss = 2.825, top1 = 30.28%], test : [loss = 2.869, top1 = 29.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.12%], valid : [loss = 0.995, top1 = 64.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5146/15625) 005146-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.74%], valid : [loss = 0.460, top1 = 86.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10        train : [loss = 0.154, top1 = 94.94%], test  : [loss = 0.341, top1 = 88.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.90 ms.
cifar100       train : [loss = 0.981, top1 = 72.21%], valid : [loss = 1.352, top1 = 62.59%], test : [loss = 1.335, top1 = 62.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.93%], valid : [loss = 2.676, top1 = 33.02%], test : [loss = 2.709, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.769, top1 = 72.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5147/15625) 005147-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.521, top1 = 88.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.364, top1 = 90.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.81 ms.
cifar100       train : [loss = 0.472, top1 = 86.17%], valid : [loss = 1.348, top1 = 65.58%], test : [loss = 1.341, top1 = 65.99%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.22%], valid : [loss = 2.531, top1 = 36.78%], test : [loss = 2.550, top1 = 36.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5148/15625) 005148-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.81%], valid : [loss = 0.473, top1 = 84.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.303, top1 = 89.87%], test  : [loss = 0.399, top1 = 86.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.43 ms.
cifar100       train : [loss = 1.324, top1 = 63.43%], valid : [loss = 1.529, top1 = 58.27%], test : [loss = 1.502, top1 = 58.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.52%], valid : [loss = 2.920, top1 = 29.00%], test : [loss = 2.958, top1 = 28.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5149/15625) 005149-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.462, top1 = 89.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.327, top1 = 91.16%], valid : [loss = 1.316, top1 = 67.01%], test : [loss = 1.297, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.21%], valid : [loss = 2.362, top1 = 40.47%], test : [loss = 2.409, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.89%], valid : [loss = 0.559, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5150/15625) 005150-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.493, top1 = 88.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.317, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.320, top1 = 91.43%], valid : [loss = 1.255, top1 = 67.69%], test : [loss = 1.259, top1 = 67.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.70%], valid : [loss = 2.322, top1 = 40.44%], test : [loss = 2.345, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5151/15625) 005151-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.484, top1 = 90.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.331, top1 = 92.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.088, top1 = 98.36%], valid : [loss = 1.412, top1 = 69.37%], test : [loss = 1.368, top1 = 69.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 1.645, top1 = 55.95%], valid : [loss = 2.248, top1 = 43.82%], test : [loss = 2.285, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.449, top1 = 84.19%], valid : [loss = 0.566, top1 = 80.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5152/15625) 005152-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.23%], valid : [loss = 0.672, top1 = 77.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10        train : [loss = 0.557, top1 = 80.53%], test  : [loss = 0.625, top1 = 78.71%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.50 ms.
cifar100       train : [loss = 1.751, top1 = 52.46%], valid : [loss = 1.895, top1 = 49.39%], test : [loss = 1.916, top1 = 49.73%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.58 ms.
ImageNet16-120 train : [loss = 3.389, top1 = 20.07%], valid : [loss = 3.364, top1 = 20.98%], test : [loss = 3.419, top1 = 19.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5153/15625) 005153-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.67%], valid : [loss = 0.449, top1 = 86.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.148, top1 = 95.19%], test  : [loss = 0.344, top1 = 89.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.12 ms.
cifar100       train : [loss = 0.957, top1 = 72.77%], valid : [loss = 1.334, top1 = 62.48%], test : [loss = 1.319, top1 = 62.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 34.33%], valid : [loss = 2.657, top1 = 33.41%], test : [loss = 2.696, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5154/15625) 005154-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.66%], valid : [loss = 0.668, top1 = 77.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 0.363, top1 = 87.42%], test  : [loss = 0.486, top1 = 83.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.45 ms.
cifar100       train : [loss = 1.619, top1 = 55.22%], valid : [loss = 1.854, top1 = 50.26%], test : [loss = 1.855, top1 = 50.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.46%], valid : [loss = 3.236, top1 = 22.99%], test : [loss = 3.285, top1 = 21.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.223, top1 = 55.87%], valid : [loss = 1.251, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5155/15625) 005155-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.580, top1 = 88.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.392, top1 = 91.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.61 ms.
cifar100       train : [loss = 0.143, top1 = 97.04%], valid : [loss = 1.532, top1 = 66.12%], test : [loss = 1.570, top1 = 65.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.93%], valid : [loss = 2.411, top1 = 39.91%], test : [loss = 2.430, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.98%], valid : [loss = 0.736, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5156/15625) 005156-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.505, top1 = 88.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.328, top1 = 91.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.01 ms.
cifar100       train : [loss = 0.293, top1 = 92.31%], valid : [loss = 1.234, top1 = 68.47%], test : [loss = 1.215, top1 = 68.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.83%], valid : [loss = 2.251, top1 = 42.79%], test : [loss = 2.267, top1 = 41.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.64%], valid : [loss = 0.630, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5157/15625) 005157-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.07%], valid : [loss = 0.462, top1 = 85.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.163, top1 = 94.64%], test  : [loss = 0.347, top1 = 88.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.11 ms.
cifar100       train : [loss = 1.020, top1 = 71.08%], valid : [loss = 1.376, top1 = 61.91%], test : [loss = 1.348, top1 = 61.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.84%], valid : [loss = 2.682, top1 = 32.58%], test : [loss = 2.712, top1 = 31.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.29%], valid : [loss = 0.766, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5158/15625) 005158-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.56%], valid : [loss = 0.519, top1 = 85.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10        train : [loss = 0.100, top1 = 96.87%], test  : [loss = 0.350, top1 = 89.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.67 ms.
cifar100       train : [loss = 0.763, top1 = 77.78%], valid : [loss = 1.356, top1 = 63.57%], test : [loss = 1.341, top1 = 63.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.468, top1 = 37.40%], valid : [loss = 2.590, top1 = 35.24%], test : [loss = 2.601, top1 = 35.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.855, top1 = 69.27%], valid : [loss = 0.911, top1 = 67.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5159/15625) 005159-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.28%], valid : [loss = 0.860, top1 = 71.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.553, top1 = 80.76%], test  : [loss = 0.712, top1 = 75.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 1.773, top1 = 52.29%], valid : [loss = 2.049, top1 = 47.25%], test : [loss = 2.058, top1 = 47.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.76%], valid : [loss = 3.644, top1 = 16.52%], test : [loss = 3.668, top1 = 15.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5160/15625) 005160-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.655, top1 = 86.01%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.54 ms.
cifar10        train : [loss = 0.021, top1 = 99.52%], test  : [loss = 0.446, top1 = 89.57%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.50 ms.
cifar100       train : [loss = 0.306, top1 = 92.12%], valid : [loss = 1.484, top1 = 64.62%], test : [loss = 1.493, top1 = 64.17%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.24%], valid : [loss = 2.602, top1 = 35.29%], test : [loss = 2.596, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 73.92%], valid : [loss = 0.806, top1 = 71.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5161/15625) 005161-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.615, top1 = 86.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.031, top1 = 99.14%], test  : [loss = 0.394, top1 = 90.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.59 ms.
cifar100       train : [loss = 0.519, top1 = 84.91%], valid : [loss = 1.424, top1 = 63.95%], test : [loss = 1.424, top1 = 64.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.17%], valid : [loss = 2.566, top1 = 35.16%], test : [loss = 2.581, top1 = 35.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5162/15625) 005162-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.86%], valid : [loss = 0.545, top1 = 82.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10        train : [loss = 0.253, top1 = 91.31%], test  : [loss = 0.406, top1 = 86.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 1.368, top1 = 61.54%], valid : [loss = 1.639, top1 = 55.33%], test : [loss = 1.617, top1 = 55.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.22%], valid : [loss = 2.932, top1 = 27.82%], test : [loss = 2.994, top1 = 27.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.997, top1 = 64.23%], valid : [loss = 1.019, top1 = 63.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5163/15625) 005163-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.16%], valid : [loss = 0.475, top1 = 84.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 0.297, top1 = 90.03%], test  : [loss = 0.398, top1 = 86.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 1.328, top1 = 63.21%], valid : [loss = 1.539, top1 = 57.90%], test : [loss = 1.512, top1 = 58.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.45%], valid : [loss = 2.909, top1 = 29.17%], test : [loss = 2.963, top1 = 28.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5164/15625) 005164-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.65%], valid : [loss = 0.628, top1 = 84.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.69 ms.
cifar10        train : [loss = 0.083, top1 = 97.33%], test  : [loss = 0.421, top1 = 88.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.19 ms.
cifar100       train : [loss = 0.783, top1 = 76.97%], valid : [loss = 1.443, top1 = 61.95%], test : [loss = 1.421, top1 = 61.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.11%], valid : [loss = 2.735, top1 = 31.81%], test : [loss = 2.758, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5165/15625) 005165-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.555, top1 = 87.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.68 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.377, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.387, top1 = 89.10%], valid : [loss = 1.377, top1 = 65.46%], test : [loss = 1.367, top1 = 66.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.78%], valid : [loss = 2.474, top1 = 37.60%], test : [loss = 2.502, top1 = 37.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.57%], valid : [loss = 0.760, top1 = 73.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5166/15625) 005166-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.65%], valid : [loss = 0.588, top1 = 87.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10        train : [loss = 0.029, top1 = 99.18%], test  : [loss = 0.373, top1 = 90.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.421, top1 = 87.97%], valid : [loss = 1.455, top1 = 63.92%], test : [loss = 1.440, top1 = 64.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 34.88%], valid : [loss = 2.662, top1 = 32.44%], test : [loss = 2.679, top1 = 32.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.162, top1 = 58.02%], valid : [loss = 1.177, top1 = 57.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5167/15625) 005167-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.65%], valid : [loss = 0.467, top1 = 86.18%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.49 ms.
cifar10        train : [loss = 0.118, top1 = 96.32%], test  : [loss = 0.340, top1 = 89.31%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.34 ms.
cifar100       train : [loss = 0.751, top1 = 79.03%], valid : [loss = 1.282, top1 = 64.55%], test : [loss = 1.277, top1 = 64.89%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.11 ms.
ImageNet16-120 train : [loss = 2.510, top1 = 36.53%], valid : [loss = 2.605, top1 = 34.43%], test : [loss = 2.620, top1 = 34.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.88%], valid : [loss = 0.841, top1 = 70.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5168/15625) 005168-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5169/15625) 005169-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.527, top1 = 89.54%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.39 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.45%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.13 ms.
cifar100       train : [loss = 0.071, top1 = 98.93%], valid : [loss = 1.362, top1 = 69.44%], test : [loss = 1.334, top1 = 69.50%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.34 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 52.10%], valid : [loss = 2.305, top1 = 41.32%], test : [loss = 2.278, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.55%], valid : [loss = 0.688, top1 = 76.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5170/15625) 005170-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.13%], valid : [loss = 1.110, top1 = 63.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.04 ms.
cifar10        train : [loss = 0.773, top1 = 72.92%], test  : [loss = 0.912, top1 = 68.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.17 ms.
cifar100       train : [loss = 2.133, top1 = 44.14%], valid : [loss = 2.402, top1 = 39.44%], test : [loss = 2.404, top1 = 39.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.38 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.89%], valid : [loss = 3.822, top1 = 13.38%], test : [loss = 3.834, top1 = 13.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5171/15625) 005171-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.94%], valid : [loss = 1.278, top1 = 54.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10        train : [loss = 1.143, top1 = 59.34%], test  : [loss = 1.136, top1 = 59.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.37 ms.
cifar100       train : [loss = 2.658, top1 = 33.31%], valid : [loss = 2.738, top1 = 32.37%], test : [loss = 2.720, top1 = 32.40%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.84 ms.
ImageNet16-120 train : [loss = 3.835, top1 = 12.90%], valid : [loss = 3.822, top1 = 13.98%], test : [loss = 3.846, top1 = 13.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.670, top1 = 37.32%], valid : [loss = 1.694, top1 = 35.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5172/15625) 005172-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.549, top1 = 87.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10        train : [loss = 0.025, top1 = 99.28%], test  : [loss = 0.353, top1 = 91.45%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.90 ms.
cifar100       train : [loss = 0.426, top1 = 87.62%], valid : [loss = 1.264, top1 = 66.67%], test : [loss = 1.261, top1 = 67.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.24%], valid : [loss = 2.391, top1 = 39.47%], test : [loss = 2.446, top1 = 38.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.86%], valid : [loss = 0.850, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5173/15625) 005173-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.563, top1 = 88.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.31 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.358, top1 = 92.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 0.183, top1 = 95.35%], valid : [loss = 1.413, top1 = 67.73%], test : [loss = 1.414, top1 = 67.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.60%], valid : [loss = 2.453, top1 = 37.84%], test : [loss = 2.460, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.10%], valid : [loss = 0.955, top1 = 65.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5174/15625) 005174-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.98%], valid : [loss = 0.476, top1 = 84.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.83 ms.
cifar10        train : [loss = 0.303, top1 = 89.81%], test  : [loss = 0.402, top1 = 86.55%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.89 ms.
cifar100       train : [loss = 1.333, top1 = 62.92%], valid : [loss = 1.542, top1 = 57.79%], test : [loss = 1.523, top1 = 58.25%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.40 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.68%], valid : [loss = 2.906, top1 = 29.16%], test : [loss = 2.962, top1 = 27.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5175/15625) 005175-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.31 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5176/15625) 005176-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.05 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.491, top1 = 90.42%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.296, top1 = 93.75%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.47 ms.
cifar100       train : [loss = 0.039, top1 = 99.58%], valid : [loss = 1.323, top1 = 71.01%], test : [loss = 1.328, top1 = 70.96%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.62 ms.
ImageNet16-120 train : [loss = 1.432, top1 = 60.95%], valid : [loss = 2.147, top1 = 45.53%], test : [loss = 2.152, top1 = 45.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.73%], valid : [loss = 0.695, top1 = 75.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5177/15625) 005177-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.318, top1 = 89.06%], valid : [loss = 0.544, top1 = 82.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.274, top1 = 90.59%], test  : [loss = 0.418, top1 = 86.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 1.497, top1 = 58.28%], valid : [loss = 1.713, top1 = 53.35%], test : [loss = 1.704, top1 = 53.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.963, top1 = 27.43%], valid : [loss = 2.970, top1 = 27.58%], test : [loss = 3.014, top1 = 26.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.41%], valid : [loss = 1.053, top1 = 62.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5178/15625) 005178-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.462, top1 = 89.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.327, top1 = 92.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.79 ms.
cifar100       train : [loss = 0.195, top1 = 95.32%], valid : [loss = 1.349, top1 = 68.14%], test : [loss = 1.327, top1 = 68.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.38%], valid : [loss = 2.303, top1 = 41.54%], test : [loss = 2.300, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 84.08%], valid : [loss = 0.553, top1 = 81.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5179/15625) 005179-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.94%], valid : [loss = 0.745, top1 = 83.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.13 ms.
cifar10        train : [loss = 0.088, top1 = 97.21%], test  : [loss = 0.490, top1 = 87.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.80 ms.
cifar100       train : [loss = 0.807, top1 = 76.47%], valid : [loss = 1.548, top1 = 59.57%], test : [loss = 1.544, top1 = 59.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.823, top1 = 30.18%], valid : [loss = 2.933, top1 = 28.24%], test : [loss = 2.997, top1 = 28.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.85%], valid : [loss = 0.881, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5180/15625) 005180-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.734, top1 = 84.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.042, top1 = 98.80%], test  : [loss = 0.503, top1 = 87.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.25 ms.
cifar100       train : [loss = 0.444, top1 = 87.60%], valid : [loss = 1.590, top1 = 61.44%], test : [loss = 1.593, top1 = 61.89%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.575, top1 = 35.14%], valid : [loss = 2.900, top1 = 29.52%], test : [loss = 2.928, top1 = 28.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.17%], valid : [loss = 0.846, top1 = 70.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5181/15625) 005181-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.316, top1 = 92.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.76 ms.
cifar100       train : [loss = 0.327, top1 = 91.21%], valid : [loss = 1.242, top1 = 67.87%], test : [loss = 1.244, top1 = 68.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.77%], valid : [loss = 2.322, top1 = 40.54%], test : [loss = 2.343, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5182/15625) 005182-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.533, top1 = 88.49%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.15 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.348, top1 = 91.80%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.39 ms.
cifar100       train : [loss = 0.303, top1 = 91.79%], valid : [loss = 1.255, top1 = 68.09%], test : [loss = 1.248, top1 = 67.99%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.66%], valid : [loss = 2.274, top1 = 41.96%], test : [loss = 2.288, top1 = 41.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.06%], valid : [loss = 0.742, top1 = 74.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5183/15625) 005183-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.535, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.25 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.332, top1 = 92.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.69 ms.
cifar100       train : [loss = 0.216, top1 = 94.41%], valid : [loss = 1.275, top1 = 68.73%], test : [loss = 1.262, top1 = 68.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.63%], valid : [loss = 2.277, top1 = 41.64%], test : [loss = 2.286, top1 = 42.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 73.95%], valid : [loss = 0.784, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5184/15625) 005184-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.449, top1 = 89.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.302, top1 = 92.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.08 ms.
cifar100       train : [loss = 0.215, top1 = 94.70%], valid : [loss = 1.292, top1 = 68.57%], test : [loss = 1.292, top1 = 68.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.54%], valid : [loss = 2.272, top1 = 42.66%], test : [loss = 2.327, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.423, top1 = 85.36%], valid : [loss = 0.550, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5185/15625) 005185-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.482, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.319, top1 = 92.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.48 ms.
cifar100       train : [loss = 0.300, top1 = 92.09%], valid : [loss = 1.249, top1 = 67.75%], test : [loss = 1.241, top1 = 68.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 1.966, top1 = 48.35%], valid : [loss = 2.286, top1 = 41.02%], test : [loss = 2.303, top1 = 41.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.75%], valid : [loss = 0.590, top1 = 79.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5186/15625) 005186-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.499, top1 = 89.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.65 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.322, top1 = 92.75%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.17 ms.
cifar100       train : [loss = 0.171, top1 = 96.02%], valid : [loss = 1.286, top1 = 69.26%], test : [loss = 1.248, top1 = 69.64%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.67%], valid : [loss = 2.194, top1 = 43.66%], test : [loss = 2.191, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.62%], valid : [loss = 0.673, top1 = 76.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5187/15625) 005187-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.552, top1 = 88.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.350, top1 = 92.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.12 ms.
cifar100       train : [loss = 0.283, top1 = 92.18%], valid : [loss = 1.342, top1 = 67.14%], test : [loss = 1.361, top1 = 67.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.76%], valid : [loss = 2.404, top1 = 38.82%], test : [loss = 2.410, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.76%], valid : [loss = 0.842, top1 = 70.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5188/15625) 005188-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.51%], valid : [loss = 0.661, top1 = 85.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.040, top1 = 98.85%], test  : [loss = 0.393, top1 = 90.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 0.541, top1 = 84.19%], valid : [loss = 1.420, top1 = 63.53%], test : [loss = 1.412, top1 = 63.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.476, top1 = 37.10%], valid : [loss = 2.615, top1 = 34.21%], test : [loss = 2.652, top1 = 34.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.98%], valid : [loss = 0.927, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5189/15625) 005189-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.74%], valid : [loss = 1.135, top1 = 62.41%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10        train : [loss = 0.776, top1 = 72.63%], test  : [loss = 0.911, top1 = 68.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.09 ms.
cifar100       train : [loss = 2.121, top1 = 44.41%], valid : [loss = 2.402, top1 = 39.52%], test : [loss = 2.403, top1 = 39.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.74 ms.
ImageNet16-120 train : [loss = 3.759, top1 = 14.02%], valid : [loss = 3.824, top1 = 13.71%], test : [loss = 3.835, top1 = 13.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5190/15625) 005190-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.570, top1 = 87.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.97 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.376, top1 = 91.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.414, top1 = 88.21%], valid : [loss = 1.395, top1 = 65.07%], test : [loss = 1.385, top1 = 65.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.71%], valid : [loss = 2.521, top1 = 36.29%], test : [loss = 2.539, top1 = 37.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.12%], valid : [loss = 0.778, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5191/15625) 005191-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.551, top1 = 88.01%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.25 ms.
cifar10        train : [loss = 0.020, top1 = 99.43%], test  : [loss = 0.357, top1 = 91.39%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.39 ms.
cifar100       train : [loss = 0.284, top1 = 92.16%], valid : [loss = 1.317, top1 = 66.87%], test : [loss = 1.329, top1 = 67.07%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.14%], valid : [loss = 2.342, top1 = 40.20%], test : [loss = 2.370, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.87%], valid : [loss = 0.861, top1 = 69.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5192/15625) 005192-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.514, top1 = 88.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.329, top1 = 92.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.48 ms.
cifar100       train : [loss = 0.336, top1 = 90.83%], valid : [loss = 1.281, top1 = 67.39%], test : [loss = 1.273, top1 = 67.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.76%], valid : [loss = 2.405, top1 = 39.11%], test : [loss = 2.426, top1 = 38.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5193/15625) 005193-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.54%], valid : [loss = 0.539, top1 = 83.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.230, top1 = 92.20%], test  : [loss = 0.403, top1 = 86.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.55 ms.
cifar100       train : [loss = 1.332, top1 = 62.40%], valid : [loss = 1.603, top1 = 56.36%], test : [loss = 1.581, top1 = 57.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.835, top1 = 29.99%], valid : [loss = 2.837, top1 = 29.59%], test : [loss = 2.880, top1 = 29.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.72%], valid : [loss = 1.094, top1 = 61.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5194/15625) 005194-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.788, top1 = 72.17%], valid : [loss = 1.108, top1 = 63.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.790, top1 = 72.36%], test  : [loss = 0.926, top1 = 67.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.96 ms.
cifar100       train : [loss = 2.125, top1 = 44.25%], valid : [loss = 2.408, top1 = 39.33%], test : [loss = 2.411, top1 = 39.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 3.762, top1 = 13.99%], valid : [loss = 3.820, top1 = 13.78%], test : [loss = 3.832, top1 = 13.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.78%], valid : [loss = 1.412, top1 = 49.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5195/15625) 005195-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.488, top1 = 89.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.351, top1 = 92.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.17 ms.
cifar100       train : [loss = 0.160, top1 = 96.15%], valid : [loss = 1.423, top1 = 67.73%], test : [loss = 1.452, top1 = 67.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.33%], valid : [loss = 2.304, top1 = 41.79%], test : [loss = 2.319, top1 = 41.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.02%], valid : [loss = 0.584, top1 = 80.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5196/15625) 005196-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.316, top1 = 89.07%], valid : [loss = 0.573, top1 = 81.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.270, top1 = 90.71%], test  : [loss = 0.438, top1 = 85.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.93 ms.
cifar100       train : [loss = 1.362, top1 = 61.68%], valid : [loss = 1.676, top1 = 54.97%], test : [loss = 1.685, top1 = 54.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.994, top1 = 27.14%], valid : [loss = 3.023, top1 = 26.10%], test : [loss = 3.066, top1 = 25.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.32%], valid : [loss = 1.224, top1 = 55.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5197/15625) 005197-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.516, top1 = 89.16%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.335, top1 = 92.08%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.63 ms.
cifar100       train : [loss = 0.204, top1 = 94.97%], valid : [loss = 1.259, top1 = 69.29%], test : [loss = 1.269, top1 = 68.73%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 1.792, top1 = 52.28%], valid : [loss = 2.209, top1 = 43.22%], test : [loss = 2.212, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.59%], valid : [loss = 0.717, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5198/15625) 005198-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.571, top1 = 88.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.383, top1 = 91.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.49 ms.
cifar100       train : [loss = 0.175, top1 = 96.14%], valid : [loss = 1.376, top1 = 67.85%], test : [loss = 1.413, top1 = 67.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.99%], valid : [loss = 2.476, top1 = 38.16%], test : [loss = 2.487, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.98%], valid : [loss = 0.712, top1 = 75.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5199/15625) 005199-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.557, top1 = 88.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.374, top1 = 91.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.133, top1 = 97.39%], valid : [loss = 1.444, top1 = 67.53%], test : [loss = 1.456, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.52%], valid : [loss = 2.453, top1 = 38.13%], test : [loss = 2.471, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.89%], valid : [loss = 0.750, top1 = 73.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5200/15625) 005200-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.48%], valid : [loss = 0.894, top1 = 68.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10        train : [loss = 0.727, top1 = 74.28%], test  : [loss = 0.774, top1 = 73.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.07 ms.
cifar100       train : [loss = 2.210, top1 = 41.46%], valid : [loss = 2.314, top1 = 39.85%], test : [loss = 2.310, top1 = 39.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 3.483, top1 = 18.11%], valid : [loss = 3.469, top1 = 18.32%], test : [loss = 3.483, top1 = 18.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.373, top1 = 49.78%], valid : [loss = 1.409, top1 = 48.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5201/15625) 005201-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.46%], valid : [loss = 0.542, top1 = 87.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.051, top1 = 98.47%], test  : [loss = 0.367, top1 = 90.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.50 ms.
cifar100       train : [loss = 0.598, top1 = 82.41%], valid : [loss = 1.316, top1 = 65.49%], test : [loss = 1.308, top1 = 65.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.57%], valid : [loss = 2.533, top1 = 35.96%], test : [loss = 2.560, top1 = 35.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.95%], valid : [loss = 0.641, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5202/15625) 005202-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.446, top1 = 89.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.283, top1 = 92.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.97 ms.
cifar100       train : [loss = 0.204, top1 = 95.24%], valid : [loss = 1.266, top1 = 68.62%], test : [loss = 1.262, top1 = 69.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.77%], valid : [loss = 2.268, top1 = 42.86%], test : [loss = 2.286, top1 = 42.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.22%], valid : [loss = 0.527, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5203/15625) 005203-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.03 ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.95%], valid : [loss = 0.667, top1 = 77.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 0.507, top1 = 82.42%], test  : [loss = 0.589, top1 = 80.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.01 ms.
cifar100       train : [loss = 1.705, top1 = 53.80%], valid : [loss = 1.869, top1 = 50.63%], test : [loss = 1.881, top1 = 50.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.339, top1 = 21.06%], valid : [loss = 3.325, top1 = 21.62%], test : [loss = 3.353, top1 = 20.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.259, top1 = 54.66%], valid : [loss = 1.285, top1 = 54.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5204/15625) 005204-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.460, top1 = 90.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.46 ms.
cifar100       train : [loss = 0.066, top1 = 99.02%], valid : [loss = 1.357, top1 = 70.34%], test : [loss = 1.383, top1 = 69.85%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 1.528, top1 = 58.77%], valid : [loss = 2.248, top1 = 44.40%], test : [loss = 2.239, top1 = 44.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.24%], valid : [loss = 0.500, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5205/15625) 005205-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.67%], valid : [loss = 0.730, top1 = 80.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10        train : [loss = 0.176, top1 = 93.93%], test  : [loss = 0.509, top1 = 85.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.75 ms.
cifar100       train : [loss = 0.885, top1 = 73.97%], valid : [loss = 1.637, top1 = 57.40%], test : [loss = 1.658, top1 = 57.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 3.483, top1 = 17.10%], valid : [loss = 3.480, top1 = 17.44%], test : [loss = 3.494, top1 = 17.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5206/15625) 005206-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.538, top1 = 89.37%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.16 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.355, top1 = 92.68%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.11 ms.
cifar100       train : [loss = 0.037, top1 = 99.66%], valid : [loss = 1.435, top1 = 69.65%], test : [loss = 1.421, top1 = 69.87%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.86 ms.
ImageNet16-120 train : [loss = 1.581, top1 = 57.44%], valid : [loss = 2.422, top1 = 41.16%], test : [loss = 2.443, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.33%], valid : [loss = 0.647, top1 = 77.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5207/15625) 005207-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=21.84 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.65%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=21.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.308, top1 = 93.30%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=20.93 ms.
cifar100       train : [loss = 0.052, top1 = 99.37%], valid : [loss = 1.290, top1 = 70.77%], test : [loss = 1.276, top1 = 71.02%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=21.80 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.42%], valid : [loss = 2.277, top1 = 41.60%], test : [loss = 2.265, top1 = 42.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 76.02%], valid : [loss = 0.747, top1 = 73.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5208/15625) 005208-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.57%], valid : [loss = 0.446, top1 = 87.73%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.80 ms.
cifar10        train : [loss = 0.058, top1 = 98.55%], test  : [loss = 0.309, top1 = 90.60%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.44 ms.
cifar100       train : [loss = 0.549, top1 = 85.00%], valid : [loss = 1.218, top1 = 66.92%], test : [loss = 1.212, top1 = 67.41%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.82%], valid : [loss = 2.451, top1 = 38.32%], test : [loss = 2.476, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 81.00%], valid : [loss = 0.619, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5209/15625) 005209-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.69%], valid : [loss = 0.552, top1 = 82.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.227, top1 = 92.27%], test  : [loss = 0.394, top1 = 87.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.346, top1 = 62.13%], valid : [loss = 1.630, top1 = 55.71%], test : [loss = 1.611, top1 = 56.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 2.846, top1 = 29.77%], valid : [loss = 2.851, top1 = 29.38%], test : [loss = 2.901, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.28%], valid : [loss = 0.987, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5210/15625) 005210-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.566, top1 = 88.37%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.57 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.376, top1 = 91.95%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.24 ms.
cifar100       train : [loss = 0.138, top1 = 97.25%], valid : [loss = 1.460, top1 = 67.03%], test : [loss = 1.459, top1 = 67.40%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.07%], valid : [loss = 2.413, top1 = 39.09%], test : [loss = 2.437, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.15%], valid : [loss = 0.732, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5211/15625) 005211-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.68%], valid : [loss = 0.529, top1 = 83.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.242, top1 = 91.74%], test  : [loss = 0.392, top1 = 87.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.49 ms.
cifar100       train : [loss = 1.311, top1 = 62.91%], valid : [loss = 1.573, top1 = 57.21%], test : [loss = 1.557, top1 = 57.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.857, top1 = 29.59%], valid : [loss = 2.868, top1 = 29.98%], test : [loss = 2.933, top1 = 28.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.41%], valid : [loss = 0.984, top1 = 65.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5212/15625) 005212-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.47%], valid : [loss = 0.537, top1 = 87.15%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.56 ms.
cifar10        train : [loss = 0.053, top1 = 98.44%], test  : [loss = 0.369, top1 = 90.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.16 ms.
cifar100       train : [loss = 0.613, top1 = 81.98%], valid : [loss = 1.339, top1 = 64.87%], test : [loss = 1.317, top1 = 65.19%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.30%], valid : [loss = 2.534, top1 = 36.18%], test : [loss = 2.543, top1 = 36.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.28%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5213/15625) 005213-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.065, top1 = 97.95%], valid : [loss = 0.622, top1 = 84.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10        train : [loss = 0.086, top1 = 97.17%], test  : [loss = 0.421, top1 = 88.58%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.89 ms.
cifar100       train : [loss = 0.667, top1 = 80.33%], valid : [loss = 1.515, top1 = 60.85%], test : [loss = 1.514, top1 = 61.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 3.151, top1 = 23.07%], valid : [loss = 3.179, top1 = 22.11%], test : [loss = 3.208, top1 = 22.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.36%], valid : [loss = 1.045, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5214/15625) 005214-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.288, top1 = 93.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.79 ms.
cifar100       train : [loss = 0.100, top1 = 98.22%], valid : [loss = 1.307, top1 = 70.01%], test : [loss = 1.304, top1 = 70.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 1.639, top1 = 55.96%], valid : [loss = 2.214, top1 = 43.83%], test : [loss = 2.251, top1 = 43.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.18%], valid : [loss = 0.541, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5215/15625) 005215-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.523, top1 = 88.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.332, top1 = 92.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.39 ms.
cifar100       train : [loss = 0.202, top1 = 95.03%], valid : [loss = 1.349, top1 = 67.85%], test : [loss = 1.337, top1 = 67.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.77 ms.
ImageNet16-120 train : [loss = 2.445, top1 = 37.23%], valid : [loss = 2.582, top1 = 34.58%], test : [loss = 2.594, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.12%], valid : [loss = 0.946, top1 = 66.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5216/15625) 005216-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.582, top1 = 87.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.388, top1 = 90.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.77 ms.
cifar100       train : [loss = 0.381, top1 = 89.27%], valid : [loss = 1.396, top1 = 64.87%], test : [loss = 1.387, top1 = 65.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 38.51%], valid : [loss = 2.578, top1 = 34.96%], test : [loss = 2.593, top1 = 34.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.063, top1 = 61.51%], valid : [loss = 1.093, top1 = 60.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5217/15625) 005217-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.03%], valid : [loss = 0.524, top1 = 87.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.073, top1 = 97.70%], test  : [loss = 0.360, top1 = 89.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.28 ms.
cifar100       train : [loss = 0.711, top1 = 79.04%], valid : [loss = 1.346, top1 = 64.56%], test : [loss = 1.345, top1 = 64.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.11%], valid : [loss = 2.640, top1 = 34.06%], test : [loss = 2.690, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5218/15625) 005218-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.215, top1 = 92.76%], valid : [loss = 0.547, top1 = 83.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.209, top1 = 93.01%], test  : [loss = 0.403, top1 = 87.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 1.264, top1 = 64.05%], valid : [loss = 1.566, top1 = 57.54%], test : [loss = 1.566, top1 = 56.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.704, top1 = 32.44%], valid : [loss = 2.731, top1 = 31.82%], test : [loss = 2.775, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.82%], valid : [loss = 0.991, top1 = 64.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5219/15625) 005219-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.465, top1 = 89.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.320, top1 = 91.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.30 ms.
cifar100       train : [loss = 0.328, top1 = 91.14%], valid : [loss = 1.309, top1 = 67.10%], test : [loss = 1.303, top1 = 67.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.27%], valid : [loss = 2.371, top1 = 40.40%], test : [loss = 2.398, top1 = 40.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5220/15625) 005220-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.76%], valid : [loss = 0.578, top1 = 85.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10        train : [loss = 0.082, top1 = 97.29%], test  : [loss = 0.392, top1 = 89.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.765, top1 = 77.76%], valid : [loss = 1.445, top1 = 61.29%], test : [loss = 1.434, top1 = 61.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 26.70%], valid : [loss = 2.924, top1 = 26.83%], test : [loss = 2.973, top1 = 25.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.442, top1 = 47.68%], valid : [loss = 1.446, top1 = 47.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5221/15625) 005221-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.72%], valid : [loss = 0.850, top1 = 72.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10        train : [loss = 0.555, top1 = 80.60%], test  : [loss = 0.713, top1 = 75.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 1.769, top1 = 52.27%], valid : [loss = 2.043, top1 = 46.97%], test : [loss = 2.054, top1 = 47.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.85%], valid : [loss = 3.638, top1 = 16.12%], test : [loss = 3.672, top1 = 15.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5222/15625) 005222-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.550, top1 = 88.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.021, top1 = 99.36%], test  : [loss = 0.366, top1 = 91.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.276, top1 = 92.45%], valid : [loss = 1.289, top1 = 67.51%], test : [loss = 1.308, top1 = 67.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.098, top1 = 45.25%], valid : [loss = 2.366, top1 = 39.88%], test : [loss = 2.386, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 71.84%], valid : [loss = 0.848, top1 = 70.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5223/15625) 005223-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.516, top1 = 89.02%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.79 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.318, top1 = 92.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.59 ms.
cifar100       train : [loss = 0.173, top1 = 96.18%], valid : [loss = 1.265, top1 = 69.30%], test : [loss = 1.260, top1 = 69.39%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.55%], valid : [loss = 2.283, top1 = 41.93%], test : [loss = 2.282, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 74.00%], valid : [loss = 0.807, top1 = 71.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5224/15625) 005224-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.18%], valid : [loss = 0.461, top1 = 85.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.159, top1 = 94.78%], test  : [loss = 0.340, top1 = 88.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.989, top1 = 71.73%], valid : [loss = 1.357, top1 = 61.94%], test : [loss = 1.347, top1 = 62.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.71%], valid : [loss = 2.695, top1 = 32.98%], test : [loss = 2.722, top1 = 32.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5225/15625) 005225-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 93.10%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.60 ms.
cifar100       train : [loss = 0.095, top1 = 98.07%], valid : [loss = 1.369, top1 = 69.00%], test : [loss = 1.369, top1 = 69.65%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.628, top1 = 56.20%], valid : [loss = 2.207, top1 = 44.21%], test : [loss = 2.209, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 85.26%], valid : [loss = 0.544, top1 = 81.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5226/15625) 005226-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.597, top1 = 87.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.404, top1 = 91.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.85 ms.
cifar100       train : [loss = 0.184, top1 = 95.46%], valid : [loss = 1.513, top1 = 65.70%], test : [loss = 1.507, top1 = 65.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 46.08%], valid : [loss = 2.461, top1 = 38.72%], test : [loss = 2.484, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.82%], valid : [loss = 0.830, top1 = 70.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5227/15625) 005227-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.072, top1 = 97.72%], valid : [loss = 0.563, top1 = 85.57%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.096, top1 = 96.83%], test  : [loss = 0.391, top1 = 88.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.21 ms.
cifar100       train : [loss = 0.777, top1 = 77.18%], valid : [loss = 1.410, top1 = 62.30%], test : [loss = 1.399, top1 = 62.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.17%], valid : [loss = 2.607, top1 = 34.77%], test : [loss = 2.638, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.83%], valid : [loss = 0.929, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5228/15625) 005228-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.44%], valid : [loss = 0.652, top1 = 78.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10        train : [loss = 0.512, top1 = 82.34%], test  : [loss = 0.590, top1 = 80.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.82 ms.
cifar100       train : [loss = 1.719, top1 = 53.40%], valid : [loss = 1.870, top1 = 50.17%], test : [loss = 1.881, top1 = 50.29%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.90 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.26%], valid : [loss = 3.317, top1 = 21.39%], test : [loss = 3.338, top1 = 21.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5229/15625) 005229-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.76%], valid : [loss = 0.544, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.370, top1 = 91.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.261, top1 = 92.76%], valid : [loss = 1.344, top1 = 67.09%], test : [loss = 1.334, top1 = 67.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.271, top1 = 41.33%], valid : [loss = 2.462, top1 = 37.56%], test : [loss = 2.475, top1 = 37.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.44%], valid : [loss = 0.978, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5230/15625) 005230-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.531, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.361, top1 = 92.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.23 ms.
cifar100       train : [loss = 0.137, top1 = 97.32%], valid : [loss = 1.433, top1 = 67.97%], test : [loss = 1.429, top1 = 67.51%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.60%], valid : [loss = 2.401, top1 = 39.84%], test : [loss = 2.388, top1 = 41.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.44%], valid : [loss = 0.660, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5231/15625) 005231-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.48%], valid : [loss = 0.563, top1 = 82.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.235, top1 = 91.97%], test  : [loss = 0.429, top1 = 86.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.14 ms.
cifar100       train : [loss = 1.256, top1 = 64.34%], valid : [loss = 1.607, top1 = 56.76%], test : [loss = 1.605, top1 = 56.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.995, top1 = 27.11%], valid : [loss = 3.017, top1 = 27.02%], test : [loss = 3.073, top1 = 26.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.171, top1 = 57.94%], valid : [loss = 1.218, top1 = 56.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5232/15625) 005232-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.538, top1 = 88.46%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.22 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.335, top1 = 92.00%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.29 ms.
cifar100       train : [loss = 0.361, top1 = 90.00%], valid : [loss = 1.332, top1 = 66.19%], test : [loss = 1.343, top1 = 65.71%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=23.27 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 43.96%], valid : [loss = 2.356, top1 = 39.02%], test : [loss = 2.356, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.75%], valid : [loss = 0.963, top1 = 65.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5233/15625) 005233-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.442, top1 = 89.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.27 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.294, top1 = 92.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.201, top1 = 95.32%], valid : [loss = 1.258, top1 = 69.04%], test : [loss = 1.247, top1 = 69.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.44%], valid : [loss = 2.251, top1 = 42.77%], test : [loss = 2.261, top1 = 43.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.89%], valid : [loss = 0.529, top1 = 82.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5234/15625) 005234-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.577, top1 = 88.59%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.375, top1 = 92.12%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.94 ms.
cifar100       train : [loss = 0.065, top1 = 99.11%], valid : [loss = 1.489, top1 = 67.94%], test : [loss = 1.499, top1 = 68.03%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.90 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.11%], valid : [loss = 2.389, top1 = 40.23%], test : [loss = 2.435, top1 = 40.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.11%], valid : [loss = 0.726, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5235/15625) 005235-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.569, top1 = 87.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.395, top1 = 91.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.71 ms.
cifar100       train : [loss = 0.425, top1 = 87.84%], valid : [loss = 1.390, top1 = 65.25%], test : [loss = 1.384, top1 = 65.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.44%], valid : [loss = 2.519, top1 = 36.48%], test : [loss = 2.543, top1 = 37.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.30%], valid : [loss = 0.789, top1 = 72.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5236/15625) 005236-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.552, top1 = 88.92%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.44 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.363, top1 = 92.70%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.00 ms.
cifar100       train : [loss = 0.071, top1 = 98.93%], valid : [loss = 1.481, top1 = 68.20%], test : [loss = 1.452, top1 = 68.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 51.95%], valid : [loss = 2.372, top1 = 41.03%], test : [loss = 2.401, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 76.97%], valid : [loss = 0.731, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5237/15625) 005237-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.231, top1 = 92.12%], valid : [loss = 0.549, top1 = 83.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10        train : [loss = 0.220, top1 = 92.54%], test  : [loss = 0.409, top1 = 86.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.86 ms.
cifar100       train : [loss = 1.296, top1 = 63.13%], valid : [loss = 1.594, top1 = 56.23%], test : [loss = 1.580, top1 = 56.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.733, top1 = 31.90%], valid : [loss = 2.756, top1 = 31.39%], test : [loss = 2.799, top1 = 31.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.24%], valid : [loss = 0.996, top1 = 64.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5238/15625) 005238-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.16%], valid : [loss = 0.454, top1 = 86.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10        train : [loss = 0.116, top1 = 96.38%], test  : [loss = 0.326, top1 = 89.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.53 ms.
cifar100       train : [loss = 0.857, top1 = 75.63%], valid : [loss = 1.298, top1 = 64.15%], test : [loss = 1.279, top1 = 64.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.64%], valid : [loss = 2.624, top1 = 33.97%], test : [loss = 2.666, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5239/15625) 005239-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.503, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.332, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.08 ms.
cifar100       train : [loss = 0.310, top1 = 91.46%], valid : [loss = 1.252, top1 = 68.27%], test : [loss = 1.267, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.63%], valid : [loss = 2.319, top1 = 40.24%], test : [loss = 2.332, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.44%], valid : [loss = 0.794, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5240/15625) 005240-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.678, top1 = 84.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.055, top1 = 98.31%], test  : [loss = 0.431, top1 = 88.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.633, top1 = 81.48%], valid : [loss = 1.521, top1 = 61.23%], test : [loss = 1.489, top1 = 62.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.31%], valid : [loss = 2.836, top1 = 30.50%], test : [loss = 2.863, top1 = 29.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.68%], valid : [loss = 0.892, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5241/15625) 005241-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5242/15625) 005242-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.56 ms.
cifar10-valid  train : [loss = 0.290, top1 = 90.19%], valid : [loss = 0.473, top1 = 84.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.271, top1 = 90.99%], test  : [loss = 0.374, top1 = 87.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.93 ms.
cifar100       train : [loss = 1.280, top1 = 64.23%], valid : [loss = 1.470, top1 = 59.00%], test : [loss = 1.464, top1 = 59.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.50 ms.
ImageNet16-120 train : [loss = 2.822, top1 = 30.44%], valid : [loss = 2.821, top1 = 30.40%], test : [loss = 2.853, top1 = 29.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.58%], valid : [loss = 1.003, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5243/15625) 005243-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.68%], valid : [loss = 0.508, top1 = 86.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10        train : [loss = 0.093, top1 = 97.09%], test  : [loss = 0.366, top1 = 89.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 0.773, top1 = 77.59%], valid : [loss = 1.331, top1 = 63.85%], test : [loss = 1.323, top1 = 64.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.04 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.58%], valid : [loss = 2.645, top1 = 34.10%], test : [loss = 2.685, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.32%], valid : [loss = 0.668, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5244/15625) 005244-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.422, top1 = 90.42%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.51 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.279, top1 = 93.29%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.25 ms.
cifar100       train : [loss = 0.177, top1 = 95.94%], valid : [loss = 1.286, top1 = 69.49%], test : [loss = 1.267, top1 = 69.76%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.80%], valid : [loss = 2.242, top1 = 42.68%], test : [loss = 2.287, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.527, top1 = 82.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5245/15625) 005245-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.29%], valid : [loss = 0.454, top1 = 86.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10        train : [loss = 0.115, top1 = 96.46%], test  : [loss = 0.324, top1 = 89.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.08 ms.
cifar100       train : [loss = 0.851, top1 = 75.75%], valid : [loss = 1.292, top1 = 64.03%], test : [loss = 1.281, top1 = 63.99%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 36.02%], valid : [loss = 2.613, top1 = 34.27%], test : [loss = 2.644, top1 = 34.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.04%], valid : [loss = 0.648, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5246/15625) 005246-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10-valid  train : [loss = 0.345, top1 = 87.95%], valid : [loss = 0.585, top1 = 80.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10        train : [loss = 0.288, top1 = 90.05%], test  : [loss = 0.435, top1 = 85.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.93 ms.
cifar100       train : [loss = 1.538, top1 = 57.11%], valid : [loss = 1.761, top1 = 52.05%], test : [loss = 1.749, top1 = 52.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.18 ms.
ImageNet16-120 train : [loss = 3.018, top1 = 26.31%], valid : [loss = 3.016, top1 = 26.18%], test : [loss = 3.069, top1 = 25.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 63.11%], valid : [loss = 1.080, top1 = 61.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5247/15625) 005247-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.526, top1 = 89.47%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.51 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.347, top1 = 92.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 0.210, top1 = 94.74%], valid : [loss = 1.372, top1 = 66.97%], test : [loss = 1.377, top1 = 67.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 49.96%], valid : [loss = 2.238, top1 = 42.80%], test : [loss = 2.273, top1 = 42.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.40%], valid : [loss = 0.721, top1 = 74.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5248/15625) 005248-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.508, top1 = 89.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.309, top1 = 93.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.128, top1 = 97.46%], valid : [loss = 1.316, top1 = 69.01%], test : [loss = 1.301, top1 = 69.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.54%], valid : [loss = 2.295, top1 = 41.67%], test : [loss = 2.273, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5249/15625) 005249-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.474, top1 = 83.62%], valid : [loss = 0.637, top1 = 78.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.99 ms.
cifar10        train : [loss = 0.513, top1 = 82.19%], test  : [loss = 0.592, top1 = 80.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.01 ms.
cifar100       train : [loss = 1.660, top1 = 54.84%], valid : [loss = 1.835, top1 = 50.87%], test : [loss = 1.850, top1 = 51.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.33%], valid : [loss = 3.320, top1 = 21.41%], test : [loss = 3.340, top1 = 21.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.295, top1 = 53.24%], valid : [loss = 1.331, top1 = 52.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5250/15625) 005250-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.421, top1 = 90.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.294, top1 = 92.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 0.191, top1 = 95.54%], valid : [loss = 1.304, top1 = 69.05%], test : [loss = 1.276, top1 = 69.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.25%], valid : [loss = 2.279, top1 = 41.98%], test : [loss = 2.297, top1 = 42.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.93%], valid : [loss = 0.531, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5251/15625) 005251-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.508, top1 = 89.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.340, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.70 ms.
cifar100       train : [loss = 0.040, top1 = 99.63%], valid : [loss = 1.420, top1 = 69.45%], test : [loss = 1.401, top1 = 70.08%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.39 ms.
ImageNet16-120 train : [loss = 1.622, top1 = 56.39%], valid : [loss = 2.402, top1 = 41.30%], test : [loss = 2.438, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.40%], valid : [loss = 0.665, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5252/15625) 005252-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.39%], valid : [loss = 0.624, top1 = 85.51%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.065, top1 = 97.99%], test  : [loss = 0.415, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.16 ms.
cifar100       train : [loss = 0.681, top1 = 80.18%], valid : [loss = 1.372, top1 = 63.61%], test : [loss = 1.357, top1 = 63.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.06%], valid : [loss = 2.655, top1 = 33.34%], test : [loss = 2.688, top1 = 33.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.72%], valid : [loss = 0.800, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5253/15625) 005253-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.15%], valid : [loss = 0.451, top1 = 86.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10        train : [loss = 0.112, top1 = 96.54%], test  : [loss = 0.333, top1 = 89.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.50 ms.
cifar100       train : [loss = 0.865, top1 = 75.36%], valid : [loss = 1.305, top1 = 63.83%], test : [loss = 1.284, top1 = 64.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.55%], valid : [loss = 2.618, top1 = 35.08%], test : [loss = 2.669, top1 = 33.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5254/15625) 005254-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.565, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.370, top1 = 92.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.099, top1 = 98.26%], valid : [loss = 1.458, top1 = 68.01%], test : [loss = 1.475, top1 = 67.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 51.02%], valid : [loss = 2.416, top1 = 40.14%], test : [loss = 2.431, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.45%], valid : [loss = 0.719, top1 = 75.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5255/15625) 005255-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.520, top1 = 88.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.330, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 0.370, top1 = 89.42%], valid : [loss = 1.238, top1 = 68.20%], test : [loss = 1.244, top1 = 67.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.084, top1 = 45.65%], valid : [loss = 2.310, top1 = 40.50%], test : [loss = 2.336, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.70%], valid : [loss = 0.724, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5256/15625) 005256-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.287, top1 = 93.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.066, top1 = 99.03%], valid : [loss = 1.361, top1 = 69.67%], test : [loss = 1.331, top1 = 70.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 1.520, top1 = 58.87%], valid : [loss = 2.244, top1 = 44.41%], test : [loss = 2.241, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.58%], valid : [loss = 0.558, top1 = 81.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5257/15625) 005257-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.581, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.378, top1 = 90.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.451, top1 = 87.06%], valid : [loss = 1.390, top1 = 65.02%], test : [loss = 1.374, top1 = 65.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.12%], valid : [loss = 2.488, top1 = 37.54%], test : [loss = 2.494, top1 = 38.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.46%], valid : [loss = 0.818, top1 = 71.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5258/15625) 005258-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.44%], valid : [loss = 0.471, top1 = 85.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.58 ms.
cifar10        train : [loss = 0.153, top1 = 95.02%], test  : [loss = 0.348, top1 = 88.78%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.76 ms.
cifar100       train : [loss = 0.974, top1 = 72.31%], valid : [loss = 1.355, top1 = 62.03%], test : [loss = 1.347, top1 = 62.35%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 34.04%], valid : [loss = 2.687, top1 = 32.43%], test : [loss = 2.713, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5259/15625) 005259-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.623, top1 = 86.53%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.86 ms.
cifar10        train : [loss = 0.024, top1 = 99.36%], test  : [loss = 0.432, top1 = 89.81%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.63 ms.
cifar100       train : [loss = 0.357, top1 = 90.20%], valid : [loss = 1.394, top1 = 65.47%], test : [loss = 1.459, top1 = 64.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.16%], valid : [loss = 2.519, top1 = 36.75%], test : [loss = 2.566, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.36%], valid : [loss = 0.790, top1 = 72.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5260/15625) 005260-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.495, top1 = 89.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.338, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.99 ms.
cifar100       train : [loss = 0.229, top1 = 94.08%], valid : [loss = 1.376, top1 = 67.28%], test : [loss = 1.369, top1 = 67.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.41%], valid : [loss = 2.349, top1 = 40.88%], test : [loss = 2.338, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.90%], valid : [loss = 0.615, top1 = 79.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5261/15625) 005261-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.20%], valid : [loss = 0.451, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.115, top1 = 96.44%], test  : [loss = 0.326, top1 = 89.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.37 ms.
cifar100       train : [loss = 0.859, top1 = 75.57%], valid : [loss = 1.296, top1 = 64.38%], test : [loss = 1.279, top1 = 64.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.00 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.67%], valid : [loss = 2.628, top1 = 34.33%], test : [loss = 2.667, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5262/15625) 005262-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.501, top1 = 89.94%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.01 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.324, top1 = 93.26%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.03 ms.
cifar100       train : [loss = 0.068, top1 = 99.00%], valid : [loss = 1.357, top1 = 69.07%], test : [loss = 1.367, top1 = 70.12%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.82%], valid : [loss = 2.318, top1 = 40.17%], test : [loss = 2.332, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.07%], valid : [loss = 0.775, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5263/15625) 005263-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.516, top1 = 88.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.333, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.56 ms.
cifar100       train : [loss = 0.278, top1 = 92.66%], valid : [loss = 1.274, top1 = 67.70%], test : [loss = 1.249, top1 = 68.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.52%], valid : [loss = 2.286, top1 = 41.88%], test : [loss = 2.292, top1 = 41.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.18%], valid : [loss = 0.695, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5264/15625) 005264-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.38%], valid : [loss = 0.848, top1 = 71.18%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.657, top1 = 77.00%], test  : [loss = 0.754, top1 = 74.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.30 ms.
cifar100       train : [loss = 1.967, top1 = 47.77%], valid : [loss = 2.143, top1 = 44.77%], test : [loss = 2.158, top1 = 44.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.71 ms.
ImageNet16-120 train : [loss = 3.656, top1 = 15.68%], valid : [loss = 3.683, top1 = 16.18%], test : [loss = 3.700, top1 = 14.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5265/15625) 005265-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.68%], valid : [loss = 0.465, top1 = 86.36%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10        train : [loss = 0.127, top1 = 95.95%], test  : [loss = 0.340, top1 = 89.26%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.78 ms.
cifar100       train : [loss = 0.760, top1 = 78.69%], valid : [loss = 1.285, top1 = 64.32%], test : [loss = 1.272, top1 = 64.75%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.68%], valid : [loss = 2.598, top1 = 34.29%], test : [loss = 2.617, top1 = 33.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5266/15625) 005266-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.502, top1 = 89.35%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.94 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.308, top1 = 92.97%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.93 ms.
cifar100       train : [loss = 0.095, top1 = 98.44%], valid : [loss = 1.270, top1 = 69.91%], test : [loss = 1.273, top1 = 70.70%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.19 ms.
ImageNet16-120 train : [loss = 1.668, top1 = 55.29%], valid : [loss = 2.188, top1 = 44.12%], test : [loss = 2.181, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.72%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5267/15625) 005267-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.607, top1 = 87.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.401, top1 = 91.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.140, top1 = 96.92%], valid : [loss = 1.587, top1 = 65.17%], test : [loss = 1.558, top1 = 65.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.42%], valid : [loss = 2.504, top1 = 37.47%], test : [loss = 2.493, top1 = 38.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.06%], valid : [loss = 0.797, top1 = 72.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5268/15625) 005268-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.73%], valid : [loss = 0.579, top1 = 87.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.96 ms.
cifar10        train : [loss = 0.021, top1 = 99.40%], test  : [loss = 0.375, top1 = 91.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.297, top1 = 91.74%], valid : [loss = 1.534, top1 = 64.48%], test : [loss = 1.508, top1 = 64.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 2.815, top1 = 29.51%], valid : [loss = 2.898, top1 = 28.05%], test : [loss = 2.910, top1 = 26.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.204, top1 = 56.55%], valid : [loss = 1.209, top1 = 56.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5269/15625) 005269-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.460, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.13 ms.
cifar100       train : [loss = 0.319, top1 = 91.50%], valid : [loss = 1.237, top1 = 68.14%], test : [loss = 1.234, top1 = 67.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.85%], valid : [loss = 2.320, top1 = 40.58%], test : [loss = 2.342, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.49%], valid : [loss = 0.609, top1 = 79.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5270/15625) 005270-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.36%], valid : [loss = 0.539, top1 = 84.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.177, top1 = 94.08%], test  : [loss = 0.377, top1 = 88.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.35 ms.
cifar100       train : [loss = 1.167, top1 = 66.54%], valid : [loss = 1.517, top1 = 59.20%], test : [loss = 1.499, top1 = 58.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.38 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.76%], valid : [loss = 2.693, top1 = 32.95%], test : [loss = 2.729, top1 = 32.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.11%], valid : [loss = 0.970, top1 = 65.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5271/15625) 005271-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.93%], valid : [loss = 0.462, top1 = 86.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10        train : [loss = 0.116, top1 = 96.37%], test  : [loss = 0.334, top1 = 89.48%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.23 ms.
cifar100       train : [loss = 0.749, top1 = 79.06%], valid : [loss = 1.264, top1 = 65.03%], test : [loss = 1.270, top1 = 64.31%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.94 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.82%], valid : [loss = 2.593, top1 = 34.65%], test : [loss = 2.614, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.80%], valid : [loss = 0.890, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5272/15625) 005272-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.53%], valid : [loss = 0.441, top1 = 88.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.051, top1 = 98.74%], test  : [loss = 0.311, top1 = 90.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.37 ms.
cifar100       train : [loss = 0.595, top1 = 83.63%], valid : [loss = 1.224, top1 = 66.80%], test : [loss = 1.207, top1 = 67.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.30%], valid : [loss = 2.457, top1 = 37.70%], test : [loss = 2.482, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.16%], valid : [loss = 0.654, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5273/15625) 005273-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.613, top1 = 86.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.53 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.402, top1 = 90.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 0.514, top1 = 84.88%], valid : [loss = 1.441, top1 = 63.54%], test : [loss = 1.440, top1 = 63.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.46%], valid : [loss = 2.541, top1 = 36.57%], test : [loss = 2.564, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5274/15625) 005274-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.68%], valid : [loss = 0.767, top1 = 74.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.500, top1 = 82.70%], test  : [loss = 0.608, top1 = 79.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.35 ms.
cifar100       train : [loss = 1.851, top1 = 49.67%], valid : [loss = 2.056, top1 = 46.22%], test : [loss = 2.023, top1 = 46.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 3.501, top1 = 17.89%], valid : [loss = 3.499, top1 = 18.10%], test : [loss = 3.549, top1 = 17.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.253, top1 = 54.39%], valid : [loss = 1.281, top1 = 53.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5275/15625) 005275-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.00 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.99%], valid : [loss = 0.480, top1 = 84.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.40 ms.
cifar10        train : [loss = 0.303, top1 = 89.81%], test  : [loss = 0.407, top1 = 86.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.38 ms.
cifar100       train : [loss = 1.320, top1 = 63.43%], valid : [loss = 1.528, top1 = 58.21%], test : [loss = 1.499, top1 = 58.47%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.25 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.70%], valid : [loss = 2.901, top1 = 29.47%], test : [loss = 2.949, top1 = 28.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5276/15625) 005276-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.324, top1 = 92.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.60 ms.
cifar100       train : [loss = 0.336, top1 = 90.90%], valid : [loss = 1.283, top1 = 67.03%], test : [loss = 1.295, top1 = 66.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.68%], valid : [loss = 2.398, top1 = 38.88%], test : [loss = 2.414, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5277/15625) 005277-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.549, top1 = 89.14%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.43 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.392, top1 = 92.40%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=13.67 ms.
cifar100       train : [loss = 0.094, top1 = 98.43%], valid : [loss = 1.462, top1 = 68.32%], test : [loss = 1.434, top1 = 68.90%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 51.05%], valid : [loss = 2.431, top1 = 39.17%], test : [loss = 2.434, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.67%], valid : [loss = 0.702, top1 = 75.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5278/15625) 005278-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.34%], valid : [loss = 0.534, top1 = 84.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.182, top1 = 93.85%], test  : [loss = 0.393, top1 = 87.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.50 ms.
cifar100       train : [loss = 1.200, top1 = 65.99%], valid : [loss = 1.512, top1 = 58.64%], test : [loss = 1.503, top1 = 58.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.75 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.70%], valid : [loss = 2.700, top1 = 32.29%], test : [loss = 2.726, top1 = 32.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5279/15625) 005279-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.59%], valid : [loss = 0.908, top1 = 68.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.699, top1 = 75.49%], test  : [loss = 0.749, top1 = 73.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.61 ms.
cifar100       train : [loss = 2.249, top1 = 40.39%], valid : [loss = 2.351, top1 = 38.66%], test : [loss = 2.355, top1 = 38.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 3.484, top1 = 18.09%], valid : [loss = 3.449, top1 = 19.17%], test : [loss = 3.496, top1 = 18.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.366, top1 = 49.95%], valid : [loss = 1.411, top1 = 48.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5280/15625) 005280-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.428, top1 = 90.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.290, top1 = 93.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.37 ms.
cifar100       train : [loss = 0.174, top1 = 95.96%], valid : [loss = 1.286, top1 = 69.46%], test : [loss = 1.248, top1 = 69.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.10%], valid : [loss = 2.218, top1 = 43.17%], test : [loss = 2.267, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.39%], valid : [loss = 0.495, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5281/15625) 005281-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.472, top1 = 89.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.91 ms.
cifar10        train : [loss = 0.009, top1 = 99.89%], test  : [loss = 0.333, top1 = 92.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.83 ms.
cifar100       train : [loss = 0.205, top1 = 95.16%], valid : [loss = 1.267, top1 = 69.64%], test : [loss = 1.268, top1 = 68.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 1.843, top1 = 51.13%], valid : [loss = 2.283, top1 = 42.20%], test : [loss = 2.287, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.44%], valid : [loss = 0.550, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5282/15625) 005282-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.529, top1 = 89.54%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.32 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.318, top1 = 93.21%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.23 ms.
cifar100       train : [loss = 0.069, top1 = 98.95%], valid : [loss = 1.336, top1 = 69.46%], test : [loss = 1.344, top1 = 69.48%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.48%], valid : [loss = 2.357, top1 = 39.77%], test : [loss = 2.326, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.820, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5283/15625) 005283-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.529, top1 = 87.91%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.54 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.369, top1 = 90.80%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.62 ms.
cifar100       train : [loss = 0.458, top1 = 86.85%], valid : [loss = 1.332, top1 = 66.35%], test : [loss = 1.334, top1 = 65.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.84%], valid : [loss = 2.428, top1 = 38.62%], test : [loss = 2.463, top1 = 37.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.18%], valid : [loss = 0.630, top1 = 78.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5284/15625) 005284-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.584, top1 = 87.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.390, top1 = 91.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 0.389, top1 = 89.05%], valid : [loss = 1.411, top1 = 65.54%], test : [loss = 1.405, top1 = 65.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.92%], valid : [loss = 2.510, top1 = 36.73%], test : [loss = 2.537, top1 = 36.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5285/15625) 005285-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.128, top1 = 95.83%], valid : [loss = 0.555, top1 = 84.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.200, top1 = 93.30%], test  : [loss = 0.406, top1 = 87.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.36 ms.
cifar100       train : [loss = 1.036, top1 = 69.99%], valid : [loss = 1.458, top1 = 60.56%], test : [loss = 1.467, top1 = 59.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 32.99%], valid : [loss = 2.748, top1 = 32.07%], test : [loss = 2.804, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.56%], valid : [loss = 1.021, top1 = 64.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5286/15625) 005286-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.526, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.90 ms.
cifar10        train : [loss = 0.019, top1 = 99.47%], test  : [loss = 0.363, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.57 ms.
cifar100       train : [loss = 0.290, top1 = 92.10%], valid : [loss = 1.278, top1 = 67.74%], test : [loss = 1.316, top1 = 67.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.003, top1 = 47.40%], valid : [loss = 2.297, top1 = 41.90%], test : [loss = 2.285, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.23%], valid : [loss = 0.819, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5287/15625) 005287-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.554, top1 = 88.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.26 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.349, top1 = 92.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.29 ms.
cifar100       train : [loss = 0.056, top1 = 99.39%], valid : [loss = 1.436, top1 = 69.32%], test : [loss = 1.436, top1 = 69.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 1.686, top1 = 55.08%], valid : [loss = 2.407, top1 = 41.13%], test : [loss = 2.409, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.24%], valid : [loss = 0.672, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5288/15625) 005288-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.497, top1 = 88.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.325, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.326, top1 = 91.21%], valid : [loss = 1.246, top1 = 67.63%], test : [loss = 1.253, top1 = 67.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.67%], valid : [loss = 2.321, top1 = 40.43%], test : [loss = 2.344, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5289/15625) 005289-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.626, top1 = 87.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.06 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.412, top1 = 91.30%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.93 ms.
cifar100       train : [loss = 0.152, top1 = 96.72%], valid : [loss = 1.494, top1 = 66.16%], test : [loss = 1.539, top1 = 66.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.55 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.96%], valid : [loss = 2.488, top1 = 37.97%], test : [loss = 2.526, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 72.86%], valid : [loss = 0.811, top1 = 71.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5290/15625) 005290-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.23%], valid : [loss = 0.550, top1 = 86.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.107, top1 = 96.48%], test  : [loss = 0.409, top1 = 88.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.839, top1 = 75.49%], valid : [loss = 1.418, top1 = 61.62%], test : [loss = 1.411, top1 = 62.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.26%], valid : [loss = 2.764, top1 = 31.37%], test : [loss = 2.822, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5291/15625) 005291-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.570, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.387, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 0.393, top1 = 88.92%], valid : [loss = 1.414, top1 = 65.16%], test : [loss = 1.382, top1 = 65.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.86%], valid : [loss = 2.507, top1 = 36.50%], test : [loss = 2.532, top1 = 36.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.26%], valid : [loss = 0.753, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5292/15625) 005292-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.68 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.419, top1 = 91.42%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.86 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.269, top1 = 94.29%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.48 ms.
cifar100       train : [loss = 0.016, top1 = 99.91%], valid : [loss = 1.285, top1 = 72.59%], test : [loss = 1.269, top1 = 72.67%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 1.058, top1 = 70.49%], valid : [loss = 2.297, top1 = 45.22%], test : [loss = 2.322, top1 = 45.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.330, top1 = 88.85%], valid : [loss = 0.485, top1 = 83.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5293/15625) 005293-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.09%], valid : [loss = 0.463, top1 = 86.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.78 ms.
cifar10        train : [loss = 0.112, top1 = 96.58%], test  : [loss = 0.326, top1 = 89.63%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.93 ms.
cifar100       train : [loss = 0.878, top1 = 74.93%], valid : [loss = 1.288, top1 = 63.94%], test : [loss = 1.301, top1 = 64.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.70%], valid : [loss = 2.612, top1 = 34.10%], test : [loss = 2.693, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.76%], valid : [loss = 0.671, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5294/15625) 005294-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.92%], valid : [loss = 0.504, top1 = 85.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.30 ms.
cifar10        train : [loss = 0.169, top1 = 94.40%], test  : [loss = 0.382, top1 = 88.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.74 ms.
cifar100       train : [loss = 1.009, top1 = 71.05%], valid : [loss = 1.368, top1 = 61.60%], test : [loss = 1.366, top1 = 62.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.58%], valid : [loss = 2.633, top1 = 34.25%], test : [loss = 2.715, top1 = 33.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.17%], valid : [loss = 0.931, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5295/15625) 005295-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.05 ms.
cifar10-valid  train : [loss = 0.458, top1 = 83.94%], valid : [loss = 0.681, top1 = 77.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10        train : [loss = 0.417, top1 = 85.62%], test  : [loss = 0.558, top1 = 81.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.78 ms.
cifar100       train : [loss = 1.667, top1 = 54.07%], valid : [loss = 1.900, top1 = 48.96%], test : [loss = 1.903, top1 = 50.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 21.07%], valid : [loss = 3.335, top1 = 21.20%], test : [loss = 3.362, top1 = 19.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.181, top1 = 57.26%], valid : [loss = 1.230, top1 = 55.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5296/15625) 005296-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.481, top1 = 89.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.316, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.325, top1 = 91.24%], valid : [loss = 1.235, top1 = 68.34%], test : [loss = 1.217, top1 = 68.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.83%], valid : [loss = 2.308, top1 = 41.00%], test : [loss = 2.340, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.10%], valid : [loss = 0.599, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5297/15625) 005297-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.17%], valid : [loss = 0.614, top1 = 85.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.98 ms.
cifar10        train : [loss = 0.073, top1 = 97.82%], test  : [loss = 0.401, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.72 ms.
cifar100       train : [loss = 0.723, top1 = 79.00%], valid : [loss = 1.403, top1 = 63.06%], test : [loss = 1.380, top1 = 63.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.92%], valid : [loss = 2.676, top1 = 33.73%], test : [loss = 2.694, top1 = 32.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5298/15625) 005298-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.601, top1 = 88.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.408, top1 = 91.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.119, top1 = 97.68%], valid : [loss = 1.529, top1 = 66.64%], test : [loss = 1.513, top1 = 66.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.75%], valid : [loss = 2.487, top1 = 38.43%], test : [loss = 2.464, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 73.95%], valid : [loss = 0.798, top1 = 72.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5299/15625) 005299-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.529, top1 = 88.11%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.55 ms.
cifar10        train : [loss = 0.027, top1 = 99.31%], test  : [loss = 0.360, top1 = 90.55%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.55 ms.
cifar100       train : [loss = 0.434, top1 = 87.69%], valid : [loss = 1.343, top1 = 66.18%], test : [loss = 1.348, top1 = 66.40%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.194, top1 = 43.22%], valid : [loss = 2.450, top1 = 38.40%], test : [loss = 2.492, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.28%], valid : [loss = 0.618, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5300/15625) 005300-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.19%], valid : [loss = 0.616, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.03 ms.
cifar10        train : [loss = 0.067, top1 = 98.03%], test  : [loss = 0.407, top1 = 88.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.20 ms.
cifar100       train : [loss = 0.740, top1 = 78.37%], valid : [loss = 1.392, top1 = 62.40%], test : [loss = 1.404, top1 = 63.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.79 ms.
ImageNet16-120 train : [loss = 2.513, top1 = 36.63%], valid : [loss = 2.664, top1 = 33.70%], test : [loss = 2.673, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5301/15625) 005301-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 90.40%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.43 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.319, top1 = 92.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.77 ms.
cifar100       train : [loss = 0.047, top1 = 99.39%], valid : [loss = 1.365, top1 = 69.54%], test : [loss = 1.365, top1 = 70.42%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 1.450, top1 = 60.54%], valid : [loss = 2.210, top1 = 44.40%], test : [loss = 2.211, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.61%], valid : [loss = 0.536, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5302/15625) 005302-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.514, top1 = 88.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.342, top1 = 91.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.356, top1 = 90.17%], valid : [loss = 1.280, top1 = 67.12%], test : [loss = 1.299, top1 = 66.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.95%], valid : [loss = 2.398, top1 = 39.17%], test : [loss = 2.430, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5303/15625) 005303-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5304/15625) 005304-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.532, top1 = 89.41%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.334, top1 = 93.09%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.97 ms.
cifar100       train : [loss = 0.061, top1 = 99.07%], valid : [loss = 1.339, top1 = 70.46%], test : [loss = 1.388, top1 = 69.70%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.43%], valid : [loss = 2.346, top1 = 40.73%], test : [loss = 2.364, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.50%], valid : [loss = 0.876, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5305/15625) 005305-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.24 ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.66%], valid : [loss = 0.781, top1 = 73.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.586, top1 = 79.58%], test  : [loss = 0.653, top1 = 77.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.38 ms.
cifar100       train : [loss = 2.003, top1 = 45.47%], valid : [loss = 2.136, top1 = 42.84%], test : [loss = 2.145, top1 = 43.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 3.031, top1 = 26.11%], valid : [loss = 3.022, top1 = 27.30%], test : [loss = 3.060, top1 = 25.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.184, top1 = 57.04%], valid : [loss = 1.241, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5306/15625) 005306-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.35%], valid : [loss = 0.466, top1 = 85.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.27 ms.
cifar10        train : [loss = 0.164, top1 = 94.66%], test  : [loss = 0.356, top1 = 88.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.64 ms.
cifar100       train : [loss = 1.008, top1 = 71.35%], valid : [loss = 1.355, top1 = 62.22%], test : [loss = 1.355, top1 = 61.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.76%], valid : [loss = 2.715, top1 = 32.53%], test : [loss = 2.730, top1 = 31.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 73.92%], valid : [loss = 0.773, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5307/15625) 005307-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.561, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.395, top1 = 90.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 0.400, top1 = 88.65%], valid : [loss = 1.385, top1 = 65.56%], test : [loss = 1.400, top1 = 65.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.18%], valid : [loss = 2.509, top1 = 36.60%], test : [loss = 2.498, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5308/15625) 005308-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.572, top1 = 87.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.383, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.95 ms.
cifar100       train : [loss = 0.378, top1 = 89.36%], valid : [loss = 1.422, top1 = 65.07%], test : [loss = 1.394, top1 = 65.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.18%], valid : [loss = 2.522, top1 = 36.57%], test : [loss = 2.516, top1 = 36.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.97%], valid : [loss = 0.772, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5309/15625) 005309-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.18%], valid : [loss = 0.676, top1 = 82.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.84 ms.
cifar10        train : [loss = 0.166, top1 = 94.38%], test  : [loss = 0.447, top1 = 86.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.65 ms.
cifar100       train : [loss = 0.996, top1 = 71.18%], valid : [loss = 1.662, top1 = 55.66%], test : [loss = 1.631, top1 = 57.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 3.123, top1 = 24.02%], valid : [loss = 3.181, top1 = 23.97%], test : [loss = 3.179, top1 = 22.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.31%], valid : [loss = 1.003, top1 = 64.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5310/15625) 005310-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.571, top1 = 87.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.377, top1 = 91.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 0.376, top1 = 89.41%], valid : [loss = 1.414, top1 = 65.96%], test : [loss = 1.338, top1 = 66.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.65%], valid : [loss = 2.519, top1 = 36.27%], test : [loss = 2.541, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5311/15625) 005311-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.86%], valid : [loss = 0.523, top1 = 85.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.088, top1 = 97.39%], test  : [loss = 0.353, top1 = 89.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.760, top1 = 77.92%], valid : [loss = 1.356, top1 = 62.94%], test : [loss = 1.321, top1 = 64.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 2.509, top1 = 36.58%], valid : [loss = 2.606, top1 = 34.73%], test : [loss = 2.663, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.28%], valid : [loss = 0.885, top1 = 69.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5312/15625) 005312-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.366, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.175, top1 = 96.21%], valid : [loss = 1.389, top1 = 67.44%], test : [loss = 1.396, top1 = 67.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.61 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.87%], valid : [loss = 2.458, top1 = 38.07%], test : [loss = 2.470, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.00%], valid : [loss = 0.689, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5313/15625) 005313-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.501, top1 = 89.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.21 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.307, top1 = 93.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.07 ms.
cifar100       train : [loss = 0.123, top1 = 97.67%], valid : [loss = 1.296, top1 = 69.11%], test : [loss = 1.296, top1 = 69.65%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 1.765, top1 = 52.98%], valid : [loss = 2.240, top1 = 42.99%], test : [loss = 2.228, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.72%], valid : [loss = 0.659, top1 = 77.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5314/15625) 005314-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.89%], valid : [loss = 0.558, top1 = 86.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.69 ms.
cifar10        train : [loss = 0.062, top1 = 98.22%], test  : [loss = 0.356, top1 = 89.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 0.598, top1 = 82.76%], valid : [loss = 1.322, top1 = 65.60%], test : [loss = 1.304, top1 = 65.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.78%], valid : [loss = 2.450, top1 = 38.03%], test : [loss = 2.489, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.10%], valid : [loss = 0.834, top1 = 70.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5315/15625) 005315-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.90%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.320, top1 = 93.26%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.88 ms.
cifar100       train : [loss = 0.040, top1 = 99.58%], valid : [loss = 1.340, top1 = 70.30%], test : [loss = 1.342, top1 = 71.08%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.25 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.86%], valid : [loss = 2.310, top1 = 40.77%], test : [loss = 2.269, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.85%], valid : [loss = 0.811, top1 = 71.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5316/15625) 005316-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.520, top1 = 88.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.028, top1 = 99.27%], test  : [loss = 0.344, top1 = 91.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.468, top1 = 86.23%], valid : [loss = 1.353, top1 = 65.44%], test : [loss = 1.319, top1 = 65.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.76%], valid : [loss = 2.547, top1 = 36.27%], test : [loss = 2.590, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.61%], valid : [loss = 0.697, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5317/15625) 005317-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.253, top1 = 91.23%], valid : [loss = 0.828, top1 = 76.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.76 ms.
cifar10        train : [loss = 0.289, top1 = 89.85%], test  : [loss = 0.596, top1 = 81.42%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.99 ms.
cifar100       train : [loss = 1.264, top1 = 63.89%], valid : [loss = 1.818, top1 = 51.62%], test : [loss = 1.827, top1 = 51.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 3.429, top1 = 18.48%], valid : [loss = 3.450, top1 = 18.53%], test : [loss = 3.461, top1 = 17.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.227, top1 = 55.27%], valid : [loss = 1.283, top1 = 53.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5318/15625) 005318-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.607, top1 = 87.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.369, top1 = 91.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.214, top1 = 94.93%], valid : [loss = 1.462, top1 = 65.88%], test : [loss = 1.425, top1 = 66.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.75%], valid : [loss = 2.479, top1 = 38.30%], test : [loss = 2.538, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5319/15625) 005319-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.477, top1 = 89.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.317, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.16 ms.
cifar100       train : [loss = 0.327, top1 = 91.14%], valid : [loss = 1.231, top1 = 68.34%], test : [loss = 1.263, top1 = 68.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.49%], valid : [loss = 2.338, top1 = 39.83%], test : [loss = 2.351, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5320/15625) 005320-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.22 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.89 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5321/15625) 005321-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.70%], valid : [loss = 0.595, top1 = 88.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10        train : [loss = 0.015, top1 = 99.51%], test  : [loss = 0.390, top1 = 91.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.40 ms.
cifar100       train : [loss = 0.299, top1 = 91.79%], valid : [loss = 1.455, top1 = 65.06%], test : [loss = 1.396, top1 = 66.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 37.49%], valid : [loss = 2.563, top1 = 35.50%], test : [loss = 2.621, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 65.11%], valid : [loss = 0.991, top1 = 64.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5322/15625) 005322-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.00%], valid : [loss = 0.565, top1 = 86.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.05 ms.
cifar10        train : [loss = 0.060, top1 = 98.10%], test  : [loss = 0.376, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.77 ms.
cifar100       train : [loss = 0.670, top1 = 80.23%], valid : [loss = 1.292, top1 = 65.22%], test : [loss = 1.313, top1 = 64.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.17%], valid : [loss = 2.510, top1 = 37.60%], test : [loss = 2.534, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5323/15625) 005323-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.630, top1 = 87.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.412, top1 = 90.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.38 ms.
cifar100       train : [loss = 0.233, top1 = 94.19%], valid : [loss = 1.461, top1 = 65.60%], test : [loss = 1.498, top1 = 65.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.87%], valid : [loss = 2.549, top1 = 37.60%], test : [loss = 2.552, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.14%], valid : [loss = 0.733, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5324/15625) 005324-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.525, top1 = 89.26%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.323, top1 = 93.03%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=23.15 ms.
cifar100       train : [loss = 0.055, top1 = 99.35%], valid : [loss = 1.421, top1 = 68.66%], test : [loss = 1.421, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.13 ms.
ImageNet16-120 train : [loss = 1.696, top1 = 54.72%], valid : [loss = 2.323, top1 = 42.20%], test : [loss = 2.363, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.57%], valid : [loss = 0.645, top1 = 78.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5325/15625) 005325-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.528, top1 = 88.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.344, top1 = 92.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.14 ms.
cifar100       train : [loss = 0.286, top1 = 91.98%], valid : [loss = 1.330, top1 = 67.40%], test : [loss = 1.327, top1 = 67.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.45%], valid : [loss = 2.467, top1 = 37.77%], test : [loss = 2.442, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5326/15625) 005326-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.03%], valid : [loss = 0.481, top1 = 84.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10        train : [loss = 0.296, top1 = 89.99%], test  : [loss = 0.402, top1 = 86.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 1.330, top1 = 63.09%], valid : [loss = 1.541, top1 = 57.84%], test : [loss = 1.514, top1 = 58.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.63%], valid : [loss = 2.907, top1 = 29.37%], test : [loss = 2.959, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5327/15625) 005327-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.70%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.380, top1 = 92.35%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.29 ms.
cifar100       train : [loss = 0.098, top1 = 98.21%], valid : [loss = 1.417, top1 = 67.64%], test : [loss = 1.449, top1 = 68.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.30 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.52%], valid : [loss = 2.439, top1 = 40.07%], test : [loss = 2.469, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.02%], valid : [loss = 0.721, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5328/15625) 005328-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.521, top1 = 88.66%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.24 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.343, top1 = 91.82%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.86 ms.
cifar100       train : [loss = 0.354, top1 = 90.19%], valid : [loss = 1.266, top1 = 66.82%], test : [loss = 1.245, top1 = 67.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.89%], valid : [loss = 2.406, top1 = 39.27%], test : [loss = 2.409, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5329/15625) 005329-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.329, top1 = 88.54%], valid : [loss = 0.628, top1 = 79.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10        train : [loss = 0.251, top1 = 91.36%], test  : [loss = 0.416, top1 = 86.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.45 ms.
cifar100       train : [loss = 1.394, top1 = 60.72%], valid : [loss = 1.655, top1 = 54.94%], test : [loss = 1.650, top1 = 53.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.868, top1 = 29.35%], valid : [loss = 2.862, top1 = 29.93%], test : [loss = 2.903, top1 = 29.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.61%], valid : [loss = 1.011, top1 = 63.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5330/15625) 005330-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.668, top1 = 85.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.91 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.471, top1 = 88.85%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.74 ms.
cifar100       train : [loss = 0.365, top1 = 90.09%], valid : [loss = 1.542, top1 = 63.10%], test : [loss = 1.553, top1 = 62.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.38%], valid : [loss = 2.619, top1 = 33.37%], test : [loss = 2.649, top1 = 34.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.20%], valid : [loss = 0.827, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5331/15625) 005331-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.204, top1 = 93.36%], valid : [loss = 0.479, top1 = 84.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10        train : [loss = 0.237, top1 = 92.13%], test  : [loss = 0.390, top1 = 86.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.32 ms.
cifar100       train : [loss = 1.466, top1 = 59.40%], valid : [loss = 1.680, top1 = 53.12%], test : [loss = 1.661, top1 = 54.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 3.017, top1 = 26.01%], valid : [loss = 3.008, top1 = 25.63%], test : [loss = 3.018, top1 = 25.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5332/15625) 005332-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.58%], valid : [loss = 0.587, top1 = 80.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.329, top1 = 88.50%], test  : [loss = 0.467, top1 = 84.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 1.621, top1 = 54.97%], valid : [loss = 1.851, top1 = 50.06%], test : [loss = 1.854, top1 = 50.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 3.009, top1 = 26.39%], valid : [loss = 3.031, top1 = 25.77%], test : [loss = 3.071, top1 = 25.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.71%], valid : [loss = 1.056, top1 = 62.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5333/15625) 005333-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.499, top1 = 88.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.330, top1 = 92.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.26 ms.
cifar100       train : [loss = 0.349, top1 = 90.40%], valid : [loss = 1.291, top1 = 66.44%], test : [loss = 1.263, top1 = 67.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.08%], valid : [loss = 2.446, top1 = 37.43%], test : [loss = 2.448, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5334/15625) 005334-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.439, top1 = 90.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.318, top1 = 93.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.69 ms.
cifar100       train : [loss = 0.071, top1 = 98.94%], valid : [loss = 1.352, top1 = 70.00%], test : [loss = 1.335, top1 = 69.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 1.569, top1 = 57.62%], valid : [loss = 2.236, top1 = 44.57%], test : [loss = 2.270, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.70%], valid : [loss = 0.526, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5335/15625) 005335-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.537, top1 = 89.73%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.338, top1 = 93.02%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.18 ms.
cifar100       train : [loss = 0.058, top1 = 99.10%], valid : [loss = 1.420, top1 = 69.42%], test : [loss = 1.415, top1 = 69.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.616, top1 = 56.69%], valid : [loss = 2.283, top1 = 41.80%], test : [loss = 2.276, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 82.09%], valid : [loss = 0.601, top1 = 79.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5336/15625) 005336-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.82 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.88 ms.
cifar100       train : [loss = 0.319, top1 = 91.34%], valid : [loss = 1.317, top1 = 67.06%], test : [loss = 1.337, top1 = 66.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.28%], valid : [loss = 2.368, top1 = 40.57%], test : [loss = 2.405, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.553, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5337/15625) 005337-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.515, top1 = 81.88%], valid : [loss = 0.854, top1 = 71.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10        train : [loss = 0.557, top1 = 80.34%], test  : [loss = 0.718, top1 = 75.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.78 ms.
cifar100       train : [loss = 1.760, top1 = 52.58%], valid : [loss = 2.014, top1 = 47.38%], test : [loss = 2.044, top1 = 47.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.88%], valid : [loss = 3.630, top1 = 16.23%], test : [loss = 3.631, top1 = 16.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5338/15625) 005338-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.570, top1 = 88.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.349, top1 = 92.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.50 ms.
cifar100       train : [loss = 0.141, top1 = 96.92%], valid : [loss = 1.349, top1 = 67.94%], test : [loss = 1.346, top1 = 68.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.98%], valid : [loss = 2.304, top1 = 41.47%], test : [loss = 2.339, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 79.02%], valid : [loss = 0.665, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5339/15625) 005339-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.75%], valid : [loss = 0.489, top1 = 83.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.301, top1 = 90.03%], test  : [loss = 0.402, top1 = 86.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.25 ms.
cifar100       train : [loss = 1.355, top1 = 62.48%], valid : [loss = 1.549, top1 = 56.86%], test : [loss = 1.532, top1 = 57.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.70%], valid : [loss = 2.914, top1 = 29.37%], test : [loss = 2.954, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5340/15625) 005340-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.46%], valid : [loss = 0.466, top1 = 86.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10        train : [loss = 0.158, top1 = 94.86%], test  : [loss = 0.354, top1 = 88.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=15.81 ms.
cifar100       train : [loss = 0.988, top1 = 71.69%], valid : [loss = 1.350, top1 = 62.52%], test : [loss = 1.360, top1 = 61.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.04%], valid : [loss = 2.673, top1 = 33.40%], test : [loss = 2.698, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5341/15625) 005341-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.592, top1 = 87.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.399, top1 = 90.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.37 ms.
cifar100       train : [loss = 0.393, top1 = 88.91%], valid : [loss = 1.390, top1 = 65.30%], test : [loss = 1.363, top1 = 65.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.19%], valid : [loss = 2.502, top1 = 37.23%], test : [loss = 2.503, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5342/15625) 005342-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.711, top1 = 85.02%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=21.97 ms.
cifar10        train : [loss = 0.030, top1 = 99.11%], test  : [loss = 0.399, top1 = 90.71%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.14 ms.
cifar100       train : [loss = 0.410, top1 = 88.19%], valid : [loss = 1.501, top1 = 62.70%], test : [loss = 1.447, top1 = 64.20%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=23.72 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 24.83%], valid : [loss = 3.096, top1 = 24.10%], test : [loss = 3.113, top1 = 23.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.117, top1 = 59.55%], valid : [loss = 1.125, top1 = 59.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5343/15625) 005343-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.48 ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.17%], valid : [loss = 0.976, top1 = 66.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.770, top1 = 73.06%], test  : [loss = 0.845, top1 = 70.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.61 ms.
cifar100       train : [loss = 2.143, top1 = 43.60%], valid : [loss = 2.321, top1 = 40.34%], test : [loss = 2.331, top1 = 40.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.33%], valid : [loss = 3.770, top1 = 15.10%], test : [loss = 3.784, top1 = 13.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.463, top1 = 46.40%], valid : [loss = 1.488, top1 = 45.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5344/15625) 005344-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.35%], valid : [loss = 0.450, top1 = 87.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10        train : [loss = 0.111, top1 = 96.56%], test  : [loss = 0.336, top1 = 89.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 0.855, top1 = 75.53%], valid : [loss = 1.297, top1 = 63.48%], test : [loss = 1.265, top1 = 64.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.61%], valid : [loss = 2.616, top1 = 34.20%], test : [loss = 2.646, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5345/15625) 005345-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.31%], valid : [loss = 0.550, top1 = 83.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.194, top1 = 93.45%], test  : [loss = 0.399, top1 = 87.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.30 ms.
cifar100       train : [loss = 1.250, top1 = 64.41%], valid : [loss = 1.555, top1 = 57.74%], test : [loss = 1.540, top1 = 57.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.706, top1 = 32.51%], valid : [loss = 2.738, top1 = 32.29%], test : [loss = 2.796, top1 = 31.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5346/15625) 005346-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.585, top1 = 87.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.417, top1 = 91.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.51 ms.
cifar100       train : [loss = 0.158, top1 = 96.26%], valid : [loss = 1.594, top1 = 64.74%], test : [loss = 1.595, top1 = 65.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.46%], valid : [loss = 2.563, top1 = 36.30%], test : [loss = 2.583, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.45%], valid : [loss = 0.704, top1 = 75.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5347/15625) 005347-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.558, top1 = 87.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.365, top1 = 91.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.28 ms.
cifar100       train : [loss = 0.406, top1 = 88.53%], valid : [loss = 1.407, top1 = 65.18%], test : [loss = 1.419, top1 = 65.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.94%], valid : [loss = 2.521, top1 = 37.33%], test : [loss = 2.537, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5348/15625) 005348-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.581, top1 = 87.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.388, top1 = 91.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.62 ms.
cifar100       train : [loss = 0.391, top1 = 89.04%], valid : [loss = 1.428, top1 = 64.93%], test : [loss = 1.415, top1 = 64.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.90%], valid : [loss = 2.502, top1 = 37.22%], test : [loss = 2.530, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5349/15625) 005349-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.471, top1 = 89.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.313, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.328, top1 = 91.18%], valid : [loss = 1.276, top1 = 66.32%], test : [loss = 1.275, top1 = 67.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.044, top1 = 46.53%], valid : [loss = 2.328, top1 = 41.03%], test : [loss = 2.349, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 81.92%], valid : [loss = 0.593, top1 = 79.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5350/15625) 005350-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.56%], valid : [loss = 0.565, top1 = 87.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.027, top1 = 99.19%], test  : [loss = 0.373, top1 = 91.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.458, top1 = 86.65%], valid : [loss = 1.292, top1 = 66.28%], test : [loss = 1.248, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 42.93%], valid : [loss = 2.382, top1 = 39.27%], test : [loss = 2.398, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5351/15625) 005351-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.24%], valid : [loss = 0.733, top1 = 75.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10        train : [loss = 0.423, top1 = 85.24%], test  : [loss = 0.581, top1 = 80.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.716, top1 = 53.00%], valid : [loss = 1.943, top1 = 49.12%], test : [loss = 1.971, top1 = 49.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 3.374, top1 = 20.14%], valid : [loss = 3.380, top1 = 20.27%], test : [loss = 3.406, top1 = 19.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.223, top1 = 55.70%], valid : [loss = 1.274, top1 = 54.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5352/15625) 005352-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.61%], valid : [loss = 0.694, top1 = 82.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10        train : [loss = 0.153, top1 = 94.65%], test  : [loss = 0.479, top1 = 86.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.987, top1 = 71.51%], valid : [loss = 1.615, top1 = 57.84%], test : [loss = 1.610, top1 = 57.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 3.068, top1 = 24.97%], valid : [loss = 3.124, top1 = 25.13%], test : [loss = 3.183, top1 = 22.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.62%], valid : [loss = 1.007, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5353/15625) 005353-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.420, top1 = 90.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.21 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.294, top1 = 92.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.40 ms.
cifar100       train : [loss = 0.118, top1 = 97.66%], valid : [loss = 1.282, top1 = 69.68%], test : [loss = 1.274, top1 = 69.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 1.735, top1 = 53.68%], valid : [loss = 2.226, top1 = 42.93%], test : [loss = 2.267, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.10%], valid : [loss = 0.543, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5354/15625) 005354-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.132, top1 = 95.82%], valid : [loss = 0.455, top1 = 86.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.00 ms.
cifar10        train : [loss = 0.170, top1 = 94.44%], test  : [loss = 0.360, top1 = 88.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.21 ms.
cifar100       train : [loss = 1.003, top1 = 71.52%], valid : [loss = 1.341, top1 = 61.86%], test : [loss = 1.337, top1 = 62.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.46%], valid : [loss = 2.704, top1 = 32.67%], test : [loss = 2.700, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5355/15625) 005355-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.564, top1 = 87.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.388, top1 = 91.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 0.391, top1 = 88.95%], valid : [loss = 1.382, top1 = 65.74%], test : [loss = 1.395, top1 = 65.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.82%], valid : [loss = 2.532, top1 = 36.30%], test : [loss = 2.539, top1 = 36.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5356/15625) 005356-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.490, top1 = 89.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.82 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.301, top1 = 93.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.93 ms.
cifar100       train : [loss = 0.139, top1 = 97.18%], valid : [loss = 1.307, top1 = 69.08%], test : [loss = 1.296, top1 = 69.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.05%], valid : [loss = 2.250, top1 = 42.70%], test : [loss = 2.289, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5357/15625) 005357-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.41%], valid : [loss = 0.869, top1 = 75.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10        train : [loss = 0.312, top1 = 89.19%], test  : [loss = 0.648, top1 = 80.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 1.408, top1 = 60.39%], valid : [loss = 1.943, top1 = 49.34%], test : [loss = 1.941, top1 = 49.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 3.493, top1 = 17.35%], valid : [loss = 3.542, top1 = 17.27%], test : [loss = 3.531, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.19%], valid : [loss = 1.301, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5358/15625) 005358-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.500, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.321, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.86 ms.
cifar100       train : [loss = 0.354, top1 = 90.07%], valid : [loss = 1.256, top1 = 68.07%], test : [loss = 1.246, top1 = 68.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.63%], valid : [loss = 2.328, top1 = 40.36%], test : [loss = 2.341, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.86%], valid : [loss = 0.704, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5359/15625) 005359-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.47%], valid : [loss = 0.604, top1 = 84.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.100, top1 = 96.64%], test  : [loss = 0.409, top1 = 88.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.14 ms.
cifar100       train : [loss = 0.716, top1 = 78.69%], valid : [loss = 1.519, top1 = 60.16%], test : [loss = 1.517, top1 = 61.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 3.008, top1 = 25.94%], valid : [loss = 3.027, top1 = 26.27%], test : [loss = 3.052, top1 = 25.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.61%], valid : [loss = 1.021, top1 = 63.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5360/15625) 005360-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.570, top1 = 87.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.50 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.384, top1 = 90.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.88 ms.
cifar100       train : [loss = 0.409, top1 = 88.38%], valid : [loss = 1.388, top1 = 65.77%], test : [loss = 1.387, top1 = 65.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.77%], valid : [loss = 2.507, top1 = 37.00%], test : [loss = 2.536, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.63%], valid : [loss = 0.829, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5361/15625) 005361-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.08%], valid : [loss = 0.453, top1 = 86.51%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.49 ms.
cifar10        train : [loss = 0.154, top1 = 95.02%], test  : [loss = 0.339, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.66 ms.
cifar100       train : [loss = 0.991, top1 = 71.78%], valid : [loss = 1.345, top1 = 62.70%], test : [loss = 1.343, top1 = 62.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.64%], valid : [loss = 2.696, top1 = 32.83%], test : [loss = 2.716, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.32%], valid : [loss = 0.770, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5362/15625) 005362-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.98%], valid : [loss = 0.921, top1 = 76.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.49 ms.
cifar10        train : [loss = 0.217, top1 = 92.59%], test  : [loss = 0.571, top1 = 82.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 1.122, top1 = 67.96%], valid : [loss = 1.738, top1 = 54.32%], test : [loss = 1.741, top1 = 55.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.62%], valid : [loss = 3.334, top1 = 21.50%], test : [loss = 3.362, top1 = 20.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.68%], valid : [loss = 1.091, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5363/15625) 005363-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.506, top1 = 88.89%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.348, top1 = 91.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.73 ms.
cifar100       train : [loss = 0.350, top1 = 90.40%], valid : [loss = 1.287, top1 = 66.16%], test : [loss = 1.298, top1 = 67.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.62%], valid : [loss = 2.406, top1 = 38.60%], test : [loss = 2.414, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5364/15625) 005364-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.524, top1 = 88.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.40 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.328, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.84 ms.
cifar100       train : [loss = 0.303, top1 = 91.80%], valid : [loss = 1.272, top1 = 67.74%], test : [loss = 1.271, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.15%], valid : [loss = 2.243, top1 = 41.23%], test : [loss = 2.244, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.32%], valid : [loss = 0.631, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5365/15625) 005365-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.567, top1 = 88.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.413, top1 = 90.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=20.52 ms.
cifar100       train : [loss = 0.206, top1 = 94.96%], valid : [loss = 1.474, top1 = 66.00%], test : [loss = 1.458, top1 = 65.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.48%], valid : [loss = 2.524, top1 = 37.33%], test : [loss = 2.598, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.30%], valid : [loss = 0.676, top1 = 76.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5366/15625) 005366-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.10%], valid : [loss = 0.547, top1 = 83.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.194, top1 = 93.43%], test  : [loss = 0.394, top1 = 87.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.35 ms.
cifar100       train : [loss = 1.270, top1 = 63.91%], valid : [loss = 1.559, top1 = 57.23%], test : [loss = 1.579, top1 = 56.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.690, top1 = 32.81%], valid : [loss = 2.717, top1 = 32.08%], test : [loss = 2.765, top1 = 31.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.88%], valid : [loss = 0.967, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5367/15625) 005367-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.62%], valid : [loss = 0.600, top1 = 87.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10        train : [loss = 0.015, top1 = 99.60%], test  : [loss = 0.390, top1 = 91.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.40 ms.
cifar100       train : [loss = 0.347, top1 = 90.29%], valid : [loss = 1.429, top1 = 64.08%], test : [loss = 1.395, top1 = 64.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 2.723, top1 = 31.29%], valid : [loss = 2.812, top1 = 29.80%], test : [loss = 2.815, top1 = 29.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.21%], valid : [loss = 1.221, top1 = 55.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5368/15625) 005368-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.455, top1 = 89.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.74 ms.
cifar10        train : [loss = 0.012, top1 = 99.83%], test  : [loss = 0.337, top1 = 91.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.96 ms.
cifar100       train : [loss = 0.327, top1 = 91.03%], valid : [loss = 1.280, top1 = 67.38%], test : [loss = 1.311, top1 = 66.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.38%], valid : [loss = 2.389, top1 = 40.37%], test : [loss = 2.432, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5369/15625) 005369-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.441, top1 = 90.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.296, top1 = 93.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.59 ms.
cifar100       train : [loss = 0.067, top1 = 98.98%], valid : [loss = 1.365, top1 = 69.26%], test : [loss = 1.348, top1 = 69.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 1.528, top1 = 58.73%], valid : [loss = 2.252, top1 = 43.97%], test : [loss = 2.262, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.31%], valid : [loss = 0.541, top1 = 81.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5370/15625) 005370-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.583, top1 = 87.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.75 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.399, top1 = 91.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.22 ms.
cifar100       train : [loss = 0.134, top1 = 97.25%], valid : [loss = 1.497, top1 = 66.98%], test : [loss = 1.465, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 1.960, top1 = 48.61%], valid : [loss = 2.492, top1 = 37.93%], test : [loss = 2.503, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.81%], valid : [loss = 0.766, top1 = 73.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5371/15625) 005371-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.56 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.587, top1 = 87.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.392, top1 = 90.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.49 ms.
cifar100       train : [loss = 0.392, top1 = 88.90%], valid : [loss = 1.450, top1 = 64.90%], test : [loss = 1.393, top1 = 65.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.73%], valid : [loss = 2.539, top1 = 36.27%], test : [loss = 2.558, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5372/15625) 005372-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.76 ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.17%], valid : [loss = 0.865, top1 = 71.46%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 0.560, top1 = 80.50%], test  : [loss = 0.715, top1 = 75.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.42 ms.
cifar100       train : [loss = 1.791, top1 = 51.88%], valid : [loss = 2.065, top1 = 47.44%], test : [loss = 2.057, top1 = 46.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.81%], valid : [loss = 3.636, top1 = 16.93%], test : [loss = 3.668, top1 = 15.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5373/15625) 005373-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.72%], valid : [loss = 0.473, top1 = 84.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10        train : [loss = 0.296, top1 = 90.12%], test  : [loss = 0.403, top1 = 86.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 1.345, top1 = 62.57%], valid : [loss = 1.548, top1 = 57.88%], test : [loss = 1.512, top1 = 57.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.937, top1 = 28.16%], valid : [loss = 2.918, top1 = 29.10%], test : [loss = 2.980, top1 = 27.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5374/15625) 005374-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.001, top1 = 100.00%], valid : [loss = 0.434, top1 = 91.33%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.24 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.285, top1 = 93.89%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.28 ms.
cifar100       train : [loss = 0.023, top1 = 99.82%], valid : [loss = 1.299, top1 = 72.56%], test : [loss = 1.325, top1 = 72.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.64 ms.
ImageNet16-120 train : [loss = 1.212, top1 = 66.45%], valid : [loss = 2.217, top1 = 45.83%], test : [loss = 2.201, top1 = 46.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.303, top1 = 89.88%], valid : [loss = 0.463, top1 = 84.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5375/15625) 005375-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.41%], valid : [loss = 0.503, top1 = 84.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.233, top1 = 92.15%], test  : [loss = 0.394, top1 = 87.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.05 ms.
cifar100       train : [loss = 1.354, top1 = 61.91%], valid : [loss = 1.618, top1 = 55.64%], test : [loss = 1.619, top1 = 56.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.809, top1 = 30.48%], valid : [loss = 2.832, top1 = 30.50%], test : [loss = 2.886, top1 = 29.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.18%], valid : [loss = 1.001, top1 = 64.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5376/15625) 005376-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.491, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.330, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.08 ms.
cifar100       train : [loss = 0.327, top1 = 91.25%], valid : [loss = 1.256, top1 = 67.39%], test : [loss = 1.255, top1 = 68.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.71%], valid : [loss = 2.297, top1 = 40.78%], test : [loss = 2.349, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5377/15625) 005377-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.55%], valid : [loss = 0.546, top1 = 87.81%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10        train : [loss = 0.035, top1 = 99.05%], test  : [loss = 0.350, top1 = 90.89%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.50 ms.
cifar100       train : [loss = 0.634, top1 = 81.55%], valid : [loss = 1.449, top1 = 62.72%], test : [loss = 1.394, top1 = 63.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 2.510, top1 = 36.02%], valid : [loss = 2.591, top1 = 35.40%], test : [loss = 2.626, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.51%], valid : [loss = 0.948, top1 = 66.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5378/15625) 005378-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.570, top1 = 87.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10        train : [loss = 0.035, top1 = 98.94%], test  : [loss = 0.364, top1 = 91.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.35 ms.
cifar100       train : [loss = 0.530, top1 = 84.82%], valid : [loss = 1.362, top1 = 64.22%], test : [loss = 1.376, top1 = 64.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.587, top1 = 34.27%], valid : [loss = 2.661, top1 = 32.60%], test : [loss = 2.695, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.45%], valid : [loss = 0.868, top1 = 69.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5379/15625) 005379-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.11 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.83%], valid : [loss = 0.453, top1 = 86.42%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10        train : [loss = 0.151, top1 = 95.07%], test  : [loss = 0.342, top1 = 88.93%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.54 ms.
cifar100       train : [loss = 0.973, top1 = 72.31%], valid : [loss = 1.339, top1 = 62.77%], test : [loss = 1.339, top1 = 62.23%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.47%], valid : [loss = 2.658, top1 = 32.88%], test : [loss = 2.689, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.29%], valid : [loss = 0.782, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5380/15625) 005380-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.514, top1 = 88.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.320, top1 = 91.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.25 ms.
cifar100       train : [loss = 0.334, top1 = 90.93%], valid : [loss = 1.308, top1 = 67.10%], test : [loss = 1.292, top1 = 66.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.16%], valid : [loss = 2.404, top1 = 39.23%], test : [loss = 2.405, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5381/15625) 005381-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.40%], valid : [loss = 0.523, top1 = 84.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.164, top1 = 94.55%], test  : [loss = 0.380, top1 = 88.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 1.119, top1 = 67.92%], valid : [loss = 1.480, top1 = 58.58%], test : [loss = 1.465, top1 = 59.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.49%], valid : [loss = 2.683, top1 = 34.13%], test : [loss = 2.714, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.36%], valid : [loss = 0.938, top1 = 66.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5382/15625) 005382-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.491, top1 = 89.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.55 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.303, top1 = 92.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.30 ms.
cifar100       train : [loss = 0.139, top1 = 97.14%], valid : [loss = 1.278, top1 = 69.52%], test : [loss = 1.283, top1 = 70.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 1.735, top1 = 53.70%], valid : [loss = 2.177, top1 = 43.73%], test : [loss = 2.194, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.00%], valid : [loss = 0.611, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5383/15625) 005383-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.65%], valid : [loss = 0.534, top1 = 88.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=20.03 ms.
cifar10        train : [loss = 0.024, top1 = 99.30%], test  : [loss = 0.368, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.444, top1 = 87.07%], valid : [loss = 1.280, top1 = 66.14%], test : [loss = 1.281, top1 = 66.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.07%], valid : [loss = 2.430, top1 = 39.27%], test : [loss = 2.455, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.99%], valid : [loss = 0.808, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5384/15625) 005384-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.577, top1 = 87.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.360, top1 = 91.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.62 ms.
cifar100       train : [loss = 0.354, top1 = 90.26%], valid : [loss = 1.456, top1 = 64.32%], test : [loss = 1.418, top1 = 65.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.69%], valid : [loss = 2.495, top1 = 37.37%], test : [loss = 2.511, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.78%], valid : [loss = 0.807, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5385/15625) 005385-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.27%], valid : [loss = 0.448, top1 = 86.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.153, top1 = 94.99%], test  : [loss = 0.349, top1 = 88.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 1.011, top1 = 71.11%], valid : [loss = 1.347, top1 = 61.76%], test : [loss = 1.344, top1 = 62.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.71%], valid : [loss = 2.725, top1 = 32.00%], test : [loss = 2.734, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5386/15625) 005386-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.519, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.019, top1 = 99.57%], test  : [loss = 0.364, top1 = 91.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.13 ms.
cifar100       train : [loss = 0.393, top1 = 88.63%], valid : [loss = 1.329, top1 = 66.52%], test : [loss = 1.326, top1 = 65.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.202, top1 = 42.93%], valid : [loss = 2.402, top1 = 39.07%], test : [loss = 2.469, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.15%], valid : [loss = 0.627, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5387/15625) 005387-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.495, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.312, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.239, top1 = 93.98%], valid : [loss = 1.221, top1 = 69.20%], test : [loss = 1.277, top1 = 68.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.84%], valid : [loss = 2.255, top1 = 42.03%], test : [loss = 2.264, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.74%], valid : [loss = 0.666, top1 = 77.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5388/15625) 005388-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.559, top1 = 88.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.370, top1 = 91.45%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.10 ms.
cifar100       train : [loss = 0.259, top1 = 92.93%], valid : [loss = 1.305, top1 = 67.68%], test : [loss = 1.341, top1 = 67.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.212, top1 = 42.77%], valid : [loss = 2.426, top1 = 37.83%], test : [loss = 2.459, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 65.92%], valid : [loss = 0.973, top1 = 65.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5389/15625) 005389-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.574, top1 = 87.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.350, top1 = 91.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.402, top1 = 88.46%], valid : [loss = 1.362, top1 = 65.86%], test : [loss = 1.356, top1 = 65.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.76%], valid : [loss = 2.493, top1 = 36.40%], test : [loss = 2.471, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.51%], valid : [loss = 0.766, top1 = 73.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5390/15625) 005390-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.422, top1 = 90.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.009, top1 = 99.90%], test  : [loss = 0.276, top1 = 92.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.68 ms.
cifar100       train : [loss = 0.204, top1 = 95.24%], valid : [loss = 1.268, top1 = 68.92%], test : [loss = 1.266, top1 = 69.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 50.88%], valid : [loss = 2.265, top1 = 42.83%], test : [loss = 2.293, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5391/15625) 005391-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.53 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5392/15625) 005392-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.493, top1 = 89.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.017, top1 = 99.62%], test  : [loss = 0.333, top1 = 92.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 0.362, top1 = 89.85%], valid : [loss = 1.279, top1 = 67.94%], test : [loss = 1.295, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.097, top1 = 45.34%], valid : [loss = 2.311, top1 = 41.57%], test : [loss = 2.353, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.11%], valid : [loss = 0.830, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5393/15625) 005393-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.49%], valid : [loss = 0.439, top1 = 88.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.80 ms.
cifar10        train : [loss = 0.059, top1 = 98.49%], test  : [loss = 0.320, top1 = 90.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.25 ms.
cifar100       train : [loss = 0.591, top1 = 83.76%], valid : [loss = 1.232, top1 = 66.78%], test : [loss = 1.201, top1 = 66.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 41.11%], valid : [loss = 2.475, top1 = 37.47%], test : [loss = 2.481, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5394/15625) 005394-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.337, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.240, top1 = 93.73%], valid : [loss = 1.253, top1 = 68.78%], test : [loss = 1.260, top1 = 68.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.14%], valid : [loss = 2.220, top1 = 43.03%], test : [loss = 2.259, top1 = 42.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.02%], valid : [loss = 0.673, top1 = 76.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5395/15625) 005395-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.604, top1 = 86.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.398, top1 = 90.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.411, top1 = 88.31%], valid : [loss = 1.372, top1 = 65.92%], test : [loss = 1.402, top1 = 65.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.74%], valid : [loss = 2.507, top1 = 37.03%], test : [loss = 2.547, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.96%], valid : [loss = 0.838, top1 = 70.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5396/15625) 005396-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.547, top1 = 88.78%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.64 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.350, top1 = 92.01%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.07 ms.
cifar100       train : [loss = 0.234, top1 = 93.91%], valid : [loss = 1.334, top1 = 68.04%], test : [loss = 1.320, top1 = 68.68%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.47 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.74%], valid : [loss = 2.369, top1 = 39.43%], test : [loss = 2.401, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.62%], valid : [loss = 0.786, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5397/15625) 005397-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.370, top1 = 91.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 0.264, top1 = 92.78%], valid : [loss = 1.464, top1 = 65.12%], test : [loss = 1.413, top1 = 66.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 45.04%], valid : [loss = 2.507, top1 = 37.80%], test : [loss = 2.517, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.74%], valid : [loss = 0.675, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5398/15625) 005398-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.11%], valid : [loss = 0.477, top1 = 84.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.302, top1 = 89.69%], test  : [loss = 0.398, top1 = 86.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 1.331, top1 = 62.96%], valid : [loss = 1.524, top1 = 58.82%], test : [loss = 1.512, top1 = 58.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.66%], valid : [loss = 2.890, top1 = 29.57%], test : [loss = 2.948, top1 = 28.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5399/15625) 005399-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.79%], valid : [loss = 0.455, top1 = 86.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.152, top1 = 95.05%], test  : [loss = 0.347, top1 = 88.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.03 ms.
cifar100       train : [loss = 0.969, top1 = 72.56%], valid : [loss = 1.351, top1 = 62.43%], test : [loss = 1.340, top1 = 62.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.07%], valid : [loss = 2.664, top1 = 33.48%], test : [loss = 2.706, top1 = 32.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5400/15625) 005400-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.08%], valid : [loss = 0.484, top1 = 84.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.299, top1 = 90.07%], test  : [loss = 0.398, top1 = 86.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.64 ms.
cifar100       train : [loss = 1.341, top1 = 62.98%], valid : [loss = 1.536, top1 = 58.08%], test : [loss = 1.501, top1 = 58.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.40%], valid : [loss = 2.889, top1 = 29.83%], test : [loss = 2.978, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5401/15625) 005401-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.93 ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.20%], valid : [loss = 0.640, top1 = 78.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10        train : [loss = 0.513, top1 = 82.15%], test  : [loss = 0.593, top1 = 80.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.06 ms.
cifar100       train : [loss = 1.676, top1 = 54.47%], valid : [loss = 1.842, top1 = 50.75%], test : [loss = 1.870, top1 = 50.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.50 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.26%], valid : [loss = 3.318, top1 = 21.07%], test : [loss = 3.352, top1 = 21.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5402/15625) 005402-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.526, top1 = 89.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.23 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.326, top1 = 93.35%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.93 ms.
cifar100       train : [loss = 0.077, top1 = 98.79%], valid : [loss = 1.385, top1 = 68.80%], test : [loss = 1.422, top1 = 68.36%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 44.92%], valid : [loss = 2.416, top1 = 38.57%], test : [loss = 2.454, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5403/15625) 005403-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.15%], valid : [loss = 0.467, top1 = 85.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.157, top1 = 94.78%], test  : [loss = 0.345, top1 = 88.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 1.020, top1 = 70.91%], valid : [loss = 1.375, top1 = 61.58%], test : [loss = 1.362, top1 = 61.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.42%], valid : [loss = 2.720, top1 = 32.60%], test : [loss = 2.704, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5404/15625) 005404-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.502, top1 = 89.39%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.41 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.328, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.68 ms.
cifar100       train : [loss = 0.151, top1 = 96.83%], valid : [loss = 1.288, top1 = 69.72%], test : [loss = 1.291, top1 = 69.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.31 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.24%], valid : [loss = 2.293, top1 = 42.00%], test : [loss = 2.301, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.66%], valid : [loss = 0.634, top1 = 78.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5405/15625) 005405-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.23%], valid : [loss = 0.552, top1 = 83.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10        train : [loss = 0.188, top1 = 93.67%], test  : [loss = 0.393, top1 = 87.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.62 ms.
cifar100       train : [loss = 1.188, top1 = 66.07%], valid : [loss = 1.518, top1 = 58.78%], test : [loss = 1.520, top1 = 58.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.64%], valid : [loss = 2.693, top1 = 32.48%], test : [loss = 2.725, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.53%], valid : [loss = 0.990, top1 = 65.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5406/15625) 005406-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.153, top1 = 95.06%], valid : [loss = 0.511, top1 = 84.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.171, top1 = 94.19%], test  : [loss = 0.381, top1 = 88.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 1.021, top1 = 70.60%], valid : [loss = 1.387, top1 = 61.72%], test : [loss = 1.386, top1 = 61.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.44%], valid : [loss = 2.668, top1 = 33.37%], test : [loss = 2.707, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.52%], valid : [loss = 0.939, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5407/15625) 005407-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.80%], valid : [loss = 0.879, top1 = 70.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.676, top1 = 76.47%], test  : [loss = 0.766, top1 = 73.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 1.959, top1 = 47.82%], valid : [loss = 2.135, top1 = 44.54%], test : [loss = 2.153, top1 = 44.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.84%], valid : [loss = 3.658, top1 = 15.97%], test : [loss = 3.677, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.376, top1 = 49.82%], valid : [loss = 1.395, top1 = 49.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5408/15625) 005408-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.68%], valid : [loss = 0.519, top1 = 83.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.243, top1 = 91.78%], test  : [loss = 0.390, top1 = 87.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.70 ms.
cifar100       train : [loss = 1.339, top1 = 62.34%], valid : [loss = 1.604, top1 = 56.33%], test : [loss = 1.592, top1 = 56.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 2.856, top1 = 29.61%], valid : [loss = 2.871, top1 = 29.78%], test : [loss = 2.928, top1 = 28.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.41%], valid : [loss = 0.984, top1 = 65.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5409/15625) 005409-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.73 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.03 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5410/15625) 005410-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.604, top1 = 88.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10        train : [loss = 0.011, top1 = 99.70%], test  : [loss = 0.399, top1 = 91.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.89 ms.
cifar100       train : [loss = 0.139, top1 = 96.79%], valid : [loss = 1.382, top1 = 68.08%], test : [loss = 1.381, top1 = 68.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.22%], valid : [loss = 2.485, top1 = 36.93%], test : [loss = 2.454, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.883, top1 = 68.27%], valid : [loss = 0.926, top1 = 67.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5411/15625) 005411-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.362, top1 = 92.45%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.90 ms.
cifar100       train : [loss = 0.101, top1 = 98.20%], valid : [loss = 1.449, top1 = 68.38%], test : [loss = 1.446, top1 = 68.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.93%], valid : [loss = 2.410, top1 = 40.10%], test : [loss = 2.432, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.92%], valid : [loss = 0.715, top1 = 75.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5412/15625) 005412-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 1.208, top1 = 56.66%], valid : [loss = 1.265, top1 = 54.97%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.01 ms.
cifar10        train : [loss = 1.176, top1 = 58.05%], test  : [loss = 1.179, top1 = 57.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.86 ms.
cifar100       train : [loss = 2.675, top1 = 32.87%], valid : [loss = 2.753, top1 = 31.54%], test : [loss = 2.747, top1 = 31.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.46 ms.
ImageNet16-120 train : [loss = 3.868, top1 = 12.40%], valid : [loss = 3.864, top1 = 13.37%], test : [loss = 3.882, top1 = 12.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5413/15625) 005413-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.465, top1 = 89.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.308, top1 = 92.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.72 ms.
cifar100       train : [loss = 0.344, top1 = 90.35%], valid : [loss = 1.297, top1 = 66.80%], test : [loss = 1.296, top1 = 67.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.088, top1 = 45.58%], valid : [loss = 2.336, top1 = 41.07%], test : [loss = 2.382, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.26%], valid : [loss = 0.624, top1 = 78.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5414/15625) 005414-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.591, top1 = 87.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.381, top1 = 91.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.11 ms.
cifar100       train : [loss = 0.380, top1 = 89.20%], valid : [loss = 1.400, top1 = 65.21%], test : [loss = 1.427, top1 = 65.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.20%], valid : [loss = 2.505, top1 = 36.96%], test : [loss = 2.534, top1 = 36.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.31%], valid : [loss = 0.832, top1 = 70.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5415/15625) 005415-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.90%], valid : [loss = 0.449, top1 = 86.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10        train : [loss = 0.157, top1 = 94.79%], test  : [loss = 0.348, top1 = 88.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.54 ms.
cifar100       train : [loss = 1.022, top1 = 71.00%], valid : [loss = 1.386, top1 = 61.24%], test : [loss = 1.369, top1 = 61.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.04%], valid : [loss = 2.679, top1 = 32.73%], test : [loss = 2.683, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5416/15625) 005416-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.80%], valid : [loss = 0.567, top1 = 86.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.067, top1 = 97.82%], test  : [loss = 0.344, top1 = 90.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.15 ms.
cifar100       train : [loss = 0.633, top1 = 81.28%], valid : [loss = 1.330, top1 = 64.52%], test : [loss = 1.303, top1 = 64.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 38.66%], valid : [loss = 2.527, top1 = 36.03%], test : [loss = 2.562, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.14%], valid : [loss = 0.877, top1 = 68.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5417/15625) 005417-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.404, top1 = 86.20%], valid : [loss = 0.537, top1 = 82.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.49 ms.
cifar10        train : [loss = 0.413, top1 = 86.01%], test  : [loss = 0.482, top1 = 83.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.15 ms.
cifar100       train : [loss = 1.546, top1 = 57.45%], valid : [loss = 1.671, top1 = 53.76%], test : [loss = 1.675, top1 = 54.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 3.046, top1 = 26.31%], valid : [loss = 3.020, top1 = 26.57%], test : [loss = 3.074, top1 = 25.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 59.78%], valid : [loss = 1.152, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5418/15625) 005418-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.24%], valid : [loss = 0.871, top1 = 70.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10        train : [loss = 0.733, top1 = 74.29%], test  : [loss = 0.787, top1 = 72.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.75 ms.
cifar100       train : [loss = 2.382, top1 = 37.63%], valid : [loss = 2.515, top1 = 34.74%], test : [loss = 2.502, top1 = 35.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 3.553, top1 = 17.02%], valid : [loss = 3.526, top1 = 17.87%], test : [loss = 3.568, top1 = 16.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.447, top1 = 47.19%], valid : [loss = 1.498, top1 = 44.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5419/15625) 005419-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.97%], valid : [loss = 0.478, top1 = 84.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.305, top1 = 89.82%], test  : [loss = 0.400, top1 = 86.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 1.334, top1 = 63.03%], valid : [loss = 1.529, top1 = 57.80%], test : [loss = 1.521, top1 = 58.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.99 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.72%], valid : [loss = 2.901, top1 = 29.57%], test : [loss = 2.960, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5420/15625) 005420-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.583, top1 = 87.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.76 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.414, top1 = 90.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.95 ms.
cifar100       train : [loss = 0.399, top1 = 88.70%], valid : [loss = 1.380, top1 = 65.28%], test : [loss = 1.356, top1 = 66.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.93%], valid : [loss = 2.527, top1 = 36.67%], test : [loss = 2.547, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.63%], valid : [loss = 0.829, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5421/15625) 005421-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.568, top1 = 88.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.20 ms.
cifar10        train : [loss = 0.015, top1 = 99.56%], test  : [loss = 0.390, top1 = 91.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.56 ms.
cifar100       train : [loss = 0.254, top1 = 93.25%], valid : [loss = 1.271, top1 = 68.38%], test : [loss = 1.322, top1 = 67.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 41.71%], valid : [loss = 2.463, top1 = 37.20%], test : [loss = 2.461, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.96%], valid : [loss = 0.945, top1 = 66.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5422/15625) 005422-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.85%], valid : [loss = 0.625, top1 = 79.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.303, top1 = 89.60%], test  : [loss = 0.452, top1 = 85.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.23 ms.
cifar100       train : [loss = 1.629, top1 = 54.96%], valid : [loss = 1.854, top1 = 50.67%], test : [loss = 1.856, top1 = 50.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 3.149, top1 = 23.99%], valid : [loss = 3.145, top1 = 24.33%], test : [loss = 3.223, top1 = 22.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.095, top1 = 60.60%], valid : [loss = 1.122, top1 = 59.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5423/15625) 005423-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.496, top1 = 89.58%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.53 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.285, top1 = 93.21%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.68 ms.
cifar100       train : [loss = 0.131, top1 = 97.46%], valid : [loss = 1.284, top1 = 68.88%], test : [loss = 1.308, top1 = 69.04%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.78 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 53.08%], valid : [loss = 2.184, top1 = 44.17%], test : [loss = 2.186, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 75.95%], valid : [loss = 0.752, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5424/15625) 005424-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.436, top1 = 89.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.302, top1 = 92.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.69 ms.
cifar100       train : [loss = 0.114, top1 = 98.00%], valid : [loss = 1.276, top1 = 70.84%], test : [loss = 1.258, top1 = 70.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 1.700, top1 = 54.68%], valid : [loss = 2.237, top1 = 43.70%], test : [loss = 2.276, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.86%], valid : [loss = 0.531, top1 = 81.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5425/15625) 005425-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.74%], valid : [loss = 0.812, top1 = 81.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.082, top1 = 97.36%], test  : [loss = 0.487, top1 = 86.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.97 ms.
cifar100       train : [loss = 0.820, top1 = 76.09%], valid : [loss = 1.530, top1 = 59.84%], test : [loss = 1.497, top1 = 60.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.795, top1 = 30.80%], valid : [loss = 2.923, top1 = 28.77%], test : [loss = 2.964, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.52%], valid : [loss = 0.894, top1 = 68.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5426/15625) 005426-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.88%], valid : [loss = 0.528, top1 = 87.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=14.71 ms.
cifar10        train : [loss = 0.075, top1 = 97.64%], test  : [loss = 0.369, top1 = 89.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.84 ms.
cifar100       train : [loss = 0.719, top1 = 78.90%], valid : [loss = 1.342, top1 = 64.84%], test : [loss = 1.334, top1 = 64.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.13%], valid : [loss = 2.624, top1 = 34.53%], test : [loss = 2.648, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.60%], valid : [loss = 0.690, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5427/15625) 005427-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.043, top1 = 99.15%], valid : [loss = 0.507, top1 = 86.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10        train : [loss = 0.058, top1 = 98.37%], test  : [loss = 0.346, top1 = 90.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.61 ms.
cifar100       train : [loss = 0.531, top1 = 84.86%], valid : [loss = 1.241, top1 = 66.66%], test : [loss = 1.209, top1 = 67.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.11%], valid : [loss = 2.330, top1 = 40.00%], test : [loss = 2.385, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.19%], valid : [loss = 0.805, top1 = 71.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5428/15625) 005428-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.19%], valid : [loss = 0.880, top1 = 71.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.74 ms.
cifar10        train : [loss = 0.552, top1 = 80.73%], test  : [loss = 0.720, top1 = 75.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 1.772, top1 = 52.24%], valid : [loss = 2.061, top1 = 46.48%], test : [loss = 2.067, top1 = 46.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.86%], valid : [loss = 3.631, top1 = 16.90%], test : [loss = 3.680, top1 = 16.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5429/15625) 005429-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.557, top1 = 88.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.98 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.348, top1 = 92.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.57 ms.
cifar100       train : [loss = 0.247, top1 = 93.37%], valid : [loss = 1.312, top1 = 68.05%], test : [loss = 1.328, top1 = 67.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.44%], valid : [loss = 2.393, top1 = 39.15%], test : [loss = 2.395, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.84%], valid : [loss = 0.896, top1 = 68.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5430/15625) 005430-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.520, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.324, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.276, top1 = 92.49%], valid : [loss = 1.276, top1 = 67.89%], test : [loss = 1.266, top1 = 67.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.992, top1 = 47.69%], valid : [loss = 2.301, top1 = 40.76%], test : [loss = 2.304, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 76.03%], valid : [loss = 0.752, top1 = 74.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5431/15625) 005431-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.58%], valid : [loss = 0.536, top1 = 86.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.111, top1 = 96.39%], test  : [loss = 0.373, top1 = 89.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.07 ms.
cifar100       train : [loss = 0.763, top1 = 78.01%], valid : [loss = 1.313, top1 = 64.46%], test : [loss = 1.307, top1 = 64.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.59%], valid : [loss = 2.591, top1 = 35.20%], test : [loss = 2.567, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.94%], valid : [loss = 0.922, top1 = 67.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5432/15625) 005432-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.26 ms.
cifar10-valid  train : [loss = 0.971, top1 = 66.11%], valid : [loss = 1.017, top1 = 64.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 0.887, top1 = 69.21%], test  : [loss = 0.897, top1 = 68.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.39 ms.
cifar100       train : [loss = 2.352, top1 = 39.66%], valid : [loss = 2.425, top1 = 37.52%], test : [loss = 2.403, top1 = 38.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.30 ms.
ImageNet16-120 train : [loss = 3.626, top1 = 16.08%], valid : [loss = 3.592, top1 = 17.30%], test : [loss = 3.628, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.607, top1 = 39.57%], valid : [loss = 1.631, top1 = 38.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5433/15625) 005433-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.52%], valid : [loss = 0.823, top1 = 77.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.17 ms.
cifar10        train : [loss = 0.246, top1 = 91.40%], test  : [loss = 0.562, top1 = 82.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.54 ms.
cifar100       train : [loss = 1.161, top1 = 66.67%], valid : [loss = 1.729, top1 = 54.98%], test : [loss = 1.762, top1 = 54.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 3.435, top1 = 18.23%], valid : [loss = 3.457, top1 = 18.20%], test : [loss = 3.468, top1 = 18.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.267, top1 = 53.76%], valid : [loss = 1.310, top1 = 52.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5434/15625) 005434-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.609, top1 = 85.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.408, top1 = 88.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.60 ms.
cifar100       train : [loss = 0.721, top1 = 78.98%], valid : [loss = 1.384, top1 = 63.53%], test : [loss = 1.369, top1 = 63.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.08%], valid : [loss = 2.661, top1 = 33.39%], test : [loss = 2.698, top1 = 33.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5435/15625) 005435-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.65 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.01%], valid : [loss = 0.873, top1 = 80.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.45 ms.
cifar10        train : [loss = 0.063, top1 = 97.97%], test  : [loss = 0.452, top1 = 88.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.28 ms.
cifar100       train : [loss = 0.535, top1 = 84.65%], valid : [loss = 1.595, top1 = 60.22%], test : [loss = 1.587, top1 = 60.62%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 2.459, top1 = 37.63%], valid : [loss = 2.770, top1 = 32.10%], test : [loss = 2.744, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.96%], valid : [loss = 0.924, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5436/15625) 005436-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.541, top1 = 89.32%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.330, top1 = 92.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.20 ms.
cifar100       train : [loss = 0.078, top1 = 98.54%], valid : [loss = 1.436, top1 = 68.74%], test : [loss = 1.467, top1 = 68.80%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.44%], valid : [loss = 2.333, top1 = 41.37%], test : [loss = 2.351, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.22%], valid : [loss = 0.890, top1 = 68.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5437/15625) 005437-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.529, top1 = 88.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.359, top1 = 91.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.93 ms.
cifar100       train : [loss = 0.242, top1 = 93.69%], valid : [loss = 1.398, top1 = 66.90%], test : [loss = 1.420, top1 = 67.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 46.12%], valid : [loss = 2.413, top1 = 40.17%], test : [loss = 2.415, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.76%], valid : [loss = 0.593, top1 = 79.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5438/15625) 005438-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.73%], valid : [loss = 0.449, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.34 ms.
cifar10        train : [loss = 0.148, top1 = 95.22%], test  : [loss = 0.333, top1 = 89.15%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.49 ms.
cifar100       train : [loss = 0.962, top1 = 72.58%], valid : [loss = 1.338, top1 = 62.83%], test : [loss = 1.321, top1 = 62.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.18%], valid : [loss = 2.662, top1 = 32.78%], test : [loss = 2.699, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.51%], valid : [loss = 0.738, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5439/15625) 005439-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.789, top1 = 83.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.77 ms.
cifar10        train : [loss = 0.037, top1 = 98.95%], test  : [loss = 0.504, top1 = 88.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.15 ms.
cifar100       train : [loss = 0.417, top1 = 88.48%], valid : [loss = 1.714, top1 = 60.18%], test : [loss = 1.739, top1 = 59.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.564, top1 = 35.43%], valid : [loss = 2.872, top1 = 30.27%], test : [loss = 2.933, top1 = 29.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.68%], valid : [loss = 0.907, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5440/15625) 005440-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.499, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.296, top1 = 92.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.64 ms.
cifar100       train : [loss = 0.174, top1 = 96.20%], valid : [loss = 1.239, top1 = 69.63%], test : [loss = 1.259, top1 = 69.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.771, top1 = 52.82%], valid : [loss = 2.222, top1 = 43.15%], test : [loss = 2.227, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.59%], valid : [loss = 0.587, top1 = 80.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5441/15625) 005441-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.507, top1 = 88.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.327, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.92 ms.
cifar100       train : [loss = 0.339, top1 = 90.79%], valid : [loss = 1.284, top1 = 65.88%], test : [loss = 1.273, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.87%], valid : [loss = 2.409, top1 = 38.53%], test : [loss = 2.404, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5442/15625) 005442-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 22.20 M, Params=0.176 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.597, top1 = 86.63%]
cifar10        FLOP= 22.20 M, Params=0.176 MB, latency=18.76 ms.
cifar10        train : [loss = 0.023, top1 = 99.47%], test  : [loss = 0.400, top1 = 90.20%]
cifar100       FLOP= 22.21 M, Params=0.182 MB, latency=17.95 ms.
cifar100       train : [loss = 0.320, top1 = 91.70%], valid : [loss = 1.364, top1 = 66.10%], test : [loss = 1.366, top1 = 66.09%]
ImageNet16-120 FLOP=  5.56 M, Params=0.183 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.87%], valid : [loss = 2.516, top1 = 37.26%], test : [loss = 2.525, top1 = 37.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.01%], valid : [loss = 0.722, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5443/15625) 005443-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.55%], valid : [loss = 0.646, top1 = 85.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.73 ms.
cifar10        train : [loss = 0.051, top1 = 98.52%], test  : [loss = 0.423, top1 = 88.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.51 ms.
cifar100       train : [loss = 0.640, top1 = 81.48%], valid : [loss = 1.400, top1 = 63.72%], test : [loss = 1.377, top1 = 63.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.25%], valid : [loss = 2.628, top1 = 34.47%], test : [loss = 2.669, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.38%], valid : [loss = 0.833, top1 = 70.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5444/15625) 005444-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.546, top1 = 89.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.378, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.85 ms.
cifar100       train : [loss = 0.119, top1 = 97.79%], valid : [loss = 1.462, top1 = 67.52%], test : [loss = 1.441, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 50.05%], valid : [loss = 2.397, top1 = 39.40%], test : [loss = 2.419, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 76.96%], valid : [loss = 0.742, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5445/15625) 005445-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.557, top1 = 87.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.381, top1 = 91.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.53 ms.
cifar100       train : [loss = 0.386, top1 = 89.17%], valid : [loss = 1.398, top1 = 65.28%], test : [loss = 1.412, top1 = 65.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.99%], valid : [loss = 2.516, top1 = 37.60%], test : [loss = 2.519, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5446/15625) 005446-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.60%], valid : [loss = 0.431, top1 = 88.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.057, top1 = 98.62%], test  : [loss = 0.315, top1 = 90.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.42 ms.
cifar100       train : [loss = 0.587, top1 = 83.88%], valid : [loss = 1.225, top1 = 66.48%], test : [loss = 1.200, top1 = 66.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.93%], valid : [loss = 2.487, top1 = 37.77%], test : [loss = 2.489, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.49%], valid : [loss = 0.635, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5447/15625) 005447-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.581, top1 = 88.20%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.86 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.359, top1 = 92.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.83 ms.
cifar100       train : [loss = 0.058, top1 = 99.33%], valid : [loss = 1.469, top1 = 68.06%], test : [loss = 1.441, top1 = 68.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.08 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.97%], valid : [loss = 2.424, top1 = 40.77%], test : [loss = 2.399, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.56%], valid : [loss = 0.688, top1 = 76.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5448/15625) 005448-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.597, top1 = 88.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.29 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.398, top1 = 91.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.52 ms.
cifar100       train : [loss = 0.142, top1 = 96.88%], valid : [loss = 1.511, top1 = 66.54%], test : [loss = 1.558, top1 = 66.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.21%], valid : [loss = 2.478, top1 = 37.53%], test : [loss = 2.506, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.56%], valid : [loss = 0.790, top1 = 72.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5449/15625) 005449-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.447, top1 = 84.42%], valid : [loss = 0.661, top1 = 78.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.348, top1 = 87.84%], test  : [loss = 0.500, top1 = 83.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.59 ms.
cifar100       train : [loss = 1.706, top1 = 53.01%], valid : [loss = 1.931, top1 = 48.46%], test : [loss = 1.898, top1 = 49.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 3.239, top1 = 22.60%], valid : [loss = 3.243, top1 = 22.23%], test : [loss = 3.313, top1 = 22.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.58%], valid : [loss = 1.255, top1 = 54.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5450/15625) 005450-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.14%], valid : [loss = 0.705, top1 = 83.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.051, top1 = 98.41%], test  : [loss = 0.447, top1 = 88.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.81 ms.
cifar100       train : [loss = 0.612, top1 = 82.09%], valid : [loss = 1.478, top1 = 62.56%], test : [loss = 1.498, top1 = 61.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.26%], valid : [loss = 2.834, top1 = 31.20%], test : [loss = 2.859, top1 = 30.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.54%], valid : [loss = 0.907, top1 = 67.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5451/15625) 005451-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.69%], valid : [loss = 0.942, top1 = 67.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.762, top1 = 73.35%], test  : [loss = 0.821, top1 = 71.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.69 ms.
cifar100       train : [loss = 2.390, top1 = 37.57%], valid : [loss = 2.519, top1 = 35.74%], test : [loss = 2.502, top1 = 35.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.37%], valid : [loss = 3.590, top1 = 17.03%], test : [loss = 3.611, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.461, top1 = 46.44%], valid : [loss = 1.510, top1 = 44.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5452/15625) 005452-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.44%], valid : [loss = 0.848, top1 = 72.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10        train : [loss = 0.564, top1 = 80.11%], test  : [loss = 0.734, top1 = 75.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.79 ms.
cifar100       train : [loss = 1.792, top1 = 51.65%], valid : [loss = 2.075, top1 = 46.20%], test : [loss = 2.078, top1 = 46.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.69%], valid : [loss = 3.661, top1 = 15.03%], test : [loss = 3.671, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5453/15625) 005453-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.345, top1 = 91.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.77 ms.
cifar100       train : [loss = 0.340, top1 = 90.74%], valid : [loss = 1.277, top1 = 67.44%], test : [loss = 1.253, top1 = 67.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.57%], valid : [loss = 2.419, top1 = 38.00%], test : [loss = 2.421, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5454/15625) 005454-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.363, top1 = 91.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.81 ms.
cifar100       train : [loss = 0.329, top1 = 90.89%], valid : [loss = 1.285, top1 = 67.26%], test : [loss = 1.295, top1 = 67.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=22.14 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 44.13%], valid : [loss = 2.405, top1 = 39.17%], test : [loss = 2.426, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.43%], valid : [loss = 0.802, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5455/15625) 005455-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.08%], valid : [loss = 0.466, top1 = 85.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.159, top1 = 94.77%], test  : [loss = 0.345, top1 = 88.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.64 ms.
cifar100       train : [loss = 1.015, top1 = 71.03%], valid : [loss = 1.366, top1 = 61.80%], test : [loss = 1.363, top1 = 61.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.92%], valid : [loss = 2.686, top1 = 32.97%], test : [loss = 2.713, top1 = 32.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5456/15625) 005456-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.523, top1 = 88.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.343, top1 = 91.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.339, top1 = 90.79%], valid : [loss = 1.269, top1 = 67.20%], test : [loss = 1.288, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.85%], valid : [loss = 2.422, top1 = 38.88%], test : [loss = 2.432, top1 = 38.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5457/15625) 005457-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.503, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.353, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.478, top1 = 86.07%], valid : [loss = 1.312, top1 = 66.34%], test : [loss = 1.324, top1 = 65.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 39.95%], valid : [loss = 2.568, top1 = 36.03%], test : [loss = 2.583, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.17%], valid : [loss = 0.679, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5458/15625) 005458-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.319, top1 = 91.33%], valid : [loss = 1.249, top1 = 68.00%], test : [loss = 1.253, top1 = 68.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.76%], valid : [loss = 2.301, top1 = 40.17%], test : [loss = 2.345, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5459/15625) 005459-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.68%], valid : [loss = 0.580, top1 = 85.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.72 ms.
cifar10        train : [loss = 0.071, top1 = 97.96%], test  : [loss = 0.356, top1 = 89.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.41 ms.
cifar100       train : [loss = 0.677, top1 = 80.26%], valid : [loss = 1.389, top1 = 63.36%], test : [loss = 1.359, top1 = 64.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.409, top1 = 38.46%], valid : [loss = 2.523, top1 = 35.70%], test : [loss = 2.531, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.40%], valid : [loss = 0.842, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5460/15625) 005460-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.52 ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.84%], valid : [loss = 0.901, top1 = 68.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10        train : [loss = 0.731, top1 = 74.15%], test  : [loss = 0.777, top1 = 73.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.23 ms.
cifar100       train : [loss = 2.295, top1 = 39.65%], valid : [loss = 2.380, top1 = 38.53%], test : [loss = 2.379, top1 = 38.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 3.536, top1 = 17.22%], valid : [loss = 3.516, top1 = 18.26%], test : [loss = 3.530, top1 = 17.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.366, top1 = 50.08%], valid : [loss = 1.409, top1 = 49.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5461/15625) 005461-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.97%], valid : [loss = 0.858, top1 = 71.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10        train : [loss = 0.556, top1 = 80.50%], test  : [loss = 0.717, top1 = 75.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.46 ms.
cifar100       train : [loss = 1.790, top1 = 51.82%], valid : [loss = 2.059, top1 = 46.82%], test : [loss = 2.078, top1 = 46.73%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.95%], valid : [loss = 3.638, top1 = 16.19%], test : [loss = 3.657, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5462/15625) 005462-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.70%], valid : [loss = 0.608, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10        train : [loss = 0.093, top1 = 96.97%], test  : [loss = 0.428, top1 = 88.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.692, top1 = 79.56%], valid : [loss = 1.526, top1 = 60.57%], test : [loss = 1.537, top1 = 60.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.182, top1 = 22.35%], valid : [loss = 3.192, top1 = 22.31%], test : [loss = 3.213, top1 = 21.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.96%], valid : [loss = 1.085, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5463/15625) 005463-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.509, top1 = 89.81%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.79 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.323, top1 = 93.26%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.31 ms.
cifar100       train : [loss = 0.070, top1 = 98.87%], valid : [loss = 1.358, top1 = 69.51%], test : [loss = 1.359, top1 = 70.07%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.37%], valid : [loss = 2.388, top1 = 38.27%], test : [loss = 2.378, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.57%], valid : [loss = 0.894, top1 = 68.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5464/15625) 005464-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.83 ms.
cifar10-valid  train : [loss = 1.829, top1 = 33.91%], valid : [loss = 1.848, top1 = 33.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10        train : [loss = 1.257, top1 = 54.74%], test  : [loss = 1.259, top1 = 54.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.44 ms.
cifar100       train : [loss = 3.817, top1 = 11.58%], valid : [loss = 3.880, top1 = 10.42%], test : [loss = 3.873, top1 = 11.22%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.26 ms.
ImageNet16-120 train : [loss = 3.884, top1 = 12.08%], valid : [loss = 3.865, top1 = 12.63%], test : [loss = 3.885, top1 = 12.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5465/15625) 005465-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.19%], valid : [loss = 0.617, top1 = 85.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10        train : [loss = 0.074, top1 = 97.73%], test  : [loss = 0.407, top1 = 88.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.09 ms.
cifar100       train : [loss = 0.711, top1 = 79.40%], valid : [loss = 1.388, top1 = 63.28%], test : [loss = 1.372, top1 = 63.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.87%], valid : [loss = 2.668, top1 = 33.47%], test : [loss = 2.700, top1 = 32.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.63%], valid : [loss = 0.784, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5466/15625) 005466-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.526, top1 = 89.27%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.60 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.342, top1 = 92.62%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.49 ms.
cifar100       train : [loss = 0.134, top1 = 97.13%], valid : [loss = 1.333, top1 = 68.99%], test : [loss = 1.325, top1 = 68.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 51.96%], valid : [loss = 2.225, top1 = 42.80%], test : [loss = 2.237, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.35%], valid : [loss = 0.673, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5467/15625) 005467-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.511, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.330, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.05 ms.
cifar100       train : [loss = 0.327, top1 = 91.16%], valid : [loss = 1.280, top1 = 66.98%], test : [loss = 1.276, top1 = 66.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 44.99%], valid : [loss = 2.400, top1 = 39.36%], test : [loss = 2.389, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5468/15625) 005468-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.723, top1 = 84.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.050, top1 = 98.50%], test  : [loss = 0.443, top1 = 88.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.90 ms.
cifar100       train : [loss = 0.638, top1 = 81.29%], valid : [loss = 1.515, top1 = 61.70%], test : [loss = 1.472, top1 = 62.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 33.14%], valid : [loss = 2.837, top1 = 30.71%], test : [loss = 2.878, top1 = 30.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5469/15625) 005469-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.59%], valid : [loss = 1.034, top1 = 77.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.098, top1 = 96.85%], test  : [loss = 0.669, top1 = 83.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 0.680, top1 = 80.78%], valid : [loss = 1.897, top1 = 54.93%], test : [loss = 1.891, top1 = 55.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 3.023, top1 = 26.68%], valid : [loss = 3.309, top1 = 22.09%], test : [loss = 3.344, top1 = 21.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.40%], valid : [loss = 1.059, top1 = 62.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5470/15625) 005470-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.20 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.340, top1 = 91.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 0.337, top1 = 90.74%], valid : [loss = 1.288, top1 = 67.23%], test : [loss = 1.302, top1 = 66.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.60%], valid : [loss = 2.395, top1 = 38.89%], test : [loss = 2.410, top1 = 39.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5471/15625) 005471-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.429, top1 = 90.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.94%], test  : [loss = 0.281, top1 = 93.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.93 ms.
cifar100       train : [loss = 0.167, top1 = 96.16%], valid : [loss = 1.275, top1 = 69.86%], test : [loss = 1.274, top1 = 70.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.771, top1 = 52.75%], valid : [loss = 2.211, top1 = 43.13%], test : [loss = 2.245, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.38%], valid : [loss = 0.507, top1 = 82.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5472/15625) 005472-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.789, top1 = 72.19%], valid : [loss = 1.101, top1 = 63.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10        train : [loss = 0.790, top1 = 72.24%], test  : [loss = 0.922, top1 = 68.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 2.154, top1 = 43.57%], valid : [loss = 2.410, top1 = 39.63%], test : [loss = 2.412, top1 = 39.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 3.768, top1 = 13.91%], valid : [loss = 3.817, top1 = 13.84%], test : [loss = 3.824, top1 = 13.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.346, top1 = 51.14%], valid : [loss = 1.388, top1 = 50.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5473/15625) 005473-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.73%], valid : [loss = 0.867, top1 = 70.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.690, top1 = 75.83%], test  : [loss = 0.772, top1 = 73.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.51 ms.
cifar100       train : [loss = 1.991, top1 = 47.14%], valid : [loss = 2.155, top1 = 44.63%], test : [loss = 2.170, top1 = 44.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 3.658, top1 = 15.60%], valid : [loss = 3.678, top1 = 15.89%], test : [loss = 3.697, top1 = 14.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.380, top1 = 49.35%], valid : [loss = 1.417, top1 = 48.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5474/15625) 005474-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.468, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.317, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.37 ms.
cifar100       train : [loss = 0.323, top1 = 91.39%], valid : [loss = 1.253, top1 = 67.79%], test : [loss = 1.247, top1 = 68.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.80%], valid : [loss = 2.296, top1 = 41.33%], test : [loss = 2.340, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.39%], valid : [loss = 0.587, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5475/15625) 005475-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.19%], valid : [loss = 0.463, top1 = 86.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.166, top1 = 94.51%], test  : [loss = 0.351, top1 = 88.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.994, top1 = 71.69%], valid : [loss = 1.348, top1 = 62.72%], test : [loss = 1.338, top1 = 62.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.75%], valid : [loss = 2.669, top1 = 33.17%], test : [loss = 2.713, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5476/15625) 005476-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.33%], valid : [loss = 0.559, top1 = 84.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10        train : [loss = 0.134, top1 = 95.61%], test  : [loss = 0.398, top1 = 88.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.62 ms.
cifar100       train : [loss = 1.021, top1 = 70.71%], valid : [loss = 1.446, top1 = 60.96%], test : [loss = 1.460, top1 = 60.39%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.504, top1 = 36.61%], valid : [loss = 2.583, top1 = 35.26%], test : [loss = 2.618, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.855, top1 = 69.33%], valid : [loss = 0.913, top1 = 68.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5477/15625) 005477-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.515, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.340, top1 = 91.80%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.86 ms.
cifar100       train : [loss = 0.344, top1 = 90.59%], valid : [loss = 1.283, top1 = 67.29%], test : [loss = 1.274, top1 = 67.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.62%], valid : [loss = 2.413, top1 = 38.62%], test : [loss = 2.428, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5478/15625) 005478-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.591, top1 = 88.03%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.38 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.393, top1 = 91.65%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.26 ms.
cifar100       train : [loss = 0.083, top1 = 98.61%], valid : [loss = 1.573, top1 = 66.68%], test : [loss = 1.577, top1 = 66.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.21%], valid : [loss = 2.431, top1 = 39.38%], test : [loss = 2.439, top1 = 40.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.03%], valid : [loss = 0.713, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5479/15625) 005479-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.76%], valid : [loss = 0.603, top1 = 86.32%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10        train : [loss = 0.035, top1 = 99.05%], test  : [loss = 0.419, top1 = 89.37%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.18 ms.
cifar100       train : [loss = 0.399, top1 = 89.06%], valid : [loss = 1.401, top1 = 65.26%], test : [loss = 1.395, top1 = 64.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.26%], valid : [loss = 2.557, top1 = 35.96%], test : [loss = 2.564, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.57%], valid : [loss = 0.766, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5480/15625) 005480-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.220, top1 = 92.50%], valid : [loss = 0.544, top1 = 83.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.229, top1 = 92.21%], test  : [loss = 0.412, top1 = 86.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 1.236, top1 = 64.92%], valid : [loss = 1.583, top1 = 57.09%], test : [loss = 1.591, top1 = 57.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.953, top1 = 27.96%], valid : [loss = 2.999, top1 = 26.88%], test : [loss = 3.046, top1 = 26.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.27%], valid : [loss = 1.201, top1 = 56.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5481/15625) 005481-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.58%], valid : [loss = 0.585, top1 = 87.51%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.64 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.396, top1 = 91.13%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.16 ms.
cifar100       train : [loss = 0.270, top1 = 92.81%], valid : [loss = 1.491, top1 = 64.64%], test : [loss = 1.478, top1 = 64.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.62 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 32.55%], valid : [loss = 2.771, top1 = 30.56%], test : [loss = 2.765, top1 = 30.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.304, top1 = 52.54%], valid : [loss = 1.313, top1 = 52.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5482/15625) 005482-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.584, top1 = 88.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.377, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.105, top1 = 98.07%], valid : [loss = 1.479, top1 = 67.52%], test : [loss = 1.477, top1 = 67.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.32%], valid : [loss = 2.444, top1 = 38.84%], test : [loss = 2.462, top1 = 39.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.30%], valid : [loss = 0.778, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5483/15625) 005483-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.69%], valid : [loss = 0.598, top1 = 87.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.00 ms.
cifar10        train : [loss = 0.019, top1 = 99.44%], test  : [loss = 0.387, top1 = 91.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.70 ms.
cifar100       train : [loss = 0.390, top1 = 88.87%], valid : [loss = 1.481, top1 = 63.77%], test : [loss = 1.484, top1 = 63.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.855, top1 = 28.44%], valid : [loss = 2.925, top1 = 27.04%], test : [loss = 2.940, top1 = 27.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.83%], valid : [loss = 1.205, top1 = 56.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5484/15625) 005484-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.453, top1 = 89.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.12 ms.
cifar100       train : [loss = 0.319, top1 = 91.38%], valid : [loss = 1.301, top1 = 67.38%], test : [loss = 1.274, top1 = 67.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.42%], valid : [loss = 2.345, top1 = 39.99%], test : [loss = 2.408, top1 = 39.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.29%], valid : [loss = 0.558, top1 = 81.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5485/15625) 005485-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.64%], valid : [loss = 0.454, top1 = 86.34%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.97 ms.
cifar10        train : [loss = 0.146, top1 = 95.29%], test  : [loss = 0.342, top1 = 89.11%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.56 ms.
cifar100       train : [loss = 0.972, top1 = 72.40%], valid : [loss = 1.339, top1 = 62.85%], test : [loss = 1.338, top1 = 62.22%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.99%], valid : [loss = 2.687, top1 = 33.10%], test : [loss = 2.708, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.97%], valid : [loss = 0.787, top1 = 72.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5486/15625) 005486-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.505, top1 = 89.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.334, top1 = 92.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.17 ms.
cifar100       train : [loss = 0.117, top1 = 97.44%], valid : [loss = 1.387, top1 = 68.55%], test : [loss = 1.398, top1 = 68.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 1.740, top1 = 53.53%], valid : [loss = 2.167, top1 = 44.14%], test : [loss = 2.197, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.67%], valid : [loss = 0.788, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5487/15625) 005487-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.54%], valid : [loss = 0.434, top1 = 87.98%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.057, top1 = 98.64%], test  : [loss = 0.327, top1 = 90.11%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.26 ms.
cifar100       train : [loss = 0.546, top1 = 85.12%], valid : [loss = 1.215, top1 = 66.87%], test : [loss = 1.216, top1 = 66.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 2.265, top1 = 41.80%], valid : [loss = 2.457, top1 = 38.87%], test : [loss = 2.471, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.15%], valid : [loss = 0.635, top1 = 78.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5488/15625) 005488-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.541, top1 = 88.71%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.53 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.356, top1 = 91.84%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.93 ms.
cifar100       train : [loss = 0.200, top1 = 94.92%], valid : [loss = 1.283, top1 = 68.96%], test : [loss = 1.307, top1 = 68.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.99%], valid : [loss = 2.239, top1 = 42.48%], test : [loss = 2.268, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 73.97%], valid : [loss = 0.799, top1 = 72.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5489/15625) 005489-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.35 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.95%], valid : [loss = 0.480, top1 = 84.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10        train : [loss = 0.301, top1 = 89.93%], test  : [loss = 0.403, top1 = 86.42%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.43 ms.
cifar100       train : [loss = 1.338, top1 = 62.67%], valid : [loss = 1.541, top1 = 57.61%], test : [loss = 1.513, top1 = 57.94%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.78 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.70%], valid : [loss = 2.913, top1 = 29.46%], test : [loss = 2.950, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5490/15625) 005490-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.21%], valid : [loss = 0.459, top1 = 87.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10        train : [loss = 0.073, top1 = 98.04%], test  : [loss = 0.313, top1 = 90.32%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 0.630, top1 = 82.50%], valid : [loss = 1.227, top1 = 66.39%], test : [loss = 1.209, top1 = 66.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.320, top1 = 40.64%], valid : [loss = 2.491, top1 = 37.26%], test : [loss = 2.496, top1 = 36.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.52%], valid : [loss = 0.641, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5491/15625) 005491-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.459, top1 = 89.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.324, top1 = 91.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 0.329, top1 = 91.08%], valid : [loss = 1.320, top1 = 66.55%], test : [loss = 1.314, top1 = 67.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 45.97%], valid : [loss = 2.396, top1 = 39.58%], test : [loss = 2.429, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5492/15625) 005492-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.673, top1 = 85.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10        train : [loss = 0.037, top1 = 98.94%], test  : [loss = 0.454, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.77 ms.
cifar100       train : [loss = 0.447, top1 = 87.33%], valid : [loss = 1.476, top1 = 63.56%], test : [loss = 1.470, top1 = 63.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.15%], valid : [loss = 2.666, top1 = 33.54%], test : [loss = 2.696, top1 = 34.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.850, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5493/15625) 005493-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.551, top1 = 87.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.025, top1 = 99.27%], test  : [loss = 0.354, top1 = 91.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.416, top1 = 87.90%], valid : [loss = 1.271, top1 = 67.06%], test : [loss = 1.291, top1 = 66.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.24%], valid : [loss = 2.413, top1 = 39.17%], test : [loss = 2.433, top1 = 38.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5494/15625) 005494-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.486, top1 = 88.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.313, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.315, top1 = 91.58%], valid : [loss = 1.256, top1 = 67.32%], test : [loss = 1.261, top1 = 67.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.75%], valid : [loss = 2.326, top1 = 40.59%], test : [loss = 2.339, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.83%], valid : [loss = 0.614, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5495/15625) 005495-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.626, top1 = 85.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.27 ms.
cifar10        train : [loss = 0.053, top1 = 98.41%], test  : [loss = 0.429, top1 = 88.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.41 ms.
cifar100       train : [loss = 0.624, top1 = 81.73%], valid : [loss = 1.383, top1 = 63.71%], test : [loss = 1.385, top1 = 63.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 37.29%], valid : [loss = 2.624, top1 = 34.87%], test : [loss = 2.653, top1 = 33.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.33%], valid : [loss = 0.832, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5496/15625) 005496-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.631, top1 = 86.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.423, top1 = 90.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.165, top1 = 96.24%], valid : [loss = 1.635, top1 = 64.31%], test : [loss = 1.605, top1 = 64.49%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.81%], valid : [loss = 2.560, top1 = 36.03%], test : [loss = 2.549, top1 = 37.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.30%], valid : [loss = 0.786, top1 = 72.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5497/15625) 005497-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.56%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.20 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.311, top1 = 93.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.64 ms.
cifar100       train : [loss = 0.116, top1 = 97.76%], valid : [loss = 1.265, top1 = 69.73%], test : [loss = 1.295, top1 = 69.68%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.785, top1 = 52.43%], valid : [loss = 2.270, top1 = 42.02%], test : [loss = 2.263, top1 = 42.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.70%], valid : [loss = 0.638, top1 = 77.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5498/15625) 005498-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.08%], valid : [loss = 0.847, top1 = 75.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.55 ms.
cifar10        train : [loss = 0.327, top1 = 88.65%], test  : [loss = 0.629, top1 = 79.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.62 ms.
cifar100       train : [loss = 1.357, top1 = 61.77%], valid : [loss = 1.917, top1 = 49.86%], test : [loss = 1.920, top1 = 50.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 3.489, top1 = 17.40%], valid : [loss = 3.520, top1 = 17.69%], test : [loss = 3.515, top1 = 16.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5499/15625) 005499-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.51 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5500/15625) 005500-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.459, top1 = 90.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.324, top1 = 92.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.74 ms.
cifar100       train : [loss = 0.125, top1 = 97.39%], valid : [loss = 1.399, top1 = 68.26%], test : [loss = 1.382, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 1.757, top1 = 53.07%], valid : [loss = 2.317, top1 = 42.21%], test : [loss = 2.322, top1 = 41.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.73%], valid : [loss = 0.558, top1 = 81.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5501/15625) 005501-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.64%], valid : [loss = 0.652, top1 = 78.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.508, top1 = 82.51%], test  : [loss = 0.583, top1 = 80.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 1.690, top1 = 54.11%], valid : [loss = 1.845, top1 = 50.75%], test : [loss = 1.867, top1 = 50.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.24%], valid : [loss = 3.318, top1 = 21.74%], test : [loss = 3.348, top1 = 21.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5502/15625) 005502-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.83%], valid : [loss = 0.479, top1 = 84.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.297, top1 = 89.96%], test  : [loss = 0.400, top1 = 86.55%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 1.323, top1 = 63.38%], valid : [loss = 1.529, top1 = 57.70%], test : [loss = 1.502, top1 = 58.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.70%], valid : [loss = 2.899, top1 = 29.04%], test : [loss = 2.962, top1 = 28.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5503/15625) 005503-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.492, top1 = 89.01%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.48 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.318, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.59 ms.
cifar100       train : [loss = 0.231, top1 = 94.37%], valid : [loss = 1.248, top1 = 68.40%], test : [loss = 1.266, top1 = 68.59%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.43%], valid : [loss = 2.275, top1 = 41.91%], test : [loss = 2.290, top1 = 41.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.42%], valid : [loss = 0.656, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5504/15625) 005504-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.12 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.36%], valid : [loss = 0.854, top1 = 71.87%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.49 ms.
cifar10        train : [loss = 0.565, top1 = 80.27%], test  : [loss = 0.723, top1 = 75.36%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.44 ms.
cifar100       train : [loss = 1.779, top1 = 52.02%], valid : [loss = 2.051, top1 = 47.03%], test : [loss = 2.062, top1 = 47.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.84 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.69%], valid : [loss = 3.637, top1 = 16.94%], test : [loss = 3.665, top1 = 15.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5505/15625) 005505-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.522, top1 = 90.07%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.326, top1 = 93.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.48 ms.
cifar100       train : [loss = 0.051, top1 = 99.22%], valid : [loss = 1.400, top1 = 69.84%], test : [loss = 1.395, top1 = 69.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 1.529, top1 = 58.62%], valid : [loss = 2.204, top1 = 44.67%], test : [loss = 2.219, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 84.89%], valid : [loss = 0.554, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5506/15625) 005506-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.13%], valid : [loss = 0.448, top1 = 87.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.325, top1 = 89.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.31 ms.
cifar100       train : [loss = 0.859, top1 = 75.60%], valid : [loss = 1.290, top1 = 63.76%], test : [loss = 1.280, top1 = 64.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.72%], valid : [loss = 2.609, top1 = 34.41%], test : [loss = 2.649, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.676, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5507/15625) 005507-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.91 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.99%], valid : [loss = 0.477, top1 = 84.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10        train : [loss = 0.300, top1 = 89.98%], test  : [loss = 0.400, top1 = 86.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 1.332, top1 = 62.97%], valid : [loss = 1.535, top1 = 57.86%], test : [loss = 1.517, top1 = 57.96%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.62 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.60%], valid : [loss = 2.898, top1 = 29.60%], test : [loss = 2.949, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5508/15625) 005508-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.75%], valid : [loss = 0.861, top1 = 70.60%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10        train : [loss = 0.691, top1 = 75.89%], test  : [loss = 0.769, top1 = 73.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 1.966, top1 = 47.69%], valid : [loss = 2.133, top1 = 44.85%], test : [loss = 2.146, top1 = 44.97%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.81 ms.
ImageNet16-120 train : [loss = 3.653, top1 = 15.66%], valid : [loss = 3.678, top1 = 15.72%], test : [loss = 3.705, top1 = 14.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5509/15625) 005509-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.580, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.372, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.140, top1 = 96.78%], valid : [loss = 1.376, top1 = 67.97%], test : [loss = 1.374, top1 = 68.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 1.950, top1 = 48.65%], valid : [loss = 2.339, top1 = 40.48%], test : [loss = 2.329, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.39%], valid : [loss = 0.886, top1 = 68.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5510/15625) 005510-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.489, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.319, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.318, top1 = 91.48%], valid : [loss = 1.268, top1 = 67.53%], test : [loss = 1.252, top1 = 68.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.78%], valid : [loss = 2.308, top1 = 41.17%], test : [loss = 2.337, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5511/15625) 005511-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.574, top1 = 87.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.381, top1 = 91.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 0.394, top1 = 88.85%], valid : [loss = 1.411, top1 = 65.31%], test : [loss = 1.396, top1 = 65.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.74 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.90%], valid : [loss = 2.519, top1 = 36.72%], test : [loss = 2.546, top1 = 36.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5512/15625) 005512-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.522, top1 = 89.37%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.51 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.75%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.33 ms.
cifar100       train : [loss = 0.183, top1 = 95.52%], valid : [loss = 1.284, top1 = 69.15%], test : [loss = 1.274, top1 = 69.65%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.20 ms.
ImageNet16-120 train : [loss = 1.771, top1 = 52.84%], valid : [loss = 2.163, top1 = 44.39%], test : [loss = 2.170, top1 = 44.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.99%], valid : [loss = 0.670, top1 = 76.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5513/15625) 005513-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.582, top1 = 87.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.038, top1 = 98.86%], test  : [loss = 0.398, top1 = 90.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 0.560, top1 = 83.53%], valid : [loss = 1.423, top1 = 63.49%], test : [loss = 1.409, top1 = 63.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.04%], valid : [loss = 2.611, top1 = 34.54%], test : [loss = 2.651, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5514/15625) 005514-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.639, top1 = 87.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.31 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.452, top1 = 90.61%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.33 ms.
cifar100       train : [loss = 0.184, top1 = 95.70%], valid : [loss = 1.608, top1 = 64.35%], test : [loss = 1.583, top1 = 64.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 43.13%], valid : [loss = 2.656, top1 = 34.59%], test : [loss = 2.665, top1 = 34.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.10%], valid : [loss = 0.836, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5515/15625) 005515-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.05%], valid : [loss = 0.667, top1 = 77.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.64 ms.
cifar10        train : [loss = 0.501, top1 = 82.63%], test  : [loss = 0.584, top1 = 79.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.45 ms.
cifar100       train : [loss = 1.700, top1 = 54.03%], valid : [loss = 1.869, top1 = 50.20%], test : [loss = 1.882, top1 = 50.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 3.349, top1 = 20.90%], valid : [loss = 3.334, top1 = 21.34%], test : [loss = 3.368, top1 = 20.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.259, top1 = 54.66%], valid : [loss = 1.285, top1 = 54.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5516/15625) 005516-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.515, top1 = 88.79%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.333, top1 = 92.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.97 ms.
cifar100       train : [loss = 0.347, top1 = 90.51%], valid : [loss = 1.274, top1 = 67.37%], test : [loss = 1.290, top1 = 67.45%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.53%], valid : [loss = 2.406, top1 = 39.24%], test : [loss = 2.407, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.56%], valid : [loss = 0.681, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5517/15625) 005517-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.561, top1 = 87.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.374, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.62 ms.
cifar100       train : [loss = 0.389, top1 = 89.03%], valid : [loss = 1.395, top1 = 65.45%], test : [loss = 1.386, top1 = 65.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.70%], valid : [loss = 2.477, top1 = 37.42%], test : [loss = 2.506, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.66%], valid : [loss = 0.778, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5518/15625) 005518-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.63%], valid : [loss = 0.560, top1 = 87.67%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10        train : [loss = 0.031, top1 = 99.14%], test  : [loss = 0.366, top1 = 90.95%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.50 ms.
cifar100       train : [loss = 0.485, top1 = 86.29%], valid : [loss = 1.390, top1 = 64.05%], test : [loss = 1.388, top1 = 64.43%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.21%], valid : [loss = 2.620, top1 = 33.57%], test : [loss = 2.644, top1 = 33.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 1.037, top1 = 62.53%], valid : [loss = 1.038, top1 = 62.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5519/15625) 005519-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.71%], valid : [loss = 0.562, top1 = 84.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.144, top1 = 95.24%], test  : [loss = 0.376, top1 = 88.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.90 ms.
cifar100       train : [loss = 0.962, top1 = 72.07%], valid : [loss = 1.485, top1 = 59.77%], test : [loss = 1.488, top1 = 60.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.16 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.06%], valid : [loss = 2.737, top1 = 32.08%], test : [loss = 2.760, top1 = 31.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.40%], valid : [loss = 0.965, top1 = 66.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5520/15625) 005520-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.21%], valid : [loss = 0.458, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.163, top1 = 94.67%], test  : [loss = 0.349, top1 = 88.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 1.020, top1 = 70.94%], valid : [loss = 1.384, top1 = 61.21%], test : [loss = 1.355, top1 = 61.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.83%], valid : [loss = 2.686, top1 = 33.24%], test : [loss = 2.717, top1 = 31.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5521/15625) 005521-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.636, top1 = 87.07%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.425, top1 = 90.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.29 ms.
cifar100       train : [loss = 0.147, top1 = 96.83%], valid : [loss = 1.622, top1 = 64.71%], test : [loss = 1.605, top1 = 65.09%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 1.957, top1 = 48.56%], valid : [loss = 2.458, top1 = 38.99%], test : [loss = 2.469, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.61%], valid : [loss = 0.798, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5522/15625) 005522-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.539, top1 = 87.89%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.12 ms.
cifar10        train : [loss = 0.026, top1 = 99.36%], test  : [loss = 0.364, top1 = 90.84%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.23 ms.
cifar100       train : [loss = 0.359, top1 = 90.12%], valid : [loss = 1.359, top1 = 66.43%], test : [loss = 1.321, top1 = 66.85%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.95%], valid : [loss = 2.448, top1 = 38.30%], test : [loss = 2.485, top1 = 37.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.71%], valid : [loss = 0.638, top1 = 78.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5523/15625) 005523-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.01%], valid : [loss = 0.688, top1 = 76.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.542, top1 = 81.15%], test  : [loss = 0.606, top1 = 79.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 1.724, top1 = 53.20%], valid : [loss = 1.877, top1 = 50.02%], test : [loss = 1.904, top1 = 49.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 3.391, top1 = 20.07%], valid : [loss = 3.362, top1 = 20.87%], test : [loss = 3.415, top1 = 19.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.349, top1 = 51.06%], valid : [loss = 1.374, top1 = 50.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5524/15625) 005524-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.28%], valid : [loss = 0.596, top1 = 86.72%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.68 ms.
cifar10        train : [loss = 0.033, top1 = 98.97%], test  : [loss = 0.414, top1 = 90.16%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.92 ms.
cifar100       train : [loss = 0.326, top1 = 90.68%], valid : [loss = 1.483, top1 = 63.93%], test : [loss = 1.495, top1 = 64.27%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 3.149, top1 = 22.54%], valid : [loss = 3.166, top1 = 22.71%], test : [loss = 3.188, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.342, top1 = 50.41%], valid : [loss = 1.331, top1 = 50.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5525/15625) 005525-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.500, top1 = 90.09%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.80 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.307, top1 = 93.53%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.96 ms.
cifar100       train : [loss = 0.050, top1 = 99.34%], valid : [loss = 1.324, top1 = 70.25%], test : [loss = 1.338, top1 = 70.27%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.73 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.63%], valid : [loss = 2.343, top1 = 40.07%], test : [loss = 2.340, top1 = 40.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.53%], valid : [loss = 0.833, top1 = 70.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5526/15625) 005526-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.17 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.529, top1 = 89.79%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.04 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.24%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.35 ms.
cifar100       train : [loss = 0.060, top1 = 99.10%], valid : [loss = 1.323, top1 = 70.07%], test : [loss = 1.340, top1 = 70.00%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.39 ms.
ImageNet16-120 train : [loss = 1.646, top1 = 55.81%], valid : [loss = 2.221, top1 = 43.44%], test : [loss = 2.234, top1 = 44.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.68%], valid : [loss = 0.606, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5527/15625) 005527-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.75%], valid : [loss = 0.841, top1 = 72.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10        train : [loss = 0.557, top1 = 80.54%], test  : [loss = 0.718, top1 = 75.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.99 ms.
cifar100       train : [loss = 1.798, top1 = 51.73%], valid : [loss = 2.066, top1 = 46.74%], test : [loss = 2.078, top1 = 46.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.81%], valid : [loss = 3.638, top1 = 16.66%], test : [loss = 3.668, top1 = 15.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5528/15625) 005528-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.05 ms.
cifar10-valid  train : [loss = 0.132, top1 = 95.69%], valid : [loss = 0.714, top1 = 81.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10        train : [loss = 0.149, top1 = 95.01%], test  : [loss = 0.479, top1 = 86.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.49 ms.
cifar100       train : [loss = 0.979, top1 = 71.53%], valid : [loss = 1.654, top1 = 56.62%], test : [loss = 1.640, top1 = 56.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 25.68%], valid : [loss = 3.111, top1 = 24.84%], test : [loss = 3.147, top1 = 23.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5529/15625) 005529-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.593, top1 = 87.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.397, top1 = 90.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 0.393, top1 = 88.99%], valid : [loss = 1.395, top1 = 65.75%], test : [loss = 1.390, top1 = 65.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.05%], valid : [loss = 2.518, top1 = 36.67%], test : [loss = 2.530, top1 = 36.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5530/15625) 005530-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.434, top1 = 89.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.293, top1 = 92.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 0.206, top1 = 95.15%], valid : [loss = 1.267, top1 = 69.07%], test : [loss = 1.237, top1 = 69.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.91%], valid : [loss = 2.257, top1 = 42.64%], test : [loss = 2.277, top1 = 42.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5531/15625) 005531-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.13%], valid : [loss = 0.855, top1 = 71.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.568, top1 = 80.08%], test  : [loss = 0.726, top1 = 75.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.13 ms.
cifar100       train : [loss = 1.778, top1 = 52.22%], valid : [loss = 2.057, top1 = 46.71%], test : [loss = 2.053, top1 = 46.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.81%], valid : [loss = 3.632, top1 = 16.50%], test : [loss = 3.669, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5532/15625) 005532-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.29%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.319, top1 = 91.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 0.328, top1 = 91.11%], valid : [loss = 1.306, top1 = 66.90%], test : [loss = 1.283, top1 = 67.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.12%], valid : [loss = 2.385, top1 = 39.67%], test : [loss = 2.432, top1 = 39.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.89%], valid : [loss = 0.538, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5533/15625) 005533-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.511, top1 = 89.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.348, top1 = 92.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.75 ms.
cifar100       train : [loss = 0.082, top1 = 98.67%], valid : [loss = 1.438, top1 = 68.55%], test : [loss = 1.419, top1 = 68.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 1.762, top1 = 53.12%], valid : [loss = 2.371, top1 = 40.44%], test : [loss = 2.384, top1 = 41.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.36%], valid : [loss = 0.661, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5534/15625) 005534-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.04%], valid : [loss = 0.476, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10        train : [loss = 0.301, top1 = 89.88%], test  : [loss = 0.402, top1 = 86.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 1.329, top1 = 63.01%], valid : [loss = 1.527, top1 = 58.06%], test : [loss = 1.504, top1 = 58.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.59%], valid : [loss = 2.903, top1 = 29.37%], test : [loss = 2.951, top1 = 28.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5535/15625) 005535-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.582, top1 = 87.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.376, top1 = 91.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.374, top1 = 89.52%], valid : [loss = 1.413, top1 = 65.10%], test : [loss = 1.413, top1 = 64.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.279, top1 = 41.44%], valid : [loss = 2.489, top1 = 37.09%], test : [loss = 2.533, top1 = 36.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.93%], valid : [loss = 0.857, top1 = 70.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5536/15625) 005536-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.37%], valid : [loss = 0.697, top1 = 84.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10        train : [loss = 0.054, top1 = 98.31%], test  : [loss = 0.451, top1 = 88.58%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 0.638, top1 = 81.30%], valid : [loss = 1.528, top1 = 61.53%], test : [loss = 1.504, top1 = 61.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.663, top1 = 33.35%], valid : [loss = 2.832, top1 = 30.57%], test : [loss = 2.864, top1 = 30.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.890, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5537/15625) 005537-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.34%], valid : [loss = 0.454, top1 = 86.26%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.07 ms.
cifar10        train : [loss = 0.159, top1 = 94.82%], test  : [loss = 0.349, top1 = 88.43%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.03 ms.
cifar100       train : [loss = 1.027, top1 = 70.92%], valid : [loss = 1.373, top1 = 61.61%], test : [loss = 1.365, top1 = 61.98%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.69%], valid : [loss = 2.673, top1 = 33.30%], test : [loss = 2.713, top1 = 31.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5538/15625) 005538-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.90%], valid : [loss = 0.859, top1 = 71.72%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10        train : [loss = 0.567, top1 = 80.25%], test  : [loss = 0.727, top1 = 75.22%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.71 ms.
cifar100       train : [loss = 1.780, top1 = 52.14%], valid : [loss = 2.061, top1 = 46.39%], test : [loss = 2.078, top1 = 46.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.03 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.78%], valid : [loss = 3.640, top1 = 16.36%], test : [loss = 3.669, top1 = 15.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5539/15625) 005539-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.77%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.269, top1 = 93.86%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.55 ms.
cifar100       train : [loss = 0.068, top1 = 99.01%], valid : [loss = 1.346, top1 = 69.95%], test : [loss = 1.341, top1 = 69.87%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 1.548, top1 = 58.26%], valid : [loss = 2.243, top1 = 43.60%], test : [loss = 2.282, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.362, top1 = 87.56%], valid : [loss = 0.499, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5540/15625) 005540-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.42%], valid : [loss = 0.814, top1 = 80.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.131, top1 = 95.60%], test  : [loss = 0.537, top1 = 85.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.86 ms.
cifar100       train : [loss = 0.859, top1 = 75.07%], valid : [loss = 1.667, top1 = 56.90%], test : [loss = 1.677, top1 = 57.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.45%], valid : [loss = 3.160, top1 = 24.59%], test : [loss = 3.198, top1 = 23.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.059, top1 = 61.74%], valid : [loss = 1.121, top1 = 59.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5541/15625) 005541-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.22%], valid : [loss = 0.601, top1 = 85.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10        train : [loss = 0.071, top1 = 97.86%], test  : [loss = 0.384, top1 = 89.18%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.56 ms.
cifar100       train : [loss = 0.721, top1 = 78.96%], valid : [loss = 1.400, top1 = 62.93%], test : [loss = 1.376, top1 = 63.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.94%], valid : [loss = 2.663, top1 = 33.74%], test : [loss = 2.696, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5542/15625) 005542-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.555, top1 = 88.40%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.354, top1 = 92.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.22 ms.
cifar100       train : [loss = 0.246, top1 = 93.47%], valid : [loss = 1.317, top1 = 67.89%], test : [loss = 1.310, top1 = 68.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.194, top1 = 43.06%], valid : [loss = 2.419, top1 = 38.49%], test : [loss = 2.434, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5543/15625) 005543-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.41%], valid : [loss = 0.853, top1 = 71.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.94 ms.
cifar10        train : [loss = 0.682, top1 = 75.98%], test  : [loss = 0.769, top1 = 73.50%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 1.960, top1 = 47.74%], valid : [loss = 2.133, top1 = 44.55%], test : [loss = 2.143, top1 = 44.75%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.91 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.72%], valid : [loss = 3.668, top1 = 16.31%], test : [loss = 3.699, top1 = 14.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5544/15625) 005544-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.16 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.287, top1 = 93.83%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.73 ms.
cifar100       train : [loss = 0.051, top1 = 99.41%], valid : [loss = 1.387, top1 = 70.14%], test : [loss = 1.328, top1 = 70.61%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 1.470, top1 = 60.05%], valid : [loss = 2.263, top1 = 43.59%], test : [loss = 2.262, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.98%], valid : [loss = 0.492, top1 = 83.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5545/15625) 005545-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.498, top1 = 89.91%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.320, top1 = 93.03%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.51 ms.
cifar100       train : [loss = 0.112, top1 = 97.78%], valid : [loss = 1.318, top1 = 69.11%], test : [loss = 1.319, top1 = 69.43%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 1.768, top1 = 52.88%], valid : [loss = 2.200, top1 = 43.61%], test : [loss = 2.196, top1 = 43.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.22%], valid : [loss = 0.739, top1 = 74.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5546/15625) 005546-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.71%], valid : [loss = 0.841, top1 = 71.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.678, top1 = 76.34%], test  : [loss = 0.768, top1 = 73.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.75 ms.
cifar100       train : [loss = 1.954, top1 = 47.97%], valid : [loss = 2.132, top1 = 44.71%], test : [loss = 2.159, top1 = 44.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.73%], valid : [loss = 3.662, top1 = 16.09%], test : [loss = 3.687, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5547/15625) 005547-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.464, top1 = 89.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.320, top1 = 91.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.29 ms.
cifar100       train : [loss = 0.327, top1 = 91.12%], valid : [loss = 1.315, top1 = 66.81%], test : [loss = 1.319, top1 = 67.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.30%], valid : [loss = 2.364, top1 = 40.18%], test : [loss = 2.401, top1 = 39.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5548/15625) 005548-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.517, top1 = 88.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.355, top1 = 91.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.313, top1 = 91.45%], valid : [loss = 1.275, top1 = 67.68%], test : [loss = 1.294, top1 = 67.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.09%], valid : [loss = 2.387, top1 = 39.46%], test : [loss = 2.392, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.86%], valid : [loss = 0.847, top1 = 70.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5549/15625) 005549-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.39%], valid : [loss = 0.541, top1 = 84.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.89 ms.
cifar10        train : [loss = 0.173, top1 = 94.19%], test  : [loss = 0.390, top1 = 87.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.36 ms.
cifar100       train : [loss = 1.198, top1 = 65.89%], valid : [loss = 1.512, top1 = 58.41%], test : [loss = 1.500, top1 = 59.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.09%], valid : [loss = 2.687, top1 = 33.48%], test : [loss = 2.724, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.57%], valid : [loss = 0.933, top1 = 67.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5550/15625) 005550-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.17%], valid : [loss = 0.462, top1 = 86.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.163, top1 = 94.63%], test  : [loss = 0.344, top1 = 88.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.995, top1 = 71.68%], valid : [loss = 1.360, top1 = 61.87%], test : [loss = 1.341, top1 = 62.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.69%], valid : [loss = 2.693, top1 = 32.36%], test : [loss = 2.717, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5551/15625) 005551-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.367, top1 = 87.12%], valid : [loss = 0.611, top1 = 80.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10        train : [loss = 0.298, top1 = 89.75%], test  : [loss = 0.454, top1 = 85.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 1.590, top1 = 55.82%], valid : [loss = 1.814, top1 = 51.33%], test : [loss = 1.795, top1 = 51.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 3.110, top1 = 24.64%], valid : [loss = 3.107, top1 = 25.00%], test : [loss = 3.164, top1 = 23.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.028, top1 = 62.68%], valid : [loss = 1.071, top1 = 61.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5552/15625) 005552-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.01%], valid : [loss = 0.483, top1 = 84.21%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10        train : [loss = 0.302, top1 = 89.85%], test  : [loss = 0.400, top1 = 86.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 1.317, top1 = 63.49%], valid : [loss = 1.532, top1 = 57.97%], test : [loss = 1.505, top1 = 58.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.77%], valid : [loss = 2.900, top1 = 29.42%], test : [loss = 2.957, top1 = 27.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5553/15625) 005553-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.416, top1 = 90.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.276, top1 = 93.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.185, top1 = 95.61%], valid : [loss = 1.267, top1 = 69.78%], test : [loss = 1.286, top1 = 69.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.54%], valid : [loss = 2.258, top1 = 42.44%], test : [loss = 2.293, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5554/15625) 005554-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.531, top1 = 88.45%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.328, top1 = 92.02%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.51 ms.
cifar100       train : [loss = 0.347, top1 = 90.55%], valid : [loss = 1.300, top1 = 66.47%], test : [loss = 1.305, top1 = 66.51%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.96%], valid : [loss = 2.409, top1 = 39.18%], test : [loss = 2.433, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5555/15625) 005555-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.469, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.301, top1 = 92.49%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.90 ms.
cifar100       train : [loss = 0.322, top1 = 91.38%], valid : [loss = 1.264, top1 = 66.99%], test : [loss = 1.252, top1 = 67.87%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.51%], valid : [loss = 2.333, top1 = 40.53%], test : [loss = 2.328, top1 = 41.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.491, top1 = 82.96%], valid : [loss = 0.582, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5556/15625) 005556-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.417, top1 = 90.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.286, top1 = 93.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.80 ms.
cifar100       train : [loss = 0.184, top1 = 95.62%], valid : [loss = 1.293, top1 = 69.45%], test : [loss = 1.267, top1 = 69.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.76%], valid : [loss = 2.259, top1 = 42.70%], test : [loss = 2.283, top1 = 42.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.89%], valid : [loss = 0.513, top1 = 82.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5557/15625) 005557-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.29%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.21 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.341, top1 = 92.74%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.24 ms.
cifar100       train : [loss = 0.081, top1 = 98.35%], valid : [loss = 1.427, top1 = 68.83%], test : [loss = 1.440, top1 = 68.73%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.67%], valid : [loss = 2.517, top1 = 35.62%], test : [loss = 2.516, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.59%], valid : [loss = 0.802, top1 = 71.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5558/15625) 005558-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.68%], valid : [loss = 0.544, top1 = 85.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.098, top1 = 96.88%], test  : [loss = 0.360, top1 = 89.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.815, top1 = 76.18%], valid : [loss = 1.387, top1 = 62.79%], test : [loss = 1.378, top1 = 62.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.17%], valid : [loss = 2.569, top1 = 34.81%], test : [loss = 2.613, top1 = 34.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.86%], valid : [loss = 0.961, top1 = 66.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5559/15625) 005559-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.80%], valid : [loss = 0.854, top1 = 71.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10        train : [loss = 0.551, top1 = 80.76%], test  : [loss = 0.708, top1 = 75.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 1.780, top1 = 52.04%], valid : [loss = 2.059, top1 = 46.71%], test : [loss = 2.061, top1 = 46.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.71%], valid : [loss = 3.633, top1 = 16.56%], test : [loss = 3.665, top1 = 15.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5560/15625) 005560-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.54%], valid : [loss = 0.567, top1 = 87.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.362, top1 = 90.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.481, top1 = 86.30%], valid : [loss = 1.312, top1 = 65.55%], test : [loss = 1.304, top1 = 65.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 36.02%], valid : [loss = 2.596, top1 = 34.59%], test : [loss = 2.614, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 67.01%], valid : [loss = 0.954, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5561/15625) 005561-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.527, top1 = 87.98%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.25 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.368, top1 = 90.61%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.59 ms.
cifar100       train : [loss = 0.442, top1 = 87.24%], valid : [loss = 1.344, top1 = 65.83%], test : [loss = 1.323, top1 = 66.25%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.73%], valid : [loss = 2.431, top1 = 39.14%], test : [loss = 2.463, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.33%], valid : [loss = 0.617, top1 = 78.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5562/15625) 005562-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.544, top1 = 89.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.384, top1 = 92.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.88 ms.
cifar100       train : [loss = 0.104, top1 = 98.16%], valid : [loss = 1.454, top1 = 67.68%], test : [loss = 1.449, top1 = 68.01%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.57%], valid : [loss = 2.434, top1 = 40.24%], test : [loss = 2.439, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5563/15625) 005563-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=21.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.497, top1 = 90.19%]
cifar10        FLOP=188.66 M, Params=1.317 MB, latency=23.27 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.315, top1 = 93.38%]
cifar100       FLOP=188.67 M, Params=1.322 MB, latency=23.91 ms.
cifar100       train : [loss = 0.031, top1 = 99.72%], valid : [loss = 1.379, top1 = 70.40%], test : [loss = 1.386, top1 = 70.58%]
ImageNet16-120 FLOP= 47.17 M, Params=1.324 MB, latency=22.20 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.39%], valid : [loss = 2.332, top1 = 40.54%], test : [loss = 2.325, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.86%], valid : [loss = 0.887, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5564/15625) 005564-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.81%], valid : [loss = 0.695, top1 = 77.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10        train : [loss = 0.398, top1 = 86.18%], test  : [loss = 0.537, top1 = 81.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.33 ms.
cifar100       train : [loss = 1.624, top1 = 55.19%], valid : [loss = 1.863, top1 = 50.38%], test : [loss = 1.872, top1 = 49.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.75 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 20.97%], valid : [loss = 3.346, top1 = 20.68%], test : [loss = 3.366, top1 = 20.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.88%], valid : [loss = 1.242, top1 = 55.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5565/15625) 005565-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.32%], valid : [loss = 0.564, top1 = 87.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.72 ms.
cifar10        train : [loss = 0.038, top1 = 98.84%], test  : [loss = 0.359, top1 = 90.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.36 ms.
cifar100       train : [loss = 0.442, top1 = 86.97%], valid : [loss = 1.318, top1 = 65.77%], test : [loss = 1.350, top1 = 65.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.806, top1 = 29.52%], valid : [loss = 2.856, top1 = 28.23%], test : [loss = 2.870, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.953, top1 = 65.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5566/15625) 005566-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.49%], valid : [loss = 0.676, top1 = 85.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.050, top1 = 98.50%], test  : [loss = 0.458, top1 = 88.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.18 ms.
cifar100       train : [loss = 0.630, top1 = 81.60%], valid : [loss = 1.521, top1 = 61.47%], test : [loss = 1.502, top1 = 62.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.29%], valid : [loss = 2.830, top1 = 30.01%], test : [loss = 2.873, top1 = 29.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.11%], valid : [loss = 0.884, top1 = 68.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5567/15625) 005567-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.551, top1 = 88.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.355, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.24 ms.
cifar100       train : [loss = 0.294, top1 = 91.77%], valid : [loss = 1.324, top1 = 67.26%], test : [loss = 1.323, top1 = 67.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.09%], valid : [loss = 2.437, top1 = 37.96%], test : [loss = 2.430, top1 = 39.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5568/15625) 005568-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.459, top1 = 90.06%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.77 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.13%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.90 ms.
cifar100       train : [loss = 0.119, top1 = 97.81%], valid : [loss = 1.273, top1 = 69.59%], test : [loss = 1.268, top1 = 70.39%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 1.668, top1 = 55.28%], valid : [loss = 2.144, top1 = 44.72%], test : [loss = 2.164, top1 = 44.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.71%], valid : [loss = 0.591, top1 = 79.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5569/15625) 005569-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.789, top1 = 72.17%], valid : [loss = 0.964, top1 = 67.10%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.778, top1 = 72.62%], test  : [loss = 0.863, top1 = 69.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 2.120, top1 = 44.32%], valid : [loss = 2.284, top1 = 40.95%], test : [loss = 2.316, top1 = 41.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 3.742, top1 = 14.24%], valid : [loss = 3.766, top1 = 14.77%], test : [loss = 3.775, top1 = 13.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.449, top1 = 47.06%], valid : [loss = 1.471, top1 = 46.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5570/15625) 005570-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.554, top1 = 88.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10        train : [loss = 0.011, top1 = 99.70%], test  : [loss = 0.368, top1 = 91.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.21 ms.
cifar100       train : [loss = 0.162, top1 = 96.00%], valid : [loss = 1.438, top1 = 67.39%], test : [loss = 1.455, top1 = 67.21%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 47.34%], valid : [loss = 2.353, top1 = 40.48%], test : [loss = 2.380, top1 = 39.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 71.76%], valid : [loss = 0.839, top1 = 70.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5571/15625) 005571-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.527, top1 = 88.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.346, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.90 ms.
cifar100       train : [loss = 0.270, top1 = 92.80%], valid : [loss = 1.282, top1 = 68.69%], test : [loss = 1.281, top1 = 68.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.08 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.96%], valid : [loss = 2.239, top1 = 42.40%], test : [loss = 2.256, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.25%], valid : [loss = 0.639, top1 = 78.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5572/15625) 005572-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.459, top1 = 86.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.116, top1 = 96.43%], test  : [loss = 0.332, top1 = 89.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.34 ms.
cifar100       train : [loss = 0.850, top1 = 75.87%], valid : [loss = 1.294, top1 = 63.89%], test : [loss = 1.273, top1 = 64.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.83%], valid : [loss = 2.626, top1 = 33.97%], test : [loss = 2.655, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.79%], valid : [loss = 0.651, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5573/15625) 005573-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.73%], valid : [loss = 0.449, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10        train : [loss = 0.148, top1 = 95.22%], test  : [loss = 0.333, top1 = 89.15%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.15 ms.
cifar100       train : [loss = 0.962, top1 = 72.58%], valid : [loss = 1.338, top1 = 62.83%], test : [loss = 1.321, top1 = 62.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.18%], valid : [loss = 2.662, top1 = 32.78%], test : [loss = 2.699, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.792, top1 = 72.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5574/15625) 005574-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.548, top1 = 88.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.342, top1 = 91.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.31 ms.
cifar100       train : [loss = 0.300, top1 = 91.75%], valid : [loss = 1.298, top1 = 67.07%], test : [loss = 1.303, top1 = 67.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.98%], valid : [loss = 2.438, top1 = 38.27%], test : [loss = 2.424, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.859, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5575/15625) 005575-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.507, top1 = 88.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.331, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.326, top1 = 91.14%], valid : [loss = 1.271, top1 = 67.72%], test : [loss = 1.286, top1 = 67.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.09%], valid : [loss = 2.382, top1 = 39.44%], test : [loss = 2.413, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5576/15625) 005576-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.413, top1 = 90.71%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.274, top1 = 93.53%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.98 ms.
cifar100       train : [loss = 0.117, top1 = 97.67%], valid : [loss = 1.283, top1 = 70.31%], test : [loss = 1.268, top1 = 70.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.25 ms.
ImageNet16-120 train : [loss = 1.676, top1 = 55.16%], valid : [loss = 2.194, top1 = 43.57%], test : [loss = 2.227, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.28%], valid : [loss = 0.505, top1 = 82.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5577/15625) 005577-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.491, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.346, top1 = 91.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.410, top1 = 88.14%], valid : [loss = 1.328, top1 = 66.85%], test : [loss = 1.296, top1 = 66.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.79%], valid : [loss = 2.420, top1 = 38.90%], test : [loss = 2.440, top1 = 38.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.29%], valid : [loss = 0.653, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5578/15625) 005578-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.14%], valid : [loss = 0.573, top1 = 86.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10        train : [loss = 0.062, top1 = 98.05%], test  : [loss = 0.378, top1 = 89.82%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.56 ms.
cifar100       train : [loss = 0.666, top1 = 80.48%], valid : [loss = 1.329, top1 = 64.38%], test : [loss = 1.311, top1 = 64.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.14%], valid : [loss = 2.504, top1 = 36.70%], test : [loss = 2.534, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5579/15625) 005579-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.67%], valid : [loss = 0.458, top1 = 86.19%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.76 ms.
cifar10        train : [loss = 0.151, top1 = 95.07%], test  : [loss = 0.338, top1 = 88.99%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.67 ms.
cifar100       train : [loss = 0.972, top1 = 72.28%], valid : [loss = 1.350, top1 = 62.08%], test : [loss = 1.334, top1 = 62.58%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.43%], valid : [loss = 2.667, top1 = 33.62%], test : [loss = 2.702, top1 = 32.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5580/15625) 005580-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.21%], valid : [loss = 0.590, top1 = 85.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.070, top1 = 97.86%], test  : [loss = 0.420, top1 = 88.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.51 ms.
cifar100       train : [loss = 0.717, top1 = 79.03%], valid : [loss = 1.379, top1 = 63.63%], test : [loss = 1.383, top1 = 63.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.87%], valid : [loss = 2.669, top1 = 33.37%], test : [loss = 2.701, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5581/15625) 005581-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.32%], valid : [loss = 0.469, top1 = 85.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10        train : [loss = 0.159, top1 = 94.83%], test  : [loss = 0.338, top1 = 89.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.18 ms.
cifar100       train : [loss = 0.995, top1 = 71.82%], valid : [loss = 1.361, top1 = 62.53%], test : [loss = 1.342, top1 = 62.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.90%], valid : [loss = 2.680, top1 = 32.78%], test : [loss = 2.689, top1 = 32.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5582/15625) 005582-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.451, top1 = 89.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.328, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.06 ms.
cifar100       train : [loss = 0.340, top1 = 90.60%], valid : [loss = 1.312, top1 = 67.09%], test : [loss = 1.302, top1 = 67.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 45.90%], valid : [loss = 2.339, top1 = 40.52%], test : [loss = 2.411, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.45%], valid : [loss = 0.549, top1 = 81.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5583/15625) 005583-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.71 ms.
cifar10-valid  train : [loss = 0.793, top1 = 72.11%], valid : [loss = 1.100, top1 = 63.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10        train : [loss = 0.785, top1 = 72.38%], test  : [loss = 0.919, top1 = 68.12%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.39 ms.
cifar100       train : [loss = 2.135, top1 = 43.96%], valid : [loss = 2.402, top1 = 40.09%], test : [loss = 2.414, top1 = 39.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.29 ms.
ImageNet16-120 train : [loss = 3.765, top1 = 13.87%], valid : [loss = 3.824, top1 = 13.53%], test : [loss = 3.838, top1 = 13.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5584/15625) 005584-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.468, top1 = 90.42%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.18 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.309, top1 = 93.30%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.25 ms.
cifar100       train : [loss = 0.066, top1 = 99.13%], valid : [loss = 1.313, top1 = 69.83%], test : [loss = 1.301, top1 = 70.22%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.75 ms.
ImageNet16-120 train : [loss = 1.584, top1 = 57.26%], valid : [loss = 2.156, top1 = 45.18%], test : [loss = 2.151, top1 = 45.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.75%], valid : [loss = 0.658, top1 = 77.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5585/15625) 005585-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.18 ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.54%], valid : [loss = 0.528, top1 = 82.31%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.84 ms.
cifar10        train : [loss = 0.405, top1 = 86.12%], test  : [loss = 0.472, top1 = 84.12%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.62 ms.
cifar100       train : [loss = 1.543, top1 = 57.70%], valid : [loss = 1.653, top1 = 54.79%], test : [loss = 1.656, top1 = 54.89%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.42 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.42%], valid : [loss = 3.012, top1 = 27.34%], test : [loss = 3.058, top1 = 26.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5586/15625) 005586-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.523, top1 = 88.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.022, top1 = 99.38%], test  : [loss = 0.345, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.385, top1 = 89.20%], valid : [loss = 1.249, top1 = 67.01%], test : [loss = 1.232, top1 = 67.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.075, top1 = 45.91%], valid : [loss = 2.317, top1 = 40.63%], test : [loss = 2.333, top1 = 40.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.92%], valid : [loss = 0.717, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5587/15625) 005587-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.547, top1 = 88.19%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.07 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.368, top1 = 91.75%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.14 ms.
cifar100       train : [loss = 0.189, top1 = 95.83%], valid : [loss = 1.412, top1 = 66.98%], test : [loss = 1.376, top1 = 67.65%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.95 ms.
ImageNet16-120 train : [loss = 2.007, top1 = 47.43%], valid : [loss = 2.442, top1 = 38.79%], test : [loss = 2.428, top1 = 39.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.31%], valid : [loss = 0.727, top1 = 74.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5588/15625) 005588-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.54%], valid : [loss = 0.455, top1 = 87.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10        train : [loss = 0.058, top1 = 98.52%], test  : [loss = 0.313, top1 = 90.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.90 ms.
cifar100       train : [loss = 0.582, top1 = 83.90%], valid : [loss = 1.209, top1 = 66.38%], test : [loss = 1.215, top1 = 66.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.25%], valid : [loss = 2.471, top1 = 37.98%], test : [loss = 2.485, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5589/15625) 005589-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.544, top1 = 89.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.50 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.356, top1 = 92.48%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.63 ms.
cifar100       train : [loss = 0.103, top1 = 98.20%], valid : [loss = 1.454, top1 = 68.45%], test : [loss = 1.450, top1 = 67.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.37%], valid : [loss = 2.432, top1 = 39.58%], test : [loss = 2.428, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5590/15625) 005590-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.541, top1 = 89.03%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.370, top1 = 92.50%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.75 ms.
cifar100       train : [loss = 0.064, top1 = 99.14%], valid : [loss = 1.465, top1 = 68.51%], test : [loss = 1.445, top1 = 69.17%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.85 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.32%], valid : [loss = 2.352, top1 = 41.58%], test : [loss = 2.387, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.27%], valid : [loss = 0.747, top1 = 74.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5591/15625) 005591-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.556, top1 = 88.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.373, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.58 ms.
cifar100       train : [loss = 0.156, top1 = 96.63%], valid : [loss = 1.470, top1 = 67.13%], test : [loss = 1.449, top1 = 67.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.13%], valid : [loss = 2.428, top1 = 39.20%], test : [loss = 2.467, top1 = 38.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.73%], valid : [loss = 0.764, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5592/15625) 005592-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.253, top1 = 91.45%], valid : [loss = 1.043, top1 = 72.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.330, top1 = 88.41%], test  : [loss = 0.683, top1 = 79.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.26 ms.
cifar100       train : [loss = 1.335, top1 = 62.46%], valid : [loss = 1.910, top1 = 50.47%], test : [loss = 1.928, top1 = 50.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 3.405, top1 = 19.72%], valid : [loss = 3.521, top1 = 18.47%], test : [loss = 3.557, top1 = 17.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.168, top1 = 58.05%], valid : [loss = 1.242, top1 = 56.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5593/15625) 005593-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.535, top1 = 88.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.48 ms.
cifar10        train : [loss = 0.027, top1 = 99.18%], test  : [loss = 0.349, top1 = 91.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.80 ms.
cifar100       train : [loss = 0.468, top1 = 86.34%], valid : [loss = 1.252, top1 = 66.95%], test : [loss = 1.267, top1 = 66.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.39%], valid : [loss = 2.378, top1 = 39.83%], test : [loss = 2.383, top1 = 39.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 73.81%], valid : [loss = 0.778, top1 = 72.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5594/15625) 005594-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.16%], valid : [loss = 0.571, top1 = 86.58%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.94 ms.
cifar10        train : [loss = 0.065, top1 = 97.90%], test  : [loss = 0.381, top1 = 89.73%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.91 ms.
cifar100       train : [loss = 0.651, top1 = 80.88%], valid : [loss = 1.300, top1 = 65.00%], test : [loss = 1.327, top1 = 64.87%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 38.71%], valid : [loss = 2.537, top1 = 36.10%], test : [loss = 2.569, top1 = 35.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.75%], valid : [loss = 0.914, top1 = 67.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5595/15625) 005595-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.91%], valid : [loss = 0.750, top1 = 74.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.512, top1 = 82.32%], test  : [loss = 0.596, top1 = 79.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.24 ms.
cifar100       train : [loss = 1.947, top1 = 47.65%], valid : [loss = 2.081, top1 = 44.91%], test : [loss = 2.088, top1 = 44.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 3.003, top1 = 26.59%], valid : [loss = 2.987, top1 = 27.29%], test : [loss = 3.018, top1 = 26.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 60.27%], valid : [loss = 1.159, top1 = 58.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5596/15625) 005596-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.536, top1 = 89.51%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.342, top1 = 93.18%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.26 ms.
cifar100       train : [loss = 0.029, top1 = 99.77%], valid : [loss = 1.436, top1 = 70.35%], test : [loss = 1.419, top1 = 70.19%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.98 ms.
ImageNet16-120 train : [loss = 1.520, top1 = 58.95%], valid : [loss = 2.426, top1 = 41.28%], test : [loss = 2.422, top1 = 41.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.708, top1 = 75.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5597/15625) 005597-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.543, top1 = 87.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10        train : [loss = 0.028, top1 = 99.25%], test  : [loss = 0.362, top1 = 90.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.18 ms.
cifar100       train : [loss = 0.416, top1 = 88.19%], valid : [loss = 1.327, top1 = 66.45%], test : [loss = 1.329, top1 = 66.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.212, top1 = 42.86%], valid : [loss = 2.482, top1 = 37.42%], test : [loss = 2.500, top1 = 37.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.83%], valid : [loss = 0.652, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5598/15625) 005598-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.21%], valid : [loss = 0.476, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10        train : [loss = 0.298, top1 = 89.98%], test  : [loss = 0.393, top1 = 86.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.80 ms.
cifar100       train : [loss = 1.336, top1 = 62.93%], valid : [loss = 1.527, top1 = 58.15%], test : [loss = 1.513, top1 = 58.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.65%], valid : [loss = 2.897, top1 = 29.63%], test : [loss = 2.958, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5599/15625) 005599-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.513, top1 = 88.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.52 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.346, top1 = 91.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 0.476, top1 = 86.02%], valid : [loss = 1.355, top1 = 65.42%], test : [loss = 1.360, top1 = 65.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.330, top1 = 40.31%], valid : [loss = 2.531, top1 = 36.45%], test : [loss = 2.564, top1 = 36.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5600/15625) 005600-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.476, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.57 ms.
cifar100       train : [loss = 0.319, top1 = 91.31%], valid : [loss = 1.257, top1 = 68.19%], test : [loss = 1.271, top1 = 67.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.81%], valid : [loss = 2.317, top1 = 40.98%], test : [loss = 2.333, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5601/15625) 005601-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.26%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=16.96 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.314, top1 = 92.09%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=16.14 ms.
cifar100       train : [loss = 0.331, top1 = 91.05%], valid : [loss = 1.302, top1 = 67.35%], test : [loss = 1.279, top1 = 67.60%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.13%], valid : [loss = 2.370, top1 = 39.59%], test : [loss = 2.388, top1 = 39.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.462, top1 = 83.77%], valid : [loss = 0.549, top1 = 81.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5602/15625) 005602-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.475, top1 = 89.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.312, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.31 ms.
cifar100       train : [loss = 0.160, top1 = 96.51%], valid : [loss = 1.293, top1 = 68.51%], test : [loss = 1.315, top1 = 68.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.55 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 52.05%], valid : [loss = 2.211, top1 = 42.82%], test : [loss = 2.236, top1 = 42.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.54%], valid : [loss = 0.573, top1 = 80.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5603/15625) 005603-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.36%], valid : [loss = 0.450, top1 = 86.50%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.52 ms.
cifar10        train : [loss = 0.134, top1 = 95.69%], test  : [loss = 0.342, top1 = 89.10%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.26 ms.
cifar100       train : [loss = 0.839, top1 = 76.19%], valid : [loss = 1.300, top1 = 63.62%], test : [loss = 1.291, top1 = 63.78%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.58%], valid : [loss = 2.587, top1 = 35.08%], test : [loss = 2.603, top1 = 34.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.66%], valid : [loss = 0.765, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5604/15625) 005604-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.41%], valid : [loss = 0.567, top1 = 87.37%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.18 ms.
cifar10        train : [loss = 0.049, top1 = 98.47%], test  : [loss = 0.374, top1 = 90.55%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.91 ms.
cifar100       train : [loss = 0.479, top1 = 86.23%], valid : [loss = 1.316, top1 = 66.15%], test : [loss = 1.320, top1 = 65.73%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 43.92%], valid : [loss = 2.373, top1 = 38.83%], test : [loss = 2.403, top1 = 38.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.60%], valid : [loss = 0.779, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5605/15625) 005605-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.07 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.65%], valid : [loss = 0.578, top1 = 84.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.90 ms.
cifar10        train : [loss = 0.127, top1 = 95.94%], test  : [loss = 0.395, top1 = 88.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 1.030, top1 = 70.55%], valid : [loss = 1.463, top1 = 60.77%], test : [loss = 1.447, top1 = 59.95%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.460, top1 = 37.60%], valid : [loss = 2.551, top1 = 35.49%], test : [loss = 2.591, top1 = 35.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 69.97%], valid : [loss = 0.892, top1 = 68.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5606/15625) 005606-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.34%], valid : [loss = 0.609, top1 = 85.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.070, top1 = 97.85%], test  : [loss = 0.405, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.45 ms.
cifar100       train : [loss = 0.704, top1 = 79.48%], valid : [loss = 1.370, top1 = 63.50%], test : [loss = 1.360, top1 = 63.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.12%], valid : [loss = 2.639, top1 = 34.13%], test : [loss = 2.671, top1 = 33.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.95%], valid : [loss = 0.777, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5607/15625) 005607-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.65%], valid : [loss = 0.894, top1 = 76.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10        train : [loss = 0.219, top1 = 92.54%], test  : [loss = 0.587, top1 = 82.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 1.129, top1 = 67.76%], valid : [loss = 1.767, top1 = 54.34%], test : [loss = 1.758, top1 = 54.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 3.176, top1 = 23.74%], valid : [loss = 3.255, top1 = 22.50%], test : [loss = 3.344, top1 = 20.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.71%], valid : [loss = 1.127, top1 = 59.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5608/15625) 005608-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.47%], valid : [loss = 0.535, top1 = 84.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10        train : [loss = 0.194, top1 = 93.37%], test  : [loss = 0.394, top1 = 87.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 1.256, top1 = 64.37%], valid : [loss = 1.532, top1 = 58.22%], test : [loss = 1.544, top1 = 57.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.28%], valid : [loss = 2.728, top1 = 32.12%], test : [loss = 2.765, top1 = 31.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 66.91%], valid : [loss = 0.983, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5609/15625) 005609-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.511, top1 = 89.67%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.74 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.320, top1 = 93.39%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.84 ms.
cifar100       train : [loss = 0.058, top1 = 99.11%], valid : [loss = 1.373, top1 = 70.04%], test : [loss = 1.372, top1 = 70.26%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.92 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.74%], valid : [loss = 2.430, top1 = 38.70%], test : [loss = 2.439, top1 = 37.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.59%], valid : [loss = 0.838, top1 = 69.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5610/15625) 005610-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.35%], valid : [loss = 0.608, top1 = 85.51%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10        train : [loss = 0.068, top1 = 97.94%], test  : [loss = 0.410, top1 = 88.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.705, top1 = 79.45%], valid : [loss = 1.352, top1 = 63.65%], test : [loss = 1.362, top1 = 63.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.08%], valid : [loss = 2.636, top1 = 34.50%], test : [loss = 2.694, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5611/15625) 005611-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.479, top1 = 88.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.69 ms.
cifar100       train : [loss = 0.317, top1 = 91.54%], valid : [loss = 1.249, top1 = 67.49%], test : [loss = 1.256, top1 = 67.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.79%], valid : [loss = 2.299, top1 = 41.15%], test : [loss = 2.339, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.28%], valid : [loss = 0.609, top1 = 79.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5612/15625) 005612-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.96%], valid : [loss = 0.582, top1 = 86.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.09 ms.
cifar10        train : [loss = 0.066, top1 = 97.91%], test  : [loss = 0.393, top1 = 89.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.21 ms.
cifar100       train : [loss = 0.658, top1 = 80.55%], valid : [loss = 1.335, top1 = 64.34%], test : [loss = 1.328, top1 = 64.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.81%], valid : [loss = 2.479, top1 = 37.70%], test : [loss = 2.505, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5613/15625) 005613-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.50%], valid : [loss = 0.571, top1 = 87.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.035, top1 = 98.99%], test  : [loss = 0.359, top1 = 91.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.20 ms.
cifar100       train : [loss = 0.464, top1 = 86.79%], valid : [loss = 1.280, top1 = 66.09%], test : [loss = 1.302, top1 = 65.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.593, top1 = 34.21%], valid : [loss = 2.666, top1 = 32.92%], test : [loss = 2.690, top1 = 32.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.61%], valid : [loss = 0.972, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5614/15625) 005614-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.20%], valid : [loss = 0.591, top1 = 85.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10        train : [loss = 0.108, top1 = 96.38%], test  : [loss = 0.394, top1 = 88.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 0.829, top1 = 75.79%], valid : [loss = 1.411, top1 = 62.40%], test : [loss = 1.417, top1 = 62.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.21%], valid : [loss = 2.757, top1 = 32.58%], test : [loss = 2.831, top1 = 30.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5615/15625) 005615-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.330, top1 = 88.48%], valid : [loss = 0.586, top1 = 81.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.281, top1 = 90.37%], test  : [loss = 0.414, top1 = 86.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 1.452, top1 = 59.16%], valid : [loss = 1.711, top1 = 53.83%], test : [loss = 1.679, top1 = 54.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.887, top1 = 28.90%], valid : [loss = 2.891, top1 = 29.65%], test : [loss = 2.934, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.90%], valid : [loss = 1.024, top1 = 63.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5616/15625) 005616-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.508, top1 = 89.44%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.27 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.342, top1 = 92.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.02 ms.
cifar100       train : [loss = 0.208, top1 = 94.74%], valid : [loss = 1.229, top1 = 69.49%], test : [loss = 1.250, top1 = 69.49%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.78%], valid : [loss = 2.210, top1 = 42.80%], test : [loss = 2.237, top1 = 42.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.64%], valid : [loss = 0.616, top1 = 79.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5617/15625) 005617-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.293, top1 = 92.95%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.33 ms.
cifar100       train : [loss = 0.121, top1 = 97.70%], valid : [loss = 1.293, top1 = 69.95%], test : [loss = 1.292, top1 = 69.71%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.699, top1 = 54.54%], valid : [loss = 2.210, top1 = 44.20%], test : [loss = 2.268, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 85.89%], valid : [loss = 0.532, top1 = 82.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5618/15625) 005618-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.03%], valid : [loss = 0.550, top1 = 86.83%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.52 ms.
cifar10        train : [loss = 0.067, top1 = 97.80%], test  : [loss = 0.360, top1 = 90.15%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.68 ms.
cifar100       train : [loss = 0.652, top1 = 80.66%], valid : [loss = 1.333, top1 = 64.50%], test : [loss = 1.314, top1 = 64.58%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.410, top1 = 38.49%], valid : [loss = 2.533, top1 = 36.03%], test : [loss = 2.571, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.95%], valid : [loss = 0.924, top1 = 67.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5619/15625) 005619-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.454, top1 = 89.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.303, top1 = 92.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.172, top1 = 96.23%], valid : [loss = 1.293, top1 = 69.55%], test : [loss = 1.257, top1 = 69.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.27%], valid : [loss = 2.249, top1 = 42.63%], test : [loss = 2.259, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.418, top1 = 85.74%], valid : [loss = 0.539, top1 = 81.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5620/15625) 005620-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.601, top1 = 88.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.408, top1 = 91.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.49 ms.
cifar100       train : [loss = 0.139, top1 = 97.01%], valid : [loss = 1.518, top1 = 66.17%], test : [loss = 1.511, top1 = 66.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.021, top1 = 47.04%], valid : [loss = 2.485, top1 = 37.85%], test : [loss = 2.489, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.67%], valid : [loss = 0.786, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5621/15625) 005621-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.517, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.344, top1 = 92.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.88 ms.
cifar100       train : [loss = 0.355, top1 = 90.32%], valid : [loss = 1.262, top1 = 67.14%], test : [loss = 1.283, top1 = 67.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.94%], valid : [loss = 2.424, top1 = 38.63%], test : [loss = 2.432, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5622/15625) 005622-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.53%], valid : [loss = 0.544, top1 = 86.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10        train : [loss = 0.082, top1 = 97.27%], test  : [loss = 0.360, top1 = 89.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.60 ms.
cifar100       train : [loss = 0.765, top1 = 77.39%], valid : [loss = 1.324, top1 = 63.95%], test : [loss = 1.318, top1 = 64.03%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.75 ms.
ImageNet16-120 train : [loss = 2.472, top1 = 37.16%], valid : [loss = 2.562, top1 = 35.20%], test : [loss = 2.596, top1 = 35.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.72%], valid : [loss = 0.746, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5623/15625) 005623-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.533, top1 = 89.06%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.49 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.359, top1 = 92.28%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.11 ms.
cifar100       train : [loss = 0.102, top1 = 98.32%], valid : [loss = 1.423, top1 = 68.68%], test : [loss = 1.434, top1 = 68.12%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.01%], valid : [loss = 2.391, top1 = 40.75%], test : [loss = 2.378, top1 = 40.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.85%], valid : [loss = 0.690, top1 = 76.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5624/15625) 005624-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.43%], valid : [loss = 0.840, top1 = 71.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.700, top1 = 75.31%], test  : [loss = 0.786, top1 = 72.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 1.955, top1 = 48.02%], valid : [loss = 2.141, top1 = 44.55%], test : [loss = 2.155, top1 = 44.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.76%], valid : [loss = 3.671, top1 = 16.12%], test : [loss = 3.702, top1 = 14.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5625/15625) 005625-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.574, top1 = 87.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.398, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.351, top1 = 90.23%], valid : [loss = 1.439, top1 = 64.94%], test : [loss = 1.407, top1 = 65.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.211, top1 = 42.99%], valid : [loss = 2.428, top1 = 38.48%], test : [loss = 2.472, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.58%], valid : [loss = 0.809, top1 = 72.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5626/15625) 005626-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.44%], valid : [loss = 0.839, top1 = 72.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 0.557, top1 = 80.58%], test  : [loss = 0.716, top1 = 75.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.14 ms.
cifar100       train : [loss = 1.785, top1 = 52.04%], valid : [loss = 2.049, top1 = 47.21%], test : [loss = 2.074, top1 = 46.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.594, top1 = 16.65%], valid : [loss = 3.646, top1 = 16.12%], test : [loss = 3.660, top1 = 15.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5627/15625) 005627-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.333, top1 = 90.93%], valid : [loss = 1.303, top1 = 67.40%], test : [loss = 1.299, top1 = 67.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.07%], valid : [loss = 2.371, top1 = 40.08%], test : [loss = 2.409, top1 = 39.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.41%], valid : [loss = 0.544, top1 = 81.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5628/15625) 005628-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10        train : [loss = 2.303, top1 = 9.95%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.48 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5629/15625) 005629-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.633, top1 = 86.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.386, top1 = 90.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.51 ms.
cifar100       train : [loss = 0.499, top1 = 85.43%], valid : [loss = 1.406, top1 = 64.34%], test : [loss = 1.366, top1 = 65.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 39.04%], valid : [loss = 2.566, top1 = 35.67%], test : [loss = 2.591, top1 = 35.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.66%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5630/15625) 005630-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.66%], valid : [loss = 0.646, top1 = 84.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.72 ms.
cifar10        train : [loss = 0.084, top1 = 97.29%], test  : [loss = 0.407, top1 = 88.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.96 ms.
cifar100       train : [loss = 0.804, top1 = 76.50%], valid : [loss = 1.462, top1 = 61.02%], test : [loss = 1.454, top1 = 61.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.72%], valid : [loss = 2.760, top1 = 31.87%], test : [loss = 2.787, top1 = 31.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.72%], valid : [loss = 0.851, top1 = 70.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5631/15625) 005631-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.548, top1 = 88.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.357, top1 = 91.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 0.300, top1 = 91.79%], valid : [loss = 1.281, top1 = 67.54%], test : [loss = 1.311, top1 = 67.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.68%], valid : [loss = 2.462, top1 = 36.83%], test : [loss = 2.463, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.87%], valid : [loss = 0.886, top1 = 68.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5632/15625) 005632-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.497, top1 = 88.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10        train : [loss = 0.020, top1 = 99.48%], test  : [loss = 0.334, top1 = 91.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.83 ms.
cifar100       train : [loss = 0.330, top1 = 91.04%], valid : [loss = 1.240, top1 = 68.14%], test : [loss = 1.262, top1 = 68.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.957, top1 = 48.50%], valid : [loss = 2.238, top1 = 42.30%], test : [loss = 2.279, top1 = 42.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.18%], valid : [loss = 0.688, top1 = 75.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5633/15625) 005633-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.445, top1 = 90.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.97 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.286, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.96 ms.
cifar100       train : [loss = 0.059, top1 = 99.31%], valid : [loss = 1.301, top1 = 70.73%], test : [loss = 1.286, top1 = 70.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 1.450, top1 = 60.58%], valid : [loss = 2.199, top1 = 44.95%], test : [loss = 2.231, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.43%], valid : [loss = 0.524, top1 = 82.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5634/15625) 005634-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.583, top1 = 87.95%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.95 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.397, top1 = 91.30%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.11 ms.
cifar100       train : [loss = 0.199, top1 = 95.55%], valid : [loss = 1.444, top1 = 66.65%], test : [loss = 1.391, top1 = 67.05%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.30 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.22%], valid : [loss = 2.481, top1 = 37.83%], test : [loss = 2.493, top1 = 38.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.30%], valid : [loss = 0.763, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5635/15625) 005635-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.558, top1 = 88.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.369, top1 = 91.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.54 ms.
cifar100       train : [loss = 0.163, top1 = 96.57%], valid : [loss = 1.385, top1 = 67.43%], test : [loss = 1.422, top1 = 67.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.83%], valid : [loss = 2.427, top1 = 39.44%], test : [loss = 2.454, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.61%], valid : [loss = 0.692, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5636/15625) 005636-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=20.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.481, top1 = 89.31%]
cifar10        FLOP= 62.83 M, Params=0.456 MB, latency=21.72 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.298, top1 = 92.71%]
cifar100       FLOP= 62.84 M, Params=0.462 MB, latency=21.43 ms.
cifar100       train : [loss = 0.203, top1 = 95.19%], valid : [loss = 1.240, top1 = 69.37%], test : [loss = 1.226, top1 = 69.36%]
ImageNet16-120 FLOP= 15.72 M, Params=0.463 MB, latency=22.52 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.52%], valid : [loss = 2.164, top1 = 43.55%], test : [loss = 2.195, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.69%], valid : [loss = 0.690, top1 = 75.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5637/15625) 005637-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.21%], valid : [loss = 0.454, top1 = 86.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10        train : [loss = 0.116, top1 = 96.36%], test  : [loss = 0.330, top1 = 89.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 0.865, top1 = 75.40%], valid : [loss = 1.289, top1 = 64.08%], test : [loss = 1.293, top1 = 63.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.73%], valid : [loss = 2.620, top1 = 34.98%], test : [loss = 2.657, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5638/15625) 005638-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.27%], valid : [loss = 0.622, top1 = 85.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.075, top1 = 97.69%], test  : [loss = 0.393, top1 = 88.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 0.719, top1 = 79.01%], valid : [loss = 1.376, top1 = 63.39%], test : [loss = 1.352, top1 = 63.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.78%], valid : [loss = 2.673, top1 = 33.24%], test : [loss = 2.703, top1 = 33.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5639/15625) 005639-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.15%], valid : [loss = 0.590, top1 = 85.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.398, top1 = 88.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.04 ms.
cifar100       train : [loss = 0.718, top1 = 79.12%], valid : [loss = 1.404, top1 = 62.90%], test : [loss = 1.399, top1 = 62.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.87%], valid : [loss = 2.660, top1 = 33.42%], test : [loss = 2.690, top1 = 32.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5640/15625) 005640-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.81%], valid : [loss = 0.478, top1 = 84.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.21 ms.
cifar10        train : [loss = 0.302, top1 = 89.92%], test  : [loss = 0.399, top1 = 86.41%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.14 ms.
cifar100       train : [loss = 1.330, top1 = 63.03%], valid : [loss = 1.540, top1 = 57.33%], test : [loss = 1.513, top1 = 57.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.71 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.73%], valid : [loss = 2.898, top1 = 29.72%], test : [loss = 2.977, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5641/15625) 005641-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.484, top1 = 89.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.311, top1 = 92.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.40 ms.
cifar100       train : [loss = 0.138, top1 = 97.19%], valid : [loss = 1.267, top1 = 69.36%], test : [loss = 1.272, top1 = 69.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.24%], valid : [loss = 2.196, top1 = 43.70%], test : [loss = 2.209, top1 = 44.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.36%], valid : [loss = 0.595, top1 = 79.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5642/15625) 005642-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.476, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.307, top1 = 92.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.58 ms.
cifar100       train : [loss = 0.318, top1 = 91.58%], valid : [loss = 1.266, top1 = 67.62%], test : [loss = 1.262, top1 = 67.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.78%], valid : [loss = 2.322, top1 = 40.58%], test : [loss = 2.343, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.97%], valid : [loss = 0.596, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5643/15625) 005643-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.542, top1 = 80.97%], valid : [loss = 0.683, top1 = 76.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.64 ms.
cifar10        train : [loss = 0.526, top1 = 81.76%], test  : [loss = 0.593, top1 = 79.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.28 ms.
cifar100       train : [loss = 1.789, top1 = 51.86%], valid : [loss = 1.950, top1 = 48.70%], test : [loss = 1.965, top1 = 48.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 3.395, top1 = 19.99%], valid : [loss = 3.369, top1 = 20.47%], test : [loss = 3.422, top1 = 19.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 51.09%], valid : [loss = 1.361, top1 = 51.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5644/15625) 005644-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.17%], valid : [loss = 0.450, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10        train : [loss = 0.113, top1 = 96.44%], test  : [loss = 0.320, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.866, top1 = 75.33%], valid : [loss = 1.306, top1 = 64.17%], test : [loss = 1.285, top1 = 64.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.62%], valid : [loss = 2.625, top1 = 34.67%], test : [loss = 2.658, top1 = 33.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5645/15625) 005645-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.420, top1 = 90.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.272, top1 = 93.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.77 ms.
cifar100       train : [loss = 0.181, top1 = 95.80%], valid : [loss = 1.282, top1 = 69.23%], test : [loss = 1.251, top1 = 70.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.84%], valid : [loss = 2.266, top1 = 42.45%], test : [loss = 2.275, top1 = 42.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.88%], valid : [loss = 0.500, top1 = 83.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5646/15625) 005646-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.419, top1 = 90.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.281, top1 = 93.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.94 ms.
cifar100       train : [loss = 0.184, top1 = 95.64%], valid : [loss = 1.287, top1 = 69.07%], test : [loss = 1.296, top1 = 68.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.62%], valid : [loss = 2.252, top1 = 42.85%], test : [loss = 2.291, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.29%], valid : [loss = 0.504, top1 = 83.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5647/15625) 005647-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.48%], valid : [loss = 0.462, top1 = 86.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10        train : [loss = 0.158, top1 = 94.88%], test  : [loss = 0.339, top1 = 89.11%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 0.996, top1 = 71.61%], valid : [loss = 1.365, top1 = 62.30%], test : [loss = 1.345, top1 = 62.66%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.85%], valid : [loss = 2.670, top1 = 33.38%], test : [loss = 2.712, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5648/15625) 005648-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.61 ms.
cifar10-valid  train : [loss = 1.163, top1 = 58.57%], valid : [loss = 1.211, top1 = 57.07%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.72 ms.
cifar10        train : [loss = 1.100, top1 = 61.14%], test  : [loss = 1.106, top1 = 60.67%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.55 ms.
cifar100       train : [loss = 2.650, top1 = 33.47%], valid : [loss = 2.724, top1 = 32.28%], test : [loss = 2.708, top1 = 32.58%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.59 ms.
ImageNet16-120 train : [loss = 3.825, top1 = 13.02%], valid : [loss = 3.814, top1 = 14.17%], test : [loss = 3.828, top1 = 12.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.672, top1 = 37.49%], valid : [loss = 1.732, top1 = 34.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5649/15625) 005649-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.583, top1 = 87.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.377, top1 = 91.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.121, top1 = 97.52%], valid : [loss = 1.550, top1 = 66.75%], test : [loss = 1.525, top1 = 66.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 48.00%], valid : [loss = 2.418, top1 = 39.66%], test : [loss = 2.435, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.84%], valid : [loss = 0.746, top1 = 73.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5650/15625) 005650-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.29%], valid : [loss = 0.743, top1 = 80.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10        train : [loss = 0.131, top1 = 95.63%], test  : [loss = 0.520, top1 = 85.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.58 ms.
cifar100       train : [loss = 0.661, top1 = 80.77%], valid : [loss = 1.672, top1 = 58.40%], test : [loss = 1.691, top1 = 57.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 3.287, top1 = 20.79%], valid : [loss = 3.323, top1 = 20.27%], test : [loss = 3.348, top1 = 19.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.07%], valid : [loss = 1.239, top1 = 55.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5651/15625) 005651-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.22%], valid : [loss = 0.454, top1 = 87.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.99 ms.
cifar10        train : [loss = 0.114, top1 = 96.53%], test  : [loss = 0.333, top1 = 89.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.57 ms.
cifar100       train : [loss = 0.865, top1 = 75.34%], valid : [loss = 1.313, top1 = 63.57%], test : [loss = 1.291, top1 = 64.69%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.46%], valid : [loss = 2.638, top1 = 34.15%], test : [loss = 2.663, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5652/15625) 005652-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.533, top1 = 89.38%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.48 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.340, top1 = 92.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.36 ms.
cifar100       train : [loss = 0.076, top1 = 98.70%], valid : [loss = 1.401, top1 = 69.15%], test : [loss = 1.389, top1 = 69.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.63%], valid : [loss = 2.409, top1 = 38.72%], test : [loss = 2.383, top1 = 39.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.91%], valid : [loss = 0.866, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5653/15625) 005653-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.469, top1 = 89.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.318, top1 = 91.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.44 ms.
cifar100       train : [loss = 0.330, top1 = 91.00%], valid : [loss = 1.291, top1 = 67.18%], test : [loss = 1.297, top1 = 67.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.10%], valid : [loss = 2.362, top1 = 40.27%], test : [loss = 2.380, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.50%], valid : [loss = 0.577, top1 = 80.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5654/15625) 005654-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.803, top1 = 83.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.588, top1 = 87.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.231, top1 = 94.43%], valid : [loss = 1.777, top1 = 61.14%], test : [loss = 1.782, top1 = 60.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 2.460, top1 = 37.98%], valid : [loss = 2.935, top1 = 29.53%], test : [loss = 2.933, top1 = 29.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.09%], valid : [loss = 0.911, top1 = 68.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5655/15625) 005655-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.54 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.483, top1 = 89.80%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.80 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.310, top1 = 92.85%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.52 ms.
cifar100       train : [loss = 0.116, top1 = 97.93%], valid : [loss = 1.291, top1 = 69.57%], test : [loss = 1.273, top1 = 69.87%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.05 ms.
ImageNet16-120 train : [loss = 1.671, top1 = 55.01%], valid : [loss = 2.152, top1 = 44.68%], test : [loss = 2.200, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.80%], valid : [loss = 0.622, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5656/15625) 005656-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.599, top1 = 87.65%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.80 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.396, top1 = 91.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.47 ms.
cifar100       train : [loss = 0.126, top1 = 97.60%], valid : [loss = 1.520, top1 = 66.81%], test : [loss = 1.509, top1 = 66.72%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 1.998, top1 = 47.65%], valid : [loss = 2.487, top1 = 38.35%], test : [loss = 2.487, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.74%], valid : [loss = 0.740, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5657/15625) 005657-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.70%], valid : [loss = 0.459, top1 = 86.48%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.65 ms.
cifar10        train : [loss = 0.152, top1 = 95.03%], test  : [loss = 0.332, top1 = 89.17%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=20.11 ms.
cifar100       train : [loss = 0.964, top1 = 72.61%], valid : [loss = 1.342, top1 = 62.54%], test : [loss = 1.339, top1 = 62.47%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.11%], valid : [loss = 2.663, top1 = 33.63%], test : [loss = 2.717, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 72.92%], valid : [loss = 0.801, top1 = 71.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5658/15625) 005658-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.494, top1 = 88.72%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=17.83 ms.
cifar10        train : [loss = 0.023, top1 = 99.43%], test  : [loss = 0.350, top1 = 91.24%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=15.85 ms.
cifar100       train : [loss = 0.428, top1 = 87.61%], valid : [loss = 1.309, top1 = 66.75%], test : [loss = 1.303, top1 = 66.83%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.194, top1 = 43.16%], valid : [loss = 2.419, top1 = 39.03%], test : [loss = 2.418, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.82%], valid : [loss = 0.587, top1 = 80.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5659/15625) 005659-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.89%], valid : [loss = 0.852, top1 = 71.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.567, top1 = 80.10%], test  : [loss = 0.722, top1 = 75.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.40 ms.
cifar100       train : [loss = 1.781, top1 = 52.14%], valid : [loss = 2.057, top1 = 47.30%], test : [loss = 2.075, top1 = 47.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.77%], valid : [loss = 3.631, top1 = 16.47%], test : [loss = 3.655, top1 = 15.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.187, top1 = 57.15%], valid : [loss = 1.249, top1 = 55.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5660/15625) 005660-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.314, top1 = 92.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 0.327, top1 = 91.09%], valid : [loss = 1.302, top1 = 67.16%], test : [loss = 1.322, top1 = 66.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.25%], valid : [loss = 2.376, top1 = 40.08%], test : [loss = 2.418, top1 = 39.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5661/15625) 005661-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.334, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.351, top1 = 90.29%], valid : [loss = 1.297, top1 = 66.62%], test : [loss = 1.294, top1 = 66.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.93%], valid : [loss = 2.397, top1 = 38.82%], test : [loss = 2.421, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5662/15625) 005662-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.20%], valid : [loss = 0.530, top1 = 85.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10        train : [loss = 0.082, top1 = 97.46%], test  : [loss = 0.356, top1 = 89.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.87 ms.
cifar100       train : [loss = 0.708, top1 = 79.43%], valid : [loss = 1.358, top1 = 63.86%], test : [loss = 1.331, top1 = 64.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.39%], valid : [loss = 2.495, top1 = 36.82%], test : [loss = 2.537, top1 = 35.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.30%], valid : [loss = 0.898, top1 = 68.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5663/15625) 005663-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.64%], valid : [loss = 0.540, top1 = 84.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.168, top1 = 94.35%], test  : [loss = 0.380, top1 = 88.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.47 ms.
cifar100       train : [loss = 1.164, top1 = 66.85%], valid : [loss = 1.495, top1 = 58.62%], test : [loss = 1.495, top1 = 59.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 34.10%], valid : [loss = 2.677, top1 = 33.87%], test : [loss = 2.718, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5664/15625) 005664-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.457, top1 = 90.71%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.48 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.296, top1 = 93.65%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.53 ms.
cifar100       train : [loss = 0.043, top1 = 99.47%], valid : [loss = 1.341, top1 = 71.15%], test : [loss = 1.347, top1 = 70.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.440, top1 = 60.85%], valid : [loss = 2.242, top1 = 44.18%], test : [loss = 2.234, top1 = 44.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.443, top1 = 84.63%], valid : [loss = 0.555, top1 = 81.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5665/15625) 005665-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.21 ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.25%], valid : [loss = 0.902, top1 = 69.03%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10        train : [loss = 0.683, top1 = 76.16%], test  : [loss = 0.769, top1 = 73.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.83 ms.
cifar100       train : [loss = 1.964, top1 = 47.69%], valid : [loss = 2.129, top1 = 44.74%], test : [loss = 2.167, top1 = 44.64%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.97 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.76%], valid : [loss = 3.671, top1 = 16.08%], test : [loss = 3.697, top1 = 15.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5666/15625) 005666-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.178, top1 = 93.90%], valid : [loss = 0.728, top1 = 80.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.188, top1 = 93.53%], test  : [loss = 0.509, top1 = 84.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.16 ms.
cifar100       train : [loss = 0.886, top1 = 73.95%], valid : [loss = 1.622, top1 = 58.09%], test : [loss = 1.661, top1 = 56.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 3.506, top1 = 16.68%], valid : [loss = 3.515, top1 = 17.37%], test : [loss = 3.512, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5667/15625) 005667-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.523, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.326, top1 = 92.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 0.260, top1 = 92.98%], valid : [loss = 1.324, top1 = 67.59%], test : [loss = 1.314, top1 = 67.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.89%], valid : [loss = 2.290, top1 = 42.23%], test : [loss = 2.293, top1 = 41.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.68%], valid : [loss = 0.625, top1 = 78.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5668/15625) 005668-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.547, top1 = 89.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.46 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.381, top1 = 92.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.90 ms.
cifar100       train : [loss = 0.097, top1 = 98.29%], valid : [loss = 1.465, top1 = 67.60%], test : [loss = 1.467, top1 = 67.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.64%], valid : [loss = 2.425, top1 = 39.80%], test : [loss = 2.452, top1 = 38.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5669/15625) 005669-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.452, top1 = 89.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.322, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 0.318, top1 = 91.40%], valid : [loss = 1.310, top1 = 66.92%], test : [loss = 1.328, top1 = 66.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.32%], valid : [loss = 2.391, top1 = 39.02%], test : [loss = 2.393, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.90%], valid : [loss = 0.549, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5670/15625) 005670-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.584, top1 = 86.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.041, top1 = 98.80%], test  : [loss = 0.384, top1 = 90.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 0.552, top1 = 83.75%], valid : [loss = 1.437, top1 = 63.64%], test : [loss = 1.413, top1 = 63.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.74%], valid : [loss = 2.619, top1 = 34.22%], test : [loss = 2.676, top1 = 33.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5671/15625) 005671-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.560, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.368, top1 = 91.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.56 ms.
cifar100       train : [loss = 0.144, top1 = 96.71%], valid : [loss = 1.398, top1 = 68.34%], test : [loss = 1.395, top1 = 67.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.51%], valid : [loss = 2.406, top1 = 38.63%], test : [loss = 2.396, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.00%], valid : [loss = 0.925, top1 = 66.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5672/15625) 005672-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.36%], valid : [loss = 0.570, top1 = 81.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10        train : [loss = 0.315, top1 = 89.17%], test  : [loss = 0.449, top1 = 85.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.508, top1 = 57.91%], valid : [loss = 1.739, top1 = 52.64%], test : [loss = 1.730, top1 = 53.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 25.83%], valid : [loss = 3.026, top1 = 26.30%], test : [loss = 3.080, top1 = 25.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.38%], valid : [loss = 1.025, top1 = 63.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5673/15625) 005673-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.552, top1 = 88.45%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.359, top1 = 92.02%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.60 ms.
cifar100       train : [loss = 0.243, top1 = 93.60%], valid : [loss = 1.301, top1 = 67.91%], test : [loss = 1.327, top1 = 67.69%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.45%], valid : [loss = 2.450, top1 = 37.17%], test : [loss = 2.459, top1 = 37.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.05%], valid : [loss = 0.887, top1 = 68.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5674/15625) 005674-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.515, top1 = 88.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.336, top1 = 91.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.96 ms.
cifar100       train : [loss = 0.338, top1 = 90.70%], valid : [loss = 1.290, top1 = 67.02%], test : [loss = 1.268, top1 = 67.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.66%], valid : [loss = 2.399, top1 = 39.02%], test : [loss = 2.393, top1 = 39.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5675/15625) 005675-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.25%], valid : [loss = 0.538, top1 = 84.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.73 ms.
cifar10        train : [loss = 0.187, top1 = 93.66%], test  : [loss = 0.388, top1 = 88.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 1.191, top1 = 66.08%], valid : [loss = 1.525, top1 = 58.08%], test : [loss = 1.483, top1 = 59.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.76%], valid : [loss = 2.699, top1 = 33.05%], test : [loss = 2.754, top1 = 32.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5676/15625) 005676-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.550, top1 = 89.09%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.96 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.360, top1 = 92.64%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.98 ms.
cifar100       train : [loss = 0.075, top1 = 98.86%], valid : [loss = 1.473, top1 = 68.28%], test : [loss = 1.439, top1 = 68.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 1.811, top1 = 51.90%], valid : [loss = 2.370, top1 = 41.12%], test : [loss = 2.403, top1 = 41.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.20%], valid : [loss = 0.757, top1 = 73.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5677/15625) 005677-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.558, top1 = 87.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.380, top1 = 91.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.49 ms.
cifar100       train : [loss = 0.400, top1 = 88.68%], valid : [loss = 1.429, top1 = 64.96%], test : [loss = 1.402, top1 = 65.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.03%], valid : [loss = 2.492, top1 = 36.50%], test : [loss = 2.529, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5678/15625) 005678-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.73 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5679/15625) 005679-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.460, top1 = 89.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.325, top1 = 92.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.28 ms.
cifar100       train : [loss = 0.301, top1 = 91.68%], valid : [loss = 1.330, top1 = 67.71%], test : [loss = 1.322, top1 = 67.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.73%], valid : [loss = 2.339, top1 = 41.03%], test : [loss = 2.373, top1 = 40.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.89%], valid : [loss = 0.638, top1 = 78.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5680/15625) 005680-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.91%], valid : [loss = 0.479, top1 = 84.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10        train : [loss = 0.295, top1 = 90.17%], test  : [loss = 0.398, top1 = 86.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.53 ms.
cifar100       train : [loss = 1.327, top1 = 63.10%], valid : [loss = 1.526, top1 = 57.85%], test : [loss = 1.507, top1 = 58.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.54%], valid : [loss = 2.917, top1 = 29.21%], test : [loss = 2.964, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5681/15625) 005681-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.93 ms.
cifar10-valid  train : [loss = 1.815, top1 = 34.24%], valid : [loss = 1.834, top1 = 33.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.39 ms.
cifar10        train : [loss = 1.190, top1 = 57.45%], test  : [loss = 1.192, top1 = 56.89%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 3.773, top1 = 12.41%], valid : [loss = 3.857, top1 = 10.66%], test : [loss = 3.849, top1 = 11.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.70 ms.
ImageNet16-120 train : [loss = 3.761, top1 = 13.85%], valid : [loss = 3.726, top1 = 14.94%], test : [loss = 3.746, top1 = 14.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5682/15625) 005682-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.43%], valid : [loss = 0.578, top1 = 85.50%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.15 ms.
cifar10        train : [loss = 0.081, top1 = 97.52%], test  : [loss = 0.378, top1 = 89.33%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.56 ms.
cifar100       train : [loss = 0.673, top1 = 80.33%], valid : [loss = 1.389, top1 = 63.63%], test : [loss = 1.372, top1 = 63.81%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.18 ms.
ImageNet16-120 train : [loss = 2.433, top1 = 38.05%], valid : [loss = 2.548, top1 = 35.22%], test : [loss = 2.594, top1 = 34.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.52%], valid : [loss = 0.845, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5683/15625) 005683-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.28%], valid : [loss = 0.840, top1 = 71.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.692, top1 = 75.79%], test  : [loss = 0.778, top1 = 73.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.05 ms.
cifar100       train : [loss = 1.973, top1 = 47.50%], valid : [loss = 2.132, top1 = 44.61%], test : [loss = 2.155, top1 = 44.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 3.657, top1 = 15.64%], valid : [loss = 3.681, top1 = 15.96%], test : [loss = 3.698, top1 = 14.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5684/15625) 005684-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.533, top1 = 87.57%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.07 ms.
cifar10        train : [loss = 0.032, top1 = 99.12%], test  : [loss = 0.374, top1 = 90.43%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.65 ms.
cifar100       train : [loss = 0.436, top1 = 87.61%], valid : [loss = 1.380, top1 = 65.75%], test : [loss = 1.375, top1 = 65.31%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 2.246, top1 = 42.13%], valid : [loss = 2.464, top1 = 37.33%], test : [loss = 2.505, top1 = 37.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.19%], valid : [loss = 0.641, top1 = 77.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5685/15625) 005685-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.85%], valid : [loss = 0.625, top1 = 79.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.303, top1 = 89.60%], test  : [loss = 0.452, top1 = 85.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.87 ms.
cifar100       train : [loss = 1.629, top1 = 54.96%], valid : [loss = 1.854, top1 = 50.67%], test : [loss = 1.856, top1 = 50.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 3.149, top1 = 23.99%], valid : [loss = 3.145, top1 = 24.33%], test : [loss = 3.223, top1 = 22.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.095, top1 = 60.60%], valid : [loss = 1.122, top1 = 59.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5686/15625) 005686-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.507, top1 = 88.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.22 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.334, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.73 ms.
cifar100       train : [loss = 0.336, top1 = 90.91%], valid : [loss = 1.285, top1 = 67.04%], test : [loss = 1.294, top1 = 67.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.76%], valid : [loss = 2.414, top1 = 39.42%], test : [loss = 2.436, top1 = 38.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.27%], valid : [loss = 0.642, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5687/15625) 005687-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.26%], valid : [loss = 0.456, top1 = 87.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.114, top1 = 96.50%], test  : [loss = 0.333, top1 = 89.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 0.849, top1 = 75.91%], valid : [loss = 1.287, top1 = 64.33%], test : [loss = 1.274, top1 = 64.31%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.41 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.73%], valid : [loss = 2.615, top1 = 34.13%], test : [loss = 2.671, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5688/15625) 005688-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.493, top1 = 89.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.329, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.317, top1 = 91.54%], valid : [loss = 1.260, top1 = 67.40%], test : [loss = 1.250, top1 = 68.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.65%], valid : [loss = 2.329, top1 = 39.87%], test : [loss = 2.338, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5689/15625) 005689-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.462, top1 = 89.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.322, top1 = 92.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.28 ms.
cifar100       train : [loss = 0.180, top1 = 95.64%], valid : [loss = 1.323, top1 = 69.23%], test : [loss = 1.338, top1 = 68.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 1.841, top1 = 51.27%], valid : [loss = 2.282, top1 = 42.29%], test : [loss = 2.317, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.22%], valid : [loss = 0.541, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5690/15625) 005690-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10-valid  train : [loss = 1.192, top1 = 57.21%], valid : [loss = 1.238, top1 = 56.09%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10        train : [loss = 1.140, top1 = 59.36%], test  : [loss = 1.139, top1 = 59.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.92 ms.
cifar100       train : [loss = 2.665, top1 = 33.01%], valid : [loss = 2.746, top1 = 31.81%], test : [loss = 2.727, top1 = 32.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.72 ms.
ImageNet16-120 train : [loss = 3.833, top1 = 12.94%], valid : [loss = 3.816, top1 = 13.77%], test : [loss = 3.827, top1 = 13.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.672, top1 = 37.49%], valid : [loss = 1.732, top1 = 34.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5691/15625) 005691-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.605, top1 = 85.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.70 ms.
cifar10        train : [loss = 0.074, top1 = 97.71%], test  : [loss = 0.385, top1 = 89.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.69 ms.
cifar100       train : [loss = 0.717, top1 = 79.10%], valid : [loss = 1.396, top1 = 63.43%], test : [loss = 1.362, top1 = 63.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 36.06%], valid : [loss = 2.652, top1 = 33.82%], test : [loss = 2.683, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5692/15625) 005692-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.50%], valid : [loss = 0.848, top1 = 72.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.10 ms.
cifar10        train : [loss = 0.554, top1 = 80.68%], test  : [loss = 0.714, top1 = 75.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 1.773, top1 = 52.25%], valid : [loss = 2.064, top1 = 47.20%], test : [loss = 2.049, top1 = 46.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.91%], valid : [loss = 3.630, top1 = 16.97%], test : [loss = 3.658, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5693/15625) 005693-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.55%], valid : [loss = 0.568, top1 = 87.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.367, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.492, top1 = 85.99%], valid : [loss = 1.332, top1 = 65.33%], test : [loss = 1.320, top1 = 66.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.39%], valid : [loss = 2.585, top1 = 34.33%], test : [loss = 2.609, top1 = 33.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5694/15625) 005694-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 74.63 M, Params=0.534 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.535, top1 = 88.73%]
cifar10        FLOP= 74.63 M, Params=0.534 MB, latency=18.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.350, top1 = 91.78%]
cifar100       FLOP= 74.64 M, Params=0.540 MB, latency=20.17 ms.
cifar100       train : [loss = 0.301, top1 = 91.61%], valid : [loss = 1.306, top1 = 67.47%], test : [loss = 1.298, top1 = 68.01%]
ImageNet16-120 FLOP= 18.67 M, Params=0.542 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.71%], valid : [loss = 2.320, top1 = 41.02%], test : [loss = 2.337, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.70%], valid : [loss = 0.779, top1 = 72.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5695/15625) 005695-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.09%], valid : [loss = 0.896, top1 = 68.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10        train : [loss = 0.730, top1 = 74.34%], test  : [loss = 0.777, top1 = 72.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.25 ms.
cifar100       train : [loss = 2.292, top1 = 39.59%], valid : [loss = 2.385, top1 = 37.77%], test : [loss = 2.369, top1 = 38.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 3.535, top1 = 17.17%], valid : [loss = 3.526, top1 = 17.85%], test : [loss = 3.535, top1 = 16.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.377, top1 = 49.65%], valid : [loss = 1.417, top1 = 48.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5696/15625) 005696-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.494, top1 = 88.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.00 ms.
cifar10        train : [loss = 0.025, top1 = 99.37%], test  : [loss = 0.341, top1 = 91.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 0.454, top1 = 86.75%], valid : [loss = 1.306, top1 = 66.25%], test : [loss = 1.285, top1 = 66.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.220, top1 = 42.58%], valid : [loss = 2.426, top1 = 38.90%], test : [loss = 2.440, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.71%], valid : [loss = 0.636, top1 = 78.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5697/15625) 005697-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.514, top1 = 88.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.332, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.340, top1 = 90.65%], valid : [loss = 1.305, top1 = 66.61%], test : [loss = 1.307, top1 = 67.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.85%], valid : [loss = 2.401, top1 = 38.90%], test : [loss = 2.416, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5698/15625) 005698-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=21.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.510, top1 = 89.84%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=20.20 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.305, top1 = 93.60%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.28 ms.
cifar100       train : [loss = 0.037, top1 = 99.59%], valid : [loss = 1.343, top1 = 70.55%], test : [loss = 1.384, top1 = 69.86%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=21.30 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 46.93%], valid : [loss = 2.371, top1 = 39.35%], test : [loss = 2.371, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.863, top1 = 69.08%], valid : [loss = 0.899, top1 = 67.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5699/15625) 005699-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.483, top1 = 89.17%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.293, top1 = 92.71%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.20 ms.
cifar100       train : [loss = 0.251, top1 = 93.65%], valid : [loss = 1.240, top1 = 68.32%], test : [loss = 1.240, top1 = 68.52%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 50.97%], valid : [loss = 2.211, top1 = 43.77%], test : [loss = 2.212, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.84%], valid : [loss = 0.648, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5700/15625) 005700-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.68%], valid : [loss = 0.552, top1 = 82.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.62 ms.
cifar10        train : [loss = 0.299, top1 = 89.73%], test  : [loss = 0.427, top1 = 85.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.21 ms.
cifar100       train : [loss = 1.321, top1 = 62.87%], valid : [loss = 1.607, top1 = 56.49%], test : [loss = 1.586, top1 = 57.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 3.068, top1 = 25.81%], valid : [loss = 3.065, top1 = 25.85%], test : [loss = 3.129, top1 = 24.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.210, top1 = 56.20%], valid : [loss = 1.259, top1 = 54.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5701/15625) 005701-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.550, top1 = 88.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.024, top1 = 99.32%], test  : [loss = 0.363, top1 = 90.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.21 ms.
cifar100       train : [loss = 0.381, top1 = 89.07%], valid : [loss = 1.303, top1 = 66.61%], test : [loss = 1.305, top1 = 66.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.64%], valid : [loss = 2.382, top1 = 39.13%], test : [loss = 2.422, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.68%], valid : [loss = 0.814, top1 = 71.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5702/15625) 005702-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.42%], valid : [loss = 0.695, top1 = 84.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.054, top1 = 98.34%], test  : [loss = 0.432, top1 = 88.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.01 ms.
cifar100       train : [loss = 0.623, top1 = 81.81%], valid : [loss = 1.518, top1 = 61.33%], test : [loss = 1.484, top1 = 61.91%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.11%], valid : [loss = 2.824, top1 = 30.80%], test : [loss = 2.863, top1 = 29.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5703/15625) 005703-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.539, top1 = 88.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.342, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.17 ms.
cifar100       train : [loss = 0.325, top1 = 91.07%], valid : [loss = 1.291, top1 = 67.31%], test : [loss = 1.315, top1 = 67.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.07%], valid : [loss = 2.413, top1 = 38.98%], test : [loss = 2.431, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5704/15625) 005704-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.184, top1 = 94.01%], valid : [loss = 0.476, top1 = 84.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10        train : [loss = 0.227, top1 = 92.21%], test  : [loss = 0.395, top1 = 86.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.29 ms.
cifar100       train : [loss = 1.384, top1 = 61.59%], valid : [loss = 1.635, top1 = 55.21%], test : [loss = 1.624, top1 = 55.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 2.965, top1 = 27.04%], valid : [loss = 2.974, top1 = 26.93%], test : [loss = 2.989, top1 = 26.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.55%], valid : [loss = 1.052, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5705/15625) 005705-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.575, top1 = 88.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.366, top1 = 92.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.29 ms.
cifar100       train : [loss = 0.120, top1 = 97.59%], valid : [loss = 1.538, top1 = 67.07%], test : [loss = 1.522, top1 = 66.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.76 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.95%], valid : [loss = 2.423, top1 = 39.44%], test : [loss = 2.446, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.84%], valid : [loss = 0.746, top1 = 73.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5706/15625) 005706-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.32%], valid : [loss = 0.469, top1 = 85.93%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=15.09 ms.
cifar10        train : [loss = 0.158, top1 = 94.84%], test  : [loss = 0.348, top1 = 88.67%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=13.52 ms.
cifar100       train : [loss = 0.982, top1 = 72.10%], valid : [loss = 1.350, top1 = 62.26%], test : [loss = 1.347, top1 = 62.25%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.84%], valid : [loss = 2.691, top1 = 32.92%], test : [loss = 2.709, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5707/15625) 005707-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.578, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.381, top1 = 91.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.38 ms.
cifar100       train : [loss = 0.370, top1 = 89.66%], valid : [loss = 1.385, top1 = 65.39%], test : [loss = 1.403, top1 = 65.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.07%], valid : [loss = 2.503, top1 = 36.80%], test : [loss = 2.533, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.80%], valid : [loss = 0.772, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5708/15625) 005708-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.505, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.98 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.327, top1 = 92.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.35 ms.
cifar100       train : [loss = 0.136, top1 = 97.07%], valid : [loss = 1.307, top1 = 68.94%], test : [loss = 1.276, top1 = 70.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.65 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.77%], valid : [loss = 2.324, top1 = 40.80%], test : [loss = 2.290, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.78%], valid : [loss = 0.769, top1 = 73.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5709/15625) 005709-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.588, top1 = 87.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.381, top1 = 91.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.35 ms.
cifar100       train : [loss = 0.383, top1 = 89.21%], valid : [loss = 1.411, top1 = 65.24%], test : [loss = 1.403, top1 = 65.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.61%], valid : [loss = 2.474, top1 = 37.51%], test : [loss = 2.502, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.09%], valid : [loss = 0.828, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5710/15625) 005710-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.81%], valid : [loss = 0.537, top1 = 85.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10        train : [loss = 0.102, top1 = 96.75%], test  : [loss = 0.366, top1 = 89.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.760, top1 = 77.89%], valid : [loss = 1.402, top1 = 62.64%], test : [loss = 1.377, top1 = 63.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.75%], valid : [loss = 2.561, top1 = 34.83%], test : [loss = 2.635, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.92%], valid : [loss = 0.871, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5711/15625) 005711-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.18 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.456, top1 = 90.67%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.294, top1 = 93.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.94 ms.
cifar100       train : [loss = 0.049, top1 = 99.29%], valid : [loss = 1.422, top1 = 70.22%], test : [loss = 1.378, top1 = 70.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 1.450, top1 = 60.65%], valid : [loss = 2.233, top1 = 44.10%], test : [loss = 2.233, top1 = 45.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 87.96%], valid : [loss = 0.487, top1 = 83.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5712/15625) 005712-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.595, top1 = 87.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.390, top1 = 91.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.205, top1 = 95.29%], valid : [loss = 1.428, top1 = 66.92%], test : [loss = 1.432, top1 = 66.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.075, top1 = 45.93%], valid : [loss = 2.494, top1 = 38.00%], test : [loss = 2.487, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.57%], valid : [loss = 0.756, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5713/15625) 005713-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.04%], valid : [loss = 0.552, top1 = 86.81%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.48 ms.
cifar10        train : [loss = 0.064, top1 = 97.79%], test  : [loss = 0.368, top1 = 90.08%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.11 ms.
cifar100       train : [loss = 0.662, top1 = 80.46%], valid : [loss = 1.321, top1 = 64.36%], test : [loss = 1.309, top1 = 64.26%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.74%], valid : [loss = 2.525, top1 = 35.87%], test : [loss = 2.571, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.75%], valid : [loss = 0.914, top1 = 67.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5714/15625) 005714-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.76 ms.
cifar10-valid  train : [loss = 0.199, top1 = 93.33%], valid : [loss = 0.489, top1 = 85.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.88 ms.
cifar10        train : [loss = 0.194, top1 = 93.40%], test  : [loss = 0.366, top1 = 88.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.75 ms.
cifar100       train : [loss = 1.214, top1 = 65.41%], valid : [loss = 1.535, top1 = 58.66%], test : [loss = 1.515, top1 = 58.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.20 ms.
ImageNet16-120 train : [loss = 2.729, top1 = 31.94%], valid : [loss = 2.729, top1 = 32.33%], test : [loss = 2.770, top1 = 31.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.19%], valid : [loss = 1.061, top1 = 62.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5715/15625) 005715-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.77%], valid : [loss = 0.532, top1 = 83.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.278, top1 = 90.42%], test  : [loss = 0.428, top1 = 86.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 1.400, top1 = 60.78%], valid : [loss = 1.648, top1 = 55.30%], test : [loss = 1.634, top1 = 55.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.942, top1 = 28.07%], valid : [loss = 2.935, top1 = 28.80%], test : [loss = 2.997, top1 = 27.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.67%], valid : [loss = 0.999, top1 = 64.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5716/15625) 005716-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.543, top1 = 88.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.21 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.363, top1 = 91.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.71 ms.
cifar100       train : [loss = 0.309, top1 = 91.21%], valid : [loss = 1.310, top1 = 67.22%], test : [loss = 1.298, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.14%], valid : [loss = 2.387, top1 = 39.57%], test : [loss = 2.426, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.32%], valid : [loss = 0.853, top1 = 69.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5717/15625) 005717-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.85%], valid : [loss = 0.547, top1 = 84.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.04 ms.
cifar10        train : [loss = 0.154, top1 = 95.04%], test  : [loss = 0.378, top1 = 88.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.05 ms.
cifar100       train : [loss = 1.148, top1 = 67.12%], valid : [loss = 1.537, top1 = 58.66%], test : [loss = 1.493, top1 = 59.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.87%], valid : [loss = 2.581, top1 = 35.13%], test : [loss = 2.612, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.19%], valid : [loss = 0.951, top1 = 66.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5718/15625) 005718-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.485, top1 = 89.61%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.45 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.308, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.84 ms.
cifar100       train : [loss = 0.143, top1 = 97.16%], valid : [loss = 1.259, top1 = 69.57%], test : [loss = 1.258, top1 = 69.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 1.747, top1 = 53.37%], valid : [loss = 2.198, top1 = 43.38%], test : [loss = 2.209, top1 = 44.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.490, top1 = 82.82%], valid : [loss = 0.586, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5719/15625) 005719-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.621, top1 = 87.66%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.94 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.388, top1 = 91.75%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.09 ms.
cifar100       train : [loss = 0.134, top1 = 97.23%], valid : [loss = 1.621, top1 = 65.56%], test : [loss = 1.571, top1 = 65.58%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.27 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.41%], valid : [loss = 2.398, top1 = 39.43%], test : [loss = 2.390, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 73.96%], valid : [loss = 0.792, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5720/15625) 005720-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.542, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.27 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.341, top1 = 91.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.36 ms.
cifar100       train : [loss = 0.331, top1 = 90.97%], valid : [loss = 1.297, top1 = 67.18%], test : [loss = 1.286, top1 = 67.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.65%], valid : [loss = 2.429, top1 = 37.53%], test : [loss = 2.432, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5721/15625) 005721-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=20.27 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.461, top1 = 90.90%]
cifar10        FLOP=188.66 M, Params=1.317 MB, latency=24.39 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.302, top1 = 93.66%]
cifar100       FLOP=188.67 M, Params=1.322 MB, latency=23.94 ms.
cifar100       train : [loss = 0.031, top1 = 99.73%], valid : [loss = 1.345, top1 = 70.76%], test : [loss = 1.328, top1 = 70.88%]
ImageNet16-120 FLOP= 47.17 M, Params=1.324 MB, latency=20.38 ms.
ImageNet16-120 train : [loss = 1.574, top1 = 57.53%], valid : [loss = 2.158, top1 = 44.47%], test : [loss = 2.159, top1 = 45.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.84%], valid : [loss = 0.702, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5722/15625) 005722-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.30%], valid : [loss = 0.629, top1 = 85.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.074, top1 = 97.69%], test  : [loss = 0.408, top1 = 88.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.32 ms.
cifar100       train : [loss = 0.730, top1 = 78.96%], valid : [loss = 1.398, top1 = 62.90%], test : [loss = 1.358, top1 = 63.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.15%], valid : [loss = 2.636, top1 = 33.77%], test : [loss = 2.690, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5723/15625) 005723-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.88 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.499, top1 = 89.23%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.36 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.330, top1 = 92.22%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.53 ms.
cifar100       train : [loss = 0.223, top1 = 94.33%], valid : [loss = 1.270, top1 = 68.68%], test : [loss = 1.271, top1 = 69.20%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.94%], valid : [loss = 2.189, top1 = 44.10%], test : [loss = 2.203, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.18%], valid : [loss = 0.626, top1 = 78.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5724/15625) 005724-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.10 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.93%], valid : [loss = 0.480, top1 = 84.30%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10        train : [loss = 0.306, top1 = 89.73%], test  : [loss = 0.405, top1 = 86.44%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.06 ms.
cifar100       train : [loss = 1.337, top1 = 63.08%], valid : [loss = 1.537, top1 = 57.56%], test : [loss = 1.522, top1 = 58.15%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.34 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.83%], valid : [loss = 2.900, top1 = 29.24%], test : [loss = 2.957, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5725/15625) 005725-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.415, top1 = 90.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.292, top1 = 93.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.179, top1 = 95.77%], valid : [loss = 1.265, top1 = 69.66%], test : [loss = 1.217, top1 = 70.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.81 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.81%], valid : [loss = 2.245, top1 = 43.30%], test : [loss = 2.302, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.88%], valid : [loss = 0.500, top1 = 83.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5726/15625) 005726-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.290, top1 = 92.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.70 ms.
cifar100       train : [loss = 0.201, top1 = 95.40%], valid : [loss = 1.227, top1 = 69.02%], test : [loss = 1.258, top1 = 69.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.79%], valid : [loss = 2.244, top1 = 42.67%], test : [loss = 2.329, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.40%], valid : [loss = 0.517, top1 = 82.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5727/15625) 005727-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.85%], valid : [loss = 0.893, top1 = 69.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.698, top1 = 75.60%], test  : [loss = 0.750, top1 = 74.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 2.209, top1 = 41.60%], valid : [loss = 2.295, top1 = 39.51%], test : [loss = 2.304, top1 = 39.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 3.459, top1 = 18.58%], valid : [loss = 3.431, top1 = 19.77%], test : [loss = 3.457, top1 = 18.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.342, top1 = 51.49%], valid : [loss = 1.388, top1 = 50.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5728/15625) 005728-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.577, top1 = 88.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.378, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.51 ms.
cifar100       train : [loss = 0.174, top1 = 96.11%], valid : [loss = 1.424, top1 = 66.76%], test : [loss = 1.425, top1 = 67.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.93%], valid : [loss = 2.473, top1 = 38.77%], test : [loss = 2.496, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.99%], valid : [loss = 0.698, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5729/15625) 005729-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.42%], valid : [loss = 0.561, top1 = 85.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10        train : [loss = 0.077, top1 = 97.61%], test  : [loss = 0.372, top1 = 89.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.37 ms.
cifar100       train : [loss = 0.672, top1 = 80.22%], valid : [loss = 1.358, top1 = 63.74%], test : [loss = 1.382, top1 = 63.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.436, top1 = 37.90%], valid : [loss = 2.553, top1 = 35.87%], test : [loss = 2.570, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.48%], valid : [loss = 0.900, top1 = 68.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5730/15625) 005730-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.540, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.343, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 0.246, top1 = 93.43%], valid : [loss = 1.340, top1 = 67.11%], test : [loss = 1.329, top1 = 67.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 42.89%], valid : [loss = 2.422, top1 = 37.92%], test : [loss = 2.427, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5731/15625) 005731-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.423, top1 = 91.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.16 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.284, top1 = 93.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.14 ms.
cifar100       train : [loss = 0.065, top1 = 99.06%], valid : [loss = 1.335, top1 = 70.20%], test : [loss = 1.336, top1 = 70.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 1.542, top1 = 58.18%], valid : [loss = 2.251, top1 = 43.40%], test : [loss = 2.254, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5732/15625) 005732-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.45 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.11%], valid : [loss = 0.461, top1 = 86.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.02 ms.
cifar10        train : [loss = 0.155, top1 = 94.98%], test  : [loss = 0.346, top1 = 88.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.05 ms.
cifar100       train : [loss = 0.996, top1 = 71.80%], valid : [loss = 1.365, top1 = 61.62%], test : [loss = 1.357, top1 = 61.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.64%], valid : [loss = 2.704, top1 = 32.60%], test : [loss = 2.709, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5733/15625) 005733-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.08%], valid : [loss = 0.764, top1 = 74.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10        train : [loss = 0.517, top1 = 82.14%], test  : [loss = 0.594, top1 = 79.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 1.996, top1 = 46.11%], valid : [loss = 2.129, top1 = 43.13%], test : [loss = 2.122, top1 = 43.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.44 ms.
ImageNet16-120 train : [loss = 2.975, top1 = 27.13%], valid : [loss = 2.959, top1 = 27.56%], test : [loss = 2.989, top1 = 26.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.78%], valid : [loss = 1.192, top1 = 57.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5734/15625) 005734-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.570, top1 = 88.78%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.54 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.354, top1 = 92.79%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.87 ms.
cifar100       train : [loss = 0.056, top1 = 99.15%], valid : [loss = 1.544, top1 = 67.70%], test : [loss = 1.539, top1 = 67.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.68%], valid : [loss = 2.351, top1 = 40.63%], test : [loss = 2.388, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.78%], valid : [loss = 0.690, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5735/15625) 005735-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.52%], valid : [loss = 0.716, top1 = 80.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.187, top1 = 93.58%], test  : [loss = 0.523, top1 = 84.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.61 ms.
cifar100       train : [loss = 0.890, top1 = 73.95%], valid : [loss = 1.641, top1 = 57.34%], test : [loss = 1.657, top1 = 57.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 3.516, top1 = 16.48%], valid : [loss = 3.510, top1 = 17.50%], test : [loss = 3.521, top1 = 16.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5736/15625) 005736-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.490, top1 = 90.03%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=18.54 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.291, top1 = 93.57%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.18 ms.
cifar100       train : [loss = 0.113, top1 = 97.83%], valid : [loss = 1.331, top1 = 68.88%], test : [loss = 1.284, top1 = 70.00%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.83%], valid : [loss = 2.174, top1 = 43.90%], test : [loss = 2.181, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.77%], valid : [loss = 0.570, top1 = 80.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5737/15625) 005737-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.266, top1 = 90.85%], valid : [loss = 0.529, top1 = 83.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.239, top1 = 91.78%], test  : [loss = 0.401, top1 = 86.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 1.326, top1 = 62.44%], valid : [loss = 1.604, top1 = 56.43%], test : [loss = 1.608, top1 = 55.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.809, top1 = 30.50%], valid : [loss = 2.812, top1 = 30.40%], test : [loss = 2.855, top1 = 29.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.12%], valid : [loss = 0.995, top1 = 64.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5738/15625) 005738-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.458, top1 = 89.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.309, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 0.330, top1 = 90.95%], valid : [loss = 1.288, top1 = 67.26%], test : [loss = 1.309, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.44%], valid : [loss = 2.370, top1 = 39.66%], test : [loss = 2.364, top1 = 39.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.74%], valid : [loss = 0.566, top1 = 81.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5739/15625) 005739-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.321, top1 = 88.84%], valid : [loss = 0.590, top1 = 81.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.263, top1 = 90.98%], test  : [loss = 0.411, top1 = 86.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.73 ms.
cifar100       train : [loss = 1.502, top1 = 57.95%], valid : [loss = 1.748, top1 = 53.07%], test : [loss = 1.734, top1 = 52.69%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.932, top1 = 28.00%], valid : [loss = 2.949, top1 = 27.82%], test : [loss = 3.001, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5740/15625) 005740-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.99%], valid : [loss = 0.460, top1 = 89.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.79 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.297, top1 = 92.49%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.05 ms.
cifar100       train : [loss = 0.178, top1 = 96.03%], valid : [loss = 1.266, top1 = 69.56%], test : [loss = 1.252, top1 = 69.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.33 ms.
ImageNet16-120 train : [loss = 1.811, top1 = 51.92%], valid : [loss = 2.272, top1 = 42.70%], test : [loss = 2.276, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.449, top1 = 84.52%], valid : [loss = 0.556, top1 = 81.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5741/15625) 005741-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.535, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.369, top1 = 92.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.71 ms.
cifar100       train : [loss = 0.143, top1 = 97.16%], valid : [loss = 1.381, top1 = 68.42%], test : [loss = 1.463, top1 = 67.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.44 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.23%], valid : [loss = 2.437, top1 = 40.07%], test : [loss = 2.405, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.707, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5742/15625) 005742-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.582, top1 = 87.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.391, top1 = 91.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.58 ms.
cifar100       train : [loss = 0.392, top1 = 88.91%], valid : [loss = 1.406, top1 = 65.24%], test : [loss = 1.384, top1 = 65.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.90%], valid : [loss = 2.514, top1 = 36.79%], test : [loss = 2.533, top1 = 37.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5743/15625) 005743-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.359, top1 = 91.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.76 ms.
cifar100       train : [loss = 0.339, top1 = 90.63%], valid : [loss = 1.294, top1 = 66.96%], test : [loss = 1.272, top1 = 67.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.95%], valid : [loss = 2.415, top1 = 38.97%], test : [loss = 2.418, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5744/15625) 005744-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.81 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.61%], valid : [loss = 0.542, top1 = 83.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.13 ms.
cifar10        train : [loss = 0.199, top1 = 93.22%], test  : [loss = 0.398, top1 = 87.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 1.269, top1 = 63.99%], valid : [loss = 1.530, top1 = 58.07%], test : [loss = 1.546, top1 = 57.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.700, top1 = 32.54%], valid : [loss = 2.733, top1 = 32.17%], test : [loss = 2.774, top1 = 30.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.06%], valid : [loss = 0.982, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5745/15625) 005745-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.465, top1 = 90.16%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.36 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 92.77%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.87 ms.
cifar100       train : [loss = 0.101, top1 = 98.13%], valid : [loss = 1.296, top1 = 70.00%], test : [loss = 1.254, top1 = 69.90%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 1.664, top1 = 55.25%], valid : [loss = 2.147, top1 = 45.10%], test : [loss = 2.141, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.26%], valid : [loss = 0.604, top1 = 79.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5746/15625) 005746-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.199, top1 = 93.29%], valid : [loss = 0.612, top1 = 81.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.194, top1 = 93.50%], test  : [loss = 0.412, top1 = 86.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.76 ms.
cifar100       train : [loss = 1.233, top1 = 64.81%], valid : [loss = 1.565, top1 = 57.50%], test : [loss = 1.579, top1 = 57.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 2.765, top1 = 31.12%], valid : [loss = 2.806, top1 = 30.97%], test : [loss = 2.820, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.36%], valid : [loss = 0.965, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5747/15625) 005747-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.21%], valid : [loss = 0.548, top1 = 87.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.040, top1 = 98.75%], test  : [loss = 0.364, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.15 ms.
cifar100       train : [loss = 0.457, top1 = 86.74%], valid : [loss = 1.332, top1 = 65.96%], test : [loss = 1.328, top1 = 65.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.962, top1 = 26.14%], valid : [loss = 3.033, top1 = 25.57%], test : [loss = 3.021, top1 = 25.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.047, top1 = 62.06%], valid : [loss = 1.056, top1 = 62.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5748/15625) 005748-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.37%], valid : [loss = 0.565, top1 = 84.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10        train : [loss = 0.206, top1 = 93.04%], test  : [loss = 0.390, top1 = 87.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.22 ms.
cifar100       train : [loss = 1.011, top1 = 70.79%], valid : [loss = 1.441, top1 = 60.66%], test : [loss = 1.426, top1 = 60.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.723, top1 = 32.14%], valid : [loss = 2.771, top1 = 32.67%], test : [loss = 2.820, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.951, top1 = 65.78%], valid : [loss = 0.993, top1 = 64.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5749/15625) 005749-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.444, top1 = 90.90%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.24 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.08 ms.
cifar100       train : [loss = 0.061, top1 = 99.19%], valid : [loss = 1.347, top1 = 69.80%], test : [loss = 1.302, top1 = 70.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.56 ms.
ImageNet16-120 train : [loss = 1.516, top1 = 59.09%], valid : [loss = 2.242, top1 = 43.83%], test : [loss = 2.246, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.346, top1 = 88.42%], valid : [loss = 0.482, top1 = 84.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5750/15625) 005750-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.530, top1 = 88.41%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.57 ms.
cifar10        train : [loss = 0.029, top1 = 99.14%], test  : [loss = 0.358, top1 = 91.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.74 ms.
cifar100       train : [loss = 0.445, top1 = 87.28%], valid : [loss = 1.234, top1 = 67.50%], test : [loss = 1.227, top1 = 67.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=24.35 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.91%], valid : [loss = 2.407, top1 = 39.43%], test : [loss = 2.410, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.64%], valid : [loss = 0.819, top1 = 71.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5751/15625) 005751-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.12%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=14.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.315, top1 = 92.02%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=12.89 ms.
cifar100       train : [loss = 0.326, top1 = 91.22%], valid : [loss = 1.290, top1 = 67.33%], test : [loss = 1.325, top1 = 66.97%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.36%], valid : [loss = 2.362, top1 = 39.88%], test : [loss = 2.395, top1 = 40.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5752/15625) 005752-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.519, top1 = 88.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.321, top1 = 92.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 0.356, top1 = 90.16%], valid : [loss = 1.297, top1 = 66.96%], test : [loss = 1.266, top1 = 67.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.29 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.66%], valid : [loss = 2.403, top1 = 38.73%], test : [loss = 2.409, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5753/15625) 005753-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.54 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.30 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5754/15625) 005754-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.336, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.93 ms.
cifar100       train : [loss = 0.313, top1 = 91.15%], valid : [loss = 1.371, top1 = 66.16%], test : [loss = 1.397, top1 = 66.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.31%], valid : [loss = 2.469, top1 = 38.23%], test : [loss = 2.521, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 79.01%], valid : [loss = 0.690, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5755/15625) 005755-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.53%], valid : [loss = 0.532, top1 = 84.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.144, top1 = 95.19%], test  : [loss = 0.370, top1 = 89.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 0.951, top1 = 72.37%], valid : [loss = 1.464, top1 = 60.62%], test : [loss = 1.479, top1 = 60.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.747, top1 = 31.47%], valid : [loss = 2.775, top1 = 31.17%], test : [loss = 2.839, top1 = 29.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.24%], valid : [loss = 0.961, top1 = 66.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5756/15625) 005756-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.30%], valid : [loss = 0.464, top1 = 85.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.33 ms.
cifar10        train : [loss = 0.158, top1 = 94.90%], test  : [loss = 0.353, top1 = 88.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.73 ms.
cifar100       train : [loss = 1.002, top1 = 71.53%], valid : [loss = 1.363, top1 = 61.28%], test : [loss = 1.353, top1 = 61.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.50%], valid : [loss = 2.713, top1 = 32.30%], test : [loss = 2.741, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5757/15625) 005757-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.583, top1 = 87.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.391, top1 = 91.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 0.387, top1 = 89.11%], valid : [loss = 1.381, top1 = 65.72%], test : [loss = 1.389, top1 = 65.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.01%], valid : [loss = 2.516, top1 = 36.96%], test : [loss = 2.536, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5758/15625) 005758-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.30%], valid : [loss = 0.564, top1 = 84.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.136, top1 = 95.53%], test  : [loss = 0.382, top1 = 88.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.857, top1 = 74.82%], valid : [loss = 1.390, top1 = 63.06%], test : [loss = 1.429, top1 = 61.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.36%], valid : [loss = 2.652, top1 = 33.10%], test : [loss = 2.640, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.05%], valid : [loss = 0.934, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5759/15625) 005759-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.18 ms.
cifar10-valid  train : [loss = 1.852, top1 = 32.77%], valid : [loss = 1.862, top1 = 32.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 1.495, top1 = 45.68%], test  : [loss = 1.497, top1 = 46.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.14 ms.
cifar100       train : [loss = 3.877, top1 = 10.44%], valid : [loss = 3.910, top1 = 9.95%], test : [loss = 3.908, top1 = 10.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.63 ms.
ImageNet16-120 train : [loss = 3.992, top1 = 10.44%], valid : [loss = 3.987, top1 = 10.89%], test : [loss = 3.997, top1 = 10.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.969, top1 = 27.06%], valid : [loss = 1.969, top1 = 27.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5760/15625) 005760-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.60%], valid : [loss = 0.585, top1 = 87.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.041, top1 = 98.79%], test  : [loss = 0.390, top1 = 89.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 0.548, top1 = 83.80%], valid : [loss = 1.390, top1 = 64.60%], test : [loss = 1.427, top1 = 63.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.26 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.81%], valid : [loss = 2.648, top1 = 33.47%], test : [loss = 2.675, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5761/15625) 005761-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.96%], valid : [loss = 0.543, top1 = 86.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.076, top1 = 97.54%], test  : [loss = 0.364, top1 = 89.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.08 ms.
cifar100       train : [loss = 0.724, top1 = 78.83%], valid : [loss = 1.366, top1 = 63.66%], test : [loss = 1.326, top1 = 64.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.90 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.02%], valid : [loss = 2.639, top1 = 34.33%], test : [loss = 2.692, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.37%], valid : [loss = 0.671, top1 = 77.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5762/15625) 005762-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.07 ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.46%], valid : [loss = 1.112, top1 = 63.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.46 ms.
cifar10        train : [loss = 0.789, top1 = 72.41%], test  : [loss = 0.939, top1 = 67.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.82 ms.
cifar100       train : [loss = 2.179, top1 = 43.10%], valid : [loss = 2.481, top1 = 39.14%], test : [loss = 2.458, top1 = 38.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.02 ms.
ImageNet16-120 train : [loss = 3.768, top1 = 13.85%], valid : [loss = 3.816, top1 = 13.63%], test : [loss = 3.834, top1 = 13.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5763/15625) 005763-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.70%], valid : [loss = 0.484, top1 = 84.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10        train : [loss = 0.298, top1 = 89.94%], test  : [loss = 0.399, top1 = 86.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.44 ms.
cifar100       train : [loss = 1.321, top1 = 63.52%], valid : [loss = 1.536, top1 = 57.86%], test : [loss = 1.511, top1 = 58.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.63%], valid : [loss = 2.888, top1 = 29.03%], test : [loss = 2.964, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5764/15625) 005764-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.12%], valid : [loss = 0.476, top1 = 84.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.24 ms.
cifar10        train : [loss = 0.303, top1 = 89.88%], test  : [loss = 0.392, top1 = 86.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 1.348, top1 = 62.67%], valid : [loss = 1.538, top1 = 57.14%], test : [loss = 1.522, top1 = 57.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.78%], valid : [loss = 2.912, top1 = 28.37%], test : [loss = 2.958, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5765/15625) 005765-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.516, top1 = 88.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.022, top1 = 99.39%], test  : [loss = 0.350, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.83 ms.
cifar100       train : [loss = 0.353, top1 = 89.82%], valid : [loss = 1.199, top1 = 68.28%], test : [loss = 1.210, top1 = 68.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.097, top1 = 45.40%], valid : [loss = 2.330, top1 = 40.87%], test : [loss = 2.358, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.20%], valid : [loss = 0.869, top1 = 69.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5766/15625) 005766-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.555, top1 = 87.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.381, top1 = 91.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.399, top1 = 88.63%], valid : [loss = 1.381, top1 = 65.89%], test : [loss = 1.401, top1 = 65.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.92%], valid : [loss = 2.468, top1 = 37.59%], test : [loss = 2.495, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.42%], valid : [loss = 0.765, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5767/15625) 005767-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.86%], valid : [loss = 0.457, top1 = 86.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10        train : [loss = 0.159, top1 = 94.86%], test  : [loss = 0.351, top1 = 88.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.26 ms.
cifar100       train : [loss = 0.966, top1 = 72.61%], valid : [loss = 1.333, top1 = 62.72%], test : [loss = 1.342, top1 = 62.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.76%], valid : [loss = 2.689, top1 = 32.50%], test : [loss = 2.721, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5768/15625) 005768-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.202, top1 = 93.22%], valid : [loss = 0.522, top1 = 84.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.205, top1 = 93.10%], test  : [loss = 0.380, top1 = 87.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.20 ms.
cifar100       train : [loss = 1.248, top1 = 64.64%], valid : [loss = 1.538, top1 = 58.55%], test : [loss = 1.551, top1 = 57.87%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.781, top1 = 31.07%], valid : [loss = 2.821, top1 = 30.11%], test : [loss = 2.850, top1 = 29.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 66.17%], valid : [loss = 0.988, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5769/15625) 005769-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.560, top1 = 88.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.030, top1 = 99.10%], test  : [loss = 0.396, top1 = 90.66%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.82 ms.
cifar100       train : [loss = 0.272, top1 = 92.43%], valid : [loss = 1.415, top1 = 66.18%], test : [loss = 1.435, top1 = 66.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 2.905, top1 = 27.51%], valid : [loss = 3.011, top1 = 26.03%], test : [loss = 2.995, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 60.09%], valid : [loss = 1.102, top1 = 59.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5770/15625) 005770-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.60%], valid : [loss = 0.588, top1 = 86.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10        train : [loss = 0.039, top1 = 98.88%], test  : [loss = 0.417, top1 = 89.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.90 ms.
cifar100       train : [loss = 0.556, top1 = 83.55%], valid : [loss = 1.408, top1 = 64.48%], test : [loss = 1.410, top1 = 63.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.26%], valid : [loss = 2.617, top1 = 34.07%], test : [loss = 2.631, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.52%], valid : [loss = 0.627, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5771/15625) 005771-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.46 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.309, top1 = 92.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.52 ms.
cifar100       train : [loss = 0.131, top1 = 97.55%], valid : [loss = 1.305, top1 = 69.28%], test : [loss = 1.345, top1 = 68.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.90 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.77%], valid : [loss = 2.181, top1 = 44.23%], test : [loss = 2.198, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.24%], valid : [loss = 0.626, top1 = 78.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5772/15625) 005772-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.500, top1 = 89.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.338, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.333, top1 = 91.08%], valid : [loss = 1.294, top1 = 67.24%], test : [loss = 1.311, top1 = 67.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.55%], valid : [loss = 2.424, top1 = 38.53%], test : [loss = 2.403, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5773/15625) 005773-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.38%], valid : [loss = 0.682, top1 = 85.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10        train : [loss = 0.056, top1 = 98.31%], test  : [loss = 0.470, top1 = 88.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 0.639, top1 = 81.26%], valid : [loss = 1.560, top1 = 61.08%], test : [loss = 1.519, top1 = 61.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.28%], valid : [loss = 2.811, top1 = 30.30%], test : [loss = 2.859, top1 = 30.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.81%], valid : [loss = 0.900, top1 = 67.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5774/15625) 005774-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.530, top1 = 88.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.51 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.350, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.42 ms.
cifar100       train : [loss = 0.248, top1 = 93.44%], valid : [loss = 1.322, top1 = 67.44%], test : [loss = 1.345, top1 = 67.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.57%], valid : [loss = 2.444, top1 = 38.43%], test : [loss = 2.436, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5775/15625) 005775-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.73 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.51%], valid : [loss = 0.529, top1 = 87.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.351, top1 = 91.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.20 ms.
cifar100       train : [loss = 0.422, top1 = 87.73%], valid : [loss = 1.246, top1 = 67.06%], test : [loss = 1.264, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.03%], valid : [loss = 2.427, top1 = 38.20%], test : [loss = 2.431, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 67.08%], valid : [loss = 0.954, top1 = 66.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5776/15625) 005776-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.437, top1 = 91.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.283, top1 = 93.51%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.42 ms.
cifar100       train : [loss = 0.069, top1 = 98.96%], valid : [loss = 1.349, top1 = 70.42%], test : [loss = 1.310, top1 = 70.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 1.561, top1 = 57.76%], valid : [loss = 2.237, top1 = 43.87%], test : [loss = 2.307, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.90%], valid : [loss = 0.500, top1 = 83.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5777/15625) 005777-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.350, top1 = 87.82%], valid : [loss = 0.567, top1 = 81.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10        train : [loss = 0.311, top1 = 89.34%], test  : [loss = 0.464, top1 = 84.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 1.619, top1 = 55.01%], valid : [loss = 1.839, top1 = 50.18%], test : [loss = 1.824, top1 = 50.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.976, top1 = 27.06%], valid : [loss = 2.981, top1 = 27.43%], test : [loss = 3.019, top1 = 26.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.26%], valid : [loss = 1.049, top1 = 62.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5778/15625) 005778-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.550, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.13 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.335, top1 = 92.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.76 ms.
cifar100       train : [loss = 0.097, top1 = 98.17%], valid : [loss = 1.342, top1 = 69.34%], test : [loss = 1.319, top1 = 69.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 55.78%], valid : [loss = 2.186, top1 = 45.03%], test : [loss = 2.191, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.22%], valid : [loss = 0.590, top1 = 79.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5779/15625) 005779-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.96%], valid : [loss = 0.480, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10        train : [loss = 0.300, top1 = 89.99%], test  : [loss = 0.399, top1 = 86.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.48 ms.
cifar100       train : [loss = 1.325, top1 = 63.02%], valid : [loss = 1.534, top1 = 57.50%], test : [loss = 1.503, top1 = 57.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.64%], valid : [loss = 2.919, top1 = 29.17%], test : [loss = 2.999, top1 = 27.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5780/15625) 005780-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 90.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.10 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.88 ms.
cifar100       train : [loss = 0.066, top1 = 99.00%], valid : [loss = 1.343, top1 = 70.20%], test : [loss = 1.377, top1 = 69.78%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 1.553, top1 = 58.14%], valid : [loss = 2.260, top1 = 43.53%], test : [loss = 2.273, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.17%], valid : [loss = 0.505, top1 = 83.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5781/15625) 005781-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.591, top1 = 87.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.023, top1 = 99.42%], test  : [loss = 0.391, top1 = 90.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.443, top1 = 87.23%], valid : [loss = 1.391, top1 = 64.93%], test : [loss = 1.382, top1 = 65.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.38%], valid : [loss = 2.518, top1 = 36.92%], test : [loss = 2.546, top1 = 36.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.75%], valid : [loss = 0.823, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5782/15625) 005782-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.56%], valid : [loss = 0.824, top1 = 76.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.315, top1 = 88.99%], test  : [loss = 0.628, top1 = 80.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.43 ms.
cifar100       train : [loss = 1.333, top1 = 62.30%], valid : [loss = 1.910, top1 = 51.18%], test : [loss = 1.911, top1 = 50.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 3.488, top1 = 17.52%], valid : [loss = 3.530, top1 = 16.60%], test : [loss = 3.515, top1 = 16.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.19%], valid : [loss = 1.301, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5783/15625) 005783-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.309, top1 = 91.93%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.13 ms.
cifar100       train : [loss = 0.327, top1 = 91.18%], valid : [loss = 1.245, top1 = 67.66%], test : [loss = 1.263, top1 = 67.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.64 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.84%], valid : [loss = 2.310, top1 = 41.40%], test : [loss = 2.298, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.74%], valid : [loss = 0.591, top1 = 79.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5784/15625) 005784-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.47%], valid : [loss = 0.552, top1 = 83.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10        train : [loss = 0.225, top1 = 92.24%], test  : [loss = 0.411, top1 = 86.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.13 ms.
cifar100       train : [loss = 1.209, top1 = 65.69%], valid : [loss = 1.583, top1 = 57.64%], test : [loss = 1.568, top1 = 57.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.51%], valid : [loss = 2.961, top1 = 28.27%], test : [loss = 3.014, top1 = 27.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.00%], valid : [loss = 1.219, top1 = 56.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5785/15625) 005785-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.530, top1 = 88.47%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.341, top1 = 91.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.44 ms.
cifar100       train : [loss = 0.318, top1 = 91.43%], valid : [loss = 1.263, top1 = 67.79%], test : [loss = 1.253, top1 = 67.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.59%], valid : [loss = 2.320, top1 = 41.03%], test : [loss = 2.353, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.80%], valid : [loss = 0.688, top1 = 76.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5786/15625) 005786-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.556, top1 = 88.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.349, top1 = 92.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.094, top1 = 98.35%], valid : [loss = 1.487, top1 = 68.24%], test : [loss = 1.475, top1 = 68.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.73 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.37%], valid : [loss = 2.401, top1 = 40.80%], test : [loss = 2.408, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.60%], valid : [loss = 0.728, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5787/15625) 005787-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.545, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.347, top1 = 92.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.13 ms.
cifar100       train : [loss = 0.105, top1 = 98.08%], valid : [loss = 1.412, top1 = 67.86%], test : [loss = 1.452, top1 = 68.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.862, top1 = 50.63%], valid : [loss = 2.444, top1 = 39.87%], test : [loss = 2.440, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.83%], valid : [loss = 0.711, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5788/15625) 005788-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.25%], valid : [loss = 0.470, top1 = 85.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.155, top1 = 94.94%], test  : [loss = 0.339, top1 = 89.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 1.003, top1 = 71.44%], valid : [loss = 1.348, top1 = 62.04%], test : [loss = 1.346, top1 = 61.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.32%], valid : [loss = 2.718, top1 = 32.30%], test : [loss = 2.729, top1 = 31.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5789/15625) 005789-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.466, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.309, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 0.331, top1 = 91.03%], valid : [loss = 1.304, top1 = 67.03%], test : [loss = 1.302, top1 = 67.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.28%], valid : [loss = 2.368, top1 = 40.53%], test : [loss = 2.402, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.00%], valid : [loss = 0.556, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5790/15625) 005790-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.67%], valid : [loss = 0.451, top1 = 86.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.154, top1 = 95.02%], test  : [loss = 0.335, top1 = 89.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.57 ms.
cifar100       train : [loss = 0.961, top1 = 72.65%], valid : [loss = 1.346, top1 = 62.73%], test : [loss = 1.345, top1 = 62.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.19%], valid : [loss = 2.669, top1 = 33.35%], test : [loss = 2.691, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.19%], valid : [loss = 0.808, top1 = 71.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5791/15625) 005791-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=21.18 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.534, top1 = 89.72%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.48 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.350, top1 = 93.11%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.72 ms.
cifar100       train : [loss = 0.027, top1 = 99.76%], valid : [loss = 1.413, top1 = 69.80%], test : [loss = 1.394, top1 = 70.24%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 1.540, top1 = 58.35%], valid : [loss = 2.406, top1 = 41.37%], test : [loss = 2.399, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.66%], valid : [loss = 0.723, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5792/15625) 005792-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.611, top1 = 86.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.407, top1 = 90.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.24 ms.
cifar100       train : [loss = 0.534, top1 = 84.31%], valid : [loss = 1.455, top1 = 63.01%], test : [loss = 1.438, top1 = 63.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.29%], valid : [loss = 2.518, top1 = 36.58%], test : [loss = 2.553, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.80%], valid : [loss = 0.857, top1 = 69.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5793/15625) 005793-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.60 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.29%], valid : [loss = 0.453, top1 = 87.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.116, top1 = 96.36%], test  : [loss = 0.318, top1 = 89.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.71 ms.
cifar100       train : [loss = 0.859, top1 = 75.56%], valid : [loss = 1.316, top1 = 63.76%], test : [loss = 1.274, top1 = 64.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.71%], valid : [loss = 2.623, top1 = 34.47%], test : [loss = 2.647, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5794/15625) 005794-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.69%], valid : [loss = 0.563, top1 = 87.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.364, top1 = 91.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.83 ms.
cifar100       train : [loss = 0.441, top1 = 87.25%], valid : [loss = 1.292, top1 = 66.04%], test : [loss = 1.339, top1 = 65.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.04%], valid : [loss = 2.610, top1 = 34.77%], test : [loss = 2.635, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.25%], valid : [loss = 0.922, top1 = 67.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5795/15625) 005795-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.26%], valid : [loss = 0.622, top1 = 85.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.039, top1 = 98.87%], test  : [loss = 0.390, top1 = 89.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.60 ms.
cifar100       train : [loss = 0.667, top1 = 80.38%], valid : [loss = 1.507, top1 = 60.88%], test : [loss = 1.488, top1 = 60.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 2.353, top1 = 39.56%], valid : [loss = 2.530, top1 = 35.57%], test : [loss = 2.586, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.39%], valid : [loss = 0.911, top1 = 67.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5796/15625) 005796-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.54%], valid : [loss = 0.643, top1 = 84.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10        train : [loss = 0.087, top1 = 97.23%], test  : [loss = 0.412, top1 = 88.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.71 ms.
cifar100       train : [loss = 0.782, top1 = 77.24%], valid : [loss = 1.442, top1 = 61.76%], test : [loss = 1.396, top1 = 62.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.97%], valid : [loss = 2.740, top1 = 32.43%], test : [loss = 2.782, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.70%], valid : [loss = 0.842, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5797/15625) 005797-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.504, top1 = 89.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 93.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.65 ms.
cifar100       train : [loss = 0.143, top1 = 96.68%], valid : [loss = 1.401, top1 = 67.82%], test : [loss = 1.439, top1 = 67.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 1.712, top1 = 54.16%], valid : [loss = 2.203, top1 = 43.80%], test : [loss = 2.165, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.13%], valid : [loss = 0.778, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5798/15625) 005798-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.93%], valid : [loss = 0.680, top1 = 84.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.57 ms.
cifar10        train : [loss = 0.086, top1 = 97.31%], test  : [loss = 0.466, top1 = 87.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.21 ms.
cifar100       train : [loss = 0.790, top1 = 76.96%], valid : [loss = 1.524, top1 = 59.54%], test : [loss = 1.523, top1 = 60.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 2.767, top1 = 31.13%], valid : [loss = 2.898, top1 = 28.43%], test : [loss = 2.932, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.85%], valid : [loss = 0.848, top1 = 70.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5799/15625) 005799-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.539, top1 = 88.37%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.337, top1 = 92.13%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.84 ms.
cifar100       train : [loss = 0.292, top1 = 91.72%], valid : [loss = 1.343, top1 = 66.90%], test : [loss = 1.345, top1 = 67.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.13 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.03%], valid : [loss = 2.436, top1 = 38.97%], test : [loss = 2.442, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.70%], valid : [loss = 0.873, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5800/15625) 005800-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.06%], valid : [loss = 0.666, top1 = 77.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.525, top1 = 81.85%], test  : [loss = 0.604, top1 = 79.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.33 ms.
cifar100       train : [loss = 1.711, top1 = 53.52%], valid : [loss = 1.868, top1 = 50.55%], test : [loss = 1.878, top1 = 50.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.30%], valid : [loss = 3.317, top1 = 21.38%], test : [loss = 3.345, top1 = 21.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.58%], valid : [loss = 1.306, top1 = 53.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5801/15625) 005801-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.05 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.280, top1 = 93.75%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.63 ms.
cifar100       train : [loss = 0.062, top1 = 99.12%], valid : [loss = 1.339, top1 = 70.56%], test : [loss = 1.344, top1 = 70.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 1.539, top1 = 58.40%], valid : [loss = 2.245, top1 = 43.73%], test : [loss = 2.278, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.26%], valid : [loss = 0.487, top1 = 83.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5802/15625) 005802-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.70 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5803/15625) 005803-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.510, top1 = 88.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.328, top1 = 91.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.50 ms.
cifar100       train : [loss = 0.337, top1 = 90.84%], valid : [loss = 1.289, top1 = 66.98%], test : [loss = 1.289, top1 = 67.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.76%], valid : [loss = 2.411, top1 = 38.70%], test : [loss = 2.401, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5804/15625) 005804-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.507, top1 = 89.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.74 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.317, top1 = 92.94%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.40 ms.
cifar100       train : [loss = 0.114, top1 = 97.76%], valid : [loss = 1.342, top1 = 68.94%], test : [loss = 1.286, top1 = 70.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 52.07%], valid : [loss = 2.266, top1 = 41.40%], test : [loss = 2.250, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.86%], valid : [loss = 0.741, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5805/15625) 005805-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.507, top1 = 89.96%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.99 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.343, top1 = 92.93%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=23.63 ms.
cifar100       train : [loss = 0.067, top1 = 98.87%], valid : [loss = 1.388, top1 = 69.40%], test : [loss = 1.374, top1 = 69.82%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.35 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.04%], valid : [loss = 2.328, top1 = 40.70%], test : [loss = 2.314, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.46%], valid : [loss = 0.765, top1 = 73.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5806/15625) 005806-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.98%], valid : [loss = 0.483, top1 = 83.95%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10        train : [loss = 0.303, top1 = 89.89%], test  : [loss = 0.401, top1 = 86.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.80 ms.
cifar100       train : [loss = 1.333, top1 = 63.00%], valid : [loss = 1.530, top1 = 57.77%], test : [loss = 1.503, top1 = 58.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.51 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.61%], valid : [loss = 2.917, top1 = 29.08%], test : [loss = 2.963, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5807/15625) 005807-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10-valid  train : [loss = 0.927, top1 = 67.07%], valid : [loss = 1.108, top1 = 62.00%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10        train : [loss = 0.870, top1 = 69.32%], test  : [loss = 0.943, top1 = 66.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.66 ms.
cifar100       train : [loss = 2.304, top1 = 40.34%], valid : [loss = 2.502, top1 = 36.98%], test : [loss = 2.501, top1 = 37.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 3.815, top1 = 13.05%], valid : [loss = 3.851, top1 = 13.50%], test : [loss = 3.835, top1 = 12.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.503, top1 = 44.78%], valid : [loss = 1.526, top1 = 44.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5808/15625) 005808-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.27%], valid : [loss = 0.545, top1 = 86.89%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.04 ms.
cifar10        train : [loss = 0.058, top1 = 98.15%], test  : [loss = 0.355, top1 = 90.45%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=12.71 ms.
cifar100       train : [loss = 0.683, top1 = 79.97%], valid : [loss = 1.346, top1 = 63.88%], test : [loss = 1.332, top1 = 64.50%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 38.95%], valid : [loss = 2.507, top1 = 37.33%], test : [loss = 2.536, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.45%], valid : [loss = 0.779, top1 = 72.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5809/15625) 005809-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.42%], valid : [loss = 0.648, top1 = 83.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.33 ms.
cifar10        train : [loss = 0.075, top1 = 97.63%], test  : [loss = 0.405, top1 = 88.42%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.27 ms.
cifar100       train : [loss = 0.764, top1 = 77.49%], valid : [loss = 1.400, top1 = 61.74%], test : [loss = 1.406, top1 = 62.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.583, top1 = 34.95%], valid : [loss = 2.670, top1 = 33.67%], test : [loss = 2.734, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.96%], valid : [loss = 0.889, top1 = 68.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5810/15625) 005810-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.564, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.387, top1 = 90.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.379, top1 = 89.18%], valid : [loss = 1.416, top1 = 65.38%], test : [loss = 1.433, top1 = 64.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.99%], valid : [loss = 2.502, top1 = 37.07%], test : [loss = 2.547, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.57%], valid : [loss = 0.842, top1 = 70.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5811/15625) 005811-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.493, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10        train : [loss = 0.017, top1 = 99.62%], test  : [loss = 0.318, top1 = 92.18%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.00 ms.
cifar100       train : [loss = 0.277, top1 = 92.72%], valid : [loss = 1.197, top1 = 69.56%], test : [loss = 1.203, top1 = 69.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.79%], valid : [loss = 2.190, top1 = 43.30%], test : [loss = 2.241, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.14%], valid : [loss = 0.728, top1 = 74.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5812/15625) 005812-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.11%], valid : [loss = 0.531, top1 = 85.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.115, top1 = 96.34%], test  : [loss = 0.356, top1 = 89.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.793, top1 = 76.96%], valid : [loss = 1.372, top1 = 63.34%], test : [loss = 1.345, top1 = 63.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.506, top1 = 36.42%], valid : [loss = 2.571, top1 = 35.13%], test : [loss = 2.597, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.49%], valid : [loss = 0.930, top1 = 67.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5813/15625) 005813-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.85%], valid : [loss = 0.602, top1 = 86.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.029, top1 = 99.31%], test  : [loss = 0.431, top1 = 89.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=21.56 ms.
cifar100       train : [loss = 0.416, top1 = 88.65%], valid : [loss = 1.519, top1 = 62.58%], test : [loss = 1.485, top1 = 63.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.91 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.80%], valid : [loss = 2.619, top1 = 35.13%], test : [loss = 2.643, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.07%], valid : [loss = 0.782, top1 = 72.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5814/15625) 005814-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.491, top1 = 88.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 0.322, top1 = 91.33%], valid : [loss = 1.238, top1 = 67.93%], test : [loss = 1.247, top1 = 67.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.72%], valid : [loss = 2.317, top1 = 40.32%], test : [loss = 2.340, top1 = 40.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5815/15625) 005815-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=22.13 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.496, top1 = 88.72%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.17 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.305, top1 = 92.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.85 ms.
cifar100       train : [loss = 0.283, top1 = 92.70%], valid : [loss = 1.194, top1 = 69.00%], test : [loss = 1.227, top1 = 68.10%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.54 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.77%], valid : [loss = 2.222, top1 = 42.03%], test : [loss = 2.225, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.18%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5816/15625) 005816-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.101, top1 = 96.80%], valid : [loss = 0.664, top1 = 83.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.154, top1 = 94.77%], test  : [loss = 0.487, top1 = 86.11%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.89 ms.
cifar100       train : [loss = 0.965, top1 = 71.79%], valid : [loss = 1.621, top1 = 57.34%], test : [loss = 1.614, top1 = 57.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 3.052, top1 = 25.41%], valid : [loss = 3.132, top1 = 24.83%], test : [loss = 3.166, top1 = 24.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5817/15625) 005817-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.494, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.53%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.16 ms.
cifar100       train : [loss = 0.230, top1 = 94.46%], valid : [loss = 1.239, top1 = 69.14%], test : [loss = 1.254, top1 = 68.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.51 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.89%], valid : [loss = 2.283, top1 = 41.40%], test : [loss = 2.277, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 82.12%], valid : [loss = 0.607, top1 = 79.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5818/15625) 005818-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.17%], valid : [loss = 0.838, top1 = 75.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10        train : [loss = 0.309, top1 = 89.27%], test  : [loss = 0.611, top1 = 80.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.59 ms.
cifar100       train : [loss = 1.393, top1 = 61.16%], valid : [loss = 2.002, top1 = 48.72%], test : [loss = 1.979, top1 = 48.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.85 ms.
ImageNet16-120 train : [loss = 3.477, top1 = 17.80%], valid : [loss = 3.507, top1 = 18.20%], test : [loss = 3.515, top1 = 17.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5819/15625) 005819-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.534, top1 = 88.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.338, top1 = 91.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.334, top1 = 90.87%], valid : [loss = 1.265, top1 = 67.00%], test : [loss = 1.288, top1 = 67.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.53%], valid : [loss = 2.404, top1 = 38.77%], test : [loss = 2.450, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5820/15625) 005820-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.38%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.28 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.372, top1 = 92.44%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.68 ms.
cifar100       train : [loss = 0.082, top1 = 98.70%], valid : [loss = 1.455, top1 = 67.60%], test : [loss = 1.479, top1 = 67.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.01 ms.
ImageNet16-120 train : [loss = 1.777, top1 = 52.71%], valid : [loss = 2.401, top1 = 40.33%], test : [loss = 2.359, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.17%], valid : [loss = 0.722, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5821/15625) 005821-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.547, top1 = 89.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=22.01 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.391, top1 = 92.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.48 ms.
cifar100       train : [loss = 0.041, top1 = 99.55%], valid : [loss = 1.413, top1 = 69.88%], test : [loss = 1.433, top1 = 69.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 1.634, top1 = 56.12%], valid : [loss = 2.393, top1 = 41.40%], test : [loss = 2.459, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.67%], valid : [loss = 0.646, top1 = 78.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5822/15625) 005822-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.466, top1 = 89.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.361, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.77 ms.
cifar100       train : [loss = 0.133, top1 = 97.15%], valid : [loss = 1.409, top1 = 68.08%], test : [loss = 1.384, top1 = 68.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 52.08%], valid : [loss = 2.353, top1 = 40.97%], test : [loss = 2.367, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.00%], valid : [loss = 0.623, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5823/15625) 005823-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.435, top1 = 90.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.286, top1 = 93.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.066, top1 = 99.04%], valid : [loss = 1.303, top1 = 70.41%], test : [loss = 1.304, top1 = 70.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 1.522, top1 = 58.76%], valid : [loss = 2.207, top1 = 44.30%], test : [loss = 2.234, top1 = 44.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.26%], valid : [loss = 0.499, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5824/15625) 005824-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.535, top1 = 88.97%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=19.40 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.354, top1 = 92.30%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=18.00 ms.
cifar100       train : [loss = 0.133, top1 = 97.42%], valid : [loss = 1.407, top1 = 68.02%], test : [loss = 1.388, top1 = 68.57%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=20.72 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.68%], valid : [loss = 2.360, top1 = 41.00%], test : [loss = 2.388, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.90%], valid : [loss = 0.672, top1 = 77.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5825/15625) 005825-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.564, top1 = 88.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.378, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 0.173, top1 = 96.23%], valid : [loss = 1.415, top1 = 66.87%], test : [loss = 1.425, top1 = 67.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 47.93%], valid : [loss = 2.470, top1 = 38.32%], test : [loss = 2.483, top1 = 38.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5826/15625) 005826-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.492, top1 = 89.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.292, top1 = 93.33%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.83 ms.
cifar100       train : [loss = 0.128, top1 = 97.56%], valid : [loss = 1.227, top1 = 69.58%], test : [loss = 1.248, top1 = 69.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.95%], valid : [loss = 2.134, top1 = 45.17%], test : [loss = 2.184, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.38%], valid : [loss = 0.576, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5827/15625) 005827-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.86%], valid : [loss = 0.459, top1 = 86.52%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.17 ms.
cifar10        train : [loss = 0.116, top1 = 96.40%], test  : [loss = 0.345, top1 = 88.98%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=20.40 ms.
cifar100       train : [loss = 0.720, top1 = 79.79%], valid : [loss = 1.258, top1 = 65.16%], test : [loss = 1.252, top1 = 64.94%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.80%], valid : [loss = 2.570, top1 = 36.30%], test : [loss = 2.610, top1 = 34.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.52%], valid : [loss = 0.824, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5828/15625) 005828-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.451, top1 = 89.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.314, top1 = 92.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.05 ms.
cifar100       train : [loss = 0.317, top1 = 91.41%], valid : [loss = 1.288, top1 = 67.08%], test : [loss = 1.306, top1 = 67.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.36%], valid : [loss = 2.353, top1 = 40.70%], test : [loss = 2.388, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.20%], valid : [loss = 0.532, top1 = 82.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5829/15625) 005829-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.143, top1 = 95.24%], valid : [loss = 0.743, top1 = 80.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.173, top1 = 94.00%], test  : [loss = 0.524, top1 = 84.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.882, top1 = 74.39%], valid : [loss = 1.671, top1 = 57.10%], test : [loss = 1.670, top1 = 57.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 3.349, top1 = 19.57%], valid : [loss = 3.361, top1 = 20.07%], test : [loss = 3.368, top1 = 19.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.166, top1 = 57.54%], valid : [loss = 1.219, top1 = 56.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5830/15625) 005830-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.72%], valid : [loss = 0.835, top1 = 72.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.86 ms.
cifar10        train : [loss = 0.561, top1 = 80.45%], test  : [loss = 0.707, top1 = 76.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.04 ms.
cifar100       train : [loss = 1.781, top1 = 51.92%], valid : [loss = 2.056, top1 = 47.02%], test : [loss = 2.061, top1 = 46.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.75%], valid : [loss = 3.643, top1 = 17.27%], test : [loss = 3.649, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5831/15625) 005831-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.520, top1 = 89.40%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.325, top1 = 92.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.07 ms.
cifar100       train : [loss = 0.124, top1 = 97.38%], valid : [loss = 1.415, top1 = 68.50%], test : [loss = 1.445, top1 = 67.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.34%], valid : [loss = 2.246, top1 = 42.37%], test : [loss = 2.238, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.872, top1 = 68.90%], valid : [loss = 0.919, top1 = 67.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5832/15625) 005832-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.485, top1 = 88.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.297, top1 = 92.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.316, top1 = 91.50%], valid : [loss = 1.240, top1 = 67.54%], test : [loss = 1.258, top1 = 68.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.94%], valid : [loss = 2.298, top1 = 41.27%], test : [loss = 2.327, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.88%], valid : [loss = 0.617, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5833/15625) 005833-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.11%], valid : [loss = 0.523, top1 = 86.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10        train : [loss = 0.100, top1 = 96.86%], test  : [loss = 0.361, top1 = 89.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.38 ms.
cifar100       train : [loss = 0.735, top1 = 78.80%], valid : [loss = 1.319, top1 = 64.52%], test : [loss = 1.310, top1 = 64.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 37.02%], valid : [loss = 2.546, top1 = 35.30%], test : [loss = 2.587, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.25%], valid : [loss = 0.913, top1 = 67.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5834/15625) 005834-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.538, top1 = 88.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.07 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.339, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 0.243, top1 = 93.69%], valid : [loss = 1.262, top1 = 68.36%], test : [loss = 1.288, top1 = 67.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.31%], valid : [loss = 2.275, top1 = 42.23%], test : [loss = 2.300, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.58%], valid : [loss = 0.699, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5835/15625) 005835-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 89.05 M, Params=0.634 MB, latency=22.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.491, top1 = 89.54%]
cifar10        FLOP= 89.05 M, Params=0.634 MB, latency=21.76 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.309, top1 = 92.83%]
cifar100       FLOP= 89.05 M, Params=0.640 MB, latency=20.12 ms.
cifar100       train : [loss = 0.140, top1 = 97.18%], valid : [loss = 1.269, top1 = 69.27%], test : [loss = 1.266, top1 = 69.50%]
ImageNet16-120 FLOP= 22.27 M, Params=0.641 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 1.752, top1 = 53.23%], valid : [loss = 2.181, top1 = 44.13%], test : [loss = 2.199, top1 = 43.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.18%], valid : [loss = 0.620, top1 = 79.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5836/15625) 005836-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.511, top1 = 89.59%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=18.80 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.05%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=21.77 ms.
cifar100       train : [loss = 0.074, top1 = 98.87%], valid : [loss = 1.363, top1 = 69.58%], test : [loss = 1.386, top1 = 69.02%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=21.96 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.76%], valid : [loss = 2.361, top1 = 39.77%], test : [loss = 2.397, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.98%], valid : [loss = 0.753, top1 = 73.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5837/15625) 005837-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.580, top1 = 87.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.57 ms.
cifar10        train : [loss = 0.039, top1 = 98.87%], test  : [loss = 0.388, top1 = 90.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.546, top1 = 83.94%], valid : [loss = 1.380, top1 = 63.78%], test : [loss = 1.383, top1 = 64.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.41%], valid : [loss = 2.579, top1 = 35.07%], test : [loss = 2.655, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.38%], valid : [loss = 0.711, top1 = 75.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5838/15625) 005838-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.62%], valid : [loss = 0.587, top1 = 86.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.78 ms.
cifar10        train : [loss = 0.039, top1 = 98.88%], test  : [loss = 0.397, top1 = 89.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.37 ms.
cifar100       train : [loss = 0.560, top1 = 83.49%], valid : [loss = 1.401, top1 = 63.76%], test : [loss = 1.418, top1 = 64.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.87%], valid : [loss = 2.635, top1 = 33.80%], test : [loss = 2.655, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.27%], valid : [loss = 0.707, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5839/15625) 005839-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.504, top1 = 89.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.361, top1 = 92.57%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.08 ms.
cifar100       train : [loss = 0.108, top1 = 98.00%], valid : [loss = 1.458, top1 = 67.34%], test : [loss = 1.437, top1 = 67.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.17%], valid : [loss = 2.381, top1 = 40.77%], test : [loss = 2.371, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.95%], valid : [loss = 0.673, top1 = 77.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5840/15625) 005840-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.513, top1 = 89.83%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.29%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.41 ms.
cifar100       train : [loss = 0.070, top1 = 98.98%], valid : [loss = 1.375, top1 = 69.34%], test : [loss = 1.355, top1 = 69.66%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.14 ms.
ImageNet16-120 train : [loss = 2.024, top1 = 46.93%], valid : [loss = 2.376, top1 = 38.93%], test : [loss = 2.370, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.39%], valid : [loss = 0.726, top1 = 74.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5841/15625) 005841-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.537, top1 = 88.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.341, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.297, top1 = 91.87%], valid : [loss = 1.301, top1 = 67.35%], test : [loss = 1.297, top1 = 67.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.64%], valid : [loss = 2.422, top1 = 38.57%], test : [loss = 2.449, top1 = 38.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5842/15625) 005842-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.274, top1 = 91.02%], valid : [loss = 0.467, top1 = 84.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10        train : [loss = 0.300, top1 = 89.80%], test  : [loss = 0.398, top1 = 86.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.92 ms.
cifar100       train : [loss = 1.325, top1 = 63.12%], valid : [loss = 1.548, top1 = 57.44%], test : [loss = 1.511, top1 = 58.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.65%], valid : [loss = 2.908, top1 = 29.90%], test : [loss = 2.962, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.81%], valid : [loss = 0.768, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5843/15625) 005843-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5844/15625) 005844-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.52 ms.
cifar10-valid  train : [loss = 0.211, top1 = 92.93%], valid : [loss = 0.543, top1 = 83.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.208, top1 = 92.92%], test  : [loss = 0.404, top1 = 87.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.32 ms.
cifar100       train : [loss = 1.299, top1 = 63.28%], valid : [loss = 1.578, top1 = 57.22%], test : [loss = 1.593, top1 = 56.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.72 ms.
ImageNet16-120 train : [loss = 2.741, top1 = 31.62%], valid : [loss = 2.752, top1 = 32.37%], test : [loss = 2.803, top1 = 31.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.38%], valid : [loss = 1.001, top1 = 64.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5845/15625) 005845-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.579, top1 = 87.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.432, top1 = 90.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 0.413, top1 = 88.16%], valid : [loss = 1.409, top1 = 65.56%], test : [loss = 1.425, top1 = 64.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.48%], valid : [loss = 2.493, top1 = 36.90%], test : [loss = 2.552, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 74.00%], valid : [loss = 0.812, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5846/15625) 005846-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.166, top1 = 94.41%], valid : [loss = 0.728, top1 = 79.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.168, top1 = 94.24%], test  : [loss = 0.512, top1 = 84.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.29 ms.
cifar100       train : [loss = 0.897, top1 = 73.77%], valid : [loss = 1.647, top1 = 57.22%], test : [loss = 1.677, top1 = 57.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 3.564, top1 = 15.80%], valid : [loss = 3.568, top1 = 16.40%], test : [loss = 3.566, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.305, top1 = 52.14%], valid : [loss = 1.327, top1 = 51.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5847/15625) 005847-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.60%], valid : [loss = 0.876, top1 = 79.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.54 ms.
cifar10        train : [loss = 0.133, top1 = 95.57%], test  : [loss = 0.540, top1 = 84.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 0.836, top1 = 75.65%], valid : [loss = 1.702, top1 = 56.82%], test : [loss = 1.701, top1 = 57.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 3.044, top1 = 26.42%], valid : [loss = 3.181, top1 = 24.37%], test : [loss = 3.224, top1 = 23.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5848/15625) 005848-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.536, top1 = 89.48%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.313, top1 = 93.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.74 ms.
cifar100       train : [loss = 0.071, top1 = 98.93%], valid : [loss = 1.337, top1 = 69.50%], test : [loss = 1.350, top1 = 70.04%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 1.978, top1 = 48.05%], valid : [loss = 2.341, top1 = 40.07%], test : [loss = 2.348, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.84%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5849/15625) 005849-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.11%], valid : [loss = 0.460, top1 = 85.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10        train : [loss = 0.150, top1 = 95.19%], test  : [loss = 0.353, top1 = 88.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.27 ms.
cifar100       train : [loss = 1.026, top1 = 70.88%], valid : [loss = 1.397, top1 = 60.72%], test : [loss = 1.384, top1 = 61.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.84%], valid : [loss = 2.700, top1 = 32.07%], test : [loss = 2.710, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5850/15625) 005850-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.568, top1 = 87.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10        train : [loss = 0.018, top1 = 99.48%], test  : [loss = 0.362, top1 = 91.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.32 ms.
cifar100       train : [loss = 0.276, top1 = 92.41%], valid : [loss = 1.332, top1 = 67.53%], test : [loss = 1.353, top1 = 67.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 36.67%], valid : [loss = 2.595, top1 = 33.69%], test : [loss = 2.629, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.90%], valid : [loss = 0.993, top1 = 64.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5851/15625) 005851-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.524, top1 = 88.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.338, top1 = 91.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.347, top1 = 90.56%], valid : [loss = 1.272, top1 = 67.47%], test : [loss = 1.286, top1 = 67.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.25%], valid : [loss = 2.425, top1 = 38.56%], test : [loss = 2.436, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5852/15625) 005852-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.518, top1 = 88.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.334, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.67 ms.
cifar100       train : [loss = 0.170, top1 = 96.22%], valid : [loss = 1.307, top1 = 68.40%], test : [loss = 1.311, top1 = 68.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.67%], valid : [loss = 2.278, top1 = 41.60%], test : [loss = 2.285, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5853/15625) 005853-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.612, top1 = 86.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.400, top1 = 90.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 0.498, top1 = 85.45%], valid : [loss = 1.395, top1 = 64.91%], test : [loss = 1.411, top1 = 64.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.08%], valid : [loss = 2.567, top1 = 35.80%], test : [loss = 2.583, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.66%], valid : [loss = 0.833, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5854/15625) 005854-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.460, top1 = 89.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.310, top1 = 92.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.116, top1 = 97.65%], valid : [loss = 1.330, top1 = 69.59%], test : [loss = 1.320, top1 = 69.53%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.47%], valid : [loss = 2.265, top1 = 42.51%], test : [loss = 2.272, top1 = 43.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.67%], valid : [loss = 0.560, top1 = 81.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5855/15625) 005855-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.30%], valid : [loss = 0.526, top1 = 86.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10        train : [loss = 0.078, top1 = 97.65%], test  : [loss = 0.347, top1 = 90.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.661, top1 = 80.96%], valid : [loss = 1.305, top1 = 64.96%], test : [loss = 1.307, top1 = 64.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.09%], valid : [loss = 2.476, top1 = 36.82%], test : [loss = 2.484, top1 = 37.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.68%], valid : [loss = 0.881, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5856/15625) 005856-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.294, top1 = 93.48%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.35 ms.
cifar100       train : [loss = 0.065, top1 = 99.11%], valid : [loss = 1.361, top1 = 70.05%], test : [loss = 1.341, top1 = 70.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.547, top1 = 58.18%], valid : [loss = 2.237, top1 = 43.97%], test : [loss = 2.267, top1 = 44.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5857/15625) 005857-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.498, top1 = 88.91%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.89 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.323, top1 = 92.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.90 ms.
cifar100       train : [loss = 0.246, top1 = 93.87%], valid : [loss = 1.290, top1 = 67.79%], test : [loss = 1.294, top1 = 68.17%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 48.05%], valid : [loss = 2.337, top1 = 40.88%], test : [loss = 2.319, top1 = 41.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.41%], valid : [loss = 0.628, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5858/15625) 005858-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.545, top1 = 88.50%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.84 ms.
cifar10        train : [loss = 0.018, top1 = 99.51%], test  : [loss = 0.343, top1 = 91.75%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.03 ms.
cifar100       train : [loss = 0.277, top1 = 92.66%], valid : [loss = 1.275, top1 = 67.95%], test : [loss = 1.265, top1 = 67.77%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.71 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.14%], valid : [loss = 2.293, top1 = 41.11%], test : [loss = 2.348, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 74.58%], valid : [loss = 0.781, top1 = 73.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5859/15625) 005859-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.90%], valid : [loss = 0.981, top1 = 66.31%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10        train : [loss = 0.771, top1 = 72.94%], test  : [loss = 0.862, top1 = 70.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.14 ms.
cifar100       train : [loss = 2.127, top1 = 44.06%], valid : [loss = 2.290, top1 = 40.90%], test : [loss = 2.319, top1 = 40.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.90 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.31%], valid : [loss = 3.771, top1 = 14.70%], test : [loss = 3.775, top1 = 13.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5860/15625) 005860-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.01%], valid : [loss = 0.850, top1 = 71.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10        train : [loss = 0.560, top1 = 80.50%], test  : [loss = 0.712, top1 = 75.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.54 ms.
cifar100       train : [loss = 1.791, top1 = 51.79%], valid : [loss = 2.061, top1 = 46.91%], test : [loss = 2.067, top1 = 46.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 16.67%], valid : [loss = 3.639, top1 = 16.22%], test : [loss = 3.670, top1 = 15.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.195, top1 = 57.00%], valid : [loss = 1.245, top1 = 55.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5861/15625) 005861-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.538, top1 = 88.74%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.72 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.331, top1 = 92.22%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.54 ms.
cifar100       train : [loss = 0.188, top1 = 95.60%], valid : [loss = 1.280, top1 = 68.78%], test : [loss = 1.295, top1 = 68.61%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.26 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.38%], valid : [loss = 2.322, top1 = 41.09%], test : [loss = 2.343, top1 = 40.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.07%], valid : [loss = 0.772, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5862/15625) 005862-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.69%], valid : [loss = 0.670, top1 = 85.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.036, top1 = 98.91%], test  : [loss = 0.448, top1 = 89.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 0.443, top1 = 87.43%], valid : [loss = 1.503, top1 = 63.53%], test : [loss = 1.482, top1 = 63.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.95%], valid : [loss = 2.646, top1 = 34.18%], test : [loss = 2.667, top1 = 34.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 70.99%], valid : [loss = 0.881, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5863/15625) 005863-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.564, top1 = 88.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.382, top1 = 91.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.23 ms.
cifar100       train : [loss = 0.189, top1 = 95.55%], valid : [loss = 1.415, top1 = 67.17%], test : [loss = 1.402, top1 = 67.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.90%], valid : [loss = 2.451, top1 = 38.44%], test : [loss = 2.477, top1 = 38.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.89%], valid : [loss = 0.715, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5864/15625) 005864-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.16%], valid : [loss = 0.588, top1 = 85.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.105, top1 = 96.50%], test  : [loss = 0.393, top1 = 88.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.48 ms.
cifar100       train : [loss = 0.821, top1 = 75.81%], valid : [loss = 1.407, top1 = 62.24%], test : [loss = 1.410, top1 = 62.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 32.93%], valid : [loss = 2.769, top1 = 31.57%], test : [loss = 2.809, top1 = 31.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.06%], valid : [loss = 0.700, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5865/15625) 005865-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.37%], valid : [loss = 1.123, top1 = 63.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.780, top1 = 72.51%], test  : [loss = 0.922, top1 = 68.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 2.122, top1 = 44.21%], valid : [loss = 2.386, top1 = 39.91%], test : [loss = 2.392, top1 = 39.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 3.762, top1 = 13.93%], valid : [loss = 3.820, top1 = 13.94%], test : [loss = 3.840, top1 = 13.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 50.71%], valid : [loss = 1.405, top1 = 48.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5866/15625) 005866-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.37%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.320, top1 = 92.03%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.99 ms.
cifar100       train : [loss = 0.319, top1 = 91.51%], valid : [loss = 1.261, top1 = 67.66%], test : [loss = 1.260, top1 = 67.94%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.66%], valid : [loss = 2.311, top1 = 41.06%], test : [loss = 2.341, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.37%], valid : [loss = 0.655, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5867/15625) 005867-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.24 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.80%], valid : [loss = 0.496, top1 = 84.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.47 ms.
cifar10        train : [loss = 0.170, top1 = 94.31%], test  : [loss = 0.382, top1 = 88.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.50 ms.
cifar100       train : [loss = 1.099, top1 = 68.33%], valid : [loss = 1.457, top1 = 59.77%], test : [loss = 1.466, top1 = 59.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.594, top1 = 34.71%], valid : [loss = 2.649, top1 = 33.90%], test : [loss = 2.682, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.66%], valid : [loss = 0.930, top1 = 67.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5868/15625) 005868-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.60%], valid : [loss = 0.679, top1 = 83.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10        train : [loss = 0.075, top1 = 97.60%], test  : [loss = 0.425, top1 = 88.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.87 ms.
cifar100       train : [loss = 0.780, top1 = 77.20%], valid : [loss = 1.450, top1 = 61.39%], test : [loss = 1.459, top1 = 61.88%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.574, top1 = 35.09%], valid : [loss = 2.716, top1 = 32.54%], test : [loss = 2.726, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.10%], valid : [loss = 0.865, top1 = 69.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5869/15625) 005869-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.86%], valid : [loss = 0.863, top1 = 71.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 0.557, top1 = 80.47%], test  : [loss = 0.712, top1 = 75.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.06 ms.
cifar100       train : [loss = 1.783, top1 = 51.86%], valid : [loss = 2.056, top1 = 46.87%], test : [loss = 2.065, top1 = 46.83%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.57 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.77%], valid : [loss = 3.638, top1 = 16.73%], test : [loss = 3.665, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5870/15625) 005870-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.321, top1 = 88.86%], valid : [loss = 0.585, top1 = 81.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10        train : [loss = 0.299, top1 = 89.72%], test  : [loss = 0.447, top1 = 85.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 1.443, top1 = 59.50%], valid : [loss = 1.698, top1 = 54.03%], test : [loss = 1.698, top1 = 53.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.46 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.25%], valid : [loss = 3.030, top1 = 26.22%], test : [loss = 3.075, top1 = 25.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.997, top1 = 64.12%], valid : [loss = 1.047, top1 = 62.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5871/15625) 005871-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.590, top1 = 87.14%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.381, top1 = 91.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.41 ms.
cifar100       train : [loss = 0.356, top1 = 90.06%], valid : [loss = 1.423, top1 = 65.26%], test : [loss = 1.413, top1 = 65.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.17%], valid : [loss = 2.472, top1 = 37.68%], test : [loss = 2.480, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.11%], valid : [loss = 0.867, top1 = 69.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5872/15625) 005872-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.534, top1 = 89.16%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.40 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.329, top1 = 92.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.08 ms.
cifar100       train : [loss = 0.115, top1 = 97.70%], valid : [loss = 1.350, top1 = 68.90%], test : [loss = 1.346, top1 = 69.15%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.35%], valid : [loss = 2.280, top1 = 42.16%], test : [loss = 2.292, top1 = 41.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.75%], valid : [loss = 0.797, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5873/15625) 005873-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.532, top1 = 88.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.342, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.301, top1 = 91.78%], valid : [loss = 1.295, top1 = 67.27%], test : [loss = 1.308, top1 = 67.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.65%], valid : [loss = 2.429, top1 = 38.99%], test : [loss = 2.428, top1 = 38.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5874/15625) 005874-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.55 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.01%], valid : [loss = 0.468, top1 = 85.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10        train : [loss = 0.157, top1 = 94.85%], test  : [loss = 0.356, top1 = 88.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 0.981, top1 = 71.94%], valid : [loss = 1.341, top1 = 62.72%], test : [loss = 1.344, top1 = 62.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.67%], valid : [loss = 2.692, top1 = 32.89%], test : [loss = 2.723, top1 = 32.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5875/15625) 005875-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.37%], valid : [loss = 0.854, top1 = 79.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.131, top1 = 95.61%], test  : [loss = 0.558, top1 = 84.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 0.890, top1 = 74.28%], valid : [loss = 1.735, top1 = 55.90%], test : [loss = 1.709, top1 = 56.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 3.044, top1 = 26.27%], valid : [loss = 3.173, top1 = 23.86%], test : [loss = 3.217, top1 = 23.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.047, top1 = 62.15%], valid : [loss = 1.115, top1 = 60.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5876/15625) 005876-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.435, top1 = 90.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.296, top1 = 92.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.22 ms.
cifar100       train : [loss = 0.118, top1 = 97.73%], valid : [loss = 1.350, top1 = 69.09%], test : [loss = 1.315, top1 = 69.75%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.46%], valid : [loss = 2.244, top1 = 43.48%], test : [loss = 2.272, top1 = 43.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.432, top1 = 84.89%], valid : [loss = 0.547, top1 = 81.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5877/15625) 005877-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.60%], valid : [loss = 0.589, top1 = 80.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10        train : [loss = 0.324, top1 = 88.87%], test  : [loss = 0.464, top1 = 84.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 1.550, top1 = 56.76%], valid : [loss = 1.783, top1 = 51.99%], test : [loss = 1.773, top1 = 52.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 3.123, top1 = 24.43%], valid : [loss = 3.120, top1 = 24.97%], test : [loss = 3.175, top1 = 23.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.040, top1 = 62.44%], valid : [loss = 1.083, top1 = 61.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5878/15625) 005878-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.422, top1 = 90.51%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.19 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.280, top1 = 93.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.50 ms.
cifar100       train : [loss = 0.152, top1 = 96.64%], valid : [loss = 1.296, top1 = 69.81%], test : [loss = 1.272, top1 = 69.96%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 1.751, top1 = 53.20%], valid : [loss = 2.201, top1 = 43.73%], test : [loss = 2.250, top1 = 43.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.21%], valid : [loss = 0.517, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5879/15625) 005879-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.579, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.017, top1 = 99.52%], test  : [loss = 0.376, top1 = 91.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.25 ms.
cifar100       train : [loss = 0.271, top1 = 92.65%], valid : [loss = 1.341, top1 = 67.27%], test : [loss = 1.356, top1 = 66.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 41.89%], valid : [loss = 2.483, top1 = 37.08%], test : [loss = 2.475, top1 = 37.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 67.63%], valid : [loss = 0.923, top1 = 66.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5880/15625) 005880-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.47 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.546, top1 = 88.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10        train : [loss = 0.027, top1 = 99.23%], test  : [loss = 0.349, top1 = 91.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.17 ms.
cifar100       train : [loss = 0.455, top1 = 86.77%], valid : [loss = 1.250, top1 = 67.34%], test : [loss = 1.279, top1 = 66.65%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.31%], valid : [loss = 2.370, top1 = 40.07%], test : [loss = 2.391, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.35%], valid : [loss = 0.803, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5881/15625) 005881-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.25%], valid : [loss = 0.609, top1 = 85.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.70 ms.
cifar10        train : [loss = 0.072, top1 = 97.82%], test  : [loss = 0.396, top1 = 89.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.96 ms.
cifar100       train : [loss = 0.713, top1 = 79.25%], valid : [loss = 1.395, top1 = 63.03%], test : [loss = 1.380, top1 = 63.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.75%], valid : [loss = 2.662, top1 = 33.33%], test : [loss = 2.695, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.28%], valid : [loss = 0.765, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5882/15625) 005882-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.25%], valid : [loss = 0.568, top1 = 86.95%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.68 ms.
cifar10        train : [loss = 0.059, top1 = 98.15%], test  : [loss = 0.380, top1 = 90.25%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.38 ms.
cifar100       train : [loss = 0.647, top1 = 80.89%], valid : [loss = 1.320, top1 = 65.39%], test : [loss = 1.312, top1 = 64.58%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.01%], valid : [loss = 2.476, top1 = 37.38%], test : [loss = 2.519, top1 = 36.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.13%], valid : [loss = 0.790, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5883/15625) 005883-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.427, top1 = 90.96%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.81 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.293, top1 = 93.82%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.69 ms.
cifar100       train : [loss = 0.067, top1 = 99.02%], valid : [loss = 1.348, top1 = 69.83%], test : [loss = 1.311, top1 = 70.43%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 1.531, top1 = 58.63%], valid : [loss = 2.235, top1 = 44.20%], test : [loss = 2.256, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.351, top1 = 88.05%], valid : [loss = 0.494, top1 = 83.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5884/15625) 005884-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.419, top1 = 90.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.277, top1 = 93.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.34 ms.
cifar100       train : [loss = 0.147, top1 = 96.79%], valid : [loss = 1.294, top1 = 69.90%], test : [loss = 1.271, top1 = 70.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.48%], valid : [loss = 2.223, top1 = 43.17%], test : [loss = 2.253, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.53%], valid : [loss = 0.515, top1 = 82.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5885/15625) 005885-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.150, top1 = 95.18%], valid : [loss = 0.555, top1 = 84.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10        train : [loss = 0.206, top1 = 93.02%], test  : [loss = 0.407, top1 = 87.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.99 ms.
cifar100       train : [loss = 1.049, top1 = 69.81%], valid : [loss = 1.489, top1 = 59.64%], test : [loss = 1.476, top1 = 59.43%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.768, top1 = 31.05%], valid : [loss = 2.830, top1 = 30.31%], test : [loss = 2.855, top1 = 29.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.19%], valid : [loss = 0.971, top1 = 65.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5886/15625) 005886-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.504, top1 = 89.56%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.312, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.10 ms.
cifar100       train : [loss = 0.133, top1 = 97.37%], valid : [loss = 1.287, top1 = 69.17%], test : [loss = 1.281, top1 = 69.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 52.98%], valid : [loss = 2.186, top1 = 43.54%], test : [loss = 2.196, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.96%], valid : [loss = 0.583, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5887/15625) 005887-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.26 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.532, top1 = 89.57%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.20 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.35%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.20 ms.
cifar100       train : [loss = 0.038, top1 = 99.48%], valid : [loss = 1.371, top1 = 70.48%], test : [loss = 1.379, top1 = 70.75%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.76 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.40%], valid : [loss = 2.312, top1 = 40.90%], test : [loss = 2.321, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.52%], valid : [loss = 0.712, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5888/15625) 005888-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.32%], valid : [loss = 0.464, top1 = 85.91%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.30 ms.
cifar10        train : [loss = 0.158, top1 = 94.83%], test  : [loss = 0.345, top1 = 88.96%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.57 ms.
cifar100       train : [loss = 0.979, top1 = 72.03%], valid : [loss = 1.338, top1 = 62.53%], test : [loss = 1.328, top1 = 63.03%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.36 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.04%], valid : [loss = 2.678, top1 = 32.96%], test : [loss = 2.703, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.28%], valid : [loss = 0.783, top1 = 72.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5889/15625) 005889-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.519, top1 = 88.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.337, top1 = 92.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.01 ms.
cifar100       train : [loss = 0.337, top1 = 90.77%], valid : [loss = 1.290, top1 = 66.93%], test : [loss = 1.293, top1 = 66.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.66%], valid : [loss = 2.425, top1 = 38.59%], test : [loss = 2.414, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.94%], valid : [loss = 0.641, top1 = 77.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5890/15625) 005890-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.52 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.23%], valid : [loss = 0.611, top1 = 85.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10        train : [loss = 0.069, top1 = 97.90%], test  : [loss = 0.409, top1 = 88.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.16 ms.
cifar100       train : [loss = 0.720, top1 = 78.93%], valid : [loss = 1.386, top1 = 63.25%], test : [loss = 1.367, top1 = 64.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.11%], valid : [loss = 2.657, top1 = 33.72%], test : [loss = 2.689, top1 = 33.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5891/15625) 005891-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.619, top1 = 87.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.05 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.418, top1 = 90.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.70 ms.
cifar100       train : [loss = 0.212, top1 = 94.94%], valid : [loss = 1.503, top1 = 65.71%], test : [loss = 1.462, top1 = 65.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.093, top1 = 45.55%], valid : [loss = 2.520, top1 = 37.04%], test : [loss = 2.529, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.26%], valid : [loss = 0.765, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5892/15625) 005892-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.764, top1 = 84.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10        train : [loss = 0.025, top1 = 99.39%], test  : [loss = 0.526, top1 = 88.19%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.84 ms.
cifar100       train : [loss = 0.313, top1 = 91.91%], valid : [loss = 1.576, top1 = 62.91%], test : [loss = 1.582, top1 = 62.69%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 2.449, top1 = 37.73%], valid : [loss = 2.825, top1 = 30.93%], test : [loss = 2.870, top1 = 30.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.34%], valid : [loss = 0.820, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5893/15625) 005893-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.49%], valid : [loss = 0.851, top1 = 71.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10        train : [loss = 0.556, top1 = 80.61%], test  : [loss = 0.711, top1 = 75.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 1.784, top1 = 52.08%], valid : [loss = 2.062, top1 = 46.89%], test : [loss = 2.073, top1 = 46.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.73%], valid : [loss = 3.639, top1 = 16.47%], test : [loss = 3.665, top1 = 15.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5894/15625) 005894-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.66 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.15 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.85%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5895/15625) 005895-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.479, top1 = 89.53%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.308, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.12 ms.
cifar100       train : [loss = 0.260, top1 = 93.20%], valid : [loss = 1.228, top1 = 68.86%], test : [loss = 1.228, top1 = 69.21%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.07%], valid : [loss = 2.222, top1 = 42.37%], test : [loss = 2.240, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5896/15625) 005896-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.28 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.93%], valid : [loss = 0.485, top1 = 87.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.00 ms.
cifar10        train : [loss = 0.076, top1 = 97.69%], test  : [loss = 0.352, top1 = 89.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.95 ms.
cifar100       train : [loss = 0.718, top1 = 79.11%], valid : [loss = 1.307, top1 = 65.11%], test : [loss = 1.274, top1 = 65.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.445, top1 = 37.85%], valid : [loss = 2.564, top1 = 35.37%], test : [loss = 2.581, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.20%], valid : [loss = 0.618, top1 = 79.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5897/15625) 005897-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.38%], valid : [loss = 0.548, top1 = 86.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.92 ms.
cifar10        train : [loss = 0.091, top1 = 97.01%], test  : [loss = 0.371, top1 = 89.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.94 ms.
cifar100       train : [loss = 0.769, top1 = 77.52%], valid : [loss = 1.352, top1 = 63.59%], test : [loss = 1.327, top1 = 63.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.462, top1 = 37.34%], valid : [loss = 2.549, top1 = 35.94%], test : [loss = 2.594, top1 = 34.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.30%], valid : [loss = 0.813, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5898/15625) 005898-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.528, top1 = 89.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.334, top1 = 92.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.13 ms.
cifar100       train : [loss = 0.109, top1 = 97.78%], valid : [loss = 1.359, top1 = 69.13%], test : [loss = 1.344, top1 = 69.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.73%], valid : [loss = 2.224, top1 = 42.98%], test : [loss = 2.221, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.90%], valid : [loss = 0.655, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5899/15625) 005899-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.66%], valid : [loss = 0.593, top1 = 87.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.022, top1 = 99.38%], test  : [loss = 0.396, top1 = 90.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.12 ms.
cifar100       train : [loss = 0.380, top1 = 89.24%], valid : [loss = 1.490, top1 = 63.51%], test : [loss = 1.470, top1 = 64.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.781, top1 = 29.92%], valid : [loss = 2.864, top1 = 28.41%], test : [loss = 2.863, top1 = 28.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.194, top1 = 56.08%], valid : [loss = 1.197, top1 = 56.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5900/15625) 005900-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.592, top1 = 87.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.394, top1 = 90.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.87 ms.
cifar100       train : [loss = 0.410, top1 = 88.23%], valid : [loss = 1.404, top1 = 65.26%], test : [loss = 1.415, top1 = 65.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.94%], valid : [loss = 2.512, top1 = 36.60%], test : [loss = 2.542, top1 = 36.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.82%], valid : [loss = 0.828, top1 = 70.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5901/15625) 005901-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.715, top1 = 84.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.39 ms.
cifar10        train : [loss = 0.054, top1 = 98.32%], test  : [loss = 0.449, top1 = 88.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 0.626, top1 = 81.69%], valid : [loss = 1.509, top1 = 61.99%], test : [loss = 1.489, top1 = 62.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.16%], valid : [loss = 2.834, top1 = 30.54%], test : [loss = 2.880, top1 = 30.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5902/15625) 005902-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.437, top1 = 91.00%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.58 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.283, top1 = 93.91%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.36 ms.
cifar100       train : [loss = 0.047, top1 = 99.37%], valid : [loss = 1.335, top1 = 70.89%], test : [loss = 1.358, top1 = 70.97%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 1.449, top1 = 60.60%], valid : [loss = 2.241, top1 = 44.33%], test : [loss = 2.290, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.56%], valid : [loss = 0.558, top1 = 81.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5903/15625) 005903-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.604, top1 = 85.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.405, top1 = 88.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.40 ms.
cifar100       train : [loss = 0.710, top1 = 79.44%], valid : [loss = 1.355, top1 = 64.13%], test : [loss = 1.343, top1 = 64.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.09%], valid : [loss = 2.649, top1 = 34.06%], test : [loss = 2.686, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.16%], valid : [loss = 0.786, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5904/15625) 005904-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.25%], valid : [loss = 0.571, top1 = 82.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.214, top1 = 92.78%], test  : [loss = 0.400, top1 = 87.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.05 ms.
cifar100       train : [loss = 1.327, top1 = 62.52%], valid : [loss = 1.614, top1 = 56.13%], test : [loss = 1.610, top1 = 56.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 30.43%], valid : [loss = 2.851, top1 = 30.24%], test : [loss = 2.886, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.949, top1 = 65.64%], valid : [loss = 1.015, top1 = 64.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5905/15625) 005905-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5906/15625) 005906-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.582, top1 = 85.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10        train : [loss = 0.067, top1 = 97.96%], test  : [loss = 0.400, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.33 ms.
cifar100       train : [loss = 0.702, top1 = 79.56%], valid : [loss = 1.381, top1 = 63.21%], test : [loss = 1.385, top1 = 63.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.12%], valid : [loss = 2.642, top1 = 33.73%], test : [loss = 2.663, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.00%], valid : [loss = 0.772, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5907/15625) 005907-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.526, top1 = 88.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.345, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.64 ms.
cifar100       train : [loss = 0.323, top1 = 91.18%], valid : [loss = 1.286, top1 = 67.19%], test : [loss = 1.295, top1 = 67.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.95%], valid : [loss = 2.425, top1 = 38.48%], test : [loss = 2.448, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.20%], valid : [loss = 0.834, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5908/15625) 005908-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.508, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.326, top1 = 92.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.51 ms.
cifar100       train : [loss = 0.342, top1 = 90.62%], valid : [loss = 1.271, top1 = 67.25%], test : [loss = 1.268, top1 = 67.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 45.04%], valid : [loss = 2.401, top1 = 38.86%], test : [loss = 2.401, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5909/15625) 005909-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.576, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.378, top1 = 91.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.92 ms.
cifar100       train : [loss = 0.161, top1 = 96.39%], valid : [loss = 1.495, top1 = 66.48%], test : [loss = 1.480, top1 = 66.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.96%], valid : [loss = 2.397, top1 = 39.46%], test : [loss = 2.418, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.09%], valid : [loss = 0.741, top1 = 74.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5910/15625) 005910-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.555, top1 = 88.44%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.18 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.370, top1 = 91.65%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.43 ms.
cifar100       train : [loss = 0.174, top1 = 96.20%], valid : [loss = 1.437, top1 = 66.65%], test : [loss = 1.415, top1 = 67.25%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.964, top1 = 48.41%], valid : [loss = 2.428, top1 = 39.59%], test : [loss = 2.435, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.96%], valid : [loss = 0.674, top1 = 76.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5911/15625) 005911-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.66%], valid : [loss = 0.486, top1 = 84.80%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.80 ms.
cifar10        train : [loss = 0.225, top1 = 92.31%], test  : [loss = 0.373, top1 = 87.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.07 ms.
cifar100       train : [loss = 1.190, top1 = 66.14%], valid : [loss = 1.487, top1 = 59.10%], test : [loss = 1.465, top1 = 59.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 2.766, top1 = 31.46%], valid : [loss = 2.767, top1 = 31.47%], test : [loss = 2.827, top1 = 30.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.06%], valid : [loss = 0.951, top1 = 66.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5912/15625) 005912-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.49%], valid : [loss = 0.552, top1 = 83.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10        train : [loss = 0.192, top1 = 93.46%], test  : [loss = 0.399, top1 = 87.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.18 ms.
cifar100       train : [loss = 1.236, top1 = 64.93%], valid : [loss = 1.540, top1 = 58.13%], test : [loss = 1.538, top1 = 57.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.699, top1 = 32.66%], valid : [loss = 2.720, top1 = 32.39%], test : [loss = 2.776, top1 = 31.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5913/15625) 005913-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.45%], valid : [loss = 0.468, top1 = 84.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.299, top1 = 89.98%], test  : [loss = 0.397, top1 = 86.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.22 ms.
cifar100       train : [loss = 1.318, top1 = 63.59%], valid : [loss = 1.528, top1 = 57.83%], test : [loss = 1.501, top1 = 58.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.71%], valid : [loss = 2.900, top1 = 29.58%], test : [loss = 2.959, top1 = 28.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.42%], valid : [loss = 0.775, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5914/15625) 005914-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.325, top1 = 92.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.78 ms.
cifar100       train : [loss = 0.328, top1 = 91.16%], valid : [loss = 1.274, top1 = 67.36%], test : [loss = 1.289, top1 = 67.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.73%], valid : [loss = 2.402, top1 = 39.16%], test : [loss = 2.410, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5915/15625) 005915-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.14%], valid : [loss = 0.477, top1 = 84.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.299, top1 = 90.06%], test  : [loss = 0.392, top1 = 86.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 1.313, top1 = 63.53%], valid : [loss = 1.512, top1 = 57.98%], test : [loss = 1.504, top1 = 58.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.74%], valid : [loss = 2.895, top1 = 29.42%], test : [loss = 2.957, top1 = 27.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5916/15625) 005916-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.509, top1 = 89.93%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.94 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.327, top1 = 93.11%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.28 ms.
cifar100       train : [loss = 0.063, top1 = 99.13%], valid : [loss = 1.357, top1 = 69.15%], test : [loss = 1.372, top1 = 69.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.62%], valid : [loss = 2.382, top1 = 39.89%], test : [loss = 2.384, top1 = 39.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 66.01%], valid : [loss = 0.980, top1 = 65.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5917/15625) 005917-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.440, top1 = 89.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.313, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.202, top1 = 95.29%], valid : [loss = 1.269, top1 = 69.11%], test : [loss = 1.234, top1 = 69.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.46%], valid : [loss = 2.257, top1 = 42.78%], test : [loss = 2.281, top1 = 42.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.417, top1 = 85.44%], valid : [loss = 0.541, top1 = 81.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5918/15625) 005918-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.596, top1 = 87.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.409, top1 = 91.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.243, top1 = 93.75%], valid : [loss = 1.465, top1 = 65.82%], test : [loss = 1.483, top1 = 65.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.96%], valid : [loss = 2.489, top1 = 37.22%], test : [loss = 2.510, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.14%], valid : [loss = 0.764, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5919/15625) 005919-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.24%], valid : [loss = 0.705, top1 = 84.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.055, top1 = 98.31%], test  : [loss = 0.455, top1 = 88.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.648, top1 = 81.03%], valid : [loss = 1.536, top1 = 61.19%], test : [loss = 1.509, top1 = 61.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.23%], valid : [loss = 2.812, top1 = 30.70%], test : [loss = 2.859, top1 = 30.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.885, top1 = 68.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5920/15625) 005920-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.68%], valid : [loss = 0.633, top1 = 84.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.071, top1 = 97.68%], test  : [loss = 0.410, top1 = 88.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.95 ms.
cifar100       train : [loss = 0.753, top1 = 77.86%], valid : [loss = 1.527, top1 = 59.98%], test : [loss = 1.498, top1 = 60.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.84%], valid : [loss = 2.659, top1 = 33.98%], test : [loss = 2.666, top1 = 34.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.59%], valid : [loss = 0.900, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5921/15625) 005921-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.67%], valid : [loss = 0.573, top1 = 87.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10        train : [loss = 0.019, top1 = 99.46%], test  : [loss = 0.375, top1 = 91.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.00 ms.
cifar100       train : [loss = 0.301, top1 = 91.48%], valid : [loss = 1.408, top1 = 66.07%], test : [loss = 1.422, top1 = 65.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.829, top1 = 29.12%], valid : [loss = 2.926, top1 = 27.62%], test : [loss = 2.922, top1 = 27.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 60.09%], valid : [loss = 1.102, top1 = 59.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5922/15625) 005922-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.552, top1 = 89.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.342, top1 = 92.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.34 ms.
cifar100       train : [loss = 0.129, top1 = 97.22%], valid : [loss = 1.365, top1 = 68.79%], test : [loss = 1.363, top1 = 69.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.998, top1 = 47.46%], valid : [loss = 2.332, top1 = 41.04%], test : [loss = 2.330, top1 = 40.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.28%], valid : [loss = 0.825, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5923/15625) 005923-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.533, top1 = 88.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.332, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.311, top1 = 91.57%], valid : [loss = 1.263, top1 = 67.53%], test : [loss = 1.274, top1 = 68.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 45.84%], valid : [loss = 2.380, top1 = 39.02%], test : [loss = 2.363, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.82%], valid : [loss = 0.717, top1 = 75.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5924/15625) 005924-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.494, top1 = 89.51%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.312, top1 = 92.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.20 ms.
cifar100       train : [loss = 0.151, top1 = 96.88%], valid : [loss = 1.250, top1 = 69.32%], test : [loss = 1.269, top1 = 69.29%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 1.796, top1 = 52.21%], valid : [loss = 2.215, top1 = 43.58%], test : [loss = 2.235, top1 = 43.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.17%], valid : [loss = 0.675, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5925/15625) 005925-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.91 ms.
cifar10-valid  train : [loss = 0.289, top1 = 90.10%], valid : [loss = 0.529, top1 = 83.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.79 ms.
cifar10        train : [loss = 0.267, top1 = 91.00%], test  : [loss = 0.428, top1 = 86.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.91 ms.
cifar100       train : [loss = 1.424, top1 = 60.17%], valid : [loss = 1.672, top1 = 54.82%], test : [loss = 1.661, top1 = 55.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 2.967, top1 = 27.57%], valid : [loss = 2.960, top1 = 27.78%], test : [loss = 3.036, top1 = 26.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.65%], valid : [loss = 1.062, top1 = 62.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5926/15625) 005926-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.578, top1 = 88.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.387, top1 = 92.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.25 ms.
cifar100       train : [loss = 0.113, top1 = 97.81%], valid : [loss = 1.457, top1 = 67.56%], test : [loss = 1.472, top1 = 67.33%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.88%], valid : [loss = 2.452, top1 = 39.32%], test : [loss = 2.456, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.96%], valid : [loss = 0.786, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5927/15625) 005927-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.17%], valid : [loss = 0.650, top1 = 78.15%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10        train : [loss = 0.517, top1 = 82.10%], test  : [loss = 0.597, top1 = 79.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.17 ms.
cifar100       train : [loss = 1.677, top1 = 54.44%], valid : [loss = 1.856, top1 = 50.44%], test : [loss = 1.858, top1 = 50.65%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.47 ms.
ImageNet16-120 train : [loss = 3.319, top1 = 21.42%], valid : [loss = 3.318, top1 = 21.28%], test : [loss = 3.347, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5928/15625) 005928-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.539, top1 = 88.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.342, top1 = 92.27%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.02 ms.
cifar100       train : [loss = 0.199, top1 = 94.96%], valid : [loss = 1.330, top1 = 68.37%], test : [loss = 1.319, top1 = 68.49%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.08%], valid : [loss = 2.268, top1 = 42.24%], test : [loss = 2.293, top1 = 41.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.14%], valid : [loss = 0.776, top1 = 72.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5929/15625) 005929-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.147, top1 = 95.13%], valid : [loss = 0.878, top1 = 77.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.58 ms.
cifar10        train : [loss = 0.201, top1 = 93.10%], test  : [loss = 0.567, top1 = 82.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.32 ms.
cifar100       train : [loss = 1.049, top1 = 69.82%], valid : [loss = 1.780, top1 = 53.91%], test : [loss = 1.774, top1 = 54.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 3.101, top1 = 25.18%], valid : [loss = 3.223, top1 = 23.20%], test : [loss = 3.253, top1 = 22.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.56%], valid : [loss = 1.182, top1 = 57.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5930/15625) 005930-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.574, top1 = 87.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.388, top1 = 91.18%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.02 ms.
cifar100       train : [loss = 0.405, top1 = 88.49%], valid : [loss = 1.400, top1 = 65.47%], test : [loss = 1.392, top1 = 65.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.91%], valid : [loss = 2.517, top1 = 36.37%], test : [loss = 2.536, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5931/15625) 005931-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.27%], valid : [loss = 0.601, top1 = 86.21%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.49 ms.
cifar10        train : [loss = 0.055, top1 = 98.28%], test  : [loss = 0.399, top1 = 89.42%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.48 ms.
cifar100       train : [loss = 0.468, top1 = 86.49%], valid : [loss = 1.407, top1 = 64.65%], test : [loss = 1.393, top1 = 64.81%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.67%], valid : [loss = 2.512, top1 = 36.59%], test : [loss = 2.517, top1 = 36.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.56%], valid : [loss = 0.931, top1 = 66.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5932/15625) 005932-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.526, top1 = 89.39%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.29 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.336, top1 = 92.45%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.96 ms.
cifar100       train : [loss = 0.152, top1 = 96.52%], valid : [loss = 1.395, top1 = 67.87%], test : [loss = 1.394, top1 = 68.02%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.787, top1 = 52.44%], valid : [loss = 2.232, top1 = 43.31%], test : [loss = 2.251, top1 = 42.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.27%], valid : [loss = 0.837, top1 = 70.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5933/15625) 005933-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.02%], valid : [loss = 0.744, top1 = 75.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.60 ms.
cifar10        train : [loss = 0.534, top1 = 81.35%], test  : [loss = 0.612, top1 = 79.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 1.983, top1 = 46.25%], valid : [loss = 2.095, top1 = 44.13%], test : [loss = 2.119, top1 = 44.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.993, top1 = 26.81%], valid : [loss = 2.972, top1 = 27.33%], test : [loss = 3.008, top1 = 26.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.48%], valid : [loss = 1.186, top1 = 57.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5934/15625) 005934-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.06%], valid : [loss = 0.858, top1 = 77.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10        train : [loss = 0.190, top1 = 93.50%], test  : [loss = 0.572, top1 = 83.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.48 ms.
cifar100       train : [loss = 1.000, top1 = 71.12%], valid : [loss = 1.754, top1 = 54.93%], test : [loss = 1.760, top1 = 55.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 3.098, top1 = 25.22%], valid : [loss = 3.222, top1 = 23.13%], test : [loss = 3.246, top1 = 23.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 59.28%], valid : [loss = 1.184, top1 = 57.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5935/15625) 005935-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.59%], valid : [loss = 0.843, top1 = 71.36%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10        train : [loss = 0.668, top1 = 76.63%], test  : [loss = 0.754, top1 = 74.10%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.51 ms.
cifar100       train : [loss = 1.950, top1 = 48.16%], valid : [loss = 2.123, top1 = 44.93%], test : [loss = 2.150, top1 = 44.44%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.27 ms.
ImageNet16-120 train : [loss = 3.644, top1 = 15.85%], valid : [loss = 3.676, top1 = 16.26%], test : [loss = 3.685, top1 = 14.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5936/15625) 005936-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.351, top1 = 87.71%], valid : [loss = 0.576, top1 = 81.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.313, top1 = 89.11%], test  : [loss = 0.447, top1 = 85.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.48 ms.
cifar100       train : [loss = 1.555, top1 = 56.58%], valid : [loss = 1.800, top1 = 51.33%], test : [loss = 1.789, top1 = 51.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.940, top1 = 27.68%], valid : [loss = 2.974, top1 = 27.17%], test : [loss = 3.023, top1 = 26.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.27%], valid : [loss = 1.095, top1 = 60.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5937/15625) 005937-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.37%], valid : [loss = 0.650, top1 = 78.15%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.47 ms.
cifar10        train : [loss = 0.506, top1 = 82.49%], test  : [loss = 0.588, top1 = 80.10%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.12 ms.
cifar100       train : [loss = 1.682, top1 = 54.32%], valid : [loss = 1.850, top1 = 50.66%], test : [loss = 1.861, top1 = 50.82%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.59 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.37%], valid : [loss = 3.307, top1 = 21.62%], test : [loss = 3.350, top1 = 21.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5938/15625) 005938-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.477, top1 = 89.33%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.312, top1 = 92.10%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.39 ms.
cifar100       train : [loss = 0.270, top1 = 93.10%], valid : [loss = 1.194, top1 = 69.06%], test : [loss = 1.200, top1 = 69.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.05%], valid : [loss = 2.206, top1 = 42.72%], test : [loss = 2.257, top1 = 42.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.20%], valid : [loss = 0.639, top1 = 77.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5939/15625) 005939-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.10 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.19%], valid : [loss = 0.473, top1 = 84.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10        train : [loss = 0.298, top1 = 90.13%], test  : [loss = 0.398, top1 = 86.55%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.15 ms.
cifar100       train : [loss = 1.326, top1 = 63.24%], valid : [loss = 1.533, top1 = 57.83%], test : [loss = 1.516, top1 = 58.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.05 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.75%], valid : [loss = 2.886, top1 = 30.04%], test : [loss = 2.953, top1 = 27.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5940/15625) 005940-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.76%], valid : [loss = 0.520, top1 = 88.25%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.72 ms.
cifar10        train : [loss = 0.027, top1 = 99.30%], test  : [loss = 0.363, top1 = 91.06%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.38 ms.
cifar100       train : [loss = 0.399, top1 = 88.62%], valid : [loss = 1.289, top1 = 67.17%], test : [loss = 1.281, top1 = 67.16%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.55%], valid : [loss = 2.398, top1 = 39.22%], test : [loss = 2.405, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.16%], valid : [loss = 0.608, top1 = 79.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5941/15625) 005941-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.624, top1 = 87.08%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.56 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.425, top1 = 90.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.82 ms.
cifar100       train : [loss = 0.164, top1 = 96.20%], valid : [loss = 1.616, top1 = 64.42%], test : [loss = 1.669, top1 = 63.59%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.014, top1 = 47.40%], valid : [loss = 2.431, top1 = 38.70%], test : [loss = 2.463, top1 = 38.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.47%], valid : [loss = 0.808, top1 = 71.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5942/15625) 005942-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.01%], valid : [loss = 0.905, top1 = 68.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.714, top1 = 74.81%], test  : [loss = 0.772, top1 = 73.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.80 ms.
cifar100       train : [loss = 2.245, top1 = 40.58%], valid : [loss = 2.338, top1 = 38.92%], test : [loss = 2.338, top1 = 38.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 3.504, top1 = 17.70%], valid : [loss = 3.485, top1 = 19.04%], test : [loss = 3.506, top1 = 18.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.371, top1 = 49.66%], valid : [loss = 1.417, top1 = 48.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5943/15625) 005943-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.20%], valid : [loss = 0.634, top1 = 78.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10        train : [loss = 0.500, top1 = 82.81%], test  : [loss = 0.578, top1 = 80.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.15 ms.
cifar100       train : [loss = 1.714, top1 = 53.58%], valid : [loss = 1.870, top1 = 50.22%], test : [loss = 1.892, top1 = 50.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 3.319, top1 = 21.38%], valid : [loss = 3.302, top1 = 21.94%], test : [loss = 3.337, top1 = 21.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.29%], valid : [loss = 1.283, top1 = 53.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5944/15625) 005944-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.457, top1 = 84.03%], valid : [loss = 0.633, top1 = 78.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.498, top1 = 82.81%], test  : [loss = 0.581, top1 = 80.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.12 ms.
cifar100       train : [loss = 1.650, top1 = 55.12%], valid : [loss = 1.813, top1 = 51.99%], test : [loss = 1.846, top1 = 51.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.33%], valid : [loss = 3.314, top1 = 21.56%], test : [loss = 3.345, top1 = 21.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5945/15625) 005945-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.455, top1 = 89.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.342, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.70 ms.
cifar100       train : [loss = 0.197, top1 = 95.06%], valid : [loss = 1.383, top1 = 67.59%], test : [loss = 1.346, top1 = 68.07%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.58%], valid : [loss = 2.350, top1 = 40.69%], test : [loss = 2.350, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.82%], valid : [loss = 0.566, top1 = 80.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5946/15625) 005946-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.48%], valid : [loss = 0.463, top1 = 86.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.153, top1 = 95.05%], test  : [loss = 0.340, top1 = 88.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.02 ms.
cifar100       train : [loss = 0.963, top1 = 72.73%], valid : [loss = 1.342, top1 = 62.53%], test : [loss = 1.338, top1 = 62.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.97%], valid : [loss = 2.690, top1 = 32.98%], test : [loss = 2.712, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5947/15625) 005947-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.558, top1 = 88.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.59 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.359, top1 = 92.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.79 ms.
cifar100       train : [loss = 0.191, top1 = 95.23%], valid : [loss = 1.366, top1 = 67.28%], test : [loss = 1.381, top1 = 67.55%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.50%], valid : [loss = 2.470, top1 = 37.50%], test : [loss = 2.453, top1 = 38.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.43%], valid : [loss = 0.898, top1 = 67.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5948/15625) 005948-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.652, top1 = 85.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.028, top1 = 99.31%], test  : [loss = 0.431, top1 = 89.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.11 ms.
cifar100       train : [loss = 0.367, top1 = 90.24%], valid : [loss = 1.418, top1 = 64.89%], test : [loss = 1.412, top1 = 65.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.275, top1 = 41.59%], valid : [loss = 2.606, top1 = 35.18%], test : [loss = 2.609, top1 = 36.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5949/15625) 005949-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.225, top1 = 92.33%], valid : [loss = 0.545, top1 = 83.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.216, top1 = 92.63%], test  : [loss = 0.400, top1 = 87.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.16 ms.
cifar100       train : [loss = 1.301, top1 = 63.12%], valid : [loss = 1.594, top1 = 56.49%], test : [loss = 1.604, top1 = 56.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.709, top1 = 32.34%], valid : [loss = 2.724, top1 = 31.94%], test : [loss = 2.768, top1 = 31.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.954, top1 = 65.52%], valid : [loss = 1.005, top1 = 64.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5950/15625) 005950-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.37%], valid : [loss = 0.738, top1 = 74.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.91 ms.
cifar10        train : [loss = 0.523, top1 = 81.96%], test  : [loss = 0.583, top1 = 80.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.34 ms.
cifar100       train : [loss = 2.033, top1 = 45.41%], valid : [loss = 2.120, top1 = 43.91%], test : [loss = 2.127, top1 = 43.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 3.182, top1 = 23.25%], valid : [loss = 3.151, top1 = 24.29%], test : [loss = 3.189, top1 = 23.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.170, top1 = 57.88%], valid : [loss = 1.216, top1 = 57.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5951/15625) 005951-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.312, top1 = 89.12%], valid : [loss = 0.581, top1 = 81.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10        train : [loss = 0.307, top1 = 89.52%], test  : [loss = 0.440, top1 = 85.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.55 ms.
cifar100       train : [loss = 1.340, top1 = 62.32%], valid : [loss = 1.625, top1 = 55.91%], test : [loss = 1.620, top1 = 56.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.082, top1 = 25.50%], valid : [loss = 3.100, top1 = 25.07%], test : [loss = 3.133, top1 = 25.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.209, top1 = 56.40%], valid : [loss = 1.240, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5952/15625) 005952-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.75%], valid : [loss = 0.464, top1 = 86.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.155, top1 = 94.98%], test  : [loss = 0.348, top1 = 88.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.975, top1 = 72.26%], valid : [loss = 1.340, top1 = 62.87%], test : [loss = 1.340, top1 = 62.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.82%], valid : [loss = 2.685, top1 = 33.08%], test : [loss = 2.696, top1 = 32.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5953/15625) 005953-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.04 ms.
cifar10-valid  train : [loss = 1.097, top1 = 61.19%], valid : [loss = 1.145, top1 = 59.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10        train : [loss = 1.061, top1 = 62.65%], test  : [loss = 1.062, top1 = 62.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.95 ms.
cifar100       train : [loss = 2.579, top1 = 34.91%], valid : [loss = 2.655, top1 = 33.77%], test : [loss = 2.632, top1 = 34.14%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.72 ms.
ImageNet16-120 train : [loss = 3.782, top1 = 13.71%], valid : [loss = 3.767, top1 = 14.60%], test : [loss = 3.792, top1 = 13.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5954/15625) 005954-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.459, top1 = 89.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.300, top1 = 92.78%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.27 ms.
cifar100       train : [loss = 0.274, top1 = 92.73%], valid : [loss = 1.238, top1 = 68.36%], test : [loss = 1.247, top1 = 68.57%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 1.870, top1 = 50.46%], valid : [loss = 2.192, top1 = 43.23%], test : [loss = 2.227, top1 = 42.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.48%], valid : [loss = 0.627, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5955/15625) 005955-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.15%], valid : [loss = 0.719, top1 = 82.70%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10        train : [loss = 0.111, top1 = 96.40%], test  : [loss = 0.466, top1 = 86.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.42 ms.
cifar100       train : [loss = 0.881, top1 = 74.52%], valid : [loss = 1.559, top1 = 58.49%], test : [loss = 1.533, top1 = 59.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.734, top1 = 31.92%], valid : [loss = 2.830, top1 = 30.27%], test : [loss = 2.876, top1 = 30.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.883, top1 = 68.75%], valid : [loss = 0.931, top1 = 67.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5956/15625) 005956-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.410, top1 = 90.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.41 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.282, top1 = 93.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.21 ms.
cifar100       train : [loss = 0.089, top1 = 98.49%], valid : [loss = 1.298, top1 = 70.79%], test : [loss = 1.294, top1 = 69.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.618, top1 = 56.54%], valid : [loss = 2.217, top1 = 44.19%], test : [loss = 2.235, top1 = 44.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.13%], valid : [loss = 0.496, top1 = 83.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5957/15625) 005957-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.34%], valid : [loss = 0.523, top1 = 87.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.40 ms.
cifar10        train : [loss = 0.058, top1 = 98.24%], test  : [loss = 0.357, top1 = 90.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.04 ms.
cifar100       train : [loss = 0.628, top1 = 81.49%], valid : [loss = 1.320, top1 = 65.25%], test : [loss = 1.311, top1 = 65.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.59%], valid : [loss = 2.503, top1 = 36.21%], test : [loss = 2.530, top1 = 36.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.24%], valid : [loss = 0.629, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5958/15625) 005958-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.21%], valid : [loss = 0.602, top1 = 85.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10        train : [loss = 0.070, top1 = 97.92%], test  : [loss = 0.409, top1 = 88.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.30 ms.
cifar100       train : [loss = 0.713, top1 = 79.27%], valid : [loss = 1.397, top1 = 63.26%], test : [loss = 1.372, top1 = 63.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.05%], valid : [loss = 2.654, top1 = 33.59%], test : [loss = 2.694, top1 = 33.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5959/15625) 005959-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.475, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.314, top1 = 91.59%], valid : [loss = 1.257, top1 = 67.60%], test : [loss = 1.252, top1 = 68.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.90%], valid : [loss = 2.319, top1 = 40.63%], test : [loss = 2.320, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5960/15625) 005960-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.573, top1 = 87.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.31 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.389, top1 = 91.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.407, top1 = 88.35%], valid : [loss = 1.396, top1 = 65.60%], test : [loss = 1.386, top1 = 65.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.96%], valid : [loss = 2.502, top1 = 37.59%], test : [loss = 2.522, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.81%], valid : [loss = 0.782, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5961/15625) 005961-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.61%], valid : [loss = 0.539, top1 = 86.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10        train : [loss = 0.077, top1 = 97.64%], test  : [loss = 0.369, top1 = 89.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.63 ms.
cifar100       train : [loss = 0.741, top1 = 78.37%], valid : [loss = 1.375, top1 = 62.98%], test : [loss = 1.354, top1 = 64.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.457, top1 = 37.43%], valid : [loss = 2.565, top1 = 35.10%], test : [loss = 2.604, top1 = 35.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.26%], valid : [loss = 0.906, top1 = 68.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5962/15625) 005962-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.523, top1 = 89.54%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.94 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.321, top1 = 93.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.65 ms.
cifar100       train : [loss = 0.069, top1 = 98.98%], valid : [loss = 1.338, top1 = 69.59%], test : [loss = 1.359, top1 = 69.45%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 46.94%], valid : [loss = 2.384, top1 = 39.30%], test : [loss = 2.380, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5963/15625) 005963-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.37 ms.
cifar10-valid  train : [loss = 1.686, top1 = 37.80%], valid : [loss = 1.714, top1 = 37.08%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.44 ms.
cifar10        train : [loss = 1.322, top1 = 52.08%], test  : [loss = 1.322, top1 = 51.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.28 ms.
cifar100       train : [loss = 3.797, top1 = 11.94%], valid : [loss = 3.906, top1 = 10.40%], test : [loss = 3.900, top1 = 10.93%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.99 ms.
ImageNet16-120 train : [loss = 3.952, top1 = 11.11%], valid : [loss = 3.944, top1 = 11.64%], test : [loss = 3.958, top1 = 11.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.58%], valid : [loss = 1.967, top1 = 27.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5964/15625) 005964-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.149, top1 = 95.16%], valid : [loss = 0.886, top1 = 77.24%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10        train : [loss = 0.189, top1 = 93.52%], test  : [loss = 0.616, top1 = 82.34%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.92 ms.
cifar100       train : [loss = 0.858, top1 = 75.60%], valid : [loss = 1.922, top1 = 52.84%], test : [loss = 1.953, top1 = 52.83%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 3.376, top1 = 19.22%], valid : [loss = 3.423, top1 = 19.14%], test : [loss = 3.440, top1 = 18.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.253, top1 = 54.41%], valid : [loss = 1.288, top1 = 53.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5965/15625) 005965-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.30%], valid : [loss = 1.071, top1 = 77.77%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.28 ms.
cifar10        train : [loss = 0.072, top1 = 97.88%], test  : [loss = 0.686, top1 = 83.22%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.89 ms.
cifar100       train : [loss = 0.579, top1 = 83.86%], valid : [loss = 1.918, top1 = 55.11%], test : [loss = 1.913, top1 = 55.15%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 2.938, top1 = 28.26%], valid : [loss = 3.288, top1 = 22.44%], test : [loss = 3.308, top1 = 22.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.993, top1 = 64.45%], valid : [loss = 1.053, top1 = 62.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5966/15625) 005966-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.547, top1 = 89.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.331, top1 = 92.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.16 ms.
cifar100       train : [loss = 0.126, top1 = 97.28%], valid : [loss = 1.344, top1 = 69.09%], test : [loss = 1.359, top1 = 68.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 1.761, top1 = 53.04%], valid : [loss = 2.233, top1 = 42.89%], test : [loss = 2.239, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.08%], valid : [loss = 0.672, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5967/15625) 005967-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.539, top1 = 88.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.359, top1 = 91.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.192, top1 = 95.67%], valid : [loss = 1.389, top1 = 66.60%], test : [loss = 1.375, top1 = 67.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.26%], valid : [loss = 2.408, top1 = 39.64%], test : [loss = 2.427, top1 = 40.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.27%], valid : [loss = 0.725, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5968/15625) 005968-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.85%], valid : [loss = 0.522, top1 = 86.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.100, top1 = 96.84%], test  : [loss = 0.350, top1 = 89.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.699, top1 = 79.75%], valid : [loss = 1.312, top1 = 64.59%], test : [loss = 1.305, top1 = 64.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.453, top1 = 37.66%], valid : [loss = 2.538, top1 = 35.92%], test : [loss = 2.559, top1 = 35.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.72%], valid : [loss = 0.872, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5969/15625) 005969-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.39%], valid : [loss = 0.685, top1 = 84.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.055, top1 = 98.32%], test  : [loss = 0.441, top1 = 88.52%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 0.631, top1 = 81.55%], valid : [loss = 1.544, top1 = 60.81%], test : [loss = 1.503, top1 = 61.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.26%], valid : [loss = 2.816, top1 = 30.60%], test : [loss = 2.869, top1 = 30.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5970/15625) 005970-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.556, top1 = 88.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.362, top1 = 92.83%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.85 ms.
cifar100       train : [loss = 0.056, top1 = 99.34%], valid : [loss = 1.424, top1 = 69.35%], test : [loss = 1.432, top1 = 68.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 1.689, top1 = 54.79%], valid : [loss = 2.353, top1 = 41.41%], test : [loss = 2.378, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.82%], valid : [loss = 0.617, top1 = 79.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5971/15625) 005971-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.64%], valid : [loss = 0.584, top1 = 87.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.039, top1 = 98.87%], test  : [loss = 0.390, top1 = 90.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 0.544, top1 = 83.92%], valid : [loss = 1.416, top1 = 64.18%], test : [loss = 1.406, top1 = 64.63%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.482, top1 = 37.16%], valid : [loss = 2.633, top1 = 33.84%], test : [loss = 2.664, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.38%], valid : [loss = 0.711, top1 = 75.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5972/15625) 005972-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.31%], valid : [loss = 0.577, top1 = 85.67%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.13 ms.
cifar10        train : [loss = 0.113, top1 = 96.25%], test  : [loss = 0.392, top1 = 88.63%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.52 ms.
cifar100       train : [loss = 0.817, top1 = 75.95%], valid : [loss = 1.401, top1 = 62.69%], test : [loss = 1.397, top1 = 62.11%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.09%], valid : [loss = 2.770, top1 = 30.94%], test : [loss = 2.828, top1 = 30.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.25%], valid : [loss = 0.716, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5973/15625) 005973-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.322, top1 = 92.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.97 ms.
cifar100       train : [loss = 0.321, top1 = 91.38%], valid : [loss = 1.303, top1 = 67.33%], test : [loss = 1.337, top1 = 66.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.40%], valid : [loss = 2.355, top1 = 40.20%], test : [loss = 2.386, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5974/15625) 005974-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.665, top1 = 86.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.424, top1 = 90.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 0.232, top1 = 94.38%], valid : [loss = 1.533, top1 = 65.21%], test : [loss = 1.576, top1 = 64.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.97%], valid : [loss = 2.544, top1 = 36.87%], test : [loss = 2.545, top1 = 37.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.13%], valid : [loss = 0.828, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5975/15625) 005975-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.424, top1 = 90.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.294, top1 = 92.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.86 ms.
cifar100       train : [loss = 0.112, top1 = 97.98%], valid : [loss = 1.297, top1 = 70.01%], test : [loss = 1.280, top1 = 70.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 1.687, top1 = 54.88%], valid : [loss = 2.230, top1 = 43.63%], test : [loss = 2.255, top1 = 43.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.93%], valid : [loss = 0.525, top1 = 82.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5976/15625) 005976-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.473, top1 = 89.73%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.296, top1 = 92.78%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.89 ms.
cifar100       train : [loss = 0.288, top1 = 92.35%], valid : [loss = 1.252, top1 = 68.13%], test : [loss = 1.253, top1 = 68.43%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.29%], valid : [loss = 2.212, top1 = 42.51%], test : [loss = 2.222, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.58%], valid : [loss = 0.634, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5977/15625) 005977-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.51%], valid : [loss = 0.658, top1 = 85.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.041, top1 = 98.79%], test  : [loss = 0.418, top1 = 89.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.51 ms.
cifar100       train : [loss = 0.545, top1 = 84.16%], valid : [loss = 1.423, top1 = 63.92%], test : [loss = 1.398, top1 = 64.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.92%], valid : [loss = 2.638, top1 = 34.29%], test : [loss = 2.677, top1 = 33.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.97%], valid : [loss = 0.933, top1 = 67.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5978/15625) 005978-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.492, top1 = 89.49%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.79 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.323, top1 = 92.79%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.16 ms.
cifar100       train : [loss = 0.138, top1 = 97.22%], valid : [loss = 1.285, top1 = 69.36%], test : [loss = 1.294, top1 = 69.15%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.25 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.49%], valid : [loss = 2.290, top1 = 41.72%], test : [loss = 2.281, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.86%], valid : [loss = 0.628, top1 = 78.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5979/15625) 005979-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.419, top1 = 90.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.81 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.271, top1 = 93.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.35 ms.
cifar100       train : [loss = 0.082, top1 = 98.65%], valid : [loss = 1.288, top1 = 70.97%], test : [loss = 1.281, top1 = 71.21%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.560, top1 = 57.88%], valid : [loss = 2.177, top1 = 44.24%], test : [loss = 2.192, top1 = 44.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.356, top1 = 87.84%], valid : [loss = 0.484, top1 = 84.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5980/15625) 005980-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.62%], valid : [loss = 0.669, top1 = 77.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10        train : [loss = 0.684, top1 = 76.19%], test  : [loss = 0.722, top1 = 75.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.49 ms.
cifar100       train : [loss = 1.792, top1 = 51.38%], valid : [loss = 1.938, top1 = 48.03%], test : [loss = 1.957, top1 = 48.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 3.393, top1 = 20.00%], valid : [loss = 3.376, top1 = 20.99%], test : [loss = 3.416, top1 = 19.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.377, top1 = 50.02%], valid : [loss = 1.389, top1 = 49.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5981/15625) 005981-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.525, top1 = 88.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.03 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.330, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.94 ms.
cifar100       train : [loss = 0.341, top1 = 90.62%], valid : [loss = 1.289, top1 = 66.81%], test : [loss = 1.296, top1 = 67.13%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.95%], valid : [loss = 2.390, top1 = 39.64%], test : [loss = 2.403, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5982/15625) 005982-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.622, top1 = 87.48%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.01 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.399, top1 = 91.65%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.91 ms.
cifar100       train : [loss = 0.128, top1 = 97.41%], valid : [loss = 1.554, top1 = 65.91%], test : [loss = 1.577, top1 = 65.41%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.38%], valid : [loss = 2.425, top1 = 39.81%], test : [loss = 2.419, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.55%], valid : [loss = 0.785, top1 = 72.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5983/15625) 005983-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.602, top1 = 85.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10        train : [loss = 0.069, top1 = 97.91%], test  : [loss = 0.398, top1 = 88.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.71 ms.
cifar100       train : [loss = 0.702, top1 = 79.62%], valid : [loss = 1.376, top1 = 63.07%], test : [loss = 1.363, top1 = 63.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.84%], valid : [loss = 2.659, top1 = 33.70%], test : [loss = 2.697, top1 = 33.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.26%], valid : [loss = 0.776, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5984/15625) 005984-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.49%], valid : [loss = 0.559, top1 = 84.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10        train : [loss = 0.128, top1 = 95.88%], test  : [loss = 0.387, top1 = 88.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.72 ms.
cifar100       train : [loss = 1.011, top1 = 70.96%], valid : [loss = 1.441, top1 = 60.43%], test : [loss = 1.435, top1 = 60.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.487, top1 = 36.91%], valid : [loss = 2.588, top1 = 34.90%], test : [loss = 2.592, top1 = 34.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.03%], valid : [loss = 0.922, top1 = 67.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5985/15625) 005985-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.540, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.368, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.40 ms.
cifar100       train : [loss = 0.118, top1 = 97.81%], valid : [loss = 1.410, top1 = 68.19%], test : [loss = 1.428, top1 = 67.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.35%], valid : [loss = 2.407, top1 = 40.31%], test : [loss = 2.410, top1 = 40.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.90%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5986/15625) 005986-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.593, top1 = 87.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.385, top1 = 91.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.62 ms.
cifar100       train : [loss = 0.387, top1 = 89.05%], valid : [loss = 1.408, top1 = 64.93%], test : [loss = 1.389, top1 = 65.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.26%], valid : [loss = 2.518, top1 = 36.86%], test : [loss = 2.523, top1 = 37.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.03%], valid : [loss = 0.838, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5987/15625) 005987-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.151, top1 = 94.93%], valid : [loss = 0.877, top1 = 77.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10        train : [loss = 0.221, top1 = 92.39%], test  : [loss = 0.585, top1 = 82.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.81 ms.
cifar100       train : [loss = 1.161, top1 = 66.95%], valid : [loss = 1.803, top1 = 53.68%], test : [loss = 1.795, top1 = 54.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 3.223, top1 = 22.87%], valid : [loss = 3.325, top1 = 21.48%], test : [loss = 3.357, top1 = 20.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5988/15625) 005988-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5989/15625) 005989-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.475, top1 = 89.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.330, top1 = 92.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 0.133, top1 = 97.02%], valid : [loss = 1.409, top1 = 68.39%], test : [loss = 1.441, top1 = 68.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 1.809, top1 = 52.01%], valid : [loss = 2.389, top1 = 40.98%], test : [loss = 2.389, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.10%], valid : [loss = 0.541, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5990/15625) 005990-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.517, top1 = 88.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.018, top1 = 99.59%], test  : [loss = 0.365, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 0.387, top1 = 88.94%], valid : [loss = 1.355, top1 = 66.25%], test : [loss = 1.341, top1 = 66.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.200, top1 = 43.13%], valid : [loss = 2.401, top1 = 38.90%], test : [loss = 2.449, top1 = 38.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.83%], valid : [loss = 0.652, top1 = 77.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5991/15625) 005991-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.326, top1 = 92.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.03 ms.
cifar100       train : [loss = 0.322, top1 = 91.31%], valid : [loss = 1.277, top1 = 67.41%], test : [loss = 1.285, top1 = 67.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.69%], valid : [loss = 2.412, top1 = 39.12%], test : [loss = 2.421, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5992/15625) 005992-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.82%], valid : [loss = 0.746, top1 = 82.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10        train : [loss = 0.089, top1 = 97.16%], test  : [loss = 0.489, top1 = 86.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.781, top1 = 77.23%], valid : [loss = 1.511, top1 = 60.46%], test : [loss = 1.499, top1 = 60.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.808, top1 = 30.50%], valid : [loss = 2.926, top1 = 28.32%], test : [loss = 2.976, top1 = 28.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.83%], valid : [loss = 0.883, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5993/15625) 005993-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.325, top1 = 88.72%], valid : [loss = 0.571, top1 = 81.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.289, top1 = 90.01%], test  : [loss = 0.430, top1 = 85.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.43 ms.
cifar100       train : [loss = 1.574, top1 = 56.29%], valid : [loss = 1.791, top1 = 51.51%], test : [loss = 1.785, top1 = 51.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.02%], valid : [loss = 3.051, top1 = 25.84%], test : [loss = 3.106, top1 = 24.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 62.80%], valid : [loss = 1.079, top1 = 61.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5994/15625) 005994-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.241, top1 = 91.85%], valid : [loss = 0.562, top1 = 82.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.238, top1 = 91.85%], test  : [loss = 0.427, top1 = 86.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 1.263, top1 = 64.20%], valid : [loss = 1.616, top1 = 56.28%], test : [loss = 1.617, top1 = 56.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.950, top1 = 27.98%], valid : [loss = 2.973, top1 = 27.43%], test : [loss = 3.034, top1 = 26.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.02%], valid : [loss = 1.195, top1 = 56.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5995/15625) 005995-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.76%], valid : [loss = 0.851, top1 = 72.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.548, top1 = 80.88%], test  : [loss = 0.708, top1 = 76.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 1.767, top1 = 52.28%], valid : [loss = 2.050, top1 = 47.06%], test : [loss = 2.062, top1 = 47.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.79%], valid : [loss = 3.636, top1 = 16.59%], test : [loss = 3.659, top1 = 16.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5996/15625) 005996-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.34 ms.
cifar10-valid  train : [loss = 1.255, top1 = 54.83%], valid : [loss = 1.308, top1 = 53.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10        train : [loss = 1.230, top1 = 55.94%], test  : [loss = 1.241, top1 = 55.42%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.45 ms.
cifar100       train : [loss = 2.782, top1 = 30.56%], valid : [loss = 2.869, top1 = 29.40%], test : [loss = 2.850, top1 = 29.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.94 ms.
ImageNet16-120 train : [loss = 3.895, top1 = 11.98%], valid : [loss = 3.886, top1 = 12.56%], test : [loss = 3.904, top1 = 11.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.770, top1 = 33.24%], valid : [loss = 1.760, top1 = 33.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5997/15625) 005997-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.85%], valid : [loss = 0.591, top1 = 81.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10        train : [loss = 0.241, top1 = 91.78%], test  : [loss = 0.423, top1 = 86.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 1.480, top1 = 58.47%], valid : [loss = 1.731, top1 = 53.58%], test : [loss = 1.730, top1 = 53.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.873, top1 = 29.14%], valid : [loss = 2.897, top1 = 28.93%], test : [loss = 2.940, top1 = 27.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 63.68%], valid : [loss = 1.049, top1 = 62.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5998/15625) 005998-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.597, top1 = 87.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.386, top1 = 90.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.22 ms.
cifar100       train : [loss = 0.191, top1 = 95.36%], valid : [loss = 1.566, top1 = 64.37%], test : [loss = 1.570, top1 = 64.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 45.01%], valid : [loss = 2.488, top1 = 37.19%], test : [loss = 2.526, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 73.96%], valid : [loss = 0.814, top1 = 71.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 5999/15625) 005999-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.77%], valid : [loss = 0.860, top1 = 71.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10        train : [loss = 0.554, top1 = 80.67%], test  : [loss = 0.715, top1 = 75.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.09 ms.
cifar100       train : [loss = 1.770, top1 = 52.40%], valid : [loss = 2.056, top1 = 46.96%], test : [loss = 2.061, top1 = 46.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.88%], valid : [loss = 3.645, top1 = 16.67%], test : [loss = 3.665, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6000/15625) 006000-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.57%], valid : [loss = 0.855, top1 = 72.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10        train : [loss = 0.549, top1 = 80.83%], test  : [loss = 0.709, top1 = 76.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.72 ms.
cifar100       train : [loss = 1.771, top1 = 52.26%], valid : [loss = 2.048, top1 = 47.26%], test : [loss = 2.066, top1 = 46.81%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.88%], valid : [loss = 3.637, top1 = 16.76%], test : [loss = 3.672, top1 = 15.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6001/15625) 006001-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.60%], valid : [loss = 0.837, top1 = 71.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.664, top1 = 76.80%], test  : [loss = 0.758, top1 = 74.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 1.949, top1 = 47.99%], valid : [loss = 2.116, top1 = 44.87%], test : [loss = 2.136, top1 = 44.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.84%], valid : [loss = 3.666, top1 = 16.16%], test : [loss = 3.692, top1 = 15.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6002/15625) 006002-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.67 ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.99%], valid : [loss = 0.709, top1 = 75.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.35 ms.
cifar10        train : [loss = 0.552, top1 = 81.03%], test  : [loss = 0.610, top1 = 79.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.23 ms.
cifar100       train : [loss = 1.951, top1 = 47.60%], valid : [loss = 2.096, top1 = 44.93%], test : [loss = 2.073, top1 = 44.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.13 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.28%], valid : [loss = 3.217, top1 = 22.83%], test : [loss = 3.237, top1 = 22.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 54.01%], valid : [loss = 1.347, top1 = 51.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6003/15625) 006003-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.50 ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.47%], valid : [loss = 0.752, top1 = 74.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.83 ms.
cifar10        train : [loss = 0.488, top1 = 82.98%], test  : [loss = 0.568, top1 = 80.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.961, top1 = 46.48%], valid : [loss = 2.087, top1 = 44.16%], test : [loss = 2.099, top1 = 44.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.027, top1 = 26.07%], valid : [loss = 3.007, top1 = 26.94%], test : [loss = 3.048, top1 = 25.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.17%], valid : [loss = 1.218, top1 = 56.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6004/15625) 006004-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.154, top1 = 94.75%], valid : [loss = 0.716, top1 = 80.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.192, top1 = 93.36%], test  : [loss = 0.513, top1 = 84.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.879, top1 = 74.42%], valid : [loss = 1.628, top1 = 57.89%], test : [loss = 1.664, top1 = 57.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 3.511, top1 = 16.65%], valid : [loss = 3.512, top1 = 17.27%], test : [loss = 3.508, top1 = 16.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.346, top1 = 50.66%], valid : [loss = 1.367, top1 = 49.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6005/15625) 006005-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.46%], valid : [loss = 0.526, top1 = 84.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.212, top1 = 92.79%], test  : [loss = 0.403, top1 = 87.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.80 ms.
cifar100       train : [loss = 1.275, top1 = 63.73%], valid : [loss = 1.565, top1 = 56.91%], test : [loss = 1.570, top1 = 56.97%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.730, top1 = 31.95%], valid : [loss = 2.765, top1 = 31.21%], test : [loss = 2.793, top1 = 30.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.38%], valid : [loss = 1.001, top1 = 64.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6006/15625) 006006-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.451, top1 = 90.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.45 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.320, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.88 ms.
cifar100       train : [loss = 0.074, top1 = 98.80%], valid : [loss = 1.412, top1 = 69.50%], test : [loss = 1.369, top1 = 70.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 1.620, top1 = 56.43%], valid : [loss = 2.293, top1 = 42.56%], test : [loss = 2.324, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.46%], valid : [loss = 0.584, top1 = 80.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6007/15625) 006007-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.566, top1 = 88.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.350, top1 = 91.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.70 ms.
cifar100       train : [loss = 0.289, top1 = 91.94%], valid : [loss = 1.321, top1 = 67.47%], test : [loss = 1.342, top1 = 66.97%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.23%], valid : [loss = 2.418, top1 = 38.59%], test : [loss = 2.422, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6008/15625) 006008-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.580, top1 = 88.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.400, top1 = 91.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.154, top1 = 96.67%], valid : [loss = 1.487, top1 = 66.33%], test : [loss = 1.472, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.006, top1 = 47.43%], valid : [loss = 2.454, top1 = 38.71%], test : [loss = 2.457, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.44%], valid : [loss = 0.729, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6009/15625) 006009-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.533, top1 = 89.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.67 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.340, top1 = 92.59%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.07 ms.
cifar100       train : [loss = 0.095, top1 = 98.16%], valid : [loss = 1.322, top1 = 69.85%], test : [loss = 1.337, top1 = 69.34%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.54 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.74%], valid : [loss = 2.371, top1 = 39.39%], test : [loss = 2.372, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 68.85%], valid : [loss = 0.894, top1 = 68.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6010/15625) 006010-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.15%], valid : [loss = 0.709, top1 = 76.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.68 ms.
cifar10        train : [loss = 0.440, top1 = 84.57%], test  : [loss = 0.574, top1 = 80.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.44 ms.
cifar100       train : [loss = 1.794, top1 = 51.18%], valid : [loss = 1.981, top1 = 47.41%], test : [loss = 1.979, top1 = 47.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 3.436, top1 = 18.93%], valid : [loss = 3.432, top1 = 19.34%], test : [loss = 3.463, top1 = 18.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.247, top1 = 54.68%], valid : [loss = 1.290, top1 = 53.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6011/15625) 006011-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.519, top1 = 88.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.325, top1 = 92.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.65 ms.
cifar100       train : [loss = 0.327, top1 = 91.12%], valid : [loss = 1.274, top1 = 67.57%], test : [loss = 1.293, top1 = 67.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.76%], valid : [loss = 2.417, top1 = 39.11%], test : [loss = 2.410, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6012/15625) 006012-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.59%], valid : [loss = 0.592, top1 = 86.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10        train : [loss = 0.041, top1 = 98.78%], test  : [loss = 0.402, top1 = 90.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.69 ms.
cifar100       train : [loss = 0.556, top1 = 83.53%], valid : [loss = 1.404, top1 = 64.23%], test : [loss = 1.411, top1 = 64.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.00%], valid : [loss = 2.620, top1 = 34.14%], test : [loss = 2.662, top1 = 34.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.51%], valid : [loss = 0.638, top1 = 78.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6013/15625) 006013-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.472, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.70 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.317, top1 = 92.40%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.90 ms.
cifar100       train : [loss = 0.226, top1 = 94.49%], valid : [loss = 1.242, top1 = 68.95%], test : [loss = 1.241, top1 = 68.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.63%], valid : [loss = 2.265, top1 = 42.47%], test : [loss = 2.278, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.33%], valid : [loss = 0.649, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6014/15625) 006014-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.09%], valid : [loss = 0.480, top1 = 84.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10        train : [loss = 0.295, top1 = 90.14%], test  : [loss = 0.396, top1 = 86.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 1.321, top1 = 63.34%], valid : [loss = 1.550, top1 = 57.81%], test : [loss = 1.501, top1 = 58.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.91%], valid : [loss = 2.895, top1 = 29.83%], test : [loss = 2.944, top1 = 28.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6015/15625) 006015-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.535, top1 = 88.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.344, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.25 ms.
cifar100       train : [loss = 0.250, top1 = 93.20%], valid : [loss = 1.305, top1 = 68.15%], test : [loss = 1.312, top1 = 68.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.170, top1 = 43.58%], valid : [loss = 2.410, top1 = 38.53%], test : [loss = 2.423, top1 = 38.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.73%], valid : [loss = 0.968, top1 = 65.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6016/15625) 006016-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.91%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.00 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.92%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.44 ms.
cifar100       train : [loss = 0.064, top1 = 99.06%], valid : [loss = 1.331, top1 = 70.43%], test : [loss = 1.324, top1 = 70.97%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 1.531, top1 = 58.66%], valid : [loss = 2.248, top1 = 43.63%], test : [loss = 2.273, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.362, top1 = 87.56%], valid : [loss = 0.499, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6017/15625) 006017-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.613, top1 = 86.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.387, top1 = 90.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.516, top1 = 84.94%], valid : [loss = 1.432, top1 = 63.73%], test : [loss = 1.424, top1 = 63.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.24%], valid : [loss = 2.536, top1 = 35.92%], test : [loss = 2.575, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.86%], valid : [loss = 0.875, top1 = 69.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6018/15625) 006018-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.44%], valid : [loss = 0.532, top1 = 84.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10        train : [loss = 0.172, top1 = 94.26%], test  : [loss = 0.379, top1 = 87.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.40 ms.
cifar100       train : [loss = 1.160, top1 = 66.75%], valid : [loss = 1.508, top1 = 58.70%], test : [loss = 1.474, top1 = 59.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.08 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.83%], valid : [loss = 2.693, top1 = 32.92%], test : [loss = 2.719, top1 = 32.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.42%], valid : [loss = 0.958, top1 = 66.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6019/15625) 006019-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.478, top1 = 90.22%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.42 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.308, top1 = 93.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.38 ms.
cifar100       train : [loss = 0.070, top1 = 98.92%], valid : [loss = 1.311, top1 = 70.61%], test : [loss = 1.298, top1 = 70.59%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.13%], valid : [loss = 2.161, top1 = 44.22%], test : [loss = 2.175, top1 = 44.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.21%], valid : [loss = 0.741, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6020/15625) 006020-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.465, top1 = 89.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.78 ms.
cifar100       train : [loss = 0.320, top1 = 91.41%], valid : [loss = 1.243, top1 = 67.97%], test : [loss = 1.241, top1 = 67.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.79%], valid : [loss = 2.303, top1 = 41.29%], test : [loss = 2.343, top1 = 41.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 82.94%], valid : [loss = 0.573, top1 = 80.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6021/15625) 006021-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.27%], valid : [loss = 0.843, top1 = 72.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.51 ms.
cifar10        train : [loss = 0.556, top1 = 80.58%], test  : [loss = 0.717, top1 = 75.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.93 ms.
cifar100       train : [loss = 1.777, top1 = 52.08%], valid : [loss = 2.049, top1 = 47.01%], test : [loss = 2.065, top1 = 46.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.82%], valid : [loss = 3.637, top1 = 16.29%], test : [loss = 3.657, top1 = 15.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6022/15625) 006022-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.489, top1 = 90.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.98 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.301, top1 = 93.60%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.01 ms.
cifar100       train : [loss = 0.055, top1 = 99.33%], valid : [loss = 1.296, top1 = 70.46%], test : [loss = 1.286, top1 = 70.77%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.66 ms.
ImageNet16-120 train : [loss = 1.619, top1 = 56.44%], valid : [loss = 2.163, top1 = 44.27%], test : [loss = 2.197, top1 = 44.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.34%], valid : [loss = 0.694, top1 = 76.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6023/15625) 006023-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.611, top1 = 87.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.411, top1 = 91.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 0.141, top1 = 96.89%], valid : [loss = 1.562, top1 = 66.16%], test : [loss = 1.556, top1 = 65.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.021, top1 = 47.27%], valid : [loss = 2.479, top1 = 37.38%], test : [loss = 2.497, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.74%], valid : [loss = 0.797, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6024/15625) 006024-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.53%], valid : [loss = 0.548, top1 = 83.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.79 ms.
cifar10        train : [loss = 0.224, top1 = 92.31%], test  : [loss = 0.409, top1 = 86.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.83 ms.
cifar100       train : [loss = 1.334, top1 = 62.20%], valid : [loss = 1.608, top1 = 56.35%], test : [loss = 1.609, top1 = 55.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.721, top1 = 32.17%], valid : [loss = 2.739, top1 = 31.86%], test : [loss = 2.790, top1 = 31.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.07%], valid : [loss = 0.968, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6025/15625) 006025-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.042, top1 = 99.00%], valid : [loss = 0.725, top1 = 83.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.02 ms.
cifar10        train : [loss = 0.085, top1 = 97.24%], test  : [loss = 0.486, top1 = 87.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 0.834, top1 = 75.66%], valid : [loss = 1.557, top1 = 59.69%], test : [loss = 1.549, top1 = 59.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.818, top1 = 30.32%], valid : [loss = 2.927, top1 = 28.51%], test : [loss = 2.984, top1 = 27.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.09%], valid : [loss = 0.883, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6026/15625) 006026-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.336, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.50 ms.
cifar100       train : [loss = 0.341, top1 = 90.67%], valid : [loss = 1.274, top1 = 67.51%], test : [loss = 1.285, top1 = 67.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.73%], valid : [loss = 2.393, top1 = 39.84%], test : [loss = 2.392, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6027/15625) 006027-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.515, top1 = 88.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.357, top1 = 91.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.56 ms.
cifar100       train : [loss = 0.481, top1 = 85.89%], valid : [loss = 1.335, top1 = 65.71%], test : [loss = 1.327, top1 = 66.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.27%], valid : [loss = 2.515, top1 = 37.04%], test : [loss = 2.540, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6028/15625) 006028-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.535, top1 = 88.51%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.28 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.334, top1 = 92.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.21 ms.
cifar100       train : [loss = 0.174, top1 = 95.56%], valid : [loss = 1.372, top1 = 68.04%], test : [loss = 1.359, top1 = 68.25%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 38.79%], valid : [loss = 2.535, top1 = 35.73%], test : [loss = 2.536, top1 = 36.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.33%], valid : [loss = 0.873, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6029/15625) 006029-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.50%], valid : [loss = 0.851, top1 = 72.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10        train : [loss = 0.559, top1 = 80.44%], test  : [loss = 0.716, top1 = 75.66%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.10 ms.
cifar100       train : [loss = 1.766, top1 = 52.39%], valid : [loss = 2.042, top1 = 47.18%], test : [loss = 2.045, top1 = 47.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.80%], valid : [loss = 3.642, top1 = 16.35%], test : [loss = 3.669, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6030/15625) 006030-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.556, top1 = 89.24%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.53 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.349, top1 = 92.80%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.71 ms.
cifar100       train : [loss = 0.126, top1 = 97.36%], valid : [loss = 1.365, top1 = 68.23%], test : [loss = 1.346, top1 = 68.67%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.99 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.92%], valid : [loss = 2.306, top1 = 40.88%], test : [loss = 2.306, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.88%], valid : [loss = 0.739, top1 = 74.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6031/15625) 006031-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.450, top1 = 89.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.312, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 0.319, top1 = 91.39%], valid : [loss = 1.325, top1 = 66.99%], test : [loss = 1.320, top1 = 67.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.44%], valid : [loss = 2.354, top1 = 40.13%], test : [loss = 2.413, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.553, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6032/15625) 006032-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.53%], valid : [loss = 0.628, top1 = 86.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.385, top1 = 90.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.16 ms.
cifar100       train : [loss = 0.541, top1 = 84.12%], valid : [loss = 1.445, top1 = 63.58%], test : [loss = 1.413, top1 = 63.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.16%], valid : [loss = 2.557, top1 = 35.47%], test : [loss = 2.577, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.68%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6033/15625) 006033-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.536, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.373, top1 = 92.10%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.04 ms.
cifar100       train : [loss = 0.147, top1 = 96.64%], valid : [loss = 1.417, top1 = 67.08%], test : [loss = 1.439, top1 = 67.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 2.218, top1 = 42.46%], valid : [loss = 2.469, top1 = 36.87%], test : [loss = 2.453, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 62.71%], valid : [loss = 1.061, top1 = 62.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6034/15625) 006034-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.506, top1 = 88.76%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.323, top1 = 92.12%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.55 ms.
cifar100       train : [loss = 0.342, top1 = 90.68%], valid : [loss = 1.268, top1 = 67.10%], test : [loss = 1.293, top1 = 66.86%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.81%], valid : [loss = 2.400, top1 = 38.95%], test : [loss = 2.413, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.94%], valid : [loss = 0.669, top1 = 76.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6035/15625) 006035-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.39%], valid : [loss = 0.635, top1 = 85.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.055, top1 = 98.37%], test  : [loss = 0.413, top1 = 89.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.13 ms.
cifar100       train : [loss = 0.655, top1 = 81.02%], valid : [loss = 1.376, top1 = 63.77%], test : [loss = 1.387, top1 = 63.97%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.463, top1 = 37.54%], valid : [loss = 2.607, top1 = 35.33%], test : [loss = 2.626, top1 = 34.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 73.01%], valid : [loss = 0.823, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6036/15625) 006036-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.653, top1 = 86.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.74 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.423, top1 = 90.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.98 ms.
cifar100       train : [loss = 0.242, top1 = 94.04%], valid : [loss = 1.567, top1 = 64.66%], test : [loss = 1.571, top1 = 63.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.88%], valid : [loss = 2.492, top1 = 37.65%], test : [loss = 2.500, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.50%], valid : [loss = 0.776, top1 = 72.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6037/15625) 006037-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.73%], valid : [loss = 0.853, top1 = 71.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.559, top1 = 80.45%], test  : [loss = 0.712, top1 = 75.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.07 ms.
cifar100       train : [loss = 1.773, top1 = 52.19%], valid : [loss = 2.043, top1 = 47.29%], test : [loss = 2.056, top1 = 47.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.96%], valid : [loss = 3.635, top1 = 16.33%], test : [loss = 3.660, top1 = 16.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6038/15625) 006038-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.559, top1 = 88.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.41 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.373, top1 = 92.10%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.37 ms.
cifar100       train : [loss = 0.123, top1 = 97.64%], valid : [loss = 1.472, top1 = 67.44%], test : [loss = 1.492, top1 = 67.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.58%], valid : [loss = 2.443, top1 = 39.17%], test : [loss = 2.435, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.04%], valid : [loss = 0.784, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6039/15625) 006039-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.574, top1 = 88.55%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.361, top1 = 92.75%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.76 ms.
cifar100       train : [loss = 0.073, top1 = 98.86%], valid : [loss = 1.464, top1 = 68.84%], test : [loss = 1.449, top1 = 68.50%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.01%], valid : [loss = 2.359, top1 = 40.97%], test : [loss = 2.374, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 76.97%], valid : [loss = 0.731, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6040/15625) 006040-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.15 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.45 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.34 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6041/15625) 006041-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.65 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.63%], valid : [loss = 0.462, top1 = 86.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.79 ms.
cifar10        train : [loss = 0.115, top1 = 96.45%], test  : [loss = 0.327, top1 = 89.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.08 ms.
cifar100       train : [loss = 0.754, top1 = 78.91%], valid : [loss = 1.264, top1 = 65.00%], test : [loss = 1.264, top1 = 65.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.50 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 37.00%], valid : [loss = 2.586, top1 = 35.13%], test : [loss = 2.579, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.76%], valid : [loss = 0.859, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6042/15625) 006042-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.506, top1 = 88.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.343, top1 = 91.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.60 ms.
cifar100       train : [loss = 0.321, top1 = 91.33%], valid : [loss = 1.256, top1 = 67.95%], test : [loss = 1.276, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.64%], valid : [loss = 2.347, top1 = 39.68%], test : [loss = 2.350, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.78%], valid : [loss = 0.641, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6043/15625) 006043-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.161, top1 = 94.69%], valid : [loss = 0.898, top1 = 76.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10        train : [loss = 0.228, top1 = 92.20%], test  : [loss = 0.628, top1 = 81.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.50 ms.
cifar100       train : [loss = 1.149, top1 = 67.34%], valid : [loss = 1.807, top1 = 53.18%], test : [loss = 1.787, top1 = 54.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.76%], valid : [loss = 3.342, top1 = 21.23%], test : [loss = 3.375, top1 = 20.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.060, top1 = 61.93%], valid : [loss = 1.119, top1 = 59.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6044/15625) 006044-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.475, top1 = 89.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.41 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.316, top1 = 92.15%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.39 ms.
cifar100       train : [loss = 0.260, top1 = 93.41%], valid : [loss = 1.222, top1 = 68.58%], test : [loss = 1.240, top1 = 68.65%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.34 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.78%], valid : [loss = 2.200, top1 = 43.20%], test : [loss = 2.226, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.629, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6045/15625) 006045-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.501, top1 = 89.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.20 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.328, top1 = 92.72%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.23 ms.
cifar100       train : [loss = 0.158, top1 = 96.70%], valid : [loss = 1.315, top1 = 68.34%], test : [loss = 1.306, top1 = 68.75%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.65 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.20%], valid : [loss = 2.285, top1 = 41.37%], test : [loss = 2.311, top1 = 42.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.45%], valid : [loss = 0.729, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6046/15625) 006046-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.581, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.395, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.401, top1 = 88.69%], valid : [loss = 1.390, top1 = 65.20%], test : [loss = 1.392, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.98%], valid : [loss = 2.492, top1 = 37.44%], test : [loss = 2.531, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6047/15625) 006047-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.69%], valid : [loss = 0.895, top1 = 68.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.731, top1 = 74.13%], test  : [loss = 0.788, top1 = 72.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 2.361, top1 = 38.47%], valid : [loss = 2.482, top1 = 36.25%], test : [loss = 2.481, top1 = 36.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 3.546, top1 = 17.23%], valid : [loss = 3.527, top1 = 18.00%], test : [loss = 3.563, top1 = 16.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 46.60%], valid : [loss = 1.500, top1 = 44.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6048/15625) 006048-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.44%], valid : [loss = 0.643, top1 = 85.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10        train : [loss = 0.049, top1 = 98.55%], test  : [loss = 0.423, top1 = 88.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.80 ms.
cifar100       train : [loss = 0.639, top1 = 81.43%], valid : [loss = 1.386, top1 = 63.57%], test : [loss = 1.382, top1 = 64.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.41%], valid : [loss = 2.614, top1 = 35.08%], test : [loss = 2.632, top1 = 34.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.42%], valid : [loss = 0.837, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6049/15625) 006049-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.90%], valid : [loss = 0.560, top1 = 85.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10        train : [loss = 0.062, top1 = 98.21%], test  : [loss = 0.361, top1 = 90.19%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.16 ms.
cifar100       train : [loss = 0.605, top1 = 82.55%], valid : [loss = 1.354, top1 = 64.26%], test : [loss = 1.375, top1 = 63.68%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 38.88%], valid : [loss = 2.514, top1 = 36.32%], test : [loss = 2.535, top1 = 35.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.39%], valid : [loss = 0.878, top1 = 69.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6050/15625) 006050-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.567, top1 = 87.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10        train : [loss = 0.029, top1 = 99.16%], test  : [loss = 0.354, top1 = 91.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.21 ms.
cifar100       train : [loss = 0.570, top1 = 83.61%], valid : [loss = 1.385, top1 = 63.64%], test : [loss = 1.372, top1 = 63.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 35.79%], valid : [loss = 2.602, top1 = 34.53%], test : [loss = 2.624, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.80%], valid : [loss = 0.906, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6051/15625) 006051-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.535, top1 = 89.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.352, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.64 ms.
cifar100       train : [loss = 0.081, top1 = 98.73%], valid : [loss = 1.447, top1 = 68.71%], test : [loss = 1.438, top1 = 68.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 1.777, top1 = 52.73%], valid : [loss = 2.360, top1 = 41.43%], test : [loss = 2.372, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.00%], valid : [loss = 0.708, top1 = 75.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6052/15625) 006052-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.572, top1 = 87.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.381, top1 = 91.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.06 ms.
cifar100       train : [loss = 0.368, top1 = 89.69%], valid : [loss = 1.423, top1 = 65.44%], test : [loss = 1.399, top1 = 65.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.29%], valid : [loss = 2.506, top1 = 37.37%], test : [loss = 2.534, top1 = 37.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.97%], valid : [loss = 0.774, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6053/15625) 006053-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.457, top1 = 89.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.325, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.17 ms.
cifar100       train : [loss = 0.198, top1 = 95.15%], valid : [loss = 1.362, top1 = 67.77%], test : [loss = 1.374, top1 = 67.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.58%], valid : [loss = 2.311, top1 = 41.15%], test : [loss = 2.346, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.45%], valid : [loss = 0.574, top1 = 80.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6054/15625) 006054-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.35%], valid : [loss = 0.609, top1 = 85.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.075, top1 = 97.69%], test  : [loss = 0.415, top1 = 88.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.719, top1 = 79.11%], valid : [loss = 1.412, top1 = 63.10%], test : [loss = 1.358, top1 = 63.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 36.00%], valid : [loss = 2.646, top1 = 33.53%], test : [loss = 2.688, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.24%], valid : [loss = 0.786, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6055/15625) 006055-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.441, top1 = 89.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.76 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.303, top1 = 92.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.78 ms.
cifar100       train : [loss = 0.180, top1 = 95.92%], valid : [loss = 1.273, top1 = 69.41%], test : [loss = 1.280, top1 = 69.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.20%], valid : [loss = 2.245, top1 = 42.98%], test : [loss = 2.256, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.415, top1 = 85.73%], valid : [loss = 0.535, top1 = 82.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6056/15625) 006056-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.578, top1 = 87.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10        train : [loss = 0.020, top1 = 99.45%], test  : [loss = 0.374, top1 = 91.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.77 ms.
cifar100       train : [loss = 0.278, top1 = 92.09%], valid : [loss = 1.431, top1 = 66.23%], test : [loss = 1.427, top1 = 65.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 32.43%], valid : [loss = 2.781, top1 = 29.90%], test : [loss = 2.786, top1 = 29.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.51%], valid : [loss = 1.096, top1 = 60.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6057/15625) 006057-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.94%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.328, top1 = 93.13%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.55 ms.
cifar100       train : [loss = 0.071, top1 = 98.93%], valid : [loss = 1.366, top1 = 69.00%], test : [loss = 1.372, top1 = 69.46%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.43 ms.
ImageNet16-120 train : [loss = 1.775, top1 = 52.75%], valid : [loss = 2.295, top1 = 41.75%], test : [loss = 2.271, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.58%], valid : [loss = 0.744, top1 = 73.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6058/15625) 006058-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=137.54 M, Params=0.964 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.533, top1 = 89.34%]
cifar10        FLOP=137.54 M, Params=0.964 MB, latency=18.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.357, top1 = 92.84%]
cifar100       FLOP=137.55 M, Params=0.970 MB, latency=19.14 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.447, top1 = 68.46%], test : [loss = 1.456, top1 = 68.47%]
ImageNet16-120 FLOP= 34.39 M, Params=0.972 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.749, top1 = 53.40%], valid : [loss = 2.378, top1 = 40.47%], test : [loss = 2.390, top1 = 41.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.42%], valid : [loss = 0.687, top1 = 76.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6059/15625) 006059-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.554, top1 = 88.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.360, top1 = 91.66%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.66 ms.
cifar100       train : [loss = 0.290, top1 = 91.85%], valid : [loss = 1.303, top1 = 67.40%], test : [loss = 1.339, top1 = 67.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.01%], valid : [loss = 2.435, top1 = 38.53%], test : [loss = 2.438, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6060/15625) 006060-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.210, top1 = 93.03%], valid : [loss = 0.493, top1 = 84.31%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10        train : [loss = 0.209, top1 = 92.93%], test  : [loss = 0.373, top1 = 87.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.74 ms.
cifar100       train : [loss = 1.282, top1 = 64.02%], valid : [loss = 1.563, top1 = 57.08%], test : [loss = 1.557, top1 = 56.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.976, top1 = 26.81%], valid : [loss = 2.982, top1 = 27.50%], test : [loss = 3.009, top1 = 25.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6061/15625) 006061-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.510, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.321, top1 = 92.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.65 ms.
cifar100       train : [loss = 0.238, top1 = 93.83%], valid : [loss = 1.248, top1 = 68.51%], test : [loss = 1.270, top1 = 68.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.65%], valid : [loss = 2.249, top1 = 43.10%], test : [loss = 2.249, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.60%], valid : [loss = 0.624, top1 = 78.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6062/15625) 006062-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.77%], valid : [loss = 0.793, top1 = 82.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10        train : [loss = 0.085, top1 = 97.30%], test  : [loss = 0.477, top1 = 87.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.803, top1 = 76.65%], valid : [loss = 1.505, top1 = 60.94%], test : [loss = 1.502, top1 = 60.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.824, top1 = 30.24%], valid : [loss = 2.951, top1 = 28.53%], test : [loss = 2.991, top1 = 27.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.09%], valid : [loss = 0.883, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6063/15625) 006063-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.507, top1 = 89.77%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.23 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.337, top1 = 93.19%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.13 ms.
cifar100       train : [loss = 0.069, top1 = 98.94%], valid : [loss = 1.371, top1 = 68.50%], test : [loss = 1.384, top1 = 69.68%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.70%], valid : [loss = 2.378, top1 = 39.37%], test : [loss = 2.398, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6064/15625) 006064-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.45%], valid : [loss = 0.434, top1 = 88.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.22 ms.
cifar10        train : [loss = 0.053, top1 = 98.74%], test  : [loss = 0.313, top1 = 90.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.19 ms.
cifar100       train : [loss = 0.541, top1 = 85.30%], valid : [loss = 1.209, top1 = 67.44%], test : [loss = 1.219, top1 = 66.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 42.13%], valid : [loss = 2.446, top1 = 38.07%], test : [loss = 2.462, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.40%], valid : [loss = 0.631, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6065/15625) 006065-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.13%], valid : [loss = 0.577, top1 = 86.63%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.26 ms.
cifar10        train : [loss = 0.063, top1 = 97.94%], test  : [loss = 0.363, top1 = 90.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 0.704, top1 = 79.36%], valid : [loss = 1.350, top1 = 63.30%], test : [loss = 1.342, top1 = 63.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.79%], valid : [loss = 2.502, top1 = 36.43%], test : [loss = 2.486, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6066/15625) 006066-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.580, top1 = 87.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.393, top1 = 91.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.48 ms.
cifar100       train : [loss = 0.196, top1 = 95.44%], valid : [loss = 1.464, top1 = 66.33%], test : [loss = 1.433, top1 = 66.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.44%], valid : [loss = 2.429, top1 = 39.05%], test : [loss = 2.467, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.92%], valid : [loss = 0.692, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6067/15625) 006067-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.433, top1 = 90.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.290, top1 = 93.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.93 ms.
cifar100       train : [loss = 0.097, top1 = 98.38%], valid : [loss = 1.325, top1 = 69.30%], test : [loss = 1.306, top1 = 69.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 1.638, top1 = 56.06%], valid : [loss = 2.190, top1 = 43.97%], test : [loss = 2.213, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 84.96%], valid : [loss = 0.548, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6068/15625) 006068-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.492, top1 = 88.98%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.303, top1 = 92.30%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.58 ms.
cifar100       train : [loss = 0.245, top1 = 93.93%], valid : [loss = 1.190, top1 = 69.46%], test : [loss = 1.172, top1 = 69.72%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.69%], valid : [loss = 2.236, top1 = 42.47%], test : [loss = 2.239, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 81.01%], valid : [loss = 0.632, top1 = 78.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6069/15625) 006069-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.21 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.78%], valid : [loss = 0.721, top1 = 83.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10        train : [loss = 0.087, top1 = 97.16%], test  : [loss = 0.462, top1 = 87.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.51 ms.
cifar100       train : [loss = 0.796, top1 = 76.74%], valid : [loss = 1.526, top1 = 60.84%], test : [loss = 1.509, top1 = 60.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 2.802, top1 = 30.47%], valid : [loss = 2.927, top1 = 28.17%], test : [loss = 2.978, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6070/15625) 006070-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.76%], valid : [loss = 0.464, top1 = 86.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.148, top1 = 95.20%], test  : [loss = 0.340, top1 = 88.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.46 ms.
cifar100       train : [loss = 0.997, top1 = 71.84%], valid : [loss = 1.372, top1 = 61.56%], test : [loss = 1.358, top1 = 61.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 33.99%], valid : [loss = 2.666, top1 = 33.07%], test : [loss = 2.681, top1 = 31.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6071/15625) 006071-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.98%], valid : [loss = 0.836, top1 = 72.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10        train : [loss = 0.568, top1 = 80.20%], test  : [loss = 0.711, top1 = 75.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 1.782, top1 = 51.87%], valid : [loss = 2.051, top1 = 47.52%], test : [loss = 2.063, top1 = 46.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 3.600, top1 = 16.54%], valid : [loss = 3.662, top1 = 16.40%], test : [loss = 3.683, top1 = 15.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6072/15625) 006072-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.41%], valid : [loss = 0.599, top1 = 86.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.041, top1 = 98.82%], test  : [loss = 0.370, top1 = 90.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.88 ms.
cifar100       train : [loss = 0.602, top1 = 82.24%], valid : [loss = 1.358, top1 = 64.44%], test : [loss = 1.373, top1 = 65.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.38%], valid : [loss = 2.532, top1 = 36.07%], test : [loss = 2.551, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.89%], valid : [loss = 0.859, top1 = 69.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6073/15625) 006073-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.516, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.49 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.334, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.06 ms.
cifar100       train : [loss = 0.135, top1 = 97.30%], valid : [loss = 1.272, top1 = 70.12%], test : [loss = 1.309, top1 = 68.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.40%], valid : [loss = 2.324, top1 = 41.13%], test : [loss = 2.275, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.28%], valid : [loss = 0.695, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6074/15625) 006074-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.528, top1 = 89.73%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.33 ms.
cifar100       train : [loss = 0.131, top1 = 97.26%], valid : [loss = 1.361, top1 = 68.20%], test : [loss = 1.347, top1 = 69.46%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.50%], valid : [loss = 2.219, top1 = 42.80%], test : [loss = 2.207, top1 = 43.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.73%], valid : [loss = 0.700, top1 = 75.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6075/15625) 006075-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.819, top1 = 71.07%], valid : [loss = 0.996, top1 = 65.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.773, top1 = 72.79%], test  : [loss = 0.876, top1 = 69.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.21 ms.
cifar100       train : [loss = 2.113, top1 = 44.45%], valid : [loss = 2.301, top1 = 41.02%], test : [loss = 2.338, top1 = 40.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.32%], valid : [loss = 3.758, top1 = 15.33%], test : [loss = 3.775, top1 = 13.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.449, top1 = 47.06%], valid : [loss = 1.471, top1 = 46.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6076/15625) 006076-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.318, top1 = 89.04%], valid : [loss = 0.572, top1 = 81.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.79 ms.
cifar10        train : [loss = 0.250, top1 = 91.41%], test  : [loss = 0.415, top1 = 86.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.22 ms.
cifar100       train : [loss = 1.448, top1 = 59.37%], valid : [loss = 1.688, top1 = 53.49%], test : [loss = 1.678, top1 = 54.11%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.885, top1 = 28.85%], valid : [loss = 2.911, top1 = 28.63%], test : [loss = 2.943, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.006, top1 = 63.94%], valid : [loss = 1.059, top1 = 62.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6077/15625) 006077-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.39%], valid : [loss = 0.561, top1 = 87.08%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.77 ms.
cifar10        train : [loss = 0.046, top1 = 98.61%], test  : [loss = 0.370, top1 = 90.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.99 ms.
cifar100       train : [loss = 0.556, top1 = 83.77%], valid : [loss = 1.322, top1 = 65.66%], test : [loss = 1.311, top1 = 64.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.01%], valid : [loss = 2.434, top1 = 38.07%], test : [loss = 2.454, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.25%], valid : [loss = 0.734, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6078/15625) 006078-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.446, top1 = 90.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.302, top1 = 93.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.38 ms.
cifar100       train : [loss = 0.082, top1 = 98.60%], valid : [loss = 1.367, top1 = 69.46%], test : [loss = 1.369, top1 = 69.61%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 1.582, top1 = 57.47%], valid : [loss = 2.272, top1 = 43.47%], test : [loss = 2.293, top1 = 43.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.59%], valid : [loss = 0.505, top1 = 82.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6079/15625) 006079-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10-valid  train : [loss = 1.230, top1 = 55.77%], valid : [loss = 1.281, top1 = 54.37%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.30 ms.
cifar10        train : [loss = 1.236, top1 = 55.72%], test  : [loss = 1.235, top1 = 55.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.29 ms.
cifar100       train : [loss = 2.697, top1 = 32.42%], valid : [loss = 2.777, top1 = 31.10%], test : [loss = 2.756, top1 = 31.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.60 ms.
ImageNet16-120 train : [loss = 3.864, top1 = 12.51%], valid : [loss = 3.859, top1 = 13.25%], test : [loss = 3.880, top1 = 12.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6080/15625) 006080-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.535, top1 = 88.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.357, top1 = 92.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.58 ms.
cifar100       train : [loss = 0.162, top1 = 96.07%], valid : [loss = 1.401, top1 = 67.22%], test : [loss = 1.414, top1 = 68.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.52%], valid : [loss = 2.368, top1 = 39.93%], test : [loss = 2.361, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.29%], valid : [loss = 0.946, top1 = 66.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6081/15625) 006081-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.150, top1 = 95.19%], valid : [loss = 0.505, top1 = 85.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.166, top1 = 94.44%], test  : [loss = 0.370, top1 = 88.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.82 ms.
cifar100       train : [loss = 1.040, top1 = 70.24%], valid : [loss = 1.397, top1 = 61.87%], test : [loss = 1.393, top1 = 61.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.95 ms.
ImageNet16-120 train : [loss = 2.590, top1 = 34.89%], valid : [loss = 2.637, top1 = 34.46%], test : [loss = 2.670, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.44%], valid : [loss = 0.917, top1 = 67.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6082/15625) 006082-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.99%], valid : [loss = 0.438, top1 = 89.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.310, top1 = 92.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.73 ms.
cifar100       train : [loss = 0.124, top1 = 97.64%], valid : [loss = 1.278, top1 = 70.22%], test : [loss = 1.289, top1 = 69.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.721, top1 = 54.08%], valid : [loss = 2.245, top1 = 43.13%], test : [loss = 2.236, top1 = 44.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.61%], valid : [loss = 0.556, top1 = 81.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6083/15625) 006083-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.88 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.30%], valid : [loss = 0.852, top1 = 71.96%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10        train : [loss = 0.564, top1 = 80.32%], test  : [loss = 0.713, top1 = 75.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.63 ms.
cifar100       train : [loss = 1.780, top1 = 51.89%], valid : [loss = 2.069, top1 = 46.62%], test : [loss = 2.064, top1 = 46.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.85%], valid : [loss = 3.619, top1 = 16.97%], test : [loss = 3.659, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6084/15625) 006084-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.70 ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.52%], valid : [loss = 0.755, top1 = 74.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.55 ms.
cifar10        train : [loss = 0.536, top1 = 81.48%], test  : [loss = 0.611, top1 = 79.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.85 ms.
cifar100       train : [loss = 1.945, top1 = 47.59%], valid : [loss = 2.068, top1 = 45.21%], test : [loss = 2.083, top1 = 44.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 2.991, top1 = 26.90%], valid : [loss = 2.975, top1 = 27.44%], test : [loss = 3.012, top1 = 26.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 59.54%], valid : [loss = 1.178, top1 = 57.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6085/15625) 006085-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.529, top1 = 88.77%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.05 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.342, top1 = 92.17%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=22.07 ms.
cifar100       train : [loss = 0.192, top1 = 95.56%], valid : [loss = 1.219, top1 = 70.16%], test : [loss = 1.231, top1 = 70.06%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.77%], valid : [loss = 2.147, top1 = 44.70%], test : [loss = 2.204, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.84%], valid : [loss = 0.684, top1 = 76.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6086/15625) 006086-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.36%], valid : [loss = 0.579, top1 = 86.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.34 ms.
cifar10        train : [loss = 0.088, top1 = 97.15%], test  : [loss = 0.380, top1 = 89.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.57 ms.
cifar100       train : [loss = 0.763, top1 = 77.58%], valid : [loss = 1.335, top1 = 63.92%], test : [loss = 1.320, top1 = 64.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.471, top1 = 37.08%], valid : [loss = 2.579, top1 = 34.60%], test : [loss = 2.606, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.30%], valid : [loss = 0.813, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6087/15625) 006087-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.49%], valid : [loss = 0.470, top1 = 85.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.159, top1 = 94.82%], test  : [loss = 0.345, top1 = 88.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 1.040, top1 = 70.36%], valid : [loss = 1.401, top1 = 61.38%], test : [loss = 1.402, top1 = 60.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.83%], valid : [loss = 2.692, top1 = 33.13%], test : [loss = 2.715, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6088/15625) 006088-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.04%], valid : [loss = 0.450, top1 = 86.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.119, top1 = 96.35%], test  : [loss = 0.332, top1 = 89.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.71 ms.
cifar100       train : [loss = 0.870, top1 = 75.12%], valid : [loss = 1.300, top1 = 64.86%], test : [loss = 1.311, top1 = 63.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.59%], valid : [loss = 2.626, top1 = 34.07%], test : [loss = 2.652, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.08%], valid : [loss = 0.629, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6089/15625) 006089-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.40%], valid : [loss = 0.448, top1 = 86.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10        train : [loss = 0.158, top1 = 94.73%], test  : [loss = 0.358, top1 = 88.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.91 ms.
cifar100       train : [loss = 1.024, top1 = 71.13%], valid : [loss = 1.383, top1 = 61.26%], test : [loss = 1.393, top1 = 60.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.71%], valid : [loss = 2.683, top1 = 33.53%], test : [loss = 2.712, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6090/15625) 006090-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.18%], valid : [loss = 0.850, top1 = 72.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.38 ms.
cifar10        train : [loss = 0.559, top1 = 80.58%], test  : [loss = 0.720, top1 = 75.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.71 ms.
cifar100       train : [loss = 1.782, top1 = 52.22%], valid : [loss = 2.058, top1 = 46.60%], test : [loss = 2.062, top1 = 46.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.70%], valid : [loss = 3.631, top1 = 16.53%], test : [loss = 3.646, top1 = 16.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6091/15625) 006091-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.593, top1 = 87.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10        train : [loss = 0.015, top1 = 99.70%], test  : [loss = 0.398, top1 = 90.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.19 ms.
cifar100       train : [loss = 0.380, top1 = 89.23%], valid : [loss = 1.405, top1 = 66.24%], test : [loss = 1.362, top1 = 66.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.88%], valid : [loss = 2.506, top1 = 36.60%], test : [loss = 2.535, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6092/15625) 006092-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.543, top1 = 88.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.330, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.347, top1 = 90.61%], valid : [loss = 1.284, top1 = 66.92%], test : [loss = 1.296, top1 = 67.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.52%], valid : [loss = 2.414, top1 = 39.70%], test : [loss = 2.416, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6093/15625) 006093-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.529, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.351, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.144, top1 = 97.13%], valid : [loss = 1.396, top1 = 68.18%], test : [loss = 1.409, top1 = 67.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.05%], valid : [loss = 2.407, top1 = 39.29%], test : [loss = 2.432, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.85%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6094/15625) 006094-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.38%], valid : [loss = 0.470, top1 = 86.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.41 ms.
cifar10        train : [loss = 0.167, top1 = 94.57%], test  : [loss = 0.347, top1 = 88.62%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.88 ms.
cifar100       train : [loss = 1.027, top1 = 71.03%], valid : [loss = 1.369, top1 = 62.34%], test : [loss = 1.373, top1 = 61.12%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.01%], valid : [loss = 2.738, top1 = 31.03%], test : [loss = 2.760, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.62%], valid : [loss = 0.765, top1 = 73.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6095/15625) 006095-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.64%], valid : [loss = 0.550, top1 = 88.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.355, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.38 ms.
cifar100       train : [loss = 0.434, top1 = 87.36%], valid : [loss = 1.251, top1 = 67.18%], test : [loss = 1.253, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.47%], valid : [loss = 2.377, top1 = 39.47%], test : [loss = 2.376, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6096/15625) 006096-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.585, top1 = 88.35%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.384, top1 = 92.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.49 ms.
cifar100       train : [loss = 0.121, top1 = 97.38%], valid : [loss = 1.363, top1 = 68.28%], test : [loss = 1.442, top1 = 67.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 40.94%], valid : [loss = 2.489, top1 = 36.47%], test : [loss = 2.497, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.02%], valid : [loss = 0.914, top1 = 67.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6097/15625) 006097-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.86 ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.54%], valid : [loss = 1.104, top1 = 63.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.790, top1 = 72.13%], test  : [loss = 0.910, top1 = 68.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.27 ms.
cifar100       train : [loss = 2.154, top1 = 43.51%], valid : [loss = 2.412, top1 = 38.78%], test : [loss = 2.416, top1 = 38.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 3.767, top1 = 13.86%], valid : [loss = 3.822, top1 = 13.93%], test : [loss = 3.825, top1 = 13.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.64%], valid : [loss = 1.400, top1 = 49.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6098/15625) 006098-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.590, top1 = 87.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.379, top1 = 91.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.64 ms.
cifar100       train : [loss = 0.216, top1 = 94.92%], valid : [loss = 1.433, top1 = 65.56%], test : [loss = 1.461, top1 = 66.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 46.13%], valid : [loss = 2.500, top1 = 38.10%], test : [loss = 2.515, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6099/15625) 006099-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.503, top1 = 89.16%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.323, top1 = 92.27%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.49 ms.
cifar100       train : [loss = 0.216, top1 = 94.86%], valid : [loss = 1.244, top1 = 69.06%], test : [loss = 1.276, top1 = 69.04%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.48 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.96%], valid : [loss = 2.272, top1 = 41.83%], test : [loss = 2.258, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.72%], valid : [loss = 0.786, top1 = 72.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6100/15625) 006100-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.533, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.60 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.388, top1 = 91.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.26 ms.
cifar100       train : [loss = 0.278, top1 = 92.38%], valid : [loss = 1.349, top1 = 66.78%], test : [loss = 1.360, top1 = 66.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.52%], valid : [loss = 2.403, top1 = 38.77%], test : [loss = 2.419, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.98%], valid : [loss = 0.669, top1 = 77.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6101/15625) 006101-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.93%], valid : [loss = 0.954, top1 = 66.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.76 ms.
cifar10        train : [loss = 0.775, top1 = 72.54%], test  : [loss = 0.849, top1 = 70.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 2.338, top1 = 38.69%], valid : [loss = 2.470, top1 = 36.68%], test : [loss = 2.462, top1 = 36.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.42%], valid : [loss = 3.578, top1 = 16.90%], test : [loss = 3.605, top1 = 16.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.56%], valid : [loss = 1.514, top1 = 44.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6102/15625) 006102-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.42%], valid : [loss = 0.564, top1 = 82.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10        train : [loss = 0.228, top1 = 92.21%], test  : [loss = 0.421, top1 = 86.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.39 ms.
cifar100       train : [loss = 1.313, top1 = 62.53%], valid : [loss = 1.612, top1 = 55.80%], test : [loss = 1.589, top1 = 56.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.753, top1 = 31.55%], valid : [loss = 2.785, top1 = 31.27%], test : [loss = 2.827, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.24%], valid : [loss = 0.993, top1 = 64.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6103/15625) 006103-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.86%], valid : [loss = 0.655, top1 = 86.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.44 ms.
cifar10        train : [loss = 0.027, top1 = 99.39%], test  : [loss = 0.425, top1 = 89.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.42 ms.
cifar100       train : [loss = 0.378, top1 = 89.99%], valid : [loss = 1.442, top1 = 63.64%], test : [loss = 1.411, top1 = 64.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.322, top1 = 40.58%], valid : [loss = 2.585, top1 = 35.60%], test : [loss = 2.634, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6104/15625) 006104-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.262, top1 = 91.08%], valid : [loss = 0.531, top1 = 83.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.257, top1 = 91.08%], test  : [loss = 0.395, top1 = 86.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.40 ms.
cifar100       train : [loss = 1.420, top1 = 60.16%], valid : [loss = 1.688, top1 = 54.10%], test : [loss = 1.670, top1 = 55.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.08 ms.
ImageNet16-120 train : [loss = 2.943, top1 = 28.06%], valid : [loss = 2.978, top1 = 28.57%], test : [loss = 3.027, top1 = 25.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.54%], valid : [loss = 1.003, top1 = 64.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6105/15625) 006105-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.39 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.316, top1 = 93.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.58 ms.
cifar100       train : [loss = 0.066, top1 = 98.96%], valid : [loss = 1.381, top1 = 69.50%], test : [loss = 1.371, top1 = 70.04%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 1.998, top1 = 47.52%], valid : [loss = 2.371, top1 = 39.37%], test : [loss = 2.334, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.84%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6106/15625) 006106-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.56%], valid : [loss = 0.525, top1 = 87.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.17 ms.
cifar10        train : [loss = 0.043, top1 = 98.74%], test  : [loss = 0.364, top1 = 90.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.31 ms.
cifar100       train : [loss = 0.569, top1 = 83.26%], valid : [loss = 1.327, top1 = 65.84%], test : [loss = 1.312, top1 = 65.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.317, top1 = 40.50%], valid : [loss = 2.468, top1 = 37.70%], test : [loss = 2.495, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.17%], valid : [loss = 0.656, top1 = 77.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6107/15625) 006107-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.53%], valid : [loss = 0.462, top1 = 86.43%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.12 ms.
cifar10        train : [loss = 0.129, top1 = 95.86%], test  : [loss = 0.348, top1 = 89.00%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.97 ms.
cifar100       train : [loss = 0.741, top1 = 79.58%], valid : [loss = 1.315, top1 = 63.64%], test : [loss = 1.290, top1 = 64.10%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 35.93%], valid : [loss = 2.626, top1 = 34.20%], test : [loss = 2.634, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 62.73%], valid : [loss = 1.049, top1 = 62.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6108/15625) 006108-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.551, top1 = 88.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.373, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.52 ms.
cifar100       train : [loss = 0.167, top1 = 96.18%], valid : [loss = 1.500, top1 = 65.99%], test : [loss = 1.491, top1 = 66.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.46%], valid : [loss = 2.406, top1 = 39.26%], test : [loss = 2.422, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.44%], valid : [loss = 0.777, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6109/15625) 006109-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.436, top1 = 89.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.317, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.79 ms.
cifar100       train : [loss = 0.326, top1 = 91.11%], valid : [loss = 1.267, top1 = 67.87%], test : [loss = 1.306, top1 = 66.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 45.99%], valid : [loss = 2.361, top1 = 40.28%], test : [loss = 2.396, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.460, top1 = 84.20%], valid : [loss = 0.549, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6110/15625) 006110-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.523, top1 = 89.08%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.323, top1 = 92.75%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.96 ms.
cifar100       train : [loss = 0.152, top1 = 96.89%], valid : [loss = 1.270, top1 = 69.42%], test : [loss = 1.290, top1 = 69.28%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.40%], valid : [loss = 2.287, top1 = 42.27%], test : [loss = 2.332, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.45%], valid : [loss = 0.729, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6111/15625) 006111-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.414, top1 = 91.61%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.10 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.262, top1 = 94.37%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.56 ms.
cifar100       train : [loss = 0.018, top1 = 99.87%], valid : [loss = 1.256, top1 = 72.75%], test : [loss = 1.231, top1 = 73.22%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.114, top1 = 69.02%], valid : [loss = 2.222, top1 = 45.56%], test : [loss = 2.249, top1 = 46.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.63%], valid : [loss = 0.485, top1 = 83.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6112/15625) 006112-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6113/15625) 006113-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.536, top1 = 89.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.342, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.22 ms.
cifar100       train : [loss = 0.223, top1 = 94.17%], valid : [loss = 1.287, top1 = 68.36%], test : [loss = 1.314, top1 = 68.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.68%], valid : [loss = 2.290, top1 = 41.66%], test : [loss = 2.293, top1 = 41.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.96%], valid : [loss = 0.785, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6114/15625) 006114-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.51%], valid : [loss = 0.836, top1 = 80.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10        train : [loss = 0.095, top1 = 96.80%], test  : [loss = 0.447, top1 = 87.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.805, top1 = 76.54%], valid : [loss = 1.556, top1 = 59.76%], test : [loss = 1.542, top1 = 59.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.741, top1 = 31.91%], valid : [loss = 2.881, top1 = 29.77%], test : [loss = 2.915, top1 = 29.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.31%], valid : [loss = 0.938, top1 = 66.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6115/15625) 006115-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.537, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.362, top1 = 91.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.38 ms.
cifar100       train : [loss = 0.203, top1 = 94.67%], valid : [loss = 1.334, top1 = 68.26%], test : [loss = 1.378, top1 = 68.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.64%], valid : [loss = 2.264, top1 = 42.23%], test : [loss = 2.280, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.83%], valid : [loss = 0.909, top1 = 67.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6116/15625) 006116-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.538, top1 = 89.49%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.338, top1 = 92.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.10 ms.
cifar100       train : [loss = 0.084, top1 = 98.70%], valid : [loss = 1.439, top1 = 68.24%], test : [loss = 1.445, top1 = 68.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 1.765, top1 = 53.00%], valid : [loss = 2.359, top1 = 41.37%], test : [loss = 2.373, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.10%], valid : [loss = 0.698, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6117/15625) 006117-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.473, top1 = 90.00%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.97 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.313, top1 = 92.87%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.22 ms.
cifar100       train : [loss = 0.151, top1 = 96.68%], valid : [loss = 1.307, top1 = 69.32%], test : [loss = 1.248, top1 = 70.22%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.11 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.86%], valid : [loss = 2.164, top1 = 44.40%], test : [loss = 2.168, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.90%], valid : [loss = 0.684, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6118/15625) 006118-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.499, top1 = 90.44%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.77 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.313, top1 = 93.62%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.67 ms.
cifar100       train : [loss = 0.035, top1 = 99.61%], valid : [loss = 1.293, top1 = 72.26%], test : [loss = 1.286, top1 = 71.70%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.508, top1 = 59.10%], valid : [loss = 2.142, top1 = 44.73%], test : [loss = 2.144, top1 = 46.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.24%], valid : [loss = 0.612, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6119/15625) 006119-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 90.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.22 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.284, top1 = 93.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.56 ms.
cifar100       train : [loss = 0.050, top1 = 99.34%], valid : [loss = 1.342, top1 = 70.64%], test : [loss = 1.300, top1 = 70.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 1.449, top1 = 60.55%], valid : [loss = 2.230, top1 = 45.00%], test : [loss = 2.232, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.350, top1 = 88.08%], valid : [loss = 0.481, top1 = 84.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6120/15625) 006120-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.487, top1 = 89.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.311, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.35 ms.
cifar100       train : [loss = 0.192, top1 = 95.58%], valid : [loss = 1.240, top1 = 69.30%], test : [loss = 1.226, top1 = 69.34%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.85 ms.
ImageNet16-120 train : [loss = 1.791, top1 = 52.41%], valid : [loss = 2.160, top1 = 43.87%], test : [loss = 2.214, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.96%], valid : [loss = 0.670, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6121/15625) 006121-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.79 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.84%], valid : [loss = 0.479, top1 = 84.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.94 ms.
cifar10        train : [loss = 0.305, top1 = 89.80%], test  : [loss = 0.403, top1 = 86.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.67 ms.
cifar100       train : [loss = 1.335, top1 = 63.07%], valid : [loss = 1.537, top1 = 57.61%], test : [loss = 1.527, top1 = 58.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.31 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.70%], valid : [loss = 2.911, top1 = 29.21%], test : [loss = 2.954, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6122/15625) 006122-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.591, top1 = 86.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.15 ms.
cifar10        train : [loss = 0.026, top1 = 99.32%], test  : [loss = 0.408, top1 = 90.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.468, top1 = 86.42%], valid : [loss = 1.382, top1 = 65.34%], test : [loss = 1.354, top1 = 65.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.05%], valid : [loss = 2.526, top1 = 36.70%], test : [loss = 2.562, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.28%], valid : [loss = 0.846, top1 = 70.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6123/15625) 006123-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.50%], valid : [loss = 0.924, top1 = 67.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.87 ms.
cifar10        train : [loss = 0.772, top1 = 72.92%], test  : [loss = 0.842, top1 = 70.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.73 ms.
cifar100       train : [loss = 2.455, top1 = 35.90%], valid : [loss = 2.598, top1 = 33.66%], test : [loss = 2.597, top1 = 33.66%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.44 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.57%], valid : [loss = 3.576, top1 = 17.23%], test : [loss = 3.624, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.453, top1 = 46.68%], valid : [loss = 1.498, top1 = 44.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6124/15625) 006124-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.511, top1 = 88.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.337, top1 = 91.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.46 ms.
cifar100       train : [loss = 0.342, top1 = 90.69%], valid : [loss = 1.261, top1 = 66.96%], test : [loss = 1.264, top1 = 68.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.27%], valid : [loss = 2.403, top1 = 39.87%], test : [loss = 2.431, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6125/15625) 006125-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10-valid  train : [loss = 0.789, top1 = 72.22%], valid : [loss = 1.104, top1 = 63.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.41 ms.
cifar10        train : [loss = 0.809, top1 = 71.50%], test  : [loss = 0.949, top1 = 67.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.48 ms.
cifar100       train : [loss = 2.159, top1 = 43.60%], valid : [loss = 2.429, top1 = 39.62%], test : [loss = 2.451, top1 = 38.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.54 ms.
ImageNet16-120 train : [loss = 3.761, top1 = 13.90%], valid : [loss = 3.822, top1 = 13.67%], test : [loss = 3.809, top1 = 13.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6126/15625) 006126-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.433, top1 = 90.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.270, top1 = 93.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.55 ms.
cifar100       train : [loss = 0.063, top1 = 99.07%], valid : [loss = 1.385, top1 = 70.54%], test : [loss = 1.340, top1 = 70.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 1.532, top1 = 58.62%], valid : [loss = 2.251, top1 = 43.73%], test : [loss = 2.283, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.350, top1 = 88.00%], valid : [loss = 0.497, top1 = 83.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6127/15625) 006127-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.60%], valid : [loss = 0.955, top1 = 74.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10        train : [loss = 0.261, top1 = 90.88%], test  : [loss = 0.621, top1 = 80.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.13 ms.
cifar100       train : [loss = 1.151, top1 = 67.05%], valid : [loss = 1.865, top1 = 52.68%], test : [loss = 1.916, top1 = 51.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.76%], valid : [loss = 3.331, top1 = 21.17%], test : [loss = 3.379, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 57.15%], valid : [loss = 1.238, top1 = 55.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6128/15625) 006128-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.28 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.541, top1 = 88.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.388, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.28 ms.
cifar100       train : [loss = 0.394, top1 = 88.94%], valid : [loss = 1.347, top1 = 66.20%], test : [loss = 1.376, top1 = 65.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.86%], valid : [loss = 2.461, top1 = 37.77%], test : [loss = 2.480, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.42%], valid : [loss = 0.765, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6129/15625) 006129-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.499, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.330, top1 = 92.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.323, top1 = 91.30%], valid : [loss = 1.261, top1 = 67.51%], test : [loss = 1.249, top1 = 68.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.63%], valid : [loss = 2.335, top1 = 40.24%], test : [loss = 2.321, top1 = 40.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.04%], valid : [loss = 0.624, top1 = 78.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6130/15625) 006130-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.88%], valid : [loss = 0.731, top1 = 83.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10        train : [loss = 0.087, top1 = 97.22%], test  : [loss = 0.473, top1 = 87.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 0.800, top1 = 76.87%], valid : [loss = 1.477, top1 = 61.28%], test : [loss = 1.486, top1 = 61.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.810, top1 = 30.46%], valid : [loss = 2.934, top1 = 28.37%], test : [loss = 2.981, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6131/15625) 006131-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.64%], valid : [loss = 0.719, top1 = 82.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.111, top1 = 96.39%], test  : [loss = 0.444, top1 = 87.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.17 ms.
cifar100       train : [loss = 0.873, top1 = 74.53%], valid : [loss = 1.660, top1 = 57.08%], test : [loss = 1.650, top1 = 58.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.758, top1 = 31.55%], valid : [loss = 2.902, top1 = 28.33%], test : [loss = 2.938, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 67.83%], valid : [loss = 0.946, top1 = 66.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6132/15625) 006132-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.69%], valid : [loss = 0.456, top1 = 86.53%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.40 ms.
cifar10        train : [loss = 0.129, top1 = 96.02%], test  : [loss = 0.343, top1 = 89.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.38 ms.
cifar100       train : [loss = 0.774, top1 = 78.39%], valid : [loss = 1.296, top1 = 63.42%], test : [loss = 1.298, top1 = 64.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.60%], valid : [loss = 2.598, top1 = 34.50%], test : [loss = 2.606, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6133/15625) 006133-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.476, top1 = 89.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.308, top1 = 92.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.25 ms.
cifar100       train : [loss = 0.258, top1 = 93.50%], valid : [loss = 1.259, top1 = 68.46%], test : [loss = 1.284, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.49%], valid : [loss = 2.275, top1 = 42.73%], test : [loss = 2.262, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.10%], valid : [loss = 0.608, top1 = 79.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6134/15625) 006134-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.86%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.342, top1 = 92.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.37 ms.
cifar100       train : [loss = 0.092, top1 = 98.12%], valid : [loss = 1.381, top1 = 69.70%], test : [loss = 1.381, top1 = 69.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.30%], valid : [loss = 2.442, top1 = 37.07%], test : [loss = 2.459, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.019, top1 = 63.03%], valid : [loss = 1.027, top1 = 63.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6135/15625) 006135-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.573, top1 = 87.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.381, top1 = 91.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.76 ms.
cifar100       train : [loss = 0.380, top1 = 89.38%], valid : [loss = 1.384, top1 = 65.77%], test : [loss = 1.391, top1 = 65.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.51%], valid : [loss = 2.472, top1 = 37.51%], test : [loss = 2.523, top1 = 37.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.95%], valid : [loss = 0.758, top1 = 73.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6136/15625) 006136-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.66%], valid : [loss = 0.484, top1 = 84.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.299, top1 = 90.00%], test  : [loss = 0.404, top1 = 86.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.10 ms.
cifar100       train : [loss = 1.332, top1 = 63.10%], valid : [loss = 1.546, top1 = 57.32%], test : [loss = 1.519, top1 = 58.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 28.32%], valid : [loss = 2.906, top1 = 29.67%], test : [loss = 2.966, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.54%], valid : [loss = 0.746, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6137/15625) 006137-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.79%], valid : [loss = 0.831, top1 = 80.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.38 ms.
cifar10        train : [loss = 0.132, top1 = 95.49%], test  : [loss = 0.522, top1 = 85.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.05 ms.
cifar100       train : [loss = 0.841, top1 = 75.30%], valid : [loss = 1.659, top1 = 57.70%], test : [loss = 1.672, top1 = 57.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 3.019, top1 = 26.91%], valid : [loss = 3.153, top1 = 24.53%], test : [loss = 3.193, top1 = 24.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.091, top1 = 60.44%], valid : [loss = 1.157, top1 = 58.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6138/15625) 006138-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.681, top1 = 85.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.450, top1 = 88.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.93 ms.
cifar100       train : [loss = 0.649, top1 = 81.11%], valid : [loss = 1.533, top1 = 61.46%], test : [loss = 1.519, top1 = 61.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.691, top1 = 32.78%], valid : [loss = 2.822, top1 = 30.30%], test : [loss = 2.867, top1 = 30.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.63%], valid : [loss = 0.898, top1 = 68.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6139/15625) 006139-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.84 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.657, top1 = 86.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.427, top1 = 91.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.50 ms.
cifar100       train : [loss = 0.202, top1 = 95.24%], valid : [loss = 1.479, top1 = 65.50%], test : [loss = 1.452, top1 = 66.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.23%], valid : [loss = 2.453, top1 = 37.47%], test : [loss = 2.529, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.50%], valid : [loss = 0.800, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6140/15625) 006140-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10-valid  train : [loss = 1.182, top1 = 57.53%], valid : [loss = 1.233, top1 = 56.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 1.120, top1 = 60.28%], test  : [loss = 1.125, top1 = 59.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.20 ms.
cifar100       train : [loss = 2.668, top1 = 33.01%], valid : [loss = 2.741, top1 = 32.11%], test : [loss = 2.731, top1 = 32.13%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.65 ms.
ImageNet16-120 train : [loss = 3.826, top1 = 13.04%], valid : [loss = 3.818, top1 = 13.87%], test : [loss = 3.838, top1 = 13.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.686, top1 = 36.92%], valid : [loss = 1.737, top1 = 33.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6141/15625) 006141-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.553, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.375, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.48 ms.
cifar100       train : [loss = 0.088, top1 = 98.49%], valid : [loss = 1.485, top1 = 67.92%], test : [loss = 1.426, top1 = 68.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.60 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.44%], valid : [loss = 2.363, top1 = 41.13%], test : [loss = 2.364, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 79.95%], valid : [loss = 0.670, top1 = 76.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6142/15625) 006142-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.603, top1 = 87.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.407, top1 = 91.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.199, top1 = 95.23%], valid : [loss = 1.463, top1 = 66.18%], test : [loss = 1.457, top1 = 66.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.11%], valid : [loss = 2.492, top1 = 37.63%], test : [loss = 2.484, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.98%], valid : [loss = 0.768, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6143/15625) 006143-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.458, top1 = 86.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.55 ms.
cifar10        train : [loss = 0.115, top1 = 96.43%], test  : [loss = 0.332, top1 = 89.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.20 ms.
cifar100       train : [loss = 0.862, top1 = 75.36%], valid : [loss = 1.302, top1 = 63.82%], test : [loss = 1.292, top1 = 63.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.55%], valid : [loss = 2.642, top1 = 34.03%], test : [loss = 2.660, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6144/15625) 006144-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.04%], valid : [loss = 0.819, top1 = 71.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10        train : [loss = 0.667, top1 = 76.82%], test  : [loss = 0.755, top1 = 73.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.08 ms.
cifar100       train : [loss = 1.960, top1 = 47.78%], valid : [loss = 2.143, top1 = 43.90%], test : [loss = 2.182, top1 = 43.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.24 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.69%], valid : [loss = 3.678, top1 = 16.03%], test : [loss = 3.706, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6145/15625) 006145-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.04%], valid : [loss = 0.527, top1 = 87.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.38 ms.
cifar10        train : [loss = 0.074, top1 = 97.66%], test  : [loss = 0.368, top1 = 89.66%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.49 ms.
cifar100       train : [loss = 0.702, top1 = 79.43%], valid : [loss = 1.329, top1 = 63.74%], test : [loss = 1.335, top1 = 65.46%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.02%], valid : [loss = 2.630, top1 = 34.07%], test : [loss = 2.661, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.84%], valid : [loss = 0.692, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6146/15625) 006146-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.544, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.359, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.153, top1 = 96.63%], valid : [loss = 1.301, top1 = 68.80%], test : [loss = 1.345, top1 = 67.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.22%], valid : [loss = 2.371, top1 = 39.97%], test : [loss = 2.343, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.60%], valid : [loss = 0.657, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6147/15625) 006147-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.70%], valid : [loss = 0.612, top1 = 86.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.74 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.401, top1 = 90.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.43 ms.
cifar100       train : [loss = 0.509, top1 = 85.27%], valid : [loss = 1.424, top1 = 63.74%], test : [loss = 1.439, top1 = 63.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 39.03%], valid : [loss = 2.567, top1 = 35.73%], test : [loss = 2.631, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6148/15625) 006148-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.70%], valid : [loss = 0.613, top1 = 87.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.405, top1 = 91.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.52 ms.
cifar100       train : [loss = 0.342, top1 = 90.41%], valid : [loss = 1.471, top1 = 63.54%], test : [loss = 1.428, top1 = 64.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.14 ms.
ImageNet16-120 train : [loss = 2.991, top1 = 25.60%], valid : [loss = 3.056, top1 = 24.97%], test : [loss = 3.065, top1 = 24.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.21%], valid : [loss = 1.221, top1 = 55.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6149/15625) 006149-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.534, top1 = 88.98%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.27 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.370, top1 = 92.65%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.81 ms.
cifar100       train : [loss = 0.055, top1 = 99.27%], valid : [loss = 1.504, top1 = 68.78%], test : [loss = 1.506, top1 = 68.12%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.51 ms.
ImageNet16-120 train : [loss = 1.752, top1 = 53.25%], valid : [loss = 2.424, top1 = 40.67%], test : [loss = 2.431, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.05%], valid : [loss = 0.718, top1 = 75.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6150/15625) 006150-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.51%], valid : [loss = 0.537, top1 = 82.99%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.279, top1 = 90.45%], test  : [loss = 0.421, top1 = 86.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.27 ms.
cifar100       train : [loss = 1.403, top1 = 60.63%], valid : [loss = 1.679, top1 = 54.77%], test : [loss = 1.662, top1 = 54.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.44%], valid : [loss = 2.913, top1 = 28.90%], test : [loss = 2.977, top1 = 27.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.74%], valid : [loss = 1.018, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6151/15625) 006151-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.132, top1 = 95.91%], valid : [loss = 0.466, top1 = 85.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.155, top1 = 94.93%], test  : [loss = 0.339, top1 = 89.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.15 ms.
cifar100       train : [loss = 0.998, top1 = 71.62%], valid : [loss = 1.374, top1 = 61.98%], test : [loss = 1.348, top1 = 62.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.72%], valid : [loss = 2.673, top1 = 33.77%], test : [loss = 2.707, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6152/15625) 006152-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.599, top1 = 86.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.80 ms.
cifar10        train : [loss = 0.035, top1 = 98.98%], test  : [loss = 0.387, top1 = 90.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.15 ms.
cifar100       train : [loss = 0.540, top1 = 84.28%], valid : [loss = 1.421, top1 = 62.98%], test : [loss = 1.427, top1 = 63.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 39.00%], valid : [loss = 2.585, top1 = 35.33%], test : [loss = 2.601, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.54%], valid : [loss = 0.834, top1 = 71.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6153/15625) 006153-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.527, top1 = 88.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.027, top1 = 99.25%], test  : [loss = 0.354, top1 = 90.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 0.417, top1 = 87.75%], valid : [loss = 1.269, top1 = 67.02%], test : [loss = 1.269, top1 = 67.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.47 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.09%], valid : [loss = 2.398, top1 = 39.77%], test : [loss = 2.434, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6154/15625) 006154-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.92%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.81 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.323, top1 = 93.32%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.72 ms.
cifar100       train : [loss = 0.061, top1 = 99.14%], valid : [loss = 1.337, top1 = 70.40%], test : [loss = 1.356, top1 = 70.10%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.14%], valid : [loss = 2.299, top1 = 42.23%], test : [loss = 2.288, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.41%], valid : [loss = 0.612, top1 = 79.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6155/15625) 006155-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.94%], valid : [loss = 0.616, top1 = 86.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.389, top1 = 91.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.86 ms.
cifar100       train : [loss = 0.385, top1 = 89.08%], valid : [loss = 1.448, top1 = 65.96%], test : [loss = 1.398, top1 = 65.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.36%], valid : [loss = 2.516, top1 = 36.87%], test : [loss = 2.507, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6156/15625) 006156-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.517, top1 = 88.37%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.06 ms.
cifar10        train : [loss = 0.022, top1 = 99.46%], test  : [loss = 0.376, top1 = 90.87%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.66 ms.
cifar100       train : [loss = 0.322, top1 = 91.32%], valid : [loss = 1.318, top1 = 67.80%], test : [loss = 1.300, top1 = 67.82%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.17%], valid : [loss = 2.365, top1 = 39.67%], test : [loss = 2.389, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.22%], valid : [loss = 0.633, top1 = 78.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6157/15625) 006157-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.35%], valid : [loss = 0.524, top1 = 82.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 0.401, top1 = 86.32%], test  : [loss = 0.473, top1 = 84.02%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.75 ms.
cifar100       train : [loss = 1.546, top1 = 57.64%], valid : [loss = 1.658, top1 = 54.63%], test : [loss = 1.658, top1 = 54.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.52 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.59%], valid : [loss = 3.006, top1 = 27.20%], test : [loss = 3.057, top1 = 25.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6158/15625) 006158-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.573, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.371, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.43 ms.
cifar100       train : [loss = 0.387, top1 = 89.04%], valid : [loss = 1.375, top1 = 66.04%], test : [loss = 1.389, top1 = 65.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.83%], valid : [loss = 2.474, top1 = 37.81%], test : [loss = 2.503, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.51%], valid : [loss = 0.766, top1 = 73.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6159/15625) 006159-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.91 ms.
cifar10-valid  train : [loss = 0.132, top1 = 95.79%], valid : [loss = 0.476, top1 = 85.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10        train : [loss = 0.146, top1 = 95.32%], test  : [loss = 0.336, top1 = 89.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.18 ms.
cifar100       train : [loss = 0.990, top1 = 72.12%], valid : [loss = 1.360, top1 = 62.10%], test : [loss = 1.351, top1 = 62.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.90%], valid : [loss = 2.661, top1 = 33.77%], test : [loss = 2.702, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6160/15625) 006160-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.496, top1 = 88.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.302, top1 = 92.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.06 ms.
cifar100       train : [loss = 0.259, top1 = 93.49%], valid : [loss = 1.285, top1 = 68.04%], test : [loss = 1.256, top1 = 68.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.25%], valid : [loss = 2.267, top1 = 42.47%], test : [loss = 2.300, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6161/15625) 006161-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.73 ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.45%], valid : [loss = 0.650, top1 = 78.06%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10        train : [loss = 0.502, top1 = 82.65%], test  : [loss = 0.572, top1 = 80.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.97 ms.
cifar100       train : [loss = 1.677, top1 = 54.35%], valid : [loss = 1.829, top1 = 51.42%], test : [loss = 1.860, top1 = 50.70%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.38%], valid : [loss = 3.309, top1 = 21.03%], test : [loss = 3.348, top1 = 20.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6162/15625) 006162-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.527, top1 = 88.42%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.341, top1 = 91.93%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.27 ms.
cifar100       train : [loss = 0.339, top1 = 90.86%], valid : [loss = 1.292, top1 = 67.18%], test : [loss = 1.330, top1 = 66.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.66%], valid : [loss = 2.447, top1 = 38.50%], test : [loss = 2.413, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6163/15625) 006163-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.514, top1 = 88.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.335, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.57 ms.
cifar100       train : [loss = 0.337, top1 = 90.92%], valid : [loss = 1.283, top1 = 67.46%], test : [loss = 1.255, top1 = 67.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.67%], valid : [loss = 2.429, top1 = 38.87%], test : [loss = 2.404, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.90%], valid : [loss = 0.650, top1 = 77.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6164/15625) 006164-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.525, top1 = 88.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.015, top1 = 99.59%], test  : [loss = 0.358, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.66 ms.
cifar100       train : [loss = 0.284, top1 = 92.18%], valid : [loss = 1.299, top1 = 67.74%], test : [loss = 1.376, top1 = 66.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.68%], valid : [loss = 2.344, top1 = 40.17%], test : [loss = 2.377, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.15%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6165/15625) 006165-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.530, top1 = 88.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.345, top1 = 91.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.68 ms.
cifar100       train : [loss = 0.285, top1 = 92.38%], valid : [loss = 1.260, top1 = 68.40%], test : [loss = 1.295, top1 = 67.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.02%], valid : [loss = 2.397, top1 = 40.03%], test : [loss = 2.413, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.34%], valid : [loss = 0.824, top1 = 70.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6166/15625) 006166-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.52 ms.
cifar10-valid  train : [loss = 0.264, top1 = 90.96%], valid : [loss = 0.525, top1 = 83.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.37 ms.
cifar10        train : [loss = 0.242, top1 = 91.73%], test  : [loss = 0.405, top1 = 86.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.46 ms.
cifar100       train : [loss = 1.357, top1 = 61.79%], valid : [loss = 1.609, top1 = 55.99%], test : [loss = 1.601, top1 = 56.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.873, top1 = 29.21%], valid : [loss = 2.891, top1 = 29.46%], test : [loss = 2.938, top1 = 28.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.006, top1 = 63.76%], valid : [loss = 1.053, top1 = 62.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6167/15625) 006167-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.455, top1 = 86.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.110, top1 = 96.57%], test  : [loss = 0.327, top1 = 89.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.40 ms.
cifar100       train : [loss = 0.863, top1 = 75.68%], valid : [loss = 1.306, top1 = 64.18%], test : [loss = 1.294, top1 = 64.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.562, top1 = 35.39%], valid : [loss = 2.630, top1 = 34.10%], test : [loss = 2.676, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.18%], valid : [loss = 0.633, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6168/15625) 006168-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.544, top1 = 88.29%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.52 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.340, top1 = 92.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.38 ms.
cifar100       train : [loss = 0.126, top1 = 97.29%], valid : [loss = 1.344, top1 = 68.90%], test : [loss = 1.383, top1 = 68.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.31%], valid : [loss = 2.394, top1 = 38.77%], test : [loss = 2.385, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.12%], valid : [loss = 0.801, top1 = 71.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6169/15625) 006169-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.62%], valid : [loss = 1.008, top1 = 73.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.217, top1 = 92.49%], test  : [loss = 0.593, top1 = 82.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 1.110, top1 = 68.14%], valid : [loss = 1.823, top1 = 53.04%], test : [loss = 1.817, top1 = 52.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 3.092, top1 = 25.38%], valid : [loss = 3.205, top1 = 24.03%], test : [loss = 3.250, top1 = 23.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.109, top1 = 60.01%], valid : [loss = 1.161, top1 = 58.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6170/15625) 006170-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.535, top1 = 89.27%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.310, top1 = 93.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.45 ms.
cifar100       train : [loss = 0.101, top1 = 98.23%], valid : [loss = 1.320, top1 = 68.84%], test : [loss = 1.339, top1 = 69.04%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.21 ms.
ImageNet16-120 train : [loss = 2.019, top1 = 47.03%], valid : [loss = 2.399, top1 = 38.67%], test : [loss = 2.376, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.97%], valid : [loss = 0.720, top1 = 75.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6171/15625) 006171-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.514, top1 = 89.94%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.323, top1 = 93.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.10 ms.
cifar100       train : [loss = 0.117, top1 = 97.65%], valid : [loss = 1.279, top1 = 69.70%], test : [loss = 1.290, top1 = 69.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 1.708, top1 = 54.46%], valid : [loss = 2.181, top1 = 44.70%], test : [loss = 2.155, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.98%], valid : [loss = 0.692, top1 = 75.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6172/15625) 006172-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.66%], valid : [loss = 0.550, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.350, top1 = 91.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.99 ms.
cifar100       train : [loss = 0.431, top1 = 87.26%], valid : [loss = 1.239, top1 = 67.00%], test : [loss = 1.235, top1 = 67.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.44%], valid : [loss = 2.355, top1 = 40.00%], test : [loss = 2.373, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.35%], valid : [loss = 0.809, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6173/15625) 006173-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.23%], valid : [loss = 0.478, top1 = 85.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10        train : [loss = 0.159, top1 = 94.85%], test  : [loss = 0.339, top1 = 88.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.41 ms.
cifar100       train : [loss = 1.010, top1 = 71.13%], valid : [loss = 1.369, top1 = 61.97%], test : [loss = 1.365, top1 = 61.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.64%], valid : [loss = 2.697, top1 = 32.77%], test : [loss = 2.723, top1 = 31.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6174/15625) 006174-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.587, top1 = 87.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10        train : [loss = 0.018, top1 = 99.46%], test  : [loss = 0.412, top1 = 90.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.82 ms.
cifar100       train : [loss = 0.345, top1 = 90.51%], valid : [loss = 1.441, top1 = 64.30%], test : [loss = 1.427, top1 = 64.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.898, top1 = 27.53%], valid : [loss = 2.980, top1 = 25.53%], test : [loss = 3.020, top1 = 26.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.21%], valid : [loss = 1.221, top1 = 55.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6175/15625) 006175-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.241, top1 = 91.88%], valid : [loss = 0.536, top1 = 83.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.230, top1 = 92.13%], test  : [loss = 0.411, top1 = 86.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.59 ms.
cifar100       train : [loss = 1.381, top1 = 61.12%], valid : [loss = 1.654, top1 = 55.22%], test : [loss = 1.660, top1 = 54.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.857, top1 = 29.40%], valid : [loss = 2.875, top1 = 29.47%], test : [loss = 2.935, top1 = 27.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.45%], valid : [loss = 1.019, top1 = 64.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6176/15625) 006176-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.38%], valid : [loss = 0.448, top1 = 86.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10        train : [loss = 0.110, top1 = 96.62%], test  : [loss = 0.328, top1 = 89.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.856, top1 = 75.73%], valid : [loss = 1.294, top1 = 64.64%], test : [loss = 1.270, top1 = 64.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.76%], valid : [loss = 2.611, top1 = 34.83%], test : [loss = 2.648, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.18%], valid : [loss = 0.633, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6177/15625) 006177-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.36%], valid : [loss = 0.453, top1 = 86.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10        train : [loss = 0.159, top1 = 94.79%], test  : [loss = 0.348, top1 = 88.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.83 ms.
cifar100       train : [loss = 0.973, top1 = 72.23%], valid : [loss = 1.345, top1 = 62.62%], test : [loss = 1.339, top1 = 62.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.78%], valid : [loss = 2.677, top1 = 33.00%], test : [loss = 2.694, top1 = 32.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6178/15625) 006178-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.45%], valid : [loss = 0.529, top1 = 86.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.099, top1 = 96.89%], test  : [loss = 0.359, top1 = 89.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.57 ms.
cifar100       train : [loss = 0.704, top1 = 79.58%], valid : [loss = 1.316, top1 = 64.67%], test : [loss = 1.298, top1 = 65.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.06%], valid : [loss = 2.541, top1 = 35.67%], test : [loss = 2.569, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.90%], valid : [loss = 0.868, top1 = 69.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6179/15625) 006179-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.560, top1 = 88.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.367, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.149, top1 = 96.98%], valid : [loss = 1.418, top1 = 67.30%], test : [loss = 1.390, top1 = 67.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.82%], valid : [loss = 2.464, top1 = 39.50%], test : [loss = 2.526, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.92%], valid : [loss = 0.709, top1 = 75.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6180/15625) 006180-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.541, top1 = 89.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.339, top1 = 92.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.63 ms.
cifar100       train : [loss = 0.129, top1 = 97.03%], valid : [loss = 1.387, top1 = 67.70%], test : [loss = 1.374, top1 = 68.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.57%], valid : [loss = 2.272, top1 = 42.03%], test : [loss = 2.277, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.92%], valid : [loss = 0.691, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6181/15625) 006181-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.125, top1 = 95.98%], valid : [loss = 0.554, top1 = 84.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10        train : [loss = 0.196, top1 = 93.55%], test  : [loss = 0.395, top1 = 87.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.71 ms.
cifar100       train : [loss = 1.022, top1 = 70.50%], valid : [loss = 1.420, top1 = 61.86%], test : [loss = 1.412, top1 = 60.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.716, top1 = 32.30%], valid : [loss = 2.786, top1 = 30.77%], test : [loss = 2.820, top1 = 30.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.951, top1 = 65.78%], valid : [loss = 0.993, top1 = 64.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6182/15625) 006182-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.513, top1 = 88.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.60 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.320, top1 = 92.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.47 ms.
cifar100       train : [loss = 0.149, top1 = 97.01%], valid : [loss = 1.308, top1 = 68.40%], test : [loss = 1.283, top1 = 69.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.48%], valid : [loss = 2.231, top1 = 43.30%], test : [loss = 2.239, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.69%], valid : [loss = 0.612, top1 = 79.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6183/15625) 006183-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.63%], valid : [loss = 0.666, top1 = 77.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.498, top1 = 82.76%], test  : [loss = 0.574, top1 = 80.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 1.702, top1 = 53.85%], valid : [loss = 1.883, top1 = 50.48%], test : [loss = 1.873, top1 = 50.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.47 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.26%], valid : [loss = 3.334, top1 = 21.13%], test : [loss = 3.355, top1 = 20.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6184/15625) 006184-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.81 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.552, top1 = 88.13%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.33 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.338, top1 = 91.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.86 ms.
cifar100       train : [loss = 0.442, top1 = 87.21%], valid : [loss = 1.209, top1 = 67.72%], test : [loss = 1.245, top1 = 67.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.82%], valid : [loss = 2.372, top1 = 39.73%], test : [loss = 2.372, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.35%], valid : [loss = 0.803, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6185/15625) 006185-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.513, top1 = 88.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.339, top1 = 91.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.09 ms.
cifar100       train : [loss = 0.364, top1 = 90.06%], valid : [loss = 1.296, top1 = 66.80%], test : [loss = 1.271, top1 = 66.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.53%], valid : [loss = 2.413, top1 = 38.43%], test : [loss = 2.411, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6186/15625) 006186-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.463, top1 = 90.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.330, top1 = 92.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 0.111, top1 = 97.83%], valid : [loss = 1.379, top1 = 69.18%], test : [loss = 1.376, top1 = 69.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 1.770, top1 = 52.99%], valid : [loss = 2.381, top1 = 40.17%], test : [loss = 2.390, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.10%], valid : [loss = 0.608, top1 = 79.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6187/15625) 006187-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.707, top1 = 85.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.47 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.459, top1 = 89.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.70 ms.
cifar100       train : [loss = 0.216, top1 = 94.79%], valid : [loss = 1.646, top1 = 62.74%], test : [loss = 1.624, top1 = 63.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 40.19%], valid : [loss = 2.722, top1 = 33.77%], test : [loss = 2.801, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.94%], valid : [loss = 0.862, top1 = 69.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6188/15625) 006188-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.329, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.65 ms.
cifar100       train : [loss = 0.071, top1 = 98.80%], valid : [loss = 1.367, top1 = 69.46%], test : [loss = 1.347, top1 = 70.25%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.30%], valid : [loss = 2.216, top1 = 44.43%], test : [loss = 2.201, top1 = 44.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6189/15625) 006189-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.492, top1 = 90.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.05 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.309, top1 = 93.61%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.26 ms.
cifar100       train : [loss = 0.066, top1 = 98.98%], valid : [loss = 1.336, top1 = 70.16%], test : [loss = 1.346, top1 = 70.22%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.38 ms.
ImageNet16-120 train : [loss = 1.698, top1 = 54.52%], valid : [loss = 2.200, top1 = 43.77%], test : [loss = 2.170, top1 = 45.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.86%], valid : [loss = 0.689, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6190/15625) 006190-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.181, top1 = 94.16%], valid : [loss = 0.472, top1 = 85.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10        train : [loss = 0.214, top1 = 92.79%], test  : [loss = 0.379, top1 = 87.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.23 ms.
cifar100       train : [loss = 1.237, top1 = 65.10%], valid : [loss = 1.512, top1 = 57.42%], test : [loss = 1.520, top1 = 57.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 3.171, top1 = 23.24%], valid : [loss = 3.173, top1 = 22.57%], test : [loss = 3.159, top1 = 23.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6191/15625) 006191-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.37%], valid : [loss = 0.968, top1 = 66.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.83 ms.
cifar10        train : [loss = 0.797, top1 = 71.82%], test  : [loss = 0.892, top1 = 69.45%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.20 ms.
cifar100       train : [loss = 2.129, top1 = 44.09%], valid : [loss = 2.297, top1 = 41.50%], test : [loss = 2.302, top1 = 41.70%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.67 ms.
ImageNet16-120 train : [loss = 3.742, top1 = 14.15%], valid : [loss = 3.769, top1 = 14.60%], test : [loss = 3.772, top1 = 13.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6192/15625) 006192-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.527, top1 = 89.73%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.67 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.332, top1 = 92.96%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.26 ms.
cifar100       train : [loss = 0.122, top1 = 97.50%], valid : [loss = 1.335, top1 = 68.40%], test : [loss = 1.329, top1 = 69.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.25%], valid : [loss = 2.205, top1 = 44.37%], test : [loss = 2.231, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.46%], valid : [loss = 0.638, top1 = 77.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6193/15625) 006193-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.498, top1 = 88.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.333, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.10 ms.
cifar100       train : [loss = 0.346, top1 = 90.62%], valid : [loss = 1.288, top1 = 67.60%], test : [loss = 1.264, top1 = 67.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.75%], valid : [loss = 2.439, top1 = 38.70%], test : [loss = 2.443, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6194/15625) 006194-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.42%], valid : [loss = 0.644, top1 = 78.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.506, top1 = 82.54%], test  : [loss = 0.587, top1 = 79.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.42 ms.
cifar100       train : [loss = 1.684, top1 = 54.30%], valid : [loss = 1.863, top1 = 50.41%], test : [loss = 1.865, top1 = 51.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.29%], valid : [loss = 3.330, top1 = 21.57%], test : [loss = 3.341, top1 = 20.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.295, top1 = 53.24%], valid : [loss = 1.331, top1 = 52.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6195/15625) 006195-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.513, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.339, top1 = 92.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.136, top1 = 96.99%], valid : [loss = 1.357, top1 = 68.34%], test : [loss = 1.364, top1 = 68.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.007, top1 = 47.40%], valid : [loss = 2.369, top1 = 40.13%], test : [loss = 2.397, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.71%], valid : [loss = 0.841, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6196/15625) 006196-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.21%], valid : [loss = 0.974, top1 = 73.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10        train : [loss = 0.302, top1 = 89.46%], test  : [loss = 0.657, top1 = 79.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.76 ms.
cifar100       train : [loss = 1.295, top1 = 63.59%], valid : [loss = 1.908, top1 = 50.64%], test : [loss = 1.903, top1 = 51.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 3.270, top1 = 21.92%], valid : [loss = 3.382, top1 = 20.03%], test : [loss = 3.401, top1 = 19.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.107, top1 = 60.06%], valid : [loss = 1.163, top1 = 58.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6197/15625) 006197-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.579, top1 = 87.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.07 ms.
cifar10        train : [loss = 0.023, top1 = 99.43%], test  : [loss = 0.374, top1 = 91.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.25 ms.
cifar100       train : [loss = 0.467, top1 = 86.53%], valid : [loss = 1.388, top1 = 64.92%], test : [loss = 1.385, top1 = 64.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.17%], valid : [loss = 2.477, top1 = 37.90%], test : [loss = 2.512, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.78%], valid : [loss = 0.808, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6198/15625) 006198-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6199/15625) 006199-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.40%], valid : [loss = 0.660, top1 = 77.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.501, top1 = 82.67%], test  : [loss = 0.583, top1 = 80.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.86 ms.
cifar100       train : [loss = 1.708, top1 = 53.64%], valid : [loss = 1.874, top1 = 50.29%], test : [loss = 1.882, top1 = 49.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.27%], valid : [loss = 3.308, top1 = 21.14%], test : [loss = 3.347, top1 = 21.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6200/15625) 006200-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.568, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.374, top1 = 91.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.400, top1 = 88.64%], valid : [loss = 1.424, top1 = 64.83%], test : [loss = 1.404, top1 = 65.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.88%], valid : [loss = 2.477, top1 = 37.90%], test : [loss = 2.483, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.97%], valid : [loss = 0.767, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6201/15625) 006201-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.39 ms.
cifar10-valid  train : [loss = 1.824, top1 = 34.02%], valid : [loss = 1.851, top1 = 33.06%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.51 ms.
cifar10        train : [loss = 1.251, top1 = 55.11%], test  : [loss = 1.259, top1 = 54.55%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.66 ms.
cifar100       train : [loss = 3.803, top1 = 11.86%], valid : [loss = 3.883, top1 = 10.51%], test : [loss = 3.876, top1 = 11.07%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.51 ms.
ImageNet16-120 train : [loss = 3.780, top1 = 13.62%], valid : [loss = 3.748, top1 = 14.91%], test : [loss = 3.770, top1 = 13.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.957, top1 = 27.98%], valid : [loss = 1.960, top1 = 27.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6202/15625) 006202-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.86%], valid : [loss = 0.581, top1 = 85.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.058, top1 = 98.32%], test  : [loss = 0.364, top1 = 90.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.60 ms.
cifar100       train : [loss = 0.581, top1 = 83.13%], valid : [loss = 1.354, top1 = 64.94%], test : [loss = 1.334, top1 = 65.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.73%], valid : [loss = 2.446, top1 = 38.07%], test : [loss = 2.483, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.30%], valid : [loss = 0.892, top1 = 68.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6203/15625) 006203-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.400, top1 = 85.85%], valid : [loss = 0.658, top1 = 78.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.59 ms.
cifar10        train : [loss = 0.371, top1 = 87.20%], test  : [loss = 0.546, top1 = 81.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 1.691, top1 = 53.67%], valid : [loss = 1.900, top1 = 49.30%], test : [loss = 1.898, top1 = 49.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 3.414, top1 = 19.25%], valid : [loss = 3.413, top1 = 19.13%], test : [loss = 3.460, top1 = 18.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 57.07%], valid : [loss = 1.234, top1 = 55.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6204/15625) 006204-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.483, top1 = 89.61%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.86 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.330, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.09 ms.
cifar100       train : [loss = 0.152, top1 = 96.78%], valid : [loss = 1.239, top1 = 69.42%], test : [loss = 1.293, top1 = 69.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.84%], valid : [loss = 2.333, top1 = 41.03%], test : [loss = 2.298, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.28%], valid : [loss = 0.695, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6205/15625) 006205-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.36%], valid : [loss = 0.821, top1 = 71.69%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10        train : [loss = 0.635, top1 = 77.74%], test  : [loss = 0.690, top1 = 75.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.88 ms.
cifar100       train : [loss = 2.149, top1 = 42.29%], valid : [loss = 2.296, top1 = 39.78%], test : [loss = 2.273, top1 = 39.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.98 ms.
ImageNet16-120 train : [loss = 3.382, top1 = 19.58%], valid : [loss = 3.373, top1 = 19.20%], test : [loss = 3.410, top1 = 19.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.310, top1 = 52.23%], valid : [loss = 1.356, top1 = 51.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6206/15625) 006206-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.492, top1 = 88.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.352, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.25 ms.
cifar100       train : [loss = 0.339, top1 = 90.32%], valid : [loss = 1.300, top1 = 67.42%], test : [loss = 1.327, top1 = 67.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.68%], valid : [loss = 2.298, top1 = 40.87%], test : [loss = 2.359, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.52%], valid : [loss = 0.576, top1 = 80.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6207/15625) 006207-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.49%], valid : [loss = 0.581, top1 = 87.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.67 ms.
cifar10        train : [loss = 0.033, top1 = 98.98%], test  : [loss = 0.359, top1 = 91.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.93 ms.
cifar100       train : [loss = 0.640, top1 = 81.34%], valid : [loss = 1.471, top1 = 62.06%], test : [loss = 1.461, top1 = 62.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.14 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 32.55%], valid : [loss = 2.719, top1 = 30.87%], test : [loss = 2.731, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.069, top1 = 61.58%], valid : [loss = 1.074, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6208/15625) 006208-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.465, top1 = 89.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.319, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.01 ms.
cifar100       train : [loss = 0.201, top1 = 95.20%], valid : [loss = 1.274, top1 = 69.02%], test : [loss = 1.297, top1 = 68.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.19%], valid : [loss = 2.247, top1 = 43.03%], test : [loss = 2.277, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.02%], valid : [loss = 0.555, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6209/15625) 006209-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.469, top1 = 90.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.327, top1 = 92.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.084, top1 = 98.44%], valid : [loss = 1.472, top1 = 68.30%], test : [loss = 1.434, top1 = 69.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 1.721, top1 = 54.26%], valid : [loss = 2.260, top1 = 43.23%], test : [loss = 2.299, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.74%], valid : [loss = 0.648, top1 = 77.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6210/15625) 006210-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.58%], valid : [loss = 0.509, top1 = 87.84%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.56 ms.
cifar10        train : [loss = 0.042, top1 = 98.87%], test  : [loss = 0.362, top1 = 90.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.02 ms.
cifar100       train : [loss = 0.465, top1 = 86.77%], valid : [loss = 1.245, top1 = 66.98%], test : [loss = 1.248, top1 = 67.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.47%], valid : [loss = 2.388, top1 = 39.13%], test : [loss = 2.451, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.76%], valid : [loss = 0.636, top1 = 77.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6211/15625) 006211-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.24%], valid : [loss = 0.857, top1 = 71.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.559, top1 = 80.40%], test  : [loss = 0.740, top1 = 75.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 1.779, top1 = 52.15%], valid : [loss = 2.095, top1 = 46.08%], test : [loss = 2.078, top1 = 46.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.87%], valid : [loss = 3.630, top1 = 17.20%], test : [loss = 3.658, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6212/15625) 006212-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.45 ms.
cifar10-valid  train : [loss = 1.407, top1 = 48.07%], valid : [loss = 1.447, top1 = 46.49%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.85 ms.
cifar10        train : [loss = 1.016, top1 = 64.12%], test  : [loss = 1.025, top1 = 63.41%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.33 ms.
cifar100       train : [loss = 3.666, top1 = 14.69%], valid : [loss = 3.745, top1 = 12.51%], test : [loss = 3.735, top1 = 13.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.25 ms.
ImageNet16-120 train : [loss = 3.688, top1 = 14.99%], valid : [loss = 3.665, top1 = 15.86%], test : [loss = 3.685, top1 = 15.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.902, top1 = 30.57%], valid : [loss = 1.907, top1 = 30.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6213/15625) 006213-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.87%], valid : [loss = 0.599, top1 = 85.84%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.25 ms.
cifar10        train : [loss = 0.065, top1 = 97.87%], test  : [loss = 0.382, top1 = 89.65%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.70 ms.
cifar100       train : [loss = 0.532, top1 = 84.32%], valid : [loss = 1.357, top1 = 64.52%], test : [loss = 1.364, top1 = 63.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 2.426, top1 = 37.95%], valid : [loss = 2.615, top1 = 33.70%], test : [loss = 2.602, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.62%], valid : [loss = 0.984, top1 = 64.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6214/15625) 006214-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.19%], valid : [loss = 0.728, top1 = 74.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10        train : [loss = 0.545, top1 = 81.25%], test  : [loss = 0.601, top1 = 79.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 2.017, top1 = 45.97%], valid : [loss = 2.150, top1 = 43.47%], test : [loss = 2.137, top1 = 43.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 3.242, top1 = 22.17%], valid : [loss = 3.229, top1 = 22.81%], test : [loss = 3.255, top1 = 22.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.49%], valid : [loss = 1.351, top1 = 51.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6215/15625) 006215-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.31%], valid : [loss = 0.589, top1 = 85.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10        train : [loss = 0.110, top1 = 96.37%], test  : [loss = 0.399, top1 = 88.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.55 ms.
cifar100       train : [loss = 0.822, top1 = 75.86%], valid : [loss = 1.411, top1 = 62.54%], test : [loss = 1.405, top1 = 62.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.01%], valid : [loss = 2.742, top1 = 32.37%], test : [loss = 2.785, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.96%], valid : [loss = 0.687, top1 = 76.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6216/15625) 006216-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.04%], valid : [loss = 0.474, top1 = 84.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.48 ms.
cifar10        train : [loss = 0.304, top1 = 89.84%], test  : [loss = 0.392, top1 = 86.53%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.76 ms.
cifar100       train : [loss = 1.353, top1 = 62.45%], valid : [loss = 1.555, top1 = 57.54%], test : [loss = 1.543, top1 = 57.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.92%], valid : [loss = 2.890, top1 = 29.83%], test : [loss = 2.944, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.46%], valid : [loss = 0.761, top1 = 73.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6217/15625) 006217-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.452, top1 = 89.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.305, top1 = 92.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.46 ms.
cifar100       train : [loss = 0.181, top1 = 95.96%], valid : [loss = 1.271, top1 = 69.24%], test : [loss = 1.239, top1 = 68.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.32%], valid : [loss = 2.229, top1 = 43.97%], test : [loss = 2.282, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.98%], valid : [loss = 0.522, top1 = 82.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6218/15625) 006218-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.468, top1 = 89.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.307, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.38 ms.
cifar100       train : [loss = 0.325, top1 = 91.23%], valid : [loss = 1.241, top1 = 67.72%], test : [loss = 1.254, top1 = 68.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.26%], valid : [loss = 2.349, top1 = 40.57%], test : [loss = 2.364, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.60%], valid : [loss = 0.654, top1 = 77.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6219/15625) 006219-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.29%], valid : [loss = 0.538, top1 = 86.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.093, top1 = 97.06%], test  : [loss = 0.372, top1 = 89.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.790, top1 = 77.09%], valid : [loss = 1.373, top1 = 62.88%], test : [loss = 1.364, top1 = 63.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.460, top1 = 37.42%], valid : [loss = 2.581, top1 = 34.83%], test : [loss = 2.604, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.43%], valid : [loss = 0.872, top1 = 69.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6220/15625) 006220-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.210, top1 = 92.95%], valid : [loss = 0.542, top1 = 83.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.66 ms.
cifar10        train : [loss = 0.205, top1 = 93.09%], test  : [loss = 0.399, top1 = 87.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 1.287, top1 = 63.47%], valid : [loss = 1.586, top1 = 56.61%], test : [loss = 1.575, top1 = 56.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.742, top1 = 31.73%], valid : [loss = 2.766, top1 = 31.18%], test : [loss = 2.814, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 64.90%], valid : [loss = 1.001, top1 = 64.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6221/15625) 006221-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.544, top1 = 88.32%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=16.74 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.368, top1 = 91.56%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.45 ms.
cifar100       train : [loss = 0.200, top1 = 94.79%], valid : [loss = 1.356, top1 = 68.04%], test : [loss = 1.351, top1 = 68.26%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 34.40%], valid : [loss = 2.676, top1 = 31.67%], test : [loss = 2.682, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.60%], valid : [loss = 1.008, top1 = 63.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6222/15625) 006222-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.87 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6223/15625) 006223-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.208, top1 = 93.08%], valid : [loss = 0.537, top1 = 83.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.37 ms.
cifar10        train : [loss = 0.208, top1 = 92.94%], test  : [loss = 0.394, top1 = 87.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.61 ms.
cifar100       train : [loss = 1.232, top1 = 65.14%], valid : [loss = 1.534, top1 = 58.38%], test : [loss = 1.518, top1 = 58.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.01 ms.
ImageNet16-120 train : [loss = 2.735, top1 = 32.08%], valid : [loss = 2.726, top1 = 32.30%], test : [loss = 2.813, top1 = 31.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.22%], valid : [loss = 1.005, top1 = 64.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6224/15625) 006224-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.26%], valid : [loss = 0.632, top1 = 85.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.432, top1 = 88.74%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.14 ms.
cifar100       train : [loss = 0.659, top1 = 80.75%], valid : [loss = 1.372, top1 = 63.78%], test : [loss = 1.366, top1 = 63.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.71%], valid : [loss = 2.642, top1 = 33.87%], test : [loss = 2.652, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.25%], valid : [loss = 0.792, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6225/15625) 006225-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.492, top1 = 90.06%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.59 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.347, top1 = 92.47%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.11 ms.
cifar100       train : [loss = 0.112, top1 = 97.89%], valid : [loss = 1.233, top1 = 70.22%], test : [loss = 1.274, top1 = 70.02%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 1.722, top1 = 53.93%], valid : [loss = 2.137, top1 = 44.67%], test : [loss = 2.166, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.14%], valid : [loss = 0.740, top1 = 74.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6226/15625) 006226-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10-valid  train : [loss = 1.835, top1 = 33.69%], valid : [loss = 1.858, top1 = 32.91%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.21 ms.
cifar10        train : [loss = 1.294, top1 = 53.30%], test  : [loss = 1.300, top1 = 52.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.87 ms.
cifar100       train : [loss = 3.802, top1 = 11.96%], valid : [loss = 3.904, top1 = 10.19%], test : [loss = 3.899, top1 = 10.65%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.36 ms.
ImageNet16-120 train : [loss = 3.940, top1 = 11.20%], valid : [loss = 3.937, top1 = 11.57%], test : [loss = 3.940, top1 = 11.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.51%], valid : [loss = 1.967, top1 = 27.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6227/15625) 006227-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.484, top1 = 89.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.313, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.93 ms.
cifar100       train : [loss = 0.165, top1 = 96.41%], valid : [loss = 1.277, top1 = 68.82%], test : [loss = 1.262, top1 = 69.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.65%], valid : [loss = 2.175, top1 = 43.13%], test : [loss = 2.238, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.33%], valid : [loss = 0.612, top1 = 79.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6228/15625) 006228-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.48%], valid : [loss = 0.443, top1 = 88.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.052, top1 = 98.74%], test  : [loss = 0.314, top1 = 90.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.51 ms.
cifar100       train : [loss = 0.589, top1 = 83.90%], valid : [loss = 1.218, top1 = 66.32%], test : [loss = 1.183, top1 = 67.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.19%], valid : [loss = 2.474, top1 = 37.47%], test : [loss = 2.498, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6229/15625) 006229-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.816, top1 = 71.29%], valid : [loss = 0.978, top1 = 66.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10        train : [loss = 0.799, top1 = 71.91%], test  : [loss = 0.875, top1 = 69.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 2.140, top1 = 43.56%], valid : [loss = 2.315, top1 = 40.36%], test : [loss = 2.322, top1 = 41.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.736, top1 = 14.38%], valid : [loss = 3.763, top1 = 14.87%], test : [loss = 3.771, top1 = 13.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.466, top1 = 46.26%], valid : [loss = 1.487, top1 = 45.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6230/15625) 006230-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.618, top1 = 87.73%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=16.34 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.402, top1 = 91.48%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.70 ms.
cifar100       train : [loss = 0.115, top1 = 97.82%], valid : [loss = 1.521, top1 = 66.40%], test : [loss = 1.554, top1 = 66.68%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=21.84 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.20%], valid : [loss = 2.393, top1 = 39.53%], test : [loss = 2.437, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.29%], valid : [loss = 0.748, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6231/15625) 006231-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.489, top1 = 89.96%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.331, top1 = 92.56%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.48 ms.
cifar100       train : [loss = 0.097, top1 = 98.28%], valid : [loss = 1.268, top1 = 69.86%], test : [loss = 1.321, top1 = 69.48%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 1.628, top1 = 56.20%], valid : [loss = 2.157, top1 = 44.57%], test : [loss = 2.179, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.80%], valid : [loss = 0.625, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6232/15625) 006232-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.32 ms.
cifar10-valid  train : [loss = 1.084, top1 = 61.56%], valid : [loss = 1.140, top1 = 59.81%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.60 ms.
cifar10        train : [loss = 1.056, top1 = 62.78%], test  : [loss = 1.059, top1 = 62.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.72 ms.
cifar100       train : [loss = 2.583, top1 = 34.77%], valid : [loss = 2.649, top1 = 33.24%], test : [loss = 2.627, top1 = 34.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.69 ms.
ImageNet16-120 train : [loss = 3.781, top1 = 13.76%], valid : [loss = 3.758, top1 = 14.17%], test : [loss = 3.786, top1 = 13.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6233/15625) 006233-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.544, top1 = 89.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.33 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.356, top1 = 92.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.65 ms.
cifar100       train : [loss = 0.072, top1 = 98.92%], valid : [loss = 1.487, top1 = 68.34%], test : [loss = 1.493, top1 = 68.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 1.792, top1 = 52.32%], valid : [loss = 2.352, top1 = 41.03%], test : [loss = 2.369, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.57%], valid : [loss = 0.693, top1 = 76.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6234/15625) 006234-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.655, top1 = 85.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.47 ms.
cifar10        train : [loss = 0.033, top1 = 99.10%], test  : [loss = 0.435, top1 = 89.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.419, top1 = 88.34%], valid : [loss = 1.476, top1 = 63.34%], test : [loss = 1.500, top1 = 63.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.97%], valid : [loss = 2.587, top1 = 35.50%], test : [loss = 2.644, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.52%], valid : [loss = 0.805, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6235/15625) 006235-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.519, top1 = 88.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.329, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.343, top1 = 90.63%], valid : [loss = 1.257, top1 = 67.28%], test : [loss = 1.262, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.45%], valid : [loss = 2.454, top1 = 38.40%], test : [loss = 2.407, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6236/15625) 006236-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.914, top1 = 81.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.039, top1 = 98.88%], test  : [loss = 0.570, top1 = 86.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.396, top1 = 89.23%], valid : [loss = 1.869, top1 = 57.26%], test : [loss = 1.831, top1 = 57.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.726, top1 = 32.46%], valid : [loss = 3.086, top1 = 25.93%], test : [loss = 3.123, top1 = 26.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.22%], valid : [loss = 0.939, top1 = 67.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6237/15625) 006237-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.850, top1 = 82.74%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.60 ms.
cifar10        train : [loss = 0.034, top1 = 99.04%], test  : [loss = 0.560, top1 = 87.17%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.66 ms.
cifar100       train : [loss = 0.288, top1 = 92.50%], valid : [loss = 1.831, top1 = 59.72%], test : [loss = 1.847, top1 = 60.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 36.05%], valid : [loss = 2.918, top1 = 30.10%], test : [loss = 2.945, top1 = 29.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.10%], valid : [loss = 0.994, top1 = 64.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6238/15625) 006238-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.22%], valid : [loss = 0.585, top1 = 82.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.269, top1 = 90.87%], test  : [loss = 0.458, top1 = 85.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=8.86 ms.
cifar100       train : [loss = 1.287, top1 = 63.51%], valid : [loss = 1.625, top1 = 56.90%], test : [loss = 1.623, top1 = 56.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 3.010, top1 = 26.98%], valid : [loss = 3.048, top1 = 26.27%], test : [loss = 3.075, top1 = 26.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.124, top1 = 59.84%], valid : [loss = 1.176, top1 = 57.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6239/15625) 006239-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.56%], valid : [loss = 0.598, top1 = 85.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.29 ms.
cifar10        train : [loss = 0.097, top1 = 96.73%], test  : [loss = 0.408, top1 = 88.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.27 ms.
cifar100       train : [loss = 0.782, top1 = 76.78%], valid : [loss = 1.389, top1 = 62.86%], test : [loss = 1.409, top1 = 62.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.662, top1 = 33.19%], valid : [loss = 2.750, top1 = 31.60%], test : [loss = 2.822, top1 = 30.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.01%], valid : [loss = 0.740, top1 = 74.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6240/15625) 006240-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.582, top1 = 87.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.387, top1 = 91.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.210, top1 = 94.80%], valid : [loss = 1.463, top1 = 66.63%], test : [loss = 1.472, top1 = 66.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.48%], valid : [loss = 2.426, top1 = 39.42%], test : [loss = 2.449, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.09%], valid : [loss = 0.725, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6241/15625) 006241-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.574, top1 = 87.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.027, top1 = 99.19%], test  : [loss = 0.375, top1 = 90.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.18 ms.
cifar100       train : [loss = 0.403, top1 = 88.34%], valid : [loss = 1.431, top1 = 64.54%], test : [loss = 1.445, top1 = 64.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.692, top1 = 31.89%], valid : [loss = 2.772, top1 = 29.94%], test : [loss = 2.775, top1 = 30.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.57%], valid : [loss = 1.294, top1 = 52.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6242/15625) 006242-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.03%], valid : [loss = 0.878, top1 = 69.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10        train : [loss = 0.673, top1 = 76.33%], test  : [loss = 0.724, top1 = 75.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.60 ms.
cifar100       train : [loss = 2.218, top1 = 41.41%], valid : [loss = 2.299, top1 = 39.77%], test : [loss = 2.314, top1 = 39.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 3.461, top1 = 18.44%], valid : [loss = 3.442, top1 = 19.60%], test : [loss = 3.470, top1 = 18.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.357, top1 = 50.66%], valid : [loss = 1.406, top1 = 49.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6243/15625) 006243-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.540, top1 = 89.03%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.58 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.365, top1 = 92.20%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.35 ms.
cifar100       train : [loss = 0.191, top1 = 95.45%], valid : [loss = 1.248, top1 = 69.31%], test : [loss = 1.258, top1 = 69.12%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.88 ms.
ImageNet16-120 train : [loss = 1.786, top1 = 52.46%], valid : [loss = 2.182, top1 = 43.53%], test : [loss = 2.195, top1 = 44.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.32%], valid : [loss = 0.727, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6244/15625) 006244-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.19%], valid : [loss = 0.452, top1 = 86.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10        train : [loss = 0.111, top1 = 96.60%], test  : [loss = 0.331, top1 = 89.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.99 ms.
cifar100       train : [loss = 0.864, top1 = 75.42%], valid : [loss = 1.298, top1 = 63.86%], test : [loss = 1.278, top1 = 64.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.51%], valid : [loss = 2.634, top1 = 34.52%], test : [loss = 2.672, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6245/15625) 006245-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.548, top1 = 88.97%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.84 ms.
cifar10        train : [loss = 0.011, top1 = 99.70%], test  : [loss = 0.410, top1 = 91.39%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.82 ms.
cifar100       train : [loss = 0.216, top1 = 94.47%], valid : [loss = 1.368, top1 = 67.04%], test : [loss = 1.394, top1 = 67.08%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.11 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 42.78%], valid : [loss = 2.384, top1 = 38.39%], test : [loss = 2.397, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.51%], valid : [loss = 0.781, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6246/15625) 006246-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.41%], valid : [loss = 0.850, top1 = 79.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.131, top1 = 95.59%], test  : [loss = 0.546, top1 = 84.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.852, top1 = 75.25%], valid : [loss = 1.662, top1 = 57.40%], test : [loss = 1.670, top1 = 57.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.31%], valid : [loss = 3.187, top1 = 23.92%], test : [loss = 3.209, top1 = 23.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.42%], valid : [loss = 1.128, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6247/15625) 006247-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.16%], valid : [loss = 0.469, top1 = 85.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10        train : [loss = 0.157, top1 = 94.94%], test  : [loss = 0.349, top1 = 88.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.54 ms.
cifar100       train : [loss = 0.984, top1 = 71.99%], valid : [loss = 1.351, top1 = 62.27%], test : [loss = 1.345, top1 = 62.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.83%], valid : [loss = 2.685, top1 = 32.81%], test : [loss = 2.713, top1 = 32.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6248/15625) 006248-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.649, top1 = 85.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.037, top1 = 99.03%], test  : [loss = 0.437, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.442, top1 = 87.77%], valid : [loss = 1.435, top1 = 64.09%], test : [loss = 1.413, top1 = 64.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.74%], valid : [loss = 2.638, top1 = 34.29%], test : [loss = 2.662, top1 = 34.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.50%], valid : [loss = 0.799, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6249/15625) 006249-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.47%], valid : [loss = 0.846, top1 = 71.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.58 ms.
cifar10        train : [loss = 0.685, top1 = 75.99%], test  : [loss = 0.774, top1 = 73.21%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 1.955, top1 = 48.10%], valid : [loss = 2.132, top1 = 45.09%], test : [loss = 2.147, top1 = 44.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 3.646, top1 = 15.76%], valid : [loss = 3.666, top1 = 16.26%], test : [loss = 3.690, top1 = 15.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.399, top1 = 49.08%], valid : [loss = 1.419, top1 = 48.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6250/15625) 006250-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.428, top1 = 90.49%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.273, top1 = 93.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.41 ms.
cifar100       train : [loss = 0.184, top1 = 95.65%], valid : [loss = 1.294, top1 = 69.71%], test : [loss = 1.249, top1 = 69.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.71%], valid : [loss = 2.262, top1 = 42.19%], test : [loss = 2.286, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 86.93%], valid : [loss = 0.501, top1 = 83.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6251/15625) 006251-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.472, top1 = 89.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.22 ms.
cifar100       train : [loss = 0.318, top1 = 91.46%], valid : [loss = 1.241, top1 = 67.93%], test : [loss = 1.257, top1 = 67.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.72%], valid : [loss = 2.322, top1 = 41.13%], test : [loss = 2.336, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.03%], valid : [loss = 0.625, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6252/15625) 006252-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.33 ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.19%], valid : [loss = 0.694, top1 = 76.23%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.52 ms.
cifar10        train : [loss = 0.544, top1 = 81.04%], test  : [loss = 0.608, top1 = 79.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.21 ms.
cifar100       train : [loss = 1.768, top1 = 52.07%], valid : [loss = 1.914, top1 = 49.25%], test : [loss = 1.961, top1 = 48.63%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.43 ms.
ImageNet16-120 train : [loss = 3.386, top1 = 20.12%], valid : [loss = 3.376, top1 = 20.82%], test : [loss = 3.397, top1 = 19.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6253/15625) 006253-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.21 ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.35%], valid : [loss = 0.855, top1 = 71.05%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10        train : [loss = 0.698, top1 = 75.58%], test  : [loss = 0.785, top1 = 72.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.58 ms.
cifar100       train : [loss = 1.961, top1 = 47.86%], valid : [loss = 2.135, top1 = 45.02%], test : [loss = 2.165, top1 = 44.18%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.37 ms.
ImageNet16-120 train : [loss = 3.646, top1 = 15.76%], valid : [loss = 3.665, top1 = 15.69%], test : [loss = 3.683, top1 = 15.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6254/15625) 006254-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.27%], valid : [loss = 0.567, top1 = 83.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.184, top1 = 93.73%], test  : [loss = 0.403, top1 = 87.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 1.218, top1 = 65.27%], valid : [loss = 1.541, top1 = 57.54%], test : [loss = 1.548, top1 = 57.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.682, top1 = 33.01%], valid : [loss = 2.738, top1 = 31.96%], test : [loss = 2.764, top1 = 30.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.42%], valid : [loss = 0.926, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6255/15625) 006255-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.65%], valid : [loss = 0.549, top1 = 87.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.363, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.384, top1 = 89.08%], valid : [loss = 1.341, top1 = 65.93%], test : [loss = 1.341, top1 = 66.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.58%], valid : [loss = 2.520, top1 = 36.29%], test : [loss = 2.535, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.12%], valid : [loss = 0.868, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6256/15625) 006256-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.416, top1 = 90.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.276, top1 = 93.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.42 ms.
cifar100       train : [loss = 0.117, top1 = 97.74%], valid : [loss = 1.295, top1 = 70.05%], test : [loss = 1.294, top1 = 69.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.06%], valid : [loss = 2.218, top1 = 43.91%], test : [loss = 2.236, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 87.10%], valid : [loss = 0.509, top1 = 83.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6257/15625) 006257-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.02%], valid : [loss = 0.478, top1 = 84.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.28 ms.
cifar10        train : [loss = 0.303, top1 = 89.88%], test  : [loss = 0.399, top1 = 86.61%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.47 ms.
cifar100       train : [loss = 1.333, top1 = 63.01%], valid : [loss = 1.547, top1 = 57.43%], test : [loss = 1.521, top1 = 58.11%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.83 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.59%], valid : [loss = 2.915, top1 = 29.49%], test : [loss = 2.975, top1 = 28.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6258/15625) 006258-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.558, top1 = 88.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.371, top1 = 92.54%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.22 ms.
cifar100       train : [loss = 0.101, top1 = 98.20%], valid : [loss = 1.460, top1 = 67.61%], test : [loss = 1.443, top1 = 68.25%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.75%], valid : [loss = 2.423, top1 = 39.79%], test : [loss = 2.444, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.31%], valid : [loss = 0.685, top1 = 76.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6259/15625) 006259-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.94%], valid : [loss = 0.477, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10        train : [loss = 0.301, top1 = 89.89%], test  : [loss = 0.404, top1 = 86.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 1.328, top1 = 63.18%], valid : [loss = 1.530, top1 = 57.76%], test : [loss = 1.504, top1 = 58.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.72%], valid : [loss = 2.892, top1 = 29.34%], test : [loss = 2.949, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6260/15625) 006260-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.621, top1 = 87.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.402, top1 = 91.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.31 ms.
cifar100       train : [loss = 0.148, top1 = 96.64%], valid : [loss = 1.553, top1 = 65.74%], test : [loss = 1.530, top1 = 66.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.93%], valid : [loss = 2.488, top1 = 37.73%], test : [loss = 2.505, top1 = 37.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.46%], valid : [loss = 0.789, top1 = 72.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6261/15625) 006261-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.479, top1 = 89.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.326, top1 = 91.25%], valid : [loss = 1.261, top1 = 67.91%], test : [loss = 1.235, top1 = 68.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.81%], valid : [loss = 2.321, top1 = 41.01%], test : [loss = 2.327, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6262/15625) 006262-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.476, top1 = 89.56%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.42 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.300, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.57 ms.
cifar100       train : [loss = 0.202, top1 = 95.10%], valid : [loss = 1.236, top1 = 69.53%], test : [loss = 1.244, top1 = 69.27%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.27 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 51.83%], valid : [loss = 2.204, top1 = 43.48%], test : [loss = 2.218, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.78%], valid : [loss = 0.678, top1 = 76.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6263/15625) 006263-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.65%], valid : [loss = 0.878, top1 = 71.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.550, top1 = 80.80%], test  : [loss = 0.709, top1 = 76.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 1.774, top1 = 52.23%], valid : [loss = 2.055, top1 = 47.02%], test : [loss = 2.059, top1 = 47.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.77%], valid : [loss = 3.633, top1 = 16.60%], test : [loss = 3.672, top1 = 15.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6264/15625) 006264-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.314, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.325, top1 = 91.18%], valid : [loss = 1.322, top1 = 66.69%], test : [loss = 1.299, top1 = 67.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.27%], valid : [loss = 2.373, top1 = 39.42%], test : [loss = 2.386, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.433, top1 = 85.02%], valid : [loss = 0.555, top1 = 81.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6265/15625) 006265-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.487, top1 = 89.75%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.09 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.304, top1 = 93.28%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.45 ms.
cifar100       train : [loss = 0.063, top1 = 99.18%], valid : [loss = 1.278, top1 = 70.43%], test : [loss = 1.298, top1 = 70.62%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.99 ms.
ImageNet16-120 train : [loss = 1.722, top1 = 53.96%], valid : [loss = 2.245, top1 = 43.06%], test : [loss = 2.225, top1 = 43.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.78%], valid : [loss = 0.678, top1 = 76.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6266/15625) 006266-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.43%], valid : [loss = 0.547, top1 = 83.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.03 ms.
cifar10        train : [loss = 0.206, top1 = 93.04%], test  : [loss = 0.395, top1 = 87.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 1.280, top1 = 63.67%], valid : [loss = 1.568, top1 = 57.37%], test : [loss = 1.578, top1 = 56.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.708, top1 = 32.45%], valid : [loss = 2.739, top1 = 31.72%], test : [loss = 2.780, top1 = 30.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.42%], valid : [loss = 0.987, top1 = 65.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6267/15625) 006267-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.514, top1 = 89.62%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.13 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.329, top1 = 92.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.09 ms.
cifar100       train : [loss = 0.116, top1 = 97.67%], valid : [loss = 1.317, top1 = 69.36%], test : [loss = 1.341, top1 = 69.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.75 ms.
ImageNet16-120 train : [loss = 1.714, top1 = 54.26%], valid : [loss = 2.187, top1 = 43.84%], test : [loss = 2.169, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.42%], valid : [loss = 0.612, top1 = 79.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6268/15625) 006268-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.33%], valid : [loss = 0.573, top1 = 81.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.292, top1 = 89.92%], test  : [loss = 0.446, top1 = 85.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 1.523, top1 = 57.37%], valid : [loss = 1.761, top1 = 52.43%], test : [loss = 1.757, top1 = 52.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.947, top1 = 27.60%], valid : [loss = 2.970, top1 = 27.27%], test : [loss = 3.014, top1 = 26.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.28%], valid : [loss = 1.038, top1 = 63.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6269/15625) 006269-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.310, top1 = 93.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.97 ms.
cifar100       train : [loss = 0.134, top1 = 97.32%], valid : [loss = 1.295, top1 = 69.09%], test : [loss = 1.303, top1 = 69.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.41%], valid : [loss = 2.278, top1 = 42.29%], test : [loss = 2.276, top1 = 42.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6270/15625) 006270-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.61%], valid : [loss = 0.871, top1 = 71.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10        train : [loss = 0.551, top1 = 80.79%], test  : [loss = 0.711, top1 = 75.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 1.776, top1 = 52.06%], valid : [loss = 2.046, top1 = 47.19%], test : [loss = 2.062, top1 = 46.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.93%], valid : [loss = 3.623, top1 = 16.51%], test : [loss = 3.674, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6271/15625) 006271-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.516, top1 = 89.62%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.64 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.329, top1 = 93.15%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.33 ms.
cifar100       train : [loss = 0.056, top1 = 99.13%], valid : [loss = 1.381, top1 = 69.63%], test : [loss = 1.357, top1 = 70.49%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.81 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.15%], valid : [loss = 2.444, top1 = 38.51%], test : [loss = 2.454, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.70%], valid : [loss = 0.883, top1 = 68.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6272/15625) 006272-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.14%], valid : [loss = 0.721, top1 = 81.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10        train : [loss = 0.153, top1 = 94.83%], test  : [loss = 0.466, top1 = 86.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.50 ms.
cifar100       train : [loss = 0.964, top1 = 71.96%], valid : [loss = 1.629, top1 = 57.08%], test : [loss = 1.643, top1 = 57.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.46 ms.
ImageNet16-120 train : [loss = 3.051, top1 = 25.43%], valid : [loss = 3.125, top1 = 24.70%], test : [loss = 3.158, top1 = 23.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6273/15625) 006273-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.35 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.478, top1 = 89.24%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.22 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.301, top1 = 92.46%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.71 ms.
cifar100       train : [loss = 0.314, top1 = 91.63%], valid : [loss = 1.237, top1 = 68.04%], test : [loss = 1.236, top1 = 68.69%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=23.43 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.74%], valid : [loss = 2.219, top1 = 42.93%], test : [loss = 2.224, top1 = 43.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.41%], valid : [loss = 0.662, top1 = 76.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6274/15625) 006274-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.77%], valid : [loss = 0.644, top1 = 82.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.146, top1 = 95.08%], test  : [loss = 0.432, top1 = 87.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.89 ms.
cifar100       train : [loss = 0.951, top1 = 72.38%], valid : [loss = 1.496, top1 = 59.69%], test : [loss = 1.499, top1 = 59.69%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 2.865, top1 = 29.34%], valid : [loss = 2.952, top1 = 27.43%], test : [loss = 2.974, top1 = 27.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.75%], valid : [loss = 0.997, top1 = 64.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6275/15625) 006275-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.454, top1 = 86.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.113, top1 = 96.52%], test  : [loss = 0.329, top1 = 89.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.44 ms.
cifar100       train : [loss = 0.870, top1 = 75.14%], valid : [loss = 1.299, top1 = 63.43%], test : [loss = 1.277, top1 = 64.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.20 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.53%], valid : [loss = 2.643, top1 = 33.59%], test : [loss = 2.667, top1 = 33.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6276/15625) 006276-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.471, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.61 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.332, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.251, top1 = 93.41%], valid : [loss = 1.324, top1 = 68.02%], test : [loss = 1.283, top1 = 68.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.31%], valid : [loss = 2.291, top1 = 41.59%], test : [loss = 2.320, top1 = 41.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.98%], valid : [loss = 0.578, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6277/15625) 006277-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.43%], valid : [loss = 0.697, top1 = 84.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.435, top1 = 88.67%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.84 ms.
cifar100       train : [loss = 0.627, top1 = 81.65%], valid : [loss = 1.518, top1 = 61.83%], test : [loss = 1.500, top1 = 61.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.45%], valid : [loss = 2.826, top1 = 30.83%], test : [loss = 2.869, top1 = 30.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.890, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6278/15625) 006278-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.36%], valid : [loss = 0.449, top1 = 87.68%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.22 ms.
cifar10        train : [loss = 0.068, top1 = 98.16%], test  : [loss = 0.314, top1 = 90.28%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.51 ms.
cifar100       train : [loss = 0.607, top1 = 83.29%], valid : [loss = 1.269, top1 = 65.39%], test : [loss = 1.256, top1 = 65.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 40.11%], valid : [loss = 2.517, top1 = 37.08%], test : [loss = 2.537, top1 = 36.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.84%], valid : [loss = 0.655, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6279/15625) 006279-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.85%], valid : [loss = 0.479, top1 = 84.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10        train : [loss = 0.300, top1 = 89.97%], test  : [loss = 0.399, top1 = 86.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.78 ms.
cifar100       train : [loss = 1.327, top1 = 63.19%], valid : [loss = 1.532, top1 = 57.48%], test : [loss = 1.508, top1 = 58.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.60%], valid : [loss = 2.903, top1 = 29.20%], test : [loss = 2.955, top1 = 28.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6280/15625) 006280-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.11%], valid : [loss = 0.474, top1 = 84.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.301, top1 = 89.98%], test  : [loss = 0.396, top1 = 86.63%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.42 ms.
cifar100       train : [loss = 1.335, top1 = 62.86%], valid : [loss = 1.546, top1 = 57.43%], test : [loss = 1.507, top1 = 57.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.68%], valid : [loss = 2.894, top1 = 29.38%], test : [loss = 2.948, top1 = 28.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6281/15625) 006281-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.503, top1 = 88.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.328, top1 = 91.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.35 ms.
cifar100       train : [loss = 0.314, top1 = 91.49%], valid : [loss = 1.265, top1 = 67.17%], test : [loss = 1.270, top1 = 67.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.79%], valid : [loss = 2.305, top1 = 40.58%], test : [loss = 2.340, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.00%], valid : [loss = 0.682, top1 = 76.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6282/15625) 006282-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.474, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.308, top1 = 92.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.62 ms.
cifar100       train : [loss = 0.318, top1 = 91.48%], valid : [loss = 1.261, top1 = 68.01%], test : [loss = 1.249, top1 = 67.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.69%], valid : [loss = 2.301, top1 = 41.20%], test : [loss = 2.329, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.58%], valid : [loss = 0.576, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6283/15625) 006283-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.44%], valid : [loss = 0.572, top1 = 87.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10        train : [loss = 0.036, top1 = 98.93%], test  : [loss = 0.363, top1 = 90.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 0.561, top1 = 83.70%], valid : [loss = 1.409, top1 = 63.46%], test : [loss = 1.397, top1 = 63.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 32.41%], valid : [loss = 2.722, top1 = 31.20%], test : [loss = 2.749, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 70.20%], valid : [loss = 0.871, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6284/15625) 006284-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.29%], valid : [loss = 0.593, top1 = 85.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.65 ms.
cifar10        train : [loss = 0.077, top1 = 97.63%], test  : [loss = 0.403, top1 = 88.73%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.51 ms.
cifar100       train : [loss = 0.714, top1 = 79.24%], valid : [loss = 1.383, top1 = 63.51%], test : [loss = 1.377, top1 = 63.31%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.76%], valid : [loss = 2.661, top1 = 34.18%], test : [loss = 2.691, top1 = 33.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.81%], valid : [loss = 0.802, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6285/15625) 006285-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.471, top1 = 89.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.317, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.272, top1 = 92.72%], valid : [loss = 1.331, top1 = 67.73%], test : [loss = 1.345, top1 = 67.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.003, top1 = 47.49%], valid : [loss = 2.356, top1 = 40.13%], test : [loss = 2.393, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.511, top1 = 82.34%], valid : [loss = 0.600, top1 = 79.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6286/15625) 006286-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.591, top1 = 87.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.399, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.36 ms.
cifar100       train : [loss = 0.371, top1 = 89.51%], valid : [loss = 1.417, top1 = 65.50%], test : [loss = 1.426, top1 = 65.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.281, top1 = 41.30%], valid : [loss = 2.504, top1 = 36.82%], test : [loss = 2.526, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.57%], valid : [loss = 0.848, top1 = 70.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6287/15625) 006287-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.494, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.321, top1 = 92.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.324, top1 = 91.27%], valid : [loss = 1.255, top1 = 67.56%], test : [loss = 1.252, top1 = 68.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.63%], valid : [loss = 2.340, top1 = 40.32%], test : [loss = 2.331, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 82.02%], valid : [loss = 0.607, top1 = 79.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6288/15625) 006288-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.329, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.15 ms.
cifar100       train : [loss = 0.123, top1 = 97.47%], valid : [loss = 1.340, top1 = 68.67%], test : [loss = 1.310, top1 = 69.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.51%], valid : [loss = 2.198, top1 = 43.53%], test : [loss = 2.205, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.77%], valid : [loss = 0.575, top1 = 80.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6289/15625) 006289-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.84 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.53%], valid : [loss = 0.644, top1 = 84.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.085, top1 = 97.29%], test  : [loss = 0.398, top1 = 88.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.80 ms.
cifar100       train : [loss = 0.786, top1 = 76.94%], valid : [loss = 1.423, top1 = 61.78%], test : [loss = 1.400, top1 = 61.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.33%], valid : [loss = 2.737, top1 = 32.49%], test : [loss = 2.765, top1 = 31.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6290/15625) 006290-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.353, top1 = 92.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.173, top1 = 95.69%], valid : [loss = 1.437, top1 = 67.17%], test : [loss = 1.414, top1 = 67.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 49.95%], valid : [loss = 2.298, top1 = 41.52%], test : [loss = 2.339, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.32%], valid : [loss = 0.651, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6291/15625) 006291-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.48%], valid : [loss = 0.600, top1 = 87.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.024, top1 = 99.29%], test  : [loss = 0.396, top1 = 91.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.83 ms.
cifar100       train : [loss = 0.374, top1 = 89.27%], valid : [loss = 1.520, top1 = 62.99%], test : [loss = 1.500, top1 = 63.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 2.831, top1 = 28.90%], valid : [loss = 2.900, top1 = 27.51%], test : [loss = 2.912, top1 = 27.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.152, top1 = 58.09%], valid : [loss = 1.161, top1 = 57.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6292/15625) 006292-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.543, top1 = 88.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.333, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.325, top1 = 91.12%], valid : [loss = 1.324, top1 = 66.84%], test : [loss = 1.303, top1 = 67.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.05%], valid : [loss = 2.415, top1 = 39.19%], test : [loss = 2.413, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6293/15625) 006293-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.496, top1 = 89.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.317, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.19 ms.
cifar100       train : [loss = 0.277, top1 = 92.87%], valid : [loss = 1.222, top1 = 68.59%], test : [loss = 1.226, top1 = 68.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.70%], valid : [loss = 2.242, top1 = 42.28%], test : [loss = 2.232, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6294/15625) 006294-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.52%], valid : [loss = 0.436, top1 = 88.11%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.81 ms.
cifar10        train : [loss = 0.055, top1 = 98.69%], test  : [loss = 0.316, top1 = 90.41%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.91 ms.
cifar100       train : [loss = 0.581, top1 = 84.09%], valid : [loss = 1.211, top1 = 66.55%], test : [loss = 1.204, top1 = 66.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.27%], valid : [loss = 2.457, top1 = 37.92%], test : [loss = 2.483, top1 = 38.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.47%], valid : [loss = 0.632, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6295/15625) 006295-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.24%], valid : [loss = 0.718, top1 = 75.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.578, top1 = 80.05%], test  : [loss = 0.641, top1 = 77.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.46 ms.
cifar100       train : [loss = 1.997, top1 = 46.38%], valid : [loss = 2.128, top1 = 43.75%], test : [loss = 2.112, top1 = 44.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 3.233, top1 = 22.29%], valid : [loss = 3.218, top1 = 22.83%], test : [loss = 3.250, top1 = 21.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 54.01%], valid : [loss = 1.347, top1 = 51.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6296/15625) 006296-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.95%], valid : [loss = 0.470, top1 = 84.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.298, top1 = 89.94%], test  : [loss = 0.394, top1 = 86.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 1.325, top1 = 63.19%], valid : [loss = 1.530, top1 = 58.01%], test : [loss = 1.503, top1 = 58.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.65%], valid : [loss = 2.911, top1 = 29.42%], test : [loss = 2.955, top1 = 27.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6297/15625) 006297-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.42%], valid : [loss = 0.454, top1 = 87.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10        train : [loss = 0.065, top1 = 98.30%], test  : [loss = 0.325, top1 = 90.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.67 ms.
cifar100       train : [loss = 0.631, top1 = 82.45%], valid : [loss = 1.264, top1 = 65.90%], test : [loss = 1.250, top1 = 66.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.95%], valid : [loss = 2.515, top1 = 36.74%], test : [loss = 2.539, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.29%], valid : [loss = 0.619, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6298/15625) 006298-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.600, top1 = 86.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.02 ms.
cifar10        train : [loss = 0.031, top1 = 99.11%], test  : [loss = 0.390, top1 = 90.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.82 ms.
cifar100       train : [loss = 0.521, top1 = 84.86%], valid : [loss = 1.440, top1 = 63.96%], test : [loss = 1.416, top1 = 64.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.35%], valid : [loss = 2.562, top1 = 35.62%], test : [loss = 2.597, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.44%], valid : [loss = 0.833, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6299/15625) 006299-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.539, top1 = 89.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.342, top1 = 92.37%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.29 ms.
cifar100       train : [loss = 0.170, top1 = 95.64%], valid : [loss = 1.379, top1 = 67.82%], test : [loss = 1.384, top1 = 68.03%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.73 ms.
ImageNet16-120 train : [loss = 2.427, top1 = 37.68%], valid : [loss = 2.562, top1 = 34.94%], test : [loss = 2.574, top1 = 34.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.896, top1 = 67.39%], valid : [loss = 0.932, top1 = 66.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6300/15625) 006300-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.17%], valid : [loss = 0.621, top1 = 83.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.096, top1 = 96.85%], test  : [loss = 0.412, top1 = 88.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.73 ms.
cifar100       train : [loss = 0.705, top1 = 79.20%], valid : [loss = 1.533, top1 = 60.36%], test : [loss = 1.529, top1 = 60.79%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 21.52%], valid : [loss = 3.236, top1 = 21.37%], test : [loss = 3.264, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.071, top1 = 61.42%], valid : [loss = 1.095, top1 = 61.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6301/15625) 006301-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.515, top1 = 88.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.326, top1 = 92.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.324, top1 = 91.15%], valid : [loss = 1.284, top1 = 67.70%], test : [loss = 1.264, top1 = 67.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.83%], valid : [loss = 2.371, top1 = 39.54%], test : [loss = 2.385, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.24%], valid : [loss = 0.677, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6302/15625) 006302-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.322, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.29 ms.
cifar100       train : [loss = 0.274, top1 = 92.75%], valid : [loss = 1.247, top1 = 68.03%], test : [loss = 1.245, top1 = 69.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.77%], valid : [loss = 2.285, top1 = 41.59%], test : [loss = 2.299, top1 = 41.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.31%], valid : [loss = 0.637, top1 = 78.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6303/15625) 006303-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 0.493, top1 = 82.81%], valid : [loss = 0.657, top1 = 77.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.04 ms.
cifar10        train : [loss = 0.523, top1 = 81.80%], test  : [loss = 0.595, top1 = 79.60%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.73 ms.
cifar100       train : [loss = 1.701, top1 = 53.89%], valid : [loss = 1.859, top1 = 50.66%], test : [loss = 1.866, top1 = 51.05%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.93 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.22%], valid : [loss = 3.316, top1 = 21.50%], test : [loss = 3.348, top1 = 20.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6304/15625) 006304-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.420, top1 = 91.06%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.87 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.285, top1 = 93.86%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.90 ms.
cifar100       train : [loss = 0.042, top1 = 99.55%], valid : [loss = 1.321, top1 = 70.73%], test : [loss = 1.312, top1 = 71.13%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.70 ms.
ImageNet16-120 train : [loss = 1.428, top1 = 61.11%], valid : [loss = 2.221, top1 = 44.59%], test : [loss = 2.237, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 88.25%], valid : [loss = 0.488, top1 = 83.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6305/15625) 006305-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.428, top1 = 90.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.283, top1 = 93.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.099, top1 = 98.27%], valid : [loss = 1.303, top1 = 70.19%], test : [loss = 1.318, top1 = 69.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 1.647, top1 = 55.72%], valid : [loss = 2.217, top1 = 43.81%], test : [loss = 2.242, top1 = 44.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 84.96%], valid : [loss = 0.548, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6306/15625) 006306-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.624, top1 = 86.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.403, top1 = 89.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.510, top1 = 85.16%], valid : [loss = 1.419, top1 = 63.84%], test : [loss = 1.411, top1 = 64.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.27%], valid : [loss = 2.561, top1 = 35.84%], test : [loss = 2.587, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.33%], valid : [loss = 0.838, top1 = 70.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6307/15625) 006307-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.560, top1 = 88.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.348, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.99 ms.
cifar100       train : [loss = 0.151, top1 = 96.55%], valid : [loss = 1.367, top1 = 68.24%], test : [loss = 1.400, top1 = 68.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.71%], valid : [loss = 2.399, top1 = 39.21%], test : [loss = 2.384, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.46%], valid : [loss = 0.966, top1 = 65.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6308/15625) 006308-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.64%], valid : [loss = 0.565, top1 = 87.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10        train : [loss = 0.030, top1 = 99.08%], test  : [loss = 0.348, top1 = 91.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.28 ms.
cifar100       train : [loss = 0.419, top1 = 87.83%], valid : [loss = 1.276, top1 = 67.14%], test : [loss = 1.281, top1 = 66.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.31 ms.
ImageNet16-120 train : [loss = 2.258, top1 = 41.74%], valid : [loss = 2.441, top1 = 38.23%], test : [loss = 2.468, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.56%], valid : [loss = 0.901, top1 = 68.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6309/15625) 006309-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.609, top1 = 87.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.427, top1 = 91.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.81 ms.
cifar100       train : [loss = 0.137, top1 = 97.00%], valid : [loss = 1.546, top1 = 66.01%], test : [loss = 1.578, top1 = 65.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.021, top1 = 47.22%], valid : [loss = 2.475, top1 = 38.10%], test : [loss = 2.502, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.74%], valid : [loss = 0.797, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6310/15625) 006310-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.587, top1 = 87.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.384, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.390, top1 = 88.92%], valid : [loss = 1.414, top1 = 65.26%], test : [loss = 1.392, top1 = 65.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.09%], valid : [loss = 2.508, top1 = 36.36%], test : [loss = 2.505, top1 = 37.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.59%], valid : [loss = 0.841, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6311/15625) 006311-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.73%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.60 ms.
cifar100       train : [loss = 0.328, top1 = 91.06%], valid : [loss = 1.286, top1 = 66.49%], test : [loss = 1.281, top1 = 67.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.69 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.95%], valid : [loss = 2.417, top1 = 39.01%], test : [loss = 2.415, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.27%], valid : [loss = 0.658, top1 = 77.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6312/15625) 006312-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.61%], valid : [loss = 0.455, top1 = 86.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10        train : [loss = 0.152, top1 = 95.13%], test  : [loss = 0.339, top1 = 88.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.979, top1 = 72.20%], valid : [loss = 1.360, top1 = 62.08%], test : [loss = 1.351, top1 = 62.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.50%], valid : [loss = 2.651, top1 = 33.63%], test : [loss = 2.679, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6313/15625) 006313-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.633, top1 = 86.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.406, top1 = 90.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.288, top1 = 92.53%], valid : [loss = 1.579, top1 = 63.27%], test : [loss = 1.593, top1 = 63.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.89%], valid : [loss = 2.500, top1 = 37.37%], test : [loss = 2.521, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 73.86%], valid : [loss = 0.802, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6314/15625) 006314-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.227, top1 = 92.17%], valid : [loss = 0.507, top1 = 84.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10        train : [loss = 0.236, top1 = 91.92%], test  : [loss = 0.395, top1 = 87.32%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.49 ms.
cifar100       train : [loss = 1.154, top1 = 67.14%], valid : [loss = 1.444, top1 = 60.19%], test : [loss = 1.452, top1 = 59.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.685, top1 = 33.08%], valid : [loss = 2.709, top1 = 33.18%], test : [loss = 2.766, top1 = 31.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 66.04%], valid : [loss = 0.976, top1 = 65.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6315/15625) 006315-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.569, top1 = 88.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.08 ms.
cifar10        train : [loss = 0.009, top1 = 99.76%], test  : [loss = 0.377, top1 = 91.74%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.61 ms.
cifar100       train : [loss = 0.175, top1 = 95.83%], valid : [loss = 1.481, top1 = 65.89%], test : [loss = 1.483, top1 = 65.93%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.429, top1 = 37.34%], valid : [loss = 2.612, top1 = 33.97%], test : [loss = 2.607, top1 = 33.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.01%], valid : [loss = 1.031, top1 = 62.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6316/15625) 006316-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.494, top1 = 89.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.317, top1 = 92.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.50 ms.
cifar100       train : [loss = 0.301, top1 = 92.02%], valid : [loss = 1.229, top1 = 68.26%], test : [loss = 1.242, top1 = 68.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.96%], valid : [loss = 2.219, top1 = 42.22%], test : [loss = 2.227, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6317/15625) 006317-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.599, top1 = 86.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.417, top1 = 89.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.499, top1 = 85.40%], valid : [loss = 1.371, top1 = 64.79%], test : [loss = 1.362, top1 = 64.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.403, top1 = 38.77%], valid : [loss = 2.560, top1 = 35.23%], test : [loss = 2.590, top1 = 35.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.08%], valid : [loss = 0.827, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6318/15625) 006318-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.53%], valid : [loss = 0.649, top1 = 79.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.315, top1 = 89.13%], test  : [loss = 0.491, top1 = 83.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 1.476, top1 = 58.88%], valid : [loss = 1.773, top1 = 52.36%], test : [loss = 1.777, top1 = 52.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 3.161, top1 = 23.88%], valid : [loss = 3.193, top1 = 23.61%], test : [loss = 3.209, top1 = 23.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.063, top1 = 61.62%], valid : [loss = 1.119, top1 = 60.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6319/15625) 006319-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.537, top1 = 88.81%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.42 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.358, top1 = 91.89%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.56 ms.
cifar100       train : [loss = 0.248, top1 = 93.32%], valid : [loss = 1.295, top1 = 68.17%], test : [loss = 1.338, top1 = 67.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.55%], valid : [loss = 2.295, top1 = 41.53%], test : [loss = 2.309, top1 = 41.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.26%], valid : [loss = 0.715, top1 = 75.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6320/15625) 006320-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.492, top1 = 88.94%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.353, top1 = 91.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.31 ms.
cifar100       train : [loss = 0.383, top1 = 89.26%], valid : [loss = 1.353, top1 = 66.31%], test : [loss = 1.328, top1 = 66.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.47%], valid : [loss = 2.410, top1 = 39.10%], test : [loss = 2.452, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.24%], valid : [loss = 0.628, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6321/15625) 006321-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.51%], valid : [loss = 0.639, top1 = 85.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.393, top1 = 90.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 0.537, top1 = 84.19%], valid : [loss = 1.399, top1 = 63.88%], test : [loss = 1.424, top1 = 63.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.50%], valid : [loss = 2.556, top1 = 35.84%], test : [loss = 2.588, top1 = 35.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.24%], valid : [loss = 0.872, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6322/15625) 006322-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.55%], valid : [loss = 0.571, top1 = 81.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.317, top1 = 89.11%], test  : [loss = 0.450, top1 = 85.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 1.561, top1 = 56.50%], valid : [loss = 1.794, top1 = 51.56%], test : [loss = 1.794, top1 = 51.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 3.053, top1 = 25.72%], valid : [loss = 3.039, top1 = 26.40%], test : [loss = 3.113, top1 = 24.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.38%], valid : [loss = 1.079, top1 = 61.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6323/15625) 006323-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.550, top1 = 88.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.352, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.299, top1 = 91.91%], valid : [loss = 1.304, top1 = 67.18%], test : [loss = 1.305, top1 = 67.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.86%], valid : [loss = 2.431, top1 = 38.51%], test : [loss = 2.421, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.82%], valid : [loss = 0.894, top1 = 68.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6324/15625) 006324-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.81%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.33 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.312, top1 = 93.11%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.09 ms.
cifar100       train : [loss = 0.071, top1 = 98.94%], valid : [loss = 1.337, top1 = 69.37%], test : [loss = 1.320, top1 = 70.45%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.25%], valid : [loss = 2.308, top1 = 41.10%], test : [loss = 2.300, top1 = 41.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.898, top1 = 67.80%], valid : [loss = 0.940, top1 = 66.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6325/15625) 006325-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.04%], valid : [loss = 0.854, top1 = 71.75%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10        train : [loss = 0.568, top1 = 80.16%], test  : [loss = 0.717, top1 = 75.38%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.68 ms.
cifar100       train : [loss = 1.801, top1 = 51.51%], valid : [loss = 2.061, top1 = 46.99%], test : [loss = 2.065, top1 = 46.73%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.82 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 16.68%], valid : [loss = 3.647, top1 = 16.14%], test : [loss = 3.663, top1 = 15.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.195, top1 = 56.66%], valid : [loss = 1.253, top1 = 55.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6326/15625) 006326-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.55%], valid : [loss = 0.530, top1 = 84.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.200, top1 = 93.17%], test  : [loss = 0.395, top1 = 87.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.55 ms.
cifar100       train : [loss = 1.271, top1 = 63.85%], valid : [loss = 1.567, top1 = 56.99%], test : [loss = 1.546, top1 = 57.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 32.93%], valid : [loss = 2.694, top1 = 33.02%], test : [loss = 2.754, top1 = 31.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.22%], valid : [loss = 0.961, top1 = 66.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6327/15625) 006327-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.26 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.534, top1 = 88.39%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.02 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.367, top1 = 91.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.27 ms.
cifar100       train : [loss = 0.203, top1 = 95.34%], valid : [loss = 1.395, top1 = 67.45%], test : [loss = 1.374, top1 = 67.39%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 47.14%], valid : [loss = 2.427, top1 = 39.08%], test : [loss = 2.462, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.14%], valid : [loss = 0.706, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6328/15625) 006328-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.89%], valid : [loss = 0.587, top1 = 86.91%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.65 ms.
cifar10        train : [loss = 0.026, top1 = 99.36%], test  : [loss = 0.400, top1 = 89.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.52 ms.
cifar100       train : [loss = 0.327, top1 = 91.49%], valid : [loss = 1.389, top1 = 65.65%], test : [loss = 1.392, top1 = 66.05%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.195, top1 = 43.28%], valid : [loss = 2.512, top1 = 36.96%], test : [loss = 2.535, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.60%], valid : [loss = 0.726, top1 = 74.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6329/15625) 006329-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.525, top1 = 89.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.08 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.342, top1 = 92.72%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.62 ms.
cifar100       train : [loss = 0.101, top1 = 97.93%], valid : [loss = 1.358, top1 = 69.05%], test : [loss = 1.385, top1 = 69.11%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.38%], valid : [loss = 2.263, top1 = 42.64%], test : [loss = 2.273, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.99%], valid : [loss = 0.698, top1 = 75.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6330/15625) 006330-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.442, top1 = 90.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.275, top1 = 94.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.061, top1 = 99.19%], valid : [loss = 1.337, top1 = 70.41%], test : [loss = 1.353, top1 = 70.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 1.517, top1 = 58.89%], valid : [loss = 2.235, top1 = 43.99%], test : [loss = 2.242, top1 = 44.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.20%], valid : [loss = 0.496, top1 = 83.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6331/15625) 006331-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.625, top1 = 86.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.399, top1 = 90.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.35 ms.
cifar100       train : [loss = 0.511, top1 = 85.06%], valid : [loss = 1.414, top1 = 64.27%], test : [loss = 1.436, top1 = 63.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 38.81%], valid : [loss = 2.577, top1 = 35.72%], test : [loss = 2.608, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6332/15625) 006332-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.93%], valid : [loss = 0.736, top1 = 83.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10        train : [loss = 0.084, top1 = 97.34%], test  : [loss = 0.477, top1 = 87.13%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.62 ms.
cifar100       train : [loss = 0.836, top1 = 75.70%], valid : [loss = 1.587, top1 = 59.25%], test : [loss = 1.561, top1 = 59.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.821, top1 = 30.31%], valid : [loss = 2.962, top1 = 27.66%], test : [loss = 3.013, top1 = 27.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6333/15625) 006333-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.595, top1 = 87.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.00 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.390, top1 = 91.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.17 ms.
cifar100       train : [loss = 0.204, top1 = 95.27%], valid : [loss = 1.398, top1 = 66.83%], test : [loss = 1.423, top1 = 66.91%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.08%], valid : [loss = 2.492, top1 = 37.72%], test : [loss = 2.511, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.41%], valid : [loss = 0.747, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6334/15625) 006334-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.20%], valid : [loss = 0.601, top1 = 80.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10        train : [loss = 0.306, top1 = 89.55%], test  : [loss = 0.447, top1 = 85.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 1.541, top1 = 57.04%], valid : [loss = 1.765, top1 = 52.37%], test : [loss = 1.755, top1 = 52.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 3.119, top1 = 24.52%], valid : [loss = 3.113, top1 = 24.58%], test : [loss = 3.161, top1 = 24.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.34%], valid : [loss = 1.096, top1 = 60.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6335/15625) 006335-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.07%], valid : [loss = 0.666, top1 = 82.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.158, top1 = 94.59%], test  : [loss = 0.465, top1 = 86.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.984, top1 = 71.47%], valid : [loss = 1.659, top1 = 56.82%], test : [loss = 1.633, top1 = 57.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 3.082, top1 = 24.68%], valid : [loss = 3.125, top1 = 24.49%], test : [loss = 3.161, top1 = 23.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.31%], valid : [loss = 1.003, top1 = 64.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6336/15625) 006336-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.520, top1 = 88.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.330, top1 = 91.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.91 ms.
cifar100       train : [loss = 0.343, top1 = 90.54%], valid : [loss = 1.271, top1 = 67.47%], test : [loss = 1.315, top1 = 66.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.69%], valid : [loss = 2.413, top1 = 39.14%], test : [loss = 2.421, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6337/15625) 006337-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6338/15625) 006338-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=22.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.486, top1 = 90.06%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=23.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.321, top1 = 93.14%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=22.22 ms.
cifar100       train : [loss = 0.082, top1 = 98.61%], valid : [loss = 1.277, top1 = 70.03%], test : [loss = 1.252, top1 = 70.50%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=25.18 ms.
ImageNet16-120 train : [loss = 1.632, top1 = 56.15%], valid : [loss = 2.114, top1 = 45.42%], test : [loss = 2.149, top1 = 44.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.22%], valid : [loss = 0.677, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6339/15625) 006339-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.21%], valid : [loss = 0.839, top1 = 72.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.561, top1 = 80.41%], test  : [loss = 0.712, top1 = 75.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.20 ms.
cifar100       train : [loss = 1.790, top1 = 52.04%], valid : [loss = 2.057, top1 = 46.91%], test : [loss = 2.082, top1 = 46.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.77%], valid : [loss = 3.637, top1 = 16.66%], test : [loss = 3.674, top1 = 15.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6340/15625) 006340-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.29%], valid : [loss = 0.457, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.162, top1 = 94.71%], test  : [loss = 0.348, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.998, top1 = 71.59%], valid : [loss = 1.358, top1 = 61.97%], test : [loss = 1.356, top1 = 62.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.73%], valid : [loss = 2.695, top1 = 33.08%], test : [loss = 2.711, top1 = 31.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6341/15625) 006341-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.503, top1 = 89.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.327, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.27 ms.
cifar100       train : [loss = 0.148, top1 = 96.87%], valid : [loss = 1.293, top1 = 68.91%], test : [loss = 1.296, top1 = 68.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.45%], valid : [loss = 2.298, top1 = 41.73%], test : [loss = 2.300, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6342/15625) 006342-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.49%], valid : [loss = 0.718, top1 = 83.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.079, top1 = 97.43%], test  : [loss = 0.497, top1 = 86.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.18 ms.
cifar100       train : [loss = 0.494, top1 = 85.82%], valid : [loss = 1.698, top1 = 58.91%], test : [loss = 1.724, top1 = 58.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 3.206, top1 = 22.12%], valid : [loss = 3.251, top1 = 21.38%], test : [loss = 3.266, top1 = 21.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.146, top1 = 57.99%], valid : [loss = 1.172, top1 = 58.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6343/15625) 006343-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.574, top1 = 87.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.384, top1 = 91.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.69 ms.
cifar100       train : [loss = 0.409, top1 = 88.28%], valid : [loss = 1.397, top1 = 65.37%], test : [loss = 1.401, top1 = 65.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.27%], valid : [loss = 2.529, top1 = 36.32%], test : [loss = 2.535, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.79%], valid : [loss = 0.829, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6344/15625) 006344-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.49%], valid : [loss = 0.865, top1 = 71.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.547, top1 = 80.92%], test  : [loss = 0.713, top1 = 75.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.34 ms.
cifar100       train : [loss = 1.764, top1 = 52.45%], valid : [loss = 2.044, top1 = 47.13%], test : [loss = 2.061, top1 = 46.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 16.95%], valid : [loss = 3.631, top1 = 16.41%], test : [loss = 3.669, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6345/15625) 006345-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.82%], valid : [loss = 0.849, top1 = 71.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10        train : [loss = 0.688, top1 = 75.93%], test  : [loss = 0.763, top1 = 73.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.70 ms.
cifar100       train : [loss = 1.946, top1 = 48.17%], valid : [loss = 2.119, top1 = 45.14%], test : [loss = 2.145, top1 = 44.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 3.643, top1 = 15.85%], valid : [loss = 3.676, top1 = 15.99%], test : [loss = 3.696, top1 = 15.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6346/15625) 006346-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.579, top1 = 87.91%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.99 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.380, top1 = 91.71%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.82 ms.
cifar100       train : [loss = 0.177, top1 = 96.10%], valid : [loss = 1.462, top1 = 66.23%], test : [loss = 1.425, top1 = 67.09%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.64 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.57%], valid : [loss = 2.455, top1 = 38.42%], test : [loss = 2.457, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.57%], valid : [loss = 0.724, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6347/15625) 006347-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.600, top1 = 85.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10        train : [loss = 0.069, top1 = 97.92%], test  : [loss = 0.410, top1 = 88.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 0.714, top1 = 79.26%], valid : [loss = 1.388, top1 = 63.58%], test : [loss = 1.371, top1 = 63.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.02%], valid : [loss = 2.658, top1 = 33.50%], test : [loss = 2.690, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6348/15625) 006348-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.09%], valid : [loss = 0.571, top1 = 86.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10        train : [loss = 0.062, top1 = 97.96%], test  : [loss = 0.374, top1 = 89.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.04 ms.
cifar100       train : [loss = 0.615, top1 = 81.84%], valid : [loss = 1.305, top1 = 65.28%], test : [loss = 1.298, top1 = 65.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.10%], valid : [loss = 2.494, top1 = 36.97%], test : [loss = 2.505, top1 = 36.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.46%], valid : [loss = 0.807, top1 = 71.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6349/15625) 006349-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.52%], valid : [loss = 0.460, top1 = 86.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.154, top1 = 95.05%], test  : [loss = 0.348, top1 = 88.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 1.002, top1 = 71.52%], valid : [loss = 1.358, top1 = 61.90%], test : [loss = 1.374, top1 = 61.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.95%], valid : [loss = 2.682, top1 = 33.14%], test : [loss = 2.698, top1 = 33.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6350/15625) 006350-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.180, top1 = 93.94%], valid : [loss = 0.512, top1 = 84.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10        train : [loss = 0.194, top1 = 93.46%], test  : [loss = 0.372, top1 = 88.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.18 ms.
cifar100       train : [loss = 1.201, top1 = 65.76%], valid : [loss = 1.516, top1 = 58.71%], test : [loss = 1.509, top1 = 58.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.741, top1 = 31.88%], valid : [loss = 2.780, top1 = 31.16%], test : [loss = 2.823, top1 = 30.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.27%], valid : [loss = 0.979, top1 = 65.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6351/15625) 006351-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.538, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.338, top1 = 92.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.123, top1 = 97.14%], valid : [loss = 1.374, top1 = 68.91%], test : [loss = 1.387, top1 = 68.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.79%], valid : [loss = 2.347, top1 = 40.62%], test : [loss = 2.350, top1 = 40.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.81%], valid : [loss = 0.795, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6352/15625) 006352-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.540, top1 = 88.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.341, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.27 ms.
cifar100       train : [loss = 0.306, top1 = 91.50%], valid : [loss = 1.259, top1 = 68.06%], test : [loss = 1.256, top1 = 68.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.92%], valid : [loss = 2.314, top1 = 41.07%], test : [loss = 2.312, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.20%], valid : [loss = 0.879, top1 = 68.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6353/15625) 006353-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.05%], valid : [loss = 0.570, top1 = 86.81%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.26 ms.
cifar10        train : [loss = 0.058, top1 = 98.07%], test  : [loss = 0.381, top1 = 89.81%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.17 ms.
cifar100       train : [loss = 0.557, top1 = 83.65%], valid : [loss = 1.309, top1 = 65.45%], test : [loss = 1.320, top1 = 65.46%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.31%], valid : [loss = 2.417, top1 = 38.47%], test : [loss = 2.424, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.80%], valid : [loss = 0.785, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6354/15625) 006354-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.55%], valid : [loss = 0.554, top1 = 83.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.160, top1 = 94.62%], test  : [loss = 0.393, top1 = 87.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.987, top1 = 71.40%], valid : [loss = 1.480, top1 = 59.96%], test : [loss = 1.486, top1 = 60.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.826, top1 = 30.11%], valid : [loss = 2.860, top1 = 29.59%], test : [loss = 2.908, top1 = 29.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.65%], valid : [loss = 0.931, top1 = 67.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6355/15625) 006355-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.502, top1 = 89.51%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.41 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.348, top1 = 92.37%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.76 ms.
cifar100       train : [loss = 0.152, top1 = 96.48%], valid : [loss = 1.383, top1 = 68.73%], test : [loss = 1.341, top1 = 69.07%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.95%], valid : [loss = 2.318, top1 = 41.81%], test : [loss = 2.319, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.40%], valid : [loss = 0.577, top1 = 80.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6356/15625) 006356-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.41%], valid : [loss = 0.456, top1 = 86.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.152, top1 = 95.10%], test  : [loss = 0.350, top1 = 88.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.15 ms.
cifar100       train : [loss = 0.975, top1 = 72.31%], valid : [loss = 1.344, top1 = 62.21%], test : [loss = 1.334, top1 = 62.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.06%], valid : [loss = 2.670, top1 = 33.09%], test : [loss = 2.712, top1 = 32.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6357/15625) 006357-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.01%], valid : [loss = 0.651, top1 = 84.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.89 ms.
cifar10        train : [loss = 0.051, top1 = 98.44%], test  : [loss = 0.402, top1 = 89.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 0.668, top1 = 80.39%], valid : [loss = 1.478, top1 = 61.83%], test : [loss = 1.465, top1 = 62.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 37.34%], valid : [loss = 2.636, top1 = 34.12%], test : [loss = 2.641, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 70.91%], valid : [loss = 0.870, top1 = 69.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6358/15625) 006358-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.91 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.324, top1 = 92.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.52 ms.
cifar100       train : [loss = 0.330, top1 = 91.02%], valid : [loss = 1.278, top1 = 67.29%], test : [loss = 1.300, top1 = 67.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.89%], valid : [loss = 2.411, top1 = 39.31%], test : [loss = 2.418, top1 = 39.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6359/15625) 006359-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.62%], valid : [loss = 0.768, top1 = 80.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.40 ms.
cifar10        train : [loss = 0.122, top1 = 95.85%], test  : [loss = 0.522, top1 = 85.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.46 ms.
cifar100       train : [loss = 0.668, top1 = 80.51%], valid : [loss = 1.672, top1 = 58.22%], test : [loss = 1.682, top1 = 58.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 21.86%], valid : [loss = 3.273, top1 = 21.27%], test : [loss = 3.290, top1 = 21.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.168, top1 = 57.57%], valid : [loss = 1.202, top1 = 56.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6360/15625) 006360-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.51%], valid : [loss = 0.530, top1 = 88.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.032, top1 = 99.04%], test  : [loss = 0.349, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.431, top1 = 87.27%], valid : [loss = 1.258, top1 = 67.13%], test : [loss = 1.262, top1 = 67.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.221, top1 = 42.56%], valid : [loss = 2.390, top1 = 39.46%], test : [loss = 2.411, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 66.84%], valid : [loss = 0.945, top1 = 65.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6361/15625) 006361-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=24.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.498, top1 = 89.59%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=22.76 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.317, top1 = 92.68%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=21.56 ms.
cifar100       train : [loss = 0.105, top1 = 98.12%], valid : [loss = 1.317, top1 = 69.45%], test : [loss = 1.298, top1 = 69.69%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=20.36 ms.
ImageNet16-120 train : [loss = 1.670, top1 = 55.34%], valid : [loss = 2.207, top1 = 43.99%], test : [loss = 2.209, top1 = 44.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.99%], valid : [loss = 0.829, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6362/15625) 006362-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.36%], valid : [loss = 0.633, top1 = 85.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10        train : [loss = 0.052, top1 = 98.49%], test  : [loss = 0.406, top1 = 89.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 0.628, top1 = 81.56%], valid : [loss = 1.425, top1 = 63.07%], test : [loss = 1.424, top1 = 62.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.466, top1 = 37.37%], valid : [loss = 2.612, top1 = 34.39%], test : [loss = 2.644, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.33%], valid : [loss = 0.832, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6363/15625) 006363-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.78%], valid : [loss = 0.461, top1 = 86.16%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10        train : [loss = 0.156, top1 = 94.88%], test  : [loss = 0.342, top1 = 88.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.81 ms.
cifar100       train : [loss = 0.966, top1 = 72.48%], valid : [loss = 1.336, top1 = 62.84%], test : [loss = 1.319, top1 = 62.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.12%], valid : [loss = 2.671, top1 = 33.46%], test : [loss = 2.699, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.38%], valid : [loss = 0.762, top1 = 73.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6364/15625) 006364-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.495, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.306, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.318, top1 = 91.46%], valid : [loss = 1.254, top1 = 67.78%], test : [loss = 1.244, top1 = 68.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.67%], valid : [loss = 2.325, top1 = 40.06%], test : [loss = 2.340, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.49%], valid : [loss = 0.613, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6365/15625) 006365-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.23%], valid : [loss = 0.582, top1 = 85.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.108, top1 = 96.39%], test  : [loss = 0.393, top1 = 88.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.58 ms.
cifar100       train : [loss = 0.816, top1 = 76.03%], valid : [loss = 1.409, top1 = 62.53%], test : [loss = 1.395, top1 = 62.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.01%], valid : [loss = 2.764, top1 = 31.19%], test : [loss = 2.807, top1 = 31.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6366/15625) 006366-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6367/15625) 006367-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.333, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.340, top1 = 90.65%], valid : [loss = 1.265, top1 = 67.29%], test : [loss = 1.264, top1 = 67.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.94%], valid : [loss = 2.403, top1 = 39.20%], test : [loss = 2.405, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6368/15625) 006368-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.533, top1 = 88.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.364, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.84 ms.
cifar100       train : [loss = 0.246, top1 = 93.43%], valid : [loss = 1.305, top1 = 67.92%], test : [loss = 1.325, top1 = 67.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.215, top1 = 42.66%], valid : [loss = 2.434, top1 = 38.03%], test : [loss = 2.450, top1 = 38.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.921, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6369/15625) 006369-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.60%], valid : [loss = 0.516, top1 = 86.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.081, top1 = 97.47%], test  : [loss = 0.343, top1 = 89.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 0.734, top1 = 78.59%], valid : [loss = 1.365, top1 = 64.39%], test : [loss = 1.349, top1 = 63.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.409, top1 = 38.55%], valid : [loss = 2.542, top1 = 35.58%], test : [loss = 2.560, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.64%], valid : [loss = 0.866, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6370/15625) 006370-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.91%], valid : [loss = 0.685, top1 = 76.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10        train : [loss = 0.534, top1 = 81.47%], test  : [loss = 0.599, top1 = 79.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.29 ms.
cifar100       train : [loss = 1.787, top1 = 51.88%], valid : [loss = 1.930, top1 = 48.64%], test : [loss = 1.959, top1 = 48.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 3.402, top1 = 19.85%], valid : [loss = 3.389, top1 = 20.53%], test : [loss = 3.426, top1 = 18.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.381, top1 = 49.69%], valid : [loss = 1.398, top1 = 49.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6371/15625) 006371-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.14%], valid : [loss = 0.730, top1 = 74.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.563, top1 = 80.52%], test  : [loss = 0.621, top1 = 78.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.89 ms.
cifar100       train : [loss = 1.958, top1 = 47.14%], valid : [loss = 2.109, top1 = 44.53%], test : [loss = 2.091, top1 = 44.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.28%], valid : [loss = 3.234, top1 = 23.06%], test : [loss = 3.267, top1 = 21.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6372/15625) 006372-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.504, top1 = 88.64%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.334, top1 = 91.91%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.96 ms.
cifar100       train : [loss = 0.336, top1 = 90.82%], valid : [loss = 1.290, top1 = 67.03%], test : [loss = 1.290, top1 = 67.69%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.93%], valid : [loss = 2.405, top1 = 38.59%], test : [loss = 2.420, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.79%], valid : [loss = 0.697, top1 = 75.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6373/15625) 006373-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.75%], valid : [loss = 0.564, top1 = 86.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.084, top1 = 97.28%], test  : [loss = 0.370, top1 = 89.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.26 ms.
cifar100       train : [loss = 0.755, top1 = 77.88%], valid : [loss = 1.339, top1 = 63.80%], test : [loss = 1.333, top1 = 63.87%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 37.05%], valid : [loss = 2.581, top1 = 34.97%], test : [loss = 2.603, top1 = 35.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.34%], valid : [loss = 0.797, top1 = 72.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6374/15625) 006374-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.85 ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.39%], valid : [loss = 0.647, top1 = 78.17%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 0.506, top1 = 82.50%], test  : [loss = 0.585, top1 = 80.13%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.67 ms.
cifar100       train : [loss = 1.669, top1 = 54.58%], valid : [loss = 1.847, top1 = 50.91%], test : [loss = 1.855, top1 = 51.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.79 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.39%], valid : [loss = 3.310, top1 = 21.52%], test : [loss = 3.352, top1 = 20.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6375/15625) 006375-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.01 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.485, top1 = 90.36%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.88 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.309, top1 = 93.45%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.94 ms.
cifar100       train : [loss = 0.062, top1 = 99.17%], valid : [loss = 1.304, top1 = 70.69%], test : [loss = 1.283, top1 = 70.67%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.08 ms.
ImageNet16-120 train : [loss = 1.547, top1 = 58.17%], valid : [loss = 2.138, top1 = 45.63%], test : [loss = 2.165, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.36%], valid : [loss = 0.616, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6376/15625) 006376-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.92%], valid : [loss = 0.857, top1 = 77.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10        train : [loss = 0.226, top1 = 92.21%], test  : [loss = 0.581, top1 = 82.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.05 ms.
cifar100       train : [loss = 1.162, top1 = 66.94%], valid : [loss = 1.807, top1 = 53.23%], test : [loss = 1.794, top1 = 54.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.87%], valid : [loss = 3.318, top1 = 21.54%], test : [loss = 3.352, top1 = 20.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6377/15625) 006377-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.90 ms.
cifar10-valid  train : [loss = 0.215, top1 = 92.95%], valid : [loss = 0.500, top1 = 84.24%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10        train : [loss = 0.223, top1 = 92.50%], test  : [loss = 0.386, top1 = 87.33%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.22 ms.
cifar100       train : [loss = 1.193, top1 = 66.44%], valid : [loss = 1.505, top1 = 58.13%], test : [loss = 1.507, top1 = 58.39%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.68 ms.
ImageNet16-120 train : [loss = 3.131, top1 = 24.11%], valid : [loss = 3.136, top1 = 23.50%], test : [loss = 3.144, top1 = 24.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.16%], valid : [loss = 0.993, top1 = 64.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6378/15625) 006378-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.40%], valid : [loss = 0.932, top1 = 80.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.049, top1 = 98.57%], test  : [loss = 0.608, top1 = 85.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.459, top1 = 87.37%], valid : [loss = 1.921, top1 = 56.55%], test : [loss = 1.911, top1 = 56.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.763, top1 = 31.63%], valid : [loss = 3.120, top1 = 25.13%], test : [loss = 3.149, top1 = 24.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 65.85%], valid : [loss = 1.001, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6379/15625) 006379-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.235, top1 = 91.96%], valid : [loss = 0.526, top1 = 83.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.242, top1 = 91.78%], test  : [loss = 0.389, top1 = 87.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.90 ms.
cifar100       train : [loss = 1.347, top1 = 62.20%], valid : [loss = 1.607, top1 = 56.27%], test : [loss = 1.604, top1 = 56.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 2.859, top1 = 29.48%], valid : [loss = 2.864, top1 = 29.96%], test : [loss = 2.923, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.20%], valid : [loss = 0.991, top1 = 64.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6380/15625) 006380-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.532, top1 = 89.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.350, top1 = 92.21%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.02 ms.
cifar100       train : [loss = 0.183, top1 = 95.67%], valid : [loss = 1.379, top1 = 67.04%], test : [loss = 1.378, top1 = 67.27%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.84%], valid : [loss = 2.255, top1 = 41.54%], test : [loss = 2.277, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.67%], valid : [loss = 0.861, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6381/15625) 006381-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.331, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.333, top1 = 90.94%], valid : [loss = 1.279, top1 = 67.24%], test : [loss = 1.295, top1 = 66.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.72 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.61%], valid : [loss = 2.415, top1 = 38.42%], test : [loss = 2.421, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6382/15625) 006382-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.429, top1 = 90.41%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.281, top1 = 93.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.60 ms.
cifar100       train : [loss = 0.174, top1 = 95.87%], valid : [loss = 1.264, top1 = 70.15%], test : [loss = 1.275, top1 = 69.53%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.01%], valid : [loss = 2.236, top1 = 42.82%], test : [loss = 2.270, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.95%], valid : [loss = 0.500, top1 = 83.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6383/15625) 006383-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.19%], valid : [loss = 0.533, top1 = 86.40%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10        train : [loss = 0.054, top1 = 98.48%], test  : [loss = 0.360, top1 = 89.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.97 ms.
cifar100       train : [loss = 0.526, top1 = 85.01%], valid : [loss = 1.308, top1 = 65.43%], test : [loss = 1.323, top1 = 65.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.251, top1 = 41.94%], valid : [loss = 2.445, top1 = 38.44%], test : [loss = 2.449, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 70.19%], valid : [loss = 0.895, top1 = 68.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6384/15625) 006384-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.39%], valid : [loss = 0.566, top1 = 85.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10        train : [loss = 0.118, top1 = 96.13%], test  : [loss = 0.371, top1 = 88.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.801, top1 = 76.67%], valid : [loss = 1.419, top1 = 62.01%], test : [loss = 1.425, top1 = 62.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.74%], valid : [loss = 2.611, top1 = 34.58%], test : [loss = 2.641, top1 = 34.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.70%], valid : [loss = 0.920, top1 = 67.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6385/15625) 006385-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.13%], valid : [loss = 0.574, top1 = 86.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.89 ms.
cifar10        train : [loss = 0.062, top1 = 98.01%], test  : [loss = 0.374, top1 = 90.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.88 ms.
cifar100       train : [loss = 0.674, top1 = 80.17%], valid : [loss = 1.344, top1 = 64.37%], test : [loss = 1.325, top1 = 64.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.81%], valid : [loss = 2.484, top1 = 36.69%], test : [loss = 2.493, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6386/15625) 006386-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.498, top1 = 89.27%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.17 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.331, top1 = 92.24%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.89 ms.
cifar100       train : [loss = 0.208, top1 = 94.95%], valid : [loss = 1.270, top1 = 68.75%], test : [loss = 1.276, top1 = 68.71%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 1.881, top1 = 50.22%], valid : [loss = 2.253, top1 = 42.31%], test : [loss = 2.265, top1 = 42.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.78%], valid : [loss = 0.635, top1 = 78.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6387/15625) 006387-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.561, top1 = 88.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.371, top1 = 92.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.71 ms.
cifar100       train : [loss = 0.097, top1 = 98.29%], valid : [loss = 1.443, top1 = 68.08%], test : [loss = 1.457, top1 = 68.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.70%], valid : [loss = 2.431, top1 = 39.63%], test : [loss = 2.450, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6388/15625) 006388-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.42%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.91 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.311, top1 = 93.17%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.59 ms.
cifar100       train : [loss = 0.123, top1 = 97.68%], valid : [loss = 1.299, top1 = 69.34%], test : [loss = 1.288, top1 = 69.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.01 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.04%], valid : [loss = 2.260, top1 = 42.79%], test : [loss = 2.268, top1 = 42.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.26%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6389/15625) 006389-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.23%], valid : [loss = 0.606, top1 = 85.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10        train : [loss = 0.069, top1 = 97.90%], test  : [loss = 0.406, top1 = 88.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.72 ms.
cifar100       train : [loss = 0.718, top1 = 79.13%], valid : [loss = 1.397, top1 = 63.04%], test : [loss = 1.375, top1 = 63.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.99%], valid : [loss = 2.648, top1 = 33.91%], test : [loss = 2.700, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6390/15625) 006390-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.72%], valid : [loss = 0.562, top1 = 82.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.245, top1 = 91.54%], test  : [loss = 0.421, top1 = 86.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 1.256, top1 = 64.46%], valid : [loss = 1.607, top1 = 57.11%], test : [loss = 1.613, top1 = 56.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.965, top1 = 27.64%], valid : [loss = 2.992, top1 = 27.73%], test : [loss = 3.055, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.171, top1 = 57.70%], valid : [loss = 1.212, top1 = 56.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6391/15625) 006391-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.54%], valid : [loss = 0.540, top1 = 84.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.166, top1 = 94.53%], test  : [loss = 0.382, top1 = 88.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.93 ms.
cifar100       train : [loss = 1.199, top1 = 66.04%], valid : [loss = 1.533, top1 = 58.13%], test : [loss = 1.523, top1 = 58.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.31%], valid : [loss = 2.665, top1 = 33.44%], test : [loss = 2.702, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 67.94%], valid : [loss = 0.949, top1 = 66.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6392/15625) 006392-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.603, top1 = 87.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.398, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.201, top1 = 95.38%], valid : [loss = 1.440, top1 = 66.39%], test : [loss = 1.433, top1 = 66.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.24%], valid : [loss = 2.475, top1 = 38.16%], test : [loss = 2.505, top1 = 38.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6393/15625) 006393-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.23%], valid : [loss = 0.574, top1 = 83.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.165, top1 = 94.49%], test  : [loss = 0.394, top1 = 87.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 1.167, top1 = 66.57%], valid : [loss = 1.537, top1 = 57.96%], test : [loss = 1.546, top1 = 57.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.715, top1 = 32.24%], valid : [loss = 2.752, top1 = 31.44%], test : [loss = 2.791, top1 = 30.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.82%], valid : [loss = 0.949, top1 = 66.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6394/15625) 006394-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.544, top1 = 88.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.356, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.67 ms.
cifar100       train : [loss = 0.264, top1 = 92.74%], valid : [loss = 1.342, top1 = 67.49%], test : [loss = 1.350, top1 = 67.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.22%], valid : [loss = 2.440, top1 = 37.72%], test : [loss = 2.448, top1 = 38.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.57%], valid : [loss = 0.950, top1 = 66.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6395/15625) 006395-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.425, top1 = 85.22%], valid : [loss = 0.674, top1 = 78.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10        train : [loss = 0.384, top1 = 86.75%], test  : [loss = 0.526, top1 = 82.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 1.597, top1 = 55.89%], valid : [loss = 1.843, top1 = 50.67%], test : [loss = 1.849, top1 = 51.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 3.292, top1 = 21.58%], valid : [loss = 3.294, top1 = 22.20%], test : [loss = 3.322, top1 = 21.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.01%], valid : [loss = 1.222, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6396/15625) 006396-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.499, top1 = 89.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.309, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.36 ms.
cifar100       train : [loss = 0.123, top1 = 97.65%], valid : [loss = 1.299, top1 = 69.30%], test : [loss = 1.296, top1 = 69.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.55%], valid : [loss = 2.275, top1 = 42.00%], test : [loss = 2.253, top1 = 42.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.36%], valid : [loss = 0.686, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6397/15625) 006397-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.471, top1 = 89.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.319, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.55 ms.
cifar100       train : [loss = 0.314, top1 = 91.60%], valid : [loss = 1.227, top1 = 68.27%], test : [loss = 1.249, top1 = 67.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.78%], valid : [loss = 2.311, top1 = 40.60%], test : [loss = 2.360, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6398/15625) 006398-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.528, top1 = 89.01%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.04 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.360, top1 = 92.02%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.71 ms.
cifar100       train : [loss = 0.090, top1 = 98.65%], valid : [loss = 1.402, top1 = 68.25%], test : [loss = 1.364, top1 = 68.85%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.767, top1 = 53.01%], valid : [loss = 2.369, top1 = 40.26%], test : [loss = 2.389, top1 = 41.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.40%], valid : [loss = 0.665, top1 = 76.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6399/15625) 006399-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.544, top1 = 88.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.369, top1 = 91.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.307, top1 = 91.50%], valid : [loss = 1.393, top1 = 65.41%], test : [loss = 1.414, top1 = 65.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 43.94%], valid : [loss = 2.424, top1 = 39.13%], test : [loss = 2.414, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.39%], valid : [loss = 0.805, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6400/15625) 006400-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.31%], valid : [loss = 0.460, top1 = 86.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10        train : [loss = 0.108, top1 = 96.77%], test  : [loss = 0.324, top1 = 89.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.73 ms.
cifar100       train : [loss = 0.868, top1 = 75.26%], valid : [loss = 1.310, top1 = 64.19%], test : [loss = 1.280, top1 = 63.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.63%], valid : [loss = 2.624, top1 = 34.22%], test : [loss = 2.652, top1 = 33.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6401/15625) 006401-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.59%], valid : [loss = 0.574, top1 = 87.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.043, top1 = 98.70%], test  : [loss = 0.393, top1 = 89.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.16 ms.
cifar100       train : [loss = 0.554, top1 = 83.81%], valid : [loss = 1.375, top1 = 64.78%], test : [loss = 1.403, top1 = 63.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 2.474, top1 = 37.25%], valid : [loss = 2.611, top1 = 34.72%], test : [loss = 2.649, top1 = 33.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.53%], valid : [loss = 0.636, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6402/15625) 006402-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.507, top1 = 89.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.304, top1 = 93.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.69 ms.
cifar100       train : [loss = 0.126, top1 = 97.54%], valid : [loss = 1.296, top1 = 69.04%], test : [loss = 1.278, top1 = 69.53%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.33%], valid : [loss = 2.297, top1 = 41.66%], test : [loss = 2.263, top1 = 42.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6403/15625) 006403-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.73%], valid : [loss = 0.546, top1 = 83.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.223, top1 = 92.37%], test  : [loss = 0.412, top1 = 86.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.78 ms.
cifar100       train : [loss = 1.262, top1 = 64.32%], valid : [loss = 1.591, top1 = 57.24%], test : [loss = 1.592, top1 = 57.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.55%], valid : [loss = 2.966, top1 = 27.93%], test : [loss = 3.010, top1 = 27.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.144, top1 = 58.80%], valid : [loss = 1.204, top1 = 56.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6404/15625) 006404-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.150, top1 = 95.13%], valid : [loss = 0.435, top1 = 86.75%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.56 ms.
cifar10        train : [loss = 0.140, top1 = 95.51%], test  : [loss = 0.307, top1 = 89.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.24 ms.
cifar100       train : [loss = 0.944, top1 = 73.13%], valid : [loss = 1.299, top1 = 63.85%], test : [loss = 1.285, top1 = 63.33%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.68%], valid : [loss = 2.671, top1 = 33.21%], test : [loss = 2.705, top1 = 32.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.951, top1 = 66.02%], valid : [loss = 0.965, top1 = 65.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6405/15625) 006405-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.78%], valid : [loss = 0.511, top1 = 88.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.025, top1 = 99.32%], test  : [loss = 0.332, top1 = 91.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.421, top1 = 87.77%], valid : [loss = 1.241, top1 = 67.60%], test : [loss = 1.228, top1 = 67.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.61 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.69%], valid : [loss = 2.372, top1 = 39.32%], test : [loss = 2.377, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.60%], valid : [loss = 0.677, top1 = 76.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6406/15625) 006406-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.60%], valid : [loss = 0.645, top1 = 78.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10        train : [loss = 0.496, top1 = 82.85%], test  : [loss = 0.580, top1 = 80.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 1.653, top1 = 55.03%], valid : [loss = 1.814, top1 = 51.83%], test : [loss = 1.849, top1 = 51.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.24 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.31%], valid : [loss = 3.310, top1 = 21.77%], test : [loss = 3.349, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6407/15625) 006407-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.45%], valid : [loss = 0.461, top1 = 86.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.152, top1 = 95.10%], test  : [loss = 0.346, top1 = 88.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.973, top1 = 72.39%], valid : [loss = 1.344, top1 = 62.35%], test : [loss = 1.338, top1 = 62.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.05%], valid : [loss = 2.679, top1 = 33.10%], test : [loss = 2.707, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6408/15625) 006408-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.559, top1 = 88.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.07 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.369, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.75 ms.
cifar100       train : [loss = 0.135, top1 = 97.28%], valid : [loss = 1.444, top1 = 67.25%], test : [loss = 1.442, top1 = 67.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.947, top1 = 48.82%], valid : [loss = 2.463, top1 = 38.53%], test : [loss = 2.467, top1 = 39.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.00%], valid : [loss = 0.760, top1 = 73.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6409/15625) 006409-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.46%], valid : [loss = 0.670, top1 = 77.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.519, top1 = 81.97%], test  : [loss = 0.591, top1 = 79.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.14 ms.
cifar100       train : [loss = 1.722, top1 = 53.40%], valid : [loss = 1.872, top1 = 50.29%], test : [loss = 1.897, top1 = 50.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 3.340, top1 = 21.08%], valid : [loss = 3.326, top1 = 21.21%], test : [loss = 3.355, top1 = 21.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 54.17%], valid : [loss = 1.296, top1 = 53.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6410/15625) 006410-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.454, top1 = 89.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 92.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.58 ms.
cifar100       train : [loss = 0.318, top1 = 91.45%], valid : [loss = 1.309, top1 = 67.40%], test : [loss = 1.285, top1 = 67.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.48%], valid : [loss = 2.375, top1 = 40.24%], test : [loss = 2.415, top1 = 39.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.32%], valid : [loss = 0.559, top1 = 80.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6411/15625) 006411-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.324, top1 = 88.90%], valid : [loss = 0.599, top1 = 81.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.260, top1 = 91.06%], test  : [loss = 0.420, top1 = 86.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 1.472, top1 = 58.82%], valid : [loss = 1.728, top1 = 53.07%], test : [loss = 1.720, top1 = 53.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.946, top1 = 27.75%], valid : [loss = 2.967, top1 = 27.71%], test : [loss = 3.004, top1 = 26.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6412/15625) 006412-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.438, top1 = 90.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.280, top1 = 93.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.175, top1 = 95.96%], valid : [loss = 1.263, top1 = 69.83%], test : [loss = 1.268, top1 = 69.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.15%], valid : [loss = 2.248, top1 = 43.11%], test : [loss = 2.271, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.33%], valid : [loss = 0.505, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6413/15625) 006413-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.489, top1 = 89.10%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.313, top1 = 92.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.35 ms.
cifar100       train : [loss = 0.255, top1 = 93.54%], valid : [loss = 1.213, top1 = 68.97%], test : [loss = 1.213, top1 = 69.06%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.45%], valid : [loss = 2.208, top1 = 43.16%], test : [loss = 2.230, top1 = 43.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 82.14%], valid : [loss = 0.607, top1 = 79.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6414/15625) 006414-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.60%], valid : [loss = 0.849, top1 = 72.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10        train : [loss = 0.554, top1 = 80.66%], test  : [loss = 0.709, top1 = 75.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.07 ms.
cifar100       train : [loss = 1.776, top1 = 52.15%], valid : [loss = 2.051, top1 = 46.90%], test : [loss = 2.056, top1 = 46.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.89%], valid : [loss = 3.631, top1 = 16.22%], test : [loss = 3.660, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6415/15625) 006415-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.066, top1 = 97.99%], valid : [loss = 0.620, top1 = 84.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.089, top1 = 97.06%], test  : [loss = 0.412, top1 = 88.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.38 ms.
cifar100       train : [loss = 0.673, top1 = 80.16%], valid : [loss = 1.500, top1 = 61.01%], test : [loss = 1.493, top1 = 61.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 3.185, top1 = 22.31%], valid : [loss = 3.200, top1 = 21.80%], test : [loss = 3.227, top1 = 21.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.098, top1 = 60.32%], valid : [loss = 1.127, top1 = 59.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6416/15625) 006416-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.539, top1 = 89.26%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.358, top1 = 92.67%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.75 ms.
cifar100       train : [loss = 0.065, top1 = 99.10%], valid : [loss = 1.473, top1 = 68.46%], test : [loss = 1.445, top1 = 68.61%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.53%], valid : [loss = 2.391, top1 = 40.83%], test : [loss = 2.385, top1 = 41.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.19%], valid : [loss = 0.686, top1 = 76.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6417/15625) 006417-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.95%], valid : [loss = 0.905, top1 = 68.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.703, top1 = 75.41%], test  : [loss = 0.757, top1 = 73.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.16 ms.
cifar100       train : [loss = 2.131, top1 = 43.40%], valid : [loss = 2.232, top1 = 41.58%], test : [loss = 2.230, top1 = 41.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 3.435, top1 = 18.93%], valid : [loss = 3.418, top1 = 19.19%], test : [loss = 3.438, top1 = 19.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 50.86%], valid : [loss = 1.381, top1 = 50.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6418/15625) 006418-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.573, top1 = 87.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.396, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.227, top1 = 94.20%], valid : [loss = 1.485, top1 = 65.21%], test : [loss = 1.484, top1 = 65.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 45.05%], valid : [loss = 2.477, top1 = 37.87%], test : [loss = 2.537, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.14%], valid : [loss = 0.795, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6419/15625) 006419-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.448, top1 = 89.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.291, top1 = 92.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.70 ms.
cifar100       train : [loss = 0.197, top1 = 95.41%], valid : [loss = 1.265, top1 = 69.51%], test : [loss = 1.248, top1 = 69.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.51%], valid : [loss = 2.252, top1 = 42.72%], test : [loss = 2.285, top1 = 42.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.48%], valid : [loss = 0.515, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6420/15625) 006420-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=22.02 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.561, top1 = 88.93%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=22.85 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.373, top1 = 92.09%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=20.38 ms.
cifar100       train : [loss = 0.090, top1 = 98.28%], valid : [loss = 1.513, top1 = 66.43%], test : [loss = 1.505, top1 = 67.37%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=19.08 ms.
ImageNet16-120 train : [loss = 2.442, top1 = 37.32%], valid : [loss = 2.652, top1 = 33.02%], test : [loss = 2.669, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 1.123, top1 = 58.87%], valid : [loss = 1.134, top1 = 58.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6421/15625) 006421-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.517, top1 = 88.65%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.341, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 0.339, top1 = 90.72%], valid : [loss = 1.289, top1 = 67.14%], test : [loss = 1.282, top1 = 67.79%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.88%], valid : [loss = 2.403, top1 = 39.15%], test : [loss = 2.413, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6422/15625) 006422-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.505, top1 = 89.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.323, top1 = 93.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.60 ms.
cifar100       train : [loss = 0.116, top1 = 97.50%], valid : [loss = 1.342, top1 = 68.99%], test : [loss = 1.365, top1 = 69.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 1.720, top1 = 53.94%], valid : [loss = 2.200, top1 = 43.73%], test : [loss = 2.182, top1 = 44.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.52%], valid : [loss = 0.658, top1 = 77.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6423/15625) 006423-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.78%], valid : [loss = 0.541, top1 = 88.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.35 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.344, top1 = 91.74%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.33 ms.
cifar100       train : [loss = 0.315, top1 = 90.92%], valid : [loss = 1.308, top1 = 67.79%], test : [loss = 1.322, top1 = 67.43%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 2.346, top1 = 39.67%], valid : [loss = 2.503, top1 = 36.50%], test : [loss = 2.523, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 66.68%], valid : [loss = 0.962, top1 = 65.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6424/15625) 006424-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.516, top1 = 88.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.347, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.480, top1 = 85.86%], valid : [loss = 1.362, top1 = 65.50%], test : [loss = 1.335, top1 = 65.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.17%], valid : [loss = 2.541, top1 = 35.90%], test : [loss = 2.539, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.88%], valid : [loss = 0.691, top1 = 76.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6425/15625) 006425-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.296, top1 = 92.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.89 ms.
cifar100       train : [loss = 0.227, top1 = 94.35%], valid : [loss = 1.248, top1 = 68.76%], test : [loss = 1.257, top1 = 69.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.08%], valid : [loss = 2.258, top1 = 41.92%], test : [loss = 2.295, top1 = 42.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.36%], valid : [loss = 0.532, top1 = 81.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6426/15625) 006426-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.62%], valid : [loss = 0.478, top1 = 84.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10        train : [loss = 0.229, top1 = 92.34%], test  : [loss = 0.391, top1 = 87.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 1.175, top1 = 66.76%], valid : [loss = 1.483, top1 = 58.65%], test : [loss = 1.481, top1 = 58.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 3.383, top1 = 20.06%], valid : [loss = 3.386, top1 = 20.63%], test : [loss = 3.401, top1 = 19.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6427/15625) 006427-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.546, top1 = 88.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.348, top1 = 91.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.70 ms.
cifar100       train : [loss = 0.291, top1 = 91.82%], valid : [loss = 1.308, top1 = 67.70%], test : [loss = 1.333, top1 = 67.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.83%], valid : [loss = 2.429, top1 = 38.40%], test : [loss = 2.421, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6428/15625) 006428-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.566, top1 = 87.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.395, top1 = 91.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.406, top1 = 88.42%], valid : [loss = 1.410, top1 = 64.97%], test : [loss = 1.389, top1 = 65.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.92%], valid : [loss = 2.514, top1 = 37.09%], test : [loss = 2.528, top1 = 37.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6429/15625) 006429-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.91 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.64%], valid : [loss = 0.852, top1 = 72.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10        train : [loss = 0.546, top1 = 80.88%], test  : [loss = 0.703, top1 = 76.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.65 ms.
cifar100       train : [loss = 1.776, top1 = 52.19%], valid : [loss = 2.062, top1 = 47.02%], test : [loss = 2.076, top1 = 46.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.85%], valid : [loss = 3.641, top1 = 16.62%], test : [loss = 3.670, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6430/15625) 006430-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.48%], valid : [loss = 0.600, top1 = 84.46%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.28 ms.
cifar10        train : [loss = 0.113, top1 = 96.31%], test  : [loss = 0.414, top1 = 88.40%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.64 ms.
cifar100       train : [loss = 0.623, top1 = 81.54%], valid : [loss = 1.532, top1 = 61.02%], test : [loss = 1.513, top1 = 61.77%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 3.198, top1 = 21.93%], valid : [loss = 3.226, top1 = 21.73%], test : [loss = 3.245, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 61.48%], valid : [loss = 1.088, top1 = 61.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6431/15625) 006431-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.468, top1 = 89.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.94 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.287, top1 = 93.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.93 ms.
cifar100       train : [loss = 0.291, top1 = 92.34%], valid : [loss = 1.239, top1 = 68.65%], test : [loss = 1.223, top1 = 68.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.08%], valid : [loss = 2.220, top1 = 42.78%], test : [loss = 2.228, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.47%], valid : [loss = 0.649, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6432/15625) 006432-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.609, top1 = 85.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.408, top1 = 88.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.59 ms.
cifar100       train : [loss = 0.721, top1 = 78.98%], valid : [loss = 1.384, top1 = 63.53%], test : [loss = 1.369, top1 = 63.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.08%], valid : [loss = 2.661, top1 = 33.39%], test : [loss = 2.698, top1 = 33.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6433/15625) 006433-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.553, top1 = 88.37%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=17.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.336, top1 = 92.29%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=16.50 ms.
cifar100       train : [loss = 0.291, top1 = 91.98%], valid : [loss = 1.314, top1 = 67.31%], test : [loss = 1.327, top1 = 67.49%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.34%], valid : [loss = 2.424, top1 = 38.29%], test : [loss = 2.422, top1 = 38.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.32%], valid : [loss = 0.852, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6434/15625) 006434-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.513, top1 = 88.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.15 ms.
cifar10        train : [loss = 0.026, top1 = 99.39%], test  : [loss = 0.349, top1 = 91.08%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.21 ms.
cifar100       train : [loss = 0.399, top1 = 88.72%], valid : [loss = 1.325, top1 = 66.78%], test : [loss = 1.312, top1 = 66.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.31%], valid : [loss = 2.409, top1 = 38.85%], test : [loss = 2.420, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.78%], valid : [loss = 0.608, top1 = 79.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6435/15625) 006435-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.451, top1 = 87.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.113, top1 = 96.51%], test  : [loss = 0.323, top1 = 89.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.18 ms.
cifar100       train : [loss = 0.865, top1 = 75.37%], valid : [loss = 1.292, top1 = 64.44%], test : [loss = 1.293, top1 = 64.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.49%], valid : [loss = 2.635, top1 = 33.97%], test : [loss = 2.664, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6436/15625) 006436-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.530, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.327, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.29 ms.
cifar100       train : [loss = 0.236, top1 = 93.84%], valid : [loss = 1.265, top1 = 68.56%], test : [loss = 1.266, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.12%], valid : [loss = 2.239, top1 = 42.46%], test : [loss = 2.284, top1 = 42.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.02%], valid : [loss = 0.673, top1 = 76.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6437/15625) 006437-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.45%], valid : [loss = 0.463, top1 = 86.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.148, top1 = 95.23%], test  : [loss = 0.337, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 0.981, top1 = 72.13%], valid : [loss = 1.336, top1 = 62.52%], test : [loss = 1.330, top1 = 62.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.17%], valid : [loss = 2.667, top1 = 33.57%], test : [loss = 2.698, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.32%], valid : [loss = 0.770, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6438/15625) 006438-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.49%], valid : [loss = 0.535, top1 = 83.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.64 ms.
cifar10        train : [loss = 0.248, top1 = 91.53%], test  : [loss = 0.396, top1 = 86.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 1.349, top1 = 61.99%], valid : [loss = 1.603, top1 = 56.15%], test : [loss = 1.599, top1 = 56.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.853, top1 = 29.52%], valid : [loss = 2.854, top1 = 29.71%], test : [loss = 2.911, top1 = 28.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.20%], valid : [loss = 0.991, top1 = 64.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6439/15625) 006439-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.41%], valid : [loss = 0.860, top1 = 78.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10        train : [loss = 0.159, top1 = 94.61%], test  : [loss = 0.545, top1 = 84.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.99 ms.
cifar100       train : [loss = 0.951, top1 = 72.57%], valid : [loss = 1.673, top1 = 56.73%], test : [loss = 1.698, top1 = 56.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 3.064, top1 = 25.88%], valid : [loss = 3.199, top1 = 23.27%], test : [loss = 3.237, top1 = 23.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.002, top1 = 63.92%], valid : [loss = 1.061, top1 = 62.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6440/15625) 006440-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.25%], valid : [loss = 0.550, top1 = 87.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.057, top1 = 98.18%], test  : [loss = 0.373, top1 = 89.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.37 ms.
cifar100       train : [loss = 0.633, top1 = 81.38%], valid : [loss = 1.271, top1 = 65.73%], test : [loss = 1.278, top1 = 65.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 2.355, top1 = 39.70%], valid : [loss = 2.493, top1 = 36.82%], test : [loss = 2.530, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.66%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6441/15625) 006441-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.574, top1 = 87.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.10 ms.
cifar10        train : [loss = 0.019, top1 = 99.47%], test  : [loss = 0.393, top1 = 91.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.10 ms.
cifar100       train : [loss = 0.226, top1 = 94.06%], valid : [loss = 1.357, top1 = 67.02%], test : [loss = 1.349, top1 = 67.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 37.54%], valid : [loss = 2.574, top1 = 34.40%], test : [loss = 2.582, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.38%], valid : [loss = 0.970, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6442/15625) 006442-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.59%], valid : [loss = 1.097, top1 = 63.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.24 ms.
cifar10        train : [loss = 0.803, top1 = 71.66%], test  : [loss = 0.932, top1 = 67.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.92 ms.
cifar100       train : [loss = 2.140, top1 = 43.91%], valid : [loss = 2.396, top1 = 39.91%], test : [loss = 2.428, top1 = 39.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 3.768, top1 = 13.94%], valid : [loss = 3.816, top1 = 13.45%], test : [loss = 3.828, top1 = 13.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.58%], valid : [loss = 1.410, top1 = 49.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6443/15625) 006443-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.75 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.50%], valid : [loss = 0.851, top1 = 72.07%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10        train : [loss = 0.551, top1 = 80.83%], test  : [loss = 0.708, top1 = 76.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.14 ms.
cifar100       train : [loss = 1.774, top1 = 52.08%], valid : [loss = 2.046, top1 = 47.08%], test : [loss = 2.072, top1 = 45.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.34 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.83%], valid : [loss = 3.638, top1 = 15.97%], test : [loss = 3.657, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6444/15625) 006444-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.532, top1 = 89.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.09 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.327, top1 = 92.48%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.59 ms.
cifar100       train : [loss = 0.145, top1 = 96.98%], valid : [loss = 1.293, top1 = 69.36%], test : [loss = 1.296, top1 = 69.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.14%], valid : [loss = 2.306, top1 = 40.87%], test : [loss = 2.305, top1 = 41.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.70%], valid : [loss = 0.753, top1 = 74.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6445/15625) 006445-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.552, top1 = 87.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.03 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.356, top1 = 91.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.78 ms.
cifar100       train : [loss = 0.195, top1 = 95.57%], valid : [loss = 1.407, top1 = 66.69%], test : [loss = 1.388, top1 = 67.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.92%], valid : [loss = 2.440, top1 = 39.30%], test : [loss = 2.436, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.27%], valid : [loss = 0.725, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6446/15625) 006446-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.355, top1 = 92.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.32 ms.
cifar100       train : [loss = 0.083, top1 = 98.69%], valid : [loss = 1.438, top1 = 68.87%], test : [loss = 1.425, top1 = 68.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 1.762, top1 = 53.09%], valid : [loss = 2.348, top1 = 40.92%], test : [loss = 2.375, top1 = 41.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.06%], valid : [loss = 0.669, top1 = 76.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6447/15625) 006447-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.76 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.33%], valid : [loss = 0.457, top1 = 86.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10        train : [loss = 0.115, top1 = 96.47%], test  : [loss = 0.330, top1 = 89.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 0.859, top1 = 75.62%], valid : [loss = 1.297, top1 = 64.53%], test : [loss = 1.288, top1 = 63.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.80 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.64%], valid : [loss = 2.626, top1 = 34.03%], test : [loss = 2.673, top1 = 33.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6448/15625) 006448-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.64 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.28 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6449/15625) 006449-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.500, top1 = 89.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.76 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.300, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.40 ms.
cifar100       train : [loss = 0.125, top1 = 97.56%], valid : [loss = 1.296, top1 = 69.47%], test : [loss = 1.294, top1 = 69.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.22%], valid : [loss = 2.298, top1 = 41.75%], test : [loss = 2.259, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6450/15625) 006450-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.84 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.67 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6451/15625) 006451-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.653, top1 = 86.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.424, top1 = 90.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.60 ms.
cifar100       train : [loss = 0.192, top1 = 95.43%], valid : [loss = 1.622, top1 = 63.88%], test : [loss = 1.641, top1 = 63.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.83%], valid : [loss = 2.458, top1 = 37.93%], test : [loss = 2.473, top1 = 38.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 72.98%], valid : [loss = 0.825, top1 = 70.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6452/15625) 006452-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.428, top1 = 90.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.296, top1 = 93.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 0.181, top1 = 95.79%], valid : [loss = 1.298, top1 = 68.99%], test : [loss = 1.287, top1 = 69.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.48%], valid : [loss = 2.285, top1 = 41.73%], test : [loss = 2.293, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.05%], valid : [loss = 0.550, top1 = 81.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6453/15625) 006453-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.82 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.24%], valid : [loss = 0.478, top1 = 84.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.02 ms.
cifar10        train : [loss = 0.294, top1 = 90.18%], test  : [loss = 0.402, top1 = 86.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.10 ms.
cifar100       train : [loss = 1.324, top1 = 63.18%], valid : [loss = 1.535, top1 = 57.74%], test : [loss = 1.513, top1 = 58.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.88%], valid : [loss = 2.889, top1 = 30.15%], test : [loss = 2.947, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6454/15625) 006454-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.83 ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.75%], valid : [loss = 0.776, top1 = 73.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.511, top1 = 81.98%], test  : [loss = 0.621, top1 = 78.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.25 ms.
cifar100       train : [loss = 1.933, top1 = 47.88%], valid : [loss = 2.128, top1 = 44.57%], test : [loss = 2.115, top1 = 44.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 3.519, top1 = 17.50%], valid : [loss = 3.510, top1 = 18.38%], test : [loss = 3.544, top1 = 17.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.247, top1 = 54.82%], valid : [loss = 1.271, top1 = 54.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6455/15625) 006455-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.572, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.393, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.393, top1 = 88.84%], valid : [loss = 1.394, top1 = 65.43%], test : [loss = 1.409, top1 = 64.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.30%], valid : [loss = 2.504, top1 = 37.55%], test : [loss = 2.504, top1 = 37.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.96%], valid : [loss = 0.815, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6456/15625) 006456-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.448, top1 = 89.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.314, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.32 ms.
cifar100       train : [loss = 0.316, top1 = 91.55%], valid : [loss = 1.317, top1 = 67.14%], test : [loss = 1.322, top1 = 66.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.51%], valid : [loss = 2.368, top1 = 39.80%], test : [loss = 2.420, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.86%], valid : [loss = 0.540, top1 = 81.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6457/15625) 006457-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.21%], valid : [loss = 0.451, top1 = 86.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.113, top1 = 96.49%], test  : [loss = 0.319, top1 = 89.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.856, top1 = 75.58%], valid : [loss = 1.297, top1 = 64.09%], test : [loss = 1.282, top1 = 63.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.79%], valid : [loss = 2.623, top1 = 33.98%], test : [loss = 2.651, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6458/15625) 006458-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.567, top1 = 87.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.388, top1 = 91.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 0.391, top1 = 88.92%], valid : [loss = 1.402, top1 = 65.13%], test : [loss = 1.388, top1 = 65.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.99%], valid : [loss = 2.508, top1 = 37.11%], test : [loss = 2.533, top1 = 36.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6459/15625) 006459-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.496, top1 = 89.93%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.324, top1 = 93.11%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.57 ms.
cifar100       train : [loss = 0.118, top1 = 97.68%], valid : [loss = 1.318, top1 = 68.81%], test : [loss = 1.292, top1 = 69.61%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 55.01%], valid : [loss = 2.165, top1 = 44.06%], test : [loss = 2.152, top1 = 45.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.37%], valid : [loss = 0.606, top1 = 79.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6460/15625) 006460-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.560, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10        train : [loss = 0.025, top1 = 99.29%], test  : [loss = 0.360, top1 = 91.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.97 ms.
cifar100       train : [loss = 0.373, top1 = 89.15%], valid : [loss = 1.293, top1 = 67.46%], test : [loss = 1.329, top1 = 66.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 32.88%], valid : [loss = 2.711, top1 = 31.38%], test : [loss = 2.724, top1 = 31.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.46%], valid : [loss = 0.958, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6461/15625) 006461-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.527, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.342, top1 = 91.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.334, top1 = 90.78%], valid : [loss = 1.294, top1 = 67.13%], test : [loss = 1.310, top1 = 67.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 44.05%], valid : [loss = 2.416, top1 = 38.65%], test : [loss = 2.431, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6462/15625) 006462-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.66%], valid : [loss = 0.857, top1 = 72.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.543, top1 = 81.10%], test  : [loss = 0.712, top1 = 76.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.46 ms.
cifar100       train : [loss = 1.766, top1 = 52.20%], valid : [loss = 2.044, top1 = 46.45%], test : [loss = 2.060, top1 = 47.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.96%], valid : [loss = 3.639, top1 = 16.15%], test : [loss = 3.661, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.203, top1 = 56.89%], valid : [loss = 1.260, top1 = 54.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6463/15625) 006463-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.34%], valid : [loss = 0.615, top1 = 85.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.92 ms.
cifar10        train : [loss = 0.072, top1 = 97.79%], test  : [loss = 0.399, top1 = 88.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.717, top1 = 79.25%], valid : [loss = 1.403, top1 = 62.89%], test : [loss = 1.390, top1 = 62.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.88%], valid : [loss = 2.658, top1 = 34.40%], test : [loss = 2.696, top1 = 33.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.36%], valid : [loss = 0.792, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6464/15625) 006464-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.483, top1 = 89.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.20 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.353, top1 = 92.31%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.76 ms.
cifar100       train : [loss = 0.226, top1 = 93.87%], valid : [loss = 1.381, top1 = 67.57%], test : [loss = 1.379, top1 = 67.41%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.32%], valid : [loss = 2.304, top1 = 41.77%], test : [loss = 2.340, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.88%], valid : [loss = 0.612, top1 = 79.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6465/15625) 006465-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.537, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.364, top1 = 92.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.40 ms.
cifar100       train : [loss = 0.107, top1 = 98.09%], valid : [loss = 1.425, top1 = 68.27%], test : [loss = 1.423, top1 = 68.14%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.44%], valid : [loss = 2.437, top1 = 39.75%], test : [loss = 2.445, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.58%], valid : [loss = 0.712, top1 = 75.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6466/15625) 006466-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.84 ms.
cifar10-valid  train : [loss = 0.290, top1 = 89.88%], valid : [loss = 0.552, top1 = 82.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.274, top1 = 90.68%], test  : [loss = 0.410, top1 = 86.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 1.439, top1 = 59.49%], valid : [loss = 1.675, top1 = 54.64%], test : [loss = 1.674, top1 = 54.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.45%], valid : [loss = 2.929, top1 = 28.27%], test : [loss = 2.973, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.14%], valid : [loss = 1.013, top1 = 63.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6467/15625) 006467-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.542, top1 = 88.70%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.343, top1 = 92.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.87 ms.
cifar100       train : [loss = 0.238, top1 = 93.63%], valid : [loss = 1.298, top1 = 68.12%], test : [loss = 1.308, top1 = 68.42%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.44%], valid : [loss = 2.401, top1 = 38.50%], test : [loss = 2.438, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.47%], valid : [loss = 0.928, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6468/15625) 006468-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.292, top1 = 89.93%], valid : [loss = 0.547, top1 = 82.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.294, top1 = 89.88%], test  : [loss = 0.428, top1 = 85.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.78 ms.
cifar100       train : [loss = 1.301, top1 = 63.23%], valid : [loss = 1.582, top1 = 56.95%], test : [loss = 1.566, top1 = 57.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.79 ms.
ImageNet16-120 train : [loss = 3.059, top1 = 25.97%], valid : [loss = 3.080, top1 = 25.55%], test : [loss = 3.124, top1 = 25.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.11%], valid : [loss = 1.251, top1 = 54.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6469/15625) 006469-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.63 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.43%], valid : [loss = 0.856, top1 = 71.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10        train : [loss = 0.545, top1 = 80.92%], test  : [loss = 0.713, top1 = 75.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.92 ms.
cifar100       train : [loss = 1.767, top1 = 52.39%], valid : [loss = 2.035, top1 = 47.32%], test : [loss = 2.040, top1 = 46.99%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 3.575, top1 = 16.99%], valid : [loss = 3.631, top1 = 16.25%], test : [loss = 3.670, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6470/15625) 006470-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.534, top1 = 88.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.328, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.51 ms.
cifar100       train : [loss = 0.362, top1 = 89.97%], valid : [loss = 1.281, top1 = 66.94%], test : [loss = 1.274, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.60%], valid : [loss = 2.422, top1 = 38.88%], test : [loss = 2.416, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6471/15625) 006471-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.40%], valid : [loss = 1.104, top1 = 63.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.59 ms.
cifar10        train : [loss = 0.790, top1 = 72.16%], test  : [loss = 0.934, top1 = 67.50%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.91 ms.
cifar100       train : [loss = 2.130, top1 = 44.21%], valid : [loss = 2.423, top1 = 39.79%], test : [loss = 2.427, top1 = 39.34%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 3.758, top1 = 14.00%], valid : [loss = 3.819, top1 = 13.77%], test : [loss = 3.831, top1 = 13.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6472/15625) 006472-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.61%], valid : [loss = 0.574, top1 = 87.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.025, top1 = 99.33%], test  : [loss = 0.361, top1 = 91.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.32 ms.
cifar100       train : [loss = 0.430, top1 = 87.50%], valid : [loss = 1.341, top1 = 66.02%], test : [loss = 1.338, top1 = 65.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.418, top1 = 38.18%], valid : [loss = 2.565, top1 = 35.10%], test : [loss = 2.600, top1 = 35.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.00%], valid : [loss = 0.902, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6473/15625) 006473-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.467, top1 = 89.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.327, top1 = 91.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.25 ms.
cifar100       train : [loss = 0.327, top1 = 91.25%], valid : [loss = 1.322, top1 = 66.65%], test : [loss = 1.336, top1 = 66.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.39%], valid : [loss = 2.359, top1 = 39.57%], test : [loss = 2.403, top1 = 39.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6474/15625) 006474-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.605, top1 = 87.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.399, top1 = 91.54%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.38 ms.
cifar100       train : [loss = 0.120, top1 = 97.72%], valid : [loss = 1.475, top1 = 66.89%], test : [loss = 1.495, top1 = 67.15%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.53 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.83%], valid : [loss = 2.449, top1 = 39.08%], test : [loss = 2.440, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.00%], valid : [loss = 0.766, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6475/15625) 006475-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.551, top1 = 88.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.020, top1 = 99.44%], test  : [loss = 0.374, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 0.295, top1 = 91.82%], valid : [loss = 1.308, top1 = 67.23%], test : [loss = 1.323, top1 = 66.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.086, top1 = 45.42%], valid : [loss = 2.360, top1 = 39.83%], test : [loss = 2.359, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.75%], valid : [loss = 0.780, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6476/15625) 006476-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.29%], valid : [loss = 0.859, top1 = 71.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10        train : [loss = 0.552, top1 = 80.71%], test  : [loss = 0.714, top1 = 75.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.46 ms.
cifar100       train : [loss = 1.774, top1 = 52.17%], valid : [loss = 2.050, top1 = 46.83%], test : [loss = 2.047, top1 = 47.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.76%], valid : [loss = 3.640, top1 = 16.61%], test : [loss = 3.673, top1 = 16.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6477/15625) 006477-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.16 ms.
cifar10-valid  train : [loss = 1.627, top1 = 38.90%], valid : [loss = 1.637, top1 = 38.65%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.86 ms.
cifar10        train : [loss = 1.417, top1 = 48.28%], test  : [loss = 1.412, top1 = 48.45%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.98 ms.
cifar100       train : [loss = 3.871, top1 = 10.53%], valid : [loss = 3.916, top1 = 9.77%], test : [loss = 3.911, top1 = 10.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.30 ms.
ImageNet16-120 train : [loss = 4.019, top1 = 10.06%], valid : [loss = 4.024, top1 = 10.27%], test : [loss = 4.035, top1 = 10.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.984, top1 = 26.04%], valid : [loss = 1.989, top1 = 26.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6478/15625) 006478-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.37 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.83 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6479/15625) 006479-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.81%], valid : [loss = 0.515, top1 = 88.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.340, top1 = 91.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.40 ms.
cifar100       train : [loss = 0.483, top1 = 85.84%], valid : [loss = 1.332, top1 = 66.09%], test : [loss = 1.321, top1 = 65.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.13%], valid : [loss = 2.514, top1 = 36.88%], test : [loss = 2.550, top1 = 36.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.48%], valid : [loss = 0.619, top1 = 78.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6480/15625) 006480-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.19 ms.
cifar10-valid  train : [loss = 0.943, top1 = 67.02%], valid : [loss = 0.986, top1 = 65.80%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.87 ms.
cifar10        train : [loss = 0.905, top1 = 68.59%], test  : [loss = 0.903, top1 = 68.36%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.34 ms.
cifar100       train : [loss = 2.394, top1 = 38.85%], valid : [loss = 2.461, top1 = 37.45%], test : [loss = 2.451, top1 = 37.94%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.69 ms.
ImageNet16-120 train : [loss = 3.637, top1 = 15.90%], valid : [loss = 3.599, top1 = 17.12%], test : [loss = 3.633, top1 = 16.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.604, top1 = 39.67%], valid : [loss = 1.620, top1 = 38.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6481/15625) 006481-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.37%], valid : [loss = 0.458, top1 = 86.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.67 ms.
cifar10        train : [loss = 0.152, top1 = 95.05%], test  : [loss = 0.342, top1 = 88.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.78 ms.
cifar100       train : [loss = 0.981, top1 = 72.02%], valid : [loss = 1.347, top1 = 62.27%], test : [loss = 1.342, top1 = 62.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.09%], valid : [loss = 2.673, top1 = 32.93%], test : [loss = 2.692, top1 = 33.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6482/15625) 006482-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.65 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.77%], valid : [loss = 0.868, top1 = 71.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.562, top1 = 80.35%], test  : [loss = 0.715, top1 = 75.63%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.25 ms.
cifar100       train : [loss = 1.774, top1 = 52.18%], valid : [loss = 2.046, top1 = 47.33%], test : [loss = 2.057, top1 = 47.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.73 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.71%], valid : [loss = 3.648, top1 = 16.58%], test : [loss = 3.671, top1 = 15.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6483/15625) 006483-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.442, top1 = 90.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.24 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.308, top1 = 93.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.03 ms.
cifar100       train : [loss = 0.074, top1 = 98.81%], valid : [loss = 1.373, top1 = 69.64%], test : [loss = 1.378, top1 = 69.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 1.576, top1 = 57.49%], valid : [loss = 2.251, top1 = 43.10%], test : [loss = 2.290, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.84%], valid : [loss = 0.513, top1 = 82.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6484/15625) 006484-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.622, top1 = 86.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.034, top1 = 98.99%], test  : [loss = 0.414, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 0.524, top1 = 84.69%], valid : [loss = 1.404, top1 = 64.15%], test : [loss = 1.393, top1 = 64.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.98%], valid : [loss = 2.576, top1 = 35.23%], test : [loss = 2.620, top1 = 34.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.38%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6485/15625) 006485-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.67%], valid : [loss = 0.462, top1 = 86.11%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.53 ms.
cifar10        train : [loss = 0.147, top1 = 95.23%], test  : [loss = 0.335, top1 = 89.07%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.88 ms.
cifar100       train : [loss = 0.964, top1 = 72.43%], valid : [loss = 1.339, top1 = 62.77%], test : [loss = 1.336, top1 = 62.18%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.18%], valid : [loss = 2.677, top1 = 32.60%], test : [loss = 2.701, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.755, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6486/15625) 006486-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.137, top1 = 95.52%], valid : [loss = 0.767, top1 = 79.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10        train : [loss = 0.179, top1 = 93.80%], test  : [loss = 0.470, top1 = 85.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.43 ms.
cifar100       train : [loss = 1.128, top1 = 67.72%], valid : [loss = 1.715, top1 = 55.15%], test : [loss = 1.728, top1 = 54.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.758, top1 = 31.36%], valid : [loss = 2.853, top1 = 29.08%], test : [loss = 2.896, top1 = 28.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.88%], valid : [loss = 1.033, top1 = 63.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6487/15625) 006487-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.322, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.167, top1 = 96.36%], valid : [loss = 1.270, top1 = 69.06%], test : [loss = 1.302, top1 = 69.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.30%], valid : [loss = 2.223, top1 = 42.82%], test : [loss = 2.256, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.24%], valid : [loss = 0.663, top1 = 77.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6488/15625) 006488-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.43%], valid : [loss = 0.705, top1 = 84.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.431, top1 = 88.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 0.626, top1 = 81.62%], valid : [loss = 1.510, top1 = 61.63%], test : [loss = 1.484, top1 = 62.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.12 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.27%], valid : [loss = 2.835, top1 = 30.07%], test : [loss = 2.889, top1 = 29.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.844, top1 = 69.93%], valid : [loss = 0.900, top1 = 68.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6489/15625) 006489-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.411, top1 = 90.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.270, top1 = 93.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.20 ms.
cifar100       train : [loss = 0.156, top1 = 96.53%], valid : [loss = 1.278, top1 = 69.70%], test : [loss = 1.286, top1 = 69.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.02 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 52.94%], valid : [loss = 2.251, top1 = 43.53%], test : [loss = 2.253, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.46%], valid : [loss = 0.496, top1 = 83.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6490/15625) 006490-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.475, top1 = 84.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.298, top1 = 89.99%], test  : [loss = 0.397, top1 = 86.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.77 ms.
cifar100       train : [loss = 1.326, top1 = 63.23%], valid : [loss = 1.533, top1 = 57.84%], test : [loss = 1.505, top1 = 58.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.76%], valid : [loss = 2.912, top1 = 29.22%], test : [loss = 2.948, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6491/15625) 006491-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.454, top1 = 86.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.111, top1 = 96.57%], test  : [loss = 0.330, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.30 ms.
cifar100       train : [loss = 0.870, top1 = 75.21%], valid : [loss = 1.302, top1 = 63.48%], test : [loss = 1.280, top1 = 64.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.62%], valid : [loss = 2.635, top1 = 33.90%], test : [loss = 2.653, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6492/15625) 006492-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.596, top1 = 85.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10        train : [loss = 0.073, top1 = 97.78%], test  : [loss = 0.384, top1 = 89.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.716, top1 = 79.22%], valid : [loss = 1.397, top1 = 63.06%], test : [loss = 1.365, top1 = 63.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.79%], valid : [loss = 2.677, top1 = 33.22%], test : [loss = 2.692, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.19%], valid : [loss = 0.785, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6493/15625) 006493-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.35%], valid : [loss = 0.524, top1 = 82.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10        train : [loss = 0.401, top1 = 86.32%], test  : [loss = 0.473, top1 = 84.02%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.18 ms.
cifar100       train : [loss = 1.546, top1 = 57.64%], valid : [loss = 1.658, top1 = 54.63%], test : [loss = 1.658, top1 = 54.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.96 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.59%], valid : [loss = 3.006, top1 = 27.20%], test : [loss = 3.057, top1 = 25.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6494/15625) 006494-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.584, top1 = 87.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.390, top1 = 90.73%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.78 ms.
cifar100       train : [loss = 0.405, top1 = 88.31%], valid : [loss = 1.391, top1 = 65.70%], test : [loss = 1.405, top1 = 65.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.01%], valid : [loss = 2.494, top1 = 37.05%], test : [loss = 2.529, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.82%], valid : [loss = 0.828, top1 = 70.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6495/15625) 006495-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.605, top1 = 86.85%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=17.65 ms.
cifar10        train : [loss = 0.022, top1 = 99.45%], test  : [loss = 0.383, top1 = 90.91%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=17.06 ms.
cifar100       train : [loss = 0.447, top1 = 87.13%], valid : [loss = 1.409, top1 = 64.72%], test : [loss = 1.417, top1 = 64.84%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.20%], valid : [loss = 2.539, top1 = 35.88%], test : [loss = 2.580, top1 = 35.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.58%], valid : [loss = 0.831, top1 = 71.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6496/15625) 006496-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.462, top1 = 90.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.304, top1 = 93.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.04 ms.
cifar100       train : [loss = 0.081, top1 = 98.65%], valid : [loss = 1.390, top1 = 69.08%], test : [loss = 1.362, top1 = 69.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 1.598, top1 = 56.99%], valid : [loss = 2.292, top1 = 42.42%], test : [loss = 2.318, top1 = 43.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.34%], valid : [loss = 0.505, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6497/15625) 006497-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.527, top1 = 89.22%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.344, top1 = 92.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.81 ms.
cifar100       train : [loss = 0.130, top1 = 97.10%], valid : [loss = 1.403, top1 = 68.39%], test : [loss = 1.374, top1 = 68.98%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.96%], valid : [loss = 2.300, top1 = 41.67%], test : [loss = 2.286, top1 = 42.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.48%], valid : [loss = 0.820, top1 = 71.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6498/15625) 006498-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.64%], valid : [loss = 0.614, top1 = 85.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10        train : [loss = 0.094, top1 = 96.92%], test  : [loss = 0.405, top1 = 88.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.65 ms.
cifar100       train : [loss = 0.780, top1 = 77.02%], valid : [loss = 1.414, top1 = 62.30%], test : [loss = 1.400, top1 = 62.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.609, top1 = 34.53%], valid : [loss = 2.732, top1 = 32.33%], test : [loss = 2.761, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.24%], valid : [loss = 0.849, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6499/15625) 006499-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.432, top1 = 90.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.289, top1 = 93.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.45 ms.
cifar100       train : [loss = 0.064, top1 = 99.07%], valid : [loss = 1.350, top1 = 70.73%], test : [loss = 1.303, top1 = 70.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 1.531, top1 = 58.56%], valid : [loss = 2.254, top1 = 43.33%], test : [loss = 2.283, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.24%], valid : [loss = 0.499, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6500/15625) 006500-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.92%], valid : [loss = 0.828, top1 = 71.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 0.661, top1 = 76.97%], test  : [loss = 0.750, top1 = 74.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.51 ms.
cifar100       train : [loss = 1.951, top1 = 48.11%], valid : [loss = 2.125, top1 = 45.07%], test : [loss = 2.142, top1 = 44.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 3.646, top1 = 15.84%], valid : [loss = 3.676, top1 = 16.08%], test : [loss = 3.692, top1 = 14.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.399, top1 = 49.08%], valid : [loss = 1.419, top1 = 48.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6501/15625) 006501-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.592, top1 = 87.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.396, top1 = 90.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.289, top1 = 92.50%], valid : [loss = 1.478, top1 = 64.64%], test : [loss = 1.502, top1 = 64.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.13%], valid : [loss = 2.505, top1 = 37.55%], test : [loss = 2.513, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.45%], valid : [loss = 0.806, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6502/15625) 006502-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.242, top1 = 91.74%], valid : [loss = 0.551, top1 = 83.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.213, top1 = 92.69%], test  : [loss = 0.399, top1 = 87.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.24 ms.
cifar100       train : [loss = 1.299, top1 = 63.25%], valid : [loss = 1.580, top1 = 56.97%], test : [loss = 1.582, top1 = 56.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.694, top1 = 32.64%], valid : [loss = 2.725, top1 = 32.18%], test : [loss = 2.768, top1 = 31.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.17%], valid : [loss = 0.981, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6503/15625) 006503-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.457, top1 = 89.23%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.308, top1 = 92.10%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.66 ms.
cifar100       train : [loss = 0.321, top1 = 91.19%], valid : [loss = 1.310, top1 = 67.12%], test : [loss = 1.299, top1 = 67.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.28%], valid : [loss = 2.370, top1 = 40.28%], test : [loss = 2.406, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.68%], valid : [loss = 0.552, top1 = 81.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6504/15625) 006504-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.83 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.583, top1 = 87.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.041, top1 = 98.81%], test  : [loss = 0.394, top1 = 90.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 0.551, top1 = 83.81%], valid : [loss = 1.413, top1 = 64.16%], test : [loss = 1.392, top1 = 64.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.84%], valid : [loss = 2.617, top1 = 34.35%], test : [loss = 2.671, top1 = 33.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6505/15625) 006505-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.62%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.339, top1 = 92.97%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.19 ms.
cifar100       train : [loss = 0.091, top1 = 98.20%], valid : [loss = 1.324, top1 = 69.72%], test : [loss = 1.329, top1 = 70.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 1.621, top1 = 56.39%], valid : [loss = 2.182, top1 = 43.98%], test : [loss = 2.188, top1 = 44.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.87%], valid : [loss = 0.678, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6506/15625) 006506-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.326, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.152, top1 = 96.81%], valid : [loss = 1.303, top1 = 68.97%], test : [loss = 1.288, top1 = 69.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.71%], valid : [loss = 2.304, top1 = 41.28%], test : [loss = 2.316, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6507/15625) 006507-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.77%], valid : [loss = 0.533, top1 = 86.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10        train : [loss = 0.093, top1 = 97.08%], test  : [loss = 0.357, top1 = 89.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.10 ms.
cifar100       train : [loss = 0.675, top1 = 80.53%], valid : [loss = 1.316, top1 = 65.16%], test : [loss = 1.301, top1 = 65.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.26%], valid : [loss = 2.486, top1 = 36.47%], test : [loss = 2.515, top1 = 37.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.77%], valid : [loss = 0.924, top1 = 67.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6508/15625) 006508-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.636, top1 = 86.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.432, top1 = 90.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.00 ms.
cifar100       train : [loss = 0.211, top1 = 94.87%], valid : [loss = 1.542, top1 = 64.74%], test : [loss = 1.503, top1 = 66.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.27%], valid : [loss = 2.572, top1 = 35.47%], test : [loss = 2.556, top1 = 37.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.04%], valid : [loss = 0.836, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6509/15625) 006509-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.451, top1 = 89.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.328, top1 = 92.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.11 ms.
cifar100       train : [loss = 0.197, top1 = 95.05%], valid : [loss = 1.383, top1 = 67.39%], test : [loss = 1.338, top1 = 67.95%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.69%], valid : [loss = 2.329, top1 = 40.69%], test : [loss = 2.357, top1 = 41.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.92%], valid : [loss = 0.568, top1 = 80.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6510/15625) 006510-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.341, top1 = 88.08%], valid : [loss = 0.611, top1 = 80.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10        train : [loss = 0.287, top1 = 90.17%], test  : [loss = 0.444, top1 = 85.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.33 ms.
cifar100       train : [loss = 1.513, top1 = 57.59%], valid : [loss = 1.763, top1 = 52.31%], test : [loss = 1.748, top1 = 52.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.933, top1 = 27.94%], valid : [loss = 2.954, top1 = 28.43%], test : [loss = 2.989, top1 = 27.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.45%], valid : [loss = 1.080, top1 = 61.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6511/15625) 006511-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.040, top1 = 99.13%], valid : [loss = 0.522, top1 = 86.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.057, top1 = 98.39%], test  : [loss = 0.363, top1 = 89.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.86 ms.
cifar100       train : [loss = 0.549, top1 = 84.30%], valid : [loss = 1.316, top1 = 65.77%], test : [loss = 1.316, top1 = 65.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.88%], valid : [loss = 2.428, top1 = 38.37%], test : [loss = 2.460, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.72%], valid : [loss = 0.845, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6512/15625) 006512-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.71%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.05 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.353, top1 = 92.93%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.75 ms.
cifar100       train : [loss = 0.076, top1 = 98.74%], valid : [loss = 1.335, top1 = 69.98%], test : [loss = 1.371, top1 = 69.81%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.019, top1 = 46.95%], valid : [loss = 2.349, top1 = 40.77%], test : [loss = 2.328, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.94%], valid : [loss = 0.868, top1 = 69.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6513/15625) 006513-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.484, top1 = 82.98%], valid : [loss = 0.656, top1 = 77.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.41 ms.
cifar10        train : [loss = 0.502, top1 = 82.53%], test  : [loss = 0.587, top1 = 80.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.30 ms.
cifar100       train : [loss = 1.695, top1 = 54.05%], valid : [loss = 1.850, top1 = 50.63%], test : [loss = 1.871, top1 = 50.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 21.18%], valid : [loss = 3.330, top1 = 21.52%], test : [loss = 3.349, top1 = 21.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6514/15625) 006514-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.574, top1 = 87.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.365, top1 = 91.66%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.36 ms.
cifar100       train : [loss = 0.376, top1 = 89.50%], valid : [loss = 1.390, top1 = 66.29%], test : [loss = 1.404, top1 = 65.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.17%], valid : [loss = 2.489, top1 = 37.15%], test : [loss = 2.511, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.54%], valid : [loss = 0.782, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6515/15625) 006515-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.285, top1 = 93.62%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.07 ms.
cifar100       train : [loss = 0.064, top1 = 99.07%], valid : [loss = 1.324, top1 = 70.45%], test : [loss = 1.326, top1 = 70.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 1.552, top1 = 58.10%], valid : [loss = 2.279, top1 = 43.14%], test : [loss = 2.271, top1 = 43.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6516/15625) 006516-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.553, top1 = 89.07%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.41 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.370, top1 = 92.61%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.07 ms.
cifar100       train : [loss = 0.072, top1 = 98.92%], valid : [loss = 1.469, top1 = 68.79%], test : [loss = 1.462, top1 = 68.50%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 1.775, top1 = 52.75%], valid : [loss = 2.382, top1 = 40.65%], test : [loss = 2.379, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.34%], valid : [loss = 0.718, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6517/15625) 006517-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.73%], valid : [loss = 0.582, top1 = 87.75%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.34 ms.
cifar10        train : [loss = 0.019, top1 = 99.44%], test  : [loss = 0.409, top1 = 90.88%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.31 ms.
cifar100       train : [loss = 0.361, top1 = 89.82%], valid : [loss = 1.448, top1 = 64.41%], test : [loss = 1.439, top1 = 64.73%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.770, top1 = 30.10%], valid : [loss = 2.864, top1 = 28.23%], test : [loss = 2.873, top1 = 28.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.00%], valid : [loss = 1.206, top1 = 56.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6518/15625) 006518-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.60 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.352, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.77 ms.
cifar100       train : [loss = 0.104, top1 = 98.21%], valid : [loss = 1.442, top1 = 67.89%], test : [loss = 1.434, top1 = 68.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.88%], valid : [loss = 2.370, top1 = 40.60%], test : [loss = 2.406, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.67%], valid : [loss = 0.746, top1 = 74.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6519/15625) 006519-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.461, top1 = 89.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.318, top1 = 92.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.41 ms.
cifar100       train : [loss = 0.323, top1 = 91.31%], valid : [loss = 1.286, top1 = 67.23%], test : [loss = 1.322, top1 = 66.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.50%], valid : [loss = 2.342, top1 = 40.25%], test : [loss = 2.403, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6520/15625) 006520-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.55%], valid : [loss = 0.458, top1 = 86.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10        train : [loss = 0.152, top1 = 95.07%], test  : [loss = 0.348, top1 = 88.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.47 ms.
cifar100       train : [loss = 0.971, top1 = 72.34%], valid : [loss = 1.344, top1 = 62.29%], test : [loss = 1.341, top1 = 62.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.15%], valid : [loss = 2.651, top1 = 33.85%], test : [loss = 2.690, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6521/15625) 006521-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.54%], valid : [loss = 0.540, top1 = 87.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.030, top1 = 99.13%], test  : [loss = 0.336, top1 = 91.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.74 ms.
cifar100       train : [loss = 0.411, top1 = 88.04%], valid : [loss = 1.266, top1 = 67.00%], test : [loss = 1.286, top1 = 66.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.17 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.04%], valid : [loss = 2.426, top1 = 38.50%], test : [loss = 2.457, top1 = 38.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.76%], valid : [loss = 0.961, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6522/15625) 006522-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.322, top1 = 88.82%], valid : [loss = 0.573, top1 = 81.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.297, top1 = 89.81%], test  : [loss = 0.444, top1 = 85.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.90 ms.
cifar100       train : [loss = 1.532, top1 = 57.16%], valid : [loss = 1.764, top1 = 52.84%], test : [loss = 1.760, top1 = 52.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.954, top1 = 27.53%], valid : [loss = 2.971, top1 = 27.47%], test : [loss = 3.019, top1 = 26.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.48%], valid : [loss = 1.021, top1 = 63.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6523/15625) 006523-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.575, top1 = 87.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.392, top1 = 91.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.54 ms.
cifar100       train : [loss = 0.389, top1 = 89.03%], valid : [loss = 1.391, top1 = 65.65%], test : [loss = 1.375, top1 = 65.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.94%], valid : [loss = 2.513, top1 = 37.24%], test : [loss = 2.520, top1 = 37.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6524/15625) 006524-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.59%], valid : [loss = 0.616, top1 = 86.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.036, top1 = 98.96%], test  : [loss = 0.407, top1 = 89.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.13 ms.
cifar100       train : [loss = 0.561, top1 = 83.56%], valid : [loss = 1.438, top1 = 62.63%], test : [loss = 1.438, top1 = 63.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.87%], valid : [loss = 2.577, top1 = 35.15%], test : [loss = 2.619, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.98%], valid : [loss = 0.879, top1 = 68.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6525/15625) 006525-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.544, top1 = 88.43%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.33 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.343, top1 = 92.13%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.73 ms.
cifar100       train : [loss = 0.236, top1 = 93.79%], valid : [loss = 1.297, top1 = 68.43%], test : [loss = 1.305, top1 = 68.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.227, top1 = 42.42%], valid : [loss = 2.444, top1 = 38.28%], test : [loss = 2.457, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.07%], valid : [loss = 0.916, top1 = 67.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6526/15625) 006526-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.556, top1 = 88.44%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.47 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.402, top1 = 91.51%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.63 ms.
cifar100       train : [loss = 0.150, top1 = 96.50%], valid : [loss = 1.577, top1 = 65.85%], test : [loss = 1.562, top1 = 65.93%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.093, top1 = 45.68%], valid : [loss = 2.545, top1 = 36.93%], test : [loss = 2.574, top1 = 37.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.59%], valid : [loss = 0.736, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6527/15625) 006527-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.39%], valid : [loss = 0.551, top1 = 83.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10        train : [loss = 0.206, top1 = 93.07%], test  : [loss = 0.392, top1 = 87.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.253, top1 = 64.39%], valid : [loss = 1.573, top1 = 57.23%], test : [loss = 1.537, top1 = 57.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 2.697, top1 = 32.62%], valid : [loss = 2.736, top1 = 31.70%], test : [loss = 2.775, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6528/15625) 006528-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.63%], valid : [loss = 0.537, top1 = 87.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.029, top1 = 99.11%], test  : [loss = 0.351, top1 = 91.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.434, top1 = 87.36%], valid : [loss = 1.284, top1 = 66.43%], test : [loss = 1.303, top1 = 66.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 41.87%], valid : [loss = 2.417, top1 = 38.47%], test : [loss = 2.435, top1 = 37.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.48%], valid : [loss = 0.908, top1 = 68.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6529/15625) 006529-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.525, top1 = 89.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.329, top1 = 92.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.166, top1 = 96.33%], valid : [loss = 1.324, top1 = 67.44%], test : [loss = 1.322, top1 = 68.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.71%], valid : [loss = 2.189, top1 = 44.03%], test : [loss = 2.179, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.24%], valid : [loss = 0.628, top1 = 78.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6530/15625) 006530-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.416, top1 = 91.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.288, top1 = 93.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.35 ms.
cifar100       train : [loss = 0.042, top1 = 99.54%], valid : [loss = 1.330, top1 = 71.40%], test : [loss = 1.339, top1 = 71.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.386, top1 = 62.12%], valid : [loss = 2.223, top1 = 44.97%], test : [loss = 2.210, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.99%], valid : [loss = 0.492, top1 = 83.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6531/15625) 006531-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.77%], valid : [loss = 0.469, top1 = 85.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.62 ms.
cifar10        train : [loss = 0.160, top1 = 94.73%], test  : [loss = 0.329, top1 = 89.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.25 ms.
cifar100       train : [loss = 0.896, top1 = 74.48%], valid : [loss = 1.293, top1 = 63.86%], test : [loss = 1.245, top1 = 64.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 2.597, top1 = 34.78%], valid : [loss = 2.608, top1 = 34.27%], test : [loss = 2.653, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.39%], valid : [loss = 1.029, top1 = 63.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6532/15625) 006532-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.540, top1 = 87.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.035, top1 = 98.95%], test  : [loss = 0.358, top1 = 91.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.93 ms.
cifar100       train : [loss = 0.537, top1 = 84.68%], valid : [loss = 1.344, top1 = 64.20%], test : [loss = 1.324, top1 = 64.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.07%], valid : [loss = 2.650, top1 = 32.93%], test : [loss = 2.655, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6533/15625) 006533-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.453, top1 = 89.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.30 ms.
cifar100       train : [loss = 0.329, top1 = 91.12%], valid : [loss = 1.329, top1 = 66.52%], test : [loss = 1.320, top1 = 67.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.05%], valid : [loss = 2.335, top1 = 39.93%], test : [loss = 2.415, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.89%], valid : [loss = 0.538, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6534/15625) 006534-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.576, top1 = 87.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.025, top1 = 99.25%], test  : [loss = 0.400, top1 = 90.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.10 ms.
cifar100       train : [loss = 0.302, top1 = 91.68%], valid : [loss = 1.334, top1 = 66.94%], test : [loss = 1.330, top1 = 66.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.07%], valid : [loss = 2.302, top1 = 40.83%], test : [loss = 2.330, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.56%], valid : [loss = 0.841, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6535/15625) 006535-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.73%], valid : [loss = 0.690, top1 = 85.23%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.09 ms.
cifar10        train : [loss = 0.042, top1 = 98.82%], test  : [loss = 0.440, top1 = 88.99%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.52 ms.
cifar100       train : [loss = 0.463, top1 = 87.21%], valid : [loss = 1.624, top1 = 60.24%], test : [loss = 1.613, top1 = 61.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.34%], valid : [loss = 2.708, top1 = 33.37%], test : [loss = 2.706, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.37%], valid : [loss = 0.865, top1 = 69.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6536/15625) 006536-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.516, top1 = 88.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.347, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.480, top1 = 85.86%], valid : [loss = 1.362, top1 = 65.50%], test : [loss = 1.335, top1 = 65.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.17%], valid : [loss = 2.541, top1 = 35.90%], test : [loss = 2.539, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.67%], valid : [loss = 0.669, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6537/15625) 006537-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.74%], valid : [loss = 0.583, top1 = 87.95%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.459, top1 = 89.62%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.87 ms.
cifar100       train : [loss = 0.446, top1 = 87.22%], valid : [loss = 1.458, top1 = 63.80%], test : [loss = 1.461, top1 = 62.78%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 2.863, top1 = 28.04%], valid : [loss = 2.916, top1 = 26.30%], test : [loss = 2.942, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 53.30%], valid : [loss = 1.261, top1 = 54.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6538/15625) 006538-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.580, top1 = 88.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.91 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.365, top1 = 91.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.82 ms.
cifar100       train : [loss = 0.136, top1 = 96.83%], valid : [loss = 1.408, top1 = 68.08%], test : [loss = 1.389, top1 = 67.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 39.75%], valid : [loss = 2.525, top1 = 35.90%], test : [loss = 2.519, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.46%], valid : [loss = 0.965, top1 = 65.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6539/15625) 006539-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.553, top1 = 88.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.23 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.350, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.86 ms.
cifar100       train : [loss = 0.292, top1 = 91.76%], valid : [loss = 1.321, top1 = 67.62%], test : [loss = 1.331, top1 = 67.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.24%], valid : [loss = 2.420, top1 = 38.53%], test : [loss = 2.453, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6540/15625) 006540-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.454, top1 = 90.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.29 ms.
cifar100       train : [loss = 0.083, top1 = 98.47%], valid : [loss = 1.426, top1 = 69.30%], test : [loss = 1.384, top1 = 69.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 56.02%], valid : [loss = 2.268, top1 = 42.92%], test : [loss = 2.291, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.82%], valid : [loss = 0.557, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6541/15625) 006541-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.503, top1 = 88.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.323, top1 = 92.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.53 ms.
cifar100       train : [loss = 0.330, top1 = 91.15%], valid : [loss = 1.280, top1 = 67.24%], test : [loss = 1.332, top1 = 65.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.60 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 44.95%], valid : [loss = 2.409, top1 = 38.57%], test : [loss = 2.399, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.60%], valid : [loss = 0.631, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6542/15625) 006542-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.573, top1 = 87.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.381, top1 = 91.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.67 ms.
cifar100       train : [loss = 0.380, top1 = 89.38%], valid : [loss = 1.384, top1 = 65.77%], test : [loss = 1.391, top1 = 65.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.51%], valid : [loss = 2.472, top1 = 37.51%], test : [loss = 2.523, top1 = 37.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.86%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6543/15625) 006543-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.480, top1 = 89.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.04 ms.
cifar100       train : [loss = 0.322, top1 = 91.41%], valid : [loss = 1.235, top1 = 68.38%], test : [loss = 1.234, top1 = 68.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.027, top1 = 46.94%], valid : [loss = 2.292, top1 = 40.03%], test : [loss = 2.326, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.10%], valid : [loss = 0.595, top1 = 79.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6544/15625) 006544-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.88 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.329, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.40 ms.
cifar100       train : [loss = 0.108, top1 = 97.94%], valid : [loss = 1.293, top1 = 69.84%], test : [loss = 1.284, top1 = 70.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.35 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.47%], valid : [loss = 2.206, top1 = 43.47%], test : [loss = 2.180, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.71%], valid : [loss = 0.643, top1 = 77.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6545/15625) 006545-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=131.65 M, Params=0.924 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.488, top1 = 88.86%]
cifar10        FLOP=131.65 M, Params=0.924 MB, latency=20.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.318, top1 = 92.25%]
cifar100       FLOP=131.65 M, Params=0.930 MB, latency=18.78 ms.
cifar100       train : [loss = 0.321, top1 = 91.38%], valid : [loss = 1.296, top1 = 67.39%], test : [loss = 1.281, top1 = 67.41%]
ImageNet16-120 FLOP= 32.92 M, Params=0.931 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.06%], valid : [loss = 2.404, top1 = 38.62%], test : [loss = 2.405, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.50%], valid : [loss = 0.677, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6546/15625) 006546-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.523, top1 = 89.13%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.66 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.341, top1 = 92.22%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.99 ms.
cifar100       train : [loss = 0.231, top1 = 94.30%], valid : [loss = 1.378, top1 = 66.66%], test : [loss = 1.344, top1 = 67.16%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 1.992, top1 = 47.59%], valid : [loss = 2.263, top1 = 41.00%], test : [loss = 2.265, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 73.04%], valid : [loss = 0.830, top1 = 70.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6547/15625) 006547-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 74.63 M, Params=0.534 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.535, top1 = 88.73%]
cifar10        FLOP= 74.63 M, Params=0.534 MB, latency=19.01 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.350, top1 = 91.78%]
cifar100       FLOP= 74.64 M, Params=0.540 MB, latency=18.43 ms.
cifar100       train : [loss = 0.301, top1 = 91.61%], valid : [loss = 1.306, top1 = 67.47%], test : [loss = 1.298, top1 = 68.01%]
ImageNet16-120 FLOP= 18.67 M, Params=0.542 MB, latency=21.99 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.71%], valid : [loss = 2.320, top1 = 41.02%], test : [loss = 2.337, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.02%], valid : [loss = 0.820, top1 = 71.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6548/15625) 006548-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.70 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.47 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6549/15625) 006549-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.84%], valid : [loss = 0.833, top1 = 72.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.55 ms.
cifar10        train : [loss = 0.555, top1 = 80.56%], test  : [loss = 0.725, top1 = 75.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.01 ms.
cifar100       train : [loss = 1.785, top1 = 51.92%], valid : [loss = 2.057, top1 = 46.68%], test : [loss = 2.071, top1 = 46.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.87%], valid : [loss = 3.635, top1 = 16.90%], test : [loss = 3.675, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6550/15625) 006550-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.21%], valid : [loss = 0.526, top1 = 83.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.245, top1 = 91.67%], test  : [loss = 0.400, top1 = 87.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 1.337, top1 = 62.36%], valid : [loss = 1.609, top1 = 56.41%], test : [loss = 1.587, top1 = 56.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.869, top1 = 29.44%], valid : [loss = 2.880, top1 = 29.08%], test : [loss = 2.931, top1 = 28.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.91%], valid : [loss = 1.032, top1 = 63.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6551/15625) 006551-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.44%], valid : [loss = 0.658, top1 = 78.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10        train : [loss = 0.509, top1 = 82.34%], test  : [loss = 0.583, top1 = 80.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.15 ms.
cifar100       train : [loss = 1.721, top1 = 53.33%], valid : [loss = 1.879, top1 = 49.44%], test : [loss = 1.913, top1 = 49.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 3.341, top1 = 21.03%], valid : [loss = 3.321, top1 = 21.03%], test : [loss = 3.384, top1 = 20.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6552/15625) 006552-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.477, top1 = 89.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.321, top1 = 92.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.202, top1 = 95.05%], valid : [loss = 1.354, top1 = 67.22%], test : [loss = 1.376, top1 = 67.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.28%], valid : [loss = 2.305, top1 = 41.60%], test : [loss = 2.382, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.46%], valid : [loss = 0.666, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6553/15625) 006553-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.754, top1 = 74.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10        train : [loss = 0.505, top1 = 82.55%], test  : [loss = 0.588, top1 = 79.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.51 ms.
cifar100       train : [loss = 1.943, top1 = 47.77%], valid : [loss = 2.073, top1 = 44.98%], test : [loss = 2.078, top1 = 44.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 3.010, top1 = 26.42%], valid : [loss = 2.991, top1 = 27.14%], test : [loss = 3.022, top1 = 26.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.129, top1 = 59.56%], valid : [loss = 1.176, top1 = 58.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6554/15625) 006554-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.504, top1 = 88.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.284, top1 = 92.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.98 ms.
cifar100       train : [loss = 0.317, top1 = 91.45%], valid : [loss = 1.248, top1 = 68.30%], test : [loss = 1.255, top1 = 68.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.55%], valid : [loss = 2.331, top1 = 40.47%], test : [loss = 2.347, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.80%], valid : [loss = 0.629, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6555/15625) 006555-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.540, top1 = 89.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.378, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.12 ms.
cifar100       train : [loss = 0.161, top1 = 96.06%], valid : [loss = 1.496, top1 = 66.32%], test : [loss = 1.513, top1 = 66.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.003, top1 = 47.67%], valid : [loss = 2.431, top1 = 40.13%], test : [loss = 2.483, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.18%], valid : [loss = 0.677, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6556/15625) 006556-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.525, top1 = 89.45%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.53 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.333, top1 = 93.02%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.41 ms.
cifar100       train : [loss = 0.070, top1 = 98.71%], valid : [loss = 1.325, top1 = 70.58%], test : [loss = 1.356, top1 = 70.24%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=25.92 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.73%], valid : [loss = 2.303, top1 = 41.80%], test : [loss = 2.310, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.60%], valid : [loss = 0.860, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6557/15625) 006557-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.50 ms.
cifar10-valid  train : [loss = 1.414, top1 = 47.80%], valid : [loss = 1.451, top1 = 46.31%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.57 ms.
cifar10        train : [loss = 1.033, top1 = 63.43%], test  : [loss = 1.043, top1 = 62.80%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.68 ms.
cifar100       train : [loss = 3.667, top1 = 14.70%], valid : [loss = 3.745, top1 = 12.43%], test : [loss = 3.735, top1 = 13.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.10 ms.
ImageNet16-120 train : [loss = 3.683, top1 = 15.09%], valid : [loss = 3.657, top1 = 16.09%], test : [loss = 3.679, top1 = 15.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.902, top1 = 30.57%], valid : [loss = 1.907, top1 = 30.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6558/15625) 006558-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.40%], valid : [loss = 0.637, top1 = 86.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.31 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.386, top1 = 90.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.07 ms.
cifar100       train : [loss = 0.557, top1 = 83.79%], valid : [loss = 1.439, top1 = 63.86%], test : [loss = 1.453, top1 = 64.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.436, top1 = 38.11%], valid : [loss = 2.608, top1 = 35.30%], test : [loss = 2.617, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 67.98%], valid : [loss = 0.940, top1 = 66.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6559/15625) 006559-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.63 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.48 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6560/15625) 006560-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.65%], valid : [loss = 0.873, top1 = 71.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.556, top1 = 80.60%], test  : [loss = 0.717, top1 = 75.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.77 ms.
cifar100       train : [loss = 1.781, top1 = 51.92%], valid : [loss = 2.050, top1 = 47.01%], test : [loss = 2.076, top1 = 46.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.82%], valid : [loss = 3.639, top1 = 16.80%], test : [loss = 3.664, top1 = 15.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6561/15625) 006561-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.22%], valid : [loss = 0.459, top1 = 86.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.25 ms.
cifar10        train : [loss = 0.157, top1 = 94.83%], test  : [loss = 0.348, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.15 ms.
cifar100       train : [loss = 0.993, top1 = 71.63%], valid : [loss = 1.346, top1 = 62.07%], test : [loss = 1.347, top1 = 62.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.84%], valid : [loss = 2.696, top1 = 32.92%], test : [loss = 2.703, top1 = 32.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6562/15625) 006562-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.636, top1 = 86.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10        train : [loss = 0.029, top1 = 99.30%], test  : [loss = 0.428, top1 = 89.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.07 ms.
cifar100       train : [loss = 0.376, top1 = 89.95%], valid : [loss = 1.438, top1 = 64.43%], test : [loss = 1.402, top1 = 65.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.26%], valid : [loss = 2.616, top1 = 34.94%], test : [loss = 2.627, top1 = 35.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6563/15625) 006563-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.547, top1 = 89.55%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.25 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.336, top1 = 93.39%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.62 ms.
cifar100       train : [loss = 0.027, top1 = 99.74%], valid : [loss = 1.440, top1 = 69.96%], test : [loss = 1.424, top1 = 70.64%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.34 ms.
ImageNet16-120 train : [loss = 1.530, top1 = 58.74%], valid : [loss = 2.480, top1 = 40.33%], test : [loss = 2.444, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.62%], valid : [loss = 0.651, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6564/15625) 006564-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.49%], valid : [loss = 0.553, top1 = 86.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.048, top1 = 98.64%], test  : [loss = 0.374, top1 = 90.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.72 ms.
cifar100       train : [loss = 0.603, top1 = 82.42%], valid : [loss = 1.357, top1 = 64.80%], test : [loss = 1.303, top1 = 65.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.44%], valid : [loss = 2.544, top1 = 36.37%], test : [loss = 2.557, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.06%], valid : [loss = 0.630, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6565/15625) 006565-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.258, top1 = 91.16%], valid : [loss = 0.531, top1 = 83.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.241, top1 = 91.75%], test  : [loss = 0.391, top1 = 87.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.92 ms.
cifar100       train : [loss = 1.368, top1 = 61.51%], valid : [loss = 1.630, top1 = 55.59%], test : [loss = 1.635, top1 = 55.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.49 ms.
ImageNet16-120 train : [loss = 2.855, top1 = 29.59%], valid : [loss = 2.865, top1 = 29.79%], test : [loss = 2.912, top1 = 28.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6566/15625) 006566-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.88 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.56%], valid : [loss = 0.852, top1 = 71.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10        train : [loss = 0.550, top1 = 80.87%], test  : [loss = 0.709, top1 = 75.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.48 ms.
cifar100       train : [loss = 1.751, top1 = 52.73%], valid : [loss = 2.021, top1 = 47.72%], test : [loss = 2.036, top1 = 47.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.91%], valid : [loss = 3.621, top1 = 16.63%], test : [loss = 3.662, top1 = 16.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6567/15625) 006567-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.436, top1 = 90.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.311, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.100, top1 = 98.26%], valid : [loss = 1.284, top1 = 70.12%], test : [loss = 1.312, top1 = 69.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 1.698, top1 = 54.63%], valid : [loss = 2.250, top1 = 43.03%], test : [loss = 2.248, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 83.78%], valid : [loss = 0.573, top1 = 80.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6568/15625) 006568-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.43 ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.39%], valid : [loss = 0.524, top1 = 82.22%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.67 ms.
cifar10        train : [loss = 0.416, top1 = 85.92%], test  : [loss = 0.466, top1 = 84.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.90 ms.
cifar100       train : [loss = 1.525, top1 = 57.95%], valid : [loss = 1.646, top1 = 54.70%], test : [loss = 1.629, top1 = 54.94%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=5.84 ms.
ImageNet16-120 train : [loss = 3.046, top1 = 26.20%], valid : [loss = 3.023, top1 = 27.10%], test : [loss = 3.078, top1 = 25.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6569/15625) 006569-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.80%], valid : [loss = 0.642, top1 = 78.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.46 ms.
cifar10        train : [loss = 0.498, top1 = 82.67%], test  : [loss = 0.584, top1 = 79.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.10 ms.
cifar100       train : [loss = 1.698, top1 = 53.93%], valid : [loss = 1.874, top1 = 50.06%], test : [loss = 1.887, top1 = 50.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.79 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.15%], valid : [loss = 3.307, top1 = 21.10%], test : [loss = 3.357, top1 = 21.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6570/15625) 006570-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.491, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.330, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.327, top1 = 91.25%], valid : [loss = 1.256, top1 = 67.39%], test : [loss = 1.255, top1 = 68.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.71%], valid : [loss = 2.297, top1 = 40.78%], test : [loss = 2.349, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6571/15625) 006571-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.30%], valid : [loss = 0.538, top1 = 86.71%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.35 ms.
cifar10        train : [loss = 0.046, top1 = 98.72%], test  : [loss = 0.344, top1 = 90.59%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.61 ms.
cifar100       train : [loss = 0.504, top1 = 85.57%], valid : [loss = 1.320, top1 = 65.72%], test : [loss = 1.317, top1 = 65.96%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.46%], valid : [loss = 2.396, top1 = 38.67%], test : [loss = 2.423, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.04%], valid : [loss = 0.870, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6572/15625) 006572-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.46%], valid : [loss = 0.454, top1 = 86.36%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10        train : [loss = 0.151, top1 = 95.15%], test  : [loss = 0.335, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.82 ms.
cifar100       train : [loss = 1.008, top1 = 71.22%], valid : [loss = 1.365, top1 = 61.70%], test : [loss = 1.374, top1 = 61.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 33.91%], valid : [loss = 2.669, top1 = 32.83%], test : [loss = 2.698, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6573/15625) 006573-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.499, top1 = 89.13%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.30 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.312, top1 = 92.27%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=13.44 ms.
cifar100       train : [loss = 0.343, top1 = 90.57%], valid : [loss = 1.260, top1 = 67.36%], test : [loss = 1.263, top1 = 67.98%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.90%], valid : [loss = 2.401, top1 = 38.93%], test : [loss = 2.422, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.42%], valid : [loss = 0.610, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6574/15625) 006574-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.426, top1 = 89.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.316, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.36 ms.
cifar100       train : [loss = 0.204, top1 = 95.27%], valid : [loss = 1.252, top1 = 69.54%], test : [loss = 1.281, top1 = 68.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.70%], valid : [loss = 2.247, top1 = 43.13%], test : [loss = 2.270, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.24%], valid : [loss = 0.523, top1 = 82.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6575/15625) 006575-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.506, top1 = 88.84%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.28 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.323, top1 = 92.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.94 ms.
cifar100       train : [loss = 0.324, top1 = 91.32%], valid : [loss = 1.270, top1 = 67.38%], test : [loss = 1.276, top1 = 67.21%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.13 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.28%], valid : [loss = 2.391, top1 = 39.09%], test : [loss = 2.389, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 80.98%], valid : [loss = 0.620, top1 = 78.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6576/15625) 006576-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.66 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.77 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.15 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6577/15625) 006577-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.18 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6578/15625) 006578-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.536, top1 = 88.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.367, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.63 ms.
cifar100       train : [loss = 0.184, top1 = 95.35%], valid : [loss = 1.355, top1 = 68.38%], test : [loss = 1.315, top1 = 68.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.79 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.42%], valid : [loss = 2.545, top1 = 35.00%], test : [loss = 2.553, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.39%], valid : [loss = 1.033, top1 = 62.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6579/15625) 006579-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.196, top1 = 93.64%], valid : [loss = 0.499, top1 = 84.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10        train : [loss = 0.230, top1 = 92.26%], test  : [loss = 0.394, top1 = 87.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.28 ms.
cifar100       train : [loss = 1.279, top1 = 64.12%], valid : [loss = 1.545, top1 = 57.36%], test : [loss = 1.545, top1 = 57.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 3.115, top1 = 24.35%], valid : [loss = 3.135, top1 = 24.03%], test : [loss = 3.147, top1 = 23.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.52%], valid : [loss = 1.052, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6580/15625) 006580-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.523, top1 = 88.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.022, top1 = 99.38%], test  : [loss = 0.345, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.93 ms.
cifar100       train : [loss = 0.385, top1 = 89.20%], valid : [loss = 1.249, top1 = 67.01%], test : [loss = 1.232, top1 = 67.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.075, top1 = 45.91%], valid : [loss = 2.317, top1 = 40.63%], test : [loss = 2.333, top1 = 40.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.92%], valid : [loss = 0.717, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6581/15625) 006581-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.600, top1 = 87.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.403, top1 = 90.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.25 ms.
cifar100       train : [loss = 0.238, top1 = 94.21%], valid : [loss = 1.556, top1 = 64.06%], test : [loss = 1.596, top1 = 63.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.32%], valid : [loss = 2.512, top1 = 37.90%], test : [loss = 2.520, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.53%], valid : [loss = 0.738, top1 = 74.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6582/15625) 006582-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.464, top1 = 89.73%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.51 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.308, top1 = 92.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.51 ms.
cifar100       train : [loss = 0.263, top1 = 93.16%], valid : [loss = 1.213, top1 = 69.44%], test : [loss = 1.213, top1 = 69.10%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.98%], valid : [loss = 2.215, top1 = 43.07%], test : [loss = 2.214, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.609, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6583/15625) 006583-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.24%], valid : [loss = 0.456, top1 = 86.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10        train : [loss = 0.160, top1 = 94.79%], test  : [loss = 0.347, top1 = 88.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.56 ms.
cifar100       train : [loss = 0.989, top1 = 71.84%], valid : [loss = 1.352, top1 = 62.41%], test : [loss = 1.346, top1 = 62.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 33.90%], valid : [loss = 2.665, top1 = 33.23%], test : [loss = 2.690, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6584/15625) 006584-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.418, top1 = 91.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.274, top1 = 94.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.068, top1 = 99.05%], valid : [loss = 1.350, top1 = 69.74%], test : [loss = 1.312, top1 = 70.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.538, top1 = 58.41%], valid : [loss = 2.216, top1 = 43.67%], test : [loss = 2.242, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.48%], valid : [loss = 0.508, top1 = 83.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6585/15625) 006585-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.499, top1 = 89.96%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.50 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.327, top1 = 93.26%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.98 ms.
cifar100       train : [loss = 0.053, top1 = 99.39%], valid : [loss = 1.316, top1 = 69.98%], test : [loss = 1.295, top1 = 71.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.557, top1 = 58.02%], valid : [loss = 2.202, top1 = 44.73%], test : [loss = 2.191, top1 = 45.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.95%], valid : [loss = 0.659, top1 = 77.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6586/15625) 006586-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.616, top1 = 85.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10        train : [loss = 0.069, top1 = 97.92%], test  : [loss = 0.417, top1 = 88.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.49 ms.
cifar100       train : [loss = 0.725, top1 = 78.84%], valid : [loss = 1.407, top1 = 62.92%], test : [loss = 1.380, top1 = 63.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.59%], valid : [loss = 2.661, top1 = 33.67%], test : [loss = 2.722, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.18%], valid : [loss = 0.787, top1 = 72.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6587/15625) 006587-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.556, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.024, top1 = 99.36%], test  : [loss = 0.354, top1 = 91.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.43 ms.
cifar100       train : [loss = 0.430, top1 = 87.62%], valid : [loss = 1.260, top1 = 67.38%], test : [loss = 1.273, top1 = 66.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.06 ms.
ImageNet16-120 train : [loss = 2.232, top1 = 42.32%], valid : [loss = 2.401, top1 = 38.53%], test : [loss = 2.447, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.99%], valid : [loss = 0.808, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6588/15625) 006588-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.582, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.385, top1 = 91.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.25 ms.
cifar100       train : [loss = 0.405, top1 = 88.55%], valid : [loss = 1.399, top1 = 65.19%], test : [loss = 1.398, top1 = 65.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.86%], valid : [loss = 2.506, top1 = 36.92%], test : [loss = 2.533, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6589/15625) 006589-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.532, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.342, top1 = 91.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 0.302, top1 = 91.78%], valid : [loss = 1.296, top1 = 67.16%], test : [loss = 1.294, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.71%], valid : [loss = 2.426, top1 = 38.00%], test : [loss = 2.435, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6590/15625) 006590-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.304, top1 = 92.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 0.233, top1 = 94.29%], valid : [loss = 1.250, top1 = 68.83%], test : [loss = 1.264, top1 = 68.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.06%], valid : [loss = 2.275, top1 = 41.92%], test : [loss = 2.285, top1 = 42.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.36%], valid : [loss = 0.532, top1 = 81.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6591/15625) 006591-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.537, top1 = 88.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.355, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=18.59 ms.
cifar100       train : [loss = 0.297, top1 = 91.91%], valid : [loss = 1.311, top1 = 67.54%], test : [loss = 1.307, top1 = 67.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.68%], valid : [loss = 2.458, top1 = 37.87%], test : [loss = 2.441, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6592/15625) 006592-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.551, top1 = 87.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.379, top1 = 91.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.25 ms.
cifar100       train : [loss = 0.386, top1 = 89.18%], valid : [loss = 1.382, top1 = 65.50%], test : [loss = 1.385, top1 = 64.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 41.93%], valid : [loss = 2.474, top1 = 37.27%], test : [loss = 2.477, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.64%], valid : [loss = 0.764, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6593/15625) 006593-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=21.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.92%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.328, top1 = 93.19%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=22.63 ms.
cifar100       train : [loss = 0.069, top1 = 98.94%], valid : [loss = 1.352, top1 = 69.28%], test : [loss = 1.335, top1 = 70.16%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.09%], valid : [loss = 2.363, top1 = 39.87%], test : [loss = 2.382, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.07%], valid : [loss = 0.775, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6594/15625) 006594-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.540, top1 = 88.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.347, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 0.244, top1 = 93.45%], valid : [loss = 1.341, top1 = 66.92%], test : [loss = 1.347, top1 = 66.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.165, top1 = 43.84%], valid : [loss = 2.424, top1 = 38.63%], test : [loss = 2.437, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6595/15625) 006595-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.638, top1 = 86.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.404, top1 = 90.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 0.277, top1 = 92.81%], valid : [loss = 1.523, top1 = 63.78%], test : [loss = 1.528, top1 = 64.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.02 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.84%], valid : [loss = 2.504, top1 = 37.40%], test : [loss = 2.528, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.74%], valid : [loss = 0.778, top1 = 72.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6596/15625) 006596-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.20%], valid : [loss = 0.544, top1 = 86.96%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.59 ms.
cifar10        train : [loss = 0.064, top1 = 97.89%], test  : [loss = 0.373, top1 = 89.84%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.72 ms.
cifar100       train : [loss = 0.721, top1 = 78.97%], valid : [loss = 1.369, top1 = 63.90%], test : [loss = 1.358, top1 = 63.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.17%], valid : [loss = 2.512, top1 = 36.63%], test : [loss = 2.561, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.67%], valid : [loss = 0.831, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6597/15625) 006597-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.604, top1 = 86.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10        train : [loss = 0.035, top1 = 98.98%], test  : [loss = 0.403, top1 = 89.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.75 ms.
cifar100       train : [loss = 0.536, top1 = 84.36%], valid : [loss = 1.419, top1 = 63.88%], test : [loss = 1.442, top1 = 63.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.47%], valid : [loss = 2.557, top1 = 35.37%], test : [loss = 2.611, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 69.93%], valid : [loss = 0.884, top1 = 68.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6598/15625) 006598-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.541, top1 = 89.20%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.88 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.344, top1 = 92.54%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=23.76 ms.
cifar100       train : [loss = 0.119, top1 = 97.57%], valid : [loss = 1.327, top1 = 68.48%], test : [loss = 1.368, top1 = 68.84%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.87 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.76%], valid : [loss = 2.270, top1 = 42.60%], test : [loss = 2.334, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.07%], valid : [loss = 0.846, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6599/15625) 006599-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.635, top1 = 87.05%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.98 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.436, top1 = 90.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.43 ms.
cifar100       train : [loss = 0.185, top1 = 95.70%], valid : [loss = 1.656, top1 = 64.04%], test : [loss = 1.612, top1 = 64.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.091, top1 = 45.46%], valid : [loss = 2.534, top1 = 36.23%], test : [loss = 2.535, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.76%], valid : [loss = 0.834, top1 = 70.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6600/15625) 006600-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 0.330, top1 = 91.03%], valid : [loss = 1.309, top1 = 66.64%], test : [loss = 1.324, top1 = 67.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.51 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.26%], valid : [loss = 2.380, top1 = 40.42%], test : [loss = 2.404, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6601/15625) 006601-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.541, top1 = 80.97%], valid : [loss = 0.843, top1 = 72.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.53 ms.
cifar10        train : [loss = 0.558, top1 = 80.34%], test  : [loss = 0.721, top1 = 75.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.26 ms.
cifar100       train : [loss = 1.792, top1 = 51.79%], valid : [loss = 2.049, top1 = 47.52%], test : [loss = 2.071, top1 = 47.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.82%], valid : [loss = 3.629, top1 = 16.20%], test : [loss = 3.665, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6602/15625) 006602-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.34%], valid : [loss = 0.552, top1 = 86.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10        train : [loss = 0.093, top1 = 96.87%], test  : [loss = 0.383, top1 = 89.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.73 ms.
cifar100       train : [loss = 0.770, top1 = 77.43%], valid : [loss = 1.384, top1 = 63.38%], test : [loss = 1.334, top1 = 63.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.466, top1 = 37.14%], valid : [loss = 2.576, top1 = 35.47%], test : [loss = 2.609, top1 = 34.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.34%], valid : [loss = 0.797, top1 = 72.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6603/15625) 006603-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.38%], valid : [loss = 0.655, top1 = 85.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10        train : [loss = 0.050, top1 = 98.57%], test  : [loss = 0.473, top1 = 88.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.66 ms.
cifar100       train : [loss = 0.620, top1 = 81.78%], valid : [loss = 1.511, top1 = 62.30%], test : [loss = 1.466, top1 = 62.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.35%], valid : [loss = 2.822, top1 = 30.63%], test : [loss = 2.893, top1 = 29.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.890, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6604/15625) 006604-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.584, top1 = 87.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.398, top1 = 90.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.03 ms.
cifar100       train : [loss = 0.374, top1 = 89.27%], valid : [loss = 1.442, top1 = 64.84%], test : [loss = 1.433, top1 = 64.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.72%], valid : [loss = 2.499, top1 = 37.37%], test : [loss = 2.510, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.16%], valid : [loss = 0.822, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6605/15625) 006605-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.26%], valid : [loss = 0.668, top1 = 82.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10        train : [loss = 0.149, top1 = 94.96%], test  : [loss = 0.452, top1 = 86.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 0.947, top1 = 72.27%], valid : [loss = 1.619, top1 = 57.98%], test : [loss = 1.602, top1 = 58.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 3.061, top1 = 25.20%], valid : [loss = 3.124, top1 = 25.13%], test : [loss = 3.175, top1 = 23.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6606/15625) 006606-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.564, top1 = 88.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.373, top1 = 92.51%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.19 ms.
cifar100       train : [loss = 0.100, top1 = 98.22%], valid : [loss = 1.470, top1 = 67.47%], test : [loss = 1.442, top1 = 68.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.62%], valid : [loss = 2.433, top1 = 39.68%], test : [loss = 2.471, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6607/15625) 006607-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.53%], valid : [loss = 0.836, top1 = 72.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.562, top1 = 80.24%], test  : [loss = 0.718, top1 = 76.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 1.774, top1 = 52.51%], valid : [loss = 2.042, top1 = 47.54%], test : [loss = 2.049, top1 = 46.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 16.63%], valid : [loss = 3.653, top1 = 16.53%], test : [loss = 3.671, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6608/15625) 006608-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.622, top1 = 86.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.029, top1 = 99.31%], test  : [loss = 0.422, top1 = 89.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.58 ms.
cifar100       train : [loss = 0.381, top1 = 89.82%], valid : [loss = 1.449, top1 = 64.72%], test : [loss = 1.406, top1 = 64.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.35%], valid : [loss = 2.615, top1 = 35.53%], test : [loss = 2.634, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6609/15625) 006609-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.548, top1 = 88.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.35 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.336, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.74 ms.
cifar100       train : [loss = 0.300, top1 = 91.68%], valid : [loss = 1.312, top1 = 67.26%], test : [loss = 1.271, top1 = 67.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.33%], valid : [loss = 2.436, top1 = 38.77%], test : [loss = 2.473, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6610/15625) 006610-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.377, top1 = 86.83%], valid : [loss = 0.629, top1 = 79.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10        train : [loss = 0.320, top1 = 88.89%], test  : [loss = 0.457, top1 = 85.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 1.622, top1 = 54.95%], valid : [loss = 1.841, top1 = 50.67%], test : [loss = 1.841, top1 = 50.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.987, top1 = 26.86%], valid : [loss = 2.999, top1 = 26.90%], test : [loss = 3.043, top1 = 26.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.015, top1 = 63.32%], valid : [loss = 1.060, top1 = 62.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6611/15625) 006611-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.517, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.332, top1 = 91.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.99 ms.
cifar100       train : [loss = 0.345, top1 = 90.65%], valid : [loss = 1.311, top1 = 66.78%], test : [loss = 1.294, top1 = 66.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.24%], valid : [loss = 2.420, top1 = 39.37%], test : [loss = 2.414, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.42%], valid : [loss = 0.750, top1 = 73.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6612/15625) 006612-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.537, top1 = 88.98%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.58 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.347, top1 = 92.59%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.39 ms.
cifar100       train : [loss = 0.126, top1 = 97.13%], valid : [loss = 1.343, top1 = 68.64%], test : [loss = 1.352, top1 = 68.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.87 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.09%], valid : [loss = 2.324, top1 = 39.63%], test : [loss = 2.343, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.42%], valid : [loss = 0.824, top1 = 71.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6613/15625) 006613-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.19%], valid : [loss = 0.441, top1 = 87.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.109, top1 = 96.71%], test  : [loss = 0.323, top1 = 89.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.863, top1 = 75.44%], valid : [loss = 1.313, top1 = 62.98%], test : [loss = 1.285, top1 = 63.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.90%], valid : [loss = 2.590, top1 = 35.27%], test : [loss = 2.647, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6614/15625) 006614-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.20%], valid : [loss = 0.787, top1 = 80.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.51 ms.
cifar10        train : [loss = 0.138, top1 = 95.39%], test  : [loss = 0.558, top1 = 84.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.870, top1 = 74.63%], valid : [loss = 1.641, top1 = 57.98%], test : [loss = 1.640, top1 = 58.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.36%], valid : [loss = 3.177, top1 = 25.03%], test : [loss = 3.209, top1 = 23.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.040, top1 = 62.68%], valid : [loss = 1.101, top1 = 61.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6615/15625) 006615-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.695, top1 = 86.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.63 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.390, top1 = 91.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.48 ms.
cifar100       train : [loss = 0.177, top1 = 96.01%], valid : [loss = 1.605, top1 = 64.44%], test : [loss = 1.583, top1 = 64.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.19%], valid : [loss = 2.484, top1 = 38.50%], test : [loss = 2.521, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.40%], valid : [loss = 0.820, top1 = 71.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6616/15625) 006616-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.462, top1 = 88.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.334, top1 = 91.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 0.324, top1 = 91.16%], valid : [loss = 1.292, top1 = 67.28%], test : [loss = 1.318, top1 = 67.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.35%], valid : [loss = 2.377, top1 = 40.67%], test : [loss = 2.414, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.53%], valid : [loss = 0.547, top1 = 81.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6617/15625) 006617-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.21%], valid : [loss = 0.616, top1 = 85.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10        train : [loss = 0.074, top1 = 97.71%], test  : [loss = 0.381, top1 = 89.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.69 ms.
cifar100       train : [loss = 0.720, top1 = 78.99%], valid : [loss = 1.382, top1 = 63.09%], test : [loss = 1.370, top1 = 63.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.95%], valid : [loss = 2.647, top1 = 33.91%], test : [loss = 2.680, top1 = 33.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.28%], valid : [loss = 0.765, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6618/15625) 006618-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.596, top1 = 87.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.388, top1 = 90.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.27 ms.
cifar100       train : [loss = 0.423, top1 = 87.93%], valid : [loss = 1.403, top1 = 65.07%], test : [loss = 1.384, top1 = 65.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.00%], valid : [loss = 2.502, top1 = 36.06%], test : [loss = 2.512, top1 = 37.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.00%], valid : [loss = 0.822, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6619/15625) 006619-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.625, top1 = 87.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.54 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.396, top1 = 91.37%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.87 ms.
cifar100       train : [loss = 0.187, top1 = 95.61%], valid : [loss = 1.616, top1 = 64.14%], test : [loss = 1.666, top1 = 63.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.57%], valid : [loss = 2.411, top1 = 39.23%], test : [loss = 2.439, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.70%], valid : [loss = 0.781, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6620/15625) 006620-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.622, top1 = 77.93%], valid : [loss = 0.730, top1 = 74.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.557, top1 = 80.80%], test  : [loss = 0.618, top1 = 78.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.59 ms.
cifar100       train : [loss = 1.992, top1 = 46.52%], valid : [loss = 2.121, top1 = 44.03%], test : [loss = 2.115, top1 = 44.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.31 ms.
ImageNet16-120 train : [loss = 3.241, top1 = 22.23%], valid : [loss = 3.228, top1 = 22.99%], test : [loss = 3.259, top1 = 22.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 54.01%], valid : [loss = 1.347, top1 = 51.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6621/15625) 006621-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.428, top1 = 90.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.286, top1 = 93.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.111, top1 = 98.09%], valid : [loss = 1.268, top1 = 70.08%], test : [loss = 1.292, top1 = 69.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 1.700, top1 = 54.57%], valid : [loss = 2.220, top1 = 43.23%], test : [loss = 2.240, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.86%], valid : [loss = 0.531, top1 = 81.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6622/15625) 006622-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.468, top1 = 89.30%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.97 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.309, top1 = 92.43%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.98 ms.
cifar100       train : [loss = 0.238, top1 = 94.10%], valid : [loss = 1.198, top1 = 69.60%], test : [loss = 1.225, top1 = 69.48%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.45 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.40%], valid : [loss = 2.228, top1 = 42.43%], test : [loss = 2.250, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.66%], valid : [loss = 0.634, top1 = 78.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6623/15625) 006623-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.29%], valid : [loss = 0.575, top1 = 85.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10        train : [loss = 0.110, top1 = 96.44%], test  : [loss = 0.362, top1 = 89.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.05 ms.
cifar100       train : [loss = 0.777, top1 = 77.34%], valid : [loss = 1.378, top1 = 63.20%], test : [loss = 1.361, top1 = 63.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.82%], valid : [loss = 2.604, top1 = 34.43%], test : [loss = 2.651, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.40%], valid : [loss = 0.885, top1 = 68.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6624/15625) 006624-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.50%], valid : [loss = 0.457, top1 = 86.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10        train : [loss = 0.154, top1 = 94.92%], test  : [loss = 0.344, top1 = 89.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.25 ms.
cifar100       train : [loss = 1.026, top1 = 70.85%], valid : [loss = 1.378, top1 = 62.40%], test : [loss = 1.376, top1 = 61.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.40%], valid : [loss = 2.704, top1 = 31.23%], test : [loss = 2.701, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6625/15625) 006625-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.24 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.38%], valid : [loss = 0.560, top1 = 83.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.217, top1 = 92.66%], test  : [loss = 0.410, top1 = 86.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.27 ms.
cifar100       train : [loss = 1.104, top1 = 68.22%], valid : [loss = 1.543, top1 = 58.84%], test : [loss = 1.518, top1 = 57.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.992, top1 = 26.79%], valid : [loss = 3.006, top1 = 27.07%], test : [loss = 3.046, top1 = 25.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.08%], valid : [loss = 1.037, top1 = 63.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6626/15625) 006626-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.484, top1 = 88.97%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.60 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.289, top1 = 92.66%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.46 ms.
cifar100       train : [loss = 0.230, top1 = 94.44%], valid : [loss = 1.227, top1 = 68.56%], test : [loss = 1.259, top1 = 68.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.18%], valid : [loss = 2.302, top1 = 41.67%], test : [loss = 2.307, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.40%], valid : [loss = 0.689, top1 = 76.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6627/15625) 006627-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.15%], valid : [loss = 0.464, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.62 ms.
cifar10        train : [loss = 0.164, top1 = 94.68%], test  : [loss = 0.350, top1 = 88.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 1.021, top1 = 70.81%], valid : [loss = 1.362, top1 = 61.60%], test : [loss = 1.378, top1 = 61.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.48%], valid : [loss = 2.690, top1 = 33.97%], test : [loss = 2.721, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6628/15625) 006628-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.483, top1 = 89.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.327, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.81 ms.
cifar100       train : [loss = 0.299, top1 = 91.97%], valid : [loss = 1.259, top1 = 67.70%], test : [loss = 1.250, top1 = 68.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.63%], valid : [loss = 2.213, top1 = 42.70%], test : [loss = 2.244, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.93%], valid : [loss = 0.624, top1 = 78.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6629/15625) 006629-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.65%], valid : [loss = 0.548, top1 = 87.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.021, top1 = 99.38%], test  : [loss = 0.364, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 0.335, top1 = 90.15%], valid : [loss = 1.333, top1 = 67.30%], test : [loss = 1.329, top1 = 67.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.15%], valid : [loss = 2.715, top1 = 32.07%], test : [loss = 2.718, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 65.74%], valid : [loss = 0.971, top1 = 65.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6630/15625) 006630-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.32%], valid : [loss = 0.744, top1 = 79.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10        train : [loss = 0.183, top1 = 93.61%], test  : [loss = 0.520, top1 = 84.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.31 ms.
cifar100       train : [loss = 0.888, top1 = 74.18%], valid : [loss = 1.653, top1 = 57.55%], test : [loss = 1.670, top1 = 57.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 3.480, top1 = 17.17%], valid : [loss = 3.484, top1 = 17.39%], test : [loss = 3.486, top1 = 16.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6631/15625) 006631-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.539, top1 = 88.92%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.56 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.344, top1 = 92.10%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.09 ms.
cifar100       train : [loss = 0.150, top1 = 96.70%], valid : [loss = 1.304, top1 = 69.17%], test : [loss = 1.329, top1 = 68.73%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.52 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.47%], valid : [loss = 2.303, top1 = 41.08%], test : [loss = 2.307, top1 = 41.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.46%], valid : [loss = 0.852, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6632/15625) 006632-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.503, top1 = 89.09%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.30 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.311, top1 = 92.44%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.20 ms.
cifar100       train : [loss = 0.195, top1 = 95.51%], valid : [loss = 1.234, top1 = 69.40%], test : [loss = 1.233, top1 = 69.67%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.34 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.76%], valid : [loss = 2.267, top1 = 41.80%], test : [loss = 2.266, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.26%], valid : [loss = 0.747, top1 = 73.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6633/15625) 006633-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.595, top1 = 85.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.074, top1 = 97.73%], test  : [loss = 0.400, top1 = 88.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.718, top1 = 79.11%], valid : [loss = 1.393, top1 = 62.76%], test : [loss = 1.376, top1 = 63.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.80%], valid : [loss = 2.676, top1 = 33.31%], test : [loss = 2.710, top1 = 33.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6634/15625) 006634-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.93%], valid : [loss = 0.472, top1 = 84.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10        train : [loss = 0.300, top1 = 89.89%], test  : [loss = 0.399, top1 = 86.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 1.335, top1 = 63.16%], valid : [loss = 1.547, top1 = 57.32%], test : [loss = 1.520, top1 = 57.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.62%], valid : [loss = 2.915, top1 = 29.39%], test : [loss = 2.963, top1 = 28.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6635/15625) 006635-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.36%], valid : [loss = 0.859, top1 = 71.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.550, top1 = 80.78%], test  : [loss = 0.717, top1 = 75.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 1.766, top1 = 52.28%], valid : [loss = 2.038, top1 = 47.53%], test : [loss = 2.051, top1 = 46.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.78%], valid : [loss = 3.630, top1 = 16.69%], test : [loss = 3.671, top1 = 15.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6636/15625) 006636-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.467, top1 = 88.97%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.64 ms.
cifar100       train : [loss = 0.322, top1 = 91.34%], valid : [loss = 1.315, top1 = 67.20%], test : [loss = 1.316, top1 = 67.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.21%], valid : [loss = 2.372, top1 = 40.08%], test : [loss = 2.389, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6637/15625) 006637-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.544, top1 = 89.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.375, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.70 ms.
cifar100       train : [loss = 0.101, top1 = 98.20%], valid : [loss = 1.441, top1 = 68.36%], test : [loss = 1.447, top1 = 68.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.40%], valid : [loss = 2.442, top1 = 38.76%], test : [loss = 2.442, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.44%], valid : [loss = 0.732, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6638/15625) 006638-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.664, top1 = 85.50%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10        train : [loss = 0.026, top1 = 99.37%], test  : [loss = 0.422, top1 = 89.50%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.98 ms.
cifar100       train : [loss = 0.356, top1 = 90.53%], valid : [loss = 1.429, top1 = 64.67%], test : [loss = 1.391, top1 = 65.38%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.62%], valid : [loss = 2.620, top1 = 35.00%], test : [loss = 2.627, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.77%], valid : [loss = 0.784, top1 = 72.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6639/15625) 006639-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.89%], valid : [loss = 0.981, top1 = 66.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10        train : [loss = 0.767, top1 = 73.12%], test  : [loss = 0.853, top1 = 69.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.16 ms.
cifar100       train : [loss = 2.155, top1 = 43.65%], valid : [loss = 2.325, top1 = 40.81%], test : [loss = 2.340, top1 = 40.51%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.05 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.28%], valid : [loss = 3.764, top1 = 14.52%], test : [loss = 3.779, top1 = 13.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6640/15625) 006640-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.488, top1 = 90.09%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.308, top1 = 93.53%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.23 ms.
cifar100       train : [loss = 0.063, top1 = 99.09%], valid : [loss = 1.319, top1 = 70.31%], test : [loss = 1.303, top1 = 70.85%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.22 ms.
ImageNet16-120 train : [loss = 1.612, top1 = 56.55%], valid : [loss = 2.196, top1 = 44.68%], test : [loss = 2.186, top1 = 45.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.69%], valid : [loss = 0.576, top1 = 80.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6641/15625) 006641-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.569, top1 = 87.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.384, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.404, top1 = 88.60%], valid : [loss = 1.408, top1 = 65.33%], test : [loss = 1.377, top1 = 65.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.75%], valid : [loss = 2.519, top1 = 36.68%], test : [loss = 2.549, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.03%], valid : [loss = 0.777, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6642/15625) 006642-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.326, top1 = 88.75%], valid : [loss = 0.576, top1 = 81.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10        train : [loss = 0.273, top1 = 90.63%], test  : [loss = 0.433, top1 = 86.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 1.474, top1 = 58.64%], valid : [loss = 1.696, top1 = 54.25%], test : [loss = 1.699, top1 = 53.87%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.28%], valid : [loss = 2.936, top1 = 28.89%], test : [loss = 2.989, top1 = 26.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.42%], valid : [loss = 1.053, top1 = 62.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6643/15625) 006643-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.00 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.52%], valid : [loss = 0.442, top1 = 87.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.38 ms.
cifar10        train : [loss = 0.058, top1 = 98.54%], test  : [loss = 0.318, top1 = 90.41%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.96 ms.
cifar100       train : [loss = 0.588, top1 = 83.80%], valid : [loss = 1.227, top1 = 66.28%], test : [loss = 1.207, top1 = 66.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.12%], valid : [loss = 2.468, top1 = 37.56%], test : [loss = 2.494, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6644/15625) 006644-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.471, top1 = 89.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.330, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.279, top1 = 92.64%], valid : [loss = 1.325, top1 = 67.25%], test : [loss = 1.324, top1 = 67.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.84%], valid : [loss = 2.349, top1 = 40.36%], test : [loss = 2.360, top1 = 40.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.447, top1 = 84.88%], valid : [loss = 0.542, top1 = 81.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6645/15625) 006645-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.478, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.309, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.319, top1 = 91.45%], valid : [loss = 1.240, top1 = 67.95%], test : [loss = 1.241, top1 = 68.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.72%], valid : [loss = 2.302, top1 = 40.60%], test : [loss = 2.331, top1 = 41.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.25%], valid : [loss = 0.620, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6646/15625) 006646-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.506, top1 = 88.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.341, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.48 ms.
cifar100       train : [loss = 0.344, top1 = 90.57%], valid : [loss = 1.302, top1 = 66.21%], test : [loss = 1.309, top1 = 66.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.54%], valid : [loss = 2.423, top1 = 39.18%], test : [loss = 2.441, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6647/15625) 006647-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.524, top1 = 88.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.365, top1 = 91.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.261, top1 = 92.92%], valid : [loss = 1.263, top1 = 68.93%], test : [loss = 1.269, top1 = 68.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.61%], valid : [loss = 2.253, top1 = 43.17%], test : [loss = 2.270, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.54%], valid : [loss = 0.737, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6648/15625) 006648-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.560, top1 = 87.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.365, top1 = 90.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.509, top1 = 85.44%], valid : [loss = 1.336, top1 = 65.06%], test : [loss = 1.346, top1 = 64.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.31%], valid : [loss = 2.628, top1 = 33.40%], test : [loss = 2.644, top1 = 33.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6649/15625) 006649-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.590, top1 = 87.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.379, top1 = 91.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.52 ms.
cifar100       train : [loss = 0.394, top1 = 88.82%], valid : [loss = 1.425, top1 = 65.54%], test : [loss = 1.399, top1 = 65.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.97%], valid : [loss = 2.516, top1 = 36.62%], test : [loss = 2.534, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.10%], valid : [loss = 0.764, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6650/15625) 006650-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.529, top1 = 88.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.020, top1 = 99.50%], test  : [loss = 0.353, top1 = 91.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.13 ms.
cifar100       train : [loss = 0.354, top1 = 90.11%], valid : [loss = 1.289, top1 = 66.85%], test : [loss = 1.282, top1 = 67.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.098, top1 = 45.28%], valid : [loss = 2.331, top1 = 39.86%], test : [loss = 2.335, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.54%], valid : [loss = 0.822, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6651/15625) 006651-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.515, top1 = 89.80%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.321, top1 = 93.24%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.95 ms.
cifar100       train : [loss = 0.068, top1 = 99.00%], valid : [loss = 1.359, top1 = 69.13%], test : [loss = 1.350, top1 = 69.93%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.10%], valid : [loss = 2.341, top1 = 40.76%], test : [loss = 2.296, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.09%], valid : [loss = 0.688, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6652/15625) 006652-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.491, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.23 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.323, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.77 ms.
cifar100       train : [loss = 0.234, top1 = 94.27%], valid : [loss = 1.235, top1 = 68.97%], test : [loss = 1.249, top1 = 68.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.23%], valid : [loss = 2.281, top1 = 41.47%], test : [loss = 2.295, top1 = 42.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6653/15625) 006653-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.507, top1 = 89.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.316, top1 = 92.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.87 ms.
cifar100       train : [loss = 0.127, top1 = 97.50%], valid : [loss = 1.291, top1 = 69.35%], test : [loss = 1.303, top1 = 69.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 1.870, top1 = 50.60%], valid : [loss = 2.308, top1 = 41.41%], test : [loss = 2.287, top1 = 42.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6654/15625) 006654-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.565, top1 = 88.14%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.04 ms.
cifar10        train : [loss = 0.021, top1 = 99.42%], test  : [loss = 0.389, top1 = 91.16%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.58 ms.
cifar100       train : [loss = 0.259, top1 = 93.10%], valid : [loss = 1.318, top1 = 67.81%], test : [loss = 1.322, top1 = 67.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.52%], valid : [loss = 2.277, top1 = 41.63%], test : [loss = 2.307, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.69%], valid : [loss = 0.928, top1 = 67.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6655/15625) 006655-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.50%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.60 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.318, top1 = 93.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.47 ms.
cifar100       train : [loss = 0.073, top1 = 98.89%], valid : [loss = 1.370, top1 = 69.69%], test : [loss = 1.388, top1 = 69.56%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.85%], valid : [loss = 2.336, top1 = 39.99%], test : [loss = 2.326, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6656/15625) 006656-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.44%], valid : [loss = 0.857, top1 = 71.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.553, top1 = 80.65%], test  : [loss = 0.714, top1 = 75.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.83 ms.
cifar100       train : [loss = 1.774, top1 = 52.26%], valid : [loss = 2.056, top1 = 47.17%], test : [loss = 2.068, top1 = 46.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.33 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.80%], valid : [loss = 3.641, top1 = 16.30%], test : [loss = 3.669, top1 = 15.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6657/15625) 006657-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.84%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.22 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.320, top1 = 93.26%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.40 ms.
cifar100       train : [loss = 0.044, top1 = 99.45%], valid : [loss = 1.387, top1 = 69.83%], test : [loss = 1.370, top1 = 70.12%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=25.58 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.82%], valid : [loss = 2.325, top1 = 40.62%], test : [loss = 2.328, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.65%], valid : [loss = 0.797, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6658/15625) 006658-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.21%], valid : [loss = 0.548, top1 = 82.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.28 ms.
cifar10        train : [loss = 0.268, top1 = 90.82%], test  : [loss = 0.422, top1 = 86.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 1.521, top1 = 57.48%], valid : [loss = 1.757, top1 = 52.41%], test : [loss = 1.750, top1 = 52.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 2.936, top1 = 27.97%], valid : [loss = 2.944, top1 = 28.18%], test : [loss = 3.004, top1 = 26.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.31%], valid : [loss = 0.993, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6659/15625) 006659-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.62%], valid : [loss = 0.685, top1 = 81.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10        train : [loss = 0.231, top1 = 92.06%], test  : [loss = 0.523, top1 = 84.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.31 ms.
cifar100       train : [loss = 1.339, top1 = 62.17%], valid : [loss = 1.926, top1 = 49.87%], test : [loss = 1.945, top1 = 50.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 3.385, top1 = 18.64%], valid : [loss = 3.409, top1 = 18.50%], test : [loss = 3.404, top1 = 18.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 57.15%], valid : [loss = 1.204, top1 = 56.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6660/15625) 006660-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.34%], valid : [loss = 0.620, top1 = 85.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.067, top1 = 97.99%], test  : [loss = 0.422, top1 = 88.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.02 ms.
cifar100       train : [loss = 0.689, top1 = 79.82%], valid : [loss = 1.397, top1 = 63.18%], test : [loss = 1.387, top1 = 63.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.85%], valid : [loss = 2.659, top1 = 33.51%], test : [loss = 2.696, top1 = 33.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.96%], valid : [loss = 0.832, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6661/15625) 006661-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.28%], valid : [loss = 0.462, top1 = 86.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.159, top1 = 94.81%], test  : [loss = 0.342, top1 = 88.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.999, top1 = 71.51%], valid : [loss = 1.359, top1 = 61.81%], test : [loss = 1.349, top1 = 62.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.84%], valid : [loss = 2.687, top1 = 32.78%], test : [loss = 2.713, top1 = 32.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6662/15625) 006662-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.88 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.35%], valid : [loss = 0.712, top1 = 80.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10        train : [loss = 0.180, top1 = 93.80%], test  : [loss = 0.512, top1 = 84.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.18 ms.
cifar100       train : [loss = 0.896, top1 = 73.82%], valid : [loss = 1.653, top1 = 57.34%], test : [loss = 1.678, top1 = 56.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 3.499, top1 = 16.87%], valid : [loss = 3.507, top1 = 16.84%], test : [loss = 3.504, top1 = 16.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6663/15625) 006663-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.505, top1 = 89.23%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.329, top1 = 92.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.05 ms.
cifar100       train : [loss = 0.293, top1 = 92.23%], valid : [loss = 1.293, top1 = 67.53%], test : [loss = 1.295, top1 = 67.67%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.870, top1 = 50.42%], valid : [loss = 2.218, top1 = 42.90%], test : [loss = 2.234, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.62%], valid : [loss = 0.662, top1 = 77.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6664/15625) 006664-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.53%], valid : [loss = 0.650, top1 = 84.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10        train : [loss = 0.086, top1 = 97.27%], test  : [loss = 0.406, top1 = 88.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.49 ms.
cifar100       train : [loss = 0.775, top1 = 77.24%], valid : [loss = 1.408, top1 = 61.84%], test : [loss = 1.406, top1 = 62.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.38%], valid : [loss = 2.732, top1 = 32.50%], test : [loss = 2.760, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6665/15625) 006665-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.528, top1 = 89.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.330, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.219, top1 = 94.35%], valid : [loss = 1.290, top1 = 67.96%], test : [loss = 1.299, top1 = 68.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.83%], valid : [loss = 2.279, top1 = 41.74%], test : [loss = 2.288, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.00%], valid : [loss = 0.741, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6666/15625) 006666-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.536, top1 = 89.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.346, top1 = 92.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.23 ms.
cifar100       train : [loss = 0.226, top1 = 94.08%], valid : [loss = 1.321, top1 = 67.75%], test : [loss = 1.325, top1 = 67.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.01 ms.
ImageNet16-120 train : [loss = 1.969, top1 = 48.16%], valid : [loss = 2.292, top1 = 41.59%], test : [loss = 2.305, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.77%], valid : [loss = 0.853, top1 = 69.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6667/15625) 006667-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.63%], valid : [loss = 0.525, top1 = 82.50%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.91 ms.
cifar10        train : [loss = 0.401, top1 = 86.38%], test  : [loss = 0.467, top1 = 84.27%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.71 ms.
cifar100       train : [loss = 1.542, top1 = 57.68%], valid : [loss = 1.663, top1 = 54.35%], test : [loss = 1.658, top1 = 54.83%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.25 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.36%], valid : [loss = 3.008, top1 = 27.73%], test : [loss = 3.045, top1 = 26.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6668/15625) 006668-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.58 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6669/15625) 006669-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.656, top1 = 86.02%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.95 ms.
cifar10        train : [loss = 0.025, top1 = 99.38%], test  : [loss = 0.425, top1 = 89.53%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.15 ms.
cifar100       train : [loss = 0.341, top1 = 90.97%], valid : [loss = 1.642, top1 = 61.84%], test : [loss = 1.597, top1 = 62.67%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.09%], valid : [loss = 2.594, top1 = 35.71%], test : [loss = 2.619, top1 = 35.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.66%], valid : [loss = 0.810, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6670/15625) 006670-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.604, top1 = 87.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.84 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.415, top1 = 90.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.251, top1 = 93.68%], valid : [loss = 1.448, top1 = 65.81%], test : [loss = 1.431, top1 = 65.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.32%], valid : [loss = 2.557, top1 = 35.83%], test : [loss = 2.588, top1 = 36.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.98%], valid : [loss = 0.813, top1 = 71.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6671/15625) 006671-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.83%], valid : [loss = 0.595, top1 = 87.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.63%], test  : [loss = 0.377, top1 = 91.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.93 ms.
cifar100       train : [loss = 0.211, top1 = 94.45%], valid : [loss = 1.440, top1 = 66.09%], test : [loss = 1.449, top1 = 66.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.434, top1 = 37.62%], valid : [loss = 2.594, top1 = 34.06%], test : [loss = 2.582, top1 = 34.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.40%], valid : [loss = 1.062, top1 = 61.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6672/15625) 006672-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.32 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.95%], valid : [loss = 0.481, top1 = 84.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10        train : [loss = 0.299, top1 = 90.00%], test  : [loss = 0.397, top1 = 86.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.34 ms.
cifar100       train : [loss = 1.331, top1 = 63.10%], valid : [loss = 1.540, top1 = 57.77%], test : [loss = 1.507, top1 = 58.03%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.51 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.64%], valid : [loss = 2.913, top1 = 29.31%], test : [loss = 2.959, top1 = 27.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6673/15625) 006673-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.37%], valid : [loss = 0.605, top1 = 85.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10        train : [loss = 0.069, top1 = 97.94%], test  : [loss = 0.403, top1 = 88.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.47 ms.
cifar100       train : [loss = 0.697, top1 = 79.79%], valid : [loss = 1.384, top1 = 63.51%], test : [loss = 1.378, top1 = 63.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.15%], valid : [loss = 2.653, top1 = 33.61%], test : [loss = 2.677, top1 = 33.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6674/15625) 006674-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.468, top1 = 88.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.324, top1 = 91.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.24 ms.
cifar100       train : [loss = 0.327, top1 = 91.07%], valid : [loss = 1.331, top1 = 66.45%], test : [loss = 1.307, top1 = 67.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.14%], valid : [loss = 2.371, top1 = 39.76%], test : [loss = 2.404, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6675/15625) 006675-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.519, top1 = 88.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.335, top1 = 91.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.31 ms.
cifar100       train : [loss = 0.336, top1 = 90.79%], valid : [loss = 1.288, top1 = 67.07%], test : [loss = 1.302, top1 = 67.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.64%], valid : [loss = 2.405, top1 = 38.59%], test : [loss = 2.424, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6676/15625) 006676-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.503, top1 = 90.07%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.04 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.309, top1 = 93.58%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.08 ms.
cifar100       train : [loss = 0.055, top1 = 99.13%], valid : [loss = 1.363, top1 = 70.15%], test : [loss = 1.338, top1 = 70.85%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.29 ms.
ImageNet16-120 train : [loss = 1.535, top1 = 58.46%], valid : [loss = 2.135, top1 = 45.68%], test : [loss = 2.150, top1 = 45.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.682, top1 = 76.07%], valid : [loss = 0.768, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6677/15625) 006677-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.15%], valid : [loss = 0.635, top1 = 78.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.359, top1 = 87.52%], test  : [loss = 0.495, top1 = 83.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.71 ms.
cifar100       train : [loss = 1.710, top1 = 52.84%], valid : [loss = 1.927, top1 = 48.58%], test : [loss = 1.925, top1 = 48.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 3.215, top1 = 22.61%], valid : [loss = 3.202, top1 = 22.59%], test : [loss = 3.257, top1 = 22.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.083, top1 = 60.72%], valid : [loss = 1.122, top1 = 59.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6678/15625) 006678-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.628, top1 = 87.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.431, top1 = 90.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.05 ms.
cifar100       train : [loss = 0.157, top1 = 96.64%], valid : [loss = 1.632, top1 = 64.46%], test : [loss = 1.603, top1 = 65.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.85%], valid : [loss = 2.639, top1 = 34.87%], test : [loss = 2.680, top1 = 34.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.23%], valid : [loss = 0.790, top1 = 72.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6679/15625) 006679-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.530, top1 = 89.55%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.68 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.340, top1 = 92.95%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.27 ms.
cifar100       train : [loss = 0.033, top1 = 99.73%], valid : [loss = 1.442, top1 = 69.59%], test : [loss = 1.420, top1 = 69.67%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.12 ms.
ImageNet16-120 train : [loss = 1.574, top1 = 57.60%], valid : [loss = 2.383, top1 = 41.43%], test : [loss = 2.420, top1 = 41.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.62%], valid : [loss = 0.666, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6680/15625) 006680-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.210, top1 = 92.88%], valid : [loss = 0.539, top1 = 83.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10        train : [loss = 0.206, top1 = 93.02%], test  : [loss = 0.401, top1 = 87.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 1.280, top1 = 63.60%], valid : [loss = 1.566, top1 = 57.09%], test : [loss = 1.563, top1 = 57.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.723, top1 = 32.17%], valid : [loss = 2.748, top1 = 31.84%], test : [loss = 2.777, top1 = 31.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.50%], valid : [loss = 0.990, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6681/15625) 006681-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.46%], valid : [loss = 0.830, top1 = 76.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.323, top1 = 88.86%], test  : [loss = 0.633, top1 = 79.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 1.378, top1 = 61.27%], valid : [loss = 1.920, top1 = 49.71%], test : [loss = 1.919, top1 = 50.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 3.508, top1 = 17.11%], valid : [loss = 3.531, top1 = 17.20%], test : [loss = 3.531, top1 = 16.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.258, top1 = 53.80%], valid : [loss = 1.308, top1 = 52.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6682/15625) 006682-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.77%], valid : [loss = 0.477, top1 = 84.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10        train : [loss = 0.301, top1 = 89.93%], test  : [loss = 0.401, top1 = 86.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.87 ms.
cifar100       train : [loss = 1.331, top1 = 63.14%], valid : [loss = 1.532, top1 = 57.86%], test : [loss = 1.494, top1 = 58.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.62%], valid : [loss = 2.900, top1 = 29.67%], test : [loss = 2.959, top1 = 27.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.42%], valid : [loss = 0.775, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6683/15625) 006683-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.69%], valid : [loss = 0.509, top1 = 85.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.28 ms.
cifar10        train : [loss = 0.155, top1 = 94.81%], test  : [loss = 0.368, top1 = 88.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.47 ms.
cifar100       train : [loss = 1.010, top1 = 70.95%], valid : [loss = 1.401, top1 = 61.38%], test : [loss = 1.387, top1 = 61.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.03%], valid : [loss = 2.594, top1 = 35.67%], test : [loss = 2.631, top1 = 34.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.90%], valid : [loss = 0.922, top1 = 66.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6684/15625) 006684-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.43%], valid : [loss = 0.661, top1 = 82.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10        train : [loss = 0.151, top1 = 94.92%], test  : [loss = 0.458, top1 = 86.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 0.985, top1 = 71.49%], valid : [loss = 1.644, top1 = 56.84%], test : [loss = 1.650, top1 = 56.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.054, top1 = 25.44%], valid : [loss = 3.137, top1 = 24.76%], test : [loss = 3.171, top1 = 23.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6685/15625) 006685-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.51%], valid : [loss = 0.454, top1 = 86.27%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.85 ms.
cifar10        train : [loss = 0.152, top1 = 95.09%], test  : [loss = 0.345, top1 = 88.87%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.71 ms.
cifar100       train : [loss = 0.981, top1 = 72.05%], valid : [loss = 1.356, top1 = 62.10%], test : [loss = 1.357, top1 = 62.23%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.08%], valid : [loss = 2.666, top1 = 33.24%], test : [loss = 2.691, top1 = 32.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6686/15625) 006686-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.506, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.331, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.52 ms.
cifar100       train : [loss = 0.344, top1 = 90.64%], valid : [loss = 1.282, top1 = 67.07%], test : [loss = 1.295, top1 = 66.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.76%], valid : [loss = 2.405, top1 = 39.04%], test : [loss = 2.434, top1 = 38.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6687/15625) 006687-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.08 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.481, top1 = 90.08%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.63 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.309, top1 = 93.35%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.06 ms.
cifar100       train : [loss = 0.064, top1 = 99.00%], valid : [loss = 1.314, top1 = 70.58%], test : [loss = 1.328, top1 = 70.70%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.15 ms.
ImageNet16-120 train : [loss = 1.655, top1 = 55.66%], valid : [loss = 2.168, top1 = 44.61%], test : [loss = 2.162, top1 = 45.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.92%], valid : [loss = 0.867, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6688/15625) 006688-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.432, top1 = 85.00%], valid : [loss = 0.674, top1 = 78.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10        train : [loss = 0.384, top1 = 86.66%], test  : [loss = 0.529, top1 = 82.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.609, top1 = 55.62%], valid : [loss = 1.870, top1 = 50.07%], test : [loss = 1.867, top1 = 50.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 3.299, top1 = 21.49%], valid : [loss = 3.308, top1 = 21.56%], test : [loss = 3.336, top1 = 21.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.34%], valid : [loss = 1.234, top1 = 55.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6689/15625) 006689-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.503, top1 = 89.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.53 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.52 ms.
cifar100       train : [loss = 0.111, top1 = 97.89%], valid : [loss = 1.274, top1 = 70.18%], test : [loss = 1.275, top1 = 70.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.17 ms.
ImageNet16-120 train : [loss = 1.712, top1 = 54.24%], valid : [loss = 2.193, top1 = 43.51%], test : [loss = 2.197, top1 = 44.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.84%], valid : [loss = 0.630, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6690/15625) 006690-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.243, top1 = 91.75%], valid : [loss = 0.526, top1 = 83.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10        train : [loss = 0.240, top1 = 91.80%], test  : [loss = 0.406, top1 = 86.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.07 ms.
cifar100       train : [loss = 1.330, top1 = 62.48%], valid : [loss = 1.596, top1 = 56.69%], test : [loss = 1.578, top1 = 56.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 2.845, top1 = 29.89%], valid : [loss = 2.856, top1 = 29.69%], test : [loss = 2.911, top1 = 28.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.58%], valid : [loss = 1.030, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6691/15625) 006691-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.568, top1 = 87.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.381, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.410, top1 = 88.29%], valid : [loss = 1.383, top1 = 65.56%], test : [loss = 1.396, top1 = 65.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.76%], valid : [loss = 2.495, top1 = 37.31%], test : [loss = 2.533, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.93%], valid : [loss = 0.777, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6692/15625) 006692-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.08 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.61%], valid : [loss = 0.469, top1 = 86.15%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.51 ms.
cifar10        train : [loss = 0.121, top1 = 96.23%], test  : [loss = 0.341, top1 = 89.10%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.05 ms.
cifar100       train : [loss = 0.749, top1 = 79.12%], valid : [loss = 1.271, top1 = 64.97%], test : [loss = 1.268, top1 = 64.62%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.25 ms.
ImageNet16-120 train : [loss = 2.503, top1 = 36.72%], valid : [loss = 2.596, top1 = 34.74%], test : [loss = 2.626, top1 = 33.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.12%], valid : [loss = 0.852, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6693/15625) 006693-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.437, top1 = 89.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.290, top1 = 93.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.61 ms.
cifar100       train : [loss = 0.083, top1 = 98.67%], valid : [loss = 1.345, top1 = 69.67%], test : [loss = 1.322, top1 = 69.55%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.13 ms.
ImageNet16-120 train : [loss = 1.647, top1 = 55.81%], valid : [loss = 2.225, top1 = 43.87%], test : [loss = 2.234, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 86.12%], valid : [loss = 0.527, top1 = 82.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6694/15625) 006694-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.554, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.373, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.72 ms.
cifar100       train : [loss = 0.091, top1 = 98.47%], valid : [loss = 1.474, top1 = 67.96%], test : [loss = 1.453, top1 = 67.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.28%], valid : [loss = 2.438, top1 = 39.32%], test : [loss = 2.428, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.73%], valid : [loss = 0.724, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6695/15625) 006695-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.23%], valid : [loss = 0.456, top1 = 86.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.91 ms.
cifar10        train : [loss = 0.117, top1 = 96.39%], test  : [loss = 0.329, top1 = 89.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 0.857, top1 = 75.66%], valid : [loss = 1.294, top1 = 64.59%], test : [loss = 1.275, top1 = 63.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.82%], valid : [loss = 2.620, top1 = 34.53%], test : [loss = 2.644, top1 = 34.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 80.02%], valid : [loss = 0.652, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6696/15625) 006696-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.457, top1 = 89.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.310, top1 = 92.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.122, top1 = 97.47%], valid : [loss = 1.388, top1 = 68.57%], test : [loss = 1.372, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 1.750, top1 = 53.37%], valid : [loss = 2.291, top1 = 42.33%], test : [loss = 2.280, top1 = 42.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.62%], valid : [loss = 0.581, top1 = 80.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6697/15625) 006697-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.432, top1 = 90.95%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.72%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.14 ms.
cifar100       train : [loss = 0.057, top1 = 99.29%], valid : [loss = 1.337, top1 = 70.70%], test : [loss = 1.315, top1 = 70.67%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 1.503, top1 = 59.27%], valid : [loss = 2.216, top1 = 44.29%], test : [loss = 2.251, top1 = 44.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.340, top1 = 88.46%], valid : [loss = 0.479, top1 = 84.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6698/15625) 006698-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.484, top1 = 89.55%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.80 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.336, top1 = 92.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.80 ms.
cifar100       train : [loss = 0.148, top1 = 96.66%], valid : [loss = 1.355, top1 = 69.06%], test : [loss = 1.362, top1 = 68.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.789, top1 = 52.50%], valid : [loss = 2.239, top1 = 43.36%], test : [loss = 2.254, top1 = 43.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.480, top1 = 83.07%], valid : [loss = 0.586, top1 = 80.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6699/15625) 006699-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.548, top1 = 87.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.026, top1 = 99.24%], test  : [loss = 0.356, top1 = 91.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.41 ms.
cifar100       train : [loss = 0.418, top1 = 87.84%], valid : [loss = 1.271, top1 = 66.81%], test : [loss = 1.262, top1 = 66.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.35%], valid : [loss = 2.409, top1 = 38.80%], test : [loss = 2.451, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.93%], valid : [loss = 0.810, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6700/15625) 006700-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.57%], valid : [loss = 0.585, top1 = 86.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.034, top1 = 98.96%], test  : [loss = 0.385, top1 = 90.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.383, top1 = 88.97%], valid : [loss = 1.371, top1 = 65.32%], test : [loss = 1.367, top1 = 65.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.458, top1 = 37.26%], valid : [loss = 2.599, top1 = 34.36%], test : [loss = 2.628, top1 = 34.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.13%], valid : [loss = 0.982, top1 = 64.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6701/15625) 006701-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.47%], valid : [loss = 0.551, top1 = 83.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.199, top1 = 93.28%], test  : [loss = 0.392, top1 = 87.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 1.277, top1 = 63.70%], valid : [loss = 1.547, top1 = 57.54%], test : [loss = 1.559, top1 = 57.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.702, top1 = 32.59%], valid : [loss = 2.725, top1 = 32.19%], test : [loss = 2.783, top1 = 31.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6702/15625) 006702-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.86%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.28 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.331, top1 = 93.12%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.53 ms.
cifar100       train : [loss = 0.063, top1 = 98.96%], valid : [loss = 1.375, top1 = 70.05%], test : [loss = 1.361, top1 = 69.45%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.52 ms.
ImageNet16-120 train : [loss = 1.758, top1 = 53.13%], valid : [loss = 2.219, top1 = 43.48%], test : [loss = 2.239, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.92%], valid : [loss = 0.681, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6703/15625) 006703-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.488, top1 = 90.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.317, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.113, top1 = 97.76%], valid : [loss = 1.306, top1 = 69.30%], test : [loss = 1.304, top1 = 69.75%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.80%], valid : [loss = 2.190, top1 = 44.14%], test : [loss = 2.178, top1 = 44.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6704/15625) 006704-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.520, top1 = 88.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.335, top1 = 91.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.49 ms.
cifar100       train : [loss = 0.343, top1 = 90.59%], valid : [loss = 1.286, top1 = 67.29%], test : [loss = 1.285, top1 = 67.35%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.71%], valid : [loss = 2.413, top1 = 38.89%], test : [loss = 2.420, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.02%], valid : [loss = 0.633, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6705/15625) 006705-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.19%], valid : [loss = 0.584, top1 = 81.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.246, top1 = 91.56%], test  : [loss = 0.404, top1 = 86.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 1.370, top1 = 61.31%], valid : [loss = 1.652, top1 = 55.31%], test : [loss = 1.628, top1 = 55.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.849, top1 = 29.70%], valid : [loss = 2.876, top1 = 29.67%], test : [loss = 2.886, top1 = 28.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.36%], valid : [loss = 0.983, top1 = 65.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6706/15625) 006706-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.15%], valid : [loss = 0.570, top1 = 86.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.063, top1 = 97.97%], test  : [loss = 0.367, top1 = 90.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.50 ms.
cifar100       train : [loss = 0.646, top1 = 81.01%], valid : [loss = 1.301, top1 = 64.93%], test : [loss = 1.309, top1 = 64.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.90 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.16%], valid : [loss = 2.505, top1 = 37.28%], test : [loss = 2.535, top1 = 35.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6707/15625) 006707-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.91 ms.
cifar10-valid  train : [loss = 0.487, top1 = 83.00%], valid : [loss = 0.645, top1 = 78.17%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.513, top1 = 82.19%], test  : [loss = 0.591, top1 = 80.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 1.696, top1 = 53.97%], valid : [loss = 1.868, top1 = 50.33%], test : [loss = 1.861, top1 = 50.91%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.72 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.35%], valid : [loss = 3.314, top1 = 21.56%], test : [loss = 3.347, top1 = 20.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6708/15625) 006708-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.215, top1 = 92.65%], valid : [loss = 0.749, top1 = 78.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.199, top1 = 93.12%], test  : [loss = 0.512, top1 = 84.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.917, top1 = 73.24%], valid : [loss = 1.664, top1 = 57.01%], test : [loss = 1.690, top1 = 56.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 3.450, top1 = 17.78%], valid : [loss = 3.446, top1 = 18.34%], test : [loss = 3.464, top1 = 17.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.298, top1 = 52.44%], valid : [loss = 1.330, top1 = 51.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6709/15625) 006709-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.465, top1 = 89.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.320, top1 = 92.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.50 ms.
cifar100       train : [loss = 0.290, top1 = 92.07%], valid : [loss = 1.307, top1 = 67.39%], test : [loss = 1.320, top1 = 67.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 47.25%], valid : [loss = 2.339, top1 = 40.86%], test : [loss = 2.368, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.43%], valid : [loss = 0.609, top1 = 79.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6710/15625) 006710-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.45%], valid : [loss = 0.855, top1 = 71.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.550, top1 = 80.86%], test  : [loss = 0.710, top1 = 75.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 1.784, top1 = 51.97%], valid : [loss = 2.068, top1 = 46.33%], test : [loss = 2.080, top1 = 46.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 17.01%], valid : [loss = 3.623, top1 = 16.89%], test : [loss = 3.664, top1 = 15.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6711/15625) 006711-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.538, top1 = 89.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.346, top1 = 92.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.52 ms.
cifar100       train : [loss = 0.129, top1 = 97.32%], valid : [loss = 1.315, top1 = 69.18%], test : [loss = 1.325, top1 = 69.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.35%], valid : [loss = 2.267, top1 = 42.20%], test : [loss = 2.277, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.63%], valid : [loss = 0.819, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6712/15625) 006712-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.234, top1 = 92.13%], valid : [loss = 0.558, top1 = 82.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10        train : [loss = 0.233, top1 = 92.03%], test  : [loss = 0.419, top1 = 86.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 1.324, top1 = 62.41%], valid : [loss = 1.611, top1 = 56.08%], test : [loss = 1.599, top1 = 56.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.65%], valid : [loss = 2.763, top1 = 31.44%], test : [loss = 2.812, top1 = 30.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.48%], valid : [loss = 0.967, top1 = 65.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6713/15625) 006713-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.51%], valid : [loss = 0.608, top1 = 86.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10        train : [loss = 0.039, top1 = 98.87%], test  : [loss = 0.397, top1 = 90.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.32 ms.
cifar100       train : [loss = 0.566, top1 = 83.50%], valid : [loss = 1.456, top1 = 63.17%], test : [loss = 1.438, top1 = 62.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.69%], valid : [loss = 2.540, top1 = 36.11%], test : [loss = 2.580, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.67%], valid : [loss = 0.916, top1 = 67.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6714/15625) 006714-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.687, top1 = 85.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.470, top1 = 89.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.38 ms.
cifar100       train : [loss = 0.251, top1 = 93.83%], valid : [loss = 1.618, top1 = 63.05%], test : [loss = 1.606, top1 = 63.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.348, top1 = 40.06%], valid : [loss = 2.765, top1 = 32.29%], test : [loss = 2.797, top1 = 32.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.25%], valid : [loss = 0.850, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6715/15625) 006715-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.526, top1 = 88.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10        train : [loss = 0.019, top1 = 99.56%], test  : [loss = 0.362, top1 = 91.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.12 ms.
cifar100       train : [loss = 0.386, top1 = 88.90%], valid : [loss = 1.341, top1 = 65.99%], test : [loss = 1.314, top1 = 66.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.93%], valid : [loss = 2.415, top1 = 38.21%], test : [loss = 2.438, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.96%], valid : [loss = 0.659, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6716/15625) 006716-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.500, top1 = 89.63%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.21 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 92.87%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.70 ms.
cifar100       train : [loss = 0.120, top1 = 97.70%], valid : [loss = 1.291, top1 = 69.52%], test : [loss = 1.272, top1 = 70.05%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.19 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.45%], valid : [loss = 2.279, top1 = 41.91%], test : [loss = 2.265, top1 = 42.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.79%], valid : [loss = 0.645, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6717/15625) 006717-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.492, top1 = 90.04%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.325, top1 = 93.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.04 ms.
cifar100       train : [loss = 0.112, top1 = 97.86%], valid : [loss = 1.318, top1 = 69.37%], test : [loss = 1.303, top1 = 69.52%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.87 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.21%], valid : [loss = 2.202, top1 = 43.99%], test : [loss = 2.205, top1 = 44.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.73%], valid : [loss = 0.659, top1 = 77.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6718/15625) 006718-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.82 ms.
cifar10-valid  train : [loss = 1.701, top1 = 38.06%], valid : [loss = 1.732, top1 = 37.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.93 ms.
cifar10        train : [loss = 1.219, top1 = 56.22%], test  : [loss = 1.225, top1 = 55.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.44 ms.
cifar100       train : [loss = 3.801, top1 = 11.93%], valid : [loss = 3.890, top1 = 10.36%], test : [loss = 3.883, top1 = 10.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.96 ms.
ImageNet16-120 train : [loss = 3.799, top1 = 13.30%], valid : [loss = 3.764, top1 = 14.31%], test : [loss = 3.776, top1 = 14.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.957, top1 = 27.94%], valid : [loss = 1.961, top1 = 27.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6719/15625) 006719-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.514, top1 = 89.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.319, top1 = 93.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.00 ms.
cifar100       train : [loss = 0.117, top1 = 97.70%], valid : [loss = 1.298, top1 = 69.61%], test : [loss = 1.301, top1 = 69.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.72%], valid : [loss = 2.183, top1 = 43.91%], test : [loss = 2.200, top1 = 44.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6720/15625) 006720-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.17%], valid : [loss = 0.457, top1 = 86.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10        train : [loss = 0.114, top1 = 96.43%], test  : [loss = 0.331, top1 = 89.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.79 ms.
cifar100       train : [loss = 0.860, top1 = 75.56%], valid : [loss = 1.307, top1 = 64.23%], test : [loss = 1.286, top1 = 64.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.67%], valid : [loss = 2.623, top1 = 34.47%], test : [loss = 2.674, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6721/15625) 006721-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.338, top1 = 92.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 0.105, top1 = 98.17%], valid : [loss = 1.422, top1 = 68.02%], test : [loss = 1.431, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.13%], valid : [loss = 2.399, top1 = 39.66%], test : [loss = 2.407, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.18%], valid : [loss = 0.718, top1 = 75.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6722/15625) 006722-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.551, top1 = 88.69%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.15 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.342, top1 = 92.28%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.08 ms.
cifar100       train : [loss = 0.235, top1 = 93.83%], valid : [loss = 1.304, top1 = 68.21%], test : [loss = 1.324, top1 = 67.97%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.076, top1 = 45.76%], valid : [loss = 2.371, top1 = 39.64%], test : [loss = 2.405, top1 = 39.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.83%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6723/15625) 006723-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.531, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.348, top1 = 91.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.278, top1 = 92.72%], valid : [loss = 1.263, top1 = 67.76%], test : [loss = 1.268, top1 = 68.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.70%], valid : [loss = 2.307, top1 = 41.36%], test : [loss = 2.326, top1 = 41.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.14%], valid : [loss = 0.716, top1 = 75.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6724/15625) 006724-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.528, top1 = 89.71%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.322, top1 = 93.29%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.21 ms.
cifar100       train : [loss = 0.068, top1 = 98.80%], valid : [loss = 1.370, top1 = 69.17%], test : [loss = 1.390, top1 = 68.83%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.80 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.60%], valid : [loss = 2.337, top1 = 40.68%], test : [loss = 2.337, top1 = 40.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 75.13%], valid : [loss = 0.774, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6725/15625) 006725-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.70 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.26%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.307, top1 = 92.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.96 ms.
cifar100       train : [loss = 0.329, top1 = 91.02%], valid : [loss = 1.319, top1 = 67.16%], test : [loss = 1.318, top1 = 67.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.24%], valid : [loss = 2.360, top1 = 39.90%], test : [loss = 2.404, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6726/15625) 006726-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.31%], valid : [loss = 0.665, top1 = 84.89%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10        train : [loss = 0.052, top1 = 98.43%], test  : [loss = 0.415, top1 = 89.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.81 ms.
cifar100       train : [loss = 0.629, top1 = 81.56%], valid : [loss = 1.475, top1 = 62.51%], test : [loss = 1.456, top1 = 62.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 36.91%], valid : [loss = 2.633, top1 = 34.11%], test : [loss = 2.668, top1 = 33.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.84%], valid : [loss = 0.924, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6727/15625) 006727-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.576, top1 = 87.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.375, top1 = 91.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.38 ms.
cifar100       train : [loss = 0.311, top1 = 91.27%], valid : [loss = 1.347, top1 = 66.87%], test : [loss = 1.359, top1 = 66.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.08%], valid : [loss = 2.475, top1 = 37.48%], test : [loss = 2.475, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.17%], valid : [loss = 0.932, top1 = 67.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6728/15625) 006728-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.298, top1 = 93.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.32 ms.
cifar100       train : [loss = 0.126, top1 = 97.37%], valid : [loss = 1.315, top1 = 69.31%], test : [loss = 1.332, top1 = 68.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 1.776, top1 = 52.68%], valid : [loss = 2.214, top1 = 43.49%], test : [loss = 2.256, top1 = 43.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.04%], valid : [loss = 0.628, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6729/15625) 006729-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.36%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.01 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.353, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.61 ms.
cifar100       train : [loss = 0.048, top1 = 99.53%], valid : [loss = 1.397, top1 = 69.39%], test : [loss = 1.406, top1 = 69.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.86 ms.
ImageNet16-120 train : [loss = 1.660, top1 = 55.53%], valid : [loss = 2.397, top1 = 40.57%], test : [loss = 2.419, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.55%], valid : [loss = 0.647, top1 = 77.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6730/15625) 006730-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.27%], valid : [loss = 0.479, top1 = 84.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.299, top1 = 89.96%], test  : [loss = 0.399, top1 = 86.59%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.69 ms.
cifar100       train : [loss = 1.318, top1 = 63.46%], valid : [loss = 1.526, top1 = 58.12%], test : [loss = 1.499, top1 = 58.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.75 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.78%], valid : [loss = 2.899, top1 = 29.54%], test : [loss = 2.947, top1 = 28.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6731/15625) 006731-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.556, top1 = 87.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.357, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.411, top1 = 88.05%], valid : [loss = 1.273, top1 = 66.74%], test : [loss = 1.280, top1 = 66.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.15%], valid : [loss = 2.407, top1 = 38.76%], test : [loss = 2.443, top1 = 38.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6732/15625) 006732-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.507, top1 = 89.95%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.305, top1 = 93.38%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.47 ms.
cifar100       train : [loss = 0.075, top1 = 98.84%], valid : [loss = 1.361, top1 = 69.35%], test : [loss = 1.352, top1 = 69.59%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.47 ms.
ImageNet16-120 train : [loss = 1.963, top1 = 48.28%], valid : [loss = 2.322, top1 = 40.37%], test : [loss = 2.317, top1 = 40.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 71.12%], valid : [loss = 0.844, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6733/15625) 006733-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.69%], valid : [loss = 0.831, top1 = 80.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10        train : [loss = 0.131, top1 = 95.57%], test  : [loss = 0.553, top1 = 84.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.90 ms.
cifar100       train : [loss = 0.858, top1 = 75.08%], valid : [loss = 1.678, top1 = 57.40%], test : [loss = 1.657, top1 = 57.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 3.039, top1 = 26.45%], valid : [loss = 3.182, top1 = 23.63%], test : [loss = 3.211, top1 = 23.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.064, top1 = 61.73%], valid : [loss = 1.110, top1 = 60.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6734/15625) 006734-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.480, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.292, top1 = 92.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.34 ms.
cifar100       train : [loss = 0.291, top1 = 92.36%], valid : [loss = 1.244, top1 = 68.08%], test : [loss = 1.247, top1 = 68.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 1.961, top1 = 48.39%], valid : [loss = 2.292, top1 = 41.38%], test : [loss = 2.289, top1 = 41.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.75%], valid : [loss = 0.590, top1 = 79.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6735/15625) 006735-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.565, top1 = 87.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.374, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.392, top1 = 88.96%], valid : [loss = 1.379, top1 = 65.94%], test : [loss = 1.388, top1 = 65.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.250, top1 = 42.00%], valid : [loss = 2.452, top1 = 38.41%], test : [loss = 2.487, top1 = 37.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.38%], valid : [loss = 0.713, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6736/15625) 006736-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.71%], valid : [loss = 0.605, top1 = 86.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.029, top1 = 99.24%], test  : [loss = 0.390, top1 = 90.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.493, top1 = 85.56%], valid : [loss = 1.444, top1 = 63.74%], test : [loss = 1.397, top1 = 65.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.20%], valid : [loss = 2.561, top1 = 36.13%], test : [loss = 2.597, top1 = 35.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.84%], valid : [loss = 0.823, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6737/15625) 006737-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.490, top1 = 89.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.35 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.319, top1 = 92.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.278, top1 = 92.66%], valid : [loss = 1.217, top1 = 69.04%], test : [loss = 1.225, top1 = 68.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 1.947, top1 = 48.69%], valid : [loss = 2.235, top1 = 42.64%], test : [loss = 2.272, top1 = 41.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.98%], valid : [loss = 0.579, top1 = 80.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6738/15625) 006738-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.565, top1 = 88.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.373, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.00 ms.
cifar100       train : [loss = 0.112, top1 = 97.72%], valid : [loss = 1.497, top1 = 67.40%], test : [loss = 1.523, top1 = 66.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.88%], valid : [loss = 2.427, top1 = 39.72%], test : [loss = 2.430, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.48%], valid : [loss = 0.753, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6739/15625) 006739-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.475, top1 = 90.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.320, top1 = 93.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.081, top1 = 98.52%], valid : [loss = 1.403, top1 = 69.53%], test : [loss = 1.418, top1 = 69.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.86%], valid : [loss = 2.273, top1 = 43.38%], test : [loss = 2.285, top1 = 43.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.63%], valid : [loss = 0.565, top1 = 80.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6740/15625) 006740-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.510, top1 = 88.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.028, top1 = 99.25%], test  : [loss = 0.353, top1 = 91.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.43 ms.
cifar100       train : [loss = 0.483, top1 = 85.84%], valid : [loss = 1.360, top1 = 65.57%], test : [loss = 1.357, top1 = 65.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.330, top1 = 40.24%], valid : [loss = 2.517, top1 = 36.87%], test : [loss = 2.556, top1 = 35.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.61%], valid : [loss = 0.697, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6741/15625) 006741-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.512, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.353, top1 = 91.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.73 ms.
cifar100       train : [loss = 0.495, top1 = 85.45%], valid : [loss = 1.337, top1 = 65.73%], test : [loss = 1.333, top1 = 65.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.06%], valid : [loss = 2.509, top1 = 36.87%], test : [loss = 2.541, top1 = 35.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.80%], valid : [loss = 0.723, top1 = 75.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6742/15625) 006742-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.545, top1 = 88.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.347, top1 = 91.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.327, top1 = 91.01%], valid : [loss = 1.280, top1 = 67.45%], test : [loss = 1.285, top1 = 67.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.19%], valid : [loss = 2.432, top1 = 38.52%], test : [loss = 2.426, top1 = 39.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6743/15625) 006743-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.623, top1 = 86.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10        train : [loss = 0.031, top1 = 99.16%], test  : [loss = 0.401, top1 = 90.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.81 ms.
cifar100       train : [loss = 0.510, top1 = 85.14%], valid : [loss = 1.397, top1 = 64.51%], test : [loss = 1.396, top1 = 64.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.07%], valid : [loss = 2.577, top1 = 35.30%], test : [loss = 2.596, top1 = 35.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6744/15625) 006744-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6745/15625) 006745-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.522, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.330, top1 = 92.53%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.22 ms.
cifar100       train : [loss = 0.140, top1 = 96.73%], valid : [loss = 1.334, top1 = 69.00%], test : [loss = 1.329, top1 = 69.25%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 1.862, top1 = 50.70%], valid : [loss = 2.234, top1 = 43.26%], test : [loss = 2.257, top1 = 43.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.50%], valid : [loss = 0.787, top1 = 72.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6746/15625) 006746-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.555, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.390, top1 = 91.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.163, top1 = 96.50%], valid : [loss = 1.448, top1 = 66.82%], test : [loss = 1.413, top1 = 67.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 1.948, top1 = 48.84%], valid : [loss = 2.428, top1 = 39.46%], test : [loss = 2.429, top1 = 39.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.04%], valid : [loss = 0.683, top1 = 76.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6747/15625) 006747-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.402, top1 = 90.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.273, top1 = 93.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.091, top1 = 98.45%], valid : [loss = 1.298, top1 = 70.84%], test : [loss = 1.286, top1 = 70.35%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.626, top1 = 56.24%], valid : [loss = 2.217, top1 = 43.88%], test : [loss = 2.242, top1 = 43.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.13%], valid : [loss = 0.496, top1 = 83.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6748/15625) 006748-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.517, top1 = 88.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.377, top1 = 90.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.394, top1 = 88.65%], valid : [loss = 1.333, top1 = 66.63%], test : [loss = 1.343, top1 = 66.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 43.00%], valid : [loss = 2.408, top1 = 38.89%], test : [loss = 2.445, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.14%], valid : [loss = 0.614, top1 = 79.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6749/15625) 006749-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.555, top1 = 88.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.80 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.340, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.67 ms.
cifar100       train : [loss = 0.262, top1 = 92.78%], valid : [loss = 1.332, top1 = 67.97%], test : [loss = 1.325, top1 = 67.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.08%], valid : [loss = 2.455, top1 = 38.01%], test : [loss = 2.465, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 68.10%], valid : [loss = 0.933, top1 = 67.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6750/15625) 006750-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.622, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.44 ms.
cifar10        train : [loss = 0.037, top1 = 99.00%], test  : [loss = 0.407, top1 = 89.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.01 ms.
cifar100       train : [loss = 0.448, top1 = 87.58%], valid : [loss = 1.383, top1 = 64.92%], test : [loss = 1.348, top1 = 65.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.93%], valid : [loss = 2.569, top1 = 35.49%], test : [loss = 2.591, top1 = 35.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.46%], valid : [loss = 0.744, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6751/15625) 006751-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.319, top1 = 88.78%], valid : [loss = 0.558, top1 = 82.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10        train : [loss = 0.298, top1 = 89.68%], test  : [loss = 0.435, top1 = 85.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.68 ms.
cifar100       train : [loss = 1.464, top1 = 58.92%], valid : [loss = 1.701, top1 = 53.74%], test : [loss = 1.698, top1 = 53.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 3.025, top1 = 26.37%], valid : [loss = 3.024, top1 = 26.70%], test : [loss = 3.080, top1 = 25.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.87%], valid : [loss = 1.029, top1 = 63.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6752/15625) 006752-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.94%], valid : [loss = 0.525, top1 = 87.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.075, top1 = 97.61%], test  : [loss = 0.357, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.16 ms.
cifar100       train : [loss = 0.710, top1 = 79.07%], valid : [loss = 1.333, top1 = 64.66%], test : [loss = 1.344, top1 = 64.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.09%], valid : [loss = 2.641, top1 = 33.70%], test : [loss = 2.674, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.68%], valid : [loss = 0.685, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6753/15625) 006753-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.567, top1 = 87.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.385, top1 = 91.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.60 ms.
cifar100       train : [loss = 0.382, top1 = 89.21%], valid : [loss = 1.395, top1 = 65.63%], test : [loss = 1.409, top1 = 65.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.271, top1 = 41.54%], valid : [loss = 2.472, top1 = 37.48%], test : [loss = 2.507, top1 = 37.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.767, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6754/15625) 006754-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.479, top1 = 89.44%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.78 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.316, top1 = 92.10%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.11 ms.
cifar100       train : [loss = 0.235, top1 = 94.31%], valid : [loss = 1.221, top1 = 68.79%], test : [loss = 1.208, top1 = 69.47%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=22.52 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.56%], valid : [loss = 2.172, top1 = 43.23%], test : [loss = 2.203, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.77%], valid : [loss = 0.683, top1 = 76.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6755/15625) 006755-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.91%], valid : [loss = 0.729, top1 = 83.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.088, top1 = 97.20%], test  : [loss = 0.492, top1 = 86.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.30 ms.
cifar100       train : [loss = 0.848, top1 = 75.31%], valid : [loss = 1.614, top1 = 58.54%], test : [loss = 1.595, top1 = 59.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 2.828, top1 = 30.22%], valid : [loss = 2.958, top1 = 28.08%], test : [loss = 3.008, top1 = 27.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.46%], valid : [loss = 0.886, top1 = 68.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6756/15625) 006756-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.561, top1 = 87.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10        train : [loss = 0.019, top1 = 99.54%], test  : [loss = 0.392, top1 = 90.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.395, top1 = 88.83%], valid : [loss = 1.403, top1 = 65.93%], test : [loss = 1.400, top1 = 65.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.16%], valid : [loss = 2.505, top1 = 36.84%], test : [loss = 2.532, top1 = 37.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.00%], valid : [loss = 0.856, top1 = 69.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6757/15625) 006757-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.42%], valid : [loss = 0.546, top1 = 86.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.053, top1 = 98.41%], test  : [loss = 0.364, top1 = 90.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.91 ms.
cifar100       train : [loss = 0.615, top1 = 81.98%], valid : [loss = 1.344, top1 = 65.17%], test : [loss = 1.334, top1 = 64.57%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.56%], valid : [loss = 2.534, top1 = 36.04%], test : [loss = 2.563, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.64%], valid : [loss = 0.653, top1 = 77.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6758/15625) 006758-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.45%], valid : [loss = 0.450, top1 = 86.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10        train : [loss = 0.153, top1 = 95.01%], test  : [loss = 0.348, top1 = 88.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.98 ms.
cifar100       train : [loss = 0.989, top1 = 71.88%], valid : [loss = 1.357, top1 = 62.17%], test : [loss = 1.354, top1 = 62.55%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.13%], valid : [loss = 2.663, top1 = 33.62%], test : [loss = 2.707, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.30%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6759/15625) 006759-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.472, top1 = 89.35%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.14 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.309, top1 = 92.70%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.54 ms.
cifar100       train : [loss = 0.133, top1 = 97.50%], valid : [loss = 1.213, top1 = 69.82%], test : [loss = 1.211, top1 = 70.16%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.717, top1 = 54.03%], valid : [loss = 2.152, top1 = 44.37%], test : [loss = 2.159, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.43%], valid : [loss = 0.676, top1 = 76.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6760/15625) 006760-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.57%], valid : [loss = 0.602, top1 = 82.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.170, top1 = 94.37%], test  : [loss = 0.428, top1 = 86.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.910, top1 = 73.76%], valid : [loss = 1.490, top1 = 60.77%], test : [loss = 1.473, top1 = 61.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.904, top1 = 28.91%], valid : [loss = 2.971, top1 = 27.89%], test : [loss = 3.004, top1 = 27.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.49%], valid : [loss = 1.034, top1 = 63.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6761/15625) 006761-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.583, top1 = 87.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.391, top1 = 91.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.04 ms.
cifar100       train : [loss = 0.381, top1 = 89.31%], valid : [loss = 1.400, top1 = 65.67%], test : [loss = 1.416, top1 = 65.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.94%], valid : [loss = 2.531, top1 = 36.40%], test : [loss = 2.525, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.18%], valid : [loss = 0.796, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6762/15625) 006762-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.18%], valid : [loss = 0.597, top1 = 85.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.074, top1 = 97.78%], test  : [loss = 0.392, top1 = 88.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.716, top1 = 79.18%], valid : [loss = 1.372, top1 = 63.47%], test : [loss = 1.368, top1 = 63.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.78%], valid : [loss = 2.650, top1 = 33.58%], test : [loss = 2.715, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.47%], valid : [loss = 0.780, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6763/15625) 006763-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.456, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.311, top1 = 92.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.99 ms.
cifar100       train : [loss = 0.227, top1 = 94.47%], valid : [loss = 1.297, top1 = 68.21%], test : [loss = 1.318, top1 = 67.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.65%], valid : [loss = 2.306, top1 = 41.66%], test : [loss = 2.318, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.04%], valid : [loss = 0.562, top1 = 80.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6764/15625) 006764-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.78%], valid : [loss = 0.459, top1 = 86.50%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10        train : [loss = 0.122, top1 = 96.23%], test  : [loss = 0.340, top1 = 89.34%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.65 ms.
cifar100       train : [loss = 0.735, top1 = 79.40%], valid : [loss = 1.278, top1 = 64.46%], test : [loss = 1.261, top1 = 64.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 36.98%], valid : [loss = 2.580, top1 = 35.32%], test : [loss = 2.597, top1 = 34.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.26%], valid : [loss = 0.849, top1 = 70.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6765/15625) 006765-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.572, top1 = 89.15%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.373, top1 = 92.57%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.17 ms.
cifar100       train : [loss = 0.039, top1 = 99.58%], valid : [loss = 1.470, top1 = 69.47%], test : [loss = 1.499, top1 = 69.13%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 1.621, top1 = 56.45%], valid : [loss = 2.397, top1 = 41.02%], test : [loss = 2.394, top1 = 41.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.24%], valid : [loss = 0.696, top1 = 76.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6766/15625) 006766-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 88.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.322, top1 = 91.32%], valid : [loss = 1.249, top1 = 67.49%], test : [loss = 1.251, top1 = 68.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.75%], valid : [loss = 2.312, top1 = 40.08%], test : [loss = 2.328, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6767/15625) 006767-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.40%], valid : [loss = 0.460, top1 = 86.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.154, top1 = 94.98%], test  : [loss = 0.340, top1 = 88.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.22 ms.
cifar100       train : [loss = 1.008, top1 = 71.38%], valid : [loss = 1.359, top1 = 62.08%], test : [loss = 1.351, top1 = 62.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.72%], valid : [loss = 2.706, top1 = 32.41%], test : [loss = 2.722, top1 = 31.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6768/15625) 006768-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.526, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.368, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.269, top1 = 92.76%], valid : [loss = 1.415, top1 = 66.26%], test : [loss = 1.411, top1 = 66.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.86%], valid : [loss = 2.417, top1 = 39.07%], test : [loss = 2.445, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.26%], valid : [loss = 0.586, top1 = 80.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6769/15625) 006769-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.615, top1 = 85.36%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=15.22 ms.
cifar10        train : [loss = 0.073, top1 = 97.75%], test  : [loss = 0.411, top1 = 88.66%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=15.07 ms.
cifar100       train : [loss = 0.715, top1 = 79.24%], valid : [loss = 1.378, top1 = 62.88%], test : [loss = 1.363, top1 = 63.97%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 35.99%], valid : [loss = 2.659, top1 = 33.82%], test : [loss = 2.700, top1 = 33.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6770/15625) 006770-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.258, top1 = 91.11%], valid : [loss = 0.530, top1 = 83.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.83 ms.
cifar10        train : [loss = 0.242, top1 = 91.75%], test  : [loss = 0.424, top1 = 86.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 1.474, top1 = 58.66%], valid : [loss = 1.736, top1 = 52.97%], test : [loss = 1.726, top1 = 53.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.852, top1 = 29.55%], valid : [loss = 2.882, top1 = 29.47%], test : [loss = 2.919, top1 = 27.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.985, top1 = 64.73%], valid : [loss = 1.034, top1 = 63.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6771/15625) 006771-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.495, top1 = 90.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.347, top1 = 92.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.18 ms.
cifar100       train : [loss = 0.149, top1 = 96.61%], valid : [loss = 1.371, top1 = 67.73%], test : [loss = 1.368, top1 = 68.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.797, top1 = 52.16%], valid : [loss = 2.232, top1 = 43.08%], test : [loss = 2.229, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.27%], valid : [loss = 0.764, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6772/15625) 006772-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.55%], valid : [loss = 0.471, top1 = 86.18%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.98 ms.
cifar10        train : [loss = 0.123, top1 = 96.16%], test  : [loss = 0.347, top1 = 89.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.93 ms.
cifar100       train : [loss = 0.751, top1 = 78.98%], valid : [loss = 1.256, top1 = 64.89%], test : [loss = 1.259, top1 = 65.44%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.92%], valid : [loss = 2.606, top1 = 34.00%], test : [loss = 2.608, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.80%], valid : [loss = 0.890, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6773/15625) 006773-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.532, top1 = 88.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.345, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.290, top1 = 92.01%], valid : [loss = 1.323, top1 = 67.69%], test : [loss = 1.319, top1 = 67.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 44.04%], valid : [loss = 2.458, top1 = 38.42%], test : [loss = 2.439, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.28%], valid : [loss = 0.900, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6774/15625) 006774-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.44%], valid : [loss = 0.722, top1 = 76.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.437, top1 = 84.72%], test  : [loss = 0.572, top1 = 80.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.86 ms.
cifar100       train : [loss = 1.819, top1 = 50.50%], valid : [loss = 2.016, top1 = 46.76%], test : [loss = 2.001, top1 = 46.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.66 ms.
ImageNet16-120 train : [loss = 3.447, top1 = 18.75%], valid : [loss = 3.443, top1 = 19.09%], test : [loss = 3.470, top1 = 17.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.235, top1 = 55.19%], valid : [loss = 1.277, top1 = 53.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6775/15625) 006775-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.62%], valid : [loss = 0.494, top1 = 84.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.76 ms.
cifar10        train : [loss = 0.214, top1 = 92.77%], test  : [loss = 0.382, top1 = 87.42%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.84 ms.
cifar100       train : [loss = 1.247, top1 = 64.77%], valid : [loss = 1.532, top1 = 57.14%], test : [loss = 1.510, top1 = 57.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 3.518, top1 = 17.33%], valid : [loss = 3.490, top1 = 17.50%], test : [loss = 3.516, top1 = 17.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6776/15625) 006776-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.610, top1 = 86.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.416, top1 = 89.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.90 ms.
cifar100       train : [loss = 0.500, top1 = 85.58%], valid : [loss = 1.373, top1 = 65.24%], test : [loss = 1.393, top1 = 65.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.49%], valid : [loss = 2.563, top1 = 35.70%], test : [loss = 2.588, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.84%], valid : [loss = 0.863, top1 = 69.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6777/15625) 006777-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.21%], valid : [loss = 0.481, top1 = 84.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.01 ms.
cifar10        train : [loss = 0.243, top1 = 91.83%], test  : [loss = 0.406, top1 = 86.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.25 ms.
cifar100       train : [loss = 1.340, top1 = 62.61%], valid : [loss = 1.604, top1 = 55.42%], test : [loss = 1.579, top1 = 55.89%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 3.397, top1 = 19.49%], valid : [loss = 3.590, top1 = 17.00%], test : [loss = 3.604, top1 = 16.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6778/15625) 006778-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.10%], valid : [loss = 0.680, top1 = 77.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10        train : [loss = 0.554, top1 = 80.82%], test  : [loss = 0.613, top1 = 79.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.29 ms.
cifar100       train : [loss = 1.781, top1 = 51.91%], valid : [loss = 1.911, top1 = 48.92%], test : [loss = 1.962, top1 = 48.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 3.413, top1 = 19.63%], valid : [loss = 3.388, top1 = 20.80%], test : [loss = 3.444, top1 = 19.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.377, top1 = 50.11%], valid : [loss = 1.410, top1 = 49.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6779/15625) 006779-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.559, top1 = 87.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.380, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.14 ms.
cifar100       train : [loss = 0.382, top1 = 89.26%], valid : [loss = 1.401, top1 = 64.95%], test : [loss = 1.381, top1 = 65.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.247, top1 = 42.03%], valid : [loss = 2.465, top1 = 37.67%], test : [loss = 2.468, top1 = 37.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.44%], valid : [loss = 0.723, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6780/15625) 006780-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.586, top1 = 87.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.401, top1 = 91.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.236, top1 = 94.04%], valid : [loss = 1.457, top1 = 65.80%], test : [loss = 1.507, top1 = 65.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.26%], valid : [loss = 2.474, top1 = 38.97%], test : [loss = 2.504, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.79%], valid : [loss = 0.736, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6781/15625) 006781-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.86%], valid : [loss = 0.540, top1 = 86.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.054, top1 = 98.53%], test  : [loss = 0.371, top1 = 89.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.77 ms.
cifar100       train : [loss = 0.511, top1 = 85.47%], valid : [loss = 1.291, top1 = 66.14%], test : [loss = 1.295, top1 = 66.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.258, top1 = 41.75%], valid : [loss = 2.429, top1 = 38.73%], test : [loss = 2.448, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.67%], valid : [loss = 0.814, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6782/15625) 006782-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.97%], valid : [loss = 0.478, top1 = 84.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.82 ms.
cifar10        train : [loss = 0.298, top1 = 90.11%], test  : [loss = 0.387, top1 = 86.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.83 ms.
cifar100       train : [loss = 1.312, top1 = 63.58%], valid : [loss = 1.528, top1 = 57.64%], test : [loss = 1.508, top1 = 58.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.64%], valid : [loss = 2.901, top1 = 29.43%], test : [loss = 2.959, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6783/15625) 006783-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.24%], valid : [loss = 0.470, top1 = 84.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.297, top1 = 90.12%], test  : [loss = 0.397, top1 = 86.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.01 ms.
cifar100       train : [loss = 1.334, top1 = 63.14%], valid : [loss = 1.554, top1 = 57.76%], test : [loss = 1.512, top1 = 58.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.937, top1 = 28.38%], valid : [loss = 2.896, top1 = 29.07%], test : [loss = 2.962, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.32%], valid : [loss = 0.760, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6784/15625) 006784-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.03%], valid : [loss = 0.593, top1 = 86.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.32 ms.
cifar10        train : [loss = 0.072, top1 = 97.65%], test  : [loss = 0.370, top1 = 89.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.09 ms.
cifar100       train : [loss = 0.686, top1 = 79.75%], valid : [loss = 1.326, top1 = 64.34%], test : [loss = 1.313, top1 = 64.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.70%], valid : [loss = 2.463, top1 = 36.63%], test : [loss = 2.503, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6785/15625) 006785-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.15%], valid : [loss = 0.939, top1 = 67.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.681, top1 = 76.08%], test  : [loss = 0.768, top1 = 73.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.965, top1 = 47.80%], valid : [loss = 2.145, top1 = 44.52%], test : [loss = 2.156, top1 = 45.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 3.652, top1 = 15.76%], valid : [loss = 3.672, top1 = 16.03%], test : [loss = 3.710, top1 = 15.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.403, top1 = 48.96%], valid : [loss = 1.428, top1 = 48.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6786/15625) 006786-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.05%], valid : [loss = 0.561, top1 = 86.75%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.95 ms.
cifar10        train : [loss = 0.069, top1 = 97.68%], test  : [loss = 0.365, top1 = 89.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.74 ms.
cifar100       train : [loss = 0.626, top1 = 81.38%], valid : [loss = 1.329, top1 = 63.96%], test : [loss = 1.309, top1 = 64.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.64 ms.
ImageNet16-120 train : [loss = 2.372, top1 = 39.28%], valid : [loss = 2.527, top1 = 36.90%], test : [loss = 2.547, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.48%], valid : [loss = 0.935, top1 = 67.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6787/15625) 006787-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.423, top1 = 90.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.270, top1 = 93.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.03 ms.
cifar100       train : [loss = 0.167, top1 = 96.26%], valid : [loss = 1.242, top1 = 70.12%], test : [loss = 1.222, top1 = 70.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 1.734, top1 = 53.76%], valid : [loss = 2.201, top1 = 43.97%], test : [loss = 2.210, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.27%], valid : [loss = 0.490, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6788/15625) 006788-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.12%], valid : [loss = 0.640, top1 = 78.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10        train : [loss = 0.505, top1 = 82.48%], test  : [loss = 0.581, top1 = 80.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.48 ms.
cifar100       train : [loss = 1.678, top1 = 54.19%], valid : [loss = 1.847, top1 = 50.84%], test : [loss = 1.866, top1 = 50.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.52 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.26%], valid : [loss = 3.311, top1 = 21.73%], test : [loss = 3.354, top1 = 21.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6789/15625) 006789-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.543, top1 = 88.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.379, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.89 ms.
cifar100       train : [loss = 0.132, top1 = 97.41%], valid : [loss = 1.461, top1 = 66.72%], test : [loss = 1.432, top1 = 67.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.56%], valid : [loss = 2.381, top1 = 40.87%], test : [loss = 2.448, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.62%], valid : [loss = 0.707, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6790/15625) 006790-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.518, top1 = 82.05%], valid : [loss = 0.843, top1 = 72.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.553, top1 = 80.55%], test  : [loss = 0.713, top1 = 75.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.45 ms.
cifar100       train : [loss = 1.753, top1 = 52.57%], valid : [loss = 2.000, top1 = 47.92%], test : [loss = 2.044, top1 = 46.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.88%], valid : [loss = 3.650, top1 = 16.00%], test : [loss = 3.653, top1 = 16.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6791/15625) 006791-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.094, top1 = 96.90%], valid : [loss = 0.602, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10        train : [loss = 0.093, top1 = 96.87%], test  : [loss = 0.417, top1 = 88.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.75 ms.
cifar100       train : [loss = 0.679, top1 = 79.89%], valid : [loss = 1.506, top1 = 60.52%], test : [loss = 1.487, top1 = 61.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 21.79%], valid : [loss = 3.250, top1 = 21.00%], test : [loss = 3.254, top1 = 21.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6792/15625) 006792-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.291, top1 = 89.82%], valid : [loss = 0.564, top1 = 82.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.35 ms.
cifar10        train : [loss = 0.256, top1 = 91.21%], test  : [loss = 0.415, top1 = 86.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.18 ms.
cifar100       train : [loss = 1.556, top1 = 56.49%], valid : [loss = 1.797, top1 = 52.04%], test : [loss = 1.769, top1 = 52.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.31%], valid : [loss = 2.962, top1 = 26.83%], test : [loss = 2.998, top1 = 25.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6793/15625) 006793-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.524, top1 = 89.15%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.83 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.347, top1 = 92.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.94 ms.
cifar100       train : [loss = 0.239, top1 = 93.70%], valid : [loss = 1.333, top1 = 67.70%], test : [loss = 1.324, top1 = 68.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 2.165, top1 = 43.83%], valid : [loss = 2.420, top1 = 38.30%], test : [loss = 2.430, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.47%], valid : [loss = 0.928, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6794/15625) 006794-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10-valid  train : [loss = 1.161, top1 = 58.31%], valid : [loss = 1.210, top1 = 56.95%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.06 ms.
cifar10        train : [loss = 1.133, top1 = 59.65%], test  : [loss = 1.137, top1 = 59.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.10 ms.
cifar100       train : [loss = 2.655, top1 = 33.18%], valid : [loss = 2.725, top1 = 32.62%], test : [loss = 2.708, top1 = 32.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.49 ms.
ImageNet16-120 train : [loss = 3.843, top1 = 12.71%], valid : [loss = 3.832, top1 = 13.80%], test : [loss = 3.854, top1 = 12.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.681, top1 = 36.72%], valid : [loss = 1.715, top1 = 34.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6795/15625) 006795-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.22%], valid : [loss = 0.484, top1 = 84.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.247, top1 = 91.70%], test  : [loss = 0.398, top1 = 86.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 1.301, top1 = 63.39%], valid : [loss = 1.588, top1 = 55.76%], test : [loss = 1.553, top1 = 56.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.952, top1 = 27.33%], valid : [loss = 2.941, top1 = 26.90%], test : [loss = 2.966, top1 = 25.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.63%], valid : [loss = 1.028, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6796/15625) 006796-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.92%], valid : [loss = 0.476, top1 = 84.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.305, top1 = 89.66%], test  : [loss = 0.406, top1 = 86.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.31 ms.
cifar100       train : [loss = 1.337, top1 = 62.82%], valid : [loss = 1.533, top1 = 57.50%], test : [loss = 1.518, top1 = 58.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.47%], valid : [loss = 2.917, top1 = 29.17%], test : [loss = 2.962, top1 = 29.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6797/15625) 006797-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.525, top1 = 89.70%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.46 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.314, top1 = 93.28%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.61 ms.
cifar100       train : [loss = 0.068, top1 = 98.93%], valid : [loss = 1.347, top1 = 69.74%], test : [loss = 1.346, top1 = 69.54%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.32 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.06%], valid : [loss = 2.277, top1 = 43.03%], test : [loss = 2.278, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.31%], valid : [loss = 0.639, top1 = 77.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6798/15625) 006798-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.55%], valid : [loss = 0.454, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.165, top1 = 94.63%], test  : [loss = 0.355, top1 = 88.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.82 ms.
cifar100       train : [loss = 1.006, top1 = 71.44%], valid : [loss = 1.356, top1 = 62.48%], test : [loss = 1.340, top1 = 62.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.77%], valid : [loss = 2.662, top1 = 33.77%], test : [loss = 2.703, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6799/15625) 006799-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.578, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.381, top1 = 91.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.16 ms.
cifar100       train : [loss = 0.370, top1 = 89.66%], valid : [loss = 1.385, top1 = 65.39%], test : [loss = 1.403, top1 = 65.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.07%], valid : [loss = 2.503, top1 = 36.80%], test : [loss = 2.533, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.80%], valid : [loss = 0.772, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6800/15625) 006800-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.40%], valid : [loss = 0.462, top1 = 86.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.151, top1 = 95.18%], test  : [loss = 0.339, top1 = 88.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.68 ms.
cifar100       train : [loss = 0.987, top1 = 72.03%], valid : [loss = 1.359, top1 = 61.80%], test : [loss = 1.349, top1 = 62.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.27%], valid : [loss = 2.655, top1 = 34.23%], test : [loss = 2.699, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.32%], valid : [loss = 0.770, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6801/15625) 006801-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.519, top1 = 88.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.366, top1 = 90.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.67 ms.
cifar100       train : [loss = 0.466, top1 = 86.37%], valid : [loss = 1.372, top1 = 65.37%], test : [loss = 1.384, top1 = 65.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.24%], valid : [loss = 2.510, top1 = 36.82%], test : [loss = 2.556, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.44%], valid : [loss = 0.680, top1 = 77.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6802/15625) 006802-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.536, top1 = 89.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.45 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.324, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.34 ms.
cifar100       train : [loss = 0.105, top1 = 98.02%], valid : [loss = 1.305, top1 = 69.94%], test : [loss = 1.313, top1 = 70.34%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.65 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.79%], valid : [loss = 2.166, top1 = 44.97%], test : [loss = 2.173, top1 = 44.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.90%], valid : [loss = 0.670, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6803/15625) 006803-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.449, top1 = 89.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.317, top1 = 91.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.24 ms.
cifar100       train : [loss = 0.338, top1 = 90.81%], valid : [loss = 1.324, top1 = 66.84%], test : [loss = 1.323, top1 = 66.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.18%], valid : [loss = 2.355, top1 = 40.17%], test : [loss = 2.402, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6804/15625) 006804-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.436, top1 = 90.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.272, top1 = 93.92%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.42 ms.
cifar100       train : [loss = 0.060, top1 = 99.22%], valid : [loss = 1.374, top1 = 70.32%], test : [loss = 1.326, top1 = 71.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.13 ms.
ImageNet16-120 train : [loss = 1.507, top1 = 59.19%], valid : [loss = 2.265, top1 = 43.50%], test : [loss = 2.271, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.403, top1 = 86.16%], valid : [loss = 0.530, top1 = 82.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6805/15625) 006805-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.492, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.310, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.329, top1 = 91.05%], valid : [loss = 1.240, top1 = 67.47%], test : [loss = 1.250, top1 = 67.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.63%], valid : [loss = 2.314, top1 = 40.54%], test : [loss = 2.337, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6806/15625) 006806-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.33%], valid : [loss = 0.655, top1 = 78.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.67 ms.
cifar10        train : [loss = 0.502, top1 = 82.60%], test  : [loss = 0.592, top1 = 79.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.90 ms.
cifar100       train : [loss = 1.737, top1 = 53.03%], valid : [loss = 1.900, top1 = 49.90%], test : [loss = 1.919, top1 = 49.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 3.343, top1 = 20.89%], valid : [loss = 3.334, top1 = 21.97%], test : [loss = 3.375, top1 = 20.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.306, top1 = 52.71%], valid : [loss = 1.331, top1 = 52.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6807/15625) 006807-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.61%], valid : [loss = 0.618, top1 = 79.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.254, top1 = 91.38%], test  : [loss = 0.412, top1 = 86.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.68 ms.
cifar100       train : [loss = 1.541, top1 = 56.78%], valid : [loss = 1.796, top1 = 51.56%], test : [loss = 1.765, top1 = 52.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.01 ms.
ImageNet16-120 train : [loss = 2.938, top1 = 27.80%], valid : [loss = 2.946, top1 = 28.67%], test : [loss = 2.986, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.019, top1 = 63.27%], valid : [loss = 1.073, top1 = 61.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6808/15625) 006808-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.593, top1 = 85.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10        train : [loss = 0.066, top1 = 98.06%], test  : [loss = 0.401, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 0.701, top1 = 79.66%], valid : [loss = 1.395, top1 = 62.99%], test : [loss = 1.363, top1 = 63.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.26%], valid : [loss = 2.627, top1 = 34.48%], test : [loss = 2.676, top1 = 33.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.00%], valid : [loss = 0.772, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6809/15625) 006809-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.536, top1 = 88.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.354, top1 = 91.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.59 ms.
cifar100       train : [loss = 0.155, top1 = 96.21%], valid : [loss = 1.387, top1 = 68.20%], test : [loss = 1.394, top1 = 67.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.151, top1 = 44.08%], valid : [loss = 2.410, top1 = 39.30%], test : [loss = 2.406, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.19%], valid : [loss = 0.896, top1 = 68.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6810/15625) 006810-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.92%], valid : [loss = 1.240, top1 = 55.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10        train : [loss = 1.136, top1 = 59.64%], test  : [loss = 1.140, top1 = 59.36%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.91 ms.
cifar100       train : [loss = 2.695, top1 = 32.40%], valid : [loss = 2.759, top1 = 31.44%], test : [loss = 2.745, top1 = 31.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 3.824, top1 = 13.09%], valid : [loss = 3.811, top1 = 13.70%], test : [loss = 3.838, top1 = 13.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.662, top1 = 37.70%], valid : [loss = 1.683, top1 = 35.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6811/15625) 006811-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.443, top1 = 89.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.335, top1 = 91.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.35 ms.
cifar100       train : [loss = 0.204, top1 = 95.22%], valid : [loss = 1.248, top1 = 69.54%], test : [loss = 1.239, top1 = 69.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.59%], valid : [loss = 2.245, top1 = 43.30%], test : [loss = 2.278, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.41%], valid : [loss = 0.519, top1 = 82.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6812/15625) 006812-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.618, top1 = 85.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10        train : [loss = 0.063, top1 = 98.16%], test  : [loss = 0.403, top1 = 88.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.37 ms.
cifar100       train : [loss = 0.721, top1 = 79.09%], valid : [loss = 1.382, top1 = 63.42%], test : [loss = 1.374, top1 = 63.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.86%], valid : [loss = 2.652, top1 = 34.13%], test : [loss = 2.696, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6813/15625) 006813-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.561, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.355, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.09 ms.
cifar100       train : [loss = 0.101, top1 = 98.17%], valid : [loss = 1.481, top1 = 67.68%], test : [loss = 1.473, top1 = 68.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.01%], valid : [loss = 2.433, top1 = 38.73%], test : [loss = 2.498, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.27%], valid : [loss = 0.722, top1 = 75.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6814/15625) 006814-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.22%], valid : [loss = 0.600, top1 = 80.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.79 ms.
cifar10        train : [loss = 0.288, top1 = 90.15%], test  : [loss = 0.444, top1 = 85.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=10.95 ms.
cifar100       train : [loss = 1.543, top1 = 57.02%], valid : [loss = 1.767, top1 = 52.22%], test : [loss = 1.743, top1 = 52.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.964, top1 = 27.41%], valid : [loss = 2.969, top1 = 27.80%], test : [loss = 3.013, top1 = 27.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.004, top1 = 64.20%], valid : [loss = 1.055, top1 = 62.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6815/15625) 006815-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.41%], valid : [loss = 0.478, top1 = 85.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 0.151, top1 = 95.14%], test  : [loss = 0.339, top1 = 89.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.63 ms.
cifar100       train : [loss = 1.005, top1 = 71.55%], valid : [loss = 1.369, top1 = 61.62%], test : [loss = 1.369, top1 = 61.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.78%], valid : [loss = 2.675, top1 = 32.80%], test : [loss = 2.732, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6816/15625) 006816-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.90%], valid : [loss = 0.565, top1 = 87.26%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.38 ms.
cifar10        train : [loss = 0.022, top1 = 99.49%], test  : [loss = 0.417, top1 = 89.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.79 ms.
cifar100       train : [loss = 0.321, top1 = 91.74%], valid : [loss = 1.364, top1 = 66.26%], test : [loss = 1.374, top1 = 66.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.23%], valid : [loss = 2.501, top1 = 37.07%], test : [loss = 2.539, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.84%], valid : [loss = 0.747, top1 = 74.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6817/15625) 006817-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.502, top1 = 88.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10        train : [loss = 0.024, top1 = 99.36%], test  : [loss = 0.362, top1 = 91.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.26 ms.
cifar100       train : [loss = 0.408, top1 = 88.24%], valid : [loss = 1.257, top1 = 67.40%], test : [loss = 1.259, top1 = 67.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.49%], valid : [loss = 2.407, top1 = 39.18%], test : [loss = 2.446, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.12%], valid : [loss = 0.738, top1 = 74.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6818/15625) 006818-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.546, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.67 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.364, top1 = 92.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.67 ms.
cifar100       train : [loss = 0.086, top1 = 98.54%], valid : [loss = 1.536, top1 = 67.18%], test : [loss = 1.513, top1 = 68.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.04%], valid : [loss = 2.420, top1 = 38.87%], test : [loss = 2.432, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 76.72%], valid : [loss = 0.741, top1 = 74.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6819/15625) 006819-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.71%], valid : [loss = 0.663, top1 = 83.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.58 ms.
cifar10        train : [loss = 0.081, top1 = 97.44%], test  : [loss = 0.421, top1 = 88.13%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.89 ms.
cifar100       train : [loss = 0.786, top1 = 76.85%], valid : [loss = 1.416, top1 = 62.56%], test : [loss = 1.380, top1 = 62.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.06%], valid : [loss = 2.776, top1 = 31.50%], test : [loss = 2.772, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6820/15625) 006820-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.541, top1 = 89.64%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.07 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.351, top1 = 92.96%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.08 ms.
cifar100       train : [loss = 0.112, top1 = 97.69%], valid : [loss = 1.320, top1 = 69.18%], test : [loss = 1.331, top1 = 69.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.82%], valid : [loss = 2.158, top1 = 43.77%], test : [loss = 2.186, top1 = 43.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.46%], valid : [loss = 0.634, top1 = 78.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6821/15625) 006821-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.490, top1 = 89.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.331, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.18 ms.
cifar100       train : [loss = 0.171, top1 = 95.92%], valid : [loss = 1.362, top1 = 67.98%], test : [loss = 1.389, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.29 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.51%], valid : [loss = 2.297, top1 = 41.33%], test : [loss = 2.339, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.85%], valid : [loss = 0.690, top1 = 76.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6822/15625) 006822-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.03 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.04%], valid : [loss = 0.472, top1 = 84.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10        train : [loss = 0.302, top1 = 89.94%], test  : [loss = 0.401, top1 = 86.43%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.31 ms.
cifar100       train : [loss = 1.333, top1 = 63.06%], valid : [loss = 1.536, top1 = 57.88%], test : [loss = 1.515, top1 = 58.43%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.08 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.70%], valid : [loss = 2.901, top1 = 30.14%], test : [loss = 2.957, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6823/15625) 006823-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.59%], valid : [loss = 0.519, top1 = 83.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.244, top1 = 91.66%], test  : [loss = 0.402, top1 = 86.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 1.375, top1 = 61.56%], valid : [loss = 1.650, top1 = 55.39%], test : [loss = 1.625, top1 = 55.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.842, top1 = 29.89%], valid : [loss = 2.847, top1 = 29.86%], test : [loss = 2.902, top1 = 28.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.57%], valid : [loss = 1.039, top1 = 63.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6824/15625) 006824-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.46%], valid : [loss = 0.616, top1 = 86.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.398, top1 = 90.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.17 ms.
cifar100       train : [loss = 0.526, top1 = 84.71%], valid : [loss = 1.415, top1 = 63.74%], test : [loss = 1.411, top1 = 63.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.78 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 39.06%], valid : [loss = 2.594, top1 = 34.07%], test : [loss = 2.599, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.68%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6825/15625) 006825-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.04%], valid : [loss = 0.527, top1 = 87.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.073, top1 = 97.67%], test  : [loss = 0.351, top1 = 89.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.53 ms.
cifar100       train : [loss = 0.721, top1 = 78.78%], valid : [loss = 1.374, top1 = 63.60%], test : [loss = 1.353, top1 = 64.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.86 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 35.78%], valid : [loss = 2.632, top1 = 34.37%], test : [loss = 2.683, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.93%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6826/15625) 006826-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6827/15625) 006827-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.042, top1 = 99.20%], valid : [loss = 0.476, top1 = 87.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10        train : [loss = 0.067, top1 = 98.16%], test  : [loss = 0.338, top1 = 90.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.05 ms.
cifar100       train : [loss = 0.605, top1 = 82.45%], valid : [loss = 1.273, top1 = 66.02%], test : [loss = 1.272, top1 = 66.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 43.88%], valid : [loss = 2.331, top1 = 40.87%], test : [loss = 2.416, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.10%], valid : [loss = 0.841, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6828/15625) 006828-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.55%], valid : [loss = 0.665, top1 = 77.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.506, top1 = 82.52%], test  : [loss = 0.587, top1 = 80.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.01 ms.
cifar100       train : [loss = 1.678, top1 = 54.40%], valid : [loss = 1.844, top1 = 50.71%], test : [loss = 1.852, top1 = 51.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.23%], valid : [loss = 3.312, top1 = 21.33%], test : [loss = 3.335, top1 = 20.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6829/15625) 006829-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.461, top1 = 89.30%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.310, top1 = 92.20%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=22.75 ms.
cifar100       train : [loss = 0.337, top1 = 90.80%], valid : [loss = 1.249, top1 = 66.58%], test : [loss = 1.233, top1 = 68.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.61%], valid : [loss = 2.304, top1 = 40.50%], test : [loss = 2.337, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.66%], valid : [loss = 0.585, top1 = 80.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6830/15625) 006830-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 91.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.56 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.283, top1 = 93.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.67 ms.
cifar100       train : [loss = 0.065, top1 = 99.13%], valid : [loss = 1.355, top1 = 69.98%], test : [loss = 1.323, top1 = 71.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 1.533, top1 = 58.64%], valid : [loss = 2.228, top1 = 43.57%], test : [loss = 2.272, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6831/15625) 006831-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.576, top1 = 87.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.016, top1 = 99.54%], test  : [loss = 0.373, top1 = 91.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.201, top1 = 94.56%], valid : [loss = 1.379, top1 = 67.62%], test : [loss = 1.412, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.23%], valid : [loss = 2.732, top1 = 30.77%], test : [loss = 2.778, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.54%], valid : [loss = 0.925, top1 = 67.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6832/15625) 006832-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.589, top1 = 86.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.030, top1 = 99.21%], test  : [loss = 0.389, top1 = 90.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.497, top1 = 85.47%], valid : [loss = 1.406, top1 = 64.75%], test : [loss = 1.396, top1 = 64.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.12%], valid : [loss = 2.563, top1 = 36.10%], test : [loss = 2.578, top1 = 35.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.29%], valid : [loss = 0.845, top1 = 70.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6833/15625) 006833-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.565, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.380, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.25 ms.
cifar100       train : [loss = 0.168, top1 = 96.34%], valid : [loss = 1.451, top1 = 66.91%], test : [loss = 1.420, top1 = 67.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.22%], valid : [loss = 2.466, top1 = 38.00%], test : [loss = 2.455, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 78.93%], valid : [loss = 0.691, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6834/15625) 006834-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.576, top1 = 86.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.356, top1 = 91.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.96 ms.
cifar100       train : [loss = 0.485, top1 = 86.14%], valid : [loss = 1.320, top1 = 65.34%], test : [loss = 1.290, top1 = 65.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.45%], valid : [loss = 2.616, top1 = 33.77%], test : [loss = 2.652, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.61%], valid : [loss = 0.972, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6835/15625) 006835-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.490, top1 = 89.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.07 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 92.91%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.23 ms.
cifar100       train : [loss = 0.132, top1 = 97.46%], valid : [loss = 1.304, top1 = 68.94%], test : [loss = 1.291, top1 = 69.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.37%], valid : [loss = 2.319, top1 = 39.93%], test : [loss = 2.312, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.79%], valid : [loss = 0.645, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6836/15625) 006836-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.32%], valid : [loss = 0.569, top1 = 86.65%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10        train : [loss = 0.058, top1 = 98.16%], test  : [loss = 0.347, top1 = 90.60%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.89 ms.
cifar100       train : [loss = 0.626, top1 = 81.68%], valid : [loss = 1.319, top1 = 65.14%], test : [loss = 1.314, top1 = 65.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.48%], valid : [loss = 2.505, top1 = 36.30%], test : [loss = 2.538, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.84%], valid : [loss = 0.775, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6837/15625) 006837-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.79 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.75%], valid : [loss = 0.860, top1 = 71.57%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10        train : [loss = 0.556, top1 = 80.60%], test  : [loss = 0.705, top1 = 75.85%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.43 ms.
cifar100       train : [loss = 1.788, top1 = 51.68%], valid : [loss = 2.034, top1 = 47.06%], test : [loss = 2.065, top1 = 46.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.67%], valid : [loss = 3.656, top1 = 16.07%], test : [loss = 3.691, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6838/15625) 006838-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.25 ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.17%], valid : [loss = 0.862, top1 = 71.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.557, top1 = 80.44%], test  : [loss = 0.711, top1 = 75.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 1.790, top1 = 51.68%], valid : [loss = 2.045, top1 = 46.90%], test : [loss = 2.076, top1 = 46.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.83%], valid : [loss = 3.632, top1 = 17.20%], test : [loss = 3.651, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6839/15625) 006839-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.135, top1 = 95.52%], valid : [loss = 0.754, top1 = 80.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10        train : [loss = 0.168, top1 = 94.21%], test  : [loss = 0.491, top1 = 85.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.874, top1 = 74.47%], valid : [loss = 1.638, top1 = 57.66%], test : [loss = 1.660, top1 = 57.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 3.344, top1 = 19.91%], valid : [loss = 3.357, top1 = 19.67%], test : [loss = 3.356, top1 = 19.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.215, top1 = 55.70%], valid : [loss = 1.252, top1 = 54.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6840/15625) 006840-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.534, top1 = 89.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.334, top1 = 92.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.79 ms.
cifar100       train : [loss = 0.072, top1 = 98.87%], valid : [loss = 1.445, top1 = 69.10%], test : [loss = 1.505, top1 = 67.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.798, top1 = 52.30%], valid : [loss = 2.364, top1 = 40.23%], test : [loss = 2.391, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.577, top1 = 79.75%], valid : [loss = 0.691, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6841/15625) 006841-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.566, top1 = 87.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.343, top1 = 91.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.303, top1 = 91.84%], valid : [loss = 1.303, top1 = 66.88%], test : [loss = 1.298, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.87%], valid : [loss = 2.427, top1 = 38.30%], test : [loss = 2.412, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.859, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6842/15625) 006842-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.14%], valid : [loss = 0.657, top1 = 84.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.055, top1 = 98.26%], test  : [loss = 0.397, top1 = 89.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.95 ms.
cifar100       train : [loss = 0.601, top1 = 82.40%], valid : [loss = 1.407, top1 = 62.80%], test : [loss = 1.403, top1 = 64.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.472, top1 = 37.27%], valid : [loss = 2.617, top1 = 32.87%], test : [loss = 2.677, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.69%], valid : [loss = 0.875, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6843/15625) 006843-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.99%], valid : [loss = 0.460, top1 = 86.33%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10        train : [loss = 0.138, top1 = 95.57%], test  : [loss = 0.339, top1 = 89.20%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.74 ms.
cifar100       train : [loss = 0.902, top1 = 74.49%], valid : [loss = 1.302, top1 = 63.34%], test : [loss = 1.287, top1 = 64.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.67%], valid : [loss = 2.632, top1 = 34.03%], test : [loss = 2.646, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.74%], valid : [loss = 0.826, top1 = 70.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6844/15625) 006844-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.88%], valid : [loss = 0.857, top1 = 70.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10        train : [loss = 0.658, top1 = 76.93%], test  : [loss = 0.751, top1 = 74.18%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.78 ms.
cifar100       train : [loss = 1.953, top1 = 48.06%], valid : [loss = 2.136, top1 = 44.46%], test : [loss = 2.143, top1 = 45.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 3.645, top1 = 15.75%], valid : [loss = 3.681, top1 = 16.13%], test : [loss = 3.693, top1 = 14.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6845/15625) 006845-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.501, top1 = 88.94%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.05 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.336, top1 = 91.81%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.35 ms.
cifar100       train : [loss = 0.362, top1 = 90.09%], valid : [loss = 1.268, top1 = 67.28%], test : [loss = 1.270, top1 = 67.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.13%], valid : [loss = 2.382, top1 = 38.70%], test : [loss = 2.408, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.64%], valid : [loss = 0.677, top1 = 76.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6846/15625) 006846-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.64 ms.
cifar10-valid  train : [loss = 1.836, top1 = 33.54%], valid : [loss = 1.853, top1 = 32.76%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.74 ms.
cifar10        train : [loss = 1.333, top1 = 51.65%], test  : [loss = 1.322, top1 = 51.87%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.47 ms.
cifar100       train : [loss = 3.845, top1 = 11.07%], valid : [loss = 3.881, top1 = 10.27%], test : [loss = 3.875, top1 = 10.99%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.47 ms.
ImageNet16-120 train : [loss = 3.872, top1 = 12.33%], valid : [loss = 3.854, top1 = 13.10%], test : [loss = 3.870, top1 = 12.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6847/15625) 006847-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.33%], valid : [loss = 0.554, top1 = 87.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10        train : [loss = 0.044, top1 = 98.60%], test  : [loss = 0.368, top1 = 90.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 0.484, top1 = 85.59%], valid : [loss = 1.341, top1 = 65.38%], test : [loss = 1.320, top1 = 65.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.757, top1 = 30.69%], valid : [loss = 2.827, top1 = 29.67%], test : [loss = 2.818, top1 = 29.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.86%], valid : [loss = 1.008, top1 = 64.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6848/15625) 006848-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.73%], valid : [loss = 0.456, top1 = 86.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10        train : [loss = 0.151, top1 = 95.13%], test  : [loss = 0.343, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.69 ms.
cifar100       train : [loss = 0.980, top1 = 72.09%], valid : [loss = 1.344, top1 = 62.37%], test : [loss = 1.343, top1 = 62.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.06%], valid : [loss = 2.678, top1 = 33.48%], test : [loss = 2.691, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6849/15625) 006849-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.548, top1 = 88.29%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.98 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.348, top1 = 91.77%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.55 ms.
cifar100       train : [loss = 0.374, top1 = 89.42%], valid : [loss = 1.354, top1 = 65.60%], test : [loss = 1.357, top1 = 65.62%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.96 ms.
ImageNet16-120 train : [loss = 2.006, top1 = 47.32%], valid : [loss = 2.259, top1 = 41.90%], test : [loss = 2.285, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.18%], valid : [loss = 0.814, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6850/15625) 006850-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.538, top1 = 88.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.027, top1 = 99.23%], test  : [loss = 0.351, top1 = 91.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.422, top1 = 87.79%], valid : [loss = 1.253, top1 = 67.40%], test : [loss = 1.250, top1 = 67.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.29%], valid : [loss = 2.368, top1 = 39.90%], test : [loss = 2.392, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6851/15625) 006851-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.486, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.303, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.81 ms.
cifar100       train : [loss = 0.318, top1 = 91.45%], valid : [loss = 1.257, top1 = 67.64%], test : [loss = 1.273, top1 = 67.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.81%], valid : [loss = 2.324, top1 = 40.69%], test : [loss = 2.349, top1 = 39.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.22%], valid : [loss = 0.615, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6852/15625) 006852-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.90%], valid : [loss = 0.606, top1 = 86.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.18 ms.
cifar10        train : [loss = 0.028, top1 = 99.32%], test  : [loss = 0.436, top1 = 89.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.02 ms.
cifar100       train : [loss = 0.379, top1 = 89.95%], valid : [loss = 1.421, top1 = 65.34%], test : [loss = 1.439, top1 = 64.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.12 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.40%], valid : [loss = 2.581, top1 = 35.80%], test : [loss = 2.599, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.24%], valid : [loss = 0.772, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6853/15625) 006853-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.48%], valid : [loss = 0.600, top1 = 87.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.74 ms.
cifar10        train : [loss = 0.019, top1 = 99.45%], test  : [loss = 0.397, top1 = 91.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.67 ms.
cifar100       train : [loss = 0.413, top1 = 88.20%], valid : [loss = 1.465, top1 = 62.98%], test : [loss = 1.457, top1 = 63.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 3.163, top1 = 22.32%], valid : [loss = 3.173, top1 = 23.07%], test : [loss = 3.197, top1 = 21.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.181, top1 = 56.83%], valid : [loss = 1.196, top1 = 56.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6854/15625) 006854-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.78%], valid : [loss = 0.409, top1 = 88.64%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.19 ms.
cifar10        train : [loss = 0.038, top1 = 99.19%], test  : [loss = 0.303, top1 = 91.04%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.20 ms.
cifar100       train : [loss = 0.352, top1 = 91.50%], valid : [loss = 1.230, top1 = 67.96%], test : [loss = 1.222, top1 = 67.26%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.47%], valid : [loss = 2.370, top1 = 40.10%], test : [loss = 2.375, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.42%], valid : [loss = 0.660, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6855/15625) 006855-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.528, top1 = 89.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.62 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.318, top1 = 93.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.88 ms.
cifar100       train : [loss = 0.135, top1 = 97.27%], valid : [loss = 1.278, top1 = 69.50%], test : [loss = 1.310, top1 = 69.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 50.92%], valid : [loss = 2.288, top1 = 41.43%], test : [loss = 2.252, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6856/15625) 006856-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.526, top1 = 88.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.65%], test  : [loss = 0.358, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.21 ms.
cifar100       train : [loss = 0.298, top1 = 91.80%], valid : [loss = 1.296, top1 = 67.64%], test : [loss = 1.341, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.07 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.54%], valid : [loss = 2.414, top1 = 38.63%], test : [loss = 2.416, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.28%], valid : [loss = 0.900, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6857/15625) 006857-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.24%], valid : [loss = 0.555, top1 = 86.45%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.73 ms.
cifar10        train : [loss = 0.077, top1 = 97.39%], test  : [loss = 0.389, top1 = 89.68%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.97 ms.
cifar100       train : [loss = 0.757, top1 = 77.63%], valid : [loss = 1.430, top1 = 61.76%], test : [loss = 1.420, top1 = 61.50%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 2.414, top1 = 38.17%], valid : [loss = 2.510, top1 = 35.93%], test : [loss = 2.556, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.55%], valid : [loss = 0.881, top1 = 68.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6858/15625) 006858-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.521, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.347, top1 = 91.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.311, top1 = 91.55%], valid : [loss = 1.249, top1 = 68.02%], test : [loss = 1.306, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.089, top1 = 45.55%], valid : [loss = 2.367, top1 = 40.67%], test : [loss = 2.378, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.63%], valid : [loss = 0.871, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6859/15625) 006859-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.556, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.348, top1 = 91.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.25 ms.
cifar100       train : [loss = 0.463, top1 = 86.63%], valid : [loss = 1.243, top1 = 67.54%], test : [loss = 1.270, top1 = 66.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.42%], valid : [loss = 2.369, top1 = 40.10%], test : [loss = 2.371, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 73.81%], valid : [loss = 0.778, top1 = 72.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6860/15625) 006860-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.08%], valid : [loss = 0.841, top1 = 72.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.43 ms.
cifar10        train : [loss = 0.569, top1 = 80.01%], test  : [loss = 0.724, top1 = 74.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.91 ms.
cifar100       train : [loss = 1.775, top1 = 52.25%], valid : [loss = 2.052, top1 = 47.00%], test : [loss = 2.068, top1 = 47.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.79%], valid : [loss = 3.649, top1 = 16.70%], test : [loss = 3.667, top1 = 15.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6861/15625) 006861-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.82%], valid : [loss = 0.509, top1 = 87.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.074, top1 = 97.74%], test  : [loss = 0.364, top1 = 89.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.88 ms.
cifar100       train : [loss = 0.714, top1 = 78.91%], valid : [loss = 1.340, top1 = 64.48%], test : [loss = 1.356, top1 = 63.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.01%], valid : [loss = 2.644, top1 = 35.40%], test : [loss = 2.665, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.68%], valid : [loss = 0.685, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6862/15625) 006862-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.527, top1 = 88.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.336, top1 = 92.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.227, top1 = 94.09%], valid : [loss = 1.242, top1 = 69.28%], test : [loss = 1.281, top1 = 68.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.61%], valid : [loss = 2.286, top1 = 41.20%], test : [loss = 2.280, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.75%], valid : [loss = 0.748, top1 = 73.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6863/15625) 006863-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.50%], valid : [loss = 0.481, top1 = 84.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10        train : [loss = 0.296, top1 = 90.15%], test  : [loss = 0.392, top1 = 86.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 1.318, top1 = 63.45%], valid : [loss = 1.539, top1 = 57.72%], test : [loss = 1.524, top1 = 58.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.49 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.79%], valid : [loss = 2.904, top1 = 29.80%], test : [loss = 2.961, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6864/15625) 006864-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.523, top1 = 89.63%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.12 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.331, top1 = 92.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.65 ms.
cifar100       train : [loss = 0.058, top1 = 99.20%], valid : [loss = 1.398, top1 = 69.26%], test : [loss = 1.413, top1 = 69.62%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 1.958, top1 = 48.41%], valid : [loss = 2.356, top1 = 40.23%], test : [loss = 2.291, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.79%], valid : [loss = 0.875, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6865/15625) 006865-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.504, top1 = 88.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.332, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.333, top1 = 90.98%], valid : [loss = 1.286, top1 = 66.97%], test : [loss = 1.276, top1 = 67.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.04%], valid : [loss = 2.399, top1 = 39.30%], test : [loss = 2.410, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6866/15625) 006866-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.247, top1 = 91.42%], valid : [loss = 0.541, top1 = 83.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.39 ms.
cifar10        train : [loss = 0.235, top1 = 92.00%], test  : [loss = 0.413, top1 = 86.65%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.62 ms.
cifar100       train : [loss = 1.327, top1 = 62.66%], valid : [loss = 1.609, top1 = 55.80%], test : [loss = 1.604, top1 = 56.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.837, top1 = 29.97%], valid : [loss = 2.824, top1 = 29.57%], test : [loss = 2.894, top1 = 29.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 67.20%], valid : [loss = 0.979, top1 = 65.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6867/15625) 006867-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.36%], valid : [loss = 0.487, top1 = 85.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.22 ms.
cifar10        train : [loss = 0.159, top1 = 94.71%], test  : [loss = 0.349, top1 = 88.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.50 ms.
cifar100       train : [loss = 1.008, top1 = 71.24%], valid : [loss = 1.362, top1 = 61.90%], test : [loss = 1.357, top1 = 61.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.64%], valid : [loss = 2.689, top1 = 33.23%], test : [loss = 2.708, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6868/15625) 006868-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.91 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.57%], valid : [loss = 0.509, top1 = 87.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10        train : [loss = 0.043, top1 = 98.74%], test  : [loss = 0.342, top1 = 90.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.40 ms.
cifar100       train : [loss = 0.553, top1 = 83.95%], valid : [loss = 1.288, top1 = 65.94%], test : [loss = 1.303, top1 = 65.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.265, top1 = 41.77%], valid : [loss = 2.436, top1 = 38.97%], test : [loss = 2.483, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.84%], valid : [loss = 0.640, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6869/15625) 006869-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.517, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.33 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.337, top1 = 91.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.66 ms.
cifar100       train : [loss = 0.468, top1 = 86.13%], valid : [loss = 1.341, top1 = 65.34%], test : [loss = 1.372, top1 = 65.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.357, top1 = 39.73%], valid : [loss = 2.532, top1 = 36.13%], test : [loss = 2.590, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.44%], valid : [loss = 0.624, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6870/15625) 006870-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.521, top1 = 88.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.022, top1 = 99.37%], test  : [loss = 0.379, top1 = 91.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.316, top1 = 91.36%], valid : [loss = 1.252, top1 = 68.20%], test : [loss = 1.261, top1 = 67.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.01%], valid : [loss = 2.305, top1 = 39.97%], test : [loss = 2.308, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.70%], valid : [loss = 0.720, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6871/15625) 006871-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.290, top1 = 90.19%], valid : [loss = 0.468, top1 = 84.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.60 ms.
cifar10        train : [loss = 0.269, top1 = 90.92%], test  : [loss = 0.374, top1 = 87.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.54 ms.
cifar100       train : [loss = 1.298, top1 = 63.61%], valid : [loss = 1.489, top1 = 58.22%], test : [loss = 1.486, top1 = 58.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.829, top1 = 30.30%], valid : [loss = 2.821, top1 = 30.70%], test : [loss = 2.863, top1 = 29.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.82%], valid : [loss = 1.031, top1 = 63.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6872/15625) 006872-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.504, top1 = 89.98%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.318, top1 = 93.40%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.54 ms.
cifar100       train : [loss = 0.034, top1 = 99.75%], valid : [loss = 1.380, top1 = 69.44%], test : [loss = 1.403, top1 = 69.58%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 1.506, top1 = 59.32%], valid : [loss = 2.397, top1 = 41.60%], test : [loss = 2.385, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.28%], valid : [loss = 0.665, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6873/15625) 006873-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.460, top1 = 89.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.312, top1 = 92.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.15 ms.
cifar100       train : [loss = 0.308, top1 = 91.68%], valid : [loss = 1.323, top1 = 67.01%], test : [loss = 1.313, top1 = 67.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.25%], valid : [loss = 2.366, top1 = 40.01%], test : [loss = 2.399, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.91%], valid : [loss = 0.595, top1 = 79.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6874/15625) 006874-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.624, top1 = 87.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.418, top1 = 90.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.69 ms.
cifar100       train : [loss = 0.264, top1 = 93.25%], valid : [loss = 1.602, top1 = 63.32%], test : [loss = 1.619, top1 = 63.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.67%], valid : [loss = 2.527, top1 = 36.57%], test : [loss = 2.516, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.69%], valid : [loss = 0.855, top1 = 69.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6875/15625) 006875-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.96%], valid : [loss = 0.513, top1 = 87.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10        train : [loss = 0.074, top1 = 97.66%], test  : [loss = 0.373, top1 = 89.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.80 ms.
cifar100       train : [loss = 0.717, top1 = 79.03%], valid : [loss = 1.373, top1 = 64.50%], test : [loss = 1.343, top1 = 64.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.78%], valid : [loss = 2.654, top1 = 33.40%], test : [loss = 2.683, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6876/15625) 006876-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.499, top1 = 88.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.360, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.55 ms.
cifar100       train : [loss = 0.214, top1 = 94.35%], valid : [loss = 1.364, top1 = 68.38%], test : [loss = 1.345, top1 = 68.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.73%], valid : [loss = 2.296, top1 = 41.67%], test : [loss = 2.312, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.33%], valid : [loss = 0.661, top1 = 77.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6877/15625) 006877-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.43%], valid : [loss = 0.661, top1 = 85.16%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=15.31 ms.
cifar10        train : [loss = 0.045, top1 = 98.66%], test  : [loss = 0.411, top1 = 89.57%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=14.46 ms.
cifar100       train : [loss = 0.589, top1 = 82.72%], valid : [loss = 1.463, top1 = 63.00%], test : [loss = 1.438, top1 = 63.05%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.442, top1 = 37.79%], valid : [loss = 2.614, top1 = 34.44%], test : [loss = 2.638, top1 = 33.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.75%], valid : [loss = 0.890, top1 = 68.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6878/15625) 006878-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 0.236, top1 = 91.99%], valid : [loss = 0.525, top1 = 83.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.217, top1 = 92.64%], test  : [loss = 0.401, top1 = 87.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 1.243, top1 = 64.83%], valid : [loss = 1.529, top1 = 57.74%], test : [loss = 1.548, top1 = 56.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.38%], valid : [loss = 2.706, top1 = 33.27%], test : [loss = 2.761, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.06%], valid : [loss = 1.015, top1 = 63.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6879/15625) 006879-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.39%], valid : [loss = 0.662, top1 = 77.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10        train : [loss = 0.514, top1 = 82.19%], test  : [loss = 0.587, top1 = 80.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 1.687, top1 = 54.21%], valid : [loss = 1.858, top1 = 50.59%], test : [loss = 1.864, top1 = 50.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.31%], valid : [loss = 3.307, top1 = 21.96%], test : [loss = 3.337, top1 = 21.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6880/15625) 006880-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.473, top1 = 89.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.300, top1 = 92.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.82 ms.
cifar100       train : [loss = 0.269, top1 = 92.93%], valid : [loss = 1.248, top1 = 67.94%], test : [loss = 1.240, top1 = 68.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.65 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.10%], valid : [loss = 2.205, top1 = 43.13%], test : [loss = 2.229, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6881/15625) 006881-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.42%], valid : [loss = 0.741, top1 = 74.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10        train : [loss = 0.568, top1 = 80.34%], test  : [loss = 0.628, top1 = 78.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.59 ms.
cifar100       train : [loss = 1.987, top1 = 46.63%], valid : [loss = 2.138, top1 = 43.80%], test : [loss = 2.138, top1 = 43.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.69 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.27%], valid : [loss = 3.243, top1 = 22.64%], test : [loss = 3.261, top1 = 22.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6882/15625) 006882-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.69%], valid : [loss = 0.838, top1 = 71.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10        train : [loss = 0.700, top1 = 75.50%], test  : [loss = 0.782, top1 = 73.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.95 ms.
cifar100       train : [loss = 1.959, top1 = 47.82%], valid : [loss = 2.128, top1 = 44.42%], test : [loss = 2.163, top1 = 44.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.71%], valid : [loss = 3.680, top1 = 16.63%], test : [loss = 3.702, top1 = 14.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6883/15625) 006883-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.44%], valid : [loss = 0.722, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10        train : [loss = 0.054, top1 = 98.35%], test  : [loss = 0.444, top1 = 88.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.32 ms.
cifar100       train : [loss = 0.632, top1 = 81.40%], valid : [loss = 1.508, top1 = 61.34%], test : [loss = 1.511, top1 = 61.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.21%], valid : [loss = 2.856, top1 = 28.97%], test : [loss = 2.866, top1 = 30.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6884/15625) 006884-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.68%], valid : [loss = 0.864, top1 = 70.80%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 0.676, top1 = 76.28%], test  : [loss = 0.756, top1 = 73.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.63 ms.
cifar100       train : [loss = 1.954, top1 = 48.08%], valid : [loss = 2.116, top1 = 45.05%], test : [loss = 2.151, top1 = 44.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.96 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.70%], valid : [loss = 3.662, top1 = 16.13%], test : [loss = 3.689, top1 = 15.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6885/15625) 006885-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.241, top1 = 91.77%], valid : [loss = 0.537, top1 = 83.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.242, top1 = 91.80%], test  : [loss = 0.388, top1 = 87.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.29 ms.
cifar100       train : [loss = 1.329, top1 = 62.66%], valid : [loss = 1.590, top1 = 56.86%], test : [loss = 1.586, top1 = 57.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 2.859, top1 = 29.45%], valid : [loss = 2.858, top1 = 30.21%], test : [loss = 2.925, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.20%], valid : [loss = 0.991, top1 = 64.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6886/15625) 006886-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.531, top1 = 89.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.89 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.321, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.48 ms.
cifar100       train : [loss = 0.138, top1 = 97.19%], valid : [loss = 1.290, top1 = 69.22%], test : [loss = 1.305, top1 = 69.08%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.55 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.35%], valid : [loss = 2.283, top1 = 42.07%], test : [loss = 2.268, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.83%], valid : [loss = 0.771, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6887/15625) 006887-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.60 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.655, top1 = 85.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.030, top1 = 99.20%], test  : [loss = 0.394, top1 = 90.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.16 ms.
cifar100       train : [loss = 0.507, top1 = 85.11%], valid : [loss = 1.380, top1 = 64.38%], test : [loss = 1.386, top1 = 64.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.80%], valid : [loss = 2.568, top1 = 34.73%], test : [loss = 2.594, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.88%], valid : [loss = 0.852, top1 = 70.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6888/15625) 006888-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.562, top1 = 88.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.67%], test  : [loss = 0.380, top1 = 91.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.95 ms.
cifar100       train : [loss = 0.255, top1 = 93.13%], valid : [loss = 1.330, top1 = 66.88%], test : [loss = 1.335, top1 = 67.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.59%], valid : [loss = 2.410, top1 = 38.63%], test : [loss = 2.424, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.84%], valid : [loss = 0.900, top1 = 68.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6889/15625) 006889-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.69%], valid : [loss = 1.108, top1 = 63.08%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10        train : [loss = 0.797, top1 = 71.96%], test  : [loss = 0.935, top1 = 67.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.64 ms.
cifar100       train : [loss = 2.141, top1 = 43.93%], valid : [loss = 2.397, top1 = 39.68%], test : [loss = 2.422, top1 = 39.06%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.87 ms.
ImageNet16-120 train : [loss = 3.766, top1 = 13.86%], valid : [loss = 3.819, top1 = 13.87%], test : [loss = 3.834, top1 = 13.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6890/15625) 006890-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.98%], valid : [loss = 0.616, top1 = 85.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10        train : [loss = 0.069, top1 = 97.86%], test  : [loss = 0.389, top1 = 89.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.16 ms.
cifar100       train : [loss = 0.709, top1 = 79.29%], valid : [loss = 1.426, top1 = 62.58%], test : [loss = 1.365, top1 = 63.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.98%], valid : [loss = 2.654, top1 = 34.03%], test : [loss = 2.718, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.75%], valid : [loss = 0.799, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6891/15625) 006891-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.473, top1 = 90.50%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.11 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.329, top1 = 93.29%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.41 ms.
cifar100       train : [loss = 0.084, top1 = 98.53%], valid : [loss = 1.310, top1 = 70.00%], test : [loss = 1.329, top1 = 70.22%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 1.657, top1 = 55.44%], valid : [loss = 2.169, top1 = 43.83%], test : [loss = 2.158, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.80%], valid : [loss = 0.704, top1 = 75.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6892/15625) 006892-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.578, top1 = 87.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.379, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.20 ms.
cifar100       train : [loss = 0.344, top1 = 90.45%], valid : [loss = 1.414, top1 = 65.12%], test : [loss = 1.395, top1 = 65.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.31%], valid : [loss = 2.473, top1 = 37.77%], test : [loss = 2.491, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.18%], valid : [loss = 0.761, top1 = 73.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6893/15625) 006893-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.03%], valid : [loss = 1.164, top1 = 58.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10        train : [loss = 1.053, top1 = 62.93%], test  : [loss = 1.054, top1 = 62.57%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.63 ms.
cifar100       train : [loss = 2.573, top1 = 35.13%], valid : [loss = 2.650, top1 = 33.79%], test : [loss = 2.622, top1 = 34.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.89 ms.
ImageNet16-120 train : [loss = 3.784, top1 = 13.67%], valid : [loss = 3.767, top1 = 14.41%], test : [loss = 3.786, top1 = 14.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6894/15625) 006894-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.13%], valid : [loss = 0.559, top1 = 86.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.29 ms.
cifar10        train : [loss = 0.064, top1 = 97.89%], test  : [loss = 0.364, top1 = 89.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.37 ms.
cifar100       train : [loss = 0.635, top1 = 81.37%], valid : [loss = 1.317, top1 = 64.88%], test : [loss = 1.296, top1 = 64.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.23%], valid : [loss = 2.489, top1 = 36.80%], test : [loss = 2.539, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6895/15625) 006895-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.605, top1 = 86.85%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=17.16 ms.
cifar10        train : [loss = 0.022, top1 = 99.45%], test  : [loss = 0.383, top1 = 90.91%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=15.06 ms.
cifar100       train : [loss = 0.447, top1 = 87.13%], valid : [loss = 1.409, top1 = 64.72%], test : [loss = 1.417, top1 = 64.84%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.20%], valid : [loss = 2.539, top1 = 35.88%], test : [loss = 2.580, top1 = 35.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.70%], valid : [loss = 0.829, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6896/15625) 006896-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.52%], valid : [loss = 0.530, top1 = 87.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10        train : [loss = 0.041, top1 = 98.81%], test  : [loss = 0.371, top1 = 90.28%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.53 ms.
cifar100       train : [loss = 0.541, top1 = 84.11%], valid : [loss = 1.300, top1 = 66.06%], test : [loss = 1.312, top1 = 65.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.40%], valid : [loss = 2.438, top1 = 38.63%], test : [loss = 2.513, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.97%], valid : [loss = 0.625, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6897/15625) 006897-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.905, top1 = 82.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10        train : [loss = 0.030, top1 = 99.25%], test  : [loss = 0.535, top1 = 87.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.06 ms.
cifar100       train : [loss = 0.383, top1 = 89.65%], valid : [loss = 1.616, top1 = 61.84%], test : [loss = 1.625, top1 = 61.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 36.51%], valid : [loss = 2.854, top1 = 29.93%], test : [loss = 2.896, top1 = 30.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.42%], valid : [loss = 0.848, top1 = 70.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6898/15625) 006898-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.41%], valid : [loss = 0.741, top1 = 74.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10        train : [loss = 0.512, top1 = 82.27%], test  : [loss = 0.598, top1 = 79.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.51 ms.
cifar100       train : [loss = 1.933, top1 = 47.95%], valid : [loss = 2.071, top1 = 44.90%], test : [loss = 2.077, top1 = 44.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.26 ms.
ImageNet16-120 train : [loss = 3.011, top1 = 26.38%], valid : [loss = 3.000, top1 = 26.89%], test : [loss = 3.027, top1 = 26.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 60.27%], valid : [loss = 1.159, top1 = 58.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6899/15625) 006899-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.51%], valid : [loss = 0.422, top1 = 88.47%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.09 ms.
cifar10        train : [loss = 0.053, top1 = 98.77%], test  : [loss = 0.306, top1 = 90.90%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.83 ms.
cifar100       train : [loss = 0.587, top1 = 83.83%], valid : [loss = 1.207, top1 = 66.98%], test : [loss = 1.188, top1 = 67.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.13%], valid : [loss = 2.495, top1 = 38.43%], test : [loss = 2.496, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.14%], valid : [loss = 0.632, top1 = 77.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6900/15625) 006900-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.494, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.72 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.310, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.70 ms.
cifar100       train : [loss = 0.228, top1 = 94.45%], valid : [loss = 1.230, top1 = 68.84%], test : [loss = 1.229, top1 = 68.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.58%], valid : [loss = 2.279, top1 = 41.53%], test : [loss = 2.302, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.90%], valid : [loss = 0.615, top1 = 78.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6901/15625) 006901-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.93 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.89%], valid : [loss = 0.476, top1 = 84.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10        train : [loss = 0.307, top1 = 89.80%], test  : [loss = 0.412, top1 = 86.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.28 ms.
cifar100       train : [loss = 1.343, top1 = 62.62%], valid : [loss = 1.534, top1 = 57.98%], test : [loss = 1.534, top1 = 57.82%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.24 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.41%], valid : [loss = 2.908, top1 = 30.40%], test : [loss = 2.958, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6902/15625) 006902-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.82%], valid : [loss = 0.578, top1 = 83.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.43 ms.
cifar10        train : [loss = 0.170, top1 = 94.28%], test  : [loss = 0.399, top1 = 87.59%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.30 ms.
cifar100       train : [loss = 1.206, top1 = 65.63%], valid : [loss = 1.549, top1 = 57.46%], test : [loss = 1.555, top1 = 58.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 34.45%], valid : [loss = 2.650, top1 = 32.90%], test : [loss = 2.705, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.898, top1 = 67.64%], valid : [loss = 0.971, top1 = 65.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6903/15625) 006903-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.88%], valid : [loss = 0.510, top1 = 89.47%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.99 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.335, top1 = 92.87%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.72 ms.
cifar100       train : [loss = 0.136, top1 = 97.06%], valid : [loss = 1.294, top1 = 69.38%], test : [loss = 1.246, top1 = 70.50%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.69%], valid : [loss = 2.205, top1 = 42.77%], test : [loss = 2.168, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.65%], valid : [loss = 0.922, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6904/15625) 006904-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.519, top1 = 89.31%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.61 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.319, top1 = 92.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.25 ms.
cifar100       train : [loss = 0.130, top1 = 97.41%], valid : [loss = 1.313, top1 = 68.98%], test : [loss = 1.289, top1 = 69.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.09%], valid : [loss = 2.287, top1 = 40.97%], test : [loss = 2.300, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.79%], valid : [loss = 0.645, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6905/15625) 006905-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.74%], valid : [loss = 0.830, top1 = 76.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.318, top1 = 88.86%], test  : [loss = 0.638, top1 = 80.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.40 ms.
cifar100       train : [loss = 1.406, top1 = 60.70%], valid : [loss = 1.966, top1 = 49.22%], test : [loss = 1.993, top1 = 49.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 3.491, top1 = 17.35%], valid : [loss = 3.510, top1 = 17.73%], test : [loss = 3.525, top1 = 16.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6906/15625) 006906-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.17 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.503, top1 = 88.44%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10        train : [loss = 0.025, top1 = 99.32%], test  : [loss = 0.331, top1 = 91.45%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.53 ms.
cifar100       train : [loss = 0.348, top1 = 90.45%], valid : [loss = 1.197, top1 = 68.90%], test : [loss = 1.234, top1 = 68.40%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 1.957, top1 = 48.48%], valid : [loss = 2.242, top1 = 42.23%], test : [loss = 2.257, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.87%], valid : [loss = 0.749, top1 = 73.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6907/15625) 006907-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.493, top1 = 88.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.313, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.10 ms.
cifar100       train : [loss = 0.328, top1 = 91.16%], valid : [loss = 1.237, top1 = 68.06%], test : [loss = 1.229, top1 = 68.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.56%], valid : [loss = 2.316, top1 = 40.33%], test : [loss = 2.325, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.25%], valid : [loss = 0.620, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6908/15625) 006908-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.518, top1 = 88.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.89 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.354, top1 = 91.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.324, top1 = 90.92%], valid : [loss = 1.280, top1 = 67.72%], test : [loss = 1.282, top1 = 67.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.02%], valid : [loss = 2.328, top1 = 40.60%], test : [loss = 2.318, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.56%], valid : [loss = 0.756, top1 = 73.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6909/15625) 006909-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.508, top1 = 88.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.95 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.343, top1 = 91.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 0.342, top1 = 90.42%], valid : [loss = 1.270, top1 = 67.02%], test : [loss = 1.255, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.77%], valid : [loss = 2.419, top1 = 39.10%], test : [loss = 2.432, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.45%], valid : [loss = 0.840, top1 = 70.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6910/15625) 006910-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.18%], valid : [loss = 0.467, top1 = 85.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.162, top1 = 94.61%], test  : [loss = 0.352, top1 = 88.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 1.034, top1 = 70.68%], valid : [loss = 1.374, top1 = 60.74%], test : [loss = 1.379, top1 = 60.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.38%], valid : [loss = 2.711, top1 = 31.97%], test : [loss = 2.712, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6911/15625) 006911-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.575, top1 = 87.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.385, top1 = 91.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 0.393, top1 = 88.82%], valid : [loss = 1.376, top1 = 66.07%], test : [loss = 1.396, top1 = 65.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.90%], valid : [loss = 2.508, top1 = 37.02%], test : [loss = 2.526, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6912/15625) 006912-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.31%], valid : [loss = 0.595, top1 = 85.77%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.18 ms.
cifar10        train : [loss = 0.068, top1 = 97.92%], test  : [loss = 0.402, top1 = 88.97%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=14.48 ms.
cifar100       train : [loss = 0.699, top1 = 79.71%], valid : [loss = 1.389, top1 = 63.89%], test : [loss = 1.363, top1 = 63.87%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.35%], valid : [loss = 2.658, top1 = 34.10%], test : [loss = 2.675, top1 = 33.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.76%], valid : [loss = 0.741, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6913/15625) 006913-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.457, top1 = 89.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.314, top1 = 92.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.90 ms.
cifar100       train : [loss = 0.153, top1 = 96.78%], valid : [loss = 1.266, top1 = 69.22%], test : [loss = 1.268, top1 = 69.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.07 ms.
ImageNet16-120 train : [loss = 1.780, top1 = 52.67%], valid : [loss = 2.275, top1 = 42.63%], test : [loss = 2.300, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.443, top1 = 84.89%], valid : [loss = 0.562, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6914/15625) 006914-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.530, top1 = 89.35%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.09 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.340, top1 = 92.56%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.21 ms.
cifar100       train : [loss = 0.050, top1 = 99.42%], valid : [loss = 1.436, top1 = 69.24%], test : [loss = 1.487, top1 = 68.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 1.651, top1 = 55.75%], valid : [loss = 2.371, top1 = 42.17%], test : [loss = 2.368, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.41%], valid : [loss = 0.675, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6915/15625) 006915-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.67%], valid : [loss = 0.688, top1 = 83.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.072, top1 = 97.70%], test  : [loss = 0.410, top1 = 88.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.04 ms.
cifar100       train : [loss = 0.779, top1 = 77.16%], valid : [loss = 1.428, top1 = 61.74%], test : [loss = 1.462, top1 = 61.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.565, top1 = 35.34%], valid : [loss = 2.677, top1 = 33.17%], test : [loss = 2.754, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.49%], valid : [loss = 0.918, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6916/15625) 006916-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.591, top1 = 87.36%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.89 ms.
cifar10        train : [loss = 0.017, top1 = 99.50%], test  : [loss = 0.413, top1 = 91.05%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.13 ms.
cifar100       train : [loss = 0.337, top1 = 90.52%], valid : [loss = 1.427, top1 = 64.72%], test : [loss = 1.431, top1 = 64.24%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.782, top1 = 29.92%], valid : [loss = 2.824, top1 = 27.73%], test : [loss = 2.863, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.83%], valid : [loss = 1.205, top1 = 56.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6917/15625) 006917-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.492, top1 = 88.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.330, top1 = 92.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.89 ms.
cifar100       train : [loss = 0.285, top1 = 92.55%], valid : [loss = 1.212, top1 = 68.68%], test : [loss = 1.197, top1 = 69.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.69 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.79%], valid : [loss = 2.262, top1 = 41.57%], test : [loss = 2.287, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.12%], valid : [loss = 0.626, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6918/15625) 006918-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.19%], valid : [loss = 0.478, top1 = 84.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.302, top1 = 89.83%], test  : [loss = 0.396, top1 = 87.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 1.329, top1 = 63.13%], valid : [loss = 1.543, top1 = 57.50%], test : [loss = 1.498, top1 = 58.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.67%], valid : [loss = 2.907, top1 = 29.23%], test : [loss = 2.951, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6919/15625) 006919-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.57 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.94 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6920/15625) 006920-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.595, top1 = 87.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.23 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.382, top1 = 91.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.10 ms.
cifar100       train : [loss = 0.383, top1 = 89.24%], valid : [loss = 1.438, top1 = 65.52%], test : [loss = 1.414, top1 = 65.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.01%], valid : [loss = 2.513, top1 = 36.60%], test : [loss = 2.565, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.31%], valid : [loss = 0.832, top1 = 70.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6921/15625) 006921-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10-valid  train : [loss = 1.852, top1 = 32.77%], valid : [loss = 1.862, top1 = 32.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.74 ms.
cifar10        train : [loss = 1.495, top1 = 45.68%], test  : [loss = 1.497, top1 = 46.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.83 ms.
cifar100       train : [loss = 3.877, top1 = 10.44%], valid : [loss = 3.910, top1 = 9.95%], test : [loss = 3.908, top1 = 10.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.23 ms.
ImageNet16-120 train : [loss = 3.992, top1 = 10.44%], valid : [loss = 3.987, top1 = 10.89%], test : [loss = 3.997, top1 = 10.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.970, top1 = 27.06%], valid : [loss = 1.968, top1 = 27.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6922/15625) 006922-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.14%], valid : [loss = 0.588, top1 = 86.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10        train : [loss = 0.069, top1 = 97.78%], test  : [loss = 0.389, top1 = 89.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.633, top1 = 81.12%], valid : [loss = 1.290, top1 = 65.00%], test : [loss = 1.288, top1 = 65.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.74%], valid : [loss = 2.469, top1 = 37.70%], test : [loss = 2.515, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.58%], valid : [loss = 0.783, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6923/15625) 006923-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.496, top1 = 90.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.60 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.344, top1 = 92.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=22.81 ms.
cifar100       train : [loss = 0.117, top1 = 97.62%], valid : [loss = 1.342, top1 = 69.60%], test : [loss = 1.354, top1 = 69.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.21 ms.
ImageNet16-120 train : [loss = 1.748, top1 = 53.41%], valid : [loss = 2.199, top1 = 43.93%], test : [loss = 2.186, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.36%], valid : [loss = 0.675, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6924/15625) 006924-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.309, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 0.336, top1 = 90.81%], valid : [loss = 1.317, top1 = 67.40%], test : [loss = 1.295, top1 = 67.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.91%], valid : [loss = 2.400, top1 = 39.33%], test : [loss = 2.406, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.33%], valid : [loss = 0.557, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6925/15625) 006925-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.398, top1 = 90.70%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.281, top1 = 93.30%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.63 ms.
cifar100       train : [loss = 0.107, top1 = 98.15%], valid : [loss = 1.226, top1 = 71.40%], test : [loss = 1.209, top1 = 71.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 1.627, top1 = 56.13%], valid : [loss = 2.155, top1 = 44.67%], test : [loss = 2.208, top1 = 44.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.78%], valid : [loss = 0.502, top1 = 83.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6926/15625) 006926-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.441, top1 = 89.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.56 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.313, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.44 ms.
cifar100       train : [loss = 0.186, top1 = 95.84%], valid : [loss = 1.228, top1 = 69.90%], test : [loss = 1.236, top1 = 69.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 1.793, top1 = 52.39%], valid : [loss = 2.241, top1 = 43.17%], test : [loss = 2.253, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.401, top1 = 86.23%], valid : [loss = 0.529, top1 = 82.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6927/15625) 006927-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.60%], valid : [loss = 0.794, top1 = 72.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.619, top1 = 78.31%], test  : [loss = 0.681, top1 = 76.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 2.188, top1 = 41.62%], valid : [loss = 2.336, top1 = 38.94%], test : [loss = 2.312, top1 = 39.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.356, top1 = 20.17%], valid : [loss = 3.343, top1 = 20.26%], test : [loss = 3.390, top1 = 19.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.273, top1 = 53.78%], valid : [loss = 1.324, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6928/15625) 006928-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.531, top1 = 89.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.329, top1 = 92.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.00 ms.
cifar100       train : [loss = 0.118, top1 = 97.60%], valid : [loss = 1.317, top1 = 69.45%], test : [loss = 1.310, top1 = 69.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 1.720, top1 = 54.08%], valid : [loss = 2.219, top1 = 43.39%], test : [loss = 2.213, top1 = 43.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.77%], valid : [loss = 0.575, top1 = 80.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6929/15625) 006929-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.36%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.84 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.330, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.86 ms.
cifar100       train : [loss = 0.135, top1 = 97.30%], valid : [loss = 1.315, top1 = 68.65%], test : [loss = 1.306, top1 = 68.98%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.36%], valid : [loss = 2.297, top1 = 41.48%], test : [loss = 2.276, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.50%], valid : [loss = 0.682, top1 = 76.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6930/15625) 006930-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.44%], valid : [loss = 0.472, top1 = 85.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10        train : [loss = 0.158, top1 = 94.92%], test  : [loss = 0.342, top1 = 88.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.77 ms.
cifar100       train : [loss = 1.002, top1 = 71.31%], valid : [loss = 1.363, top1 = 62.28%], test : [loss = 1.359, top1 = 61.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.99%], valid : [loss = 2.696, top1 = 33.43%], test : [loss = 2.692, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6931/15625) 006931-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.439, top1 = 90.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.283, top1 = 93.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.062, top1 = 99.02%], valid : [loss = 1.307, top1 = 70.82%], test : [loss = 1.331, top1 = 71.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 1.508, top1 = 59.01%], valid : [loss = 2.210, top1 = 44.90%], test : [loss = 2.274, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 88.19%], valid : [loss = 0.496, top1 = 83.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6932/15625) 006932-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.495, top1 = 90.08%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.311, top1 = 93.43%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.64 ms.
cifar100       train : [loss = 0.093, top1 = 98.35%], valid : [loss = 1.361, top1 = 68.86%], test : [loss = 1.347, top1 = 69.30%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.35 ms.
ImageNet16-120 train : [loss = 1.694, top1 = 54.60%], valid : [loss = 2.180, top1 = 43.40%], test : [loss = 2.160, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.20%], valid : [loss = 0.663, top1 = 77.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6933/15625) 006933-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.525, top1 = 88.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.75 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.357, top1 = 91.74%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.65 ms.
cifar100       train : [loss = 0.290, top1 = 92.20%], valid : [loss = 1.293, top1 = 68.32%], test : [loss = 1.277, top1 = 68.08%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.70%], valid : [loss = 2.315, top1 = 40.13%], test : [loss = 2.368, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.98%], valid : [loss = 0.754, top1 = 73.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6934/15625) 006934-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.504, top1 = 88.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.339, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.47 ms.
cifar100       train : [loss = 0.337, top1 = 90.71%], valid : [loss = 1.293, top1 = 67.48%], test : [loss = 1.306, top1 = 66.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.55%], valid : [loss = 2.417, top1 = 39.73%], test : [loss = 2.416, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6935/15625) 006935-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.537, top1 = 88.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.384, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.395, top1 = 88.82%], valid : [loss = 1.395, top1 = 65.43%], test : [loss = 1.387, top1 = 65.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.94%], valid : [loss = 2.460, top1 = 38.37%], test : [loss = 2.519, top1 = 37.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.42%], valid : [loss = 0.765, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6936/15625) 006936-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.08%], valid : [loss = 0.733, top1 = 83.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.089, top1 = 97.14%], test  : [loss = 0.507, top1 = 86.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.25 ms.
cifar100       train : [loss = 0.839, top1 = 75.61%], valid : [loss = 1.593, top1 = 59.14%], test : [loss = 1.541, top1 = 59.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.813, top1 = 30.37%], valid : [loss = 2.946, top1 = 28.10%], test : [loss = 2.983, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.85%], valid : [loss = 0.881, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6937/15625) 006937-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.582, top1 = 88.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.377, top1 = 92.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.41 ms.
cifar100       train : [loss = 0.152, top1 = 96.75%], valid : [loss = 1.489, top1 = 66.44%], test : [loss = 1.460, top1 = 67.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.22%], valid : [loss = 2.441, top1 = 39.00%], test : [loss = 2.462, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.40%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6938/15625) 006938-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.604, top1 = 85.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.069, top1 = 97.88%], test  : [loss = 0.414, top1 = 88.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.45 ms.
cifar100       train : [loss = 0.716, top1 = 79.13%], valid : [loss = 1.382, top1 = 63.51%], test : [loss = 1.370, top1 = 63.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.86%], valid : [loss = 2.659, top1 = 33.64%], test : [loss = 2.695, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6939/15625) 006939-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.503, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.332, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.32 ms.
cifar100       train : [loss = 0.310, top1 = 91.46%], valid : [loss = 1.252, top1 = 68.27%], test : [loss = 1.267, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.63%], valid : [loss = 2.319, top1 = 40.24%], test : [loss = 2.332, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.48%], valid : [loss = 0.777, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6940/15625) 006940-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.10%], valid : [loss = 0.683, top1 = 76.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.635, top1 = 77.87%], test  : [loss = 0.675, top1 = 76.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 1.833, top1 = 50.67%], valid : [loss = 1.944, top1 = 49.48%], test : [loss = 1.989, top1 = 47.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 3.420, top1 = 19.63%], valid : [loss = 3.399, top1 = 20.40%], test : [loss = 3.431, top1 = 19.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 51.05%], valid : [loss = 1.406, top1 = 49.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6941/15625) 006941-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.487, top1 = 89.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.52 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.342, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.16 ms.
cifar100       train : [loss = 0.116, top1 = 97.63%], valid : [loss = 1.386, top1 = 69.34%], test : [loss = 1.402, top1 = 68.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.21 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.67%], valid : [loss = 2.301, top1 = 41.03%], test : [loss = 2.284, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.481, top1 = 82.80%], valid : [loss = 0.589, top1 = 79.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6942/15625) 006942-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10-valid  train : [loss = 0.895, top1 = 68.52%], valid : [loss = 1.086, top1 = 62.92%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10        train : [loss = 0.892, top1 = 68.58%], test  : [loss = 0.963, top1 = 66.21%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.98 ms.
cifar100       train : [loss = 2.313, top1 = 40.20%], valid : [loss = 2.510, top1 = 37.02%], test : [loss = 2.512, top1 = 36.70%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.99 ms.
ImageNet16-120 train : [loss = 3.824, top1 = 12.92%], valid : [loss = 3.843, top1 = 13.33%], test : [loss = 3.851, top1 = 12.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.503, top1 = 44.78%], valid : [loss = 1.526, top1 = 44.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6943/15625) 006943-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.24%], valid : [loss = 0.605, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.072, top1 = 97.82%], test  : [loss = 0.406, top1 = 88.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.97 ms.
cifar100       train : [loss = 0.726, top1 = 78.95%], valid : [loss = 1.395, top1 = 62.52%], test : [loss = 1.396, top1 = 63.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.12%], valid : [loss = 2.663, top1 = 33.47%], test : [loss = 2.680, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6944/15625) 006944-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.15%], valid : [loss = 0.885, top1 = 78.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.19 ms.
cifar10        train : [loss = 0.136, top1 = 95.44%], test  : [loss = 0.541, top1 = 84.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.96 ms.
cifar100       train : [loss = 0.935, top1 = 73.05%], valid : [loss = 1.677, top1 = 56.76%], test : [loss = 1.674, top1 = 56.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 3.053, top1 = 26.16%], valid : [loss = 3.172, top1 = 23.93%], test : [loss = 3.241, top1 = 23.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 62.82%], valid : [loss = 1.091, top1 = 61.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6945/15625) 006945-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.465, top1 = 89.44%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.20 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.294, top1 = 92.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.96 ms.
cifar100       train : [loss = 0.237, top1 = 94.15%], valid : [loss = 1.194, top1 = 68.84%], test : [loss = 1.229, top1 = 68.62%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 1.933, top1 = 48.94%], valid : [loss = 2.250, top1 = 42.67%], test : [loss = 2.262, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.97%], valid : [loss = 0.608, top1 = 79.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6946/15625) 006946-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.519, top1 = 88.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.331, top1 = 92.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.31 ms.
cifar100       train : [loss = 0.337, top1 = 90.88%], valid : [loss = 1.275, top1 = 67.23%], test : [loss = 1.283, top1 = 67.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.77%], valid : [loss = 2.410, top1 = 39.53%], test : [loss = 2.400, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6947/15625) 006947-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.76%], valid : [loss = 0.719, top1 = 82.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.062, top1 = 98.03%], test  : [loss = 0.400, top1 = 89.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.712, top1 = 78.96%], valid : [loss = 1.411, top1 = 62.24%], test : [loss = 1.421, top1 = 62.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.32%], valid : [loss = 2.621, top1 = 34.23%], test : [loss = 2.646, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.38%], valid : [loss = 0.889, top1 = 68.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6948/15625) 006948-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.20%], valid : [loss = 0.620, top1 = 85.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.67 ms.
cifar10        train : [loss = 0.070, top1 = 97.85%], test  : [loss = 0.401, top1 = 89.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.32 ms.
cifar100       train : [loss = 0.720, top1 = 79.26%], valid : [loss = 1.420, top1 = 62.50%], test : [loss = 1.362, top1 = 63.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.44 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.77%], valid : [loss = 2.661, top1 = 33.07%], test : [loss = 2.697, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6949/15625) 006949-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.20%], valid : [loss = 0.547, top1 = 83.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.191, top1 = 93.49%], test  : [loss = 0.397, top1 = 87.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 1.262, top1 = 64.10%], valid : [loss = 1.565, top1 = 57.17%], test : [loss = 1.546, top1 = 57.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 2.695, top1 = 32.60%], valid : [loss = 2.735, top1 = 31.90%], test : [loss = 2.774, top1 = 31.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6950/15625) 006950-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.505, top1 = 88.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.333, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 0.344, top1 = 90.55%], valid : [loss = 1.304, top1 = 66.78%], test : [loss = 1.284, top1 = 67.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.48%], valid : [loss = 2.428, top1 = 38.83%], test : [loss = 2.404, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6951/15625) 006951-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.506, top1 = 89.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.303, top1 = 93.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.08 ms.
cifar100       train : [loss = 0.110, top1 = 97.63%], valid : [loss = 1.331, top1 = 69.12%], test : [loss = 1.356, top1 = 69.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.681, top1 = 54.99%], valid : [loss = 2.232, top1 = 43.97%], test : [loss = 2.276, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.60%], valid : [loss = 0.593, top1 = 79.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6952/15625) 006952-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.62%], valid : [loss = 0.564, top1 = 85.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.30 ms.
cifar10        train : [loss = 0.107, top1 = 96.56%], test  : [loss = 0.379, top1 = 88.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.37 ms.
cifar100       train : [loss = 0.793, top1 = 76.56%], valid : [loss = 1.404, top1 = 63.26%], test : [loss = 1.401, top1 = 62.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.481, top1 = 36.90%], valid : [loss = 2.577, top1 = 35.17%], test : [loss = 2.622, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.50%], valid : [loss = 0.878, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6953/15625) 006953-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.517, top1 = 88.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.89 ms.
cifar100       train : [loss = 0.354, top1 = 90.23%], valid : [loss = 1.291, top1 = 66.90%], test : [loss = 1.276, top1 = 67.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.52%], valid : [loss = 2.438, top1 = 38.17%], test : [loss = 2.441, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6954/15625) 006954-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.15%], valid : [loss = 0.734, top1 = 75.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.516, top1 = 82.26%], test  : [loss = 0.590, top1 = 79.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.67 ms.
cifar100       train : [loss = 1.846, top1 = 49.83%], valid : [loss = 1.983, top1 = 47.19%], test : [loss = 1.986, top1 = 46.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.14 ms.
ImageNet16-120 train : [loss = 3.011, top1 = 26.40%], valid : [loss = 2.991, top1 = 27.33%], test : [loss = 3.015, top1 = 26.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.129, top1 = 59.56%], valid : [loss = 1.176, top1 = 58.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6955/15625) 006955-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.520, top1 = 88.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.77 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.336, top1 = 92.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.280, top1 = 92.58%], valid : [loss = 1.290, top1 = 68.24%], test : [loss = 1.269, top1 = 67.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.007, top1 = 47.36%], valid : [loss = 2.301, top1 = 41.00%], test : [loss = 2.337, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.81%], valid : [loss = 0.703, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6956/15625) 006956-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.519, top1 = 88.98%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.27 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.327, top1 = 92.41%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.38 ms.
cifar100       train : [loss = 0.245, top1 = 93.52%], valid : [loss = 1.296, top1 = 67.95%], test : [loss = 1.293, top1 = 68.91%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.71 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.87%], valid : [loss = 2.255, top1 = 42.51%], test : [loss = 2.271, top1 = 42.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.55%], valid : [loss = 0.597, top1 = 79.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6957/15625) 006957-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.51%], valid : [loss = 0.436, top1 = 87.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10        train : [loss = 0.054, top1 = 98.65%], test  : [loss = 0.316, top1 = 90.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.12 ms.
cifar100       train : [loss = 0.582, top1 = 83.95%], valid : [loss = 1.230, top1 = 67.14%], test : [loss = 1.218, top1 = 66.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 41.06%], valid : [loss = 2.454, top1 = 37.00%], test : [loss = 2.469, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6958/15625) 006958-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.517, top1 = 88.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.85 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.356, top1 = 91.80%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.91 ms.
cifar100       train : [loss = 0.322, top1 = 91.04%], valid : [loss = 1.309, top1 = 67.30%], test : [loss = 1.289, top1 = 67.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.199, top1 = 42.93%], valid : [loss = 2.442, top1 = 37.57%], test : [loss = 2.450, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.06%], valid : [loss = 0.853, top1 = 69.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6959/15625) 006959-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.33%], valid : [loss = 0.679, top1 = 82.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.67 ms.
cifar10        train : [loss = 0.148, top1 = 94.98%], test  : [loss = 0.489, top1 = 86.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 0.968, top1 = 71.97%], valid : [loss = 1.647, top1 = 56.92%], test : [loss = 1.608, top1 = 57.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.86 ms.
ImageNet16-120 train : [loss = 3.030, top1 = 25.91%], valid : [loss = 3.131, top1 = 25.20%], test : [loss = 3.152, top1 = 23.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6960/15625) 006960-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.532, top1 = 88.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.72 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.322, top1 = 92.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.60 ms.
cifar100       train : [loss = 0.343, top1 = 90.53%], valid : [loss = 1.258, top1 = 67.60%], test : [loss = 1.292, top1 = 67.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.37%], valid : [loss = 2.394, top1 = 39.20%], test : [loss = 2.419, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6961/15625) 006961-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.458, top1 = 89.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.315, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.70 ms.
cifar100       train : [loss = 0.329, top1 = 91.03%], valid : [loss = 1.300, top1 = 67.40%], test : [loss = 1.314, top1 = 66.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.43%], valid : [loss = 2.356, top1 = 40.38%], test : [loss = 2.402, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.36%], valid : [loss = 0.553, top1 = 81.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6962/15625) 006962-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.74%], valid : [loss = 0.564, top1 = 88.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.29 ms.
cifar10        train : [loss = 0.020, top1 = 99.45%], test  : [loss = 0.392, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.282, top1 = 92.13%], valid : [loss = 1.370, top1 = 65.86%], test : [loss = 1.340, top1 = 68.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.26%], valid : [loss = 2.340, top1 = 39.57%], test : [loss = 2.395, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.47%], valid : [loss = 0.831, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6963/15625) 006963-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.82%], valid : [loss = 0.636, top1 = 84.95%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.95 ms.
cifar10        train : [loss = 0.078, top1 = 97.43%], test  : [loss = 0.422, top1 = 88.77%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.41 ms.
cifar100       train : [loss = 0.540, top1 = 84.34%], valid : [loss = 1.400, top1 = 63.76%], test : [loss = 1.379, top1 = 64.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.05%], valid : [loss = 2.709, top1 = 32.23%], test : [loss = 2.754, top1 = 30.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.009, top1 = 63.53%], valid : [loss = 1.051, top1 = 62.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6964/15625) 006964-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.503, top1 = 90.42%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.09 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.339, top1 = 93.26%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.38 ms.
cifar100       train : [loss = 0.065, top1 = 99.05%], valid : [loss = 1.341, top1 = 70.24%], test : [loss = 1.339, top1 = 70.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.06 ms.
ImageNet16-120 train : [loss = 1.663, top1 = 55.52%], valid : [loss = 2.179, top1 = 44.43%], test : [loss = 2.183, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.16%], valid : [loss = 0.600, top1 = 79.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6965/15625) 006965-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.655, top1 = 86.50%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.93 ms.
cifar10        train : [loss = 0.019, top1 = 99.54%], test  : [loss = 0.414, top1 = 90.45%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.23 ms.
cifar100       train : [loss = 0.286, top1 = 92.67%], valid : [loss = 1.615, top1 = 63.20%], test : [loss = 1.581, top1 = 63.20%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.72%], valid : [loss = 2.579, top1 = 35.50%], test : [loss = 2.575, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.51%], valid : [loss = 0.832, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6966/15625) 006966-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.394, top1 = 91.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.35 ms.
cifar100       train : [loss = 0.180, top1 = 96.00%], valid : [loss = 1.454, top1 = 66.48%], test : [loss = 1.443, top1 = 66.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.11%], valid : [loss = 2.444, top1 = 38.27%], test : [loss = 2.439, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.87%], valid : [loss = 0.699, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6967/15625) 006967-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.644, top1 = 87.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.426, top1 = 90.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.95 ms.
cifar100       train : [loss = 0.163, top1 = 96.45%], valid : [loss = 1.543, top1 = 65.70%], test : [loss = 1.530, top1 = 65.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.14 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.92%], valid : [loss = 2.516, top1 = 38.47%], test : [loss = 2.514, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.02%], valid : [loss = 0.855, top1 = 69.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6968/15625) 006968-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.247, top1 = 91.49%], valid : [loss = 0.560, top1 = 82.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.70 ms.
cifar10        train : [loss = 0.220, top1 = 92.44%], test  : [loss = 0.399, top1 = 86.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 1.242, top1 = 64.67%], valid : [loss = 1.554, top1 = 57.26%], test : [loss = 1.552, top1 = 57.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.703, top1 = 32.37%], valid : [loss = 2.733, top1 = 32.17%], test : [loss = 2.770, top1 = 31.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.08%], valid : [loss = 1.013, top1 = 63.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6969/15625) 006969-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.718, top1 = 84.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.42 ms.
cifar10        train : [loss = 0.030, top1 = 99.27%], test  : [loss = 0.429, top1 = 89.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.68 ms.
cifar100       train : [loss = 0.395, top1 = 89.28%], valid : [loss = 1.428, top1 = 64.66%], test : [loss = 1.418, top1 = 64.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.08%], valid : [loss = 2.600, top1 = 35.33%], test : [loss = 2.633, top1 = 35.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6970/15625) 006970-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.81 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.32 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.35 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.99 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6971/15625) 006971-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.635, top1 = 87.58%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.434, top1 = 91.28%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.63 ms.
cifar100       train : [loss = 0.086, top1 = 98.37%], valid : [loss = 1.610, top1 = 66.48%], test : [loss = 1.595, top1 = 66.56%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 2.027, top1 = 47.01%], valid : [loss = 2.443, top1 = 38.40%], test : [loss = 2.481, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.36%], valid : [loss = 0.754, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6972/15625) 006972-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.568, top1 = 87.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.038, top1 = 98.85%], test  : [loss = 0.397, top1 = 89.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.53 ms.
cifar100       train : [loss = 0.562, top1 = 83.47%], valid : [loss = 1.406, top1 = 63.87%], test : [loss = 1.415, top1 = 63.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.88%], valid : [loss = 2.620, top1 = 34.28%], test : [loss = 2.662, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6973/15625) 006973-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.587, top1 = 87.32%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.45 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.384, top1 = 91.08%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.72 ms.
cifar100       train : [loss = 0.390, top1 = 88.99%], valid : [loss = 1.389, top1 = 65.42%], test : [loss = 1.399, top1 = 65.27%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.87 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 41.01%], valid : [loss = 2.520, top1 = 36.60%], test : [loss = 2.531, top1 = 36.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.27%], valid : [loss = 0.799, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6974/15625) 006974-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.36%], valid : [loss = 0.443, top1 = 86.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10        train : [loss = 0.155, top1 = 94.94%], test  : [loss = 0.349, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.971, top1 = 72.19%], valid : [loss = 1.362, top1 = 62.82%], test : [loss = 1.343, top1 = 61.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.73%], valid : [loss = 2.691, top1 = 32.50%], test : [loss = 2.718, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6975/15625) 006975-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.34%], valid : [loss = 0.847, top1 = 79.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.135, top1 = 95.58%], test  : [loss = 0.548, top1 = 84.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 0.860, top1 = 75.04%], valid : [loss = 1.672, top1 = 56.96%], test : [loss = 1.710, top1 = 57.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 26.41%], valid : [loss = 3.176, top1 = 23.80%], test : [loss = 3.207, top1 = 24.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.45%], valid : [loss = 1.071, top1 = 61.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6976/15625) 006976-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.440, top1 = 90.25%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.87 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.277, top1 = 92.96%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.36 ms.
cifar100       train : [loss = 0.163, top1 = 96.45%], valid : [loss = 1.194, top1 = 70.06%], test : [loss = 1.210, top1 = 71.14%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 1.708, top1 = 54.08%], valid : [loss = 2.156, top1 = 44.10%], test : [loss = 2.164, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.60%], valid : [loss = 0.683, top1 = 76.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6977/15625) 006977-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 20.89 M, Params=0.167 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.59%], valid : [loss = 0.461, top1 = 86.11%]
cifar10        FLOP= 20.89 M, Params=0.167 MB, latency=19.82 ms.
cifar10        train : [loss = 0.152, top1 = 95.12%], test  : [loss = 0.338, top1 = 89.22%]
cifar100       FLOP= 20.90 M, Params=0.172 MB, latency=19.50 ms.
cifar100       train : [loss = 0.969, top1 = 72.42%], valid : [loss = 1.346, top1 = 62.68%], test : [loss = 1.338, top1 = 62.19%]
ImageNet16-120 FLOP=  5.23 M, Params=0.174 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.17%], valid : [loss = 2.680, top1 = 33.41%], test : [loss = 2.703, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 74.96%], valid : [loss = 0.754, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6978/15625) 006978-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10-valid  train : [loss = 1.274, top1 = 54.38%], valid : [loss = 1.311, top1 = 53.23%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10        train : [loss = 1.233, top1 = 55.88%], test  : [loss = 1.237, top1 = 55.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.66 ms.
cifar100       train : [loss = 2.751, top1 = 31.23%], valid : [loss = 2.829, top1 = 29.88%], test : [loss = 2.816, top1 = 29.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.18 ms.
ImageNet16-120 train : [loss = 3.899, top1 = 11.92%], valid : [loss = 3.899, top1 = 12.80%], test : [loss = 3.908, top1 = 12.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.734, top1 = 34.67%], valid : [loss = 1.724, top1 = 34.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6979/15625) 006979-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.486, top1 = 88.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.26 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.320, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.09 ms.
cifar100       train : [loss = 0.336, top1 = 90.87%], valid : [loss = 1.258, top1 = 68.14%], test : [loss = 1.247, top1 = 68.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.57%], valid : [loss = 2.336, top1 = 40.50%], test : [loss = 2.346, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.64%], valid : [loss = 0.603, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6980/15625) 006980-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.56 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.334, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.52 ms.
cifar100       train : [loss = 0.139, top1 = 97.22%], valid : [loss = 1.284, top1 = 69.30%], test : [loss = 1.316, top1 = 68.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.06%], valid : [loss = 2.250, top1 = 42.53%], test : [loss = 2.239, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.53%], valid : [loss = 0.689, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6981/15625) 006981-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.68%], valid : [loss = 0.735, top1 = 75.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.14 ms.
cifar10        train : [loss = 0.448, top1 = 84.48%], test  : [loss = 0.610, top1 = 79.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.17 ms.
cifar100       train : [loss = 1.694, top1 = 53.64%], valid : [loss = 1.961, top1 = 49.10%], test : [loss = 1.980, top1 = 49.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 3.399, top1 = 19.70%], valid : [loss = 3.443, top1 = 19.13%], test : [loss = 3.473, top1 = 18.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 53.86%], valid : [loss = 1.320, top1 = 52.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6982/15625) 006982-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.480, top1 = 90.31%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.91 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.305, top1 = 93.47%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.13 ms.
cifar100       train : [loss = 0.096, top1 = 98.21%], valid : [loss = 1.269, top1 = 70.48%], test : [loss = 1.262, top1 = 70.36%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.23 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.45%], valid : [loss = 2.146, top1 = 44.57%], test : [loss = 2.130, top1 = 45.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.68%], valid : [loss = 0.783, top1 = 72.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6983/15625) 006983-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.505, top1 = 88.72%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=22.51 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.10%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.61 ms.
cifar100       train : [loss = 0.244, top1 = 94.00%], valid : [loss = 1.245, top1 = 68.56%], test : [loss = 1.229, top1 = 69.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.45%], valid : [loss = 2.270, top1 = 41.33%], test : [loss = 2.287, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.42%], valid : [loss = 0.655, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6984/15625) 006984-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.37%], valid : [loss = 0.928, top1 = 67.99%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10        train : [loss = 0.701, top1 = 75.34%], test  : [loss = 0.751, top1 = 73.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.27 ms.
cifar100       train : [loss = 2.226, top1 = 41.05%], valid : [loss = 2.311, top1 = 39.18%], test : [loss = 2.335, top1 = 39.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 3.491, top1 = 17.84%], valid : [loss = 3.461, top1 = 18.97%], test : [loss = 3.483, top1 = 17.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.374, top1 = 49.68%], valid : [loss = 1.416, top1 = 48.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6985/15625) 006985-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.11%], valid : [loss = 0.448, top1 = 87.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.25 ms.
cifar10        train : [loss = 0.109, top1 = 96.66%], test  : [loss = 0.327, top1 = 89.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.73 ms.
cifar100       train : [loss = 0.867, top1 = 75.40%], valid : [loss = 1.298, top1 = 63.84%], test : [loss = 1.264, top1 = 64.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.51%], valid : [loss = 2.631, top1 = 34.77%], test : [loss = 2.652, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.76%], valid : [loss = 0.671, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6986/15625) 006986-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.524, top1 = 88.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.337, top1 = 91.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.348, top1 = 90.53%], valid : [loss = 1.273, top1 = 67.08%], test : [loss = 1.281, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.47%], valid : [loss = 2.396, top1 = 38.53%], test : [loss = 2.413, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6987/15625) 006987-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.500, top1 = 89.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.307, top1 = 92.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.39 ms.
cifar100       train : [loss = 0.210, top1 = 94.72%], valid : [loss = 1.241, top1 = 69.00%], test : [loss = 1.209, top1 = 69.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.92%], valid : [loss = 2.229, top1 = 41.83%], test : [loss = 2.181, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.44%], valid : [loss = 0.770, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6988/15625) 006988-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.53%], valid : [loss = 0.848, top1 = 72.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10        train : [loss = 0.564, top1 = 80.39%], test  : [loss = 0.717, top1 = 75.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.16 ms.
cifar100       train : [loss = 1.806, top1 = 51.36%], valid : [loss = 2.066, top1 = 45.94%], test : [loss = 2.121, top1 = 46.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.63 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.79%], valid : [loss = 3.638, top1 = 16.90%], test : [loss = 3.660, top1 = 15.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 56.36%], valid : [loss = 1.273, top1 = 54.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6989/15625) 006989-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.514, top1 = 89.76%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.35 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.295, top1 = 93.50%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.11 ms.
cifar100       train : [loss = 0.063, top1 = 99.03%], valid : [loss = 1.328, top1 = 69.68%], test : [loss = 1.317, top1 = 71.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.89 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.68%], valid : [loss = 2.310, top1 = 41.77%], test : [loss = 2.281, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.61%], valid : [loss = 0.853, top1 = 69.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6990/15625) 006990-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.15%], valid : [loss = 0.517, top1 = 87.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10        train : [loss = 0.070, top1 = 97.78%], test  : [loss = 0.364, top1 = 89.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.98 ms.
cifar100       train : [loss = 0.676, top1 = 80.11%], valid : [loss = 1.362, top1 = 64.00%], test : [loss = 1.313, top1 = 64.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.431, top1 = 38.11%], valid : [loss = 2.543, top1 = 35.93%], test : [loss = 2.586, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.46%], valid : [loss = 0.672, top1 = 76.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6991/15625) 006991-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.527, top1 = 88.25%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.47 ms.
cifar10        train : [loss = 0.022, top1 = 99.43%], test  : [loss = 0.371, top1 = 90.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.01 ms.
cifar100       train : [loss = 0.385, top1 = 89.16%], valid : [loss = 1.311, top1 = 66.78%], test : [loss = 1.256, top1 = 67.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.11%], valid : [loss = 2.379, top1 = 39.80%], test : [loss = 2.416, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.46%], valid : [loss = 0.626, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6992/15625) 006992-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.628, top1 = 87.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.57 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.411, top1 = 91.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=20.05 ms.
cifar100       train : [loss = 0.127, top1 = 97.44%], valid : [loss = 1.608, top1 = 65.24%], test : [loss = 1.592, top1 = 65.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.093, top1 = 45.70%], valid : [loss = 2.636, top1 = 35.80%], test : [loss = 2.673, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.53%], valid : [loss = 0.769, top1 = 73.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6993/15625) 006993-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.430, top1 = 91.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.294, top1 = 93.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.062, top1 = 99.22%], valid : [loss = 1.383, top1 = 70.30%], test : [loss = 1.333, top1 = 70.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 1.516, top1 = 59.03%], valid : [loss = 2.267, top1 = 43.33%], test : [loss = 2.261, top1 = 44.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.369, top1 = 87.63%], valid : [loss = 0.503, top1 = 83.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6994/15625) 006994-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.523, top1 = 88.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.319, top1 = 92.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.52 ms.
cifar100       train : [loss = 0.344, top1 = 90.61%], valid : [loss = 1.266, top1 = 68.12%], test : [loss = 1.276, top1 = 67.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.39 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.62%], valid : [loss = 2.421, top1 = 38.40%], test : [loss = 2.416, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6995/15625) 006995-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.82%], valid : [loss = 0.580, top1 = 88.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=22.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.371, top1 = 91.62%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=15.97 ms.
cifar100       train : [loss = 0.258, top1 = 93.32%], valid : [loss = 1.568, top1 = 63.62%], test : [loss = 1.524, top1 = 63.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.45 ms.
ImageNet16-120 train : [loss = 2.856, top1 = 28.47%], valid : [loss = 2.967, top1 = 27.07%], test : [loss = 2.963, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.252, top1 = 54.44%], valid : [loss = 1.265, top1 = 54.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6996/15625) 006996-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.71 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.41%], valid : [loss = 0.578, top1 = 86.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.26 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.361, top1 = 91.20%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.21 ms.
cifar100       train : [loss = 0.629, top1 = 81.69%], valid : [loss = 1.445, top1 = 62.48%], test : [loss = 1.409, top1 = 63.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 36.72%], valid : [loss = 2.590, top1 = 33.23%], test : [loss = 2.587, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.23%], valid : [loss = 1.004, top1 = 64.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6997/15625) 006997-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.554, top1 = 88.53%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.55 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.365, top1 = 92.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.62 ms.
cifar100       train : [loss = 0.125, top1 = 97.36%], valid : [loss = 1.413, top1 = 67.32%], test : [loss = 1.380, top1 = 68.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 39.84%], valid : [loss = 2.515, top1 = 35.83%], test : [loss = 2.550, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.109, top1 = 60.03%], valid : [loss = 1.127, top1 = 59.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6998/15625) 006998-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.571, top1 = 87.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.385, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 0.392, top1 = 88.89%], valid : [loss = 1.421, top1 = 64.70%], test : [loss = 1.394, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.01%], valid : [loss = 2.510, top1 = 36.77%], test : [loss = 2.526, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.96%], valid : [loss = 0.815, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 6999/15625) 006999-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.12 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.277, top1 = 93.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.16 ms.
cifar100       train : [loss = 0.066, top1 = 99.10%], valid : [loss = 1.383, top1 = 69.04%], test : [loss = 1.359, top1 = 70.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.545, top1 = 58.25%], valid : [loss = 2.258, top1 = 43.50%], test : [loss = 2.335, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.08%], valid : [loss = 0.513, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7000/15625) 007000-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.01%], valid : [loss = 0.754, top1 = 74.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.52 ms.
cifar10        train : [loss = 0.526, top1 = 81.77%], test  : [loss = 0.597, top1 = 79.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 1.970, top1 = 46.56%], valid : [loss = 2.093, top1 = 43.94%], test : [loss = 2.103, top1 = 43.91%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.37 ms.
ImageNet16-120 train : [loss = 3.017, top1 = 26.27%], valid : [loss = 3.008, top1 = 26.59%], test : [loss = 3.039, top1 = 26.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7001/15625) 007001-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.52 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7002/15625) 007002-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.567, top1 = 89.09%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.372, top1 = 92.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.21 ms.
cifar100       train : [loss = 0.102, top1 = 98.13%], valid : [loss = 1.441, top1 = 67.68%], test : [loss = 1.432, top1 = 68.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.71%], valid : [loss = 2.441, top1 = 39.63%], test : [loss = 2.467, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 78.97%], valid : [loss = 0.692, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7003/15625) 007003-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.571, top1 = 88.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.397, top1 = 91.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.25 ms.
cifar100       train : [loss = 0.179, top1 = 96.14%], valid : [loss = 1.444, top1 = 65.72%], test : [loss = 1.465, top1 = 66.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.83%], valid : [loss = 2.458, top1 = 37.87%], test : [loss = 2.449, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.50%], valid : [loss = 0.705, top1 = 75.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7004/15625) 007004-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.616, top1 = 86.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10        train : [loss = 0.024, top1 = 99.47%], test  : [loss = 0.419, top1 = 89.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.22 ms.
cifar100       train : [loss = 0.385, top1 = 89.68%], valid : [loss = 1.439, top1 = 64.84%], test : [loss = 1.406, top1 = 65.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.59%], valid : [loss = 2.624, top1 = 34.83%], test : [loss = 2.641, top1 = 35.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7005/15625) 007005-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.572, top1 = 87.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.382, top1 = 91.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.383, top1 = 89.22%], valid : [loss = 1.367, top1 = 66.53%], test : [loss = 1.378, top1 = 66.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.89%], valid : [loss = 2.480, top1 = 37.51%], test : [loss = 2.501, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.93%], valid : [loss = 0.763, top1 = 73.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7006/15625) 007006-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.74%], valid : [loss = 0.656, top1 = 77.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.540, top1 = 81.07%], test  : [loss = 0.593, top1 = 79.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.93 ms.
cifar100       train : [loss = 1.742, top1 = 52.81%], valid : [loss = 1.887, top1 = 50.06%], test : [loss = 1.900, top1 = 49.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.30 ms.
ImageNet16-120 train : [loss = 3.393, top1 = 19.96%], valid : [loss = 3.367, top1 = 21.43%], test : [loss = 3.418, top1 = 19.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.379, top1 = 49.75%], valid : [loss = 1.391, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7007/15625) 007007-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.731, top1 = 83.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10        train : [loss = 0.051, top1 = 98.44%], test  : [loss = 0.451, top1 = 88.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.571, top1 = 83.33%], valid : [loss = 1.585, top1 = 61.10%], test : [loss = 1.533, top1 = 61.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.61%], valid : [loss = 2.735, top1 = 31.67%], test : [loss = 2.781, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.48%], valid : [loss = 0.895, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7008/15625) 007008-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.83 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.64%], valid : [loss = 0.585, top1 = 86.94%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10        train : [loss = 0.038, top1 = 98.89%], test  : [loss = 0.408, top1 = 89.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.97 ms.
cifar100       train : [loss = 0.559, top1 = 83.42%], valid : [loss = 1.406, top1 = 63.96%], test : [loss = 1.400, top1 = 63.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.24%], valid : [loss = 2.628, top1 = 33.90%], test : [loss = 2.665, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7009/15625) 007009-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=21.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.510, top1 = 89.81%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.80 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.339, top1 = 93.18%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.92 ms.
cifar100       train : [loss = 0.063, top1 = 99.09%], valid : [loss = 1.346, top1 = 69.80%], test : [loss = 1.333, top1 = 70.42%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.07%], valid : [loss = 2.332, top1 = 41.63%], test : [loss = 2.310, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.76%], valid : [loss = 0.751, top1 = 73.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7010/15625) 007010-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.49%], valid : [loss = 0.632, top1 = 85.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.43 ms.
cifar10        train : [loss = 0.057, top1 = 98.27%], test  : [loss = 0.393, top1 = 89.42%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.69 ms.
cifar100       train : [loss = 0.622, top1 = 81.73%], valid : [loss = 1.386, top1 = 63.40%], test : [loss = 1.382, top1 = 64.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.464, top1 = 37.52%], valid : [loss = 2.608, top1 = 33.97%], test : [loss = 2.601, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.46%], valid : [loss = 0.810, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7011/15625) 007011-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.341, top1 = 88.10%], valid : [loss = 0.574, top1 = 81.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.51 ms.
cifar10        train : [loss = 0.292, top1 = 89.87%], test  : [loss = 0.436, top1 = 85.52%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.06 ms.
cifar100       train : [loss = 1.499, top1 = 57.99%], valid : [loss = 1.745, top1 = 52.92%], test : [loss = 1.739, top1 = 52.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 3.051, top1 = 25.77%], valid : [loss = 3.042, top1 = 26.47%], test : [loss = 3.088, top1 = 24.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 63.85%], valid : [loss = 1.037, top1 = 63.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7012/15625) 007012-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.31%], valid : [loss = 0.581, top1 = 85.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10        train : [loss = 0.075, top1 = 97.71%], test  : [loss = 0.379, top1 = 89.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.05 ms.
cifar100       train : [loss = 0.743, top1 = 78.39%], valid : [loss = 1.364, top1 = 63.38%], test : [loss = 1.380, top1 = 63.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.448, top1 = 37.55%], valid : [loss = 2.555, top1 = 35.50%], test : [loss = 2.583, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.23%], valid : [loss = 0.858, top1 = 69.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7013/15625) 007013-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.487, top1 = 89.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.81 ms.
cifar100       train : [loss = 0.316, top1 = 91.57%], valid : [loss = 1.247, top1 = 67.79%], test : [loss = 1.257, top1 = 67.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.61%], valid : [loss = 2.349, top1 = 40.17%], test : [loss = 2.366, top1 = 39.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.77%], valid : [loss = 0.633, top1 = 78.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7014/15625) 007014-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.138, top1 = 95.63%], valid : [loss = 0.461, top1 = 85.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10        train : [loss = 0.168, top1 = 94.57%], test  : [loss = 0.363, top1 = 88.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.40 ms.
cifar100       train : [loss = 0.967, top1 = 72.72%], valid : [loss = 1.368, top1 = 61.44%], test : [loss = 1.374, top1 = 61.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.597, top1 = 34.68%], valid : [loss = 2.670, top1 = 33.27%], test : [loss = 2.707, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.25%], valid : [loss = 0.915, top1 = 67.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7015/15625) 007015-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.40%], valid : [loss = 0.661, top1 = 77.65%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.38 ms.
cifar10        train : [loss = 0.522, top1 = 81.92%], test  : [loss = 0.597, top1 = 79.85%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.58 ms.
cifar100       train : [loss = 1.701, top1 = 53.72%], valid : [loss = 1.866, top1 = 50.13%], test : [loss = 1.873, top1 = 50.76%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.88 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.27%], valid : [loss = 3.301, top1 = 21.99%], test : [loss = 3.345, top1 = 21.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7016/15625) 007016-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.531, top1 = 88.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.332, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.49 ms.
cifar100       train : [loss = 0.308, top1 = 91.59%], valid : [loss = 1.279, top1 = 68.44%], test : [loss = 1.273, top1 = 67.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.41 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 43.72%], valid : [loss = 2.432, top1 = 38.80%], test : [loss = 2.423, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.859, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7017/15625) 007017-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.02%], valid : [loss = 0.480, top1 = 84.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10        train : [loss = 0.299, top1 = 89.91%], test  : [loss = 0.399, top1 = 86.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.78 ms.
cifar100       train : [loss = 1.321, top1 = 63.37%], valid : [loss = 1.533, top1 = 58.16%], test : [loss = 1.502, top1 = 58.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.73%], valid : [loss = 2.899, top1 = 28.53%], test : [loss = 2.967, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7018/15625) 007018-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.63 ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.11%], valid : [loss = 0.729, top1 = 74.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10        train : [loss = 0.556, top1 = 80.77%], test  : [loss = 0.619, top1 = 78.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.14 ms.
cifar100       train : [loss = 1.977, top1 = 46.92%], valid : [loss = 2.114, top1 = 44.48%], test : [loss = 2.102, top1 = 44.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.08 ms.
ImageNet16-120 train : [loss = 3.251, top1 = 22.05%], valid : [loss = 3.235, top1 = 22.56%], test : [loss = 3.274, top1 = 21.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 54.01%], valid : [loss = 1.347, top1 = 51.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7019/15625) 007019-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.595, top1 = 86.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.040, top1 = 98.82%], test  : [loss = 0.405, top1 = 90.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.34 ms.
cifar100       train : [loss = 0.557, top1 = 83.78%], valid : [loss = 1.403, top1 = 64.32%], test : [loss = 1.397, top1 = 64.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.88%], valid : [loss = 2.584, top1 = 36.03%], test : [loss = 2.658, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.62%], valid : [loss = 0.732, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7020/15625) 007020-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.88%], valid : [loss = 0.563, top1 = 82.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.255, top1 = 91.27%], test  : [loss = 0.413, top1 = 86.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 1.337, top1 = 62.21%], valid : [loss = 1.613, top1 = 56.09%], test : [loss = 1.586, top1 = 56.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.899, top1 = 28.78%], valid : [loss = 2.893, top1 = 28.80%], test : [loss = 2.952, top1 = 28.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.06%], valid : [loss = 1.029, top1 = 63.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7021/15625) 007021-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.605, top1 = 87.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.399, top1 = 91.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.63 ms.
cifar100       train : [loss = 0.231, top1 = 94.18%], valid : [loss = 1.516, top1 = 64.77%], test : [loss = 1.503, top1 = 65.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.12%], valid : [loss = 2.461, top1 = 37.70%], test : [loss = 2.482, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 74.99%], valid : [loss = 0.778, top1 = 72.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7022/15625) 007022-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.57%], valid : [loss = 0.774, top1 = 80.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.132, top1 = 95.53%], test  : [loss = 0.445, top1 = 86.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 0.915, top1 = 73.36%], valid : [loss = 1.657, top1 = 56.80%], test : [loss = 1.648, top1 = 57.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.780, top1 = 31.12%], valid : [loss = 2.922, top1 = 28.37%], test : [loss = 2.948, top1 = 28.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.02%], valid : [loss = 0.950, top1 = 66.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7023/15625) 007023-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.76 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.336, top1 = 92.88%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.52 ms.
cifar100       train : [loss = 0.082, top1 = 98.66%], valid : [loss = 1.354, top1 = 69.49%], test : [loss = 1.374, top1 = 69.03%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.03%], valid : [loss = 2.278, top1 = 41.99%], test : [loss = 2.290, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 81.09%], valid : [loss = 0.614, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7024/15625) 007024-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.584, top1 = 87.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.379, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 0.409, top1 = 88.32%], valid : [loss = 1.406, top1 = 65.10%], test : [loss = 1.373, top1 = 65.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.319, top1 = 40.48%], valid : [loss = 2.509, top1 = 36.49%], test : [loss = 2.544, top1 = 36.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.25%], valid : [loss = 0.819, top1 = 71.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7025/15625) 007025-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.20%], valid : [loss = 0.759, top1 = 73.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.542, top1 = 81.10%], test  : [loss = 0.606, top1 = 79.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 1.754, top1 = 52.46%], valid : [loss = 1.908, top1 = 49.34%], test : [loss = 1.924, top1 = 49.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 3.397, top1 = 19.92%], valid : [loss = 3.375, top1 = 20.80%], test : [loss = 3.424, top1 = 19.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.351, top1 = 51.46%], valid : [loss = 1.399, top1 = 49.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7026/15625) 007026-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.569, top1 = 88.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.391, top1 = 91.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.175, top1 = 96.15%], valid : [loss = 1.407, top1 = 67.35%], test : [loss = 1.412, top1 = 67.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.95%], valid : [loss = 2.471, top1 = 38.92%], test : [loss = 2.452, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7027/15625) 007027-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.46%], valid : [loss = 0.474, top1 = 85.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10        train : [loss = 0.157, top1 = 94.84%], test  : [loss = 0.336, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.46 ms.
cifar100       train : [loss = 0.994, top1 = 71.64%], valid : [loss = 1.352, top1 = 62.16%], test : [loss = 1.357, top1 = 61.90%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.80%], valid : [loss = 2.701, top1 = 32.30%], test : [loss = 2.719, top1 = 31.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7028/15625) 007028-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.19 ms.
cifar10-valid  train : [loss = 1.805, top1 = 34.80%], valid : [loss = 1.827, top1 = 33.88%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.75 ms.
cifar10        train : [loss = 1.195, top1 = 57.17%], test  : [loss = 1.201, top1 = 56.41%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.30 ms.
cifar100       train : [loss = 3.768, top1 = 12.54%], valid : [loss = 3.856, top1 = 10.79%], test : [loss = 3.848, top1 = 11.67%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.00 ms.
ImageNet16-120 train : [loss = 3.775, top1 = 13.69%], valid : [loss = 3.740, top1 = 14.80%], test : [loss = 3.752, top1 = 14.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7029/15625) 007029-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.554, top1 = 89.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.373, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.35 ms.
cifar100       train : [loss = 0.103, top1 = 98.09%], valid : [loss = 1.473, top1 = 67.77%], test : [loss = 1.467, top1 = 67.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 1.881, top1 = 50.34%], valid : [loss = 2.449, top1 = 39.23%], test : [loss = 2.467, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7030/15625) 007030-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.286, top1 = 93.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.183, top1 = 95.73%], valid : [loss = 1.281, top1 = 69.51%], test : [loss = 1.284, top1 = 69.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.62%], valid : [loss = 2.255, top1 = 42.57%], test : [loss = 2.303, top1 = 42.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.33%], valid : [loss = 0.505, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7031/15625) 007031-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.420, top1 = 90.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.283, top1 = 93.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.34 ms.
cifar100       train : [loss = 0.187, top1 = 95.58%], valid : [loss = 1.282, top1 = 69.21%], test : [loss = 1.245, top1 = 69.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.53%], valid : [loss = 2.263, top1 = 42.91%], test : [loss = 2.280, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7032/15625) 007032-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.534, top1 = 88.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.343, top1 = 91.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.30 ms.
cifar100       train : [loss = 0.336, top1 = 90.90%], valid : [loss = 1.287, top1 = 67.22%], test : [loss = 1.281, top1 = 67.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.46%], valid : [loss = 2.420, top1 = 38.24%], test : [loss = 2.417, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7033/15625) 007033-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.371, top1 = 92.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.30 ms.
cifar100       train : [loss = 0.074, top1 = 98.84%], valid : [loss = 1.528, top1 = 67.54%], test : [loss = 1.513, top1 = 67.49%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.44%], valid : [loss = 2.366, top1 = 41.16%], test : [loss = 2.380, top1 = 41.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.33%], valid : [loss = 0.676, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7034/15625) 007034-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.577, top1 = 88.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.362, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.81 ms.
cifar100       train : [loss = 0.169, top1 = 96.39%], valid : [loss = 1.418, top1 = 67.19%], test : [loss = 1.388, top1 = 67.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.04%], valid : [loss = 2.463, top1 = 38.50%], test : [loss = 2.474, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.84%], valid : [loss = 0.691, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7035/15625) 007035-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.53%], valid : [loss = 0.565, top1 = 87.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.372, top1 = 90.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.497, top1 = 85.80%], valid : [loss = 1.338, top1 = 65.04%], test : [loss = 1.331, top1 = 65.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 35.90%], valid : [loss = 2.612, top1 = 34.21%], test : [loss = 2.632, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7036/15625) 007036-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.50%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.95 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.318, top1 = 93.25%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.95 ms.
cifar100       train : [loss = 0.079, top1 = 98.68%], valid : [loss = 1.335, top1 = 69.92%], test : [loss = 1.331, top1 = 69.91%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.87 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.54%], valid : [loss = 2.248, top1 = 43.10%], test : [loss = 2.256, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.95%], valid : [loss = 0.663, top1 = 77.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7037/15625) 007037-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.470, top1 = 89.04%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.306, top1 = 92.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.15 ms.
cifar100       train : [loss = 0.319, top1 = 91.41%], valid : [loss = 1.236, top1 = 67.95%], test : [loss = 1.231, top1 = 67.99%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.76%], valid : [loss = 2.314, top1 = 41.16%], test : [loss = 2.353, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.58%], valid : [loss = 0.618, top1 = 78.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7038/15625) 007038-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.63%], valid : [loss = 0.628, top1 = 86.21%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.86 ms.
cifar10        train : [loss = 0.026, top1 = 99.30%], test  : [loss = 0.392, top1 = 90.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.60 ms.
cifar100       train : [loss = 0.453, top1 = 86.90%], valid : [loss = 1.438, top1 = 64.31%], test : [loss = 1.449, top1 = 63.59%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.81%], valid : [loss = 2.508, top1 = 36.74%], test : [loss = 2.529, top1 = 36.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.50%], valid : [loss = 0.837, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7039/15625) 007039-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.497, top1 = 88.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.318, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.98 ms.
cifar100       train : [loss = 0.234, top1 = 94.23%], valid : [loss = 1.252, top1 = 68.39%], test : [loss = 1.235, top1 = 68.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.23%], valid : [loss = 2.270, top1 = 42.07%], test : [loss = 2.294, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7040/15625) 007040-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.63%], valid : [loss = 0.625, top1 = 86.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.409, top1 = 90.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.48 ms.
cifar100       train : [loss = 0.515, top1 = 84.95%], valid : [loss = 1.442, top1 = 63.51%], test : [loss = 1.431, top1 = 63.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.369, top1 = 39.35%], valid : [loss = 2.567, top1 = 35.46%], test : [loss = 2.568, top1 = 35.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.48%], valid : [loss = 0.856, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7041/15625) 007041-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.152, top1 = 95.13%], valid : [loss = 0.506, top1 = 85.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10        train : [loss = 0.172, top1 = 94.26%], test  : [loss = 0.372, top1 = 88.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 1.034, top1 = 70.34%], valid : [loss = 1.384, top1 = 61.82%], test : [loss = 1.389, top1 = 61.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.25 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.47%], valid : [loss = 2.658, top1 = 34.04%], test : [loss = 2.714, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 68.10%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7042/15625) 007042-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.49%], valid : [loss = 0.954, top1 = 80.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.049, top1 = 98.54%], test  : [loss = 0.655, top1 = 84.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.473, top1 = 86.94%], valid : [loss = 1.829, top1 = 57.43%], test : [loss = 1.810, top1 = 57.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 31.00%], valid : [loss = 3.137, top1 = 24.94%], test : [loss = 3.151, top1 = 24.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 65.09%], valid : [loss = 1.042, top1 = 62.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7043/15625) 007043-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.524, top1 = 88.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.329, top1 = 92.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.52 ms.
cifar100       train : [loss = 0.338, top1 = 90.90%], valid : [loss = 1.295, top1 = 67.05%], test : [loss = 1.278, top1 = 67.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.74%], valid : [loss = 2.404, top1 = 38.98%], test : [loss = 2.428, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7044/15625) 007044-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.45%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.345, top1 = 91.93%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.53 ms.
cifar100       train : [loss = 0.343, top1 = 90.60%], valid : [loss = 1.296, top1 = 66.61%], test : [loss = 1.297, top1 = 67.19%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.33%], valid : [loss = 2.412, top1 = 38.81%], test : [loss = 2.457, top1 = 37.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.52%], valid : [loss = 0.716, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7045/15625) 007045-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.25%], valid : [loss = 0.458, top1 = 86.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10        train : [loss = 0.113, top1 = 96.54%], test  : [loss = 0.331, top1 = 89.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.16 ms.
cifar100       train : [loss = 0.870, top1 = 75.23%], valid : [loss = 1.310, top1 = 63.78%], test : [loss = 1.295, top1 = 63.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.76%], valid : [loss = 2.622, top1 = 34.61%], test : [loss = 2.644, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7046/15625) 007046-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.98%], valid : [loss = 0.738, top1 = 83.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10        train : [loss = 0.085, top1 = 97.27%], test  : [loss = 0.483, top1 = 86.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.27 ms.
cifar100       train : [loss = 0.799, top1 = 76.78%], valid : [loss = 1.549, top1 = 59.75%], test : [loss = 1.514, top1 = 60.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 30.54%], valid : [loss = 2.918, top1 = 28.49%], test : [loss = 2.977, top1 = 27.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7047/15625) 007047-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.544, top1 = 88.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.374, top1 = 91.89%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.04 ms.
cifar100       train : [loss = 0.137, top1 = 97.34%], valid : [loss = 1.438, top1 = 66.90%], test : [loss = 1.447, top1 = 67.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.06 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.20%], valid : [loss = 2.396, top1 = 40.12%], test : [loss = 2.413, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.99%], valid : [loss = 0.664, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7048/15625) 007048-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.439, top1 = 90.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.296, top1 = 92.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.187, top1 = 95.54%], valid : [loss = 1.334, top1 = 68.55%], test : [loss = 1.294, top1 = 69.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.29%], valid : [loss = 2.265, top1 = 42.13%], test : [loss = 2.289, top1 = 42.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.15%], valid : [loss = 0.552, top1 = 81.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7049/15625) 007049-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.92%], valid : [loss = 0.849, top1 = 71.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.681, top1 = 76.12%], test  : [loss = 0.767, top1 = 73.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.961, top1 = 47.85%], valid : [loss = 2.132, top1 = 44.90%], test : [loss = 2.167, top1 = 44.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.77%], valid : [loss = 3.674, top1 = 16.04%], test : [loss = 3.694, top1 = 14.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7050/15625) 007050-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.27 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.02 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7051/15625) 007051-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.41%], valid : [loss = 0.551, top1 = 83.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.202, top1 = 93.16%], test  : [loss = 0.399, top1 = 87.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.32 ms.
cifar100       train : [loss = 1.283, top1 = 63.67%], valid : [loss = 1.578, top1 = 56.95%], test : [loss = 1.578, top1 = 56.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.699, top1 = 32.68%], valid : [loss = 2.737, top1 = 31.78%], test : [loss = 2.779, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.06%], valid : [loss = 0.966, top1 = 65.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7052/15625) 007052-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.77%], valid : [loss = 0.610, top1 = 86.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.029, top1 = 99.18%], test  : [loss = 0.407, top1 = 90.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.25 ms.
cifar100       train : [loss = 0.500, top1 = 85.42%], valid : [loss = 1.410, top1 = 64.55%], test : [loss = 1.395, top1 = 64.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.28%], valid : [loss = 2.543, top1 = 36.10%], test : [loss = 2.575, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.66%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7053/15625) 007053-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.36%], valid : [loss = 0.707, top1 = 84.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10        train : [loss = 0.053, top1 = 98.38%], test  : [loss = 0.438, top1 = 88.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.24 ms.
cifar100       train : [loss = 0.625, top1 = 81.67%], valid : [loss = 1.518, top1 = 61.25%], test : [loss = 1.485, top1 = 62.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.54 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.77%], valid : [loss = 2.796, top1 = 30.89%], test : [loss = 2.847, top1 = 30.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.27%], valid : [loss = 0.878, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7054/15625) 007054-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.457, top1 = 90.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.321, top1 = 93.39%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.79 ms.
cifar100       train : [loss = 0.063, top1 = 99.07%], valid : [loss = 1.397, top1 = 69.59%], test : [loss = 1.395, top1 = 69.67%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.87%], valid : [loss = 2.307, top1 = 42.17%], test : [loss = 2.317, top1 = 42.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.87%], valid : [loss = 0.611, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7055/15625) 007055-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.625, top1 = 87.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.410, top1 = 90.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.228, top1 = 94.47%], valid : [loss = 1.535, top1 = 64.91%], test : [loss = 1.543, top1 = 64.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.94%], valid : [loss = 2.520, top1 = 36.68%], test : [loss = 2.554, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.30%], valid : [loss = 0.784, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7056/15625) 007056-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.505, top1 = 89.23%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.328, top1 = 92.72%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.74 ms.
cifar100       train : [loss = 0.148, top1 = 96.83%], valid : [loss = 1.295, top1 = 69.10%], test : [loss = 1.310, top1 = 69.03%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.95 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.57%], valid : [loss = 2.297, top1 = 42.12%], test : [loss = 2.288, top1 = 42.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.07%], valid : [loss = 0.743, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7057/15625) 007057-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.501, top1 = 89.44%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.307, top1 = 93.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.66 ms.
cifar100       train : [loss = 0.124, top1 = 97.57%], valid : [loss = 1.305, top1 = 69.23%], test : [loss = 1.309, top1 = 69.25%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.62%], valid : [loss = 2.282, top1 = 42.06%], test : [loss = 2.281, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.79%], valid : [loss = 0.645, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7058/15625) 007058-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.524, top1 = 88.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.340, top1 = 92.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.02 ms.
cifar100       train : [loss = 0.337, top1 = 90.80%], valid : [loss = 1.289, top1 = 67.00%], test : [loss = 1.287, top1 = 67.35%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.40%], valid : [loss = 2.407, top1 = 39.06%], test : [loss = 2.411, top1 = 38.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7059/15625) 007059-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.540, top1 = 88.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.25 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.343, top1 = 92.37%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.99 ms.
cifar100       train : [loss = 0.136, top1 = 96.84%], valid : [loss = 1.354, top1 = 68.87%], test : [loss = 1.371, top1 = 68.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.64 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.44%], valid : [loss = 2.263, top1 = 42.23%], test : [loss = 2.269, top1 = 41.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 66.98%], valid : [loss = 0.944, top1 = 66.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7060/15625) 007060-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.63%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.326, top1 = 93.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.24 ms.
cifar100       train : [loss = 0.072, top1 = 98.86%], valid : [loss = 1.385, top1 = 69.41%], test : [loss = 1.386, top1 = 69.57%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.19%], valid : [loss = 2.369, top1 = 39.54%], test : [loss = 2.378, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7061/15625) 007061-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.40%], valid : [loss = 0.802, top1 = 72.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10        train : [loss = 0.633, top1 = 77.76%], test  : [loss = 0.694, top1 = 76.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.19 ms.
cifar100       train : [loss = 2.146, top1 = 42.53%], valid : [loss = 2.285, top1 = 39.99%], test : [loss = 2.278, top1 = 40.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 3.389, top1 = 19.48%], valid : [loss = 3.386, top1 = 19.31%], test : [loss = 3.420, top1 = 19.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.68%], valid : [loss = 1.319, top1 = 52.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7062/15625) 007062-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.95 ms.
cifar10-valid  train : [loss = 1.290, top1 = 53.59%], valid : [loss = 1.349, top1 = 51.88%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 1.281, top1 = 54.12%], test  : [loss = 1.286, top1 = 54.04%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.61 ms.
cifar100       train : [loss = 2.832, top1 = 29.46%], valid : [loss = 2.932, top1 = 28.02%], test : [loss = 2.916, top1 = 28.44%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.05 ms.
ImageNet16-120 train : [loss = 3.976, top1 = 10.77%], valid : [loss = 3.974, top1 = 11.08%], test : [loss = 3.989, top1 = 10.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.855, top1 = 31.08%], valid : [loss = 1.824, top1 = 31.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7063/15625) 007063-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.538, top1 = 88.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.370, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.43 ms.
cifar100       train : [loss = 0.107, top1 = 97.86%], valid : [loss = 1.474, top1 = 67.38%], test : [loss = 1.484, top1 = 67.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.96%], valid : [loss = 2.377, top1 = 40.36%], test : [loss = 2.391, top1 = 40.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.09%], valid : [loss = 0.713, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7064/15625) 007064-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.527, top1 = 89.30%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.60 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.338, top1 = 92.75%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.99 ms.
cifar100       train : [loss = 0.070, top1 = 98.79%], valid : [loss = 1.417, top1 = 69.47%], test : [loss = 1.416, top1 = 69.57%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.208, top1 = 42.58%], valid : [loss = 2.450, top1 = 37.77%], test : [loss = 2.453, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.60%], valid : [loss = 0.815, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7065/15625) 007065-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.239, top1 = 91.89%], valid : [loss = 0.532, top1 = 83.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.242, top1 = 91.72%], test  : [loss = 0.401, top1 = 86.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 1.352, top1 = 61.98%], valid : [loss = 1.601, top1 = 56.33%], test : [loss = 1.585, top1 = 56.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.860, top1 = 29.53%], valid : [loss = 2.867, top1 = 29.49%], test : [loss = 2.922, top1 = 28.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.01%], valid : [loss = 1.012, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7066/15625) 007066-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.20 ms.
cifar10-valid  train : [loss = 1.193, top1 = 57.38%], valid : [loss = 1.237, top1 = 56.05%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.16 ms.
cifar10        train : [loss = 1.155, top1 = 58.79%], test  : [loss = 1.150, top1 = 58.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.66 ms.
cifar100       train : [loss = 2.695, top1 = 32.60%], valid : [loss = 2.776, top1 = 31.25%], test : [loss = 2.758, top1 = 31.57%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.54 ms.
ImageNet16-120 train : [loss = 3.871, top1 = 12.45%], valid : [loss = 3.865, top1 = 13.07%], test : [loss = 3.890, top1 = 12.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7067/15625) 007067-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.71%], valid : [loss = 0.561, top1 = 87.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.021, top1 = 99.42%], test  : [loss = 0.382, top1 = 91.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.58 ms.
cifar100       train : [loss = 0.276, top1 = 92.30%], valid : [loss = 1.471, top1 = 65.28%], test : [loss = 1.499, top1 = 65.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.782, top1 = 30.22%], valid : [loss = 2.847, top1 = 29.49%], test : [loss = 2.872, top1 = 28.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.332, top1 = 51.72%], valid : [loss = 1.340, top1 = 51.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7068/15625) 007068-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.77%], valid : [loss = 0.590, top1 = 86.54%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.22 ms.
cifar10        train : [loss = 0.034, top1 = 99.12%], test  : [loss = 0.416, top1 = 89.50%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.48 ms.
cifar100       train : [loss = 0.400, top1 = 88.98%], valid : [loss = 1.403, top1 = 64.85%], test : [loss = 1.400, top1 = 64.79%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.01%], valid : [loss = 2.550, top1 = 36.29%], test : [loss = 2.572, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.57%], valid : [loss = 0.766, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7069/15625) 007069-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.438, top1 = 89.68%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.21 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.312, top1 = 92.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.05 ms.
cifar100       train : [loss = 0.209, top1 = 95.09%], valid : [loss = 1.265, top1 = 68.84%], test : [loss = 1.253, top1 = 69.49%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 1.870, top1 = 50.59%], valid : [loss = 2.234, top1 = 43.22%], test : [loss = 2.276, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.545, top1 = 81.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7070/15625) 007070-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.34%], valid : [loss = 0.619, top1 = 85.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.93 ms.
cifar10        train : [loss = 0.073, top1 = 97.75%], test  : [loss = 0.400, top1 = 88.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.60 ms.
cifar100       train : [loss = 0.715, top1 = 79.20%], valid : [loss = 1.393, top1 = 63.53%], test : [loss = 1.366, top1 = 63.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 36.08%], valid : [loss = 2.649, top1 = 33.74%], test : [loss = 2.700, top1 = 33.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.55%], valid : [loss = 0.786, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7071/15625) 007071-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.619, top1 = 86.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.430, top1 = 90.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.91 ms.
cifar100       train : [loss = 0.216, top1 = 94.96%], valid : [loss = 1.516, top1 = 65.43%], test : [loss = 1.501, top1 = 65.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.97%], valid : [loss = 2.556, top1 = 36.16%], test : [loss = 2.571, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.12%], valid : [loss = 0.766, top1 = 73.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7072/15625) 007072-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.96%], valid : [loss = 0.543, top1 = 85.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.47 ms.
cifar10        train : [loss = 0.087, top1 = 97.29%], test  : [loss = 0.356, top1 = 89.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.761, top1 = 77.91%], valid : [loss = 1.382, top1 = 62.76%], test : [loss = 1.385, top1 = 62.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 2.467, top1 = 37.24%], valid : [loss = 2.583, top1 = 35.22%], test : [loss = 2.610, top1 = 34.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 67.85%], valid : [loss = 0.955, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7073/15625) 007073-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.78%], valid : [loss = 0.508, top1 = 88.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.351, top1 = 91.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.78 ms.
cifar100       train : [loss = 0.478, top1 = 86.06%], valid : [loss = 1.357, top1 = 65.64%], test : [loss = 1.337, top1 = 65.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.33%], valid : [loss = 2.507, top1 = 36.97%], test : [loss = 2.552, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7074/15625) 007074-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.55%], valid : [loss = 0.451, top1 = 87.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10        train : [loss = 0.058, top1 = 98.52%], test  : [loss = 0.320, top1 = 90.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.590, top1 = 83.77%], valid : [loss = 1.227, top1 = 66.24%], test : [loss = 1.209, top1 = 66.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 41.04%], valid : [loss = 2.469, top1 = 37.62%], test : [loss = 2.485, top1 = 37.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.12%], valid : [loss = 0.652, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7075/15625) 007075-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.513, top1 = 89.07%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.22 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.334, top1 = 92.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.96 ms.
cifar100       train : [loss = 0.251, top1 = 93.35%], valid : [loss = 1.296, top1 = 68.16%], test : [loss = 1.288, top1 = 68.69%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.97%], valid : [loss = 2.242, top1 = 42.64%], test : [loss = 2.266, top1 = 42.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.08%], valid : [loss = 0.630, top1 = 78.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7076/15625) 007076-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.563, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.381, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.219, top1 = 94.60%], valid : [loss = 1.482, top1 = 65.72%], test : [loss = 1.485, top1 = 65.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.96 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.70%], valid : [loss = 2.472, top1 = 37.90%], test : [loss = 2.489, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.77%], valid : [loss = 0.778, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7077/15625) 007077-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.557, top1 = 87.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.355, top1 = 91.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.91 ms.
cifar100       train : [loss = 0.271, top1 = 92.46%], valid : [loss = 1.347, top1 = 67.00%], test : [loss = 1.335, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.62%], valid : [loss = 2.509, top1 = 36.07%], test : [loss = 2.519, top1 = 36.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.31%], valid : [loss = 0.964, top1 = 65.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7078/15625) 007078-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.08%], valid : [loss = 0.851, top1 = 71.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10        train : [loss = 0.571, top1 = 80.06%], test  : [loss = 0.717, top1 = 75.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.28 ms.
cifar100       train : [loss = 1.797, top1 = 51.72%], valid : [loss = 2.069, top1 = 46.36%], test : [loss = 2.076, top1 = 46.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 3.592, top1 = 16.72%], valid : [loss = 3.640, top1 = 16.54%], test : [loss = 3.670, top1 = 16.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.09%], valid : [loss = 1.257, top1 = 55.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7079/15625) 007079-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.511, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.336, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.12 ms.
cifar100       train : [loss = 0.131, top1 = 97.29%], valid : [loss = 1.299, top1 = 69.46%], test : [loss = 1.287, top1 = 69.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.39%], valid : [loss = 2.150, top1 = 44.77%], test : [loss = 2.169, top1 = 44.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.60%], valid : [loss = 0.666, top1 = 77.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7080/15625) 007080-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.28 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.45 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7081/15625) 007081-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.36 ms.
cifar10-valid  train : [loss = 0.541, top1 = 80.96%], valid : [loss = 0.857, top1 = 71.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10        train : [loss = 0.564, top1 = 80.27%], test  : [loss = 0.724, top1 = 75.50%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.29 ms.
cifar100       train : [loss = 1.781, top1 = 51.96%], valid : [loss = 2.044, top1 = 47.01%], test : [loss = 2.060, top1 = 46.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.90 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.80%], valid : [loss = 3.631, top1 = 16.86%], test : [loss = 3.673, top1 = 15.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7082/15625) 007082-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.581, top1 = 87.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.386, top1 = 91.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.33 ms.
cifar100       train : [loss = 0.361, top1 = 89.85%], valid : [loss = 1.400, top1 = 65.73%], test : [loss = 1.410, top1 = 65.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 42.04%], valid : [loss = 2.495, top1 = 36.74%], test : [loss = 2.511, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 71.92%], valid : [loss = 0.842, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7083/15625) 007083-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.43 ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.86%], valid : [loss = 0.737, top1 = 74.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.54 ms.
cifar10        train : [loss = 0.579, top1 = 79.85%], test  : [loss = 0.646, top1 = 78.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 2.025, top1 = 45.55%], valid : [loss = 2.164, top1 = 43.05%], test : [loss = 2.159, top1 = 43.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.51 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.40%], valid : [loss = 3.232, top1 = 22.89%], test : [loss = 3.238, top1 = 22.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.275, top1 = 54.26%], valid : [loss = 1.360, top1 = 51.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7084/15625) 007084-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.470, top1 = 83.47%], valid : [loss = 0.694, top1 = 77.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.423, top1 = 85.22%], test  : [loss = 0.554, top1 = 81.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.683, top1 = 53.78%], valid : [loss = 1.897, top1 = 49.38%], test : [loss = 1.898, top1 = 49.97%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 21.10%], valid : [loss = 3.325, top1 = 21.56%], test : [loss = 3.371, top1 = 20.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.179, top1 = 57.31%], valid : [loss = 1.241, top1 = 55.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7085/15625) 007085-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.56%], valid : [loss = 0.522, top1 = 86.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.077, top1 = 97.70%], test  : [loss = 0.346, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 0.668, top1 = 80.56%], valid : [loss = 1.303, top1 = 64.81%], test : [loss = 1.278, top1 = 65.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.31%], valid : [loss = 2.504, top1 = 36.57%], test : [loss = 2.511, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 70.95%], valid : [loss = 0.871, top1 = 69.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7086/15625) 007086-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.477, top1 = 89.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.313, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.64 ms.
cifar100       train : [loss = 0.278, top1 = 92.72%], valid : [loss = 1.251, top1 = 67.93%], test : [loss = 1.288, top1 = 67.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.81%], valid : [loss = 2.272, top1 = 41.73%], test : [loss = 2.290, top1 = 41.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.90%], valid : [loss = 0.585, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7087/15625) 007087-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.536, top1 = 88.93%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.370, top1 = 92.12%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.69 ms.
cifar100       train : [loss = 0.137, top1 = 97.35%], valid : [loss = 1.427, top1 = 67.77%], test : [loss = 1.425, top1 = 67.59%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.07%], valid : [loss = 2.427, top1 = 39.23%], test : [loss = 2.414, top1 = 40.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.12%], valid : [loss = 0.733, top1 = 74.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7088/15625) 007088-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.91%], valid : [loss = 0.817, top1 = 81.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.090, top1 = 97.05%], test  : [loss = 0.496, top1 = 86.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 0.823, top1 = 76.06%], valid : [loss = 1.565, top1 = 59.63%], test : [loss = 1.538, top1 = 60.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.64 ms.
ImageNet16-120 train : [loss = 2.827, top1 = 30.07%], valid : [loss = 2.951, top1 = 28.26%], test : [loss = 3.002, top1 = 27.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 71.00%], valid : [loss = 0.872, top1 = 69.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7089/15625) 007089-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.531, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.026, top1 = 99.28%], test  : [loss = 0.348, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.442, top1 = 87.20%], valid : [loss = 1.240, top1 = 67.23%], test : [loss = 1.244, top1 = 67.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.47%], valid : [loss = 2.380, top1 = 39.59%], test : [loss = 2.390, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7090/15625) 007090-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.55%], valid : [loss = 0.665, top1 = 77.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.36 ms.
cifar10        train : [loss = 0.518, top1 = 81.98%], test  : [loss = 0.596, top1 = 79.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.33 ms.
cifar100       train : [loss = 1.687, top1 = 54.19%], valid : [loss = 1.854, top1 = 50.75%], test : [loss = 1.870, top1 = 50.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.18 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.25%], valid : [loss = 3.317, top1 = 21.63%], test : [loss = 3.344, top1 = 20.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7091/15625) 007091-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.554, top1 = 87.51%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.07 ms.
cifar10        train : [loss = 0.038, top1 = 98.88%], test  : [loss = 0.397, top1 = 89.97%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.37 ms.
cifar100       train : [loss = 0.504, top1 = 85.83%], valid : [loss = 1.357, top1 = 64.83%], test : [loss = 1.359, top1 = 64.79%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.397, top1 = 38.69%], valid : [loss = 2.541, top1 = 35.81%], test : [loss = 2.559, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 67.19%], valid : [loss = 0.955, top1 = 66.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7092/15625) 007092-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.641, top1 = 86.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10        train : [loss = 0.028, top1 = 99.34%], test  : [loss = 0.432, top1 = 89.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.28 ms.
cifar100       train : [loss = 0.398, top1 = 89.22%], valid : [loss = 1.407, top1 = 64.45%], test : [loss = 1.407, top1 = 64.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.21%], valid : [loss = 2.617, top1 = 35.17%], test : [loss = 2.634, top1 = 34.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7093/15625) 007093-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.541, top1 = 88.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.364, top1 = 91.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.81 ms.
cifar100       train : [loss = 0.200, top1 = 95.42%], valid : [loss = 1.418, top1 = 66.82%], test : [loss = 1.375, top1 = 67.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.84%], valid : [loss = 2.430, top1 = 38.57%], test : [loss = 2.454, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.27%], valid : [loss = 0.725, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7094/15625) 007094-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.19%], valid : [loss = 0.538, top1 = 84.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.181, top1 = 93.94%], test  : [loss = 0.401, top1 = 87.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.74 ms.
cifar100       train : [loss = 1.207, top1 = 65.75%], valid : [loss = 1.512, top1 = 58.77%], test : [loss = 1.496, top1 = 58.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.582, top1 = 35.08%], valid : [loss = 2.646, top1 = 33.76%], test : [loss = 2.678, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 67.06%], valid : [loss = 0.978, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7095/15625) 007095-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.64%], valid : [loss = 0.533, top1 = 86.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.96 ms.
cifar10        train : [loss = 0.086, top1 = 97.17%], test  : [loss = 0.375, top1 = 89.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.23 ms.
cifar100       train : [loss = 0.753, top1 = 77.82%], valid : [loss = 1.311, top1 = 64.80%], test : [loss = 1.326, top1 = 64.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.459, top1 = 37.31%], valid : [loss = 2.562, top1 = 35.07%], test : [loss = 2.600, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.57%], valid : [loss = 0.786, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7096/15625) 007096-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.23 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.46 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.36 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7097/15625) 007097-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.667, top1 = 85.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.03 ms.
cifar10        train : [loss = 0.036, top1 = 98.97%], test  : [loss = 0.457, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.33 ms.
cifar100       train : [loss = 0.453, top1 = 87.28%], valid : [loss = 1.489, top1 = 62.87%], test : [loss = 1.471, top1 = 63.03%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.33%], valid : [loss = 2.692, top1 = 33.01%], test : [loss = 2.705, top1 = 33.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.09%], valid : [loss = 0.849, top1 = 70.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7098/15625) 007098-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.297, top1 = 92.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.37 ms.
cifar100       train : [loss = 0.192, top1 = 95.57%], valid : [loss = 1.269, top1 = 69.48%], test : [loss = 1.277, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.69%], valid : [loss = 2.260, top1 = 42.68%], test : [loss = 2.272, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.422, top1 = 85.46%], valid : [loss = 0.530, top1 = 82.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7099/15625) 007099-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.58%], valid : [loss = 0.617, top1 = 84.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10        train : [loss = 0.091, top1 = 97.09%], test  : [loss = 0.404, top1 = 88.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.784, top1 = 77.18%], valid : [loss = 1.402, top1 = 62.64%], test : [loss = 1.409, top1 = 62.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.14%], valid : [loss = 2.745, top1 = 31.91%], test : [loss = 2.772, top1 = 31.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.75%], valid : [loss = 0.867, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7100/15625) 007100-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10-valid  train : [loss = 0.815, top1 = 71.17%], valid : [loss = 0.980, top1 = 66.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.27 ms.
cifar10        train : [loss = 0.773, top1 = 72.70%], test  : [loss = 0.856, top1 = 70.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.74 ms.
cifar100       train : [loss = 2.144, top1 = 43.86%], valid : [loss = 2.312, top1 = 41.22%], test : [loss = 2.330, top1 = 40.57%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 3.742, top1 = 14.22%], valid : [loss = 3.763, top1 = 14.43%], test : [loss = 3.774, top1 = 13.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7101/15625) 007101-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.463, top1 = 89.30%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.308, top1 = 92.26%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.40 ms.
cifar100       train : [loss = 0.317, top1 = 91.55%], valid : [loss = 1.252, top1 = 67.84%], test : [loss = 1.239, top1 = 68.41%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.73%], valid : [loss = 2.294, top1 = 41.04%], test : [loss = 2.320, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.487, top1 = 83.16%], valid : [loss = 0.572, top1 = 80.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7102/15625) 007102-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.20%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.69 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.353, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.60 ms.
cifar100       train : [loss = 0.043, top1 = 99.58%], valid : [loss = 1.428, top1 = 69.36%], test : [loss = 1.401, top1 = 69.37%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.629, top1 = 56.23%], valid : [loss = 2.367, top1 = 41.18%], test : [loss = 2.380, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.11%], valid : [loss = 0.647, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7103/15625) 007103-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.531, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.344, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.46 ms.
cifar100       train : [loss = 0.220, top1 = 94.25%], valid : [loss = 1.274, top1 = 68.57%], test : [loss = 1.291, top1 = 68.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.65%], valid : [loss = 2.285, top1 = 41.62%], test : [loss = 2.306, top1 = 41.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.52%], valid : [loss = 0.741, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7104/15625) 007104-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.11 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.21%], valid : [loss = 0.863, top1 = 71.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.24 ms.
cifar10        train : [loss = 0.562, top1 = 80.37%], test  : [loss = 0.721, top1 = 75.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.76 ms.
cifar100       train : [loss = 1.780, top1 = 52.03%], valid : [loss = 2.057, top1 = 46.44%], test : [loss = 2.072, top1 = 46.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.79%], valid : [loss = 3.647, top1 = 16.68%], test : [loss = 3.668, top1 = 15.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7105/15625) 007105-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.573, top1 = 87.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.020, top1 = 99.46%], test  : [loss = 0.387, top1 = 91.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.97 ms.
cifar100       train : [loss = 0.261, top1 = 93.02%], valid : [loss = 1.358, top1 = 67.05%], test : [loss = 1.336, top1 = 67.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 40.85%], valid : [loss = 2.482, top1 = 36.84%], test : [loss = 2.505, top1 = 36.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.72%], valid : [loss = 0.857, top1 = 69.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7106/15625) 007106-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.522, top1 = 88.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.341, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.347, top1 = 90.54%], valid : [loss = 1.287, top1 = 66.64%], test : [loss = 1.284, top1 = 67.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.41%], valid : [loss = 2.427, top1 = 38.38%], test : [loss = 2.429, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.738, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7107/15625) 007107-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.487, top1 = 88.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.314, top1 = 92.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.83 ms.
cifar100       train : [loss = 0.274, top1 = 92.95%], valid : [loss = 1.185, top1 = 69.05%], test : [loss = 1.205, top1 = 69.37%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.42%], valid : [loss = 2.220, top1 = 42.53%], test : [loss = 2.252, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.629, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7108/15625) 007108-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.554, top1 = 88.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.360, top1 = 92.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.080, top1 = 98.60%], valid : [loss = 1.503, top1 = 67.61%], test : [loss = 1.488, top1 = 67.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.31%], valid : [loss = 2.410, top1 = 39.93%], test : [loss = 2.440, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.07%], valid : [loss = 0.729, top1 = 74.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7109/15625) 007109-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.12%], valid : [loss = 0.567, top1 = 86.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.57 ms.
cifar10        train : [loss = 0.062, top1 = 98.00%], test  : [loss = 0.371, top1 = 89.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.654, top1 = 80.68%], valid : [loss = 1.319, top1 = 64.83%], test : [loss = 1.287, top1 = 64.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.16%], valid : [loss = 2.496, top1 = 36.43%], test : [loss = 2.534, top1 = 36.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7110/15625) 007110-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.04 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.87%], valid : [loss = 0.475, top1 = 84.43%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.16 ms.
cifar10        train : [loss = 0.300, top1 = 89.99%], test  : [loss = 0.400, top1 = 86.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 1.331, top1 = 62.97%], valid : [loss = 1.541, top1 = 57.75%], test : [loss = 1.518, top1 = 58.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.35 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.64%], valid : [loss = 2.919, top1 = 29.40%], test : [loss = 2.958, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7111/15625) 007111-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.95 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.71%], valid : [loss = 0.540, top1 = 88.03%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.339, top1 = 91.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.80 ms.
cifar100       train : [loss = 0.433, top1 = 87.61%], valid : [loss = 1.251, top1 = 67.12%], test : [loss = 1.281, top1 = 66.55%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.62 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.11%], valid : [loss = 2.427, top1 = 38.82%], test : [loss = 2.426, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.57%], valid : [loss = 0.821, top1 = 71.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7112/15625) 007112-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.463, top1 = 89.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.76 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.316, top1 = 92.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.08 ms.
cifar100       train : [loss = 0.281, top1 = 92.62%], valid : [loss = 1.231, top1 = 68.47%], test : [loss = 1.213, top1 = 69.17%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.92%], valid : [loss = 2.216, top1 = 42.40%], test : [loss = 2.243, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.72%], valid : [loss = 0.663, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7113/15625) 007113-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.14%], valid : [loss = 0.456, top1 = 87.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.117, top1 = 96.37%], test  : [loss = 0.332, top1 = 89.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 0.853, top1 = 75.77%], valid : [loss = 1.288, top1 = 64.53%], test : [loss = 1.274, top1 = 64.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.52%], valid : [loss = 2.608, top1 = 34.70%], test : [loss = 2.652, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.12%], valid : [loss = 0.663, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7114/15625) 007114-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.428, top1 = 90.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.285, top1 = 93.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.127, top1 = 97.39%], valid : [loss = 1.289, top1 = 69.83%], test : [loss = 1.299, top1 = 69.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.86%], valid : [loss = 2.235, top1 = 43.18%], test : [loss = 2.268, top1 = 43.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 84.29%], valid : [loss = 0.575, top1 = 80.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7115/15625) 007115-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.510, top1 = 88.26%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.65 ms.
cifar10        train : [loss = 0.027, top1 = 99.38%], test  : [loss = 0.359, top1 = 90.88%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.41 ms.
cifar100       train : [loss = 0.368, top1 = 89.78%], valid : [loss = 1.266, top1 = 67.96%], test : [loss = 1.272, top1 = 68.16%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 46.01%], valid : [loss = 2.371, top1 = 40.53%], test : [loss = 2.390, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.40%], valid : [loss = 0.624, top1 = 78.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7116/15625) 007116-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.05 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.38%], valid : [loss = 0.850, top1 = 72.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.552, top1 = 80.71%], test  : [loss = 0.714, top1 = 75.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.18 ms.
cifar100       train : [loss = 1.765, top1 = 52.36%], valid : [loss = 2.035, top1 = 47.01%], test : [loss = 2.068, top1 = 46.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.59 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.90%], valid : [loss = 3.632, top1 = 16.58%], test : [loss = 3.668, top1 = 15.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7117/15625) 007117-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.512, top1 = 89.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.81 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.346, top1 = 92.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.78 ms.
cifar100       train : [loss = 0.115, top1 = 97.70%], valid : [loss = 1.311, top1 = 69.19%], test : [loss = 1.319, top1 = 69.51%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.42%], valid : [loss = 2.177, top1 = 44.55%], test : [loss = 2.189, top1 = 44.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.92%], valid : [loss = 0.601, top1 = 79.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7118/15625) 007118-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.23%], valid : [loss = 0.475, top1 = 84.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10        train : [loss = 0.301, top1 = 90.05%], test  : [loss = 0.402, top1 = 86.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.336, top1 = 62.97%], valid : [loss = 1.527, top1 = 58.02%], test : [loss = 1.520, top1 = 57.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.52%], valid : [loss = 2.891, top1 = 29.63%], test : [loss = 2.959, top1 = 28.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7119/15625) 007119-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.603, top1 = 88.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.378, top1 = 92.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.103, top1 = 98.00%], valid : [loss = 1.547, top1 = 66.78%], test : [loss = 1.544, top1 = 66.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.33 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.11%], valid : [loss = 2.400, top1 = 38.98%], test : [loss = 2.406, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.91%], valid : [loss = 0.722, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7120/15625) 007120-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.03%], valid : [loss = 0.862, top1 = 71.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10        train : [loss = 0.569, top1 = 80.07%], test  : [loss = 0.722, top1 = 75.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.29 ms.
cifar100       train : [loss = 1.783, top1 = 51.99%], valid : [loss = 2.057, top1 = 47.07%], test : [loss = 2.062, top1 = 46.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.83 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.78%], valid : [loss = 3.656, top1 = 16.40%], test : [loss = 3.672, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7121/15625) 007121-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.77 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.535, top1 = 88.85%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.82 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.346, top1 = 92.46%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.16 ms.
cifar100       train : [loss = 0.168, top1 = 96.19%], valid : [loss = 1.340, top1 = 69.12%], test : [loss = 1.325, top1 = 68.83%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.82%], valid : [loss = 2.275, top1 = 42.30%], test : [loss = 2.267, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.16%], valid : [loss = 0.817, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7122/15625) 007122-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.00%], valid : [loss = 0.865, top1 = 75.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.305, top1 = 89.41%], test  : [loss = 0.625, top1 = 80.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.74 ms.
cifar100       train : [loss = 1.385, top1 = 61.31%], valid : [loss = 1.933, top1 = 49.91%], test : [loss = 1.923, top1 = 50.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 3.468, top1 = 17.84%], valid : [loss = 3.503, top1 = 17.67%], test : [loss = 3.503, top1 = 17.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7123/15625) 007123-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.68%], valid : [loss = 0.529, top1 = 83.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.252, top1 = 91.50%], test  : [loss = 0.403, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.64 ms.
cifar100       train : [loss = 1.326, top1 = 62.55%], valid : [loss = 1.607, top1 = 56.50%], test : [loss = 1.573, top1 = 57.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.855, top1 = 29.68%], valid : [loss = 2.851, top1 = 30.67%], test : [loss = 2.919, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.01%], valid : [loss = 1.012, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7124/15625) 007124-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.57%], valid : [loss = 0.441, top1 = 87.94%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.58 ms.
cifar10        train : [loss = 0.053, top1 = 98.73%], test  : [loss = 0.299, top1 = 90.83%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.13 ms.
cifar100       train : [loss = 0.593, top1 = 83.62%], valid : [loss = 1.224, top1 = 66.87%], test : [loss = 1.204, top1 = 66.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.24%], valid : [loss = 2.455, top1 = 37.92%], test : [loss = 2.494, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.95%], valid : [loss = 0.638, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7125/15625) 007125-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.71 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.545, top1 = 88.92%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.349, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.52 ms.
cifar100       train : [loss = 0.123, top1 = 97.40%], valid : [loss = 1.320, top1 = 69.13%], test : [loss = 1.367, top1 = 68.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.07 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.04%], valid : [loss = 2.311, top1 = 41.90%], test : [loss = 2.318, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.08%], valid : [loss = 0.736, top1 = 74.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7126/15625) 007126-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.67 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.33 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.47 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7127/15625) 007127-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 74.63 M, Params=0.534 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.486, top1 = 88.82%]
cifar10        FLOP= 74.63 M, Params=0.534 MB, latency=20.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 92.01%]
cifar100       FLOP= 74.64 M, Params=0.540 MB, latency=18.73 ms.
cifar100       train : [loss = 0.328, top1 = 91.20%], valid : [loss = 1.259, top1 = 67.16%], test : [loss = 1.248, top1 = 68.00%]
ImageNet16-120 FLOP= 18.67 M, Params=0.542 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.60%], valid : [loss = 2.333, top1 = 40.71%], test : [loss = 2.355, top1 = 40.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.78%], valid : [loss = 0.619, top1 = 78.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7128/15625) 007128-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.58 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.66%], valid : [loss = 0.495, top1 = 84.21%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10        train : [loss = 0.221, top1 = 92.57%], test  : [loss = 0.383, top1 = 87.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.96 ms.
cifar100       train : [loss = 1.248, top1 = 64.97%], valid : [loss = 1.524, top1 = 57.21%], test : [loss = 1.545, top1 = 57.00%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.35 ms.
ImageNet16-120 train : [loss = 3.149, top1 = 23.63%], valid : [loss = 3.152, top1 = 23.33%], test : [loss = 3.154, top1 = 23.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 1.095, top1 = 60.73%], valid : [loss = 1.112, top1 = 59.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7129/15625) 007129-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.506, top1 = 90.18%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.42 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.327, top1 = 93.06%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.48 ms.
cifar100       train : [loss = 0.094, top1 = 98.25%], valid : [loss = 1.291, top1 = 70.43%], test : [loss = 1.300, top1 = 70.17%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.56 ms.
ImageNet16-120 train : [loss = 1.638, top1 = 56.00%], valid : [loss = 2.156, top1 = 44.38%], test : [loss = 2.152, top1 = 45.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.40%], valid : [loss = 0.605, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7130/15625) 007130-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.50%], valid : [loss = 0.507, top1 = 83.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10        train : [loss = 0.279, top1 = 90.63%], test  : [loss = 0.422, top1 = 86.03%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.90 ms.
cifar100       train : [loss = 1.353, top1 = 62.17%], valid : [loss = 1.615, top1 = 55.89%], test : [loss = 1.599, top1 = 56.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 3.242, top1 = 22.27%], valid : [loss = 3.237, top1 = 21.98%], test : [loss = 3.255, top1 = 21.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7131/15625) 007131-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.574, top1 = 87.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.397, top1 = 91.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.36 ms.
cifar100       train : [loss = 0.211, top1 = 94.74%], valid : [loss = 1.473, top1 = 65.92%], test : [loss = 1.476, top1 = 65.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.31%], valid : [loss = 2.463, top1 = 37.95%], test : [loss = 2.471, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.86%], valid : [loss = 0.778, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7132/15625) 007132-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.620, top1 = 86.46%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.60 ms.
cifar10        train : [loss = 0.028, top1 = 99.32%], test  : [loss = 0.445, top1 = 89.32%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.50 ms.
cifar100       train : [loss = 0.369, top1 = 90.00%], valid : [loss = 1.392, top1 = 65.21%], test : [loss = 1.385, top1 = 65.38%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.37%], valid : [loss = 2.543, top1 = 36.63%], test : [loss = 2.555, top1 = 36.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.64%], valid : [loss = 0.761, top1 = 73.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7133/15625) 007133-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.584, top1 = 87.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.378, top1 = 91.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.408, top1 = 88.38%], valid : [loss = 1.417, top1 = 64.73%], test : [loss = 1.413, top1 = 65.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.85%], valid : [loss = 2.520, top1 = 36.62%], test : [loss = 2.544, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.16%], valid : [loss = 0.817, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7134/15625) 007134-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.496, top1 = 90.04%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.32 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.302, top1 = 93.48%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.34 ms.
cifar100       train : [loss = 0.098, top1 = 98.26%], valid : [loss = 1.293, top1 = 69.84%], test : [loss = 1.297, top1 = 69.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.44 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.10%], valid : [loss = 2.186, top1 = 43.65%], test : [loss = 2.162, top1 = 44.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.46%], valid : [loss = 0.617, top1 = 78.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7135/15625) 007135-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.26%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=19.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.352, top1 = 92.60%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=18.18 ms.
cifar100       train : [loss = 0.108, top1 = 98.02%], valid : [loss = 1.445, top1 = 67.86%], test : [loss = 1.418, top1 = 67.95%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.35%], valid : [loss = 2.403, top1 = 40.31%], test : [loss = 2.409, top1 = 40.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.16%], valid : [loss = 0.680, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7136/15625) 007136-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.484, top1 = 90.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.71 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.326, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.88 ms.
cifar100       train : [loss = 0.109, top1 = 97.93%], valid : [loss = 1.283, top1 = 69.75%], test : [loss = 1.311, top1 = 69.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.23 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.24%], valid : [loss = 2.193, top1 = 44.47%], test : [loss = 2.194, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.24%], valid : [loss = 0.633, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7137/15625) 007137-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.77%], valid : [loss = 0.598, top1 = 86.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.026, top1 = 99.31%], test  : [loss = 0.405, top1 = 90.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 0.497, top1 = 85.61%], valid : [loss = 1.383, top1 = 64.76%], test : [loss = 1.405, top1 = 64.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.20%], valid : [loss = 2.533, top1 = 36.22%], test : [loss = 2.539, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.04%], valid : [loss = 0.817, top1 = 71.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7138/15625) 007138-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.55%], valid : [loss = 0.847, top1 = 75.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.308, top1 = 89.31%], test  : [loss = 0.631, top1 = 80.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 1.313, top1 = 62.84%], valid : [loss = 1.856, top1 = 51.16%], test : [loss = 1.884, top1 = 51.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 3.478, top1 = 17.72%], valid : [loss = 3.505, top1 = 18.05%], test : [loss = 3.503, top1 = 17.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 54.08%], valid : [loss = 1.317, top1 = 52.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7139/15625) 007139-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.527, top1 = 88.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.318, top1 = 92.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.271, top1 = 92.64%], valid : [loss = 1.293, top1 = 67.56%], test : [loss = 1.264, top1 = 68.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.51%], valid : [loss = 2.307, top1 = 40.57%], test : [loss = 2.295, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.53%], valid : [loss = 0.698, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7140/15625) 007140-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.95 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.80%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.50 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.294, top1 = 92.81%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.85 ms.
cifar100       train : [loss = 0.152, top1 = 96.72%], valid : [loss = 1.236, top1 = 70.12%], test : [loss = 1.224, top1 = 70.38%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.71 ms.
ImageNet16-120 train : [loss = 1.717, top1 = 54.05%], valid : [loss = 2.183, top1 = 44.33%], test : [loss = 2.214, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.69%], valid : [loss = 0.601, top1 = 79.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7141/15625) 007141-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.34%], valid : [loss = 0.521, top1 = 84.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.194, top1 = 93.52%], test  : [loss = 0.400, top1 = 87.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 1.231, top1 = 65.01%], valid : [loss = 1.536, top1 = 58.09%], test : [loss = 1.524, top1 = 58.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.664, top1 = 33.41%], valid : [loss = 2.705, top1 = 32.48%], test : [loss = 2.756, top1 = 31.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.37%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7142/15625) 007142-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.47%], valid : [loss = 0.648, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.075, top1 = 97.57%], test  : [loss = 0.417, top1 = 88.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.644, top1 = 80.99%], valid : [loss = 1.504, top1 = 61.63%], test : [loss = 1.471, top1 = 62.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.57%], valid : [loss = 2.975, top1 = 27.02%], test : [loss = 3.018, top1 = 26.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.36%], valid : [loss = 0.996, top1 = 64.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7143/15625) 007143-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.180, top1 = 94.05%], valid : [loss = 0.540, top1 = 84.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.185, top1 = 93.82%], test  : [loss = 0.391, top1 = 87.62%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 1.184, top1 = 66.37%], valid : [loss = 1.495, top1 = 58.91%], test : [loss = 1.495, top1 = 58.53%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.80%], valid : [loss = 2.658, top1 = 33.58%], test : [loss = 2.684, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.48%], valid : [loss = 0.965, top1 = 66.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7144/15625) 007144-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.424, top1 = 90.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.269, top1 = 93.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.146, top1 = 96.79%], valid : [loss = 1.297, top1 = 69.41%], test : [loss = 1.281, top1 = 69.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 1.731, top1 = 53.81%], valid : [loss = 2.201, top1 = 43.83%], test : [loss = 2.278, top1 = 42.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.61%], valid : [loss = 0.512, top1 = 82.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7145/15625) 007145-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.624, top1 = 86.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.033, top1 = 99.08%], test  : [loss = 0.379, top1 = 90.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 0.557, top1 = 83.65%], valid : [loss = 1.431, top1 = 63.45%], test : [loss = 1.435, top1 = 63.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.86%], valid : [loss = 2.584, top1 = 35.50%], test : [loss = 2.607, top1 = 34.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.88%], valid : [loss = 0.867, top1 = 68.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7146/15625) 007146-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.503, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.329, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.85 ms.
cifar100       train : [loss = 0.283, top1 = 92.57%], valid : [loss = 1.256, top1 = 68.18%], test : [loss = 1.259, top1 = 68.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.15%], valid : [loss = 2.295, top1 = 41.82%], test : [loss = 2.318, top1 = 41.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.25%], valid : [loss = 0.630, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7147/15625) 007147-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.53%], valid : [loss = 0.527, top1 = 83.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10        train : [loss = 0.242, top1 = 91.74%], test  : [loss = 0.401, top1 = 87.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.50 ms.
cifar100       train : [loss = 1.363, top1 = 61.69%], valid : [loss = 1.621, top1 = 56.23%], test : [loss = 1.625, top1 = 56.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.855, top1 = 29.60%], valid : [loss = 2.861, top1 = 30.00%], test : [loss = 2.925, top1 = 28.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.32%], valid : [loss = 1.031, top1 = 63.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7148/15625) 007148-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.154, top1 = 94.99%], valid : [loss = 0.509, top1 = 85.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.174, top1 = 94.13%], test  : [loss = 0.381, top1 = 88.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 1.096, top1 = 68.61%], valid : [loss = 1.437, top1 = 60.47%], test : [loss = 1.445, top1 = 60.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.75%], valid : [loss = 2.636, top1 = 33.94%], test : [loss = 2.685, top1 = 33.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.73%], valid : [loss = 0.933, top1 = 66.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7149/15625) 007149-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.16 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.93%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 93.29%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.89 ms.
cifar100       train : [loss = 0.135, top1 = 97.05%], valid : [loss = 1.339, top1 = 68.43%], test : [loss = 1.325, top1 = 69.12%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.65 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.58%], valid : [loss = 2.187, top1 = 42.77%], test : [loss = 2.208, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.66%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7150/15625) 007150-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.75%], valid : [loss = 0.495, top1 = 85.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10        train : [loss = 0.173, top1 = 94.16%], test  : [loss = 0.363, top1 = 88.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.36 ms.
cifar100       train : [loss = 1.056, top1 = 69.71%], valid : [loss = 1.423, top1 = 60.71%], test : [loss = 1.410, top1 = 60.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.61 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.27%], valid : [loss = 2.670, top1 = 33.46%], test : [loss = 2.701, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.56%], valid : [loss = 0.883, top1 = 68.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7151/15625) 007151-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.54%], valid : [loss = 0.547, top1 = 85.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.10 ms.
cifar10        train : [loss = 0.141, top1 = 95.29%], test  : [loss = 0.388, top1 = 88.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.966, top1 = 71.88%], valid : [loss = 1.474, top1 = 60.37%], test : [loss = 1.490, top1 = 59.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.771, top1 = 31.07%], valid : [loss = 2.824, top1 = 29.85%], test : [loss = 2.860, top1 = 29.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.64%], valid : [loss = 0.886, top1 = 68.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7152/15625) 007152-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.04 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 92.94%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.97 ms.
cifar100       train : [loss = 0.070, top1 = 98.81%], valid : [loss = 1.379, top1 = 69.70%], test : [loss = 1.402, top1 = 69.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.06 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.33%], valid : [loss = 2.317, top1 = 41.55%], test : [loss = 2.319, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.14%], valid : [loss = 0.824, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7153/15625) 007153-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.590, top1 = 86.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.042, top1 = 98.77%], test  : [loss = 0.400, top1 = 89.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.561, top1 = 83.50%], valid : [loss = 1.411, top1 = 63.86%], test : [loss = 1.391, top1 = 64.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 37.08%], valid : [loss = 2.616, top1 = 34.77%], test : [loss = 2.663, top1 = 33.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.52%], valid : [loss = 0.627, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7154/15625) 007154-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.72%], valid : [loss = 0.541, top1 = 82.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.230, top1 = 92.12%], test  : [loss = 0.387, top1 = 87.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.03 ms.
cifar100       train : [loss = 1.331, top1 = 62.45%], valid : [loss = 1.605, top1 = 55.83%], test : [loss = 1.581, top1 = 56.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.786, top1 = 31.02%], valid : [loss = 2.816, top1 = 30.97%], test : [loss = 2.851, top1 = 29.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.27%], valid : [loss = 1.025, top1 = 63.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7155/15625) 007155-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.68%], valid : [loss = 0.801, top1 = 72.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.48 ms.
cifar10        train : [loss = 0.685, top1 = 76.22%], test  : [loss = 0.729, top1 = 74.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.35 ms.
cifar100       train : [loss = 2.041, top1 = 45.78%], valid : [loss = 2.154, top1 = 43.22%], test : [loss = 2.157, top1 = 43.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 3.419, top1 = 19.17%], valid : [loss = 3.400, top1 = 20.13%], test : [loss = 3.434, top1 = 18.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.425, top1 = 47.82%], valid : [loss = 1.483, top1 = 45.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7156/15625) 007156-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.35%], valid : [loss = 0.539, top1 = 83.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10        train : [loss = 0.173, top1 = 94.28%], test  : [loss = 0.387, top1 = 87.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.14 ms.
cifar100       train : [loss = 1.185, top1 = 66.16%], valid : [loss = 1.514, top1 = 59.04%], test : [loss = 1.510, top1 = 58.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.86%], valid : [loss = 2.683, top1 = 32.92%], test : [loss = 2.742, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.32%], valid : [loss = 0.989, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7157/15625) 007157-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.60 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.593, top1 = 88.21%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.38 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.353, top1 = 92.38%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.83 ms.
cifar100       train : [loss = 0.187, top1 = 95.66%], valid : [loss = 1.388, top1 = 67.25%], test : [loss = 1.388, top1 = 66.96%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.31 ms.
ImageNet16-120 train : [loss = 1.992, top1 = 47.63%], valid : [loss = 2.242, top1 = 41.82%], test : [loss = 2.283, top1 = 41.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.56%], valid : [loss = 0.776, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7158/15625) 007158-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.532, top1 = 88.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10        train : [loss = 0.027, top1 = 99.17%], test  : [loss = 0.334, top1 = 91.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.22 ms.
cifar100       train : [loss = 0.421, top1 = 87.76%], valid : [loss = 1.236, top1 = 67.74%], test : [loss = 1.250, top1 = 67.55%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.45%], valid : [loss = 2.364, top1 = 40.20%], test : [loss = 2.375, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.76%], valid : [loss = 0.801, top1 = 71.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7159/15625) 007159-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.44%], valid : [loss = 0.651, top1 = 85.38%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=15.71 ms.
cifar10        train : [loss = 0.040, top1 = 98.82%], test  : [loss = 0.412, top1 = 89.81%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=13.87 ms.
cifar100       train : [loss = 0.569, top1 = 83.22%], valid : [loss = 1.461, top1 = 63.10%], test : [loss = 1.441, top1 = 63.09%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.403, top1 = 38.68%], valid : [loss = 2.578, top1 = 34.89%], test : [loss = 2.600, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.75%], valid : [loss = 0.890, top1 = 68.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7160/15625) 007160-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.535, top1 = 88.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.346, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.97 ms.
cifar100       train : [loss = 0.196, top1 = 95.12%], valid : [loss = 1.281, top1 = 69.09%], test : [loss = 1.295, top1 = 69.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.447, top1 = 37.14%], valid : [loss = 2.572, top1 = 34.62%], test : [loss = 2.585, top1 = 34.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.60%], valid : [loss = 0.872, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7161/15625) 007161-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.89 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7162/15625) 007162-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.612, top1 = 87.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.414, top1 = 91.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.15 ms.
cifar100       train : [loss = 0.136, top1 = 97.11%], valid : [loss = 1.459, top1 = 67.23%], test : [loss = 1.409, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 49.13%], valid : [loss = 2.415, top1 = 39.35%], test : [loss = 2.436, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.98%], valid : [loss = 0.751, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7163/15625) 007163-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.81 ms.
cifar10-valid  train : [loss = 0.149, top1 = 95.17%], valid : [loss = 0.544, top1 = 84.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.144, top1 = 95.23%], test  : [loss = 0.375, top1 = 88.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 1.073, top1 = 68.99%], valid : [loss = 1.473, top1 = 60.26%], test : [loss = 1.468, top1 = 59.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.587, top1 = 34.89%], valid : [loss = 2.664, top1 = 33.30%], test : [loss = 2.679, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.32%], valid : [loss = 0.960, top1 = 65.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7164/15625) 007164-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.85%], valid : [loss = 0.538, top1 = 84.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.185, top1 = 93.76%], test  : [loss = 0.387, top1 = 87.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.18 ms.
cifar100       train : [loss = 1.256, top1 = 64.36%], valid : [loss = 1.549, top1 = 57.54%], test : [loss = 1.533, top1 = 57.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 33.19%], valid : [loss = 2.724, top1 = 32.29%], test : [loss = 2.763, top1 = 31.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 66.92%], valid : [loss = 0.972, top1 = 65.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7165/15625) 007165-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.42%], valid : [loss = 0.529, top1 = 81.96%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.40 ms.
cifar10        train : [loss = 0.403, top1 = 86.28%], test  : [loss = 0.463, top1 = 84.16%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.00 ms.
cifar100       train : [loss = 1.532, top1 = 57.87%], valid : [loss = 1.646, top1 = 54.90%], test : [loss = 1.652, top1 = 54.81%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.72 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.31%], valid : [loss = 3.024, top1 = 26.40%], test : [loss = 3.063, top1 = 26.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7166/15625) 007166-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.453, top1 = 90.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.309, top1 = 93.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.090, top1 = 98.31%], valid : [loss = 1.381, top1 = 69.71%], test : [loss = 1.376, top1 = 69.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 1.645, top1 = 55.92%], valid : [loss = 2.267, top1 = 42.77%], test : [loss = 2.251, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 86.08%], valid : [loss = 0.531, top1 = 82.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7167/15625) 007167-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.473, top1 = 89.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.68 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.320, top1 = 92.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.83 ms.
cifar100       train : [loss = 0.198, top1 = 95.14%], valid : [loss = 1.390, top1 = 67.29%], test : [loss = 1.334, top1 = 68.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.46%], valid : [loss = 2.300, top1 = 41.75%], test : [loss = 2.364, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.97%], valid : [loss = 0.584, top1 = 80.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7168/15625) 007168-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.27%], valid : [loss = 0.661, top1 = 77.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.518, top1 = 82.11%], test  : [loss = 0.591, top1 = 79.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.71 ms.
cifar100       train : [loss = 1.708, top1 = 53.80%], valid : [loss = 1.874, top1 = 50.59%], test : [loss = 1.874, top1 = 50.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 3.352, top1 = 20.87%], valid : [loss = 3.339, top1 = 20.83%], test : [loss = 3.370, top1 = 20.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 54.17%], valid : [loss = 1.296, top1 = 53.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7169/15625) 007169-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.450, top1 = 89.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.315, top1 = 92.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.15 ms.
cifar100       train : [loss = 0.227, top1 = 94.39%], valid : [loss = 1.297, top1 = 68.21%], test : [loss = 1.295, top1 = 68.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.46%], valid : [loss = 2.283, top1 = 41.88%], test : [loss = 2.310, top1 = 41.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.415, top1 = 85.46%], valid : [loss = 0.540, top1 = 81.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7170/15625) 007170-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.452, top1 = 89.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.316, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.56 ms.
cifar100       train : [loss = 0.315, top1 = 91.61%], valid : [loss = 1.311, top1 = 66.96%], test : [loss = 1.301, top1 = 67.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.24%], valid : [loss = 2.374, top1 = 39.57%], test : [loss = 2.408, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.86%], valid : [loss = 0.540, top1 = 81.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7171/15625) 007171-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.93%], valid : [loss = 0.774, top1 = 82.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.81 ms.
cifar10        train : [loss = 0.089, top1 = 97.17%], test  : [loss = 0.478, top1 = 86.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.802, top1 = 76.57%], valid : [loss = 1.525, top1 = 60.54%], test : [loss = 1.508, top1 = 60.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.820, top1 = 30.26%], valid : [loss = 2.912, top1 = 29.18%], test : [loss = 2.989, top1 = 26.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.90%], valid : [loss = 0.894, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7172/15625) 007172-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.376, top1 = 86.79%], valid : [loss = 0.618, top1 = 79.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10        train : [loss = 0.302, top1 = 89.66%], test  : [loss = 0.442, top1 = 85.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.20 ms.
cifar100       train : [loss = 1.520, top1 = 57.47%], valid : [loss = 1.748, top1 = 53.30%], test : [loss = 1.737, top1 = 52.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.71 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.04%], valid : [loss = 3.045, top1 = 26.27%], test : [loss = 3.086, top1 = 25.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.019, top1 = 63.23%], valid : [loss = 1.071, top1 = 61.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7173/15625) 007173-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.47%], valid : [loss = 0.876, top1 = 70.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.37 ms.
cifar10        train : [loss = 0.676, top1 = 76.24%], test  : [loss = 0.764, top1 = 73.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 1.978, top1 = 47.45%], valid : [loss = 2.140, top1 = 44.77%], test : [loss = 2.171, top1 = 44.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.41 ms.
ImageNet16-120 train : [loss = 3.655, top1 = 15.68%], valid : [loss = 3.675, top1 = 15.65%], test : [loss = 3.709, top1 = 14.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7174/15625) 007174-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.63%], valid : [loss = 0.463, top1 = 86.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.153, top1 = 95.02%], test  : [loss = 0.343, top1 = 88.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.28 ms.
cifar100       train : [loss = 0.987, top1 = 71.94%], valid : [loss = 1.342, top1 = 62.26%], test : [loss = 1.336, top1 = 62.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.40%], valid : [loss = 2.651, top1 = 33.62%], test : [loss = 2.684, top1 = 33.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7175/15625) 007175-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.491, top1 = 89.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.308, top1 = 92.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.38 ms.
cifar100       train : [loss = 0.271, top1 = 92.82%], valid : [loss = 1.230, top1 = 68.96%], test : [loss = 1.256, top1 = 68.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.33 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.32%], valid : [loss = 2.206, top1 = 42.68%], test : [loss = 2.210, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.22%], valid : [loss = 0.632, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7176/15625) 007176-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.15 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.506, top1 = 89.95%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.43 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.316, top1 = 93.41%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.63 ms.
cifar100       train : [loss = 0.054, top1 = 99.15%], valid : [loss = 1.353, top1 = 70.58%], test : [loss = 1.343, top1 = 70.39%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.86 ms.
ImageNet16-120 train : [loss = 1.580, top1 = 57.36%], valid : [loss = 2.157, top1 = 44.43%], test : [loss = 2.157, top1 = 45.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.00%], valid : [loss = 0.797, top1 = 71.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7177/15625) 007177-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.25%], valid : [loss = 0.518, top1 = 84.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.204, top1 = 93.12%], test  : [loss = 0.380, top1 = 87.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 1.229, top1 = 65.14%], valid : [loss = 1.523, top1 = 58.55%], test : [loss = 1.538, top1 = 58.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.786, top1 = 30.99%], valid : [loss = 2.817, top1 = 30.28%], test : [loss = 2.859, top1 = 29.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.87%], valid : [loss = 1.013, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7178/15625) 007178-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.527, top1 = 88.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.352, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.57 ms.
cifar100       train : [loss = 0.412, top1 = 88.13%], valid : [loss = 1.257, top1 = 67.04%], test : [loss = 1.251, top1 = 67.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.31%], valid : [loss = 2.414, top1 = 39.13%], test : [loss = 2.453, top1 = 38.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.96%], valid : [loss = 0.756, top1 = 73.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7179/15625) 007179-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.540, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.359, top1 = 92.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.33 ms.
cifar100       train : [loss = 0.119, top1 = 97.40%], valid : [loss = 1.376, top1 = 68.65%], test : [loss = 1.363, top1 = 69.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.32%], valid : [loss = 2.421, top1 = 38.40%], test : [loss = 2.387, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.50%], valid : [loss = 1.010, top1 = 63.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7180/15625) 007180-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.57%], valid : [loss = 0.587, top1 = 87.30%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.22 ms.
cifar10        train : [loss = 0.033, top1 = 99.05%], test  : [loss = 0.399, top1 = 90.25%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.47 ms.
cifar100       train : [loss = 0.382, top1 = 89.10%], valid : [loss = 1.370, top1 = 66.10%], test : [loss = 1.357, top1 = 66.08%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=23.44 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.94%], valid : [loss = 2.388, top1 = 39.27%], test : [loss = 2.380, top1 = 39.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.62%], valid : [loss = 0.868, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7181/15625) 007181-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.567, top1 = 87.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.368, top1 = 91.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.35 ms.
cifar100       train : [loss = 0.379, top1 = 89.34%], valid : [loss = 1.434, top1 = 64.75%], test : [loss = 1.392, top1 = 65.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.29%], valid : [loss = 2.496, top1 = 37.28%], test : [loss = 2.509, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.97%], valid : [loss = 0.772, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7182/15625) 007182-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.17%], valid : [loss = 0.540, top1 = 84.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.151, top1 = 94.98%], test  : [loss = 0.374, top1 = 88.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 1.101, top1 = 68.53%], valid : [loss = 1.484, top1 = 59.11%], test : [loss = 1.475, top1 = 59.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.581, top1 = 35.03%], valid : [loss = 2.648, top1 = 34.39%], test : [loss = 2.689, top1 = 32.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 67.03%], valid : [loss = 0.972, top1 = 65.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7183/15625) 007183-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.21%], valid : [loss = 0.460, top1 = 86.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10        train : [loss = 0.115, top1 = 96.44%], test  : [loss = 0.334, top1 = 89.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.60 ms.
cifar100       train : [loss = 0.860, top1 = 75.45%], valid : [loss = 1.300, top1 = 63.95%], test : [loss = 1.289, top1 = 63.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.54%], valid : [loss = 2.638, top1 = 33.96%], test : [loss = 2.673, top1 = 33.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7184/15625) 007184-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.510, top1 = 89.67%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.34 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.20%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.81 ms.
cifar100       train : [loss = 0.075, top1 = 98.84%], valid : [loss = 1.360, top1 = 69.09%], test : [loss = 1.320, top1 = 70.28%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.14 ms.
ImageNet16-120 train : [loss = 1.609, top1 = 56.72%], valid : [loss = 2.183, top1 = 44.20%], test : [loss = 2.183, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.491, top1 = 83.01%], valid : [loss = 0.583, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7185/15625) 007185-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.34%], valid : [loss = 0.743, top1 = 74.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.496, top1 = 82.73%], test  : [loss = 0.611, top1 = 79.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 1.847, top1 = 49.76%], valid : [loss = 2.027, top1 = 46.28%], test : [loss = 2.025, top1 = 46.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 3.503, top1 = 17.81%], valid : [loss = 3.508, top1 = 18.47%], test : [loss = 3.527, top1 = 17.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.10%], valid : [loss = 1.250, top1 = 55.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7186/15625) 007186-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.55%], valid : [loss = 0.573, top1 = 83.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.156, top1 = 94.88%], test  : [loss = 0.412, top1 = 87.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.61 ms.
cifar100       train : [loss = 1.084, top1 = 68.79%], valid : [loss = 1.495, top1 = 59.17%], test : [loss = 1.486, top1 = 59.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.580, top1 = 34.93%], valid : [loss = 2.648, top1 = 33.88%], test : [loss = 2.679, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.60%], valid : [loss = 0.913, top1 = 67.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7187/15625) 007187-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.55 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.21%], valid : [loss = 0.468, top1 = 84.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.59 ms.
cifar10        train : [loss = 0.302, top1 = 89.94%], test  : [loss = 0.399, top1 = 86.63%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.26 ms.
cifar100       train : [loss = 1.332, top1 = 63.12%], valid : [loss = 1.535, top1 = 57.79%], test : [loss = 1.512, top1 = 58.15%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.54 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.55%], valid : [loss = 2.891, top1 = 29.70%], test : [loss = 2.964, top1 = 28.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7188/15625) 007188-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.570, top1 = 87.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.394, top1 = 90.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.54 ms.
cifar100       train : [loss = 0.346, top1 = 90.35%], valid : [loss = 1.432, top1 = 65.38%], test : [loss = 1.436, top1 = 65.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.30%], valid : [loss = 2.464, top1 = 37.95%], test : [loss = 2.492, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.15%], valid : [loss = 0.872, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7189/15625) 007189-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.444, top1 = 89.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.287, top1 = 92.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.35 ms.
cifar100       train : [loss = 0.202, top1 = 95.23%], valid : [loss = 1.224, top1 = 69.57%], test : [loss = 1.243, top1 = 69.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.35%], valid : [loss = 2.252, top1 = 42.88%], test : [loss = 2.289, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.48%], valid : [loss = 0.515, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7190/15625) 007190-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.557, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.361, top1 = 92.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.51 ms.
cifar100       train : [loss = 0.091, top1 = 98.46%], valid : [loss = 1.411, top1 = 68.75%], test : [loss = 1.473, top1 = 68.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 1.797, top1 = 52.28%], valid : [loss = 2.386, top1 = 40.77%], test : [loss = 2.410, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.03%], valid : [loss = 0.692, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7191/15625) 007191-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.57%], valid : [loss = 0.559, top1 = 87.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.031, top1 = 99.08%], test  : [loss = 0.364, top1 = 90.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.29 ms.
cifar100       train : [loss = 0.531, top1 = 84.63%], valid : [loss = 1.377, top1 = 63.54%], test : [loss = 1.353, top1 = 64.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 2.587, top1 = 34.25%], valid : [loss = 2.669, top1 = 32.58%], test : [loss = 2.691, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.97%], valid : [loss = 0.957, top1 = 65.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7192/15625) 007192-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.498, top1 = 88.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.78 ms.
cifar10        train : [loss = 0.027, top1 = 99.29%], test  : [loss = 0.359, top1 = 91.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 0.480, top1 = 85.84%], valid : [loss = 1.350, top1 = 65.50%], test : [loss = 1.347, top1 = 66.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.65 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.37%], valid : [loss = 2.532, top1 = 36.97%], test : [loss = 2.574, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7193/15625) 007193-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.82%], valid : [loss = 0.670, top1 = 84.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10        train : [loss = 0.067, top1 = 97.90%], test  : [loss = 0.418, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.08 ms.
cifar100       train : [loss = 0.777, top1 = 76.99%], valid : [loss = 1.482, top1 = 60.34%], test : [loss = 1.446, top1 = 61.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.36%], valid : [loss = 2.666, top1 = 33.20%], test : [loss = 2.723, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.04%], valid : [loss = 0.891, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7194/15625) 007194-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.529, top1 = 88.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.333, top1 = 91.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.22 ms.
cifar100       train : [loss = 0.342, top1 = 90.76%], valid : [loss = 1.293, top1 = 66.50%], test : [loss = 1.270, top1 = 67.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.46%], valid : [loss = 2.413, top1 = 38.87%], test : [loss = 2.425, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7195/15625) 007195-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.473, top1 = 89.47%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.13 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.301, top1 = 92.59%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.24 ms.
cifar100       train : [loss = 0.193, top1 = 95.46%], valid : [loss = 1.198, top1 = 69.66%], test : [loss = 1.192, top1 = 70.42%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=25.58 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.66%], valid : [loss = 2.170, top1 = 44.13%], test : [loss = 2.173, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.56%], valid : [loss = 0.633, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7196/15625) 007196-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.44%], valid : [loss = 0.458, top1 = 86.58%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.45 ms.
cifar10        train : [loss = 0.123, top1 = 96.16%], test  : [loss = 0.342, top1 = 89.14%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.27 ms.
cifar100       train : [loss = 0.765, top1 = 78.56%], valid : [loss = 1.293, top1 = 64.32%], test : [loss = 1.290, top1 = 64.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.59%], valid : [loss = 2.604, top1 = 34.70%], test : [loss = 2.633, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7197/15625) 007197-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.43%], valid : [loss = 0.456, top1 = 87.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.96 ms.
cifar10        train : [loss = 0.065, top1 = 98.28%], test  : [loss = 0.320, top1 = 90.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.87 ms.
cifar100       train : [loss = 0.636, top1 = 82.33%], valid : [loss = 1.259, top1 = 65.82%], test : [loss = 1.246, top1 = 65.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.78%], valid : [loss = 2.533, top1 = 36.49%], test : [loss = 2.550, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.29%], valid : [loss = 0.619, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7198/15625) 007198-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.22 ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.58%], valid : [loss = 0.869, top1 = 71.70%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.94 ms.
cifar10        train : [loss = 0.565, top1 = 80.28%], test  : [loss = 0.726, top1 = 75.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.84 ms.
cifar100       train : [loss = 1.777, top1 = 52.00%], valid : [loss = 2.046, top1 = 47.62%], test : [loss = 2.042, top1 = 47.04%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.79%], valid : [loss = 3.645, top1 = 16.83%], test : [loss = 3.674, top1 = 15.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7199/15625) 007199-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.472, top1 = 89.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.297, top1 = 92.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.36 ms.
cifar100       train : [loss = 0.271, top1 = 93.18%], valid : [loss = 1.204, top1 = 69.26%], test : [loss = 1.236, top1 = 68.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.63%], valid : [loss = 2.236, top1 = 43.53%], test : [loss = 2.277, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.629, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7200/15625) 007200-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.521, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.322, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.78 ms.
cifar100       train : [loss = 0.324, top1 = 91.28%], valid : [loss = 1.281, top1 = 67.15%], test : [loss = 1.269, top1 = 67.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.03%], valid : [loss = 2.403, top1 = 38.92%], test : [loss = 2.406, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7201/15625) 007201-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.593, top1 = 87.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.369, top1 = 90.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.78 ms.
cifar100       train : [loss = 0.284, top1 = 92.64%], valid : [loss = 1.544, top1 = 63.42%], test : [loss = 1.540, top1 = 63.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.90%], valid : [loss = 2.494, top1 = 37.07%], test : [loss = 2.486, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.59%], valid : [loss = 0.785, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7202/15625) 007202-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.415, top1 = 90.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.288, top1 = 92.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.12 ms.
cifar100       train : [loss = 0.141, top1 = 96.98%], valid : [loss = 1.290, top1 = 70.20%], test : [loss = 1.270, top1 = 69.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 1.740, top1 = 53.52%], valid : [loss = 2.215, top1 = 44.37%], test : [loss = 2.275, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.84%], valid : [loss = 0.545, top1 = 81.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7203/15625) 007203-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.498, top1 = 89.23%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.73 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.299, top1 = 92.77%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.94 ms.
cifar100       train : [loss = 0.215, top1 = 94.63%], valid : [loss = 1.246, top1 = 69.30%], test : [loss = 1.256, top1 = 69.08%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.38 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.10%], valid : [loss = 2.196, top1 = 43.70%], test : [loss = 2.215, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.61%], valid : [loss = 0.727, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7204/15625) 007204-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.36%], valid : [loss = 0.465, top1 = 85.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10        train : [loss = 0.145, top1 = 95.36%], test  : [loss = 0.345, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.36 ms.
cifar100       train : [loss = 0.975, top1 = 72.26%], valid : [loss = 1.325, top1 = 62.40%], test : [loss = 1.339, top1 = 62.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.24%], valid : [loss = 2.644, top1 = 33.80%], test : [loss = 2.705, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7205/15625) 007205-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.22%], valid : [loss = 0.575, top1 = 81.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.305, top1 = 89.59%], test  : [loss = 0.448, top1 = 85.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.07 ms.
cifar100       train : [loss = 1.633, top1 = 54.64%], valid : [loss = 1.838, top1 = 50.24%], test : [loss = 1.824, top1 = 50.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 3.172, top1 = 23.51%], valid : [loss = 3.158, top1 = 24.00%], test : [loss = 3.233, top1 = 23.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.34%], valid : [loss = 1.052, top1 = 62.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7206/15625) 007206-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.09 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7207/15625) 007207-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.454, top1 = 86.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.111, top1 = 96.57%], test  : [loss = 0.330, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.870, top1 = 75.21%], valid : [loss = 1.302, top1 = 63.48%], test : [loss = 1.280, top1 = 64.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.62%], valid : [loss = 2.635, top1 = 33.90%], test : [loss = 2.653, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7208/15625) 007208-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.45 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.74 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.85 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.74 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7209/15625) 007209-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=27.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.503, top1 = 90.18%]
cifar10        FLOP=188.66 M, Params=1.317 MB, latency=23.94 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.298, top1 = 93.64%]
cifar100       FLOP=188.67 M, Params=1.322 MB, latency=22.96 ms.
cifar100       train : [loss = 0.029, top1 = 99.74%], valid : [loss = 1.349, top1 = 71.06%], test : [loss = 1.351, top1 = 70.82%]
ImageNet16-120 FLOP= 47.17 M, Params=1.324 MB, latency=18.91 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.29%], valid : [loss = 2.312, top1 = 40.83%], test : [loss = 2.319, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 75.22%], valid : [loss = 0.777, top1 = 73.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7210/15625) 007210-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.514, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.319, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.68 ms.
cifar100       train : [loss = 0.338, top1 = 90.96%], valid : [loss = 1.298, top1 = 66.62%], test : [loss = 1.261, top1 = 67.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.58%], valid : [loss = 2.399, top1 = 38.63%], test : [loss = 2.387, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7211/15625) 007211-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.21%], valid : [loss = 0.857, top1 = 71.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10        train : [loss = 0.549, top1 = 80.87%], test  : [loss = 0.701, top1 = 76.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.56 ms.
cifar100       train : [loss = 1.780, top1 = 52.42%], valid : [loss = 2.055, top1 = 46.64%], test : [loss = 2.078, top1 = 47.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.52 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.79%], valid : [loss = 3.634, top1 = 16.37%], test : [loss = 3.668, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.36%], valid : [loss = 1.272, top1 = 54.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7212/15625) 007212-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.309, top1 = 89.45%], valid : [loss = 0.555, top1 = 82.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10        train : [loss = 0.251, top1 = 91.42%], test  : [loss = 0.409, top1 = 86.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 1.447, top1 = 59.57%], valid : [loss = 1.688, top1 = 54.33%], test : [loss = 1.681, top1 = 54.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 27.92%], valid : [loss = 2.958, top1 = 28.17%], test : [loss = 3.007, top1 = 26.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.003, top1 = 64.24%], valid : [loss = 1.055, top1 = 62.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7213/15625) 007213-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.87%], valid : [loss = 0.483, top1 = 84.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10        train : [loss = 0.304, top1 = 89.81%], test  : [loss = 0.404, top1 = 86.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.81 ms.
cifar100       train : [loss = 1.335, top1 = 63.16%], valid : [loss = 1.540, top1 = 57.39%], test : [loss = 1.522, top1 = 57.99%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.41 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.81%], valid : [loss = 2.901, top1 = 29.31%], test : [loss = 2.956, top1 = 28.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7214/15625) 007214-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.14%], valid : [loss = 0.909, top1 = 68.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.66 ms.
cifar10        train : [loss = 0.679, top1 = 76.16%], test  : [loss = 0.723, top1 = 74.88%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.67 ms.
cifar100       train : [loss = 2.243, top1 = 40.61%], valid : [loss = 2.344, top1 = 38.80%], test : [loss = 2.352, top1 = 38.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 3.449, top1 = 18.66%], valid : [loss = 3.426, top1 = 19.23%], test : [loss = 3.449, top1 = 18.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.372, top1 = 50.08%], valid : [loss = 1.413, top1 = 48.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7215/15625) 007215-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.479, top1 = 89.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.312, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.70 ms.
cifar100       train : [loss = 0.139, top1 = 97.19%], valid : [loss = 1.259, top1 = 69.33%], test : [loss = 1.281, top1 = 69.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.759, top1 = 53.17%], valid : [loss = 2.188, top1 = 43.77%], test : [loss = 2.204, top1 = 43.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.22%], valid : [loss = 0.628, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7216/15625) 007216-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.096, top1 = 97.09%], valid : [loss = 0.671, top1 = 83.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.69 ms.
cifar10        train : [loss = 0.153, top1 = 94.80%], test  : [loss = 0.460, top1 = 86.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.51 ms.
cifar100       train : [loss = 0.964, top1 = 71.91%], valid : [loss = 1.648, top1 = 56.28%], test : [loss = 1.636, top1 = 57.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 3.060, top1 = 25.13%], valid : [loss = 3.122, top1 = 25.13%], test : [loss = 3.176, top1 = 22.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7217/15625) 007217-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.02%], valid : [loss = 0.763, top1 = 73.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.540, top1 = 81.24%], test  : [loss = 0.597, top1 = 79.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 2.052, top1 = 44.73%], valid : [loss = 2.155, top1 = 42.21%], test : [loss = 2.151, top1 = 42.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.30%], valid : [loss = 3.201, top1 = 23.42%], test : [loss = 3.238, top1 = 21.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.152, top1 = 58.61%], valid : [loss = 1.187, top1 = 57.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7218/15625) 007218-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.520, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.323, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.21 ms.
cifar100       train : [loss = 0.361, top1 = 90.02%], valid : [loss = 1.260, top1 = 67.48%], test : [loss = 1.254, top1 = 67.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.24%], valid : [loss = 2.433, top1 = 38.63%], test : [loss = 2.432, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7219/15625) 007219-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.598, top1 = 87.06%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.71 ms.
cifar10        train : [loss = 0.018, top1 = 99.58%], test  : [loss = 0.430, top1 = 89.92%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.76 ms.
cifar100       train : [loss = 0.290, top1 = 92.57%], valid : [loss = 1.458, top1 = 65.16%], test : [loss = 1.448, top1 = 64.90%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.27%], valid : [loss = 2.489, top1 = 37.93%], test : [loss = 2.518, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.88%], valid : [loss = 0.768, top1 = 73.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7220/15625) 007220-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.52%], valid : [loss = 0.465, top1 = 86.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10        train : [loss = 0.156, top1 = 94.90%], test  : [loss = 0.343, top1 = 88.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.63 ms.
cifar100       train : [loss = 0.978, top1 = 72.17%], valid : [loss = 1.352, top1 = 62.41%], test : [loss = 1.354, top1 = 62.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.90%], valid : [loss = 2.688, top1 = 32.82%], test : [loss = 2.711, top1 = 32.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7221/15625) 007221-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.28%], valid : [loss = 0.676, top1 = 84.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.14 ms.
cifar10        train : [loss = 0.055, top1 = 98.33%], test  : [loss = 0.448, top1 = 88.65%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.66 ms.
cifar100       train : [loss = 0.622, top1 = 81.85%], valid : [loss = 1.496, top1 = 61.62%], test : [loss = 1.490, top1 = 61.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.04%], valid : [loss = 2.820, top1 = 31.43%], test : [loss = 2.864, top1 = 30.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.59%], valid : [loss = 0.885, top1 = 68.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7222/15625) 007222-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.492, top1 = 88.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.336, top1 = 91.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.09 ms.
cifar100       train : [loss = 0.415, top1 = 88.14%], valid : [loss = 1.316, top1 = 66.30%], test : [loss = 1.344, top1 = 66.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.88 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.48%], valid : [loss = 2.372, top1 = 40.60%], test : [loss = 2.390, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.18%], valid : [loss = 0.650, top1 = 77.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7223/15625) 007223-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.516, top1 = 88.58%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.89 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.328, top1 = 92.16%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.70 ms.
cifar100       train : [loss = 0.318, top1 = 91.57%], valid : [loss = 1.308, top1 = 66.88%], test : [loss = 1.291, top1 = 68.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.94%], valid : [loss = 2.411, top1 = 38.73%], test : [loss = 2.434, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.32%], valid : [loss = 0.614, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7224/15625) 007224-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.71%], valid : [loss = 0.660, top1 = 78.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10        train : [loss = 0.508, top1 = 82.44%], test  : [loss = 0.592, top1 = 79.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 1.685, top1 = 54.34%], valid : [loss = 1.854, top1 = 50.65%], test : [loss = 1.862, top1 = 51.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.15 ms.
ImageNet16-120 train : [loss = 3.333, top1 = 21.20%], valid : [loss = 3.315, top1 = 21.04%], test : [loss = 3.344, top1 = 21.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7225/15625) 007225-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.58%], valid : [loss = 0.577, top1 = 87.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.027, top1 = 99.16%], test  : [loss = 0.369, top1 = 91.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.360, top1 = 89.71%], valid : [loss = 1.357, top1 = 66.16%], test : [loss = 1.369, top1 = 65.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.88 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 33.87%], valid : [loss = 2.665, top1 = 32.20%], test : [loss = 2.695, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.250, top1 = 54.39%], valid : [loss = 1.249, top1 = 54.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7226/15625) 007226-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.35%], valid : [loss = 0.527, top1 = 87.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10        train : [loss = 0.053, top1 = 98.36%], test  : [loss = 0.362, top1 = 90.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.623, top1 = 81.55%], valid : [loss = 1.322, top1 = 65.08%], test : [loss = 1.337, top1 = 65.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.15%], valid : [loss = 2.465, top1 = 37.17%], test : [loss = 2.508, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.11%], valid : [loss = 0.652, top1 = 77.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7227/15625) 007227-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.08%], valid : [loss = 0.459, top1 = 86.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.89 ms.
cifar10        train : [loss = 0.155, top1 = 94.90%], test  : [loss = 0.348, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.89 ms.
cifar100       train : [loss = 0.993, top1 = 71.73%], valid : [loss = 1.352, top1 = 61.98%], test : [loss = 1.342, top1 = 61.81%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.96%], valid : [loss = 2.693, top1 = 33.14%], test : [loss = 2.700, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7228/15625) 007228-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.504, top1 = 88.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.332, top1 = 92.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.50 ms.
cifar100       train : [loss = 0.314, top1 = 91.58%], valid : [loss = 1.287, top1 = 66.86%], test : [loss = 1.265, top1 = 67.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.13%], valid : [loss = 2.395, top1 = 39.33%], test : [loss = 2.401, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7229/15625) 007229-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.77%], valid : [loss = 0.529, top1 = 85.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10        train : [loss = 0.094, top1 = 97.00%], test  : [loss = 0.357, top1 = 89.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 0.815, top1 = 76.21%], valid : [loss = 1.371, top1 = 63.46%], test : [loss = 1.400, top1 = 62.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.66%], valid : [loss = 2.602, top1 = 34.37%], test : [loss = 2.643, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.52%], valid : [loss = 0.947, top1 = 66.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7230/15625) 007230-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.16 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7231/15625) 007231-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.590, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.384, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.49 ms.
cifar100       train : [loss = 0.407, top1 = 88.51%], valid : [loss = 1.414, top1 = 64.90%], test : [loss = 1.388, top1 = 65.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.18%], valid : [loss = 2.502, top1 = 36.92%], test : [loss = 2.508, top1 = 37.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.86%], valid : [loss = 0.801, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7232/15625) 007232-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.24%], valid : [loss = 0.461, top1 = 85.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.161, top1 = 94.79%], test  : [loss = 0.342, top1 = 89.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.995, top1 = 71.72%], valid : [loss = 1.358, top1 = 62.04%], test : [loss = 1.342, top1 = 61.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.683, top1 = 32.98%], valid : [loss = 2.727, top1 = 32.20%], test : [loss = 2.784, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7233/15625) 007233-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.526, top1 = 88.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.44 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.326, top1 = 92.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.16 ms.
cifar100       train : [loss = 0.184, top1 = 95.51%], valid : [loss = 1.341, top1 = 67.70%], test : [loss = 1.357, top1 = 67.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.15%], valid : [loss = 2.352, top1 = 39.87%], test : [loss = 2.355, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 77.10%], valid : [loss = 0.729, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7234/15625) 007234-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.42%], valid : [loss = 0.471, top1 = 85.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.52 ms.
cifar10        train : [loss = 0.162, top1 = 94.72%], test  : [loss = 0.346, top1 = 88.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 0.980, top1 = 72.00%], valid : [loss = 1.351, top1 = 62.02%], test : [loss = 1.336, top1 = 62.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 33.92%], valid : [loss = 2.694, top1 = 32.93%], test : [loss = 2.715, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7235/15625) 007235-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.531, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.312, top1 = 92.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.00 ms.
cifar100       train : [loss = 0.150, top1 = 96.84%], valid : [loss = 1.304, top1 = 68.76%], test : [loss = 1.304, top1 = 69.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 51.05%], valid : [loss = 2.285, top1 = 41.63%], test : [loss = 2.299, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7236/15625) 007236-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.531, top1 = 89.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.339, top1 = 92.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.75 ms.
cifar100       train : [loss = 0.119, top1 = 97.46%], valid : [loss = 1.368, top1 = 68.84%], test : [loss = 1.349, top1 = 68.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.02%], valid : [loss = 2.226, top1 = 42.90%], test : [loss = 2.233, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.09%], valid : [loss = 0.645, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7237/15625) 007237-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.79%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.85 ms.
cifar100       train : [loss = 0.130, top1 = 97.30%], valid : [loss = 1.310, top1 = 69.20%], test : [loss = 1.334, top1 = 68.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.77 ms.
ImageNet16-120 train : [loss = 1.690, top1 = 54.70%], valid : [loss = 2.197, top1 = 43.97%], test : [loss = 2.203, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.84%], valid : [loss = 0.630, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7238/15625) 007238-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.423, top1 = 90.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.297, top1 = 92.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.31 ms.
cifar100       train : [loss = 0.167, top1 = 96.18%], valid : [loss = 1.287, top1 = 69.60%], test : [loss = 1.280, top1 = 70.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 1.790, top1 = 52.46%], valid : [loss = 2.260, top1 = 42.07%], test : [loss = 2.262, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.419, top1 = 85.50%], valid : [loss = 0.550, top1 = 81.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7239/15625) 007239-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.74%], valid : [loss = 0.473, top1 = 84.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.295, top1 = 90.12%], test  : [loss = 0.399, top1 = 86.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 1.348, top1 = 62.70%], valid : [loss = 1.550, top1 = 57.42%], test : [loss = 1.524, top1 = 57.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.73%], valid : [loss = 2.904, top1 = 29.87%], test : [loss = 2.954, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7240/15625) 007240-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.540, top1 = 88.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.324, top1 = 91.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.83 ms.
cifar100       train : [loss = 0.436, top1 = 87.25%], valid : [loss = 1.237, top1 = 67.66%], test : [loss = 1.248, top1 = 67.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.92%], valid : [loss = 2.375, top1 = 39.67%], test : [loss = 2.406, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.33%], valid : [loss = 0.802, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7241/15625) 007241-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10-valid  train : [loss = 0.281, top1 = 90.61%], valid : [loss = 0.483, top1 = 84.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10        train : [loss = 0.302, top1 = 89.89%], test  : [loss = 0.405, top1 = 86.04%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.00 ms.
cifar100       train : [loss = 1.335, top1 = 62.89%], valid : [loss = 1.535, top1 = 57.82%], test : [loss = 1.499, top1 = 57.64%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.07 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.50%], valid : [loss = 2.917, top1 = 29.10%], test : [loss = 2.964, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7242/15625) 007242-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.571, top1 = 87.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.14 ms.
cifar10        train : [loss = 0.038, top1 = 98.82%], test  : [loss = 0.381, top1 = 90.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.18 ms.
cifar100       train : [loss = 0.644, top1 = 81.35%], valid : [loss = 1.486, top1 = 61.00%], test : [loss = 1.448, top1 = 62.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.50 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 34.90%], valid : [loss = 2.650, top1 = 33.77%], test : [loss = 2.666, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.45%], valid : [loss = 0.868, top1 = 69.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7243/15625) 007243-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.536, top1 = 89.85%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.33 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.296, top1 = 93.57%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.66 ms.
cifar100       train : [loss = 0.046, top1 = 99.23%], valid : [loss = 1.431, top1 = 69.20%], test : [loss = 1.411, top1 = 70.36%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 47.93%], valid : [loss = 2.335, top1 = 40.37%], test : [loss = 2.322, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.66%], valid : [loss = 0.776, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7244/15625) 007244-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.318, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.87 ms.
cifar100       train : [loss = 0.327, top1 = 91.16%], valid : [loss = 1.299, top1 = 67.03%], test : [loss = 1.314, top1 = 67.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.23%], valid : [loss = 2.370, top1 = 40.63%], test : [loss = 2.414, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7245/15625) 007245-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10-valid  train : [loss = 1.165, top1 = 58.34%], valid : [loss = 1.215, top1 = 57.15%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.79 ms.
cifar10        train : [loss = 1.096, top1 = 61.22%], test  : [loss = 1.102, top1 = 60.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.33 ms.
cifar100       train : [loss = 2.693, top1 = 32.61%], valid : [loss = 2.765, top1 = 31.70%], test : [loss = 2.737, top1 = 32.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.04 ms.
ImageNet16-120 train : [loss = 3.825, top1 = 13.03%], valid : [loss = 3.829, top1 = 13.90%], test : [loss = 3.829, top1 = 13.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.681, top1 = 36.72%], valid : [loss = 1.715, top1 = 34.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7246/15625) 007246-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.622, top1 = 85.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.416, top1 = 88.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 0.715, top1 = 79.29%], valid : [loss = 1.396, top1 = 62.16%], test : [loss = 1.405, top1 = 62.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 36.06%], valid : [loss = 2.643, top1 = 34.43%], test : [loss = 2.665, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.18%], valid : [loss = 0.787, top1 = 72.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7247/15625) 007247-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.66%], valid : [loss = 0.877, top1 = 71.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.561, top1 = 80.34%], test  : [loss = 0.726, top1 = 75.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.41 ms.
cifar100       train : [loss = 1.776, top1 = 52.16%], valid : [loss = 2.064, top1 = 46.44%], test : [loss = 2.070, top1 = 46.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.80%], valid : [loss = 3.622, top1 = 17.30%], test : [loss = 3.673, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7248/15625) 007248-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.544, top1 = 89.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.17 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.351, top1 = 92.18%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.96 ms.
cifar100       train : [loss = 0.112, top1 = 97.69%], valid : [loss = 1.365, top1 = 68.40%], test : [loss = 1.362, top1 = 69.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 1.963, top1 = 48.36%], valid : [loss = 2.330, top1 = 40.27%], test : [loss = 2.345, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.74%], valid : [loss = 0.862, top1 = 69.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7249/15625) 007249-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.78%], valid : [loss = 0.873, top1 = 71.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10        train : [loss = 0.557, top1 = 80.48%], test  : [loss = 0.715, top1 = 75.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.23 ms.
cifar100       train : [loss = 1.768, top1 = 52.35%], valid : [loss = 2.044, top1 = 47.40%], test : [loss = 2.063, top1 = 47.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.87%], valid : [loss = 3.638, top1 = 17.10%], test : [loss = 3.668, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7250/15625) 007250-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.512, top1 = 88.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.335, top1 = 92.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 0.345, top1 = 90.60%], valid : [loss = 1.277, top1 = 67.40%], test : [loss = 1.274, top1 = 67.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.86%], valid : [loss = 2.404, top1 = 39.03%], test : [loss = 2.428, top1 = 39.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7251/15625) 007251-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.50%], valid : [loss = 0.537, top1 = 83.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10        train : [loss = 0.199, top1 = 93.23%], test  : [loss = 0.403, top1 = 87.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 1.233, top1 = 64.98%], valid : [loss = 1.544, top1 = 57.97%], test : [loss = 1.548, top1 = 57.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.696, top1 = 32.61%], valid : [loss = 2.743, top1 = 32.22%], test : [loss = 2.779, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.89%], valid : [loss = 0.993, top1 = 64.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7252/15625) 007252-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.80 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.469, top1 = 89.42%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.327, top1 = 92.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.36 ms.
cifar100       train : [loss = 0.301, top1 = 92.15%], valid : [loss = 1.204, top1 = 68.74%], test : [loss = 1.232, top1 = 68.50%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.91%], valid : [loss = 2.203, top1 = 43.30%], test : [loss = 2.188, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.54%], valid : [loss = 0.639, top1 = 78.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7253/15625) 007253-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.97%], valid : [loss = 0.526, top1 = 85.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.076, top1 = 97.74%], test  : [loss = 0.352, top1 = 89.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.15 ms.
cifar100       train : [loss = 0.690, top1 = 79.94%], valid : [loss = 1.306, top1 = 64.38%], test : [loss = 1.278, top1 = 65.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.47%], valid : [loss = 2.499, top1 = 36.60%], test : [loss = 2.512, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.71%], valid : [loss = 0.921, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7254/15625) 007254-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.475, top1 = 89.58%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.287, top1 = 93.14%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.29 ms.
cifar100       train : [loss = 0.104, top1 = 98.16%], valid : [loss = 1.284, top1 = 69.64%], test : [loss = 1.300, top1 = 69.96%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 1.653, top1 = 55.71%], valid : [loss = 2.140, top1 = 45.07%], test : [loss = 2.175, top1 = 44.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.63%], valid : [loss = 0.622, top1 = 78.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7255/15625) 007255-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.608, top1 = 87.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.387, top1 = 91.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.93 ms.
cifar100       train : [loss = 0.434, top1 = 87.73%], valid : [loss = 1.514, top1 = 63.04%], test : [loss = 1.507, top1 = 62.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.410, top1 = 38.11%], valid : [loss = 2.556, top1 = 34.43%], test : [loss = 2.591, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 63.13%], valid : [loss = 1.066, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7256/15625) 007256-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.633, top1 = 87.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.419, top1 = 90.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.193, top1 = 95.40%], valid : [loss = 1.559, top1 = 64.58%], test : [loss = 1.591, top1 = 64.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.10 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.08%], valid : [loss = 2.500, top1 = 38.00%], test : [loss = 2.509, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.10%], valid : [loss = 0.797, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7257/15625) 007257-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.185, top1 = 93.78%], valid : [loss = 0.503, top1 = 84.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.197, top1 = 93.34%], test  : [loss = 0.374, top1 = 87.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.64 ms.
cifar100       train : [loss = 1.220, top1 = 65.48%], valid : [loss = 1.548, top1 = 57.81%], test : [loss = 1.538, top1 = 57.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.768, top1 = 31.33%], valid : [loss = 2.811, top1 = 30.36%], test : [loss = 2.832, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.04%], valid : [loss = 1.037, top1 = 63.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7258/15625) 007258-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.13%], valid : [loss = 0.838, top1 = 72.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.37 ms.
cifar10        train : [loss = 0.562, top1 = 80.32%], test  : [loss = 0.719, top1 = 75.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.83 ms.
cifar100       train : [loss = 1.785, top1 = 52.01%], valid : [loss = 2.053, top1 = 46.98%], test : [loss = 2.066, top1 = 46.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.86%], valid : [loss = 3.639, top1 = 16.97%], test : [loss = 3.664, top1 = 15.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7259/15625) 007259-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.69%], valid : [loss = 0.604, top1 = 84.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.11 ms.
cifar10        train : [loss = 0.091, top1 = 97.09%], test  : [loss = 0.414, top1 = 88.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 0.787, top1 = 76.96%], valid : [loss = 1.449, top1 = 61.56%], test : [loss = 1.404, top1 = 62.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.29%], valid : [loss = 2.736, top1 = 32.80%], test : [loss = 2.766, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7260/15625) 007260-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.492, top1 = 89.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.314, top1 = 92.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.56 ms.
cifar100       train : [loss = 0.248, top1 = 93.73%], valid : [loss = 1.256, top1 = 68.56%], test : [loss = 1.258, top1 = 68.46%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.58%], valid : [loss = 2.252, top1 = 41.83%], test : [loss = 2.289, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.49%], valid : [loss = 0.645, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7261/15625) 007261-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.543, top1 = 88.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.019, top1 = 99.48%], test  : [loss = 0.314, top1 = 92.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 0.332, top1 = 90.87%], valid : [loss = 1.254, top1 = 67.60%], test : [loss = 1.244, top1 = 68.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.27%], valid : [loss = 2.308, top1 = 41.03%], test : [loss = 2.330, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.26%], valid : [loss = 0.671, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7262/15625) 007262-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.10%], valid : [loss = 0.719, top1 = 75.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.436, top1 = 84.72%], test  : [loss = 0.574, top1 = 80.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.60 ms.
cifar100       train : [loss = 1.781, top1 = 51.51%], valid : [loss = 1.968, top1 = 47.76%], test : [loss = 1.964, top1 = 47.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 3.451, top1 = 18.65%], valid : [loss = 3.443, top1 = 19.49%], test : [loss = 3.474, top1 = 18.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.247, top1 = 54.68%], valid : [loss = 1.290, top1 = 53.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7263/15625) 007263-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.27%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=19.27 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.18%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=18.59 ms.
cifar100       train : [loss = 0.256, top1 = 93.49%], valid : [loss = 1.234, top1 = 68.62%], test : [loss = 1.237, top1 = 69.13%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.39%], valid : [loss = 2.252, top1 = 41.72%], test : [loss = 2.282, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.50%], valid : [loss = 0.609, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7264/15625) 007264-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.34%], valid : [loss = 0.688, top1 = 84.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.34 ms.
cifar10        train : [loss = 0.056, top1 = 98.30%], test  : [loss = 0.469, top1 = 88.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.611, top1 = 82.11%], valid : [loss = 1.498, top1 = 61.80%], test : [loss = 1.528, top1 = 61.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.37%], valid : [loss = 2.795, top1 = 31.00%], test : [loss = 2.870, top1 = 29.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.68%], valid : [loss = 0.892, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7265/15625) 007265-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.18%], valid : [loss = 0.461, top1 = 86.72%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.29 ms.
cifar10        train : [loss = 0.120, top1 = 96.28%], test  : [loss = 0.349, top1 = 88.79%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=15.11 ms.
cifar100       train : [loss = 0.738, top1 = 79.35%], valid : [loss = 1.273, top1 = 65.20%], test : [loss = 1.266, top1 = 65.04%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 36.83%], valid : [loss = 2.584, top1 = 35.43%], test : [loss = 2.606, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.92%], valid : [loss = 0.809, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7266/15625) 007266-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.243, top1 = 91.66%], valid : [loss = 0.850, top1 = 76.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.74 ms.
cifar10        train : [loss = 0.320, top1 = 89.01%], test  : [loss = 0.649, top1 = 79.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.89 ms.
cifar100       train : [loss = 1.347, top1 = 62.14%], valid : [loss = 1.919, top1 = 49.68%], test : [loss = 1.921, top1 = 50.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 3.469, top1 = 17.77%], valid : [loss = 3.488, top1 = 18.13%], test : [loss = 3.493, top1 = 16.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.218, top1 = 55.91%], valid : [loss = 1.257, top1 = 54.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7267/15625) 007267-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.14%], valid : [loss = 0.474, top1 = 85.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.165, top1 = 94.63%], test  : [loss = 0.352, top1 = 88.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.97 ms.
cifar100       train : [loss = 1.018, top1 = 71.16%], valid : [loss = 1.386, top1 = 61.66%], test : [loss = 1.362, top1 = 61.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.78%], valid : [loss = 2.683, top1 = 33.23%], test : [loss = 2.690, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7268/15625) 007268-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.65%], valid : [loss = 0.470, top1 = 85.94%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=14.71 ms.
cifar10        train : [loss = 0.159, top1 = 94.78%], test  : [loss = 0.346, top1 = 88.92%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=14.95 ms.
cifar100       train : [loss = 1.019, top1 = 71.02%], valid : [loss = 1.361, top1 = 61.71%], test : [loss = 1.368, top1 = 61.89%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.82%], valid : [loss = 2.689, top1 = 32.79%], test : [loss = 2.695, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.75%], valid : [loss = 0.791, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7269/15625) 007269-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.510, top1 = 89.32%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.57 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.316, top1 = 92.65%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=22.04 ms.
cifar100       train : [loss = 0.198, top1 = 95.12%], valid : [loss = 1.182, top1 = 70.88%], test : [loss = 1.242, top1 = 69.34%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.26 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.64%], valid : [loss = 2.160, top1 = 44.03%], test : [loss = 2.211, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.04%], valid : [loss = 0.745, top1 = 74.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7270/15625) 007270-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.13%], valid : [loss = 0.602, top1 = 85.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.85 ms.
cifar10        train : [loss = 0.074, top1 = 97.71%], test  : [loss = 0.397, top1 = 88.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 0.718, top1 = 79.17%], valid : [loss = 1.401, top1 = 63.58%], test : [loss = 1.356, top1 = 63.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.60%], valid : [loss = 2.660, top1 = 33.87%], test : [loss = 2.733, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7271/15625) 007271-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.469, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.316, top1 = 92.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.44 ms.
cifar100       train : [loss = 0.337, top1 = 90.92%], valid : [loss = 1.233, top1 = 67.89%], test : [loss = 1.236, top1 = 68.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.66%], valid : [loss = 2.324, top1 = 40.32%], test : [loss = 2.356, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7272/15625) 007272-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.538, top1 = 87.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.036, top1 = 99.02%], test  : [loss = 0.371, top1 = 90.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.95 ms.
cifar100       train : [loss = 0.529, top1 = 84.60%], valid : [loss = 1.348, top1 = 65.15%], test : [loss = 1.327, top1 = 65.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.16%], valid : [loss = 2.481, top1 = 37.44%], test : [loss = 2.517, top1 = 36.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.15%], valid : [loss = 0.635, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7273/15625) 007273-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.445, top1 = 89.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.284, top1 = 92.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.52 ms.
cifar100       train : [loss = 0.205, top1 = 95.22%], valid : [loss = 1.269, top1 = 69.64%], test : [loss = 1.245, top1 = 69.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.856, top1 = 51.00%], valid : [loss = 2.245, top1 = 42.20%], test : [loss = 2.305, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.22%], valid : [loss = 0.527, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7274/15625) 007274-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.70%], valid : [loss = 0.548, top1 = 83.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10        train : [loss = 0.209, top1 = 92.91%], test  : [loss = 0.396, top1 = 87.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 1.299, top1 = 63.16%], valid : [loss = 1.598, top1 = 56.19%], test : [loss = 1.588, top1 = 56.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.741, top1 = 31.77%], valid : [loss = 2.777, top1 = 31.00%], test : [loss = 2.809, top1 = 30.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 65.41%], valid : [loss = 1.002, top1 = 64.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7275/15625) 007275-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.582, top1 = 87.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.361, top1 = 91.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.82 ms.
cifar100       train : [loss = 0.288, top1 = 91.95%], valid : [loss = 1.305, top1 = 67.70%], test : [loss = 1.352, top1 = 67.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.24%], valid : [loss = 2.415, top1 = 38.80%], test : [loss = 2.451, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7276/15625) 007276-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.351, top1 = 87.72%], valid : [loss = 0.615, top1 = 80.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.288, top1 = 90.13%], test  : [loss = 0.442, top1 = 85.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.47 ms.
cifar100       train : [loss = 1.538, top1 = 57.01%], valid : [loss = 1.779, top1 = 51.92%], test : [loss = 1.761, top1 = 52.13%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.46%], valid : [loss = 2.941, top1 = 28.12%], test : [loss = 2.977, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.046, top1 = 62.06%], valid : [loss = 1.097, top1 = 60.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7277/15625) 007277-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.493, top1 = 90.13%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.28 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.308, top1 = 93.44%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.70 ms.
cifar100       train : [loss = 0.106, top1 = 98.05%], valid : [loss = 1.306, top1 = 69.22%], test : [loss = 1.315, top1 = 69.62%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.71 ms.
ImageNet16-120 train : [loss = 1.668, top1 = 55.25%], valid : [loss = 2.178, top1 = 44.03%], test : [loss = 2.155, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.79%], valid : [loss = 0.577, top1 = 80.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7278/15625) 007278-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.528, top1 = 89.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.346, top1 = 92.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.14 ms.
cifar100       train : [loss = 0.081, top1 = 98.68%], valid : [loss = 1.413, top1 = 69.07%], test : [loss = 1.444, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.11%], valid : [loss = 2.362, top1 = 41.16%], test : [loss = 2.374, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.661, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7279/15625) 007279-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.524, top1 = 88.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.331, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.208, top1 = 94.97%], valid : [loss = 1.303, top1 = 68.48%], test : [loss = 1.296, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.29 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.33%], valid : [loss = 2.302, top1 = 41.30%], test : [loss = 2.294, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.88%], valid : [loss = 0.671, top1 = 76.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7280/15625) 007280-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.613, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.429, top1 = 90.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.249, top1 = 93.67%], valid : [loss = 1.531, top1 = 64.74%], test : [loss = 1.539, top1 = 64.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.31%], valid : [loss = 2.549, top1 = 36.33%], test : [loss = 2.571, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.48%], valid : [loss = 0.754, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7281/15625) 007281-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.27%], valid : [loss = 0.511, top1 = 86.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10        train : [loss = 0.090, top1 = 97.05%], test  : [loss = 0.348, top1 = 89.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.661, top1 = 81.01%], valid : [loss = 1.194, top1 = 67.25%], test : [loss = 1.183, top1 = 67.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.54%], valid : [loss = 2.473, top1 = 37.95%], test : [loss = 2.495, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.96%], valid : [loss = 0.917, top1 = 67.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7282/15625) 007282-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.561, top1 = 88.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.44 ms.
cifar10        train : [loss = 0.010, top1 = 99.72%], test  : [loss = 0.376, top1 = 92.05%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.47 ms.
cifar100       train : [loss = 0.171, top1 = 95.87%], valid : [loss = 1.371, top1 = 68.24%], test : [loss = 1.360, top1 = 68.10%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.47%], valid : [loss = 2.246, top1 = 42.10%], test : [loss = 2.270, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.97%], valid : [loss = 0.900, top1 = 68.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7283/15625) 007283-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.21%], valid : [loss = 0.481, top1 = 84.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10        train : [loss = 0.243, top1 = 91.83%], test  : [loss = 0.406, top1 = 86.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 1.340, top1 = 62.61%], valid : [loss = 1.604, top1 = 55.42%], test : [loss = 1.579, top1 = 55.89%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 3.397, top1 = 19.49%], valid : [loss = 3.590, top1 = 17.00%], test : [loss = 3.604, top1 = 16.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7284/15625) 007284-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.40%], valid : [loss = 0.870, top1 = 71.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10        train : [loss = 0.567, top1 = 80.14%], test  : [loss = 0.719, top1 = 75.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.32 ms.
cifar100       train : [loss = 1.783, top1 = 52.05%], valid : [loss = 2.072, top1 = 46.86%], test : [loss = 2.064, top1 = 46.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.53%], valid : [loss = 3.624, top1 = 16.20%], test : [loss = 3.660, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7285/15625) 007285-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.181, top1 = 93.95%], valid : [loss = 0.526, top1 = 84.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.171, top1 = 94.28%], test  : [loss = 0.378, top1 = 88.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 1.232, top1 = 65.17%], valid : [loss = 1.534, top1 = 57.77%], test : [loss = 1.534, top1 = 57.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 34.07%], valid : [loss = 2.685, top1 = 33.58%], test : [loss = 2.717, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 1.000, top1 = 64.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7286/15625) 007286-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.48%], valid : [loss = 0.582, top1 = 87.02%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.68 ms.
cifar10        train : [loss = 0.039, top1 = 98.78%], test  : [loss = 0.378, top1 = 90.27%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.74 ms.
cifar100       train : [loss = 0.440, top1 = 87.39%], valid : [loss = 1.309, top1 = 65.76%], test : [loss = 1.290, top1 = 66.08%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.13 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 43.97%], valid : [loss = 2.375, top1 = 39.17%], test : [loss = 2.355, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.10%], valid : [loss = 0.856, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7287/15625) 007287-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.544, top1 = 88.64%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.46 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.387, top1 = 90.90%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=23.26 ms.
cifar100       train : [loss = 0.434, top1 = 87.48%], valid : [loss = 1.488, top1 = 62.98%], test : [loss = 1.440, top1 = 64.14%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.25%], valid : [loss = 2.278, top1 = 40.93%], test : [loss = 2.335, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.34%], valid : [loss = 0.929, top1 = 67.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7288/15625) 007288-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.81%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.94 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.308, top1 = 93.22%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.58 ms.
cifar100       train : [loss = 0.072, top1 = 98.89%], valid : [loss = 1.369, top1 = 69.30%], test : [loss = 1.355, top1 = 70.10%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.79 ms.
ImageNet16-120 train : [loss = 2.021, top1 = 46.84%], valid : [loss = 2.383, top1 = 39.67%], test : [loss = 2.402, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.38%], valid : [loss = 0.784, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7289/15625) 007289-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.25%], valid : [loss = 0.968, top1 = 75.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10        train : [loss = 0.216, top1 = 92.64%], test  : [loss = 0.595, top1 = 82.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 1.149, top1 = 67.40%], valid : [loss = 1.808, top1 = 53.45%], test : [loss = 1.778, top1 = 54.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.80%], valid : [loss = 3.339, top1 = 21.67%], test : [loss = 3.375, top1 = 20.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.66%], valid : [loss = 1.095, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7290/15625) 007290-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.537, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.348, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.94 ms.
cifar100       train : [loss = 0.269, top1 = 92.73%], valid : [loss = 1.329, top1 = 66.80%], test : [loss = 1.329, top1 = 67.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.23%], valid : [loss = 2.416, top1 = 38.23%], test : [loss = 2.478, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7291/15625) 007291-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.464, top1 = 86.70%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.115, top1 = 96.45%], test  : [loss = 0.333, top1 = 89.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.81 ms.
cifar100       train : [loss = 0.865, top1 = 75.34%], valid : [loss = 1.294, top1 = 64.19%], test : [loss = 1.283, top1 = 64.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.57%], valid : [loss = 2.638, top1 = 33.98%], test : [loss = 2.675, top1 = 33.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7292/15625) 007292-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.332, top1 = 92.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.72 ms.
cifar100       train : [loss = 0.172, top1 = 96.30%], valid : [loss = 1.314, top1 = 68.54%], test : [loss = 1.306, top1 = 68.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.42%], valid : [loss = 2.308, top1 = 41.27%], test : [loss = 2.301, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7293/15625) 007293-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.453, top1 = 90.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.303, top1 = 93.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.89 ms.
cifar100       train : [loss = 0.084, top1 = 98.64%], valid : [loss = 1.354, top1 = 69.50%], test : [loss = 1.390, top1 = 69.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.88 ms.
ImageNet16-120 train : [loss = 1.592, top1 = 57.17%], valid : [loss = 2.205, top1 = 44.23%], test : [loss = 2.240, top1 = 44.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.34%], valid : [loss = 0.522, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7294/15625) 007294-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=21.84 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.512, top1 = 89.96%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=24.36 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.316, top1 = 93.15%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=23.04 ms.
cifar100       train : [loss = 0.038, top1 = 99.61%], valid : [loss = 1.344, top1 = 70.74%], test : [loss = 1.357, top1 = 70.76%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.22%], valid : [loss = 2.304, top1 = 40.63%], test : [loss = 2.302, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.37%], valid : [loss = 0.688, top1 = 76.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7295/15625) 007295-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.92%], valid : [loss = 0.480, top1 = 84.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.301, top1 = 89.95%], test  : [loss = 0.403, top1 = 86.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.92 ms.
cifar100       train : [loss = 1.337, top1 = 62.80%], valid : [loss = 1.543, top1 = 57.27%], test : [loss = 1.505, top1 = 58.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.58%], valid : [loss = 2.899, top1 = 29.47%], test : [loss = 2.970, top1 = 27.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7296/15625) 007296-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.85%], valid : [loss = 0.797, top1 = 81.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.057, top1 = 98.19%], test  : [loss = 0.438, top1 = 88.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.98 ms.
cifar100       train : [loss = 0.667, top1 = 80.63%], valid : [loss = 1.533, top1 = 61.04%], test : [loss = 1.497, top1 = 61.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 33.03%], valid : [loss = 2.838, top1 = 30.00%], test : [loss = 2.882, top1 = 30.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.78%], valid : [loss = 0.902, top1 = 68.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7297/15625) 007297-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.02%], valid : [loss = 0.521, top1 = 87.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.077, top1 = 97.52%], test  : [loss = 0.351, top1 = 90.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.13 ms.
cifar100       train : [loss = 0.707, top1 = 79.24%], valid : [loss = 1.336, top1 = 64.72%], test : [loss = 1.377, top1 = 64.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.01%], valid : [loss = 2.630, top1 = 33.57%], test : [loss = 2.673, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.27%], valid : [loss = 0.659, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7298/15625) 007298-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.57%], valid : [loss = 0.447, top1 = 86.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.162, top1 = 94.80%], test  : [loss = 0.351, top1 = 88.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.96 ms.
cifar100       train : [loss = 1.005, top1 = 71.38%], valid : [loss = 1.367, top1 = 61.92%], test : [loss = 1.348, top1 = 62.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.19 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.59%], valid : [loss = 2.694, top1 = 32.83%], test : [loss = 2.716, top1 = 31.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7299/15625) 007299-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.47%], valid : [loss = 0.660, top1 = 77.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.497, top1 = 82.79%], test  : [loss = 0.581, top1 = 80.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 1.698, top1 = 54.00%], valid : [loss = 1.872, top1 = 49.89%], test : [loss = 1.867, top1 = 50.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 21.23%], valid : [loss = 3.322, top1 = 21.69%], test : [loss = 3.349, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.62%], valid : [loss = 1.304, top1 = 53.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7300/15625) 007300-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.445, top1 = 90.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.297, top1 = 93.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.08 ms.
cifar100       train : [loss = 0.066, top1 = 99.01%], valid : [loss = 1.370, top1 = 70.14%], test : [loss = 1.366, top1 = 69.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 1.540, top1 = 58.39%], valid : [loss = 2.229, top1 = 44.63%], test : [loss = 2.273, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.398, top1 = 86.35%], valid : [loss = 0.514, top1 = 82.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7301/15625) 007301-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.560, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.378, top1 = 91.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 0.400, top1 = 88.60%], valid : [loss = 1.406, top1 = 65.03%], test : [loss = 1.386, top1 = 65.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.94%], valid : [loss = 2.474, top1 = 37.92%], test : [loss = 2.487, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.32%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7302/15625) 007302-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.38%], valid : [loss = 0.452, top1 = 86.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.19 ms.
cifar10        train : [loss = 0.161, top1 = 94.72%], test  : [loss = 0.367, top1 = 88.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.19 ms.
cifar100       train : [loss = 1.032, top1 = 70.78%], valid : [loss = 1.388, top1 = 60.96%], test : [loss = 1.381, top1 = 61.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 34.01%], valid : [loss = 2.702, top1 = 32.70%], test : [loss = 2.699, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.40%], valid : [loss = 0.792, top1 = 72.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7303/15625) 007303-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.72%], valid : [loss = 0.609, top1 = 84.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.57 ms.
cifar10        train : [loss = 0.086, top1 = 97.25%], test  : [loss = 0.425, top1 = 88.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.49 ms.
cifar100       train : [loss = 0.734, top1 = 78.24%], valid : [loss = 1.573, top1 = 59.80%], test : [loss = 1.585, top1 = 59.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 3.243, top1 = 21.25%], valid : [loss = 3.246, top1 = 20.77%], test : [loss = 3.275, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.97%], valid : [loss = 1.069, top1 = 61.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7304/15625) 007304-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.489, top1 = 89.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.319, top1 = 92.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.88 ms.
cifar100       train : [loss = 0.139, top1 = 97.28%], valid : [loss = 1.250, top1 = 70.30%], test : [loss = 1.230, top1 = 69.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.90%], valid : [loss = 2.194, top1 = 43.73%], test : [loss = 2.176, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 82.11%], valid : [loss = 0.615, top1 = 79.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7305/15625) 007305-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.130, top1 = 96.01%], valid : [loss = 0.462, top1 = 86.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.165, top1 = 94.72%], test  : [loss = 0.362, top1 = 88.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.28 ms.
cifar100       train : [loss = 0.992, top1 = 71.83%], valid : [loss = 1.357, top1 = 62.62%], test : [loss = 1.355, top1 = 61.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.67%], valid : [loss = 2.683, top1 = 32.67%], test : [loss = 2.701, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7306/15625) 007306-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.546, top1 = 88.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.344, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.38 ms.
cifar100       train : [loss = 0.293, top1 = 91.78%], valid : [loss = 1.332, top1 = 67.11%], test : [loss = 1.318, top1 = 67.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.91%], valid : [loss = 2.447, top1 = 38.04%], test : [loss = 2.440, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7307/15625) 007307-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.54%], valid : [loss = 0.502, top1 = 85.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.101, top1 = 96.84%], test  : [loss = 0.357, top1 = 89.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.25 ms.
cifar100       train : [loss = 0.774, top1 = 77.53%], valid : [loss = 1.349, top1 = 63.68%], test : [loss = 1.339, top1 = 63.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.517, top1 = 36.34%], valid : [loss = 2.627, top1 = 34.10%], test : [loss = 2.662, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.886, top1 = 68.51%], valid : [loss = 0.950, top1 = 66.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7308/15625) 007308-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.231, top1 = 92.18%], valid : [loss = 0.511, top1 = 83.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.285, top1 = 90.46%], test  : [loss = 0.434, top1 = 85.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.42 ms.
cifar100       train : [loss = 1.321, top1 = 63.13%], valid : [loss = 1.602, top1 = 55.82%], test : [loss = 1.579, top1 = 56.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 3.449, top1 = 18.68%], valid : [loss = 3.797, top1 = 13.23%], test : [loss = 3.800, top1 = 13.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.63%], valid : [loss = 1.028, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7309/15625) 007309-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.55 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.88 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7310/15625) 007310-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.60 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.500, top1 = 88.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.027, top1 = 99.27%], test  : [loss = 0.325, top1 = 91.45%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.03 ms.
cifar100       train : [loss = 0.480, top1 = 85.88%], valid : [loss = 1.360, top1 = 65.84%], test : [loss = 1.350, top1 = 66.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.35%], valid : [loss = 2.512, top1 = 36.97%], test : [loss = 2.542, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7311/15625) 007311-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.37 ms.
cifar10-valid  train : [loss = 1.245, top1 = 55.26%], valid : [loss = 1.293, top1 = 54.15%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10        train : [loss = 1.219, top1 = 56.53%], test  : [loss = 1.230, top1 = 55.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.20 ms.
cifar100       train : [loss = 2.757, top1 = 31.12%], valid : [loss = 2.842, top1 = 30.20%], test : [loss = 2.831, top1 = 30.98%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.10 ms.
ImageNet16-120 train : [loss = 3.897, top1 = 12.01%], valid : [loss = 3.907, top1 = 11.83%], test : [loss = 3.909, top1 = 11.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.736, top1 = 34.44%], valid : [loss = 1.737, top1 = 34.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7312/15625) 007312-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.82%], valid : [loss = 0.542, top1 = 83.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10        train : [loss = 0.217, top1 = 92.44%], test  : [loss = 0.410, top1 = 87.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.49 ms.
cifar100       train : [loss = 1.280, top1 = 63.66%], valid : [loss = 1.549, top1 = 57.48%], test : [loss = 1.567, top1 = 57.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 31.86%], valid : [loss = 2.757, top1 = 31.73%], test : [loss = 2.816, top1 = 30.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 65.80%], valid : [loss = 0.992, top1 = 64.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7313/15625) 007313-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.486, top1 = 90.12%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=23.35 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.287, top1 = 93.70%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.81 ms.
cifar100       train : [loss = 0.068, top1 = 99.03%], valid : [loss = 1.274, top1 = 70.82%], test : [loss = 1.282, top1 = 70.84%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.77 ms.
ImageNet16-120 train : [loss = 1.740, top1 = 53.56%], valid : [loss = 2.247, top1 = 43.53%], test : [loss = 2.219, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.43%], valid : [loss = 0.710, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7314/15625) 007314-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.82%], valid : [loss = 0.717, top1 = 82.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.93 ms.
cifar10        train : [loss = 0.068, top1 = 97.83%], test  : [loss = 0.425, top1 = 88.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.21 ms.
cifar100       train : [loss = 0.766, top1 = 77.55%], valid : [loss = 1.507, top1 = 60.68%], test : [loss = 1.512, top1 = 60.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.75%], valid : [loss = 2.629, top1 = 34.30%], test : [loss = 2.677, top1 = 34.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.84%], valid : [loss = 0.888, top1 = 68.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7315/15625) 007315-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.512, top1 = 88.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.340, top1 = 91.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 0.476, top1 = 85.99%], valid : [loss = 1.345, top1 = 65.55%], test : [loss = 1.349, top1 = 65.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.14%], valid : [loss = 2.535, top1 = 36.00%], test : [loss = 2.553, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7316/15625) 007316-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.06%], valid : [loss = 0.475, top1 = 84.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.304, top1 = 89.87%], test  : [loss = 0.397, top1 = 86.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.44 ms.
cifar100       train : [loss = 1.342, top1 = 62.69%], valid : [loss = 1.543, top1 = 57.46%], test : [loss = 1.516, top1 = 58.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.940, top1 = 28.30%], valid : [loss = 2.936, top1 = 28.77%], test : [loss = 2.969, top1 = 26.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.65%], valid : [loss = 0.751, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7317/15625) 007317-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.62%], valid : [loss = 0.573, top1 = 87.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10        train : [loss = 0.030, top1 = 99.12%], test  : [loss = 0.355, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.70 ms.
cifar100       train : [loss = 0.421, top1 = 87.74%], valid : [loss = 1.293, top1 = 66.90%], test : [loss = 1.293, top1 = 66.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.58%], valid : [loss = 2.445, top1 = 38.23%], test : [loss = 2.446, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.82%], valid : [loss = 0.891, top1 = 68.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7318/15625) 007318-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.78%], valid : [loss = 0.488, top1 = 88.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.021, top1 = 99.46%], test  : [loss = 0.331, top1 = 91.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.58 ms.
cifar100       train : [loss = 0.393, top1 = 88.54%], valid : [loss = 1.328, top1 = 66.86%], test : [loss = 1.290, top1 = 66.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.72%], valid : [loss = 2.412, top1 = 38.90%], test : [loss = 2.433, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.28%], valid : [loss = 0.584, top1 = 80.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7319/15625) 007319-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.36%], valid : [loss = 0.852, top1 = 72.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10        train : [loss = 0.556, top1 = 80.46%], test  : [loss = 0.721, top1 = 75.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.36 ms.
cifar100       train : [loss = 1.777, top1 = 51.91%], valid : [loss = 2.069, top1 = 46.38%], test : [loss = 2.039, top1 = 47.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.86%], valid : [loss = 3.641, top1 = 16.57%], test : [loss = 3.683, top1 = 16.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7320/15625) 007320-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.324, top1 = 88.85%], valid : [loss = 0.611, top1 = 80.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10        train : [loss = 0.281, top1 = 90.34%], test  : [loss = 0.413, top1 = 85.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 1.430, top1 = 59.69%], valid : [loss = 1.702, top1 = 53.64%], test : [loss = 1.682, top1 = 54.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.860, top1 = 29.33%], valid : [loss = 2.878, top1 = 29.63%], test : [loss = 2.923, top1 = 28.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 65.76%], valid : [loss = 1.001, top1 = 64.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7321/15625) 007321-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7322/15625) 007322-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.69%], valid : [loss = 0.840, top1 = 72.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.03 ms.
cifar10        train : [loss = 0.561, top1 = 80.58%], test  : [loss = 0.714, top1 = 75.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.33 ms.
cifar100       train : [loss = 1.788, top1 = 51.91%], valid : [loss = 2.064, top1 = 47.00%], test : [loss = 2.094, top1 = 46.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.60%], valid : [loss = 3.654, top1 = 15.57%], test : [loss = 3.671, top1 = 15.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7323/15625) 007323-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.33 ms.
cifar10-valid  train : [loss = 0.489, top1 = 83.12%], valid : [loss = 0.653, top1 = 78.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10        train : [loss = 0.518, top1 = 81.97%], test  : [loss = 0.593, top1 = 80.09%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.68 ms.
cifar100       train : [loss = 1.686, top1 = 54.23%], valid : [loss = 1.855, top1 = 50.90%], test : [loss = 1.859, top1 = 50.94%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.17 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.44%], valid : [loss = 3.313, top1 = 21.37%], test : [loss = 3.353, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7324/15625) 007324-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.35%], valid : [loss = 0.860, top1 = 71.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 0.559, top1 = 80.64%], test  : [loss = 0.719, top1 = 75.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.87 ms.
cifar100       train : [loss = 1.794, top1 = 51.78%], valid : [loss = 2.060, top1 = 46.18%], test : [loss = 2.080, top1 = 45.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.73%], valid : [loss = 3.633, top1 = 16.83%], test : [loss = 3.655, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7325/15625) 007325-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.537, top1 = 88.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.331, top1 = 92.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.08 ms.
cifar100       train : [loss = 0.085, top1 = 98.53%], valid : [loss = 1.473, top1 = 67.10%], test : [loss = 1.501, top1 = 66.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.88%], valid : [loss = 2.345, top1 = 41.40%], test : [loss = 2.374, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.74%], valid : [loss = 0.676, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7326/15625) 007326-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=110.02 M, Params=0.777 MB, latency=20.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.60%]
cifar10        FLOP=110.02 M, Params=0.777 MB, latency=20.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 93.13%]
cifar100       FLOP=110.03 M, Params=0.783 MB, latency=20.61 ms.
cifar100       train : [loss = 0.133, top1 = 97.39%], valid : [loss = 1.263, top1 = 69.69%], test : [loss = 1.266, top1 = 69.53%]
ImageNet16-120 FLOP= 27.51 M, Params=0.785 MB, latency=20.10 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.16%], valid : [loss = 2.174, top1 = 44.06%], test : [loss = 2.183, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.94%], valid : [loss = 0.595, top1 = 79.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7327/15625) 007327-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.63%], valid : [loss = 0.509, top1 = 88.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.27 ms.
cifar10        train : [loss = 0.025, top1 = 99.38%], test  : [loss = 0.340, top1 = 91.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.59 ms.
cifar100       train : [loss = 0.351, top1 = 90.39%], valid : [loss = 1.181, top1 = 68.98%], test : [loss = 1.199, top1 = 68.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.32%], valid : [loss = 2.260, top1 = 41.77%], test : [loss = 2.320, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.54%], valid : [loss = 0.766, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7328/15625) 007328-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.523, top1 = 82.00%], valid : [loss = 0.835, top1 = 72.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10        train : [loss = 0.554, top1 = 80.56%], test  : [loss = 0.718, top1 = 75.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.41 ms.
cifar100       train : [loss = 1.774, top1 = 52.20%], valid : [loss = 2.070, top1 = 47.48%], test : [loss = 2.074, top1 = 46.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.81%], valid : [loss = 3.634, top1 = 16.43%], test : [loss = 3.683, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7329/15625) 007329-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.586, top1 = 86.91%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.14 ms.
cifar10        train : [loss = 0.031, top1 = 99.20%], test  : [loss = 0.390, top1 = 90.04%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.30 ms.
cifar100       train : [loss = 0.375, top1 = 89.86%], valid : [loss = 1.381, top1 = 65.35%], test : [loss = 1.375, top1 = 65.67%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.64%], valid : [loss = 2.518, top1 = 36.62%], test : [loss = 2.538, top1 = 36.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.76%], valid : [loss = 0.734, top1 = 74.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7330/15625) 007330-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.41 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.00 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7331/15625) 007331-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.478, top1 = 84.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.295, top1 = 90.16%], test  : [loss = 0.399, top1 = 86.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.99 ms.
cifar100       train : [loss = 1.340, top1 = 62.87%], valid : [loss = 1.571, top1 = 57.54%], test : [loss = 1.506, top1 = 58.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.48%], valid : [loss = 2.894, top1 = 29.83%], test : [loss = 2.952, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7332/15625) 007332-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.357, top1 = 87.62%], valid : [loss = 0.574, top1 = 81.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.267, top1 = 90.85%], test  : [loss = 0.422, top1 = 86.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.19 ms.
cifar100       train : [loss = 1.561, top1 = 56.61%], valid : [loss = 1.774, top1 = 52.08%], test : [loss = 1.773, top1 = 51.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.01%], valid : [loss = 2.948, top1 = 28.03%], test : [loss = 2.985, top1 = 27.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.28%], valid : [loss = 1.038, top1 = 63.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7333/15625) 007333-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.97 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7334/15625) 007334-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.76 ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.28%], valid : [loss = 0.842, top1 = 71.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10        train : [loss = 0.710, top1 = 75.18%], test  : [loss = 0.798, top1 = 72.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.76 ms.
cifar100       train : [loss = 1.947, top1 = 48.26%], valid : [loss = 2.121, top1 = 45.24%], test : [loss = 2.134, top1 = 44.82%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.40 ms.
ImageNet16-120 train : [loss = 3.655, top1 = 15.58%], valid : [loss = 3.663, top1 = 16.03%], test : [loss = 3.695, top1 = 15.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7335/15625) 007335-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=22.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.90%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=24.50 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.293, top1 = 93.30%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.87 ms.
cifar100       train : [loss = 0.053, top1 = 99.29%], valid : [loss = 1.314, top1 = 70.14%], test : [loss = 1.321, top1 = 71.46%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=27.06 ms.
ImageNet16-120 train : [loss = 1.619, top1 = 56.53%], valid : [loss = 2.241, top1 = 43.93%], test : [loss = 2.202, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.06%], valid : [loss = 0.714, top1 = 75.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7336/15625) 007336-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.28%], valid : [loss = 0.662, top1 = 77.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10        train : [loss = 0.521, top1 = 81.93%], test  : [loss = 0.590, top1 = 79.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.84 ms.
cifar100       train : [loss = 1.730, top1 = 53.17%], valid : [loss = 1.900, top1 = 49.84%], test : [loss = 1.895, top1 = 49.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 3.351, top1 = 20.95%], valid : [loss = 3.335, top1 = 21.63%], test : [loss = 3.375, top1 = 20.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.306, top1 = 52.71%], valid : [loss = 1.331, top1 = 52.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7337/15625) 007337-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=21.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.479, top1 = 89.65%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=24.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.282, top1 = 93.44%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=23.60 ms.
cifar100       train : [loss = 0.091, top1 = 98.54%], valid : [loss = 1.194, top1 = 71.18%], test : [loss = 1.175, top1 = 71.96%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=19.56 ms.
ImageNet16-120 train : [loss = 1.587, top1 = 57.20%], valid : [loss = 2.129, top1 = 44.83%], test : [loss = 2.116, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.72%], valid : [loss = 0.639, top1 = 78.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7338/15625) 007338-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.562, top1 = 87.43%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.62 ms.
cifar10        train : [loss = 0.042, top1 = 98.68%], test  : [loss = 0.372, top1 = 90.62%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.21 ms.
cifar100       train : [loss = 0.396, top1 = 88.77%], valid : [loss = 1.375, top1 = 65.00%], test : [loss = 1.356, top1 = 66.02%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 40.88%], valid : [loss = 2.490, top1 = 37.53%], test : [loss = 2.492, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.883, top1 = 68.58%], valid : [loss = 0.934, top1 = 66.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7339/15625) 007339-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.06%], valid : [loss = 0.456, top1 = 86.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.159, top1 = 94.78%], test  : [loss = 0.356, top1 = 88.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 1.065, top1 = 69.83%], valid : [loss = 1.379, top1 = 61.36%], test : [loss = 1.403, top1 = 61.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.86 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.56%], valid : [loss = 2.704, top1 = 31.77%], test : [loss = 2.711, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7340/15625) 007340-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.505, top1 = 88.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.69 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.322, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.39 ms.
cifar100       train : [loss = 0.265, top1 = 93.30%], valid : [loss = 1.161, top1 = 69.58%], test : [loss = 1.187, top1 = 69.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.92%], valid : [loss = 2.232, top1 = 42.07%], test : [loss = 2.223, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7341/15625) 007341-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.02%], valid : [loss = 0.477, top1 = 84.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10        train : [loss = 0.299, top1 = 90.08%], test  : [loss = 0.400, top1 = 86.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 1.332, top1 = 63.02%], valid : [loss = 1.533, top1 = 57.34%], test : [loss = 1.502, top1 = 58.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.48%], valid : [loss = 2.905, top1 = 28.27%], test : [loss = 2.984, top1 = 26.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7342/15625) 007342-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.313, top1 = 89.24%], valid : [loss = 0.549, top1 = 82.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10        train : [loss = 0.264, top1 = 90.94%], test  : [loss = 0.425, top1 = 86.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.30 ms.
cifar100       train : [loss = 1.444, top1 = 59.44%], valid : [loss = 1.678, top1 = 54.63%], test : [loss = 1.669, top1 = 54.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.896, top1 = 28.66%], valid : [loss = 2.911, top1 = 28.84%], test : [loss = 2.950, top1 = 27.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.05%], valid : [loss = 1.078, top1 = 62.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7343/15625) 007343-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.470, top1 = 89.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.30 ms.
cifar100       train : [loss = 0.323, top1 = 91.32%], valid : [loss = 1.229, top1 = 68.09%], test : [loss = 1.242, top1 = 68.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.65%], valid : [loss = 2.312, top1 = 40.92%], test : [loss = 2.341, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.58%], valid : [loss = 0.576, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7344/15625) 007344-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.94%], valid : [loss = 0.468, top1 = 86.44%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=21.40 ms.
cifar10        train : [loss = 0.107, top1 = 96.71%], test  : [loss = 0.344, top1 = 89.14%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=18.94 ms.
cifar100       train : [loss = 0.641, top1 = 82.25%], valid : [loss = 1.266, top1 = 65.80%], test : [loss = 1.268, top1 = 65.46%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=24.25 ms.
ImageNet16-120 train : [loss = 2.432, top1 = 38.26%], valid : [loss = 2.529, top1 = 36.10%], test : [loss = 2.570, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.29%], valid : [loss = 0.875, top1 = 68.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7345/15625) 007345-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.55 ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.59%], valid : [loss = 0.862, top1 = 71.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.49 ms.
cifar10        train : [loss = 0.557, top1 = 80.68%], test  : [loss = 0.720, top1 = 75.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.79 ms.
cifar100       train : [loss = 1.774, top1 = 52.29%], valid : [loss = 2.036, top1 = 47.42%], test : [loss = 2.047, top1 = 46.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.83%], valid : [loss = 3.635, top1 = 16.70%], test : [loss = 3.673, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7346/15625) 007346-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.621, top1 = 86.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10        train : [loss = 0.031, top1 = 99.15%], test  : [loss = 0.399, top1 = 90.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 0.483, top1 = 86.08%], valid : [loss = 1.398, top1 = 64.02%], test : [loss = 1.408, top1 = 64.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.14%], valid : [loss = 2.560, top1 = 35.87%], test : [loss = 2.600, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7347/15625) 007347-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.421, top1 = 90.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.295, top1 = 92.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.210, top1 = 95.04%], valid : [loss = 1.270, top1 = 68.56%], test : [loss = 1.248, top1 = 69.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.64%], valid : [loss = 2.260, top1 = 42.23%], test : [loss = 2.288, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7348/15625) 007348-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.54%], valid : [loss = 0.458, top1 = 86.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.153, top1 = 95.01%], test  : [loss = 0.350, top1 = 88.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.977, top1 = 72.26%], valid : [loss = 1.343, top1 = 62.39%], test : [loss = 1.339, top1 = 62.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.21%], valid : [loss = 2.678, top1 = 32.78%], test : [loss = 2.691, top1 = 32.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7349/15625) 007349-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.444, top1 = 89.65%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.58 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.297, top1 = 92.53%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.87 ms.
cifar100       train : [loss = 0.185, top1 = 95.78%], valid : [loss = 1.246, top1 = 69.78%], test : [loss = 1.220, top1 = 70.28%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.73%], valid : [loss = 2.211, top1 = 43.67%], test : [loss = 2.223, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.74%], valid : [loss = 0.556, top1 = 81.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7350/15625) 007350-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10-valid  train : [loss = 1.124, top1 = 60.21%], valid : [loss = 1.165, top1 = 58.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10        train : [loss = 1.067, top1 = 62.41%], test  : [loss = 1.067, top1 = 61.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.28 ms.
cifar100       train : [loss = 2.575, top1 = 34.97%], valid : [loss = 2.650, top1 = 34.22%], test : [loss = 2.628, top1 = 34.25%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.35 ms.
ImageNet16-120 train : [loss = 3.795, top1 = 13.52%], valid : [loss = 3.773, top1 = 14.50%], test : [loss = 3.795, top1 = 13.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7351/15625) 007351-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.07%], valid : [loss = 0.870, top1 = 71.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.92 ms.
cifar10        train : [loss = 0.564, top1 = 80.38%], test  : [loss = 0.710, top1 = 75.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.53 ms.
cifar100       train : [loss = 1.789, top1 = 51.98%], valid : [loss = 2.050, top1 = 47.06%], test : [loss = 2.058, top1 = 46.64%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.60%], valid : [loss = 3.633, top1 = 15.97%], test : [loss = 3.654, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7352/15625) 007352-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.506, top1 = 88.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.81 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.323, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.17 ms.
cifar100       train : [loss = 0.349, top1 = 90.43%], valid : [loss = 1.277, top1 = 66.72%], test : [loss = 1.295, top1 = 66.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.39%], valid : [loss = 2.447, top1 = 37.87%], test : [loss = 2.429, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7353/15625) 007353-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.418, top1 = 91.03%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.95 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.288, top1 = 93.62%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.54 ms.
cifar100       train : [loss = 0.065, top1 = 99.13%], valid : [loss = 1.403, top1 = 69.76%], test : [loss = 1.327, top1 = 70.02%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.561, top1 = 57.79%], valid : [loss = 2.258, top1 = 43.90%], test : [loss = 2.268, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.80%], valid : [loss = 0.495, top1 = 83.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7354/15625) 007354-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.520, top1 = 89.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.54 ms.
cifar100       train : [loss = 0.218, top1 = 94.45%], valid : [loss = 1.254, top1 = 68.74%], test : [loss = 1.257, top1 = 68.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.52%], valid : [loss = 2.272, top1 = 42.57%], test : [loss = 2.305, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.27%], valid : [loss = 0.756, top1 = 73.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7355/15625) 007355-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.09%], valid : [loss = 0.706, top1 = 79.88%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.39 ms.
cifar10        train : [loss = 0.200, top1 = 93.14%], test  : [loss = 0.532, top1 = 84.40%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.32 ms.
cifar100       train : [loss = 0.912, top1 = 73.52%], valid : [loss = 1.647, top1 = 57.52%], test : [loss = 1.650, top1 = 57.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 3.557, top1 = 15.86%], valid : [loss = 3.546, top1 = 16.53%], test : [loss = 3.550, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.280, top1 = 53.48%], valid : [loss = 1.297, top1 = 52.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7356/15625) 007356-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.47%], valid : [loss = 0.553, top1 = 87.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.06 ms.
cifar10        train : [loss = 0.032, top1 = 99.05%], test  : [loss = 0.360, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.60 ms.
cifar100       train : [loss = 0.442, top1 = 86.97%], valid : [loss = 1.287, top1 = 66.44%], test : [loss = 1.302, top1 = 66.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.66%], valid : [loss = 2.456, top1 = 37.63%], test : [loss = 2.462, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.30%], valid : [loss = 0.934, top1 = 66.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7357/15625) 007357-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.483, top1 = 89.55%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.295, top1 = 92.94%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.52 ms.
cifar100       train : [loss = 0.270, top1 = 92.91%], valid : [loss = 1.204, top1 = 68.90%], test : [loss = 1.227, top1 = 68.28%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.69%], valid : [loss = 2.214, top1 = 42.87%], test : [loss = 2.207, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.609, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7358/15625) 007358-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.623, top1 = 85.41%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=16.00 ms.
cifar10        train : [loss = 0.071, top1 = 97.80%], test  : [loss = 0.412, top1 = 88.71%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=13.70 ms.
cifar100       train : [loss = 0.718, top1 = 79.14%], valid : [loss = 1.393, top1 = 62.81%], test : [loss = 1.366, top1 = 63.53%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.89%], valid : [loss = 2.658, top1 = 34.00%], test : [loss = 2.693, top1 = 33.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7359/15625) 007359-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.09%], valid : [loss = 0.524, top1 = 85.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.077, top1 = 97.65%], test  : [loss = 0.352, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.25 ms.
cifar100       train : [loss = 0.704, top1 = 79.69%], valid : [loss = 1.320, top1 = 64.24%], test : [loss = 1.310, top1 = 65.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.35%], valid : [loss = 2.501, top1 = 36.57%], test : [loss = 2.530, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.68%], valid : [loss = 0.952, top1 = 66.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7360/15625) 007360-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.548, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.377, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.095, top1 = 98.20%], valid : [loss = 1.494, top1 = 67.30%], test : [loss = 1.483, top1 = 67.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.41%], valid : [loss = 2.365, top1 = 41.00%], test : [loss = 2.394, top1 = 41.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.83%], valid : [loss = 0.675, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7361/15625) 007361-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=23.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.480, top1 = 89.04%]
cifar10        FLOP= 62.83 M, Params=0.456 MB, latency=24.45 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.301, top1 = 92.51%]
cifar100       FLOP= 62.84 M, Params=0.462 MB, latency=23.05 ms.
cifar100       train : [loss = 0.189, top1 = 95.91%], valid : [loss = 1.160, top1 = 70.76%], test : [loss = 1.179, top1 = 70.50%]
ImageNet16-120 FLOP= 15.72 M, Params=0.463 MB, latency=19.31 ms.
ImageNet16-120 train : [loss = 1.843, top1 = 51.07%], valid : [loss = 2.149, top1 = 43.80%], test : [loss = 2.187, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.55%], valid : [loss = 0.702, top1 = 75.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7362/15625) 007362-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.96%], valid : [loss = 1.004, top1 = 65.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10        train : [loss = 0.785, top1 = 72.51%], test  : [loss = 0.867, top1 = 69.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.32 ms.
cifar100       train : [loss = 2.122, top1 = 44.15%], valid : [loss = 2.299, top1 = 41.50%], test : [loss = 2.307, top1 = 41.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 3.753, top1 = 14.16%], valid : [loss = 3.787, top1 = 14.23%], test : [loss = 3.773, top1 = 14.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.454, top1 = 46.72%], valid : [loss = 1.494, top1 = 45.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7363/15625) 007363-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.506, top1 = 89.93%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.85 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.333, top1 = 92.89%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.76 ms.
cifar100       train : [loss = 0.093, top1 = 98.18%], valid : [loss = 1.371, top1 = 69.26%], test : [loss = 1.353, top1 = 70.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.76%], valid : [loss = 2.243, top1 = 42.70%], test : [loss = 2.194, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.90%], valid : [loss = 0.823, top1 = 70.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7364/15625) 007364-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.532, top1 = 88.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.347, top1 = 91.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.16 ms.
cifar100       train : [loss = 0.425, top1 = 87.74%], valid : [loss = 1.268, top1 = 67.03%], test : [loss = 1.268, top1 = 66.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.12%], valid : [loss = 2.407, top1 = 39.03%], test : [loss = 2.436, top1 = 38.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7365/15625) 007365-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.76 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.99 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.48 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7366/15625) 007366-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.207, top1 = 93.22%], valid : [loss = 0.732, top1 = 79.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.227, top1 = 92.25%], test  : [loss = 0.474, top1 = 85.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 1.069, top1 = 69.41%], valid : [loss = 1.690, top1 = 55.06%], test : [loss = 1.651, top1 = 57.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 3.104, top1 = 25.01%], valid : [loss = 3.137, top1 = 24.43%], test : [loss = 3.153, top1 = 24.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.100, top1 = 60.37%], valid : [loss = 1.171, top1 = 58.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7367/15625) 007367-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.480, top1 = 89.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.329, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.24 ms.
cifar100       train : [loss = 0.350, top1 = 90.41%], valid : [loss = 1.235, top1 = 67.54%], test : [loss = 1.290, top1 = 67.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.61%], valid : [loss = 2.421, top1 = 38.17%], test : [loss = 2.412, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7368/15625) 007368-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.67%], valid : [loss = 0.729, top1 = 75.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.35 ms.
cifar10        train : [loss = 0.475, top1 = 83.74%], test  : [loss = 0.558, top1 = 80.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.22 ms.
cifar100       train : [loss = 1.820, top1 = 50.56%], valid : [loss = 1.930, top1 = 48.14%], test : [loss = 1.917, top1 = 48.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=7.98 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.17%], valid : [loss = 2.999, top1 = 27.60%], test : [loss = 3.027, top1 = 26.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.169, top1 = 58.09%], valid : [loss = 1.203, top1 = 56.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7369/15625) 007369-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.53%], valid : [loss = 0.630, top1 = 86.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10        train : [loss = 0.035, top1 = 98.98%], test  : [loss = 0.410, top1 = 89.71%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.47 ms.
cifar100       train : [loss = 0.553, top1 = 83.65%], valid : [loss = 1.438, top1 = 63.08%], test : [loss = 1.433, top1 = 63.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.360, top1 = 39.63%], valid : [loss = 2.560, top1 = 36.23%], test : [loss = 2.577, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.75%], valid : [loss = 0.890, top1 = 68.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7370/15625) 007370-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.597, top1 = 87.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.386, top1 = 90.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.89 ms.
cifar100       train : [loss = 0.386, top1 = 89.25%], valid : [loss = 1.355, top1 = 65.46%], test : [loss = 1.360, top1 = 65.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.99%], valid : [loss = 2.529, top1 = 36.23%], test : [loss = 2.546, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7371/15625) 007371-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7372/15625) 007372-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.58%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.09 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.329, top1 = 92.85%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=26.14 ms.
cifar100       train : [loss = 0.107, top1 = 97.85%], valid : [loss = 1.274, top1 = 70.20%], test : [loss = 1.285, top1 = 70.30%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.06 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.52%], valid : [loss = 2.173, top1 = 43.80%], test : [loss = 2.164, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 72.85%], valid : [loss = 0.814, top1 = 71.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7373/15625) 007373-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.323, top1 = 92.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 0.328, top1 = 91.21%], valid : [loss = 1.303, top1 = 67.29%], test : [loss = 1.339, top1 = 66.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.37%], valid : [loss = 2.361, top1 = 39.94%], test : [loss = 2.407, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7374/15625) 007374-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.621, top1 = 86.24%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.72 ms.
cifar10        train : [loss = 0.031, top1 = 99.17%], test  : [loss = 0.422, top1 = 89.49%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.90 ms.
cifar100       train : [loss = 0.380, top1 = 89.74%], valid : [loss = 1.435, top1 = 64.94%], test : [loss = 1.415, top1 = 65.32%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.61%], valid : [loss = 2.591, top1 = 35.10%], test : [loss = 2.627, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.14%], valid : [loss = 0.750, top1 = 74.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7375/15625) 007375-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.57%], valid : [loss = 0.530, top1 = 83.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.243, top1 = 91.76%], test  : [loss = 0.402, top1 = 86.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.367, top1 = 61.75%], valid : [loss = 1.648, top1 = 55.33%], test : [loss = 1.611, top1 = 56.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.852, top1 = 29.70%], valid : [loss = 2.852, top1 = 29.97%], test : [loss = 2.900, top1 = 28.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.08%], valid : [loss = 1.050, top1 = 62.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7376/15625) 007376-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.482, top1 = 89.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.07 ms.
cifar100       train : [loss = 0.137, top1 = 97.28%], valid : [loss = 1.265, top1 = 69.80%], test : [loss = 1.269, top1 = 69.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.19%], valid : [loss = 2.185, top1 = 43.89%], test : [loss = 2.175, top1 = 44.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.26%], valid : [loss = 0.596, top1 = 79.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7377/15625) 007377-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.290, top1 = 90.19%], valid : [loss = 0.508, top1 = 83.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.278, top1 = 90.57%], test  : [loss = 0.394, top1 = 86.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.91 ms.
cifar100       train : [loss = 1.327, top1 = 62.47%], valid : [loss = 1.551, top1 = 57.90%], test : [loss = 1.576, top1 = 56.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.865, top1 = 29.63%], valid : [loss = 2.863, top1 = 29.27%], test : [loss = 2.910, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 64.09%], valid : [loss = 1.037, top1 = 63.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7378/15625) 007378-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.90%], valid : [loss = 1.030, top1 = 65.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.759, top1 = 73.42%], test  : [loss = 0.846, top1 = 70.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.69 ms.
cifar100       train : [loss = 2.122, top1 = 44.25%], valid : [loss = 2.307, top1 = 40.72%], test : [loss = 2.296, top1 = 41.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 3.743, top1 = 14.23%], valid : [loss = 3.767, top1 = 13.97%], test : [loss = 3.782, top1 = 13.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.494, top1 = 44.83%], valid : [loss = 1.510, top1 = 44.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7379/15625) 007379-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.24%], valid : [loss = 0.601, top1 = 85.83%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.96 ms.
cifar10        train : [loss = 0.071, top1 = 97.77%], test  : [loss = 0.390, top1 = 89.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.47 ms.
cifar100       train : [loss = 0.720, top1 = 79.11%], valid : [loss = 1.386, top1 = 62.92%], test : [loss = 1.373, top1 = 62.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.21%], valid : [loss = 2.632, top1 = 34.53%], test : [loss = 2.689, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7380/15625) 007380-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.24%], valid : [loss = 0.449, top1 = 86.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10        train : [loss = 0.114, top1 = 96.52%], test  : [loss = 0.331, top1 = 89.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 0.858, top1 = 75.48%], valid : [loss = 1.284, top1 = 64.24%], test : [loss = 1.292, top1 = 63.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.71%], valid : [loss = 2.616, top1 = 34.97%], test : [loss = 2.639, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.30%], valid : [loss = 0.658, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7381/15625) 007381-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.530, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.020, top1 = 99.48%], test  : [loss = 0.362, top1 = 91.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.36 ms.
cifar100       train : [loss = 0.384, top1 = 89.07%], valid : [loss = 1.345, top1 = 65.24%], test : [loss = 1.353, top1 = 66.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 43.10%], valid : [loss = 2.448, top1 = 37.77%], test : [loss = 2.435, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 78.97%], valid : [loss = 0.679, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7382/15625) 007382-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.79%], valid : [loss = 0.563, top1 = 87.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.74 ms.
cifar10        train : [loss = 0.020, top1 = 99.43%], test  : [loss = 0.355, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.36 ms.
cifar100       train : [loss = 0.299, top1 = 91.77%], valid : [loss = 1.277, top1 = 67.62%], test : [loss = 1.316, top1 = 68.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.14 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.81%], valid : [loss = 2.392, top1 = 39.23%], test : [loss = 2.408, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.58%], valid : [loss = 0.808, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7383/15625) 007383-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.461, top1 = 89.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.311, top1 = 92.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.195, top1 = 95.34%], valid : [loss = 1.383, top1 = 67.06%], test : [loss = 1.409, top1 = 67.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.22%], valid : [loss = 2.318, top1 = 41.93%], test : [loss = 2.374, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.449, top1 = 84.35%], valid : [loss = 0.554, top1 = 81.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7384/15625) 007384-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.310, top1 = 93.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.25 ms.
cifar100       train : [loss = 0.067, top1 = 99.00%], valid : [loss = 1.357, top1 = 70.52%], test : [loss = 1.335, top1 = 69.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.95 ms.
ImageNet16-120 train : [loss = 1.537, top1 = 58.49%], valid : [loss = 2.246, top1 = 43.97%], test : [loss = 2.254, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.398, top1 = 86.35%], valid : [loss = 0.514, top1 = 82.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7385/15625) 007385-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.71 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.20%], valid : [loss = 0.462, top1 = 86.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.114, top1 = 96.48%], test  : [loss = 0.333, top1 = 89.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 0.864, top1 = 75.39%], valid : [loss = 1.295, top1 = 64.15%], test : [loss = 1.290, top1 = 64.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.91 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.58%], valid : [loss = 2.626, top1 = 34.30%], test : [loss = 2.669, top1 = 33.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7386/15625) 007386-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.65%], valid : [loss = 0.840, top1 = 81.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.44 ms.
cifar10        train : [loss = 0.085, top1 = 97.28%], test  : [loss = 0.486, top1 = 86.74%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.17 ms.
cifar100       train : [loss = 0.828, top1 = 76.18%], valid : [loss = 1.622, top1 = 58.24%], test : [loss = 1.565, top1 = 59.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 2.797, top1 = 30.75%], valid : [loss = 2.901, top1 = 28.70%], test : [loss = 2.957, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 71.04%], valid : [loss = 0.877, top1 = 69.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7387/15625) 007387-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.43%], valid : [loss = 0.531, top1 = 85.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.100, top1 = 96.85%], test  : [loss = 0.348, top1 = 89.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.34 ms.
cifar100       train : [loss = 0.715, top1 = 79.45%], valid : [loss = 1.325, top1 = 64.82%], test : [loss = 1.276, top1 = 65.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 36.99%], valid : [loss = 2.554, top1 = 35.43%], test : [loss = 2.558, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.64%], valid : [loss = 0.944, top1 = 66.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7388/15625) 007388-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.556, top1 = 87.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.024, top1 = 99.36%], test  : [loss = 0.353, top1 = 91.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.68 ms.
cifar100       train : [loss = 0.410, top1 = 88.18%], valid : [loss = 1.260, top1 = 67.46%], test : [loss = 1.279, top1 = 66.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 41.87%], valid : [loss = 2.419, top1 = 38.97%], test : [loss = 2.457, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.99%], valid : [loss = 0.808, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7389/15625) 007389-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.563, top1 = 89.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.29 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.350, top1 = 92.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.19 ms.
cifar100       train : [loss = 0.110, top1 = 97.77%], valid : [loss = 1.379, top1 = 68.70%], test : [loss = 1.367, top1 = 69.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 1.959, top1 = 48.41%], valid : [loss = 2.331, top1 = 40.83%], test : [loss = 2.317, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.22%], valid : [loss = 0.791, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7390/15625) 007390-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.544, top1 = 80.97%], valid : [loss = 0.858, top1 = 71.54%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.558, top1 = 80.54%], test  : [loss = 0.713, top1 = 76.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 1.786, top1 = 51.69%], valid : [loss = 2.069, top1 = 46.50%], test : [loss = 2.045, top1 = 46.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.71%], valid : [loss = 3.639, top1 = 16.87%], test : [loss = 3.673, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7391/15625) 007391-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.575, top1 = 88.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.18 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.373, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.177, top1 = 96.01%], valid : [loss = 1.395, top1 = 67.68%], test : [loss = 1.434, top1 = 66.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.38%], valid : [loss = 2.495, top1 = 37.37%], test : [loss = 2.489, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.99%], valid : [loss = 0.698, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7392/15625) 007392-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.275, top1 = 91.15%], valid : [loss = 0.482, top1 = 84.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.298, top1 = 90.12%], test  : [loss = 0.395, top1 = 86.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 1.336, top1 = 63.04%], valid : [loss = 1.528, top1 = 57.96%], test : [loss = 1.517, top1 = 57.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 28.39%], valid : [loss = 2.921, top1 = 29.20%], test : [loss = 2.995, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.56%], valid : [loss = 0.745, top1 = 73.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7393/15625) 007393-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.06 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.591, top1 = 87.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.60 ms.
cifar10        train : [loss = 0.021, top1 = 99.46%], test  : [loss = 0.410, top1 = 90.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.48 ms.
cifar100       train : [loss = 0.432, top1 = 87.50%], valid : [loss = 1.423, top1 = 64.74%], test : [loss = 1.424, top1 = 65.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.57%], valid : [loss = 2.523, top1 = 36.30%], test : [loss = 2.546, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.00%], valid : [loss = 0.880, top1 = 68.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7394/15625) 007394-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.87%], valid : [loss = 0.956, top1 = 76.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.218, top1 = 92.48%], test  : [loss = 0.578, top1 = 82.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.33 ms.
cifar100       train : [loss = 1.167, top1 = 66.78%], valid : [loss = 1.801, top1 = 53.76%], test : [loss = 1.782, top1 = 53.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 3.241, top1 = 22.49%], valid : [loss = 3.365, top1 = 21.47%], test : [loss = 3.383, top1 = 19.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.92%], valid : [loss = 1.068, top1 = 62.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7395/15625) 007395-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.619, top1 = 85.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10        train : [loss = 0.075, top1 = 97.70%], test  : [loss = 0.395, top1 = 88.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 0.718, top1 = 79.17%], valid : [loss = 1.407, top1 = 62.85%], test : [loss = 1.388, top1 = 63.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.87%], valid : [loss = 2.654, top1 = 34.28%], test : [loss = 2.712, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7396/15625) 007396-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.461, top1 = 89.14%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=14.89 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.315, top1 = 92.03%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=15.71 ms.
cifar100       train : [loss = 0.324, top1 = 91.29%], valid : [loss = 1.282, top1 = 67.47%], test : [loss = 1.311, top1 = 67.20%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.38%], valid : [loss = 2.375, top1 = 39.92%], test : [loss = 2.404, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7397/15625) 007397-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10-valid  train : [loss = 1.850, top1 = 32.80%], valid : [loss = 1.864, top1 = 32.50%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10        train : [loss = 1.318, top1 = 52.21%], test  : [loss = 1.333, top1 = 51.86%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.44 ms.
cifar100       train : [loss = 3.908, top1 = 9.86%], valid : [loss = 3.908, top1 = 9.84%], test : [loss = 3.907, top1 = 10.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.22 ms.
ImageNet16-120 train : [loss = 3.953, top1 = 11.01%], valid : [loss = 3.952, top1 = 11.40%], test : [loss = 3.938, top1 = 11.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.971, top1 = 26.94%], valid : [loss = 1.970, top1 = 27.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7398/15625) 007398-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.516, top1 = 88.74%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.328, top1 = 92.20%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.72 ms.
cifar100       train : [loss = 0.362, top1 = 89.99%], valid : [loss = 1.279, top1 = 66.18%], test : [loss = 1.272, top1 = 68.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.48%], valid : [loss = 2.384, top1 = 38.30%], test : [loss = 2.409, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.54%], valid : [loss = 0.656, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7399/15625) 007399-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.553, top1 = 88.94%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.380, top1 = 92.24%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.50 ms.
cifar100       train : [loss = 0.137, top1 = 97.16%], valid : [loss = 1.441, top1 = 67.38%], test : [loss = 1.423, top1 = 67.74%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.05 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.67%], valid : [loss = 2.435, top1 = 39.67%], test : [loss = 2.397, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 77.81%], valid : [loss = 0.715, top1 = 75.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7400/15625) 007400-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.593, top1 = 88.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.397, top1 = 91.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.72 ms.
cifar100       train : [loss = 0.158, top1 = 96.73%], valid : [loss = 1.413, top1 = 67.50%], test : [loss = 1.450, top1 = 67.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.14 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.95%], valid : [loss = 2.473, top1 = 37.93%], test : [loss = 2.477, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.54%], valid : [loss = 0.765, top1 = 73.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7401/15625) 007401-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.67%], valid : [loss = 0.481, top1 = 84.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.87 ms.
cifar10        train : [loss = 0.302, top1 = 89.93%], test  : [loss = 0.404, top1 = 86.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.46 ms.
cifar100       train : [loss = 1.327, top1 = 63.22%], valid : [loss = 1.550, top1 = 57.62%], test : [loss = 1.516, top1 = 58.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.54%], valid : [loss = 2.924, top1 = 28.80%], test : [loss = 2.938, top1 = 28.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7402/15625) 007402-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.82%], valid : [loss = 0.892, top1 = 71.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10        train : [loss = 0.556, top1 = 80.60%], test  : [loss = 0.708, top1 = 75.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.33 ms.
cifar100       train : [loss = 1.762, top1 = 52.71%], valid : [loss = 2.041, top1 = 47.02%], test : [loss = 2.062, top1 = 46.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 17.04%], valid : [loss = 3.624, top1 = 17.07%], test : [loss = 3.638, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7403/15625) 007403-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.552, top1 = 89.30%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.06 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.333, top1 = 93.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.88 ms.
cifar100       train : [loss = 0.060, top1 = 99.19%], valid : [loss = 1.450, top1 = 69.38%], test : [loss = 1.425, top1 = 68.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 1.726, top1 = 53.98%], valid : [loss = 2.372, top1 = 41.53%], test : [loss = 2.378, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.30%], valid : [loss = 0.651, top1 = 77.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7404/15625) 007404-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.88%], valid : [loss = 0.482, top1 = 84.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10        train : [loss = 0.304, top1 = 89.92%], test  : [loss = 0.405, top1 = 86.29%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.99 ms.
cifar100       train : [loss = 1.322, top1 = 63.32%], valid : [loss = 1.537, top1 = 57.55%], test : [loss = 1.513, top1 = 58.57%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.89%], valid : [loss = 2.897, top1 = 29.54%], test : [loss = 2.939, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7405/15625) 007405-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.479, top1 = 90.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.320, top1 = 93.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.00 ms.
cifar100       train : [loss = 0.109, top1 = 97.87%], valid : [loss = 1.306, top1 = 69.00%], test : [loss = 1.335, top1 = 68.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 1.719, top1 = 54.00%], valid : [loss = 2.200, top1 = 43.70%], test : [loss = 2.219, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7406/15625) 007406-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.37%], valid : [loss = 0.582, top1 = 87.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.376, top1 = 90.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.550, top1 = 84.07%], valid : [loss = 1.369, top1 = 64.36%], test : [loss = 1.353, top1 = 64.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.572, top1 = 34.53%], valid : [loss = 2.623, top1 = 34.10%], test : [loss = 2.676, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7407/15625) 007407-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.425, top1 = 90.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.278, top1 = 93.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.01 ms.
cifar100       train : [loss = 0.160, top1 = 96.41%], valid : [loss = 1.279, top1 = 69.85%], test : [loss = 1.265, top1 = 70.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 1.768, top1 = 52.88%], valid : [loss = 2.230, top1 = 43.68%], test : [loss = 2.286, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.46%], valid : [loss = 0.518, top1 = 82.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7408/15625) 007408-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=25.12 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.493, top1 = 89.72%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=24.70 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.305, top1 = 93.10%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.65 ms.
cifar100       train : [loss = 0.073, top1 = 98.99%], valid : [loss = 1.253, top1 = 70.58%], test : [loss = 1.222, top1 = 71.12%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=25.26 ms.
ImageNet16-120 train : [loss = 1.569, top1 = 57.73%], valid : [loss = 2.192, top1 = 44.23%], test : [loss = 2.181, top1 = 44.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.77%], valid : [loss = 0.739, top1 = 74.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7409/15625) 007409-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.10%], valid : [loss = 0.645, top1 = 85.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10        train : [loss = 0.049, top1 = 98.47%], test  : [loss = 0.421, top1 = 89.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.08 ms.
cifar100       train : [loss = 0.416, top1 = 88.16%], valid : [loss = 1.546, top1 = 62.38%], test : [loss = 1.580, top1 = 62.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.779, top1 = 30.43%], valid : [loss = 2.868, top1 = 28.83%], test : [loss = 2.899, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.52%], valid : [loss = 0.997, top1 = 64.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7410/15625) 007410-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.581, top1 = 87.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.390, top1 = 91.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 0.402, top1 = 88.60%], valid : [loss = 1.411, top1 = 64.81%], test : [loss = 1.411, top1 = 65.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.05%], valid : [loss = 2.515, top1 = 36.34%], test : [loss = 2.536, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7411/15625) 007411-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.589, top1 = 85.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.072, top1 = 97.79%], test  : [loss = 0.394, top1 = 89.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.20 ms.
cifar100       train : [loss = 0.731, top1 = 78.68%], valid : [loss = 1.380, top1 = 63.29%], test : [loss = 1.349, top1 = 63.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.67%], valid : [loss = 2.649, top1 = 33.84%], test : [loss = 2.694, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.67%], valid : [loss = 0.804, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7412/15625) 007412-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.522, top1 = 89.56%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.334, top1 = 92.60%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.05 ms.
cifar100       train : [loss = 0.106, top1 = 97.83%], valid : [loss = 1.308, top1 = 69.95%], test : [loss = 1.339, top1 = 69.86%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 1.651, top1 = 55.56%], valid : [loss = 2.150, top1 = 44.98%], test : [loss = 2.157, top1 = 44.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.57%], valid : [loss = 0.697, top1 = 75.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7413/15625) 007413-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.735, top1 = 84.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.01 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.467, top1 = 89.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.82 ms.
cifar100       train : [loss = 0.342, top1 = 90.82%], valid : [loss = 1.628, top1 = 61.79%], test : [loss = 1.654, top1 = 61.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.49%], valid : [loss = 2.595, top1 = 35.50%], test : [loss = 2.624, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.34%], valid : [loss = 0.838, top1 = 70.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7414/15625) 007414-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.69%], valid : [loss = 0.716, top1 = 75.52%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10        train : [loss = 0.546, top1 = 80.96%], test  : [loss = 0.609, top1 = 79.22%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.45 ms.
cifar100       train : [loss = 1.762, top1 = 52.19%], valid : [loss = 1.901, top1 = 49.93%], test : [loss = 1.933, top1 = 49.08%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.92 ms.
ImageNet16-120 train : [loss = 3.385, top1 = 20.19%], valid : [loss = 3.373, top1 = 20.70%], test : [loss = 3.416, top1 = 19.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7415/15625) 007415-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.28%], valid : [loss = 0.853, top1 = 70.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.20 ms.
cifar10        train : [loss = 0.702, top1 = 75.43%], test  : [loss = 0.791, top1 = 72.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.66 ms.
cifar100       train : [loss = 1.958, top1 = 47.88%], valid : [loss = 2.121, top1 = 45.03%], test : [loss = 2.160, top1 = 44.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.91 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.75%], valid : [loss = 3.670, top1 = 15.86%], test : [loss = 3.690, top1 = 15.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7416/15625) 007416-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.550, top1 = 88.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.367, top1 = 91.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.38 ms.
cifar100       train : [loss = 0.166, top1 = 96.35%], valid : [loss = 1.447, top1 = 66.62%], test : [loss = 1.419, top1 = 67.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.932, top1 = 49.28%], valid : [loss = 2.343, top1 = 40.56%], test : [loss = 2.373, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.75%], valid : [loss = 0.668, top1 = 76.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7417/15625) 007417-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.444, top1 = 89.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.82%], test  : [loss = 0.307, top1 = 92.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.41 ms.
cifar100       train : [loss = 0.322, top1 = 91.38%], valid : [loss = 1.308, top1 = 67.08%], test : [loss = 1.307, top1 = 67.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.44%], valid : [loss = 2.362, top1 = 39.83%], test : [loss = 2.411, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 83.99%], valid : [loss = 0.568, top1 = 80.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7418/15625) 007418-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.580, top1 = 87.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.402, top1 = 90.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.76 ms.
cifar100       train : [loss = 0.402, top1 = 88.65%], valid : [loss = 1.396, top1 = 65.10%], test : [loss = 1.401, top1 = 65.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.11%], valid : [loss = 2.508, top1 = 36.91%], test : [loss = 2.533, top1 = 36.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.22%], valid : [loss = 0.815, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7419/15625) 007419-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.418, top1 = 91.08%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.295, top1 = 93.81%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.99 ms.
cifar100       train : [loss = 0.044, top1 = 99.54%], valid : [loss = 1.342, top1 = 70.89%], test : [loss = 1.330, top1 = 71.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.474, top1 = 59.96%], valid : [loss = 2.249, top1 = 44.18%], test : [loss = 2.257, top1 = 44.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.36%], valid : [loss = 0.519, top1 = 82.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7420/15625) 007420-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.507, top1 = 89.49%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.318, top1 = 92.80%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.80 ms.
cifar100       train : [loss = 0.121, top1 = 97.65%], valid : [loss = 1.298, top1 = 69.09%], test : [loss = 1.283, top1 = 69.81%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.782, top1 = 52.59%], valid : [loss = 2.243, top1 = 42.60%], test : [loss = 2.238, top1 = 43.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.20%], valid : [loss = 0.642, top1 = 78.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7421/15625) 007421-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.574, top1 = 87.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.398, top1 = 90.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 0.393, top1 = 88.83%], valid : [loss = 1.400, top1 = 65.17%], test : [loss = 1.391, top1 = 65.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.85%], valid : [loss = 2.497, top1 = 36.63%], test : [loss = 2.534, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.20%], valid : [loss = 0.783, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7422/15625) 007422-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.97%], valid : [loss = 0.480, top1 = 84.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.297, top1 = 90.12%], test  : [loss = 0.399, top1 = 86.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.84 ms.
cifar100       train : [loss = 1.332, top1 = 63.06%], valid : [loss = 1.532, top1 = 58.19%], test : [loss = 1.504, top1 = 58.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.75%], valid : [loss = 2.911, top1 = 28.57%], test : [loss = 2.958, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7423/15625) 007423-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.069, top1 = 97.89%], valid : [loss = 0.624, top1 = 84.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.089, top1 = 97.07%], test  : [loss = 0.415, top1 = 88.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.712, top1 = 79.01%], valid : [loss = 1.537, top1 = 60.26%], test : [loss = 1.529, top1 = 60.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 3.212, top1 = 21.73%], valid : [loss = 3.212, top1 = 21.67%], test : [loss = 3.245, top1 = 21.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 63.04%], valid : [loss = 1.057, top1 = 62.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7424/15625) 007424-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.76%], valid : [loss = 0.603, top1 = 87.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10        train : [loss = 0.020, top1 = 99.38%], test  : [loss = 0.410, top1 = 90.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.20 ms.
cifar100       train : [loss = 0.349, top1 = 90.19%], valid : [loss = 1.466, top1 = 63.84%], test : [loss = 1.445, top1 = 64.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.791, top1 = 29.68%], valid : [loss = 2.850, top1 = 28.96%], test : [loss = 2.859, top1 = 28.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7425/15625) 007425-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.549, top1 = 88.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.355, top1 = 92.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.65 ms.
cifar100       train : [loss = 0.124, top1 = 97.67%], valid : [loss = 1.396, top1 = 68.13%], test : [loss = 1.403, top1 = 68.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 1.856, top1 = 50.94%], valid : [loss = 2.415, top1 = 39.56%], test : [loss = 2.428, top1 = 40.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.69%], valid : [loss = 0.678, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7426/15625) 007426-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.49%], valid : [loss = 0.727, top1 = 75.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10        train : [loss = 0.488, top1 = 83.01%], test  : [loss = 0.600, top1 = 79.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.863, top1 = 49.25%], valid : [loss = 2.031, top1 = 46.31%], test : [loss = 2.039, top1 = 46.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 3.506, top1 = 17.76%], valid : [loss = 3.496, top1 = 18.18%], test : [loss = 3.549, top1 = 17.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.216, top1 = 56.09%], valid : [loss = 1.252, top1 = 55.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7427/15625) 007427-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10-valid  train : [loss = 0.948, top1 = 66.77%], valid : [loss = 0.992, top1 = 65.61%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10        train : [loss = 0.910, top1 = 68.38%], test  : [loss = 0.914, top1 = 67.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.06 ms.
cifar100       train : [loss = 2.378, top1 = 39.19%], valid : [loss = 2.443, top1 = 37.23%], test : [loss = 2.428, top1 = 38.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.58 ms.
ImageNet16-120 train : [loss = 3.640, top1 = 15.79%], valid : [loss = 3.612, top1 = 17.16%], test : [loss = 3.636, top1 = 16.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.610, top1 = 39.64%], valid : [loss = 1.669, top1 = 36.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7428/15625) 007428-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.57%], valid : [loss = 0.562, top1 = 87.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.032, top1 = 99.04%], test  : [loss = 0.367, top1 = 91.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.88 ms.
cifar100       train : [loss = 0.539, top1 = 84.36%], valid : [loss = 1.379, top1 = 63.92%], test : [loss = 1.362, top1 = 64.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 33.66%], valid : [loss = 2.687, top1 = 32.26%], test : [loss = 2.715, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.970, top1 = 64.87%], valid : [loss = 0.982, top1 = 64.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7429/15625) 007429-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.12 ms.
cifar10-valid  train : [loss = 0.331, top1 = 88.49%], valid : [loss = 0.585, top1 = 81.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.15 ms.
cifar10        train : [loss = 0.294, top1 = 89.85%], test  : [loss = 0.425, top1 = 85.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 1.449, top1 = 59.21%], valid : [loss = 1.694, top1 = 54.18%], test : [loss = 1.688, top1 = 53.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.854, top1 = 29.59%], valid : [loss = 2.879, top1 = 28.70%], test : [loss = 2.892, top1 = 29.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.48%], valid : [loss = 1.035, top1 = 62.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7430/15625) 007430-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.451, top1 = 90.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.62 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.30%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.42 ms.
cifar100       train : [loss = 0.049, top1 = 99.37%], valid : [loss = 1.358, top1 = 70.43%], test : [loss = 1.323, top1 = 70.97%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 1.427, top1 = 61.19%], valid : [loss = 2.221, top1 = 44.26%], test : [loss = 2.223, top1 = 45.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.26%], valid : [loss = 0.514, top1 = 82.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7431/15625) 007431-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.39%], valid : [loss = 0.469, top1 = 85.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.159, top1 = 94.81%], test  : [loss = 0.344, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.77 ms.
cifar100       train : [loss = 1.004, top1 = 71.35%], valid : [loss = 1.362, top1 = 62.11%], test : [loss = 1.362, top1 = 61.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.52%], valid : [loss = 2.698, top1 = 32.77%], test : [loss = 2.716, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7432/15625) 007432-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.70 ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.54%], valid : [loss = 0.914, top1 = 68.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.715, top1 = 74.88%], test  : [loss = 0.768, top1 = 73.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.35 ms.
cifar100       train : [loss = 2.263, top1 = 40.35%], valid : [loss = 2.357, top1 = 39.23%], test : [loss = 2.350, top1 = 38.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 3.529, top1 = 17.31%], valid : [loss = 3.505, top1 = 18.23%], test : [loss = 3.521, top1 = 16.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 49.77%], valid : [loss = 1.418, top1 = 48.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7433/15625) 007433-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.432, top1 = 85.07%], valid : [loss = 0.680, top1 = 77.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10        train : [loss = 0.385, top1 = 86.60%], test  : [loss = 0.526, top1 = 82.58%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.77 ms.
cifar100       train : [loss = 1.570, top1 = 56.45%], valid : [loss = 1.816, top1 = 51.18%], test : [loss = 1.832, top1 = 51.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 3.284, top1 = 21.67%], valid : [loss = 3.286, top1 = 21.94%], test : [loss = 3.331, top1 = 20.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.193, top1 = 56.94%], valid : [loss = 1.238, top1 = 55.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7434/15625) 007434-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.21%], valid : [loss = 0.457, top1 = 86.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.116, top1 = 96.38%], test  : [loss = 0.344, top1 = 89.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 0.864, top1 = 75.33%], valid : [loss = 1.288, top1 = 64.21%], test : [loss = 1.285, top1 = 64.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.67%], valid : [loss = 2.634, top1 = 34.13%], test : [loss = 2.667, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7435/15625) 007435-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.50%], valid : [loss = 0.594, top1 = 87.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.68 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.398, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 0.363, top1 = 89.91%], valid : [loss = 1.451, top1 = 64.05%], test : [loss = 1.451, top1 = 63.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.860, top1 = 28.33%], valid : [loss = 2.927, top1 = 26.79%], test : [loss = 2.939, top1 = 26.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7436/15625) 007436-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.422, top1 = 90.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.287, top1 = 93.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.79 ms.
cifar100       train : [loss = 0.184, top1 = 95.64%], valid : [loss = 1.270, top1 = 69.55%], test : [loss = 1.258, top1 = 69.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.59%], valid : [loss = 2.250, top1 = 42.63%], test : [loss = 2.283, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.03%], valid : [loss = 0.504, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7437/15625) 007437-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.31%], valid : [loss = 0.465, top1 = 86.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 0.158, top1 = 94.88%], test  : [loss = 0.346, top1 = 88.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.25 ms.
cifar100       train : [loss = 0.996, top1 = 71.59%], valid : [loss = 1.365, top1 = 62.07%], test : [loss = 1.344, top1 = 62.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.44%], valid : [loss = 2.703, top1 = 32.92%], test : [loss = 2.728, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7438/15625) 007438-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.627, top1 = 86.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10        train : [loss = 0.029, top1 = 99.30%], test  : [loss = 0.422, top1 = 89.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.37 ms.
cifar100       train : [loss = 0.384, top1 = 89.78%], valid : [loss = 1.432, top1 = 64.77%], test : [loss = 1.427, top1 = 64.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.01%], valid : [loss = 2.599, top1 = 34.64%], test : [loss = 2.638, top1 = 35.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7439/15625) 007439-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.49%], valid : [loss = 0.565, top1 = 87.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.358, top1 = 91.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.27 ms.
cifar100       train : [loss = 0.548, top1 = 84.36%], valid : [loss = 1.355, top1 = 64.39%], test : [loss = 1.346, top1 = 64.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.07%], valid : [loss = 2.641, top1 = 33.08%], test : [loss = 2.658, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 70.42%], valid : [loss = 0.871, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7440/15625) 007440-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.253, top1 = 91.30%], valid : [loss = 0.567, top1 = 82.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.239, top1 = 91.77%], test  : [loss = 0.420, top1 = 86.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.84 ms.
cifar100       train : [loss = 1.268, top1 = 64.10%], valid : [loss = 1.626, top1 = 56.28%], test : [loss = 1.630, top1 = 56.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.949, top1 = 27.92%], valid : [loss = 2.977, top1 = 27.26%], test : [loss = 3.048, top1 = 26.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.168, top1 = 57.73%], valid : [loss = 1.205, top1 = 56.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7441/15625) 007441-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.23%], valid : [loss = 1.119, top1 = 62.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10        train : [loss = 0.780, top1 = 72.64%], test  : [loss = 0.925, top1 = 67.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.34 ms.
cifar100       train : [loss = 2.123, top1 = 44.30%], valid : [loss = 2.401, top1 = 39.81%], test : [loss = 2.400, top1 = 39.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 3.760, top1 = 14.00%], valid : [loss = 3.813, top1 = 13.52%], test : [loss = 3.829, top1 = 13.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 50.71%], valid : [loss = 1.405, top1 = 48.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7442/15625) 007442-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=21.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.492, top1 = 89.85%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=24.35 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.305, top1 = 93.10%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.38 ms.
cifar100       train : [loss = 0.080, top1 = 98.81%], valid : [loss = 1.276, top1 = 70.38%], test : [loss = 1.290, top1 = 70.34%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=21.80 ms.
ImageNet16-120 train : [loss = 1.597, top1 = 56.99%], valid : [loss = 2.159, top1 = 44.28%], test : [loss = 2.167, top1 = 45.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.10%], valid : [loss = 0.682, top1 = 76.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7443/15625) 007443-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.93 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.86%], valid : [loss = 0.526, top1 = 85.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.88 ms.
cifar10        train : [loss = 0.133, top1 = 95.79%], test  : [loss = 0.381, top1 = 88.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.46 ms.
cifar100       train : [loss = 0.963, top1 = 72.15%], valid : [loss = 1.391, top1 = 62.13%], test : [loss = 1.379, top1 = 61.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.401, top1 = 38.74%], valid : [loss = 2.522, top1 = 36.60%], test : [loss = 2.551, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.45%], valid : [loss = 0.908, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7444/15625) 007444-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.602, top1 = 87.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.400, top1 = 91.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 0.231, top1 = 94.06%], valid : [loss = 1.487, top1 = 65.47%], test : [loss = 1.466, top1 = 65.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.40%], valid : [loss = 2.472, top1 = 37.91%], test : [loss = 2.511, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.77%], valid : [loss = 0.809, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7445/15625) 007445-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.47%], valid : [loss = 0.531, top1 = 84.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10        train : [loss = 0.177, top1 = 94.04%], test  : [loss = 0.384, top1 = 88.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.15 ms.
cifar100       train : [loss = 1.219, top1 = 65.32%], valid : [loss = 1.524, top1 = 58.31%], test : [loss = 1.521, top1 = 58.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.664, top1 = 33.45%], valid : [loss = 2.702, top1 = 32.84%], test : [loss = 2.749, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7446/15625) 007446-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.538, top1 = 88.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10        train : [loss = 0.026, top1 = 99.24%], test  : [loss = 0.348, top1 = 91.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.30 ms.
cifar100       train : [loss = 0.444, top1 = 87.03%], valid : [loss = 1.260, top1 = 67.27%], test : [loss = 1.249, top1 = 67.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.40%], valid : [loss = 2.355, top1 = 39.72%], test : [loss = 2.380, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.72%], valid : [loss = 0.800, top1 = 71.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7447/15625) 007447-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.70 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.75%], valid : [loss = 0.864, top1 = 71.50%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10        train : [loss = 0.561, top1 = 80.38%], test  : [loss = 0.718, top1 = 75.73%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.94 ms.
cifar100       train : [loss = 1.780, top1 = 52.01%], valid : [loss = 2.057, top1 = 46.73%], test : [loss = 2.073, top1 = 46.75%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.44 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.87%], valid : [loss = 3.641, top1 = 16.36%], test : [loss = 3.660, top1 = 15.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7448/15625) 007448-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.26%], valid : [loss = 0.460, top1 = 86.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.159, top1 = 94.77%], test  : [loss = 0.354, top1 = 88.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 1.004, top1 = 71.49%], valid : [loss = 1.374, top1 = 61.88%], test : [loss = 1.358, top1 = 62.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.75%], valid : [loss = 2.695, top1 = 33.02%], test : [loss = 2.703, top1 = 32.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7449/15625) 007449-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.65%], valid : [loss = 0.670, top1 = 85.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.04 ms.
cifar10        train : [loss = 0.037, top1 = 98.93%], test  : [loss = 0.450, top1 = 89.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.13 ms.
cifar100       train : [loss = 0.412, top1 = 88.38%], valid : [loss = 1.490, top1 = 63.47%], test : [loss = 1.467, top1 = 63.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.357, top1 = 39.75%], valid : [loss = 2.652, top1 = 34.40%], test : [loss = 2.674, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.62%], valid : [loss = 0.851, top1 = 70.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7450/15625) 007450-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.481, top1 = 89.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.320, top1 = 91.39%], valid : [loss = 1.247, top1 = 67.75%], test : [loss = 1.267, top1 = 68.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.73%], valid : [loss = 2.300, top1 = 40.54%], test : [loss = 2.343, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7451/15625) 007451-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.59%], valid : [loss = 0.542, top1 = 83.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.227, top1 = 92.25%], test  : [loss = 0.402, top1 = 87.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.82 ms.
cifar100       train : [loss = 1.378, top1 = 61.25%], valid : [loss = 1.661, top1 = 54.76%], test : [loss = 1.666, top1 = 54.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.852, top1 = 29.54%], valid : [loss = 2.867, top1 = 29.46%], test : [loss = 2.937, top1 = 27.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.45%], valid : [loss = 1.019, top1 = 64.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7452/15625) 007452-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.483, top1 = 89.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.328, top1 = 92.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.106, top1 = 97.93%], valid : [loss = 1.428, top1 = 68.39%], test : [loss = 1.419, top1 = 68.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 1.772, top1 = 52.79%], valid : [loss = 2.366, top1 = 41.06%], test : [loss = 2.403, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.51%], valid : [loss = 0.648, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7453/15625) 007453-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.14%], valid : [loss = 0.559, top1 = 86.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.060, top1 = 98.07%], test  : [loss = 0.365, top1 = 90.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.78 ms.
cifar100       train : [loss = 0.649, top1 = 80.79%], valid : [loss = 1.294, top1 = 65.05%], test : [loss = 1.301, top1 = 64.67%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.00%], valid : [loss = 2.529, top1 = 36.09%], test : [loss = 2.552, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7454/15625) 007454-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.494, top1 = 89.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.308, top1 = 92.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.28 ms.
cifar100       train : [loss = 0.254, top1 = 93.39%], valid : [loss = 1.179, top1 = 69.73%], test : [loss = 1.209, top1 = 69.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 1.881, top1 = 50.15%], valid : [loss = 2.211, top1 = 42.73%], test : [loss = 2.223, top1 = 43.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7455/15625) 007455-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.494, top1 = 89.47%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.09 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.314, top1 = 92.78%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.66 ms.
cifar100       train : [loss = 0.146, top1 = 96.92%], valid : [loss = 1.291, top1 = 69.41%], test : [loss = 1.297, top1 = 69.30%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.45%], valid : [loss = 2.293, top1 = 41.32%], test : [loss = 2.295, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.48%], valid : [loss = 0.720, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7456/15625) 007456-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.480, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.319, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.57 ms.
cifar100       train : [loss = 0.318, top1 = 91.59%], valid : [loss = 1.262, top1 = 67.46%], test : [loss = 1.252, top1 = 67.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.66%], valid : [loss = 2.312, top1 = 41.06%], test : [loss = 2.340, top1 = 41.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7457/15625) 007457-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.32%], valid : [loss = 0.548, top1 = 83.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.205, top1 = 93.08%], test  : [loss = 0.403, top1 = 87.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.99 ms.
cifar100       train : [loss = 1.264, top1 = 64.20%], valid : [loss = 1.559, top1 = 57.61%], test : [loss = 1.554, top1 = 57.25%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.712, top1 = 32.49%], valid : [loss = 2.739, top1 = 31.94%], test : [loss = 2.772, top1 = 30.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7458/15625) 007458-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.608, top1 = 86.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.61 ms.
cifar10        train : [loss = 0.035, top1 = 99.01%], test  : [loss = 0.411, top1 = 89.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.509, top1 = 85.09%], valid : [loss = 1.414, top1 = 63.97%], test : [loss = 1.391, top1 = 64.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 39.07%], valid : [loss = 2.556, top1 = 36.14%], test : [loss = 2.607, top1 = 35.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.21%], valid : [loss = 0.847, top1 = 70.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7459/15625) 007459-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.54%], valid : [loss = 0.858, top1 = 79.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.131, top1 = 95.60%], test  : [loss = 0.566, top1 = 84.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.851, top1 = 75.33%], valid : [loss = 1.694, top1 = 57.51%], test : [loss = 1.690, top1 = 57.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 3.027, top1 = 26.61%], valid : [loss = 3.158, top1 = 24.28%], test : [loss = 3.188, top1 = 24.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.079, top1 = 60.77%], valid : [loss = 1.136, top1 = 59.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7460/15625) 007460-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.53%], valid : [loss = 0.852, top1 = 75.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.328, top1 = 88.59%], test  : [loss = 0.637, top1 = 80.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 1.391, top1 = 60.97%], valid : [loss = 1.918, top1 = 49.93%], test : [loss = 1.926, top1 = 49.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 3.512, top1 = 17.02%], valid : [loss = 3.537, top1 = 17.13%], test : [loss = 3.530, top1 = 16.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 53.28%], valid : [loss = 1.309, top1 = 52.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7461/15625) 007461-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.66%], valid : [loss = 0.583, top1 = 87.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.026, top1 = 99.28%], test  : [loss = 0.381, top1 = 90.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.66 ms.
cifar100       train : [loss = 0.293, top1 = 91.93%], valid : [loss = 1.373, top1 = 66.61%], test : [loss = 1.388, top1 = 66.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.05%], valid : [loss = 2.540, top1 = 36.31%], test : [loss = 2.554, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.34%], valid : [loss = 0.880, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7462/15625) 007462-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.10%], valid : [loss = 0.458, top1 = 86.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.160, top1 = 94.77%], test  : [loss = 0.348, top1 = 88.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 1.013, top1 = 71.11%], valid : [loss = 1.376, top1 = 61.58%], test : [loss = 1.370, top1 = 61.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.70%], valid : [loss = 2.690, top1 = 32.76%], test : [loss = 2.717, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7463/15625) 007463-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.490, top1 = 90.22%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.301, top1 = 93.60%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.79 ms.
cifar100       train : [loss = 0.057, top1 = 99.27%], valid : [loss = 1.307, top1 = 70.54%], test : [loss = 1.300, top1 = 70.89%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.70 ms.
ImageNet16-120 train : [loss = 1.564, top1 = 57.82%], valid : [loss = 2.157, top1 = 44.64%], test : [loss = 2.154, top1 = 45.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.88%], valid : [loss = 0.634, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7464/15625) 007464-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.464, top1 = 89.15%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.322, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.23 ms.
cifar100       train : [loss = 0.321, top1 = 91.41%], valid : [loss = 1.256, top1 = 67.90%], test : [loss = 1.267, top1 = 67.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.65%], valid : [loss = 2.302, top1 = 41.16%], test : [loss = 2.339, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.03%], valid : [loss = 0.625, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7465/15625) 007465-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.738, top1 = 85.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.024, top1 = 99.38%], test  : [loss = 0.493, top1 = 88.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 0.317, top1 = 91.65%], valid : [loss = 1.687, top1 = 61.57%], test : [loss = 1.713, top1 = 60.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.436, top1 = 38.11%], valid : [loss = 2.806, top1 = 31.00%], test : [loss = 2.829, top1 = 31.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.57%], valid : [loss = 0.839, top1 = 70.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7466/15625) 007466-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.098, top1 = 96.99%], valid : [loss = 0.556, top1 = 84.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.107, top1 = 96.56%], test  : [loss = 0.372, top1 = 89.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.80 ms.
cifar100       train : [loss = 0.871, top1 = 74.53%], valid : [loss = 1.416, top1 = 62.04%], test : [loss = 1.415, top1 = 61.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.583, top1 = 34.77%], valid : [loss = 2.658, top1 = 33.61%], test : [loss = 2.683, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.99%], valid : [loss = 0.954, top1 = 66.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7467/15625) 007467-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.89 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.49%], valid : [loss = 0.555, top1 = 83.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.173, top1 = 94.18%], test  : [loss = 0.395, top1 = 87.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.48 ms.
cifar100       train : [loss = 1.144, top1 = 67.15%], valid : [loss = 1.517, top1 = 58.33%], test : [loss = 1.510, top1 = 58.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.35%], valid : [loss = 2.700, top1 = 32.77%], test : [loss = 2.742, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.78%], valid : [loss = 0.939, top1 = 66.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7468/15625) 007468-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.54%], valid : [loss = 0.641, top1 = 85.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10        train : [loss = 0.039, top1 = 98.86%], test  : [loss = 0.408, top1 = 89.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.43 ms.
cifar100       train : [loss = 0.560, top1 = 83.65%], valid : [loss = 1.438, top1 = 63.66%], test : [loss = 1.399, top1 = 64.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.15%], valid : [loss = 2.633, top1 = 33.94%], test : [loss = 2.668, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.97%], valid : [loss = 0.933, top1 = 67.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7469/15625) 007469-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.47%], valid : [loss = 0.565, top1 = 87.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.034, top1 = 98.98%], test  : [loss = 0.369, top1 = 90.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.32 ms.
cifar100       train : [loss = 0.570, top1 = 83.38%], valid : [loss = 1.415, top1 = 63.70%], test : [loss = 1.413, top1 = 62.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 32.71%], valid : [loss = 2.716, top1 = 31.41%], test : [loss = 2.745, top1 = 31.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.901, top1 = 67.83%], valid : [loss = 0.936, top1 = 66.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7470/15625) 007470-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.568, top1 = 87.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.56 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.383, top1 = 91.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.19 ms.
cifar100       train : [loss = 0.418, top1 = 88.14%], valid : [loss = 1.394, top1 = 65.68%], test : [loss = 1.372, top1 = 66.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.71%], valid : [loss = 2.519, top1 = 36.41%], test : [loss = 2.543, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.14%], valid : [loss = 0.806, top1 = 72.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7471/15625) 007471-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.266, top1 = 90.91%], valid : [loss = 0.531, top1 = 83.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10        train : [loss = 0.249, top1 = 91.52%], test  : [loss = 0.403, top1 = 86.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.92 ms.
cifar100       train : [loss = 1.347, top1 = 62.15%], valid : [loss = 1.606, top1 = 56.43%], test : [loss = 1.580, top1 = 56.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 2.880, top1 = 29.25%], valid : [loss = 2.880, top1 = 29.18%], test : [loss = 2.934, top1 = 29.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.91%], valid : [loss = 1.032, top1 = 63.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7472/15625) 007472-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.21%], valid : [loss = 0.592, top1 = 85.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.44 ms.
cifar10        train : [loss = 0.111, top1 = 96.31%], test  : [loss = 0.397, top1 = 88.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 0.817, top1 = 75.90%], valid : [loss = 1.418, top1 = 62.39%], test : [loss = 1.414, top1 = 62.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 32.83%], valid : [loss = 2.754, top1 = 31.79%], test : [loss = 2.808, top1 = 30.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 78.08%], valid : [loss = 0.709, top1 = 75.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7473/15625) 007473-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.25%], valid : [loss = 0.539, top1 = 84.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.153, top1 = 94.88%], test  : [loss = 0.375, top1 = 88.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 1.091, top1 = 68.72%], valid : [loss = 1.484, top1 = 59.19%], test : [loss = 1.472, top1 = 59.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.589, top1 = 34.88%], valid : [loss = 2.644, top1 = 34.02%], test : [loss = 2.693, top1 = 32.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 67.00%], valid : [loss = 0.987, top1 = 64.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7474/15625) 007474-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.46%], valid : [loss = 0.733, top1 = 75.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10        train : [loss = 0.472, top1 = 83.42%], test  : [loss = 0.588, top1 = 80.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.16 ms.
cifar100       train : [loss = 1.749, top1 = 52.15%], valid : [loss = 1.956, top1 = 48.29%], test : [loss = 1.942, top1 = 48.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 3.410, top1 = 19.45%], valid : [loss = 3.415, top1 = 20.07%], test : [loss = 3.445, top1 = 18.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.56%], valid : [loss = 1.265, top1 = 54.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7475/15625) 007475-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.90%], valid : [loss = 0.820, top1 = 76.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.89 ms.
cifar10        train : [loss = 0.324, top1 = 88.72%], test  : [loss = 0.626, top1 = 80.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 1.391, top1 = 61.02%], valid : [loss = 1.965, top1 = 49.35%], test : [loss = 1.976, top1 = 49.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 3.520, top1 = 16.87%], valid : [loss = 3.530, top1 = 17.46%], test : [loss = 3.536, top1 = 16.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.263, top1 = 53.88%], valid : [loss = 1.311, top1 = 52.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7476/15625) 007476-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.91%], valid : [loss = 0.484, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 0.303, top1 = 89.91%], test  : [loss = 0.398, top1 = 86.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.86 ms.
cifar100       train : [loss = 1.327, top1 = 63.25%], valid : [loss = 1.535, top1 = 57.49%], test : [loss = 1.509, top1 = 57.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.64%], valid : [loss = 2.886, top1 = 30.00%], test : [loss = 2.967, top1 = 27.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.27%], valid : [loss = 0.759, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7477/15625) 007477-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.88%], valid : [loss = 0.501, top1 = 86.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.092, top1 = 96.98%], test  : [loss = 0.348, top1 = 89.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.74 ms.
cifar100       train : [loss = 0.717, top1 = 79.07%], valid : [loss = 1.244, top1 = 65.66%], test : [loss = 1.230, top1 = 66.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.82%], valid : [loss = 2.441, top1 = 38.14%], test : [loss = 2.447, top1 = 38.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.79%], valid : [loss = 0.944, top1 = 66.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7478/15625) 007478-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.78%], valid : [loss = 0.458, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.82 ms.
cifar10        train : [loss = 0.118, top1 = 96.39%], test  : [loss = 0.336, top1 = 89.21%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.79 ms.
cifar100       train : [loss = 0.774, top1 = 78.35%], valid : [loss = 1.313, top1 = 63.79%], test : [loss = 1.294, top1 = 64.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.451, top1 = 37.73%], valid : [loss = 2.591, top1 = 35.39%], test : [loss = 2.592, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 72.23%], valid : [loss = 0.842, top1 = 70.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7479/15625) 007479-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.578, top1 = 88.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.424, top1 = 91.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 0.167, top1 = 96.05%], valid : [loss = 1.579, top1 = 65.25%], test : [loss = 1.573, top1 = 65.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.41%], valid : [loss = 2.550, top1 = 36.38%], test : [loss = 2.586, top1 = 36.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.31%], valid : [loss = 0.635, top1 = 78.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7480/15625) 007480-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.30%], valid : [loss = 0.939, top1 = 75.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10        train : [loss = 0.216, top1 = 92.58%], test  : [loss = 0.591, top1 = 82.41%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.77 ms.
cifar100       train : [loss = 1.132, top1 = 67.86%], valid : [loss = 1.763, top1 = 54.11%], test : [loss = 1.761, top1 = 54.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 3.233, top1 = 22.64%], valid : [loss = 3.338, top1 = 22.07%], test : [loss = 3.366, top1 = 20.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.59%], valid : [loss = 1.130, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7481/15625) 007481-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.69%], valid : [loss = 0.536, top1 = 84.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10        train : [loss = 0.172, top1 = 94.22%], test  : [loss = 0.377, top1 = 88.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 1.206, top1 = 65.76%], valid : [loss = 1.519, top1 = 58.86%], test : [loss = 1.497, top1 = 59.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.74%], valid : [loss = 2.707, top1 = 32.84%], test : [loss = 2.729, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7482/15625) 007482-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.407, top1 = 90.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.275, top1 = 93.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.13 ms.
cifar100       train : [loss = 0.091, top1 = 98.53%], valid : [loss = 1.301, top1 = 70.40%], test : [loss = 1.274, top1 = 70.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 1.624, top1 = 56.24%], valid : [loss = 2.197, top1 = 44.43%], test : [loss = 2.230, top1 = 43.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 86.99%], valid : [loss = 0.510, top1 = 83.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7483/15625) 007483-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.546, top1 = 88.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.345, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.324, top1 = 91.15%], valid : [loss = 1.314, top1 = 66.99%], test : [loss = 1.302, top1 = 67.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 43.91%], valid : [loss = 2.425, top1 = 38.82%], test : [loss = 2.432, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7484/15625) 007484-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.550, top1 = 87.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.377, top1 = 90.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.466, top1 = 86.28%], valid : [loss = 1.389, top1 = 64.46%], test : [loss = 1.399, top1 = 64.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 32.97%], valid : [loss = 2.708, top1 = 31.36%], test : [loss = 2.726, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.46%], valid : [loss = 0.958, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7485/15625) 007485-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.12%], valid : [loss = 0.868, top1 = 71.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10        train : [loss = 0.555, top1 = 80.50%], test  : [loss = 0.716, top1 = 75.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.38 ms.
cifar100       train : [loss = 1.780, top1 = 52.02%], valid : [loss = 2.053, top1 = 46.90%], test : [loss = 2.072, top1 = 46.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.11 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.86%], valid : [loss = 3.638, top1 = 16.40%], test : [loss = 3.658, top1 = 16.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7486/15625) 007486-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.80%], valid : [loss = 0.456, top1 = 86.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.50 ms.
cifar10        train : [loss = 0.146, top1 = 95.25%], test  : [loss = 0.339, top1 = 89.13%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.48 ms.
cifar100       train : [loss = 0.961, top1 = 72.67%], valid : [loss = 1.342, top1 = 62.60%], test : [loss = 1.340, top1 = 62.23%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.38%], valid : [loss = 2.662, top1 = 32.74%], test : [loss = 2.692, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.29%], valid : [loss = 0.782, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7487/15625) 007487-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.641, top1 = 86.68%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.88 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.386, top1 = 90.98%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.12 ms.
cifar100       train : [loss = 0.259, top1 = 93.53%], valid : [loss = 1.576, top1 = 63.67%], test : [loss = 1.585, top1 = 63.26%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.80%], valid : [loss = 2.502, top1 = 37.18%], test : [loss = 2.514, top1 = 38.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 74.99%], valid : [loss = 0.785, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7488/15625) 007488-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.70 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.14%], valid : [loss = 0.847, top1 = 72.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.77 ms.
cifar10        train : [loss = 0.561, top1 = 80.45%], test  : [loss = 0.713, top1 = 75.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 1.792, top1 = 51.74%], valid : [loss = 2.053, top1 = 47.09%], test : [loss = 2.080, top1 = 46.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 3.592, top1 = 16.71%], valid : [loss = 3.644, top1 = 16.06%], test : [loss = 3.664, top1 = 15.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7489/15625) 007489-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.281, top1 = 93.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.127, top1 = 97.43%], valid : [loss = 1.306, top1 = 70.19%], test : [loss = 1.303, top1 = 69.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 1.720, top1 = 54.01%], valid : [loss = 2.226, top1 = 43.24%], test : [loss = 2.276, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.39%], valid : [loss = 0.512, top1 = 82.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7490/15625) 007490-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.46%], valid : [loss = 0.748, top1 = 74.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.573, top1 = 80.18%], test  : [loss = 0.632, top1 = 78.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.18 ms.
cifar100       train : [loss = 1.968, top1 = 46.96%], valid : [loss = 2.113, top1 = 44.23%], test : [loss = 2.101, top1 = 44.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.43%], valid : [loss = 3.228, top1 = 23.06%], test : [loss = 3.245, top1 = 22.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.251, top1 = 55.00%], valid : [loss = 1.312, top1 = 52.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7491/15625) 007491-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.56%], valid : [loss = 0.686, top1 = 82.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.163, top1 = 94.44%], test  : [loss = 0.457, top1 = 86.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.990, top1 = 71.32%], valid : [loss = 1.644, top1 = 56.45%], test : [loss = 1.634, top1 = 57.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 3.125, top1 = 23.92%], valid : [loss = 3.167, top1 = 23.64%], test : [loss = 3.204, top1 = 22.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.31%], valid : [loss = 1.003, top1 = 64.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7492/15625) 007492-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.494, top1 = 89.31%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.52 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.318, top1 = 92.50%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.52 ms.
cifar100       train : [loss = 0.206, top1 = 95.03%], valid : [loss = 1.252, top1 = 69.25%], test : [loss = 1.247, top1 = 69.33%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.60%], valid : [loss = 2.230, top1 = 41.98%], test : [loss = 2.237, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.81%], valid : [loss = 0.652, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7493/15625) 007493-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.56%], valid : [loss = 0.654, top1 = 77.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.03 ms.
cifar10        train : [loss = 0.535, top1 = 81.44%], test  : [loss = 0.609, top1 = 79.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.692, top1 = 54.20%], valid : [loss = 1.867, top1 = 50.24%], test : [loss = 1.874, top1 = 50.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 3.340, top1 = 21.00%], valid : [loss = 3.322, top1 = 21.68%], test : [loss = 3.360, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.14%], valid : [loss = 1.299, top1 = 53.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7494/15625) 007494-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.530, top1 = 89.39%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.340, top1 = 92.94%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.55 ms.
cifar100       train : [loss = 0.091, top1 = 98.22%], valid : [loss = 1.403, top1 = 69.11%], test : [loss = 1.356, top1 = 69.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 1.712, top1 = 54.13%], valid : [loss = 2.195, top1 = 43.73%], test : [loss = 2.199, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.65%], valid : [loss = 0.848, top1 = 70.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7495/15625) 007495-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.88%], valid : [loss = 0.449, top1 = 86.57%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10        train : [loss = 0.146, top1 = 95.25%], test  : [loss = 0.340, top1 = 89.02%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.71 ms.
cifar100       train : [loss = 0.975, top1 = 72.19%], valid : [loss = 1.334, top1 = 62.69%], test : [loss = 1.335, top1 = 62.47%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.30%], valid : [loss = 2.664, top1 = 33.06%], test : [loss = 2.697, top1 = 32.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.66%], valid : [loss = 0.809, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7496/15625) 007496-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.61%], valid : [loss = 0.849, top1 = 72.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10        train : [loss = 0.547, top1 = 80.88%], test  : [loss = 0.707, top1 = 76.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.62 ms.
cifar100       train : [loss = 1.775, top1 = 52.32%], valid : [loss = 2.056, top1 = 46.86%], test : [loss = 2.082, top1 = 46.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.86%], valid : [loss = 3.637, top1 = 16.43%], test : [loss = 3.661, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7497/15625) 007497-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.499, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.321, top1 = 92.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 0.327, top1 = 91.16%], valid : [loss = 1.286, top1 = 66.77%], test : [loss = 1.288, top1 = 67.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.89%], valid : [loss = 2.394, top1 = 39.18%], test : [loss = 2.415, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7498/15625) 007498-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.212, top1 = 92.89%], valid : [loss = 0.529, top1 = 83.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.206, top1 = 93.04%], test  : [loss = 0.388, top1 = 87.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.40 ms.
cifar100       train : [loss = 1.249, top1 = 64.65%], valid : [loss = 1.542, top1 = 58.15%], test : [loss = 1.525, top1 = 58.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.34 ms.
ImageNet16-120 train : [loss = 2.730, top1 = 32.09%], valid : [loss = 2.720, top1 = 31.97%], test : [loss = 2.777, top1 = 31.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.54%], valid : [loss = 1.009, top1 = 64.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7499/15625) 007499-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.571, top1 = 88.05%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.41 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.395, top1 = 91.39%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.52 ms.
cifar100       train : [loss = 0.183, top1 = 95.88%], valid : [loss = 1.438, top1 = 66.57%], test : [loss = 1.422, top1 = 67.07%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.67 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 48.01%], valid : [loss = 2.420, top1 = 39.34%], test : [loss = 2.438, top1 = 39.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.30%], valid : [loss = 0.684, top1 = 76.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7500/15625) 007500-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.473, top1 = 89.46%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.90 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.288, top1 = 93.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.18 ms.
cifar100       train : [loss = 0.137, top1 = 97.24%], valid : [loss = 1.299, top1 = 69.10%], test : [loss = 1.290, top1 = 69.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.744, top1 = 53.50%], valid : [loss = 2.188, top1 = 43.78%], test : [loss = 2.227, top1 = 43.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.448, top1 = 84.58%], valid : [loss = 0.549, top1 = 81.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7501/15625) 007501-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7502/15625) 007502-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.454, top1 = 89.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.73 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.308, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.68 ms.
cifar100       train : [loss = 0.198, top1 = 95.46%], valid : [loss = 1.269, top1 = 69.18%], test : [loss = 1.275, top1 = 69.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.53%], valid : [loss = 2.246, top1 = 42.49%], test : [loss = 2.267, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.22%], valid : [loss = 0.539, top1 = 81.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7503/15625) 007503-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.16%], valid : [loss = 0.472, top1 = 84.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.301, top1 = 89.95%], test  : [loss = 0.396, top1 = 86.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.27 ms.
cifar100       train : [loss = 1.325, top1 = 63.32%], valid : [loss = 1.528, top1 = 58.29%], test : [loss = 1.510, top1 = 58.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.47%], valid : [loss = 2.922, top1 = 29.12%], test : [loss = 2.968, top1 = 27.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7504/15625) 007504-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.45%], valid : [loss = 0.617, top1 = 84.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.60 ms.
cifar10        train : [loss = 0.090, top1 = 97.03%], test  : [loss = 0.429, top1 = 88.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 0.704, top1 = 79.32%], valid : [loss = 1.531, top1 = 60.71%], test : [loss = 1.553, top1 = 60.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 3.198, top1 = 22.10%], valid : [loss = 3.207, top1 = 21.80%], test : [loss = 3.243, top1 = 21.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7505/15625) 007505-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.535, top1 = 89.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.341, top1 = 92.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.115, top1 = 97.57%], valid : [loss = 1.355, top1 = 68.75%], test : [loss = 1.369, top1 = 69.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 52.98%], valid : [loss = 2.212, top1 = 43.06%], test : [loss = 2.241, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.09%], valid : [loss = 0.645, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7506/15625) 007506-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.50%], valid : [loss = 0.639, top1 = 78.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.59 ms.
cifar10        train : [loss = 0.509, top1 = 82.40%], test  : [loss = 0.586, top1 = 80.08%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.13 ms.
cifar100       train : [loss = 1.683, top1 = 54.42%], valid : [loss = 1.850, top1 = 50.38%], test : [loss = 1.864, top1 = 50.67%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.36 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.41%], valid : [loss = 3.315, top1 = 21.13%], test : [loss = 3.348, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7507/15625) 007507-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.550, top1 = 89.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.358, top1 = 92.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.87 ms.
cifar100       train : [loss = 0.200, top1 = 95.02%], valid : [loss = 1.407, top1 = 66.59%], test : [loss = 1.414, top1 = 66.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.35%], valid : [loss = 2.444, top1 = 37.58%], test : [loss = 2.441, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.43%], valid : [loss = 0.898, top1 = 67.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7508/15625) 007508-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.335, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.242, top1 = 93.89%], valid : [loss = 1.257, top1 = 68.49%], test : [loss = 1.276, top1 = 68.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.08%], valid : [loss = 2.292, top1 = 40.63%], test : [loss = 2.307, top1 = 41.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.77%], valid : [loss = 0.724, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7509/15625) 007509-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.224, top1 = 92.46%], valid : [loss = 0.518, top1 = 84.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.215, top1 = 92.65%], test  : [loss = 0.383, top1 = 87.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 1.288, top1 = 63.38%], valid : [loss = 1.600, top1 = 56.03%], test : [loss = 1.591, top1 = 56.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.882, top1 = 28.99%], valid : [loss = 2.905, top1 = 29.01%], test : [loss = 2.942, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.79%], valid : [loss = 1.028, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7510/15625) 007510-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.502, top1 = 88.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.344, top1 = 91.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.66 ms.
cifar100       train : [loss = 0.473, top1 = 86.10%], valid : [loss = 1.326, top1 = 66.07%], test : [loss = 1.320, top1 = 65.69%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.17%], valid : [loss = 2.509, top1 = 36.79%], test : [loss = 2.535, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.91%], valid : [loss = 0.688, top1 = 76.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7511/15625) 007511-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.60 ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.53%], valid : [loss = 0.526, top1 = 82.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.40 ms.
cifar10        train : [loss = 0.399, top1 = 86.45%], test  : [loss = 0.462, top1 = 84.52%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.36 ms.
cifar100       train : [loss = 1.538, top1 = 57.84%], valid : [loss = 1.663, top1 = 54.73%], test : [loss = 1.655, top1 = 54.57%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.72 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.47%], valid : [loss = 3.013, top1 = 27.39%], test : [loss = 3.056, top1 = 26.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7512/15625) 007512-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.27%], valid : [loss = 0.600, top1 = 86.68%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.93 ms.
cifar10        train : [loss = 0.048, top1 = 98.49%], test  : [loss = 0.402, top1 = 89.93%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.34 ms.
cifar100       train : [loss = 0.499, top1 = 85.54%], valid : [loss = 1.423, top1 = 64.11%], test : [loss = 1.404, top1 = 64.43%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.07%], valid : [loss = 2.451, top1 = 37.93%], test : [loss = 2.446, top1 = 38.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 70.00%], valid : [loss = 0.895, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7513/15625) 007513-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.567, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.384, top1 = 91.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.24 ms.
cifar100       train : [loss = 0.176, top1 = 96.13%], valid : [loss = 1.438, top1 = 66.61%], test : [loss = 1.412, top1 = 67.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.71%], valid : [loss = 2.444, top1 = 38.77%], test : [loss = 2.442, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.89%], valid : [loss = 0.693, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7514/15625) 007514-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.49 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.470, top1 = 89.51%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.39 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.299, top1 = 92.44%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.88 ms.
cifar100       train : [loss = 0.237, top1 = 94.01%], valid : [loss = 1.216, top1 = 69.19%], test : [loss = 1.223, top1 = 69.27%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.12 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.56%], valid : [loss = 2.172, top1 = 43.87%], test : [loss = 2.209, top1 = 43.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.71%], valid : [loss = 0.675, top1 = 76.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7515/15625) 007515-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.00 ms.
cifar10-valid  train : [loss = 0.490, top1 = 82.89%], valid : [loss = 0.648, top1 = 78.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 0.516, top1 = 82.16%], test  : [loss = 0.591, top1 = 79.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 1.690, top1 = 54.06%], valid : [loss = 1.860, top1 = 50.45%], test : [loss = 1.860, top1 = 50.75%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.12 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.37%], valid : [loss = 3.323, top1 = 21.36%], test : [loss = 3.346, top1 = 21.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7516/15625) 007516-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.20%], valid : [loss = 0.852, top1 = 71.96%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.50 ms.
cifar10        train : [loss = 0.560, top1 = 80.41%], test  : [loss = 0.711, top1 = 75.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.84 ms.
cifar100       train : [loss = 1.774, top1 = 52.08%], valid : [loss = 2.056, top1 = 46.79%], test : [loss = 2.055, top1 = 47.08%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.68%], valid : [loss = 3.651, top1 = 16.24%], test : [loss = 3.674, top1 = 15.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7517/15625) 007517-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.14%], valid : [loss = 0.456, top1 = 86.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10        train : [loss = 0.158, top1 = 94.87%], test  : [loss = 0.346, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.37 ms.
cifar100       train : [loss = 1.018, top1 = 71.11%], valid : [loss = 1.367, top1 = 61.39%], test : [loss = 1.379, top1 = 61.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.66%], valid : [loss = 2.700, top1 = 32.38%], test : [loss = 2.719, top1 = 32.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.69%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7518/15625) 007518-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.187, top1 = 93.82%], valid : [loss = 0.538, top1 = 84.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10        train : [loss = 0.198, top1 = 93.28%], test  : [loss = 0.389, top1 = 87.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 1.186, top1 = 66.04%], valid : [loss = 1.521, top1 = 58.31%], test : [loss = 1.500, top1 = 58.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.728, top1 = 32.08%], valid : [loss = 2.739, top1 = 31.88%], test : [loss = 2.782, top1 = 31.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.18%], valid : [loss = 0.996, top1 = 64.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7519/15625) 007519-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.72 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.43%], valid : [loss = 0.673, top1 = 77.17%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10        train : [loss = 0.548, top1 = 80.90%], test  : [loss = 0.608, top1 = 79.27%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.24 ms.
cifar100       train : [loss = 1.861, top1 = 50.04%], valid : [loss = 1.987, top1 = 47.55%], test : [loss = 2.005, top1 = 47.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.57 ms.
ImageNet16-120 train : [loss = 3.388, top1 = 20.05%], valid : [loss = 3.381, top1 = 19.98%], test : [loss = 3.405, top1 = 19.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7520/15625) 007520-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.597, top1 = 87.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.382, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.00 ms.
cifar100       train : [loss = 0.397, top1 = 88.73%], valid : [loss = 1.389, top1 = 65.90%], test : [loss = 1.366, top1 = 65.53%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.05%], valid : [loss = 2.521, top1 = 36.82%], test : [loss = 2.526, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7521/15625) 007521-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.79%], valid : [loss = 0.618, top1 = 80.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.24 ms.
cifar10        train : [loss = 0.288, top1 = 90.12%], test  : [loss = 0.435, top1 = 85.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.82 ms.
cifar100       train : [loss = 1.538, top1 = 57.03%], valid : [loss = 1.752, top1 = 52.53%], test : [loss = 1.766, top1 = 52.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.38%], valid : [loss = 2.936, top1 = 27.53%], test : [loss = 2.983, top1 = 26.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.98%], valid : [loss = 1.091, top1 = 60.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7522/15625) 007522-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.455, top1 = 89.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.316, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.57 ms.
cifar100       train : [loss = 0.325, top1 = 91.13%], valid : [loss = 1.303, top1 = 67.43%], test : [loss = 1.288, top1 = 67.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.17%], valid : [loss = 2.362, top1 = 40.21%], test : [loss = 2.420, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.451, top1 = 84.30%], valid : [loss = 0.551, top1 = 81.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7523/15625) 007523-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.492, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.022, top1 = 99.44%], test  : [loss = 0.346, top1 = 91.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 0.407, top1 = 88.23%], valid : [loss = 1.319, top1 = 66.77%], test : [loss = 1.301, top1 = 66.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.47%], valid : [loss = 2.409, top1 = 39.50%], test : [loss = 2.432, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.91%], valid : [loss = 0.624, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7524/15625) 007524-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.535, top1 = 88.95%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.50 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.345, top1 = 92.70%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.62 ms.
cifar100       train : [loss = 0.049, top1 = 99.58%], valid : [loss = 1.404, top1 = 69.75%], test : [loss = 1.396, top1 = 69.53%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.10 ms.
ImageNet16-120 train : [loss = 1.600, top1 = 57.04%], valid : [loss = 2.422, top1 = 40.67%], test : [loss = 2.434, top1 = 41.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.19%], valid : [loss = 0.651, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7525/15625) 007525-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.529, top1 = 89.48%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.01 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.309, top1 = 93.11%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.91 ms.
cifar100       train : [loss = 0.060, top1 = 99.19%], valid : [loss = 1.354, top1 = 69.64%], test : [loss = 1.334, top1 = 70.21%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.711, top1 = 54.26%], valid : [loss = 2.268, top1 = 42.68%], test : [loss = 2.274, top1 = 42.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 81.00%], valid : [loss = 0.637, top1 = 78.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7526/15625) 007526-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.18%], valid : [loss = 0.645, top1 = 78.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.44 ms.
cifar10        train : [loss = 0.524, top1 = 81.84%], test  : [loss = 0.598, top1 = 79.77%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.43 ms.
cifar100       train : [loss = 1.701, top1 = 53.90%], valid : [loss = 1.871, top1 = 50.33%], test : [loss = 1.880, top1 = 50.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.31 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.36%], valid : [loss = 3.309, top1 = 21.31%], test : [loss = 3.345, top1 = 21.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7527/15625) 007527-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.522, top1 = 88.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.019, top1 = 99.55%], test  : [loss = 0.357, top1 = 91.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.390, top1 = 88.83%], valid : [loss = 1.337, top1 = 66.60%], test : [loss = 1.346, top1 = 66.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.204, top1 = 42.95%], valid : [loss = 2.421, top1 = 38.47%], test : [loss = 2.448, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.56%], valid : [loss = 0.639, top1 = 78.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7528/15625) 007528-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.40%], valid : [loss = 0.845, top1 = 72.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.566, top1 = 80.26%], test  : [loss = 0.713, top1 = 75.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 1.781, top1 = 52.01%], valid : [loss = 2.047, top1 = 47.16%], test : [loss = 2.065, top1 = 46.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.78%], valid : [loss = 3.629, top1 = 16.62%], test : [loss = 3.667, top1 = 15.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7529/15625) 007529-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.559, top1 = 88.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.373, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.13 ms.
cifar100       train : [loss = 0.172, top1 = 96.26%], valid : [loss = 1.376, top1 = 67.64%], test : [loss = 1.376, top1 = 67.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 48.03%], valid : [loss = 2.447, top1 = 38.70%], test : [loss = 2.483, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.58%], valid : [loss = 0.708, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7530/15625) 007530-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.580, top1 = 88.05%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.63 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.386, top1 = 92.08%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.04 ms.
cifar100       train : [loss = 0.091, top1 = 98.33%], valid : [loss = 1.572, top1 = 66.75%], test : [loss = 1.528, top1 = 67.41%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.59%], valid : [loss = 2.387, top1 = 39.74%], test : [loss = 2.401, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.71%], valid : [loss = 0.802, top1 = 71.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7531/15625) 007531-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.423, top1 = 90.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.279, top1 = 93.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.28 ms.
cifar100       train : [loss = 0.182, top1 = 95.68%], valid : [loss = 1.290, top1 = 69.09%], test : [loss = 1.283, top1 = 69.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.73%], valid : [loss = 2.260, top1 = 42.58%], test : [loss = 2.295, top1 = 42.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.88%], valid : [loss = 0.500, top1 = 83.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7532/15625) 007532-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.510, top1 = 88.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.328, top1 = 92.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.03 ms.
cifar100       train : [loss = 0.322, top1 = 91.28%], valid : [loss = 1.307, top1 = 66.71%], test : [loss = 1.303, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.93%], valid : [loss = 2.408, top1 = 38.80%], test : [loss = 2.416, top1 = 39.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7533/15625) 007533-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.73%], valid : [loss = 0.637, top1 = 83.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.142, top1 = 95.19%], test  : [loss = 0.428, top1 = 87.18%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.91 ms.
cifar100       train : [loss = 0.949, top1 = 72.42%], valid : [loss = 1.509, top1 = 59.45%], test : [loss = 1.502, top1 = 59.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.842, top1 = 29.85%], valid : [loss = 2.930, top1 = 28.03%], test : [loss = 2.970, top1 = 27.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.75%], valid : [loss = 0.997, top1 = 64.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7534/15625) 007534-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.65%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.329, top1 = 93.11%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.17 ms.
cifar100       train : [loss = 0.090, top1 = 98.34%], valid : [loss = 1.349, top1 = 69.91%], test : [loss = 1.341, top1 = 70.28%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.29 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.47%], valid : [loss = 2.345, top1 = 39.74%], test : [loss = 2.333, top1 = 40.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.14%], valid : [loss = 0.870, top1 = 69.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7535/15625) 007535-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.82%], valid : [loss = 0.966, top1 = 66.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10        train : [loss = 0.770, top1 = 73.00%], test  : [loss = 0.855, top1 = 70.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.33 ms.
cifar100       train : [loss = 2.148, top1 = 43.57%], valid : [loss = 2.317, top1 = 40.77%], test : [loss = 2.343, top1 = 40.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 3.744, top1 = 14.25%], valid : [loss = 3.770, top1 = 14.33%], test : [loss = 3.774, top1 = 13.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.462, top1 = 46.22%], valid : [loss = 1.477, top1 = 46.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7536/15625) 007536-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.46%], valid : [loss = 0.661, top1 = 77.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10        train : [loss = 0.499, top1 = 82.72%], test  : [loss = 0.583, top1 = 79.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 1.701, top1 = 53.95%], valid : [loss = 1.864, top1 = 50.55%], test : [loss = 1.891, top1 = 49.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.30%], valid : [loss = 3.309, top1 = 21.82%], test : [loss = 3.347, top1 = 21.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7537/15625) 007537-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.597, top1 = 87.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.392, top1 = 91.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.45 ms.
cifar100       train : [loss = 0.401, top1 = 88.61%], valid : [loss = 1.403, top1 = 65.89%], test : [loss = 1.398, top1 = 65.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.99%], valid : [loss = 2.523, top1 = 35.60%], test : [loss = 2.533, top1 = 36.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7538/15625) 007538-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.656, top1 = 86.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10        train : [loss = 0.020, top1 = 99.48%], test  : [loss = 0.433, top1 = 90.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.287, top1 = 92.39%], valid : [loss = 1.523, top1 = 64.34%], test : [loss = 1.528, top1 = 64.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.92%], valid : [loss = 2.559, top1 = 36.02%], test : [loss = 2.578, top1 = 36.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.57%], valid : [loss = 0.845, top1 = 70.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7539/15625) 007539-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.62%], valid : [loss = 0.456, top1 = 86.31%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.69 ms.
cifar10        train : [loss = 0.157, top1 = 94.87%], test  : [loss = 0.347, top1 = 88.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.81 ms.
cifar100       train : [loss = 0.980, top1 = 72.15%], valid : [loss = 1.349, top1 = 62.48%], test : [loss = 1.343, top1 = 62.06%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 34.35%], valid : [loss = 2.664, top1 = 33.78%], test : [loss = 2.683, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.28%], valid : [loss = 0.814, top1 = 71.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7540/15625) 007540-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.64%], valid : [loss = 0.853, top1 = 80.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10        train : [loss = 0.128, top1 = 95.69%], test  : [loss = 0.550, top1 = 85.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.89 ms.
cifar100       train : [loss = 0.849, top1 = 75.37%], valid : [loss = 1.649, top1 = 57.84%], test : [loss = 1.676, top1 = 57.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.34%], valid : [loss = 3.176, top1 = 24.21%], test : [loss = 3.194, top1 = 23.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7541/15625) 007541-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.561, top1 = 88.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.385, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.11 ms.
cifar100       train : [loss = 0.101, top1 = 98.17%], valid : [loss = 1.464, top1 = 67.93%], test : [loss = 1.448, top1 = 68.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.51%], valid : [loss = 2.439, top1 = 39.63%], test : [loss = 2.448, top1 = 40.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.44%], valid : [loss = 0.732, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7542/15625) 007542-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.11%], valid : [loss = 0.476, top1 = 84.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.299, top1 = 89.99%], test  : [loss = 0.398, top1 = 86.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 1.334, top1 = 63.07%], valid : [loss = 1.543, top1 = 57.64%], test : [loss = 1.523, top1 = 57.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.68%], valid : [loss = 2.900, top1 = 29.39%], test : [loss = 2.954, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7543/15625) 007543-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.338, top1 = 88.17%], valid : [loss = 0.582, top1 = 81.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 0.285, top1 = 90.22%], test  : [loss = 0.432, top1 = 85.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 1.568, top1 = 56.46%], valid : [loss = 1.777, top1 = 51.72%], test : [loss = 1.778, top1 = 51.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 3.049, top1 = 25.80%], valid : [loss = 3.053, top1 = 25.77%], test : [loss = 3.117, top1 = 24.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 62.92%], valid : [loss = 1.079, top1 = 61.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7544/15625) 007544-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.479, top1 = 89.51%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.68 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.306, top1 = 92.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.14 ms.
cifar100       train : [loss = 0.281, top1 = 92.53%], valid : [loss = 1.267, top1 = 67.99%], test : [loss = 1.232, top1 = 68.65%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.64%], valid : [loss = 2.231, top1 = 42.39%], test : [loss = 2.241, top1 = 42.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7545/15625) 007545-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.18%], valid : [loss = 0.695, top1 = 77.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.390, top1 = 86.50%], test  : [loss = 0.521, top1 = 82.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 1.642, top1 = 54.78%], valid : [loss = 1.881, top1 = 49.93%], test : [loss = 1.884, top1 = 49.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 3.297, top1 = 21.49%], valid : [loss = 3.309, top1 = 21.41%], test : [loss = 3.323, top1 = 20.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.206, top1 = 56.22%], valid : [loss = 1.250, top1 = 54.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7546/15625) 007546-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.570, top1 = 87.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.386, top1 = 91.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.57 ms.
cifar100       train : [loss = 0.275, top1 = 92.23%], valid : [loss = 1.422, top1 = 66.08%], test : [loss = 1.418, top1 = 66.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.696, top1 = 31.85%], valid : [loss = 2.799, top1 = 29.47%], test : [loss = 2.798, top1 = 29.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.51%], valid : [loss = 1.096, top1 = 60.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7547/15625) 007547-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.48%], valid : [loss = 0.558, top1 = 87.61%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.63 ms.
cifar10        train : [loss = 0.034, top1 = 98.97%], test  : [loss = 0.365, top1 = 91.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.15 ms.
cifar100       train : [loss = 0.549, top1 = 84.06%], valid : [loss = 1.391, top1 = 63.69%], test : [loss = 1.381, top1 = 63.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 33.79%], valid : [loss = 2.684, top1 = 31.98%], test : [loss = 2.696, top1 = 31.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.23%], valid : [loss = 1.004, top1 = 64.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7548/15625) 007548-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.443, top1 = 91.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.51 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.282, top1 = 93.96%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.84 ms.
cifar100       train : [loss = 0.031, top1 = 99.70%], valid : [loss = 1.349, top1 = 71.79%], test : [loss = 1.328, top1 = 72.09%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 1.312, top1 = 64.00%], valid : [loss = 2.251, top1 = 44.68%], test : [loss = 2.251, top1 = 45.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.345, top1 = 88.18%], valid : [loss = 0.498, top1 = 83.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7549/15625) 007549-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.458, top1 = 89.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.322, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.277, top1 = 92.58%], valid : [loss = 1.352, top1 = 67.27%], test : [loss = 1.353, top1 = 67.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.48%], valid : [loss = 2.358, top1 = 40.16%], test : [loss = 2.382, top1 = 40.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.15%], valid : [loss = 0.595, top1 = 79.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7550/15625) 007550-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.481, top1 = 89.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.308, top1 = 92.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.19 ms.
cifar100       train : [loss = 0.247, top1 = 93.67%], valid : [loss = 1.227, top1 = 68.83%], test : [loss = 1.249, top1 = 68.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.84%], valid : [loss = 2.226, top1 = 42.46%], test : [loss = 2.234, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7551/15625) 007551-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.71%], valid : [loss = 0.444, top1 = 87.97%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.29 ms.
cifar10        train : [loss = 0.046, top1 = 98.98%], test  : [loss = 0.323, top1 = 90.36%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.63 ms.
cifar100       train : [loss = 0.489, top1 = 87.08%], valid : [loss = 1.231, top1 = 66.87%], test : [loss = 1.207, top1 = 67.29%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.208, top1 = 43.07%], valid : [loss = 2.428, top1 = 39.02%], test : [loss = 2.449, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.73%], valid : [loss = 0.631, top1 = 78.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7552/15625) 007552-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.077, top1 = 98.08%], valid : [loss = 0.465, top1 = 86.50%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.93 ms.
cifar10        train : [loss = 0.120, top1 = 96.22%], test  : [loss = 0.338, top1 = 89.31%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.56 ms.
cifar100       train : [loss = 0.728, top1 = 79.61%], valid : [loss = 1.258, top1 = 65.15%], test : [loss = 1.253, top1 = 65.51%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.96%], valid : [loss = 2.602, top1 = 35.00%], test : [loss = 2.613, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.52%], valid : [loss = 0.824, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7553/15625) 007553-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.35%], valid : [loss = 0.891, top1 = 69.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10        train : [loss = 0.742, top1 = 73.87%], test  : [loss = 0.789, top1 = 72.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.37 ms.
cifar100       train : [loss = 2.297, top1 = 39.96%], valid : [loss = 2.400, top1 = 38.38%], test : [loss = 2.397, top1 = 38.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 3.527, top1 = 17.56%], valid : [loss = 3.517, top1 = 18.68%], test : [loss = 3.542, top1 = 16.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 46.70%], valid : [loss = 1.515, top1 = 45.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7554/15625) 007554-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.77%], valid : [loss = 0.504, top1 = 88.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.024, top1 = 99.37%], test  : [loss = 0.333, top1 = 91.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.58 ms.
cifar100       train : [loss = 0.397, top1 = 88.91%], valid : [loss = 1.256, top1 = 66.93%], test : [loss = 1.271, top1 = 67.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.12%], valid : [loss = 2.329, top1 = 40.91%], test : [loss = 2.338, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.61%], valid : [loss = 0.699, top1 = 75.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7555/15625) 007555-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.536, top1 = 89.34%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.322, top1 = 93.15%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.52 ms.
cifar100       train : [loss = 0.064, top1 = 99.02%], valid : [loss = 1.378, top1 = 69.16%], test : [loss = 1.378, top1 = 69.87%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.25%], valid : [loss = 2.387, top1 = 39.19%], test : [loss = 2.379, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 65.94%], valid : [loss = 0.989, top1 = 64.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7556/15625) 007556-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.408, top1 = 91.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.73 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.267, top1 = 93.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.37 ms.
cifar100       train : [loss = 0.071, top1 = 98.93%], valid : [loss = 1.283, top1 = 71.23%], test : [loss = 1.279, top1 = 71.53%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 1.522, top1 = 58.85%], valid : [loss = 2.205, top1 = 44.62%], test : [loss = 2.223, top1 = 44.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.42%], valid : [loss = 0.482, top1 = 83.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7557/15625) 007557-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.504, top1 = 89.94%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.95 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.311, top1 = 93.40%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.32 ms.
cifar100       train : [loss = 0.042, top1 = 99.48%], valid : [loss = 1.382, top1 = 70.00%], test : [loss = 1.367, top1 = 70.67%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.51 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.30%], valid : [loss = 2.310, top1 = 42.04%], test : [loss = 2.274, top1 = 43.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.91%], valid : [loss = 0.727, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7558/15625) 007558-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.40%], valid : [loss = 0.549, top1 = 83.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.11 ms.
cifar10        train : [loss = 0.199, top1 = 93.26%], test  : [loss = 0.396, top1 = 87.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.68 ms.
cifar100       train : [loss = 1.260, top1 = 64.32%], valid : [loss = 1.542, top1 = 57.85%], test : [loss = 1.545, top1 = 57.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.24 ms.
ImageNet16-120 train : [loss = 2.711, top1 = 32.38%], valid : [loss = 2.745, top1 = 31.84%], test : [loss = 2.778, top1 = 31.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.66%], valid : [loss = 0.990, top1 = 65.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7559/15625) 007559-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.66%], valid : [loss = 0.507, top1 = 84.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.203, top1 = 93.09%], test  : [loss = 0.381, top1 = 87.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.51 ms.
cifar100       train : [loss = 1.265, top1 = 64.27%], valid : [loss = 1.549, top1 = 58.11%], test : [loss = 1.531, top1 = 57.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.721, top1 = 32.25%], valid : [loss = 2.765, top1 = 31.80%], test : [loss = 2.798, top1 = 31.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.898, top1 = 67.70%], valid : [loss = 0.961, top1 = 65.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7560/15625) 007560-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.498, top1 = 90.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.97 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.323, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.90 ms.
cifar100       train : [loss = 0.114, top1 = 97.77%], valid : [loss = 1.286, top1 = 70.03%], test : [loss = 1.314, top1 = 69.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.713, top1 = 54.17%], valid : [loss = 2.184, top1 = 44.28%], test : [loss = 2.181, top1 = 44.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.00%], valid : [loss = 0.656, top1 = 77.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7561/15625) 007561-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.575, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.372, top1 = 91.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.397, top1 = 88.81%], valid : [loss = 1.398, top1 = 65.25%], test : [loss = 1.383, top1 = 65.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.00%], valid : [loss = 2.498, top1 = 36.93%], test : [loss = 2.534, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7562/15625) 007562-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.71 ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.54%], valid : [loss = 0.769, top1 = 73.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10        train : [loss = 0.540, top1 = 81.25%], test  : [loss = 0.599, top1 = 79.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.24 ms.
cifar100       train : [loss = 2.089, top1 = 44.09%], valid : [loss = 2.184, top1 = 42.01%], test : [loss = 2.188, top1 = 41.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 3.211, top1 = 22.70%], valid : [loss = 3.188, top1 = 23.24%], test : [loss = 3.221, top1 = 22.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.58%], valid : [loss = 1.209, top1 = 56.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7563/15625) 007563-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.558, top1 = 88.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.10 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.353, top1 = 92.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.77 ms.
cifar100       train : [loss = 0.171, top1 = 95.82%], valid : [loss = 1.383, top1 = 67.83%], test : [loss = 1.379, top1 = 67.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.86%], valid : [loss = 2.405, top1 = 39.34%], test : [loss = 2.430, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.54%], valid : [loss = 0.885, top1 = 68.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7564/15625) 007564-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.340, top1 = 88.15%], valid : [loss = 0.573, top1 = 81.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.296, top1 = 89.76%], test  : [loss = 0.439, top1 = 85.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 1.580, top1 = 56.07%], valid : [loss = 1.800, top1 = 51.33%], test : [loss = 1.790, top1 = 51.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.943, top1 = 27.68%], valid : [loss = 2.973, top1 = 27.18%], test : [loss = 3.008, top1 = 27.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.54%], valid : [loss = 1.026, top1 = 63.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7565/15625) 007565-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.487, top1 = 90.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.329, top1 = 93.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.95 ms.
cifar100       train : [loss = 0.105, top1 = 97.99%], valid : [loss = 1.298, top1 = 69.93%], test : [loss = 1.298, top1 = 70.11%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 1.693, top1 = 54.61%], valid : [loss = 2.180, top1 = 44.90%], test : [loss = 2.198, top1 = 43.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.05%], valid : [loss = 0.571, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7566/15625) 007566-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.50%], valid : [loss = 0.575, top1 = 87.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.034, top1 = 98.97%], test  : [loss = 0.369, top1 = 90.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.553, top1 = 83.97%], valid : [loss = 1.371, top1 = 64.15%], test : [loss = 1.368, top1 = 64.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.591, top1 = 34.21%], valid : [loss = 2.667, top1 = 32.53%], test : [loss = 2.692, top1 = 32.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7567/15625) 007567-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.487, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.65 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.322, top1 = 92.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.89 ms.
cifar100       train : [loss = 0.241, top1 = 94.04%], valid : [loss = 1.236, top1 = 68.83%], test : [loss = 1.268, top1 = 68.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.40%], valid : [loss = 2.268, top1 = 41.68%], test : [loss = 2.269, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7568/15625) 007568-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.17%], valid : [loss = 0.956, top1 = 79.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10        train : [loss = 0.070, top1 = 97.79%], test  : [loss = 0.605, top1 = 84.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.79 ms.
cifar100       train : [loss = 0.506, top1 = 85.73%], valid : [loss = 1.865, top1 = 56.65%], test : [loss = 1.867, top1 = 57.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.822, top1 = 30.63%], valid : [loss = 3.134, top1 = 25.50%], test : [loss = 3.155, top1 = 25.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.25%], valid : [loss = 1.024, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7569/15625) 007569-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.510, top1 = 88.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.329, top1 = 91.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.14 ms.
cifar100       train : [loss = 0.343, top1 = 90.62%], valid : [loss = 1.286, top1 = 66.64%], test : [loss = 1.281, top1 = 67.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.72%], valid : [loss = 2.414, top1 = 39.12%], test : [loss = 2.411, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7570/15625) 007570-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 91.21%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.61 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.280, top1 = 93.83%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.38 ms.
cifar100       train : [loss = 0.021, top1 = 99.85%], valid : [loss = 1.347, top1 = 71.60%], test : [loss = 1.338, top1 = 71.88%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 1.208, top1 = 66.67%], valid : [loss = 2.259, top1 = 45.75%], test : [loss = 2.307, top1 = 44.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.331, top1 = 88.79%], valid : [loss = 0.481, top1 = 84.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7571/15625) 007571-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.72%], valid : [loss = 0.627, top1 = 84.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10        train : [loss = 0.086, top1 = 97.26%], test  : [loss = 0.401, top1 = 88.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 0.782, top1 = 77.08%], valid : [loss = 1.423, top1 = 61.88%], test : [loss = 1.411, top1 = 62.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.02%], valid : [loss = 2.746, top1 = 32.18%], test : [loss = 2.764, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7572/15625) 007572-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.490, top1 = 82.74%], valid : [loss = 0.717, top1 = 76.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10        train : [loss = 0.406, top1 = 85.86%], test  : [loss = 0.527, top1 = 82.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.06 ms.
cifar100       train : [loss = 1.692, top1 = 53.44%], valid : [loss = 1.922, top1 = 49.61%], test : [loss = 1.909, top1 = 49.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 20.84%], valid : [loss = 3.329, top1 = 21.13%], test : [loss = 3.365, top1 = 20.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.167, top1 = 57.70%], valid : [loss = 1.219, top1 = 56.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7573/15625) 007573-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.602, top1 = 87.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.394, top1 = 90.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.56 ms.
cifar100       train : [loss = 0.404, top1 = 88.37%], valid : [loss = 1.385, top1 = 65.42%], test : [loss = 1.409, top1 = 65.13%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.13%], valid : [loss = 2.492, top1 = 36.42%], test : [loss = 2.518, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.82%], valid : [loss = 0.828, top1 = 70.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7574/15625) 007574-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.585, top1 = 88.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.381, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.60 ms.
cifar100       train : [loss = 0.170, top1 = 96.31%], valid : [loss = 1.402, top1 = 67.01%], test : [loss = 1.452, top1 = 66.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 48.14%], valid : [loss = 2.480, top1 = 38.42%], test : [loss = 2.475, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7575/15625) 007575-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.475, top1 = 89.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.63 ms.
cifar100       train : [loss = 0.321, top1 = 91.36%], valid : [loss = 1.253, top1 = 67.62%], test : [loss = 1.275, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.60%], valid : [loss = 2.311, top1 = 40.44%], test : [loss = 2.332, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7576/15625) 007576-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.92%], valid : [loss = 0.619, top1 = 84.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10        train : [loss = 0.084, top1 = 97.24%], test  : [loss = 0.425, top1 = 88.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.17 ms.
cifar100       train : [loss = 0.684, top1 = 79.76%], valid : [loss = 1.524, top1 = 59.86%], test : [loss = 1.517, top1 = 60.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 3.202, top1 = 21.95%], valid : [loss = 3.204, top1 = 21.37%], test : [loss = 3.253, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.061, top1 = 61.75%], valid : [loss = 1.088, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7577/15625) 007577-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.571, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.375, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.398, top1 = 88.82%], valid : [loss = 1.389, top1 = 65.41%], test : [loss = 1.397, top1 = 65.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.94%], valid : [loss = 2.505, top1 = 37.02%], test : [loss = 2.532, top1 = 36.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7578/15625) 007578-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.18%], valid : [loss = 0.567, top1 = 86.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.94 ms.
cifar10        train : [loss = 0.056, top1 = 98.22%], test  : [loss = 0.369, top1 = 90.13%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.85 ms.
cifar100       train : [loss = 0.565, top1 = 83.56%], valid : [loss = 1.333, top1 = 64.77%], test : [loss = 1.291, top1 = 65.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.09%], valid : [loss = 2.423, top1 = 38.12%], test : [loss = 2.435, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.92%], valid : [loss = 0.735, top1 = 74.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7579/15625) 007579-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.77%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.19 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.288, top1 = 92.73%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.62 ms.
cifar100       train : [loss = 0.195, top1 = 95.45%], valid : [loss = 1.254, top1 = 69.45%], test : [loss = 1.231, top1 = 69.84%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.55%], valid : [loss = 2.242, top1 = 42.62%], test : [loss = 2.267, top1 = 42.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.41%], valid : [loss = 0.523, top1 = 82.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7580/15625) 007580-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.475, top1 = 89.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.315, top1 = 92.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.267, top1 = 93.17%], valid : [loss = 1.200, top1 = 69.37%], test : [loss = 1.198, top1 = 68.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.13%], valid : [loss = 2.210, top1 = 42.15%], test : [loss = 2.227, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.14%], valid : [loss = 0.634, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7581/15625) 007581-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 1.669, top1 = 37.28%], valid : [loss = 1.676, top1 = 37.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.97 ms.
cifar10        train : [loss = 1.398, top1 = 49.03%], test  : [loss = 1.400, top1 = 49.02%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.21 ms.
cifar100       train : [loss = 3.869, top1 = 10.55%], valid : [loss = 3.924, top1 = 9.99%], test : [loss = 3.918, top1 = 10.20%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 4.071, top1 = 9.25%], valid : [loss = 4.066, top1 = 9.38%], test : [loss = 4.077, top1 = 9.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.985, top1 = 26.02%], valid : [loss = 1.988, top1 = 26.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7582/15625) 007582-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.73 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.50%], valid : [loss = 0.854, top1 = 71.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.544, top1 = 80.93%], test  : [loss = 0.707, top1 = 76.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.68 ms.
cifar100       train : [loss = 1.775, top1 = 52.17%], valid : [loss = 2.077, top1 = 46.51%], test : [loss = 2.068, top1 = 46.64%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 16.97%], valid : [loss = 3.632, top1 = 17.10%], test : [loss = 3.659, top1 = 15.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7583/15625) 007583-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.13%], valid : [loss = 0.475, top1 = 84.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.296, top1 = 90.14%], test  : [loss = 0.404, top1 = 86.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 1.337, top1 = 63.15%], valid : [loss = 1.542, top1 = 57.99%], test : [loss = 1.514, top1 = 58.31%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.60%], valid : [loss = 2.905, top1 = 29.23%], test : [loss = 2.947, top1 = 28.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7584/15625) 007584-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.59%], valid : [loss = 0.851, top1 = 71.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10        train : [loss = 0.556, top1 = 80.61%], test  : [loss = 0.709, top1 = 75.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.94 ms.
cifar100       train : [loss = 1.779, top1 = 52.09%], valid : [loss = 2.054, top1 = 46.52%], test : [loss = 2.062, top1 = 46.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.86%], valid : [loss = 3.644, top1 = 16.67%], test : [loss = 3.669, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7585/15625) 007585-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.62%], valid : [loss = 0.458, top1 = 86.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.154, top1 = 95.03%], test  : [loss = 0.345, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.21 ms.
cifar100       train : [loss = 0.969, top1 = 72.47%], valid : [loss = 1.352, top1 = 62.15%], test : [loss = 1.348, top1 = 62.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.73%], valid : [loss = 2.696, top1 = 32.35%], test : [loss = 2.721, top1 = 32.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7586/15625) 007586-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.15%], valid : [loss = 0.637, top1 = 83.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.148, top1 = 94.99%], test  : [loss = 0.465, top1 = 86.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.02 ms.
cifar100       train : [loss = 0.954, top1 = 72.26%], valid : [loss = 1.625, top1 = 57.12%], test : [loss = 1.633, top1 = 57.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 3.111, top1 = 24.20%], valid : [loss = 3.162, top1 = 24.05%], test : [loss = 3.206, top1 = 22.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.009, top1 = 63.72%], valid : [loss = 1.051, top1 = 62.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7587/15625) 007587-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.537, top1 = 88.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.384, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.395, top1 = 88.82%], valid : [loss = 1.395, top1 = 65.43%], test : [loss = 1.387, top1 = 65.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.94%], valid : [loss = 2.460, top1 = 38.37%], test : [loss = 2.519, top1 = 37.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.42%], valid : [loss = 0.765, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7588/15625) 007588-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.28%], valid : [loss = 0.452, top1 = 86.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.111, top1 = 96.59%], test  : [loss = 0.323, top1 = 89.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 0.852, top1 = 75.82%], valid : [loss = 1.294, top1 = 64.28%], test : [loss = 1.269, top1 = 64.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.60 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.66%], valid : [loss = 2.610, top1 = 34.20%], test : [loss = 2.660, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7589/15625) 007589-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.567, top1 = 88.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.13 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.376, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.109, top1 = 98.00%], valid : [loss = 1.488, top1 = 66.90%], test : [loss = 1.493, top1 = 67.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 50.00%], valid : [loss = 2.402, top1 = 39.45%], test : [loss = 2.428, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.22%], valid : [loss = 0.735, top1 = 74.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7590/15625) 007590-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.494, top1 = 88.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.325, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.330, top1 = 91.12%], valid : [loss = 1.280, top1 = 67.04%], test : [loss = 1.274, top1 = 67.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.16%], valid : [loss = 2.382, top1 = 39.02%], test : [loss = 2.390, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.42%], valid : [loss = 0.750, top1 = 73.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7591/15625) 007591-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.472, top1 = 89.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.316, top1 = 91.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.77 ms.
cifar100       train : [loss = 0.245, top1 = 93.90%], valid : [loss = 1.252, top1 = 68.62%], test : [loss = 1.241, top1 = 68.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.34%], valid : [loss = 2.261, top1 = 41.93%], test : [loss = 2.287, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.84%], valid : [loss = 0.616, top1 = 78.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7592/15625) 007592-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.549, top1 = 88.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.353, top1 = 91.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.66 ms.
cifar100       train : [loss = 0.294, top1 = 91.80%], valid : [loss = 1.318, top1 = 67.59%], test : [loss = 1.331, top1 = 66.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.70%], valid : [loss = 2.441, top1 = 38.30%], test : [loss = 2.443, top1 = 38.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7593/15625) 007593-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.515, top1 = 88.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.369, top1 = 91.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.265, top1 = 92.92%], valid : [loss = 1.386, top1 = 66.38%], test : [loss = 1.377, top1 = 66.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.090, top1 = 45.60%], valid : [loss = 2.429, top1 = 38.45%], test : [loss = 2.455, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.12%], valid : [loss = 0.584, top1 = 80.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7594/15625) 007594-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.10%], valid : [loss = 0.475, top1 = 84.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10        train : [loss = 0.301, top1 = 90.03%], test  : [loss = 0.402, top1 = 86.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.41 ms.
cifar100       train : [loss = 1.332, top1 = 63.12%], valid : [loss = 1.536, top1 = 57.97%], test : [loss = 1.515, top1 = 58.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.67 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.65%], valid : [loss = 2.897, top1 = 30.32%], test : [loss = 2.955, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7595/15625) 007595-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 0.325, top1 = 91.12%], valid : [loss = 1.309, top1 = 67.17%], test : [loss = 1.295, top1 = 67.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.30%], valid : [loss = 2.369, top1 = 39.92%], test : [loss = 2.390, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.83%], valid : [loss = 0.564, top1 = 81.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7596/15625) 007596-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.75 ms.
cifar10-valid  train : [loss = 0.292, top1 = 90.04%], valid : [loss = 0.514, top1 = 83.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.293, top1 = 90.07%], test  : [loss = 0.414, top1 = 86.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.76 ms.
cifar100       train : [loss = 1.306, top1 = 63.22%], valid : [loss = 1.523, top1 = 58.23%], test : [loss = 1.523, top1 = 58.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.874, top1 = 29.34%], valid : [loss = 2.873, top1 = 29.80%], test : [loss = 2.912, top1 = 28.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 66.31%], valid : [loss = 0.963, top1 = 65.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7597/15625) 007597-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.504, top1 = 89.18%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.70 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.324, top1 = 92.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.68 ms.
cifar100       train : [loss = 0.193, top1 = 95.41%], valid : [loss = 1.259, top1 = 68.49%], test : [loss = 1.278, top1 = 68.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.61%], valid : [loss = 2.230, top1 = 42.62%], test : [loss = 2.253, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.84%], valid : [loss = 0.647, top1 = 78.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7598/15625) 007598-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.220, top1 = 92.53%], valid : [loss = 0.926, top1 = 75.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.278, top1 = 90.42%], test  : [loss = 0.649, top1 = 80.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.28 ms.
cifar100       train : [loss = 1.276, top1 = 64.17%], valid : [loss = 1.877, top1 = 51.69%], test : [loss = 1.865, top1 = 51.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 20.88%], valid : [loss = 3.442, top1 = 20.13%], test : [loss = 3.466, top1 = 18.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.100, top1 = 60.63%], valid : [loss = 1.152, top1 = 59.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7599/15625) 007599-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.23%], valid : [loss = 0.461, top1 = 86.68%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.75 ms.
cifar10        train : [loss = 0.105, top1 = 96.82%], test  : [loss = 0.326, top1 = 89.58%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.14 ms.
cifar100       train : [loss = 0.695, top1 = 80.66%], valid : [loss = 1.259, top1 = 65.44%], test : [loss = 1.278, top1 = 64.88%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 2.447, top1 = 37.83%], valid : [loss = 2.550, top1 = 36.28%], test : [loss = 2.576, top1 = 34.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.21%], valid : [loss = 0.824, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7600/15625) 007600-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.422, top1 = 90.54%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.38 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.280, top1 = 93.32%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.23 ms.
cifar100       train : [loss = 0.152, top1 = 96.66%], valid : [loss = 1.281, top1 = 69.67%], test : [loss = 1.272, top1 = 69.96%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.31 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.15%], valid : [loss = 2.215, top1 = 43.60%], test : [loss = 2.254, top1 = 43.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.54%], valid : [loss = 0.504, top1 = 83.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7601/15625) 007601-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.37%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.56 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.310, top1 = 92.84%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.56 ms.
cifar100       train : [loss = 0.151, top1 = 96.87%], valid : [loss = 1.283, top1 = 68.78%], test : [loss = 1.273, top1 = 69.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.62%], valid : [loss = 2.307, top1 = 42.07%], test : [loss = 2.291, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.07%], valid : [loss = 0.743, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7602/15625) 007602-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.418, top1 = 91.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.275, top1 = 94.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.58 ms.
cifar100       train : [loss = 0.047, top1 = 99.45%], valid : [loss = 1.355, top1 = 70.50%], test : [loss = 1.275, top1 = 71.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.425, top1 = 61.17%], valid : [loss = 2.202, top1 = 45.35%], test : [loss = 2.213, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.26%], valid : [loss = 0.503, top1 = 82.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7603/15625) 007603-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.541, top1 = 89.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.356, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.56 ms.
cifar100       train : [loss = 0.048, top1 = 99.51%], valid : [loss = 1.437, top1 = 69.40%], test : [loss = 1.413, top1 = 69.43%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.49 ms.
ImageNet16-120 train : [loss = 1.655, top1 = 55.57%], valid : [loss = 2.396, top1 = 41.02%], test : [loss = 2.413, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.77%], valid : [loss = 0.689, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7604/15625) 007604-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.00 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.619, top1 = 85.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.53 ms.
cifar10        train : [loss = 0.075, top1 = 97.72%], test  : [loss = 0.394, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 0.702, top1 = 79.62%], valid : [loss = 1.366, top1 = 63.91%], test : [loss = 1.354, top1 = 63.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.85%], valid : [loss = 2.663, top1 = 33.78%], test : [loss = 2.700, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.26%], valid : [loss = 0.776, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7605/15625) 007605-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.18%], valid : [loss = 0.555, top1 = 86.83%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10        train : [loss = 0.064, top1 = 97.95%], test  : [loss = 0.370, top1 = 89.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.87 ms.
cifar100       train : [loss = 0.661, top1 = 80.44%], valid : [loss = 1.305, top1 = 65.13%], test : [loss = 1.305, top1 = 64.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.00%], valid : [loss = 2.509, top1 = 36.68%], test : [loss = 2.559, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7606/15625) 007606-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.62 ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.85%], valid : [loss = 0.980, top1 = 65.95%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10        train : [loss = 0.889, top1 = 69.18%], test  : [loss = 0.886, top1 = 68.95%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.00 ms.
cifar100       train : [loss = 2.375, top1 = 39.27%], valid : [loss = 2.445, top1 = 37.67%], test : [loss = 2.428, top1 = 38.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.17 ms.
ImageNet16-120 train : [loss = 3.631, top1 = 16.00%], valid : [loss = 3.590, top1 = 17.07%], test : [loss = 3.632, top1 = 16.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.607, top1 = 39.57%], valid : [loss = 1.631, top1 = 38.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7607/15625) 007607-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.341, top1 = 88.16%], valid : [loss = 0.604, top1 = 80.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.283, top1 = 90.30%], test  : [loss = 0.430, top1 = 86.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.69 ms.
cifar100       train : [loss = 1.539, top1 = 57.00%], valid : [loss = 1.769, top1 = 52.31%], test : [loss = 1.766, top1 = 51.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.956, top1 = 27.56%], valid : [loss = 2.981, top1 = 27.03%], test : [loss = 3.015, top1 = 26.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.49%], valid : [loss = 1.027, top1 = 63.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7608/15625) 007608-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.575, top1 = 88.42%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.368, top1 = 92.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.93 ms.
cifar100       train : [loss = 0.135, top1 = 97.16%], valid : [loss = 1.407, top1 = 67.22%], test : [loss = 1.421, top1 = 67.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.95 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.32%], valid : [loss = 2.449, top1 = 36.92%], test : [loss = 2.453, top1 = 37.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.23%], valid : [loss = 1.049, top1 = 62.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7609/15625) 007609-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.505, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.330, top1 = 92.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.02 ms.
cifar100       train : [loss = 0.332, top1 = 91.01%], valid : [loss = 1.276, top1 = 67.07%], test : [loss = 1.288, top1 = 67.03%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.09%], valid : [loss = 2.393, top1 = 39.30%], test : [loss = 2.415, top1 = 39.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7610/15625) 007610-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.490, top1 = 89.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.325, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.316, top1 = 91.50%], valid : [loss = 1.257, top1 = 67.94%], test : [loss = 1.273, top1 = 67.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.75%], valid : [loss = 2.332, top1 = 39.92%], test : [loss = 2.327, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7611/15625) 007611-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.536, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.339, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.158, top1 = 96.45%], valid : [loss = 1.338, top1 = 68.42%], test : [loss = 1.323, top1 = 68.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.53%], valid : [loss = 2.302, top1 = 40.83%], test : [loss = 2.320, top1 = 41.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.68%], valid : [loss = 0.735, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7612/15625) 007612-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.60 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.90%], valid : [loss = 0.517, top1 = 87.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10        train : [loss = 0.074, top1 = 97.64%], test  : [loss = 0.367, top1 = 89.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 0.715, top1 = 78.99%], valid : [loss = 1.352, top1 = 63.68%], test : [loss = 1.308, top1 = 64.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.07%], valid : [loss = 2.631, top1 = 34.03%], test : [loss = 2.697, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7613/15625) 007613-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.485, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.311, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.10 ms.
cifar100       train : [loss = 0.270, top1 = 93.11%], valid : [loss = 1.216, top1 = 69.11%], test : [loss = 1.222, top1 = 68.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.93%], valid : [loss = 2.228, top1 = 42.17%], test : [loss = 2.244, top1 = 42.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7614/15625) 007614-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.528, top1 = 88.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.341, top1 = 91.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.35 ms.
cifar100       train : [loss = 0.348, top1 = 90.53%], valid : [loss = 1.283, top1 = 66.95%], test : [loss = 1.306, top1 = 66.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.68%], valid : [loss = 2.404, top1 = 38.51%], test : [loss = 2.414, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7615/15625) 007615-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.498, top1 = 89.93%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.29 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.317, top1 = 93.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.42 ms.
cifar100       train : [loss = 0.131, top1 = 97.29%], valid : [loss = 1.298, top1 = 69.26%], test : [loss = 1.326, top1 = 69.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 50.93%], valid : [loss = 2.216, top1 = 42.63%], test : [loss = 2.218, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.73%], valid : [loss = 0.700, top1 = 75.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7616/15625) 007616-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.10%], valid : [loss = 0.682, top1 = 77.01%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.22 ms.
cifar10        train : [loss = 0.542, top1 = 81.04%], test  : [loss = 0.604, top1 = 79.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.19 ms.
cifar100       train : [loss = 1.736, top1 = 52.93%], valid : [loss = 1.899, top1 = 49.88%], test : [loss = 1.919, top1 = 49.34%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.50 ms.
ImageNet16-120 train : [loss = 3.393, top1 = 20.05%], valid : [loss = 3.379, top1 = 20.70%], test : [loss = 3.412, top1 = 19.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7617/15625) 007617-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.19%], valid : [loss = 0.449, top1 = 87.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.112, top1 = 96.50%], test  : [loss = 0.328, top1 = 89.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.22 ms.
cifar100       train : [loss = 0.869, top1 = 75.31%], valid : [loss = 1.297, top1 = 64.08%], test : [loss = 1.289, top1 = 63.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.66%], valid : [loss = 2.619, top1 = 34.86%], test : [loss = 2.652, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7618/15625) 007618-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.522, top1 = 89.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.331, top1 = 93.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.91 ms.
cifar100       train : [loss = 0.088, top1 = 98.23%], valid : [loss = 1.363, top1 = 69.42%], test : [loss = 1.372, top1 = 69.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 1.650, top1 = 55.60%], valid : [loss = 2.221, top1 = 43.18%], test : [loss = 2.242, top1 = 43.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.28%], valid : [loss = 0.642, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7619/15625) 007619-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.26 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.66%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.309, top1 = 93.54%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.12 ms.
cifar100       train : [loss = 0.047, top1 = 99.40%], valid : [loss = 1.357, top1 = 69.99%], test : [loss = 1.331, top1 = 70.98%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.90 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.53%], valid : [loss = 2.277, top1 = 42.10%], test : [loss = 2.291, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.90%], valid : [loss = 0.648, top1 = 77.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7620/15625) 007620-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.548, top1 = 88.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.358, top1 = 91.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.282, top1 = 92.47%], valid : [loss = 1.307, top1 = 67.10%], test : [loss = 1.322, top1 = 67.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.56%], valid : [loss = 2.407, top1 = 38.80%], test : [loss = 2.410, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.99%], valid : [loss = 0.873, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7621/15625) 007621-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.505, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.344, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.198, top1 = 95.23%], valid : [loss = 1.367, top1 = 67.76%], test : [loss = 1.335, top1 = 68.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 1.978, top1 = 48.18%], valid : [loss = 2.386, top1 = 40.68%], test : [loss = 2.401, top1 = 38.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 81.99%], valid : [loss = 0.604, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7622/15625) 007622-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.27%], valid : [loss = 0.467, top1 = 84.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.13 ms.
cifar10        train : [loss = 0.298, top1 = 90.05%], test  : [loss = 0.397, top1 = 86.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.74 ms.
cifar100       train : [loss = 1.337, top1 = 62.98%], valid : [loss = 1.532, top1 = 57.80%], test : [loss = 1.510, top1 = 59.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.66%], valid : [loss = 2.907, top1 = 30.17%], test : [loss = 2.976, top1 = 27.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7623/15625) 007623-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.456, top1 = 89.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.44 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.313, top1 = 92.30%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.43 ms.
cifar100       train : [loss = 0.245, top1 = 93.86%], valid : [loss = 1.251, top1 = 68.40%], test : [loss = 1.257, top1 = 68.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.948, top1 = 48.71%], valid : [loss = 2.271, top1 = 41.77%], test : [loss = 2.284, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.16%], valid : [loss = 0.635, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7624/15625) 007624-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.33%], valid : [loss = 0.524, top1 = 83.06%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.10 ms.
cifar10        train : [loss = 0.213, top1 = 92.94%], test  : [loss = 0.408, top1 = 86.77%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.76 ms.
cifar100       train : [loss = 1.317, top1 = 63.17%], valid : [loss = 1.616, top1 = 55.98%], test : [loss = 1.606, top1 = 55.54%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=23.52 ms.
ImageNet16-120 train : [loss = 3.550, top1 = 16.81%], valid : [loss = 3.537, top1 = 16.77%], test : [loss = 3.551, top1 = 16.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 57.10%], valid : [loss = 1.184, top1 = 56.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7625/15625) 007625-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.452, top1 = 89.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.310, top1 = 92.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.36 ms.
cifar100       train : [loss = 0.322, top1 = 91.30%], valid : [loss = 1.308, top1 = 67.52%], test : [loss = 1.290, top1 = 67.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.32%], valid : [loss = 2.366, top1 = 39.28%], test : [loss = 2.402, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.34%], valid : [loss = 0.572, top1 = 80.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7626/15625) 007626-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.63 ms.
cifar10-valid  train : [loss = 1.815, top1 = 34.21%], valid : [loss = 1.834, top1 = 33.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.58 ms.
cifar10        train : [loss = 1.190, top1 = 57.33%], test  : [loss = 1.193, top1 = 56.77%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.69 ms.
cifar100       train : [loss = 3.772, top1 = 12.42%], valid : [loss = 3.856, top1 = 10.70%], test : [loss = 3.849, top1 = 11.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.35 ms.
ImageNet16-120 train : [loss = 3.766, top1 = 13.77%], valid : [loss = 3.727, top1 = 14.84%], test : [loss = 3.745, top1 = 14.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7627/15625) 007627-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.48%], valid : [loss = 0.445, top1 = 87.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10        train : [loss = 0.055, top1 = 98.66%], test  : [loss = 0.321, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.11 ms.
cifar100       train : [loss = 0.582, top1 = 84.06%], valid : [loss = 1.222, top1 = 66.56%], test : [loss = 1.208, top1 = 66.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.88%], valid : [loss = 2.482, top1 = 37.77%], test : [loss = 2.501, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7628/15625) 007628-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.94%], valid : [loss = 0.518, top1 = 82.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.405, top1 = 86.16%], test  : [loss = 0.471, top1 = 83.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 1.544, top1 = 57.59%], valid : [loss = 1.669, top1 = 53.90%], test : [loss = 1.659, top1 = 54.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.27%], valid : [loss = 3.016, top1 = 26.88%], test : [loss = 3.047, top1 = 26.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.140, top1 = 59.49%], valid : [loss = 1.160, top1 = 58.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7629/15625) 007629-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.37%], valid : [loss = 0.664, top1 = 84.96%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=15.09 ms.
cifar10        train : [loss = 0.044, top1 = 98.69%], test  : [loss = 0.411, top1 = 89.57%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=14.55 ms.
cifar100       train : [loss = 0.600, top1 = 82.37%], valid : [loss = 1.456, top1 = 63.33%], test : [loss = 1.446, top1 = 62.45%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.440, top1 = 37.84%], valid : [loss = 2.625, top1 = 34.01%], test : [loss = 2.638, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.14%], valid : [loss = 0.889, top1 = 68.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7630/15625) 007630-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.80%], valid : [loss = 0.538, top1 = 83.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.163, top1 = 94.53%], test  : [loss = 0.375, top1 = 88.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.17 ms.
cifar100       train : [loss = 1.190, top1 = 66.20%], valid : [loss = 1.530, top1 = 58.52%], test : [loss = 1.507, top1 = 58.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.28%], valid : [loss = 2.682, top1 = 33.57%], test : [loss = 2.733, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.49%], valid : [loss = 0.981, top1 = 65.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7631/15625) 007631-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.438, top1 = 89.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.306, top1 = 92.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.236, top1 = 94.32%], valid : [loss = 1.267, top1 = 68.06%], test : [loss = 1.295, top1 = 68.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.09%], valid : [loss = 2.300, top1 = 41.40%], test : [loss = 2.324, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 85.06%], valid : [loss = 0.541, top1 = 81.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7632/15625) 007632-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=24.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.96%]
cifar10        FLOP=188.66 M, Params=1.317 MB, latency=22.25 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.294, top1 = 93.69%]
cifar100       FLOP=188.67 M, Params=1.322 MB, latency=22.62 ms.
cifar100       train : [loss = 0.031, top1 = 99.72%], valid : [loss = 1.369, top1 = 70.76%], test : [loss = 1.360, top1 = 70.36%]
ImageNet16-120 FLOP= 47.17 M, Params=1.324 MB, latency=20.57 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.14%], valid : [loss = 2.268, top1 = 42.83%], test : [loss = 2.283, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.52%], valid : [loss = 0.818, top1 = 71.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7633/15625) 007633-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.508, top1 = 89.47%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.307, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.29 ms.
cifar100       train : [loss = 0.158, top1 = 96.54%], valid : [loss = 1.308, top1 = 68.62%], test : [loss = 1.296, top1 = 68.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.72%], valid : [loss = 2.294, top1 = 41.73%], test : [loss = 2.250, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.66%], valid : [loss = 0.634, top1 = 78.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7634/15625) 007634-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.65%], valid : [loss = 0.592, top1 = 80.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10        train : [loss = 0.264, top1 = 91.06%], test  : [loss = 0.414, top1 = 86.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 1.517, top1 = 57.66%], valid : [loss = 1.761, top1 = 52.34%], test : [loss = 1.756, top1 = 53.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.962, top1 = 27.39%], valid : [loss = 2.967, top1 = 28.13%], test : [loss = 3.031, top1 = 26.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7635/15625) 007635-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.525, top1 = 88.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.328, top1 = 92.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.358, top1 = 90.14%], valid : [loss = 1.293, top1 = 66.84%], test : [loss = 1.285, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.00 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.44%], valid : [loss = 2.407, top1 = 38.70%], test : [loss = 2.401, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7636/15625) 007636-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.503, top1 = 88.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.330, top1 = 92.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 0.323, top1 = 91.22%], valid : [loss = 1.261, top1 = 68.18%], test : [loss = 1.285, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.91%], valid : [loss = 2.396, top1 = 39.77%], test : [loss = 2.408, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.68%], valid : [loss = 0.746, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7637/15625) 007637-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.538, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.347, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.73 ms.
cifar100       train : [loss = 0.248, top1 = 93.32%], valid : [loss = 1.349, top1 = 67.36%], test : [loss = 1.344, top1 = 67.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.55%], valid : [loss = 2.469, top1 = 36.43%], test : [loss = 2.408, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.10%], valid : [loss = 0.976, top1 = 64.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7638/15625) 007638-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.35%], valid : [loss = 0.621, top1 = 85.36%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.100, top1 = 96.69%], test  : [loss = 0.398, top1 = 88.63%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 0.788, top1 = 76.67%], valid : [loss = 1.404, top1 = 62.78%], test : [loss = 1.409, top1 = 62.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.66%], valid : [loss = 2.734, top1 = 32.30%], test : [loss = 2.791, top1 = 30.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 76.03%], valid : [loss = 0.769, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7639/15625) 007639-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.93%], valid : [loss = 0.788, top1 = 80.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.112, top1 = 96.23%], test  : [loss = 0.455, top1 = 86.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.89 ms.
cifar100       train : [loss = 0.896, top1 = 73.94%], valid : [loss = 1.672, top1 = 56.84%], test : [loss = 1.624, top1 = 58.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.748, top1 = 31.72%], valid : [loss = 2.879, top1 = 29.00%], test : [loss = 2.931, top1 = 28.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.92%], valid : [loss = 0.942, top1 = 67.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7640/15625) 007640-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.71%], valid : [loss = 0.577, top1 = 85.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.370, top1 = 89.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.08 ms.
cifar100       train : [loss = 0.637, top1 = 81.61%], valid : [loss = 1.369, top1 = 64.17%], test : [loss = 1.370, top1 = 63.97%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.95%], valid : [loss = 2.554, top1 = 35.85%], test : [loss = 2.566, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.50%], valid : [loss = 0.867, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7641/15625) 007641-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.546, top1 = 88.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.93 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.332, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.79 ms.
cifar100       train : [loss = 0.208, top1 = 95.04%], valid : [loss = 1.322, top1 = 67.76%], test : [loss = 1.321, top1 = 68.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.39%], valid : [loss = 2.321, top1 = 41.30%], test : [loss = 2.336, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.86%], valid : [loss = 0.692, top1 = 75.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7642/15625) 007642-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.75%], valid : [loss = 0.590, top1 = 87.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.89 ms.
cifar10        train : [loss = 0.032, top1 = 99.10%], test  : [loss = 0.390, top1 = 90.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.30 ms.
cifar100       train : [loss = 0.525, top1 = 84.74%], valid : [loss = 1.419, top1 = 63.98%], test : [loss = 1.469, top1 = 63.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.11 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.29%], valid : [loss = 2.513, top1 = 36.47%], test : [loss = 2.538, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.08%], valid : [loss = 0.821, top1 = 71.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7643/15625) 007643-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.89 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.62 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.08 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7644/15625) 007644-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.44%], valid : [loss = 0.623, top1 = 79.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.06 ms.
cifar10        train : [loss = 0.314, top1 = 89.28%], test  : [loss = 0.459, top1 = 85.13%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.88 ms.
cifar100       train : [loss = 1.527, top1 = 57.55%], valid : [loss = 1.749, top1 = 52.12%], test : [loss = 1.757, top1 = 51.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 3.053, top1 = 25.78%], valid : [loss = 3.039, top1 = 26.43%], test : [loss = 3.113, top1 = 25.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.99%], valid : [loss = 1.078, top1 = 61.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7645/15625) 007645-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.11%], valid : [loss = 0.454, top1 = 86.26%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.56 ms.
cifar10        train : [loss = 0.167, top1 = 94.63%], test  : [loss = 0.353, top1 = 88.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.41 ms.
cifar100       train : [loss = 1.003, top1 = 71.42%], valid : [loss = 1.374, top1 = 61.70%], test : [loss = 1.353, top1 = 61.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.76%], valid : [loss = 2.681, top1 = 32.53%], test : [loss = 2.707, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.90%], valid : [loss = 0.786, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7646/15625) 007646-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.587, top1 = 87.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.41 ms.
cifar10        train : [loss = 0.022, top1 = 99.41%], test  : [loss = 0.409, top1 = 90.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.72 ms.
cifar100       train : [loss = 0.302, top1 = 91.68%], valid : [loss = 1.454, top1 = 65.12%], test : [loss = 1.492, top1 = 65.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.271, top1 = 41.70%], valid : [loss = 2.552, top1 = 37.27%], test : [loss = 2.658, top1 = 34.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.35%], valid : [loss = 0.669, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7647/15625) 007647-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.614, top1 = 85.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10        train : [loss = 0.070, top1 = 97.91%], test  : [loss = 0.410, top1 = 88.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.57 ms.
cifar100       train : [loss = 0.714, top1 = 79.23%], valid : [loss = 1.378, top1 = 63.49%], test : [loss = 1.383, top1 = 63.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.02%], valid : [loss = 2.646, top1 = 34.41%], test : [loss = 2.686, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7648/15625) 007648-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.13%], valid : [loss = 0.638, top1 = 83.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.71 ms.
cifar10        train : [loss = 0.134, top1 = 95.60%], test  : [loss = 0.401, top1 = 87.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.14 ms.
cifar100       train : [loss = 0.858, top1 = 74.94%], valid : [loss = 1.419, top1 = 61.38%], test : [loss = 1.442, top1 = 60.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.844, top1 = 29.32%], valid : [loss = 2.895, top1 = 27.60%], test : [loss = 2.955, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.076, top1 = 61.43%], valid : [loss = 1.130, top1 = 59.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7649/15625) 007649-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.099, top1 = 96.99%], valid : [loss = 0.527, top1 = 85.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10        train : [loss = 0.117, top1 = 96.16%], test  : [loss = 0.363, top1 = 89.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.897, top1 = 74.01%], valid : [loss = 1.419, top1 = 60.80%], test : [loss = 1.428, top1 = 61.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.744, top1 = 31.66%], valid : [loss = 2.788, top1 = 31.30%], test : [loss = 2.836, top1 = 30.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.10%], valid : [loss = 0.861, top1 = 69.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7650/15625) 007650-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.23%], valid : [loss = 0.674, top1 = 77.26%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.452, top1 = 84.18%], test  : [loss = 0.570, top1 = 80.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.59 ms.
cifar100       train : [loss = 1.717, top1 = 53.13%], valid : [loss = 1.933, top1 = 48.96%], test : [loss = 1.940, top1 = 48.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 3.345, top1 = 20.59%], valid : [loss = 3.361, top1 = 20.50%], test : [loss = 3.374, top1 = 19.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.49%], valid : [loss = 1.252, top1 = 54.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7651/15625) 007651-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.26%], valid : [loss = 0.911, top1 = 68.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.716, top1 = 74.75%], test  : [loss = 0.769, top1 = 73.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.49 ms.
cifar100       train : [loss = 2.320, top1 = 38.97%], valid : [loss = 2.406, top1 = 37.38%], test : [loss = 2.417, top1 = 37.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 3.572, top1 = 16.58%], valid : [loss = 3.548, top1 = 17.13%], test : [loss = 3.555, top1 = 16.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.373, top1 = 49.62%], valid : [loss = 1.413, top1 = 48.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7652/15625) 007652-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.565, top1 = 88.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.49 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.388, top1 = 91.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.33 ms.
cifar100       train : [loss = 0.178, top1 = 96.09%], valid : [loss = 1.454, top1 = 66.34%], test : [loss = 1.443, top1 = 67.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.06%], valid : [loss = 2.448, top1 = 38.96%], test : [loss = 2.458, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.89%], valid : [loss = 0.693, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7653/15625) 007653-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.511, top1 = 88.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.335, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.320, top1 = 91.30%], valid : [loss = 1.259, top1 = 67.12%], test : [loss = 1.295, top1 = 67.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.024, top1 = 47.05%], valid : [loss = 2.327, top1 = 40.37%], test : [loss = 2.343, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.51%], valid : [loss = 0.682, top1 = 76.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7654/15625) 007654-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.52%], valid : [loss = 0.531, top1 = 86.51%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10        train : [loss = 0.085, top1 = 97.16%], test  : [loss = 0.389, top1 = 89.31%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.12 ms.
cifar100       train : [loss = 0.705, top1 = 79.22%], valid : [loss = 1.373, top1 = 63.74%], test : [loss = 1.389, top1 = 62.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.358, top1 = 39.57%], valid : [loss = 2.510, top1 = 36.57%], test : [loss = 2.501, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.02%], valid : [loss = 0.912, top1 = 67.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7655/15625) 007655-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.560, top1 = 88.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.52 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.344, top1 = 92.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.01 ms.
cifar100       train : [loss = 0.140, top1 = 96.79%], valid : [loss = 1.332, top1 = 68.70%], test : [loss = 1.346, top1 = 68.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.07%], valid : [loss = 2.422, top1 = 38.23%], test : [loss = 2.404, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 68.90%], valid : [loss = 0.908, top1 = 67.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7656/15625) 007656-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.291, top1 = 90.08%], valid : [loss = 0.530, top1 = 82.91%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.96 ms.
cifar10        train : [loss = 0.266, top1 = 90.92%], test  : [loss = 0.424, top1 = 86.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.62 ms.
cifar100       train : [loss = 1.393, top1 = 60.76%], valid : [loss = 1.663, top1 = 54.88%], test : [loss = 1.645, top1 = 55.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.51%], valid : [loss = 2.906, top1 = 28.63%], test : [loss = 2.965, top1 = 27.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.008, top1 = 63.76%], valid : [loss = 1.041, top1 = 63.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7657/15625) 007657-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.36%], valid : [loss = 0.526, top1 = 87.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.056, top1 = 98.29%], test  : [loss = 0.340, top1 = 90.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.37 ms.
cifar100       train : [loss = 0.639, top1 = 81.27%], valid : [loss = 1.304, top1 = 65.42%], test : [loss = 1.269, top1 = 66.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.10%], valid : [loss = 2.500, top1 = 36.50%], test : [loss = 2.564, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.94%], valid : [loss = 0.655, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7658/15625) 007658-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.476, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.07 ms.
cifar100       train : [loss = 0.322, top1 = 91.45%], valid : [loss = 1.233, top1 = 68.68%], test : [loss = 1.240, top1 = 68.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 2.026, top1 = 47.05%], valid : [loss = 2.312, top1 = 40.40%], test : [loss = 2.354, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.96%], valid : [loss = 0.599, top1 = 79.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7659/15625) 007659-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.76%], valid : [loss = 0.454, top1 = 86.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.152, top1 = 95.03%], test  : [loss = 0.337, top1 = 89.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.981, top1 = 72.07%], valid : [loss = 1.357, top1 = 62.28%], test : [loss = 1.317, top1 = 63.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.21%], valid : [loss = 2.649, top1 = 34.00%], test : [loss = 2.709, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.42%], valid : [loss = 0.775, top1 = 72.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7660/15625) 007660-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.569, top1 = 88.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.369, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.98 ms.
cifar100       train : [loss = 0.121, top1 = 97.54%], valid : [loss = 1.534, top1 = 67.07%], test : [loss = 1.526, top1 = 66.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 48.07%], valid : [loss = 2.412, top1 = 39.60%], test : [loss = 2.428, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.14%], valid : [loss = 0.730, top1 = 74.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7661/15625) 007661-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.505, top1 = 88.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.332, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.00 ms.
cifar100       train : [loss = 0.331, top1 = 91.07%], valid : [loss = 1.275, top1 = 67.13%], test : [loss = 1.281, top1 = 67.33%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.93%], valid : [loss = 2.396, top1 = 39.34%], test : [loss = 2.415, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7662/15625) 007662-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.24%], valid : [loss = 0.851, top1 = 71.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10        train : [loss = 0.551, top1 = 80.78%], test  : [loss = 0.693, top1 = 76.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.98 ms.
cifar100       train : [loss = 1.776, top1 = 52.16%], valid : [loss = 2.044, top1 = 47.26%], test : [loss = 2.062, top1 = 46.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.29 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.82%], valid : [loss = 3.639, top1 = 16.43%], test : [loss = 3.678, top1 = 15.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7663/15625) 007663-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.279, top1 = 90.70%], valid : [loss = 0.483, top1 = 84.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.82 ms.
cifar10        train : [loss = 0.305, top1 = 89.65%], test  : [loss = 0.404, top1 = 86.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.34 ms.
cifar100       train : [loss = 1.336, top1 = 62.80%], valid : [loss = 1.533, top1 = 57.96%], test : [loss = 1.524, top1 = 57.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.903, top1 = 28.98%], valid : [loss = 2.898, top1 = 29.37%], test : [loss = 2.953, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7664/15625) 007664-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.88%], valid : [loss = 0.580, top1 = 88.24%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.71 ms.
cifar10        train : [loss = 0.014, top1 = 99.60%], test  : [loss = 0.393, top1 = 91.39%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.42 ms.
cifar100       train : [loss = 0.176, top1 = 95.74%], valid : [loss = 1.550, top1 = 64.98%], test : [loss = 1.544, top1 = 64.94%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.08 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 34.86%], valid : [loss = 2.697, top1 = 32.83%], test : [loss = 2.699, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.350, top1 = 50.51%], valid : [loss = 1.350, top1 = 50.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7665/15625) 007665-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.511, top1 = 89.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.318, top1 = 93.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.128, top1 = 97.08%], valid : [loss = 1.339, top1 = 68.86%], test : [loss = 1.345, top1 = 69.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.92%], valid : [loss = 2.196, top1 = 43.73%], test : [loss = 2.202, top1 = 44.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.01%], valid : [loss = 0.740, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7666/15625) 007666-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.429, top1 = 89.73%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.00 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.305, top1 = 92.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.19 ms.
cifar100       train : [loss = 0.206, top1 = 95.11%], valid : [loss = 1.272, top1 = 69.40%], test : [loss = 1.256, top1 = 69.34%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.50%], valid : [loss = 2.269, top1 = 42.27%], test : [loss = 2.288, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.86%], valid : [loss = 0.535, top1 = 81.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7667/15625) 007667-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.70%], valid : [loss = 0.554, top1 = 82.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10        train : [loss = 0.238, top1 = 91.98%], test  : [loss = 0.400, top1 = 86.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.45 ms.
cifar100       train : [loss = 1.299, top1 = 63.23%], valid : [loss = 1.593, top1 = 57.06%], test : [loss = 1.574, top1 = 56.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 2.888, top1 = 29.01%], valid : [loss = 2.865, top1 = 31.00%], test : [loss = 2.940, top1 = 28.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.30%], valid : [loss = 1.035, top1 = 63.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7668/15625) 007668-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.67%], valid : [loss = 0.799, top1 = 72.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.48 ms.
cifar10        train : [loss = 0.537, top1 = 81.17%], test  : [loss = 0.624, top1 = 78.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.08 ms.
cifar100       train : [loss = 1.925, top1 = 47.87%], valid : [loss = 2.118, top1 = 44.20%], test : [loss = 2.093, top1 = 45.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 3.563, top1 = 16.87%], valid : [loss = 3.574, top1 = 17.40%], test : [loss = 3.581, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.262, top1 = 54.42%], valid : [loss = 1.287, top1 = 53.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7669/15625) 007669-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.85%], valid : [loss = 0.457, top1 = 86.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.149, top1 = 95.23%], test  : [loss = 0.336, top1 = 89.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 0.969, top1 = 72.47%], valid : [loss = 1.345, top1 = 62.74%], test : [loss = 1.340, top1 = 62.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.05%], valid : [loss = 2.679, top1 = 33.53%], test : [loss = 2.706, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7670/15625) 007670-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.550, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.387, top1 = 91.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.77 ms.
cifar100       train : [loss = 0.132, top1 = 97.39%], valid : [loss = 1.469, top1 = 67.54%], test : [loss = 1.449, top1 = 67.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.62 ms.
ImageNet16-120 train : [loss = 1.937, top1 = 48.98%], valid : [loss = 2.456, top1 = 37.93%], test : [loss = 2.495, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.64%], valid : [loss = 0.769, top1 = 73.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7671/15625) 007671-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.503, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.341, top1 = 91.70%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.59 ms.
cifar100       train : [loss = 0.325, top1 = 91.25%], valid : [loss = 1.276, top1 = 66.76%], test : [loss = 1.316, top1 = 66.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.34%], valid : [loss = 2.418, top1 = 38.60%], test : [loss = 2.406, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7672/15625) 007672-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.439, top1 = 89.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.292, top1 = 92.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.16 ms.
cifar100       train : [loss = 0.208, top1 = 95.21%], valid : [loss = 1.227, top1 = 69.46%], test : [loss = 1.258, top1 = 69.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.15%], valid : [loss = 2.263, top1 = 42.37%], test : [loss = 2.264, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.83%], valid : [loss = 0.531, top1 = 82.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7673/15625) 007673-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.74%], valid : [loss = 0.485, top1 = 84.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.222, top1 = 92.39%], test  : [loss = 0.368, top1 = 87.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 1.202, top1 = 65.79%], valid : [loss = 1.488, top1 = 59.22%], test : [loss = 1.474, top1 = 59.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.766, top1 = 31.46%], valid : [loss = 2.766, top1 = 31.58%], test : [loss = 2.825, top1 = 30.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.06%], valid : [loss = 0.951, top1 = 66.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7674/15625) 007674-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.75%], valid : [loss = 0.860, top1 = 71.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10        train : [loss = 0.564, top1 = 80.42%], test  : [loss = 0.718, top1 = 75.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.07 ms.
cifar100       train : [loss = 1.770, top1 = 52.40%], valid : [loss = 2.052, top1 = 46.96%], test : [loss = 2.065, top1 = 46.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.594, top1 = 16.63%], valid : [loss = 3.639, top1 = 16.87%], test : [loss = 3.653, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7675/15625) 007675-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.130, top1 = 95.94%], valid : [loss = 0.444, top1 = 86.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10        train : [loss = 0.157, top1 = 94.84%], test  : [loss = 0.342, top1 = 88.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 1.005, top1 = 71.40%], valid : [loss = 1.371, top1 = 61.64%], test : [loss = 1.355, top1 = 62.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.75%], valid : [loss = 2.697, top1 = 32.77%], test : [loss = 2.747, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7676/15625) 007676-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.510, top1 = 88.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.330, top1 = 92.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.50 ms.
cifar100       train : [loss = 0.354, top1 = 90.45%], valid : [loss = 1.301, top1 = 66.38%], test : [loss = 1.312, top1 = 66.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.23%], valid : [loss = 2.437, top1 = 37.30%], test : [loss = 2.436, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7677/15625) 007677-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.321, top1 = 88.80%], valid : [loss = 0.572, top1 = 81.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10        train : [loss = 0.305, top1 = 89.48%], test  : [loss = 0.427, top1 = 85.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 1.318, top1 = 62.91%], valid : [loss = 1.599, top1 = 56.66%], test : [loss = 1.586, top1 = 56.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 3.076, top1 = 25.63%], valid : [loss = 3.081, top1 = 25.47%], test : [loss = 3.134, top1 = 25.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.11%], valid : [loss = 1.251, top1 = 54.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7678/15625) 007678-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.08%], valid : [loss = 0.446, top1 = 86.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10        train : [loss = 0.107, top1 = 96.75%], test  : [loss = 0.320, top1 = 89.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.66 ms.
cifar100       train : [loss = 0.862, top1 = 75.53%], valid : [loss = 1.289, top1 = 64.92%], test : [loss = 1.276, top1 = 64.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 2.566, top1 = 35.27%], valid : [loss = 2.650, top1 = 33.93%], test : [loss = 2.654, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.08%], valid : [loss = 0.646, top1 = 77.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7679/15625) 007679-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.38%], valid : [loss = 0.691, top1 = 83.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10        train : [loss = 0.095, top1 = 96.86%], test  : [loss = 0.457, top1 = 87.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 0.810, top1 = 76.27%], valid : [loss = 1.627, top1 = 58.64%], test : [loss = 1.653, top1 = 58.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.743, top1 = 31.88%], valid : [loss = 2.881, top1 = 29.93%], test : [loss = 2.920, top1 = 29.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.54%], valid : [loss = 0.937, top1 = 66.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7680/15625) 007680-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.633, top1 = 85.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10        train : [loss = 0.029, top1 = 99.28%], test  : [loss = 0.422, top1 = 89.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.84 ms.
cifar100       train : [loss = 0.391, top1 = 89.46%], valid : [loss = 1.442, top1 = 63.92%], test : [loss = 1.409, top1 = 65.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.34%], valid : [loss = 2.610, top1 = 35.93%], test : [loss = 2.585, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7681/15625) 007681-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.523, top1 = 88.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.024, top1 = 99.32%], test  : [loss = 0.339, top1 = 91.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 0.432, top1 = 87.50%], valid : [loss = 1.253, top1 = 67.20%], test : [loss = 1.269, top1 = 67.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.41%], valid : [loss = 2.356, top1 = 40.23%], test : [loss = 2.373, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.93%], valid : [loss = 0.759, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7682/15625) 007682-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.09%], valid : [loss = 0.475, top1 = 84.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10        train : [loss = 0.298, top1 = 89.92%], test  : [loss = 0.411, top1 = 86.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.05 ms.
cifar100       train : [loss = 1.331, top1 = 63.17%], valid : [loss = 1.535, top1 = 57.78%], test : [loss = 1.515, top1 = 57.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.65%], valid : [loss = 2.906, top1 = 29.10%], test : [loss = 2.965, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7683/15625) 007683-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.524, top1 = 88.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.319, top1 = 92.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.65 ms.
cifar100       train : [loss = 0.348, top1 = 90.46%], valid : [loss = 1.290, top1 = 66.54%], test : [loss = 1.292, top1 = 66.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.47%], valid : [loss = 2.409, top1 = 39.20%], test : [loss = 2.403, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7684/15625) 007684-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.54%], valid : [loss = 0.598, top1 = 86.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10        train : [loss = 0.042, top1 = 98.74%], test  : [loss = 0.377, top1 = 90.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.29 ms.
cifar100       train : [loss = 0.561, top1 = 83.59%], valid : [loss = 1.430, top1 = 63.74%], test : [loss = 1.394, top1 = 63.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 37.15%], valid : [loss = 2.633, top1 = 34.03%], test : [loss = 2.681, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.11%], valid : [loss = 0.656, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7685/15625) 007685-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.49%], valid : [loss = 0.445, top1 = 87.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10        train : [loss = 0.056, top1 = 98.60%], test  : [loss = 0.315, top1 = 90.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.65 ms.
cifar100       train : [loss = 0.592, top1 = 83.64%], valid : [loss = 1.238, top1 = 66.30%], test : [loss = 1.215, top1 = 66.53%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.16%], valid : [loss = 2.461, top1 = 37.90%], test : [loss = 2.487, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7686/15625) 007686-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.98 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.323, top1 = 92.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.07 ms.
cifar100       train : [loss = 0.228, top1 = 94.03%], valid : [loss = 1.232, top1 = 69.46%], test : [loss = 1.234, top1 = 68.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.35%], valid : [loss = 2.233, top1 = 41.37%], test : [loss = 2.255, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.10%], valid : [loss = 0.602, top1 = 79.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7687/15625) 007687-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.33 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.60%], valid : [loss = 0.868, top1 = 71.50%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10        train : [loss = 0.562, top1 = 80.52%], test  : [loss = 0.735, top1 = 75.09%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.24 ms.
cifar100       train : [loss = 1.786, top1 = 51.96%], valid : [loss = 2.064, top1 = 46.56%], test : [loss = 2.059, top1 = 46.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.22 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 16.63%], valid : [loss = 3.654, top1 = 16.13%], test : [loss = 3.688, top1 = 15.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7688/15625) 007688-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.557, top1 = 88.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.348, top1 = 92.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.21 ms.
cifar100       train : [loss = 0.247, top1 = 93.37%], valid : [loss = 1.312, top1 = 68.05%], test : [loss = 1.328, top1 = 67.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.44%], valid : [loss = 2.393, top1 = 39.15%], test : [loss = 2.395, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.84%], valid : [loss = 0.896, top1 = 68.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7689/15625) 007689-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.560, top1 = 87.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.372, top1 = 91.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.382, top1 = 89.31%], valid : [loss = 1.388, top1 = 65.11%], test : [loss = 1.380, top1 = 65.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.03%], valid : [loss = 2.472, top1 = 37.30%], test : [loss = 2.476, top1 = 37.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.79%], valid : [loss = 0.734, top1 = 74.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7690/15625) 007690-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.10 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.75%], valid : [loss = 0.475, top1 = 84.14%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10        train : [loss = 0.307, top1 = 89.67%], test  : [loss = 0.410, top1 = 85.86%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.55 ms.
cifar100       train : [loss = 1.343, top1 = 62.81%], valid : [loss = 1.548, top1 = 57.78%], test : [loss = 1.523, top1 = 57.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.89 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.79%], valid : [loss = 2.891, top1 = 29.13%], test : [loss = 2.948, top1 = 27.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7691/15625) 007691-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.14%], valid : [loss = 0.565, top1 = 86.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10        train : [loss = 0.063, top1 = 98.01%], test  : [loss = 0.359, top1 = 90.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.91 ms.
cifar100       train : [loss = 0.703, top1 = 79.26%], valid : [loss = 1.353, top1 = 63.98%], test : [loss = 1.321, top1 = 63.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.14%], valid : [loss = 2.509, top1 = 37.27%], test : [loss = 2.530, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7692/15625) 007692-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.98%], valid : [loss = 0.521, top1 = 86.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.82 ms.
cifar10        train : [loss = 0.067, top1 = 98.01%], test  : [loss = 0.347, top1 = 90.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.34 ms.
cifar100       train : [loss = 0.646, top1 = 81.29%], valid : [loss = 1.308, top1 = 65.30%], test : [loss = 1.294, top1 = 65.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.40%], valid : [loss = 2.518, top1 = 36.50%], test : [loss = 2.530, top1 = 36.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.76%], valid : [loss = 0.874, top1 = 69.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7693/15625) 007693-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.609, top1 = 87.46%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.86 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.416, top1 = 90.71%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.78 ms.
cifar100       train : [loss = 0.182, top1 = 95.93%], valid : [loss = 1.521, top1 = 65.30%], test : [loss = 1.531, top1 = 65.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.18%], valid : [loss = 2.542, top1 = 37.10%], test : [loss = 2.529, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.04%], valid : [loss = 0.776, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7694/15625) 007694-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.446, top1 = 89.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.13 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.311, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.11 ms.
cifar100       train : [loss = 0.211, top1 = 94.80%], valid : [loss = 1.283, top1 = 68.71%], test : [loss = 1.330, top1 = 68.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.36%], valid : [loss = 2.288, top1 = 42.13%], test : [loss = 2.315, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.92%], valid : [loss = 0.544, top1 = 81.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7695/15625) 007695-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.493, top1 = 89.56%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.329, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.45 ms.
cifar100       train : [loss = 0.221, top1 = 94.67%], valid : [loss = 1.179, top1 = 69.94%], test : [loss = 1.228, top1 = 69.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.75%], valid : [loss = 2.262, top1 = 42.20%], test : [loss = 2.218, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.36%], valid : [loss = 0.717, top1 = 74.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7696/15625) 007696-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.483, top1 = 89.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.87 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.301, top1 = 92.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.93 ms.
cifar100       train : [loss = 0.269, top1 = 93.10%], valid : [loss = 1.194, top1 = 68.82%], test : [loss = 1.204, top1 = 69.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.36%], valid : [loss = 2.234, top1 = 42.27%], test : [loss = 2.260, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7697/15625) 007697-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.636, top1 = 86.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.85 ms.
cifar10        train : [loss = 0.031, top1 = 99.12%], test  : [loss = 0.408, top1 = 90.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.63 ms.
cifar100       train : [loss = 0.519, top1 = 84.91%], valid : [loss = 1.394, top1 = 64.32%], test : [loss = 1.367, top1 = 65.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.28%], valid : [loss = 2.561, top1 = 35.88%], test : [loss = 2.569, top1 = 35.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.49%], valid : [loss = 0.835, top1 = 70.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7698/15625) 007698-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.50%], valid : [loss = 0.686, top1 = 84.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.051, top1 = 98.41%], test  : [loss = 0.439, top1 = 88.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.20 ms.
cifar100       train : [loss = 0.644, top1 = 80.97%], valid : [loss = 1.537, top1 = 60.96%], test : [loss = 1.481, top1 = 61.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.48%], valid : [loss = 2.828, top1 = 30.23%], test : [loss = 2.848, top1 = 31.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.70%], valid : [loss = 0.854, top1 = 69.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7699/15625) 007699-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.65%], valid : [loss = 0.695, top1 = 76.37%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.74 ms.
cifar10        train : [loss = 0.548, top1 = 80.90%], test  : [loss = 0.603, top1 = 79.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.23 ms.
cifar100       train : [loss = 1.764, top1 = 52.17%], valid : [loss = 1.895, top1 = 48.91%], test : [loss = 1.936, top1 = 49.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.82 ms.
ImageNet16-120 train : [loss = 3.378, top1 = 20.27%], valid : [loss = 3.352, top1 = 21.23%], test : [loss = 3.405, top1 = 19.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7700/15625) 007700-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.37%], valid : [loss = 0.456, top1 = 86.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.161, top1 = 94.72%], test  : [loss = 0.349, top1 = 88.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 1.014, top1 = 71.38%], valid : [loss = 1.384, top1 = 61.52%], test : [loss = 1.382, top1 = 61.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.79%], valid : [loss = 2.668, top1 = 33.43%], test : [loss = 2.708, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7701/15625) 007701-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.519, top1 = 88.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.364, top1 = 92.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.15 ms.
cifar100       train : [loss = 0.077, top1 = 98.69%], valid : [loss = 1.517, top1 = 67.86%], test : [loss = 1.496, top1 = 68.05%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.47%], valid : [loss = 2.361, top1 = 40.79%], test : [loss = 2.383, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.79%], valid : [loss = 0.745, top1 = 74.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7702/15625) 007702-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.436, top1 = 89.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.317, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.38 ms.
cifar100       train : [loss = 0.326, top1 = 91.11%], valid : [loss = 1.267, top1 = 67.87%], test : [loss = 1.306, top1 = 66.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 45.99%], valid : [loss = 2.361, top1 = 40.28%], test : [loss = 2.396, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.460, top1 = 84.20%], valid : [loss = 0.549, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7703/15625) 007703-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.539, top1 = 88.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.325, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.319, top1 = 91.33%], valid : [loss = 1.273, top1 = 67.14%], test : [loss = 1.293, top1 = 68.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.89%], valid : [loss = 2.413, top1 = 39.37%], test : [loss = 2.381, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.58%], valid : [loss = 0.730, top1 = 74.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7704/15625) 007704-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.94%], valid : [loss = 0.511, top1 = 87.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.074, top1 = 97.64%], test  : [loss = 0.381, top1 = 89.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 0.728, top1 = 78.56%], valid : [loss = 1.356, top1 = 64.04%], test : [loss = 1.347, top1 = 63.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.70%], valid : [loss = 2.661, top1 = 33.23%], test : [loss = 2.722, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7705/15625) 007705-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.17 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.13%], valid : [loss = 0.456, top1 = 86.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10        train : [loss = 0.112, top1 = 96.58%], test  : [loss = 0.322, top1 = 89.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.73 ms.
cifar100       train : [loss = 0.857, top1 = 75.60%], valid : [loss = 1.302, top1 = 64.00%], test : [loss = 1.292, top1 = 64.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.565, top1 = 35.38%], valid : [loss = 2.611, top1 = 34.95%], test : [loss = 2.667, top1 = 33.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.34%], valid : [loss = 0.640, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7706/15625) 007706-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 89.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.46 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.329, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.92 ms.
cifar100       train : [loss = 0.277, top1 = 92.69%], valid : [loss = 1.278, top1 = 67.57%], test : [loss = 1.280, top1 = 67.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.72%], valid : [loss = 2.321, top1 = 40.58%], test : [loss = 2.321, top1 = 41.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 77.17%], valid : [loss = 0.725, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7707/15625) 007707-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.541, top1 = 88.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.350, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 0.298, top1 = 91.93%], valid : [loss = 1.297, top1 = 66.98%], test : [loss = 1.304, top1 = 67.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.79%], valid : [loss = 2.469, top1 = 37.97%], test : [loss = 2.418, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.82%], valid : [loss = 0.894, top1 = 68.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7708/15625) 007708-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.468, top1 = 88.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 91.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 0.324, top1 = 91.27%], valid : [loss = 1.367, top1 = 66.18%], test : [loss = 1.320, top1 = 67.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.27%], valid : [loss = 2.380, top1 = 39.90%], test : [loss = 2.418, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7709/15625) 007709-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.61%], valid : [loss = 0.888, top1 = 77.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.229, top1 = 92.14%], test  : [loss = 0.579, top1 = 82.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.13 ms.
cifar100       train : [loss = 1.171, top1 = 66.76%], valid : [loss = 1.816, top1 = 53.20%], test : [loss = 1.791, top1 = 53.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 3.222, top1 = 22.83%], valid : [loss = 3.320, top1 = 21.80%], test : [loss = 3.370, top1 = 20.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7710/15625) 007710-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.71%], valid : [loss = 0.548, top1 = 86.47%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.72 ms.
cifar10        train : [loss = 0.073, top1 = 97.66%], test  : [loss = 0.383, top1 = 89.59%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.66 ms.
cifar100       train : [loss = 0.670, top1 = 80.21%], valid : [loss = 1.330, top1 = 64.16%], test : [loss = 1.314, top1 = 64.88%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.67 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 38.80%], valid : [loss = 2.537, top1 = 35.47%], test : [loss = 2.540, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.883, top1 = 68.82%], valid : [loss = 0.927, top1 = 66.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7711/15625) 007711-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.34%], valid : [loss = 0.869, top1 = 71.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.560, top1 = 80.54%], test  : [loss = 0.720, top1 = 75.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 1.778, top1 = 52.14%], valid : [loss = 2.065, top1 = 46.70%], test : [loss = 2.046, top1 = 47.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.88%], valid : [loss = 3.630, top1 = 16.33%], test : [loss = 3.663, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7712/15625) 007712-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.528, top1 = 89.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.346, top1 = 92.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.15 ms.
cifar100       train : [loss = 0.081, top1 = 98.68%], valid : [loss = 1.413, top1 = 69.07%], test : [loss = 1.444, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.11%], valid : [loss = 2.362, top1 = 41.16%], test : [loss = 2.374, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.661, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7713/15625) 007713-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.60%], valid : [loss = 0.892, top1 = 78.80%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10        train : [loss = 0.135, top1 = 95.40%], test  : [loss = 0.530, top1 = 85.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.97 ms.
cifar100       train : [loss = 0.876, top1 = 74.58%], valid : [loss = 1.688, top1 = 57.18%], test : [loss = 1.706, top1 = 57.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 3.021, top1 = 26.64%], valid : [loss = 3.139, top1 = 25.07%], test : [loss = 3.168, top1 = 24.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7714/15625) 007714-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.584, top1 = 87.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.382, top1 = 91.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.180, top1 = 95.59%], valid : [loss = 1.559, top1 = 65.70%], test : [loss = 1.522, top1 = 66.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.39%], valid : [loss = 2.477, top1 = 38.20%], test : [loss = 2.550, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.05%], valid : [loss = 0.839, top1 = 70.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7715/15625) 007715-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.530, top1 = 89.33%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.339, top1 = 92.85%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.70 ms.
cifar100       train : [loss = 0.076, top1 = 98.65%], valid : [loss = 1.357, top1 = 70.30%], test : [loss = 1.360, top1 = 70.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 43.87%], valid : [loss = 2.416, top1 = 39.17%], test : [loss = 2.430, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.10%], valid : [loss = 0.876, top1 = 68.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7716/15625) 007716-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.451, top1 = 89.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.307, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.223, top1 = 94.62%], valid : [loss = 1.333, top1 = 67.35%], test : [loss = 1.317, top1 = 68.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.58%], valid : [loss = 2.296, top1 = 42.60%], test : [loss = 2.345, top1 = 41.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.18%], valid : [loss = 0.540, top1 = 81.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7717/15625) 007717-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.05%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=14.03 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.320, top1 = 91.89%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=13.79 ms.
cifar100       train : [loss = 0.326, top1 = 91.20%], valid : [loss = 1.311, top1 = 67.01%], test : [loss = 1.299, top1 = 67.26%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.34%], valid : [loss = 2.371, top1 = 39.73%], test : [loss = 2.411, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7718/15625) 007718-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.574, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.363, top1 = 91.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.14 ms.
cifar100       train : [loss = 0.398, top1 = 88.70%], valid : [loss = 1.405, top1 = 65.25%], test : [loss = 1.396, top1 = 65.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.93%], valid : [loss = 2.451, top1 = 38.12%], test : [loss = 2.478, top1 = 37.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.97%], valid : [loss = 0.767, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7719/15625) 007719-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.14%], valid : [loss = 0.667, top1 = 84.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.058, top1 = 98.23%], test  : [loss = 0.446, top1 = 88.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.642, top1 = 81.08%], valid : [loss = 1.479, top1 = 62.12%], test : [loss = 1.482, top1 = 61.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 2.687, top1 = 32.92%], valid : [loss = 2.831, top1 = 30.77%], test : [loss = 2.889, top1 = 29.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.872, top1 = 68.52%], valid : [loss = 0.929, top1 = 67.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7720/15625) 007720-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.516, top1 = 89.76%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.312, top1 = 93.41%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.51 ms.
cifar100       train : [loss = 0.038, top1 = 99.64%], valid : [loss = 1.361, top1 = 70.80%], test : [loss = 1.328, top1 = 70.66%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=23.33 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.58%], valid : [loss = 2.307, top1 = 41.23%], test : [loss = 2.290, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.32%], valid : [loss = 0.651, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7721/15625) 007721-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.580, top1 = 87.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.387, top1 = 91.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.83 ms.
cifar100       train : [loss = 0.410, top1 = 88.26%], valid : [loss = 1.408, top1 = 65.05%], test : [loss = 1.418, top1 = 65.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.15%], valid : [loss = 2.482, top1 = 37.71%], test : [loss = 2.501, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.51%], valid : [loss = 0.846, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7722/15625) 007722-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 88.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.322, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.38 ms.
cifar100       train : [loss = 0.333, top1 = 90.85%], valid : [loss = 1.319, top1 = 66.76%], test : [loss = 1.288, top1 = 67.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.83%], valid : [loss = 2.376, top1 = 39.27%], test : [loss = 2.397, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.41%], valid : [loss = 0.544, top1 = 81.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7723/15625) 007723-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.84%], valid : [loss = 0.465, top1 = 84.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10        train : [loss = 0.303, top1 = 89.88%], test  : [loss = 0.400, top1 = 86.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 1.333, top1 = 62.95%], valid : [loss = 1.536, top1 = 58.12%], test : [loss = 1.512, top1 = 58.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.50%], valid : [loss = 2.897, top1 = 30.07%], test : [loss = 2.955, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7724/15625) 007724-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.317, top1 = 89.11%], valid : [loss = 0.571, top1 = 81.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.37 ms.
cifar10        train : [loss = 0.281, top1 = 90.35%], test  : [loss = 0.427, top1 = 85.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 1.457, top1 = 59.30%], valid : [loss = 1.671, top1 = 55.14%], test : [loss = 1.665, top1 = 53.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.982, top1 = 27.11%], valid : [loss = 2.980, top1 = 26.87%], test : [loss = 3.044, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.13%], valid : [loss = 1.042, top1 = 62.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7725/15625) 007725-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.425, top1 = 90.84%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.54 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.282, top1 = 93.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.96 ms.
cifar100       train : [loss = 0.050, top1 = 99.42%], valid : [loss = 1.321, top1 = 70.90%], test : [loss = 1.345, top1 = 71.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 1.487, top1 = 59.56%], valid : [loss = 2.250, top1 = 42.93%], test : [loss = 2.255, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.352, top1 = 88.04%], valid : [loss = 0.490, top1 = 83.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7726/15625) 007726-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.99 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.355, top1 = 92.92%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.95 ms.
cifar100       train : [loss = 0.044, top1 = 99.61%], valid : [loss = 1.431, top1 = 69.40%], test : [loss = 1.461, top1 = 68.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.89%], valid : [loss = 2.418, top1 = 41.27%], test : [loss = 2.447, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.80%], valid : [loss = 0.680, top1 = 76.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7727/15625) 007727-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.67%], valid : [loss = 0.620, top1 = 84.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10        train : [loss = 0.088, top1 = 97.10%], test  : [loss = 0.379, top1 = 89.31%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.68 ms.
cifar100       train : [loss = 0.790, top1 = 76.99%], valid : [loss = 1.418, top1 = 61.90%], test : [loss = 1.418, top1 = 61.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 34.32%], valid : [loss = 2.726, top1 = 31.57%], test : [loss = 2.760, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.24%], valid : [loss = 0.849, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7728/15625) 007728-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.24%], valid : [loss = 0.535, top1 = 81.85%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.398, top1 = 86.57%], test  : [loss = 0.470, top1 = 83.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.39 ms.
cifar100       train : [loss = 1.517, top1 = 58.42%], valid : [loss = 1.657, top1 = 54.28%], test : [loss = 1.620, top1 = 55.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.48 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 26.29%], valid : [loss = 3.013, top1 = 26.47%], test : [loss = 3.051, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7729/15625) 007729-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.557, top1 = 87.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.405, top1 = 90.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.95 ms.
cifar100       train : [loss = 0.385, top1 = 89.09%], valid : [loss = 1.379, top1 = 66.00%], test : [loss = 1.408, top1 = 64.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.02%], valid : [loss = 2.506, top1 = 36.80%], test : [loss = 2.530, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7730/15625) 007730-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.57%], valid : [loss = 1.308, top1 = 53.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10        train : [loss = 1.259, top1 = 54.70%], test  : [loss = 1.262, top1 = 55.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.81 ms.
cifar100       train : [loss = 2.794, top1 = 30.21%], valid : [loss = 2.890, top1 = 28.76%], test : [loss = 2.883, top1 = 29.06%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 3.953, top1 = 11.06%], valid : [loss = 3.949, top1 = 11.33%], test : [loss = 3.975, top1 = 10.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.763, top1 = 33.43%], valid : [loss = 1.754, top1 = 33.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7731/15625) 007731-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.370, top1 = 92.51%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 0.101, top1 = 98.22%], valid : [loss = 1.458, top1 = 67.69%], test : [loss = 1.441, top1 = 67.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.45%], valid : [loss = 2.439, top1 = 39.37%], test : [loss = 2.463, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7732/15625) 007732-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.623, top1 = 77.90%], valid : [loss = 0.759, top1 = 74.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.04 ms.
cifar10        train : [loss = 0.554, top1 = 80.74%], test  : [loss = 0.628, top1 = 78.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.23 ms.
cifar100       train : [loss = 1.974, top1 = 46.43%], valid : [loss = 2.096, top1 = 44.02%], test : [loss = 2.105, top1 = 44.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 3.007, top1 = 26.53%], valid : [loss = 2.986, top1 = 27.08%], test : [loss = 3.028, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.152, top1 = 58.57%], valid : [loss = 1.192, top1 = 57.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7733/15625) 007733-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.46%], valid : [loss = 0.829, top1 = 72.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.558, top1 = 80.58%], test  : [loss = 0.715, top1 = 75.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.00 ms.
cifar100       train : [loss = 1.779, top1 = 52.07%], valid : [loss = 2.054, top1 = 47.00%], test : [loss = 2.052, top1 = 47.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.84%], valid : [loss = 3.628, top1 = 16.80%], test : [loss = 3.666, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7734/15625) 007734-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.23%], valid : [loss = 0.601, top1 = 85.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.065, top1 = 98.05%], test  : [loss = 0.404, top1 = 88.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.00 ms.
cifar100       train : [loss = 0.716, top1 = 79.07%], valid : [loss = 1.414, top1 = 62.74%], test : [loss = 1.370, top1 = 63.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 35.98%], valid : [loss = 2.665, top1 = 33.60%], test : [loss = 2.693, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7735/15625) 007735-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.574, top1 = 87.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.357, top1 = 91.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.26 ms.
cifar100       train : [loss = 0.296, top1 = 91.64%], valid : [loss = 1.352, top1 = 66.93%], test : [loss = 1.339, top1 = 67.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.30%], valid : [loss = 2.434, top1 = 38.42%], test : [loss = 2.437, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.32%], valid : [loss = 0.879, top1 = 68.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7736/15625) 007736-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.28%], valid : [loss = 0.463, top1 = 85.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10        train : [loss = 0.155, top1 = 94.90%], test  : [loss = 0.344, top1 = 88.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.41 ms.
cifar100       train : [loss = 0.991, top1 = 71.68%], valid : [loss = 1.354, top1 = 62.06%], test : [loss = 1.351, top1 = 61.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.89%], valid : [loss = 2.685, top1 = 33.17%], test : [loss = 2.718, top1 = 31.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7737/15625) 007737-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.507, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.338, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.69 ms.
cifar100       train : [loss = 0.367, top1 = 89.90%], valid : [loss = 1.286, top1 = 66.62%], test : [loss = 1.313, top1 = 66.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.24%], valid : [loss = 2.404, top1 = 37.83%], test : [loss = 2.430, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7738/15625) 007738-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.514, top1 = 88.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.94 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.342, top1 = 92.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.25 ms.
cifar100       train : [loss = 0.129, top1 = 97.19%], valid : [loss = 1.360, top1 = 68.34%], test : [loss = 1.394, top1 = 68.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.16 ms.
ImageNet16-120 train : [loss = 1.926, top1 = 49.13%], valid : [loss = 2.326, top1 = 41.47%], test : [loss = 2.303, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.65%], valid : [loss = 0.848, top1 = 70.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7739/15625) 007739-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10-valid  train : [loss = 1.134, top1 = 59.74%], valid : [loss = 1.168, top1 = 58.60%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.72 ms.
cifar10        train : [loss = 1.056, top1 = 62.81%], test  : [loss = 1.049, top1 = 62.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.59 ms.
cifar100       train : [loss = 2.613, top1 = 34.23%], valid : [loss = 2.678, top1 = 33.52%], test : [loss = 2.663, top1 = 33.82%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.26 ms.
ImageNet16-120 train : [loss = 3.796, top1 = 13.42%], valid : [loss = 3.766, top1 = 15.00%], test : [loss = 3.791, top1 = 13.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7740/15625) 007740-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.533, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.349, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.51 ms.
cifar100       train : [loss = 0.240, top1 = 93.83%], valid : [loss = 1.278, top1 = 68.14%], test : [loss = 1.277, top1 = 68.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.37%], valid : [loss = 2.315, top1 = 41.23%], test : [loss = 2.317, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.79%], valid : [loss = 0.728, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7741/15625) 007741-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.80%], valid : [loss = 0.563, top1 = 87.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10        train : [loss = 0.028, top1 = 99.27%], test  : [loss = 0.374, top1 = 90.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.60 ms.
cifar100       train : [loss = 0.462, top1 = 86.62%], valid : [loss = 1.397, top1 = 64.84%], test : [loss = 1.366, top1 = 64.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 40.13%], valid : [loss = 2.523, top1 = 36.33%], test : [loss = 2.583, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.54%], valid : [loss = 0.783, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7742/15625) 007742-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.551, top1 = 88.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.373, top1 = 92.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.05 ms.
cifar100       train : [loss = 0.118, top1 = 97.75%], valid : [loss = 1.424, top1 = 68.18%], test : [loss = 1.472, top1 = 67.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.41%], valid : [loss = 2.426, top1 = 39.60%], test : [loss = 2.438, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.734, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7743/15625) 007743-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.08%], valid : [loss = 0.468, top1 = 86.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.341, top1 = 89.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 1.008, top1 = 71.23%], valid : [loss = 1.348, top1 = 62.00%], test : [loss = 1.366, top1 = 61.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.70%], valid : [loss = 2.719, top1 = 32.20%], test : [loss = 2.719, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7744/15625) 007744-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.83 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.99 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7745/15625) 007745-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.79 ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.33%], valid : [loss = 0.903, top1 = 70.14%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 0.568, top1 = 80.09%], test  : [loss = 0.721, top1 = 75.71%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.60 ms.
cifar100       train : [loss = 1.801, top1 = 51.63%], valid : [loss = 2.061, top1 = 46.86%], test : [loss = 2.079, top1 = 46.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.59 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.80%], valid : [loss = 3.623, top1 = 16.47%], test : [loss = 3.670, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7746/15625) 007746-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.569, top1 = 88.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.92 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.377, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.31 ms.
cifar100       train : [loss = 0.175, top1 = 96.23%], valid : [loss = 1.398, top1 = 67.60%], test : [loss = 1.432, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 1.982, top1 = 48.04%], valid : [loss = 2.450, top1 = 39.47%], test : [loss = 2.493, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7747/15625) 007747-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.33%], valid : [loss = 0.758, top1 = 73.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.57 ms.
cifar10        train : [loss = 0.578, top1 = 79.88%], test  : [loss = 0.636, top1 = 78.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.13 ms.
cifar100       train : [loss = 2.017, top1 = 45.72%], valid : [loss = 2.161, top1 = 43.02%], test : [loss = 2.165, top1 = 42.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 3.227, top1 = 22.38%], valid : [loss = 3.229, top1 = 22.43%], test : [loss = 3.245, top1 = 22.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.87%], valid : [loss = 1.348, top1 = 52.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7748/15625) 007748-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.381, top1 = 86.73%], valid : [loss = 0.622, top1 = 79.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10        train : [loss = 0.287, top1 = 90.14%], test  : [loss = 0.418, top1 = 86.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.99 ms.
cifar100       train : [loss = 1.555, top1 = 56.65%], valid : [loss = 1.764, top1 = 52.06%], test : [loss = 1.760, top1 = 52.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 2.936, top1 = 27.87%], valid : [loss = 2.963, top1 = 26.63%], test : [loss = 2.994, top1 = 26.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.50%], valid : [loss = 1.021, top1 = 63.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7749/15625) 007749-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.497, top1 = 89.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.317, top1 = 93.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.33 ms.
cifar100       train : [loss = 0.126, top1 = 97.49%], valid : [loss = 1.291, top1 = 69.64%], test : [loss = 1.285, top1 = 69.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.53%], valid : [loss = 2.289, top1 = 42.06%], test : [loss = 2.277, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7750/15625) 007750-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.456, top1 = 89.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.298, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.55 ms.
cifar100       train : [loss = 0.210, top1 = 95.11%], valid : [loss = 1.267, top1 = 68.86%], test : [loss = 1.269, top1 = 69.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.77 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 51.02%], valid : [loss = 2.235, top1 = 42.60%], test : [loss = 2.304, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.10%], valid : [loss = 0.523, top1 = 82.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7751/15625) 007751-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.531, top1 = 88.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.382, top1 = 92.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.43 ms.
cifar100       train : [loss = 0.129, top1 = 97.54%], valid : [loss = 1.464, top1 = 67.74%], test : [loss = 1.428, top1 = 67.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.60%], valid : [loss = 2.389, top1 = 39.30%], test : [loss = 2.440, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.62%], valid : [loss = 0.707, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7752/15625) 007752-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.09%], valid : [loss = 0.734, top1 = 74.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10        train : [loss = 0.588, top1 = 79.43%], test  : [loss = 0.659, top1 = 77.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=8.53 ms.
cifar100       train : [loss = 1.966, top1 = 46.82%], valid : [loss = 2.114, top1 = 44.34%], test : [loss = 2.120, top1 = 44.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 3.211, top1 = 22.50%], valid : [loss = 3.214, top1 = 23.60%], test : [loss = 3.240, top1 = 21.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.299, top1 = 53.14%], valid : [loss = 1.349, top1 = 51.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7753/15625) 007753-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.02%], valid : [loss = 0.534, top1 = 84.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.131, top1 = 95.62%], test  : [loss = 0.369, top1 = 88.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 0.849, top1 = 75.16%], valid : [loss = 1.398, top1 = 62.64%], test : [loss = 1.390, top1 = 62.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.564, top1 = 35.27%], valid : [loss = 2.669, top1 = 34.10%], test : [loss = 2.674, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.896, top1 = 67.98%], valid : [loss = 0.941, top1 = 66.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7754/15625) 007754-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.56%], valid : [loss = 0.453, top1 = 86.56%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10        train : [loss = 0.128, top1 = 95.82%], test  : [loss = 0.336, top1 = 89.32%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.13 ms.
cifar100       train : [loss = 0.749, top1 = 79.10%], valid : [loss = 1.286, top1 = 64.38%], test : [loss = 1.277, top1 = 64.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.513, top1 = 36.38%], valid : [loss = 2.612, top1 = 33.27%], test : [loss = 2.645, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7755/15625) 007755-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.466, top1 = 89.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.328, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.213, top1 = 94.87%], valid : [loss = 1.272, top1 = 68.68%], test : [loss = 1.263, top1 = 69.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.32%], valid : [loss = 2.261, top1 = 41.47%], test : [loss = 2.267, top1 = 43.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.00%], valid : [loss = 0.536, top1 = 81.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7756/15625) 007756-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.04%], valid : [loss = 0.527, top1 = 84.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.182, top1 = 93.84%], test  : [loss = 0.387, top1 = 87.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 1.202, top1 = 65.79%], valid : [loss = 1.509, top1 = 58.34%], test : [loss = 1.513, top1 = 58.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.86%], valid : [loss = 2.688, top1 = 33.07%], test : [loss = 2.728, top1 = 32.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.96%], valid : [loss = 0.960, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7757/15625) 007757-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.94%], valid : [loss = 0.509, top1 = 87.59%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.39 ms.
cifar10        train : [loss = 0.074, top1 = 97.65%], test  : [loss = 0.346, top1 = 90.10%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.22 ms.
cifar100       train : [loss = 0.729, top1 = 78.53%], valid : [loss = 1.364, top1 = 63.52%], test : [loss = 1.336, top1 = 63.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.95%], valid : [loss = 2.632, top1 = 34.50%], test : [loss = 2.700, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.97%], valid : [loss = 0.665, top1 = 77.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7758/15625) 007758-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.567, top1 = 87.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.027, top1 = 99.19%], test  : [loss = 0.398, top1 = 90.62%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.70 ms.
cifar100       train : [loss = 0.292, top1 = 91.66%], valid : [loss = 1.392, top1 = 66.32%], test : [loss = 1.418, top1 = 65.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.757, top1 = 30.59%], valid : [loss = 2.859, top1 = 28.23%], test : [loss = 2.847, top1 = 29.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 60.09%], valid : [loss = 1.102, top1 = 59.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7759/15625) 007759-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.92%], valid : [loss = 0.725, top1 = 74.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.41 ms.
cifar10        train : [loss = 0.567, top1 = 80.55%], test  : [loss = 0.621, top1 = 78.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.39 ms.
cifar100       train : [loss = 1.997, top1 = 46.64%], valid : [loss = 2.122, top1 = 44.07%], test : [loss = 2.108, top1 = 43.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 3.231, top1 = 22.38%], valid : [loss = 3.202, top1 = 23.49%], test : [loss = 3.238, top1 = 22.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 53.41%], valid : [loss = 1.355, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7760/15625) 007760-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=22.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.513, top1 = 88.82%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.334, top1 = 91.92%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.14 ms.
cifar100       train : [loss = 0.353, top1 = 90.44%], valid : [loss = 1.299, top1 = 67.22%], test : [loss = 1.302, top1 = 67.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.81 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.25%], valid : [loss = 2.412, top1 = 38.43%], test : [loss = 2.421, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.79%], valid : [loss = 0.697, top1 = 75.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7761/15625) 007761-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.93%], valid : [loss = 0.632, top1 = 78.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 0.492, top1 = 82.90%], test  : [loss = 0.574, top1 = 80.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.33 ms.
cifar100       train : [loss = 1.676, top1 = 54.33%], valid : [loss = 1.855, top1 = 50.24%], test : [loss = 1.866, top1 = 50.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 3.336, top1 = 21.02%], valid : [loss = 3.324, top1 = 21.00%], test : [loss = 3.352, top1 = 20.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.29%], valid : [loss = 1.283, top1 = 53.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7762/15625) 007762-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10-valid  train : [loss = 1.815, top1 = 34.23%], valid : [loss = 1.834, top1 = 33.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.98 ms.
cifar10        train : [loss = 1.209, top1 = 56.70%], test  : [loss = 1.210, top1 = 56.03%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.85 ms.
cifar100       train : [loss = 3.773, top1 = 12.42%], valid : [loss = 3.856, top1 = 10.69%], test : [loss = 3.849, top1 = 11.58%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.71 ms.
ImageNet16-120 train : [loss = 3.749, top1 = 14.06%], valid : [loss = 3.713, top1 = 15.06%], test : [loss = 3.729, top1 = 14.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7763/15625) 007763-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.531, top1 = 88.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=20.22 ms.
cifar10        train : [loss = 0.025, top1 = 99.31%], test  : [loss = 0.356, top1 = 91.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.65 ms.
cifar100       train : [loss = 0.441, top1 = 87.22%], valid : [loss = 1.268, top1 = 66.80%], test : [loss = 1.286, top1 = 66.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.208, top1 = 42.72%], valid : [loss = 2.364, top1 = 39.53%], test : [loss = 2.423, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.52%], valid : [loss = 0.764, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7764/15625) 007764-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.490, top1 = 89.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.298, top1 = 92.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.318, top1 = 91.47%], valid : [loss = 1.247, top1 = 68.42%], test : [loss = 1.247, top1 = 68.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.60%], valid : [loss = 2.322, top1 = 40.13%], test : [loss = 2.363, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7765/15625) 007765-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.523, top1 = 88.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.328, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 0.361, top1 = 89.75%], valid : [loss = 1.246, top1 = 67.57%], test : [loss = 1.254, top1 = 67.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.74%], valid : [loss = 2.308, top1 = 40.45%], test : [loss = 2.336, top1 = 40.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.71%], valid : [loss = 0.815, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7766/15625) 007766-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.83 ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.27%], valid : [loss = 0.774, top1 = 73.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.18 ms.
cifar10        train : [loss = 0.609, top1 = 78.76%], test  : [loss = 0.665, top1 = 77.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.91 ms.
cifar100       train : [loss = 2.111, top1 = 43.44%], valid : [loss = 2.244, top1 = 40.44%], test : [loss = 2.239, top1 = 41.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 3.357, top1 = 20.06%], valid : [loss = 3.349, top1 = 20.23%], test : [loss = 3.397, top1 = 19.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.328, top1 = 51.68%], valid : [loss = 1.368, top1 = 50.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7767/15625) 007767-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.474, top1 = 89.56%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.307, top1 = 93.02%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.63 ms.
cifar100       train : [loss = 0.255, top1 = 93.29%], valid : [loss = 1.210, top1 = 69.16%], test : [loss = 1.252, top1 = 68.72%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=25.49 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.38%], valid : [loss = 2.236, top1 = 42.37%], test : [loss = 2.218, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.688, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7768/15625) 007768-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.485, top1 = 89.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.289, top1 = 92.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.17 ms.
cifar100       train : [loss = 0.243, top1 = 93.78%], valid : [loss = 1.196, top1 = 69.56%], test : [loss = 1.214, top1 = 69.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.02%], valid : [loss = 2.225, top1 = 41.83%], test : [loss = 2.238, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.71%], valid : [loss = 0.611, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7769/15625) 007769-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.463, top1 = 89.69%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.24 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.293, top1 = 92.75%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.24 ms.
cifar100       train : [loss = 0.339, top1 = 90.90%], valid : [loss = 1.284, top1 = 67.12%], test : [loss = 1.290, top1 = 66.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.90 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.78%], valid : [loss = 2.216, top1 = 43.53%], test : [loss = 2.227, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.95%], valid : [loss = 0.652, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7770/15625) 007770-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.567, top1 = 88.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.336, top1 = 92.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.02 ms.
cifar100       train : [loss = 0.171, top1 = 96.37%], valid : [loss = 1.392, top1 = 67.16%], test : [loss = 1.387, top1 = 66.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 48.02%], valid : [loss = 2.476, top1 = 37.63%], test : [loss = 2.504, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.48%], valid : [loss = 0.710, top1 = 75.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7771/15625) 007771-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.539, top1 = 88.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.351, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.20 ms.
cifar100       train : [loss = 0.243, top1 = 93.53%], valid : [loss = 1.255, top1 = 68.61%], test : [loss = 1.251, top1 = 68.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.41%], valid : [loss = 2.241, top1 = 42.66%], test : [loss = 2.257, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.29%], valid : [loss = 0.734, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7772/15625) 007772-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.449, top1 = 89.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.09 ms.
cifar100       train : [loss = 0.318, top1 = 91.47%], valid : [loss = 1.307, top1 = 67.22%], test : [loss = 1.303, top1 = 67.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.26%], valid : [loss = 2.372, top1 = 39.43%], test : [loss = 2.405, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.553, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7773/15625) 007773-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.64%], valid : [loss = 0.624, top1 = 86.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.39 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.405, top1 = 90.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.31 ms.
cifar100       train : [loss = 0.538, top1 = 84.32%], valid : [loss = 1.437, top1 = 63.02%], test : [loss = 1.393, top1 = 63.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.12%], valid : [loss = 2.517, top1 = 36.77%], test : [loss = 2.571, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 68.92%], valid : [loss = 0.915, top1 = 67.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7774/15625) 007774-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.92 ms.
cifar10-valid  train : [loss = 1.124, top1 = 60.21%], valid : [loss = 1.165, top1 = 58.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10        train : [loss = 1.067, top1 = 62.41%], test  : [loss = 1.067, top1 = 61.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.01 ms.
cifar100       train : [loss = 2.575, top1 = 34.97%], valid : [loss = 2.650, top1 = 34.22%], test : [loss = 2.628, top1 = 34.25%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.38 ms.
ImageNet16-120 train : [loss = 3.795, top1 = 13.52%], valid : [loss = 3.773, top1 = 14.50%], test : [loss = 3.795, top1 = 13.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7775/15625) 007775-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.85 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.467, top1 = 89.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.00 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.305, top1 = 92.82%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.93 ms.
cifar100       train : [loss = 0.242, top1 = 93.82%], valid : [loss = 1.199, top1 = 69.56%], test : [loss = 1.218, top1 = 69.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.76%], valid : [loss = 2.216, top1 = 42.50%], test : [loss = 2.246, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.75%], valid : [loss = 0.599, top1 = 79.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7776/15625) 007776-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.208, top1 = 92.96%], valid : [loss = 0.488, top1 = 84.38%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.45 ms.
cifar10        train : [loss = 0.223, top1 = 92.54%], test  : [loss = 0.386, top1 = 87.69%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.30 ms.
cifar100       train : [loss = 1.242, top1 = 65.05%], valid : [loss = 1.532, top1 = 58.10%], test : [loss = 1.532, top1 = 56.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.64%], valid : [loss = 2.942, top1 = 27.00%], test : [loss = 2.956, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.44%], valid : [loss = 1.046, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7777/15625) 007777-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.37 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.19%], valid : [loss = 0.549, top1 = 86.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10        train : [loss = 0.058, top1 = 98.33%], test  : [loss = 0.362, top1 = 90.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.96 ms.
cifar100       train : [loss = 0.566, top1 = 83.71%], valid : [loss = 1.307, top1 = 65.37%], test : [loss = 1.298, top1 = 65.73%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 41.92%], valid : [loss = 2.433, top1 = 38.34%], test : [loss = 2.453, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.70%], valid : [loss = 0.882, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7778/15625) 007778-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.03%], valid : [loss = 0.675, top1 = 84.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.059, top1 = 98.19%], test  : [loss = 0.428, top1 = 89.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.61 ms.
cifar100       train : [loss = 0.671, top1 = 80.33%], valid : [loss = 1.454, top1 = 62.34%], test : [loss = 1.457, top1 = 62.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.89%], valid : [loss = 2.641, top1 = 35.40%], test : [loss = 2.682, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.38%], valid : [loss = 0.868, top1 = 69.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7779/15625) 007779-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.18%], valid : [loss = 0.858, top1 = 71.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.29 ms.
cifar10        train : [loss = 0.547, top1 = 81.09%], test  : [loss = 0.710, top1 = 75.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.66 ms.
cifar100       train : [loss = 1.762, top1 = 52.43%], valid : [loss = 2.040, top1 = 48.06%], test : [loss = 2.078, top1 = 46.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.91 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.88%], valid : [loss = 3.648, top1 = 16.33%], test : [loss = 3.671, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7780/15625) 007780-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.15%], valid : [loss = 0.554, top1 = 86.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.091, top1 = 97.01%], test  : [loss = 0.354, top1 = 89.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.48 ms.
cifar100       train : [loss = 0.768, top1 = 77.16%], valid : [loss = 1.299, top1 = 64.46%], test : [loss = 1.309, top1 = 64.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.23%], valid : [loss = 2.556, top1 = 35.30%], test : [loss = 2.593, top1 = 34.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.03%], valid : [loss = 0.825, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7781/15625) 007781-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.82%], valid : [loss = 0.479, top1 = 84.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.297, top1 = 90.11%], test  : [loss = 0.407, top1 = 86.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.40 ms.
cifar100       train : [loss = 1.324, top1 = 63.39%], valid : [loss = 1.544, top1 = 57.92%], test : [loss = 1.505, top1 = 58.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.81%], valid : [loss = 2.891, top1 = 30.00%], test : [loss = 2.950, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7782/15625) 007782-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.98%], valid : [loss = 0.649, top1 = 84.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.53 ms.
cifar10        train : [loss = 0.080, top1 = 97.54%], test  : [loss = 0.407, top1 = 88.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.814, top1 = 76.09%], valid : [loss = 1.462, top1 = 61.62%], test : [loss = 1.469, top1 = 60.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.61%], valid : [loss = 2.744, top1 = 32.20%], test : [loss = 2.761, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.51%], valid : [loss = 0.850, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7783/15625) 007783-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.567, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.40 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.369, top1 = 92.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.46 ms.
cifar100       train : [loss = 0.101, top1 = 98.13%], valid : [loss = 1.439, top1 = 67.80%], test : [loss = 1.487, top1 = 67.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.46%], valid : [loss = 2.438, top1 = 39.97%], test : [loss = 2.453, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7784/15625) 007784-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.535, top1 = 88.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.96 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.335, top1 = 92.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.80 ms.
cifar100       train : [loss = 0.320, top1 = 91.00%], valid : [loss = 1.313, top1 = 66.83%], test : [loss = 1.316, top1 = 67.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.34%], valid : [loss = 2.444, top1 = 38.06%], test : [loss = 2.443, top1 = 37.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.70%], valid : [loss = 0.836, top1 = 70.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7785/15625) 007785-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.492, top1 = 89.29%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=19.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.326, top1 = 92.34%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=17.37 ms.
cifar100       train : [loss = 0.221, top1 = 94.54%], valid : [loss = 1.276, top1 = 68.43%], test : [loss = 1.252, top1 = 68.59%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=20.74 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.55%], valid : [loss = 2.245, top1 = 42.31%], test : [loss = 2.270, top1 = 42.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.08%], valid : [loss = 0.682, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7786/15625) 007786-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.516, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.15 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.322, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.74 ms.
cifar100       train : [loss = 0.313, top1 = 91.36%], valid : [loss = 1.304, top1 = 68.12%], test : [loss = 1.298, top1 = 68.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.66%], valid : [loss = 2.272, top1 = 42.23%], test : [loss = 2.296, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.55%], valid : [loss = 0.714, top1 = 75.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7787/15625) 007787-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.54%], valid : [loss = 0.664, top1 = 85.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.32 ms.
cifar10        train : [loss = 0.038, top1 = 98.88%], test  : [loss = 0.408, top1 = 89.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.537, top1 = 84.24%], valid : [loss = 1.404, top1 = 63.80%], test : [loss = 1.398, top1 = 64.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 39.08%], valid : [loss = 2.581, top1 = 34.57%], test : [loss = 2.618, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.06%], valid : [loss = 0.842, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7788/15625) 007788-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.32%], valid : [loss = 0.632, top1 = 85.67%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.81 ms.
cifar10        train : [loss = 0.047, top1 = 98.68%], test  : [loss = 0.439, top1 = 88.90%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.41 ms.
cifar100       train : [loss = 0.437, top1 = 87.71%], valid : [loss = 1.483, top1 = 63.12%], test : [loss = 1.485, top1 = 62.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.362, top1 = 39.79%], valid : [loss = 2.700, top1 = 33.20%], test : [loss = 2.694, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.79%], valid : [loss = 0.846, top1 = 70.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7789/15625) 007789-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.41%], valid : [loss = 0.751, top1 = 79.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10        train : [loss = 0.188, top1 = 93.42%], test  : [loss = 0.509, top1 = 84.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.08 ms.
cifar100       train : [loss = 0.858, top1 = 74.99%], valid : [loss = 1.639, top1 = 57.84%], test : [loss = 1.662, top1 = 57.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 3.459, top1 = 17.51%], valid : [loss = 3.487, top1 = 17.30%], test : [loss = 3.479, top1 = 17.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.46%], valid : [loss = 1.311, top1 = 52.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7790/15625) 007790-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.513, top1 = 88.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.351, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.72 ms.
cifar100       train : [loss = 0.355, top1 = 90.36%], valid : [loss = 1.285, top1 = 66.88%], test : [loss = 1.267, top1 = 66.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.27%], valid : [loss = 2.433, top1 = 38.43%], test : [loss = 2.439, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7791/15625) 007791-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.521, top1 = 88.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.30 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.346, top1 = 91.68%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.46 ms.
cifar100       train : [loss = 0.330, top1 = 90.86%], valid : [loss = 1.261, top1 = 67.46%], test : [loss = 1.266, top1 = 68.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.47%], valid : [loss = 2.427, top1 = 37.93%], test : [loss = 2.451, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.08%], valid : [loss = 0.784, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7792/15625) 007792-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.97%], valid : [loss = 0.558, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10        train : [loss = 0.110, top1 = 96.44%], test  : [loss = 0.370, top1 = 88.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.21 ms.
cifar100       train : [loss = 0.867, top1 = 74.70%], valid : [loss = 1.399, top1 = 62.30%], test : [loss = 1.378, top1 = 62.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.568, top1 = 35.04%], valid : [loss = 2.642, top1 = 33.93%], test : [loss = 2.691, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.41%], valid : [loss = 0.931, top1 = 66.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7793/15625) 007793-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.56%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=14.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.05%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=13.66 ms.
cifar100       train : [loss = 0.346, top1 = 90.57%], valid : [loss = 1.292, top1 = 66.93%], test : [loss = 1.288, top1 = 67.32%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.73%], valid : [loss = 2.388, top1 = 39.09%], test : [loss = 2.405, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.68%], valid : [loss = 0.746, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7794/15625) 007794-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.560, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.61 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.388, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.46 ms.
cifar100       train : [loss = 0.219, top1 = 94.56%], valid : [loss = 1.472, top1 = 65.83%], test : [loss = 1.477, top1 = 65.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.69%], valid : [loss = 2.482, top1 = 37.50%], test : [loss = 2.480, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.77%], valid : [loss = 0.778, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7795/15625) 007795-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.561, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.369, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.40 ms.
cifar100       train : [loss = 0.122, top1 = 97.78%], valid : [loss = 1.407, top1 = 68.42%], test : [loss = 1.423, top1 = 67.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.85%], valid : [loss = 2.429, top1 = 39.37%], test : [loss = 2.443, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.89%], valid : [loss = 0.722, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7796/15625) 007796-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.04%], valid : [loss = 0.468, top1 = 84.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10        train : [loss = 0.299, top1 = 89.88%], test  : [loss = 0.409, top1 = 86.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.23 ms.
cifar100       train : [loss = 1.332, top1 = 63.11%], valid : [loss = 1.535, top1 = 57.62%], test : [loss = 1.513, top1 = 58.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.62%], valid : [loss = 2.898, top1 = 29.63%], test : [loss = 2.950, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7797/15625) 007797-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.48 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7798/15625) 007798-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.46%], valid : [loss = 0.860, top1 = 70.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.37 ms.
cifar10        train : [loss = 0.670, top1 = 76.43%], test  : [loss = 0.756, top1 = 74.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.40 ms.
cifar100       train : [loss = 1.955, top1 = 48.10%], valid : [loss = 2.124, top1 = 45.17%], test : [loss = 2.137, top1 = 44.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 3.644, top1 = 15.82%], valid : [loss = 3.666, top1 = 16.26%], test : [loss = 3.687, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7799/15625) 007799-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.459, top1 = 89.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.298, top1 = 92.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.65 ms.
cifar100       train : [loss = 0.203, top1 = 95.16%], valid : [loss = 1.289, top1 = 68.62%], test : [loss = 1.276, top1 = 68.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 1.828, top1 = 51.63%], valid : [loss = 2.258, top1 = 42.97%], test : [loss = 2.283, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.02%], valid : [loss = 0.555, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7800/15625) 007800-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.492, top1 = 89.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.26 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.310, top1 = 92.37%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.51 ms.
cifar100       train : [loss = 0.241, top1 = 94.04%], valid : [loss = 1.252, top1 = 68.59%], test : [loss = 1.268, top1 = 68.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.37%], valid : [loss = 2.288, top1 = 41.74%], test : [loss = 2.291, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.49%], valid : [loss = 0.645, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7801/15625) 007801-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.529, top1 = 89.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.339, top1 = 93.13%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.43 ms.
cifar100       train : [loss = 0.076, top1 = 98.82%], valid : [loss = 1.459, top1 = 68.35%], test : [loss = 1.430, top1 = 68.92%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.54%], valid : [loss = 2.366, top1 = 40.82%], test : [loss = 2.375, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 80.71%], valid : [loss = 0.647, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7802/15625) 007802-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.524, top1 = 89.13%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.331, top1 = 92.62%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.99 ms.
cifar100       train : [loss = 0.151, top1 = 96.75%], valid : [loss = 1.323, top1 = 68.65%], test : [loss = 1.324, top1 = 69.17%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.32%], valid : [loss = 2.333, top1 = 40.93%], test : [loss = 2.318, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.32%], valid : [loss = 0.719, top1 = 74.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7803/15625) 007803-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.74 ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.90%], valid : [loss = 0.979, top1 = 66.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.63 ms.
cifar10        train : [loss = 0.778, top1 = 72.74%], test  : [loss = 0.857, top1 = 69.98%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.99 ms.
cifar100       train : [loss = 2.153, top1 = 43.66%], valid : [loss = 2.337, top1 = 40.73%], test : [loss = 2.358, top1 = 40.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.29%], valid : [loss = 3.768, top1 = 14.74%], test : [loss = 3.784, top1 = 13.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7804/15625) 007804-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.553, top1 = 88.85%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.58 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.356, top1 = 92.33%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.88 ms.
cifar100       train : [loss = 0.080, top1 = 98.39%], valid : [loss = 1.443, top1 = 68.54%], test : [loss = 1.458, top1 = 68.60%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.93 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 35.80%], valid : [loss = 2.725, top1 = 31.83%], test : [loss = 2.744, top1 = 32.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.080, top1 = 60.58%], valid : [loss = 1.113, top1 = 59.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7805/15625) 007805-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.79%], valid : [loss = 0.532, top1 = 84.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.79 ms.
cifar10        train : [loss = 0.125, top1 = 96.07%], test  : [loss = 0.378, top1 = 88.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.965, top1 = 72.10%], valid : [loss = 1.406, top1 = 61.78%], test : [loss = 1.394, top1 = 61.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.403, top1 = 38.71%], valid : [loss = 2.518, top1 = 36.77%], test : [loss = 2.544, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 69.06%], valid : [loss = 0.919, top1 = 68.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7806/15625) 007806-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.098, top1 = 96.95%], valid : [loss = 0.841, top1 = 79.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10        train : [loss = 0.137, top1 = 95.38%], test  : [loss = 0.492, top1 = 85.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 1.013, top1 = 70.76%], valid : [loss = 1.689, top1 = 55.84%], test : [loss = 1.675, top1 = 56.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 2.902, top1 = 28.61%], valid : [loss = 3.027, top1 = 26.50%], test : [loss = 3.072, top1 = 25.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 67.81%], valid : [loss = 0.951, top1 = 66.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7807/15625) 007807-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.566, top1 = 87.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10        train : [loss = 0.019, top1 = 99.54%], test  : [loss = 0.386, top1 = 90.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 0.430, top1 = 87.77%], valid : [loss = 1.369, top1 = 65.63%], test : [loss = 1.384, top1 = 64.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.45%], valid : [loss = 2.523, top1 = 36.66%], test : [loss = 2.535, top1 = 36.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.37%], valid : [loss = 0.786, top1 = 72.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7808/15625) 007808-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.575, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.387, top1 = 91.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 0.408, top1 = 88.48%], valid : [loss = 1.401, top1 = 65.38%], test : [loss = 1.405, top1 = 65.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.318, top1 = 40.60%], valid : [loss = 2.533, top1 = 36.61%], test : [loss = 2.529, top1 = 37.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.02%], valid : [loss = 0.825, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7809/15625) 007809-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.03 ms.
cifar10-valid  train : [loss = 0.381, top1 = 86.96%], valid : [loss = 0.516, top1 = 82.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.402, top1 = 86.44%], test  : [loss = 0.461, top1 = 84.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 1.542, top1 = 57.65%], valid : [loss = 1.654, top1 = 54.49%], test : [loss = 1.653, top1 = 55.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 26.34%], valid : [loss = 3.021, top1 = 26.97%], test : [loss = 3.061, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.112, top1 = 60.74%], valid : [loss = 1.142, top1 = 59.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7810/15625) 007810-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.13 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7811/15625) 007811-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.535, top1 = 88.06%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.16 ms.
cifar10        train : [loss = 0.023, top1 = 99.44%], test  : [loss = 0.351, top1 = 91.18%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.50 ms.
cifar100       train : [loss = 0.372, top1 = 89.85%], valid : [loss = 1.261, top1 = 67.11%], test : [loss = 1.258, top1 = 67.29%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.93 ms.
ImageNet16-120 train : [loss = 2.088, top1 = 45.49%], valid : [loss = 2.316, top1 = 40.59%], test : [loss = 2.318, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.72%], valid : [loss = 0.766, top1 = 73.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7812/15625) 007812-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.63%], valid : [loss = 0.731, top1 = 75.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.516, top1 = 82.21%], test  : [loss = 0.594, top1 = 79.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 1.850, top1 = 49.59%], valid : [loss = 1.990, top1 = 46.54%], test : [loss = 1.988, top1 = 46.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.00 ms.
ImageNet16-120 train : [loss = 3.014, top1 = 26.41%], valid : [loss = 2.994, top1 = 27.26%], test : [loss = 3.017, top1 = 26.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 60.27%], valid : [loss = 1.159, top1 = 58.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7813/15625) 007813-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.586, top1 = 87.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.85 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.386, top1 = 91.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.20 ms.
cifar100       train : [loss = 0.408, top1 = 88.43%], valid : [loss = 1.385, top1 = 65.43%], test : [loss = 1.398, top1 = 65.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.89%], valid : [loss = 2.512, top1 = 36.33%], test : [loss = 2.510, top1 = 37.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.32%], valid : [loss = 0.822, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7814/15625) 007814-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.35%], valid : [loss = 0.646, top1 = 85.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.059, top1 = 98.18%], test  : [loss = 0.427, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.95 ms.
cifar100       train : [loss = 0.670, top1 = 80.51%], valid : [loss = 1.421, top1 = 62.60%], test : [loss = 1.398, top1 = 63.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.499, top1 = 36.75%], valid : [loss = 2.644, top1 = 34.32%], test : [loss = 2.653, top1 = 34.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.38%], valid : [loss = 0.853, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7815/15625) 007815-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.08 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.68%], valid : [loss = 0.688, top1 = 76.58%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10        train : [loss = 0.539, top1 = 81.25%], test  : [loss = 0.601, top1 = 79.63%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.91 ms.
cifar100       train : [loss = 1.745, top1 = 52.63%], valid : [loss = 1.886, top1 = 49.28%], test : [loss = 1.921, top1 = 49.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 3.380, top1 = 20.27%], valid : [loss = 3.351, top1 = 21.44%], test : [loss = 3.396, top1 = 19.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7816/15625) 007816-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.222, top1 = 92.52%], valid : [loss = 0.555, top1 = 83.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.211, top1 = 92.78%], test  : [loss = 0.399, top1 = 87.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 1.296, top1 = 63.29%], valid : [loss = 1.588, top1 = 56.59%], test : [loss = 1.582, top1 = 56.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.724, top1 = 32.17%], valid : [loss = 2.743, top1 = 31.78%], test : [loss = 2.798, top1 = 31.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.00%], valid : [loss = 0.972, top1 = 65.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7817/15625) 007817-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.639, top1 = 86.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10        train : [loss = 0.031, top1 = 99.13%], test  : [loss = 0.404, top1 = 90.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.528, top1 = 84.58%], valid : [loss = 1.420, top1 = 64.01%], test : [loss = 1.439, top1 = 63.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.10%], valid : [loss = 2.554, top1 = 35.91%], test : [loss = 2.595, top1 = 35.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.55%], valid : [loss = 0.907, top1 = 67.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7818/15625) 007818-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.47%], valid : [loss = 0.624, top1 = 85.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10        train : [loss = 0.036, top1 = 98.97%], test  : [loss = 0.405, top1 = 89.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.536, top1 = 84.32%], valid : [loss = 1.400, top1 = 64.04%], test : [loss = 1.436, top1 = 63.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.80 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.93%], valid : [loss = 2.545, top1 = 36.51%], test : [loss = 2.561, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 69.22%], valid : [loss = 0.911, top1 = 67.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7819/15625) 007819-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.569, top1 = 88.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.54 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.360, top1 = 92.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.71 ms.
cifar100       train : [loss = 0.125, top1 = 97.14%], valid : [loss = 1.374, top1 = 68.71%], test : [loss = 1.412, top1 = 68.79%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.76 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 38.85%], valid : [loss = 2.541, top1 = 34.99%], test : [loss = 2.539, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.90%], valid : [loss = 0.979, top1 = 65.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7820/15625) 007820-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.541, top1 = 88.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.344, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.150, top1 = 96.59%], valid : [loss = 1.367, top1 = 68.15%], test : [loss = 1.376, top1 = 68.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.024, top1 = 46.90%], valid : [loss = 2.353, top1 = 40.63%], test : [loss = 2.344, top1 = 40.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.39%], valid : [loss = 0.819, top1 = 71.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7821/15625) 007821-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.534, top1 = 89.57%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.353, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.58 ms.
cifar100       train : [loss = 0.046, top1 = 99.57%], valid : [loss = 1.411, top1 = 69.51%], test : [loss = 1.395, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.69 ms.
ImageNet16-120 train : [loss = 1.595, top1 = 57.14%], valid : [loss = 2.386, top1 = 40.84%], test : [loss = 2.403, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.29%], valid : [loss = 0.645, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7822/15625) 007822-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.65%], valid : [loss = 0.648, top1 = 84.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.48 ms.
cifar10        train : [loss = 0.090, top1 = 97.08%], test  : [loss = 0.413, top1 = 88.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.78 ms.
cifar100       train : [loss = 0.785, top1 = 77.05%], valid : [loss = 1.430, top1 = 61.73%], test : [loss = 1.427, top1 = 61.85%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 34.00%], valid : [loss = 2.758, top1 = 32.16%], test : [loss = 2.779, top1 = 31.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.90%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7823/15625) 007823-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.620, top1 = 86.40%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.51 ms.
cifar10        train : [loss = 0.029, top1 = 99.29%], test  : [loss = 0.425, top1 = 89.50%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.01 ms.
cifar100       train : [loss = 0.393, top1 = 89.48%], valid : [loss = 1.442, top1 = 64.37%], test : [loss = 1.404, top1 = 64.67%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.26%], valid : [loss = 2.599, top1 = 34.83%], test : [loss = 2.617, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.27%], valid : [loss = 0.765, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7824/15625) 007824-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.437, top1 = 89.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.89%], test  : [loss = 0.297, top1 = 92.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.53 ms.
cifar100       train : [loss = 0.205, top1 = 95.17%], valid : [loss = 1.268, top1 = 68.83%], test : [loss = 1.247, top1 = 69.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.93%], valid : [loss = 2.267, top1 = 42.21%], test : [loss = 2.310, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.40%], valid : [loss = 0.517, top1 = 82.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7825/15625) 007825-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.01%], valid : [loss = 0.841, top1 = 72.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.565, top1 = 80.31%], test  : [loss = 0.716, top1 = 75.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.95 ms.
cifar100       train : [loss = 1.807, top1 = 51.36%], valid : [loss = 2.072, top1 = 46.47%], test : [loss = 2.083, top1 = 46.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 3.592, top1 = 16.74%], valid : [loss = 3.649, top1 = 16.51%], test : [loss = 3.660, top1 = 15.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.22%], valid : [loss = 1.258, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7826/15625) 007826-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.80 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.476, top1 = 89.83%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.96 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.310, top1 = 92.93%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.99 ms.
cifar100       train : [loss = 0.122, top1 = 97.74%], valid : [loss = 1.245, top1 = 70.14%], test : [loss = 1.256, top1 = 70.17%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 1.672, top1 = 55.15%], valid : [loss = 2.120, top1 = 45.01%], test : [loss = 2.128, top1 = 45.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.84%], valid : [loss = 0.672, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7827/15625) 007827-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.545, top1 = 88.61%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.79 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.350, top1 = 92.21%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.57 ms.
cifar100       train : [loss = 0.233, top1 = 94.11%], valid : [loss = 1.419, top1 = 65.97%], test : [loss = 1.415, top1 = 66.25%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.37 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 40.56%], valid : [loss = 2.485, top1 = 36.38%], test : [loss = 2.495, top1 = 36.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.41%], valid : [loss = 0.944, top1 = 66.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7828/15625) 007828-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.317, top1 = 89.12%], valid : [loss = 0.520, top1 = 83.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10        train : [loss = 0.284, top1 = 90.30%], test  : [loss = 0.396, top1 = 86.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.26 ms.
cifar100       train : [loss = 1.304, top1 = 63.24%], valid : [loss = 1.537, top1 = 57.60%], test : [loss = 1.529, top1 = 57.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 2.831, top1 = 30.24%], valid : [loss = 2.842, top1 = 30.23%], test : [loss = 2.885, top1 = 29.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 64.06%], valid : [loss = 1.015, top1 = 63.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7829/15625) 007829-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.805, top1 = 71.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.643, top1 = 77.41%], test  : [loss = 0.699, top1 = 75.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 2.158, top1 = 42.15%], valid : [loss = 2.317, top1 = 39.34%], test : [loss = 2.307, top1 = 39.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 3.404, top1 = 19.25%], valid : [loss = 3.408, top1 = 19.54%], test : [loss = 3.428, top1 = 19.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.298, top1 = 52.53%], valid : [loss = 1.349, top1 = 51.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7830/15625) 007830-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.481, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.308, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.317, top1 = 91.47%], valid : [loss = 1.261, top1 = 67.66%], test : [loss = 1.246, top1 = 68.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.90%], valid : [loss = 2.312, top1 = 40.64%], test : [loss = 2.333, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.51%], valid : [loss = 0.588, top1 = 79.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7831/15625) 007831-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.040, top1 = 99.16%], valid : [loss = 0.545, top1 = 86.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.051, top1 = 98.61%], test  : [loss = 0.346, top1 = 90.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.549, top1 = 84.24%], valid : [loss = 1.299, top1 = 65.61%], test : [loss = 1.304, top1 = 65.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.80%], valid : [loss = 2.420, top1 = 37.99%], test : [loss = 2.432, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.08%], valid : [loss = 0.907, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7832/15625) 007832-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.557, top1 = 89.23%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.362, top1 = 92.77%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.32 ms.
cifar100       train : [loss = 0.074, top1 = 98.88%], valid : [loss = 1.449, top1 = 68.45%], test : [loss = 1.460, top1 = 68.43%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 53.07%], valid : [loss = 2.366, top1 = 40.62%], test : [loss = 2.377, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.51%], valid : [loss = 0.656, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7833/15625) 007833-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.530, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.347, top1 = 91.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 0.329, top1 = 90.98%], valid : [loss = 1.304, top1 = 66.87%], test : [loss = 1.297, top1 = 66.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.02%], valid : [loss = 2.418, top1 = 38.47%], test : [loss = 2.445, top1 = 38.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7834/15625) 007834-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.505, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.031, top1 = 99.10%], test  : [loss = 0.350, top1 = 91.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 0.508, top1 = 85.15%], valid : [loss = 1.357, top1 = 65.21%], test : [loss = 1.342, top1 = 65.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.76%], valid : [loss = 2.524, top1 = 36.31%], test : [loss = 2.568, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.53%], valid : [loss = 0.728, top1 = 75.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7835/15625) 007835-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.31%], valid : [loss = 0.534, top1 = 82.12%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.74 ms.
cifar10        train : [loss = 0.401, top1 = 86.40%], test  : [loss = 0.469, top1 = 84.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.12 ms.
cifar100       train : [loss = 1.535, top1 = 57.84%], valid : [loss = 1.666, top1 = 54.27%], test : [loss = 1.650, top1 = 55.06%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.14 ms.
ImageNet16-120 train : [loss = 3.033, top1 = 26.41%], valid : [loss = 2.998, top1 = 27.56%], test : [loss = 3.045, top1 = 26.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7836/15625) 007836-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.264, top1 = 90.92%], valid : [loss = 0.547, top1 = 83.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10        train : [loss = 0.256, top1 = 91.22%], test  : [loss = 0.405, top1 = 86.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.35 ms.
cifar100       train : [loss = 1.392, top1 = 60.73%], valid : [loss = 1.653, top1 = 54.86%], test : [loss = 1.639, top1 = 55.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.53%], valid : [loss = 2.915, top1 = 28.62%], test : [loss = 2.963, top1 = 27.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.94%], valid : [loss = 1.001, top1 = 64.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7837/15625) 007837-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.19%], valid : [loss = 0.457, top1 = 86.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10        train : [loss = 0.158, top1 = 94.92%], test  : [loss = 0.348, top1 = 88.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 0.987, top1 = 72.01%], valid : [loss = 1.357, top1 = 62.43%], test : [loss = 1.353, top1 = 62.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.95%], valid : [loss = 2.675, top1 = 33.44%], test : [loss = 2.712, top1 = 32.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7838/15625) 007838-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.325, top1 = 91.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.42 ms.
cifar100       train : [loss = 0.335, top1 = 90.89%], valid : [loss = 1.335, top1 = 66.59%], test : [loss = 1.337, top1 = 67.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.19%], valid : [loss = 2.386, top1 = 39.41%], test : [loss = 2.414, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7839/15625) 007839-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.539, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.351, top1 = 91.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.41 ms.
cifar100       train : [loss = 0.300, top1 = 91.82%], valid : [loss = 1.299, top1 = 67.29%], test : [loss = 1.305, top1 = 67.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.92%], valid : [loss = 2.416, top1 = 38.56%], test : [loss = 2.434, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 70.67%], valid : [loss = 0.864, top1 = 69.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7840/15625) 007840-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.470, top1 = 89.71%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.78 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.307, top1 = 92.68%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.30 ms.
cifar100       train : [loss = 0.247, top1 = 93.63%], valid : [loss = 1.216, top1 = 68.99%], test : [loss = 1.221, top1 = 69.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.37%], valid : [loss = 2.198, top1 = 42.92%], test : [loss = 2.222, top1 = 43.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.20%], valid : [loss = 0.625, top1 = 78.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7841/15625) 007841-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.35%], valid : [loss = 0.557, top1 = 82.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10        train : [loss = 0.287, top1 = 90.11%], test  : [loss = 0.426, top1 = 85.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.20 ms.
cifar100       train : [loss = 1.462, top1 = 58.90%], valid : [loss = 1.700, top1 = 53.47%], test : [loss = 1.695, top1 = 53.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.990, top1 = 27.07%], valid : [loss = 2.970, top1 = 27.58%], test : [loss = 3.047, top1 = 26.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.42%], valid : [loss = 1.016, top1 = 64.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7842/15625) 007842-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.513, top1 = 88.64%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.327, top1 = 92.08%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.19 ms.
cifar100       train : [loss = 0.326, top1 = 91.19%], valid : [loss = 1.276, top1 = 67.29%], test : [loss = 1.299, top1 = 67.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.85 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.12%], valid : [loss = 2.417, top1 = 39.19%], test : [loss = 2.413, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.88%], valid : [loss = 0.625, top1 = 78.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7843/15625) 007843-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.522, top1 = 89.47%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.30 ms.
cifar100       train : [loss = 0.062, top1 = 99.08%], valid : [loss = 1.339, top1 = 70.28%], test : [loss = 1.373, top1 = 70.05%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.75%], valid : [loss = 2.321, top1 = 40.99%], test : [loss = 2.320, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.65%], valid : [loss = 0.901, top1 = 68.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7844/15625) 007844-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.550, top1 = 89.38%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.352, top1 = 92.91%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.34 ms.
cifar100       train : [loss = 0.090, top1 = 98.33%], valid : [loss = 1.345, top1 = 69.37%], test : [loss = 1.353, top1 = 69.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.85 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.64%], valid : [loss = 2.304, top1 = 41.66%], test : [loss = 2.281, top1 = 42.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 78.40%], valid : [loss = 0.687, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7845/15625) 007845-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.536, top1 = 88.82%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.25 ms.
cifar10        train : [loss = 0.010, top1 = 99.74%], test  : [loss = 0.342, top1 = 92.31%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.78 ms.
cifar100       train : [loss = 0.144, top1 = 96.62%], valid : [loss = 1.414, top1 = 68.05%], test : [loss = 1.434, top1 = 67.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.48 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.33%], valid : [loss = 2.499, top1 = 36.61%], test : [loss = 2.506, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 65.00%], valid : [loss = 0.991, top1 = 64.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7846/15625) 007846-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.338, top1 = 88.25%], valid : [loss = 0.560, top1 = 81.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.294, top1 = 89.85%], test  : [loss = 0.437, top1 = 85.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.18 ms.
cifar100       train : [loss = 1.554, top1 = 56.72%], valid : [loss = 1.782, top1 = 51.91%], test : [loss = 1.770, top1 = 52.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 25.88%], valid : [loss = 3.054, top1 = 25.93%], test : [loss = 3.116, top1 = 24.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.84%], valid : [loss = 1.077, top1 = 61.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7847/15625) 007847-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.548, top1 = 89.16%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.361, top1 = 92.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.49 ms.
cifar100       train : [loss = 0.189, top1 = 95.44%], valid : [loss = 1.378, top1 = 66.97%], test : [loss = 1.370, top1 = 67.45%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.36 ms.
ImageNet16-120 train : [loss = 1.960, top1 = 48.34%], valid : [loss = 2.252, top1 = 41.81%], test : [loss = 2.271, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 71.10%], valid : [loss = 0.857, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7848/15625) 007848-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.539, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.348, top1 = 92.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.87 ms.
cifar100       train : [loss = 0.146, top1 = 96.59%], valid : [loss = 1.345, top1 = 68.79%], test : [loss = 1.355, top1 = 68.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.93%], valid : [loss = 2.369, top1 = 39.63%], test : [loss = 2.368, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.33%], valid : [loss = 0.908, top1 = 67.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7849/15625) 007849-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.319, top1 = 91.37%], valid : [loss = 1.301, top1 = 67.39%], test : [loss = 1.299, top1 = 67.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.46%], valid : [loss = 2.372, top1 = 40.09%], test : [loss = 2.402, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.32%], valid : [loss = 0.559, top1 = 80.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7850/15625) 007850-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.40%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.27 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.318, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.89 ms.
cifar100       train : [loss = 0.133, top1 = 97.32%], valid : [loss = 1.306, top1 = 68.89%], test : [loss = 1.306, top1 = 68.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.37%], valid : [loss = 2.268, top1 = 41.76%], test : [loss = 2.261, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.46%], valid : [loss = 0.716, top1 = 75.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7851/15625) 007851-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.569, top1 = 88.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.386, top1 = 91.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.178, top1 = 95.98%], valid : [loss = 1.431, top1 = 67.05%], test : [loss = 1.430, top1 = 66.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.99%], valid : [loss = 2.449, top1 = 38.94%], test : [loss = 2.464, top1 = 39.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.04%], valid : [loss = 0.696, top1 = 75.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7852/15625) 007852-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.18%], valid : [loss = 0.715, top1 = 80.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.185, top1 = 93.57%], test  : [loss = 0.515, top1 = 84.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.53 ms.
cifar100       train : [loss = 0.891, top1 = 74.02%], valid : [loss = 1.660, top1 = 56.78%], test : [loss = 1.692, top1 = 56.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 3.486, top1 = 17.20%], valid : [loss = 3.495, top1 = 17.60%], test : [loss = 3.503, top1 = 17.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7853/15625) 007853-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.22%], valid : [loss = 0.552, top1 = 82.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.262, top1 = 90.98%], test  : [loss = 0.413, top1 = 86.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 1.370, top1 = 61.27%], valid : [loss = 1.639, top1 = 55.06%], test : [loss = 1.628, top1 = 54.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.815, top1 = 30.32%], valid : [loss = 2.828, top1 = 30.00%], test : [loss = 2.876, top1 = 29.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.001, top1 = 63.39%], valid : [loss = 1.057, top1 = 62.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7854/15625) 007854-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.648, top1 = 86.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.41 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.431, top1 = 90.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.282, top1 = 92.53%], valid : [loss = 1.521, top1 = 64.07%], test : [loss = 1.520, top1 = 64.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.93%], valid : [loss = 2.566, top1 = 36.40%], test : [loss = 2.582, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 72.95%], valid : [loss = 0.815, top1 = 71.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7855/15625) 007855-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=23.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.475, top1 = 89.79%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=23.15 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.289, top1 = 93.00%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=24.08 ms.
cifar100       train : [loss = 0.112, top1 = 97.97%], valid : [loss = 1.240, top1 = 70.41%], test : [loss = 1.249, top1 = 70.31%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=23.22 ms.
ImageNet16-120 train : [loss = 1.629, top1 = 56.24%], valid : [loss = 2.119, top1 = 45.57%], test : [loss = 2.141, top1 = 45.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.99%], valid : [loss = 0.718, top1 = 75.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7856/15625) 007856-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.53%], valid : [loss = 0.441, top1 = 88.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10        train : [loss = 0.058, top1 = 98.59%], test  : [loss = 0.315, top1 = 90.47%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.73 ms.
cifar100       train : [loss = 0.591, top1 = 83.60%], valid : [loss = 1.206, top1 = 67.06%], test : [loss = 1.193, top1 = 66.55%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.23%], valid : [loss = 2.468, top1 = 37.69%], test : [loss = 2.485, top1 = 37.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.58%], valid : [loss = 0.652, top1 = 77.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7857/15625) 007857-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.633, top1 = 86.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10        train : [loss = 0.027, top1 = 99.30%], test  : [loss = 0.422, top1 = 90.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 0.485, top1 = 86.01%], valid : [loss = 1.436, top1 = 64.15%], test : [loss = 1.403, top1 = 64.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.416, top1 = 38.44%], valid : [loss = 2.599, top1 = 35.03%], test : [loss = 2.622, top1 = 34.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.02%], valid : [loss = 0.871, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7858/15625) 007858-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.29%], valid : [loss = 0.604, top1 = 85.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10        train : [loss = 0.072, top1 = 97.79%], test  : [loss = 0.399, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.13 ms.
cifar100       train : [loss = 0.711, top1 = 79.26%], valid : [loss = 1.394, top1 = 62.99%], test : [loss = 1.348, top1 = 63.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.82%], valid : [loss = 2.676, top1 = 33.32%], test : [loss = 2.692, top1 = 33.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7859/15625) 007859-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.29%], valid : [loss = 0.466, top1 = 85.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10        train : [loss = 0.160, top1 = 94.76%], test  : [loss = 0.341, top1 = 88.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.98 ms.
cifar100       train : [loss = 0.998, top1 = 71.57%], valid : [loss = 1.356, top1 = 61.65%], test : [loss = 1.351, top1 = 61.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.75%], valid : [loss = 2.682, top1 = 33.10%], test : [loss = 2.698, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7860/15625) 007860-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.508, top1 = 89.43%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.54 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.318, top1 = 92.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.15 ms.
cifar100       train : [loss = 0.141, top1 = 96.89%], valid : [loss = 1.210, top1 = 70.52%], test : [loss = 1.231, top1 = 70.21%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.73 ms.
ImageNet16-120 train : [loss = 1.797, top1 = 52.21%], valid : [loss = 2.185, top1 = 43.93%], test : [loss = 2.195, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.72%], valid : [loss = 0.740, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7861/15625) 007861-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.37%], valid : [loss = 0.585, top1 = 85.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.107, top1 = 96.49%], test  : [loss = 0.390, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.816, top1 = 75.98%], valid : [loss = 1.431, top1 = 62.27%], test : [loss = 1.413, top1 = 62.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.683, top1 = 32.82%], valid : [loss = 2.751, top1 = 31.40%], test : [loss = 2.792, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7862/15625) 007862-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.511, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.353, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.476, top1 = 86.06%], valid : [loss = 1.359, top1 = 65.47%], test : [loss = 1.361, top1 = 65.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.22%], valid : [loss = 2.521, top1 = 37.04%], test : [loss = 2.570, top1 = 36.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.44%], valid : [loss = 0.623, top1 = 78.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7863/15625) 007863-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.357, top1 = 87.65%], valid : [loss = 0.653, top1 = 79.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.321, top1 = 88.88%], test  : [loss = 0.485, top1 = 84.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 1.502, top1 = 58.15%], valid : [loss = 1.787, top1 = 52.07%], test : [loss = 1.798, top1 = 52.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 3.186, top1 = 23.37%], valid : [loss = 3.205, top1 = 22.82%], test : [loss = 3.229, top1 = 23.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.009, top1 = 63.41%], valid : [loss = 1.054, top1 = 62.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7864/15625) 007864-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.67%], valid : [loss = 0.533, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10        train : [loss = 0.026, top1 = 99.28%], test  : [loss = 0.334, top1 = 91.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.438, top1 = 87.32%], valid : [loss = 1.244, top1 = 67.15%], test : [loss = 1.250, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.187, top1 = 43.27%], valid : [loss = 2.361, top1 = 39.83%], test : [loss = 2.399, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7865/15625) 007865-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.87%], valid : [loss = 0.551, top1 = 88.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.94 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.359, top1 = 92.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.17 ms.
cifar100       train : [loss = 0.172, top1 = 95.87%], valid : [loss = 1.382, top1 = 67.61%], test : [loss = 1.378, top1 = 67.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.19%], valid : [loss = 2.340, top1 = 40.47%], test : [loss = 2.353, top1 = 40.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.32%], valid : [loss = 0.783, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7866/15625) 007866-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.59%], valid : [loss = 0.613, top1 = 86.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10        train : [loss = 0.034, top1 = 99.05%], test  : [loss = 0.395, top1 = 90.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.535, top1 = 84.38%], valid : [loss = 1.425, top1 = 63.93%], test : [loss = 1.432, top1 = 63.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.46%], valid : [loss = 2.533, top1 = 36.09%], test : [loss = 2.575, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.22%], valid : [loss = 0.898, top1 = 68.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7867/15625) 007867-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.547, top1 = 87.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.373, top1 = 91.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.384, top1 = 89.24%], valid : [loss = 1.360, top1 = 66.35%], test : [loss = 1.360, top1 = 65.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.80%], valid : [loss = 2.472, top1 = 37.81%], test : [loss = 2.508, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.60%], valid : [loss = 0.666, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7868/15625) 007868-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.550, top1 = 88.57%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.337, top1 = 92.17%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.86 ms.
cifar100       train : [loss = 0.206, top1 = 94.80%], valid : [loss = 1.314, top1 = 67.95%], test : [loss = 1.319, top1 = 68.23%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.15 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.30%], valid : [loss = 2.343, top1 = 40.32%], test : [loss = 2.328, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.70%], valid : [loss = 0.850, top1 = 70.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7869/15625) 007869-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.43%], valid : [loss = 0.542, top1 = 83.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.195, top1 = 93.44%], test  : [loss = 0.396, top1 = 87.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 1.238, top1 = 64.79%], valid : [loss = 1.551, top1 = 57.53%], test : [loss = 1.551, top1 = 57.95%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.83%], valid : [loss = 2.699, top1 = 32.71%], test : [loss = 2.722, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.81%], valid : [loss = 0.996, top1 = 64.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7870/15625) 007870-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.444, top1 = 89.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.298, top1 = 92.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.208, top1 = 95.08%], valid : [loss = 1.274, top1 = 68.95%], test : [loss = 1.280, top1 = 68.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.96%], valid : [loss = 2.268, top1 = 42.32%], test : [loss = 2.296, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7871/15625) 007871-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.567, top1 = 87.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.381, top1 = 91.31%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.380, top1 = 89.27%], valid : [loss = 1.406, top1 = 65.20%], test : [loss = 1.414, top1 = 65.17%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.00%], valid : [loss = 2.507, top1 = 37.29%], test : [loss = 2.537, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.54%], valid : [loss = 0.782, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7872/15625) 007872-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.72%], valid : [loss = 0.877, top1 = 71.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10        train : [loss = 0.552, top1 = 80.70%], test  : [loss = 0.709, top1 = 76.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.24 ms.
cifar100       train : [loss = 1.770, top1 = 52.32%], valid : [loss = 2.045, top1 = 46.67%], test : [loss = 2.073, top1 = 46.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.88%], valid : [loss = 3.620, top1 = 16.97%], test : [loss = 3.669, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7873/15625) 007873-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.78%], valid : [loss = 0.527, top1 = 86.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.077, top1 = 97.57%], test  : [loss = 0.360, top1 = 89.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.44 ms.
cifar100       train : [loss = 0.723, top1 = 78.73%], valid : [loss = 1.347, top1 = 64.19%], test : [loss = 1.337, top1 = 64.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.00%], valid : [loss = 2.650, top1 = 33.74%], test : [loss = 2.689, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.27%], valid : [loss = 0.659, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7874/15625) 007874-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.52%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.18 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.344, top1 = 92.82%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.41 ms.
cifar100       train : [loss = 0.083, top1 = 98.61%], valid : [loss = 1.380, top1 = 68.77%], test : [loss = 1.369, top1 = 69.35%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 1.792, top1 = 52.33%], valid : [loss = 2.286, top1 = 42.07%], test : [loss = 2.282, top1 = 41.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 81.09%], valid : [loss = 0.614, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7875/15625) 007875-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.40%], valid : [loss = 0.631, top1 = 85.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.052, top1 = 98.43%], test  : [loss = 0.421, top1 = 88.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 0.635, top1 = 81.42%], valid : [loss = 1.409, top1 = 63.03%], test : [loss = 1.411, top1 = 63.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.19%], valid : [loss = 2.629, top1 = 34.38%], test : [loss = 2.673, top1 = 33.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.42%], valid : [loss = 0.837, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7876/15625) 007876-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.621, top1 = 86.41%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.19 ms.
cifar10        train : [loss = 0.027, top1 = 99.37%], test  : [loss = 0.416, top1 = 89.61%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=20.21 ms.
cifar100       train : [loss = 0.383, top1 = 89.72%], valid : [loss = 1.419, top1 = 64.76%], test : [loss = 1.398, top1 = 65.14%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.60 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.21%], valid : [loss = 2.601, top1 = 35.64%], test : [loss = 2.627, top1 = 35.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 76.00%], valid : [loss = 0.766, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7877/15625) 007877-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.500, top1 = 90.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.328, top1 = 93.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.34 ms.
cifar100       train : [loss = 0.119, top1 = 97.64%], valid : [loss = 1.307, top1 = 69.42%], test : [loss = 1.296, top1 = 70.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 1.683, top1 = 54.80%], valid : [loss = 2.185, top1 = 44.15%], test : [loss = 2.183, top1 = 44.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7878/15625) 007878-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.73%], valid : [loss = 0.468, top1 = 86.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.90 ms.
cifar10        train : [loss = 0.156, top1 = 94.96%], test  : [loss = 0.349, top1 = 88.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.57 ms.
cifar100       train : [loss = 0.990, top1 = 71.93%], valid : [loss = 1.344, top1 = 62.47%], test : [loss = 1.353, top1 = 62.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.97%], valid : [loss = 2.687, top1 = 32.72%], test : [loss = 2.708, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.48%], valid : [loss = 0.789, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7879/15625) 007879-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.603, top1 = 86.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.411, top1 = 90.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.99 ms.
cifar100       train : [loss = 0.507, top1 = 85.27%], valid : [loss = 1.428, top1 = 63.38%], test : [loss = 1.432, top1 = 63.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.04%], valid : [loss = 2.571, top1 = 35.31%], test : [loss = 2.590, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7880/15625) 007880-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.12%], valid : [loss = 0.701, top1 = 77.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10        train : [loss = 0.410, top1 = 85.67%], test  : [loss = 0.557, top1 = 81.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 1.661, top1 = 54.18%], valid : [loss = 1.897, top1 = 49.72%], test : [loss = 1.902, top1 = 49.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 3.346, top1 = 20.64%], valid : [loss = 3.351, top1 = 21.10%], test : [loss = 3.386, top1 = 19.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.187, top1 = 56.77%], valid : [loss = 1.240, top1 = 55.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7881/15625) 007881-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.81%], valid : [loss = 0.889, top1 = 68.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.732, top1 = 74.08%], test  : [loss = 0.788, top1 = 72.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.41 ms.
cifar100       train : [loss = 2.347, top1 = 38.35%], valid : [loss = 2.476, top1 = 36.62%], test : [loss = 2.466, top1 = 36.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.560, top1 = 16.90%], valid : [loss = 3.544, top1 = 17.90%], test : [loss = 3.576, top1 = 16.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 46.58%], valid : [loss = 1.502, top1 = 45.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7882/15625) 007882-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.57%], valid : [loss = 0.777, top1 = 73.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10        train : [loss = 0.596, top1 = 79.22%], test  : [loss = 0.651, top1 = 77.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.96 ms.
cifar100       train : [loss = 2.066, top1 = 44.45%], valid : [loss = 2.210, top1 = 41.93%], test : [loss = 2.203, top1 = 41.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 20.79%], valid : [loss = 3.305, top1 = 20.84%], test : [loss = 3.358, top1 = 20.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.24%], valid : [loss = 1.319, top1 = 52.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7883/15625) 007883-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.483, top1 = 89.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.307, top1 = 92.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.14 ms.
cifar100       train : [loss = 0.239, top1 = 94.12%], valid : [loss = 1.244, top1 = 68.77%], test : [loss = 1.251, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 1.958, top1 = 48.48%], valid : [loss = 2.255, top1 = 41.53%], test : [loss = 2.286, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.93%], valid : [loss = 0.597, top1 = 79.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7884/15625) 007884-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.453, top1 = 89.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.321, top1 = 92.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.62 ms.
cifar100       train : [loss = 0.321, top1 = 91.32%], valid : [loss = 1.312, top1 = 67.37%], test : [loss = 1.288, top1 = 67.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.43%], valid : [loss = 2.379, top1 = 39.50%], test : [loss = 2.399, top1 = 39.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.63%], valid : [loss = 0.557, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7885/15625) 007885-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.64%], valid : [loss = 0.612, top1 = 85.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 0.034, top1 = 99.08%], test  : [loss = 0.408, top1 = 89.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.30 ms.
cifar100       train : [loss = 0.528, top1 = 84.57%], valid : [loss = 1.412, top1 = 64.64%], test : [loss = 1.398, top1 = 64.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.19%], valid : [loss = 2.551, top1 = 35.75%], test : [loss = 2.584, top1 = 35.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 71.83%], valid : [loss = 0.847, top1 = 70.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7886/15625) 007886-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.475, top1 = 89.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.98 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.340, top1 = 92.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.19 ms.
cifar100       train : [loss = 0.193, top1 = 95.21%], valid : [loss = 1.360, top1 = 68.47%], test : [loss = 1.361, top1 = 68.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.68%], valid : [loss = 2.299, top1 = 42.13%], test : [loss = 2.326, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.26%], valid : [loss = 0.622, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7887/15625) 007887-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.81%], valid : [loss = 0.565, top1 = 85.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.56 ms.
cifar10        train : [loss = 0.096, top1 = 97.00%], test  : [loss = 0.365, top1 = 89.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.44 ms.
cifar100       train : [loss = 0.847, top1 = 75.33%], valid : [loss = 1.463, top1 = 61.16%], test : [loss = 1.454, top1 = 61.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.38%], valid : [loss = 2.608, top1 = 33.57%], test : [loss = 2.654, top1 = 34.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 67.72%], valid : [loss = 0.942, top1 = 67.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7888/15625) 007888-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.40%], valid : [loss = 0.846, top1 = 72.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10        train : [loss = 0.562, top1 = 80.43%], test  : [loss = 0.717, top1 = 75.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 1.794, top1 = 51.83%], valid : [loss = 2.066, top1 = 46.56%], test : [loss = 2.079, top1 = 46.61%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.68%], valid : [loss = 3.648, top1 = 15.90%], test : [loss = 3.666, top1 = 15.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.196, top1 = 57.09%], valid : [loss = 1.262, top1 = 54.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7889/15625) 007889-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.94%], valid : [loss = 0.656, top1 = 77.63%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10        train : [loss = 0.536, top1 = 81.45%], test  : [loss = 0.615, top1 = 79.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.44 ms.
cifar100       train : [loss = 1.702, top1 = 53.80%], valid : [loss = 1.860, top1 = 50.44%], test : [loss = 1.874, top1 = 50.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 3.338, top1 = 21.09%], valid : [loss = 3.331, top1 = 21.75%], test : [loss = 3.354, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.263, top1 = 54.21%], valid : [loss = 1.276, top1 = 54.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7890/15625) 007890-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.36 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.505, top1 = 89.57%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.61 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.324, top1 = 92.53%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=22.06 ms.
cifar100       train : [loss = 0.169, top1 = 95.93%], valid : [loss = 1.247, top1 = 69.70%], test : [loss = 1.261, top1 = 69.68%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=21.52 ms.
ImageNet16-120 train : [loss = 1.744, top1 = 53.38%], valid : [loss = 2.169, top1 = 44.30%], test : [loss = 2.181, top1 = 44.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.67%], valid : [loss = 0.677, top1 = 76.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7891/15625) 007891-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.496, top1 = 88.21%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.28 ms.
cifar10        train : [loss = 0.036, top1 = 99.05%], test  : [loss = 0.351, top1 = 90.70%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.76 ms.
cifar100       train : [loss = 0.438, top1 = 87.64%], valid : [loss = 1.253, top1 = 67.38%], test : [loss = 1.271, top1 = 67.55%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.78%], valid : [loss = 2.402, top1 = 39.33%], test : [loss = 2.424, top1 = 38.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.75%], valid : [loss = 0.609, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7892/15625) 007892-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.15%], valid : [loss = 0.565, top1 = 86.70%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10        train : [loss = 0.062, top1 = 98.03%], test  : [loss = 0.374, top1 = 90.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.35 ms.
cifar100       train : [loss = 0.637, top1 = 81.30%], valid : [loss = 1.322, top1 = 64.36%], test : [loss = 1.326, top1 = 64.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 38.82%], valid : [loss = 2.525, top1 = 35.83%], test : [loss = 2.519, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7893/15625) 007893-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.18 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.85%], valid : [loss = 0.514, top1 = 82.86%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.91 ms.
cifar10        train : [loss = 0.400, top1 = 86.37%], test  : [loss = 0.461, top1 = 84.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.00 ms.
cifar100       train : [loss = 1.533, top1 = 57.83%], valid : [loss = 1.649, top1 = 55.12%], test : [loss = 1.649, top1 = 55.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.50 ms.
ImageNet16-120 train : [loss = 3.030, top1 = 26.48%], valid : [loss = 3.000, top1 = 26.87%], test : [loss = 3.040, top1 = 26.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7894/15625) 007894-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 74.63 M, Params=0.534 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.486, top1 = 88.82%]
cifar10        FLOP= 74.63 M, Params=0.534 MB, latency=17.62 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 92.01%]
cifar100       FLOP= 74.64 M, Params=0.540 MB, latency=16.59 ms.
cifar100       train : [loss = 0.328, top1 = 91.20%], valid : [loss = 1.259, top1 = 67.16%], test : [loss = 1.248, top1 = 68.00%]
ImageNet16-120 FLOP= 18.67 M, Params=0.542 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.60%], valid : [loss = 2.333, top1 = 40.71%], test : [loss = 2.355, top1 = 40.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.64%], valid : [loss = 0.603, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7895/15625) 007895-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.568, top1 = 88.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.380, top1 = 92.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.24 ms.
cifar100       train : [loss = 0.100, top1 = 98.23%], valid : [loss = 1.477, top1 = 67.67%], test : [loss = 1.443, top1 = 68.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.45%], valid : [loss = 2.435, top1 = 39.56%], test : [loss = 2.452, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7896/15625) 007896-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.304, top1 = 92.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.91 ms.
cifar100       train : [loss = 0.317, top1 = 91.53%], valid : [loss = 1.254, top1 = 67.65%], test : [loss = 1.277, top1 = 67.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.94 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.68%], valid : [loss = 2.317, top1 = 40.99%], test : [loss = 2.348, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.511, top1 = 82.29%], valid : [loss = 0.599, top1 = 79.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7897/15625) 007897-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.430, top1 = 90.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.283, top1 = 93.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.02 ms.
cifar100       train : [loss = 0.056, top1 = 99.26%], valid : [loss = 1.343, top1 = 70.62%], test : [loss = 1.336, top1 = 71.23%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 1.480, top1 = 59.77%], valid : [loss = 2.232, top1 = 44.77%], test : [loss = 2.247, top1 = 44.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.80%], valid : [loss = 0.500, top1 = 83.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7898/15625) 007898-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.31%], valid : [loss = 0.486, top1 = 87.30%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.91 ms.
cifar10        train : [loss = 0.055, top1 = 98.51%], test  : [loss = 0.329, top1 = 90.65%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.48 ms.
cifar100       train : [loss = 0.528, top1 = 84.77%], valid : [loss = 1.233, top1 = 67.17%], test : [loss = 1.229, top1 = 67.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.96 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.19%], valid : [loss = 2.364, top1 = 40.38%], test : [loss = 2.372, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.57%], valid : [loss = 0.848, top1 = 69.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7899/15625) 007899-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.565, top1 = 87.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.396, top1 = 91.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.03 ms.
cifar100       train : [loss = 0.416, top1 = 88.15%], valid : [loss = 1.398, top1 = 65.40%], test : [loss = 1.402, top1 = 65.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.90%], valid : [loss = 2.500, top1 = 36.76%], test : [loss = 2.514, top1 = 37.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.32%], valid : [loss = 0.822, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7900/15625) 007900-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.460, top1 = 89.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.319, top1 = 92.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.57 ms.
cifar100       train : [loss = 0.283, top1 = 92.39%], valid : [loss = 1.317, top1 = 67.74%], test : [loss = 1.323, top1 = 67.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.36%], valid : [loss = 2.325, top1 = 40.93%], test : [loss = 2.376, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.35%], valid : [loss = 0.599, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7901/15625) 007901-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.484, top1 = 90.04%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.306, top1 = 93.34%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.06 ms.
cifar100       train : [loss = 0.106, top1 = 97.74%], valid : [loss = 1.298, top1 = 69.67%], test : [loss = 1.299, top1 = 69.77%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 1.603, top1 = 56.72%], valid : [loss = 2.130, top1 = 45.72%], test : [loss = 2.150, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.466, top1 = 84.16%], valid : [loss = 0.579, top1 = 80.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7902/15625) 007902-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.20%], valid : [loss = 0.613, top1 = 85.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.074, top1 = 97.72%], test  : [loss = 0.399, top1 = 88.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.73 ms.
cifar100       train : [loss = 0.716, top1 = 79.12%], valid : [loss = 1.352, top1 = 63.41%], test : [loss = 1.352, top1 = 63.87%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.92%], valid : [loss = 2.650, top1 = 34.10%], test : [loss = 2.680, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.67%], valid : [loss = 0.771, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7903/15625) 007903-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.71 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.486, top1 = 89.20%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.85 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.330, top1 = 91.90%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=23.52 ms.
cifar100       train : [loss = 0.240, top1 = 94.08%], valid : [loss = 1.263, top1 = 68.25%], test : [loss = 1.276, top1 = 68.46%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=24.49 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.32%], valid : [loss = 2.275, top1 = 42.07%], test : [loss = 2.289, top1 = 41.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.98%], valid : [loss = 0.691, top1 = 76.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7904/15625) 007904-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.66 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.02 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7905/15625) 007905-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.82 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.502, top1 = 89.59%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.346, top1 = 92.35%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.33 ms.
cifar100       train : [loss = 0.139, top1 = 97.09%], valid : [loss = 1.314, top1 = 69.31%], test : [loss = 1.303, top1 = 68.98%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.43%], valid : [loss = 2.309, top1 = 41.17%], test : [loss = 2.312, top1 = 41.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 72.86%], valid : [loss = 0.816, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7906/15625) 007906-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.456, top1 = 91.00%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.37 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.299, top1 = 94.01%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.70 ms.
cifar100       train : [loss = 0.026, top1 = 99.76%], valid : [loss = 1.330, top1 = 71.75%], test : [loss = 1.277, top1 = 72.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.244, top1 = 65.74%], valid : [loss = 2.193, top1 = 46.22%], test : [loss = 2.195, top1 = 46.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.11%], valid : [loss = 0.488, top1 = 83.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7907/15625) 007907-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.639, top1 = 85.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10        train : [loss = 0.036, top1 = 99.05%], test  : [loss = 0.428, top1 = 89.29%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.31 ms.
cifar100       train : [loss = 0.447, top1 = 87.52%], valid : [loss = 1.420, top1 = 63.95%], test : [loss = 1.413, top1 = 64.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 40.09%], valid : [loss = 2.600, top1 = 35.50%], test : [loss = 2.634, top1 = 34.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.20%], valid : [loss = 0.792, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7908/15625) 007908-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.618, top1 = 87.16%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.402, top1 = 91.05%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.98 ms.
cifar100       train : [loss = 0.172, top1 = 96.17%], valid : [loss = 1.561, top1 = 64.75%], test : [loss = 1.571, top1 = 65.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.26%], valid : [loss = 2.514, top1 = 37.22%], test : [loss = 2.494, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.71%], valid : [loss = 0.781, top1 = 72.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7909/15625) 007909-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.35%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.320, top1 = 92.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.58 ms.
cifar100       train : [loss = 0.155, top1 = 96.63%], valid : [loss = 1.294, top1 = 69.01%], test : [loss = 1.296, top1 = 69.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.87%], valid : [loss = 2.305, top1 = 41.43%], test : [loss = 2.307, top1 = 41.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7910/15625) 007910-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.51%], valid : [loss = 0.537, top1 = 87.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10        train : [loss = 0.052, top1 = 98.44%], test  : [loss = 0.373, top1 = 89.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.15 ms.
cifar100       train : [loss = 0.607, top1 = 82.25%], valid : [loss = 1.324, top1 = 65.07%], test : [loss = 1.307, top1 = 65.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.39%], valid : [loss = 2.518, top1 = 36.33%], test : [loss = 2.565, top1 = 35.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.25%], valid : [loss = 0.619, top1 = 78.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7911/15625) 007911-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.473, top1 = 89.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.02 ms.
cifar100       train : [loss = 0.325, top1 = 91.34%], valid : [loss = 1.262, top1 = 67.40%], test : [loss = 1.255, top1 = 68.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.74%], valid : [loss = 2.319, top1 = 40.51%], test : [loss = 2.337, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7912/15625) 007912-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.498, top1 = 90.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.319, top1 = 93.26%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.05 ms.
cifar100       train : [loss = 0.113, top1 = 97.83%], valid : [loss = 1.277, top1 = 69.48%], test : [loss = 1.303, top1 = 69.57%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.35 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.70%], valid : [loss = 2.175, top1 = 43.80%], test : [loss = 2.179, top1 = 44.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.84%], valid : [loss = 0.630, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7913/15625) 007913-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.517, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.360, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.52 ms.
cifar100       train : [loss = 0.117, top1 = 97.62%], valid : [loss = 1.509, top1 = 66.02%], test : [loss = 1.508, top1 = 67.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 49.23%], valid : [loss = 2.350, top1 = 40.62%], test : [loss = 2.394, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.59%], valid : [loss = 0.737, top1 = 74.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7914/15625) 007914-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.065, top1 = 98.26%], valid : [loss = 0.560, top1 = 85.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.106, top1 = 96.56%], test  : [loss = 0.377, top1 = 88.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.75 ms.
cifar100       train : [loss = 0.774, top1 = 77.60%], valid : [loss = 1.382, top1 = 63.65%], test : [loss = 1.375, top1 = 63.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.75%], valid : [loss = 2.600, top1 = 34.43%], test : [loss = 2.641, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.39%], valid : [loss = 0.905, top1 = 68.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7915/15625) 007915-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.27%], valid : [loss = 0.715, top1 = 80.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10        train : [loss = 0.189, top1 = 93.46%], test  : [loss = 0.514, top1 = 84.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 0.877, top1 = 74.39%], valid : [loss = 1.640, top1 = 57.51%], test : [loss = 1.660, top1 = 56.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 3.476, top1 = 17.32%], valid : [loss = 3.478, top1 = 17.60%], test : [loss = 3.493, top1 = 16.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7916/15625) 007916-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.199, top1 = 93.25%], valid : [loss = 0.524, top1 = 84.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10        train : [loss = 0.210, top1 = 92.86%], test  : [loss = 0.402, top1 = 87.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.11 ms.
cifar100       train : [loss = 1.274, top1 = 63.85%], valid : [loss = 1.561, top1 = 56.89%], test : [loss = 1.570, top1 = 57.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.703, top1 = 32.50%], valid : [loss = 2.743, top1 = 31.53%], test : [loss = 2.776, top1 = 31.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.54%], valid : [loss = 0.992, top1 = 64.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7917/15625) 007917-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.86%], valid : [loss = 0.714, top1 = 83.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10        train : [loss = 0.083, top1 = 97.38%], test  : [loss = 0.484, top1 = 87.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.43 ms.
cifar100       train : [loss = 0.823, top1 = 75.97%], valid : [loss = 1.572, top1 = 59.33%], test : [loss = 1.545, top1 = 59.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.813, top1 = 30.37%], valid : [loss = 2.954, top1 = 28.13%], test : [loss = 2.995, top1 = 27.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.92%], valid : [loss = 0.857, top1 = 69.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7918/15625) 007918-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.425, top1 = 90.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.293, top1 = 93.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.104, top1 = 98.12%], valid : [loss = 1.316, top1 = 69.45%], test : [loss = 1.289, top1 = 70.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 1.658, top1 = 55.58%], valid : [loss = 2.225, top1 = 44.01%], test : [loss = 2.256, top1 = 43.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.17%], valid : [loss = 0.523, top1 = 82.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7919/15625) 007919-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.508, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.357, top1 = 90.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.485, top1 = 85.75%], valid : [loss = 1.336, top1 = 65.68%], test : [loss = 1.329, top1 = 65.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.11%], valid : [loss = 2.543, top1 = 36.25%], test : [loss = 2.566, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.88%], valid : [loss = 0.691, top1 = 76.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7920/15625) 007920-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.45%], valid : [loss = 0.862, top1 = 71.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10        train : [loss = 0.547, top1 = 80.95%], test  : [loss = 0.712, top1 = 75.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.92 ms.
cifar100       train : [loss = 1.760, top1 = 52.49%], valid : [loss = 2.028, top1 = 48.17%], test : [loss = 2.049, top1 = 47.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 16.98%], valid : [loss = 3.635, top1 = 16.38%], test : [loss = 3.670, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7921/15625) 007921-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.521, top1 = 88.66%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.347, top1 = 92.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.17 ms.
cifar100       train : [loss = 0.239, top1 = 93.47%], valid : [loss = 1.334, top1 = 67.57%], test : [loss = 1.354, top1 = 67.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.44%], valid : [loss = 2.521, top1 = 36.05%], test : [loss = 2.551, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.47%], valid : [loss = 0.936, top1 = 66.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7922/15625) 007922-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.83%], valid : [loss = 1.087, top1 = 63.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.780, top1 = 72.72%], test  : [loss = 0.913, top1 = 68.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 2.134, top1 = 44.19%], valid : [loss = 2.402, top1 = 39.44%], test : [loss = 2.423, top1 = 39.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 3.771, top1 = 13.79%], valid : [loss = 3.822, top1 = 13.77%], test : [loss = 3.833, top1 = 13.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.367, top1 = 50.31%], valid : [loss = 1.410, top1 = 48.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7923/15625) 007923-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.88%], valid : [loss = 0.560, top1 = 88.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.008, top1 = 99.79%], test  : [loss = 0.368, top1 = 92.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.05 ms.
cifar100       train : [loss = 0.186, top1 = 95.08%], valid : [loss = 1.399, top1 = 66.82%], test : [loss = 1.376, top1 = 67.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.22%], valid : [loss = 2.419, top1 = 38.43%], test : [loss = 2.416, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 59.73%], valid : [loss = 1.106, top1 = 59.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7924/15625) 007924-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.588, top1 = 86.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.044, top1 = 98.67%], test  : [loss = 0.396, top1 = 89.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.10 ms.
cifar100       train : [loss = 0.563, top1 = 83.40%], valid : [loss = 1.401, top1 = 64.10%], test : [loss = 1.399, top1 = 63.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.94%], valid : [loss = 2.617, top1 = 34.20%], test : [loss = 2.667, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.29%], valid : [loss = 0.722, top1 = 75.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7925/15625) 007925-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.43%], valid : [loss = 0.576, top1 = 87.10%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.21 ms.
cifar10        train : [loss = 0.046, top1 = 98.57%], test  : [loss = 0.375, top1 = 90.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.42 ms.
cifar100       train : [loss = 0.511, top1 = 85.17%], valid : [loss = 1.422, top1 = 64.42%], test : [loss = 1.388, top1 = 64.99%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 2.204, top1 = 42.93%], valid : [loss = 2.398, top1 = 38.62%], test : [loss = 2.423, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.22%], valid : [loss = 0.903, top1 = 67.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7926/15625) 007926-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.486, top1 = 89.75%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.19 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.303, top1 = 93.12%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.48 ms.
cifar100       train : [loss = 0.122, top1 = 97.58%], valid : [loss = 1.251, top1 = 70.56%], test : [loss = 1.240, top1 = 70.61%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 1.673, top1 = 55.14%], valid : [loss = 2.162, top1 = 44.53%], test : [loss = 2.157, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.60%], valid : [loss = 0.732, top1 = 74.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7927/15625) 007927-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.13%], valid : [loss = 0.575, top1 = 86.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10        train : [loss = 0.064, top1 = 97.93%], test  : [loss = 0.372, top1 = 89.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.24 ms.
cifar100       train : [loss = 0.646, top1 = 80.96%], valid : [loss = 1.326, top1 = 64.83%], test : [loss = 1.302, top1 = 64.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.358, top1 = 39.55%], valid : [loss = 2.487, top1 = 36.62%], test : [loss = 2.509, top1 = 37.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7928/15625) 007928-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.522, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.324, top1 = 92.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.17 ms.
cifar100       train : [loss = 0.199, top1 = 95.12%], valid : [loss = 1.271, top1 = 68.12%], test : [loss = 1.255, top1 = 68.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.48%], valid : [loss = 2.302, top1 = 40.70%], test : [loss = 2.297, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 79.04%], valid : [loss = 0.677, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7929/15625) 007929-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.583, top1 = 87.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.387, top1 = 90.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.85 ms.
cifar100       train : [loss = 0.400, top1 = 88.63%], valid : [loss = 1.397, top1 = 65.58%], test : [loss = 1.387, top1 = 65.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.02%], valid : [loss = 2.497, top1 = 37.50%], test : [loss = 2.535, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7930/15625) 007930-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.34%], valid : [loss = 0.573, top1 = 85.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10        train : [loss = 0.108, top1 = 96.46%], test  : [loss = 0.378, top1 = 88.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 0.824, top1 = 75.91%], valid : [loss = 1.429, top1 = 61.52%], test : [loss = 1.429, top1 = 61.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 32.97%], valid : [loss = 2.755, top1 = 31.63%], test : [loss = 2.802, top1 = 30.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.24%], valid : [loss = 0.692, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7931/15625) 007931-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.368, top1 = 86.99%], valid : [loss = 0.619, top1 = 79.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.298, top1 = 89.91%], test  : [loss = 0.434, top1 = 85.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.24 ms.
cifar100       train : [loss = 1.521, top1 = 57.39%], valid : [loss = 1.774, top1 = 51.92%], test : [loss = 1.753, top1 = 52.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.12%], valid : [loss = 3.048, top1 = 26.23%], test : [loss = 3.062, top1 = 25.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.982, top1 = 64.69%], valid : [loss = 1.021, top1 = 63.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7932/15625) 007932-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.515, top1 = 88.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.91 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.341, top1 = 91.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.69 ms.
cifar100       train : [loss = 0.331, top1 = 90.92%], valid : [loss = 1.315, top1 = 67.92%], test : [loss = 1.277, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.97%], valid : [loss = 2.445, top1 = 37.87%], test : [loss = 2.438, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.96%], valid : [loss = 0.839, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7933/15625) 007933-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.52%], valid : [loss = 0.619, top1 = 84.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10        train : [loss = 0.101, top1 = 96.62%], test  : [loss = 0.427, top1 = 88.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.44 ms.
cifar100       train : [loss = 0.656, top1 = 80.50%], valid : [loss = 1.513, top1 = 61.32%], test : [loss = 1.519, top1 = 60.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 21.96%], valid : [loss = 3.223, top1 = 21.07%], test : [loss = 3.243, top1 = 21.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.36%], valid : [loss = 1.045, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7934/15625) 007934-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.610, top1 = 86.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.414, top1 = 90.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.75 ms.
cifar100       train : [loss = 0.286, top1 = 92.40%], valid : [loss = 1.537, top1 = 63.72%], test : [loss = 1.535, top1 = 64.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 44.04%], valid : [loss = 2.508, top1 = 38.63%], test : [loss = 2.552, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.40%], valid : [loss = 0.782, top1 = 72.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7935/15625) 007935-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.572, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.022, top1 = 99.45%], test  : [loss = 0.377, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.459, top1 = 86.70%], valid : [loss = 1.381, top1 = 65.34%], test : [loss = 1.400, top1 = 65.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.330, top1 = 40.15%], valid : [loss = 2.523, top1 = 36.40%], test : [loss = 2.584, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.54%], valid : [loss = 0.821, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7936/15625) 007936-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.19%], valid : [loss = 0.743, top1 = 74.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10        train : [loss = 0.518, top1 = 82.03%], test  : [loss = 0.602, top1 = 79.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.19 ms.
cifar100       train : [loss = 2.046, top1 = 44.86%], valid : [loss = 2.159, top1 = 42.89%], test : [loss = 2.167, top1 = 42.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 3.024, top1 = 26.10%], valid : [loss = 3.014, top1 = 26.13%], test : [loss = 3.046, top1 = 25.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7937/15625) 007937-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.34%], valid : [loss = 0.459, top1 = 86.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.161, top1 = 94.89%], test  : [loss = 0.353, top1 = 88.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 0.978, top1 = 72.25%], valid : [loss = 1.357, top1 = 62.32%], test : [loss = 1.363, top1 = 62.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.71%], valid : [loss = 2.707, top1 = 31.97%], test : [loss = 2.730, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7938/15625) 007938-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.480, top1 = 89.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.310, top1 = 92.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.34 ms.
cifar100       train : [loss = 0.271, top1 = 93.16%], valid : [loss = 1.186, top1 = 68.94%], test : [loss = 1.188, top1 = 69.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.56%], valid : [loss = 2.230, top1 = 42.60%], test : [loss = 2.235, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7939/15625) 007939-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.519, top1 = 88.54%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.34 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.326, top1 = 92.33%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.30 ms.
cifar100       train : [loss = 0.341, top1 = 90.68%], valid : [loss = 1.279, top1 = 67.24%], test : [loss = 1.296, top1 = 67.16%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.66%], valid : [loss = 2.407, top1 = 39.20%], test : [loss = 2.389, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.87%], valid : [loss = 0.717, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7940/15625) 007940-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.350, top1 = 87.75%], valid : [loss = 0.614, top1 = 80.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.296, top1 = 89.97%], test  : [loss = 0.451, top1 = 85.04%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 1.609, top1 = 55.35%], valid : [loss = 1.816, top1 = 51.68%], test : [loss = 1.814, top1 = 50.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 3.088, top1 = 25.17%], valid : [loss = 3.100, top1 = 25.37%], test : [loss = 3.141, top1 = 24.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.40%], valid : [loss = 1.014, top1 = 63.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7941/15625) 007941-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.20%], valid : [loss = 0.534, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.183, top1 = 93.82%], test  : [loss = 0.391, top1 = 87.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.76 ms.
cifar100       train : [loss = 1.176, top1 = 66.52%], valid : [loss = 1.511, top1 = 58.81%], test : [loss = 1.504, top1 = 58.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 34.03%], valid : [loss = 2.693, top1 = 33.04%], test : [loss = 2.738, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7942/15625) 007942-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.481, top1 = 89.14%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.98 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.302, top1 = 92.75%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.98 ms.
cifar100       train : [loss = 0.227, top1 = 94.64%], valid : [loss = 1.240, top1 = 68.38%], test : [loss = 1.253, top1 = 68.30%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.36 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.27%], valid : [loss = 2.283, top1 = 41.33%], test : [loss = 2.306, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.81%], valid : [loss = 0.665, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7943/15625) 007943-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.38%], valid : [loss = 0.530, top1 = 83.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.251, top1 = 91.44%], test  : [loss = 0.406, top1 = 86.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.80 ms.
cifar100       train : [loss = 1.275, top1 = 63.99%], valid : [loss = 1.579, top1 = 57.39%], test : [loss = 1.573, top1 = 57.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 2.865, top1 = 29.50%], valid : [loss = 2.858, top1 = 29.78%], test : [loss = 2.927, top1 = 28.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 64.92%], valid : [loss = 1.016, top1 = 64.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7944/15625) 007944-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.601, top1 = 87.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.375, top1 = 92.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.74 ms.
cifar100       train : [loss = 0.157, top1 = 96.72%], valid : [loss = 1.467, top1 = 66.72%], test : [loss = 1.428, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.85%], valid : [loss = 2.448, top1 = 38.23%], test : [loss = 2.482, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.682, top1 = 75.88%], valid : [loss = 0.764, top1 = 73.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7945/15625) 007945-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.641, top1 = 87.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.412, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.41 ms.
cifar100       train : [loss = 0.262, top1 = 93.35%], valid : [loss = 1.558, top1 = 64.38%], test : [loss = 1.554, top1 = 64.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.189, top1 = 43.39%], valid : [loss = 2.562, top1 = 35.90%], test : [loss = 2.573, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.812, top1 = 71.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7946/15625) 007946-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.600, top1 = 87.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.398, top1 = 90.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.54 ms.
cifar100       train : [loss = 0.275, top1 = 92.74%], valid : [loss = 1.549, top1 = 63.92%], test : [loss = 1.477, top1 = 64.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 44.12%], valid : [loss = 2.518, top1 = 36.40%], test : [loss = 2.534, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.69%], valid : [loss = 0.737, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7947/15625) 007947-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.487, top1 = 88.98%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.315, top1 = 91.92%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.06 ms.
cifar100       train : [loss = 0.288, top1 = 92.53%], valid : [loss = 1.215, top1 = 69.04%], test : [loss = 1.221, top1 = 68.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.61%], valid : [loss = 2.225, top1 = 43.07%], test : [loss = 2.219, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.16%], valid : [loss = 0.684, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7948/15625) 007948-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.509, top1 = 88.77%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=21.09 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.330, top1 = 92.36%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.41 ms.
cifar100       train : [loss = 0.238, top1 = 94.09%], valid : [loss = 1.341, top1 = 66.76%], test : [loss = 1.284, top1 = 67.58%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.19%], valid : [loss = 2.327, top1 = 41.10%], test : [loss = 2.321, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.84%], valid : [loss = 0.654, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7949/15625) 007949-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.560, top1 = 88.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.04 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.395, top1 = 91.03%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.44 ms.
cifar100       train : [loss = 0.211, top1 = 95.17%], valid : [loss = 1.420, top1 = 66.88%], test : [loss = 1.420, top1 = 66.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.18%], valid : [loss = 2.483, top1 = 39.07%], test : [loss = 2.504, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.41%], valid : [loss = 0.747, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7950/15625) 007950-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.69%], valid : [loss = 0.606, top1 = 86.11%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=17.52 ms.
cifar10        train : [loss = 0.032, top1 = 99.07%], test  : [loss = 0.389, top1 = 90.22%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=17.95 ms.
cifar100       train : [loss = 0.566, top1 = 83.45%], valid : [loss = 1.423, top1 = 63.78%], test : [loss = 1.445, top1 = 62.95%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.23%], valid : [loss = 2.566, top1 = 35.61%], test : [loss = 2.586, top1 = 35.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.33%], valid : [loss = 0.813, top1 = 71.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7951/15625) 007951-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.522, top1 = 88.61%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.53 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.310, top1 = 92.30%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.11 ms.
cifar100       train : [loss = 0.327, top1 = 91.26%], valid : [loss = 1.406, top1 = 65.08%], test : [loss = 1.414, top1 = 65.54%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.27 ms.
ImageNet16-120 train : [loss = 2.223, top1 = 42.56%], valid : [loss = 2.373, top1 = 39.27%], test : [loss = 2.385, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.36%], valid : [loss = 0.837, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7952/15625) 007952-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.73%], valid : [loss = 0.842, top1 = 72.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10        train : [loss = 0.563, top1 = 80.20%], test  : [loss = 0.731, top1 = 75.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.16 ms.
cifar100       train : [loss = 1.774, top1 = 52.40%], valid : [loss = 2.065, top1 = 46.52%], test : [loss = 2.063, top1 = 47.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.76%], valid : [loss = 3.625, top1 = 16.40%], test : [loss = 3.655, top1 = 16.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7953/15625) 007953-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.455, top1 = 90.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.322, top1 = 93.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.41 ms.
cifar100       train : [loss = 0.086, top1 = 98.45%], valid : [loss = 1.401, top1 = 69.28%], test : [loss = 1.421, top1 = 68.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 1.666, top1 = 55.47%], valid : [loss = 2.271, top1 = 43.83%], test : [loss = 2.316, top1 = 42.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.48%], valid : [loss = 0.584, top1 = 80.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7954/15625) 007954-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.82%], valid : [loss = 0.461, top1 = 86.61%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.22 ms.
cifar10        train : [loss = 0.116, top1 = 96.37%], test  : [loss = 0.336, top1 = 89.43%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.70 ms.
cifar100       train : [loss = 0.745, top1 = 79.14%], valid : [loss = 1.280, top1 = 64.48%], test : [loss = 1.280, top1 = 64.46%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.04%], valid : [loss = 2.579, top1 = 35.71%], test : [loss = 2.610, top1 = 34.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.20%], valid : [loss = 0.826, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7955/15625) 007955-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.534, top1 = 88.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.328, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.95 ms.
cifar100       train : [loss = 0.362, top1 = 89.97%], valid : [loss = 1.281, top1 = 66.94%], test : [loss = 1.274, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.60%], valid : [loss = 2.422, top1 = 38.88%], test : [loss = 2.416, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7956/15625) 007956-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.22%], valid : [loss = 0.456, top1 = 86.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.14 ms.
cifar10        train : [loss = 0.157, top1 = 94.86%], test  : [loss = 0.351, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.54 ms.
cifar100       train : [loss = 0.995, top1 = 71.65%], valid : [loss = 1.353, top1 = 61.89%], test : [loss = 1.342, top1 = 62.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.96%], valid : [loss = 2.685, top1 = 33.09%], test : [loss = 2.700, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7957/15625) 007957-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.05%], valid : [loss = 0.473, top1 = 85.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10        train : [loss = 0.151, top1 = 95.06%], test  : [loss = 0.342, top1 = 89.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.35 ms.
cifar100       train : [loss = 0.973, top1 = 72.23%], valid : [loss = 1.378, top1 = 62.30%], test : [loss = 1.333, top1 = 62.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 34.01%], valid : [loss = 2.663, top1 = 33.33%], test : [loss = 2.702, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7958/15625) 007958-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.292, top1 = 89.99%], valid : [loss = 0.544, top1 = 82.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.18 ms.
cifar10        train : [loss = 0.245, top1 = 91.72%], test  : [loss = 0.384, top1 = 87.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.90 ms.
cifar100       train : [loss = 1.369, top1 = 61.36%], valid : [loss = 1.627, top1 = 55.84%], test : [loss = 1.642, top1 = 55.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.59 ms.
ImageNet16-120 train : [loss = 2.854, top1 = 29.50%], valid : [loss = 2.838, top1 = 30.67%], test : [loss = 2.884, top1 = 29.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.062, top1 = 61.62%], valid : [loss = 1.108, top1 = 60.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7959/15625) 007959-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.68%], valid : [loss = 0.823, top1 = 80.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.127, top1 = 95.80%], test  : [loss = 0.553, top1 = 84.71%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.98 ms.
cifar100       train : [loss = 0.873, top1 = 74.66%], valid : [loss = 1.698, top1 = 57.02%], test : [loss = 1.706, top1 = 56.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 3.021, top1 = 26.74%], valid : [loss = 3.173, top1 = 24.00%], test : [loss = 3.187, top1 = 23.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.059, top1 = 61.74%], valid : [loss = 1.121, top1 = 59.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7960/15625) 007960-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.557, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.354, top1 = 92.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.30 ms.
cifar100       train : [loss = 0.097, top1 = 98.30%], valid : [loss = 1.476, top1 = 67.58%], test : [loss = 1.450, top1 = 68.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.74%], valid : [loss = 2.448, top1 = 38.80%], test : [loss = 2.430, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.54%], valid : [loss = 0.726, top1 = 75.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7961/15625) 007961-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.96%], valid : [loss = 0.668, top1 = 83.22%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.75 ms.
cifar10        train : [loss = 0.102, top1 = 96.58%], test  : [loss = 0.450, top1 = 87.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.82 ms.
cifar100       train : [loss = 0.888, top1 = 74.06%], valid : [loss = 1.549, top1 = 59.38%], test : [loss = 1.539, top1 = 58.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.53%], valid : [loss = 2.672, top1 = 32.03%], test : [loss = 2.690, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 68.12%], valid : [loss = 0.932, top1 = 66.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7962/15625) 007962-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.62%], valid : [loss = 0.478, top1 = 84.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.69 ms.
cifar10        train : [loss = 0.248, top1 = 91.49%], test  : [loss = 0.406, top1 = 86.61%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.36 ms.
cifar100       train : [loss = 1.435, top1 = 59.91%], valid : [loss = 1.687, top1 = 54.14%], test : [loss = 1.655, top1 = 54.46%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 3.079, top1 = 24.97%], valid : [loss = 3.109, top1 = 25.03%], test : [loss = 3.115, top1 = 24.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.85%], valid : [loss = 1.017, top1 = 63.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7963/15625) 007963-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.502, top1 = 90.04%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.306, top1 = 93.66%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=23.66 ms.
cifar100       train : [loss = 0.043, top1 = 99.55%], valid : [loss = 1.374, top1 = 69.48%], test : [loss = 1.360, top1 = 70.30%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.38 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.02%], valid : [loss = 2.298, top1 = 41.10%], test : [loss = 2.297, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.35%], valid : [loss = 0.794, top1 = 72.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7964/15625) 007964-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.90%], valid : [loss = 0.531, top1 = 89.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=20.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.324, top1 = 92.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.93 ms.
cifar100       train : [loss = 0.117, top1 = 97.73%], valid : [loss = 1.303, top1 = 70.18%], test : [loss = 1.292, top1 = 69.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.54%], valid : [loss = 2.209, top1 = 42.60%], test : [loss = 2.242, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7965/15625) 007965-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.26%], valid : [loss = 0.738, top1 = 82.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.110, top1 = 96.42%], test  : [loss = 0.474, top1 = 86.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 0.885, top1 = 74.40%], valid : [loss = 1.558, top1 = 59.22%], test : [loss = 1.506, top1 = 60.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.80 ms.
ImageNet16-120 train : [loss = 2.740, top1 = 31.88%], valid : [loss = 2.843, top1 = 30.36%], test : [loss = 2.892, top1 = 29.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.883, top1 = 68.75%], valid : [loss = 0.931, top1 = 67.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7966/15625) 007966-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.506, top1 = 89.03%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=14.35 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.319, top1 = 92.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.44 ms.
cifar100       train : [loss = 0.334, top1 = 91.07%], valid : [loss = 1.316, top1 = 65.52%], test : [loss = 1.253, top1 = 67.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.09%], valid : [loss = 2.400, top1 = 39.23%], test : [loss = 2.443, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.41%], valid : [loss = 0.665, top1 = 76.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7967/15625) 007967-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.35%], valid : [loss = 0.589, top1 = 81.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10        train : [loss = 0.260, top1 = 91.09%], test  : [loss = 0.409, top1 = 86.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 1.451, top1 = 59.30%], valid : [loss = 1.704, top1 = 53.66%], test : [loss = 1.702, top1 = 53.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.955, top1 = 27.58%], valid : [loss = 2.975, top1 = 27.78%], test : [loss = 3.024, top1 = 26.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7968/15625) 007968-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.593, top1 = 88.27%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.57 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.383, top1 = 91.61%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.49 ms.
cifar100       train : [loss = 0.267, top1 = 93.05%], valid : [loss = 1.518, top1 = 63.68%], test : [loss = 1.502, top1 = 64.46%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 2.418, top1 = 37.69%], valid : [loss = 2.560, top1 = 35.37%], test : [loss = 2.581, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.273, top1 = 53.01%], valid : [loss = 1.286, top1 = 52.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7969/15625) 007969-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.12%], valid : [loss = 0.651, top1 = 78.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.510, top1 = 82.30%], test  : [loss = 0.593, top1 = 79.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 1.698, top1 = 53.88%], valid : [loss = 1.851, top1 = 50.35%], test : [loss = 1.870, top1 = 50.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.35%], valid : [loss = 3.307, top1 = 21.47%], test : [loss = 3.349, top1 = 20.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7970/15625) 007970-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.12%], valid : [loss = 0.607, top1 = 85.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.075, top1 = 97.67%], test  : [loss = 0.378, top1 = 89.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.67 ms.
cifar100       train : [loss = 0.717, top1 = 79.25%], valid : [loss = 1.375, top1 = 63.60%], test : [loss = 1.349, top1 = 63.74%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.562, top1 = 35.44%], valid : [loss = 2.651, top1 = 34.10%], test : [loss = 2.698, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7971/15625) 007971-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.640, top1 = 85.93%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=16.19 ms.
cifar10        train : [loss = 0.038, top1 = 98.94%], test  : [loss = 0.436, top1 = 89.31%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=15.73 ms.
cifar100       train : [loss = 0.463, top1 = 86.99%], valid : [loss = 1.449, top1 = 63.70%], test : [loss = 1.419, top1 = 64.32%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.52%], valid : [loss = 2.589, top1 = 35.27%], test : [loss = 2.612, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.40%], valid : [loss = 0.755, top1 = 73.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7972/15625) 007972-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.582, top1 = 88.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.99 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.392, top1 = 92.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.14 ms.
cifar100       train : [loss = 0.089, top1 = 98.42%], valid : [loss = 1.563, top1 = 66.93%], test : [loss = 1.523, top1 = 67.29%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.01 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.57%], valid : [loss = 2.385, top1 = 39.80%], test : [loss = 2.393, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.00%], valid : [loss = 0.798, top1 = 71.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7973/15625) 007973-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.14%], valid : [loss = 0.582, top1 = 86.72%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.33 ms.
cifar10        train : [loss = 0.063, top1 = 97.99%], test  : [loss = 0.372, top1 = 89.90%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=20.23 ms.
cifar100       train : [loss = 0.638, top1 = 81.01%], valid : [loss = 1.341, top1 = 64.36%], test : [loss = 1.324, top1 = 65.18%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.57 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.11%], valid : [loss = 2.471, top1 = 37.57%], test : [loss = 2.512, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.35%], valid : [loss = 0.767, top1 = 73.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7974/15625) 007974-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.533, top1 = 88.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.339, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.326, top1 = 90.99%], valid : [loss = 1.295, top1 = 67.35%], test : [loss = 1.300, top1 = 67.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.10%], valid : [loss = 2.417, top1 = 38.90%], test : [loss = 2.435, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7975/15625) 007975-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.38%], valid : [loss = 0.537, top1 = 87.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.00 ms.
cifar10        train : [loss = 0.035, top1 = 98.92%], test  : [loss = 0.364, top1 = 90.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.472, top1 = 86.20%], valid : [loss = 1.262, top1 = 66.96%], test : [loss = 1.257, top1 = 66.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.30%], valid : [loss = 2.394, top1 = 38.93%], test : [loss = 2.387, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.95%], valid : [loss = 0.988, top1 = 65.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7976/15625) 007976-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.06 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.573, top1 = 88.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.37 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.393, top1 = 91.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.50 ms.
cifar100       train : [loss = 0.201, top1 = 95.18%], valid : [loss = 1.342, top1 = 67.56%], test : [loss = 1.382, top1 = 67.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.71%], valid : [loss = 2.308, top1 = 40.57%], test : [loss = 2.288, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 76.09%], valid : [loss = 0.744, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7977/15625) 007977-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.605, top1 = 85.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.61 ms.
cifar10        train : [loss = 0.073, top1 = 97.75%], test  : [loss = 0.396, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.64 ms.
cifar100       train : [loss = 0.715, top1 = 79.26%], valid : [loss = 1.373, top1 = 63.41%], test : [loss = 1.367, top1 = 63.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.10%], valid : [loss = 2.635, top1 = 33.97%], test : [loss = 2.677, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7978/15625) 007978-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.586, top1 = 86.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.55 ms.
cifar10        train : [loss = 0.022, top1 = 99.48%], test  : [loss = 0.396, top1 = 90.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.27 ms.
cifar100       train : [loss = 0.334, top1 = 91.31%], valid : [loss = 1.360, top1 = 66.70%], test : [loss = 1.366, top1 = 65.54%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 44.04%], valid : [loss = 2.504, top1 = 37.57%], test : [loss = 2.539, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.84%], valid : [loss = 0.747, top1 = 74.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7979/15625) 007979-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.49%], valid : [loss = 0.529, top1 = 84.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.176, top1 = 94.05%], test  : [loss = 0.386, top1 = 87.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.54 ms.
cifar100       train : [loss = 1.212, top1 = 65.64%], valid : [loss = 1.518, top1 = 58.52%], test : [loss = 1.505, top1 = 58.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.83%], valid : [loss = 2.701, top1 = 32.29%], test : [loss = 2.734, top1 = 31.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.50%], valid : [loss = 0.952, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7980/15625) 007980-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.621, top1 = 85.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.67 ms.
cifar10        train : [loss = 0.068, top1 = 98.01%], test  : [loss = 0.399, top1 = 88.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.73 ms.
cifar100       train : [loss = 0.702, top1 = 79.46%], valid : [loss = 1.380, top1 = 63.58%], test : [loss = 1.342, top1 = 64.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 35.90%], valid : [loss = 2.654, top1 = 33.17%], test : [loss = 2.671, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.16%], valid : [loss = 0.781, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7981/15625) 007981-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.597, top1 = 87.09%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=17.53 ms.
cifar10        train : [loss = 0.021, top1 = 99.43%], test  : [loss = 0.396, top1 = 90.56%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=16.50 ms.
cifar100       train : [loss = 0.380, top1 = 89.26%], valid : [loss = 1.418, top1 = 65.39%], test : [loss = 1.411, top1 = 64.99%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=19.34 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.08%], valid : [loss = 2.481, top1 = 37.77%], test : [loss = 2.510, top1 = 37.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.65%], valid : [loss = 0.767, top1 = 73.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7982/15625) 007982-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.56%], valid : [loss = 0.546, top1 = 83.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10        train : [loss = 0.197, top1 = 93.32%], test  : [loss = 0.397, top1 = 87.40%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.67 ms.
cifar100       train : [loss = 1.241, top1 = 64.60%], valid : [loss = 1.565, top1 = 57.06%], test : [loss = 1.538, top1 = 57.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.09%], valid : [loss = 2.685, top1 = 32.89%], test : [loss = 2.715, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.81%], valid : [loss = 0.996, top1 = 64.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7983/15625) 007983-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.29%], valid : [loss = 0.857, top1 = 71.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.55 ms.
cifar10        train : [loss = 0.568, top1 = 80.13%], test  : [loss = 0.708, top1 = 75.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 1.807, top1 = 51.45%], valid : [loss = 2.064, top1 = 46.46%], test : [loss = 2.065, top1 = 46.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.28 ms.
ImageNet16-120 train : [loss = 3.598, top1 = 16.64%], valid : [loss = 3.648, top1 = 16.13%], test : [loss = 3.670, top1 = 15.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7984/15625) 007984-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.606, top1 = 86.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.05 ms.
cifar10        train : [loss = 0.028, top1 = 99.31%], test  : [loss = 0.444, top1 = 89.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.09 ms.
cifar100       train : [loss = 0.375, top1 = 90.06%], valid : [loss = 1.415, top1 = 65.06%], test : [loss = 1.440, top1 = 63.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.85%], valid : [loss = 2.633, top1 = 33.90%], test : [loss = 2.629, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7985/15625) 007985-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.484, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.70 ms.
cifar100       train : [loss = 0.286, top1 = 92.43%], valid : [loss = 1.214, top1 = 68.94%], test : [loss = 1.243, top1 = 68.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.09%], valid : [loss = 2.206, top1 = 43.27%], test : [loss = 2.226, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7986/15625) 007986-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.596, top1 = 88.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.370, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 0.198, top1 = 95.32%], valid : [loss = 1.515, top1 = 65.70%], test : [loss = 1.543, top1 = 65.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.092, top1 = 45.55%], valid : [loss = 2.481, top1 = 37.67%], test : [loss = 2.557, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.57%], valid : [loss = 0.752, top1 = 73.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7987/15625) 007987-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.537, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.43 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.326, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.72 ms.
cifar100       train : [loss = 0.142, top1 = 96.95%], valid : [loss = 1.284, top1 = 68.78%], test : [loss = 1.349, top1 = 68.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.81%], valid : [loss = 2.263, top1 = 42.17%], test : [loss = 2.260, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.03%], valid : [loss = 0.675, top1 = 76.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7988/15625) 007988-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.39%], valid : [loss = 0.876, top1 = 71.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.42 ms.
cifar10        train : [loss = 0.564, top1 = 80.32%], test  : [loss = 0.730, top1 = 75.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.18 ms.
cifar100       train : [loss = 1.785, top1 = 51.85%], valid : [loss = 2.038, top1 = 47.80%], test : [loss = 2.087, top1 = 46.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.01 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.67%], valid : [loss = 3.637, top1 = 16.40%], test : [loss = 3.663, top1 = 15.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7989/15625) 007989-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.444, top1 = 90.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.308, top1 = 92.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.61 ms.
cifar100       train : [loss = 0.103, top1 = 98.06%], valid : [loss = 1.371, top1 = 68.76%], test : [loss = 1.337, top1 = 69.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.66 ms.
ImageNet16-120 train : [loss = 1.681, top1 = 55.01%], valid : [loss = 2.274, top1 = 42.62%], test : [loss = 2.322, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.09%], valid : [loss = 0.548, top1 = 81.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7990/15625) 007990-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.579, top1 = 88.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.51 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.360, top1 = 92.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.15 ms.
cifar100       train : [loss = 0.080, top1 = 98.68%], valid : [loss = 1.490, top1 = 67.42%], test : [loss = 1.456, top1 = 68.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.809, top1 = 51.97%], valid : [loss = 2.345, top1 = 40.73%], test : [loss = 2.372, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 76.97%], valid : [loss = 0.723, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7991/15625) 007991-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.544, top1 = 88.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.350, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.67 ms.
cifar100       train : [loss = 0.289, top1 = 91.97%], valid : [loss = 1.326, top1 = 67.51%], test : [loss = 1.311, top1 = 67.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.88%], valid : [loss = 2.439, top1 = 38.54%], test : [loss = 2.434, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7992/15625) 007992-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.95%], valid : [loss = 0.495, top1 = 84.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.289, top1 = 90.15%], test  : [loss = 0.395, top1 = 86.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.91 ms.
cifar100       train : [loss = 1.292, top1 = 63.59%], valid : [loss = 1.513, top1 = 58.04%], test : [loss = 1.501, top1 = 58.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 2.868, top1 = 29.52%], valid : [loss = 2.852, top1 = 30.13%], test : [loss = 2.905, top1 = 28.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.33%], valid : [loss = 0.970, top1 = 65.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7993/15625) 007993-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.496, top1 = 88.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.315, top1 = 92.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.99 ms.
cifar100       train : [loss = 0.320, top1 = 91.22%], valid : [loss = 1.276, top1 = 67.58%], test : [loss = 1.256, top1 = 67.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.72%], valid : [loss = 2.302, top1 = 40.93%], test : [loss = 2.334, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7994/15625) 007994-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10-valid  train : [loss = 1.834, top1 = 33.76%], valid : [loss = 1.856, top1 = 33.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 1.276, top1 = 53.99%], test  : [loss = 1.284, top1 = 53.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.28 ms.
cifar100       train : [loss = 3.817, top1 = 11.61%], valid : [loss = 3.911, top1 = 10.06%], test : [loss = 3.910, top1 = 10.58%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.35 ms.
ImageNet16-120 train : [loss = 3.819, top1 = 12.92%], valid : [loss = 3.796, top1 = 14.57%], test : [loss = 3.810, top1 = 12.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.965, top1 = 27.36%], valid : [loss = 1.966, top1 = 27.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7995/15625) 007995-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.56 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7996/15625) 007996-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.35%], valid : [loss = 0.617, top1 = 79.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.73 ms.
cifar10        train : [loss = 0.292, top1 = 89.94%], test  : [loss = 0.425, top1 = 86.04%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.19 ms.
cifar100       train : [loss = 1.578, top1 = 56.04%], valid : [loss = 1.792, top1 = 51.30%], test : [loss = 1.796, top1 = 51.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.944, top1 = 27.72%], valid : [loss = 2.984, top1 = 27.20%], test : [loss = 2.999, top1 = 27.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.49%], valid : [loss = 1.027, top1 = 63.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7997/15625) 007997-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.40%], valid : [loss = 0.548, top1 = 85.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10        train : [loss = 0.080, top1 = 97.64%], test  : [loss = 0.345, top1 = 90.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.08 ms.
cifar100       train : [loss = 0.673, top1 = 80.52%], valid : [loss = 1.337, top1 = 64.20%], test : [loss = 1.338, top1 = 63.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.84%], valid : [loss = 2.581, top1 = 34.57%], test : [loss = 2.613, top1 = 35.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.32%], valid : [loss = 0.890, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7998/15625) 007998-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.56%], valid : [loss = 0.448, top1 = 87.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.67 ms.
cifar10        train : [loss = 0.056, top1 = 98.68%], test  : [loss = 0.308, top1 = 90.53%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.90 ms.
cifar100       train : [loss = 0.585, top1 = 83.98%], valid : [loss = 1.207, top1 = 66.88%], test : [loss = 1.194, top1 = 67.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.25%], valid : [loss = 2.477, top1 = 37.93%], test : [loss = 2.467, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.95%], valid : [loss = 0.638, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 7999/15625) 007999-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.47%], valid : [loss = 0.538, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10        train : [loss = 0.036, top1 = 98.88%], test  : [loss = 0.353, top1 = 90.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.76 ms.
cifar100       train : [loss = 0.450, top1 = 86.73%], valid : [loss = 1.281, top1 = 67.28%], test : [loss = 1.275, top1 = 66.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.267, top1 = 41.47%], valid : [loss = 2.455, top1 = 38.20%], test : [loss = 2.466, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.29%], valid : [loss = 0.954, top1 = 66.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8000/15625) 008000-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.48%], valid : [loss = 0.458, top1 = 87.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.110, top1 = 96.64%], test  : [loss = 0.335, top1 = 89.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.17 ms.
cifar100       train : [loss = 0.876, top1 = 74.96%], valid : [loss = 1.292, top1 = 64.26%], test : [loss = 1.279, top1 = 63.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.57%], valid : [loss = 2.643, top1 = 33.77%], test : [loss = 2.685, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8001/15625) 008001-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.68%], valid : [loss = 0.630, top1 = 86.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.037, top1 = 98.98%], test  : [loss = 0.420, top1 = 89.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.89 ms.
cifar100       train : [loss = 0.518, top1 = 84.85%], valid : [loss = 1.415, top1 = 63.22%], test : [loss = 1.433, top1 = 63.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.40%], valid : [loss = 2.557, top1 = 35.77%], test : [loss = 2.594, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8002/15625) 008002-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.430, top1 = 91.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.05 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.294, top1 = 93.94%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.33 ms.
cifar100       train : [loss = 0.037, top1 = 99.56%], valid : [loss = 1.309, top1 = 71.60%], test : [loss = 1.339, top1 = 71.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 1.350, top1 = 62.77%], valid : [loss = 2.188, top1 = 46.27%], test : [loss = 2.215, top1 = 45.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 86.94%], valid : [loss = 0.498, top1 = 83.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8003/15625) 008003-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.72%], valid : [loss = 0.455, top1 = 86.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.147, top1 = 95.29%], test  : [loss = 0.340, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 0.970, top1 = 72.35%], valid : [loss = 1.350, top1 = 62.17%], test : [loss = 1.342, top1 = 62.53%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.17%], valid : [loss = 2.678, top1 = 33.30%], test : [loss = 2.684, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8004/15625) 008004-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.472, top1 = 90.73%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.46 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.327, top1 = 93.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.35 ms.
cifar100       train : [loss = 0.034, top1 = 99.57%], valid : [loss = 1.371, top1 = 71.48%], test : [loss = 1.389, top1 = 71.50%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 1.390, top1 = 62.15%], valid : [loss = 2.244, top1 = 44.20%], test : [loss = 2.292, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.04%], valid : [loss = 0.513, top1 = 83.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8005/15625) 008005-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.19%], valid : [loss = 0.455, top1 = 87.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10        train : [loss = 0.117, top1 = 96.35%], test  : [loss = 0.330, top1 = 89.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.84 ms.
cifar100       train : [loss = 0.859, top1 = 75.59%], valid : [loss = 1.300, top1 = 63.59%], test : [loss = 1.292, top1 = 63.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.69%], valid : [loss = 2.630, top1 = 34.62%], test : [loss = 2.657, top1 = 33.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8006/15625) 008006-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.565, top1 = 87.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.398, top1 = 91.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.67 ms.
cifar100       train : [loss = 0.404, top1 = 88.56%], valid : [loss = 1.438, top1 = 64.94%], test : [loss = 1.421, top1 = 65.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.95%], valid : [loss = 2.532, top1 = 35.77%], test : [loss = 2.571, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.58%], valid : [loss = 0.823, top1 = 71.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8007/15625) 008007-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.73 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.25%], valid : [loss = 0.597, top1 = 84.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.70 ms.
cifar10        train : [loss = 0.085, top1 = 97.39%], test  : [loss = 0.374, top1 = 89.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.66 ms.
cifar100       train : [loss = 0.700, top1 = 79.57%], valid : [loss = 1.369, top1 = 63.90%], test : [loss = 1.364, top1 = 63.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.450, top1 = 37.56%], valid : [loss = 2.559, top1 = 35.53%], test : [loss = 2.599, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.29%], valid : [loss = 0.871, top1 = 69.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8008/15625) 008008-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.269, top1 = 93.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.73 ms.
cifar100       train : [loss = 0.187, top1 = 95.52%], valid : [loss = 1.263, top1 = 70.06%], test : [loss = 1.289, top1 = 69.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.50%], valid : [loss = 2.278, top1 = 43.13%], test : [loss = 2.285, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8009/15625) 008009-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.74%], valid : [loss = 0.544, top1 = 83.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10        train : [loss = 0.207, top1 = 93.00%], test  : [loss = 0.395, top1 = 87.52%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.52 ms.
cifar100       train : [loss = 1.264, top1 = 64.11%], valid : [loss = 1.562, top1 = 57.06%], test : [loss = 1.570, top1 = 57.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.94%], valid : [loss = 2.722, top1 = 31.94%], test : [loss = 2.765, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.29%], valid : [loss = 1.017, top1 = 64.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8010/15625) 008010-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.49%], valid : [loss = 0.468, top1 = 85.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10        train : [loss = 0.157, top1 = 94.85%], test  : [loss = 0.346, top1 = 88.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.023, top1 = 70.86%], valid : [loss = 1.385, top1 = 61.20%], test : [loss = 1.373, top1 = 61.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.80%], valid : [loss = 2.709, top1 = 32.33%], test : [loss = 2.718, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8011/15625) 008011-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.53%], valid : [loss = 0.457, top1 = 87.64%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.29 ms.
cifar10        train : [loss = 0.056, top1 = 98.58%], test  : [loss = 0.319, top1 = 90.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.40 ms.
cifar100       train : [loss = 0.588, top1 = 83.77%], valid : [loss = 1.237, top1 = 66.70%], test : [loss = 1.214, top1 = 66.12%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.23%], valid : [loss = 2.469, top1 = 37.30%], test : [loss = 2.475, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.30%], valid : [loss = 0.645, top1 = 78.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8012/15625) 008012-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.499, top1 = 89.85%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.63 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.329, top1 = 93.00%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.26 ms.
cifar100       train : [loss = 0.072, top1 = 98.92%], valid : [loss = 1.354, top1 = 68.74%], test : [loss = 1.352, top1 = 69.94%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.19 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.06%], valid : [loss = 2.285, top1 = 42.23%], test : [loss = 2.259, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 79.04%], valid : [loss = 0.669, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8013/15625) 008013-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.45%], valid : [loss = 0.452, top1 = 86.44%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.61 ms.
cifar10        train : [loss = 0.168, top1 = 94.51%], test  : [loss = 0.336, top1 = 89.32%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.22 ms.
cifar100       train : [loss = 1.012, top1 = 71.22%], valid : [loss = 1.367, top1 = 62.20%], test : [loss = 1.380, top1 = 61.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.70%], valid : [loss = 2.688, top1 = 32.57%], test : [loss = 2.714, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.00%], valid : [loss = 0.791, top1 = 71.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8014/15625) 008014-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.558, top1 = 87.92%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.10 ms.
cifar10        train : [loss = 0.025, top1 = 99.26%], test  : [loss = 0.360, top1 = 91.32%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.32 ms.
cifar100       train : [loss = 0.296, top1 = 91.77%], valid : [loss = 1.343, top1 = 67.36%], test : [loss = 1.349, top1 = 67.52%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.69%], valid : [loss = 2.459, top1 = 37.30%], test : [loss = 2.458, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.26%], valid : [loss = 0.953, top1 = 66.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8015/15625) 008015-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.86%], valid : [loss = 0.619, top1 = 79.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.03 ms.
cifar10        train : [loss = 0.328, top1 = 88.68%], test  : [loss = 0.471, top1 = 84.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.74 ms.
cifar100       train : [loss = 1.642, top1 = 54.59%], valid : [loss = 1.841, top1 = 49.56%], test : [loss = 1.865, top1 = 49.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 3.188, top1 = 23.22%], valid : [loss = 3.175, top1 = 23.40%], test : [loss = 3.227, top1 = 23.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.86%], valid : [loss = 1.073, top1 = 61.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8016/15625) 008016-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.34%], valid : [loss = 0.686, top1 = 84.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.052, top1 = 98.40%], test  : [loss = 0.451, top1 = 88.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.53 ms.
cifar100       train : [loss = 0.630, top1 = 81.61%], valid : [loss = 1.501, top1 = 61.54%], test : [loss = 1.527, top1 = 62.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.16%], valid : [loss = 2.807, top1 = 30.90%], test : [loss = 2.873, top1 = 29.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8017/15625) 008017-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.330, top1 = 92.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.96 ms.
cifar100       train : [loss = 0.296, top1 = 92.04%], valid : [loss = 1.328, top1 = 66.94%], test : [loss = 1.319, top1 = 67.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.68 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 44.00%], valid : [loss = 2.414, top1 = 38.97%], test : [loss = 2.424, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.00%], valid : [loss = 0.842, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8018/15625) 008018-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.18%], valid : [loss = 0.453, top1 = 86.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.24 ms.
cifar10        train : [loss = 0.114, top1 = 96.50%], test  : [loss = 0.331, top1 = 89.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 0.864, top1 = 75.33%], valid : [loss = 1.297, top1 = 63.73%], test : [loss = 1.290, top1 = 64.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.25 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.68%], valid : [loss = 2.622, top1 = 33.96%], test : [loss = 2.648, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8019/15625) 008019-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.585, top1 = 86.93%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10        train : [loss = 0.025, top1 = 99.42%], test  : [loss = 0.412, top1 = 89.81%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.98 ms.
cifar100       train : [loss = 0.343, top1 = 90.92%], valid : [loss = 1.356, top1 = 66.09%], test : [loss = 1.370, top1 = 65.51%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 2.187, top1 = 43.34%], valid : [loss = 2.529, top1 = 36.76%], test : [loss = 2.530, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.16%], valid : [loss = 0.727, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8020/15625) 008020-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.30%], valid : [loss = 0.539, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10        train : [loss = 0.039, top1 = 98.72%], test  : [loss = 0.348, top1 = 90.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.60 ms.
cifar100       train : [loss = 0.464, top1 = 86.43%], valid : [loss = 1.259, top1 = 66.24%], test : [loss = 1.263, top1 = 66.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.14%], valid : [loss = 2.450, top1 = 37.97%], test : [loss = 2.493, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.40%], valid : [loss = 0.922, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8021/15625) 008021-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.498, top1 = 89.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.328, top1 = 92.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.152, top1 = 96.85%], valid : [loss = 1.271, top1 = 69.10%], test : [loss = 1.327, top1 = 68.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.27%], valid : [loss = 2.312, top1 = 40.80%], test : [loss = 2.295, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8022/15625) 008022-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.570, top1 = 87.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.376, top1 = 91.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.376, top1 = 89.43%], valid : [loss = 1.380, top1 = 66.12%], test : [loss = 1.384, top1 = 66.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.69%], valid : [loss = 2.479, top1 = 37.24%], test : [loss = 2.508, top1 = 37.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.21%], valid : [loss = 0.750, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8023/15625) 008023-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.72 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.693, top1 = 84.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.87 ms.
cifar10        train : [loss = 0.049, top1 = 98.54%], test  : [loss = 0.464, top1 = 88.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.60 ms.
cifar100       train : [loss = 0.612, top1 = 81.93%], valid : [loss = 1.527, top1 = 61.70%], test : [loss = 1.504, top1 = 61.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.66%], valid : [loss = 2.814, top1 = 31.27%], test : [loss = 2.866, top1 = 29.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.71%], valid : [loss = 0.887, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8024/15625) 008024-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.10%], valid : [loss = 0.527, top1 = 83.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.249, top1 = 91.53%], test  : [loss = 0.398, top1 = 87.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 1.332, top1 = 62.41%], valid : [loss = 1.604, top1 = 56.38%], test : [loss = 1.585, top1 = 56.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.782, top1 = 31.08%], valid : [loss = 2.790, top1 = 30.89%], test : [loss = 2.837, top1 = 30.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 66.04%], valid : [loss = 0.991, top1 = 64.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8025/15625) 008025-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.97%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.338, top1 = 92.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.82 ms.
cifar100       train : [loss = 0.292, top1 = 92.17%], valid : [loss = 1.283, top1 = 67.35%], test : [loss = 1.296, top1 = 67.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.85%], valid : [loss = 2.403, top1 = 39.10%], test : [loss = 2.397, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.29%], valid : [loss = 0.809, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8026/15625) 008026-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.364, top1 = 91.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=15.03 ms.
cifar100       train : [loss = 0.353, top1 = 90.32%], valid : [loss = 1.285, top1 = 66.34%], test : [loss = 1.296, top1 = 67.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.72%], valid : [loss = 2.413, top1 = 39.63%], test : [loss = 2.378, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8027/15625) 008027-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.624, top1 = 86.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.379, top1 = 91.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.276, top1 = 92.78%], valid : [loss = 1.472, top1 = 64.98%], test : [loss = 1.447, top1 = 65.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.40%], valid : [loss = 2.537, top1 = 36.90%], test : [loss = 2.549, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.28%], valid : [loss = 0.756, top1 = 73.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8028/15625) 008028-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.28%], valid : [loss = 0.589, top1 = 85.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.64 ms.
cifar10        train : [loss = 0.108, top1 = 96.46%], test  : [loss = 0.396, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.11 ms.
cifar100       train : [loss = 0.809, top1 = 76.22%], valid : [loss = 1.393, top1 = 62.84%], test : [loss = 1.398, top1 = 62.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 32.93%], valid : [loss = 2.766, top1 = 31.20%], test : [loss = 2.804, top1 = 30.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.06%], valid : [loss = 0.700, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8029/15625) 008029-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.573, top1 = 87.16%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10        train : [loss = 0.039, top1 = 98.82%], test  : [loss = 0.393, top1 = 89.86%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.99 ms.
cifar100       train : [loss = 0.554, top1 = 83.78%], valid : [loss = 1.417, top1 = 63.42%], test : [loss = 1.400, top1 = 64.34%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 2.484, top1 = 37.13%], valid : [loss = 2.594, top1 = 34.77%], test : [loss = 2.646, top1 = 34.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.07%], valid : [loss = 0.669, top1 = 77.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8030/15625) 008030-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.553, top1 = 88.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.360, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.00 ms.
cifar100       train : [loss = 0.225, top1 = 94.20%], valid : [loss = 1.264, top1 = 68.20%], test : [loss = 1.275, top1 = 68.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.195, top1 = 43.09%], valid : [loss = 2.454, top1 = 37.73%], test : [loss = 2.488, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.66%], valid : [loss = 0.846, top1 = 70.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8031/15625) 008031-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.555, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.343, top1 = 91.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 0.299, top1 = 91.93%], valid : [loss = 1.293, top1 = 66.98%], test : [loss = 1.335, top1 = 67.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.66%], valid : [loss = 2.445, top1 = 38.57%], test : [loss = 2.434, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8032/15625) 008032-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.507, top1 = 88.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.320, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.79 ms.
cifar100       train : [loss = 0.339, top1 = 90.77%], valid : [loss = 1.273, top1 = 66.90%], test : [loss = 1.296, top1 = 67.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 45.04%], valid : [loss = 2.387, top1 = 39.17%], test : [loss = 2.390, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8033/15625) 008033-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.96%], valid : [loss = 0.884, top1 = 70.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.553, top1 = 80.70%], test  : [loss = 0.708, top1 = 76.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.51 ms.
cifar100       train : [loss = 1.767, top1 = 52.54%], valid : [loss = 2.044, top1 = 46.56%], test : [loss = 2.062, top1 = 46.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.85%], valid : [loss = 3.627, top1 = 17.10%], test : [loss = 3.659, top1 = 16.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8034/15625) 008034-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.578, top1 = 87.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.376, top1 = 91.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.97 ms.
cifar100       train : [loss = 0.371, top1 = 89.55%], valid : [loss = 1.419, top1 = 65.49%], test : [loss = 1.408, top1 = 65.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.32%], valid : [loss = 2.500, top1 = 37.59%], test : [loss = 2.516, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.16%], valid : [loss = 0.791, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8035/15625) 008035-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.574, top1 = 88.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.69 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.405, top1 = 91.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 0.259, top1 = 93.15%], valid : [loss = 1.459, top1 = 66.44%], test : [loss = 1.436, top1 = 66.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.68 ms.
ImageNet16-120 train : [loss = 2.221, top1 = 42.93%], valid : [loss = 2.562, top1 = 35.70%], test : [loss = 2.609, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.33%], valid : [loss = 0.640, top1 = 78.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8036/15625) 008036-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.13%], valid : [loss = 0.852, top1 = 71.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10        train : [loss = 0.569, top1 = 80.03%], test  : [loss = 0.724, top1 = 75.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 1.781, top1 = 51.90%], valid : [loss = 2.052, top1 = 46.76%], test : [loss = 2.063, top1 = 46.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.81%], valid : [loss = 3.617, top1 = 17.77%], test : [loss = 3.673, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8037/15625) 008037-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.524, top1 = 89.14%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.01 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.342, top1 = 92.28%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.83 ms.
cifar100       train : [loss = 0.130, top1 = 97.20%], valid : [loss = 1.334, top1 = 68.80%], test : [loss = 1.311, top1 = 69.36%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=25.01 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 47.85%], valid : [loss = 2.345, top1 = 40.93%], test : [loss = 2.343, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.36%], valid : [loss = 0.873, top1 = 69.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8038/15625) 008038-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.77 ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.76%], valid : [loss = 0.713, top1 = 75.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10        train : [loss = 0.549, top1 = 81.01%], test  : [loss = 0.601, top1 = 79.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 1.961, top1 = 47.25%], valid : [loss = 2.097, top1 = 44.57%], test : [loss = 2.089, top1 = 44.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.60 ms.
ImageNet16-120 train : [loss = 3.232, top1 = 22.36%], valid : [loss = 3.219, top1 = 22.46%], test : [loss = 3.254, top1 = 22.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.49%], valid : [loss = 1.351, top1 = 51.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8039/15625) 008039-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.49 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8040/15625) 008040-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.25%], valid : [loss = 0.968, top1 = 75.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.216, top1 = 92.64%], test  : [loss = 0.595, top1 = 82.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 1.149, top1 = 67.40%], valid : [loss = 1.808, top1 = 53.45%], test : [loss = 1.778, top1 = 54.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.80%], valid : [loss = 3.339, top1 = 21.67%], test : [loss = 3.375, top1 = 20.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.82%], valid : [loss = 1.094, top1 = 61.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8041/15625) 008041-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.523, top1 = 88.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.334, top1 = 91.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 0.315, top1 = 91.53%], valid : [loss = 1.261, top1 = 67.83%], test : [loss = 1.263, top1 = 67.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.62%], valid : [loss = 2.327, top1 = 40.88%], test : [loss = 2.344, top1 = 40.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.63%], valid : [loss = 0.678, top1 = 76.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8042/15625) 008042-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.582, top1 = 87.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.372, top1 = 91.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.03 ms.
cifar100       train : [loss = 0.410, top1 = 88.33%], valid : [loss = 1.381, top1 = 65.50%], test : [loss = 1.381, top1 = 65.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.42%], valid : [loss = 2.527, top1 = 36.00%], test : [loss = 2.553, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.14%], valid : [loss = 0.791, top1 = 72.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8043/15625) 008043-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.592, top1 = 87.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.394, top1 = 90.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.86 ms.
cifar100       train : [loss = 0.385, top1 = 89.26%], valid : [loss = 1.430, top1 = 64.54%], test : [loss = 1.388, top1 = 65.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.83%], valid : [loss = 2.505, top1 = 36.87%], test : [loss = 2.521, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.13%], valid : [loss = 0.796, top1 = 72.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8044/15625) 008044-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.39%], valid : [loss = 0.869, top1 = 71.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10        train : [loss = 0.564, top1 = 80.41%], test  : [loss = 0.723, top1 = 75.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.87 ms.
cifar100       train : [loss = 1.778, top1 = 52.05%], valid : [loss = 2.036, top1 = 47.04%], test : [loss = 2.072, top1 = 46.71%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.09 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.70%], valid : [loss = 3.644, top1 = 16.09%], test : [loss = 3.660, top1 = 16.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8045/15625) 008045-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.67%], valid : [loss = 0.554, top1 = 87.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.85 ms.
cifar10        train : [loss = 0.028, top1 = 99.15%], test  : [loss = 0.348, top1 = 91.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.87 ms.
cifar100       train : [loss = 0.409, top1 = 88.39%], valid : [loss = 1.221, top1 = 67.74%], test : [loss = 1.277, top1 = 66.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.251, top1 = 41.91%], valid : [loss = 2.415, top1 = 39.40%], test : [loss = 2.444, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.99%], valid : [loss = 0.808, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8046/15625) 008046-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.570, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.380, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.26 ms.
cifar100       train : [loss = 0.399, top1 = 88.68%], valid : [loss = 1.411, top1 = 65.04%], test : [loss = 1.384, top1 = 65.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 42.00%], valid : [loss = 2.477, top1 = 37.71%], test : [loss = 2.476, top1 = 38.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.32%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8047/15625) 008047-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.50%], valid : [loss = 0.540, top1 = 85.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10        train : [loss = 0.109, top1 = 96.35%], test  : [loss = 0.376, top1 = 88.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.40 ms.
cifar100       train : [loss = 0.810, top1 = 76.46%], valid : [loss = 1.468, top1 = 60.40%], test : [loss = 1.448, top1 = 61.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 26.56%], valid : [loss = 2.939, top1 = 26.47%], test : [loss = 2.948, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 51.16%], valid : [loss = 1.343, top1 = 51.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8048/15625) 008048-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.96%], valid : [loss = 0.480, top1 = 84.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.295, top1 = 90.13%], test  : [loss = 0.402, top1 = 86.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.32 ms.
cifar100       train : [loss = 1.337, top1 = 62.78%], valid : [loss = 1.545, top1 = 57.78%], test : [loss = 1.513, top1 = 57.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.45%], valid : [loss = 2.914, top1 = 29.80%], test : [loss = 2.959, top1 = 27.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8049/15625) 008049-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.519, top1 = 89.42%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.27 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.322, top1 = 92.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.58 ms.
cifar100       train : [loss = 0.147, top1 = 96.83%], valid : [loss = 1.235, top1 = 69.16%], test : [loss = 1.223, top1 = 69.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 1.793, top1 = 52.39%], valid : [loss = 2.179, top1 = 44.57%], test : [loss = 2.181, top1 = 44.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.46%], valid : [loss = 0.779, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8050/15625) 008050-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.498, top1 = 88.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.330, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.30 ms.
cifar100       train : [loss = 0.312, top1 = 91.63%], valid : [loss = 1.251, top1 = 67.72%], test : [loss = 1.266, top1 = 67.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.27%], valid : [loss = 2.318, top1 = 40.67%], test : [loss = 2.336, top1 = 41.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.16%], valid : [loss = 0.612, top1 = 79.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8051/15625) 008051-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.491, top1 = 82.76%], valid : [loss = 0.643, top1 = 78.42%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.508, top1 = 82.54%], test  : [loss = 0.593, top1 = 79.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 1.731, top1 = 53.03%], valid : [loss = 1.879, top1 = 50.26%], test : [loss = 1.905, top1 = 50.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.31%], valid : [loss = 3.310, top1 = 22.33%], test : [loss = 3.332, top1 = 21.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8052/15625) 008052-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.515, top1 = 89.81%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.62 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.333, top1 = 92.78%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.20 ms.
cifar100       train : [loss = 0.072, top1 = 98.80%], valid : [loss = 1.383, top1 = 69.22%], test : [loss = 1.338, top1 = 70.22%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.53%], valid : [loss = 2.291, top1 = 41.57%], test : [loss = 2.301, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.36%], valid : [loss = 0.733, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8053/15625) 008053-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.457, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.310, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.329, top1 = 91.06%], valid : [loss = 1.313, top1 = 67.03%], test : [loss = 1.302, top1 = 67.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.15%], valid : [loss = 2.388, top1 = 39.92%], test : [loss = 2.411, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8054/15625) 008054-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.505, top1 = 88.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.030, top1 = 99.16%], test  : [loss = 0.346, top1 = 91.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.483, top1 = 85.77%], valid : [loss = 1.348, top1 = 65.74%], test : [loss = 1.356, top1 = 65.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.07%], valid : [loss = 2.522, top1 = 36.50%], test : [loss = 2.540, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.61%], valid : [loss = 0.697, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8055/15625) 008055-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.553, top1 = 88.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.47 ms.
cifar10        train : [loss = 0.011, top1 = 99.70%], test  : [loss = 0.341, top1 = 92.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.69 ms.
cifar100       train : [loss = 0.252, top1 = 93.22%], valid : [loss = 1.327, top1 = 67.20%], test : [loss = 1.326, top1 = 67.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.12%], valid : [loss = 2.408, top1 = 38.17%], test : [loss = 2.458, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8056/15625) 008056-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.70%], valid : [loss = 0.559, top1 = 83.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.204, top1 = 93.10%], test  : [loss = 0.387, top1 = 87.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.74 ms.
cifar100       train : [loss = 1.294, top1 = 63.31%], valid : [loss = 1.586, top1 = 56.78%], test : [loss = 1.562, top1 = 56.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.747, top1 = 31.70%], valid : [loss = 2.755, top1 = 31.97%], test : [loss = 2.805, top1 = 29.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 64.90%], valid : [loss = 1.001, top1 = 64.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8057/15625) 008057-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.21%], valid : [loss = 0.464, top1 = 85.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10        train : [loss = 0.162, top1 = 94.67%], test  : [loss = 0.352, top1 = 88.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.28 ms.
cifar100       train : [loss = 1.026, top1 = 70.91%], valid : [loss = 1.376, top1 = 61.57%], test : [loss = 1.372, top1 = 61.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.49%], valid : [loss = 2.711, top1 = 32.36%], test : [loss = 2.729, top1 = 31.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8058/15625) 008058-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.503, top1 = 89.96%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.57%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.61 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.312, top1 = 70.31%], test : [loss = 1.306, top1 = 70.49%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.67 ms.
ImageNet16-120 train : [loss = 1.560, top1 = 57.88%], valid : [loss = 2.158, top1 = 44.84%], test : [loss = 2.163, top1 = 45.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.66%], valid : [loss = 0.595, top1 = 79.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8059/15625) 008059-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=22.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.508, top1 = 89.42%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.96 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.319, top1 = 93.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.93 ms.
cifar100       train : [loss = 0.127, top1 = 97.23%], valid : [loss = 1.299, top1 = 69.04%], test : [loss = 1.317, top1 = 69.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.45 ms.
ImageNet16-120 train : [loss = 1.730, top1 = 53.88%], valid : [loss = 2.147, top1 = 44.50%], test : [loss = 2.147, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.53%], valid : [loss = 0.714, top1 = 75.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8060/15625) 008060-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.19%], valid : [loss = 0.465, top1 = 85.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.48 ms.
cifar10        train : [loss = 0.154, top1 = 94.94%], test  : [loss = 0.341, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.87 ms.
cifar100       train : [loss = 1.026, top1 = 70.97%], valid : [loss = 1.359, top1 = 61.42%], test : [loss = 1.367, top1 = 62.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.47%], valid : [loss = 2.712, top1 = 32.37%], test : [loss = 2.736, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8061/15625) 008061-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.72%], valid : [loss = 0.644, top1 = 84.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.086, top1 = 97.23%], test  : [loss = 0.401, top1 = 88.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.62 ms.
cifar100       train : [loss = 0.777, top1 = 77.39%], valid : [loss = 1.424, top1 = 62.05%], test : [loss = 1.418, top1 = 62.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.27%], valid : [loss = 2.734, top1 = 31.96%], test : [loss = 2.752, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8062/15625) 008062-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.15%], valid : [loss = 0.491, top1 = 83.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.300, top1 = 89.95%], test  : [loss = 0.408, top1 = 86.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.95 ms.
cifar100       train : [loss = 1.344, top1 = 62.56%], valid : [loss = 1.543, top1 = 57.30%], test : [loss = 1.523, top1 = 58.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.01 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.56%], valid : [loss = 2.903, top1 = 29.70%], test : [loss = 2.967, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8063/15625) 008063-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.557, top1 = 88.17%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.363, top1 = 91.72%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.54 ms.
cifar100       train : [loss = 0.139, top1 = 96.59%], valid : [loss = 1.436, top1 = 66.86%], test : [loss = 1.477, top1 = 66.98%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.15%], valid : [loss = 2.662, top1 = 32.40%], test : [loss = 2.622, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 63.90%], valid : [loss = 1.019, top1 = 63.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8064/15625) 008064-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.40%], valid : [loss = 0.585, top1 = 87.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.382, top1 = 90.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.568, top1 = 83.62%], valid : [loss = 1.403, top1 = 63.04%], test : [loss = 1.398, top1 = 63.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 34.44%], valid : [loss = 2.657, top1 = 32.73%], test : [loss = 2.680, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8065/15625) 008065-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.83 ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.17%], valid : [loss = 0.661, top1 = 78.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.380, top1 = 86.75%], test  : [loss = 0.533, top1 = 82.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.99 ms.
cifar100       train : [loss = 1.537, top1 = 57.19%], valid : [loss = 1.800, top1 = 51.90%], test : [loss = 1.808, top1 = 52.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 3.222, top1 = 22.79%], valid : [loss = 3.246, top1 = 22.00%], test : [loss = 3.286, top1 = 21.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.12%], valid : [loss = 1.224, top1 = 55.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8066/15625) 008066-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.561, top1 = 87.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.392, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.11 ms.
cifar100       train : [loss = 0.406, top1 = 88.47%], valid : [loss = 1.356, top1 = 64.98%], test : [loss = 1.360, top1 = 65.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.86%], valid : [loss = 2.495, top1 = 37.23%], test : [loss = 2.533, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8067/15625) 008067-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.87%], valid : [loss = 0.842, top1 = 72.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.561, top1 = 80.30%], test  : [loss = 0.710, top1 = 75.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.65 ms.
cifar100       train : [loss = 1.790, top1 = 51.70%], valid : [loss = 2.043, top1 = 47.22%], test : [loss = 2.079, top1 = 46.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 3.603, top1 = 16.60%], valid : [loss = 3.676, top1 = 15.17%], test : [loss = 3.665, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8068/15625) 008068-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.19 ms.
cifar10-valid  train : [loss = 1.105, top1 = 60.74%], valid : [loss = 1.155, top1 = 59.02%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.76 ms.
cifar10        train : [loss = 1.058, top1 = 62.61%], test  : [loss = 1.053, top1 = 62.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.22 ms.
cifar100       train : [loss = 2.571, top1 = 35.10%], valid : [loss = 2.644, top1 = 33.89%], test : [loss = 2.617, top1 = 34.39%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.85 ms.
ImageNet16-120 train : [loss = 3.785, top1 = 13.63%], valid : [loss = 3.764, top1 = 14.44%], test : [loss = 3.791, top1 = 13.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8069/15625) 008069-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.42%], valid : [loss = 0.529, top1 = 83.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.264, top1 = 91.01%], test  : [loss = 0.417, top1 = 86.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.478, top1 = 58.57%], valid : [loss = 1.741, top1 = 52.80%], test : [loss = 1.738, top1 = 53.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.964, top1 = 27.40%], valid : [loss = 2.966, top1 = 28.00%], test : [loss = 3.016, top1 = 26.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8070/15625) 008070-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8071/15625) 008071-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.241, top1 = 91.73%], valid : [loss = 0.519, top1 = 83.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10        train : [loss = 0.244, top1 = 91.69%], test  : [loss = 0.393, top1 = 87.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.48 ms.
cifar100       train : [loss = 1.353, top1 = 61.89%], valid : [loss = 1.629, top1 = 56.01%], test : [loss = 1.603, top1 = 56.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.851, top1 = 29.68%], valid : [loss = 2.875, top1 = 29.03%], test : [loss = 2.924, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8072/15625) 008072-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.74%], valid : [loss = 0.921, top1 = 77.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10        train : [loss = 0.155, top1 = 94.69%], test  : [loss = 0.538, top1 = 84.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.04 ms.
cifar100       train : [loss = 1.068, top1 = 69.38%], valid : [loss = 1.712, top1 = 55.50%], test : [loss = 1.731, top1 = 55.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 3.020, top1 = 26.56%], valid : [loss = 3.147, top1 = 24.00%], test : [loss = 3.203, top1 = 22.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.44%], valid : [loss = 0.968, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8073/15625) 008073-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.66%], valid : [loss = 0.651, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.091, top1 = 97.11%], test  : [loss = 0.424, top1 = 88.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.70 ms.
cifar100       train : [loss = 0.777, top1 = 77.22%], valid : [loss = 1.408, top1 = 62.18%], test : [loss = 1.395, top1 = 62.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.26%], valid : [loss = 2.720, top1 = 33.10%], test : [loss = 2.772, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.39%], valid : [loss = 0.858, top1 = 70.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8074/15625) 008074-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.528, top1 = 89.24%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.39 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.329, top1 = 92.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.30 ms.
cifar100       train : [loss = 0.114, top1 = 97.69%], valid : [loss = 1.329, top1 = 68.98%], test : [loss = 1.341, top1 = 68.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.49%], valid : [loss = 2.294, top1 = 41.97%], test : [loss = 2.297, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.10%], valid : [loss = 0.812, top1 = 71.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8075/15625) 008075-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.00%], valid : [loss = 0.569, top1 = 86.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.066, top1 = 97.88%], test  : [loss = 0.376, top1 = 90.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.75 ms.
cifar100       train : [loss = 0.700, top1 = 79.25%], valid : [loss = 1.351, top1 = 64.10%], test : [loss = 1.340, top1 = 64.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 2.357, top1 = 39.80%], valid : [loss = 2.494, top1 = 37.37%], test : [loss = 2.504, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8076/15625) 008076-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.487, top1 = 89.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.336, top1 = 92.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.43 ms.
cifar100       train : [loss = 0.210, top1 = 94.58%], valid : [loss = 1.342, top1 = 68.19%], test : [loss = 1.368, top1 = 67.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.62%], valid : [loss = 2.276, top1 = 41.74%], test : [loss = 2.323, top1 = 41.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.94%], valid : [loss = 0.562, top1 = 80.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8077/15625) 008077-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.99%], valid : [loss = 0.448, top1 = 89.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.299, top1 = 92.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.51 ms.
cifar100       train : [loss = 0.178, top1 = 96.07%], valid : [loss = 1.319, top1 = 68.16%], test : [loss = 1.267, top1 = 69.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.85%], valid : [loss = 2.245, top1 = 42.90%], test : [loss = 2.288, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.22%], valid : [loss = 0.542, top1 = 81.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8078/15625) 008078-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.465, top1 = 89.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.323, top1 = 92.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.59 ms.
cifar100       train : [loss = 0.151, top1 = 96.60%], valid : [loss = 1.271, top1 = 69.76%], test : [loss = 1.288, top1 = 69.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 53.06%], valid : [loss = 2.272, top1 = 43.30%], test : [loss = 2.250, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.63%], valid : [loss = 0.553, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8079/15625) 008079-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.550, top1 = 87.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.351, top1 = 91.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.347, top1 = 90.38%], valid : [loss = 1.289, top1 = 66.18%], test : [loss = 1.289, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.24%], valid : [loss = 2.450, top1 = 38.37%], test : [loss = 2.443, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.41%], valid : [loss = 0.803, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8080/15625) 008080-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.529, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.351, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.144, top1 = 97.13%], valid : [loss = 1.396, top1 = 68.18%], test : [loss = 1.409, top1 = 67.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.05%], valid : [loss = 2.407, top1 = 39.29%], test : [loss = 2.432, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 78.98%], valid : [loss = 0.690, top1 = 76.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8081/15625) 008081-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.53%], valid : [loss = 0.616, top1 = 86.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.79 ms.
cifar10        train : [loss = 0.031, top1 = 99.16%], test  : [loss = 0.394, top1 = 90.30%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.47 ms.
cifar100       train : [loss = 0.537, top1 = 84.35%], valid : [loss = 1.423, top1 = 63.64%], test : [loss = 1.418, top1 = 63.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.30%], valid : [loss = 2.547, top1 = 35.97%], test : [loss = 2.558, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.25%], valid : [loss = 0.883, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8082/15625) 008082-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.431, top1 = 89.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.296, top1 = 92.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.202, top1 = 95.36%], valid : [loss = 1.217, top1 = 69.34%], test : [loss = 1.217, top1 = 69.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.44%], valid : [loss = 2.246, top1 = 42.03%], test : [loss = 2.297, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8083/15625) 008083-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.698, top1 = 84.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.89 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.453, top1 = 88.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.641, top1 = 81.27%], valid : [loss = 1.531, top1 = 60.89%], test : [loss = 1.513, top1 = 61.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 33.22%], valid : [loss = 2.842, top1 = 30.31%], test : [loss = 2.879, top1 = 30.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.42%], valid : [loss = 0.858, top1 = 70.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8084/15625) 008084-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.076, top1 = 98.06%], valid : [loss = 0.447, top1 = 87.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.111, top1 = 96.55%], test  : [loss = 0.333, top1 = 89.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.79 ms.
cifar100       train : [loss = 0.851, top1 = 75.99%], valid : [loss = 1.301, top1 = 64.16%], test : [loss = 1.279, top1 = 64.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 36.03%], valid : [loss = 2.614, top1 = 34.10%], test : [loss = 2.652, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.12%], valid : [loss = 0.635, top1 = 78.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8085/15625) 008085-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=24.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.49%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.26 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.304, top1 = 92.95%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.49 ms.
cifar100       train : [loss = 0.145, top1 = 97.09%], valid : [loss = 1.299, top1 = 68.96%], test : [loss = 1.264, top1 = 69.60%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.91 ms.
ImageNet16-120 train : [loss = 1.739, top1 = 53.52%], valid : [loss = 2.195, top1 = 42.80%], test : [loss = 2.202, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 81.04%], valid : [loss = 0.628, top1 = 78.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8086/15625) 008086-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.493, top1 = 90.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.15 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.337, top1 = 92.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.41 ms.
cifar100       train : [loss = 0.109, top1 = 98.01%], valid : [loss = 1.262, top1 = 69.62%], test : [loss = 1.280, top1 = 69.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.24%], valid : [loss = 2.182, top1 = 43.53%], test : [loss = 2.217, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.14%], valid : [loss = 0.766, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8087/15625) 008087-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.49 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.605, top1 = 87.54%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.63 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.381, top1 = 91.52%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.83 ms.
cifar100       train : [loss = 0.213, top1 = 95.02%], valid : [loss = 1.474, top1 = 65.46%], test : [loss = 1.456, top1 = 66.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.84%], valid : [loss = 2.530, top1 = 37.60%], test : [loss = 2.523, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.45%], valid : [loss = 0.761, top1 = 73.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8088/15625) 008088-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.25 ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.41%], valid : [loss = 0.846, top1 = 70.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10        train : [loss = 0.685, top1 = 76.10%], test  : [loss = 0.773, top1 = 73.46%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.88 ms.
cifar100       train : [loss = 1.988, top1 = 47.15%], valid : [loss = 2.143, top1 = 44.18%], test : [loss = 2.158, top1 = 44.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.65 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.73%], valid : [loss = 3.667, top1 = 16.07%], test : [loss = 3.703, top1 = 15.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8089/15625) 008089-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.462, top1 = 89.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.322, top1 = 92.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.204, top1 = 95.01%], valid : [loss = 1.355, top1 = 68.17%], test : [loss = 1.318, top1 = 68.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.62%], valid : [loss = 2.304, top1 = 41.64%], test : [loss = 2.331, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.91%], valid : [loss = 0.576, top1 = 80.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8090/15625) 008090-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.584, top1 = 87.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.391, top1 = 90.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.47 ms.
cifar100       train : [loss = 0.377, top1 = 89.47%], valid : [loss = 1.367, top1 = 66.16%], test : [loss = 1.404, top1 = 65.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.85%], valid : [loss = 2.522, top1 = 36.23%], test : [loss = 2.543, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8091/15625) 008091-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.552, top1 = 88.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.45 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.387, top1 = 91.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.93 ms.
cifar100       train : [loss = 0.178, top1 = 96.09%], valid : [loss = 1.440, top1 = 66.72%], test : [loss = 1.450, top1 = 66.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 48.05%], valid : [loss = 2.434, top1 = 38.64%], test : [loss = 2.450, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.78%], valid : [loss = 0.688, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8092/15625) 008092-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.461, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.297, top1 = 92.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 0.319, top1 = 91.42%], valid : [loss = 1.251, top1 = 66.56%], test : [loss = 1.277, top1 = 67.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.68%], valid : [loss = 2.295, top1 = 41.63%], test : [loss = 2.326, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.20%], valid : [loss = 0.635, top1 = 78.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8093/15625) 008093-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.66%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=22.00 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.326, top1 = 93.34%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.01 ms.
cifar100       train : [loss = 0.056, top1 = 99.05%], valid : [loss = 1.494, top1 = 68.00%], test : [loss = 1.459, top1 = 68.88%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=22.92 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 47.74%], valid : [loss = 2.330, top1 = 40.23%], test : [loss = 2.338, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.18%], valid : [loss = 0.968, top1 = 65.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8094/15625) 008094-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.478, top1 = 89.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.324, top1 = 92.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.84 ms.
cifar100       train : [loss = 0.188, top1 = 95.52%], valid : [loss = 1.324, top1 = 69.38%], test : [loss = 1.313, top1 = 68.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.83%], valid : [loss = 2.298, top1 = 41.63%], test : [loss = 2.299, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.433, top1 = 85.13%], valid : [loss = 0.554, top1 = 81.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8095/15625) 008095-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.199, top1 = 93.16%], valid : [loss = 0.517, top1 = 84.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10        train : [loss = 0.210, top1 = 92.92%], test  : [loss = 0.376, top1 = 87.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.38 ms.
cifar100       train : [loss = 1.165, top1 = 66.73%], valid : [loss = 1.469, top1 = 59.24%], test : [loss = 1.467, top1 = 58.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.740, top1 = 31.96%], valid : [loss = 2.756, top1 = 31.67%], test : [loss = 2.796, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 69.00%], valid : [loss = 0.902, top1 = 67.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8096/15625) 008096-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.09%], valid : [loss = 0.650, top1 = 78.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.506, top1 = 82.52%], test  : [loss = 0.588, top1 = 80.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 1.710, top1 = 53.73%], valid : [loss = 1.872, top1 = 50.21%], test : [loss = 1.885, top1 = 50.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.25%], valid : [loss = 3.313, top1 = 21.83%], test : [loss = 3.346, top1 = 21.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.62%], valid : [loss = 1.304, top1 = 53.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8097/15625) 008097-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.86%], valid : [loss = 0.584, top1 = 86.27%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.39 ms.
cifar10        train : [loss = 0.075, top1 = 97.46%], test  : [loss = 0.376, top1 = 89.57%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.25 ms.
cifar100       train : [loss = 0.572, top1 = 83.29%], valid : [loss = 1.358, top1 = 64.84%], test : [loss = 1.316, top1 = 64.88%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.64 ms.
ImageNet16-120 train : [loss = 2.322, top1 = 40.26%], valid : [loss = 2.513, top1 = 36.90%], test : [loss = 2.508, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.21%], valid : [loss = 0.825, top1 = 70.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8098/15625) 008098-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.461, top1 = 88.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.30 ms.
cifar100       train : [loss = 0.331, top1 = 90.91%], valid : [loss = 1.290, top1 = 67.22%], test : [loss = 1.295, top1 = 67.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.40%], valid : [loss = 2.361, top1 = 39.87%], test : [loss = 2.368, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.74%], valid : [loss = 0.566, top1 = 81.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8099/15625) 008099-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.48%], valid : [loss = 0.532, top1 = 84.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10        train : [loss = 0.185, top1 = 93.78%], test  : [loss = 0.396, top1 = 87.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.72 ms.
cifar100       train : [loss = 1.200, top1 = 66.00%], valid : [loss = 1.517, top1 = 58.53%], test : [loss = 1.498, top1 = 58.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.80%], valid : [loss = 2.699, top1 = 32.08%], test : [loss = 2.732, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.50%], valid : [loss = 0.952, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8100/15625) 008100-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.66%], valid : [loss = 0.629, top1 = 84.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.082, top1 = 97.41%], test  : [loss = 0.393, top1 = 88.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.74 ms.
cifar100       train : [loss = 0.790, top1 = 76.66%], valid : [loss = 1.435, top1 = 61.62%], test : [loss = 1.453, top1 = 62.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.03%], valid : [loss = 2.708, top1 = 32.37%], test : [loss = 2.773, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8101/15625) 008101-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=21.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.529, top1 = 89.70%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.41 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.337, top1 = 93.38%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.93 ms.
cifar100       train : [loss = 0.047, top1 = 99.38%], valid : [loss = 1.394, top1 = 69.48%], test : [loss = 1.359, top1 = 70.50%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 47.93%], valid : [loss = 2.413, top1 = 39.10%], test : [loss = 2.377, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 73.26%], valid : [loss = 0.813, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8102/15625) 008102-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=21.19 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.511, top1 = 90.12%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=22.82 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.301, top1 = 93.59%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=24.43 ms.
cifar100       train : [loss = 0.032, top1 = 99.71%], valid : [loss = 1.294, top1 = 71.54%], test : [loss = 1.286, top1 = 71.50%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=23.17 ms.
ImageNet16-120 train : [loss = 1.529, top1 = 58.57%], valid : [loss = 2.108, top1 = 45.77%], test : [loss = 2.114, top1 = 45.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.62%], valid : [loss = 0.610, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8103/15625) 008103-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.545, top1 = 88.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.355, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.428, top1 = 87.58%], valid : [loss = 1.273, top1 = 66.75%], test : [loss = 1.247, top1 = 67.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.06%], valid : [loss = 2.422, top1 = 38.48%], test : [loss = 2.450, top1 = 37.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.40%], valid : [loss = 0.810, top1 = 71.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8104/15625) 008104-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.492, top1 = 89.70%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.09 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.41%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.32 ms.
cifar100       train : [loss = 0.097, top1 = 98.26%], valid : [loss = 1.315, top1 = 68.96%], test : [loss = 1.267, top1 = 70.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.65 ms.
ImageNet16-120 train : [loss = 1.638, top1 = 55.93%], valid : [loss = 2.177, top1 = 44.83%], test : [loss = 2.180, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.493, top1 = 83.11%], valid : [loss = 0.589, top1 = 79.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8105/15625) 008105-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.552, top1 = 89.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.357, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.088, top1 = 98.52%], valid : [loss = 1.444, top1 = 68.45%], test : [loss = 1.439, top1 = 68.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 52.03%], valid : [loss = 2.378, top1 = 40.69%], test : [loss = 2.372, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.55%], valid : [loss = 0.664, top1 = 77.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8106/15625) 008106-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.48%], valid : [loss = 0.663, top1 = 78.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10        train : [loss = 0.342, top1 = 88.22%], test  : [loss = 0.474, top1 = 84.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.57 ms.
cifar100       train : [loss = 1.621, top1 = 54.71%], valid : [loss = 1.864, top1 = 50.32%], test : [loss = 1.846, top1 = 50.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 3.192, top1 = 22.98%], valid : [loss = 3.208, top1 = 22.73%], test : [loss = 3.267, top1 = 21.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.64%], valid : [loss = 1.099, top1 = 61.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8107/15625) 008107-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.586, top1 = 88.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.369, top1 = 92.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.98 ms.
cifar100       train : [loss = 0.105, top1 = 98.12%], valid : [loss = 1.510, top1 = 66.80%], test : [loss = 1.513, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.54%], valid : [loss = 2.418, top1 = 39.57%], test : [loss = 2.426, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.70%], valid : [loss = 0.739, top1 = 74.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8108/15625) 008108-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.73%], valid : [loss = 0.555, top1 = 85.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.04 ms.
cifar10        train : [loss = 0.108, top1 = 96.33%], test  : [loss = 0.379, top1 = 89.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.39 ms.
cifar100       train : [loss = 0.789, top1 = 76.81%], valid : [loss = 1.409, top1 = 62.32%], test : [loss = 1.398, top1 = 62.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 36.91%], valid : [loss = 2.601, top1 = 34.58%], test : [loss = 2.640, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.33%], valid : [loss = 0.909, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8109/15625) 008109-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.86%], valid : [loss = 0.615, top1 = 84.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.12 ms.
cifar10        train : [loss = 0.077, top1 = 97.44%], test  : [loss = 0.413, top1 = 88.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.48 ms.
cifar100       train : [loss = 0.665, top1 = 80.34%], valid : [loss = 1.549, top1 = 60.26%], test : [loss = 1.528, top1 = 60.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 3.107, top1 = 23.89%], valid : [loss = 3.134, top1 = 23.70%], test : [loss = 3.147, top1 = 22.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 62.74%], valid : [loss = 1.052, top1 = 61.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8110/15625) 008110-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.515, top1 = 89.61%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.30 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.378, top1 = 92.31%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.96 ms.
cifar100       train : [loss = 0.065, top1 = 99.10%], valid : [loss = 1.426, top1 = 69.24%], test : [loss = 1.435, top1 = 69.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.43%], valid : [loss = 2.342, top1 = 41.83%], test : [loss = 2.399, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.14%], valid : [loss = 0.674, top1 = 77.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8111/15625) 008111-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.00%], valid : [loss = 0.563, top1 = 85.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.96 ms.
cifar10        train : [loss = 0.099, top1 = 96.82%], test  : [loss = 0.364, top1 = 89.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.35 ms.
cifar100       train : [loss = 0.726, top1 = 78.77%], valid : [loss = 1.375, top1 = 63.18%], test : [loss = 1.363, top1 = 64.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.88%], valid : [loss = 2.591, top1 = 34.80%], test : [loss = 2.638, top1 = 34.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.89%], valid : [loss = 0.928, top1 = 67.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8112/15625) 008112-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.98%], valid : [loss = 0.580, top1 = 86.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.92 ms.
cifar10        train : [loss = 0.063, top1 = 98.00%], test  : [loss = 0.364, top1 = 89.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.81 ms.
cifar100       train : [loss = 0.648, top1 = 81.13%], valid : [loss = 1.329, top1 = 64.38%], test : [loss = 1.304, top1 = 65.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.405, top1 = 38.63%], valid : [loss = 2.507, top1 = 36.77%], test : [loss = 2.543, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8113/15625) 008113-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.499, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.23 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.318, top1 = 92.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.09 ms.
cifar100       train : [loss = 0.240, top1 = 94.08%], valid : [loss = 1.245, top1 = 68.47%], test : [loss = 1.236, top1 = 68.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.32%], valid : [loss = 2.269, top1 = 41.92%], test : [loss = 2.309, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8114/15625) 008114-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 90.98%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.32 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.303, top1 = 93.70%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.33 ms.
cifar100       train : [loss = 0.030, top1 = 99.65%], valid : [loss = 1.385, top1 = 70.92%], test : [loss = 1.346, top1 = 71.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.362, top1 = 62.77%], valid : [loss = 2.221, top1 = 44.73%], test : [loss = 2.249, top1 = 45.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.343, top1 = 88.23%], valid : [loss = 0.482, top1 = 83.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8115/15625) 008115-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.438, top1 = 89.47%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.83%], test  : [loss = 0.313, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.322, top1 = 91.26%], valid : [loss = 1.304, top1 = 67.54%], test : [loss = 1.309, top1 = 66.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.28%], valid : [loss = 2.364, top1 = 40.50%], test : [loss = 2.435, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.44%], valid : [loss = 0.526, top1 = 82.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8116/15625) 008116-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.21%], valid : [loss = 0.445, top1 = 87.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.115, top1 = 96.48%], test  : [loss = 0.342, top1 = 89.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.76 ms.
cifar100       train : [loss = 0.867, top1 = 75.17%], valid : [loss = 1.310, top1 = 64.16%], test : [loss = 1.258, top1 = 64.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.50%], valid : [loss = 2.603, top1 = 35.23%], test : [loss = 2.668, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.12%], valid : [loss = 0.667, top1 = 77.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8117/15625) 008117-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.85 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.329, top1 = 92.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.63 ms.
cifar100       train : [loss = 0.121, top1 = 97.53%], valid : [loss = 1.324, top1 = 69.18%], test : [loss = 1.334, top1 = 69.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.61 ms.
ImageNet16-120 train : [loss = 1.731, top1 = 53.85%], valid : [loss = 2.212, top1 = 43.52%], test : [loss = 2.237, top1 = 43.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.72%], valid : [loss = 0.645, top1 = 77.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8118/15625) 008118-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.17%], valid : [loss = 0.666, top1 = 84.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.050, top1 = 98.46%], test  : [loss = 0.394, top1 = 89.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.24 ms.
cifar100       train : [loss = 0.665, top1 = 80.55%], valid : [loss = 1.478, top1 = 62.34%], test : [loss = 1.452, top1 = 62.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.445, top1 = 37.74%], valid : [loss = 2.615, top1 = 34.20%], test : [loss = 2.650, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.60%], valid : [loss = 0.871, top1 = 69.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8119/15625) 008119-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.531, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.332, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.306, top1 = 91.51%], valid : [loss = 1.283, top1 = 67.68%], test : [loss = 1.290, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.17%], valid : [loss = 2.313, top1 = 41.87%], test : [loss = 2.322, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.00%], valid : [loss = 0.781, top1 = 72.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8120/15625) 008120-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.398, top1 = 90.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.288, top1 = 93.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.33 ms.
cifar100       train : [loss = 0.093, top1 = 98.47%], valid : [loss = 1.286, top1 = 70.40%], test : [loss = 1.297, top1 = 70.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 1.641, top1 = 55.85%], valid : [loss = 2.221, top1 = 43.40%], test : [loss = 2.250, top1 = 43.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.77%], valid : [loss = 0.516, top1 = 82.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8121/15625) 008121-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.591, top1 = 88.24%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.398, top1 = 91.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.87 ms.
cifar100       train : [loss = 0.208, top1 = 95.11%], valid : [loss = 1.453, top1 = 66.14%], test : [loss = 1.428, top1 = 66.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.25 ms.
ImageNet16-120 train : [loss = 2.076, top1 = 45.93%], valid : [loss = 2.487, top1 = 38.97%], test : [loss = 2.536, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.12%], valid : [loss = 0.727, top1 = 74.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8122/15625) 008122-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.72 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.43 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8123/15625) 008123-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.454, top1 = 90.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.19 ms.
cifar100       train : [loss = 0.083, top1 = 98.47%], valid : [loss = 1.426, top1 = 69.30%], test : [loss = 1.384, top1 = 69.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 56.02%], valid : [loss = 2.268, top1 = 42.92%], test : [loss = 2.291, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.32%], valid : [loss = 0.561, top1 = 80.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8124/15625) 008124-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.478, top1 = 90.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.320, top1 = 93.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.95 ms.
cifar100       train : [loss = 0.066, top1 = 98.99%], valid : [loss = 1.396, top1 = 70.24%], test : [loss = 1.426, top1 = 69.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 1.639, top1 = 55.94%], valid : [loss = 2.363, top1 = 40.97%], test : [loss = 2.401, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.447, top1 = 84.46%], valid : [loss = 0.569, top1 = 81.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8125/15625) 008125-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.75%], valid : [loss = 0.613, top1 = 87.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.09 ms.
cifar10        train : [loss = 0.017, top1 = 99.51%], test  : [loss = 0.399, top1 = 90.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.75 ms.
cifar100       train : [loss = 0.385, top1 = 88.95%], valid : [loss = 1.478, top1 = 63.94%], test : [loss = 1.464, top1 = 64.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.756, top1 = 30.57%], valid : [loss = 2.832, top1 = 28.73%], test : [loss = 2.847, top1 = 28.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 56.70%], valid : [loss = 1.179, top1 = 56.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8126/15625) 008126-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.76%], valid : [loss = 0.479, top1 = 84.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10        train : [loss = 0.297, top1 = 90.14%], test  : [loss = 0.394, top1 = 86.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.58 ms.
cifar100       train : [loss = 1.333, top1 = 63.25%], valid : [loss = 1.538, top1 = 58.06%], test : [loss = 1.525, top1 = 57.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.51%], valid : [loss = 2.913, top1 = 29.93%], test : [loss = 2.950, top1 = 28.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8127/15625) 008127-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.58%], valid : [loss = 0.471, top1 = 84.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10        train : [loss = 0.240, top1 = 91.74%], test  : [loss = 0.414, top1 = 86.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.67 ms.
cifar100       train : [loss = 1.296, top1 = 63.77%], valid : [loss = 1.566, top1 = 56.96%], test : [loss = 1.562, top1 = 57.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.599, top1 = 15.81%], valid : [loss = 3.601, top1 = 16.27%], test : [loss = 3.609, top1 = 15.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8128/15625) 008128-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.34%], valid : [loss = 0.709, top1 = 80.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.44 ms.
cifar10        train : [loss = 0.189, top1 = 93.41%], test  : [loss = 0.522, top1 = 84.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 0.897, top1 = 73.74%], valid : [loss = 1.615, top1 = 58.28%], test : [loss = 1.661, top1 = 56.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 3.479, top1 = 17.24%], valid : [loss = 3.484, top1 = 17.00%], test : [loss = 3.461, top1 = 17.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.38%], valid : [loss = 1.303, top1 = 52.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8129/15625) 008129-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.538, top1 = 88.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.83 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.368, top1 = 92.21%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.15 ms.
cifar100       train : [loss = 0.145, top1 = 96.73%], valid : [loss = 1.389, top1 = 68.42%], test : [loss = 1.417, top1 = 67.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.14%], valid : [loss = 2.343, top1 = 39.57%], test : [loss = 2.350, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.35%], valid : [loss = 0.889, top1 = 68.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8130/15625) 008130-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.32%], valid : [loss = 0.463, top1 = 85.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.35 ms.
cifar10        train : [loss = 0.163, top1 = 94.65%], test  : [loss = 0.350, top1 = 88.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 1.017, top1 = 70.86%], valid : [loss = 1.368, top1 = 61.78%], test : [loss = 1.336, top1 = 63.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.81%], valid : [loss = 2.684, top1 = 32.87%], test : [loss = 2.723, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8131/15625) 008131-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.516, top1 = 88.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.63 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.339, top1 = 91.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.01 ms.
cifar100       train : [loss = 0.321, top1 = 91.30%], valid : [loss = 1.288, top1 = 67.25%], test : [loss = 1.291, top1 = 67.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.14 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.83%], valid : [loss = 2.405, top1 = 38.83%], test : [loss = 2.411, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.96%], valid : [loss = 0.703, top1 = 75.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8132/15625) 008132-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.551, top1 = 88.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.393, top1 = 91.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.07 ms.
cifar100       train : [loss = 0.172, top1 = 96.13%], valid : [loss = 1.458, top1 = 67.26%], test : [loss = 1.438, top1 = 66.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.80%], valid : [loss = 2.451, top1 = 38.77%], test : [loss = 2.526, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.62%], valid : [loss = 0.751, top1 = 73.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8133/15625) 008133-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.28 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.76 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.68 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8134/15625) 008134-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.490, top1 = 90.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.319, top1 = 93.11%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.50 ms.
cifar100       train : [loss = 0.124, top1 = 97.48%], valid : [loss = 1.316, top1 = 68.43%], test : [loss = 1.323, top1 = 69.01%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.62%], valid : [loss = 2.192, top1 = 44.15%], test : [loss = 2.185, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.92%], valid : [loss = 0.633, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8135/15625) 008135-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.405, top1 = 91.42%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.59 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.271, top1 = 94.12%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.15 ms.
cifar100       train : [loss = 0.028, top1 = 99.76%], valid : [loss = 1.305, top1 = 71.94%], test : [loss = 1.275, top1 = 72.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 1.250, top1 = 65.53%], valid : [loss = 2.242, top1 = 45.87%], test : [loss = 2.256, top1 = 45.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 88.02%], valid : [loss = 0.498, top1 = 83.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8136/15625) 008136-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.639, top1 = 85.96%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.84 ms.
cifar10        train : [loss = 0.028, top1 = 99.34%], test  : [loss = 0.448, top1 = 89.20%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.77 ms.
cifar100       train : [loss = 0.386, top1 = 89.74%], valid : [loss = 1.404, top1 = 65.02%], test : [loss = 1.380, top1 = 64.76%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.98%], valid : [loss = 2.616, top1 = 34.33%], test : [loss = 2.650, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.74%], valid : [loss = 0.772, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8137/15625) 008137-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.478, top1 = 89.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.58 ms.
cifar100       train : [loss = 0.324, top1 = 91.23%], valid : [loss = 1.259, top1 = 67.39%], test : [loss = 1.271, top1 = 67.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.56%], valid : [loss = 2.316, top1 = 41.12%], test : [loss = 2.336, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8138/15625) 008138-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.21 ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.44%], valid : [loss = 0.850, top1 = 70.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10        train : [loss = 0.672, top1 = 76.31%], test  : [loss = 0.766, top1 = 73.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.16 ms.
cifar100       train : [loss = 1.965, top1 = 47.71%], valid : [loss = 2.125, top1 = 45.30%], test : [loss = 2.147, top1 = 44.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 3.656, top1 = 15.59%], valid : [loss = 3.690, top1 = 15.63%], test : [loss = 3.691, top1 = 14.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.380, top1 = 49.95%], valid : [loss = 1.405, top1 = 49.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8139/15625) 008139-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.458, top1 = 86.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10        train : [loss = 0.113, top1 = 96.54%], test  : [loss = 0.343, top1 = 89.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 0.864, top1 = 75.48%], valid : [loss = 1.302, top1 = 63.86%], test : [loss = 1.293, top1 = 64.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.58%], valid : [loss = 2.625, top1 = 34.45%], test : [loss = 2.653, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8140/15625) 008140-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.99%], valid : [loss = 0.483, top1 = 84.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.18 ms.
cifar10        train : [loss = 0.298, top1 = 90.14%], test  : [loss = 0.395, top1 = 86.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.15 ms.
cifar100       train : [loss = 1.316, top1 = 63.66%], valid : [loss = 1.535, top1 = 58.22%], test : [loss = 1.487, top1 = 58.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.54%], valid : [loss = 2.910, top1 = 29.47%], test : [loss = 2.955, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.13%], valid : [loss = 0.731, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8141/15625) 008141-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.529, top1 = 88.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.321, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.54 ms.
cifar100       train : [loss = 0.355, top1 = 90.20%], valid : [loss = 1.246, top1 = 67.76%], test : [loss = 1.261, top1 = 67.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.69 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.54%], valid : [loss = 2.402, top1 = 38.50%], test : [loss = 2.430, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.35%], valid : [loss = 0.680, top1 = 76.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8142/15625) 008142-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.561, top1 = 87.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.361, top1 = 91.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.98 ms.
cifar100       train : [loss = 0.401, top1 = 88.55%], valid : [loss = 1.259, top1 = 67.30%], test : [loss = 1.276, top1 = 66.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.47 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.53%], valid : [loss = 2.370, top1 = 40.50%], test : [loss = 2.389, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.82%], valid : [loss = 0.914, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8143/15625) 008143-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.554, top1 = 88.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.83 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.355, top1 = 92.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.149, top1 = 96.87%], valid : [loss = 1.405, top1 = 67.14%], test : [loss = 1.446, top1 = 67.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.89 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.26%], valid : [loss = 2.405, top1 = 38.90%], test : [loss = 2.417, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 79.80%], valid : [loss = 0.689, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8144/15625) 008144-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.36%], valid : [loss = 0.570, top1 = 86.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.19 ms.
cifar10        train : [loss = 0.045, top1 = 98.58%], test  : [loss = 0.393, top1 = 89.72%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.70 ms.
cifar100       train : [loss = 0.489, top1 = 85.84%], valid : [loss = 1.384, top1 = 64.14%], test : [loss = 1.379, top1 = 64.04%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 41.79%], valid : [loss = 2.474, top1 = 36.93%], test : [loss = 2.497, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.45%], valid : [loss = 0.835, top1 = 70.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8145/15625) 008145-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.547, top1 = 88.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10        train : [loss = 0.015, top1 = 99.58%], test  : [loss = 0.359, top1 = 91.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.281, top1 = 92.17%], valid : [loss = 1.305, top1 = 67.84%], test : [loss = 1.295, top1 = 67.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.68 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.72%], valid : [loss = 2.316, top1 = 40.87%], test : [loss = 2.357, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.34%], valid : [loss = 0.841, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8146/15625) 008146-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.90%], valid : [loss = 0.461, top1 = 84.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10        train : [loss = 0.303, top1 = 89.84%], test  : [loss = 0.401, top1 = 86.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 1.333, top1 = 63.22%], valid : [loss = 1.552, top1 = 57.56%], test : [loss = 1.514, top1 = 58.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.50%], valid : [loss = 2.893, top1 = 29.57%], test : [loss = 2.956, top1 = 27.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.76%], valid : [loss = 0.773, top1 = 73.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8147/15625) 008147-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.28%], valid : [loss = 0.601, top1 = 85.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10        train : [loss = 0.103, top1 = 96.61%], test  : [loss = 0.400, top1 = 89.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.57 ms.
cifar100       train : [loss = 0.828, top1 = 75.63%], valid : [loss = 1.436, top1 = 62.10%], test : [loss = 1.442, top1 = 61.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.10%], valid : [loss = 2.751, top1 = 32.80%], test : [loss = 2.823, top1 = 30.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.06%], valid : [loss = 0.700, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8148/15625) 008148-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.08%], valid : [loss = 0.733, top1 = 82.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.44 ms.
cifar10        train : [loss = 0.090, top1 = 97.04%], test  : [loss = 0.520, top1 = 86.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.86 ms.
cifar100       train : [loss = 0.598, top1 = 82.39%], valid : [loss = 1.704, top1 = 58.74%], test : [loss = 1.686, top1 = 57.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 3.193, top1 = 22.35%], valid : [loss = 3.237, top1 = 21.20%], test : [loss = 3.258, top1 = 21.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 58.79%], valid : [loss = 1.168, top1 = 58.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8149/15625) 008149-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.55%], valid : [loss = 0.562, top1 = 85.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10        train : [loss = 0.110, top1 = 96.48%], test  : [loss = 0.377, top1 = 88.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.32 ms.
cifar100       train : [loss = 0.770, top1 = 77.15%], valid : [loss = 1.382, top1 = 62.90%], test : [loss = 1.396, top1 = 62.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.56%], valid : [loss = 2.691, top1 = 33.77%], test : [loss = 2.717, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.844, top1 = 69.98%], valid : [loss = 0.903, top1 = 68.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8150/15625) 008150-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.641, top1 = 86.58%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.58 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.431, top1 = 90.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.90 ms.
cifar100       train : [loss = 0.238, top1 = 94.06%], valid : [loss = 1.552, top1 = 64.36%], test : [loss = 1.560, top1 = 64.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.23%], valid : [loss = 2.527, top1 = 35.80%], test : [loss = 2.560, top1 = 36.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.43%], valid : [loss = 0.800, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8151/15625) 008151-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.64%], valid : [loss = 0.547, top1 = 87.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10        train : [loss = 0.032, top1 = 99.00%], test  : [loss = 0.356, top1 = 91.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 0.454, top1 = 86.69%], valid : [loss = 1.266, top1 = 66.68%], test : [loss = 1.290, top1 = 65.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 41.99%], valid : [loss = 2.423, top1 = 38.13%], test : [loss = 2.455, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.01%], valid : [loss = 0.875, top1 = 69.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8152/15625) 008152-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.22%], valid : [loss = 0.466, top1 = 86.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10        train : [loss = 0.152, top1 = 95.11%], test  : [loss = 0.339, top1 = 88.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 1.037, top1 = 70.57%], valid : [loss = 1.398, top1 = 61.02%], test : [loss = 1.390, top1 = 60.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.62%], valid : [loss = 2.711, top1 = 32.87%], test : [loss = 2.716, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8153/15625) 008153-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.68%], valid : [loss = 0.710, top1 = 83.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.086, top1 = 97.25%], test  : [loss = 0.484, top1 = 86.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.99 ms.
cifar100       train : [loss = 0.788, top1 = 77.17%], valid : [loss = 1.508, top1 = 60.84%], test : [loss = 1.449, top1 = 61.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.794, top1 = 30.71%], valid : [loss = 2.922, top1 = 28.33%], test : [loss = 2.979, top1 = 27.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.33%], valid : [loss = 0.868, top1 = 69.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8154/15625) 008154-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.669, top1 = 84.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10        train : [loss = 0.038, top1 = 98.89%], test  : [loss = 0.409, top1 = 89.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.82 ms.
cifar100       train : [loss = 0.561, top1 = 83.48%], valid : [loss = 1.483, top1 = 62.36%], test : [loss = 1.474, top1 = 62.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.401, top1 = 38.67%], valid : [loss = 2.588, top1 = 34.63%], test : [loss = 2.581, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.10%], valid : [loss = 0.914, top1 = 67.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8155/15625) 008155-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.536, top1 = 89.11%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.390, top1 = 91.64%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.05 ms.
cifar100       train : [loss = 0.062, top1 = 99.34%], valid : [loss = 1.356, top1 = 69.76%], test : [loss = 1.361, top1 = 68.88%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=24.76 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.52%], valid : [loss = 2.430, top1 = 40.83%], test : [loss = 2.466, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.61%], valid : [loss = 0.665, top1 = 77.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8156/15625) 008156-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.73%], valid : [loss = 0.542, top1 = 83.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.207, top1 = 92.94%], test  : [loss = 0.403, top1 = 87.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.36 ms.
cifar100       train : [loss = 1.317, top1 = 62.56%], valid : [loss = 1.585, top1 = 56.16%], test : [loss = 1.585, top1 = 55.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.724, top1 = 32.04%], valid : [loss = 2.753, top1 = 31.60%], test : [loss = 2.779, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 65.87%], valid : [loss = 0.994, top1 = 64.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8157/15625) 008157-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.539, top1 = 88.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.355, top1 = 91.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.93 ms.
cifar100       train : [loss = 0.251, top1 = 93.34%], valid : [loss = 1.300, top1 = 68.02%], test : [loss = 1.314, top1 = 67.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.45%], valid : [loss = 2.422, top1 = 38.30%], test : [loss = 2.428, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8158/15625) 008158-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.437, top1 = 89.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.290, top1 = 92.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.208, top1 = 95.07%], valid : [loss = 1.279, top1 = 68.89%], test : [loss = 1.259, top1 = 69.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.70%], valid : [loss = 2.267, top1 = 42.33%], test : [loss = 2.296, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8159/15625) 008159-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.424, top1 = 90.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.10 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.284, top1 = 93.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.22 ms.
cifar100       train : [loss = 0.058, top1 = 99.26%], valid : [loss = 1.332, top1 = 70.53%], test : [loss = 1.324, top1 = 70.45%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.56 ms.
ImageNet16-120 train : [loss = 1.490, top1 = 59.65%], valid : [loss = 2.224, top1 = 44.44%], test : [loss = 2.241, top1 = 43.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.363, top1 = 87.59%], valid : [loss = 0.499, top1 = 83.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8160/15625) 008160-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.558, top1 = 88.26%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=19.24 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.371, top1 = 91.89%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=19.83 ms.
cifar100       train : [loss = 0.173, top1 = 96.21%], valid : [loss = 1.442, top1 = 66.82%], test : [loss = 1.431, top1 = 67.08%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=19.55 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.42%], valid : [loss = 2.437, top1 = 39.29%], test : [loss = 2.451, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.31%], valid : [loss = 0.694, top1 = 75.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8161/15625) 008161-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.655, top1 = 85.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.036, top1 = 98.97%], test  : [loss = 0.393, top1 = 90.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.545, top1 = 83.94%], valid : [loss = 1.417, top1 = 63.46%], test : [loss = 1.443, top1 = 63.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.29%], valid : [loss = 2.544, top1 = 34.83%], test : [loss = 2.595, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 69.39%], valid : [loss = 0.913, top1 = 67.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8162/15625) 008162-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.398, top1 = 90.80%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.252, top1 = 93.64%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.75 ms.
cifar100       train : [loss = 0.063, top1 = 99.26%], valid : [loss = 1.246, top1 = 71.94%], test : [loss = 1.239, top1 = 71.94%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.50 ms.
ImageNet16-120 train : [loss = 1.420, top1 = 61.41%], valid : [loss = 2.148, top1 = 46.37%], test : [loss = 2.161, top1 = 46.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.369, top1 = 87.38%], valid : [loss = 0.513, top1 = 83.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8163/15625) 008163-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.540, top1 = 88.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.348, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.138, top1 = 97.22%], valid : [loss = 1.391, top1 = 68.06%], test : [loss = 1.419, top1 = 67.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 49.84%], valid : [loss = 2.413, top1 = 40.23%], test : [loss = 2.451, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.10%], valid : [loss = 0.664, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8164/15625) 008164-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8165/15625) 008165-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.14%], valid : [loss = 0.985, top1 = 66.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.73 ms.
cifar10        train : [loss = 0.774, top1 = 72.91%], test  : [loss = 0.869, top1 = 69.78%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.81 ms.
cifar100       train : [loss = 2.135, top1 = 44.21%], valid : [loss = 2.311, top1 = 40.28%], test : [loss = 2.309, top1 = 40.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.31 ms.
ImageNet16-120 train : [loss = 3.738, top1 = 14.28%], valid : [loss = 3.758, top1 = 14.30%], test : [loss = 3.762, top1 = 13.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8166/15625) 008166-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.451, top1 = 90.49%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.314, top1 = 92.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.080, top1 = 98.55%], valid : [loss = 1.410, top1 = 69.46%], test : [loss = 1.357, top1 = 70.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 1.585, top1 = 57.34%], valid : [loss = 2.243, top1 = 43.03%], test : [loss = 2.294, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.383, top1 = 86.85%], valid : [loss = 0.513, top1 = 82.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8167/15625) 008167-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.552, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.348, top1 = 91.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.16 ms.
cifar100       train : [loss = 0.248, top1 = 93.43%], valid : [loss = 1.340, top1 = 67.18%], test : [loss = 1.371, top1 = 67.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.78%], valid : [loss = 2.437, top1 = 38.27%], test : [loss = 2.429, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8168/15625) 008168-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.523, top1 = 88.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.83 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.346, top1 = 91.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.62 ms.
cifar100       train : [loss = 0.327, top1 = 91.03%], valid : [loss = 1.322, top1 = 66.94%], test : [loss = 1.308, top1 = 66.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.97%], valid : [loss = 2.415, top1 = 39.20%], test : [loss = 2.427, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.43%], valid : [loss = 0.802, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8169/15625) 008169-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.80%], valid : [loss = 0.711, top1 = 76.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.441, top1 = 84.62%], test  : [loss = 0.564, top1 = 80.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.23 ms.
cifar100       train : [loss = 1.788, top1 = 51.14%], valid : [loss = 1.982, top1 = 47.86%], test : [loss = 1.966, top1 = 47.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.61 ms.
ImageNet16-120 train : [loss = 3.444, top1 = 18.82%], valid : [loss = 3.439, top1 = 19.93%], test : [loss = 3.477, top1 = 17.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.233, top1 = 55.32%], valid : [loss = 1.265, top1 = 54.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8170/15625) 008170-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.64%], valid : [loss = 0.681, top1 = 82.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10        train : [loss = 0.096, top1 = 96.76%], test  : [loss = 0.418, top1 = 87.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 0.846, top1 = 75.08%], valid : [loss = 1.503, top1 = 59.70%], test : [loss = 1.495, top1 = 60.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.68%], valid : [loss = 2.733, top1 = 31.50%], test : [loss = 2.744, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.42%], valid : [loss = 0.908, top1 = 68.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8171/15625) 008171-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.17%], valid : [loss = 0.596, top1 = 85.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.89 ms.
cifar10        train : [loss = 0.078, top1 = 97.62%], test  : [loss = 0.389, top1 = 89.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.722, top1 = 79.02%], valid : [loss = 1.402, top1 = 62.06%], test : [loss = 1.377, top1 = 63.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 35.98%], valid : [loss = 2.645, top1 = 33.53%], test : [loss = 2.690, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.03%], valid : [loss = 0.792, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8172/15625) 008172-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.09%], valid : [loss = 0.528, top1 = 86.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.078, top1 = 97.52%], test  : [loss = 0.378, top1 = 89.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 0.724, top1 = 78.58%], valid : [loss = 1.368, top1 = 64.06%], test : [loss = 1.387, top1 = 64.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 35.91%], valid : [loss = 2.620, top1 = 33.87%], test : [loss = 2.708, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8173/15625) 008173-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.77%], valid : [loss = 0.537, top1 = 84.14%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=14.40 ms.
cifar10        train : [loss = 0.193, top1 = 93.51%], test  : [loss = 0.386, top1 = 87.82%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=12.67 ms.
cifar100       train : [loss = 1.206, top1 = 65.84%], valid : [loss = 1.519, top1 = 58.30%], test : [loss = 1.506, top1 = 58.57%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 34.00%], valid : [loss = 2.671, top1 = 33.17%], test : [loss = 2.722, top1 = 32.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.48%], valid : [loss = 0.965, top1 = 66.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8174/15625) 008174-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.86 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.76%], valid : [loss = 0.529, top1 = 85.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.175, top1 = 94.16%], test  : [loss = 0.372, top1 = 88.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.73 ms.
cifar100       train : [loss = 0.967, top1 = 72.01%], valid : [loss = 1.348, top1 = 62.74%], test : [loss = 1.372, top1 = 61.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.14%], valid : [loss = 2.681, top1 = 32.70%], test : [loss = 2.718, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.62%], valid : [loss = 0.985, top1 = 65.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8175/15625) 008175-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.509, top1 = 89.22%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.90 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.41%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.89 ms.
cifar100       train : [loss = 0.181, top1 = 95.80%], valid : [loss = 1.264, top1 = 69.12%], test : [loss = 1.268, top1 = 68.26%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=23.83 ms.
ImageNet16-120 train : [loss = 1.750, top1 = 53.36%], valid : [loss = 2.149, top1 = 44.53%], test : [loss = 2.207, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.35%], valid : [loss = 0.681, top1 = 76.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8176/15625) 008176-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.487, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.301, top1 = 92.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.25 ms.
cifar100       train : [loss = 0.290, top1 = 92.40%], valid : [loss = 1.213, top1 = 68.46%], test : [loss = 1.242, top1 = 68.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.61%], valid : [loss = 2.233, top1 = 42.63%], test : [loss = 2.257, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.85%], valid : [loss = 0.666, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8177/15625) 008177-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.91%], valid : [loss = 0.476, top1 = 84.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10        train : [loss = 0.299, top1 = 89.96%], test  : [loss = 0.404, top1 = 86.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 1.340, top1 = 62.88%], valid : [loss = 1.546, top1 = 57.87%], test : [loss = 1.520, top1 = 58.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.63%], valid : [loss = 2.897, top1 = 29.00%], test : [loss = 2.954, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8178/15625) 008178-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.99%], valid : [loss = 0.477, top1 = 84.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10        train : [loss = 0.305, top1 = 89.71%], test  : [loss = 0.410, top1 = 86.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.56 ms.
cifar100       train : [loss = 1.344, top1 = 62.81%], valid : [loss = 1.535, top1 = 57.88%], test : [loss = 1.525, top1 = 58.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.76 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.54%], valid : [loss = 2.911, top1 = 29.53%], test : [loss = 2.955, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8179/15625) 008179-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.90%], valid : [loss = 0.554, top1 = 86.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.16 ms.
cifar10        train : [loss = 0.064, top1 = 97.91%], test  : [loss = 0.379, top1 = 89.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.22 ms.
cifar100       train : [loss = 0.635, top1 = 81.15%], valid : [loss = 1.304, top1 = 65.98%], test : [loss = 1.292, top1 = 64.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.11%], valid : [loss = 2.482, top1 = 36.73%], test : [loss = 2.500, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8180/15625) 008180-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.531, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.19 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.369, top1 = 92.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.77 ms.
cifar100       train : [loss = 0.116, top1 = 97.47%], valid : [loss = 1.373, top1 = 69.06%], test : [loss = 1.380, top1 = 68.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.32 ms.
ImageNet16-120 train : [loss = 1.978, top1 = 48.00%], valid : [loss = 2.378, top1 = 39.37%], test : [loss = 2.340, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.35%], valid : [loss = 0.823, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8181/15625) 008181-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.14%], valid : [loss = 0.449, top1 = 87.12%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=14.82 ms.
cifar10        train : [loss = 0.117, top1 = 96.36%], test  : [loss = 0.328, top1 = 89.52%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=13.33 ms.
cifar100       train : [loss = 0.867, top1 = 75.23%], valid : [loss = 1.297, top1 = 63.87%], test : [loss = 1.283, top1 = 64.32%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.57%], valid : [loss = 2.624, top1 = 33.86%], test : [loss = 2.668, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8182/15625) 008182-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.56%], valid : [loss = 0.623, top1 = 84.14%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.29 ms.
cifar10        train : [loss = 0.090, top1 = 97.02%], test  : [loss = 0.405, top1 = 88.60%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.38 ms.
cifar100       train : [loss = 0.595, top1 = 82.50%], valid : [loss = 1.493, top1 = 62.22%], test : [loss = 1.519, top1 = 62.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 3.164, top1 = 22.70%], valid : [loss = 3.173, top1 = 22.40%], test : [loss = 3.185, top1 = 22.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.16%], valid : [loss = 1.074, top1 = 61.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8183/15625) 008183-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.55 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.30 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8184/15625) 008184-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.321, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.305, top1 = 91.81%], valid : [loss = 1.312, top1 = 67.05%], test : [loss = 1.303, top1 = 67.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.01%], valid : [loss = 2.342, top1 = 40.37%], test : [loss = 2.372, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.61%], valid : [loss = 0.567, top1 = 80.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8185/15625) 008185-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.559, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.391, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.72 ms.
cifar100       train : [loss = 0.111, top1 = 97.78%], valid : [loss = 1.542, top1 = 66.66%], test : [loss = 1.560, top1 = 66.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.52%], valid : [loss = 2.397, top1 = 39.97%], test : [loss = 2.429, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.34%], valid : [loss = 0.744, top1 = 74.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8186/15625) 008186-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.61%], valid : [loss = 0.717, top1 = 80.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.180, top1 = 93.81%], test  : [loss = 0.522, top1 = 84.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 0.886, top1 = 73.82%], valid : [loss = 1.608, top1 = 57.80%], test : [loss = 1.644, top1 = 57.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 3.532, top1 = 16.29%], valid : [loss = 3.521, top1 = 16.53%], test : [loss = 3.508, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.346, top1 = 50.66%], valid : [loss = 1.367, top1 = 49.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8187/15625) 008187-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.04 ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.24%], valid : [loss = 0.954, top1 = 67.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10        train : [loss = 0.774, top1 = 73.05%], test  : [loss = 0.862, top1 = 69.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 2.138, top1 = 43.84%], valid : [loss = 2.313, top1 = 41.02%], test : [loss = 2.346, top1 = 40.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 3.738, top1 = 14.26%], valid : [loss = 3.763, top1 = 14.60%], test : [loss = 3.772, top1 = 13.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.449, top1 = 47.06%], valid : [loss = 1.471, top1 = 46.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8188/15625) 008188-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.483, top1 = 89.51%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.73 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.293, top1 = 92.62%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=23.17 ms.
cifar100       train : [loss = 0.200, top1 = 95.17%], valid : [loss = 1.197, top1 = 70.74%], test : [loss = 1.213, top1 = 69.84%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.14 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.56%], valid : [loss = 2.149, top1 = 44.13%], test : [loss = 2.197, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.78%], valid : [loss = 0.651, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8189/15625) 008189-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.69%], valid : [loss = 0.457, top1 = 86.64%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.53 ms.
cifar10        train : [loss = 0.121, top1 = 96.25%], test  : [loss = 0.333, top1 = 89.50%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.32 ms.
cifar100       train : [loss = 0.763, top1 = 78.55%], valid : [loss = 1.285, top1 = 64.48%], test : [loss = 1.292, top1 = 64.45%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.78%], valid : [loss = 2.576, top1 = 34.62%], test : [loss = 2.621, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.75%], valid : [loss = 0.816, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8190/15625) 008190-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.586, top1 = 88.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.374, top1 = 92.15%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.45 ms.
cifar100       train : [loss = 0.094, top1 = 98.35%], valid : [loss = 1.456, top1 = 67.87%], test : [loss = 1.464, top1 = 67.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.59%], valid : [loss = 2.427, top1 = 39.12%], test : [loss = 2.447, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.96%], valid : [loss = 0.736, top1 = 74.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8191/15625) 008191-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.23%], valid : [loss = 0.583, top1 = 86.69%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10        train : [loss = 0.061, top1 = 98.05%], test  : [loss = 0.375, top1 = 89.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.02 ms.
cifar100       train : [loss = 0.673, top1 = 80.18%], valid : [loss = 1.324, top1 = 64.43%], test : [loss = 1.312, top1 = 64.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.70%], valid : [loss = 2.480, top1 = 36.94%], test : [loss = 2.490, top1 = 36.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.56%], valid : [loss = 0.716, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8192/15625) 008192-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.414, top1 = 90.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.284, top1 = 93.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.185, top1 = 95.61%], valid : [loss = 1.280, top1 = 70.24%], test : [loss = 1.280, top1 = 69.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.52%], valid : [loss = 2.242, top1 = 42.67%], test : [loss = 2.287, top1 = 42.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8193/15625) 008193-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.16%], valid : [loss = 0.546, top1 = 82.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.82 ms.
cifar10        train : [loss = 0.240, top1 = 91.78%], test  : [loss = 0.393, top1 = 87.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.33 ms.
cifar100       train : [loss = 1.335, top1 = 62.36%], valid : [loss = 1.600, top1 = 56.27%], test : [loss = 1.597, top1 = 56.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 2.838, top1 = 29.95%], valid : [loss = 2.864, top1 = 30.12%], test : [loss = 2.903, top1 = 29.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.11%], valid : [loss = 1.038, top1 = 63.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8194/15625) 008194-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.483, top1 = 89.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.326, top1 = 92.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.117, top1 = 97.52%], valid : [loss = 1.434, top1 = 67.86%], test : [loss = 1.455, top1 = 68.45%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.74%], valid : [loss = 2.296, top1 = 41.72%], test : [loss = 2.284, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.44%], valid : [loss = 0.626, top1 = 78.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8195/15625) 008195-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.638, top1 = 86.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10        train : [loss = 0.029, top1 = 99.28%], test  : [loss = 0.425, top1 = 89.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.11 ms.
cifar100       train : [loss = 0.387, top1 = 89.62%], valid : [loss = 1.416, top1 = 65.04%], test : [loss = 1.381, top1 = 65.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.88%], valid : [loss = 2.613, top1 = 34.79%], test : [loss = 2.644, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8196/15625) 008196-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.71%], valid : [loss = 0.722, top1 = 75.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10        train : [loss = 0.444, top1 = 84.57%], test  : [loss = 0.585, top1 = 80.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 1.783, top1 = 51.33%], valid : [loss = 1.992, top1 = 48.03%], test : [loss = 2.001, top1 = 47.45%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 3.420, top1 = 19.26%], valid : [loss = 3.407, top1 = 20.19%], test : [loss = 3.442, top1 = 18.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.266, top1 = 54.30%], valid : [loss = 1.312, top1 = 52.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8197/15625) 008197-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.527, top1 = 88.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.338, top1 = 91.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 0.350, top1 = 90.46%], valid : [loss = 1.296, top1 = 66.85%], test : [loss = 1.272, top1 = 67.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.67%], valid : [loss = 2.403, top1 = 39.61%], test : [loss = 2.417, top1 = 39.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8198/15625) 008198-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.544, top1 = 88.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 0.017, top1 = 99.54%], test  : [loss = 0.364, top1 = 91.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 0.312, top1 = 91.24%], valid : [loss = 1.315, top1 = 66.89%], test : [loss = 1.337, top1 = 66.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.17%], valid : [loss = 2.477, top1 = 36.73%], test : [loss = 2.489, top1 = 37.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.45%], valid : [loss = 0.972, top1 = 65.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8199/15625) 008199-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.89%], valid : [loss = 0.756, top1 = 74.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10        train : [loss = 0.481, top1 = 83.07%], test  : [loss = 0.600, top1 = 79.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.10 ms.
cifar100       train : [loss = 1.859, top1 = 49.48%], valid : [loss = 2.042, top1 = 46.01%], test : [loss = 2.041, top1 = 46.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 3.512, top1 = 17.66%], valid : [loss = 3.509, top1 = 18.37%], test : [loss = 3.537, top1 = 17.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.10%], valid : [loss = 1.250, top1 = 55.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8200/15625) 008200-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.51%], valid : [loss = 0.472, top1 = 86.38%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.73 ms.
cifar10        train : [loss = 0.123, top1 = 96.16%], test  : [loss = 0.344, top1 = 89.09%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.52 ms.
cifar100       train : [loss = 0.762, top1 = 78.74%], valid : [loss = 1.291, top1 = 63.88%], test : [loss = 1.287, top1 = 64.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.78%], valid : [loss = 2.609, top1 = 34.82%], test : [loss = 2.613, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8201/15625) 008201-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.45%], valid : [loss = 0.548, top1 = 82.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.70 ms.
cifar10        train : [loss = 0.263, top1 = 91.06%], test  : [loss = 0.402, top1 = 86.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.04 ms.
cifar100       train : [loss = 1.393, top1 = 60.94%], valid : [loss = 1.648, top1 = 54.98%], test : [loss = 1.639, top1 = 55.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.46%], valid : [loss = 2.901, top1 = 29.00%], test : [loss = 2.958, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.40%], valid : [loss = 1.010, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8202/15625) 008202-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.63%], valid : [loss = 0.535, top1 = 86.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.060, top1 = 98.00%], test  : [loss = 0.357, top1 = 90.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.12 ms.
cifar100       train : [loss = 0.521, top1 = 84.58%], valid : [loss = 1.276, top1 = 66.19%], test : [loss = 1.294, top1 = 65.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.905, top1 = 27.37%], valid : [loss = 2.925, top1 = 26.81%], test : [loss = 2.930, top1 = 26.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.197, top1 = 56.13%], valid : [loss = 1.220, top1 = 55.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8203/15625) 008203-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.557, top1 = 88.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.350, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.94 ms.
cifar100       train : [loss = 0.132, top1 = 97.41%], valid : [loss = 1.470, top1 = 66.71%], test : [loss = 1.465, top1 = 67.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.60%], valid : [loss = 2.453, top1 = 39.09%], test : [loss = 2.479, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.42%], valid : [loss = 0.773, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8204/15625) 008204-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.387, top1 = 86.81%], valid : [loss = 0.522, top1 = 82.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.405, top1 = 86.21%], test  : [loss = 0.472, top1 = 83.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 1.549, top1 = 57.40%], valid : [loss = 1.669, top1 = 54.02%], test : [loss = 1.655, top1 = 54.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.07 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.40%], valid : [loss = 3.007, top1 = 27.14%], test : [loss = 3.057, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.134, top1 = 59.92%], valid : [loss = 1.146, top1 = 59.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8205/15625) 008205-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.614, top1 = 86.54%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.60 ms.
cifar10        train : [loss = 0.030, top1 = 99.21%], test  : [loss = 0.442, top1 = 89.43%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.24 ms.
cifar100       train : [loss = 0.374, top1 = 89.72%], valid : [loss = 1.466, top1 = 64.34%], test : [loss = 1.445, top1 = 64.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.89%], valid : [loss = 2.591, top1 = 34.90%], test : [loss = 2.602, top1 = 35.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.73%], valid : [loss = 0.772, top1 = 73.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8206/15625) 008206-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.12%], valid : [loss = 0.544, top1 = 84.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10        train : [loss = 0.150, top1 = 95.02%], test  : [loss = 0.374, top1 = 88.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 1.094, top1 = 68.63%], valid : [loss = 1.484, top1 = 59.73%], test : [loss = 1.478, top1 = 59.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.590, top1 = 34.93%], valid : [loss = 2.658, top1 = 33.19%], test : [loss = 2.683, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 67.00%], valid : [loss = 0.987, top1 = 64.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8207/15625) 008207-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.533, top1 = 88.29%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.334, top1 = 91.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 0.341, top1 = 90.73%], valid : [loss = 1.279, top1 = 66.85%], test : [loss = 1.298, top1 = 66.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.59%], valid : [loss = 2.404, top1 = 39.33%], test : [loss = 2.424, top1 = 38.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8208/15625) 008208-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.506, top1 = 88.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.346, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.14 ms.
cifar100       train : [loss = 0.475, top1 = 85.97%], valid : [loss = 1.329, top1 = 66.24%], test : [loss = 1.334, top1 = 65.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.16%], valid : [loss = 2.531, top1 = 36.18%], test : [loss = 2.548, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.50%], valid : [loss = 0.695, top1 = 76.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8209/15625) 008209-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.450, top1 = 89.64%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.15 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.302, top1 = 92.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.89 ms.
cifar100       train : [loss = 0.189, top1 = 95.69%], valid : [loss = 1.276, top1 = 68.94%], test : [loss = 1.262, top1 = 69.43%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.58%], valid : [loss = 2.248, top1 = 42.84%], test : [loss = 2.266, top1 = 42.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 84.97%], valid : [loss = 0.545, top1 = 81.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8210/15625) 008210-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.511, top1 = 88.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.337, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 0.356, top1 = 90.24%], valid : [loss = 1.275, top1 = 66.65%], test : [loss = 1.307, top1 = 67.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.68%], valid : [loss = 2.416, top1 = 39.41%], test : [loss = 2.426, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8211/15625) 008211-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.562, top1 = 87.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.99 ms.
cifar10        train : [loss = 0.031, top1 = 99.06%], test  : [loss = 0.376, top1 = 90.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.504, top1 = 85.49%], valid : [loss = 1.337, top1 = 64.87%], test : [loss = 1.327, top1 = 65.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.28 ms.
ImageNet16-120 train : [loss = 2.590, top1 = 34.17%], valid : [loss = 2.664, top1 = 32.70%], test : [loss = 2.683, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 0.963, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8212/15625) 008212-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.96%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.312, top1 = 93.49%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.23 ms.
cifar100       train : [loss = 0.061, top1 = 99.14%], valid : [loss = 1.321, top1 = 70.29%], test : [loss = 1.333, top1 = 70.57%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.77%], valid : [loss = 2.285, top1 = 41.36%], test : [loss = 2.277, top1 = 41.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.59%], valid : [loss = 0.820, top1 = 71.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8213/15625) 008213-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.79%], valid : [loss = 0.552, top1 = 83.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.204, top1 = 93.14%], test  : [loss = 0.411, top1 = 87.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.37 ms.
cifar100       train : [loss = 1.240, top1 = 64.62%], valid : [loss = 1.546, top1 = 57.69%], test : [loss = 1.562, top1 = 57.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 32.99%], valid : [loss = 2.727, top1 = 32.23%], test : [loss = 2.749, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.06%], valid : [loss = 1.020, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8214/15625) 008214-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.58%], valid : [loss = 0.855, top1 = 70.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10        train : [loss = 0.685, top1 = 76.01%], test  : [loss = 0.766, top1 = 73.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.53 ms.
cifar100       train : [loss = 1.967, top1 = 47.86%], valid : [loss = 2.141, top1 = 44.47%], test : [loss = 2.157, top1 = 44.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 3.659, top1 = 15.54%], valid : [loss = 3.685, top1 = 15.38%], test : [loss = 3.709, top1 = 15.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8215/15625) 008215-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.72%], valid : [loss = 0.613, top1 = 84.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10        train : [loss = 0.089, top1 = 97.05%], test  : [loss = 0.418, top1 = 88.60%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.53 ms.
cifar100       train : [loss = 0.724, top1 = 78.71%], valid : [loss = 1.531, top1 = 60.29%], test : [loss = 1.541, top1 = 60.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 3.233, top1 = 21.27%], valid : [loss = 3.238, top1 = 21.04%], test : [loss = 3.273, top1 = 20.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.72%], valid : [loss = 1.051, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8216/15625) 008216-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.80 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.280, top1 = 93.83%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.37 ms.
cifar100       train : [loss = 0.053, top1 = 99.36%], valid : [loss = 1.338, top1 = 70.39%], test : [loss = 1.308, top1 = 71.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 1.483, top1 = 59.78%], valid : [loss = 2.225, top1 = 44.78%], test : [loss = 2.249, top1 = 44.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.348, top1 = 88.21%], valid : [loss = 0.482, top1 = 83.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8217/15625) 008217-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.547, top1 = 88.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.352, top1 = 91.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.57 ms.
cifar100       train : [loss = 0.328, top1 = 91.02%], valid : [loss = 1.289, top1 = 67.03%], test : [loss = 1.296, top1 = 67.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.56%], valid : [loss = 2.425, top1 = 37.88%], test : [loss = 2.440, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.94%], valid : [loss = 0.779, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8218/15625) 008218-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.67%], valid : [loss = 0.852, top1 = 72.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.559, top1 = 80.50%], test  : [loss = 0.716, top1 = 75.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.41 ms.
cifar100       train : [loss = 1.764, top1 = 52.39%], valid : [loss = 2.047, top1 = 47.11%], test : [loss = 2.065, top1 = 46.81%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.90%], valid : [loss = 3.626, top1 = 16.52%], test : [loss = 3.669, top1 = 15.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8219/15625) 008219-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.521, top1 = 88.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.362, top1 = 91.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.282, top1 = 92.73%], valid : [loss = 1.418, top1 = 65.29%], test : [loss = 1.405, top1 = 65.87%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.61%], valid : [loss = 2.342, top1 = 39.81%], test : [loss = 2.347, top1 = 39.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.51%], valid : [loss = 0.735, top1 = 74.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8220/15625) 008220-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.548, top1 = 88.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.361, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.152, top1 = 96.81%], valid : [loss = 1.399, top1 = 67.79%], test : [loss = 1.404, top1 = 67.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.930, top1 = 49.18%], valid : [loss = 2.410, top1 = 39.52%], test : [loss = 2.407, top1 = 40.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.86%], valid : [loss = 0.680, top1 = 76.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8221/15625) 008221-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.551, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.374, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.45 ms.
cifar100       train : [loss = 0.077, top1 = 98.86%], valid : [loss = 1.429, top1 = 68.82%], test : [loss = 1.450, top1 = 68.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 1.774, top1 = 52.78%], valid : [loss = 2.404, top1 = 40.52%], test : [loss = 2.383, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.96%], valid : [loss = 0.657, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8222/15625) 008222-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.41%], valid : [loss = 0.685, top1 = 81.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.173, top1 = 94.02%], test  : [loss = 0.459, top1 = 86.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.36 ms.
cifar100       train : [loss = 1.006, top1 = 70.74%], valid : [loss = 1.638, top1 = 56.90%], test : [loss = 1.623, top1 = 56.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.96 ms.
ImageNet16-120 train : [loss = 3.150, top1 = 23.24%], valid : [loss = 3.190, top1 = 23.19%], test : [loss = 3.222, top1 = 22.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 63.25%], valid : [loss = 1.072, top1 = 61.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8223/15625) 008223-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.624, top1 = 87.18%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.34 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.398, top1 = 90.89%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.37 ms.
cifar100       train : [loss = 0.228, top1 = 94.35%], valid : [loss = 1.573, top1 = 64.14%], test : [loss = 1.586, top1 = 63.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 45.92%], valid : [loss = 2.455, top1 = 38.33%], test : [loss = 2.468, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.36%], valid : [loss = 0.796, top1 = 71.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8224/15625) 008224-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.83 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.06 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8225/15625) 008225-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.83%], valid : [loss = 0.459, top1 = 86.46%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.47 ms.
cifar10        train : [loss = 0.122, top1 = 96.17%], test  : [loss = 0.340, top1 = 89.13%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.96 ms.
cifar100       train : [loss = 0.761, top1 = 78.71%], valid : [loss = 1.281, top1 = 64.56%], test : [loss = 1.277, top1 = 64.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.501, top1 = 36.70%], valid : [loss = 2.589, top1 = 35.19%], test : [loss = 2.609, top1 = 34.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8226/15625) 008226-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.296, top1 = 89.81%], valid : [loss = 0.468, top1 = 84.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.41 ms.
cifar10        train : [loss = 0.270, top1 = 90.96%], test  : [loss = 0.376, top1 = 87.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.50 ms.
cifar100       train : [loss = 1.286, top1 = 63.93%], valid : [loss = 1.485, top1 = 58.49%], test : [loss = 1.466, top1 = 59.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 2.829, top1 = 30.33%], valid : [loss = 2.828, top1 = 30.61%], test : [loss = 2.876, top1 = 29.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.58%], valid : [loss = 1.003, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8227/15625) 008227-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.99%], valid : [loss = 0.773, top1 = 82.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 0.088, top1 = 97.16%], test  : [loss = 0.492, top1 = 87.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 0.810, top1 = 76.42%], valid : [loss = 1.544, top1 = 59.91%], test : [loss = 1.517, top1 = 60.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.830, top1 = 30.07%], valid : [loss = 2.965, top1 = 28.08%], test : [loss = 3.014, top1 = 26.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8228/15625) 008228-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.523, top1 = 89.36%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.323, top1 = 92.92%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.78 ms.
cifar100       train : [loss = 0.090, top1 = 98.37%], valid : [loss = 1.337, top1 = 69.70%], test : [loss = 1.332, top1 = 69.97%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.83 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.44%], valid : [loss = 2.321, top1 = 41.13%], test : [loss = 2.320, top1 = 41.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.38%], valid : [loss = 0.799, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8229/15625) 008229-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.502, top1 = 88.39%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.347, top1 = 91.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.00 ms.
cifar100       train : [loss = 0.472, top1 = 86.12%], valid : [loss = 1.326, top1 = 65.62%], test : [loss = 1.317, top1 = 65.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.26%], valid : [loss = 2.514, top1 = 36.66%], test : [loss = 2.534, top1 = 36.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.88%], valid : [loss = 0.661, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8230/15625) 008230-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.06%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.320, top1 = 91.81%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.51 ms.
cifar100       train : [loss = 0.329, top1 = 91.04%], valid : [loss = 1.330, top1 = 67.27%], test : [loss = 1.321, top1 = 67.23%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.34%], valid : [loss = 2.377, top1 = 39.72%], test : [loss = 2.394, top1 = 39.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.454, top1 = 84.16%], valid : [loss = 0.548, top1 = 81.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8231/15625) 008231-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.161, top1 = 94.87%], valid : [loss = 0.527, top1 = 84.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10        train : [loss = 0.171, top1 = 94.28%], test  : [loss = 0.370, top1 = 88.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.09 ms.
cifar100       train : [loss = 1.188, top1 = 66.27%], valid : [loss = 1.506, top1 = 58.89%], test : [loss = 1.496, top1 = 58.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.96%], valid : [loss = 2.693, top1 = 32.91%], test : [loss = 2.719, top1 = 32.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.09%], valid : [loss = 0.964, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8232/15625) 008232-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.41 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.01 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.73 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8233/15625) 008233-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.473, top1 = 89.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.65 ms.
cifar100       train : [loss = 0.322, top1 = 91.39%], valid : [loss = 1.251, top1 = 67.32%], test : [loss = 1.246, top1 = 67.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.77%], valid : [loss = 2.315, top1 = 40.22%], test : [loss = 2.332, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.64%], valid : [loss = 0.603, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8234/15625) 008234-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.80 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.557, top1 = 88.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.349, top1 = 91.73%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.51 ms.
cifar100       train : [loss = 0.302, top1 = 91.78%], valid : [loss = 1.259, top1 = 68.05%], test : [loss = 1.263, top1 = 67.93%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.78%], valid : [loss = 2.293, top1 = 41.54%], test : [loss = 2.300, top1 = 41.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.86%], valid : [loss = 0.781, top1 = 72.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8235/15625) 008235-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.30%], valid : [loss = 0.776, top1 = 73.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10        train : [loss = 0.598, top1 = 79.14%], test  : [loss = 0.654, top1 = 77.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.11 ms.
cifar100       train : [loss = 2.069, top1 = 44.34%], valid : [loss = 2.216, top1 = 41.63%], test : [loss = 2.199, top1 = 41.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 20.78%], valid : [loss = 3.310, top1 = 21.30%], test : [loss = 3.360, top1 = 20.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.306, top1 = 52.80%], valid : [loss = 1.368, top1 = 50.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8236/15625) 008236-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.514, top1 = 88.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.340, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.94 ms.
cifar100       train : [loss = 0.359, top1 = 90.08%], valid : [loss = 1.291, top1 = 67.11%], test : [loss = 1.277, top1 = 67.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.44%], valid : [loss = 2.426, top1 = 38.27%], test : [loss = 2.408, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8237/15625) 008237-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.26 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.88 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.07 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8238/15625) 008238-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.516, top1 = 88.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.96 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.320, top1 = 92.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.93 ms.
cifar100       train : [loss = 0.334, top1 = 90.93%], valid : [loss = 1.272, top1 = 67.21%], test : [loss = 1.283, top1 = 67.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 45.00%], valid : [loss = 2.409, top1 = 38.84%], test : [loss = 2.400, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8239/15625) 008239-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.555, top1 = 88.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.370, top1 = 91.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 0.207, top1 = 95.03%], valid : [loss = 1.429, top1 = 66.38%], test : [loss = 1.411, top1 = 67.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.88%], valid : [loss = 2.403, top1 = 39.66%], test : [loss = 2.440, top1 = 39.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.40%], valid : [loss = 0.714, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8240/15625) 008240-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.68 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.30%], valid : [loss = 0.539, top1 = 83.89%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 0.193, top1 = 93.52%], test  : [loss = 0.401, top1 = 87.48%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.296, top1 = 63.26%], valid : [loss = 1.570, top1 = 57.33%], test : [loss = 1.570, top1 = 56.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.697, top1 = 32.64%], valid : [loss = 2.743, top1 = 31.66%], test : [loss = 2.761, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8241/15625) 008241-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.04%], valid : [loss = 0.663, top1 = 78.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10        train : [loss = 0.376, top1 = 86.93%], test  : [loss = 0.529, top1 = 82.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.58 ms.
cifar100       train : [loss = 1.580, top1 = 56.26%], valid : [loss = 1.830, top1 = 51.04%], test : [loss = 1.822, top1 = 51.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 3.276, top1 = 21.87%], valid : [loss = 3.280, top1 = 22.19%], test : [loss = 3.317, top1 = 21.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.12%], valid : [loss = 1.224, top1 = 55.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8242/15625) 008242-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.511, top1 = 88.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.341, top1 = 91.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.35 ms.
cifar100       train : [loss = 0.351, top1 = 89.92%], valid : [loss = 1.354, top1 = 66.81%], test : [loss = 1.367, top1 = 66.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.40%], valid : [loss = 2.355, top1 = 39.79%], test : [loss = 2.389, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.49%], valid : [loss = 0.695, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8243/15625) 008243-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.19%], valid : [loss = 0.629, top1 = 85.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.050, top1 = 98.47%], test  : [loss = 0.410, top1 = 89.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.12 ms.
cifar100       train : [loss = 0.683, top1 = 79.90%], valid : [loss = 1.473, top1 = 61.71%], test : [loss = 1.482, top1 = 61.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.428, top1 = 38.05%], valid : [loss = 2.599, top1 = 34.97%], test : [loss = 2.624, top1 = 34.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.16%], valid : [loss = 0.905, top1 = 67.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8244/15625) 008244-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.29%], valid : [loss = 0.652, top1 = 85.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.050, top1 = 98.50%], test  : [loss = 0.412, top1 = 89.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.633, top1 = 81.37%], valid : [loss = 1.466, top1 = 62.11%], test : [loss = 1.434, top1 = 62.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.471, top1 = 37.33%], valid : [loss = 2.631, top1 = 34.06%], test : [loss = 2.645, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.54%], valid : [loss = 0.882, top1 = 69.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8245/15625) 008245-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.71 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.457, top1 = 89.45%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.70 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.319, top1 = 92.24%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.82 ms.
cifar100       train : [loss = 0.175, top1 = 96.26%], valid : [loss = 1.249, top1 = 69.42%], test : [loss = 1.245, top1 = 69.47%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.47 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.07%], valid : [loss = 2.234, top1 = 43.20%], test : [loss = 2.236, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.68%], valid : [loss = 0.684, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8246/15625) 008246-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.468, top1 = 89.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.303, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.323, top1 = 91.34%], valid : [loss = 1.267, top1 = 67.80%], test : [loss = 1.261, top1 = 67.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.72%], valid : [loss = 2.307, top1 = 40.93%], test : [loss = 2.335, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8247/15625) 008247-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.18%], valid : [loss = 0.458, top1 = 86.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.162, top1 = 94.66%], test  : [loss = 0.347, top1 = 88.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.67 ms.
cifar100       train : [loss = 1.025, top1 = 70.80%], valid : [loss = 1.370, top1 = 61.49%], test : [loss = 1.351, top1 = 61.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.45%], valid : [loss = 2.700, top1 = 32.51%], test : [loss = 2.727, top1 = 31.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.78%], valid : [loss = 0.759, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8248/15625) 008248-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.545, top1 = 89.08%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.43 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.340, top1 = 92.85%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.48 ms.
cifar100       train : [loss = 0.082, top1 = 98.44%], valid : [loss = 1.433, top1 = 68.64%], test : [loss = 1.458, top1 = 68.68%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.51%], valid : [loss = 2.395, top1 = 39.44%], test : [loss = 2.414, top1 = 38.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.62%], valid : [loss = 0.878, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8249/15625) 008249-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.592, top1 = 87.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.403, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 0.237, top1 = 94.17%], valid : [loss = 1.432, top1 = 65.84%], test : [loss = 1.418, top1 = 66.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.53%], valid : [loss = 2.486, top1 = 37.67%], test : [loss = 2.492, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.20%], valid : [loss = 0.742, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8250/15625) 008250-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.594, top1 = 87.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.391, top1 = 91.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.88 ms.
cifar100       train : [loss = 0.213, top1 = 95.00%], valid : [loss = 1.426, top1 = 66.12%], test : [loss = 1.403, top1 = 66.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.084, top1 = 45.67%], valid : [loss = 2.469, top1 = 38.24%], test : [loss = 2.494, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 77.80%], valid : [loss = 0.704, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8251/15625) 008251-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.68%], valid : [loss = 0.595, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.018, top1 = 99.48%], test  : [loss = 0.392, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.61 ms.
cifar100       train : [loss = 0.391, top1 = 88.90%], valid : [loss = 1.497, top1 = 63.01%], test : [loss = 1.487, top1 = 63.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.994, top1 = 25.82%], valid : [loss = 3.062, top1 = 25.07%], test : [loss = 3.073, top1 = 24.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8252/15625) 008252-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.82%], valid : [loss = 0.499, top1 = 85.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.167, top1 = 94.43%], test  : [loss = 0.361, top1 = 88.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.09 ms.
cifar100       train : [loss = 1.051, top1 = 69.72%], valid : [loss = 1.399, top1 = 61.35%], test : [loss = 1.409, top1 = 60.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 2.597, top1 = 34.82%], valid : [loss = 2.649, top1 = 34.07%], test : [loss = 2.668, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.17%], valid : [loss = 0.931, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8253/15625) 008253-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.433, top1 = 90.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.77 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.289, top1 = 93.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.00 ms.
cifar100       train : [loss = 0.067, top1 = 99.04%], valid : [loss = 1.342, top1 = 69.85%], test : [loss = 1.360, top1 = 70.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.02 ms.
ImageNet16-120 train : [loss = 1.550, top1 = 58.09%], valid : [loss = 2.249, top1 = 43.67%], test : [loss = 2.289, top1 = 43.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.348, top1 = 88.05%], valid : [loss = 0.482, top1 = 83.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8254/15625) 008254-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.561, top1 = 88.77%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.84 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.362, top1 = 92.25%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.46 ms.
cifar100       train : [loss = 0.159, top1 = 96.44%], valid : [loss = 1.400, top1 = 66.89%], test : [loss = 1.417, top1 = 66.89%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.22%], valid : [loss = 2.454, top1 = 36.98%], test : [loss = 2.469, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 74.00%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8255/15625) 008255-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.90 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.20%], valid : [loss = 0.559, top1 = 85.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.058, top1 = 98.35%], test  : [loss = 0.362, top1 = 90.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.29 ms.
cifar100       train : [loss = 0.551, top1 = 84.12%], valid : [loss = 1.294, top1 = 65.49%], test : [loss = 1.296, top1 = 65.99%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.83%], valid : [loss = 2.437, top1 = 38.39%], test : [loss = 2.450, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.70%], valid : [loss = 0.882, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8256/15625) 008256-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.566, top1 = 87.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.391, top1 = 91.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.90 ms.
cifar100       train : [loss = 0.351, top1 = 90.14%], valid : [loss = 1.422, top1 = 65.26%], test : [loss = 1.413, top1 = 65.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.18%], valid : [loss = 2.478, top1 = 37.64%], test : [loss = 2.503, top1 = 37.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.11%], valid : [loss = 0.867, top1 = 69.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8257/15625) 008257-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.38%], valid : [loss = 0.572, top1 = 87.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10        train : [loss = 0.023, top1 = 99.34%], test  : [loss = 0.374, top1 = 91.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.89 ms.
cifar100       train : [loss = 0.369, top1 = 89.36%], valid : [loss = 1.488, top1 = 63.82%], test : [loss = 1.497, top1 = 64.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 3.199, top1 = 21.89%], valid : [loss = 3.213, top1 = 22.13%], test : [loss = 3.235, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.326, top1 = 50.86%], valid : [loss = 1.316, top1 = 51.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8258/15625) 008258-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.239, top1 = 91.92%], valid : [loss = 0.557, top1 = 82.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.227, top1 = 92.22%], test  : [loss = 0.408, top1 = 86.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 1.342, top1 = 61.85%], valid : [loss = 1.615, top1 = 55.43%], test : [loss = 1.616, top1 = 55.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.734, top1 = 31.85%], valid : [loss = 2.765, top1 = 31.20%], test : [loss = 2.816, top1 = 30.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.21%], valid : [loss = 0.970, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8259/15625) 008259-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.561, top1 = 87.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.365, top1 = 91.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.59 ms.
cifar100       train : [loss = 0.268, top1 = 92.58%], valid : [loss = 1.355, top1 = 67.51%], test : [loss = 1.370, top1 = 67.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.69%], valid : [loss = 2.457, top1 = 37.12%], test : [loss = 2.460, top1 = 37.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.18%], valid : [loss = 0.942, top1 = 66.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8260/15625) 008260-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.437, top1 = 90.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.287, top1 = 93.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.45 ms.
cifar100       train : [loss = 0.190, top1 = 95.45%], valid : [loss = 1.314, top1 = 68.59%], test : [loss = 1.307, top1 = 68.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.35%], valid : [loss = 2.264, top1 = 42.34%], test : [loss = 2.304, top1 = 42.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.15%], valid : [loss = 0.552, top1 = 81.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8261/15625) 008261-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.650, top1 = 85.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10        train : [loss = 0.029, top1 = 99.31%], test  : [loss = 0.443, top1 = 89.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.96 ms.
cifar100       train : [loss = 0.388, top1 = 89.54%], valid : [loss = 1.424, top1 = 64.51%], test : [loss = 1.414, top1 = 65.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.05%], valid : [loss = 2.620, top1 = 35.12%], test : [loss = 2.638, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8262/15625) 008262-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.45%], valid : [loss = 0.772, top1 = 80.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.75 ms.
cifar10        train : [loss = 0.126, top1 = 95.77%], test  : [loss = 0.522, top1 = 85.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.557, top1 = 83.88%], valid : [loss = 1.724, top1 = 58.47%], test : [loss = 1.746, top1 = 57.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 3.373, top1 = 19.06%], valid : [loss = 3.386, top1 = 19.17%], test : [loss = 3.404, top1 = 18.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.312, top1 = 51.82%], valid : [loss = 1.344, top1 = 51.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8263/15625) 008263-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.603, top1 = 86.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.023, top1 = 99.44%], test  : [loss = 0.399, top1 = 90.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.00 ms.
cifar100       train : [loss = 0.444, top1 = 87.31%], valid : [loss = 1.397, top1 = 65.03%], test : [loss = 1.387, top1 = 65.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.38%], valid : [loss = 2.498, top1 = 37.72%], test : [loss = 2.551, top1 = 35.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.17%], valid : [loss = 0.823, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8264/15625) 008264-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.33%], valid : [loss = 0.452, top1 = 86.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10        train : [loss = 0.112, top1 = 96.59%], test  : [loss = 0.323, top1 = 89.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.96 ms.
cifar100       train : [loss = 0.874, top1 = 75.10%], valid : [loss = 1.297, top1 = 64.17%], test : [loss = 1.290, top1 = 63.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.72%], valid : [loss = 2.631, top1 = 34.50%], test : [loss = 2.652, top1 = 33.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8265/15625) 008265-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.506, top1 = 88.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.361, top1 = 91.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.17 ms.
cifar100       train : [loss = 0.477, top1 = 85.93%], valid : [loss = 1.336, top1 = 65.76%], test : [loss = 1.341, top1 = 65.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 40.07%], valid : [loss = 2.513, top1 = 36.86%], test : [loss = 2.562, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8266/15625) 008266-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.560, top1 = 87.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.377, top1 = 91.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.53 ms.
cifar100       train : [loss = 0.394, top1 = 88.52%], valid : [loss = 1.330, top1 = 66.25%], test : [loss = 1.345, top1 = 66.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 33.49%], valid : [loss = 2.685, top1 = 32.23%], test : [loss = 2.722, top1 = 31.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.46%], valid : [loss = 0.958, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8267/15625) 008267-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.01%], valid : [loss = 0.863, top1 = 71.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10        train : [loss = 0.554, top1 = 80.65%], test  : [loss = 0.712, top1 = 75.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.03 ms.
cifar100       train : [loss = 1.786, top1 = 51.86%], valid : [loss = 2.061, top1 = 46.80%], test : [loss = 2.067, top1 = 47.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.01 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.75%], valid : [loss = 3.643, top1 = 16.20%], test : [loss = 3.672, top1 = 16.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8268/15625) 008268-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.33%], valid : [loss = 0.760, top1 = 80.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.14 ms.
cifar10        train : [loss = 0.154, top1 = 94.74%], test  : [loss = 0.459, top1 = 86.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.94 ms.
cifar100       train : [loss = 0.965, top1 = 71.99%], valid : [loss = 1.644, top1 = 56.35%], test : [loss = 1.633, top1 = 56.90%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 3.051, top1 = 25.36%], valid : [loss = 3.128, top1 = 24.16%], test : [loss = 3.172, top1 = 22.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.15%], valid : [loss = 1.050, top1 = 62.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8269/15625) 008269-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.441, top1 = 89.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.35 ms.
cifar10        train : [loss = 0.010, top1 = 99.86%], test  : [loss = 0.307, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.71 ms.
cifar100       train : [loss = 0.206, top1 = 95.21%], valid : [loss = 1.306, top1 = 68.19%], test : [loss = 1.295, top1 = 68.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.59%], valid : [loss = 2.247, top1 = 42.88%], test : [loss = 2.289, top1 = 42.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.22%], valid : [loss = 0.527, top1 = 82.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8270/15625) 008270-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.28%], valid : [loss = 0.612, top1 = 85.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.068, top1 = 97.93%], test  : [loss = 0.397, top1 = 89.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.98 ms.
cifar100       train : [loss = 0.706, top1 = 79.48%], valid : [loss = 1.374, top1 = 63.53%], test : [loss = 1.375, top1 = 63.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.96%], valid : [loss = 2.651, top1 = 34.11%], test : [loss = 2.690, top1 = 33.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8271/15625) 008271-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.587, top1 = 87.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.375, top1 = 91.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.78 ms.
cifar100       train : [loss = 0.406, top1 = 88.51%], valid : [loss = 1.361, top1 = 66.23%], test : [loss = 1.348, top1 = 65.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.95%], valid : [loss = 2.517, top1 = 36.85%], test : [loss = 2.534, top1 = 36.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.81%], valid : [loss = 0.782, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8272/15625) 008272-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.523, top1 = 88.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.333, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.30 ms.
cifar100       train : [loss = 0.277, top1 = 92.74%], valid : [loss = 1.263, top1 = 67.61%], test : [loss = 1.272, top1 = 68.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.58%], valid : [loss = 2.334, top1 = 40.67%], test : [loss = 2.342, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8273/15625) 008273-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.549, top1 = 88.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.44 ms.
cifar10        train : [loss = 0.016, top1 = 99.54%], test  : [loss = 0.373, top1 = 91.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.12 ms.
cifar100       train : [loss = 0.274, top1 = 92.27%], valid : [loss = 1.359, top1 = 67.52%], test : [loss = 1.409, top1 = 66.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 2.274, top1 = 41.23%], valid : [loss = 2.479, top1 = 37.30%], test : [loss = 2.473, top1 = 37.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.49%], valid : [loss = 0.980, top1 = 65.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8274/15625) 008274-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.58 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.81 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8275/15625) 008275-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.464, top1 = 89.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.303, top1 = 92.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.35 ms.
cifar100       train : [loss = 0.321, top1 = 91.42%], valid : [loss = 1.259, top1 = 67.54%], test : [loss = 1.242, top1 = 68.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 2.028, top1 = 46.88%], valid : [loss = 2.319, top1 = 41.20%], test : [loss = 2.338, top1 = 41.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.28%], valid : [loss = 0.609, top1 = 79.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8276/15625) 008276-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.410, top1 = 90.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.284, top1 = 93.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.177, top1 = 95.87%], valid : [loss = 1.256, top1 = 69.83%], test : [loss = 1.282, top1 = 69.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 1.811, top1 = 51.83%], valid : [loss = 2.235, top1 = 42.80%], test : [loss = 2.285, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8277/15625) 008277-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.526, top1 = 89.53%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.356, top1 = 92.71%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.49 ms.
cifar100       train : [loss = 0.096, top1 = 98.05%], valid : [loss = 1.408, top1 = 68.83%], test : [loss = 1.378, top1 = 69.14%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.42 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.64%], valid : [loss = 2.361, top1 = 40.25%], test : [loss = 2.371, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.26%], valid : [loss = 0.822, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8278/15625) 008278-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.519, top1 = 88.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.331, top1 = 92.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.92 ms.
cifar100       train : [loss = 0.326, top1 = 91.20%], valid : [loss = 1.290, top1 = 66.95%], test : [loss = 1.285, top1 = 67.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 44.98%], valid : [loss = 2.406, top1 = 39.30%], test : [loss = 2.410, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8279/15625) 008279-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.495, top1 = 89.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.333, top1 = 92.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.26 ms.
cifar100       train : [loss = 0.330, top1 = 91.12%], valid : [loss = 1.260, top1 = 67.65%], test : [loss = 1.282, top1 = 66.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.27%], valid : [loss = 2.412, top1 = 39.48%], test : [loss = 2.411, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8280/15625) 008280-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.65%], valid : [loss = 0.470, top1 = 85.94%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=17.46 ms.
cifar10        train : [loss = 0.159, top1 = 94.78%], test  : [loss = 0.346, top1 = 88.92%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=17.01 ms.
cifar100       train : [loss = 1.019, top1 = 71.02%], valid : [loss = 1.361, top1 = 61.71%], test : [loss = 1.368, top1 = 61.89%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.82%], valid : [loss = 2.689, top1 = 32.79%], test : [loss = 2.695, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8281/15625) 008281-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.44%], valid : [loss = 0.681, top1 = 82.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10        train : [loss = 0.155, top1 = 94.72%], test  : [loss = 0.500, top1 = 85.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.50 ms.
cifar100       train : [loss = 0.955, top1 = 72.20%], valid : [loss = 1.640, top1 = 56.93%], test : [loss = 1.634, top1 = 57.49%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 3.046, top1 = 25.39%], valid : [loss = 3.121, top1 = 25.67%], test : [loss = 3.159, top1 = 24.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.15%], valid : [loss = 1.050, top1 = 62.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8282/15625) 008282-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.546, top1 = 88.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.39 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.363, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.62 ms.
cifar100       train : [loss = 0.200, top1 = 95.45%], valid : [loss = 1.362, top1 = 67.83%], test : [loss = 1.389, top1 = 67.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 2.015, top1 = 47.26%], valid : [loss = 2.431, top1 = 39.20%], test : [loss = 2.441, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.62%], valid : [loss = 0.698, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8283/15625) 008283-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.576, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.23 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.390, top1 = 91.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.68 ms.
cifar100       train : [loss = 0.132, top1 = 97.36%], valid : [loss = 1.520, top1 = 66.28%], test : [loss = 1.543, top1 = 66.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.35%], valid : [loss = 2.455, top1 = 38.77%], test : [loss = 2.478, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.07%], valid : [loss = 0.778, top1 = 72.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8284/15625) 008284-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.520, top1 = 89.67%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.59 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.325, top1 = 92.87%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.75 ms.
cifar100       train : [loss = 0.136, top1 = 97.05%], valid : [loss = 1.273, top1 = 69.82%], test : [loss = 1.275, top1 = 70.11%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.36%], valid : [loss = 2.178, top1 = 44.05%], test : [loss = 2.165, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.60%], valid : [loss = 0.755, top1 = 73.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8285/15625) 008285-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.431, top1 = 91.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.282, top1 = 93.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.57 ms.
cifar100       train : [loss = 0.064, top1 = 99.10%], valid : [loss = 1.359, top1 = 70.21%], test : [loss = 1.343, top1 = 70.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 1.538, top1 = 58.42%], valid : [loss = 2.248, top1 = 43.72%], test : [loss = 2.271, top1 = 44.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.77%], valid : [loss = 0.541, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8286/15625) 008286-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.539, top1 = 89.13%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.41 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.345, top1 = 92.53%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.34 ms.
cifar100       train : [loss = 0.125, top1 = 97.34%], valid : [loss = 1.345, top1 = 69.08%], test : [loss = 1.350, top1 = 69.41%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.95 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 50.84%], valid : [loss = 2.239, top1 = 42.53%], test : [loss = 2.244, top1 = 42.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.20%], valid : [loss = 0.880, top1 = 68.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8287/15625) 008287-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.29%], valid : [loss = 0.674, top1 = 83.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.93 ms.
cifar10        train : [loss = 0.089, top1 = 97.14%], test  : [loss = 0.412, top1 = 88.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.39 ms.
cifar100       train : [loss = 0.799, top1 = 76.65%], valid : [loss = 1.460, top1 = 61.72%], test : [loss = 1.440, top1 = 61.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.06%], valid : [loss = 2.732, top1 = 32.40%], test : [loss = 2.764, top1 = 31.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 70.04%], valid : [loss = 0.896, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8288/15625) 008288-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.91 ms.
cifar100       train : [loss = 0.062, top1 = 99.09%], valid : [loss = 1.374, top1 = 70.04%], test : [loss = 1.349, top1 = 70.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 1.543, top1 = 58.28%], valid : [loss = 2.235, top1 = 44.28%], test : [loss = 2.291, top1 = 43.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8289/15625) 008289-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.50%], valid : [loss = 0.454, top1 = 86.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.155, top1 = 95.03%], test  : [loss = 0.340, top1 = 88.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 0.997, top1 = 71.61%], valid : [loss = 1.353, top1 = 62.15%], test : [loss = 1.354, top1 = 61.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.16%], valid : [loss = 2.676, top1 = 33.72%], test : [loss = 2.701, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.25%], valid : [loss = 0.797, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8290/15625) 008290-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.411, top1 = 90.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.266, top1 = 93.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.10 ms.
cifar100       train : [loss = 0.072, top1 = 98.93%], valid : [loss = 1.267, top1 = 71.53%], test : [loss = 1.248, top1 = 71.33%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.21 ms.
ImageNet16-120 train : [loss = 1.509, top1 = 59.09%], valid : [loss = 2.195, top1 = 45.45%], test : [loss = 2.189, top1 = 46.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.95%], valid : [loss = 0.490, top1 = 83.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8291/15625) 008291-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.515, top1 = 89.53%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.77 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.315, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.18 ms.
cifar100       train : [loss = 0.119, top1 = 97.67%], valid : [loss = 1.334, top1 = 69.02%], test : [loss = 1.323, top1 = 69.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.71%], valid : [loss = 2.295, top1 = 41.85%], test : [loss = 2.283, top1 = 42.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 75.01%], valid : [loss = 0.769, top1 = 72.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8292/15625) 008292-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.561, top1 = 87.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.382, top1 = 91.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.31 ms.
cifar100       train : [loss = 0.398, top1 = 88.68%], valid : [loss = 1.382, top1 = 65.90%], test : [loss = 1.395, top1 = 65.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.73%], valid : [loss = 2.515, top1 = 36.23%], test : [loss = 2.538, top1 = 36.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8293/15625) 008293-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.27%], valid : [loss = 0.610, top1 = 85.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.406, top1 = 88.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 0.721, top1 = 78.92%], valid : [loss = 1.391, top1 = 63.13%], test : [loss = 1.365, top1 = 63.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.89 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.89%], valid : [loss = 2.669, top1 = 33.76%], test : [loss = 2.698, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8294/15625) 008294-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.154, top1 = 95.05%], valid : [loss = 0.434, top1 = 86.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.34 ms.
cifar10        train : [loss = 0.151, top1 = 95.16%], test  : [loss = 0.312, top1 = 89.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.52 ms.
cifar100       train : [loss = 0.959, top1 = 72.64%], valid : [loss = 1.301, top1 = 63.82%], test : [loss = 1.277, top1 = 64.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.713, top1 = 32.56%], valid : [loss = 2.717, top1 = 33.00%], test : [loss = 2.751, top1 = 31.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 66.18%], valid : [loss = 0.973, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8295/15625) 008295-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.578, top1 = 87.06%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.82 ms.
cifar10        train : [loss = 0.024, top1 = 99.43%], test  : [loss = 0.396, top1 = 90.12%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.49 ms.
cifar100       train : [loss = 0.320, top1 = 91.76%], valid : [loss = 1.407, top1 = 65.62%], test : [loss = 1.392, top1 = 65.93%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.46 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.84%], valid : [loss = 2.499, top1 = 37.57%], test : [loss = 2.519, top1 = 36.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.09%], valid : [loss = 0.766, top1 = 73.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8296/15625) 008296-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.499, top1 = 90.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.322, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.108, top1 = 97.95%], valid : [loss = 1.289, top1 = 69.89%], test : [loss = 1.277, top1 = 70.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 1.694, top1 = 54.52%], valid : [loss = 2.177, top1 = 43.88%], test : [loss = 2.200, top1 = 43.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8297/15625) 008297-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.605, top1 = 85.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.070, top1 = 97.90%], test  : [loss = 0.408, top1 = 88.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.90 ms.
cifar100       train : [loss = 0.723, top1 = 79.05%], valid : [loss = 1.436, top1 = 62.53%], test : [loss = 1.412, top1 = 62.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.78%], valid : [loss = 2.676, top1 = 33.48%], test : [loss = 2.716, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.77%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8298/15625) 008298-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.76%], valid : [loss = 0.831, top1 = 80.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.130, top1 = 95.57%], test  : [loss = 0.548, top1 = 84.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.03 ms.
cifar100       train : [loss = 0.840, top1 = 75.60%], valid : [loss = 1.682, top1 = 57.35%], test : [loss = 1.697, top1 = 57.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.29%], valid : [loss = 3.158, top1 = 24.45%], test : [loss = 3.221, top1 = 23.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.079, top1 = 60.77%], valid : [loss = 1.136, top1 = 59.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8299/15625) 008299-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.61%], valid : [loss = 0.542, top1 = 84.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.168, top1 = 94.36%], test  : [loss = 0.376, top1 = 88.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.99 ms.
cifar100       train : [loss = 1.139, top1 = 67.41%], valid : [loss = 1.479, top1 = 59.65%], test : [loss = 1.465, top1 = 59.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.664, top1 = 33.49%], valid : [loss = 2.702, top1 = 32.98%], test : [loss = 2.739, top1 = 32.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8300/15625) 008300-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.514, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.341, top1 = 92.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.33 ms.
cifar100       train : [loss = 0.232, top1 = 93.85%], valid : [loss = 1.277, top1 = 68.13%], test : [loss = 1.305, top1 = 68.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.58%], valid : [loss = 2.238, top1 = 42.63%], test : [loss = 2.246, top1 = 42.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.01%], valid : [loss = 0.781, top1 = 72.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8301/15625) 008301-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.525, top1 = 88.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.61 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.334, top1 = 92.40%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.73 ms.
cifar100       train : [loss = 0.170, top1 = 95.74%], valid : [loss = 1.316, top1 = 68.61%], test : [loss = 1.326, top1 = 68.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.08 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.05%], valid : [loss = 2.250, top1 = 42.53%], test : [loss = 2.252, top1 = 42.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.855, top1 = 69.02%], valid : [loss = 0.902, top1 = 67.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8302/15625) 008302-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.498, top1 = 89.18%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.77 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.323, top1 = 92.47%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.58 ms.
cifar100       train : [loss = 0.169, top1 = 96.22%], valid : [loss = 1.262, top1 = 69.08%], test : [loss = 1.262, top1 = 69.46%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.04 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.42%], valid : [loss = 2.263, top1 = 41.93%], test : [loss = 2.261, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.30%], valid : [loss = 0.746, top1 = 73.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8303/15625) 008303-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.07%], valid : [loss = 0.565, top1 = 85.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.108, top1 = 96.43%], test  : [loss = 0.385, top1 = 88.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.52 ms.
cifar100       train : [loss = 0.804, top1 = 76.46%], valid : [loss = 1.428, top1 = 62.42%], test : [loss = 1.411, top1 = 62.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.661, top1 = 33.32%], valid : [loss = 2.763, top1 = 31.68%], test : [loss = 2.795, top1 = 30.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.89%], valid : [loss = 0.728, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8304/15625) 008304-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.33%], valid : [loss = 0.498, top1 = 84.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.04 ms.
cifar10        train : [loss = 0.174, top1 = 94.20%], test  : [loss = 0.376, top1 = 88.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.30 ms.
cifar100       train : [loss = 1.052, top1 = 69.82%], valid : [loss = 1.413, top1 = 60.82%], test : [loss = 1.405, top1 = 60.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.47%], valid : [loss = 2.651, top1 = 34.37%], test : [loss = 2.699, top1 = 33.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.901, top1 = 67.69%], valid : [loss = 0.948, top1 = 66.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8305/15625) 008305-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.34%], valid : [loss = 0.613, top1 = 85.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.068, top1 = 97.93%], test  : [loss = 0.395, top1 = 88.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 0.719, top1 = 79.08%], valid : [loss = 1.378, top1 = 62.99%], test : [loss = 1.373, top1 = 63.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.90%], valid : [loss = 2.650, top1 = 33.91%], test : [loss = 2.669, top1 = 33.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8306/15625) 008306-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.503, top1 = 89.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.03 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.309, top1 = 92.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.162, top1 = 96.54%], valid : [loss = 1.255, top1 = 69.43%], test : [loss = 1.246, top1 = 70.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.35%], valid : [loss = 2.226, top1 = 42.60%], test : [loss = 2.231, top1 = 43.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.626, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8307/15625) 008307-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.519, top1 = 88.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.338, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.77 ms.
cifar100       train : [loss = 0.328, top1 = 91.17%], valid : [loss = 1.288, top1 = 67.12%], test : [loss = 1.291, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.11%], valid : [loss = 2.398, top1 = 39.00%], test : [loss = 2.412, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8308/15625) 008308-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.450, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.314, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.38 ms.
cifar100       train : [loss = 0.322, top1 = 91.33%], valid : [loss = 1.290, top1 = 67.39%], test : [loss = 1.313, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.59%], valid : [loss = 2.369, top1 = 40.48%], test : [loss = 2.403, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.446, top1 = 84.52%], valid : [loss = 0.551, top1 = 81.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8309/15625) 008309-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.559, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.385, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.01 ms.
cifar100       train : [loss = 0.210, top1 = 94.78%], valid : [loss = 1.444, top1 = 66.63%], test : [loss = 1.431, top1 = 66.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.42%], valid : [loss = 2.426, top1 = 39.26%], test : [loss = 2.450, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.98%], valid : [loss = 0.734, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8310/15625) 008310-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.58%], valid : [loss = 0.716, top1 = 76.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.452, top1 = 84.26%], test  : [loss = 0.586, top1 = 80.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.32 ms.
cifar100       train : [loss = 1.786, top1 = 51.41%], valid : [loss = 1.973, top1 = 48.01%], test : [loss = 1.978, top1 = 47.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.467, top1 = 18.44%], valid : [loss = 3.465, top1 = 18.78%], test : [loss = 3.491, top1 = 17.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.238, top1 = 54.98%], valid : [loss = 1.288, top1 = 53.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8311/15625) 008311-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.23%], valid : [loss = 0.569, top1 = 85.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.114, top1 = 96.20%], test  : [loss = 0.396, top1 = 88.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.87 ms.
cifar100       train : [loss = 0.822, top1 = 75.90%], valid : [loss = 1.449, top1 = 61.68%], test : [loss = 1.423, top1 = 62.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.31%], valid : [loss = 2.747, top1 = 32.97%], test : [loss = 2.815, top1 = 30.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.36%], valid : [loss = 0.691, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8312/15625) 008312-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.532, top1 = 89.44%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.67 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.340, top1 = 92.86%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.91 ms.
cifar100       train : [loss = 0.085, top1 = 98.56%], valid : [loss = 1.379, top1 = 68.85%], test : [loss = 1.366, top1 = 69.41%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.39%], valid : [loss = 2.302, top1 = 41.50%], test : [loss = 2.295, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.98%], valid : [loss = 0.654, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8313/15625) 008313-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.55%], valid : [loss = 0.578, top1 = 87.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.22 ms.
cifar10        train : [loss = 0.035, top1 = 98.99%], test  : [loss = 0.347, top1 = 90.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.37 ms.
cifar100       train : [loss = 0.527, top1 = 84.95%], valid : [loss = 1.309, top1 = 65.12%], test : [loss = 1.326, top1 = 64.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 35.92%], valid : [loss = 2.624, top1 = 34.23%], test : [loss = 2.628, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.61%], valid : [loss = 0.972, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8314/15625) 008314-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10-valid  train : [loss = 0.973, top1 = 65.40%], valid : [loss = 1.155, top1 = 60.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.94 ms.
cifar10        train : [loss = 0.960, top1 = 66.24%], test  : [loss = 1.042, top1 = 63.79%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.86 ms.
cifar100       train : [loss = 2.468, top1 = 36.92%], valid : [loss = 2.626, top1 = 34.72%], test : [loss = 2.627, top1 = 34.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.38 ms.
ImageNet16-120 train : [loss = 3.867, top1 = 12.27%], valid : [loss = 3.884, top1 = 12.27%], test : [loss = 3.890, top1 = 11.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.524, top1 = 43.81%], valid : [loss = 1.537, top1 = 43.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8315/15625) 008315-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.153, top1 = 95.18%], valid : [loss = 0.909, top1 = 76.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10        train : [loss = 0.195, top1 = 93.42%], test  : [loss = 0.586, top1 = 82.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.81 ms.
cifar100       train : [loss = 1.092, top1 = 68.80%], valid : [loss = 1.706, top1 = 55.44%], test : [loss = 1.699, top1 = 55.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 3.150, top1 = 24.18%], valid : [loss = 3.245, top1 = 23.23%], test : [loss = 3.306, top1 = 21.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.063, top1 = 61.78%], valid : [loss = 1.133, top1 = 59.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8316/15625) 008316-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.481, top1 = 84.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.303, top1 = 89.82%], test  : [loss = 0.403, top1 = 86.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.94 ms.
cifar100       train : [loss = 1.317, top1 = 63.44%], valid : [loss = 1.525, top1 = 58.24%], test : [loss = 1.511, top1 = 58.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.74%], valid : [loss = 2.918, top1 = 30.00%], test : [loss = 2.944, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8317/15625) 008317-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.79 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8318/15625) 008318-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.39%], valid : [loss = 0.560, top1 = 82.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10        train : [loss = 0.270, top1 = 90.75%], test  : [loss = 0.410, top1 = 86.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.86 ms.
cifar100       train : [loss = 1.369, top1 = 61.45%], valid : [loss = 1.654, top1 = 55.70%], test : [loss = 1.701, top1 = 54.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.997, top1 = 27.01%], valid : [loss = 3.007, top1 = 27.70%], test : [loss = 3.093, top1 = 25.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.192, top1 = 56.75%], valid : [loss = 1.243, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8319/15625) 008319-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.499, top1 = 88.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.331, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.343, top1 = 90.61%], valid : [loss = 1.266, top1 = 67.22%], test : [loss = 1.279, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.17%], valid : [loss = 2.396, top1 = 38.97%], test : [loss = 2.418, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.42%], valid : [loss = 0.750, top1 = 73.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8320/15625) 008320-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.47%], valid : [loss = 0.552, top1 = 83.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.225, top1 = 92.24%], test  : [loss = 0.411, top1 = 86.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.64 ms.
cifar100       train : [loss = 1.209, top1 = 65.69%], valid : [loss = 1.583, top1 = 57.64%], test : [loss = 1.568, top1 = 57.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.98 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.51%], valid : [loss = 2.961, top1 = 28.27%], test : [loss = 3.014, top1 = 27.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.00%], valid : [loss = 1.219, top1 = 56.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8321/15625) 008321-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.552, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=22.90 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.355, top1 = 92.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.74 ms.
cifar100       train : [loss = 0.152, top1 = 96.54%], valid : [loss = 1.335, top1 = 68.48%], test : [loss = 1.349, top1 = 68.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.69%], valid : [loss = 2.380, top1 = 39.63%], test : [loss = 2.356, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 68.80%], valid : [loss = 0.915, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8322/15625) 008322-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.339, top1 = 88.19%], valid : [loss = 0.576, top1 = 81.31%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=14.59 ms.
cifar10        train : [loss = 0.281, top1 = 90.35%], test  : [loss = 0.435, top1 = 85.81%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=13.54 ms.
cifar100       train : [loss = 1.504, top1 = 57.96%], valid : [loss = 1.735, top1 = 53.05%], test : [loss = 1.735, top1 = 52.85%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.967, top1 = 27.36%], valid : [loss = 2.970, top1 = 27.56%], test : [loss = 3.016, top1 = 26.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.19%], valid : [loss = 1.074, top1 = 61.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8323/15625) 008323-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.49%], valid : [loss = 0.446, top1 = 87.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10        train : [loss = 0.053, top1 = 98.72%], test  : [loss = 0.314, top1 = 90.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 0.588, top1 = 83.83%], valid : [loss = 1.224, top1 = 66.54%], test : [loss = 1.194, top1 = 67.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.05%], valid : [loss = 2.497, top1 = 38.13%], test : [loss = 2.472, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8324/15625) 008324-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.86 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.89%], valid : [loss = 0.481, top1 = 84.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 0.303, top1 = 89.88%], test  : [loss = 0.406, top1 = 86.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 1.328, top1 = 63.13%], valid : [loss = 1.539, top1 = 58.56%], test : [loss = 1.504, top1 = 58.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.43 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.55%], valid : [loss = 2.907, top1 = 28.67%], test : [loss = 2.975, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8325/15625) 008325-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.57%], valid : [loss = 0.508, top1 = 85.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.152, top1 = 94.89%], test  : [loss = 0.363, top1 = 88.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.64 ms.
cifar100       train : [loss = 0.990, top1 = 71.57%], valid : [loss = 1.400, top1 = 61.86%], test : [loss = 1.383, top1 = 61.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 35.95%], valid : [loss = 2.593, top1 = 35.36%], test : [loss = 2.622, top1 = 34.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.90%], valid : [loss = 0.922, top1 = 66.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8326/15625) 008326-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.154, top1 = 95.09%], valid : [loss = 0.505, top1 = 85.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.74 ms.
cifar10        train : [loss = 0.168, top1 = 94.36%], test  : [loss = 0.374, top1 = 88.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 1.030, top1 = 70.34%], valid : [loss = 1.393, top1 = 61.75%], test : [loss = 1.392, top1 = 61.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.47%], valid : [loss = 2.675, top1 = 33.53%], test : [loss = 2.698, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.52%], valid : [loss = 0.939, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8327/15625) 008327-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.211, top1 = 93.02%], valid : [loss = 0.474, top1 = 84.84%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.04 ms.
cifar10        train : [loss = 0.238, top1 = 91.94%], test  : [loss = 0.385, top1 = 87.24%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.27 ms.
cifar100       train : [loss = 1.250, top1 = 64.91%], valid : [loss = 1.569, top1 = 56.70%], test : [loss = 1.559, top1 = 57.14%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 3.160, top1 = 23.47%], valid : [loss = 3.175, top1 = 23.33%], test : [loss = 3.188, top1 = 22.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.12%], valid : [loss = 1.031, top1 = 63.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8328/15625) 008328-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.76%], valid : [loss = 0.579, top1 = 88.06%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.27 ms.
cifar10        train : [loss = 0.019, top1 = 99.47%], test  : [loss = 0.414, top1 = 90.77%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.07 ms.
cifar100       train : [loss = 0.333, top1 = 90.92%], valid : [loss = 1.446, top1 = 65.04%], test : [loss = 1.428, top1 = 65.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 3.271, top1 = 20.17%], valid : [loss = 3.255, top1 = 20.43%], test : [loss = 3.262, top1 = 19.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 53.30%], valid : [loss = 1.261, top1 = 54.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8329/15625) 008329-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10-valid  train : [loss = 1.297, top1 = 53.45%], valid : [loss = 1.342, top1 = 52.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10        train : [loss = 1.235, top1 = 55.67%], test  : [loss = 1.244, top1 = 55.06%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.89 ms.
cifar100       train : [loss = 2.799, top1 = 30.33%], valid : [loss = 2.891, top1 = 28.71%], test : [loss = 2.876, top1 = 28.65%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.60 ms.
ImageNet16-120 train : [loss = 3.944, top1 = 11.24%], valid : [loss = 3.946, top1 = 11.64%], test : [loss = 3.958, top1 = 11.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.761, top1 = 33.83%], valid : [loss = 1.747, top1 = 34.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8330/15625) 008330-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.524, top1 = 88.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.345, top1 = 92.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.65 ms.
cifar100       train : [loss = 0.292, top1 = 92.13%], valid : [loss = 1.285, top1 = 67.51%], test : [loss = 1.304, top1 = 67.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.82%], valid : [loss = 2.402, top1 = 39.21%], test : [loss = 2.398, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.02%], valid : [loss = 0.831, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8331/15625) 008331-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.42 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.558, top1 = 88.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.56 ms.
cifar10        train : [loss = 0.020, top1 = 99.42%], test  : [loss = 0.355, top1 = 91.40%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.88 ms.
cifar100       train : [loss = 0.325, top1 = 90.92%], valid : [loss = 1.290, top1 = 67.20%], test : [loss = 1.292, top1 = 67.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.64%], valid : [loss = 2.333, top1 = 40.63%], test : [loss = 2.302, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.27%], valid : [loss = 0.821, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8332/15625) 008332-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10-valid  train : [loss = 0.279, top1 = 90.64%], valid : [loss = 0.482, top1 = 84.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.46 ms.
cifar10        train : [loss = 0.302, top1 = 89.98%], test  : [loss = 0.409, top1 = 86.32%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.96 ms.
cifar100       train : [loss = 1.327, top1 = 63.13%], valid : [loss = 1.520, top1 = 57.90%], test : [loss = 1.512, top1 = 58.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.88 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.67%], valid : [loss = 2.912, top1 = 28.90%], test : [loss = 2.982, top1 = 27.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8333/15625) 008333-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.60%], valid : [loss = 0.497, top1 = 88.18%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.77 ms.
cifar10        train : [loss = 0.044, top1 = 98.74%], test  : [loss = 0.369, top1 = 90.52%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.38 ms.
cifar100       train : [loss = 0.520, top1 = 84.96%], valid : [loss = 1.295, top1 = 66.94%], test : [loss = 1.295, top1 = 66.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.60%], valid : [loss = 2.409, top1 = 38.47%], test : [loss = 2.443, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.61%], valid : [loss = 0.609, top1 = 79.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8334/15625) 008334-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.526, top1 = 88.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.24 ms.
cifar10        train : [loss = 0.018, top1 = 99.51%], test  : [loss = 0.345, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.02 ms.
cifar100       train : [loss = 0.352, top1 = 89.94%], valid : [loss = 1.420, top1 = 65.58%], test : [loss = 1.355, top1 = 66.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.212, top1 = 42.96%], valid : [loss = 2.468, top1 = 37.67%], test : [loss = 2.524, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.23%], valid : [loss = 0.728, top1 = 74.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8335/15625) 008335-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.29%], valid : [loss = 0.531, top1 = 84.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.88 ms.
cifar10        train : [loss = 0.182, top1 = 93.87%], test  : [loss = 0.393, top1 = 87.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.79 ms.
cifar100       train : [loss = 1.203, top1 = 65.68%], valid : [loss = 1.520, top1 = 58.80%], test : [loss = 1.486, top1 = 58.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.35%], valid : [loss = 2.682, top1 = 33.23%], test : [loss = 2.755, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.42%], valid : [loss = 0.958, top1 = 66.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8336/15625) 008336-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.469, top1 = 89.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.54 ms.
cifar100       train : [loss = 0.325, top1 = 91.24%], valid : [loss = 1.239, top1 = 67.63%], test : [loss = 1.234, top1 = 68.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.65%], valid : [loss = 2.324, top1 = 40.54%], test : [loss = 2.328, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.59%], valid : [loss = 0.619, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8337/15625) 008337-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.07 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.27%], valid : [loss = 0.609, top1 = 85.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10        train : [loss = 0.071, top1 = 97.86%], test  : [loss = 0.398, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.79 ms.
cifar100       train : [loss = 0.726, top1 = 78.75%], valid : [loss = 1.396, top1 = 62.90%], test : [loss = 1.371, top1 = 63.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.92%], valid : [loss = 2.665, top1 = 33.59%], test : [loss = 2.697, top1 = 33.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8338/15625) 008338-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.91 ms.
cifar10-valid  train : [loss = 0.128, top1 = 95.72%], valid : [loss = 0.792, top1 = 80.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10        train : [loss = 0.148, top1 = 95.07%], test  : [loss = 0.469, top1 = 86.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 0.955, top1 = 72.21%], valid : [loss = 1.638, top1 = 57.46%], test : [loss = 1.623, top1 = 57.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.30%], valid : [loss = 3.142, top1 = 24.57%], test : [loss = 3.160, top1 = 24.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8339/15625) 008339-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.81%], valid : [loss = 0.448, top1 = 86.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10        train : [loss = 0.151, top1 = 95.10%], test  : [loss = 0.329, top1 = 89.53%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.54 ms.
cifar100       train : [loss = 0.972, top1 = 72.52%], valid : [loss = 1.344, top1 = 62.16%], test : [loss = 1.313, top1 = 63.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.00%], valid : [loss = 2.674, top1 = 32.73%], test : [loss = 2.709, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.96%], valid : [loss = 0.766, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8340/15625) 008340-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.603, top1 = 87.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.66 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.404, top1 = 91.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.38 ms.
cifar100       train : [loss = 0.216, top1 = 94.86%], valid : [loss = 1.399, top1 = 67.24%], test : [loss = 1.400, top1 = 67.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.76%], valid : [loss = 2.492, top1 = 37.73%], test : [loss = 2.496, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.62%], valid : [loss = 0.751, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8341/15625) 008341-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.519, top1 = 89.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.43 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.325, top1 = 92.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.93 ms.
cifar100       train : [loss = 0.267, top1 = 92.64%], valid : [loss = 1.305, top1 = 68.04%], test : [loss = 1.287, top1 = 67.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.61%], valid : [loss = 2.271, top1 = 40.70%], test : [loss = 2.319, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.85%], valid : [loss = 0.755, top1 = 73.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8342/15625) 008342-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.377, top1 = 86.83%], valid : [loss = 0.629, top1 = 79.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10        train : [loss = 0.320, top1 = 88.89%], test  : [loss = 0.457, top1 = 85.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.29 ms.
cifar100       train : [loss = 1.622, top1 = 54.95%], valid : [loss = 1.841, top1 = 50.67%], test : [loss = 1.841, top1 = 50.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.987, top1 = 26.86%], valid : [loss = 2.999, top1 = 26.90%], test : [loss = 3.043, top1 = 26.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.015, top1 = 63.32%], valid : [loss = 1.060, top1 = 62.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8343/15625) 008343-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.499, top1 = 89.65%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=23.45 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.316, top1 = 93.16%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.81 ms.
cifar100       train : [loss = 0.094, top1 = 98.41%], valid : [loss = 1.308, top1 = 69.90%], test : [loss = 1.279, top1 = 69.90%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.71 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.37%], valid : [loss = 2.157, top1 = 43.90%], test : [loss = 2.180, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.66%], valid : [loss = 0.708, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8344/15625) 008344-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.566, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.383, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 0.395, top1 = 88.81%], valid : [loss = 1.400, top1 = 65.88%], test : [loss = 1.376, top1 = 66.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.73%], valid : [loss = 2.514, top1 = 37.10%], test : [loss = 2.531, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8345/15625) 008345-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.72%], valid : [loss = 0.795, top1 = 83.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10        train : [loss = 0.044, top1 = 98.77%], test  : [loss = 0.497, top1 = 87.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.74 ms.
cifar100       train : [loss = 0.445, top1 = 87.58%], valid : [loss = 1.561, top1 = 62.94%], test : [loss = 1.517, top1 = 62.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.44%], valid : [loss = 2.915, top1 = 29.17%], test : [loss = 2.958, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.35%], valid : [loss = 0.836, top1 = 70.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8346/15625) 008346-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.311, top1 = 91.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.74 ms.
cifar100       train : [loss = 0.324, top1 = 91.17%], valid : [loss = 1.300, top1 = 67.15%], test : [loss = 1.318, top1 = 67.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.36%], valid : [loss = 2.370, top1 = 39.80%], test : [loss = 2.397, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.26%], valid : [loss = 0.547, top1 = 81.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8347/15625) 008347-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.89%], valid : [loss = 0.823, top1 = 80.82%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.22 ms.
cifar10        train : [loss = 0.135, top1 = 95.37%], test  : [loss = 0.526, top1 = 85.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.69 ms.
cifar100       train : [loss = 0.839, top1 = 75.64%], valid : [loss = 1.646, top1 = 58.26%], test : [loss = 1.672, top1 = 57.74%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 26.29%], valid : [loss = 3.190, top1 = 23.10%], test : [loss = 3.232, top1 = 23.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.71%], valid : [loss = 1.101, top1 = 60.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8348/15625) 008348-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.65%], valid : [loss = 0.869, top1 = 71.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10        train : [loss = 0.552, top1 = 80.74%], test  : [loss = 0.709, top1 = 75.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.94 ms.
cifar100       train : [loss = 1.776, top1 = 52.15%], valid : [loss = 2.053, top1 = 47.06%], test : [loss = 2.070, top1 = 46.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.94%], valid : [loss = 3.623, top1 = 16.44%], test : [loss = 3.675, top1 = 15.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8349/15625) 008349-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.88%], valid : [loss = 0.527, top1 = 86.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.09 ms.
cifar10        train : [loss = 0.074, top1 = 97.68%], test  : [loss = 0.368, top1 = 89.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 0.710, top1 = 79.00%], valid : [loss = 1.352, top1 = 63.94%], test : [loss = 1.361, top1 = 63.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.524, top1 = 36.26%], valid : [loss = 2.612, top1 = 34.67%], test : [loss = 2.649, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.04%], valid : [loss = 0.668, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8350/15625) 008350-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.17%], valid : [loss = 0.870, top1 = 70.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10        train : [loss = 0.694, top1 = 75.83%], test  : [loss = 0.780, top1 = 73.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.17 ms.
cifar100       train : [loss = 1.995, top1 = 47.06%], valid : [loss = 2.154, top1 = 44.04%], test : [loss = 2.171, top1 = 43.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 3.657, top1 = 15.66%], valid : [loss = 3.670, top1 = 16.40%], test : [loss = 3.703, top1 = 14.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8351/15625) 008351-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.67%], valid : [loss = 0.656, top1 = 82.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.48 ms.
cifar10        train : [loss = 0.144, top1 = 95.23%], test  : [loss = 0.430, top1 = 87.32%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.02 ms.
cifar100       train : [loss = 0.929, top1 = 72.91%], valid : [loss = 1.634, top1 = 56.88%], test : [loss = 1.619, top1 = 57.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 25.59%], valid : [loss = 3.104, top1 = 25.60%], test : [loss = 3.160, top1 = 23.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.017, top1 = 63.76%], valid : [loss = 1.061, top1 = 62.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8352/15625) 008352-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.515, top1 = 89.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.90 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.329, top1 = 93.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.30 ms.
cifar100       train : [loss = 0.089, top1 = 98.52%], valid : [loss = 1.412, top1 = 67.62%], test : [loss = 1.401, top1 = 68.66%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.19%], valid : [loss = 2.377, top1 = 39.10%], test : [loss = 2.392, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.32%], valid : [loss = 0.769, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8353/15625) 008353-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.29%], valid : [loss = 0.611, top1 = 85.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.400, top1 = 88.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.01 ms.
cifar100       train : [loss = 0.718, top1 = 78.97%], valid : [loss = 1.394, top1 = 63.02%], test : [loss = 1.378, top1 = 63.62%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.11%], valid : [loss = 2.635, top1 = 34.63%], test : [loss = 2.681, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.63%], valid : [loss = 0.784, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8354/15625) 008354-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.83 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8355/15625) 008355-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.507, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.358, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.32 ms.
cifar100       train : [loss = 0.334, top1 = 90.97%], valid : [loss = 1.286, top1 = 66.86%], test : [loss = 1.242, top1 = 67.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.75%], valid : [loss = 2.433, top1 = 38.00%], test : [loss = 2.428, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8356/15625) 008356-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.567, top1 = 88.32%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.47 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.360, top1 = 91.61%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.73 ms.
cifar100       train : [loss = 0.255, top1 = 93.15%], valid : [loss = 1.312, top1 = 67.94%], test : [loss = 1.297, top1 = 68.48%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.86 ms.
ImageNet16-120 train : [loss = 2.215, top1 = 42.76%], valid : [loss = 2.427, top1 = 39.47%], test : [loss = 2.435, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 68.93%], valid : [loss = 0.894, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8357/15625) 008357-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.59%], valid : [loss = 0.589, top1 = 87.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10        train : [loss = 0.034, top1 = 98.96%], test  : [loss = 0.384, top1 = 90.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 0.401, top1 = 88.25%], valid : [loss = 1.301, top1 = 66.96%], test : [loss = 1.325, top1 = 66.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 2.404, top1 = 38.41%], valid : [loss = 2.557, top1 = 35.03%], test : [loss = 2.582, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 66.96%], valid : [loss = 0.932, top1 = 66.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8358/15625) 008358-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.514, top1 = 88.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.337, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.95 ms.
cifar100       train : [loss = 0.356, top1 = 89.93%], valid : [loss = 1.235, top1 = 67.50%], test : [loss = 1.259, top1 = 68.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.086, top1 = 45.71%], valid : [loss = 2.319, top1 = 40.67%], test : [loss = 2.333, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.71%], valid : [loss = 0.815, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8359/15625) 008359-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.544, top1 = 88.27%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.32 ms.
cifar10        train : [loss = 0.026, top1 = 99.28%], test  : [loss = 0.333, top1 = 91.66%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.92 ms.
cifar100       train : [loss = 0.446, top1 = 87.04%], valid : [loss = 1.269, top1 = 67.14%], test : [loss = 1.270, top1 = 67.16%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.08 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.31%], valid : [loss = 2.352, top1 = 40.03%], test : [loss = 2.370, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.88%], valid : [loss = 0.803, top1 = 72.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8360/15625) 008360-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.517, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.346, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.78 ms.
cifar100       train : [loss = 0.331, top1 = 90.91%], valid : [loss = 1.243, top1 = 67.80%], test : [loss = 1.259, top1 = 68.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.094, top1 = 45.41%], valid : [loss = 2.389, top1 = 40.17%], test : [loss = 2.402, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 78.09%], valid : [loss = 0.703, top1 = 75.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8361/15625) 008361-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10-valid  train : [loss = 0.493, top1 = 82.75%], valid : [loss = 0.656, top1 = 77.92%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10        train : [loss = 0.512, top1 = 82.24%], test  : [loss = 0.591, top1 = 79.78%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.43 ms.
cifar100       train : [loss = 1.670, top1 = 54.57%], valid : [loss = 1.845, top1 = 50.45%], test : [loss = 1.851, top1 = 50.89%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.60 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.33%], valid : [loss = 3.326, top1 = 21.21%], test : [loss = 3.351, top1 = 21.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8362/15625) 008362-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.74%], valid : [loss = 0.462, top1 = 86.23%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.41 ms.
cifar10        train : [loss = 0.148, top1 = 95.24%], test  : [loss = 0.326, top1 = 88.99%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.01 ms.
cifar100       train : [loss = 0.973, top1 = 72.33%], valid : [loss = 1.352, top1 = 63.24%], test : [loss = 1.342, top1 = 62.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.26%], valid : [loss = 2.664, top1 = 33.23%], test : [loss = 2.694, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8363/15625) 008363-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.26%], valid : [loss = 0.756, top1 = 83.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.20 ms.
cifar10        train : [loss = 0.053, top1 = 98.36%], test  : [loss = 0.439, top1 = 88.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.94 ms.
cifar100       train : [loss = 0.613, top1 = 82.02%], valid : [loss = 1.532, top1 = 61.58%], test : [loss = 1.505, top1 = 61.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.37%], valid : [loss = 2.846, top1 = 30.00%], test : [loss = 2.871, top1 = 30.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 70.04%], valid : [loss = 0.883, top1 = 68.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8364/15625) 008364-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.35%], valid : [loss = 0.562, top1 = 87.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10        train : [loss = 0.037, top1 = 98.82%], test  : [loss = 0.386, top1 = 90.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.71 ms.
cifar100       train : [loss = 0.470, top1 = 86.47%], valid : [loss = 1.291, top1 = 64.84%], test : [loss = 1.288, top1 = 65.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.15%], valid : [loss = 2.672, top1 = 31.87%], test : [loss = 2.704, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8365/15625) 008365-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.48 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.81%], valid : [loss = 0.580, top1 = 88.26%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.39 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.382, top1 = 91.63%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.05 ms.
cifar100       train : [loss = 0.186, top1 = 95.48%], valid : [loss = 1.442, top1 = 66.56%], test : [loss = 1.431, top1 = 66.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.35 ms.
ImageNet16-120 train : [loss = 2.562, top1 = 34.65%], valid : [loss = 2.692, top1 = 31.60%], test : [loss = 2.726, top1 = 31.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.161, top1 = 57.82%], valid : [loss = 1.151, top1 = 58.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8366/15625) 008366-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.91%], valid : [loss = 0.581, top1 = 86.98%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.19 ms.
cifar10        train : [loss = 0.024, top1 = 99.44%], test  : [loss = 0.409, top1 = 89.91%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.43 ms.
cifar100       train : [loss = 0.318, top1 = 91.88%], valid : [loss = 1.393, top1 = 65.54%], test : [loss = 1.370, top1 = 66.32%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.78%], valid : [loss = 2.491, top1 = 37.90%], test : [loss = 2.534, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.84%], valid : [loss = 0.747, top1 = 74.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8367/15625) 008367-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.58 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.04%], valid : [loss = 0.664, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.44 ms.
cifar10        train : [loss = 0.074, top1 = 97.67%], test  : [loss = 0.422, top1 = 88.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 0.791, top1 = 77.07%], valid : [loss = 1.507, top1 = 60.34%], test : [loss = 1.499, top1 = 60.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.711, top1 = 32.44%], valid : [loss = 2.830, top1 = 30.10%], test : [loss = 2.885, top1 = 28.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 73.47%], valid : [loss = 0.824, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8368/15625) 008368-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.99%], valid : [loss = 0.459, top1 = 86.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10        train : [loss = 0.152, top1 = 95.00%], test  : [loss = 0.342, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.37 ms.
cifar100       train : [loss = 0.958, top1 = 72.70%], valid : [loss = 1.347, top1 = 62.60%], test : [loss = 1.329, top1 = 63.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.85%], valid : [loss = 2.691, top1 = 33.37%], test : [loss = 2.714, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8369/15625) 008369-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.24%], valid : [loss = 0.442, top1 = 87.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.116, top1 = 96.44%], test  : [loss = 0.330, top1 = 89.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.35 ms.
cifar100       train : [loss = 0.862, top1 = 75.57%], valid : [loss = 1.278, top1 = 64.50%], test : [loss = 1.276, top1 = 64.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.579, top1 = 34.98%], valid : [loss = 2.650, top1 = 34.77%], test : [loss = 2.682, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.46%], valid : [loss = 0.659, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8370/15625) 008370-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.19%], valid : [loss = 0.481, top1 = 84.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.295, top1 = 90.10%], test  : [loss = 0.396, top1 = 86.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.91 ms.
cifar100       train : [loss = 1.330, top1 = 63.10%], valid : [loss = 1.537, top1 = 57.89%], test : [loss = 1.509, top1 = 58.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.69%], valid : [loss = 2.910, top1 = 29.31%], test : [loss = 2.958, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8371/15625) 008371-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.279, top1 = 90.34%], valid : [loss = 0.557, top1 = 82.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.35 ms.
cifar10        train : [loss = 0.276, top1 = 90.64%], test  : [loss = 0.413, top1 = 86.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 1.364, top1 = 61.70%], valid : [loss = 1.621, top1 = 55.92%], test : [loss = 1.619, top1 = 55.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.17 ms.
ImageNet16-120 train : [loss = 2.952, top1 = 27.77%], valid : [loss = 2.936, top1 = 27.77%], test : [loss = 3.027, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 65.94%], valid : [loss = 0.987, top1 = 64.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8372/15625) 008372-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.72%], valid : [loss = 0.654, top1 = 86.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10        train : [loss = 0.016, top1 = 99.55%], test  : [loss = 0.395, top1 = 91.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.70 ms.
cifar100       train : [loss = 0.345, top1 = 90.28%], valid : [loss = 1.446, top1 = 64.02%], test : [loss = 1.439, top1 = 64.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.864, top1 = 28.29%], valid : [loss = 2.912, top1 = 26.97%], test : [loss = 2.926, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8373/15625) 008373-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.56%], valid : [loss = 0.856, top1 = 79.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.31 ms.
cifar10        train : [loss = 0.133, top1 = 95.59%], test  : [loss = 0.529, top1 = 84.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.59 ms.
cifar100       train : [loss = 0.862, top1 = 75.28%], valid : [loss = 1.675, top1 = 57.36%], test : [loss = 1.661, top1 = 57.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.59%], valid : [loss = 3.170, top1 = 23.97%], test : [loss = 3.199, top1 = 23.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.70%], valid : [loss = 1.053, top1 = 62.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8374/15625) 008374-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.76%], valid : [loss = 0.463, top1 = 86.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10        train : [loss = 0.160, top1 = 94.84%], test  : [loss = 0.343, top1 = 88.82%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 1.012, top1 = 71.48%], valid : [loss = 1.369, top1 = 61.50%], test : [loss = 1.359, top1 = 62.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.32%], valid : [loss = 2.703, top1 = 32.47%], test : [loss = 2.722, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8375/15625) 008375-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.515, top1 = 88.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.331, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.342, top1 = 90.60%], valid : [loss = 1.285, top1 = 66.91%], test : [loss = 1.287, top1 = 67.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.72%], valid : [loss = 2.407, top1 = 39.27%], test : [loss = 2.405, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8376/15625) 008376-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.602, top1 = 87.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.425, top1 = 90.82%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.40 ms.
cifar100       train : [loss = 0.162, top1 = 96.57%], valid : [loss = 1.408, top1 = 67.00%], test : [loss = 1.470, top1 = 66.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.95%], valid : [loss = 2.490, top1 = 38.13%], test : [loss = 2.519, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.16%], valid : [loss = 0.755, top1 = 73.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8377/15625) 008377-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.515, top1 = 89.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.71 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.341, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.87 ms.
cifar100       train : [loss = 0.318, top1 = 91.40%], valid : [loss = 1.293, top1 = 66.64%], test : [loss = 1.281, top1 = 67.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.81%], valid : [loss = 2.229, top1 = 41.60%], test : [loss = 2.266, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.14%], valid : [loss = 0.685, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8378/15625) 008378-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.551, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10        train : [loss = 0.032, top1 = 99.04%], test  : [loss = 0.381, top1 = 91.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.08 ms.
cifar100       train : [loss = 0.412, top1 = 88.05%], valid : [loss = 1.439, top1 = 64.40%], test : [loss = 1.413, top1 = 64.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.885, top1 = 27.78%], valid : [loss = 2.958, top1 = 26.30%], test : [loss = 2.947, top1 = 26.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.137, top1 = 58.62%], valid : [loss = 1.145, top1 = 58.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8379/15625) 008379-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.566, top1 = 87.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.034, top1 = 98.97%], test  : [loss = 0.359, top1 = 91.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.11 ms.
cifar100       train : [loss = 0.495, top1 = 85.78%], valid : [loss = 1.316, top1 = 64.90%], test : [loss = 1.310, top1 = 65.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.712, top1 = 31.37%], valid : [loss = 2.776, top1 = 29.57%], test : [loss = 2.768, top1 = 30.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.97%], valid : [loss = 0.957, top1 = 65.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8380/15625) 008380-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.519, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.19 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.380, top1 = 92.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.01 ms.
cifar100       train : [loss = 0.112, top1 = 98.01%], valid : [loss = 1.420, top1 = 68.54%], test : [loss = 1.392, top1 = 68.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.31%], valid : [loss = 2.336, top1 = 40.90%], test : [loss = 2.417, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.71%], valid : [loss = 0.694, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8381/15625) 008381-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.66 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8382/15625) 008382-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.582, top1 = 87.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.98 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.393, top1 = 91.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.40 ms.
cifar100       train : [loss = 0.221, top1 = 94.57%], valid : [loss = 1.381, top1 = 67.30%], test : [loss = 1.385, top1 = 66.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.31%], valid : [loss = 2.470, top1 = 37.80%], test : [loss = 2.501, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.50%], valid : [loss = 0.737, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8383/15625) 008383-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.28%], valid : [loss = 0.567, top1 = 86.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.42 ms.
cifar10        train : [loss = 0.107, top1 = 96.44%], test  : [loss = 0.400, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.44 ms.
cifar100       train : [loss = 0.809, top1 = 76.32%], valid : [loss = 1.412, top1 = 61.98%], test : [loss = 1.419, top1 = 62.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.04%], valid : [loss = 2.779, top1 = 31.37%], test : [loss = 2.817, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.06%], valid : [loss = 0.700, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8384/15625) 008384-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.50%], valid : [loss = 0.596, top1 = 85.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.072, top1 = 97.81%], test  : [loss = 0.371, top1 = 89.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=17.52 ms.
cifar100       train : [loss = 0.633, top1 = 81.62%], valid : [loss = 1.351, top1 = 64.20%], test : [loss = 1.359, top1 = 64.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.07%], valid : [loss = 2.547, top1 = 35.50%], test : [loss = 2.567, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.40%], valid : [loss = 0.835, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8385/15625) 008385-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.64%], valid : [loss = 0.567, top1 = 87.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10        train : [loss = 0.038, top1 = 98.87%], test  : [loss = 0.397, top1 = 90.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 0.559, top1 = 83.44%], valid : [loss = 1.442, top1 = 63.30%], test : [loss = 1.447, top1 = 63.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 37.02%], valid : [loss = 2.658, top1 = 33.53%], test : [loss = 2.665, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8386/15625) 008386-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.44%], valid : [loss = 0.675, top1 = 85.39%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10        train : [loss = 0.041, top1 = 98.81%], test  : [loss = 0.440, top1 = 89.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.86 ms.
cifar100       train : [loss = 0.549, top1 = 84.08%], valid : [loss = 1.494, top1 = 61.84%], test : [loss = 1.485, top1 = 62.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.589, top1 = 35.00%], valid : [loss = 2.739, top1 = 31.83%], test : [loss = 2.761, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.81%], valid : [loss = 0.918, top1 = 67.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8387/15625) 008387-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.499, top1 = 90.30%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=24.01 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.329, top1 = 93.19%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.70 ms.
cifar100       train : [loss = 0.115, top1 = 97.71%], valid : [loss = 1.295, top1 = 69.34%], test : [loss = 1.305, top1 = 69.66%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.714, top1 = 54.06%], valid : [loss = 2.178, top1 = 42.87%], test : [loss = 2.196, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 82.12%], valid : [loss = 0.624, top1 = 78.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8388/15625) 008388-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.586, top1 = 87.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.77 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.394, top1 = 91.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.43 ms.
cifar100       train : [loss = 0.392, top1 = 88.92%], valid : [loss = 1.431, top1 = 65.12%], test : [loss = 1.416, top1 = 64.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.14%], valid : [loss = 2.512, top1 = 37.80%], test : [loss = 2.525, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8389/15625) 008389-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.526, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10        train : [loss = 0.027, top1 = 99.17%], test  : [loss = 0.343, top1 = 91.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.41 ms.
cifar100       train : [loss = 0.447, top1 = 86.91%], valid : [loss = 1.247, top1 = 67.50%], test : [loss = 1.236, top1 = 67.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.64%], valid : [loss = 2.358, top1 = 40.37%], test : [loss = 2.372, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8390/15625) 008390-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.49%], valid : [loss = 0.600, top1 = 81.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10        train : [loss = 0.294, top1 = 89.91%], test  : [loss = 0.439, top1 = 85.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 1.344, top1 = 62.07%], valid : [loss = 1.613, top1 = 56.94%], test : [loss = 1.623, top1 = 56.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.26%], valid : [loss = 3.051, top1 = 26.97%], test : [loss = 3.117, top1 = 25.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.227, top1 = 55.63%], valid : [loss = 1.278, top1 = 53.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8391/15625) 008391-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.95%], valid : [loss = 0.462, top1 = 85.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10        train : [loss = 0.154, top1 = 94.92%], test  : [loss = 0.342, top1 = 88.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.54 ms.
cifar100       train : [loss = 0.981, top1 = 71.88%], valid : [loss = 1.353, top1 = 62.10%], test : [loss = 1.333, top1 = 62.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.99%], valid : [loss = 2.666, top1 = 32.87%], test : [loss = 2.696, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.75%], valid : [loss = 0.791, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8392/15625) 008392-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.99%], valid : [loss = 0.476, top1 = 84.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10        train : [loss = 0.297, top1 = 90.06%], test  : [loss = 0.400, top1 = 86.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.40 ms.
cifar100       train : [loss = 1.328, top1 = 63.39%], valid : [loss = 1.541, top1 = 57.60%], test : [loss = 1.515, top1 = 58.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.07 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 28.37%], valid : [loss = 2.906, top1 = 28.27%], test : [loss = 2.987, top1 = 27.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8393/15625) 008393-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.95%], valid : [loss = 0.483, top1 = 84.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10        train : [loss = 0.296, top1 = 90.19%], test  : [loss = 0.396, top1 = 86.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 1.317, top1 = 63.16%], valid : [loss = 1.517, top1 = 58.14%], test : [loss = 1.482, top1 = 58.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.74%], valid : [loss = 2.899, top1 = 30.23%], test : [loss = 2.938, top1 = 28.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8394/15625) 008394-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.467, top1 = 89.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.307, top1 = 92.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.54 ms.
cifar100       train : [loss = 0.158, top1 = 96.31%], valid : [loss = 1.293, top1 = 69.06%], test : [loss = 1.326, top1 = 69.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 1.784, top1 = 52.55%], valid : [loss = 2.236, top1 = 43.10%], test : [loss = 2.289, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.447, top1 = 84.55%], valid : [loss = 0.543, top1 = 81.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8395/15625) 008395-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.55 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.578, top1 = 87.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.387, top1 = 91.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 0.398, top1 = 88.59%], valid : [loss = 1.398, top1 = 64.60%], test : [loss = 1.394, top1 = 65.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.88%], valid : [loss = 2.521, top1 = 36.77%], test : [loss = 2.520, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8396/15625) 008396-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.483, top1 = 88.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.015, top1 = 99.70%], test  : [loss = 0.325, top1 = 92.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.16 ms.
cifar100       train : [loss = 0.358, top1 = 90.13%], valid : [loss = 1.332, top1 = 66.02%], test : [loss = 1.321, top1 = 67.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.51 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.67%], valid : [loss = 2.390, top1 = 39.07%], test : [loss = 2.425, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.84%], valid : [loss = 0.640, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8397/15625) 008397-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.532, top1 = 88.95%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.381, top1 = 91.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.97 ms.
cifar100       train : [loss = 0.143, top1 = 96.67%], valid : [loss = 1.394, top1 = 68.38%], test : [loss = 1.412, top1 = 68.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 2.194, top1 = 43.03%], valid : [loss = 2.421, top1 = 37.93%], test : [loss = 2.430, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.65%], valid : [loss = 0.916, top1 = 67.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8398/15625) 008398-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.573, top1 = 87.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.384, top1 = 91.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 0.400, top1 = 88.62%], valid : [loss = 1.424, top1 = 64.95%], test : [loss = 1.419, top1 = 65.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.69%], valid : [loss = 2.533, top1 = 36.04%], test : [loss = 2.542, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.29%], valid : [loss = 0.767, top1 = 73.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8399/15625) 008399-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.533, top1 = 89.49%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.330, top1 = 93.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.59 ms.
cifar100       train : [loss = 0.066, top1 = 98.90%], valid : [loss = 1.358, top1 = 69.32%], test : [loss = 1.380, top1 = 69.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 1.796, top1 = 52.12%], valid : [loss = 2.319, top1 = 41.87%], test : [loss = 2.309, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.72%], valid : [loss = 0.847, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8400/15625) 008400-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.585, top1 = 87.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.389, top1 = 92.04%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.68 ms.
cifar100       train : [loss = 0.090, top1 = 98.39%], valid : [loss = 1.572, top1 = 66.71%], test : [loss = 1.541, top1 = 67.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.63%], valid : [loss = 2.395, top1 = 40.01%], test : [loss = 2.389, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.17%], valid : [loss = 0.791, top1 = 71.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8401/15625) 008401-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.34 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.286, top1 = 93.49%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.73 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.338, top1 = 70.58%], test : [loss = 1.325, top1 = 71.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 1.549, top1 = 58.16%], valid : [loss = 2.262, top1 = 43.07%], test : [loss = 2.283, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.17%], valid : [loss = 0.505, top1 = 83.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8402/15625) 008402-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.70%], valid : [loss = 0.794, top1 = 73.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10        train : [loss = 0.511, top1 = 82.05%], test  : [loss = 0.621, top1 = 78.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.46 ms.
cifar100       train : [loss = 1.948, top1 = 47.53%], valid : [loss = 2.147, top1 = 43.98%], test : [loss = 2.118, top1 = 43.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.60 ms.
ImageNet16-120 train : [loss = 3.532, top1 = 17.31%], valid : [loss = 3.530, top1 = 18.27%], test : [loss = 3.568, top1 = 16.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.235, top1 = 55.41%], valid : [loss = 1.257, top1 = 54.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8403/15625) 008403-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.26%], valid : [loss = 0.448, top1 = 87.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.322, top1 = 89.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.35 ms.
cifar100       train : [loss = 0.867, top1 = 75.28%], valid : [loss = 1.284, top1 = 63.95%], test : [loss = 1.274, top1 = 64.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.63%], valid : [loss = 2.627, top1 = 34.43%], test : [loss = 2.681, top1 = 33.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.12%], valid : [loss = 0.667, top1 = 77.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8404/15625) 008404-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.222, top1 = 92.54%], valid : [loss = 0.554, top1 = 83.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.239, top1 = 91.84%], test  : [loss = 0.422, top1 = 86.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.37 ms.
cifar100       train : [loss = 1.236, top1 = 65.01%], valid : [loss = 1.618, top1 = 56.84%], test : [loss = 1.584, top1 = 57.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 2.970, top1 = 27.72%], valid : [loss = 3.003, top1 = 26.70%], test : [loss = 3.062, top1 = 26.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.36%], valid : [loss = 1.209, top1 = 56.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8405/15625) 008405-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.505, top1 = 88.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.342, top1 = 91.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.340, top1 = 90.68%], valid : [loss = 1.290, top1 = 67.18%], test : [loss = 1.293, top1 = 66.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.67%], valid : [loss = 2.413, top1 = 39.07%], test : [loss = 2.408, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8406/15625) 008406-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.413, top1 = 90.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.287, top1 = 93.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.076, top1 = 98.87%], valid : [loss = 1.297, top1 = 70.88%], test : [loss = 1.304, top1 = 70.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 1.564, top1 = 57.71%], valid : [loss = 2.221, top1 = 43.53%], test : [loss = 2.231, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.31%], valid : [loss = 0.495, top1 = 83.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8407/15625) 008407-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.09%], valid : [loss = 0.838, top1 = 72.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.52 ms.
cifar10        train : [loss = 0.564, top1 = 80.37%], test  : [loss = 0.714, top1 = 75.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.62 ms.
cifar100       train : [loss = 1.775, top1 = 52.05%], valid : [loss = 2.058, top1 = 47.20%], test : [loss = 2.060, top1 = 47.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.71%], valid : [loss = 3.642, top1 = 16.07%], test : [loss = 3.649, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8408/15625) 008408-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.489, top1 = 88.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.320, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.320, top1 = 91.51%], valid : [loss = 1.253, top1 = 68.04%], test : [loss = 1.256, top1 = 68.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.62%], valid : [loss = 2.324, top1 = 40.53%], test : [loss = 2.350, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8409/15625) 008409-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=10.30 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.501, top1 = 88.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.363, top1 = 90.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.48 ms.
cifar100       train : [loss = 0.490, top1 = 85.49%], valid : [loss = 1.347, top1 = 65.28%], test : [loss = 1.344, top1 = 65.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.28%], valid : [loss = 2.551, top1 = 36.10%], test : [loss = 2.558, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8410/15625) 008410-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.524, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10        train : [loss = 0.029, top1 = 99.18%], test  : [loss = 0.322, top1 = 91.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.24 ms.
cifar100       train : [loss = 0.483, top1 = 86.02%], valid : [loss = 1.324, top1 = 66.44%], test : [loss = 1.321, top1 = 65.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.21%], valid : [loss = 2.532, top1 = 36.40%], test : [loss = 2.591, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.12%], valid : [loss = 0.628, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8411/15625) 008411-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.541, top1 = 89.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.324, top1 = 92.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.24 ms.
cifar100       train : [loss = 0.103, top1 = 97.94%], valid : [loss = 1.343, top1 = 69.26%], test : [loss = 1.373, top1 = 69.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.28 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.54%], valid : [loss = 2.249, top1 = 43.30%], test : [loss = 2.259, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.47%], valid : [loss = 0.704, top1 = 75.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8412/15625) 008412-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.19%], valid : [loss = 0.576, top1 = 86.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10        train : [loss = 0.070, top1 = 97.75%], test  : [loss = 0.394, top1 = 89.28%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.40 ms.
cifar100       train : [loss = 0.569, top1 = 83.73%], valid : [loss = 1.339, top1 = 65.56%], test : [loss = 1.347, top1 = 64.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.77 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.84%], valid : [loss = 2.562, top1 = 35.80%], test : [loss = 2.580, top1 = 35.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.24%], valid : [loss = 0.913, top1 = 67.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8413/15625) 008413-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.93%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.91 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.292, top1 = 93.65%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.88 ms.
cifar100       train : [loss = 0.064, top1 = 99.10%], valid : [loss = 1.403, top1 = 68.94%], test : [loss = 1.320, top1 = 70.88%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 1.562, top1 = 57.91%], valid : [loss = 2.232, top1 = 44.00%], test : [loss = 2.310, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.357, top1 = 87.92%], valid : [loss = 0.488, top1 = 83.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8414/15625) 008414-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.575, top1 = 87.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.45 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.380, top1 = 90.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.82 ms.
cifar100       train : [loss = 0.409, top1 = 88.24%], valid : [loss = 1.413, top1 = 64.82%], test : [loss = 1.394, top1 = 65.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.16%], valid : [loss = 2.462, top1 = 37.90%], test : [loss = 2.518, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.68%], valid : [loss = 0.818, top1 = 71.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8415/15625) 008415-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.505, top1 = 89.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.339, top1 = 92.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.65 ms.
cifar100       train : [loss = 0.110, top1 = 97.96%], valid : [loss = 1.242, top1 = 70.30%], test : [loss = 1.337, top1 = 69.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.92 ms.
ImageNet16-120 train : [loss = 1.739, top1 = 53.66%], valid : [loss = 2.203, top1 = 43.50%], test : [loss = 2.194, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.00%], valid : [loss = 0.656, top1 = 77.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8416/15625) 008416-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.56%], valid : [loss = 0.553, top1 = 82.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10        train : [loss = 0.301, top1 = 89.66%], test  : [loss = 0.428, top1 = 85.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.15 ms.
cifar100       train : [loss = 1.298, top1 = 63.37%], valid : [loss = 1.579, top1 = 57.01%], test : [loss = 1.570, top1 = 56.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 3.068, top1 = 25.78%], valid : [loss = 3.071, top1 = 25.84%], test : [loss = 3.151, top1 = 25.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.56%], valid : [loss = 1.244, top1 = 55.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8417/15625) 008417-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.15%], valid : [loss = 0.464, top1 = 86.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.45 ms.
cifar10        train : [loss = 0.163, top1 = 94.59%], test  : [loss = 0.348, top1 = 88.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.84 ms.
cifar100       train : [loss = 1.023, top1 = 71.17%], valid : [loss = 1.384, top1 = 62.20%], test : [loss = 1.370, top1 = 61.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.64%], valid : [loss = 2.684, top1 = 32.93%], test : [loss = 2.713, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8418/15625) 008418-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.30%], valid : [loss = 0.612, top1 = 85.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.070, top1 = 97.89%], test  : [loss = 0.400, top1 = 88.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 0.721, top1 = 78.91%], valid : [loss = 1.402, top1 = 63.03%], test : [loss = 1.366, top1 = 63.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.91%], valid : [loss = 2.672, top1 = 33.37%], test : [loss = 2.703, top1 = 33.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8419/15625) 008419-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.19%], valid : [loss = 0.610, top1 = 85.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10        train : [loss = 0.078, top1 = 97.56%], test  : [loss = 0.382, top1 = 89.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.21 ms.
cifar100       train : [loss = 0.727, top1 = 78.88%], valid : [loss = 1.366, top1 = 63.56%], test : [loss = 1.343, top1 = 63.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 36.00%], valid : [loss = 2.670, top1 = 33.43%], test : [loss = 2.719, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8420/15625) 008420-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.03%], valid : [loss = 0.614, top1 = 86.04%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.75 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.414, top1 = 91.37%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.48 ms.
cifar100       train : [loss = 0.177, top1 = 95.68%], valid : [loss = 1.505, top1 = 65.52%], test : [loss = 1.530, top1 = 64.58%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 26.89%], valid : [loss = 2.986, top1 = 27.13%], test : [loss = 3.021, top1 = 24.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.333, top1 = 51.32%], valid : [loss = 1.354, top1 = 50.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8421/15625) 008421-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8422/15625) 008422-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.568, top1 = 88.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.374, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.27 ms.
cifar100       train : [loss = 0.186, top1 = 95.31%], valid : [loss = 1.400, top1 = 66.97%], test : [loss = 1.392, top1 = 67.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.42%], valid : [loss = 2.421, top1 = 38.33%], test : [loss = 2.455, top1 = 37.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.10%], valid : [loss = 0.955, top1 = 65.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8423/15625) 008423-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.640 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.556, top1 = 88.92%]
cifar10        FLOP= 90.36 M, Params=0.640 MB, latency=17.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.370, top1 = 92.50%]
cifar100       FLOP= 90.36 M, Params=0.646 MB, latency=16.65 ms.
cifar100       train : [loss = 0.095, top1 = 98.29%], valid : [loss = 1.455, top1 = 68.25%], test : [loss = 1.465, top1 = 68.19%]
ImageNet16-120 FLOP= 22.60 M, Params=0.648 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.89%], valid : [loss = 2.407, top1 = 39.81%], test : [loss = 2.424, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 79.92%], valid : [loss = 0.672, top1 = 77.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8424/15625) 008424-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.613, top1 = 87.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.16 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.401, top1 = 91.40%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.86 ms.
cifar100       train : [loss = 0.117, top1 = 97.59%], valid : [loss = 1.586, top1 = 65.60%], test : [loss = 1.586, top1 = 65.92%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.019, top1 = 47.26%], valid : [loss = 2.478, top1 = 36.90%], test : [loss = 2.503, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.37%], valid : [loss = 0.813, top1 = 71.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8425/15625) 008425-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.541, top1 = 88.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.349, top1 = 91.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.297, top1 = 91.91%], valid : [loss = 1.307, top1 = 67.28%], test : [loss = 1.304, top1 = 67.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.72%], valid : [loss = 2.429, top1 = 38.52%], test : [loss = 2.440, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8426/15625) 008426-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.438, top1 = 90.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.283, top1 = 93.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.21 ms.
cifar100       train : [loss = 0.063, top1 = 99.12%], valid : [loss = 1.322, top1 = 70.14%], test : [loss = 1.331, top1 = 70.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 1.540, top1 = 58.35%], valid : [loss = 2.248, top1 = 43.60%], test : [loss = 2.262, top1 = 44.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8427/15625) 008427-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.21%], valid : [loss = 0.481, top1 = 84.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10        train : [loss = 0.243, top1 = 91.83%], test  : [loss = 0.406, top1 = 86.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.38 ms.
cifar100       train : [loss = 1.340, top1 = 62.61%], valid : [loss = 1.604, top1 = 55.42%], test : [loss = 1.579, top1 = 55.89%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 3.397, top1 = 19.49%], valid : [loss = 3.590, top1 = 17.00%], test : [loss = 3.604, top1 = 16.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8428/15625) 008428-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.075, top1 = 98.00%], valid : [loss = 0.480, top1 = 86.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.085, top1 = 97.21%], test  : [loss = 0.357, top1 = 90.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.57 ms.
cifar100       train : [loss = 0.661, top1 = 81.03%], valid : [loss = 1.209, top1 = 66.02%], test : [loss = 1.193, top1 = 66.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.372, top1 = 39.54%], valid : [loss = 2.457, top1 = 37.83%], test : [loss = 2.518, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.74%], valid : [loss = 0.913, top1 = 67.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8429/15625) 008429-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.566, top1 = 87.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=20.30 ms.
cifar10        train : [loss = 0.034, top1 = 99.01%], test  : [loss = 0.366, top1 = 90.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.40 ms.
cifar100       train : [loss = 0.665, top1 = 80.96%], valid : [loss = 1.487, top1 = 61.42%], test : [loss = 1.445, top1 = 61.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 2.516, top1 = 35.85%], valid : [loss = 2.622, top1 = 34.67%], test : [loss = 2.653, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.80%], valid : [loss = 0.906, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8430/15625) 008430-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.16%], valid : [loss = 0.717, top1 = 75.62%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10        train : [loss = 0.481, top1 = 83.12%], test  : [loss = 0.587, top1 = 80.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.34 ms.
cifar100       train : [loss = 1.821, top1 = 50.63%], valid : [loss = 2.015, top1 = 46.42%], test : [loss = 2.002, top1 = 47.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.497, top1 = 17.92%], valid : [loss = 3.520, top1 = 17.93%], test : [loss = 3.527, top1 = 17.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.227, top1 = 55.58%], valid : [loss = 1.255, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8431/15625) 008431-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.35%], valid : [loss = 0.454, top1 = 87.60%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.03 ms.
cifar10        train : [loss = 0.066, top1 = 98.22%], test  : [loss = 0.315, top1 = 90.29%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.44 ms.
cifar100       train : [loss = 0.611, top1 = 83.10%], valid : [loss = 1.267, top1 = 65.83%], test : [loss = 1.253, top1 = 65.59%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 40.12%], valid : [loss = 2.516, top1 = 36.87%], test : [loss = 2.520, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.81%], valid : [loss = 0.646, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8432/15625) 008432-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.521, top1 = 88.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.344, top1 = 92.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.61 ms.
cifar100       train : [loss = 0.257, top1 = 93.30%], valid : [loss = 1.279, top1 = 68.40%], test : [loss = 1.267, top1 = 69.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 49.96%], valid : [loss = 2.214, top1 = 42.00%], test : [loss = 2.224, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.78%], valid : [loss = 0.711, top1 = 75.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8433/15625) 008433-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.19 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.12%], valid : [loss = 0.859, top1 = 71.87%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 0.557, top1 = 80.48%], test  : [loss = 0.716, top1 = 75.44%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.18 ms.
cifar100       train : [loss = 1.776, top1 = 52.08%], valid : [loss = 2.045, top1 = 47.07%], test : [loss = 2.076, top1 = 46.11%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.52 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.78%], valid : [loss = 3.632, top1 = 16.52%], test : [loss = 3.658, top1 = 15.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8434/15625) 008434-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.496, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.324, top1 = 92.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.67 ms.
cifar100       train : [loss = 0.228, top1 = 94.46%], valid : [loss = 1.213, top1 = 69.78%], test : [loss = 1.267, top1 = 69.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 1.937, top1 = 49.00%], valid : [loss = 2.273, top1 = 41.87%], test : [loss = 2.262, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.698, top1 = 75.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8435/15625) 008435-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.609, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.035, top1 = 98.99%], test  : [loss = 0.404, top1 = 90.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.514, top1 = 84.89%], valid : [loss = 1.361, top1 = 65.12%], test : [loss = 1.351, top1 = 65.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 2.401, top1 = 38.91%], valid : [loss = 2.569, top1 = 35.87%], test : [loss = 2.564, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.71%], valid : [loss = 0.823, top1 = 70.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8436/15625) 008436-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.622, top1 = 84.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.069, top1 = 97.92%], test  : [loss = 0.367, top1 = 89.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 0.729, top1 = 78.80%], valid : [loss = 1.365, top1 = 63.14%], test : [loss = 1.396, top1 = 62.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.93%], valid : [loss = 2.662, top1 = 34.27%], test : [loss = 2.699, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.59%], valid : [loss = 0.817, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8437/15625) 008437-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.20%], valid : [loss = 0.457, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.155, top1 = 94.99%], test  : [loss = 0.343, top1 = 89.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.78 ms.
cifar100       train : [loss = 1.007, top1 = 71.27%], valid : [loss = 1.367, top1 = 61.78%], test : [loss = 1.359, top1 = 61.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.34%], valid : [loss = 2.707, top1 = 32.58%], test : [loss = 2.734, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8438/15625) 008438-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.582, top1 = 87.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.412, top1 = 90.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.48 ms.
cifar100       train : [loss = 0.307, top1 = 91.65%], valid : [loss = 1.463, top1 = 64.72%], test : [loss = 1.454, top1 = 65.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.65%], valid : [loss = 2.481, top1 = 37.47%], test : [loss = 2.512, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 72.94%], valid : [loss = 0.829, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8439/15625) 008439-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=10.94 ms.
cifar10-valid  train : [loss = 0.403, top1 = 86.13%], valid : [loss = 0.529, top1 = 82.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.404, top1 = 86.32%], test  : [loss = 0.474, top1 = 84.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.48 ms.
cifar100       train : [loss = 1.515, top1 = 58.29%], valid : [loss = 1.638, top1 = 54.86%], test : [loss = 1.637, top1 = 55.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 3.058, top1 = 25.97%], valid : [loss = 3.043, top1 = 27.13%], test : [loss = 3.069, top1 = 25.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.134, top1 = 59.92%], valid : [loss = 1.146, top1 = 59.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8440/15625) 008440-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.08%], valid : [loss = 0.583, top1 = 86.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.44 ms.
cifar10        train : [loss = 0.047, top1 = 98.51%], test  : [loss = 0.371, top1 = 90.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.08 ms.
cifar100       train : [loss = 0.394, top1 = 88.64%], valid : [loss = 1.362, top1 = 65.68%], test : [loss = 1.357, top1 = 65.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 2.754, top1 = 30.63%], valid : [loss = 2.780, top1 = 30.33%], test : [loss = 2.791, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 66.22%], valid : [loss = 0.978, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8441/15625) 008441-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.358, top1 = 87.45%], valid : [loss = 0.621, top1 = 80.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10        train : [loss = 0.289, top1 = 90.01%], test  : [loss = 0.427, top1 = 85.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.01 ms.
cifar100       train : [loss = 1.515, top1 = 57.64%], valid : [loss = 1.745, top1 = 52.42%], test : [loss = 1.762, top1 = 52.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.85%], valid : [loss = 2.952, top1 = 28.27%], test : [loss = 2.991, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 62.92%], valid : [loss = 1.093, top1 = 61.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8442/15625) 008442-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.712, top1 = 85.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.443, top1 = 90.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.224, top1 = 94.49%], valid : [loss = 1.631, top1 = 63.90%], test : [loss = 1.645, top1 = 63.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.92%], valid : [loss = 2.697, top1 = 33.53%], test : [loss = 2.770, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.43%], valid : [loss = 0.834, top1 = 70.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8443/15625) 008443-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.22%], valid : [loss = 0.587, top1 = 83.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10        train : [loss = 0.203, top1 = 93.09%], test  : [loss = 0.411, top1 = 86.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.10 ms.
cifar100       train : [loss = 1.043, top1 = 69.93%], valid : [loss = 1.477, top1 = 60.60%], test : [loss = 1.444, top1 = 60.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.864, top1 = 29.14%], valid : [loss = 2.956, top1 = 28.60%], test : [loss = 2.990, top1 = 27.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 66.22%], valid : [loss = 1.001, top1 = 64.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8444/15625) 008444-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.50%], valid : [loss = 0.580, top1 = 81.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.266, top1 = 90.81%], test  : [loss = 0.421, top1 = 86.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.59 ms.
cifar100       train : [loss = 1.504, top1 = 57.90%], valid : [loss = 1.737, top1 = 52.90%], test : [loss = 1.738, top1 = 52.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.98%], valid : [loss = 2.953, top1 = 27.77%], test : [loss = 3.004, top1 = 26.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 63.92%], valid : [loss = 1.048, top1 = 62.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8445/15625) 008445-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.02 ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.36%], valid : [loss = 0.977, top1 = 66.84%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10        train : [loss = 0.789, top1 = 72.43%], test  : [loss = 0.878, top1 = 69.42%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.03 ms.
cifar100       train : [loss = 2.150, top1 = 43.75%], valid : [loss = 2.347, top1 = 40.60%], test : [loss = 2.345, top1 = 40.70%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.21 ms.
ImageNet16-120 train : [loss = 3.738, top1 = 14.41%], valid : [loss = 3.757, top1 = 14.17%], test : [loss = 3.774, top1 = 13.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.460, top1 = 46.64%], valid : [loss = 1.477, top1 = 46.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8446/15625) 008446-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.23%], valid : [loss = 0.592, top1 = 86.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10        train : [loss = 0.072, top1 = 97.83%], test  : [loss = 0.403, top1 = 89.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.71 ms.
cifar100       train : [loss = 0.718, top1 = 79.27%], valid : [loss = 1.407, top1 = 62.10%], test : [loss = 1.410, top1 = 62.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.566, top1 = 35.38%], valid : [loss = 2.649, top1 = 33.27%], test : [loss = 2.724, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.28%], valid : [loss = 0.765, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8447/15625) 008447-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.464, top1 = 89.12%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=15.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.00%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=14.02 ms.
cifar100       train : [loss = 0.324, top1 = 91.32%], valid : [loss = 1.291, top1 = 67.59%], test : [loss = 1.327, top1 = 67.11%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.38%], valid : [loss = 2.360, top1 = 39.91%], test : [loss = 2.407, top1 = 40.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8448/15625) 008448-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.17%], valid : [loss = 0.555, top1 = 86.87%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.20 ms.
cifar10        train : [loss = 0.053, top1 = 98.34%], test  : [loss = 0.378, top1 = 90.03%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=16.74 ms.
cifar100       train : [loss = 0.595, top1 = 82.62%], valid : [loss = 1.295, top1 = 65.15%], test : [loss = 1.314, top1 = 65.09%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.69%], valid : [loss = 2.464, top1 = 37.38%], test : [loss = 2.481, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.07%], valid : [loss = 0.737, top1 = 74.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8449/15625) 008449-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.414, top1 = 91.38%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.85 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.286, top1 = 93.97%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.39 ms.
cifar100       train : [loss = 0.032, top1 = 99.65%], valid : [loss = 1.254, top1 = 72.52%], test : [loss = 1.255, top1 = 72.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 1.306, top1 = 64.14%], valid : [loss = 2.210, top1 = 46.20%], test : [loss = 2.205, top1 = 46.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.81%], valid : [loss = 0.472, top1 = 84.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8450/15625) 008450-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.493, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.312, top1 = 92.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.48 ms.
cifar100       train : [loss = 0.244, top1 = 93.91%], valid : [loss = 1.276, top1 = 67.99%], test : [loss = 1.262, top1 = 68.83%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.48%], valid : [loss = 2.267, top1 = 41.78%], test : [loss = 2.267, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.511, top1 = 82.12%], valid : [loss = 0.599, top1 = 79.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8451/15625) 008451-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.510, top1 = 88.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.95 ms.
cifar10        train : [loss = 0.026, top1 = 99.35%], test  : [loss = 0.352, top1 = 91.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.66 ms.
cifar100       train : [loss = 0.465, top1 = 86.36%], valid : [loss = 1.328, top1 = 66.34%], test : [loss = 1.323, top1 = 66.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.16%], valid : [loss = 2.513, top1 = 36.37%], test : [loss = 2.536, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.71%], valid : [loss = 0.699, top1 = 76.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8452/15625) 008452-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.457, top1 = 90.84%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.97 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.313, top1 = 93.52%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.87 ms.
cifar100       train : [loss = 0.021, top1 = 99.82%], valid : [loss = 1.378, top1 = 71.08%], test : [loss = 1.360, top1 = 72.04%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.92 ms.
ImageNet16-120 train : [loss = 1.248, top1 = 65.64%], valid : [loss = 2.292, top1 = 44.37%], test : [loss = 2.253, top1 = 45.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.88%], valid : [loss = 0.518, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8453/15625) 008453-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.35%], valid : [loss = 0.567, top1 = 83.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.180, top1 = 93.94%], test  : [loss = 0.394, top1 = 87.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.09 ms.
cifar100       train : [loss = 1.184, top1 = 66.24%], valid : [loss = 1.528, top1 = 58.17%], test : [loss = 1.532, top1 = 57.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.730, top1 = 31.95%], valid : [loss = 2.753, top1 = 31.24%], test : [loss = 2.810, top1 = 30.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.72%], valid : [loss = 0.959, top1 = 66.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8454/15625) 008454-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.571, top1 = 87.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.86 ms.
cifar10        train : [loss = 0.039, top1 = 98.86%], test  : [loss = 0.402, top1 = 90.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.59 ms.
cifar100       train : [loss = 0.548, top1 = 83.94%], valid : [loss = 1.441, top1 = 63.60%], test : [loss = 1.370, top1 = 64.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.461, top1 = 37.49%], valid : [loss = 2.592, top1 = 34.37%], test : [loss = 2.639, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.17%], valid : [loss = 0.642, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8455/15625) 008455-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.522, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.56 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.337, top1 = 92.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.161, top1 = 96.20%], valid : [loss = 1.367, top1 = 68.00%], test : [loss = 1.383, top1 = 67.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 1.967, top1 = 48.25%], valid : [loss = 2.346, top1 = 39.77%], test : [loss = 2.328, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.17%], valid : [loss = 0.799, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8456/15625) 008456-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.70%], valid : [loss = 0.665, top1 = 77.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.508, top1 = 82.43%], test  : [loss = 0.593, top1 = 80.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.10 ms.
cifar100       train : [loss = 1.693, top1 = 54.17%], valid : [loss = 1.855, top1 = 49.92%], test : [loss = 1.876, top1 = 50.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 21.26%], valid : [loss = 3.327, top1 = 21.30%], test : [loss = 3.332, top1 = 21.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8457/15625) 008457-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.562, top1 = 89.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.48 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.360, top1 = 92.86%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.80 ms.
cifar100       train : [loss = 0.039, top1 = 99.62%], valid : [loss = 1.413, top1 = 69.60%], test : [loss = 1.419, top1 = 69.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.702, top1 = 54.60%], valid : [loss = 2.383, top1 = 40.03%], test : [loss = 2.442, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.77%], valid : [loss = 0.678, top1 = 76.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8458/15625) 008458-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.530, top1 = 88.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.88 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.330, top1 = 92.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.72 ms.
cifar100       train : [loss = 0.318, top1 = 90.95%], valid : [loss = 1.303, top1 = 67.04%], test : [loss = 1.354, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.30%], valid : [loss = 2.475, top1 = 37.87%], test : [loss = 2.498, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.12%], valid : [loss = 0.912, top1 = 67.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8459/15625) 008459-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.67%], valid : [loss = 0.637, top1 = 84.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.094, top1 = 96.89%], test  : [loss = 0.380, top1 = 88.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 0.789, top1 = 76.90%], valid : [loss = 1.441, top1 = 61.76%], test : [loss = 1.414, top1 = 62.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.72%], valid : [loss = 2.756, top1 = 31.97%], test : [loss = 2.772, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.10%], valid : [loss = 0.833, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8460/15625) 008460-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.341, top1 = 88.12%], valid : [loss = 0.562, top1 = 81.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10        train : [loss = 0.286, top1 = 90.17%], test  : [loss = 0.425, top1 = 86.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 1.576, top1 = 56.05%], valid : [loss = 1.799, top1 = 51.45%], test : [loss = 1.782, top1 = 51.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 25.90%], valid : [loss = 3.048, top1 = 26.02%], test : [loss = 3.123, top1 = 24.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 62.80%], valid : [loss = 1.079, top1 = 61.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8461/15625) 008461-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.31%], valid : [loss = 0.526, top1 = 85.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.089, top1 = 97.16%], test  : [loss = 0.342, top1 = 89.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.65 ms.
cifar100       train : [loss = 0.798, top1 = 76.59%], valid : [loss = 1.346, top1 = 63.86%], test : [loss = 1.333, top1 = 64.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.02%], valid : [loss = 2.595, top1 = 34.73%], test : [loss = 2.601, top1 = 34.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.37%], valid : [loss = 0.990, top1 = 65.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8462/15625) 008462-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.274, top1 = 91.02%], valid : [loss = 0.463, top1 = 84.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.299, top1 = 90.00%], test  : [loss = 0.403, top1 = 86.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.90 ms.
cifar100       train : [loss = 1.323, top1 = 63.40%], valid : [loss = 1.545, top1 = 57.18%], test : [loss = 1.526, top1 = 58.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.50%], valid : [loss = 2.921, top1 = 28.83%], test : [loss = 2.973, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.81%], valid : [loss = 0.768, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8463/15625) 008463-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.578, top1 = 88.69%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.354, top1 = 92.82%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.41 ms.
cifar100       train : [loss = 0.066, top1 = 99.04%], valid : [loss = 1.433, top1 = 69.20%], test : [loss = 1.461, top1 = 68.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.14%], valid : [loss = 2.429, top1 = 39.63%], test : [loss = 2.440, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 76.91%], valid : [loss = 0.742, top1 = 74.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8464/15625) 008464-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.32 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.503, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.18 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.321, top1 = 92.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.41 ms.
cifar100       train : [loss = 0.149, top1 = 96.81%], valid : [loss = 1.299, top1 = 68.92%], test : [loss = 1.320, top1 = 68.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.72%], valid : [loss = 2.304, top1 = 41.47%], test : [loss = 2.296, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.72%], valid : [loss = 0.719, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8465/15625) 008465-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.567, top1 = 87.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.392, top1 = 90.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.414, top1 = 88.27%], valid : [loss = 1.426, top1 = 64.40%], test : [loss = 1.452, top1 = 63.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.03%], valid : [loss = 2.503, top1 = 37.27%], test : [loss = 2.512, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8466/15625) 008466-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.521, top1 = 88.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.019, top1 = 99.54%], test  : [loss = 0.359, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 0.387, top1 = 88.92%], valid : [loss = 1.342, top1 = 66.27%], test : [loss = 1.358, top1 = 66.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.94%], valid : [loss = 2.423, top1 = 38.67%], test : [loss = 2.477, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.59%], valid : [loss = 0.640, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8467/15625) 008467-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.25 ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.57%], valid : [loss = 0.842, top1 = 71.49%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 0.680, top1 = 76.20%], test  : [loss = 0.771, top1 = 73.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.20 ms.
cifar100       train : [loss = 1.968, top1 = 47.81%], valid : [loss = 2.136, top1 = 45.30%], test : [loss = 2.158, top1 = 44.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.53 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.75%], valid : [loss = 3.662, top1 = 16.27%], test : [loss = 3.691, top1 = 14.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8468/15625) 008468-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.53%], valid : [loss = 0.562, top1 = 84.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.71 ms.
cifar10        train : [loss = 0.132, top1 = 95.74%], test  : [loss = 0.398, top1 = 88.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 0.996, top1 = 71.37%], valid : [loss = 1.428, top1 = 60.91%], test : [loss = 1.449, top1 = 60.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.89%], valid : [loss = 2.589, top1 = 35.20%], test : [loss = 2.612, top1 = 34.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.91%], valid : [loss = 0.923, top1 = 67.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8469/15625) 008469-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.87%], valid : [loss = 0.625, top1 = 84.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.111, top1 = 96.25%], test  : [loss = 0.413, top1 = 88.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.25 ms.
cifar100       train : [loss = 0.845, top1 = 75.10%], valid : [loss = 1.466, top1 = 61.68%], test : [loss = 1.456, top1 = 61.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.22 ms.
ImageNet16-120 train : [loss = 2.697, top1 = 32.47%], valid : [loss = 2.773, top1 = 31.90%], test : [loss = 2.830, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.20%], valid : [loss = 0.708, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8470/15625) 008470-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.74%], valid : [loss = 0.768, top1 = 73.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10        train : [loss = 0.545, top1 = 81.08%], test  : [loss = 0.599, top1 = 79.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.01 ms.
cifar100       train : [loss = 2.109, top1 = 43.64%], valid : [loss = 2.195, top1 = 41.76%], test : [loss = 2.206, top1 = 41.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.36%], valid : [loss = 3.202, top1 = 22.97%], test : [loss = 3.246, top1 = 21.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.58%], valid : [loss = 1.209, top1 = 56.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8471/15625) 008471-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.595, top1 = 88.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.388, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.04 ms.
cifar100       train : [loss = 0.127, top1 = 97.53%], valid : [loss = 1.492, top1 = 67.00%], test : [loss = 1.502, top1 = 66.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.67%], valid : [loss = 2.395, top1 = 39.77%], test : [loss = 2.405, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.04%], valid : [loss = 0.768, top1 = 73.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8472/15625) 008472-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.02%], valid : [loss = 0.551, top1 = 85.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10        train : [loss = 0.100, top1 = 96.81%], test  : [loss = 0.369, top1 = 89.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.47 ms.
cifar100       train : [loss = 0.687, top1 = 80.09%], valid : [loss = 1.383, top1 = 63.90%], test : [loss = 1.387, top1 = 62.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.20%], valid : [loss = 2.593, top1 = 34.43%], test : [loss = 2.637, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.42%], valid : [loss = 0.870, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8473/15625) 008473-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.62%], valid : [loss = 0.449, top1 = 86.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.10 ms.
cifar10        train : [loss = 0.148, top1 = 95.21%], test  : [loss = 0.334, top1 = 89.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.46 ms.
cifar100       train : [loss = 0.999, top1 = 71.63%], valid : [loss = 1.354, top1 = 62.50%], test : [loss = 1.350, top1 = 62.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.05%], valid : [loss = 2.700, top1 = 32.43%], test : [loss = 2.701, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.00%], valid : [loss = 0.775, top1 = 72.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8474/15625) 008474-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.46%], valid : [loss = 0.459, top1 = 86.71%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.18 ms.
cifar10        train : [loss = 0.119, top1 = 96.29%], test  : [loss = 0.340, top1 = 89.08%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.58 ms.
cifar100       train : [loss = 0.734, top1 = 79.36%], valid : [loss = 1.276, top1 = 65.14%], test : [loss = 1.266, top1 = 64.82%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.99%], valid : [loss = 2.580, top1 = 34.93%], test : [loss = 2.611, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.20%], valid : [loss = 0.826, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8475/15625) 008475-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.67%], valid : [loss = 0.850, top1 = 71.10%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.46 ms.
cifar10        train : [loss = 0.677, top1 = 76.31%], test  : [loss = 0.759, top1 = 73.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.86 ms.
cifar100       train : [loss = 1.967, top1 = 47.83%], valid : [loss = 2.142, top1 = 44.59%], test : [loss = 2.154, top1 = 44.03%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.82 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.72%], valid : [loss = 3.671, top1 = 15.89%], test : [loss = 3.694, top1 = 14.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8476/15625) 008476-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.515, top1 = 89.27%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.334, top1 = 91.97%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.64 ms.
cifar100       train : [loss = 0.201, top1 = 95.24%], valid : [loss = 1.232, top1 = 68.50%], test : [loss = 1.213, top1 = 69.32%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.41%], valid : [loss = 2.200, top1 = 43.73%], test : [loss = 2.251, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.42%], valid : [loss = 0.690, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8477/15625) 008477-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.35%], valid : [loss = 0.839, top1 = 71.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10        train : [loss = 0.677, top1 = 76.19%], test  : [loss = 0.761, top1 = 73.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.992, top1 = 47.14%], valid : [loss = 2.143, top1 = 44.66%], test : [loss = 2.175, top1 = 43.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 3.661, top1 = 15.46%], valid : [loss = 3.691, top1 = 15.57%], test : [loss = 3.708, top1 = 14.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.385, top1 = 49.74%], valid : [loss = 1.400, top1 = 49.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8478/15625) 008478-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.655, top1 = 85.84%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.58 ms.
cifar10        train : [loss = 0.024, top1 = 99.46%], test  : [loss = 0.465, top1 = 89.14%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.46 ms.
cifar100       train : [loss = 0.346, top1 = 90.93%], valid : [loss = 1.443, top1 = 65.22%], test : [loss = 1.430, top1 = 64.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.17%], valid : [loss = 2.594, top1 = 35.03%], test : [loss = 2.603, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.88%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8479/15625) 008479-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.628, top1 = 87.40%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.66%], test  : [loss = 0.418, top1 = 90.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=17.06 ms.
cifar100       train : [loss = 0.183, top1 = 95.72%], valid : [loss = 1.514, top1 = 65.16%], test : [loss = 1.505, top1 = 66.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.18%], valid : [loss = 2.461, top1 = 37.73%], test : [loss = 2.516, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 72.83%], valid : [loss = 0.831, top1 = 70.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8480/15625) 008480-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.473, top1 = 89.06%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.68 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.313, top1 = 92.40%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.53 ms.
cifar100       train : [loss = 0.302, top1 = 92.18%], valid : [loss = 1.196, top1 = 68.46%], test : [loss = 1.230, top1 = 68.18%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.59%], valid : [loss = 2.230, top1 = 42.83%], test : [loss = 2.240, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.55%], valid : [loss = 0.617, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8481/15625) 008481-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10-valid  train : [loss = 1.315, top1 = 52.54%], valid : [loss = 1.358, top1 = 51.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10        train : [loss = 1.313, top1 = 52.62%], test  : [loss = 1.308, top1 = 52.65%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.50 ms.
cifar100       train : [loss = 2.796, top1 = 30.22%], valid : [loss = 2.881, top1 = 28.58%], test : [loss = 2.883, top1 = 29.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.53 ms.
ImageNet16-120 train : [loss = 3.920, top1 = 11.56%], valid : [loss = 3.930, top1 = 11.30%], test : [loss = 3.943, top1 = 11.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.754, top1 = 33.84%], valid : [loss = 1.741, top1 = 34.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8482/15625) 008482-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.39%], valid : [loss = 0.456, top1 = 87.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10        train : [loss = 0.066, top1 = 98.26%], test  : [loss = 0.317, top1 = 90.46%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.01 ms.
cifar100       train : [loss = 0.633, top1 = 82.35%], valid : [loss = 1.262, top1 = 65.80%], test : [loss = 1.252, top1 = 65.93%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.87%], valid : [loss = 2.534, top1 = 36.34%], test : [loss = 2.545, top1 = 35.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.92%], valid : [loss = 0.635, top1 = 78.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8483/15625) 008483-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.501, top1 = 89.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.319, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.57 ms.
cifar100       train : [loss = 0.170, top1 = 96.35%], valid : [loss = 1.276, top1 = 69.46%], test : [loss = 1.290, top1 = 69.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.41%], valid : [loss = 2.258, top1 = 42.07%], test : [loss = 2.247, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.33%], valid : [loss = 0.672, top1 = 76.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8484/15625) 008484-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.132, top1 = 96.00%], valid : [loss = 0.463, top1 = 86.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10        train : [loss = 0.151, top1 = 95.10%], test  : [loss = 0.337, top1 = 89.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.05 ms.
cifar100       train : [loss = 1.008, top1 = 71.45%], valid : [loss = 1.360, top1 = 62.36%], test : [loss = 1.344, top1 = 62.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.51%], valid : [loss = 2.720, top1 = 32.47%], test : [loss = 2.722, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.73%], valid : [loss = 0.774, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8485/15625) 008485-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.514, top1 = 89.49%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.78 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.02%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.11 ms.
cifar100       train : [loss = 0.074, top1 = 98.94%], valid : [loss = 1.316, top1 = 69.94%], test : [loss = 1.293, top1 = 69.64%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.04 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.97%], valid : [loss = 2.297, top1 = 41.83%], test : [loss = 2.252, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.73%], valid : [loss = 0.789, top1 = 72.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8486/15625) 008486-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.537, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.29 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.367, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.45 ms.
cifar100       train : [loss = 0.221, top1 = 94.84%], valid : [loss = 1.404, top1 = 66.50%], test : [loss = 1.384, top1 = 67.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.49%], valid : [loss = 2.428, top1 = 38.62%], test : [loss = 2.437, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.11%], valid : [loss = 0.686, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8487/15625) 008487-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.32%], valid : [loss = 0.634, top1 = 85.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.053, top1 = 98.41%], test  : [loss = 0.406, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.29 ms.
cifar100       train : [loss = 0.638, top1 = 81.47%], valid : [loss = 1.424, top1 = 63.15%], test : [loss = 1.403, top1 = 63.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.05%], valid : [loss = 2.607, top1 = 34.49%], test : [loss = 2.657, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.12%], valid : [loss = 0.838, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8488/15625) 008488-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.672, top1 = 85.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10        train : [loss = 0.052, top1 = 98.40%], test  : [loss = 0.457, top1 = 88.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.648, top1 = 81.05%], valid : [loss = 1.532, top1 = 61.20%], test : [loss = 1.494, top1 = 61.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.52%], valid : [loss = 2.818, top1 = 31.20%], test : [loss = 2.870, top1 = 29.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.86%], valid : [loss = 0.895, top1 = 68.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8489/15625) 008489-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.563, top1 = 87.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.38 ms.
cifar10        train : [loss = 0.015, top1 = 99.59%], test  : [loss = 0.352, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.84 ms.
cifar100       train : [loss = 0.224, top1 = 94.20%], valid : [loss = 1.330, top1 = 66.98%], test : [loss = 1.313, top1 = 67.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.89%], valid : [loss = 2.355, top1 = 40.30%], test : [loss = 2.346, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.33%], valid : [loss = 0.904, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8490/15625) 008490-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.02 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.562, top1 = 88.87%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.357, top1 = 92.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.19 ms.
cifar100       train : [loss = 0.201, top1 = 95.14%], valid : [loss = 1.381, top1 = 66.40%], test : [loss = 1.405, top1 = 66.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.98 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.26%], valid : [loss = 2.449, top1 = 37.67%], test : [loss = 2.424, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.84%], valid : [loss = 0.927, top1 = 66.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8491/15625) 008491-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.567, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.380, top1 = 91.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.176, top1 = 96.25%], valid : [loss = 1.383, top1 = 67.96%], test : [loss = 1.364, top1 = 67.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.24%], valid : [loss = 2.459, top1 = 39.37%], test : [loss = 2.481, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8492/15625) 008492-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.571, top1 = 87.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.67 ms.
cifar10        train : [loss = 0.041, top1 = 98.79%], test  : [loss = 0.410, top1 = 89.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.01 ms.
cifar100       train : [loss = 0.552, top1 = 83.83%], valid : [loss = 1.417, top1 = 64.60%], test : [loss = 1.397, top1 = 63.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.86 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.77%], valid : [loss = 2.612, top1 = 33.93%], test : [loss = 2.666, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8493/15625) 008493-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.491, top1 = 88.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.330, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.288, top1 = 66.74%], test : [loss = 1.307, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.91%], valid : [loss = 2.401, top1 = 39.53%], test : [loss = 2.414, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8494/15625) 008494-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.60 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.539, top1 = 88.82%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.355, top1 = 92.18%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.85 ms.
cifar100       train : [loss = 0.099, top1 = 98.40%], valid : [loss = 1.426, top1 = 67.48%], test : [loss = 1.447, top1 = 67.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.47 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.42%], valid : [loss = 2.405, top1 = 39.97%], test : [loss = 2.404, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.35%], valid : [loss = 0.700, top1 = 75.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8495/15625) 008495-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.42%], valid : [loss = 0.529, top1 = 84.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.66 ms.
cifar10        train : [loss = 0.179, top1 = 94.01%], test  : [loss = 0.383, top1 = 88.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.49 ms.
cifar100       train : [loss = 1.224, top1 = 65.11%], valid : [loss = 1.529, top1 = 57.52%], test : [loss = 1.519, top1 = 57.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.79%], valid : [loss = 2.690, top1 = 33.67%], test : [loss = 2.717, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 67.09%], valid : [loss = 0.980, top1 = 65.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8496/15625) 008496-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.555, top1 = 88.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.352, top1 = 92.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.53 ms.
cifar100       train : [loss = 0.177, top1 = 96.11%], valid : [loss = 1.397, top1 = 67.84%], test : [loss = 1.426, top1 = 66.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.59%], valid : [loss = 2.462, top1 = 37.87%], test : [loss = 2.494, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8497/15625) 008497-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.543, top1 = 88.53%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.351, top1 = 91.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.22 ms.
cifar100       train : [loss = 0.170, top1 = 95.80%], valid : [loss = 1.331, top1 = 67.78%], test : [loss = 1.378, top1 = 68.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.78 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.69%], valid : [loss = 2.432, top1 = 38.57%], test : [loss = 2.487, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.74%], valid : [loss = 0.915, top1 = 67.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8498/15625) 008498-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.575, top1 = 88.28%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.47 ms.
cifar10        train : [loss = 0.007, top1 = 99.81%], test  : [loss = 0.346, top1 = 92.50%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.00 ms.
cifar100       train : [loss = 0.090, top1 = 98.11%], valid : [loss = 1.345, top1 = 69.68%], test : [loss = 1.395, top1 = 68.98%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.61 ms.
ImageNet16-120 train : [loss = 2.441, top1 = 37.44%], valid : [loss = 2.616, top1 = 33.47%], test : [loss = 2.635, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.36%], valid : [loss = 0.960, top1 = 66.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8499/15625) 008499-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.761, top1 = 84.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.45 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.582, top1 = 86.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.72 ms.
cifar100       train : [loss = 0.293, top1 = 92.29%], valid : [loss = 1.824, top1 = 59.34%], test : [loss = 1.834, top1 = 59.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.579, top1 = 35.48%], valid : [loss = 2.955, top1 = 28.33%], test : [loss = 2.991, top1 = 28.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.28%], valid : [loss = 0.935, top1 = 66.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8500/15625) 008500-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.546, top1 = 87.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10        train : [loss = 0.024, top1 = 99.32%], test  : [loss = 0.345, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.404, top1 = 88.35%], valid : [loss = 1.278, top1 = 66.48%], test : [loss = 1.279, top1 = 66.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.19%], valid : [loss = 2.404, top1 = 38.70%], test : [loss = 2.454, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8501/15625) 008501-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.59 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.92%], valid : [loss = 0.880, top1 = 71.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.22 ms.
cifar10        train : [loss = 0.567, top1 = 80.23%], test  : [loss = 0.732, top1 = 75.34%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.42 ms.
cifar100       train : [loss = 1.780, top1 = 52.16%], valid : [loss = 2.046, top1 = 47.30%], test : [loss = 2.044, top1 = 47.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.82 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.70%], valid : [loss = 3.627, top1 = 16.70%], test : [loss = 3.667, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8502/15625) 008502-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.575, top1 = 88.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.62%], test  : [loss = 0.372, top1 = 91.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.46 ms.
cifar100       train : [loss = 0.161, top1 = 96.02%], valid : [loss = 1.381, top1 = 68.34%], test : [loss = 1.352, top1 = 68.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 38.56%], valid : [loss = 2.520, top1 = 35.73%], test : [loss = 2.540, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.08%], valid : [loss = 0.971, top1 = 65.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8503/15625) 008503-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.93%], valid : [loss = 0.457, top1 = 86.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.143, top1 = 95.31%], test  : [loss = 0.337, top1 = 88.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.68 ms.
cifar100       train : [loss = 0.892, top1 = 74.45%], valid : [loss = 1.309, top1 = 63.08%], test : [loss = 1.284, top1 = 63.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.49%], valid : [loss = 2.624, top1 = 34.27%], test : [loss = 2.660, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.47%], valid : [loss = 0.769, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8504/15625) 008504-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.78%], valid : [loss = 0.582, top1 = 87.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.017, top1 = 99.50%], test  : [loss = 0.380, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 0.311, top1 = 91.26%], valid : [loss = 1.295, top1 = 67.66%], test : [loss = 1.310, top1 = 67.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.03%], valid : [loss = 2.453, top1 = 37.37%], test : [loss = 2.480, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.913, top1 = 67.06%], valid : [loss = 0.950, top1 = 66.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8505/15625) 008505-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.23%], valid : [loss = 0.583, top1 = 86.58%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10        train : [loss = 0.061, top1 = 97.97%], test  : [loss = 0.383, top1 = 90.00%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.97 ms.
cifar100       train : [loss = 0.666, top1 = 80.21%], valid : [loss = 1.306, top1 = 65.12%], test : [loss = 1.328, top1 = 64.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 39.92%], valid : [loss = 2.465, top1 = 37.67%], test : [loss = 2.513, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.08%], valid : [loss = 0.761, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8506/15625) 008506-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.500, top1 = 88.89%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.93 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.323, top1 = 92.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.12 ms.
cifar100       train : [loss = 0.325, top1 = 91.19%], valid : [loss = 1.295, top1 = 66.78%], test : [loss = 1.287, top1 = 67.25%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.10%], valid : [loss = 2.403, top1 = 38.98%], test : [loss = 2.400, top1 = 38.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.78%], valid : [loss = 0.651, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8507/15625) 008507-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.616, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.068, top1 = 97.94%], test  : [loss = 0.399, top1 = 89.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 0.714, top1 = 79.28%], valid : [loss = 1.388, top1 = 63.20%], test : [loss = 1.368, top1 = 63.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.19%], valid : [loss = 2.655, top1 = 33.82%], test : [loss = 2.685, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8508/15625) 008508-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.712, top1 = 84.84%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.95 ms.
cifar10        train : [loss = 0.033, top1 = 99.09%], test  : [loss = 0.435, top1 = 89.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.85 ms.
cifar100       train : [loss = 0.365, top1 = 90.11%], valid : [loss = 1.466, top1 = 63.86%], test : [loss = 1.484, top1 = 63.78%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.16%], valid : [loss = 2.625, top1 = 34.27%], test : [loss = 2.635, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.73%], valid : [loss = 0.783, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8509/15625) 008509-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.24%], valid : [loss = 0.529, top1 = 83.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.25 ms.
cifar10        train : [loss = 0.259, top1 = 91.17%], test  : [loss = 0.418, top1 = 86.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.05 ms.
cifar100       train : [loss = 1.443, top1 = 59.54%], valid : [loss = 1.693, top1 = 54.12%], test : [loss = 1.683, top1 = 54.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 2.987, top1 = 27.08%], valid : [loss = 2.989, top1 = 26.93%], test : [loss = 3.040, top1 = 26.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.996, top1 = 64.71%], valid : [loss = 1.020, top1 = 63.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8510/15625) 008510-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.24 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.527, top1 = 89.09%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.79 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.348, top1 = 92.59%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.26 ms.
cifar100       train : [loss = 0.117, top1 = 97.70%], valid : [loss = 1.367, top1 = 68.88%], test : [loss = 1.361, top1 = 69.04%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 41.75%], valid : [loss = 2.462, top1 = 36.57%], test : [loss = 2.447, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.97%], valid : [loss = 0.881, top1 = 68.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8511/15625) 008511-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.55%], valid : [loss = 0.817, top1 = 82.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.29 ms.
cifar10        train : [loss = 0.039, top1 = 98.86%], test  : [loss = 0.551, top1 = 87.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.331, top1 = 91.19%], valid : [loss = 1.881, top1 = 58.32%], test : [loss = 1.847, top1 = 58.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.89%], valid : [loss = 2.987, top1 = 27.67%], test : [loss = 3.033, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.93%], valid : [loss = 0.968, top1 = 65.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8512/15625) 008512-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.24%], valid : [loss = 0.554, top1 = 82.94%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.09 ms.
cifar10        train : [loss = 0.242, top1 = 91.70%], test  : [loss = 0.413, top1 = 86.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 1.330, top1 = 62.41%], valid : [loss = 1.625, top1 = 56.50%], test : [loss = 1.626, top1 = 56.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.801, top1 = 30.59%], valid : [loss = 2.805, top1 = 30.57%], test : [loss = 2.853, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.958, top1 = 65.32%], valid : [loss = 1.018, top1 = 64.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8513/15625) 008513-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.57%], valid : [loss = 0.658, top1 = 83.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.097, top1 = 96.86%], test  : [loss = 0.404, top1 = 88.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 0.795, top1 = 76.52%], valid : [loss = 1.425, top1 = 62.22%], test : [loss = 1.445, top1 = 61.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.24%], valid : [loss = 2.750, top1 = 31.57%], test : [loss = 2.755, top1 = 31.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.10%], valid : [loss = 0.833, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8514/15625) 008514-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.559, top1 = 89.03%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.01 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.353, top1 = 92.65%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.28 ms.
cifar100       train : [loss = 0.085, top1 = 98.57%], valid : [loss = 1.414, top1 = 68.16%], test : [loss = 1.387, top1 = 68.96%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.56%], valid : [loss = 2.318, top1 = 42.50%], test : [loss = 2.292, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.08%], valid : [loss = 0.631, top1 = 78.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8515/15625) 008515-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.588, top1 = 87.85%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.05 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.372, top1 = 91.55%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=20.01 ms.
cifar100       train : [loss = 0.138, top1 = 96.42%], valid : [loss = 1.439, top1 = 67.92%], test : [loss = 1.483, top1 = 67.32%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.09%], valid : [loss = 2.733, top1 = 31.17%], test : [loss = 2.763, top1 = 30.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.218, top1 = 55.28%], valid : [loss = 1.231, top1 = 55.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8516/15625) 008516-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.20%], valid : [loss = 0.569, top1 = 86.86%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.80 ms.
cifar10        train : [loss = 0.062, top1 = 98.01%], test  : [loss = 0.393, top1 = 89.78%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.64 ms.
cifar100       train : [loss = 0.658, top1 = 80.45%], valid : [loss = 1.327, top1 = 64.08%], test : [loss = 1.303, top1 = 65.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.15%], valid : [loss = 2.473, top1 = 37.70%], test : [loss = 2.513, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 73.87%], valid : [loss = 0.792, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8517/15625) 008517-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.92 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.43 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8518/15625) 008518-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.611, top1 = 87.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.08 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.372, top1 = 91.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.133, top1 = 97.28%], valid : [loss = 1.458, top1 = 67.46%], test : [loss = 1.417, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.46 ms.
ImageNet16-120 train : [loss = 1.929, top1 = 49.31%], valid : [loss = 2.473, top1 = 38.53%], test : [loss = 2.391, top1 = 41.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.86%], valid : [loss = 0.774, top1 = 73.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8519/15625) 008519-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.94 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8520/15625) 008520-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.16%], valid : [loss = 0.449, top1 = 87.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.114, top1 = 96.53%], test  : [loss = 0.329, top1 = 89.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.50 ms.
cifar100       train : [loss = 0.864, top1 = 75.51%], valid : [loss = 1.283, top1 = 64.28%], test : [loss = 1.272, top1 = 64.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.42%], valid : [loss = 2.616, top1 = 34.83%], test : [loss = 2.676, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8521/15625) 008521-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.59%], valid : [loss = 0.848, top1 = 72.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.42 ms.
cifar10        train : [loss = 0.553, top1 = 80.65%], test  : [loss = 0.715, top1 = 75.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 1.762, top1 = 52.52%], valid : [loss = 2.045, top1 = 46.74%], test : [loss = 2.063, top1 = 47.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.78%], valid : [loss = 3.638, top1 = 16.30%], test : [loss = 3.662, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8522/15625) 008522-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.537, top1 = 88.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10        train : [loss = 0.018, top1 = 99.48%], test  : [loss = 0.331, top1 = 91.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.236, top1 = 93.74%], valid : [loss = 1.319, top1 = 67.32%], test : [loss = 1.338, top1 = 67.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.416, top1 = 37.97%], valid : [loss = 2.551, top1 = 35.33%], test : [loss = 2.570, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.913, top1 = 67.06%], valid : [loss = 0.948, top1 = 66.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8523/15625) 008523-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=22.03 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.547, top1 = 87.91%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.57 ms.
cifar10        train : [loss = 0.038, top1 = 98.82%], test  : [loss = 0.378, top1 = 90.78%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.28 ms.
cifar100       train : [loss = 0.510, top1 = 85.38%], valid : [loss = 1.331, top1 = 65.04%], test : [loss = 1.325, top1 = 64.34%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 2.575, top1 = 34.48%], valid : [loss = 2.655, top1 = 32.20%], test : [loss = 2.658, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 68.05%], valid : [loss = 0.928, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8524/15625) 008524-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.563, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.15 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.366, top1 = 92.33%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.63 ms.
cifar100       train : [loss = 0.094, top1 = 98.05%], valid : [loss = 1.406, top1 = 68.22%], test : [loss = 1.403, top1 = 68.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 40.67%], valid : [loss = 2.503, top1 = 36.23%], test : [loss = 2.496, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.12%], valid : [loss = 0.923, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8525/15625) 008525-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.36%], valid : [loss = 0.465, top1 = 85.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.54 ms.
cifar10        train : [loss = 0.155, top1 = 94.98%], test  : [loss = 0.330, top1 = 89.32%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.29 ms.
cifar100       train : [loss = 0.994, top1 = 71.63%], valid : [loss = 1.352, top1 = 62.60%], test : [loss = 1.355, top1 = 61.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.50%], valid : [loss = 2.702, top1 = 32.23%], test : [loss = 2.703, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8526/15625) 008526-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.207, top1 = 93.08%], valid : [loss = 0.541, top1 = 83.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.205, top1 = 93.10%], test  : [loss = 0.401, top1 = 87.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.95 ms.
cifar100       train : [loss = 1.211, top1 = 65.50%], valid : [loss = 1.541, top1 = 57.78%], test : [loss = 1.532, top1 = 57.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 2.700, top1 = 32.58%], valid : [loss = 2.741, top1 = 31.03%], test : [loss = 2.782, top1 = 31.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8527/15625) 008527-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.04%], valid : [loss = 0.617, top1 = 84.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 0.104, top1 = 96.47%], test  : [loss = 0.434, top1 = 87.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.89 ms.
cifar100       train : [loss = 0.691, top1 = 79.71%], valid : [loss = 1.561, top1 = 60.30%], test : [loss = 1.566, top1 = 60.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 3.175, top1 = 22.42%], valid : [loss = 3.183, top1 = 22.67%], test : [loss = 3.227, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8528/15625) 008528-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.91 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.516, top1 = 89.26%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.05 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.341, top1 = 92.43%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.16 ms.
cifar100       train : [loss = 0.169, top1 = 96.04%], valid : [loss = 1.236, top1 = 70.62%], test : [loss = 1.268, top1 = 70.18%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.32 ms.
ImageNet16-120 train : [loss = 1.767, top1 = 52.98%], valid : [loss = 2.169, top1 = 44.03%], test : [loss = 2.198, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.10%], valid : [loss = 0.672, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8529/15625) 008529-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.421, top1 = 91.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.281, top1 = 93.64%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.02 ms.
cifar100       train : [loss = 0.051, top1 = 99.38%], valid : [loss = 1.366, top1 = 69.74%], test : [loss = 1.319, top1 = 70.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 1.481, top1 = 59.78%], valid : [loss = 2.293, top1 = 42.87%], test : [loss = 2.271, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.403, top1 = 86.30%], valid : [loss = 0.527, top1 = 82.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8530/15625) 008530-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.538, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.356, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.46 ms.
cifar100       train : [loss = 0.148, top1 = 96.76%], valid : [loss = 1.326, top1 = 68.45%], test : [loss = 1.322, top1 = 68.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.85%], valid : [loss = 2.292, top1 = 41.19%], test : [loss = 2.301, top1 = 41.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.36%], valid : [loss = 0.663, top1 = 77.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8531/15625) 008531-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.663, top1 = 86.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.75 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.442, top1 = 90.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 0.301, top1 = 91.89%], valid : [loss = 1.521, top1 = 63.50%], test : [loss = 1.508, top1 = 64.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 43.01%], valid : [loss = 2.540, top1 = 37.03%], test : [loss = 2.591, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.68%], valid : [loss = 0.821, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8532/15625) 008532-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.438, top1 = 90.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.27 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.300, top1 = 93.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 0.070, top1 = 98.90%], valid : [loss = 1.388, top1 = 69.62%], test : [loss = 1.384, top1 = 69.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 1.568, top1 = 57.74%], valid : [loss = 2.242, top1 = 44.40%], test : [loss = 2.293, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.66%], valid : [loss = 0.517, top1 = 82.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8533/15625) 008533-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.474, top1 = 89.12%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=15.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.20%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=13.25 ms.
cifar100       train : [loss = 0.323, top1 = 91.35%], valid : [loss = 1.234, top1 = 68.10%], test : [loss = 1.234, top1 = 68.23%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.74%], valid : [loss = 2.319, top1 = 40.40%], test : [loss = 2.343, top1 = 40.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8534/15625) 008534-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.500, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.72 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.319, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.87 ms.
cifar100       train : [loss = 0.243, top1 = 94.01%], valid : [loss = 1.238, top1 = 68.49%], test : [loss = 1.243, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.32%], valid : [loss = 2.275, top1 = 41.69%], test : [loss = 2.301, top1 = 41.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8535/15625) 008535-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.550, top1 = 88.52%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.74 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.322, top1 = 92.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.20 ms.
cifar100       train : [loss = 0.237, top1 = 93.84%], valid : [loss = 1.329, top1 = 68.22%], test : [loss = 1.304, top1 = 68.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.74%], valid : [loss = 2.252, top1 = 42.47%], test : [loss = 2.267, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.00%], valid : [loss = 0.641, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8536/15625) 008536-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.479, top1 = 89.59%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.307, top1 = 92.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.95 ms.
cifar100       train : [loss = 0.142, top1 = 97.13%], valid : [loss = 1.252, top1 = 69.75%], test : [loss = 1.262, top1 = 69.57%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 52.99%], valid : [loss = 2.207, top1 = 43.24%], test : [loss = 2.221, top1 = 43.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.89%], valid : [loss = 0.592, top1 = 79.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8537/15625) 008537-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.506, top1 = 88.72%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.337, top1 = 91.97%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.49 ms.
cifar100       train : [loss = 0.380, top1 = 89.38%], valid : [loss = 1.314, top1 = 66.48%], test : [loss = 1.300, top1 = 66.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.29%], valid : [loss = 2.422, top1 = 39.37%], test : [loss = 2.426, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8538/15625) 008538-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.478, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.60 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.339, top1 = 92.50%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.94 ms.
cifar100       train : [loss = 0.143, top1 = 97.05%], valid : [loss = 1.311, top1 = 68.70%], test : [loss = 1.312, top1 = 69.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.12%], valid : [loss = 2.229, top1 = 43.20%], test : [loss = 2.230, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.73%], valid : [loss = 0.635, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8539/15625) 008539-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.861, top1 = 82.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.042, top1 = 98.82%], test  : [loss = 0.580, top1 = 85.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 0.402, top1 = 89.06%], valid : [loss = 1.811, top1 = 58.82%], test : [loss = 1.821, top1 = 58.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.705, top1 = 32.72%], valid : [loss = 3.041, top1 = 27.17%], test : [loss = 3.064, top1 = 27.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.31%], valid : [loss = 0.918, top1 = 67.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8540/15625) 008540-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.29%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=14.10 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.330, top1 = 92.02%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=14.13 ms.
cifar100       train : [loss = 0.309, top1 = 91.60%], valid : [loss = 1.351, top1 = 66.90%], test : [loss = 1.330, top1 = 67.39%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=12.01 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.52%], valid : [loss = 2.362, top1 = 40.06%], test : [loss = 2.376, top1 = 40.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.77%], valid : [loss = 0.590, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8541/15625) 008541-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.491, top1 = 82.93%], valid : [loss = 0.637, top1 = 78.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.83 ms.
cifar10        train : [loss = 0.482, top1 = 83.33%], test  : [loss = 0.566, top1 = 80.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 1.674, top1 = 54.71%], valid : [loss = 1.850, top1 = 50.54%], test : [loss = 1.853, top1 = 51.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.23%], valid : [loss = 3.318, top1 = 21.57%], test : [loss = 3.341, top1 = 21.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8542/15625) 008542-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.31%], valid : [loss = 0.604, top1 = 85.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10        train : [loss = 0.073, top1 = 97.77%], test  : [loss = 0.394, top1 = 88.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 0.721, top1 = 78.94%], valid : [loss = 1.373, top1 = 63.59%], test : [loss = 1.355, top1 = 63.77%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.11%], valid : [loss = 2.650, top1 = 33.67%], test : [loss = 2.686, top1 = 33.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8543/15625) 008543-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 0.212, top1 = 92.84%], valid : [loss = 0.550, top1 = 83.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10        train : [loss = 0.199, top1 = 93.18%], test  : [loss = 0.389, top1 = 87.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.16 ms.
cifar100       train : [loss = 1.251, top1 = 64.44%], valid : [loss = 1.550, top1 = 57.16%], test : [loss = 1.561, top1 = 57.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.694, top1 = 32.65%], valid : [loss = 2.702, top1 = 32.23%], test : [loss = 2.747, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.46%], valid : [loss = 1.032, top1 = 63.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8544/15625) 008544-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.06%], valid : [loss = 0.731, top1 = 75.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.409, top1 = 85.61%], test  : [loss = 0.541, top1 = 81.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.15 ms.
cifar100       train : [loss = 1.673, top1 = 53.95%], valid : [loss = 1.893, top1 = 49.90%], test : [loss = 1.887, top1 = 49.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 3.313, top1 = 21.23%], valid : [loss = 3.339, top1 = 21.23%], test : [loss = 3.368, top1 = 20.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.206, top1 = 56.27%], valid : [loss = 1.251, top1 = 54.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8545/15625) 008545-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.58%], valid : [loss = 0.446, top1 = 86.59%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.90 ms.
cifar10        train : [loss = 0.147, top1 = 95.23%], test  : [loss = 0.338, top1 = 89.02%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.06 ms.
cifar100       train : [loss = 0.978, top1 = 72.31%], valid : [loss = 1.323, top1 = 63.06%], test : [loss = 1.328, top1 = 62.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.10%], valid : [loss = 2.687, top1 = 32.10%], test : [loss = 2.699, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 75.17%], valid : [loss = 0.769, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8546/15625) 008546-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.747, top1 = 84.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10        train : [loss = 0.024, top1 = 99.39%], test  : [loss = 0.505, top1 = 88.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.08 ms.
cifar100       train : [loss = 0.349, top1 = 90.79%], valid : [loss = 1.702, top1 = 60.52%], test : [loss = 1.669, top1 = 60.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.87%], valid : [loss = 2.854, top1 = 30.17%], test : [loss = 2.891, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.08%], valid : [loss = 0.883, top1 = 69.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8547/15625) 008547-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.421, top1 = 90.59%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.75 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.286, top1 = 93.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.95 ms.
cifar100       train : [loss = 0.173, top1 = 96.02%], valid : [loss = 1.343, top1 = 68.82%], test : [loss = 1.281, top1 = 69.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.08 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.84%], valid : [loss = 2.258, top1 = 42.93%], test : [loss = 2.285, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.19%], valid : [loss = 0.503, top1 = 83.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8548/15625) 008548-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.27%], valid : [loss = 0.458, top1 = 86.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.114, top1 = 96.46%], test  : [loss = 0.331, top1 = 89.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.46 ms.
cifar100       train : [loss = 0.864, top1 = 75.38%], valid : [loss = 1.292, top1 = 64.65%], test : [loss = 1.278, top1 = 64.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.54%], valid : [loss = 2.630, top1 = 33.98%], test : [loss = 2.665, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8549/15625) 008549-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.504, top1 = 89.78%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.63 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.285, top1 = 93.49%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.89 ms.
cifar100       train : [loss = 0.061, top1 = 99.19%], valid : [loss = 1.260, top1 = 71.28%], test : [loss = 1.308, top1 = 70.28%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.96 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 53.97%], valid : [loss = 2.256, top1 = 43.47%], test : [loss = 2.246, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 77.05%], valid : [loss = 0.720, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8550/15625) 008550-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.441, top1 = 89.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.321, top1 = 91.38%], valid : [loss = 1.320, top1 = 66.96%], test : [loss = 1.303, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.36%], valid : [loss = 2.351, top1 = 39.93%], test : [loss = 2.398, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.46%], valid : [loss = 0.555, top1 = 80.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8551/15625) 008551-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.05%], valid : [loss = 0.549, top1 = 86.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.12 ms.
cifar10        train : [loss = 0.078, top1 = 97.51%], test  : [loss = 0.369, top1 = 89.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.59 ms.
cifar100       train : [loss = 0.714, top1 = 78.64%], valid : [loss = 1.369, top1 = 63.98%], test : [loss = 1.382, top1 = 63.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.77%], valid : [loss = 2.662, top1 = 33.20%], test : [loss = 2.714, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8552/15625) 008552-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.74 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.86 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.87 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8553/15625) 008553-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.541, top1 = 88.86%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.348, top1 = 92.08%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.44 ms.
cifar100       train : [loss = 0.218, top1 = 94.45%], valid : [loss = 1.335, top1 = 67.90%], test : [loss = 1.319, top1 = 68.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.17 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.15%], valid : [loss = 2.234, top1 = 42.53%], test : [loss = 2.275, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.87%], valid : [loss = 0.765, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8554/15625) 008554-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.15 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.51%], valid : [loss = 0.561, top1 = 87.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10        train : [loss = 0.034, top1 = 98.93%], test  : [loss = 0.336, top1 = 91.27%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.97 ms.
cifar100       train : [loss = 0.421, top1 = 87.53%], valid : [loss = 1.252, top1 = 66.98%], test : [loss = 1.291, top1 = 66.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.206, top1 = 42.84%], valid : [loss = 2.386, top1 = 39.97%], test : [loss = 2.409, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.44%], valid : [loss = 0.948, top1 = 66.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8555/15625) 008555-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.83%], valid : [loss = 0.549, top1 = 83.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10        train : [loss = 0.217, top1 = 92.67%], test  : [loss = 0.404, top1 = 87.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.31 ms.
cifar100       train : [loss = 1.298, top1 = 63.12%], valid : [loss = 1.572, top1 = 57.46%], test : [loss = 1.591, top1 = 56.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.746, top1 = 31.70%], valid : [loss = 2.756, top1 = 31.60%], test : [loss = 2.813, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 65.80%], valid : [loss = 0.992, top1 = 64.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8556/15625) 008556-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.40%], valid : [loss = 0.721, top1 = 82.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.76 ms.
cifar10        train : [loss = 0.116, top1 = 96.18%], test  : [loss = 0.461, top1 = 86.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 0.885, top1 = 74.44%], valid : [loss = 1.551, top1 = 59.50%], test : [loss = 1.515, top1 = 59.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.708, top1 = 32.42%], valid : [loss = 2.823, top1 = 30.37%], test : [loss = 2.855, top1 = 30.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.79%], valid : [loss = 0.960, top1 = 66.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8557/15625) 008557-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.465, top1 = 89.53%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=19.09 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.301, top1 = 92.81%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=18.75 ms.
cifar100       train : [loss = 0.167, top1 = 96.35%], valid : [loss = 1.284, top1 = 69.02%], test : [loss = 1.275, top1 = 69.07%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 1.809, top1 = 51.92%], valid : [loss = 2.239, top1 = 42.58%], test : [loss = 2.255, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.19%], valid : [loss = 0.596, top1 = 79.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8558/15625) 008558-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.04%], valid : [loss = 0.529, top1 = 84.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.178, top1 = 94.03%], test  : [loss = 0.385, top1 = 87.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 1.209, top1 = 65.75%], valid : [loss = 1.523, top1 = 58.01%], test : [loss = 1.511, top1 = 58.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.95%], valid : [loss = 2.678, top1 = 33.34%], test : [loss = 2.725, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.96%], valid : [loss = 0.960, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8559/15625) 008559-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.612, top1 = 86.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.405, top1 = 90.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.12 ms.
cifar100       train : [loss = 0.493, top1 = 85.70%], valid : [loss = 1.418, top1 = 64.01%], test : [loss = 1.379, top1 = 64.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.28%], valid : [loss = 2.546, top1 = 35.54%], test : [loss = 2.568, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.11%], valid : [loss = 0.831, top1 = 70.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8560/15625) 008560-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.583, top1 = 88.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.398, top1 = 91.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.08 ms.
cifar100       train : [loss = 0.117, top1 = 97.78%], valid : [loss = 1.522, top1 = 66.14%], test : [loss = 1.499, top1 = 66.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.69%], valid : [loss = 2.427, top1 = 39.40%], test : [loss = 2.483, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.96%], valid : [loss = 0.786, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8561/15625) 008561-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.549, top1 = 89.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.319, top1 = 92.96%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.11 ms.
cifar100       train : [loss = 0.114, top1 = 97.75%], valid : [loss = 1.316, top1 = 69.78%], test : [loss = 1.322, top1 = 68.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.75 ms.
ImageNet16-120 train : [loss = 1.787, top1 = 52.44%], valid : [loss = 2.224, top1 = 42.63%], test : [loss = 2.261, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.08%], valid : [loss = 0.744, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8562/15625) 008562-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.31%], valid : [loss = 0.577, top1 = 81.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.235, top1 = 92.04%], test  : [loss = 0.386, top1 = 87.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.53 ms.
cifar100       train : [loss = 1.295, top1 = 63.51%], valid : [loss = 1.556, top1 = 57.36%], test : [loss = 1.534, top1 = 58.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.867, top1 = 29.33%], valid : [loss = 2.868, top1 = 30.53%], test : [loss = 2.929, top1 = 28.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8563/15625) 008563-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.82%], valid : [loss = 0.843, top1 = 80.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10        train : [loss = 0.132, top1 = 95.54%], test  : [loss = 0.531, top1 = 85.40%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.50 ms.
cifar100       train : [loss = 0.849, top1 = 75.45%], valid : [loss = 1.686, top1 = 56.42%], test : [loss = 1.680, top1 = 56.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.39%], valid : [loss = 3.167, top1 = 23.67%], test : [loss = 3.205, top1 = 24.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.059, top1 = 61.74%], valid : [loss = 1.121, top1 = 59.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8564/15625) 008564-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.30%], valid : [loss = 0.638, top1 = 85.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10        train : [loss = 0.075, top1 = 97.71%], test  : [loss = 0.376, top1 = 89.31%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.83 ms.
cifar100       train : [loss = 0.712, top1 = 79.30%], valid : [loss = 1.390, top1 = 63.16%], test : [loss = 1.343, top1 = 64.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.52%], valid : [loss = 2.664, top1 = 34.40%], test : [loss = 2.674, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.28%], valid : [loss = 0.765, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8565/15625) 008565-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.512, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.328, top1 = 92.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.92 ms.
cifar100       train : [loss = 0.275, top1 = 92.47%], valid : [loss = 1.285, top1 = 67.50%], test : [loss = 1.267, top1 = 68.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.51 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.72%], valid : [loss = 2.296, top1 = 40.53%], test : [loss = 2.272, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.11%], valid : [loss = 0.741, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8566/15625) 008566-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.446, top1 = 90.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.302, top1 = 93.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.86 ms.
cifar100       train : [loss = 0.082, top1 = 98.60%], valid : [loss = 1.367, top1 = 69.46%], test : [loss = 1.369, top1 = 69.61%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 1.582, top1 = 57.47%], valid : [loss = 2.272, top1 = 43.47%], test : [loss = 2.293, top1 = 43.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.15%], valid : [loss = 0.497, top1 = 83.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8567/15625) 008567-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.553, top1 = 88.68%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.43 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.367, top1 = 92.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.08 ms.
cifar100       train : [loss = 0.104, top1 = 98.15%], valid : [loss = 1.424, top1 = 68.16%], test : [loss = 1.398, top1 = 68.42%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.97 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.26%], valid : [loss = 2.422, top1 = 38.40%], test : [loss = 2.429, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.35%], valid : [loss = 0.711, top1 = 75.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8568/15625) 008568-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.476, top1 = 89.48%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.96 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.335, top1 = 92.16%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.18 ms.
cifar100       train : [loss = 0.186, top1 = 95.64%], valid : [loss = 1.332, top1 = 67.80%], test : [loss = 1.307, top1 = 69.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.28%], valid : [loss = 2.302, top1 = 42.47%], test : [loss = 2.303, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.474, top1 = 83.31%], valid : [loss = 0.571, top1 = 80.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8569/15625) 008569-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.513, top1 = 88.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.337, top1 = 92.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=21.46 ms.
cifar100       train : [loss = 0.340, top1 = 90.67%], valid : [loss = 1.293, top1 = 67.28%], test : [loss = 1.276, top1 = 68.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.66%], valid : [loss = 2.419, top1 = 39.27%], test : [loss = 2.417, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8570/15625) 008570-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.101, top1 = 96.86%], valid : [loss = 0.885, top1 = 78.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.160, top1 = 94.50%], test  : [loss = 0.503, top1 = 84.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.31 ms.
cifar100       train : [loss = 0.993, top1 = 71.44%], valid : [loss = 1.702, top1 = 55.48%], test : [loss = 1.662, top1 = 56.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.833, top1 = 29.90%], valid : [loss = 2.961, top1 = 27.30%], test : [loss = 3.011, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.26%], valid : [loss = 0.981, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8571/15625) 008571-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.345, top1 = 87.99%], valid : [loss = 0.633, top1 = 79.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.281, top1 = 90.37%], test  : [loss = 0.449, top1 = 85.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 1.405, top1 = 60.55%], valid : [loss = 1.719, top1 = 53.54%], test : [loss = 1.718, top1 = 54.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.962, top1 = 27.72%], valid : [loss = 2.976, top1 = 26.83%], test : [loss = 3.065, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.152, top1 = 58.27%], valid : [loss = 1.195, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8572/15625) 008572-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.442, top1 = 90.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.32 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.288, top1 = 93.67%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.25 ms.
cifar100       train : [loss = 0.052, top1 = 99.46%], valid : [loss = 1.294, top1 = 71.32%], test : [loss = 1.246, top1 = 71.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.01 ms.
ImageNet16-120 train : [loss = 1.407, top1 = 61.66%], valid : [loss = 2.203, top1 = 45.80%], test : [loss = 2.228, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.334, top1 = 88.62%], valid : [loss = 0.470, top1 = 84.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8573/15625) 008573-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.454, top1 = 86.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.111, top1 = 96.57%], test  : [loss = 0.330, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.870, top1 = 75.21%], valid : [loss = 1.302, top1 = 63.48%], test : [loss = 1.280, top1 = 64.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.62%], valid : [loss = 2.635, top1 = 33.90%], test : [loss = 2.653, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8574/15625) 008574-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.16%], valid : [loss = 0.479, top1 = 84.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10        train : [loss = 0.303, top1 = 89.91%], test  : [loss = 0.407, top1 = 86.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.58 ms.
cifar100       train : [loss = 1.337, top1 = 62.96%], valid : [loss = 1.549, top1 = 57.04%], test : [loss = 1.515, top1 = 58.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.24 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.57%], valid : [loss = 2.907, top1 = 29.27%], test : [loss = 2.961, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8575/15625) 008575-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.638, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.398, top1 = 91.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.34 ms.
cifar100       train : [loss = 0.199, top1 = 95.33%], valid : [loss = 1.445, top1 = 66.12%], test : [loss = 1.451, top1 = 66.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.17%], valid : [loss = 2.461, top1 = 38.60%], test : [loss = 2.485, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 73.88%], valid : [loss = 0.790, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8576/15625) 008576-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.77 ms.
cifar10-valid  train : [loss = 0.260, top1 = 91.06%], valid : [loss = 0.867, top1 = 75.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.316, top1 = 89.04%], test  : [loss = 0.618, top1 = 80.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.402, top1 = 60.87%], valid : [loss = 1.915, top1 = 50.40%], test : [loss = 1.956, top1 = 49.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 3.485, top1 = 17.64%], valid : [loss = 3.529, top1 = 17.00%], test : [loss = 3.520, top1 = 17.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8577/15625) 008577-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.32%], valid : [loss = 0.591, top1 = 86.88%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.59 ms.
cifar10        train : [loss = 0.043, top1 = 98.61%], test  : [loss = 0.373, top1 = 90.26%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.14 ms.
cifar100       train : [loss = 0.465, top1 = 86.40%], valid : [loss = 1.310, top1 = 66.48%], test : [loss = 1.325, top1 = 65.32%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.75%], valid : [loss = 2.349, top1 = 39.83%], test : [loss = 2.361, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.55%], valid : [loss = 0.824, top1 = 71.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8578/15625) 008578-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.97 ms.
cifar10-valid  train : [loss = 0.726, top1 = 73.93%], valid : [loss = 0.817, top1 = 71.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10        train : [loss = 0.688, top1 = 76.07%], test  : [loss = 0.719, top1 = 75.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.72 ms.
cifar100       train : [loss = 2.095, top1 = 44.60%], valid : [loss = 2.241, top1 = 41.20%], test : [loss = 2.228, top1 = 42.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 3.443, top1 = 18.80%], valid : [loss = 3.448, top1 = 19.43%], test : [loss = 3.459, top1 = 18.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.456, top1 = 46.79%], valid : [loss = 1.514, top1 = 44.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8579/15625) 008579-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.39 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.475, top1 = 84.37%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10        train : [loss = 0.305, top1 = 89.83%], test  : [loss = 0.416, top1 = 85.85%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.48 ms.
cifar100       train : [loss = 1.337, top1 = 63.08%], valid : [loss = 1.550, top1 = 57.72%], test : [loss = 1.532, top1 = 57.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.63%], valid : [loss = 2.905, top1 = 29.93%], test : [loss = 2.945, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8580/15625) 008580-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.34 ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.94%], valid : [loss = 0.879, top1 = 69.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.670, top1 = 76.49%], test  : [loss = 0.760, top1 = 73.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.57 ms.
cifar100       train : [loss = 1.978, top1 = 47.38%], valid : [loss = 2.148, top1 = 44.20%], test : [loss = 2.177, top1 = 43.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 3.660, top1 = 15.55%], valid : [loss = 3.673, top1 = 16.02%], test : [loss = 3.702, top1 = 14.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8581/15625) 008581-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.567, top1 = 88.22%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.365, top1 = 91.94%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.92 ms.
cifar100       train : [loss = 0.121, top1 = 97.30%], valid : [loss = 1.388, top1 = 68.66%], test : [loss = 1.393, top1 = 68.77%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 34.16%], valid : [loss = 2.751, top1 = 30.92%], test : [loss = 2.757, top1 = 31.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.004, top1 = 63.51%], valid : [loss = 1.041, top1 = 62.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8582/15625) 008582-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.73 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8583/15625) 008583-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.458, top1 = 89.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.315, top1 = 92.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.218, top1 = 94.74%], valid : [loss = 1.333, top1 = 67.48%], test : [loss = 1.322, top1 = 68.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.67%], valid : [loss = 2.274, top1 = 42.72%], test : [loss = 2.334, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.18%], valid : [loss = 0.540, top1 = 81.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8584/15625) 008584-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.25%], valid : [loss = 0.454, top1 = 86.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.111, top1 = 96.63%], test  : [loss = 0.330, top1 = 89.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 0.877, top1 = 75.12%], valid : [loss = 1.301, top1 = 64.04%], test : [loss = 1.294, top1 = 63.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.61%], valid : [loss = 2.621, top1 = 34.06%], test : [loss = 2.653, top1 = 34.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8585/15625) 008585-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.64%], valid : [loss = 0.604, top1 = 87.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.64 ms.
cifar10        train : [loss = 0.021, top1 = 99.38%], test  : [loss = 0.388, top1 = 90.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.27 ms.
cifar100       train : [loss = 0.387, top1 = 88.95%], valid : [loss = 1.471, top1 = 63.80%], test : [loss = 1.480, top1 = 63.81%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.736, top1 = 30.74%], valid : [loss = 2.819, top1 = 28.93%], test : [loss = 2.826, top1 = 28.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8586/15625) 008586-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.479, top1 = 89.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.312, top1 = 92.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.16 ms.
cifar100       train : [loss = 0.261, top1 = 93.17%], valid : [loss = 1.222, top1 = 68.75%], test : [loss = 1.250, top1 = 68.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.13%], valid : [loss = 2.204, top1 = 43.15%], test : [loss = 2.227, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.47%], valid : [loss = 0.649, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8587/15625) 008587-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.564, top1 = 87.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.388, top1 = 90.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.31 ms.
cifar100       train : [loss = 0.386, top1 = 89.10%], valid : [loss = 1.401, top1 = 65.89%], test : [loss = 1.396, top1 = 65.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.98%], valid : [loss = 2.510, top1 = 36.65%], test : [loss = 2.511, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8588/15625) 008588-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.76%], valid : [loss = 0.456, top1 = 86.39%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.95 ms.
cifar10        train : [loss = 0.151, top1 = 95.07%], test  : [loss = 0.340, top1 = 88.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.01 ms.
cifar100       train : [loss = 0.984, top1 = 72.02%], valid : [loss = 1.330, top1 = 63.01%], test : [loss = 1.347, top1 = 62.13%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.609, top1 = 34.32%], valid : [loss = 2.651, top1 = 33.18%], test : [loss = 2.678, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.755, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8589/15625) 008589-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 16.96 M, Params=0.139 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.70%], valid : [loss = 0.452, top1 = 86.39%]
cifar10        FLOP= 16.96 M, Params=0.139 MB, latency=15.19 ms.
cifar10        train : [loss = 0.149, top1 = 95.07%], test  : [loss = 0.332, top1 = 89.19%]
cifar100       FLOP= 16.96 M, Params=0.144 MB, latency=14.19 ms.
cifar100       train : [loss = 0.969, top1 = 72.37%], valid : [loss = 1.346, top1 = 62.58%], test : [loss = 1.332, top1 = 62.54%]
ImageNet16-120 FLOP=  4.25 M, Params=0.146 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.47%], valid : [loss = 2.668, top1 = 33.16%], test : [loss = 2.695, top1 = 32.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8590/15625) 008590-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.529, top1 = 89.72%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.334, top1 = 93.15%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.61 ms.
cifar100       train : [loss = 0.070, top1 = 98.87%], valid : [loss = 1.357, top1 = 69.66%], test : [loss = 1.367, top1 = 69.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.66 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.46%], valid : [loss = 2.192, top1 = 44.22%], test : [loss = 2.232, top1 = 43.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.84%], valid : [loss = 0.608, top1 = 79.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8591/15625) 008591-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.596, top1 = 87.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.382, top1 = 91.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.195, top1 = 95.50%], valid : [loss = 1.474, top1 = 66.40%], test : [loss = 1.435, top1 = 66.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.50%], valid : [loss = 2.464, top1 = 38.35%], test : [loss = 2.466, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.30%], valid : [loss = 0.695, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8592/15625) 008592-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.411, top1 = 90.69%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.270, top1 = 93.75%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.97 ms.
cifar100       train : [loss = 0.112, top1 = 97.93%], valid : [loss = 1.247, top1 = 70.92%], test : [loss = 1.269, top1 = 70.61%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 1.636, top1 = 56.00%], valid : [loss = 2.170, top1 = 44.90%], test : [loss = 2.202, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.12%], valid : [loss = 0.501, top1 = 83.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8593/15625) 008593-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.458, top1 = 89.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.313, top1 = 92.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 0.324, top1 = 91.10%], valid : [loss = 1.299, top1 = 67.39%], test : [loss = 1.337, top1 = 66.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.10%], valid : [loss = 2.360, top1 = 40.33%], test : [loss = 2.409, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.446, top1 = 84.50%], valid : [loss = 0.547, top1 = 81.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8594/15625) 008594-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.601, top1 = 87.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.372, top1 = 91.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.60 ms.
cifar100       train : [loss = 0.148, top1 = 96.76%], valid : [loss = 1.542, top1 = 65.81%], test : [loss = 1.521, top1 = 65.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.86%], valid : [loss = 2.536, top1 = 36.77%], test : [loss = 2.555, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.18%], valid : [loss = 0.740, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8595/15625) 008595-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.545, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.347, top1 = 91.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 0.327, top1 = 91.06%], valid : [loss = 1.288, top1 = 67.18%], test : [loss = 1.298, top1 = 67.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.56%], valid : [loss = 2.408, top1 = 39.05%], test : [loss = 2.443, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.41%], valid : [loss = 0.803, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8596/15625) 008596-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.34 ms.
cifar10-valid  train : [loss = 0.682, top1 = 76.00%], valid : [loss = 0.859, top1 = 70.81%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 0.680, top1 = 76.22%], test  : [loss = 0.765, top1 = 73.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.34 ms.
cifar100       train : [loss = 1.980, top1 = 47.32%], valid : [loss = 2.152, top1 = 44.43%], test : [loss = 2.174, top1 = 44.13%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.13 ms.
ImageNet16-120 train : [loss = 3.643, top1 = 15.87%], valid : [loss = 3.665, top1 = 15.71%], test : [loss = 3.686, top1 = 15.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8597/15625) 008597-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.06%], valid : [loss = 0.750, top1 = 74.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10        train : [loss = 0.452, top1 = 84.25%], test  : [loss = 0.589, top1 = 80.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 1.788, top1 = 51.31%], valid : [loss = 1.989, top1 = 47.46%], test : [loss = 1.970, top1 = 48.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 3.431, top1 = 19.12%], valid : [loss = 3.439, top1 = 19.12%], test : [loss = 3.467, top1 = 18.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.222, top1 = 55.74%], valid : [loss = 1.263, top1 = 54.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8598/15625) 008598-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.531, top1 = 89.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.344, top1 = 92.47%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.30 ms.
cifar100       train : [loss = 0.150, top1 = 96.72%], valid : [loss = 1.333, top1 = 68.49%], test : [loss = 1.317, top1 = 68.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.40%], valid : [loss = 2.307, top1 = 41.80%], test : [loss = 2.298, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.15%], valid : [loss = 0.725, top1 = 74.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8599/15625) 008599-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.70%], valid : [loss = 0.613, top1 = 87.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10        train : [loss = 0.019, top1 = 99.47%], test  : [loss = 0.397, top1 = 91.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.46 ms.
cifar100       train : [loss = 0.359, top1 = 89.86%], valid : [loss = 1.510, top1 = 63.10%], test : [loss = 1.496, top1 = 63.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 24.95%], valid : [loss = 3.045, top1 = 24.65%], test : [loss = 3.068, top1 = 23.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8600/15625) 008600-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.375, top1 = 87.01%], valid : [loss = 0.631, top1 = 79.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.291, top1 = 90.06%], test  : [loss = 0.441, top1 = 85.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.17 ms.
cifar100       train : [loss = 1.563, top1 = 56.55%], valid : [loss = 1.791, top1 = 51.47%], test : [loss = 1.781, top1 = 51.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 3.092, top1 = 25.00%], valid : [loss = 3.092, top1 = 25.34%], test : [loss = 3.162, top1 = 23.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.93%], valid : [loss = 1.015, top1 = 63.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8601/15625) 008601-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.419, top1 = 90.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.294, top1 = 93.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.78 ms.
cifar100       train : [loss = 0.117, top1 = 97.76%], valid : [loss = 1.314, top1 = 69.45%], test : [loss = 1.287, top1 = 69.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 1.700, top1 = 54.47%], valid : [loss = 2.239, top1 = 43.17%], test : [loss = 2.236, top1 = 43.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.51%], valid : [loss = 0.545, top1 = 81.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8602/15625) 008602-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.531, top1 = 87.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.17 ms.
cifar10        train : [loss = 0.026, top1 = 99.31%], test  : [loss = 0.372, top1 = 90.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.457, top1 = 86.64%], valid : [loss = 1.363, top1 = 65.79%], test : [loss = 1.338, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.43%], valid : [loss = 2.495, top1 = 36.72%], test : [loss = 2.510, top1 = 37.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.43%], valid : [loss = 0.668, top1 = 77.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8603/15625) 008603-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.25%], valid : [loss = 0.606, top1 = 85.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.074, top1 = 97.69%], test  : [loss = 0.395, top1 = 88.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.79 ms.
cifar100       train : [loss = 0.718, top1 = 79.05%], valid : [loss = 1.391, top1 = 63.07%], test : [loss = 1.393, top1 = 63.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.76%], valid : [loss = 2.686, top1 = 33.05%], test : [loss = 2.696, top1 = 33.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8604/15625) 008604-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.86 ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.60%], valid : [loss = 0.525, top1 = 82.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.68 ms.
cifar10        train : [loss = 0.393, top1 = 86.52%], test  : [loss = 0.463, top1 = 84.32%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.75 ms.
cifar100       train : [loss = 1.543, top1 = 57.57%], valid : [loss = 1.666, top1 = 54.56%], test : [loss = 1.660, top1 = 55.07%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.30 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.41%], valid : [loss = 3.006, top1 = 27.14%], test : [loss = 3.057, top1 = 25.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8605/15625) 008605-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.86 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.31%], valid : [loss = 0.551, top1 = 82.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10        train : [loss = 0.233, top1 = 92.03%], test  : [loss = 0.406, top1 = 86.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.24 ms.
cifar100       train : [loss = 1.296, top1 = 63.01%], valid : [loss = 1.599, top1 = 56.38%], test : [loss = 1.607, top1 = 56.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.741, top1 = 31.80%], valid : [loss = 2.760, top1 = 32.00%], test : [loss = 2.814, top1 = 30.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.51%], valid : [loss = 0.983, top1 = 65.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8606/15625) 008606-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.75 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.436, top1 = 90.99%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.36 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.294, top1 = 93.66%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.11 ms.
cifar100       train : [loss = 0.068, top1 = 98.96%], valid : [loss = 1.321, top1 = 70.93%], test : [loss = 1.328, top1 = 70.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 1.553, top1 = 58.03%], valid : [loss = 2.272, top1 = 42.65%], test : [loss = 2.261, top1 = 43.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.90%], valid : [loss = 0.500, top1 = 83.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8607/15625) 008607-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.571, top1 = 87.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.021, top1 = 99.44%], test  : [loss = 0.381, top1 = 91.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.79 ms.
cifar100       train : [loss = 0.273, top1 = 92.47%], valid : [loss = 1.328, top1 = 67.78%], test : [loss = 1.367, top1 = 67.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 2.409, top1 = 38.36%], valid : [loss = 2.571, top1 = 34.97%], test : [loss = 2.564, top1 = 35.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.82%], valid : [loss = 0.910, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8608/15625) 008608-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.144, top1 = 95.39%], valid : [loss = 0.567, top1 = 84.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10        train : [loss = 0.201, top1 = 93.09%], test  : [loss = 0.407, top1 = 87.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.16 ms.
cifar100       train : [loss = 1.050, top1 = 69.63%], valid : [loss = 1.466, top1 = 60.14%], test : [loss = 1.475, top1 = 60.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.768, top1 = 31.12%], valid : [loss = 2.794, top1 = 30.77%], test : [loss = 2.843, top1 = 29.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.39%], valid : [loss = 1.031, top1 = 63.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8609/15625) 008609-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.495, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.93 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.331, top1 = 91.95%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.41 ms.
cifar100       train : [loss = 0.241, top1 = 94.06%], valid : [loss = 1.240, top1 = 68.55%], test : [loss = 1.263, top1 = 69.32%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.00 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.24%], valid : [loss = 2.293, top1 = 41.92%], test : [loss = 2.290, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.42%], valid : [loss = 0.655, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8610/15625) 008610-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.426, top1 = 91.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.288, top1 = 93.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.71 ms.
cifar100       train : [loss = 0.061, top1 = 99.13%], valid : [loss = 1.314, top1 = 71.14%], test : [loss = 1.311, top1 = 71.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 1.518, top1 = 58.90%], valid : [loss = 2.237, top1 = 43.87%], test : [loss = 2.270, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.59%], valid : [loss = 0.486, top1 = 83.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8611/15625) 008611-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.478, top1 = 89.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.295, top1 = 93.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.54 ms.
cifar100       train : [loss = 0.146, top1 = 97.05%], valid : [loss = 1.255, top1 = 69.37%], test : [loss = 1.276, top1 = 69.37%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 1.751, top1 = 53.32%], valid : [loss = 2.168, top1 = 44.35%], test : [loss = 2.194, top1 = 44.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.52%], valid : [loss = 0.600, top1 = 79.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8612/15625) 008612-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.582, top1 = 87.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.392, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.349, top1 = 90.18%], valid : [loss = 1.406, top1 = 65.48%], test : [loss = 1.412, top1 = 66.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.217, top1 = 42.79%], valid : [loss = 2.449, top1 = 38.22%], test : [loss = 2.477, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.21%], valid : [loss = 0.774, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8613/15625) 008613-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10-valid  train : [loss = 1.181, top1 = 57.65%], valid : [loss = 1.225, top1 = 56.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10        train : [loss = 1.142, top1 = 59.46%], test  : [loss = 1.144, top1 = 59.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.48 ms.
cifar100       train : [loss = 2.669, top1 = 32.88%], valid : [loss = 2.742, top1 = 31.58%], test : [loss = 2.728, top1 = 32.20%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.80 ms.
ImageNet16-120 train : [loss = 3.832, top1 = 12.93%], valid : [loss = 3.818, top1 = 13.66%], test : [loss = 3.835, top1 = 13.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.672, top1 = 37.49%], valid : [loss = 1.732, top1 = 34.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8614/15625) 008614-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.19 ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.99%], valid : [loss = 1.241, top1 = 55.80%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10        train : [loss = 1.145, top1 = 59.18%], test  : [loss = 1.148, top1 = 58.78%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.65 ms.
cifar100       train : [loss = 2.710, top1 = 32.25%], valid : [loss = 2.791, top1 = 31.30%], test : [loss = 2.771, top1 = 31.15%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.46 ms.
ImageNet16-120 train : [loss = 3.866, top1 = 12.41%], valid : [loss = 3.866, top1 = 12.96%], test : [loss = 3.879, top1 = 12.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8615/15625) 008615-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.447, top1 = 89.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.304, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.50 ms.
cifar100       train : [loss = 0.194, top1 = 95.50%], valid : [loss = 1.291, top1 = 68.83%], test : [loss = 1.298, top1 = 68.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.50%], valid : [loss = 2.268, top1 = 42.73%], test : [loss = 2.268, top1 = 43.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.451, top1 = 84.08%], valid : [loss = 0.561, top1 = 81.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8616/15625) 008616-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.553, top1 = 89.09%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.341, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.08 ms.
cifar100       train : [loss = 0.089, top1 = 98.27%], valid : [loss = 1.363, top1 = 69.20%], test : [loss = 1.382, top1 = 69.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.95 ms.
ImageNet16-120 train : [loss = 2.024, top1 = 46.83%], valid : [loss = 2.355, top1 = 40.10%], test : [loss = 2.346, top1 = 40.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.54%], valid : [loss = 0.937, top1 = 66.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8617/15625) 008617-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.489, top1 = 88.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.320, top1 = 91.36%], valid : [loss = 1.249, top1 = 67.91%], test : [loss = 1.266, top1 = 67.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.89%], valid : [loss = 2.306, top1 = 40.94%], test : [loss = 2.350, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.34%], valid : [loss = 0.562, top1 = 80.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8618/15625) 008618-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.531, top1 = 89.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.339, top1 = 93.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.107, top1 = 97.83%], valid : [loss = 1.408, top1 = 68.85%], test : [loss = 1.396, top1 = 68.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.29%], valid : [loss = 2.283, top1 = 41.90%], test : [loss = 2.278, top1 = 42.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.34%], valid : [loss = 0.651, top1 = 77.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8619/15625) 008619-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.533, top1 = 89.32%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.62 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.352, top1 = 92.88%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.64 ms.
cifar100       train : [loss = 0.076, top1 = 98.57%], valid : [loss = 1.460, top1 = 68.66%], test : [loss = 1.451, top1 = 69.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.014, top1 = 47.14%], valid : [loss = 2.347, top1 = 40.18%], test : [loss = 2.329, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.22%], valid : [loss = 0.890, top1 = 68.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8620/15625) 008620-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.148, top1 = 95.31%], valid : [loss = 0.538, top1 = 84.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.154, top1 = 94.89%], test  : [loss = 0.377, top1 = 88.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.93 ms.
cifar100       train : [loss = 1.151, top1 = 67.13%], valid : [loss = 1.491, top1 = 59.11%], test : [loss = 1.484, top1 = 58.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.572, top1 = 35.21%], valid : [loss = 2.656, top1 = 33.61%], test : [loss = 2.674, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.66%], valid : [loss = 0.945, top1 = 66.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8621/15625) 008621-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.416, top1 = 91.42%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.92 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.274, top1 = 93.80%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.85 ms.
cifar100       train : [loss = 0.030, top1 = 99.74%], valid : [loss = 1.274, top1 = 72.35%], test : [loss = 1.271, top1 = 72.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.28 ms.
ImageNet16-120 train : [loss = 1.266, top1 = 65.29%], valid : [loss = 2.234, top1 = 45.30%], test : [loss = 2.229, top1 = 46.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.314, top1 = 89.20%], valid : [loss = 0.464, top1 = 84.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8622/15625) 008622-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.21%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.14 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.318, top1 = 92.69%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.46 ms.
cifar100       train : [loss = 0.166, top1 = 96.44%], valid : [loss = 1.340, top1 = 68.19%], test : [loss = 1.310, top1 = 68.74%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.91 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.20%], valid : [loss = 2.309, top1 = 40.80%], test : [loss = 2.307, top1 = 41.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.25%], valid : [loss = 0.686, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8623/15625) 008623-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.565, top1 = 88.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.371, top1 = 92.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.176, top1 = 96.16%], valid : [loss = 1.477, top1 = 66.31%], test : [loss = 1.453, top1 = 66.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 2.003, top1 = 47.52%], valid : [loss = 2.457, top1 = 38.53%], test : [loss = 2.480, top1 = 38.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.52%], valid : [loss = 0.715, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8624/15625) 008624-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.96%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.80 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.332, top1 = 93.03%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.02 ms.
cifar100       train : [loss = 0.103, top1 = 98.05%], valid : [loss = 1.375, top1 = 68.96%], test : [loss = 1.351, top1 = 69.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 1.696, top1 = 54.54%], valid : [loss = 2.174, top1 = 43.87%], test : [loss = 2.213, top1 = 43.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 77.00%], valid : [loss = 0.714, top1 = 75.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8625/15625) 008625-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=20.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.459, top1 = 90.23%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=25.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.298, top1 = 93.28%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=22.12 ms.
cifar100       train : [loss = 0.094, top1 = 98.40%], valid : [loss = 1.256, top1 = 70.36%], test : [loss = 1.236, top1 = 71.01%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 1.697, top1 = 54.58%], valid : [loss = 2.138, top1 = 45.48%], test : [loss = 2.158, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.61%], valid : [loss = 0.649, top1 = 77.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8626/15625) 008626-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.589, top1 = 87.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.40 ms.
cifar10        train : [loss = 0.017, top1 = 99.50%], test  : [loss = 0.399, top1 = 90.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.99 ms.
cifar100       train : [loss = 0.365, top1 = 89.74%], valid : [loss = 1.479, top1 = 63.73%], test : [loss = 1.469, top1 = 64.07%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.970, top1 = 26.12%], valid : [loss = 3.020, top1 = 25.02%], test : [loss = 3.028, top1 = 25.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8627/15625) 008627-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.82 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.478, top1 = 89.48%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.68 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.290, top1 = 93.00%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.82 ms.
cifar100       train : [loss = 0.273, top1 = 92.75%], valid : [loss = 1.222, top1 = 69.02%], test : [loss = 1.241, top1 = 68.47%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.30 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.24%], valid : [loss = 2.216, top1 = 42.07%], test : [loss = 2.193, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.16%], valid : [loss = 0.627, top1 = 78.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8628/15625) 008628-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.96%], valid : [loss = 0.845, top1 = 72.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.548, top1 = 80.80%], test  : [loss = 0.710, top1 = 76.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 1.766, top1 = 52.46%], valid : [loss = 2.047, top1 = 47.44%], test : [loss = 2.065, top1 = 46.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.94%], valid : [loss = 3.636, top1 = 16.70%], test : [loss = 3.661, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8629/15625) 008629-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.69%], valid : [loss = 0.563, top1 = 87.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.364, top1 = 91.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 0.441, top1 = 87.25%], valid : [loss = 1.292, top1 = 66.04%], test : [loss = 1.339, top1 = 65.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.04%], valid : [loss = 2.610, top1 = 34.77%], test : [loss = 2.635, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.25%], valid : [loss = 0.922, top1 = 67.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8630/15625) 008630-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.37%], valid : [loss = 0.552, top1 = 86.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10        train : [loss = 0.087, top1 = 97.18%], test  : [loss = 0.384, top1 = 89.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.66 ms.
cifar100       train : [loss = 0.874, top1 = 74.87%], valid : [loss = 1.470, top1 = 60.37%], test : [loss = 1.439, top1 = 61.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.768, top1 = 30.33%], valid : [loss = 2.792, top1 = 30.03%], test : [loss = 2.822, top1 = 29.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.430, top1 = 47.84%], valid : [loss = 1.438, top1 = 47.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8631/15625) 008631-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.93%], valid : [loss = 0.520, top1 = 84.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.151, top1 = 95.02%], test  : [loss = 0.375, top1 = 88.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 1.091, top1 = 68.75%], valid : [loss = 1.469, top1 = 59.93%], test : [loss = 1.462, top1 = 59.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 35.20%], valid : [loss = 2.635, top1 = 34.13%], test : [loss = 2.691, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 67.01%], valid : [loss = 0.983, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8632/15625) 008632-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.38%], valid : [loss = 0.910, top1 = 76.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10        train : [loss = 0.232, top1 = 92.05%], test  : [loss = 0.610, top1 = 81.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.85 ms.
cifar100       train : [loss = 1.142, top1 = 67.52%], valid : [loss = 1.785, top1 = 53.68%], test : [loss = 1.778, top1 = 54.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.81%], valid : [loss = 3.326, top1 = 21.60%], test : [loss = 3.369, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.59%], valid : [loss = 1.130, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8633/15625) 008633-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.496, top1 = 88.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.21 ms.
cifar10        train : [loss = 0.034, top1 = 99.13%], test  : [loss = 0.356, top1 = 90.57%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.27 ms.
cifar100       train : [loss = 0.398, top1 = 89.03%], valid : [loss = 1.282, top1 = 67.44%], test : [loss = 1.284, top1 = 67.25%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.80%], valid : [loss = 2.377, top1 = 39.87%], test : [loss = 2.386, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.93%], valid : [loss = 0.614, top1 = 79.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8634/15625) 008634-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.560, top1 = 88.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10        train : [loss = 0.020, top1 = 99.46%], test  : [loss = 0.372, top1 = 91.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.33 ms.
cifar100       train : [loss = 0.289, top1 = 92.12%], valid : [loss = 1.298, top1 = 66.97%], test : [loss = 1.312, top1 = 66.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.55%], valid : [loss = 2.413, top1 = 38.95%], test : [loss = 2.429, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.74%], valid : [loss = 0.849, top1 = 70.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8635/15625) 008635-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.68%], valid : [loss = 0.625, top1 = 81.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.260, top1 = 91.11%], test  : [loss = 0.463, top1 = 85.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.15 ms.
cifar100       train : [loss = 1.258, top1 = 64.42%], valid : [loss = 1.621, top1 = 55.61%], test : [loss = 1.628, top1 = 56.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.969, top1 = 27.64%], valid : [loss = 2.992, top1 = 27.73%], test : [loss = 3.030, top1 = 27.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.035, top1 = 62.61%], valid : [loss = 1.095, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8636/15625) 008636-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.485, top1 = 89.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.82 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.319, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.250, top1 = 93.61%], valid : [loss = 1.252, top1 = 68.83%], test : [loss = 1.281, top1 = 68.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.91%], valid : [loss = 2.226, top1 = 42.77%], test : [loss = 2.259, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.32%], valid : [loss = 0.585, top1 = 79.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8637/15625) 008637-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.040, top1 = 99.02%], valid : [loss = 0.730, top1 = 83.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10        train : [loss = 0.087, top1 = 97.20%], test  : [loss = 0.480, top1 = 86.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.52 ms.
cifar100       train : [loss = 0.825, top1 = 76.05%], valid : [loss = 1.582, top1 = 59.67%], test : [loss = 1.585, top1 = 59.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 30.41%], valid : [loss = 2.944, top1 = 28.42%], test : [loss = 2.992, top1 = 27.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.09%], valid : [loss = 0.883, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8638/15625) 008638-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.92%], valid : [loss = 0.477, top1 = 84.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10        train : [loss = 0.298, top1 = 90.03%], test  : [loss = 0.397, top1 = 86.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.40 ms.
cifar100       train : [loss = 1.323, top1 = 63.19%], valid : [loss = 1.539, top1 = 57.72%], test : [loss = 1.507, top1 = 58.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.91%], valid : [loss = 2.897, top1 = 29.92%], test : [loss = 2.952, top1 = 28.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8639/15625) 008639-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.573, top1 = 87.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.389, top1 = 91.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 0.394, top1 = 88.79%], valid : [loss = 1.381, top1 = 65.67%], test : [loss = 1.385, top1 = 66.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.72%], valid : [loss = 2.519, top1 = 36.27%], test : [loss = 2.531, top1 = 37.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.13%], valid : [loss = 0.796, top1 = 72.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8640/15625) 008640-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.43%], valid : [loss = 0.644, top1 = 83.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10        train : [loss = 0.150, top1 = 94.93%], test  : [loss = 0.463, top1 = 86.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.39 ms.
cifar100       train : [loss = 0.974, top1 = 71.71%], valid : [loss = 1.638, top1 = 56.81%], test : [loss = 1.647, top1 = 56.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 25.53%], valid : [loss = 3.128, top1 = 24.37%], test : [loss = 3.172, top1 = 23.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8641/15625) 008641-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.524, top1 = 89.58%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.34 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.317, top1 = 93.17%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.34 ms.
cifar100       train : [loss = 0.082, top1 = 98.55%], valid : [loss = 1.363, top1 = 69.07%], test : [loss = 1.365, top1 = 69.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.82%], valid : [loss = 2.283, top1 = 41.57%], test : [loss = 2.275, top1 = 41.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.44%], valid : [loss = 0.705, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8642/15625) 008642-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.37%], valid : [loss = 0.838, top1 = 72.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10        train : [loss = 0.561, top1 = 80.48%], test  : [loss = 0.718, top1 = 75.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.26 ms.
cifar100       train : [loss = 1.773, top1 = 52.19%], valid : [loss = 2.035, top1 = 47.60%], test : [loss = 2.043, top1 = 47.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.83%], valid : [loss = 3.648, top1 = 16.17%], test : [loss = 3.684, top1 = 15.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8643/15625) 008643-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.32%], valid : [loss = 0.926, top1 = 75.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.217, top1 = 92.57%], test  : [loss = 0.587, top1 = 82.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.10 ms.
cifar100       train : [loss = 1.156, top1 = 67.14%], valid : [loss = 1.791, top1 = 53.78%], test : [loss = 1.766, top1 = 54.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 3.230, top1 = 22.68%], valid : [loss = 3.321, top1 = 21.62%], test : [loss = 3.364, top1 = 20.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.50%], valid : [loss = 1.089, top1 = 61.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8644/15625) 008644-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.437, top1 = 89.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.306, top1 = 92.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.202, top1 = 95.22%], valid : [loss = 1.245, top1 = 69.65%], test : [loss = 1.253, top1 = 69.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.53%], valid : [loss = 2.248, top1 = 43.25%], test : [loss = 2.280, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.10%], valid : [loss = 0.523, top1 = 82.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8645/15625) 008645-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.815, top1 = 71.19%], valid : [loss = 0.905, top1 = 68.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10        train : [loss = 0.672, top1 = 76.47%], test  : [loss = 0.735, top1 = 74.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 2.132, top1 = 43.32%], valid : [loss = 2.222, top1 = 41.63%], test : [loss = 2.240, top1 = 41.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 3.419, top1 = 19.25%], valid : [loss = 3.402, top1 = 19.82%], test : [loss = 3.421, top1 = 19.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.36%], valid : [loss = 1.390, top1 = 49.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8646/15625) 008646-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.27 ms.
cifar10-valid  train : [loss = 0.653, top1 = 77.06%], valid : [loss = 0.831, top1 = 71.86%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.85 ms.
cifar10        train : [loss = 0.679, top1 = 76.19%], test  : [loss = 0.765, top1 = 73.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.57 ms.
cifar100       train : [loss = 1.962, top1 = 48.01%], valid : [loss = 2.129, top1 = 45.06%], test : [loss = 2.141, top1 = 44.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.72%], valid : [loss = 3.680, top1 = 16.38%], test : [loss = 3.688, top1 = 14.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8647/15625) 008647-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.295, top1 = 89.83%], valid : [loss = 0.561, top1 = 82.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.276, top1 = 90.45%], test  : [loss = 0.427, top1 = 85.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.74 ms.
cifar100       train : [loss = 1.440, top1 = 59.70%], valid : [loss = 1.692, top1 = 54.55%], test : [loss = 1.670, top1 = 54.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 3.009, top1 = 26.82%], valid : [loss = 3.023, top1 = 26.83%], test : [loss = 3.087, top1 = 25.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.100, top1 = 60.60%], valid : [loss = 1.137, top1 = 59.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8648/15625) 008648-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.49%], valid : [loss = 0.840, top1 = 72.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.559, top1 = 80.61%], test  : [loss = 0.716, top1 = 75.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.22 ms.
cifar100       train : [loss = 1.776, top1 = 52.15%], valid : [loss = 2.042, top1 = 47.28%], test : [loss = 2.049, top1 = 47.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.80%], valid : [loss = 3.650, top1 = 16.22%], test : [loss = 3.673, top1 = 15.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8649/15625) 008649-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.436, top1 = 90.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.39 ms.
cifar100       train : [loss = 0.064, top1 = 99.07%], valid : [loss = 1.359, top1 = 70.31%], test : [loss = 1.329, top1 = 70.69%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 1.536, top1 = 58.49%], valid : [loss = 2.253, top1 = 44.10%], test : [loss = 2.268, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8650/15625) 008650-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.555, top1 = 87.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.377, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.43 ms.
cifar100       train : [loss = 0.311, top1 = 91.50%], valid : [loss = 1.332, top1 = 66.58%], test : [loss = 1.337, top1 = 66.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.11%], valid : [loss = 2.477, top1 = 37.28%], test : [loss = 2.483, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.34%], valid : [loss = 0.947, top1 = 66.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8651/15625) 008651-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.563, top1 = 88.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.40 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.392, top1 = 91.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.172, top1 = 96.32%], valid : [loss = 1.404, top1 = 67.01%], test : [loss = 1.408, top1 = 67.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 1.997, top1 = 47.67%], valid : [loss = 2.420, top1 = 39.20%], test : [loss = 2.440, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.28%], valid : [loss = 0.692, top1 = 76.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8652/15625) 008652-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.28 ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.57%], valid : [loss = 0.657, top1 = 77.86%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10        train : [loss = 0.508, top1 = 82.42%], test  : [loss = 0.587, top1 = 80.08%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.27 ms.
cifar100       train : [loss = 1.684, top1 = 54.27%], valid : [loss = 1.852, top1 = 50.65%], test : [loss = 1.859, top1 = 51.17%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.71 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.26%], valid : [loss = 3.311, top1 = 21.36%], test : [loss = 3.355, top1 = 20.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8653/15625) 008653-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.26 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8654/15625) 008654-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.487, top1 = 90.23%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.03 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.307, top1 = 93.61%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.05 ms.
cifar100       train : [loss = 0.037, top1 = 99.60%], valid : [loss = 1.326, top1 = 70.57%], test : [loss = 1.353, top1 = 70.66%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.88 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.94%], valid : [loss = 2.244, top1 = 43.37%], test : [loss = 2.235, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.36%], valid : [loss = 0.637, top1 = 78.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8655/15625) 008655-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10-valid  train : [loss = 1.282, top1 = 53.82%], valid : [loss = 1.330, top1 = 52.66%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10        train : [loss = 1.235, top1 = 55.71%], test  : [loss = 1.246, top1 = 55.27%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.71 ms.
cifar100       train : [loss = 2.800, top1 = 30.39%], valid : [loss = 2.893, top1 = 28.63%], test : [loss = 2.882, top1 = 28.69%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.39 ms.
ImageNet16-120 train : [loss = 3.943, top1 = 11.26%], valid : [loss = 3.943, top1 = 11.87%], test : [loss = 3.950, top1 = 11.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.761, top1 = 33.83%], valid : [loss = 1.747, top1 = 34.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8656/15625) 008656-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.629, top1 = 87.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.51 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.407, top1 = 91.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 0.151, top1 = 96.49%], valid : [loss = 1.552, top1 = 66.49%], test : [loss = 1.556, top1 = 65.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.18%], valid : [loss = 2.493, top1 = 38.50%], test : [loss = 2.513, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.00%], valid : [loss = 0.809, top1 = 71.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8657/15625) 008657-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.29%], valid : [loss = 0.555, top1 = 83.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10        train : [loss = 0.203, top1 = 93.20%], test  : [loss = 0.397, top1 = 87.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 1.255, top1 = 64.23%], valid : [loss = 1.551, top1 = 57.79%], test : [loss = 1.561, top1 = 57.25%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.66 ms.
ImageNet16-120 train : [loss = 2.721, top1 = 32.18%], valid : [loss = 2.744, top1 = 31.67%], test : [loss = 2.776, top1 = 31.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8658/15625) 008658-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.511, top1 = 88.78%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.44%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.58 ms.
cifar100       train : [loss = 0.322, top1 = 91.44%], valid : [loss = 1.282, top1 = 66.98%], test : [loss = 1.295, top1 = 67.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.12%], valid : [loss = 2.407, top1 = 39.17%], test : [loss = 2.409, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 81.00%], valid : [loss = 0.620, top1 = 78.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8659/15625) 008659-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.553, top1 = 88.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.380, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.79 ms.
cifar100       train : [loss = 0.166, top1 = 96.44%], valid : [loss = 1.391, top1 = 67.27%], test : [loss = 1.437, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.96%], valid : [loss = 2.471, top1 = 38.47%], test : [loss = 2.488, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8660/15625) 008660-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.08%], valid : [loss = 0.542, top1 = 83.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10        train : [loss = 0.242, top1 = 91.73%], test  : [loss = 0.389, top1 = 87.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.10 ms.
cifar100       train : [loss = 1.287, top1 = 63.65%], valid : [loss = 1.545, top1 = 57.91%], test : [loss = 1.548, top1 = 57.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.14 ms.
ImageNet16-120 train : [loss = 2.833, top1 = 30.03%], valid : [loss = 2.834, top1 = 31.20%], test : [loss = 2.906, top1 = 29.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8661/15625) 008661-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.68%], valid : [loss = 0.468, top1 = 85.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.152, top1 = 95.03%], test  : [loss = 0.344, top1 = 88.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 0.977, top1 = 72.25%], valid : [loss = 1.346, top1 = 62.42%], test : [loss = 1.331, top1 = 62.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.03%], valid : [loss = 2.685, top1 = 33.10%], test : [loss = 2.697, top1 = 32.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8662/15625) 008662-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=23.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.492, top1 = 89.59%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=24.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.323, top1 = 92.94%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=23.15 ms.
cifar100       train : [loss = 0.078, top1 = 98.91%], valid : [loss = 1.312, top1 = 69.72%], test : [loss = 1.316, top1 = 69.96%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=21.87 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 51.97%], valid : [loss = 2.257, top1 = 42.72%], test : [loss = 2.245, top1 = 42.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.41%], valid : [loss = 0.733, top1 = 74.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8663/15625) 008663-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.486, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.303, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.74 ms.
cifar100       train : [loss = 0.318, top1 = 91.45%], valid : [loss = 1.257, top1 = 67.64%], test : [loss = 1.273, top1 = 67.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.10 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.81%], valid : [loss = 2.324, top1 = 40.69%], test : [loss = 2.349, top1 = 39.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.99%], valid : [loss = 0.639, top1 = 78.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8664/15625) 008664-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.24%], valid : [loss = 0.480, top1 = 84.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10        train : [loss = 0.293, top1 = 90.28%], test  : [loss = 0.398, top1 = 86.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 1.320, top1 = 63.30%], valid : [loss = 1.528, top1 = 58.11%], test : [loss = 1.505, top1 = 58.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.85%], valid : [loss = 2.888, top1 = 29.80%], test : [loss = 2.945, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8665/15625) 008665-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.85%], valid : [loss = 0.569, top1 = 88.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.65%], test  : [loss = 0.364, top1 = 91.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.34 ms.
cifar100       train : [loss = 0.201, top1 = 95.08%], valid : [loss = 1.279, top1 = 68.28%], test : [loss = 1.294, top1 = 68.31%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 1.930, top1 = 49.15%], valid : [loss = 2.271, top1 = 42.45%], test : [loss = 2.264, top1 = 42.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.16%], valid : [loss = 0.828, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8666/15625) 008666-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.63%], valid : [loss = 0.499, top1 = 88.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.75 ms.
cifar10        train : [loss = 0.043, top1 = 98.82%], test  : [loss = 0.344, top1 = 90.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.39 ms.
cifar100       train : [loss = 0.494, top1 = 85.75%], valid : [loss = 1.305, top1 = 66.32%], test : [loss = 1.291, top1 = 66.31%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.84%], valid : [loss = 2.407, top1 = 38.93%], test : [loss = 2.458, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.91%], valid : [loss = 0.600, top1 = 79.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8667/15625) 008667-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.490, top1 = 89.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.89 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.321, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.27 ms.
cifar100       train : [loss = 0.230, top1 = 94.41%], valid : [loss = 1.258, top1 = 68.51%], test : [loss = 1.242, top1 = 68.45%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.58%], valid : [loss = 2.278, top1 = 41.43%], test : [loss = 2.283, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.20%], valid : [loss = 0.645, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8668/15625) 008668-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.326, top1 = 92.72%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.50 ms.
cifar100       train : [loss = 0.142, top1 = 96.95%], valid : [loss = 1.400, top1 = 67.52%], test : [loss = 1.402, top1 = 67.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.71%], valid : [loss = 2.312, top1 = 40.95%], test : [loss = 2.313, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.22%], valid : [loss = 0.668, top1 = 77.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8669/15625) 008669-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.494, top1 = 90.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.308, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.15 ms.
cifar100       train : [loss = 0.112, top1 = 97.83%], valid : [loss = 1.280, top1 = 70.05%], test : [loss = 1.294, top1 = 69.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.84%], valid : [loss = 2.188, top1 = 44.13%], test : [loss = 2.207, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8670/15625) 008670-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.510, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.321, top1 = 92.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.52 ms.
cifar100       train : [loss = 0.238, top1 = 93.83%], valid : [loss = 1.248, top1 = 68.51%], test : [loss = 1.270, top1 = 68.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.65%], valid : [loss = 2.249, top1 = 43.10%], test : [loss = 2.249, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.14%], valid : [loss = 0.583, top1 = 80.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8671/15625) 008671-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.92%], valid : [loss = 0.479, top1 = 84.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.48 ms.
cifar10        train : [loss = 0.304, top1 = 89.86%], test  : [loss = 0.401, top1 = 86.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 1.329, top1 = 63.27%], valid : [loss = 1.526, top1 = 58.20%], test : [loss = 1.508, top1 = 57.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.64%], valid : [loss = 2.900, top1 = 30.53%], test : [loss = 2.952, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8672/15625) 008672-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.65%], valid : [loss = 0.461, top1 = 86.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10        train : [loss = 0.150, top1 = 95.11%], test  : [loss = 0.342, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.78 ms.
cifar100       train : [loss = 0.979, top1 = 72.12%], valid : [loss = 1.339, top1 = 62.31%], test : [loss = 1.339, top1 = 62.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.31%], valid : [loss = 2.664, top1 = 33.60%], test : [loss = 2.694, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8673/15625) 008673-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.41%], valid : [loss = 0.456, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.73 ms.
cifar10        train : [loss = 0.159, top1 = 94.89%], test  : [loss = 0.338, top1 = 89.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 1.016, top1 = 70.96%], valid : [loss = 1.363, top1 = 61.58%], test : [loss = 1.374, top1 = 62.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.72%], valid : [loss = 2.714, top1 = 31.97%], test : [loss = 2.737, top1 = 31.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.75%], valid : [loss = 0.791, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8674/15625) 008674-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.593, top1 = 88.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.374, top1 = 92.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.13 ms.
cifar100       train : [loss = 0.064, top1 = 99.24%], valid : [loss = 1.449, top1 = 67.72%], test : [loss = 1.446, top1 = 68.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 1.725, top1 = 54.09%], valid : [loss = 2.415, top1 = 39.93%], test : [loss = 2.422, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.52%], valid : [loss = 0.677, top1 = 76.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8675/15625) 008675-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.563, top1 = 87.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10        train : [loss = 0.034, top1 = 98.99%], test  : [loss = 0.375, top1 = 90.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.554, top1 = 83.99%], valid : [loss = 1.387, top1 = 63.62%], test : [loss = 1.368, top1 = 64.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.09%], valid : [loss = 2.648, top1 = 33.50%], test : [loss = 2.679, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8676/15625) 008676-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.94%], valid : [loss = 0.623, top1 = 84.18%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.65 ms.
cifar10        train : [loss = 0.092, top1 = 96.92%], test  : [loss = 0.447, top1 = 87.88%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.60 ms.
cifar100       train : [loss = 0.672, top1 = 80.18%], valid : [loss = 1.508, top1 = 60.88%], test : [loss = 1.546, top1 = 60.98%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 3.166, top1 = 22.68%], valid : [loss = 3.183, top1 = 23.37%], test : [loss = 3.203, top1 = 22.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.087, top1 = 60.74%], valid : [loss = 1.100, top1 = 60.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8677/15625) 008677-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.02%], valid : [loss = 0.551, top1 = 85.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.20 ms.
cifar10        train : [loss = 0.085, top1 = 97.33%], test  : [loss = 0.361, top1 = 89.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.86 ms.
cifar100       train : [loss = 0.696, top1 = 79.48%], valid : [loss = 1.358, top1 = 63.92%], test : [loss = 1.339, top1 = 63.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.437, top1 = 37.90%], valid : [loss = 2.551, top1 = 35.80%], test : [loss = 2.575, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.64%], valid : [loss = 0.874, top1 = 69.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8678/15625) 008678-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.505, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.327, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.35 ms.
cifar100       train : [loss = 0.368, top1 = 90.00%], valid : [loss = 1.308, top1 = 66.60%], test : [loss = 1.283, top1 = 66.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.48%], valid : [loss = 2.404, top1 = 38.97%], test : [loss = 2.411, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.82%], valid : [loss = 0.691, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8679/15625) 008679-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.484, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.325, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.08 ms.
cifar100       train : [loss = 0.270, top1 = 93.13%], valid : [loss = 1.192, top1 = 69.62%], test : [loss = 1.200, top1 = 69.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 49.95%], valid : [loss = 2.210, top1 = 42.40%], test : [loss = 2.257, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.14%], valid : [loss = 0.634, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8680/15625) 008680-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.15%], valid : [loss = 0.603, top1 = 86.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.72 ms.
cifar10        train : [loss = 0.028, top1 = 99.20%], test  : [loss = 0.409, top1 = 90.28%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.94 ms.
cifar100       train : [loss = 0.286, top1 = 92.09%], valid : [loss = 1.528, top1 = 64.10%], test : [loss = 1.500, top1 = 65.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 2.902, top1 = 27.95%], valid : [loss = 2.983, top1 = 25.73%], test : [loss = 2.989, top1 = 26.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 64.84%], valid : [loss = 1.009, top1 = 63.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8681/15625) 008681-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.23%], valid : [loss = 0.618, top1 = 85.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.79 ms.
cifar10        train : [loss = 0.048, top1 = 98.49%], test  : [loss = 0.386, top1 = 89.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.28 ms.
cifar100       train : [loss = 0.574, top1 = 83.19%], valid : [loss = 1.389, top1 = 64.72%], test : [loss = 1.374, top1 = 64.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.431, top1 = 38.20%], valid : [loss = 2.591, top1 = 35.27%], test : [loss = 2.602, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 65.08%], valid : [loss = 1.014, top1 = 64.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8682/15625) 008682-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.76%], valid : [loss = 0.815, top1 = 83.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.567, top1 = 87.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.86 ms.
cifar100       train : [loss = 0.284, top1 = 92.55%], valid : [loss = 1.865, top1 = 59.64%], test : [loss = 1.861, top1 = 59.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 36.14%], valid : [loss = 2.931, top1 = 29.23%], test : [loss = 3.015, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.79%], valid : [loss = 0.976, top1 = 65.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8683/15625) 008683-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.482, top1 = 89.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.309, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.10 ms.
cifar100       train : [loss = 0.256, top1 = 93.38%], valid : [loss = 1.208, top1 = 69.12%], test : [loss = 1.199, top1 = 69.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.11%], valid : [loss = 2.231, top1 = 41.90%], test : [loss = 2.205, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8684/15625) 008684-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.48%], valid : [loss = 0.545, top1 = 87.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10        train : [loss = 0.052, top1 = 98.46%], test  : [loss = 0.361, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.35 ms.
cifar100       train : [loss = 0.610, top1 = 82.29%], valid : [loss = 1.383, top1 = 64.22%], test : [loss = 1.361, top1 = 64.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.49%], valid : [loss = 2.541, top1 = 36.30%], test : [loss = 2.547, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.95%], valid : [loss = 0.641, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8685/15625) 008685-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.56%], valid : [loss = 0.608, top1 = 85.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.38 ms.
cifar10        train : [loss = 0.113, top1 = 96.24%], test  : [loss = 0.410, top1 = 88.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.90 ms.
cifar100       train : [loss = 0.817, top1 = 76.01%], valid : [loss = 1.440, top1 = 62.30%], test : [loss = 1.400, top1 = 62.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 32.98%], valid : [loss = 2.776, top1 = 31.03%], test : [loss = 2.794, top1 = 30.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.86%], valid : [loss = 0.712, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8686/15625) 008686-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.33%], valid : [loss = 0.556, top1 = 82.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10        train : [loss = 0.302, top1 = 89.63%], test  : [loss = 0.429, top1 = 85.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.43 ms.
cifar100       train : [loss = 1.302, top1 = 63.26%], valid : [loss = 1.580, top1 = 56.90%], test : [loss = 1.574, top1 = 56.77%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 3.068, top1 = 25.78%], valid : [loss = 3.070, top1 = 25.70%], test : [loss = 3.141, top1 = 25.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.56%], valid : [loss = 1.244, top1 = 55.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8687/15625) 008687-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.93%], valid : [loss = 0.477, top1 = 84.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.295, top1 = 90.19%], test  : [loss = 0.395, top1 = 86.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.05 ms.
cifar100       train : [loss = 1.328, top1 = 63.13%], valid : [loss = 1.528, top1 = 57.69%], test : [loss = 1.514, top1 = 58.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.69%], valid : [loss = 2.899, top1 = 29.66%], test : [loss = 2.946, top1 = 28.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8688/15625) 008688-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.648, top1 = 86.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10        train : [loss = 0.026, top1 = 99.34%], test  : [loss = 0.414, top1 = 90.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.62 ms.
cifar100       train : [loss = 0.471, top1 = 86.44%], valid : [loss = 1.410, top1 = 63.76%], test : [loss = 1.402, top1 = 64.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.420, top1 = 38.38%], valid : [loss = 2.593, top1 = 34.67%], test : [loss = 2.647, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.30%], valid : [loss = 0.867, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8689/15625) 008689-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.36%], valid : [loss = 0.603, top1 = 85.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10        train : [loss = 0.069, top1 = 97.87%], test  : [loss = 0.417, top1 = 88.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.12 ms.
cifar100       train : [loss = 0.718, top1 = 79.18%], valid : [loss = 1.434, top1 = 62.62%], test : [loss = 1.385, top1 = 62.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.79%], valid : [loss = 2.650, top1 = 34.30%], test : [loss = 2.698, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8690/15625) 008690-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.50%], valid : [loss = 0.638, top1 = 86.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.94 ms.
cifar10        train : [loss = 0.055, top1 = 98.31%], test  : [loss = 0.473, top1 = 88.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.16 ms.
cifar100       train : [loss = 0.625, top1 = 81.66%], valid : [loss = 1.554, top1 = 61.06%], test : [loss = 1.508, top1 = 61.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.53%], valid : [loss = 2.811, top1 = 31.27%], test : [loss = 2.884, top1 = 29.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.68%], valid : [loss = 0.892, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8691/15625) 008691-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.557, top1 = 88.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.15 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.374, top1 = 91.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.50 ms.
cifar100       train : [loss = 0.227, top1 = 94.48%], valid : [loss = 1.368, top1 = 67.10%], test : [loss = 1.388, top1 = 67.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.48%], valid : [loss = 2.486, top1 = 37.77%], test : [loss = 2.462, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.28%], valid : [loss = 0.689, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8692/15625) 008692-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.61%], valid : [loss = 0.839, top1 = 79.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.99 ms.
cifar10        train : [loss = 0.131, top1 = 95.66%], test  : [loss = 0.554, top1 = 84.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.11 ms.
cifar100       train : [loss = 0.850, top1 = 75.22%], valid : [loss = 1.685, top1 = 57.32%], test : [loss = 1.681, top1 = 57.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 26.43%], valid : [loss = 3.187, top1 = 24.73%], test : [loss = 3.166, top1 = 25.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.42%], valid : [loss = 1.128, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8693/15625) 008693-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.551, top1 = 88.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.82%], test  : [loss = 0.348, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.00 ms.
cifar100       train : [loss = 0.125, top1 = 97.19%], valid : [loss = 1.378, top1 = 68.38%], test : [loss = 1.384, top1 = 67.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.68 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.11%], valid : [loss = 2.467, top1 = 36.60%], test : [loss = 2.464, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.67%], valid : [loss = 0.877, top1 = 68.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8694/15625) 008694-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.627, top1 = 85.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.068, top1 = 97.91%], test  : [loss = 0.402, top1 = 88.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.91 ms.
cifar100       train : [loss = 0.707, top1 = 79.53%], valid : [loss = 1.380, top1 = 63.52%], test : [loss = 1.368, top1 = 63.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.522, top1 = 36.26%], valid : [loss = 2.656, top1 = 33.77%], test : [loss = 2.669, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8695/15625) 008695-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.92 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.408, top1 = 90.69%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.249, top1 = 94.22%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.66 ms.
cifar100       train : [loss = 0.061, top1 = 99.20%], valid : [loss = 1.296, top1 = 71.50%], test : [loss = 1.258, top1 = 71.40%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.96 ms.
ImageNet16-120 train : [loss = 1.479, top1 = 59.68%], valid : [loss = 2.180, top1 = 46.03%], test : [loss = 2.165, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.02%], valid : [loss = 0.508, top1 = 82.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8696/15625) 008696-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.551, top1 = 88.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.35 ms.
cifar10        train : [loss = 0.019, top1 = 99.45%], test  : [loss = 0.378, top1 = 91.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.45 ms.
cifar100       train : [loss = 0.402, top1 = 88.45%], valid : [loss = 1.385, top1 = 65.86%], test : [loss = 1.439, top1 = 64.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.19%], valid : [loss = 2.369, top1 = 40.13%], test : [loss = 2.351, top1 = 41.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.28%], valid : [loss = 0.890, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8697/15625) 008697-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.99%], valid : [loss = 0.454, top1 = 86.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.159, top1 = 94.83%], test  : [loss = 0.343, top1 = 88.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.73 ms.
cifar100       train : [loss = 0.991, top1 = 71.83%], valid : [loss = 1.352, top1 = 61.78%], test : [loss = 1.342, top1 = 62.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.27%], valid : [loss = 2.714, top1 = 31.17%], test : [loss = 2.736, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8698/15625) 008698-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.142, top1 = 95.44%], valid : [loss = 0.761, top1 = 79.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.10 ms.
cifar10        train : [loss = 0.172, top1 = 94.23%], test  : [loss = 0.482, top1 = 85.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.07 ms.
cifar100       train : [loss = 1.025, top1 = 70.34%], valid : [loss = 1.655, top1 = 56.54%], test : [loss = 1.658, top1 = 55.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.46 ms.
ImageNet16-120 train : [loss = 3.155, top1 = 23.29%], valid : [loss = 3.187, top1 = 22.63%], test : [loss = 3.225, top1 = 21.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 63.25%], valid : [loss = 1.072, top1 = 61.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8699/15625) 008699-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.69 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8700/15625) 008700-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.53%], valid : [loss = 0.627, top1 = 83.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.102, top1 = 96.65%], test  : [loss = 0.436, top1 = 87.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.91 ms.
cifar100       train : [loss = 0.718, top1 = 78.82%], valid : [loss = 1.533, top1 = 60.72%], test : [loss = 1.534, top1 = 60.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 3.112, top1 = 23.92%], valid : [loss = 3.128, top1 = 23.70%], test : [loss = 3.148, top1 = 23.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 61.82%], valid : [loss = 1.097, top1 = 60.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8701/15625) 008701-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.497, top1 = 88.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.021, top1 = 99.49%], test  : [loss = 0.341, top1 = 91.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 0.406, top1 = 88.37%], valid : [loss = 1.309, top1 = 66.84%], test : [loss = 1.315, top1 = 66.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.50%], valid : [loss = 2.412, top1 = 38.90%], test : [loss = 2.446, top1 = 38.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.58%], valid : [loss = 0.640, top1 = 77.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8702/15625) 008702-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.550, top1 = 88.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.56 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.360, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.46 ms.
cifar100       train : [loss = 0.222, top1 = 94.31%], valid : [loss = 1.271, top1 = 68.36%], test : [loss = 1.292, top1 = 68.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.02%], valid : [loss = 2.504, top1 = 36.40%], test : [loss = 2.527, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.12%], valid : [loss = 0.883, top1 = 68.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8703/15625) 008703-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.602, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10        train : [loss = 0.018, top1 = 99.46%], test  : [loss = 0.423, top1 = 90.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.14 ms.
cifar100       train : [loss = 0.400, top1 = 88.48%], valid : [loss = 1.491, top1 = 63.70%], test : [loss = 1.486, top1 = 64.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 32.16%], valid : [loss = 2.763, top1 = 30.33%], test : [loss = 2.771, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8704/15625) 008704-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.501, top1 = 88.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.321, top1 = 92.49%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.71 ms.
cifar100       train : [loss = 0.247, top1 = 93.90%], valid : [loss = 1.306, top1 = 67.42%], test : [loss = 1.327, top1 = 67.54%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 1.992, top1 = 47.71%], valid : [loss = 2.338, top1 = 41.13%], test : [loss = 2.329, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.78%], valid : [loss = 0.607, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8705/15625) 008705-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.703, top1 = 85.34%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.55 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.471, top1 = 88.77%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.66 ms.
cifar100       train : [loss = 0.331, top1 = 91.29%], valid : [loss = 1.572, top1 = 62.92%], test : [loss = 1.552, top1 = 63.18%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.99 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.16%], valid : [loss = 2.700, top1 = 32.27%], test : [loss = 2.717, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.32%], valid : [loss = 0.823, top1 = 71.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8706/15625) 008706-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.40%], valid : [loss = 0.851, top1 = 72.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.03 ms.
cifar10        train : [loss = 0.554, top1 = 80.57%], test  : [loss = 0.713, top1 = 75.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.66 ms.
cifar100       train : [loss = 1.760, top1 = 52.47%], valid : [loss = 2.047, top1 = 46.81%], test : [loss = 2.057, top1 = 47.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.82%], valid : [loss = 3.635, top1 = 16.34%], test : [loss = 3.665, top1 = 15.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8707/15625) 008707-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.58%], valid : [loss = 0.878, top1 = 79.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.127, top1 = 95.77%], test  : [loss = 0.531, top1 = 85.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.35 ms.
cifar100       train : [loss = 0.847, top1 = 75.63%], valid : [loss = 1.660, top1 = 58.24%], test : [loss = 1.673, top1 = 57.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.14 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.40%], valid : [loss = 3.200, top1 = 23.80%], test : [loss = 3.230, top1 = 24.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.037, top1 = 62.71%], valid : [loss = 1.096, top1 = 60.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8708/15625) 008708-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.419, top1 = 91.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.269, top1 = 94.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.90 ms.
cifar100       train : [loss = 0.068, top1 = 99.04%], valid : [loss = 1.326, top1 = 71.06%], test : [loss = 1.316, top1 = 70.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 1.549, top1 = 58.22%], valid : [loss = 2.267, top1 = 43.67%], test : [loss = 2.292, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.43%], valid : [loss = 0.499, top1 = 83.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8709/15625) 008709-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.60%], valid : [loss = 0.597, top1 = 86.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.88 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.388, top1 = 90.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.521, top1 = 84.85%], valid : [loss = 1.447, top1 = 63.04%], test : [loss = 1.427, top1 = 63.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.92%], valid : [loss = 2.479, top1 = 38.40%], test : [loss = 2.493, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.35%], valid : [loss = 0.859, top1 = 69.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8710/15625) 008710-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.138, top1 = 95.58%], valid : [loss = 0.641, top1 = 82.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.73 ms.
cifar10        train : [loss = 0.199, top1 = 93.25%], test  : [loss = 0.399, top1 = 87.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.39 ms.
cifar100       train : [loss = 1.004, top1 = 71.05%], valid : [loss = 1.437, top1 = 60.86%], test : [loss = 1.416, top1 = 61.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.762, top1 = 31.24%], valid : [loss = 2.807, top1 = 30.82%], test : [loss = 2.858, top1 = 30.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.64%], valid : [loss = 0.920, top1 = 67.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8711/15625) 008711-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.45 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.777, top1 = 84.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.36 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.449, top1 = 89.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.44 ms.
cifar100       train : [loss = 0.278, top1 = 92.88%], valid : [loss = 1.624, top1 = 62.90%], test : [loss = 1.571, top1 = 63.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.212, top1 = 42.88%], valid : [loss = 2.627, top1 = 35.73%], test : [loss = 2.628, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.85%], valid : [loss = 0.808, top1 = 72.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8712/15625) 008712-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.25%], valid : [loss = 0.968, top1 = 75.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.216, top1 = 92.64%], test  : [loss = 0.595, top1 = 82.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.23 ms.
cifar100       train : [loss = 1.149, top1 = 67.40%], valid : [loss = 1.808, top1 = 53.45%], test : [loss = 1.778, top1 = 54.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.80%], valid : [loss = 3.339, top1 = 21.67%], test : [loss = 3.375, top1 = 20.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.82%], valid : [loss = 1.094, top1 = 61.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8713/15625) 008713-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.44%], valid : [loss = 0.536, top1 = 83.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.234, top1 = 91.92%], test  : [loss = 0.398, top1 = 86.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.23 ms.
cifar100       train : [loss = 1.401, top1 = 60.59%], valid : [loss = 1.648, top1 = 55.52%], test : [loss = 1.642, top1 = 55.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.85 ms.
ImageNet16-120 train : [loss = 2.855, top1 = 29.53%], valid : [loss = 2.863, top1 = 29.63%], test : [loss = 2.926, top1 = 29.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8714/15625) 008714-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.571, top1 = 87.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.378, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.399, top1 = 88.65%], valid : [loss = 1.409, top1 = 65.28%], test : [loss = 1.387, top1 = 65.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.89%], valid : [loss = 2.483, top1 = 37.62%], test : [loss = 2.485, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.60%], valid : [loss = 0.762, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8715/15625) 008715-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.76%], valid : [loss = 0.456, top1 = 87.80%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.49 ms.
cifar10        train : [loss = 0.043, top1 = 99.04%], test  : [loss = 0.312, top1 = 90.79%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.26 ms.
cifar100       train : [loss = 0.451, top1 = 88.22%], valid : [loss = 1.232, top1 = 67.30%], test : [loss = 1.240, top1 = 66.82%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=22.91 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.81%], valid : [loss = 2.427, top1 = 38.27%], test : [loss = 2.446, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.98%], valid : [loss = 0.629, top1 = 78.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8716/15625) 008716-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.34%], valid : [loss = 0.861, top1 = 71.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10        train : [loss = 0.552, top1 = 80.71%], test  : [loss = 0.717, top1 = 75.90%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.47 ms.
cifar100       train : [loss = 1.787, top1 = 52.08%], valid : [loss = 2.056, top1 = 47.46%], test : [loss = 2.075, top1 = 47.44%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.43 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.84%], valid : [loss = 3.640, top1 = 17.13%], test : [loss = 3.658, top1 = 16.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8717/15625) 008717-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.314, top1 = 89.20%], valid : [loss = 0.570, top1 = 81.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.269, top1 = 90.76%], test  : [loss = 0.425, top1 = 86.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.07 ms.
cifar100       train : [loss = 1.498, top1 = 58.10%], valid : [loss = 1.742, top1 = 52.98%], test : [loss = 1.740, top1 = 53.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 27.89%], valid : [loss = 2.947, top1 = 28.28%], test : [loss = 3.013, top1 = 27.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8718/15625) 008718-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.563, top1 = 89.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.358, top1 = 92.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.77 ms.
cifar100       train : [loss = 0.080, top1 = 98.73%], valid : [loss = 1.433, top1 = 68.74%], test : [loss = 1.412, top1 = 69.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 1.764, top1 = 53.08%], valid : [loss = 2.370, top1 = 40.10%], test : [loss = 2.394, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.00%], valid : [loss = 0.663, top1 = 77.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8719/15625) 008719-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=13.95 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.83%], valid : [loss = 0.495, top1 = 84.02%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=13.64 ms.
cifar10        train : [loss = 0.270, top1 = 90.86%], test  : [loss = 0.370, top1 = 87.60%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=13.30 ms.
cifar100       train : [loss = 1.299, top1 = 63.66%], valid : [loss = 1.502, top1 = 58.55%], test : [loss = 1.489, top1 = 57.87%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.815, top1 = 30.60%], valid : [loss = 2.816, top1 = 30.44%], test : [loss = 2.851, top1 = 29.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 63.11%], valid : [loss = 1.066, top1 = 62.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8720/15625) 008720-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.456, top1 = 87.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10        train : [loss = 0.116, top1 = 96.47%], test  : [loss = 0.323, top1 = 89.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 0.866, top1 = 75.33%], valid : [loss = 1.312, top1 = 63.61%], test : [loss = 1.273, top1 = 64.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.53%], valid : [loss = 2.650, top1 = 33.57%], test : [loss = 2.658, top1 = 32.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8721/15625) 008721-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.18%], valid : [loss = 0.737, top1 = 74.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10        train : [loss = 0.542, top1 = 81.24%], test  : [loss = 0.601, top1 = 79.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.82 ms.
cifar100       train : [loss = 2.011, top1 = 45.86%], valid : [loss = 2.198, top1 = 42.50%], test : [loss = 2.170, top1 = 42.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.46%], valid : [loss = 3.226, top1 = 22.33%], test : [loss = 3.240, top1 = 22.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.282, top1 = 53.77%], valid : [loss = 1.334, top1 = 52.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8722/15625) 008722-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.40 ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.46%], valid : [loss = 0.843, top1 = 71.32%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10        train : [loss = 0.669, top1 = 76.67%], test  : [loss = 0.771, top1 = 73.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.73 ms.
cifar100       train : [loss = 1.965, top1 = 47.54%], valid : [loss = 2.131, top1 = 44.78%], test : [loss = 2.161, top1 = 44.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.28 ms.
ImageNet16-120 train : [loss = 3.657, top1 = 15.56%], valid : [loss = 3.685, top1 = 15.97%], test : [loss = 3.701, top1 = 14.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8723/15625) 008723-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.526, top1 = 89.26%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.66 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.318, top1 = 92.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.33 ms.
cifar100       train : [loss = 0.146, top1 = 97.02%], valid : [loss = 1.297, top1 = 69.06%], test : [loss = 1.267, top1 = 69.50%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.62%], valid : [loss = 2.224, top1 = 43.10%], test : [loss = 2.228, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.12%], valid : [loss = 0.606, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8724/15625) 008724-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.475, top1 = 89.35%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.29 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.314, top1 = 92.25%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.35 ms.
cifar100       train : [loss = 0.302, top1 = 91.84%], valid : [loss = 1.252, top1 = 68.10%], test : [loss = 1.265, top1 = 67.52%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.40 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.66%], valid : [loss = 2.213, top1 = 42.30%], test : [loss = 2.244, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.78%], valid : [loss = 0.615, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8725/15625) 008725-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.36%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.39 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.330, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.24 ms.
cifar100       train : [loss = 0.135, top1 = 97.30%], valid : [loss = 1.315, top1 = 68.65%], test : [loss = 1.306, top1 = 68.98%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.04 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.36%], valid : [loss = 2.297, top1 = 41.48%], test : [loss = 2.276, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.40%], valid : [loss = 0.634, top1 = 78.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8726/15625) 008726-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.552, top1 = 88.60%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.63 ms.
cifar10        train : [loss = 0.009, top1 = 99.76%], test  : [loss = 0.349, top1 = 92.10%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.73 ms.
cifar100       train : [loss = 0.124, top1 = 97.06%], valid : [loss = 1.403, top1 = 68.08%], test : [loss = 1.422, top1 = 68.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 38.72%], valid : [loss = 2.525, top1 = 35.90%], test : [loss = 2.544, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 67.83%], valid : [loss = 0.929, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8727/15625) 008727-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.92%], valid : [loss = 0.847, top1 = 72.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10        train : [loss = 0.563, top1 = 80.34%], test  : [loss = 0.723, top1 = 75.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 1.795, top1 = 52.04%], valid : [loss = 2.060, top1 = 46.84%], test : [loss = 2.040, top1 = 47.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 3.596, top1 = 16.67%], valid : [loss = 3.636, top1 = 16.63%], test : [loss = 3.649, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.195, top1 = 57.00%], valid : [loss = 1.245, top1 = 55.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8728/15625) 008728-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.44%], valid : [loss = 0.682, top1 = 85.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.51 ms.
cifar10        train : [loss = 0.057, top1 = 98.22%], test  : [loss = 0.484, top1 = 87.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.13 ms.
cifar100       train : [loss = 0.617, top1 = 81.74%], valid : [loss = 1.495, top1 = 62.72%], test : [loss = 1.512, top1 = 61.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 33.22%], valid : [loss = 2.838, top1 = 30.77%], test : [loss = 2.882, top1 = 30.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8729/15625) 008729-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.543, top1 = 89.03%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.39 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.326, top1 = 92.71%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.49 ms.
cifar100       train : [loss = 0.176, top1 = 95.76%], valid : [loss = 1.303, top1 = 68.94%], test : [loss = 1.250, top1 = 70.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=24.22 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.47%], valid : [loss = 2.161, top1 = 43.73%], test : [loss = 2.215, top1 = 44.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 73.91%], valid : [loss = 0.797, top1 = 71.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8730/15625) 008730-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.487, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.331, top1 = 92.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.10 ms.
cifar100       train : [loss = 0.235, top1 = 94.24%], valid : [loss = 1.246, top1 = 67.82%], test : [loss = 1.234, top1 = 68.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.43%], valid : [loss = 2.296, top1 = 41.87%], test : [loss = 2.295, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8731/15625) 008731-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10-valid  train : [loss = 1.162, top1 = 58.22%], valid : [loss = 1.220, top1 = 56.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.02 ms.
cifar10        train : [loss = 1.128, top1 = 59.92%], test  : [loss = 1.125, top1 = 59.61%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 2.658, top1 = 33.28%], valid : [loss = 2.728, top1 = 31.86%], test : [loss = 2.718, top1 = 31.96%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.63 ms.
ImageNet16-120 train : [loss = 3.830, top1 = 13.01%], valid : [loss = 3.809, top1 = 14.00%], test : [loss = 3.840, top1 = 12.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.662, top1 = 37.70%], valid : [loss = 1.683, top1 = 35.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8732/15625) 008732-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.547, top1 = 88.68%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.351, top1 = 92.01%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.91 ms.
cifar100       train : [loss = 0.240, top1 = 93.60%], valid : [loss = 1.279, top1 = 68.00%], test : [loss = 1.320, top1 = 67.98%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 42.90%], valid : [loss = 2.466, top1 = 37.60%], test : [loss = 2.474, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 67.95%], valid : [loss = 0.931, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8733/15625) 008733-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 91.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.277, top1 = 93.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.90 ms.
cifar100       train : [loss = 0.044, top1 = 99.55%], valid : [loss = 1.358, top1 = 70.88%], test : [loss = 1.331, top1 = 70.78%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 1.442, top1 = 60.76%], valid : [loss = 2.214, top1 = 44.93%], test : [loss = 2.234, top1 = 46.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.345, top1 = 88.15%], valid : [loss = 0.483, top1 = 83.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8734/15625) 008734-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.509, top1 = 88.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.348, top1 = 91.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.52 ms.
cifar100       train : [loss = 0.342, top1 = 90.61%], valid : [loss = 1.304, top1 = 66.98%], test : [loss = 1.318, top1 = 67.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.04 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.79%], valid : [loss = 2.409, top1 = 38.97%], test : [loss = 2.418, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8735/15625) 008735-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.451, top1 = 89.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.315, top1 = 91.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.29 ms.
cifar100       train : [loss = 0.324, top1 = 91.28%], valid : [loss = 1.333, top1 = 66.62%], test : [loss = 1.311, top1 = 67.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.36%], valid : [loss = 2.343, top1 = 39.73%], test : [loss = 2.425, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.53%], valid : [loss = 0.547, top1 = 81.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8736/15625) 008736-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.411, top1 = 90.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.274, top1 = 93.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.42 ms.
cifar100       train : [loss = 0.095, top1 = 98.37%], valid : [loss = 1.285, top1 = 69.74%], test : [loss = 1.293, top1 = 70.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.03 ms.
ImageNet16-120 train : [loss = 1.630, top1 = 55.98%], valid : [loss = 2.196, top1 = 44.87%], test : [loss = 2.175, top1 = 45.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.77%], valid : [loss = 0.516, top1 = 82.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8737/15625) 008737-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.279, top1 = 90.78%], valid : [loss = 0.469, top1 = 84.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 0.300, top1 = 89.87%], test  : [loss = 0.393, top1 = 86.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.10 ms.
cifar100       train : [loss = 1.327, top1 = 63.22%], valid : [loss = 1.512, top1 = 59.08%], test : [loss = 1.496, top1 = 58.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.81%], valid : [loss = 2.909, top1 = 29.40%], test : [loss = 2.944, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8738/15625) 008738-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.10%], valid : [loss = 0.528, top1 = 85.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10        train : [loss = 0.166, top1 = 94.40%], test  : [loss = 0.363, top1 = 88.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.25 ms.
cifar100       train : [loss = 0.981, top1 = 71.65%], valid : [loss = 1.338, top1 = 63.36%], test : [loss = 1.334, top1 = 62.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.87%], valid : [loss = 2.683, top1 = 33.50%], test : [loss = 2.731, top1 = 31.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.21%], valid : [loss = 0.987, top1 = 65.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8739/15625) 008739-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.518, top1 = 88.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.347, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 0.483, top1 = 85.83%], valid : [loss = 1.361, top1 = 65.37%], test : [loss = 1.333, top1 = 65.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.11%], valid : [loss = 2.536, top1 = 36.34%], test : [loss = 2.553, top1 = 36.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.35%], valid : [loss = 0.672, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8740/15625) 008740-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.31 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.14 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.03 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8741/15625) 008741-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.14%], valid : [loss = 0.477, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.298, top1 = 89.99%], test  : [loss = 0.398, top1 = 86.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.69 ms.
cifar100       train : [loss = 1.328, top1 = 63.18%], valid : [loss = 1.533, top1 = 58.12%], test : [loss = 1.506, top1 = 58.64%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.70%], valid : [loss = 2.906, top1 = 29.39%], test : [loss = 2.945, top1 = 28.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8742/15625) 008742-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.54%], valid : [loss = 0.666, top1 = 85.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.036, top1 = 98.90%], test  : [loss = 0.408, top1 = 89.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.15 ms.
cifar100       train : [loss = 0.523, top1 = 84.68%], valid : [loss = 1.429, top1 = 63.42%], test : [loss = 1.384, top1 = 64.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.44 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 39.13%], valid : [loss = 2.587, top1 = 35.03%], test : [loss = 2.584, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.45%], valid : [loss = 0.867, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8743/15625) 008743-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.46%], valid : [loss = 0.630, top1 = 85.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10        train : [loss = 0.051, top1 = 98.49%], test  : [loss = 0.425, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.635, top1 = 81.57%], valid : [loss = 1.419, top1 = 63.19%], test : [loss = 1.393, top1 = 63.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.59%], valid : [loss = 2.619, top1 = 34.29%], test : [loss = 2.673, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.33%], valid : [loss = 0.828, top1 = 71.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8744/15625) 008744-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.64%], valid : [loss = 0.618, top1 = 86.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.75 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.391, top1 = 90.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.33 ms.
cifar100       train : [loss = 0.539, top1 = 84.33%], valid : [loss = 1.428, top1 = 63.54%], test : [loss = 1.409, top1 = 64.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.92%], valid : [loss = 2.540, top1 = 35.97%], test : [loss = 2.617, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.38%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8745/15625) 008745-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.611, top1 = 86.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.377, top1 = 91.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.35 ms.
cifar100       train : [loss = 0.408, top1 = 88.45%], valid : [loss = 1.411, top1 = 65.52%], test : [loss = 1.355, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.88%], valid : [loss = 2.512, top1 = 35.87%], test : [loss = 2.542, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.49%], valid : [loss = 0.787, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8746/15625) 008746-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.094, top1 = 97.16%], valid : [loss = 0.494, top1 = 86.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.113, top1 = 96.28%], test  : [loss = 0.339, top1 = 89.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 0.725, top1 = 79.16%], valid : [loss = 1.233, top1 = 65.94%], test : [loss = 1.213, top1 = 66.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.59%], valid : [loss = 2.447, top1 = 37.63%], test : [loss = 2.481, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.40%], valid : [loss = 0.889, top1 = 68.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8747/15625) 008747-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.60 ms.
cifar10-valid  train : [loss = 1.233, top1 = 55.82%], valid : [loss = 1.278, top1 = 54.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 1.166, top1 = 58.32%], test  : [loss = 1.178, top1 = 57.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.52 ms.
cifar100       train : [loss = 2.729, top1 = 31.66%], valid : [loss = 2.798, top1 = 30.52%], test : [loss = 2.794, top1 = 30.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.60 ms.
ImageNet16-120 train : [loss = 3.876, top1 = 12.30%], valid : [loss = 3.870, top1 = 12.87%], test : [loss = 3.879, top1 = 12.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.711, top1 = 35.38%], valid : [loss = 1.722, top1 = 34.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8748/15625) 008748-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.204, top1 = 93.12%], valid : [loss = 0.551, top1 = 83.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.194, top1 = 93.45%], test  : [loss = 0.399, top1 = 87.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.80 ms.
cifar100       train : [loss = 1.265, top1 = 64.09%], valid : [loss = 1.556, top1 = 57.44%], test : [loss = 1.554, top1 = 57.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.697, top1 = 32.63%], valid : [loss = 2.733, top1 = 31.53%], test : [loss = 2.783, top1 = 30.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8749/15625) 008749-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.548, top1 = 88.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.80 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.330, top1 = 91.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.351, top1 = 90.41%], valid : [loss = 1.285, top1 = 66.92%], test : [loss = 1.289, top1 = 66.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.27%], valid : [loss = 2.397, top1 = 38.37%], test : [loss = 2.405, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.90%], valid : [loss = 0.650, top1 = 77.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8750/15625) 008750-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.565, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.380, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.77 ms.
cifar100       train : [loss = 0.168, top1 = 96.34%], valid : [loss = 1.451, top1 = 66.91%], test : [loss = 1.420, top1 = 67.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.22%], valid : [loss = 2.466, top1 = 38.00%], test : [loss = 2.455, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.90%], valid : [loss = 0.703, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8751/15625) 008751-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.473, top1 = 89.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.309, top1 = 92.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.44 ms.
cifar100       train : [loss = 0.250, top1 = 93.70%], valid : [loss = 1.235, top1 = 69.20%], test : [loss = 1.255, top1 = 68.73%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.40 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.76%], valid : [loss = 2.244, top1 = 42.16%], test : [loss = 2.262, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.24%], valid : [loss = 0.594, top1 = 79.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8752/15625) 008752-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.483, top1 = 89.94%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.321, top1 = 92.99%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.26 ms.
cifar100       train : [loss = 0.132, top1 = 97.29%], valid : [loss = 1.312, top1 = 68.80%], test : [loss = 1.276, top1 = 69.16%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.99 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.05%], valid : [loss = 2.231, top1 = 43.13%], test : [loss = 2.271, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.36%], valid : [loss = 0.686, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8753/15625) 008753-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.558, top1 = 88.80%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.56 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.345, top1 = 92.29%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.65 ms.
cifar100       train : [loss = 0.170, top1 = 96.25%], valid : [loss = 1.236, top1 = 69.68%], test : [loss = 1.233, top1 = 70.24%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.58 ms.
ImageNet16-120 train : [loss = 1.796, top1 = 52.17%], valid : [loss = 2.174, top1 = 44.67%], test : [loss = 2.216, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.17%], valid : [loss = 0.794, top1 = 72.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8754/15625) 008754-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.514, top1 = 89.32%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.71 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.307, top1 = 93.11%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.50 ms.
cifar100       train : [loss = 0.148, top1 = 96.91%], valid : [loss = 1.269, top1 = 69.50%], test : [loss = 1.300, top1 = 68.94%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=25.50 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.69%], valid : [loss = 2.307, top1 = 40.93%], test : [loss = 2.288, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.40%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8755/15625) 008755-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.570, top1 = 87.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.038, top1 = 98.86%], test  : [loss = 0.397, top1 = 89.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.12 ms.
cifar100       train : [loss = 0.564, top1 = 83.40%], valid : [loss = 1.407, top1 = 63.94%], test : [loss = 1.398, top1 = 63.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.91%], valid : [loss = 2.620, top1 = 34.12%], test : [loss = 2.661, top1 = 33.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8756/15625) 008756-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.58%], valid : [loss = 0.448, top1 = 86.47%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10        train : [loss = 0.150, top1 = 95.07%], test  : [loss = 0.340, top1 = 89.09%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.45 ms.
cifar100       train : [loss = 0.991, top1 = 71.85%], valid : [loss = 1.338, top1 = 62.54%], test : [loss = 1.358, top1 = 62.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.19%], valid : [loss = 2.681, top1 = 33.03%], test : [loss = 2.678, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.755, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8757/15625) 008757-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.70%], valid : [loss = 0.456, top1 = 85.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10        train : [loss = 0.161, top1 = 94.82%], test  : [loss = 0.346, top1 = 88.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=20.40 ms.
cifar100       train : [loss = 1.012, top1 = 71.29%], valid : [loss = 1.373, top1 = 61.52%], test : [loss = 1.363, top1 = 62.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.92%], valid : [loss = 2.660, top1 = 33.67%], test : [loss = 2.714, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8758/15625) 008758-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.530, top1 = 88.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.359, top1 = 91.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 0.294, top1 = 92.10%], valid : [loss = 1.309, top1 = 66.82%], test : [loss = 1.338, top1 = 66.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.99%], valid : [loss = 2.418, top1 = 38.37%], test : [loss = 2.459, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.32%], valid : [loss = 0.897, top1 = 68.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8759/15625) 008759-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.33%], valid : [loss = 0.498, top1 = 84.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10        train : [loss = 0.174, top1 = 94.20%], test  : [loss = 0.376, top1 = 88.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.09 ms.
cifar100       train : [loss = 1.052, top1 = 69.82%], valid : [loss = 1.413, top1 = 60.82%], test : [loss = 1.405, top1 = 60.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.47%], valid : [loss = 2.651, top1 = 34.37%], test : [loss = 2.699, top1 = 33.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.44%], valid : [loss = 0.915, top1 = 67.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8760/15625) 008760-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.78%], valid : [loss = 0.461, top1 = 86.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.156, top1 = 94.96%], test  : [loss = 0.351, top1 = 88.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.05 ms.
cifar100       train : [loss = 1.021, top1 = 70.96%], valid : [loss = 1.378, top1 = 61.20%], test : [loss = 1.362, top1 = 61.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.07%], valid : [loss = 2.660, top1 = 34.07%], test : [loss = 2.698, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8761/15625) 008761-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.531, top1 = 89.74%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.69 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.341, top1 = 93.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.82 ms.
cifar100       train : [loss = 0.066, top1 = 99.07%], valid : [loss = 1.392, top1 = 69.40%], test : [loss = 1.311, top1 = 70.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.737, top1 = 53.65%], valid : [loss = 2.213, top1 = 42.03%], test : [loss = 2.257, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.687, top1 = 76.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8762/15625) 008762-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.66 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.70 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.81 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8763/15625) 008763-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.490, top1 = 88.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.318, top1 = 92.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.57 ms.
cifar100       train : [loss = 0.325, top1 = 91.26%], valid : [loss = 1.265, top1 = 66.60%], test : [loss = 1.245, top1 = 67.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.044, top1 = 46.59%], valid : [loss = 2.339, top1 = 40.77%], test : [loss = 2.351, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.78%], valid : [loss = 0.619, top1 = 78.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8764/15625) 008764-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.87 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.30%], valid : [loss = 0.472, top1 = 84.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.48 ms.
cifar10        train : [loss = 0.305, top1 = 89.68%], test  : [loss = 0.399, top1 = 86.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.38 ms.
cifar100       train : [loss = 1.346, top1 = 62.82%], valid : [loss = 1.547, top1 = 57.18%], test : [loss = 1.537, top1 = 57.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.45%], valid : [loss = 2.914, top1 = 28.90%], test : [loss = 2.963, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8765/15625) 008765-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8766/15625) 008766-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.210, top1 = 92.86%], valid : [loss = 0.543, top1 = 83.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.219, top1 = 92.50%], test  : [loss = 0.410, top1 = 87.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 1.296, top1 = 63.19%], valid : [loss = 1.580, top1 = 56.97%], test : [loss = 1.592, top1 = 56.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.733, top1 = 31.93%], valid : [loss = 2.766, top1 = 31.17%], test : [loss = 2.800, top1 = 30.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.38%], valid : [loss = 0.984, top1 = 65.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8767/15625) 008767-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.529, top1 = 88.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.392, top1 = 91.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.31 ms.
cifar100       train : [loss = 0.261, top1 = 92.96%], valid : [loss = 1.423, top1 = 66.44%], test : [loss = 1.409, top1 = 66.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.77%], valid : [loss = 2.452, top1 = 37.97%], test : [loss = 2.499, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.14%], valid : [loss = 0.638, top1 = 78.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8768/15625) 008768-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.422, top1 = 90.34%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.94%], test  : [loss = 0.297, top1 = 92.76%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.90 ms.
cifar100       train : [loss = 0.095, top1 = 98.48%], valid : [loss = 1.263, top1 = 70.64%], test : [loss = 1.244, top1 = 71.12%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 1.579, top1 = 57.42%], valid : [loss = 2.124, top1 = 45.63%], test : [loss = 2.183, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.58%], valid : [loss = 0.520, top1 = 82.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8769/15625) 008769-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.49%], valid : [loss = 0.774, top1 = 73.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 0.589, top1 = 79.54%], test  : [loss = 0.648, top1 = 77.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.76 ms.
cifar100       train : [loss = 2.103, top1 = 43.71%], valid : [loss = 2.241, top1 = 41.17%], test : [loss = 2.230, top1 = 41.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 3.317, top1 = 20.87%], valid : [loss = 3.303, top1 = 21.26%], test : [loss = 3.350, top1 = 20.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.287, top1 = 53.38%], valid : [loss = 1.344, top1 = 51.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8770/15625) 008770-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.57%], valid : [loss = 0.547, top1 = 87.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.88 ms.
cifar10        train : [loss = 0.033, top1 = 99.05%], test  : [loss = 0.382, top1 = 90.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.79 ms.
cifar100       train : [loss = 0.348, top1 = 90.27%], valid : [loss = 1.284, top1 = 67.74%], test : [loss = 1.269, top1 = 67.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.31%], valid : [loss = 2.421, top1 = 38.10%], test : [loss = 2.434, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.44%], valid : [loss = 0.888, top1 = 68.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8771/15625) 008771-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.635, top1 = 86.69%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.442, top1 = 90.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.44 ms.
cifar100       train : [loss = 0.179, top1 = 95.77%], valid : [loss = 1.649, top1 = 63.58%], test : [loss = 1.618, top1 = 63.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.008, top1 = 47.62%], valid : [loss = 2.426, top1 = 38.50%], test : [loss = 2.441, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.67%], valid : [loss = 0.821, top1 = 70.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8772/15625) 008772-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.486, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.309, top1 = 92.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.00 ms.
cifar100       train : [loss = 0.239, top1 = 94.15%], valid : [loss = 1.234, top1 = 68.85%], test : [loss = 1.265, top1 = 68.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.67%], valid : [loss = 2.258, top1 = 42.23%], test : [loss = 2.277, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.74%], valid : [loss = 0.666, top1 = 77.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8773/15625) 008773-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.586, top1 = 88.16%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.09 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.404, top1 = 91.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.51 ms.
cifar100       train : [loss = 0.211, top1 = 95.03%], valid : [loss = 1.423, top1 = 66.24%], test : [loss = 1.422, top1 = 66.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.19%], valid : [loss = 2.477, top1 = 38.37%], test : [loss = 2.540, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.12%], valid : [loss = 0.727, top1 = 74.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8774/15625) 008774-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.473, top1 = 90.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.89 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.322, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.59 ms.
cifar100       train : [loss = 0.110, top1 = 97.86%], valid : [loss = 1.282, top1 = 70.06%], test : [loss = 1.285, top1 = 70.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 1.694, top1 = 54.64%], valid : [loss = 2.207, top1 = 44.10%], test : [loss = 2.223, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 83.35%], valid : [loss = 0.577, top1 = 80.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8775/15625) 008775-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.434, top1 = 90.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.289, top1 = 93.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.92 ms.
cifar100       train : [loss = 0.139, top1 = 96.87%], valid : [loss = 1.334, top1 = 69.62%], test : [loss = 1.308, top1 = 69.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.58%], valid : [loss = 2.222, top1 = 42.30%], test : [loss = 2.267, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.66%], valid : [loss = 0.510, top1 = 83.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8776/15625) 008776-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.546, top1 = 87.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.38 ms.
cifar10        train : [loss = 0.033, top1 = 99.00%], test  : [loss = 0.364, top1 = 91.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.08 ms.
cifar100       train : [loss = 0.623, top1 = 82.07%], valid : [loss = 1.403, top1 = 62.92%], test : [loss = 1.398, top1 = 62.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 35.66%], valid : [loss = 2.642, top1 = 32.33%], test : [loss = 2.644, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.42%], valid : [loss = 0.941, top1 = 66.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8777/15625) 008777-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.526, top1 = 88.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.342, top1 = 91.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.00 ms.
cifar100       train : [loss = 0.350, top1 = 90.55%], valid : [loss = 1.276, top1 = 67.34%], test : [loss = 1.270, top1 = 68.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.27%], valid : [loss = 2.442, top1 = 38.77%], test : [loss = 2.405, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8778/15625) 008778-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.243, top1 = 91.66%], valid : [loss = 0.514, top1 = 83.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.243, top1 = 91.68%], test  : [loss = 0.387, top1 = 87.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.42 ms.
cifar100       train : [loss = 1.338, top1 = 62.23%], valid : [loss = 1.599, top1 = 56.40%], test : [loss = 1.610, top1 = 56.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.858, top1 = 29.56%], valid : [loss = 2.872, top1 = 29.72%], test : [loss = 2.923, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.46%], valid : [loss = 1.001, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8779/15625) 008779-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.538, top1 = 88.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.027, top1 = 99.23%], test  : [loss = 0.369, top1 = 91.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.429, top1 = 87.66%], valid : [loss = 1.234, top1 = 67.62%], test : [loss = 1.251, top1 = 66.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.27%], valid : [loss = 2.359, top1 = 40.73%], test : [loss = 2.363, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.15%], valid : [loss = 0.836, top1 = 70.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8780/15625) 008780-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.82%], valid : [loss = 0.598, top1 = 85.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.087, top1 = 97.18%], test  : [loss = 0.398, top1 = 88.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 0.771, top1 = 77.22%], valid : [loss = 1.405, top1 = 62.86%], test : [loss = 1.407, top1 = 62.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.20%], valid : [loss = 2.754, top1 = 31.80%], test : [loss = 2.804, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8781/15625) 008781-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.24%], valid : [loss = 0.468, top1 = 85.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.158, top1 = 94.91%], test  : [loss = 0.349, top1 = 88.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 0.991, top1 = 71.74%], valid : [loss = 1.359, top1 = 62.18%], test : [loss = 1.350, top1 = 62.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.81%], valid : [loss = 2.679, top1 = 32.43%], test : [loss = 2.697, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8782/15625) 008782-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.07%], valid : [loss = 0.539, top1 = 83.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.05 ms.
cifar10        train : [loss = 0.230, top1 = 92.17%], test  : [loss = 0.400, top1 = 86.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 1.338, top1 = 62.54%], valid : [loss = 1.603, top1 = 56.48%], test : [loss = 1.598, top1 = 57.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.851, top1 = 29.66%], valid : [loss = 2.862, top1 = 28.83%], test : [loss = 2.919, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.27%], valid : [loss = 1.030, top1 = 63.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8783/15625) 008783-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.453, top1 = 89.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.319, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.33 ms.
cifar100       train : [loss = 0.226, top1 = 94.42%], valid : [loss = 1.286, top1 = 67.98%], test : [loss = 1.278, top1 = 68.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.29%], valid : [loss = 2.291, top1 = 41.73%], test : [loss = 2.338, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.77%], valid : [loss = 0.554, top1 = 81.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8784/15625) 008784-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.520, top1 = 89.70%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.12 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.328, top1 = 92.64%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.01 ms.
cifar100       train : [loss = 0.115, top1 = 97.67%], valid : [loss = 1.378, top1 = 68.42%], test : [loss = 1.374, top1 = 69.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.95%], valid : [loss = 2.300, top1 = 42.33%], test : [loss = 2.277, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.82%], valid : [loss = 0.811, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8785/15625) 008785-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.527, top1 = 88.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.351, top1 = 91.82%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.51 ms.
cifar100       train : [loss = 0.302, top1 = 91.70%], valid : [loss = 1.272, top1 = 67.44%], test : [loss = 1.292, top1 = 66.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.52%], valid : [loss = 2.441, top1 = 37.43%], test : [loss = 2.445, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.49%], valid : [loss = 0.811, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8786/15625) 008786-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.40%], valid : [loss = 0.583, top1 = 86.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.050, top1 = 98.48%], test  : [loss = 0.405, top1 = 89.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.614, top1 = 81.74%], valid : [loss = 1.415, top1 = 63.34%], test : [loss = 1.430, top1 = 62.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.28%], valid : [loss = 2.618, top1 = 34.37%], test : [loss = 2.674, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.80%], valid : [loss = 0.707, top1 = 75.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8787/15625) 008787-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.526, top1 = 88.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.349, top1 = 91.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.306, top1 = 91.60%], valid : [loss = 1.333, top1 = 66.78%], test : [loss = 1.306, top1 = 67.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.165, top1 = 43.83%], valid : [loss = 2.432, top1 = 38.77%], test : [loss = 2.415, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8788/15625) 008788-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.66%], valid : [loss = 0.667, top1 = 83.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=12.53 ms.
cifar10        train : [loss = 0.084, top1 = 97.36%], test  : [loss = 0.418, top1 = 87.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.00 ms.
cifar100       train : [loss = 0.793, top1 = 76.62%], valid : [loss = 1.469, top1 = 61.22%], test : [loss = 1.472, top1 = 61.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.90%], valid : [loss = 2.749, top1 = 31.17%], test : [loss = 2.779, top1 = 31.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.51%], valid : [loss = 0.850, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8789/15625) 008789-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.44%], valid : [loss = 0.519, top1 = 85.38%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.75 ms.
cifar10        train : [loss = 0.169, top1 = 94.38%], test  : [loss = 0.374, top1 = 88.50%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.71 ms.
cifar100       train : [loss = 0.973, top1 = 71.76%], valid : [loss = 1.475, top1 = 60.58%], test : [loss = 1.456, top1 = 60.22%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.12%], valid : [loss = 2.732, top1 = 32.83%], test : [loss = 2.763, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.901, top1 = 67.77%], valid : [loss = 0.939, top1 = 66.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8790/15625) 008790-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.65 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.60 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8791/15625) 008791-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.531, top1 = 88.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.356, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.48 ms.
cifar100       train : [loss = 0.175, top1 = 95.64%], valid : [loss = 1.360, top1 = 67.66%], test : [loss = 1.351, top1 = 68.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.67%], valid : [loss = 2.514, top1 = 36.00%], test : [loss = 2.567, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.87%], valid : [loss = 0.957, top1 = 65.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8792/15625) 008792-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.72 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8793/15625) 008793-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.64%], valid : [loss = 0.562, top1 = 87.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.23 ms.
cifar10        train : [loss = 0.028, top1 = 99.19%], test  : [loss = 0.363, top1 = 91.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.47 ms.
cifar100       train : [loss = 0.406, top1 = 88.59%], valid : [loss = 1.374, top1 = 65.96%], test : [loss = 1.352, top1 = 65.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.66%], valid : [loss = 2.414, top1 = 39.63%], test : [loss = 2.412, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.73%], valid : [loss = 0.895, top1 = 68.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8794/15625) 008794-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.62 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.577, top1 = 87.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.390, top1 = 91.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.03 ms.
cifar100       train : [loss = 0.396, top1 = 88.93%], valid : [loss = 1.419, top1 = 64.51%], test : [loss = 1.383, top1 = 65.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.72%], valid : [loss = 2.512, top1 = 36.38%], test : [loss = 2.534, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8795/15625) 008795-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.35%], valid : [loss = 0.555, top1 = 84.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.37 ms.
cifar10        train : [loss = 0.195, top1 = 93.37%], test  : [loss = 0.397, top1 = 87.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.46 ms.
cifar100       train : [loss = 1.040, top1 = 69.94%], valid : [loss = 1.425, top1 = 61.15%], test : [loss = 1.419, top1 = 60.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.712, top1 = 32.27%], valid : [loss = 2.760, top1 = 31.66%], test : [loss = 2.802, top1 = 30.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.64%], valid : [loss = 0.997, top1 = 64.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8796/15625) 008796-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.593, top1 = 87.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.379, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.161, top1 = 96.48%], valid : [loss = 1.499, top1 = 66.21%], test : [loss = 1.524, top1 = 65.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 47.02%], valid : [loss = 2.445, top1 = 38.56%], test : [loss = 2.454, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.57%], valid : [loss = 0.718, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8797/15625) 008797-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.53%], valid : [loss = 0.732, top1 = 84.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.08 ms.
cifar10        train : [loss = 0.052, top1 = 98.49%], test  : [loss = 0.455, top1 = 88.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.23 ms.
cifar100       train : [loss = 0.556, top1 = 84.21%], valid : [loss = 1.664, top1 = 58.80%], test : [loss = 1.661, top1 = 59.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.463, top1 = 37.42%], valid : [loss = 2.709, top1 = 32.23%], test : [loss = 2.773, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.26%], valid : [loss = 0.878, top1 = 69.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8798/15625) 008798-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.543, top1 = 87.95%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.76 ms.
cifar10        train : [loss = 0.020, top1 = 99.42%], test  : [loss = 0.349, top1 = 91.60%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.78 ms.
cifar100       train : [loss = 0.289, top1 = 91.99%], valid : [loss = 1.316, top1 = 67.68%], test : [loss = 1.298, top1 = 67.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.15 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 44.98%], valid : [loss = 2.347, top1 = 39.33%], test : [loss = 2.369, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.03%], valid : [loss = 0.817, top1 = 71.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8799/15625) 008799-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.38%], valid : [loss = 0.744, top1 = 74.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10        train : [loss = 0.565, top1 = 80.20%], test  : [loss = 0.639, top1 = 78.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 1.995, top1 = 45.77%], valid : [loss = 2.118, top1 = 43.93%], test : [loss = 2.118, top1 = 43.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.38%], valid : [loss = 3.040, top1 = 26.19%], test : [loss = 3.074, top1 = 24.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.161, top1 = 57.76%], valid : [loss = 1.187, top1 = 57.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8800/15625) 008800-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.64%], valid : [loss = 0.640, top1 = 78.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10        train : [loss = 0.334, top1 = 88.52%], test  : [loss = 0.466, top1 = 84.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.37 ms.
cifar100       train : [loss = 1.659, top1 = 54.26%], valid : [loss = 1.870, top1 = 49.89%], test : [loss = 1.881, top1 = 49.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 3.219, top1 = 22.56%], valid : [loss = 3.213, top1 = 22.90%], test : [loss = 3.267, top1 = 22.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.86%], valid : [loss = 1.073, top1 = 61.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8801/15625) 008801-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.525, top1 = 88.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.332, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.99 ms.
cifar100       train : [loss = 0.333, top1 = 91.13%], valid : [loss = 1.271, top1 = 66.84%], test : [loss = 1.293, top1 = 66.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.32%], valid : [loss = 2.439, top1 = 38.90%], test : [loss = 2.425, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8802/15625) 008802-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.69%], valid : [loss = 0.538, top1 = 88.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.40 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.353, top1 = 91.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.74 ms.
cifar100       train : [loss = 0.433, top1 = 87.33%], valid : [loss = 1.284, top1 = 66.40%], test : [loss = 1.247, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.198, top1 = 42.98%], valid : [loss = 2.391, top1 = 39.60%], test : [loss = 2.389, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.72%], valid : [loss = 0.787, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8803/15625) 008803-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.33%], valid : [loss = 0.531, top1 = 87.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.75 ms.
cifar10        train : [loss = 0.061, top1 = 98.08%], test  : [loss = 0.370, top1 = 90.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.84 ms.
cifar100       train : [loss = 0.648, top1 = 80.89%], valid : [loss = 1.327, top1 = 63.95%], test : [loss = 1.314, top1 = 64.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.40%], valid : [loss = 2.509, top1 = 36.82%], test : [loss = 2.515, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.84%], valid : [loss = 0.775, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8804/15625) 008804-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.456, top1 = 89.33%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=16.86 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.310, top1 = 92.03%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=16.01 ms.
cifar100       train : [loss = 0.316, top1 = 91.49%], valid : [loss = 1.299, top1 = 67.37%], test : [loss = 1.287, top1 = 68.01%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.44%], valid : [loss = 2.352, top1 = 40.29%], test : [loss = 2.415, top1 = 39.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 84.11%], valid : [loss = 0.567, top1 = 80.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8805/15625) 008805-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.563, top1 = 87.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.380, top1 = 91.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.14 ms.
cifar100       train : [loss = 0.379, top1 = 89.33%], valid : [loss = 1.412, top1 = 65.52%], test : [loss = 1.404, top1 = 64.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.23%], valid : [loss = 2.507, top1 = 36.67%], test : [loss = 2.540, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8806/15625) 008806-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.15%], valid : [loss = 0.564, top1 = 86.85%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.46 ms.
cifar10        train : [loss = 0.073, top1 = 97.61%], test  : [loss = 0.364, top1 = 90.06%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.18 ms.
cifar100       train : [loss = 0.655, top1 = 80.61%], valid : [loss = 1.334, top1 = 64.36%], test : [loss = 1.324, top1 = 65.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.90%], valid : [loss = 2.502, top1 = 36.97%], test : [loss = 2.519, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.88%], valid : [loss = 0.780, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8807/15625) 008807-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.31%], valid : [loss = 0.458, top1 = 86.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.115, top1 = 96.43%], test  : [loss = 0.330, top1 = 89.44%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.43 ms.
cifar100       train : [loss = 0.853, top1 = 75.73%], valid : [loss = 1.286, top1 = 64.29%], test : [loss = 1.276, top1 = 63.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.74%], valid : [loss = 2.616, top1 = 34.52%], test : [loss = 2.654, top1 = 33.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.09%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8808/15625) 008808-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.33%], valid : [loss = 0.479, top1 = 85.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.49 ms.
cifar10        train : [loss = 0.161, top1 = 94.65%], test  : [loss = 0.349, top1 = 88.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.57 ms.
cifar100       train : [loss = 0.982, top1 = 72.28%], valid : [loss = 1.330, top1 = 62.04%], test : [loss = 1.339, top1 = 62.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.76%], valid : [loss = 2.673, top1 = 33.93%], test : [loss = 2.716, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8809/15625) 008809-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.65%], valid : [loss = 0.470, top1 = 85.94%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=17.55 ms.
cifar10        train : [loss = 0.159, top1 = 94.78%], test  : [loss = 0.346, top1 = 88.92%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=16.45 ms.
cifar100       train : [loss = 1.019, top1 = 71.02%], valid : [loss = 1.361, top1 = 61.71%], test : [loss = 1.368, top1 = 61.89%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.82%], valid : [loss = 2.689, top1 = 32.79%], test : [loss = 2.695, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8810/15625) 008810-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.99%], valid : [loss = 0.530, top1 = 83.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.242, top1 = 91.70%], test  : [loss = 0.392, top1 = 87.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 1.321, top1 = 62.64%], valid : [loss = 1.602, top1 = 56.59%], test : [loss = 1.582, top1 = 56.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.779, top1 = 31.12%], valid : [loss = 2.793, top1 = 31.20%], test : [loss = 2.832, top1 = 30.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.26%], valid : [loss = 1.027, top1 = 63.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8811/15625) 008811-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.65%], valid : [loss = 0.867, top1 = 71.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.68 ms.
cifar10        train : [loss = 0.554, top1 = 80.71%], test  : [loss = 0.722, top1 = 75.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.66 ms.
cifar100       train : [loss = 1.783, top1 = 52.06%], valid : [loss = 2.049, top1 = 46.89%], test : [loss = 2.073, top1 = 46.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.55 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.69%], valid : [loss = 3.639, top1 = 16.73%], test : [loss = 3.675, top1 = 15.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8812/15625) 008812-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.171, top1 = 94.40%], valid : [loss = 0.448, top1 = 86.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10        train : [loss = 0.151, top1 = 95.12%], test  : [loss = 0.317, top1 = 89.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.60 ms.
cifar100       train : [loss = 0.933, top1 = 73.41%], valid : [loss = 1.277, top1 = 63.73%], test : [loss = 1.259, top1 = 64.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.693, top1 = 32.94%], valid : [loss = 2.689, top1 = 32.74%], test : [loss = 2.728, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 65.23%], valid : [loss = 0.995, top1 = 64.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8813/15625) 008813-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.506, top1 = 89.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.334, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.08 ms.
cifar100       train : [loss = 0.358, top1 = 90.16%], valid : [loss = 1.269, top1 = 66.68%], test : [loss = 1.269, top1 = 68.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.91%], valid : [loss = 2.401, top1 = 38.07%], test : [loss = 2.406, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8814/15625) 008814-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.72%], valid : [loss = 0.475, top1 = 86.23%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.29 ms.
cifar10        train : [loss = 0.118, top1 = 96.39%], test  : [loss = 0.335, top1 = 89.41%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.74 ms.
cifar100       train : [loss = 0.762, top1 = 78.78%], valid : [loss = 1.282, top1 = 64.20%], test : [loss = 1.287, top1 = 63.78%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=23.13 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.70%], valid : [loss = 2.587, top1 = 35.23%], test : [loss = 2.617, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.88%], valid : [loss = 0.841, top1 = 70.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8815/15625) 008815-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.33%], valid : [loss = 0.758, top1 = 73.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10        train : [loss = 0.592, top1 = 79.42%], test  : [loss = 0.650, top1 = 77.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.61 ms.
cifar100       train : [loss = 2.081, top1 = 44.34%], valid : [loss = 2.209, top1 = 42.06%], test : [loss = 2.189, top1 = 42.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.98 ms.
ImageNet16-120 train : [loss = 3.298, top1 = 21.27%], valid : [loss = 3.286, top1 = 21.63%], test : [loss = 3.319, top1 = 21.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 53.39%], valid : [loss = 1.360, top1 = 51.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8816/15625) 008816-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.475, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.306, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.16 ms.
cifar100       train : [loss = 0.316, top1 = 91.55%], valid : [loss = 1.244, top1 = 67.57%], test : [loss = 1.258, top1 = 67.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.57%], valid : [loss = 2.315, top1 = 40.93%], test : [loss = 2.365, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8817/15625) 008817-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.544, top1 = 88.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.66 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.351, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.47 ms.
cifar100       train : [loss = 0.244, top1 = 93.51%], valid : [loss = 1.296, top1 = 67.96%], test : [loss = 1.330, top1 = 67.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 44.03%], valid : [loss = 2.426, top1 = 39.03%], test : [loss = 2.423, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8818/15625) 008818-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.74%], valid : [loss = 0.452, top1 = 86.57%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10        train : [loss = 0.152, top1 = 94.95%], test  : [loss = 0.344, top1 = 89.18%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.95 ms.
cifar100       train : [loss = 0.955, top1 = 72.99%], valid : [loss = 1.342, top1 = 62.40%], test : [loss = 1.338, top1 = 62.66%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 33.95%], valid : [loss = 2.658, top1 = 34.30%], test : [loss = 2.696, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.40%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8819/15625) 008819-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.548, top1 = 88.74%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.71 ms.
cifar10        train : [loss = 0.012, top1 = 99.68%], test  : [loss = 0.358, top1 = 92.18%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.62 ms.
cifar100       train : [loss = 0.169, top1 = 95.95%], valid : [loss = 1.337, top1 = 68.26%], test : [loss = 1.352, top1 = 68.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.27 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.09%], valid : [loss = 2.404, top1 = 38.83%], test : [loss = 2.423, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.10%], valid : [loss = 0.980, top1 = 64.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8820/15625) 008820-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.24%], valid : [loss = 0.564, top1 = 83.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.46 ms.
cifar10        train : [loss = 0.208, top1 = 92.88%], test  : [loss = 0.405, top1 = 87.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.71 ms.
cifar100       train : [loss = 1.277, top1 = 63.71%], valid : [loss = 1.578, top1 = 56.81%], test : [loss = 1.578, top1 = 56.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.706, top1 = 32.41%], valid : [loss = 2.721, top1 = 32.11%], test : [loss = 2.782, top1 = 31.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.42%], valid : [loss = 1.006, top1 = 64.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8821/15625) 008821-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.525, top1 = 88.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.33 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.391, top1 = 91.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.155, top1 = 96.70%], valid : [loss = 1.440, top1 = 67.76%], test : [loss = 1.445, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.57%], valid : [loss = 2.391, top1 = 39.93%], test : [loss = 2.397, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.11%], valid : [loss = 0.712, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8822/15625) 008822-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.82 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.56%], valid : [loss = 0.551, top1 = 87.72%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.07 ms.
cifar10        train : [loss = 0.020, top1 = 99.42%], test  : [loss = 0.355, top1 = 91.38%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.44 ms.
cifar100       train : [loss = 0.272, top1 = 92.32%], valid : [loss = 1.370, top1 = 67.72%], test : [loss = 1.393, top1 = 67.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 39.94%], valid : [loss = 2.491, top1 = 36.80%], test : [loss = 2.521, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.40%], valid : [loss = 0.952, top1 = 66.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8823/15625) 008823-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.590, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.384, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.407, top1 = 88.51%], valid : [loss = 1.414, top1 = 64.90%], test : [loss = 1.388, top1 = 65.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.18%], valid : [loss = 2.502, top1 = 36.92%], test : [loss = 2.508, top1 = 37.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.86%], valid : [loss = 0.801, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8824/15625) 008824-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.504, top1 = 89.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.288, top1 = 93.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.13 ms.
cifar100       train : [loss = 0.130, top1 = 97.32%], valid : [loss = 1.280, top1 = 69.28%], test : [loss = 1.317, top1 = 69.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.21 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.73%], valid : [loss = 2.262, top1 = 42.10%], test : [loss = 2.270, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8825/15625) 008825-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.553, top1 = 88.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.343, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.307, top1 = 91.55%], valid : [loss = 1.289, top1 = 67.16%], test : [loss = 1.287, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.11%], valid : [loss = 2.425, top1 = 38.93%], test : [loss = 2.436, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.859, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8826/15625) 008826-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.27%], valid : [loss = 0.465, top1 = 85.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.154, top1 = 95.06%], test  : [loss = 0.343, top1 = 89.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.16 ms.
cifar100       train : [loss = 1.005, top1 = 71.37%], valid : [loss = 1.366, top1 = 62.30%], test : [loss = 1.365, top1 = 62.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.80%], valid : [loss = 2.680, top1 = 33.73%], test : [loss = 2.718, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8827/15625) 008827-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.458, top1 = 89.96%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.34 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.300, top1 = 93.07%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.78 ms.
cifar100       train : [loss = 0.115, top1 = 97.98%], valid : [loss = 1.276, top1 = 69.80%], test : [loss = 1.312, top1 = 69.40%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.03 ms.
ImageNet16-120 train : [loss = 1.623, top1 = 56.35%], valid : [loss = 2.135, top1 = 44.60%], test : [loss = 2.150, top1 = 45.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.31%], valid : [loss = 0.582, top1 = 80.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8828/15625) 008828-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.587, top1 = 87.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.415, top1 = 90.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.80 ms.
cifar100       train : [loss = 0.385, top1 = 89.23%], valid : [loss = 1.387, top1 = 65.74%], test : [loss = 1.413, top1 = 64.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.41%], valid : [loss = 2.499, top1 = 37.60%], test : [loss = 2.543, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8829/15625) 008829-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.22%], valid : [loss = 0.871, top1 = 70.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.693, top1 = 75.80%], test  : [loss = 0.776, top1 = 73.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.23 ms.
cifar100       train : [loss = 1.972, top1 = 47.77%], valid : [loss = 2.120, top1 = 45.11%], test : [loss = 2.155, top1 = 44.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.79%], valid : [loss = 3.667, top1 = 16.12%], test : [loss = 3.694, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8830/15625) 008830-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.83%], valid : [loss = 0.859, top1 = 80.14%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.31 ms.
cifar10        train : [loss = 0.130, top1 = 95.65%], test  : [loss = 0.519, top1 = 85.55%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.53 ms.
cifar100       train : [loss = 0.848, top1 = 75.46%], valid : [loss = 1.672, top1 = 57.44%], test : [loss = 1.674, top1 = 57.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.29 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.29%], valid : [loss = 3.170, top1 = 23.80%], test : [loss = 3.207, top1 = 23.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 63.04%], valid : [loss = 1.087, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8831/15625) 008831-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.560, top1 = 87.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.385, top1 = 91.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.40 ms.
cifar100       train : [loss = 0.356, top1 = 90.08%], valid : [loss = 1.381, top1 = 65.36%], test : [loss = 1.394, top1 = 66.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.258, top1 = 41.86%], valid : [loss = 2.468, top1 = 37.47%], test : [loss = 2.496, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.24%], valid : [loss = 0.773, top1 = 73.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8832/15625) 008832-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.508, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.317, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.01 ms.
cifar100       train : [loss = 0.231, top1 = 94.40%], valid : [loss = 1.288, top1 = 68.00%], test : [loss = 1.259, top1 = 69.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.75%], valid : [loss = 2.299, top1 = 40.70%], test : [loss = 2.271, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.698, top1 = 75.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8833/15625) 008833-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.549, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.382, top1 = 91.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 0.178, top1 = 96.09%], valid : [loss = 1.417, top1 = 67.94%], test : [loss = 1.381, top1 = 68.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.969, top1 = 48.33%], valid : [loss = 2.453, top1 = 39.03%], test : [loss = 2.469, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.52%], valid : [loss = 0.715, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8834/15625) 008834-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.532, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.364, top1 = 92.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.98 ms.
cifar100       train : [loss = 0.113, top1 = 97.92%], valid : [loss = 1.433, top1 = 67.66%], test : [loss = 1.436, top1 = 67.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.73%], valid : [loss = 2.385, top1 = 40.47%], test : [loss = 2.414, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.74%], valid : [loss = 0.711, top1 = 75.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8835/15625) 008835-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.546, top1 = 88.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.369, top1 = 91.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.28 ms.
cifar100       train : [loss = 0.163, top1 = 96.38%], valid : [loss = 1.436, top1 = 66.57%], test : [loss = 1.400, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 49.20%], valid : [loss = 2.346, top1 = 40.38%], test : [loss = 2.362, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.26%], valid : [loss = 0.669, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8836/15625) 008836-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.329, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.93 ms.
cifar100       train : [loss = 0.340, top1 = 90.55%], valid : [loss = 1.268, top1 = 67.10%], test : [loss = 1.305, top1 = 67.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.00%], valid : [loss = 2.416, top1 = 37.67%], test : [loss = 2.438, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8837/15625) 008837-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.637, top1 = 86.09%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10        train : [loss = 0.025, top1 = 99.44%], test  : [loss = 0.431, top1 = 89.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.48 ms.
cifar100       train : [loss = 0.378, top1 = 89.90%], valid : [loss = 1.454, top1 = 64.06%], test : [loss = 1.433, top1 = 64.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.91%], valid : [loss = 2.635, top1 = 34.23%], test : [loss = 2.606, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.56%], valid : [loss = 0.771, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8838/15625) 008838-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.497, top1 = 90.04%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=16.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.332, top1 = 93.01%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.96 ms.
cifar100       train : [loss = 0.077, top1 = 98.77%], valid : [loss = 1.363, top1 = 69.04%], test : [loss = 1.361, top1 = 69.34%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 46.87%], valid : [loss = 2.362, top1 = 39.80%], test : [loss = 2.384, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.80%], valid : [loss = 0.850, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8839/15625) 008839-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.209, top1 = 93.18%], valid : [loss = 0.715, top1 = 79.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.248, top1 = 91.52%], test  : [loss = 0.445, top1 = 85.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.80 ms.
cifar100       train : [loss = 1.040, top1 = 70.09%], valid : [loss = 1.624, top1 = 56.92%], test : [loss = 1.626, top1 = 57.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.943, top1 = 28.01%], valid : [loss = 2.958, top1 = 27.23%], test : [loss = 3.021, top1 = 26.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.101, top1 = 60.31%], valid : [loss = 1.167, top1 = 58.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8840/15625) 008840-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.568, top1 = 88.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.76 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.377, top1 = 92.31%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.29 ms.
cifar100       train : [loss = 0.099, top1 = 98.22%], valid : [loss = 1.462, top1 = 68.12%], test : [loss = 1.420, top1 = 68.70%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.97%], valid : [loss = 2.418, top1 = 39.53%], test : [loss = 2.448, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.67%], valid : [loss = 0.702, top1 = 75.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8841/15625) 008841-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.458, top1 = 89.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.319, top1 = 92.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.56 ms.
cifar100       train : [loss = 0.268, top1 = 93.10%], valid : [loss = 1.223, top1 = 68.46%], test : [loss = 1.211, top1 = 69.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.76%], valid : [loss = 2.202, top1 = 42.93%], test : [loss = 2.238, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8842/15625) 008842-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.478, top1 = 89.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.319, top1 = 92.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.82 ms.
cifar100       train : [loss = 0.287, top1 = 92.67%], valid : [loss = 1.191, top1 = 69.78%], test : [loss = 1.186, top1 = 68.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.33 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.40%], valid : [loss = 2.247, top1 = 42.60%], test : [loss = 2.248, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8843/15625) 008843-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.76%], valid : [loss = 0.576, top1 = 88.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.021, top1 = 99.45%], test  : [loss = 0.380, top1 = 91.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.32 ms.
cifar100       train : [loss = 0.284, top1 = 92.26%], valid : [loss = 1.291, top1 = 67.26%], test : [loss = 1.305, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.026, top1 = 46.77%], valid : [loss = 2.326, top1 = 40.73%], test : [loss = 2.318, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.73%], valid : [loss = 0.860, top1 = 69.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8844/15625) 008844-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.236, top1 = 91.79%], valid : [loss = 0.556, top1 = 83.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.226, top1 = 92.28%], test  : [loss = 0.406, top1 = 86.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.70 ms.
cifar100       train : [loss = 1.306, top1 = 62.85%], valid : [loss = 1.586, top1 = 56.19%], test : [loss = 1.583, top1 = 56.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.756, top1 = 31.39%], valid : [loss = 2.784, top1 = 30.75%], test : [loss = 2.813, top1 = 30.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.970, top1 = 64.90%], valid : [loss = 1.030, top1 = 63.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8845/15625) 008845-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.287, top1 = 93.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.19 ms.
cifar100       train : [loss = 0.061, top1 = 99.13%], valid : [loss = 1.341, top1 = 70.80%], test : [loss = 1.351, top1 = 70.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 1.506, top1 = 59.25%], valid : [loss = 2.236, top1 = 43.72%], test : [loss = 2.233, top1 = 44.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.97%], valid : [loss = 0.512, top1 = 82.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8846/15625) 008846-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.603, top1 = 87.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.403, top1 = 90.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.14 ms.
cifar100       train : [loss = 0.259, top1 = 93.13%], valid : [loss = 1.503, top1 = 64.94%], test : [loss = 1.525, top1 = 64.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 42.10%], valid : [loss = 2.587, top1 = 34.93%], test : [loss = 2.642, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.68%], valid : [loss = 0.637, top1 = 78.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8847/15625) 008847-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.34 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.511, top1 = 89.94%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.88 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.320, top1 = 93.45%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=21.36 ms.
cifar100       train : [loss = 0.022, top1 = 99.85%], valid : [loss = 1.413, top1 = 70.66%], test : [loss = 1.408, top1 = 69.74%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.68 ms.
ImageNet16-120 train : [loss = 1.499, top1 = 59.42%], valid : [loss = 2.435, top1 = 41.10%], test : [loss = 2.448, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.09%], valid : [loss = 0.663, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8848/15625) 008848-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.513, top1 = 90.04%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.40 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.316, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.78 ms.
cifar100       train : [loss = 0.115, top1 = 97.72%], valid : [loss = 1.294, top1 = 69.68%], test : [loss = 1.287, top1 = 69.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.33%], valid : [loss = 2.231, top1 = 42.67%], test : [loss = 2.227, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.66%], valid : [loss = 0.657, top1 = 77.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8849/15625) 008849-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.98 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.329, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.17 ms.
cifar100       train : [loss = 0.071, top1 = 98.80%], valid : [loss = 1.367, top1 = 69.46%], test : [loss = 1.347, top1 = 70.25%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.30%], valid : [loss = 2.216, top1 = 44.43%], test : [loss = 2.201, top1 = 44.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.13%], valid : [loss = 0.720, top1 = 75.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8850/15625) 008850-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.565, top1 = 87.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.391, top1 = 90.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.348, top1 = 90.30%], valid : [loss = 1.415, top1 = 65.52%], test : [loss = 1.421, top1 = 65.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.32%], valid : [loss = 2.472, top1 = 37.81%], test : [loss = 2.502, top1 = 37.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.11%], valid : [loss = 0.867, top1 = 69.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8851/15625) 008851-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.548, top1 = 89.40%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.32 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.345, top1 = 92.79%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.41 ms.
cifar100       train : [loss = 0.084, top1 = 98.39%], valid : [loss = 1.428, top1 = 68.78%], test : [loss = 1.405, top1 = 69.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.48%], valid : [loss = 2.303, top1 = 40.13%], test : [loss = 2.362, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 67.18%], valid : [loss = 0.962, top1 = 65.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8852/15625) 008852-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.92 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.311, top1 = 93.35%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.55 ms.
cifar100       train : [loss = 0.057, top1 = 99.16%], valid : [loss = 1.409, top1 = 69.49%], test : [loss = 1.396, top1 = 69.83%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.559, top1 = 57.94%], valid : [loss = 2.265, top1 = 43.61%], test : [loss = 2.300, top1 = 43.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.66%], valid : [loss = 0.589, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8853/15625) 008853-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.428, top1 = 90.37%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.274, top1 = 93.26%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=24.51 ms.
cifar100       train : [loss = 0.108, top1 = 98.00%], valid : [loss = 1.215, top1 = 71.68%], test : [loss = 1.229, top1 = 71.22%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 1.595, top1 = 57.13%], valid : [loss = 2.125, top1 = 45.97%], test : [loss = 2.163, top1 = 45.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.12%], valid : [loss = 0.520, top1 = 82.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8854/15625) 008854-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.559, top1 = 88.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.43 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.346, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.66 ms.
cifar100       train : [loss = 0.293, top1 = 91.84%], valid : [loss = 1.293, top1 = 68.02%], test : [loss = 1.340, top1 = 66.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.14%], valid : [loss = 2.406, top1 = 39.57%], test : [loss = 2.385, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8855/15625) 008855-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.443, top1 = 90.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.276, top1 = 93.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.65 ms.
cifar100       train : [loss = 0.059, top1 = 99.20%], valid : [loss = 1.337, top1 = 70.72%], test : [loss = 1.320, top1 = 70.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.11 ms.
ImageNet16-120 train : [loss = 1.511, top1 = 59.01%], valid : [loss = 2.258, top1 = 43.63%], test : [loss = 2.232, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.369, top1 = 87.63%], valid : [loss = 0.503, top1 = 83.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8856/15625) 008856-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.77%], valid : [loss = 0.845, top1 = 71.82%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.95 ms.
cifar10        train : [loss = 0.580, top1 = 79.78%], test  : [loss = 0.736, top1 = 75.44%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.27 ms.
cifar100       train : [loss = 1.791, top1 = 51.68%], valid : [loss = 2.048, top1 = 47.24%], test : [loss = 2.062, top1 = 46.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 3.604, top1 = 16.52%], valid : [loss = 3.652, top1 = 16.57%], test : [loss = 3.676, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.88%], valid : [loss = 1.250, top1 = 55.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8857/15625) 008857-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.444, top1 = 90.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.310, top1 = 93.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.23 ms.
cifar100       train : [loss = 0.082, top1 = 98.61%], valid : [loss = 1.369, top1 = 69.45%], test : [loss = 1.363, top1 = 69.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 1.581, top1 = 57.48%], valid : [loss = 2.263, top1 = 43.48%], test : [loss = 2.291, top1 = 43.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.15%], valid : [loss = 0.497, top1 = 83.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8858/15625) 008858-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.593, top1 = 87.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.379, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.57 ms.
cifar100       train : [loss = 0.161, top1 = 96.48%], valid : [loss = 1.499, top1 = 66.21%], test : [loss = 1.524, top1 = 65.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 47.02%], valid : [loss = 2.445, top1 = 38.56%], test : [loss = 2.454, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.49%], valid : [loss = 0.738, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8859/15625) 008859-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.530, top1 = 89.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.342, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.153, top1 = 96.44%], valid : [loss = 1.339, top1 = 68.21%], test : [loss = 1.331, top1 = 68.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 47.93%], valid : [loss = 2.338, top1 = 40.69%], test : [loss = 2.322, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.45%], valid : [loss = 0.836, top1 = 70.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8860/15625) 008860-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.423, top1 = 91.11%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.08 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.274, top1 = 94.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.01 ms.
cifar100       train : [loss = 0.033, top1 = 99.73%], valid : [loss = 1.272, top1 = 72.18%], test : [loss = 1.267, top1 = 71.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.282, top1 = 64.77%], valid : [loss = 2.197, top1 = 45.99%], test : [loss = 2.211, top1 = 46.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.338, top1 = 88.66%], valid : [loss = 0.478, top1 = 84.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8861/15625) 008861-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.497, top1 = 89.46%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.85 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.324, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.82 ms.
cifar100       train : [loss = 0.166, top1 = 96.48%], valid : [loss = 1.303, top1 = 68.78%], test : [loss = 1.263, top1 = 69.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 1.765, top1 = 52.90%], valid : [loss = 2.227, top1 = 43.53%], test : [loss = 2.256, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.76%], valid : [loss = 0.613, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8862/15625) 008862-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.537, top1 = 88.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.022, top1 = 99.43%], test  : [loss = 0.318, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.77 ms.
cifar100       train : [loss = 0.374, top1 = 89.21%], valid : [loss = 1.253, top1 = 67.04%], test : [loss = 1.244, top1 = 68.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.15%], valid : [loss = 2.316, top1 = 41.23%], test : [loss = 2.320, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.44%], valid : [loss = 0.959, top1 = 66.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8863/15625) 008863-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.544, top1 = 80.94%], valid : [loss = 0.851, top1 = 71.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10        train : [loss = 0.548, top1 = 81.01%], test  : [loss = 0.702, top1 = 76.21%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.98 ms.
cifar100       train : [loss = 1.811, top1 = 51.04%], valid : [loss = 2.087, top1 = 46.54%], test : [loss = 2.086, top1 = 46.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 3.574, top1 = 17.04%], valid : [loss = 3.621, top1 = 17.00%], test : [loss = 3.670, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8864/15625) 008864-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.10%], valid : [loss = 0.526, top1 = 84.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.193, top1 = 93.50%], test  : [loss = 0.389, top1 = 87.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 1.215, top1 = 65.54%], valid : [loss = 1.522, top1 = 58.41%], test : [loss = 1.513, top1 = 58.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.16%], valid : [loss = 2.708, top1 = 32.48%], test : [loss = 2.752, top1 = 32.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.03%], valid : [loss = 0.964, top1 = 65.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8865/15625) 008865-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.161, top1 = 94.66%], valid : [loss = 0.947, top1 = 76.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.208, top1 = 92.92%], test  : [loss = 0.611, top1 = 82.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.10 ms.
cifar100       train : [loss = 1.142, top1 = 67.50%], valid : [loss = 1.809, top1 = 53.34%], test : [loss = 1.729, top1 = 54.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.51%], valid : [loss = 3.346, top1 = 21.50%], test : [loss = 3.368, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 62.89%], valid : [loss = 1.077, top1 = 62.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8866/15625) 008866-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.151, top1 = 95.19%], valid : [loss = 0.543, top1 = 84.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.151, top1 = 95.02%], test  : [loss = 0.380, top1 = 88.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.65 ms.
cifar100       train : [loss = 1.092, top1 = 68.77%], valid : [loss = 1.485, top1 = 59.19%], test : [loss = 1.479, top1 = 59.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 35.02%], valid : [loss = 2.658, top1 = 33.97%], test : [loss = 2.682, top1 = 32.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.04%], valid : [loss = 0.993, top1 = 65.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8867/15625) 008867-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.44%], valid : [loss = 0.475, top1 = 87.06%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=14.54 ms.
cifar10        train : [loss = 0.064, top1 = 98.31%], test  : [loss = 0.333, top1 = 90.33%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.85 ms.
cifar100       train : [loss = 0.615, top1 = 82.84%], valid : [loss = 1.279, top1 = 65.28%], test : [loss = 1.268, top1 = 65.38%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.39%], valid : [loss = 2.496, top1 = 37.50%], test : [loss = 2.541, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.94%], valid : [loss = 0.644, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8868/15625) 008868-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.481, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.82%], test  : [loss = 0.309, top1 = 92.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.318, top1 = 91.45%], valid : [loss = 1.235, top1 = 68.26%], test : [loss = 1.276, top1 = 68.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.66%], valid : [loss = 2.326, top1 = 41.10%], test : [loss = 2.316, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8869/15625) 008869-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.526, top1 = 88.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.48 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.340, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.21 ms.
cifar100       train : [loss = 0.346, top1 = 90.51%], valid : [loss = 1.286, top1 = 67.00%], test : [loss = 1.292, top1 = 67.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.43%], valid : [loss = 2.392, top1 = 39.13%], test : [loss = 2.424, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8870/15625) 008870-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.140, top1 = 95.66%], valid : [loss = 0.575, top1 = 84.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10        train : [loss = 0.207, top1 = 93.02%], test  : [loss = 0.405, top1 = 86.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.17 ms.
cifar100       train : [loss = 1.073, top1 = 69.07%], valid : [loss = 1.496, top1 = 58.72%], test : [loss = 1.503, top1 = 59.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.736, top1 = 31.82%], valid : [loss = 2.786, top1 = 31.47%], test : [loss = 2.843, top1 = 29.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.72%], valid : [loss = 1.030, top1 = 63.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8871/15625) 008871-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=21.70 ms.
cifar10-valid  train : [loss = 0.135, top1 = 95.93%], valid : [loss = 0.473, top1 = 85.66%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=21.63 ms.
cifar10        train : [loss = 0.148, top1 = 95.14%], test  : [loss = 0.353, top1 = 88.79%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=21.32 ms.
cifar100       train : [loss = 0.952, top1 = 73.06%], valid : [loss = 1.352, top1 = 62.56%], test : [loss = 1.376, top1 = 61.68%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=22.75 ms.
ImageNet16-120 train : [loss = 2.938, top1 = 27.65%], valid : [loss = 2.987, top1 = 26.17%], test : [loss = 3.002, top1 = 26.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.82%], valid : [loss = 1.003, top1 = 64.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8872/15625) 008872-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.60%], valid : [loss = 0.476, top1 = 85.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.158, top1 = 94.80%], test  : [loss = 0.349, top1 = 88.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.49 ms.
cifar100       train : [loss = 1.017, top1 = 71.25%], valid : [loss = 1.384, top1 = 61.60%], test : [loss = 1.356, top1 = 61.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.54%], valid : [loss = 2.684, top1 = 32.57%], test : [loss = 2.713, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8873/15625) 008873-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.54%], valid : [loss = 0.470, top1 = 85.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.158, top1 = 94.90%], test  : [loss = 0.350, top1 = 89.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.86 ms.
cifar100       train : [loss = 0.982, top1 = 72.12%], valid : [loss = 1.351, top1 = 61.96%], test : [loss = 1.361, top1 = 62.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.00 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.65%], valid : [loss = 2.690, top1 = 32.27%], test : [loss = 2.724, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8874/15625) 008874-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.643, top1 = 86.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.446, top1 = 90.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.39 ms.
cifar100       train : [loss = 0.195, top1 = 95.34%], valid : [loss = 1.606, top1 = 64.34%], test : [loss = 1.606, top1 = 64.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 44.04%], valid : [loss = 2.547, top1 = 37.33%], test : [loss = 2.571, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.51%], valid : [loss = 0.804, top1 = 71.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8875/15625) 008875-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.529, top1 = 89.45%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.342, top1 = 92.97%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.26 ms.
cifar100       train : [loss = 0.092, top1 = 98.20%], valid : [loss = 1.495, top1 = 68.52%], test : [loss = 1.485, top1 = 68.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.10%], valid : [loss = 2.360, top1 = 39.40%], test : [loss = 2.379, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.77%], valid : [loss = 0.888, top1 = 68.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8876/15625) 008876-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.36%], valid : [loss = 0.459, top1 = 86.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10        train : [loss = 0.154, top1 = 95.04%], test  : [loss = 0.349, top1 = 88.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.02 ms.
cifar100       train : [loss = 0.990, top1 = 71.88%], valid : [loss = 1.336, top1 = 62.56%], test : [loss = 1.339, top1 = 62.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.99%], valid : [loss = 2.676, top1 = 33.07%], test : [loss = 2.713, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.12%], valid : [loss = 0.789, top1 = 72.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8877/15625) 008877-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.438, top1 = 90.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.18 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.283, top1 = 93.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.062, top1 = 99.07%], valid : [loss = 1.397, top1 = 69.66%], test : [loss = 1.319, top1 = 70.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.543, top1 = 58.22%], valid : [loss = 2.225, top1 = 43.67%], test : [loss = 2.257, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 86.12%], valid : [loss = 0.515, top1 = 82.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8878/15625) 008878-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.08%], valid : [loss = 0.466, top1 = 85.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.159, top1 = 94.77%], test  : [loss = 0.345, top1 = 88.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 1.015, top1 = 71.03%], valid : [loss = 1.366, top1 = 61.80%], test : [loss = 1.363, top1 = 61.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.92%], valid : [loss = 2.686, top1 = 32.97%], test : [loss = 2.713, top1 = 32.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8879/15625) 008879-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.53%], valid : [loss = 0.747, top1 = 79.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.07 ms.
cifar10        train : [loss = 0.198, top1 = 93.34%], test  : [loss = 0.509, top1 = 84.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.16 ms.
cifar100       train : [loss = 0.868, top1 = 74.55%], valid : [loss = 1.636, top1 = 57.76%], test : [loss = 1.659, top1 = 57.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 3.539, top1 = 16.08%], valid : [loss = 3.532, top1 = 17.00%], test : [loss = 3.519, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.38%], valid : [loss = 1.303, top1 = 52.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8880/15625) 008880-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.44%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.22 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.328, top1 = 92.57%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.70 ms.
cifar100       train : [loss = 0.134, top1 = 97.34%], valid : [loss = 1.298, top1 = 69.40%], test : [loss = 1.314, top1 = 68.86%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.08 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.64%], valid : [loss = 2.229, top1 = 43.57%], test : [loss = 2.265, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.30%], valid : [loss = 0.595, top1 = 79.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8881/15625) 008881-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.180, top1 = 93.94%], valid : [loss = 0.950, top1 = 75.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10        train : [loss = 0.220, top1 = 92.47%], test  : [loss = 0.576, top1 = 82.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.55 ms.
cifar100       train : [loss = 1.203, top1 = 65.69%], valid : [loss = 1.803, top1 = 53.66%], test : [loss = 1.821, top1 = 53.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.81%], valid : [loss = 3.324, top1 = 22.57%], test : [loss = 3.354, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.55%], valid : [loss = 1.073, top1 = 61.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8882/15625) 008882-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=21.77 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.65%], valid : [loss = 0.554, top1 = 87.85%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=18.92 ms.
cifar10        train : [loss = 0.036, top1 = 98.93%], test  : [loss = 0.402, top1 = 90.15%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=23.95 ms.
cifar100       train : [loss = 0.372, top1 = 89.53%], valid : [loss = 1.347, top1 = 67.62%], test : [loss = 1.341, top1 = 66.16%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.06%], valid : [loss = 2.382, top1 = 39.37%], test : [loss = 2.358, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.10%], valid : [loss = 0.856, top1 = 69.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8883/15625) 008883-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.603, top1 = 88.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.23 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.376, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.13 ms.
cifar100       train : [loss = 0.151, top1 = 96.82%], valid : [loss = 1.474, top1 = 66.76%], test : [loss = 1.433, top1 = 66.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.967, top1 = 48.42%], valid : [loss = 2.472, top1 = 38.27%], test : [loss = 2.459, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.84%], valid : [loss = 0.765, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8884/15625) 008884-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.419, top1 = 91.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.287, top1 = 93.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.52 ms.
cifar100       train : [loss = 0.063, top1 = 99.16%], valid : [loss = 1.379, top1 = 70.32%], test : [loss = 1.351, top1 = 69.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 1.534, top1 = 58.55%], valid : [loss = 2.245, top1 = 44.37%], test : [loss = 2.264, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8885/15625) 008885-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.583, top1 = 87.29%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.400, top1 = 90.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.76 ms.
cifar100       train : [loss = 0.403, top1 = 88.74%], valid : [loss = 1.395, top1 = 64.82%], test : [loss = 1.392, top1 = 65.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.98%], valid : [loss = 2.482, top1 = 37.80%], test : [loss = 2.538, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.60%], valid : [loss = 0.823, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8886/15625) 008886-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.487, top1 = 88.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.301, top1 = 92.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.85 ms.
cifar100       train : [loss = 0.318, top1 = 91.39%], valid : [loss = 1.254, top1 = 67.96%], test : [loss = 1.281, top1 = 67.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.45%], valid : [loss = 2.313, top1 = 40.53%], test : [loss = 2.353, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.07%], valid : [loss = 0.623, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8887/15625) 008887-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8888/15625) 008888-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.81%], valid : [loss = 0.528, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.170, top1 = 94.36%], test  : [loss = 0.378, top1 = 87.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.54 ms.
cifar100       train : [loss = 1.015, top1 = 70.84%], valid : [loss = 1.375, top1 = 61.91%], test : [loss = 1.378, top1 = 61.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.54%], valid : [loss = 2.683, top1 = 33.45%], test : [loss = 2.758, top1 = 32.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.69%], valid : [loss = 0.993, top1 = 64.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8889/15625) 008889-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.27%], valid : [loss = 0.630, top1 = 85.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10        train : [loss = 0.064, top1 = 98.01%], test  : [loss = 0.421, top1 = 88.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.05 ms.
cifar100       train : [loss = 0.683, top1 = 80.09%], valid : [loss = 1.396, top1 = 63.17%], test : [loss = 1.377, top1 = 63.62%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.524, top1 = 36.25%], valid : [loss = 2.655, top1 = 33.39%], test : [loss = 2.698, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.05%], valid : [loss = 0.799, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8890/15625) 008890-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.63 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.337, top1 = 91.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.345, top1 = 90.47%], valid : [loss = 1.254, top1 = 67.40%], test : [loss = 1.228, top1 = 68.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 45.07%], valid : [loss = 2.413, top1 = 39.40%], test : [loss = 2.404, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.07%], valid : [loss = 0.643, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8891/15625) 008891-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.506, top1 = 89.95%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=23.54 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.309, top1 = 93.43%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.63 ms.
cifar100       train : [loss = 0.044, top1 = 99.41%], valid : [loss = 1.400, top1 = 70.10%], test : [loss = 1.417, top1 = 70.20%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=24.35 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.04%], valid : [loss = 2.345, top1 = 40.57%], test : [loss = 2.317, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.80%], valid : [loss = 0.741, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8892/15625) 008892-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.641, top1 = 86.10%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.028, top1 = 99.27%], test  : [loss = 0.415, top1 = 90.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.20 ms.
cifar100       train : [loss = 0.487, top1 = 85.88%], valid : [loss = 1.458, top1 = 63.73%], test : [loss = 1.404, top1 = 64.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.22 ms.
ImageNet16-120 train : [loss = 2.415, top1 = 38.54%], valid : [loss = 2.599, top1 = 35.33%], test : [loss = 2.610, top1 = 34.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.02%], valid : [loss = 0.871, top1 = 69.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8893/15625) 008893-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.148, top1 = 95.31%], valid : [loss = 0.538, top1 = 84.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.154, top1 = 94.89%], test  : [loss = 0.377, top1 = 88.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 1.151, top1 = 67.13%], valid : [loss = 1.491, top1 = 59.11%], test : [loss = 1.484, top1 = 58.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.572, top1 = 35.21%], valid : [loss = 2.656, top1 = 33.61%], test : [loss = 2.674, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.58%], valid : [loss = 0.936, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8894/15625) 008894-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.452, top1 = 89.95%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.80 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.304, top1 = 93.07%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.49 ms.
cifar100       train : [loss = 0.121, top1 = 97.89%], valid : [loss = 1.298, top1 = 68.78%], test : [loss = 1.257, top1 = 69.92%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.06 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.78%], valid : [loss = 2.244, top1 = 42.10%], test : [loss = 2.199, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.15%], valid : [loss = 0.653, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8895/15625) 008895-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.19%], valid : [loss = 0.444, top1 = 87.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.116, top1 = 96.37%], test  : [loss = 0.326, top1 = 89.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 0.866, top1 = 75.36%], valid : [loss = 1.325, top1 = 63.48%], test : [loss = 1.285, top1 = 64.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.71%], valid : [loss = 2.628, top1 = 33.57%], test : [loss = 2.641, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8896/15625) 008896-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.74%], valid : [loss = 0.532, top1 = 85.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.096, top1 = 96.94%], test  : [loss = 0.365, top1 = 89.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.12 ms.
cifar100       train : [loss = 0.793, top1 = 76.77%], valid : [loss = 1.380, top1 = 63.16%], test : [loss = 1.374, top1 = 63.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.468, top1 = 37.15%], valid : [loss = 2.579, top1 = 35.17%], test : [loss = 2.608, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.72%], valid : [loss = 0.936, top1 = 67.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8897/15625) 008897-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.578, top1 = 87.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.350, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.81 ms.
cifar100       train : [loss = 0.297, top1 = 91.58%], valid : [loss = 1.330, top1 = 67.00%], test : [loss = 1.368, top1 = 66.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.73 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 44.00%], valid : [loss = 2.432, top1 = 37.90%], test : [loss = 2.436, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.86%], valid : [loss = 0.872, top1 = 69.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8898/15625) 008898-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.76 ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.93%], valid : [loss = 0.520, top1 = 82.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10        train : [loss = 0.396, top1 = 86.48%], test  : [loss = 0.457, top1 = 84.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.57 ms.
cifar100       train : [loss = 1.537, top1 = 57.60%], valid : [loss = 1.679, top1 = 54.28%], test : [loss = 1.656, top1 = 54.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.020, top1 = 26.62%], valid : [loss = 2.999, top1 = 27.23%], test : [loss = 3.047, top1 = 26.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.78%], valid : [loss = 1.138, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8899/15625) 008899-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10-valid  train : [loss = 1.229, top1 = 55.95%], valid : [loss = 1.267, top1 = 54.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 1.160, top1 = 58.62%], test  : [loss = 1.167, top1 = 58.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.76 ms.
cifar100       train : [loss = 2.695, top1 = 32.50%], valid : [loss = 2.778, top1 = 31.41%], test : [loss = 2.760, top1 = 31.63%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.14 ms.
ImageNet16-120 train : [loss = 3.871, top1 = 12.41%], valid : [loss = 3.872, top1 = 12.46%], test : [loss = 3.887, top1 = 12.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8900/15625) 008900-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.560, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.335, top1 = 92.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.41 ms.
cifar100       train : [loss = 0.105, top1 = 98.08%], valid : [loss = 1.377, top1 = 69.20%], test : [loss = 1.423, top1 = 68.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.70%], valid : [loss = 2.432, top1 = 40.10%], test : [loss = 2.424, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.63%], valid : [loss = 0.740, top1 = 74.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8901/15625) 008901-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.92%], valid : [loss = 0.533, top1 = 89.28%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.25 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.325, top1 = 93.15%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.73 ms.
cifar100       train : [loss = 0.082, top1 = 98.57%], valid : [loss = 1.357, top1 = 68.96%], test : [loss = 1.326, top1 = 69.94%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.616, top1 = 56.63%], valid : [loss = 2.163, top1 = 44.87%], test : [loss = 2.169, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.93%], valid : [loss = 0.724, top1 = 74.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8902/15625) 008902-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.534, top1 = 88.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.020, top1 = 99.48%], test  : [loss = 0.379, top1 = 91.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.371, top1 = 89.30%], valid : [loss = 1.386, top1 = 66.22%], test : [loss = 1.376, top1 = 66.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 42.00%], valid : [loss = 2.474, top1 = 37.17%], test : [loss = 2.523, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.10%], valid : [loss = 0.699, top1 = 76.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8903/15625) 008903-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.78%], valid : [loss = 0.866, top1 = 71.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.88 ms.
cifar10        train : [loss = 0.556, top1 = 80.55%], test  : [loss = 0.711, top1 = 75.75%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.10 ms.
cifar100       train : [loss = 1.774, top1 = 52.20%], valid : [loss = 2.049, top1 = 47.32%], test : [loss = 2.057, top1 = 47.27%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.67%], valid : [loss = 3.646, top1 = 16.51%], test : [loss = 3.670, top1 = 15.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8904/15625) 008904-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.541, top1 = 88.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.353, top1 = 91.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.54 ms.
cifar100       train : [loss = 0.343, top1 = 90.62%], valid : [loss = 1.297, top1 = 66.98%], test : [loss = 1.308, top1 = 66.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.56%], valid : [loss = 2.428, top1 = 38.73%], test : [loss = 2.434, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.96%], valid : [loss = 0.839, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8905/15625) 008905-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.92%], valid : [loss = 0.589, top1 = 86.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 0.064, top1 = 97.91%], test  : [loss = 0.384, top1 = 89.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.83 ms.
cifar100       train : [loss = 0.635, top1 = 81.38%], valid : [loss = 1.332, top1 = 64.62%], test : [loss = 1.338, top1 = 64.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.18%], valid : [loss = 2.486, top1 = 36.77%], test : [loss = 2.525, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.72%], valid : [loss = 0.837, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8906/15625) 008906-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.15 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.95 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8907/15625) 008907-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.576, top1 = 88.92%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.361, top1 = 92.45%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.61 ms.
cifar100       train : [loss = 0.106, top1 = 98.06%], valid : [loss = 1.442, top1 = 68.10%], test : [loss = 1.433, top1 = 68.22%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 1.862, top1 = 50.72%], valid : [loss = 2.442, top1 = 38.70%], test : [loss = 2.445, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.53%], valid : [loss = 0.719, top1 = 75.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8908/15625) 008908-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.480, top1 = 89.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.239, top1 = 67.91%], test : [loss = 1.262, top1 = 67.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.82%], valid : [loss = 2.324, top1 = 40.36%], test : [loss = 2.337, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8909/15625) 008909-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.54%], valid : [loss = 0.768, top1 = 73.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.578, top1 = 79.97%], test  : [loss = 0.637, top1 = 77.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.74 ms.
cifar100       train : [loss = 1.960, top1 = 46.91%], valid : [loss = 2.111, top1 = 44.32%], test : [loss = 2.114, top1 = 43.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 3.231, top1 = 22.31%], valid : [loss = 3.225, top1 = 23.37%], test : [loss = 3.245, top1 = 21.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.292, top1 = 53.43%], valid : [loss = 1.331, top1 = 52.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8910/15625) 008910-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.098, top1 = 97.09%], valid : [loss = 0.593, top1 = 84.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10        train : [loss = 0.120, top1 = 96.06%], test  : [loss = 0.385, top1 = 88.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 0.791, top1 = 77.16%], valid : [loss = 1.396, top1 = 62.04%], test : [loss = 1.397, top1 = 62.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.06 ms.
ImageNet16-120 train : [loss = 2.575, top1 = 35.04%], valid : [loss = 2.659, top1 = 32.93%], test : [loss = 2.671, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.855, top1 = 69.22%], valid : [loss = 0.897, top1 = 68.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8911/15625) 008911-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.10%], valid : [loss = 0.865, top1 = 71.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10        train : [loss = 0.553, top1 = 80.68%], test  : [loss = 0.716, top1 = 75.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 1.761, top1 = 52.60%], valid : [loss = 2.033, top1 = 47.00%], test : [loss = 2.041, top1 = 47.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.91%], valid : [loss = 3.623, top1 = 16.03%], test : [loss = 3.664, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8912/15625) 008912-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.84 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.73%], valid : [loss = 0.481, top1 = 84.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 0.297, top1 = 90.13%], test  : [loss = 0.404, top1 = 86.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.45 ms.
cifar100       train : [loss = 1.336, top1 = 63.04%], valid : [loss = 1.536, top1 = 58.14%], test : [loss = 1.512, top1 = 59.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.49 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.48%], valid : [loss = 2.920, top1 = 28.43%], test : [loss = 2.940, top1 = 27.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8913/15625) 008913-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.581, top1 = 87.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.409, top1 = 90.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.97 ms.
cifar100       train : [loss = 0.272, top1 = 92.62%], valid : [loss = 1.537, top1 = 64.40%], test : [loss = 1.491, top1 = 64.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.247, top1 = 42.27%], valid : [loss = 2.611, top1 = 34.70%], test : [loss = 2.655, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.50%], valid : [loss = 0.629, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8914/15625) 008914-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.42%], valid : [loss = 0.858, top1 = 71.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.564, top1 = 80.22%], test  : [loss = 0.718, top1 = 75.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.49 ms.
cifar100       train : [loss = 1.767, top1 = 52.09%], valid : [loss = 2.029, top1 = 47.86%], test : [loss = 2.054, top1 = 46.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.96 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 16.92%], valid : [loss = 3.624, top1 = 16.53%], test : [loss = 3.665, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8915/15625) 008915-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.08%], valid : [loss = 0.466, top1 = 85.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10        train : [loss = 0.159, top1 = 94.77%], test  : [loss = 0.345, top1 = 88.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.02 ms.
cifar100       train : [loss = 1.015, top1 = 71.03%], valid : [loss = 1.366, top1 = 61.80%], test : [loss = 1.363, top1 = 61.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.92%], valid : [loss = 2.686, top1 = 32.97%], test : [loss = 2.713, top1 = 32.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8916/15625) 008916-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.579, top1 = 87.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.17 ms.
cifar10        train : [loss = 0.039, top1 = 98.86%], test  : [loss = 0.393, top1 = 90.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.36 ms.
cifar100       train : [loss = 0.550, top1 = 83.84%], valid : [loss = 1.421, top1 = 63.00%], test : [loss = 1.390, top1 = 64.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 37.09%], valid : [loss = 2.621, top1 = 34.43%], test : [loss = 2.645, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.87%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8917/15625) 008917-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.17%], valid : [loss = 0.598, top1 = 85.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.92 ms.
cifar10        train : [loss = 0.074, top1 = 97.68%], test  : [loss = 0.406, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.98 ms.
cifar100       train : [loss = 0.719, top1 = 79.13%], valid : [loss = 1.352, top1 = 64.14%], test : [loss = 1.354, top1 = 64.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.91%], valid : [loss = 2.691, top1 = 33.33%], test : [loss = 2.702, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8918/15625) 008918-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.48%], valid : [loss = 0.559, top1 = 87.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10        train : [loss = 0.032, top1 = 99.00%], test  : [loss = 0.368, top1 = 90.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.25 ms.
cifar100       train : [loss = 0.630, top1 = 81.78%], valid : [loss = 1.457, top1 = 61.48%], test : [loss = 1.428, top1 = 62.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.04%], valid : [loss = 2.716, top1 = 31.07%], test : [loss = 2.694, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8919/15625) 008919-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.562, top1 = 88.81%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=25.68 ms.
cifar10        train : [loss = 0.010, top1 = 99.74%], test  : [loss = 0.347, top1 = 92.19%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.55 ms.
cifar100       train : [loss = 0.249, top1 = 93.53%], valid : [loss = 1.512, top1 = 64.88%], test : [loss = 1.503, top1 = 64.36%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.41 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 40.78%], valid : [loss = 2.476, top1 = 37.80%], test : [loss = 2.482, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.79%], valid : [loss = 0.920, top1 = 67.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8920/15625) 008920-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.524, top1 = 89.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.332, top1 = 92.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.10 ms.
cifar100       train : [loss = 0.183, top1 = 95.61%], valid : [loss = 1.355, top1 = 67.62%], test : [loss = 1.391, top1 = 67.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.09%], valid : [loss = 2.320, top1 = 40.77%], test : [loss = 2.347, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.14%], valid : [loss = 0.783, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8921/15625) 008921-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.449, top1 = 84.29%], valid : [loss = 0.694, top1 = 77.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.391, top1 = 86.41%], test  : [loss = 0.521, top1 = 82.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 1.590, top1 = 55.93%], valid : [loss = 1.813, top1 = 51.36%], test : [loss = 1.839, top1 = 50.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.04%], valid : [loss = 3.313, top1 = 21.07%], test : [loss = 3.334, top1 = 21.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.98%], valid : [loss = 1.257, top1 = 55.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8922/15625) 008922-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.576, top1 = 87.65%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.385, top1 = 91.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.376, top1 = 89.44%], valid : [loss = 1.408, top1 = 65.16%], test : [loss = 1.396, top1 = 65.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.18%], valid : [loss = 2.508, top1 = 36.73%], test : [loss = 2.504, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.18%], valid : [loss = 0.796, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8923/15625) 008923-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.24 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.34%], valid : [loss = 0.608, top1 = 85.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10        train : [loss = 0.068, top1 = 97.95%], test  : [loss = 0.410, top1 = 88.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.53 ms.
cifar100       train : [loss = 0.722, top1 = 78.94%], valid : [loss = 1.387, top1 = 63.51%], test : [loss = 1.376, top1 = 63.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.87%], valid : [loss = 2.657, top1 = 33.36%], test : [loss = 2.704, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8924/15625) 008924-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.561, top1 = 88.33%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.37 ms.
cifar10        train : [loss = 0.014, top1 = 99.61%], test  : [loss = 0.337, top1 = 92.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.68 ms.
cifar100       train : [loss = 0.198, top1 = 95.32%], valid : [loss = 1.284, top1 = 68.56%], test : [loss = 1.333, top1 = 67.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.33%], valid : [loss = 2.488, top1 = 36.77%], test : [loss = 2.504, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.24%], valid : [loss = 0.995, top1 = 64.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8925/15625) 008925-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.98%], valid : [loss = 0.738, top1 = 83.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10        train : [loss = 0.087, top1 = 97.19%], test  : [loss = 0.478, top1 = 86.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.17 ms.
cifar100       train : [loss = 0.805, top1 = 76.61%], valid : [loss = 1.534, top1 = 60.31%], test : [loss = 1.518, top1 = 60.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 2.799, top1 = 30.66%], valid : [loss = 2.920, top1 = 28.48%], test : [loss = 2.975, top1 = 27.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8926/15625) 008926-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.556, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.359, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.54 ms.
cifar100       train : [loss = 0.098, top1 = 98.20%], valid : [loss = 1.414, top1 = 68.44%], test : [loss = 1.405, top1 = 68.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.64%], valid : [loss = 2.451, top1 = 39.77%], test : [loss = 2.467, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.44%], valid : [loss = 0.732, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8927/15625) 008927-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.67 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.07 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8928/15625) 008928-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.150, top1 = 95.13%], valid : [loss = 0.935, top1 = 76.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10        train : [loss = 0.214, top1 = 92.67%], test  : [loss = 0.617, top1 = 82.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.80 ms.
cifar100       train : [loss = 1.039, top1 = 69.98%], valid : [loss = 1.798, top1 = 54.52%], test : [loss = 1.785, top1 = 54.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 3.232, top1 = 22.87%], valid : [loss = 3.361, top1 = 20.63%], test : [loss = 3.409, top1 = 19.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.176, top1 = 57.58%], valid : [loss = 1.239, top1 = 55.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8929/15625) 008929-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.538, top1 = 89.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.328, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.85 ms.
cifar100       train : [loss = 0.128, top1 = 97.31%], valid : [loss = 1.348, top1 = 68.48%], test : [loss = 1.357, top1 = 68.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.72%], valid : [loss = 2.350, top1 = 40.83%], test : [loss = 2.354, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.06%], valid : [loss = 0.917, top1 = 66.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8930/15625) 008930-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.595, top1 = 85.70%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10        train : [loss = 0.068, top1 = 97.95%], test  : [loss = 0.399, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 0.698, top1 = 79.74%], valid : [loss = 1.386, top1 = 63.21%], test : [loss = 1.360, top1 = 63.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.39%], valid : [loss = 2.625, top1 = 34.72%], test : [loss = 2.687, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8931/15625) 008931-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.319, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.326, top1 = 91.15%], valid : [loss = 1.299, top1 = 66.89%], test : [loss = 1.321, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.30%], valid : [loss = 2.378, top1 = 39.73%], test : [loss = 2.416, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 84.91%], valid : [loss = 0.547, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8932/15625) 008932-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.35%], valid : [loss = 0.816, top1 = 72.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.42 ms.
cifar10        train : [loss = 0.562, top1 = 80.56%], test  : [loss = 0.605, top1 = 79.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.91 ms.
cifar100       train : [loss = 2.155, top1 = 42.30%], valid : [loss = 2.271, top1 = 40.42%], test : [loss = 2.265, top1 = 39.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 3.300, top1 = 20.73%], valid : [loss = 3.260, top1 = 22.37%], test : [loss = 3.297, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.216, top1 = 55.83%], valid : [loss = 1.263, top1 = 54.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8933/15625) 008933-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.21%], valid : [loss = 0.536, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.036, top1 = 98.89%], test  : [loss = 0.370, top1 = 90.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.49 ms.
cifar100       train : [loss = 0.456, top1 = 86.86%], valid : [loss = 1.334, top1 = 66.16%], test : [loss = 1.327, top1 = 65.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 2.894, top1 = 27.69%], valid : [loss = 2.978, top1 = 25.77%], test : [loss = 2.974, top1 = 25.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.047, top1 = 62.06%], valid : [loss = 1.056, top1 = 62.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8934/15625) 008934-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.595, top1 = 88.33%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.81%], test  : [loss = 0.359, top1 = 92.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.16 ms.
cifar100       train : [loss = 0.148, top1 = 96.57%], valid : [loss = 1.396, top1 = 68.24%], test : [loss = 1.423, top1 = 68.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 45.83%], valid : [loss = 2.387, top1 = 39.40%], test : [loss = 2.384, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.85%], valid : [loss = 0.947, top1 = 66.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8935/15625) 008935-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.96%], valid : [loss = 0.577, top1 = 85.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 0.121, top1 = 96.12%], test  : [loss = 0.393, top1 = 88.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.825, top1 = 75.83%], valid : [loss = 1.348, top1 = 63.22%], test : [loss = 1.365, top1 = 63.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.64%], valid : [loss = 2.635, top1 = 33.83%], test : [loss = 2.675, top1 = 34.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 69.76%], valid : [loss = 0.897, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8936/15625) 008936-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.498, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.304, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.67 ms.
cifar100       train : [loss = 0.315, top1 = 91.58%], valid : [loss = 1.240, top1 = 67.79%], test : [loss = 1.249, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.83%], valid : [loss = 2.337, top1 = 40.62%], test : [loss = 2.325, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.49%], valid : [loss = 0.613, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8937/15625) 008937-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.26%], valid : [loss = 0.708, top1 = 82.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.69 ms.
cifar10        train : [loss = 0.116, top1 = 96.18%], test  : [loss = 0.467, top1 = 87.03%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.03 ms.
cifar100       train : [loss = 0.915, top1 = 73.41%], valid : [loss = 1.550, top1 = 59.30%], test : [loss = 1.544, top1 = 59.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 2.795, top1 = 30.57%], valid : [loss = 2.875, top1 = 28.80%], test : [loss = 2.935, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.913, top1 = 67.21%], valid : [loss = 0.969, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8938/15625) 008938-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.09%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.388, top1 = 91.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.79 ms.
cifar100       train : [loss = 0.090, top1 = 98.36%], valid : [loss = 1.549, top1 = 67.01%], test : [loss = 1.532, top1 = 67.21%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.58%], valid : [loss = 2.392, top1 = 39.86%], test : [loss = 2.398, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.17%], valid : [loss = 0.791, top1 = 71.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8939/15625) 008939-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.596, top1 = 88.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.413, top1 = 91.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.11 ms.
cifar100       train : [loss = 0.139, top1 = 96.97%], valid : [loss = 1.525, top1 = 65.58%], test : [loss = 1.575, top1 = 66.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.52%], valid : [loss = 2.484, top1 = 37.63%], test : [loss = 2.506, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.91%], valid : [loss = 0.804, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8940/15625) 008940-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.567, top1 = 87.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.383, top1 = 91.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.75 ms.
cifar100       train : [loss = 0.349, top1 = 90.25%], valid : [loss = 1.416, top1 = 65.23%], test : [loss = 1.415, top1 = 65.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.31%], valid : [loss = 2.465, top1 = 38.12%], test : [loss = 2.497, top1 = 37.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.30%], valid : [loss = 0.861, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8941/15625) 008941-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.33%], valid : [loss = 0.618, top1 = 86.50%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10        train : [loss = 0.021, top1 = 99.38%], test  : [loss = 0.400, top1 = 90.82%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.00 ms.
cifar100       train : [loss = 0.378, top1 = 89.29%], valid : [loss = 1.508, top1 = 63.52%], test : [loss = 1.473, top1 = 64.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 3.183, top1 = 21.84%], valid : [loss = 3.198, top1 = 22.17%], test : [loss = 3.194, top1 = 21.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.02%], valid : [loss = 1.200, top1 = 56.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8942/15625) 008942-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.536, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.337, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.327, top1 = 91.15%], valid : [loss = 1.296, top1 = 67.30%], test : [loss = 1.308, top1 = 66.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.93%], valid : [loss = 2.436, top1 = 38.30%], test : [loss = 2.427, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8943/15625) 008943-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.90 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.92%], valid : [loss = 0.861, top1 = 71.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.31 ms.
cifar10        train : [loss = 0.564, top1 = 80.29%], test  : [loss = 0.721, top1 = 75.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.93 ms.
cifar100       train : [loss = 1.782, top1 = 52.08%], valid : [loss = 2.059, top1 = 46.59%], test : [loss = 2.047, top1 = 46.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.59 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.74%], valid : [loss = 3.653, top1 = 16.42%], test : [loss = 3.674, top1 = 15.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8944/15625) 008944-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.514, top1 = 88.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.329, top1 = 92.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.50 ms.
cifar100       train : [loss = 0.331, top1 = 91.01%], valid : [loss = 1.283, top1 = 67.00%], test : [loss = 1.282, top1 = 67.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.80%], valid : [loss = 2.385, top1 = 39.30%], test : [loss = 2.420, top1 = 38.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8945/15625) 008945-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.554, top1 = 88.39%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.00 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.389, top1 = 91.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.75 ms.
cifar100       train : [loss = 0.136, top1 = 97.35%], valid : [loss = 1.431, top1 = 67.62%], test : [loss = 1.434, top1 = 68.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 1.929, top1 = 49.22%], valid : [loss = 2.399, top1 = 39.50%], test : [loss = 2.376, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.21%], valid : [loss = 0.712, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8946/15625) 008946-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.478, top1 = 90.19%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.323, top1 = 93.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.56 ms.
cifar100       train : [loss = 0.044, top1 = 99.43%], valid : [loss = 1.428, top1 = 70.26%], test : [loss = 1.437, top1 = 69.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 1.507, top1 = 59.18%], valid : [loss = 2.259, top1 = 44.33%], test : [loss = 2.263, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.42%], valid : [loss = 0.604, top1 = 79.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8947/15625) 008947-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.70%], valid : [loss = 0.854, top1 = 71.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.548, top1 = 80.80%], test  : [loss = 0.702, top1 = 76.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.95 ms.
cifar100       train : [loss = 1.774, top1 = 52.14%], valid : [loss = 2.042, top1 = 46.82%], test : [loss = 2.058, top1 = 46.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.80%], valid : [loss = 3.631, top1 = 16.80%], test : [loss = 3.656, top1 = 15.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8948/15625) 008948-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.584, top1 = 87.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.69 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.390, top1 = 91.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.37 ms.
cifar100       train : [loss = 0.387, top1 = 89.07%], valid : [loss = 1.414, top1 = 65.07%], test : [loss = 1.396, top1 = 65.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 41.01%], valid : [loss = 2.494, top1 = 37.20%], test : [loss = 2.517, top1 = 37.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8949/15625) 008949-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.528, top1 = 88.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.341, top1 = 91.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 0.348, top1 = 90.53%], valid : [loss = 1.283, top1 = 66.95%], test : [loss = 1.306, top1 = 66.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.68%], valid : [loss = 2.404, top1 = 38.51%], test : [loss = 2.414, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8950/15625) 008950-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.56%], valid : [loss = 0.457, top1 = 86.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.56 ms.
cifar10        train : [loss = 0.118, top1 = 96.30%], test  : [loss = 0.333, top1 = 89.30%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.76 ms.
cifar100       train : [loss = 0.752, top1 = 78.93%], valid : [loss = 1.294, top1 = 64.22%], test : [loss = 1.281, top1 = 63.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.513, top1 = 36.48%], valid : [loss = 2.613, top1 = 34.93%], test : [loss = 2.638, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8951/15625) 008951-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.235, top1 = 92.01%], valid : [loss = 0.515, top1 = 83.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.47 ms.
cifar10        train : [loss = 0.223, top1 = 92.44%], test  : [loss = 0.390, top1 = 87.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.62 ms.
cifar100       train : [loss = 1.299, top1 = 63.49%], valid : [loss = 1.564, top1 = 57.17%], test : [loss = 1.569, top1 = 57.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.795, top1 = 30.76%], valid : [loss = 2.814, top1 = 30.49%], test : [loss = 2.876, top1 = 29.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.68%], valid : [loss = 1.064, top1 = 62.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8952/15625) 008952-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.99%], valid : [loss = 0.526, top1 = 87.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.98 ms.
cifar10        train : [loss = 0.071, top1 = 97.79%], test  : [loss = 0.363, top1 = 89.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.97 ms.
cifar100       train : [loss = 0.710, top1 = 79.14%], valid : [loss = 1.370, top1 = 64.22%], test : [loss = 1.344, top1 = 64.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.28%], valid : [loss = 2.610, top1 = 34.37%], test : [loss = 2.676, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.99%], valid : [loss = 0.638, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8953/15625) 008953-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.76%], valid : [loss = 0.677, top1 = 77.16%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.25 ms.
cifar10        train : [loss = 0.537, top1 = 81.22%], test  : [loss = 0.599, top1 = 79.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.59 ms.
cifar100       train : [loss = 1.734, top1 = 52.73%], valid : [loss = 1.882, top1 = 49.78%], test : [loss = 1.905, top1 = 49.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.38 ms.
ImageNet16-120 train : [loss = 3.392, top1 = 20.06%], valid : [loss = 3.377, top1 = 20.47%], test : [loss = 3.415, top1 = 19.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8954/15625) 008954-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.15%], valid : [loss = 0.478, top1 = 84.15%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10        train : [loss = 0.304, top1 = 89.99%], test  : [loss = 0.395, top1 = 86.57%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.13 ms.
cifar100       train : [loss = 1.325, top1 = 63.14%], valid : [loss = 1.523, top1 = 58.00%], test : [loss = 1.500, top1 = 58.58%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.21 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.76%], valid : [loss = 2.908, top1 = 29.37%], test : [loss = 2.973, top1 = 28.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8955/15625) 008955-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.458, top1 = 89.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.328, top1 = 91.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 0.324, top1 = 91.36%], valid : [loss = 1.306, top1 = 67.35%], test : [loss = 1.335, top1 = 66.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.36%], valid : [loss = 2.368, top1 = 39.53%], test : [loss = 2.404, top1 = 39.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8956/15625) 008956-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.142, top1 = 95.45%], valid : [loss = 0.565, top1 = 84.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.26 ms.
cifar10        train : [loss = 0.195, top1 = 93.22%], test  : [loss = 0.393, top1 = 87.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.31 ms.
cifar100       train : [loss = 1.089, top1 = 68.52%], valid : [loss = 1.535, top1 = 58.44%], test : [loss = 1.537, top1 = 58.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 2.768, top1 = 31.16%], valid : [loss = 2.791, top1 = 31.73%], test : [loss = 2.837, top1 = 29.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 64.94%], valid : [loss = 1.064, top1 = 62.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8957/15625) 008957-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.96%], valid : [loss = 0.636, top1 = 84.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 0.064, top1 = 97.98%], test  : [loss = 0.405, top1 = 89.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.50 ms.
cifar100       train : [loss = 0.706, top1 = 79.22%], valid : [loss = 1.538, top1 = 60.70%], test : [loss = 1.519, top1 = 61.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.76%], valid : [loss = 2.660, top1 = 34.03%], test : [loss = 2.682, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.46%], valid : [loss = 0.930, top1 = 67.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8958/15625) 008958-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8959/15625) 008959-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.682, top1 = 85.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.022, top1 = 99.40%], test  : [loss = 0.442, top1 = 89.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 0.316, top1 = 91.60%], valid : [loss = 1.570, top1 = 62.38%], test : [loss = 1.559, top1 = 63.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.42%], valid : [loss = 2.659, top1 = 34.00%], test : [loss = 2.652, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.41%], valid : [loss = 0.823, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8960/15625) 008960-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.504, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.343, top1 = 91.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.20 ms.
cifar100       train : [loss = 0.341, top1 = 90.65%], valid : [loss = 1.276, top1 = 67.52%], test : [loss = 1.295, top1 = 67.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.54%], valid : [loss = 2.381, top1 = 39.43%], test : [loss = 2.419, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8961/15625) 008961-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.436, top1 = 89.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.02 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.288, top1 = 92.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.41 ms.
cifar100       train : [loss = 0.209, top1 = 95.08%], valid : [loss = 1.261, top1 = 69.08%], test : [loss = 1.276, top1 = 69.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.89%], valid : [loss = 2.274, top1 = 42.67%], test : [loss = 2.298, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.10%], valid : [loss = 0.523, top1 = 82.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8962/15625) 008962-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.15%], valid : [loss = 0.662, top1 = 84.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.079, top1 = 97.50%], test  : [loss = 0.443, top1 = 88.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.62 ms.
cifar100       train : [loss = 0.746, top1 = 78.30%], valid : [loss = 1.456, top1 = 61.57%], test : [loss = 1.455, top1 = 61.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 2.716, top1 = 32.35%], valid : [loss = 2.840, top1 = 30.29%], test : [loss = 2.883, top1 = 30.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.32%], valid : [loss = 0.826, top1 = 71.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8963/15625) 008963-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.56%], valid : [loss = 0.703, top1 = 80.23%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.66 ms.
cifar10        train : [loss = 0.188, top1 = 93.47%], test  : [loss = 0.506, top1 = 84.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.43 ms.
cifar100       train : [loss = 0.909, top1 = 73.51%], valid : [loss = 1.651, top1 = 57.12%], test : [loss = 1.678, top1 = 56.32%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 3.469, top1 = 17.51%], valid : [loss = 3.485, top1 = 17.80%], test : [loss = 3.488, top1 = 17.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.254, top1 = 54.48%], valid : [loss = 1.282, top1 = 53.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8964/15625) 008964-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.24%], valid : [loss = 0.460, top1 = 86.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10        train : [loss = 0.113, top1 = 96.47%], test  : [loss = 0.332, top1 = 89.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.63 ms.
cifar100       train : [loss = 0.856, top1 = 75.70%], valid : [loss = 1.300, top1 = 63.71%], test : [loss = 1.265, top1 = 64.63%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.65%], valid : [loss = 2.621, top1 = 34.83%], test : [loss = 2.651, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 80.02%], valid : [loss = 0.652, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8965/15625) 008965-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 16.96 M, Params=0.139 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.23%], valid : [loss = 0.452, top1 = 87.05%]
cifar10        FLOP= 16.96 M, Params=0.139 MB, latency=17.42 ms.
cifar10        train : [loss = 0.117, top1 = 96.33%], test  : [loss = 0.333, top1 = 89.54%]
cifar100       FLOP= 16.96 M, Params=0.144 MB, latency=15.47 ms.
cifar100       train : [loss = 0.864, top1 = 75.37%], valid : [loss = 1.309, top1 = 63.60%], test : [loss = 1.287, top1 = 63.62%]
ImageNet16-120 FLOP=  4.25 M, Params=0.146 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.59%], valid : [loss = 2.631, top1 = 34.31%], test : [loss = 2.664, top1 = 33.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.40%], valid : [loss = 0.679, top1 = 76.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8966/15625) 008966-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.45%], valid : [loss = 0.643, top1 = 85.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10        train : [loss = 0.056, top1 = 98.36%], test  : [loss = 0.403, top1 = 89.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.60 ms.
cifar100       train : [loss = 0.662, top1 = 80.49%], valid : [loss = 1.386, top1 = 63.72%], test : [loss = 1.378, top1 = 63.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.50%], valid : [loss = 2.592, top1 = 34.73%], test : [loss = 2.633, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.05%], valid : [loss = 0.840, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8967/15625) 008967-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.550, top1 = 87.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.10 ms.
cifar10        train : [loss = 0.034, top1 = 98.94%], test  : [loss = 0.355, top1 = 90.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.28 ms.
cifar100       train : [loss = 0.396, top1 = 88.30%], valid : [loss = 1.310, top1 = 66.48%], test : [loss = 1.285, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 2.250, top1 = 41.85%], valid : [loss = 2.418, top1 = 38.83%], test : [loss = 2.414, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 65.98%], valid : [loss = 0.983, top1 = 65.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8968/15625) 008968-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.28%], valid : [loss = 0.499, top1 = 86.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.72 ms.
cifar10        train : [loss = 0.047, top1 = 98.66%], test  : [loss = 0.349, top1 = 90.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.42 ms.
cifar100       train : [loss = 0.501, top1 = 85.70%], valid : [loss = 1.227, top1 = 67.00%], test : [loss = 1.189, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.74%], valid : [loss = 2.326, top1 = 40.62%], test : [loss = 2.353, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.82%], valid : [loss = 0.831, top1 = 70.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8969/15625) 008969-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.782, top1 = 83.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.58 ms.
cifar10        train : [loss = 0.038, top1 = 98.87%], test  : [loss = 0.504, top1 = 88.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.388, top1 = 89.18%], valid : [loss = 1.699, top1 = 59.90%], test : [loss = 1.643, top1 = 60.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.94%], valid : [loss = 2.899, top1 = 30.27%], test : [loss = 2.905, top1 = 30.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.83%], valid : [loss = 0.877, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8970/15625) 008970-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.737, top1 = 84.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.021, top1 = 99.48%], test  : [loss = 0.471, top1 = 89.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.318, top1 = 91.68%], valid : [loss = 1.669, top1 = 61.98%], test : [loss = 1.641, top1 = 62.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.57%], valid : [loss = 2.838, top1 = 30.64%], test : [loss = 2.874, top1 = 30.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.28%], valid : [loss = 0.857, top1 = 69.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8971/15625) 008971-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.55%], valid : [loss = 0.620, top1 = 86.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10        train : [loss = 0.031, top1 = 99.13%], test  : [loss = 0.388, top1 = 90.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.53 ms.
cifar100       train : [loss = 0.541, top1 = 84.22%], valid : [loss = 1.439, top1 = 63.61%], test : [loss = 1.411, top1 = 64.15%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.08%], valid : [loss = 2.569, top1 = 35.86%], test : [loss = 2.582, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.33%], valid : [loss = 0.886, top1 = 68.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8972/15625) 008972-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.76%], valid : [loss = 0.529, top1 = 84.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.189, top1 = 93.62%], test  : [loss = 0.395, top1 = 87.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 1.220, top1 = 65.36%], valid : [loss = 1.524, top1 = 58.55%], test : [loss = 1.526, top1 = 58.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.64%], valid : [loss = 2.703, top1 = 32.48%], test : [loss = 2.738, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.44%], valid : [loss = 0.973, top1 = 65.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8973/15625) 008973-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.447, top1 = 89.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.71 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.300, top1 = 92.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.94 ms.
cifar100       train : [loss = 0.190, top1 = 95.70%], valid : [loss = 1.264, top1 = 69.39%], test : [loss = 1.244, top1 = 69.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.74%], valid : [loss = 2.240, top1 = 43.07%], test : [loss = 2.251, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.410, top1 = 85.80%], valid : [loss = 0.532, top1 = 82.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8974/15625) 008974-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.45%], valid : [loss = 0.714, top1 = 80.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10        train : [loss = 0.188, top1 = 93.45%], test  : [loss = 0.508, top1 = 85.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.90 ms.
cifar100       train : [loss = 0.888, top1 = 74.10%], valid : [loss = 1.631, top1 = 57.75%], test : [loss = 1.676, top1 = 56.77%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 3.521, top1 = 16.39%], valid : [loss = 3.523, top1 = 16.70%], test : [loss = 3.520, top1 = 16.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.90%], valid : [loss = 1.293, top1 = 52.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8975/15625) 008975-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.325, top1 = 88.75%], valid : [loss = 0.575, top1 = 81.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10        train : [loss = 0.272, top1 = 90.70%], test  : [loss = 0.430, top1 = 86.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.68 ms.
cifar100       train : [loss = 1.475, top1 = 58.64%], valid : [loss = 1.706, top1 = 53.79%], test : [loss = 1.703, top1 = 53.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.26%], valid : [loss = 2.939, top1 = 27.93%], test : [loss = 2.975, top1 = 27.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.42%], valid : [loss = 1.053, top1 = 62.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8976/15625) 008976-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.452, top1 = 89.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.312, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.82 ms.
cifar100       train : [loss = 0.223, top1 = 94.59%], valid : [loss = 1.280, top1 = 68.79%], test : [loss = 1.304, top1 = 68.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.15%], valid : [loss = 2.275, top1 = 42.52%], test : [loss = 2.291, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.85%], valid : [loss = 0.548, top1 = 81.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8977/15625) 008977-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.217, top1 = 92.67%], valid : [loss = 0.548, top1 = 83.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.216, top1 = 92.67%], test  : [loss = 0.398, top1 = 87.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.48 ms.
cifar100       train : [loss = 1.309, top1 = 62.92%], valid : [loss = 1.591, top1 = 56.06%], test : [loss = 1.593, top1 = 55.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.742, top1 = 31.75%], valid : [loss = 2.755, top1 = 31.47%], test : [loss = 2.812, top1 = 30.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 66.77%], valid : [loss = 0.977, top1 = 65.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8978/15625) 008978-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.52%], valid : [loss = 0.590, top1 = 80.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.75 ms.
cifar10        train : [loss = 0.286, top1 = 90.15%], test  : [loss = 0.431, top1 = 85.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.89 ms.
cifar100       train : [loss = 1.532, top1 = 57.36%], valid : [loss = 1.769, top1 = 52.36%], test : [loss = 1.765, top1 = 52.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.874, top1 = 29.11%], valid : [loss = 2.905, top1 = 28.69%], test : [loss = 2.945, top1 = 28.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.037, top1 = 62.34%], valid : [loss = 1.097, top1 = 61.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8979/15625) 008979-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.530, top1 = 88.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.343, top1 = 91.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.22 ms.
cifar100       train : [loss = 0.339, top1 = 90.84%], valid : [loss = 1.277, top1 = 67.20%], test : [loss = 1.299, top1 = 66.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.82%], valid : [loss = 2.405, top1 = 38.62%], test : [loss = 2.418, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8980/15625) 008980-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.532, top1 = 87.95%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10        train : [loss = 0.029, top1 = 99.26%], test  : [loss = 0.369, top1 = 90.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.83 ms.
cifar100       train : [loss = 0.451, top1 = 87.05%], valid : [loss = 1.341, top1 = 66.05%], test : [loss = 1.322, top1 = 65.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.68%], valid : [loss = 2.426, top1 = 38.80%], test : [loss = 2.473, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.33%], valid : [loss = 0.617, top1 = 78.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8981/15625) 008981-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 1.771, top1 = 34.46%], valid : [loss = 1.774, top1 = 34.61%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10        train : [loss = 1.368, top1 = 50.32%], test  : [loss = 1.370, top1 = 50.35%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.57 ms.
cifar100       train : [loss = 3.858, top1 = 10.73%], valid : [loss = 3.920, top1 = 9.75%], test : [loss = 3.917, top1 = 10.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.42 ms.
ImageNet16-120 train : [loss = 4.030, top1 = 9.91%], valid : [loss = 4.021, top1 = 10.02%], test : [loss = 4.038, top1 = 9.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.985, top1 = 25.93%], valid : [loss = 1.991, top1 = 26.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8982/15625) 008982-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.563, top1 = 88.49%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.79 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.366, top1 = 92.10%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.85 ms.
cifar100       train : [loss = 0.174, top1 = 96.22%], valid : [loss = 1.371, top1 = 67.78%], test : [loss = 1.384, top1 = 67.59%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.08 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.85%], valid : [loss = 2.443, top1 = 38.92%], test : [loss = 2.469, top1 = 38.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.37%], valid : [loss = 0.737, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8983/15625) 008983-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.68 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.78%], valid : [loss = 0.573, top1 = 87.89%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.60 ms.
cifar10        train : [loss = 0.017, top1 = 99.54%], test  : [loss = 0.369, top1 = 91.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.96 ms.
cifar100       train : [loss = 0.316, top1 = 91.02%], valid : [loss = 1.363, top1 = 66.84%], test : [loss = 1.362, top1 = 67.01%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.33%], valid : [loss = 2.472, top1 = 37.30%], test : [loss = 2.487, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 67.24%], valid : [loss = 0.960, top1 = 65.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8984/15625) 008984-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.16%], valid : [loss = 0.633, top1 = 84.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10        train : [loss = 0.075, top1 = 97.60%], test  : [loss = 0.421, top1 = 88.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 0.639, top1 = 81.11%], valid : [loss = 1.541, top1 = 60.79%], test : [loss = 1.517, top1 = 61.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.943, top1 = 27.26%], valid : [loss = 2.996, top1 = 26.23%], test : [loss = 3.024, top1 = 25.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.019, top1 = 63.16%], valid : [loss = 1.049, top1 = 62.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8985/15625) 008985-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.442, top1 = 90.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.306, top1 = 92.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.91 ms.
cifar100       train : [loss = 0.160, top1 = 96.36%], valid : [loss = 1.303, top1 = 69.13%], test : [loss = 1.295, top1 = 69.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.786, top1 = 52.49%], valid : [loss = 2.257, top1 = 42.67%], test : [loss = 2.279, top1 = 42.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.417, top1 = 85.59%], valid : [loss = 0.535, top1 = 81.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8986/15625) 008986-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.93 ms.
cifar10-valid  train : [loss = 0.147, top1 = 95.35%], valid : [loss = 0.503, top1 = 85.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.42 ms.
cifar10        train : [loss = 0.171, top1 = 94.22%], test  : [loss = 0.368, top1 = 88.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.95 ms.
cifar100       train : [loss = 1.054, top1 = 69.78%], valid : [loss = 1.396, top1 = 61.05%], test : [loss = 1.380, top1 = 61.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.86%], valid : [loss = 2.596, top1 = 35.18%], test : [loss = 2.612, top1 = 34.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.33%], valid : [loss = 0.978, top1 = 65.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8987/15625) 008987-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.483, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.310, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.27 ms.
cifar100       train : [loss = 0.318, top1 = 91.48%], valid : [loss = 1.248, top1 = 68.10%], test : [loss = 1.259, top1 = 67.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.67%], valid : [loss = 2.316, top1 = 41.10%], test : [loss = 2.330, top1 = 40.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8988/15625) 008988-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.75%], valid : [loss = 0.504, top1 = 85.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10        train : [loss = 0.162, top1 = 94.59%], test  : [loss = 0.382, top1 = 88.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.59 ms.
cifar100       train : [loss = 0.964, top1 = 72.23%], valid : [loss = 1.383, top1 = 62.03%], test : [loss = 1.360, top1 = 62.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.81%], valid : [loss = 2.699, top1 = 32.96%], test : [loss = 2.749, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.90%], valid : [loss = 0.992, top1 = 65.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8989/15625) 008989-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.542, top1 = 88.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.024, top1 = 99.32%], test  : [loss = 0.359, top1 = 91.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.57 ms.
cifar100       train : [loss = 0.416, top1 = 88.00%], valid : [loss = 1.249, top1 = 67.36%], test : [loss = 1.266, top1 = 67.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.42%], valid : [loss = 2.370, top1 = 39.77%], test : [loss = 2.390, top1 = 39.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.68%], valid : [loss = 0.730, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8990/15625) 008990-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.631, top1 = 86.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.99 ms.
cifar10        train : [loss = 0.027, top1 = 99.35%], test  : [loss = 0.445, top1 = 89.31%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.36 ms.
cifar100       train : [loss = 0.385, top1 = 89.74%], valid : [loss = 1.435, top1 = 64.29%], test : [loss = 1.434, top1 = 64.60%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.99%], valid : [loss = 2.613, top1 = 34.70%], test : [loss = 2.636, top1 = 35.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.74%], valid : [loss = 0.772, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8991/15625) 008991-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.585, top1 = 86.96%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.040, top1 = 98.79%], test  : [loss = 0.398, top1 = 89.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.11 ms.
cifar100       train : [loss = 0.556, top1 = 83.66%], valid : [loss = 1.410, top1 = 64.01%], test : [loss = 1.403, top1 = 63.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.481, top1 = 37.20%], valid : [loss = 2.630, top1 = 34.03%], test : [loss = 2.649, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8992/15625) 008992-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.530, top1 = 89.19%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.46 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.336, top1 = 92.73%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.72 ms.
cifar100       train : [loss = 0.083, top1 = 98.38%], valid : [loss = 1.411, top1 = 68.93%], test : [loss = 1.417, top1 = 68.69%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.17%], valid : [loss = 2.295, top1 = 41.48%], test : [loss = 2.305, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.18%], valid : [loss = 0.781, top1 = 72.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8993/15625) 008993-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.51%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.95 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.310, top1 = 93.19%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.95 ms.
cifar100       train : [loss = 0.113, top1 = 97.84%], valid : [loss = 1.295, top1 = 69.20%], test : [loss = 1.325, top1 = 69.21%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 51.97%], valid : [loss = 2.283, top1 = 42.51%], test : [loss = 2.278, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.80%], valid : [loss = 0.602, top1 = 79.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8994/15625) 008994-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.60%], valid : [loss = 0.670, top1 = 77.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.520, top1 = 81.92%], test  : [loss = 0.597, top1 = 79.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.02 ms.
cifar100       train : [loss = 1.682, top1 = 54.31%], valid : [loss = 1.837, top1 = 51.06%], test : [loss = 1.865, top1 = 50.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 3.339, top1 = 21.09%], valid : [loss = 3.319, top1 = 21.18%], test : [loss = 3.361, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.58%], valid : [loss = 1.306, top1 = 53.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8995/15625) 008995-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.588, top1 = 88.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.17 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.394, top1 = 91.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.76 ms.
cifar100       train : [loss = 0.197, top1 = 95.36%], valid : [loss = 1.416, top1 = 66.82%], test : [loss = 1.430, top1 = 66.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.84%], valid : [loss = 2.508, top1 = 37.92%], test : [loss = 2.519, top1 = 37.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.45%], valid : [loss = 0.769, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8996/15625) 008996-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.576, top1 = 87.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.57 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.381, top1 = 91.30%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.13 ms.
cifar100       train : [loss = 0.398, top1 = 88.73%], valid : [loss = 1.387, top1 = 65.51%], test : [loss = 1.401, top1 = 65.77%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.83%], valid : [loss = 2.502, top1 = 36.90%], test : [loss = 2.519, top1 = 36.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8997/15625) 008997-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.64%], valid : [loss = 0.520, top1 = 85.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.176, top1 = 94.10%], test  : [loss = 0.383, top1 = 87.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 1.000, top1 = 71.22%], valid : [loss = 1.406, top1 = 61.41%], test : [loss = 1.381, top1 = 61.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.48%], valid : [loss = 2.720, top1 = 32.72%], test : [loss = 2.756, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.88%], valid : [loss = 0.944, top1 = 66.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8998/15625) 008998-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.14%], valid : [loss = 0.848, top1 = 71.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.693, top1 = 75.75%], test  : [loss = 0.779, top1 = 73.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.01 ms.
cifar100       train : [loss = 1.969, top1 = 47.58%], valid : [loss = 2.132, top1 = 44.78%], test : [loss = 2.156, top1 = 44.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 3.658, top1 = 15.66%], valid : [loss = 3.682, top1 = 16.02%], test : [loss = 3.700, top1 = 14.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 8999/15625) 008999-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.511, top1 = 88.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.337, top1 = 92.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.97 ms.
cifar100       train : [loss = 0.342, top1 = 90.72%], valid : [loss = 1.277, top1 = 67.27%], test : [loss = 1.282, top1 = 67.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.55%], valid : [loss = 2.417, top1 = 38.71%], test : [loss = 2.432, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9000/15625) 009000-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.547, top1 = 88.96%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.366, top1 = 92.62%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.77 ms.
cifar100       train : [loss = 0.070, top1 = 98.99%], valid : [loss = 1.500, top1 = 67.99%], test : [loss = 1.497, top1 = 67.73%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 1.795, top1 = 52.31%], valid : [loss = 2.445, top1 = 39.11%], test : [loss = 2.435, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.70%], valid : [loss = 0.737, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9001/15625) 009001-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.540, top1 = 88.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10        train : [loss = 0.030, top1 = 99.09%], test  : [loss = 0.340, top1 = 91.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.57 ms.
cifar100       train : [loss = 0.425, top1 = 87.57%], valid : [loss = 1.274, top1 = 67.25%], test : [loss = 1.253, top1 = 67.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 2.200, top1 = 43.05%], valid : [loss = 2.380, top1 = 39.43%], test : [loss = 2.378, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 70.09%], valid : [loss = 0.877, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9002/15625) 009002-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.69 ms.
cifar100       train : [loss = 0.320, top1 = 91.46%], valid : [loss = 1.253, top1 = 67.39%], test : [loss = 1.247, top1 = 68.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.71%], valid : [loss = 2.287, top1 = 41.24%], test : [loss = 2.343, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.45%], valid : [loss = 0.614, top1 = 78.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9003/15625) 009003-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.77%], valid : [loss = 0.592, top1 = 87.07%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.08 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.381, top1 = 91.19%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.66 ms.
cifar100       train : [loss = 0.374, top1 = 89.36%], valid : [loss = 1.416, top1 = 64.82%], test : [loss = 1.419, top1 = 65.23%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 42.04%], valid : [loss = 2.489, top1 = 37.39%], test : [loss = 2.509, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.38%], valid : [loss = 0.861, top1 = 69.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9004/15625) 009004-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.512, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.320, top1 = 92.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.20 ms.
cifar100       train : [loss = 0.173, top1 = 96.09%], valid : [loss = 1.309, top1 = 68.29%], test : [loss = 1.320, top1 = 68.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.21%], valid : [loss = 2.311, top1 = 41.61%], test : [loss = 2.306, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9005/15625) 009005-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.91 ms.
cifar10-valid  train : [loss = 0.681, top1 = 76.21%], valid : [loss = 0.860, top1 = 70.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.59 ms.
cifar10        train : [loss = 0.668, top1 = 76.55%], test  : [loss = 0.757, top1 = 73.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.72 ms.
cifar100       train : [loss = 1.971, top1 = 47.57%], valid : [loss = 2.132, top1 = 44.97%], test : [loss = 2.157, top1 = 44.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.32 ms.
ImageNet16-120 train : [loss = 3.654, top1 = 15.68%], valid : [loss = 3.667, top1 = 15.89%], test : [loss = 3.702, top1 = 14.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9006/15625) 009006-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.45%], valid : [loss = 0.838, top1 = 75.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.94 ms.
cifar10        train : [loss = 0.311, top1 = 89.22%], test  : [loss = 0.620, top1 = 80.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.60 ms.
cifar100       train : [loss = 1.367, top1 = 61.59%], valid : [loss = 1.923, top1 = 50.23%], test : [loss = 1.918, top1 = 50.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 3.515, top1 = 16.96%], valid : [loss = 3.530, top1 = 17.36%], test : [loss = 3.531, top1 = 16.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.263, top1 = 53.88%], valid : [loss = 1.311, top1 = 52.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9007/15625) 009007-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.510, top1 = 88.70%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.335, top1 = 92.12%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.96 ms.
cifar100       train : [loss = 0.330, top1 = 91.09%], valid : [loss = 1.310, top1 = 66.78%], test : [loss = 1.286, top1 = 67.49%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.04%], valid : [loss = 2.397, top1 = 38.97%], test : [loss = 2.439, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.17%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9008/15625) 009008-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.33%], valid : [loss = 0.621, top1 = 85.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10        train : [loss = 0.069, top1 = 97.89%], test  : [loss = 0.405, top1 = 88.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.50 ms.
cifar100       train : [loss = 0.711, top1 = 79.29%], valid : [loss = 1.386, top1 = 63.35%], test : [loss = 1.390, top1 = 62.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.09%], valid : [loss = 2.644, top1 = 33.47%], test : [loss = 2.688, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9009/15625) 009009-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.346, top1 = 91.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.30 ms.
cifar100       train : [loss = 0.342, top1 = 90.69%], valid : [loss = 1.290, top1 = 66.91%], test : [loss = 1.287, top1 = 67.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.84%], valid : [loss = 2.397, top1 = 39.11%], test : [loss = 2.406, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9010/15625) 009010-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.59%], valid : [loss = 0.518, top1 = 87.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.046, top1 = 98.75%], test  : [loss = 0.361, top1 = 90.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.38 ms.
cifar100       train : [loss = 0.550, top1 = 84.03%], valid : [loss = 1.291, top1 = 66.37%], test : [loss = 1.286, top1 = 66.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.79%], valid : [loss = 2.447, top1 = 38.52%], test : [loss = 2.485, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.52%], valid : [loss = 0.625, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9011/15625) 009011-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9012/15625) 009012-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.09%], valid : [loss = 0.854, top1 = 71.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10        train : [loss = 0.562, top1 = 80.35%], test  : [loss = 0.721, top1 = 75.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.22 ms.
cifar100       train : [loss = 1.781, top1 = 51.91%], valid : [loss = 2.042, top1 = 47.13%], test : [loss = 2.074, top1 = 46.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.93%], valid : [loss = 3.627, top1 = 16.43%], test : [loss = 3.664, top1 = 15.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9013/15625) 009013-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.563, top1 = 89.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.341, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.33 ms.
cifar100       train : [loss = 0.152, top1 = 96.40%], valid : [loss = 1.409, top1 = 67.76%], test : [loss = 1.401, top1 = 68.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 2.098, top1 = 45.12%], valid : [loss = 2.377, top1 = 39.03%], test : [loss = 2.389, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.62%], valid : [loss = 0.853, top1 = 69.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9014/15625) 009014-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.98%], valid : [loss = 0.975, top1 = 66.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10        train : [loss = 0.774, top1 = 72.74%], test  : [loss = 0.858, top1 = 70.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.25 ms.
cifar100       train : [loss = 2.151, top1 = 43.62%], valid : [loss = 2.341, top1 = 40.54%], test : [loss = 2.350, top1 = 40.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 3.746, top1 = 14.23%], valid : [loss = 3.767, top1 = 14.62%], test : [loss = 3.780, top1 = 13.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.449, top1 = 47.06%], valid : [loss = 1.471, top1 = 46.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9015/15625) 009015-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.454, top1 = 89.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.320, top1 = 91.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.89 ms.
cifar100       train : [loss = 0.326, top1 = 91.14%], valid : [loss = 1.312, top1 = 67.19%], test : [loss = 1.298, top1 = 67.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.19%], valid : [loss = 2.384, top1 = 39.68%], test : [loss = 2.405, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9016/15625) 009016-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 90.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.91 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.74%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.72 ms.
cifar100       train : [loss = 0.044, top1 = 99.53%], valid : [loss = 1.336, top1 = 71.18%], test : [loss = 1.329, top1 = 70.83%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 1.446, top1 = 60.68%], valid : [loss = 2.231, top1 = 44.58%], test : [loss = 2.262, top1 = 43.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.40%], valid : [loss = 0.474, top1 = 84.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9017/15625) 009017-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.161, top1 = 94.72%], valid : [loss = 0.545, top1 = 84.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.159, top1 = 94.65%], test  : [loss = 0.379, top1 = 88.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.134, top1 = 67.56%], valid : [loss = 1.475, top1 = 59.55%], test : [loss = 1.470, top1 = 59.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.567, top1 = 35.40%], valid : [loss = 2.626, top1 = 34.21%], test : [loss = 2.667, top1 = 33.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.21%], valid : [loss = 0.937, top1 = 66.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9018/15625) 009018-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.624, top1 = 86.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.13 ms.
cifar10        train : [loss = 0.034, top1 = 99.05%], test  : [loss = 0.416, top1 = 89.63%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.22 ms.
cifar100       train : [loss = 0.445, top1 = 87.39%], valid : [loss = 1.562, top1 = 61.94%], test : [loss = 1.528, top1 = 62.51%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.53%], valid : [loss = 2.639, top1 = 34.20%], test : [loss = 2.653, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.67%], valid : [loss = 0.798, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9019/15625) 009019-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.12%], valid : [loss = 0.642, top1 = 78.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.12 ms.
cifar10        train : [loss = 0.664, top1 = 76.91%], test  : [loss = 0.709, top1 = 75.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.85 ms.
cifar100       train : [loss = 1.685, top1 = 54.30%], valid : [loss = 1.859, top1 = 50.05%], test : [loss = 1.872, top1 = 50.61%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.340, top1 = 21.07%], valid : [loss = 3.315, top1 = 21.58%], test : [loss = 3.367, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.292, top1 = 53.12%], valid : [loss = 1.304, top1 = 53.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9020/15625) 009020-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.548, top1 = 88.65%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.19 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.379, top1 = 91.94%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.53 ms.
cifar100       train : [loss = 0.079, top1 = 98.96%], valid : [loss = 1.436, top1 = 68.10%], test : [loss = 1.448, top1 = 67.93%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.41 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.22%], valid : [loss = 2.437, top1 = 39.62%], test : [loss = 2.457, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.22%], valid : [loss = 0.694, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9021/15625) 009021-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.515, top1 = 89.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.08 ms.
cifar10        train : [loss = 0.008, top1 = 99.79%], test  : [loss = 0.332, top1 = 92.73%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.94 ms.
cifar100       train : [loss = 0.227, top1 = 93.99%], valid : [loss = 1.286, top1 = 68.54%], test : [loss = 1.272, top1 = 69.02%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.06 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 50.83%], valid : [loss = 2.215, top1 = 43.10%], test : [loss = 2.217, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.96%], valid : [loss = 0.774, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9022/15625) 009022-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.559, top1 = 87.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10        train : [loss = 0.030, top1 = 99.13%], test  : [loss = 0.369, top1 = 90.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.43 ms.
cifar100       train : [loss = 0.510, top1 = 85.17%], valid : [loss = 1.342, top1 = 64.57%], test : [loss = 1.340, top1 = 65.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.18%], valid : [loss = 2.456, top1 = 37.09%], test : [loss = 2.474, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.87%], valid : [loss = 0.830, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9023/15625) 009023-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.27%], valid : [loss = 0.662, top1 = 77.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.35 ms.
cifar10        train : [loss = 0.515, top1 = 82.23%], test  : [loss = 0.594, top1 = 79.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.56 ms.
cifar100       train : [loss = 1.742, top1 = 52.79%], valid : [loss = 1.899, top1 = 49.01%], test : [loss = 1.903, top1 = 50.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 3.335, top1 = 21.13%], valid : [loss = 3.329, top1 = 21.58%], test : [loss = 3.362, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.14%], valid : [loss = 1.299, top1 = 53.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9024/15625) 009024-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.45%], valid : [loss = 0.851, top1 = 71.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10        train : [loss = 0.560, top1 = 80.44%], test  : [loss = 0.716, top1 = 75.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.84 ms.
cifar100       train : [loss = 1.778, top1 = 52.17%], valid : [loss = 2.047, top1 = 46.96%], test : [loss = 2.068, top1 = 46.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.84%], valid : [loss = 3.623, top1 = 17.15%], test : [loss = 3.667, top1 = 15.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9025/15625) 009025-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.482, top1 = 89.29%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.317, top1 = 92.06%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.54 ms.
cifar100       train : [loss = 0.224, top1 = 94.55%], valid : [loss = 1.229, top1 = 69.19%], test : [loss = 1.231, top1 = 68.88%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.64 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.92%], valid : [loss = 2.196, top1 = 43.07%], test : [loss = 2.232, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.64%], valid : [loss = 0.722, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9026/15625) 009026-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.551, top1 = 88.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.027, top1 = 99.24%], test  : [loss = 0.341, top1 = 91.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.96 ms.
cifar100       train : [loss = 0.421, top1 = 87.76%], valid : [loss = 1.253, top1 = 67.99%], test : [loss = 1.256, top1 = 67.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.25%], valid : [loss = 2.379, top1 = 39.62%], test : [loss = 2.392, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9027/15625) 009027-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.619, top1 = 87.44%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.398, top1 = 91.79%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.06 ms.
cifar100       train : [loss = 0.125, top1 = 97.45%], valid : [loss = 1.537, top1 = 65.82%], test : [loss = 1.536, top1 = 66.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.36%], valid : [loss = 2.406, top1 = 38.97%], test : [loss = 2.419, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.66%], valid : [loss = 0.785, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9028/15625) 009028-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.590, top1 = 87.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.392, top1 = 91.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.74 ms.
cifar100       train : [loss = 0.194, top1 = 95.53%], valid : [loss = 1.452, top1 = 66.10%], test : [loss = 1.472, top1 = 66.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.85%], valid : [loss = 2.479, top1 = 37.85%], test : [loss = 2.522, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.78%], valid : [loss = 0.754, top1 = 73.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9029/15625) 009029-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.224, top1 = 92.33%], valid : [loss = 0.512, top1 = 84.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.218, top1 = 92.65%], test  : [loss = 0.390, top1 = 87.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.32 ms.
cifar100       train : [loss = 1.232, top1 = 65.11%], valid : [loss = 1.536, top1 = 57.50%], test : [loss = 1.534, top1 = 57.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.728, top1 = 32.09%], valid : [loss = 2.745, top1 = 31.93%], test : [loss = 2.799, top1 = 31.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.58%], valid : [loss = 1.091, top1 = 61.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9030/15625) 009030-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.072, top1 = 97.70%], valid : [loss = 0.605, top1 = 84.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10        train : [loss = 0.086, top1 = 97.17%], test  : [loss = 0.413, top1 = 88.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.26 ms.
cifar100       train : [loss = 0.673, top1 = 80.06%], valid : [loss = 1.516, top1 = 61.40%], test : [loss = 1.517, top1 = 60.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 21.84%], valid : [loss = 3.222, top1 = 21.33%], test : [loss = 3.245, top1 = 21.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.72%], valid : [loss = 1.051, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9031/15625) 009031-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.572, top1 = 87.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.46 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.391, top1 = 91.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.421, top1 = 87.98%], valid : [loss = 1.399, top1 = 65.12%], test : [loss = 1.374, top1 = 65.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.63%], valid : [loss = 2.517, top1 = 36.57%], test : [loss = 2.528, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.14%], valid : [loss = 0.801, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9032/15625) 009032-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.49%], valid : [loss = 0.435, top1 = 88.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.42 ms.
cifar10        train : [loss = 0.055, top1 = 98.62%], test  : [loss = 0.304, top1 = 90.74%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.78 ms.
cifar100       train : [loss = 0.578, top1 = 84.11%], valid : [loss = 1.223, top1 = 66.74%], test : [loss = 1.219, top1 = 66.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.44%], valid : [loss = 2.457, top1 = 37.82%], test : [loss = 2.468, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9033/15625) 009033-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.561, top1 = 87.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.379, top1 = 91.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 0.397, top1 = 88.70%], valid : [loss = 1.395, top1 = 65.78%], test : [loss = 1.374, top1 = 65.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.90%], valid : [loss = 2.527, top1 = 36.33%], test : [loss = 2.530, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9034/15625) 009034-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.552, top1 = 89.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.359, top1 = 92.79%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.68 ms.
cifar100       train : [loss = 0.101, top1 = 98.22%], valid : [loss = 1.416, top1 = 68.37%], test : [loss = 1.437, top1 = 68.47%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.60%], valid : [loss = 2.447, top1 = 38.90%], test : [loss = 2.452, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.35%], valid : [loss = 0.711, top1 = 75.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9035/15625) 009035-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.61%], valid : [loss = 0.435, top1 = 88.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10        train : [loss = 0.054, top1 = 98.71%], test  : [loss = 0.311, top1 = 90.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.86 ms.
cifar100       train : [loss = 0.581, top1 = 83.95%], valid : [loss = 1.196, top1 = 67.21%], test : [loss = 1.202, top1 = 66.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.41%], valid : [loss = 2.453, top1 = 38.28%], test : [loss = 2.475, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.49%], valid : [loss = 0.635, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9036/15625) 009036-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.586, top1 = 87.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.72 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.384, top1 = 91.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.48 ms.
cifar100       train : [loss = 0.395, top1 = 88.69%], valid : [loss = 1.397, top1 = 64.97%], test : [loss = 1.395, top1 = 65.77%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.12%], valid : [loss = 2.519, top1 = 36.97%], test : [loss = 2.547, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.22%], valid : [loss = 0.815, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9037/15625) 009037-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.21%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.320, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.314, top1 = 91.43%], valid : [loss = 1.319, top1 = 66.73%], test : [loss = 1.283, top1 = 67.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.25%], valid : [loss = 2.377, top1 = 39.33%], test : [loss = 2.401, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.53%], valid : [loss = 0.547, top1 = 81.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9038/15625) 009038-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.533, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.346, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.03 ms.
cifar100       train : [loss = 0.153, top1 = 96.45%], valid : [loss = 1.351, top1 = 68.25%], test : [loss = 1.340, top1 = 68.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 47.95%], valid : [loss = 2.332, top1 = 40.52%], test : [loss = 2.322, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.45%], valid : [loss = 0.836, top1 = 70.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9039/15625) 009039-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.72%], valid : [loss = 0.731, top1 = 80.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10        train : [loss = 0.179, top1 = 93.80%], test  : [loss = 0.517, top1 = 84.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.71 ms.
cifar100       train : [loss = 0.882, top1 = 74.16%], valid : [loss = 1.650, top1 = 57.28%], test : [loss = 1.677, top1 = 56.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 3.498, top1 = 16.82%], valid : [loss = 3.496, top1 = 17.08%], test : [loss = 3.511, top1 = 16.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 52.86%], valid : [loss = 1.308, top1 = 52.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9040/15625) 009040-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.13%], valid : [loss = 0.479, top1 = 84.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.295, top1 = 90.16%], test  : [loss = 0.399, top1 = 86.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.34 ms.
cifar100       train : [loss = 1.332, top1 = 63.11%], valid : [loss = 1.542, top1 = 57.65%], test : [loss = 1.511, top1 = 58.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.74%], valid : [loss = 2.888, top1 = 29.27%], test : [loss = 2.955, top1 = 28.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9041/15625) 009041-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.318, top1 = 91.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.08 ms.
cifar100       train : [loss = 0.323, top1 = 91.21%], valid : [loss = 1.323, top1 = 66.86%], test : [loss = 1.300, top1 = 67.69%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.34%], valid : [loss = 2.376, top1 = 39.85%], test : [loss = 2.399, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9042/15625) 009042-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.44%], valid : [loss = 0.545, top1 = 87.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10        train : [loss = 0.048, top1 = 98.54%], test  : [loss = 0.375, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.57 ms.
cifar100       train : [loss = 0.577, top1 = 83.07%], valid : [loss = 1.373, top1 = 65.27%], test : [loss = 1.354, top1 = 65.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.423, top1 = 38.33%], valid : [loss = 2.586, top1 = 35.68%], test : [loss = 2.630, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.01%], valid : [loss = 0.671, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9043/15625) 009043-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 52.35 M, Params=0.382 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.522, top1 = 88.75%]
cifar10        FLOP= 52.35 M, Params=0.382 MB, latency=19.72 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.343, top1 = 91.90%]
cifar100       FLOP= 52.35 M, Params=0.388 MB, latency=18.37 ms.
cifar100       train : [loss = 0.269, top1 = 92.78%], valid : [loss = 1.280, top1 = 68.09%], test : [loss = 1.248, top1 = 68.81%]
ImageNet16-120 FLOP= 13.09 M, Params=0.389 MB, latency=19.09 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.19%], valid : [loss = 2.269, top1 = 41.72%], test : [loss = 2.295, top1 = 42.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.72%], valid : [loss = 0.659, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9044/15625) 009044-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.458, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 0.324, top1 = 91.29%], valid : [loss = 1.307, top1 = 67.23%], test : [loss = 1.309, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.16%], valid : [loss = 2.355, top1 = 39.68%], test : [loss = 2.389, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.83%], valid : [loss = 0.564, top1 = 81.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9045/15625) 009045-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.542, top1 = 89.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.45 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.339, top1 = 92.47%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.63 ms.
cifar100       train : [loss = 0.102, top1 = 97.81%], valid : [loss = 1.412, top1 = 68.79%], test : [loss = 1.417, top1 = 68.28%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.31 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 39.52%], valid : [loss = 2.536, top1 = 34.72%], test : [loss = 2.543, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 58.92%], valid : [loss = 1.150, top1 = 58.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9046/15625) 009046-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.445, top1 = 90.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.276, top1 = 93.57%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.74 ms.
cifar100       train : [loss = 0.099, top1 = 98.14%], valid : [loss = 1.315, top1 = 70.86%], test : [loss = 1.291, top1 = 70.17%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 1.671, top1 = 55.24%], valid : [loss = 2.235, top1 = 43.75%], test : [loss = 2.261, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.08%], valid : [loss = 0.498, top1 = 83.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9047/15625) 009047-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.647, top1 = 86.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.86 ms.
cifar10        train : [loss = 0.028, top1 = 99.30%], test  : [loss = 0.431, top1 = 89.41%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.88 ms.
cifar100       train : [loss = 0.365, top1 = 90.25%], valid : [loss = 1.416, top1 = 65.22%], test : [loss = 1.403, top1 = 65.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.18%], valid : [loss = 2.611, top1 = 34.77%], test : [loss = 2.627, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9048/15625) 009048-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.457, top1 = 89.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.296, top1 = 93.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.103, top1 = 98.13%], valid : [loss = 1.305, top1 = 69.67%], test : [loss = 1.292, top1 = 70.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.672, top1 = 55.20%], valid : [loss = 2.209, top1 = 43.17%], test : [loss = 2.234, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.445, top1 = 84.60%], valid : [loss = 0.566, top1 = 80.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9049/15625) 009049-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=22.15 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.493, top1 = 90.11%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=20.93 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.311, top1 = 93.41%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.91 ms.
cifar100       train : [loss = 0.031, top1 = 99.72%], valid : [loss = 1.407, top1 = 69.95%], test : [loss = 1.376, top1 = 70.21%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=26.18 ms.
ImageNet16-120 train : [loss = 1.933, top1 = 48.81%], valid : [loss = 2.335, top1 = 40.45%], test : [loss = 2.328, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.54%], valid : [loss = 0.849, top1 = 69.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9050/15625) 009050-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.586, top1 = 86.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10        train : [loss = 0.019, top1 = 99.51%], test  : [loss = 0.397, top1 = 90.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.64 ms.
cifar100       train : [loss = 0.388, top1 = 88.93%], valid : [loss = 1.413, top1 = 66.12%], test : [loss = 1.410, top1 = 64.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 2.267, top1 = 41.63%], valid : [loss = 2.476, top1 = 37.77%], test : [loss = 2.502, top1 = 37.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 72.78%], valid : [loss = 0.831, top1 = 70.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9051/15625) 009051-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.98 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.50 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.47 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9052/15625) 009052-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.540, top1 = 89.39%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.25 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.333, top1 = 93.32%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.78 ms.
cifar100       train : [loss = 0.032, top1 = 99.73%], valid : [loss = 1.425, top1 = 70.26%], test : [loss = 1.402, top1 = 70.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 1.550, top1 = 58.18%], valid : [loss = 2.407, top1 = 41.68%], test : [loss = 2.412, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.23%], valid : [loss = 0.675, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9053/15625) 009053-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.560, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.387, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.42 ms.
cifar100       train : [loss = 0.116, top1 = 97.78%], valid : [loss = 1.454, top1 = 67.75%], test : [loss = 1.473, top1 = 67.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.45%], valid : [loss = 2.455, top1 = 39.10%], test : [loss = 2.475, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.15%], valid : [loss = 0.777, top1 = 73.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9054/15625) 009054-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10-valid  train : [loss = 1.230, top1 = 55.77%], valid : [loss = 1.281, top1 = 54.37%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10        train : [loss = 1.236, top1 = 55.72%], test  : [loss = 1.235, top1 = 55.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.47 ms.
cifar100       train : [loss = 2.697, top1 = 32.42%], valid : [loss = 2.777, top1 = 31.10%], test : [loss = 2.756, top1 = 31.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 3.864, top1 = 12.51%], valid : [loss = 3.859, top1 = 13.25%], test : [loss = 3.880, top1 = 12.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9055/15625) 009055-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.551, top1 = 87.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.377, top1 = 91.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.01 ms.
cifar100       train : [loss = 0.390, top1 = 89.00%], valid : [loss = 1.366, top1 = 65.97%], test : [loss = 1.372, top1 = 65.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.89%], valid : [loss = 2.468, top1 = 37.79%], test : [loss = 2.505, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.50%], valid : [loss = 0.713, top1 = 75.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9056/15625) 009056-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.545, top1 = 87.72%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.22 ms.
cifar10        train : [loss = 0.036, top1 = 99.02%], test  : [loss = 0.382, top1 = 90.29%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.490, top1 = 85.98%], valid : [loss = 1.365, top1 = 65.10%], test : [loss = 1.358, top1 = 65.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.40%], valid : [loss = 2.503, top1 = 37.05%], test : [loss = 2.511, top1 = 37.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.33%], valid : [loss = 0.597, top1 = 79.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9057/15625) 009057-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.77%], valid : [loss = 1.078, top1 = 63.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 0.845, top1 = 70.31%], test  : [loss = 0.920, top1 = 67.77%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.61 ms.
cifar100       train : [loss = 2.279, top1 = 40.72%], valid : [loss = 2.484, top1 = 37.76%], test : [loss = 2.495, top1 = 37.03%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 3.800, top1 = 13.30%], valid : [loss = 3.828, top1 = 13.80%], test : [loss = 3.824, top1 = 13.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.498, top1 = 45.08%], valid : [loss = 1.513, top1 = 44.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9058/15625) 009058-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.28%], valid : [loss = 0.467, top1 = 86.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10        train : [loss = 0.112, top1 = 96.59%], test  : [loss = 0.323, top1 = 89.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 0.851, top1 = 75.87%], valid : [loss = 1.275, top1 = 64.28%], test : [loss = 1.277, top1 = 63.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.60%], valid : [loss = 2.617, top1 = 34.33%], test : [loss = 2.645, top1 = 33.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.76%], valid : [loss = 0.671, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9059/15625) 009059-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.487, top1 = 89.53%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.307, top1 = 92.69%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.05 ms.
cifar100       train : [loss = 0.114, top1 = 98.01%], valid : [loss = 1.265, top1 = 69.44%], test : [loss = 1.278, top1 = 69.53%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.11 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.38%], valid : [loss = 2.206, top1 = 43.60%], test : [loss = 2.222, top1 = 44.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.25%], valid : [loss = 0.657, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9060/15625) 009060-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.604, top1 = 87.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.410, top1 = 91.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.76 ms.
cifar100       train : [loss = 0.204, top1 = 95.19%], valid : [loss = 1.449, top1 = 66.27%], test : [loss = 1.434, top1 = 66.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.33%], valid : [loss = 2.468, top1 = 38.83%], test : [loss = 2.494, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.66%], valid : [loss = 0.750, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9061/15625) 009061-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.46 ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.30%], valid : [loss = 0.644, top1 = 78.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.56 ms.
cifar10        train : [loss = 0.514, top1 = 82.24%], test  : [loss = 0.592, top1 = 79.94%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.99 ms.
cifar100       train : [loss = 1.688, top1 = 54.17%], valid : [loss = 1.859, top1 = 50.81%], test : [loss = 1.854, top1 = 51.08%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.37%], valid : [loss = 3.327, top1 = 21.73%], test : [loss = 3.354, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9062/15625) 009062-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.567, top1 = 87.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.380, top1 = 91.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.400, top1 = 88.52%], valid : [loss = 1.409, top1 = 65.31%], test : [loss = 1.408, top1 = 64.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.44%], valid : [loss = 2.486, top1 = 36.97%], test : [loss = 2.529, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 72.98%], valid : [loss = 0.823, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9063/15625) 009063-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.257, top1 = 91.09%], valid : [loss = 0.872, top1 = 75.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.294, top1 = 89.81%], test  : [loss = 0.630, top1 = 80.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.86 ms.
cifar100       train : [loss = 1.339, top1 = 62.39%], valid : [loss = 1.911, top1 = 50.40%], test : [loss = 1.927, top1 = 50.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 3.468, top1 = 17.80%], valid : [loss = 3.509, top1 = 17.80%], test : [loss = 3.510, top1 = 17.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9064/15625) 009064-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.68%], valid : [loss = 0.542, top1 = 87.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10        train : [loss = 0.037, top1 = 98.98%], test  : [loss = 0.376, top1 = 90.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 0.467, top1 = 86.56%], valid : [loss = 1.336, top1 = 65.51%], test : [loss = 1.340, top1 = 66.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 42.06%], valid : [loss = 2.516, top1 = 36.72%], test : [loss = 2.549, top1 = 37.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.16%], valid : [loss = 0.627, top1 = 78.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9065/15625) 009065-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.515, top1 = 88.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.333, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.360, top1 = 89.87%], valid : [loss = 1.237, top1 = 67.61%], test : [loss = 1.242, top1 = 68.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.083, top1 = 45.67%], valid : [loss = 2.311, top1 = 41.25%], test : [loss = 2.314, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.11%], valid : [loss = 0.830, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9066/15625) 009066-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.557, top1 = 87.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.387, top1 = 91.32%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.61 ms.
cifar100       train : [loss = 0.378, top1 = 89.29%], valid : [loss = 1.403, top1 = 65.37%], test : [loss = 1.383, top1 = 65.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.33%], valid : [loss = 2.508, top1 = 36.82%], test : [loss = 2.537, top1 = 36.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.82%], valid : [loss = 0.760, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9067/15625) 009067-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.21%], valid : [loss = 0.452, top1 = 86.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.94 ms.
cifar10        train : [loss = 0.156, top1 = 94.87%], test  : [loss = 0.342, top1 = 88.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.42 ms.
cifar100       train : [loss = 0.988, top1 = 71.82%], valid : [loss = 1.345, top1 = 62.31%], test : [loss = 1.349, top1 = 61.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.52%], valid : [loss = 2.726, top1 = 32.08%], test : [loss = 2.723, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9068/15625) 009068-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.51%], valid : [loss = 0.580, top1 = 83.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10        train : [loss = 0.167, top1 = 94.45%], test  : [loss = 0.403, top1 = 87.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.21 ms.
cifar100       train : [loss = 0.944, top1 = 72.52%], valid : [loss = 1.462, top1 = 60.62%], test : [loss = 1.461, top1 = 60.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 2.814, top1 = 30.28%], valid : [loss = 2.861, top1 = 29.23%], test : [loss = 2.888, top1 = 29.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.60%], valid : [loss = 0.938, top1 = 66.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9069/15625) 009069-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.539, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.386, top1 = 91.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.36 ms.
cifar100       train : [loss = 0.159, top1 = 96.69%], valid : [loss = 1.426, top1 = 67.37%], test : [loss = 1.412, top1 = 67.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.79%], valid : [loss = 2.438, top1 = 38.73%], test : [loss = 2.454, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.54%], valid : [loss = 0.672, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9070/15625) 009070-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.85%], valid : [loss = 0.568, top1 = 85.78%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.81 ms.
cifar10        train : [loss = 0.072, top1 = 97.83%], test  : [loss = 0.360, top1 = 89.66%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.75 ms.
cifar100       train : [loss = 0.604, top1 = 82.49%], valid : [loss = 1.342, top1 = 64.97%], test : [loss = 1.364, top1 = 65.16%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.88%], valid : [loss = 2.511, top1 = 35.73%], test : [loss = 2.522, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.59%], valid : [loss = 0.863, top1 = 69.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9071/15625) 009071-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.46%], valid : [loss = 0.967, top1 = 73.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10        train : [loss = 0.310, top1 = 89.13%], test  : [loss = 0.621, top1 = 80.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 1.324, top1 = 62.70%], valid : [loss = 1.942, top1 = 50.19%], test : [loss = 1.942, top1 = 49.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 3.347, top1 = 20.48%], valid : [loss = 3.461, top1 = 19.13%], test : [loss = 3.496, top1 = 18.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.156, top1 = 58.50%], valid : [loss = 1.213, top1 = 56.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9072/15625) 009072-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.466, top1 = 89.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.326, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.18 ms.
cifar100       train : [loss = 0.326, top1 = 91.28%], valid : [loss = 1.259, top1 = 67.34%], test : [loss = 1.259, top1 = 68.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.69%], valid : [loss = 2.327, top1 = 40.21%], test : [loss = 2.339, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9073/15625) 009073-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.78%], valid : [loss = 0.537, top1 = 86.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10        train : [loss = 0.093, top1 = 96.88%], test  : [loss = 0.376, top1 = 89.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.47 ms.
cifar100       train : [loss = 0.779, top1 = 76.94%], valid : [loss = 1.404, top1 = 62.35%], test : [loss = 1.394, top1 = 62.41%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 37.37%], valid : [loss = 2.591, top1 = 35.18%], test : [loss = 2.622, top1 = 34.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.57%], valid : [loss = 0.858, top1 = 69.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9074/15625) 009074-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.518, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.336, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.70 ms.
cifar100       train : [loss = 0.326, top1 = 91.15%], valid : [loss = 1.276, top1 = 67.50%], test : [loss = 1.282, top1 = 66.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.05%], valid : [loss = 2.394, top1 = 39.25%], test : [loss = 2.413, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9075/15625) 009075-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.67%], valid : [loss = 0.469, top1 = 85.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10        train : [loss = 0.227, top1 = 92.29%], test  : [loss = 0.390, top1 = 87.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 1.191, top1 = 66.23%], valid : [loss = 1.494, top1 = 58.29%], test : [loss = 1.501, top1 = 57.89%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = nan, top1 = 13.71%], valid : [loss = nan, top1 = 14.03%], test : [loss = nan, top1 = 13.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9076/15625) 009076-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.32%], valid : [loss = 0.634, top1 = 85.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10        train : [loss = 0.053, top1 = 98.41%], test  : [loss = 0.406, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.25 ms.
cifar100       train : [loss = 0.638, top1 = 81.47%], valid : [loss = 1.424, top1 = 63.15%], test : [loss = 1.403, top1 = 63.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.05%], valid : [loss = 2.607, top1 = 34.49%], test : [loss = 2.657, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.74%], valid : [loss = 0.845, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9077/15625) 009077-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.495, top1 = 88.90%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.329, top1 = 92.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.22 ms.
cifar100       train : [loss = 0.342, top1 = 90.73%], valid : [loss = 1.279, top1 = 67.36%], test : [loss = 1.312, top1 = 66.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.58%], valid : [loss = 2.419, top1 = 38.57%], test : [loss = 2.405, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9078/15625) 009078-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.92%], valid : [loss = 0.538, top1 = 86.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.89 ms.
cifar10        train : [loss = 0.075, top1 = 97.62%], test  : [loss = 0.347, top1 = 90.25%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.46 ms.
cifar100       train : [loss = 0.713, top1 = 79.05%], valid : [loss = 1.362, top1 = 64.36%], test : [loss = 1.334, top1 = 64.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 35.98%], valid : [loss = 2.622, top1 = 34.83%], test : [loss = 2.666, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.04%], valid : [loss = 0.668, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9079/15625) 009079-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.479, top1 = 89.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.296, top1 = 92.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.46 ms.
cifar100       train : [loss = 0.303, top1 = 92.02%], valid : [loss = 1.227, top1 = 68.04%], test : [loss = 1.295, top1 = 66.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.19%], valid : [loss = 2.300, top1 = 41.53%], test : [loss = 2.292, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.50%], valid : [loss = 0.616, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9080/15625) 009080-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.510, top1 = 90.06%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.78 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.307, top1 = 93.23%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.36 ms.
cifar100       train : [loss = 0.079, top1 = 98.70%], valid : [loss = 1.319, top1 = 70.24%], test : [loss = 1.276, top1 = 70.54%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.13 ms.
ImageNet16-120 train : [loss = 1.654, top1 = 55.66%], valid : [loss = 2.126, top1 = 45.43%], test : [loss = 2.163, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.470, top1 = 83.78%], valid : [loss = 0.584, top1 = 80.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9081/15625) 009081-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.94%], valid : [loss = 0.527, top1 = 86.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10        train : [loss = 0.075, top1 = 97.54%], test  : [loss = 0.360, top1 = 90.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.19 ms.
cifar100       train : [loss = 0.696, top1 = 79.52%], valid : [loss = 1.347, top1 = 63.64%], test : [loss = 1.373, top1 = 63.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 35.99%], valid : [loss = 2.635, top1 = 34.27%], test : [loss = 2.683, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.81%], valid : [loss = 0.676, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9082/15625) 009082-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.87%], valid : [loss = 0.772, top1 = 73.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10        train : [loss = 0.519, top1 = 82.02%], test  : [loss = 0.580, top1 = 80.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 2.065, top1 = 44.54%], valid : [loss = 2.171, top1 = 42.38%], test : [loss = 2.174, top1 = 42.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.23%], valid : [loss = 3.200, top1 = 23.52%], test : [loss = 3.242, top1 = 22.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.144, top1 = 58.60%], valid : [loss = 1.194, top1 = 57.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9083/15625) 009083-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.44%], valid : [loss = 0.499, top1 = 88.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.031, top1 = 99.07%], test  : [loss = 0.345, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.420, top1 = 87.79%], valid : [loss = 1.291, top1 = 66.70%], test : [loss = 1.278, top1 = 66.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.62%], valid : [loss = 2.372, top1 = 38.77%], test : [loss = 2.385, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.38%], valid : [loss = 0.818, top1 = 71.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9084/15625) 009084-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.38%], valid : [loss = 0.615, top1 = 85.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.30 ms.
cifar10        train : [loss = 0.060, top1 = 98.16%], test  : [loss = 0.423, top1 = 88.64%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 0.680, top1 = 80.02%], valid : [loss = 1.399, top1 = 63.04%], test : [loss = 1.388, top1 = 63.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.13%], valid : [loss = 2.654, top1 = 34.80%], test : [loss = 2.668, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.11%], valid : [loss = 0.820, top1 = 71.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9085/15625) 009085-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.39%], valid : [loss = 0.551, top1 = 83.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10        train : [loss = 0.206, top1 = 93.07%], test  : [loss = 0.392, top1 = 87.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 1.253, top1 = 64.39%], valid : [loss = 1.573, top1 = 57.23%], test : [loss = 1.537, top1 = 57.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.697, top1 = 32.62%], valid : [loss = 2.736, top1 = 31.70%], test : [loss = 2.775, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9086/15625) 009086-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.559, top1 = 88.30%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.74 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.365, top1 = 91.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.34 ms.
cifar100       train : [loss = 0.144, top1 = 97.00%], valid : [loss = 1.525, top1 = 66.34%], test : [loss = 1.554, top1 = 64.92%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.52%], valid : [loss = 2.410, top1 = 40.23%], test : [loss = 2.430, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 74.88%], valid : [loss = 0.782, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9087/15625) 009087-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.04%], valid : [loss = 0.677, top1 = 77.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10        train : [loss = 0.503, top1 = 82.77%], test  : [loss = 0.584, top1 = 79.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.713, top1 = 53.64%], valid : [loss = 1.872, top1 = 50.20%], test : [loss = 1.900, top1 = 50.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 3.359, top1 = 20.77%], valid : [loss = 3.333, top1 = 22.03%], test : [loss = 3.371, top1 = 20.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 54.17%], valid : [loss = 1.296, top1 = 53.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9088/15625) 009088-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.21%], valid : [loss = 0.456, top1 = 86.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.51 ms.
cifar10        train : [loss = 0.159, top1 = 94.63%], test  : [loss = 0.352, top1 = 88.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.16 ms.
cifar100       train : [loss = 1.003, top1 = 71.44%], valid : [loss = 1.351, top1 = 62.42%], test : [loss = 1.342, top1 = 62.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.84%], valid : [loss = 2.652, top1 = 33.60%], test : [loss = 2.682, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9089/15625) 009089-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.62%], valid : [loss = 0.543, top1 = 87.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10        train : [loss = 0.030, top1 = 99.05%], test  : [loss = 0.338, top1 = 91.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.42 ms.
cifar100       train : [loss = 0.415, top1 = 87.91%], valid : [loss = 1.270, top1 = 67.34%], test : [loss = 1.290, top1 = 66.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.267, top1 = 41.61%], valid : [loss = 2.423, top1 = 37.83%], test : [loss = 2.461, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.954, top1 = 65.46%], valid : [loss = 0.998, top1 = 64.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9090/15625) 009090-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.99%], valid : [loss = 0.748, top1 = 83.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10        train : [loss = 0.092, top1 = 97.09%], test  : [loss = 0.474, top1 = 87.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.56 ms.
cifar100       train : [loss = 0.829, top1 = 76.06%], valid : [loss = 1.607, top1 = 58.76%], test : [loss = 1.568, top1 = 59.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.824, top1 = 30.26%], valid : [loss = 2.960, top1 = 27.27%], test : [loss = 2.964, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.85%], valid : [loss = 0.881, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9091/15625) 009091-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.549, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.419, top1 = 91.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.24 ms.
cifar100       train : [loss = 0.134, top1 = 97.09%], valid : [loss = 1.490, top1 = 66.56%], test : [loss = 1.509, top1 = 66.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.49 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.72%], valid : [loss = 2.524, top1 = 36.57%], test : [loss = 2.537, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.24%], valid : [loss = 0.741, top1 = 74.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9092/15625) 009092-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.25%], valid : [loss = 0.457, top1 = 86.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.66 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.327, top1 = 89.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.854, top1 = 75.67%], valid : [loss = 1.283, top1 = 64.17%], test : [loss = 1.274, top1 = 64.17%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.83%], valid : [loss = 2.616, top1 = 34.69%], test : [loss = 2.651, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 80.02%], valid : [loss = 0.652, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9093/15625) 009093-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.300, top1 = 89.61%], valid : [loss = 0.475, top1 = 84.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.39 ms.
cifar10        train : [loss = 0.270, top1 = 90.90%], test  : [loss = 0.372, top1 = 87.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.60 ms.
cifar100       train : [loss = 1.269, top1 = 64.36%], valid : [loss = 1.467, top1 = 58.96%], test : [loss = 1.450, top1 = 59.31%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.28 ms.
ImageNet16-120 train : [loss = 2.815, top1 = 30.57%], valid : [loss = 2.793, top1 = 30.88%], test : [loss = 2.845, top1 = 29.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.34%], valid : [loss = 1.010, top1 = 64.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9094/15625) 009094-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.518, top1 = 89.86%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.56 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.331, top1 = 93.15%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.08 ms.
cifar100       train : [loss = 0.075, top1 = 98.76%], valid : [loss = 1.370, top1 = 69.18%], test : [loss = 1.392, top1 = 68.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.57%], valid : [loss = 2.431, top1 = 38.47%], test : [loss = 2.465, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 77.00%], valid : [loss = 0.714, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9095/15625) 009095-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.509, top1 = 89.55%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.80 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.324, top1 = 92.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.91 ms.
cifar100       train : [loss = 0.145, top1 = 97.14%], valid : [loss = 1.241, top1 = 69.88%], test : [loss = 1.254, top1 = 69.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.76 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.97%], valid : [loss = 2.153, top1 = 44.20%], test : [loss = 2.182, top1 = 45.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.50%], valid : [loss = 0.602, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9096/15625) 009096-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.50%], valid : [loss = 0.886, top1 = 69.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10        train : [loss = 0.698, top1 = 75.67%], test  : [loss = 0.758, top1 = 73.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.10 ms.
cifar100       train : [loss = 2.165, top1 = 42.59%], valid : [loss = 2.277, top1 = 40.20%], test : [loss = 2.261, top1 = 40.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 3.439, top1 = 18.89%], valid : [loss = 3.425, top1 = 19.33%], test : [loss = 3.437, top1 = 18.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.36%], valid : [loss = 1.390, top1 = 49.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9097/15625) 009097-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.34%], valid : [loss = 0.644, top1 = 85.26%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=15.27 ms.
cifar10        train : [loss = 0.061, top1 = 98.15%], test  : [loss = 0.408, top1 = 89.06%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=12.96 ms.
cifar100       train : [loss = 0.699, top1 = 79.65%], valid : [loss = 1.437, top1 = 62.37%], test : [loss = 1.420, top1 = 62.70%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.62%], valid : [loss = 2.683, top1 = 33.19%], test : [loss = 2.733, top1 = 32.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.12%], valid : [loss = 0.845, top1 = 70.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9098/15625) 009098-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.24%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.72 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.330, top1 = 92.53%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.25 ms.
cifar100       train : [loss = 0.137, top1 = 96.99%], valid : [loss = 1.286, top1 = 69.20%], test : [loss = 1.316, top1 = 69.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.92 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.44%], valid : [loss = 2.304, top1 = 41.40%], test : [loss = 2.307, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.91%], valid : [loss = 0.727, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9099/15625) 009099-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.433, top1 = 90.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.32 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.94 ms.
cifar100       train : [loss = 0.067, top1 = 99.11%], valid : [loss = 1.349, top1 = 69.72%], test : [loss = 1.357, top1 = 70.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.542, top1 = 58.21%], valid : [loss = 2.268, top1 = 43.70%], test : [loss = 2.284, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.24%], valid : [loss = 0.499, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9100/15625) 009100-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.51%], valid : [loss = 0.563, top1 = 87.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.032, top1 = 99.03%], test  : [loss = 0.358, top1 = 91.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.92 ms.
cifar100       train : [loss = 0.415, top1 = 87.81%], valid : [loss = 1.275, top1 = 66.90%], test : [loss = 1.268, top1 = 68.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.86%], valid : [loss = 2.408, top1 = 39.00%], test : [loss = 2.429, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.76%], valid : [loss = 0.896, top1 = 68.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9101/15625) 009101-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.549, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.352, top1 = 92.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.20 ms.
cifar100       train : [loss = 0.098, top1 = 98.31%], valid : [loss = 1.395, top1 = 69.18%], test : [loss = 1.472, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.30%], valid : [loss = 2.437, top1 = 38.47%], test : [loss = 2.463, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.44%], valid : [loss = 0.732, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9102/15625) 009102-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.70 ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.82%], valid : [loss = 0.868, top1 = 71.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10        train : [loss = 0.562, top1 = 80.51%], test  : [loss = 0.717, top1 = 75.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.56 ms.
cifar100       train : [loss = 1.769, top1 = 52.33%], valid : [loss = 2.042, top1 = 47.38%], test : [loss = 2.062, top1 = 47.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.32 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.69%], valid : [loss = 3.626, top1 = 16.30%], test : [loss = 3.662, top1 = 16.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9103/15625) 009103-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.558, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.394, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 0.193, top1 = 95.49%], valid : [loss = 1.398, top1 = 67.15%], test : [loss = 1.415, top1 = 67.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.83%], valid : [loss = 2.468, top1 = 38.08%], test : [loss = 2.507, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.92%], valid : [loss = 0.714, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9104/15625) 009104-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.592, top1 = 86.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.026, top1 = 99.31%], test  : [loss = 0.406, top1 = 90.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.09 ms.
cifar100       train : [loss = 0.480, top1 = 86.16%], valid : [loss = 1.444, top1 = 64.44%], test : [loss = 1.410, top1 = 63.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.38 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.91%], valid : [loss = 2.534, top1 = 36.03%], test : [loss = 2.576, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.13%], valid : [loss = 0.787, top1 = 72.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9105/15625) 009105-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.334, top1 = 88.72%], valid : [loss = 0.567, top1 = 81.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.277, top1 = 90.38%], test  : [loss = 0.437, top1 = 85.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.48 ms.
cifar100       train : [loss = 1.477, top1 = 58.75%], valid : [loss = 1.764, top1 = 52.84%], test : [loss = 1.746, top1 = 53.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.972, top1 = 27.45%], valid : [loss = 2.997, top1 = 27.17%], test : [loss = 3.069, top1 = 25.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.206, top1 = 56.01%], valid : [loss = 1.247, top1 = 55.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9106/15625) 009106-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.91%], valid : [loss = 0.519, top1 = 89.76%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.95 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.340, top1 = 93.07%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.76 ms.
cifar100       train : [loss = 0.087, top1 = 98.33%], valid : [loss = 1.302, top1 = 70.38%], test : [loss = 1.317, top1 = 70.48%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 1.578, top1 = 57.35%], valid : [loss = 2.152, top1 = 45.73%], test : [loss = 2.151, top1 = 45.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 81.02%], valid : [loss = 0.634, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9107/15625) 009107-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.593, top1 = 87.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.63 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.418, top1 = 90.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.17 ms.
cifar100       train : [loss = 0.219, top1 = 94.77%], valid : [loss = 1.482, top1 = 65.50%], test : [loss = 1.470, top1 = 66.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 2.090, top1 = 45.58%], valid : [loss = 2.491, top1 = 38.17%], test : [loss = 2.531, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.56%], valid : [loss = 0.761, top1 = 73.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9108/15625) 009108-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.484, top1 = 89.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.66 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.327, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.84 ms.
cifar100       train : [loss = 0.345, top1 = 90.51%], valid : [loss = 1.283, top1 = 66.70%], test : [loss = 1.261, top1 = 67.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.61 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.67%], valid : [loss = 2.397, top1 = 38.63%], test : [loss = 2.403, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9109/15625) 009109-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.505, top1 = 88.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.353, top1 = 91.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.49 ms.
cifar100       train : [loss = 0.341, top1 = 90.75%], valid : [loss = 1.298, top1 = 66.54%], test : [loss = 1.311, top1 = 66.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.80%], valid : [loss = 2.416, top1 = 39.30%], test : [loss = 2.386, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9110/15625) 009110-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.91%], valid : [loss = 0.759, top1 = 82.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.086, top1 = 97.31%], test  : [loss = 0.473, top1 = 86.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.55 ms.
cifar100       train : [loss = 0.829, top1 = 75.96%], valid : [loss = 1.604, top1 = 59.16%], test : [loss = 1.586, top1 = 59.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.828, top1 = 30.13%], valid : [loss = 2.940, top1 = 28.97%], test : [loss = 3.019, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.85%], valid : [loss = 0.881, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9111/15625) 009111-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.574, top1 = 88.38%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.56 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.374, top1 = 92.48%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.14 ms.
cifar100       train : [loss = 0.145, top1 = 96.95%], valid : [loss = 1.503, top1 = 66.84%], test : [loss = 1.497, top1 = 66.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.12 ms.
ImageNet16-120 train : [loss = 1.960, top1 = 48.57%], valid : [loss = 2.451, top1 = 38.43%], test : [loss = 2.457, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.98%], valid : [loss = 0.769, top1 = 73.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9112/15625) 009112-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.570, top1 = 88.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.356, top1 = 92.61%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.61 ms.
cifar100       train : [loss = 0.126, top1 = 97.35%], valid : [loss = 1.390, top1 = 67.74%], test : [loss = 1.441, top1 = 67.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.395, top1 = 38.21%], valid : [loss = 2.573, top1 = 34.93%], test : [loss = 2.550, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.56%], valid : [loss = 0.894, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9113/15625) 009113-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.28%], valid : [loss = 0.463, top1 = 85.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.165, top1 = 94.53%], test  : [loss = 0.358, top1 = 88.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 1.002, top1 = 71.58%], valid : [loss = 1.375, top1 = 62.02%], test : [loss = 1.336, top1 = 61.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.84%], valid : [loss = 2.702, top1 = 31.87%], test : [loss = 2.738, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9114/15625) 009114-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.603, top1 = 86.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=12.95 ms.
cifar10        train : [loss = 0.022, top1 = 99.47%], test  : [loss = 0.389, top1 = 90.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.01 ms.
cifar100       train : [loss = 0.441, top1 = 87.11%], valid : [loss = 1.427, top1 = 65.10%], test : [loss = 1.431, top1 = 64.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.81%], valid : [loss = 2.502, top1 = 37.30%], test : [loss = 2.534, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.34%], valid : [loss = 0.874, top1 = 69.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9115/15625) 009115-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.74%], valid : [loss = 0.612, top1 = 86.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10        train : [loss = 0.030, top1 = 99.21%], test  : [loss = 0.397, top1 = 90.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.58 ms.
cifar100       train : [loss = 0.502, top1 = 85.21%], valid : [loss = 1.449, top1 = 63.94%], test : [loss = 1.463, top1 = 63.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.10%], valid : [loss = 2.590, top1 = 34.27%], test : [loss = 2.598, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9116/15625) 009116-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.510, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.321, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.36 ms.
cifar100       train : [loss = 0.347, top1 = 90.41%], valid : [loss = 1.290, top1 = 66.20%], test : [loss = 1.280, top1 = 67.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.58 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.44%], valid : [loss = 2.385, top1 = 39.37%], test : [loss = 2.440, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9117/15625) 009117-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.34%], valid : [loss = 0.615, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.067, top1 = 97.98%], test  : [loss = 0.394, top1 = 89.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.729, top1 = 78.74%], valid : [loss = 1.427, top1 = 62.50%], test : [loss = 1.399, top1 = 62.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.96%], valid : [loss = 2.663, top1 = 34.17%], test : [loss = 2.708, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9118/15625) 009118-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.514, top1 = 88.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.343, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.46 ms.
cifar100       train : [loss = 0.358, top1 = 90.10%], valid : [loss = 1.281, top1 = 67.20%], test : [loss = 1.284, top1 = 67.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.85%], valid : [loss = 2.396, top1 = 38.43%], test : [loss = 2.410, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9119/15625) 009119-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.18%], valid : [loss = 0.544, top1 = 87.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.058, top1 = 98.18%], test  : [loss = 0.359, top1 = 90.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.11 ms.
cifar100       train : [loss = 0.636, top1 = 81.21%], valid : [loss = 1.319, top1 = 65.58%], test : [loss = 1.270, top1 = 65.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.362, top1 = 39.38%], valid : [loss = 2.491, top1 = 36.90%], test : [loss = 2.552, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9120/15625) 009120-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.559, top1 = 88.42%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=13.98 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.335, top1 = 92.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.07 ms.
cifar100       train : [loss = 0.298, top1 = 91.54%], valid : [loss = 1.334, top1 = 66.80%], test : [loss = 1.354, top1 = 66.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.65%], valid : [loss = 2.434, top1 = 37.83%], test : [loss = 2.425, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.04%], valid : [loss = 0.869, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9121/15625) 009121-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.442, top1 = 90.64%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.09 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.293, top1 = 93.65%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.66 ms.
cifar100       train : [loss = 0.047, top1 = 99.48%], valid : [loss = 1.339, top1 = 70.58%], test : [loss = 1.382, top1 = 70.62%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.10 ms.
ImageNet16-120 train : [loss = 1.468, top1 = 60.12%], valid : [loss = 2.258, top1 = 44.30%], test : [loss = 2.259, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.60%], valid : [loss = 0.534, top1 = 81.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9122/15625) 009122-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.38%], valid : [loss = 0.576, top1 = 87.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.371, top1 = 90.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.23 ms.
cifar100       train : [loss = 0.501, top1 = 85.64%], valid : [loss = 1.331, top1 = 64.98%], test : [loss = 1.320, top1 = 65.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 2.707, top1 = 31.51%], valid : [loss = 2.751, top1 = 30.07%], test : [loss = 2.765, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 0.963, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9123/15625) 009123-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.589, top1 = 87.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.037, top1 = 98.92%], test  : [loss = 0.403, top1 = 89.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.01 ms.
cifar100       train : [loss = 0.544, top1 = 83.81%], valid : [loss = 1.390, top1 = 64.06%], test : [loss = 1.418, top1 = 64.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.472, top1 = 37.30%], valid : [loss = 2.623, top1 = 33.43%], test : [loss = 2.655, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.17%], valid : [loss = 0.642, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9124/15625) 009124-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.486, top1 = 89.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.67 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.334, top1 = 91.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.91 ms.
cifar100       train : [loss = 0.317, top1 = 91.56%], valid : [loss = 1.273, top1 = 67.00%], test : [loss = 1.262, top1 = 67.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.65%], valid : [loss = 2.322, top1 = 40.33%], test : [loss = 2.357, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.98%], valid : [loss = 0.650, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9125/15625) 009125-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.41%], valid : [loss = 0.914, top1 = 73.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.314, top1 = 89.07%], test  : [loss = 0.634, top1 = 79.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.48 ms.
cifar100       train : [loss = 1.371, top1 = 61.29%], valid : [loss = 1.904, top1 = 50.00%], test : [loss = 1.920, top1 = 49.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 3.502, top1 = 17.24%], valid : [loss = 3.526, top1 = 17.27%], test : [loss = 3.515, top1 = 16.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.19%], valid : [loss = 1.301, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9126/15625) 009126-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.98%], valid : [loss = 0.725, top1 = 75.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.550, top1 = 81.04%], test  : [loss = 0.601, top1 = 79.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 2.009, top1 = 46.37%], valid : [loss = 2.125, top1 = 44.49%], test : [loss = 2.105, top1 = 44.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.89 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.52%], valid : [loss = 3.203, top1 = 23.46%], test : [loss = 3.230, top1 = 22.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 53.41%], valid : [loss = 1.355, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9127/15625) 009127-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.55 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.78%], valid : [loss = 0.539, top1 = 84.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.179, top1 = 93.96%], test  : [loss = 0.403, top1 = 88.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 1.180, top1 = 66.26%], valid : [loss = 1.510, top1 = 59.24%], test : [loss = 1.469, top1 = 59.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.56 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.76%], valid : [loss = 2.729, top1 = 32.40%], test : [loss = 2.743, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9128/15625) 009128-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.33%], valid : [loss = 0.863, top1 = 72.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.92 ms.
cifar10        train : [loss = 0.551, top1 = 80.85%], test  : [loss = 0.723, top1 = 75.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 1.760, top1 = 52.28%], valid : [loss = 2.057, top1 = 46.94%], test : [loss = 2.063, top1 = 46.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.95%], valid : [loss = 3.631, top1 = 16.63%], test : [loss = 3.643, top1 = 16.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9129/15625) 009129-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.326, top1 = 92.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.02 ms.
cifar100       train : [loss = 0.109, top1 = 97.93%], valid : [loss = 1.324, top1 = 68.82%], test : [loss = 1.312, top1 = 69.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.26 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.64%], valid : [loss = 2.181, top1 = 44.80%], test : [loss = 2.197, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.24%], valid : [loss = 0.633, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9130/15625) 009130-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.21%], valid : [loss = 0.751, top1 = 83.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10        train : [loss = 0.053, top1 = 98.42%], test  : [loss = 0.427, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.56 ms.
cifar100       train : [loss = 0.623, top1 = 81.94%], valid : [loss = 1.404, top1 = 63.46%], test : [loss = 1.376, top1 = 63.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.34%], valid : [loss = 2.616, top1 = 34.63%], test : [loss = 2.623, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.74%], valid : [loss = 0.845, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9131/15625) 009131-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.36%], valid : [loss = 0.865, top1 = 70.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10        train : [loss = 0.682, top1 = 75.92%], test  : [loss = 0.772, top1 = 73.11%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.61 ms.
cifar100       train : [loss = 1.953, top1 = 48.06%], valid : [loss = 2.116, top1 = 44.76%], test : [loss = 2.143, top1 = 44.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.73%], valid : [loss = 3.676, top1 = 16.20%], test : [loss = 3.708, top1 = 15.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.403, top1 = 48.96%], valid : [loss = 1.428, top1 = 48.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9132/15625) 009132-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.34%], valid : [loss = 0.537, top1 = 83.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.210, top1 = 92.82%], test  : [loss = 0.407, top1 = 87.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 1.244, top1 = 64.64%], valid : [loss = 1.555, top1 = 57.27%], test : [loss = 1.544, top1 = 57.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 2.715, top1 = 32.39%], valid : [loss = 2.751, top1 = 30.97%], test : [loss = 2.782, top1 = 31.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9133/15625) 009133-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.531, top1 = 88.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.336, top1 = 92.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=20.31 ms.
cifar100       train : [loss = 0.128, top1 = 97.37%], valid : [loss = 1.361, top1 = 68.94%], test : [loss = 1.350, top1 = 68.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.35 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.94%], valid : [loss = 2.309, top1 = 41.83%], test : [loss = 2.329, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.53%], valid : [loss = 0.784, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9134/15625) 009134-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.96%], valid : [loss = 0.855, top1 = 71.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10        train : [loss = 0.556, top1 = 80.48%], test  : [loss = 0.721, top1 = 75.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.47 ms.
cifar100       train : [loss = 1.757, top1 = 52.83%], valid : [loss = 2.038, top1 = 47.54%], test : [loss = 2.046, top1 = 47.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.74 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.95%], valid : [loss = 3.604, top1 = 16.83%], test : [loss = 3.650, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9135/15625) 009135-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.09%], valid : [loss = 0.453, top1 = 86.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10        train : [loss = 0.161, top1 = 94.68%], test  : [loss = 0.353, top1 = 88.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.39 ms.
cifar100       train : [loss = 0.955, top1 = 72.94%], valid : [loss = 1.342, top1 = 62.18%], test : [loss = 1.352, top1 = 61.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 34.92%], valid : [loss = 2.631, top1 = 33.57%], test : [loss = 2.663, top1 = 31.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.19%], valid : [loss = 0.916, top1 = 67.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9136/15625) 009136-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.321, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.71 ms.
cifar100       train : [loss = 0.305, top1 = 91.81%], valid : [loss = 1.312, top1 = 67.05%], test : [loss = 1.303, top1 = 67.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.01%], valid : [loss = 2.342, top1 = 40.37%], test : [loss = 2.372, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.61%], valid : [loss = 0.567, top1 = 80.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9137/15625) 009137-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.459, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=12.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.301, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.97 ms.
cifar100       train : [loss = 0.324, top1 = 91.15%], valid : [loss = 1.310, top1 = 67.72%], test : [loss = 1.282, top1 = 67.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.24%], valid : [loss = 2.376, top1 = 39.83%], test : [loss = 2.402, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.83%], valid : [loss = 0.564, top1 = 81.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9138/15625) 009138-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.85 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.347, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.40 ms.
cifar100       train : [loss = 0.074, top1 = 98.73%], valid : [loss = 1.340, top1 = 69.98%], test : [loss = 1.302, top1 = 70.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.96 ms.
ImageNet16-120 train : [loss = 1.619, top1 = 56.25%], valid : [loss = 2.176, top1 = 44.07%], test : [loss = 2.193, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.65%], valid : [loss = 0.728, top1 = 74.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9139/15625) 009139-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.73 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.595, top1 = 86.57%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10        train : [loss = 0.041, top1 = 98.76%], test  : [loss = 0.403, top1 = 89.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 0.545, top1 = 84.05%], valid : [loss = 1.400, top1 = 64.28%], test : [loss = 1.384, top1 = 64.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.84%], valid : [loss = 2.612, top1 = 34.37%], test : [loss = 2.682, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9140/15625) 009140-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.461, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.306, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.350, top1 = 90.25%], valid : [loss = 1.317, top1 = 67.30%], test : [loss = 1.287, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.092, top1 = 45.49%], valid : [loss = 2.345, top1 = 40.23%], test : [loss = 2.416, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.69%], valid : [loss = 0.629, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9141/15625) 009141-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=137.54 M, Params=0.964 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.528, top1 = 89.45%]
cifar10        FLOP=137.54 M, Params=0.964 MB, latency=17.82 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.330, top1 = 92.91%]
cifar100       FLOP=137.55 M, Params=0.970 MB, latency=19.12 ms.
cifar100       train : [loss = 0.093, top1 = 98.10%], valid : [loss = 1.411, top1 = 68.65%], test : [loss = 1.419, top1 = 68.54%]
ImageNet16-120 FLOP= 34.39 M, Params=0.972 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.61%], valid : [loss = 2.330, top1 = 41.03%], test : [loss = 2.304, top1 = 41.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.82%], valid : [loss = 0.647, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9142/15625) 009142-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.82%], valid : [loss = 0.560, top1 = 86.33%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.87 ms.
cifar10        train : [loss = 0.072, top1 = 97.66%], test  : [loss = 0.384, top1 = 89.56%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.53 ms.
cifar100       train : [loss = 0.578, top1 = 83.09%], valid : [loss = 1.367, top1 = 64.68%], test : [loss = 1.333, top1 = 65.56%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.450, top1 = 37.45%], valid : [loss = 2.619, top1 = 34.37%], test : [loss = 2.604, top1 = 34.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.00%], valid : [loss = 0.930, top1 = 66.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9143/15625) 009143-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.622, top1 = 86.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.17 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.417, top1 = 89.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.550, top1 = 83.82%], valid : [loss = 1.456, top1 = 63.48%], test : [loss = 1.426, top1 = 63.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.15%], valid : [loss = 2.585, top1 = 35.70%], test : [loss = 2.594, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.38%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9144/15625) 009144-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.553, top1 = 88.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.390, top1 = 91.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.06 ms.
cifar100       train : [loss = 0.173, top1 = 96.28%], valid : [loss = 1.417, top1 = 67.34%], test : [loss = 1.414, top1 = 67.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.36 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.83%], valid : [loss = 2.488, top1 = 38.30%], test : [loss = 2.491, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.52%], valid : [loss = 0.715, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9145/15625) 009145-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.25%], valid : [loss = 0.784, top1 = 78.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10        train : [loss = 0.206, top1 = 92.88%], test  : [loss = 0.507, top1 = 84.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.94 ms.
cifar100       train : [loss = 1.061, top1 = 69.48%], valid : [loss = 1.721, top1 = 54.84%], test : [loss = 1.716, top1 = 55.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.239, top1 = 21.57%], valid : [loss = 3.281, top1 = 22.27%], test : [loss = 3.317, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.60%], valid : [loss = 1.058, top1 = 62.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9146/15625) 009146-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.539, top1 = 89.01%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.45 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.352, top1 = 92.20%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.51 ms.
cifar100       train : [loss = 0.161, top1 = 96.16%], valid : [loss = 1.351, top1 = 68.62%], test : [loss = 1.380, top1 = 68.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 2.412, top1 = 38.05%], valid : [loss = 2.584, top1 = 33.90%], test : [loss = 2.570, top1 = 35.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.30%], valid : [loss = 0.980, top1 = 64.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9147/15625) 009147-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.65%], valid : [loss = 0.556, top1 = 82.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.251, top1 = 91.52%], test  : [loss = 0.413, top1 = 86.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 1.335, top1 = 62.59%], valid : [loss = 1.626, top1 = 56.10%], test : [loss = 1.606, top1 = 56.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 2.881, top1 = 29.15%], valid : [loss = 2.884, top1 = 28.43%], test : [loss = 2.938, top1 = 29.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.30%], valid : [loss = 1.035, top1 = 63.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9148/15625) 009148-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.541, top1 = 88.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.022, top1 = 99.38%], test  : [loss = 0.359, top1 = 91.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.02 ms.
cifar100       train : [loss = 0.228, top1 = 93.81%], valid : [loss = 1.382, top1 = 66.66%], test : [loss = 1.378, top1 = 67.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.21%], valid : [loss = 2.739, top1 = 31.93%], test : [loss = 2.736, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.000, top1 = 64.00%], valid : [loss = 1.026, top1 = 63.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9149/15625) 009149-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 91.06%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.64 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.277, top1 = 94.16%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.83 ms.
cifar100       train : [loss = 0.028, top1 = 99.78%], valid : [loss = 1.280, top1 = 72.72%], test : [loss = 1.279, top1 = 71.96%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.68 ms.
ImageNet16-120 train : [loss = 1.232, top1 = 65.95%], valid : [loss = 2.210, top1 = 45.90%], test : [loss = 2.196, top1 = 46.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.381, top1 = 87.06%], valid : [loss = 0.526, top1 = 82.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9150/15625) 009150-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.79%], valid : [loss = 0.476, top1 = 85.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.49 ms.
cifar10        train : [loss = 0.153, top1 = 95.08%], test  : [loss = 0.338, top1 = 89.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.25 ms.
cifar100       train : [loss = 0.963, top1 = 72.58%], valid : [loss = 1.335, top1 = 62.60%], test : [loss = 1.332, top1 = 62.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 34.00%], valid : [loss = 2.661, top1 = 33.30%], test : [loss = 2.718, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.769, top1 = 72.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9151/15625) 009151-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.21%], valid : [loss = 0.517, top1 = 84.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.182, top1 = 93.85%], test  : [loss = 0.387, top1 = 87.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 1.203, top1 = 65.82%], valid : [loss = 1.518, top1 = 58.55%], test : [loss = 1.509, top1 = 58.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.94%], valid : [loss = 2.691, top1 = 33.21%], test : [loss = 2.727, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.22%], valid : [loss = 0.958, top1 = 65.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9152/15625) 009152-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.86 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.67%], valid : [loss = 0.481, top1 = 84.08%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.40 ms.
cifar10        train : [loss = 0.303, top1 = 89.82%], test  : [loss = 0.403, top1 = 86.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.87 ms.
cifar100       train : [loss = 1.335, top1 = 63.07%], valid : [loss = 1.551, top1 = 56.82%], test : [loss = 1.534, top1 = 56.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.47 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.47%], valid : [loss = 2.922, top1 = 29.33%], test : [loss = 2.968, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9153/15625) 009153-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.590, top1 = 87.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.367, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.03 ms.
cifar100       train : [loss = 0.176, top1 = 96.11%], valid : [loss = 1.357, top1 = 68.72%], test : [loss = 1.386, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.28 ms.
ImageNet16-120 train : [loss = 1.997, top1 = 47.74%], valid : [loss = 2.488, top1 = 37.53%], test : [loss = 2.492, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.99%], valid : [loss = 0.698, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9154/15625) 009154-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.514, top1 = 88.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.327, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.336, top1 = 90.84%], valid : [loss = 1.291, top1 = 67.22%], test : [loss = 1.282, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.66%], valid : [loss = 2.414, top1 = 39.39%], test : [loss = 2.417, top1 = 38.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9155/15625) 009155-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.73 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.89%], valid : [loss = 0.851, top1 = 72.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.08 ms.
cifar10        train : [loss = 0.555, top1 = 80.59%], test  : [loss = 0.715, top1 = 76.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.93 ms.
cifar100       train : [loss = 1.783, top1 = 51.81%], valid : [loss = 2.049, top1 = 47.18%], test : [loss = 2.086, top1 = 46.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 17.00%], valid : [loss = 3.648, top1 = 15.60%], test : [loss = 3.681, top1 = 15.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9156/15625) 009156-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.496, top1 = 90.13%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.18 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.310, top1 = 93.40%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.01 ms.
cifar100       train : [loss = 0.097, top1 = 98.19%], valid : [loss = 1.317, top1 = 69.98%], test : [loss = 1.316, top1 = 70.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 1.625, top1 = 56.14%], valid : [loss = 2.153, top1 = 44.80%], test : [loss = 2.172, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.97%], valid : [loss = 0.648, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9157/15625) 009157-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.38%], valid : [loss = 0.530, top1 = 83.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.251, top1 = 91.44%], test  : [loss = 0.406, top1 = 86.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.49 ms.
cifar100       train : [loss = 1.275, top1 = 63.99%], valid : [loss = 1.579, top1 = 57.39%], test : [loss = 1.573, top1 = 57.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.865, top1 = 29.50%], valid : [loss = 2.858, top1 = 29.78%], test : [loss = 2.927, top1 = 28.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.27%], valid : [loss = 1.030, top1 = 63.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9158/15625) 009158-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.431, top1 = 89.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.318, top1 = 92.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=20.23 ms.
cifar100       train : [loss = 0.332, top1 = 90.96%], valid : [loss = 1.317, top1 = 66.94%], test : [loss = 1.306, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.90%], valid : [loss = 2.377, top1 = 39.63%], test : [loss = 2.410, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 84.89%], valid : [loss = 0.535, top1 = 81.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9159/15625) 009159-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.480, top1 = 89.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.310, top1 = 92.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.339, top1 = 90.86%], valid : [loss = 1.279, top1 = 66.94%], test : [loss = 1.275, top1 = 68.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.54%], valid : [loss = 2.326, top1 = 40.40%], test : [loss = 2.378, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.07%], valid : [loss = 0.623, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9160/15625) 009160-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.564, top1 = 88.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.32 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.372, top1 = 91.66%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.35 ms.
cifar100       train : [loss = 0.254, top1 = 93.09%], valid : [loss = 1.312, top1 = 67.60%], test : [loss = 1.345, top1 = 67.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.22%], valid : [loss = 2.421, top1 = 37.87%], test : [loss = 2.431, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.56%], valid : [loss = 0.855, top1 = 69.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9161/15625) 009161-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.395, top1 = 90.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.72 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.256, top1 = 93.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.99 ms.
cifar100       train : [loss = 0.094, top1 = 98.33%], valid : [loss = 1.240, top1 = 71.32%], test : [loss = 1.256, top1 = 70.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 1.633, top1 = 56.04%], valid : [loss = 2.270, top1 = 43.03%], test : [loss = 2.250, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 87.10%], valid : [loss = 0.507, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9162/15625) 009162-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.12%], valid : [loss = 0.611, top1 = 85.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.99 ms.
cifar10        train : [loss = 0.076, top1 = 97.69%], test  : [loss = 0.403, top1 = 88.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.48 ms.
cifar100       train : [loss = 0.727, top1 = 78.77%], valid : [loss = 1.358, top1 = 63.30%], test : [loss = 1.414, top1 = 62.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.05%], valid : [loss = 2.652, top1 = 33.67%], test : [loss = 2.657, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9163/15625) 009163-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.182, top1 = 94.10%], valid : [loss = 0.940, top1 = 75.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.67 ms.
cifar10        train : [loss = 0.218, top1 = 92.55%], test  : [loss = 0.592, top1 = 82.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.17 ms.
cifar100       train : [loss = 1.139, top1 = 67.57%], valid : [loss = 1.773, top1 = 53.12%], test : [loss = 1.779, top1 = 53.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.74%], valid : [loss = 3.320, top1 = 21.30%], test : [loss = 3.370, top1 = 21.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.063, top1 = 62.04%], valid : [loss = 1.117, top1 = 60.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9164/15625) 009164-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.457, top1 = 89.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.312, top1 = 92.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.65 ms.
cifar100       train : [loss = 0.190, top1 = 95.51%], valid : [loss = 1.280, top1 = 68.58%], test : [loss = 1.312, top1 = 69.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.76%], valid : [loss = 2.279, top1 = 42.23%], test : [loss = 2.288, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.79%], valid : [loss = 0.555, top1 = 81.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9165/15625) 009165-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.573, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.371, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.387, top1 = 89.04%], valid : [loss = 1.375, top1 = 66.04%], test : [loss = 1.389, top1 = 65.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.83%], valid : [loss = 2.474, top1 = 37.81%], test : [loss = 2.503, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.64%], valid : [loss = 0.764, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9166/15625) 009166-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.31%], valid : [loss = 0.583, top1 = 85.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10        train : [loss = 0.108, top1 = 96.44%], test  : [loss = 0.379, top1 = 88.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.81 ms.
cifar100       train : [loss = 0.828, top1 = 75.58%], valid : [loss = 1.438, top1 = 61.70%], test : [loss = 1.427, top1 = 61.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 32.87%], valid : [loss = 2.753, top1 = 31.97%], test : [loss = 2.816, top1 = 30.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.91%], valid : [loss = 0.707, top1 = 75.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9167/15625) 009167-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.23%], valid : [loss = 0.756, top1 = 73.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10        train : [loss = 0.575, top1 = 79.86%], test  : [loss = 0.644, top1 = 77.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.93 ms.
cifar100       train : [loss = 2.092, top1 = 44.12%], valid : [loss = 2.229, top1 = 42.12%], test : [loss = 2.222, top1 = 41.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 3.254, top1 = 21.98%], valid : [loss = 3.267, top1 = 21.87%], test : [loss = 3.255, top1 = 22.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.73%], valid : [loss = 1.334, top1 = 52.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9168/15625) 009168-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.464, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.317, top1 = 91.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.38 ms.
cifar100       train : [loss = 0.346, top1 = 90.48%], valid : [loss = 1.330, top1 = 66.32%], test : [loss = 1.300, top1 = 67.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.34%], valid : [loss = 2.352, top1 = 41.07%], test : [loss = 2.386, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.09%], valid : [loss = 0.534, top1 = 81.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9169/15625) 009169-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.487, top1 = 88.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.297, top1 = 92.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.80 ms.
cifar100       train : [loss = 0.230, top1 = 94.31%], valid : [loss = 1.237, top1 = 68.96%], test : [loss = 1.258, top1 = 68.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.27%], valid : [loss = 2.308, top1 = 40.47%], test : [loss = 2.298, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9170/15625) 009170-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.502, top1 = 88.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10        train : [loss = 0.024, top1 = 99.36%], test  : [loss = 0.362, top1 = 91.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.18 ms.
cifar100       train : [loss = 0.408, top1 = 88.24%], valid : [loss = 1.257, top1 = 67.40%], test : [loss = 1.259, top1 = 67.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.49%], valid : [loss = 2.407, top1 = 39.18%], test : [loss = 2.446, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 74.62%], valid : [loss = 0.780, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9171/15625) 009171-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.36%], valid : [loss = 0.672, top1 = 84.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.21 ms.
cifar10        train : [loss = 0.049, top1 = 98.54%], test  : [loss = 0.462, top1 = 88.60%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.69 ms.
cifar100       train : [loss = 0.630, top1 = 81.40%], valid : [loss = 1.518, top1 = 61.38%], test : [loss = 1.506, top1 = 62.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 33.09%], valid : [loss = 2.854, top1 = 29.63%], test : [loss = 2.898, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.26%], valid : [loss = 0.894, top1 = 68.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9172/15625) 009172-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.668 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.488, top1 = 88.98%]
cifar10        FLOP= 94.29 M, Params=0.668 MB, latency=19.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.23%]
cifar100       FLOP= 94.30 M, Params=0.674 MB, latency=18.38 ms.
cifar100       train : [loss = 0.317, top1 = 91.56%], valid : [loss = 1.252, top1 = 67.72%], test : [loss = 1.255, top1 = 67.71%]
ImageNet16-120 FLOP= 23.58 M, Params=0.676 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.61%], valid : [loss = 2.341, top1 = 39.93%], test : [loss = 2.359, top1 = 40.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.19%], valid : [loss = 0.575, top1 = 80.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9173/15625) 009173-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.471, top1 = 89.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.39 ms.
cifar100       train : [loss = 0.321, top1 = 91.33%], valid : [loss = 1.272, top1 = 67.66%], test : [loss = 1.229, top1 = 67.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.73%], valid : [loss = 2.327, top1 = 40.57%], test : [loss = 2.347, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9174/15625) 009174-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.82%], valid : [loss = 0.461, top1 = 86.50%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.02 ms.
cifar10        train : [loss = 0.110, top1 = 96.57%], test  : [loss = 0.332, top1 = 89.40%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.31 ms.
cifar100       train : [loss = 0.738, top1 = 79.38%], valid : [loss = 1.280, top1 = 65.14%], test : [loss = 1.259, top1 = 64.90%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.476, top1 = 37.27%], valid : [loss = 2.581, top1 = 35.30%], test : [loss = 2.591, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.39%], valid : [loss = 0.834, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9175/15625) 009175-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.617, top1 = 87.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.87 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.397, top1 = 91.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.213, top1 = 94.99%], valid : [loss = 1.456, top1 = 65.86%], test : [loss = 1.430, top1 = 66.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.075, top1 = 45.91%], valid : [loss = 2.492, top1 = 37.18%], test : [loss = 2.507, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9176/15625) 009176-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.70%], valid : [loss = 0.555, top1 = 86.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.360, top1 = 89.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.42 ms.
cifar100       train : [loss = 0.639, top1 = 81.41%], valid : [loss = 1.345, top1 = 64.74%], test : [loss = 1.365, top1 = 63.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 2.426, top1 = 38.19%], valid : [loss = 2.552, top1 = 35.87%], test : [loss = 2.592, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.40%], valid : [loss = 0.835, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9177/15625) 009177-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.74 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.39 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.10 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.68 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9178/15625) 009178-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.77 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.35%], valid : [loss = 0.624, top1 = 85.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10        train : [loss = 0.071, top1 = 97.75%], test  : [loss = 0.405, top1 = 88.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.05 ms.
cifar100       train : [loss = 0.719, top1 = 79.09%], valid : [loss = 1.372, top1 = 63.28%], test : [loss = 1.367, top1 = 64.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.16%], valid : [loss = 2.644, top1 = 33.63%], test : [loss = 2.684, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9179/15625) 009179-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.36%], valid : [loss = 0.532, top1 = 86.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10        train : [loss = 0.046, top1 = 98.75%], test  : [loss = 0.351, top1 = 90.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.45 ms.
cifar100       train : [loss = 0.505, top1 = 85.67%], valid : [loss = 1.293, top1 = 66.12%], test : [loss = 1.282, top1 = 66.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.92%], valid : [loss = 2.428, top1 = 38.62%], test : [loss = 2.445, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.74%], valid : [loss = 0.852, top1 = 70.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9180/15625) 009180-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.573, top1 = 88.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.381, top1 = 91.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.54 ms.
cifar100       train : [loss = 0.175, top1 = 96.13%], valid : [loss = 1.481, top1 = 66.70%], test : [loss = 1.513, top1 = 65.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.73 ms.
ImageNet16-120 train : [loss = 2.021, top1 = 47.07%], valid : [loss = 2.459, top1 = 38.07%], test : [loss = 2.452, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.37%], valid : [loss = 0.782, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9181/15625) 009181-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.614, top1 = 87.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.403, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.211, top1 = 94.85%], valid : [loss = 1.486, top1 = 65.77%], test : [loss = 1.495, top1 = 65.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 45.05%], valid : [loss = 2.518, top1 = 36.92%], test : [loss = 2.534, top1 = 38.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.48%], valid : [loss = 0.756, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9182/15625) 009182-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.43%], valid : [loss = 0.545, top1 = 82.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.287, top1 = 90.00%], test  : [loss = 0.424, top1 = 85.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 1.409, top1 = 60.37%], valid : [loss = 1.678, top1 = 54.76%], test : [loss = 1.654, top1 = 55.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.805, top1 = 30.59%], valid : [loss = 2.830, top1 = 29.37%], test : [loss = 2.869, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.64%], valid : [loss = 1.036, top1 = 62.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9183/15625) 009183-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.641, top1 = 86.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10        train : [loss = 0.017, top1 = 99.54%], test  : [loss = 0.444, top1 = 90.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.85 ms.
cifar100       train : [loss = 0.248, top1 = 93.77%], valid : [loss = 1.510, top1 = 64.76%], test : [loss = 1.459, top1 = 65.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.63%], valid : [loss = 2.606, top1 = 35.07%], test : [loss = 2.598, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 74.83%], valid : [loss = 0.780, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9184/15625) 009184-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.551, top1 = 89.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.02 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.362, top1 = 92.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.23 ms.
cifar100       train : [loss = 0.079, top1 = 98.80%], valid : [loss = 1.437, top1 = 67.88%], test : [loss = 1.417, top1 = 69.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.40%], valid : [loss = 2.352, top1 = 40.23%], test : [loss = 2.372, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.00%], valid : [loss = 0.663, top1 = 77.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9185/15625) 009185-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.549, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.09 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.345, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.60 ms.
cifar100       train : [loss = 0.123, top1 = 97.40%], valid : [loss = 1.337, top1 = 69.08%], test : [loss = 1.351, top1 = 68.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.82%], valid : [loss = 2.420, top1 = 38.53%], test : [loss = 2.423, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.24%], valid : [loss = 0.970, top1 = 65.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9186/15625) 009186-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=22.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.581, top1 = 87.23%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=20.65 ms.
cifar10        train : [loss = 0.011, top1 = 99.84%], test  : [loss = 0.406, top1 = 90.63%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=22.32 ms.
cifar100       train : [loss = 0.109, top1 = 98.57%], valid : [loss = 1.537, top1 = 65.52%], test : [loss = 1.498, top1 = 67.20%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.54%], valid : [loss = 2.596, top1 = 36.27%], test : [loss = 2.585, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.56%], valid : [loss = 0.732, top1 = 74.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9187/15625) 009187-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.441, top1 = 89.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.320, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.344, top1 = 90.40%], valid : [loss = 1.303, top1 = 67.66%], test : [loss = 1.323, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.16%], valid : [loss = 2.396, top1 = 39.17%], test : [loss = 2.412, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.64%], valid : [loss = 0.570, top1 = 80.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9188/15625) 009188-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.463, top1 = 89.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.329, top1 = 91.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.82 ms.
cifar100       train : [loss = 0.323, top1 = 91.25%], valid : [loss = 1.294, top1 = 66.24%], test : [loss = 1.323, top1 = 67.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.38%], valid : [loss = 2.379, top1 = 39.60%], test : [loss = 2.383, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.20%], valid : [loss = 0.532, top1 = 82.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9189/15625) 009189-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.592, top1 = 88.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.376, top1 = 92.43%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.19 ms.
cifar100       train : [loss = 0.086, top1 = 98.48%], valid : [loss = 1.497, top1 = 67.96%], test : [loss = 1.524, top1 = 67.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.06%], valid : [loss = 2.409, top1 = 39.73%], test : [loss = 2.407, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.39%], valid : [loss = 0.736, top1 = 74.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9190/15625) 009190-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.497, top1 = 88.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.305, top1 = 92.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.54 ms.
cifar100       train : [loss = 0.298, top1 = 92.11%], valid : [loss = 1.222, top1 = 68.70%], test : [loss = 1.225, top1 = 68.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.12%], valid : [loss = 2.226, top1 = 42.77%], test : [loss = 2.264, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.54%], valid : [loss = 0.642, top1 = 77.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9191/15625) 009191-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.624, top1 = 87.37%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.66 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.387, top1 = 91.42%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.87 ms.
cifar100       train : [loss = 0.206, top1 = 95.12%], valid : [loss = 1.394, top1 = 66.96%], test : [loss = 1.400, top1 = 67.00%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.97%], valid : [loss = 2.484, top1 = 38.33%], test : [loss = 2.518, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 76.86%], valid : [loss = 0.740, top1 = 74.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9192/15625) 009192-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.33%], valid : [loss = 0.545, top1 = 86.60%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.12 ms.
cifar10        train : [loss = 0.043, top1 = 98.87%], test  : [loss = 0.358, top1 = 90.38%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.37 ms.
cifar100       train : [loss = 0.498, top1 = 85.88%], valid : [loss = 1.314, top1 = 65.84%], test : [loss = 1.284, top1 = 66.11%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.12%], valid : [loss = 2.419, top1 = 38.03%], test : [loss = 2.432, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.63%], valid : [loss = 0.818, top1 = 71.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9193/15625) 009193-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.582, top1 = 88.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.005, top1 = 99.86%], test  : [loss = 0.384, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.10 ms.
cifar100       train : [loss = 0.120, top1 = 97.66%], valid : [loss = 1.518, top1 = 66.64%], test : [loss = 1.514, top1 = 67.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 1.933, top1 = 49.12%], valid : [loss = 2.440, top1 = 39.00%], test : [loss = 2.474, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 75.89%], valid : [loss = 0.764, top1 = 73.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9194/15625) 009194-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.55%], valid : [loss = 0.661, top1 = 77.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.86 ms.
cifar10        train : [loss = 0.520, top1 = 81.89%], test  : [loss = 0.603, top1 = 79.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.59 ms.
cifar100       train : [loss = 1.719, top1 = 53.50%], valid : [loss = 1.887, top1 = 50.41%], test : [loss = 1.891, top1 = 50.12%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.58 ms.
ImageNet16-120 train : [loss = 3.331, top1 = 21.15%], valid : [loss = 3.324, top1 = 20.87%], test : [loss = 3.370, top1 = 20.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9195/15625) 009195-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.70%], valid : [loss = 0.841, top1 = 81.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.90 ms.
cifar10        train : [loss = 0.081, top1 = 97.29%], test  : [loss = 0.469, top1 = 86.76%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.13 ms.
cifar100       train : [loss = 0.782, top1 = 77.38%], valid : [loss = 1.604, top1 = 58.90%], test : [loss = 1.585, top1 = 60.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.80 ms.
ImageNet16-120 train : [loss = 2.749, top1 = 31.69%], valid : [loss = 2.874, top1 = 30.30%], test : [loss = 2.903, top1 = 29.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.40%], valid : [loss = 0.948, top1 = 66.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9196/15625) 009196-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.72%], valid : [loss = 0.514, top1 = 86.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.074, top1 = 97.84%], test  : [loss = 0.345, top1 = 90.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.662, top1 = 80.89%], valid : [loss = 1.300, top1 = 65.18%], test : [loss = 1.271, top1 = 65.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.90%], valid : [loss = 2.501, top1 = 36.56%], test : [loss = 2.536, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.89%], valid : [loss = 0.913, top1 = 67.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9197/15625) 009197-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.00%], valid : [loss = 0.533, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10        train : [loss = 0.075, top1 = 97.60%], test  : [loss = 0.377, top1 = 89.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.57 ms.
cifar100       train : [loss = 0.720, top1 = 78.84%], valid : [loss = 1.368, top1 = 63.94%], test : [loss = 1.338, top1 = 64.66%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.14%], valid : [loss = 2.643, top1 = 33.60%], test : [loss = 2.690, top1 = 33.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9198/15625) 009198-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.46%], valid : [loss = 0.667, top1 = 77.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 0.519, top1 = 82.09%], test  : [loss = 0.594, top1 = 79.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.93 ms.
cifar100       train : [loss = 1.687, top1 = 54.08%], valid : [loss = 1.849, top1 = 51.10%], test : [loss = 1.862, top1 = 51.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.22%], valid : [loss = 3.322, top1 = 21.63%], test : [loss = 3.338, top1 = 22.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9199/15625) 009199-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.607, top1 = 86.50%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.96 ms.
cifar10        train : [loss = 0.033, top1 = 99.14%], test  : [loss = 0.385, top1 = 90.06%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.65 ms.
cifar100       train : [loss = 0.323, top1 = 91.78%], valid : [loss = 1.404, top1 = 65.48%], test : [loss = 1.370, top1 = 66.14%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.32%], valid : [loss = 2.587, top1 = 36.13%], test : [loss = 2.619, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.53%], valid : [loss = 0.782, top1 = 72.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9200/15625) 009200-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.00%], valid : [loss = 0.482, top1 = 84.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.298, top1 = 90.11%], test  : [loss = 0.399, top1 = 86.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.68 ms.
cifar100       train : [loss = 1.331, top1 = 63.16%], valid : [loss = 1.554, top1 = 57.44%], test : [loss = 1.517, top1 = 58.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.62%], valid : [loss = 2.943, top1 = 28.70%], test : [loss = 2.963, top1 = 28.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9201/15625) 009201-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=22.30 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.70%], valid : [loss = 0.472, top1 = 86.16%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=21.11 ms.
cifar10        train : [loss = 0.116, top1 = 96.37%], test  : [loss = 0.343, top1 = 89.16%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=20.11 ms.
cifar100       train : [loss = 0.709, top1 = 80.50%], valid : [loss = 1.293, top1 = 63.64%], test : [loss = 1.274, top1 = 64.92%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=24.13 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.75%], valid : [loss = 2.586, top1 = 35.13%], test : [loss = 2.616, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.68%], valid : [loss = 0.996, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9202/15625) 009202-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.553, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.360, top1 = 92.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.127, top1 = 97.61%], valid : [loss = 1.433, top1 = 67.47%], test : [loss = 1.459, top1 = 66.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.54%], valid : [loss = 2.403, top1 = 39.17%], test : [loss = 2.439, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.23%], valid : [loss = 0.718, top1 = 75.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9203/15625) 009203-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.552, top1 = 88.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.50 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.356, top1 = 91.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.24 ms.
cifar100       train : [loss = 0.309, top1 = 91.36%], valid : [loss = 1.286, top1 = 67.70%], test : [loss = 1.303, top1 = 67.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.71%], valid : [loss = 2.424, top1 = 38.50%], test : [loss = 2.441, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9204/15625) 009204-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.86%], valid : [loss = 0.642, top1 = 85.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.91 ms.
cifar10        train : [loss = 0.028, top1 = 99.28%], test  : [loss = 0.406, top1 = 90.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.58 ms.
cifar100       train : [loss = 0.406, top1 = 88.99%], valid : [loss = 1.440, top1 = 63.94%], test : [loss = 1.426, top1 = 64.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=21.28 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.41%], valid : [loss = 2.600, top1 = 34.83%], test : [loss = 2.590, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.69%], valid : [loss = 0.790, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9205/15625) 009205-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.622, top1 = 87.26%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.35 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.416, top1 = 91.09%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.08 ms.
cifar100       train : [loss = 0.123, top1 = 97.40%], valid : [loss = 1.593, top1 = 66.26%], test : [loss = 1.543, top1 = 65.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.92%], valid : [loss = 2.481, top1 = 38.17%], test : [loss = 2.511, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.59%], valid : [loss = 0.803, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9206/15625) 009206-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.96%], valid : [loss = 0.612, top1 = 85.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=17.81 ms.
cifar10        train : [loss = 0.043, top1 = 98.68%], test  : [loss = 0.407, top1 = 89.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.76 ms.
cifar100       train : [loss = 0.489, top1 = 85.64%], valid : [loss = 1.515, top1 = 62.26%], test : [loss = 1.520, top1 = 63.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 3.115, top1 = 23.32%], valid : [loss = 3.153, top1 = 22.93%], test : [loss = 3.148, top1 = 22.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 59.52%], valid : [loss = 1.120, top1 = 59.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9207/15625) 009207-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.525, top1 = 89.06%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.47 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.316, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.42 ms.
cifar100       train : [loss = 0.153, top1 = 96.84%], valid : [loss = 1.278, top1 = 69.08%], test : [loss = 1.267, top1 = 69.26%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.80 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.65%], valid : [loss = 2.321, top1 = 40.30%], test : [loss = 2.290, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.75%], valid : [loss = 0.704, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9208/15625) 009208-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.444, top1 = 89.96%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.59 ms.
cifar10        train : [loss = 0.006, top1 = 99.94%], test  : [loss = 0.298, top1 = 92.57%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.23 ms.
cifar100       train : [loss = 0.111, top1 = 98.16%], valid : [loss = 1.232, top1 = 70.32%], test : [loss = 1.266, top1 = 70.42%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.57 ms.
ImageNet16-120 train : [loss = 1.624, top1 = 56.30%], valid : [loss = 2.168, top1 = 44.40%], test : [loss = 2.240, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.34%], valid : [loss = 0.506, top1 = 82.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9209/15625) 009209-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.35%], valid : [loss = 0.613, top1 = 86.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.74 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.403, top1 = 90.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 0.262, top1 = 92.72%], valid : [loss = 1.388, top1 = 66.22%], test : [loss = 1.434, top1 = 66.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 36.57%], valid : [loss = 2.640, top1 = 34.17%], test : [loss = 2.633, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.47%], valid : [loss = 1.063, top1 = 61.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9210/15625) 009210-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.262, top1 = 91.26%], valid : [loss = 0.478, top1 = 84.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10        train : [loss = 0.305, top1 = 89.82%], test  : [loss = 0.405, top1 = 86.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.04 ms.
cifar100       train : [loss = 1.331, top1 = 63.03%], valid : [loss = 1.538, top1 = 58.20%], test : [loss = 1.512, top1 = 58.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.62%], valid : [loss = 2.903, top1 = 29.33%], test : [loss = 2.956, top1 = 27.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9211/15625) 009211-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.629, top1 = 87.92%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.93 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.379, top1 = 92.38%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.38 ms.
cifar100       train : [loss = 0.098, top1 = 98.20%], valid : [loss = 1.472, top1 = 67.36%], test : [loss = 1.455, top1 = 67.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 1.841, top1 = 51.28%], valid : [loss = 2.411, top1 = 40.30%], test : [loss = 2.391, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.13%], valid : [loss = 0.754, top1 = 73.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9212/15625) 009212-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.559, top1 = 88.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.379, top1 = 91.80%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.51 ms.
cifar100       train : [loss = 0.099, top1 = 98.20%], valid : [loss = 1.518, top1 = 66.92%], test : [loss = 1.541, top1 = 67.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.88%], valid : [loss = 2.421, top1 = 38.97%], test : [loss = 2.433, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.75%], valid : [loss = 0.733, top1 = 74.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9213/15625) 009213-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.503, top1 = 88.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.92 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.315, top1 = 92.38%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.60 ms.
cifar100       train : [loss = 0.331, top1 = 90.93%], valid : [loss = 1.265, top1 = 67.48%], test : [loss = 1.275, top1 = 67.84%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.83%], valid : [loss = 2.424, top1 = 39.13%], test : [loss = 2.410, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 81.00%], valid : [loss = 0.620, top1 = 78.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9214/15625) 009214-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.30%], valid : [loss = 0.726, top1 = 75.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.48 ms.
cifar10        train : [loss = 0.475, top1 = 83.45%], test  : [loss = 0.581, top1 = 80.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.81 ms.
cifar100       train : [loss = 1.860, top1 = 49.32%], valid : [loss = 2.037, top1 = 46.54%], test : [loss = 2.022, top1 = 46.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 3.508, top1 = 17.64%], valid : [loss = 3.509, top1 = 18.93%], test : [loss = 3.535, top1 = 17.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.218, top1 = 55.89%], valid : [loss = 1.255, top1 = 54.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9215/15625) 009215-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.482, top1 = 89.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.14 ms.
cifar100       train : [loss = 0.137, top1 = 97.28%], valid : [loss = 1.265, top1 = 69.80%], test : [loss = 1.269, top1 = 69.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.19%], valid : [loss = 2.185, top1 = 43.89%], test : [loss = 2.175, top1 = 44.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.454, top1 = 84.50%], valid : [loss = 0.557, top1 = 81.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9216/15625) 009216-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.507, top1 = 89.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.296, top1 = 93.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.15 ms.
cifar100       train : [loss = 0.136, top1 = 97.31%], valid : [loss = 1.289, top1 = 69.52%], test : [loss = 1.311, top1 = 69.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.38%], valid : [loss = 2.302, top1 = 41.60%], test : [loss = 2.281, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9217/15625) 009217-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.605, top1 = 86.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.406, top1 = 90.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.74 ms.
cifar100       train : [loss = 0.394, top1 = 88.74%], valid : [loss = 1.422, top1 = 65.26%], test : [loss = 1.422, top1 = 65.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.317, top1 = 40.60%], valid : [loss = 2.528, top1 = 37.17%], test : [loss = 2.555, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9218/15625) 009218-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.475, top1 = 89.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.99 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.300, top1 = 93.05%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=23.46 ms.
cifar100       train : [loss = 0.284, top1 = 92.53%], valid : [loss = 1.250, top1 = 67.90%], test : [loss = 1.220, top1 = 68.96%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.76%], valid : [loss = 2.220, top1 = 42.87%], test : [loss = 2.246, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.76%], valid : [loss = 0.635, top1 = 78.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9219/15625) 009219-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.509, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.332, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.84 ms.
cifar100       train : [loss = 0.336, top1 = 90.80%], valid : [loss = 1.243, top1 = 66.92%], test : [loss = 1.278, top1 = 66.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 44.93%], valid : [loss = 2.384, top1 = 40.33%], test : [loss = 2.375, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9220/15625) 009220-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.451, top1 = 89.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.349, top1 = 91.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=8.91 ms.
cifar100       train : [loss = 0.328, top1 = 91.21%], valid : [loss = 1.323, top1 = 66.90%], test : [loss = 1.309, top1 = 67.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.29%], valid : [loss = 2.377, top1 = 40.30%], test : [loss = 2.419, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9221/15625) 009221-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.68%], valid : [loss = 0.565, top1 = 87.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10        train : [loss = 0.015, top1 = 99.60%], test  : [loss = 0.357, top1 = 91.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.77 ms.
cifar100       train : [loss = 0.268, top1 = 92.39%], valid : [loss = 1.358, top1 = 67.12%], test : [loss = 1.347, top1 = 67.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.72%], valid : [loss = 2.518, top1 = 35.70%], test : [loss = 2.552, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.899, top1 = 67.66%], valid : [loss = 0.939, top1 = 66.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9222/15625) 009222-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.28%], valid : [loss = 0.758, top1 = 78.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.84 ms.
cifar10        train : [loss = 0.256, top1 = 91.18%], test  : [loss = 0.513, top1 = 84.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.27 ms.
cifar100       train : [loss = 1.194, top1 = 65.67%], valid : [loss = 1.779, top1 = 53.54%], test : [loss = 1.730, top1 = 52.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 3.359, top1 = 19.28%], valid : [loss = 3.386, top1 = 19.43%], test : [loss = 3.419, top1 = 19.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.121, top1 = 59.42%], valid : [loss = 1.167, top1 = 57.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9223/15625) 009223-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.27%], valid : [loss = 0.636, top1 = 85.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10        train : [loss = 0.077, top1 = 97.60%], test  : [loss = 0.392, top1 = 89.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.96 ms.
cifar100       train : [loss = 0.728, top1 = 78.67%], valid : [loss = 1.369, top1 = 63.34%], test : [loss = 1.372, top1 = 63.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.71%], valid : [loss = 2.670, top1 = 33.20%], test : [loss = 2.698, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.26%], valid : [loss = 0.791, top1 = 72.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9224/15625) 009224-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.73%], valid : [loss = 0.478, top1 = 85.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.91 ms.
cifar10        train : [loss = 0.218, top1 = 92.75%], test  : [loss = 0.366, top1 = 88.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.50 ms.
cifar100       train : [loss = 1.211, top1 = 65.48%], valid : [loss = 1.492, top1 = 58.74%], test : [loss = 1.507, top1 = 59.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.24 ms.
ImageNet16-120 train : [loss = 2.772, top1 = 31.40%], valid : [loss = 2.774, top1 = 30.90%], test : [loss = 2.806, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 66.93%], valid : [loss = 0.953, top1 = 66.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9225/15625) 009225-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.568, top1 = 88.15%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.67%], test  : [loss = 0.344, top1 = 92.41%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.96 ms.
cifar100       train : [loss = 0.113, top1 = 97.46%], valid : [loss = 1.361, top1 = 69.34%], test : [loss = 1.393, top1 = 69.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.68 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.31%], valid : [loss = 2.783, top1 = 30.60%], test : [loss = 2.776, top1 = 30.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.68%], valid : [loss = 0.909, top1 = 67.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9226/15625) 009226-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.22%], valid : [loss = 0.837, top1 = 77.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.219, top1 = 92.51%], test  : [loss = 0.618, top1 = 81.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 1.168, top1 = 66.78%], valid : [loss = 1.811, top1 = 52.48%], test : [loss = 1.761, top1 = 54.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 3.223, top1 = 22.77%], valid : [loss = 3.344, top1 = 21.47%], test : [loss = 3.362, top1 = 20.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9227/15625) 009227-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.589, top1 = 88.09%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.61 ms.
cifar10        train : [loss = 0.019, top1 = 99.49%], test  : [loss = 0.418, top1 = 90.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.40 ms.
cifar100       train : [loss = 0.398, top1 = 88.89%], valid : [loss = 1.439, top1 = 63.58%], test : [loss = 1.432, top1 = 64.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.50%], valid : [loss = 2.370, top1 = 38.90%], test : [loss = 2.419, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 66.22%], valid : [loss = 0.975, top1 = 65.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9228/15625) 009228-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.574, top1 = 87.80%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.95 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.389, top1 = 91.13%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.51 ms.
cifar100       train : [loss = 0.377, top1 = 89.45%], valid : [loss = 1.418, top1 = 65.03%], test : [loss = 1.391, top1 = 65.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.30%], valid : [loss = 2.508, top1 = 37.11%], test : [loss = 2.530, top1 = 36.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.04%], valid : [loss = 0.756, top1 = 73.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9229/15625) 009229-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.588, top1 = 87.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.387, top1 = 91.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 0.376, top1 = 89.46%], valid : [loss = 1.395, top1 = 65.37%], test : [loss = 1.381, top1 = 65.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.33%], valid : [loss = 2.511, top1 = 37.21%], test : [loss = 2.524, top1 = 37.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.03%], valid : [loss = 0.838, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9230/15625) 009230-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.63 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.05%], valid : [loss = 0.478, top1 = 84.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10        train : [loss = 0.301, top1 = 89.98%], test  : [loss = 0.404, top1 = 86.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.340, top1 = 62.96%], valid : [loss = 1.546, top1 = 58.08%], test : [loss = 1.534, top1 = 57.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.52%], valid : [loss = 2.925, top1 = 28.83%], test : [loss = 2.969, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9231/15625) 009231-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.80%], valid : [loss = 1.130, top1 = 62.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10        train : [loss = 0.774, top1 = 72.69%], test  : [loss = 0.926, top1 = 67.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 2.113, top1 = 44.42%], valid : [loss = 2.422, top1 = 39.32%], test : [loss = 2.397, top1 = 39.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 3.755, top1 = 14.13%], valid : [loss = 3.824, top1 = 13.77%], test : [loss = 3.833, top1 = 13.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 50.71%], valid : [loss = 1.405, top1 = 48.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9232/15625) 009232-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.499, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.320, top1 = 92.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.26 ms.
cifar100       train : [loss = 0.324, top1 = 91.14%], valid : [loss = 1.269, top1 = 67.12%], test : [loss = 1.267, top1 = 67.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.71%], valid : [loss = 2.315, top1 = 41.13%], test : [loss = 2.337, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.46%], valid : [loss = 0.604, top1 = 79.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9233/15625) 009233-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.425, top1 = 90.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.279, top1 = 93.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.52 ms.
cifar100       train : [loss = 0.184, top1 = 95.64%], valid : [loss = 1.238, top1 = 70.70%], test : [loss = 1.274, top1 = 70.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.81 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.68%], valid : [loss = 2.245, top1 = 42.90%], test : [loss = 2.277, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.89%], valid : [loss = 0.513, top1 = 82.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9234/15625) 009234-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.65%], valid : [loss = 0.461, top1 = 86.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.150, top1 = 95.11%], test  : [loss = 0.342, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.76 ms.
cifar100       train : [loss = 0.979, top1 = 72.12%], valid : [loss = 1.339, top1 = 62.31%], test : [loss = 1.339, top1 = 62.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.31%], valid : [loss = 2.664, top1 = 33.60%], test : [loss = 2.694, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9235/15625) 009235-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.509, top1 = 89.59%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.341, top1 = 92.74%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.77 ms.
cifar100       train : [loss = 0.177, top1 = 95.71%], valid : [loss = 1.274, top1 = 69.32%], test : [loss = 1.276, top1 = 69.78%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.19%], valid : [loss = 2.178, top1 = 43.93%], test : [loss = 2.188, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.73%], valid : [loss = 0.799, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9236/15625) 009236-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.138, top1 = 95.58%], valid : [loss = 0.641, top1 = 82.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10        train : [loss = 0.199, top1 = 93.25%], test  : [loss = 0.399, top1 = 87.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.89 ms.
cifar100       train : [loss = 1.004, top1 = 71.05%], valid : [loss = 1.437, top1 = 60.86%], test : [loss = 1.416, top1 = 61.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.762, top1 = 31.24%], valid : [loss = 2.807, top1 = 30.82%], test : [loss = 2.858, top1 = 30.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.64%], valid : [loss = 0.920, top1 = 67.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9237/15625) 009237-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.34%], valid : [loss = 0.580, top1 = 85.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.105, top1 = 96.52%], test  : [loss = 0.403, top1 = 88.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.30 ms.
cifar100       train : [loss = 0.819, top1 = 76.07%], valid : [loss = 1.397, top1 = 62.65%], test : [loss = 1.424, top1 = 62.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 32.97%], valid : [loss = 2.769, top1 = 31.72%], test : [loss = 2.810, top1 = 30.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9238/15625) 009238-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.89%], valid : [loss = 0.454, top1 = 86.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10        train : [loss = 0.162, top1 = 94.75%], test  : [loss = 0.363, top1 = 88.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.92 ms.
cifar100       train : [loss = 0.963, top1 = 72.47%], valid : [loss = 1.334, top1 = 63.22%], test : [loss = 1.325, top1 = 62.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.91 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.68%], valid : [loss = 2.669, top1 = 33.13%], test : [loss = 2.698, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9239/15625) 009239-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.16%], valid : [loss = 0.559, top1 = 86.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10        train : [loss = 0.061, top1 = 98.06%], test  : [loss = 0.375, top1 = 89.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.11 ms.
cifar100       train : [loss = 0.669, top1 = 80.28%], valid : [loss = 1.309, top1 = 64.37%], test : [loss = 1.324, top1 = 64.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 38.81%], valid : [loss = 2.522, top1 = 36.24%], test : [loss = 2.550, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.63%], valid : [loss = 0.843, top1 = 70.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9240/15625) 009240-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.53%], valid : [loss = 0.445, top1 = 87.94%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.03 ms.
cifar10        train : [loss = 0.058, top1 = 98.62%], test  : [loss = 0.304, top1 = 90.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.48 ms.
cifar100       train : [loss = 0.585, top1 = 83.77%], valid : [loss = 1.211, top1 = 66.94%], test : [loss = 1.214, top1 = 65.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 41.04%], valid : [loss = 2.484, top1 = 37.63%], test : [loss = 2.515, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.95%], valid : [loss = 0.660, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9241/15625) 009241-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.76 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.90%], valid : [loss = 0.477, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.303, top1 = 89.92%], test  : [loss = 0.399, top1 = 86.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 1.336, top1 = 62.92%], valid : [loss = 1.535, top1 = 57.50%], test : [loss = 1.523, top1 = 57.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.73 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.61%], valid : [loss = 2.905, top1 = 29.67%], test : [loss = 2.956, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9242/15625) 009242-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.450, top1 = 89.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.312, top1 = 92.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.333, top1 = 90.86%], valid : [loss = 1.310, top1 = 67.18%], test : [loss = 1.298, top1 = 67.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.10%], valid : [loss = 2.353, top1 = 39.87%], test : [loss = 2.399, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.45%], valid : [loss = 0.549, top1 = 81.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9243/15625) 009243-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.448, top1 = 89.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 91.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 0.326, top1 = 91.17%], valid : [loss = 1.311, top1 = 67.08%], test : [loss = 1.331, top1 = 66.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.31%], valid : [loss = 2.377, top1 = 39.78%], test : [loss = 2.420, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9244/15625) 009244-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.529, top1 = 89.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.317, top1 = 92.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.72 ms.
cifar100       train : [loss = 0.154, top1 = 96.76%], valid : [loss = 1.299, top1 = 69.50%], test : [loss = 1.288, top1 = 69.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.48%], valid : [loss = 2.301, top1 = 42.00%], test : [loss = 2.298, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 79.01%], valid : [loss = 0.676, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9245/15625) 009245-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.98%], valid : [loss = 0.575, top1 = 86.09%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.61 ms.
cifar10        train : [loss = 0.067, top1 = 97.75%], test  : [loss = 0.373, top1 = 89.42%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.78 ms.
cifar100       train : [loss = 0.648, top1 = 81.32%], valid : [loss = 1.411, top1 = 63.22%], test : [loss = 1.439, top1 = 62.48%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=21.49 ms.
ImageNet16-120 train : [loss = 2.319, top1 = 40.30%], valid : [loss = 2.514, top1 = 35.63%], test : [loss = 2.558, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.54%], valid : [loss = 0.893, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9246/15625) 009246-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 91.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.56 ms.
cifar100       train : [loss = 0.327, top1 = 91.08%], valid : [loss = 1.298, top1 = 67.30%], test : [loss = 1.311, top1 = 67.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.23%], valid : [loss = 2.362, top1 = 40.24%], test : [loss = 2.412, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9247/15625) 009247-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.32%], valid : [loss = 0.764, top1 = 73.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.564, top1 = 80.40%], test  : [loss = 0.637, top1 = 78.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 2.012, top1 = 45.52%], valid : [loss = 2.121, top1 = 43.47%], test : [loss = 2.135, top1 = 43.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 25.69%], valid : [loss = 3.042, top1 = 26.18%], test : [loss = 3.070, top1 = 25.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.194, top1 = 56.97%], valid : [loss = 1.245, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9248/15625) 009248-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.46%], valid : [loss = 0.863, top1 = 78.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.126, top1 = 95.76%], test  : [loss = 0.536, top1 = 85.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.887, top1 = 74.29%], valid : [loss = 1.644, top1 = 56.50%], test : [loss = 1.681, top1 = 57.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 3.027, top1 = 26.67%], valid : [loss = 3.155, top1 = 24.97%], test : [loss = 3.190, top1 = 23.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 62.64%], valid : [loss = 1.096, top1 = 60.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9249/15625) 009249-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.47 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.18 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9250/15625) 009250-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.595, top1 = 87.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.414, top1 = 90.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.83 ms.
cifar100       train : [loss = 0.205, top1 = 95.13%], valid : [loss = 1.422, top1 = 67.38%], test : [loss = 1.403, top1 = 67.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.61%], valid : [loss = 2.516, top1 = 37.77%], test : [loss = 2.539, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.15%], valid : [loss = 0.738, top1 = 74.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9251/15625) 009251-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.679, top1 = 85.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.42 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.411, top1 = 90.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.267, top1 = 93.13%], valid : [loss = 1.642, top1 = 62.48%], test : [loss = 1.649, top1 = 62.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.54%], valid : [loss = 2.549, top1 = 36.43%], test : [loss = 2.563, top1 = 36.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.80%], valid : [loss = 0.857, top1 = 69.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9252/15625) 009252-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.562, top1 = 87.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.368, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.38 ms.
cifar100       train : [loss = 0.463, top1 = 86.83%], valid : [loss = 1.256, top1 = 66.02%], test : [loss = 1.287, top1 = 66.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.56 ms.
ImageNet16-120 train : [loss = 2.582, top1 = 34.23%], valid : [loss = 2.687, top1 = 32.73%], test : [loss = 2.690, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.06%], valid : [loss = 0.861, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9253/15625) 009253-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.10%], valid : [loss = 0.504, top1 = 86.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.104, top1 = 96.61%], test  : [loss = 0.358, top1 = 89.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.747, top1 = 78.38%], valid : [loss = 1.305, top1 = 64.62%], test : [loss = 1.282, top1 = 65.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.452, top1 = 37.67%], valid : [loss = 2.536, top1 = 35.73%], test : [loss = 2.558, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.67%], valid : [loss = 0.907, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9254/15625) 009254-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.493, top1 = 89.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.342, top1 = 91.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 0.313, top1 = 91.50%], valid : [loss = 1.244, top1 = 67.14%], test : [loss = 1.252, top1 = 68.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.95%], valid : [loss = 2.309, top1 = 41.40%], test : [loss = 2.354, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.15%], valid : [loss = 0.673, top1 = 76.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9255/15625) 009255-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.488, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.75 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.328, top1 = 92.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.83 ms.
cifar100       train : [loss = 0.170, top1 = 96.01%], valid : [loss = 1.421, top1 = 67.26%], test : [loss = 1.347, top1 = 68.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.68%], valid : [loss = 2.303, top1 = 41.47%], test : [loss = 2.388, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.445, top1 = 84.62%], valid : [loss = 0.551, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9256/15625) 009256-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.79%], valid : [loss = 0.467, top1 = 86.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10        train : [loss = 0.150, top1 = 95.15%], test  : [loss = 0.345, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.19 ms.
cifar100       train : [loss = 0.968, top1 = 72.62%], valid : [loss = 1.342, top1 = 62.42%], test : [loss = 1.336, top1 = 62.90%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.14%], valid : [loss = 2.659, top1 = 33.33%], test : [loss = 2.712, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9257/15625) 009257-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.579, top1 = 87.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.76 ms.
cifar10        train : [loss = 0.024, top1 = 99.44%], test  : [loss = 0.403, top1 = 89.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.52 ms.
cifar100       train : [loss = 0.341, top1 = 90.98%], valid : [loss = 1.381, top1 = 65.79%], test : [loss = 1.372, top1 = 65.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.40%], valid : [loss = 2.536, top1 = 37.14%], test : [loss = 2.523, top1 = 37.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.55%], valid : [loss = 0.764, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9258/15625) 009258-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.78%], valid : [loss = 0.538, top1 = 88.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10        train : [loss = 0.019, top1 = 99.48%], test  : [loss = 0.358, top1 = 91.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.47 ms.
cifar100       train : [loss = 0.329, top1 = 90.44%], valid : [loss = 1.309, top1 = 67.24%], test : [loss = 1.374, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 37.55%], valid : [loss = 2.556, top1 = 34.10%], test : [loss = 2.581, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.55%], valid : [loss = 0.926, top1 = 67.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9259/15625) 009259-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.21%], valid : [loss = 0.849, top1 = 71.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.64 ms.
cifar10        train : [loss = 0.561, top1 = 80.35%], test  : [loss = 0.732, top1 = 74.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.23 ms.
cifar100       train : [loss = 1.786, top1 = 52.09%], valid : [loss = 2.071, top1 = 46.44%], test : [loss = 2.071, top1 = 46.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.89%], valid : [loss = 3.634, top1 = 16.27%], test : [loss = 3.656, top1 = 15.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9260/15625) 009260-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.529, top1 = 88.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.330, top1 = 91.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.10 ms.
cifar100       train : [loss = 0.356, top1 = 90.18%], valid : [loss = 1.274, top1 = 67.76%], test : [loss = 1.296, top1 = 66.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.58%], valid : [loss = 2.423, top1 = 38.50%], test : [loss = 2.432, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9261/15625) 009261-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.29%], valid : [loss = 0.461, top1 = 86.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.108, top1 = 96.66%], test  : [loss = 0.336, top1 = 89.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.50 ms.
cifar100       train : [loss = 0.879, top1 = 75.08%], valid : [loss = 1.319, top1 = 63.66%], test : [loss = 1.316, top1 = 62.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.70%], valid : [loss = 2.633, top1 = 33.17%], test : [loss = 2.661, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9262/15625) 009262-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.48%], valid : [loss = 0.672, top1 = 77.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.546, top1 = 80.96%], test  : [loss = 0.609, top1 = 79.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.90 ms.
cifar100       train : [loss = 1.760, top1 = 52.14%], valid : [loss = 1.891, top1 = 49.92%], test : [loss = 1.927, top1 = 49.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 3.403, top1 = 19.86%], valid : [loss = 3.371, top1 = 21.13%], test : [loss = 3.423, top1 = 19.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.379, top1 = 49.75%], valid : [loss = 1.391, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9263/15625) 009263-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.571, top1 = 88.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.12 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.373, top1 = 92.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.66 ms.
cifar100       train : [loss = 0.076, top1 = 98.75%], valid : [loss = 1.448, top1 = 69.26%], test : [loss = 1.429, top1 = 69.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.26 ms.
ImageNet16-120 train : [loss = 1.843, top1 = 51.16%], valid : [loss = 2.401, top1 = 39.90%], test : [loss = 2.444, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.59%], valid : [loss = 0.694, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9264/15625) 009264-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.463, top1 = 89.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.308, top1 = 92.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.91 ms.
cifar100       train : [loss = 0.304, top1 = 91.87%], valid : [loss = 1.257, top1 = 68.16%], test : [loss = 1.252, top1 = 67.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.38%], valid : [loss = 2.246, top1 = 42.07%], test : [loss = 2.263, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.28%], valid : [loss = 0.608, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9265/15625) 009265-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.68%], valid : [loss = 0.634, top1 = 84.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10        train : [loss = 0.091, top1 = 97.10%], test  : [loss = 0.417, top1 = 88.28%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.45 ms.
cifar100       train : [loss = 0.799, top1 = 76.39%], valid : [loss = 1.434, top1 = 61.74%], test : [loss = 1.413, top1 = 62.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.85%], valid : [loss = 2.728, top1 = 32.53%], test : [loss = 2.767, top1 = 31.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.42%], valid : [loss = 0.844, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9266/15625) 009266-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.65%], valid : [loss = 0.621, top1 = 86.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10        train : [loss = 0.032, top1 = 99.14%], test  : [loss = 0.398, top1 = 90.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.83 ms.
cifar100       train : [loss = 0.504, top1 = 85.32%], valid : [loss = 1.408, top1 = 64.02%], test : [loss = 1.413, top1 = 64.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.09%], valid : [loss = 2.527, top1 = 36.33%], test : [loss = 2.620, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9267/15625) 009267-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.473, top1 = 89.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.70 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.311, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.326, top1 = 91.27%], valid : [loss = 1.249, top1 = 67.34%], test : [loss = 1.257, top1 = 67.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.81%], valid : [loss = 2.326, top1 = 39.97%], test : [loss = 2.361, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9268/15625) 009268-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.44%], valid : [loss = 0.684, top1 = 84.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10        train : [loss = 0.050, top1 = 98.47%], test  : [loss = 0.456, top1 = 88.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 0.610, top1 = 82.11%], valid : [loss = 1.503, top1 = 62.00%], test : [loss = 1.470, top1 = 63.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.23%], valid : [loss = 2.796, top1 = 30.13%], test : [loss = 2.882, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.890, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9269/15625) 009269-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.565, top1 = 87.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.396, top1 = 90.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.25 ms.
cifar100       train : [loss = 0.388, top1 = 88.97%], valid : [loss = 1.383, top1 = 65.52%], test : [loss = 1.415, top1 = 65.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.17%], valid : [loss = 2.524, top1 = 36.82%], test : [loss = 2.518, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9270/15625) 009270-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 52.35 M, Params=0.382 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.505, top1 = 88.96%]
cifar10        FLOP= 52.35 M, Params=0.382 MB, latency=19.73 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.323, top1 = 91.87%]
cifar100       FLOP= 52.35 M, Params=0.388 MB, latency=18.86 ms.
cifar100       train : [loss = 0.286, top1 = 92.54%], valid : [loss = 1.217, top1 = 68.91%], test : [loss = 1.201, top1 = 68.89%]
ImageNet16-120 FLOP= 13.09 M, Params=0.389 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.31%], valid : [loss = 2.244, top1 = 43.00%], test : [loss = 2.259, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.19%], valid : [loss = 0.660, top1 = 77.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9271/15625) 009271-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.72%], valid : [loss = 0.467, top1 = 85.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.158, top1 = 94.81%], test  : [loss = 0.338, top1 = 89.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.04 ms.
cifar100       train : [loss = 0.979, top1 = 72.05%], valid : [loss = 1.352, top1 = 62.32%], test : [loss = 1.321, top1 = 63.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.10%], valid : [loss = 2.702, top1 = 32.60%], test : [loss = 2.765, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9272/15625) 009272-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.519, top1 = 89.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.87 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.334, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.57 ms.
cifar100       train : [loss = 0.133, top1 = 97.19%], valid : [loss = 1.314, top1 = 69.51%], test : [loss = 1.342, top1 = 68.73%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.82 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.90%], valid : [loss = 2.227, top1 = 42.59%], test : [loss = 2.226, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.48%], valid : [loss = 0.634, top1 = 78.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9273/15625) 009273-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.493, top1 = 89.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.93 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.313, top1 = 93.17%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.10 ms.
cifar100       train : [loss = 0.128, top1 = 97.47%], valid : [loss = 1.301, top1 = 69.40%], test : [loss = 1.256, top1 = 69.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.60 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 51.92%], valid : [loss = 2.265, top1 = 41.93%], test : [loss = 2.235, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.734, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9274/15625) 009274-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.86%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.44 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.289, top1 = 93.11%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.96 ms.
cifar100       train : [loss = 0.126, top1 = 97.68%], valid : [loss = 1.212, top1 = 69.90%], test : [loss = 1.226, top1 = 69.98%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=25.36 ms.
ImageNet16-120 train : [loss = 1.631, top1 = 56.19%], valid : [loss = 2.157, top1 = 45.00%], test : [loss = 2.115, top1 = 45.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.88%], valid : [loss = 0.647, top1 = 77.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9275/15625) 009275-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=22.02 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.94%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.327, top1 = 91.84%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.45 ms.
cifar100       train : [loss = 0.347, top1 = 90.51%], valid : [loss = 1.291, top1 = 67.62%], test : [loss = 1.298, top1 = 67.36%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.43%], valid : [loss = 2.407, top1 = 39.23%], test : [loss = 2.428, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.82%], valid : [loss = 0.672, top1 = 77.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9276/15625) 009276-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.616, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.068, top1 = 97.94%], test  : [loss = 0.399, top1 = 89.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.21 ms.
cifar100       train : [loss = 0.714, top1 = 79.28%], valid : [loss = 1.388, top1 = 63.20%], test : [loss = 1.368, top1 = 63.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.19%], valid : [loss = 2.655, top1 = 33.82%], test : [loss = 2.685, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9277/15625) 009277-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.69%], valid : [loss = 0.532, top1 = 83.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.239, top1 = 91.88%], test  : [loss = 0.401, top1 = 87.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.58 ms.
cifar100       train : [loss = 1.424, top1 = 60.22%], valid : [loss = 1.693, top1 = 54.16%], test : [loss = 1.677, top1 = 54.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.24%], valid : [loss = 2.941, top1 = 27.53%], test : [loss = 3.012, top1 = 27.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.58%], valid : [loss = 1.017, top1 = 63.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9278/15625) 009278-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.572, top1 = 88.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.352, top1 = 92.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.84 ms.
cifar100       train : [loss = 0.122, top1 = 97.50%], valid : [loss = 1.406, top1 = 68.08%], test : [loss = 1.421, top1 = 68.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.948, top1 = 48.64%], valid : [loss = 2.323, top1 = 41.20%], test : [loss = 2.317, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.35%], valid : [loss = 0.816, top1 = 71.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9279/15625) 009279-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.487, top1 = 89.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.316, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.46 ms.
cifar100       train : [loss = 0.256, top1 = 93.51%], valid : [loss = 1.203, top1 = 69.33%], test : [loss = 1.204, top1 = 69.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.77%], valid : [loss = 2.230, top1 = 42.92%], test : [loss = 2.238, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9280/15625) 009280-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.30%], valid : [loss = 0.865, top1 = 79.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.132, top1 = 95.52%], test  : [loss = 0.559, top1 = 84.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.82 ms.
cifar100       train : [loss = 0.858, top1 = 74.96%], valid : [loss = 1.686, top1 = 57.54%], test : [loss = 1.700, top1 = 56.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 3.044, top1 = 26.19%], valid : [loss = 3.174, top1 = 24.23%], test : [loss = 3.219, top1 = 22.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.15%], valid : [loss = 1.084, top1 = 61.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9281/15625) 009281-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.492, top1 = 90.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.320, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.49 ms.
cifar100       train : [loss = 0.118, top1 = 97.72%], valid : [loss = 1.296, top1 = 69.43%], test : [loss = 1.279, top1 = 69.79%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.28 ms.
ImageNet16-120 train : [loss = 1.681, top1 = 54.94%], valid : [loss = 2.161, top1 = 44.23%], test : [loss = 2.162, top1 = 44.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.18%], valid : [loss = 0.604, top1 = 79.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9282/15625) 009282-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.20 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.02%], valid : [loss = 0.483, top1 = 84.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 0.305, top1 = 89.85%], test  : [loss = 0.404, top1 = 86.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.76 ms.
cifar100       train : [loss = 1.344, top1 = 62.70%], valid : [loss = 1.531, top1 = 57.80%], test : [loss = 1.523, top1 = 58.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.59%], valid : [loss = 2.898, top1 = 29.23%], test : [loss = 2.969, top1 = 27.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9283/15625) 009283-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.633, top1 = 86.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.028, top1 = 99.30%], test  : [loss = 0.423, top1 = 90.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.57 ms.
cifar100       train : [loss = 0.512, top1 = 85.14%], valid : [loss = 1.434, top1 = 63.44%], test : [loss = 1.416, top1 = 63.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.404, top1 = 38.68%], valid : [loss = 2.592, top1 = 34.77%], test : [loss = 2.634, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 72.16%], valid : [loss = 0.852, top1 = 70.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9284/15625) 009284-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.17%], valid : [loss = 0.855, top1 = 75.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10        train : [loss = 0.317, top1 = 88.95%], test  : [loss = 0.618, top1 = 80.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.28 ms.
cifar100       train : [loss = 1.389, top1 = 61.08%], valid : [loss = 1.941, top1 = 49.89%], test : [loss = 1.936, top1 = 49.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 3.483, top1 = 17.55%], valid : [loss = 3.508, top1 = 17.93%], test : [loss = 3.504, top1 = 16.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9285/15625) 009285-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.532, top1 = 88.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.339, top1 = 91.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.241, top1 = 93.95%], valid : [loss = 1.245, top1 = 68.30%], test : [loss = 1.257, top1 = 68.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.68%], valid : [loss = 2.307, top1 = 40.70%], test : [loss = 2.336, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.77%], valid : [loss = 0.724, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9286/15625) 009286-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.504, top1 = 88.61%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.72 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.321, top1 = 92.36%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.35 ms.
cifar100       train : [loss = 0.215, top1 = 94.99%], valid : [loss = 1.238, top1 = 69.40%], test : [loss = 1.250, top1 = 69.04%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.45%], valid : [loss = 2.269, top1 = 41.57%], test : [loss = 2.281, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 74.17%], valid : [loss = 0.781, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9287/15625) 009287-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.18%], valid : [loss = 0.857, top1 = 70.74%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10        train : [loss = 0.671, top1 = 76.39%], test  : [loss = 0.770, top1 = 73.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.24 ms.
cifar100       train : [loss = 1.972, top1 = 47.68%], valid : [loss = 2.168, top1 = 43.90%], test : [loss = 2.186, top1 = 44.04%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.91 ms.
ImageNet16-120 train : [loss = 3.662, top1 = 15.49%], valid : [loss = 3.669, top1 = 15.40%], test : [loss = 3.711, top1 = 14.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9288/15625) 009288-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.493, top1 = 89.68%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.26 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.314, top1 = 92.94%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.54 ms.
cifar100       train : [loss = 0.116, top1 = 97.80%], valid : [loss = 1.287, top1 = 69.65%], test : [loss = 1.281, top1 = 69.95%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.63 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.49%], valid : [loss = 2.245, top1 = 42.51%], test : [loss = 2.228, top1 = 43.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.51%], valid : [loss = 0.693, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9289/15625) 009289-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.387, top1 = 86.73%], valid : [loss = 0.523, top1 = 82.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.391, top1 = 86.67%], test  : [loss = 0.461, top1 = 84.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.30 ms.
cifar100       train : [loss = 1.516, top1 = 58.30%], valid : [loss = 1.646, top1 = 54.43%], test : [loss = 1.630, top1 = 54.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.42 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.48%], valid : [loss = 2.987, top1 = 27.65%], test : [loss = 3.055, top1 = 26.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 60.45%], valid : [loss = 1.137, top1 = 59.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9290/15625) 009290-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.66%], valid : [loss = 0.525, top1 = 88.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.354, top1 = 91.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.44 ms.
cifar100       train : [loss = 0.409, top1 = 88.22%], valid : [loss = 1.239, top1 = 67.24%], test : [loss = 1.243, top1 = 67.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.32%], valid : [loss = 2.411, top1 = 38.23%], test : [loss = 2.456, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9291/15625) 009291-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.538, top1 = 89.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.369, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.44 ms.
cifar100       train : [loss = 0.099, top1 = 98.28%], valid : [loss = 1.463, top1 = 67.80%], test : [loss = 1.451, top1 = 68.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.49%], valid : [loss = 2.480, top1 = 38.97%], test : [loss = 2.436, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.59%], valid : [loss = 0.721, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9292/15625) 009292-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.612, top1 = 87.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.400, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.13 ms.
cifar100       train : [loss = 0.212, top1 = 95.03%], valid : [loss = 1.448, top1 = 66.27%], test : [loss = 1.437, top1 = 66.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.78%], valid : [loss = 2.486, top1 = 37.43%], test : [loss = 2.514, top1 = 37.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9293/15625) 009293-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.25%], valid : [loss = 0.709, top1 = 83.91%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.074, top1 = 97.63%], test  : [loss = 0.450, top1 = 87.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.16 ms.
cifar100       train : [loss = 0.708, top1 = 78.96%], valid : [loss = 1.534, top1 = 61.40%], test : [loss = 1.554, top1 = 61.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.15 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 31.94%], valid : [loss = 2.887, top1 = 28.90%], test : [loss = 2.900, top1 = 29.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.44%], valid : [loss = 0.933, top1 = 67.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9294/15625) 009294-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.74%], valid : [loss = 0.777, top1 = 80.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.108, top1 = 96.43%], test  : [loss = 0.453, top1 = 87.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.97 ms.
cifar100       train : [loss = 0.914, top1 = 73.53%], valid : [loss = 1.590, top1 = 58.44%], test : [loss = 1.581, top1 = 58.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.717, top1 = 32.22%], valid : [loss = 2.805, top1 = 30.37%], test : [loss = 2.892, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.96%], valid : [loss = 0.892, top1 = 69.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9295/15625) 009295-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.52%], valid : [loss = 0.613, top1 = 84.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.68 ms.
cifar10        train : [loss = 0.107, top1 = 96.42%], test  : [loss = 0.422, top1 = 87.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 0.603, top1 = 82.19%], valid : [loss = 1.579, top1 = 60.26%], test : [loss = 1.589, top1 = 59.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 3.392, top1 = 18.43%], valid : [loss = 3.389, top1 = 19.33%], test : [loss = 3.422, top1 = 17.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.269, top1 = 53.21%], valid : [loss = 1.272, top1 = 53.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9296/15625) 009296-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.25%], valid : [loss = 0.616, top1 = 85.23%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=12.37 ms.
cifar10        train : [loss = 0.073, top1 = 97.76%], test  : [loss = 0.391, top1 = 89.15%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=11.74 ms.
cifar100       train : [loss = 0.723, top1 = 78.92%], valid : [loss = 1.397, top1 = 63.05%], test : [loss = 1.383, top1 = 63.21%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.86%], valid : [loss = 2.677, top1 = 33.68%], test : [loss = 2.692, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9297/15625) 009297-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.546, top1 = 87.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.023, top1 = 99.38%], test  : [loss = 0.363, top1 = 91.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 0.344, top1 = 90.32%], valid : [loss = 1.331, top1 = 66.26%], test : [loss = 1.317, top1 = 67.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.73 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 40.87%], valid : [loss = 2.480, top1 = 36.50%], test : [loss = 2.520, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.96%], valid : [loss = 0.903, top1 = 68.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9298/15625) 009298-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.555, top1 = 87.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.368, top1 = 91.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.51 ms.
cifar100       train : [loss = 0.364, top1 = 89.74%], valid : [loss = 1.361, top1 = 65.38%], test : [loss = 1.377, top1 = 65.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.49%], valid : [loss = 2.491, top1 = 37.13%], test : [loss = 2.512, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.24%], valid : [loss = 0.773, top1 = 73.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9299/15625) 009299-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.88%], valid : [loss = 0.574, top1 = 86.84%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.78 ms.
cifar10        train : [loss = 0.077, top1 = 97.41%], test  : [loss = 0.378, top1 = 89.77%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.75 ms.
cifar100       train : [loss = 0.665, top1 = 80.37%], valid : [loss = 1.334, top1 = 64.42%], test : [loss = 1.320, top1 = 64.90%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=21.93 ms.
ImageNet16-120 train : [loss = 2.352, top1 = 39.56%], valid : [loss = 2.471, top1 = 37.17%], test : [loss = 2.527, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.60%], valid : [loss = 0.785, top1 = 72.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9300/15625) 009300-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.646, top1 = 86.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.404, top1 = 91.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.72 ms.
cifar100       train : [loss = 0.240, top1 = 94.01%], valid : [loss = 1.584, top1 = 64.02%], test : [loss = 1.570, top1 = 64.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.46 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.49%], valid : [loss = 2.459, top1 = 39.10%], test : [loss = 2.474, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.59%], valid : [loss = 0.787, top1 = 72.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9301/15625) 009301-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.260, top1 = 91.12%], valid : [loss = 0.535, top1 = 83.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10        train : [loss = 0.235, top1 = 91.95%], test  : [loss = 0.389, top1 = 87.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.78 ms.
cifar100       train : [loss = 1.332, top1 = 62.53%], valid : [loss = 1.589, top1 = 57.26%], test : [loss = 1.585, top1 = 56.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.850, top1 = 29.75%], valid : [loss = 2.858, top1 = 29.78%], test : [loss = 2.916, top1 = 28.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.32%], valid : [loss = 1.031, top1 = 63.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9302/15625) 009302-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.409, top1 = 91.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.279, top1 = 93.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.27 ms.
cifar100       train : [loss = 0.051, top1 = 99.38%], valid : [loss = 1.314, top1 = 71.54%], test : [loss = 1.352, top1 = 70.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 1.486, top1 = 59.66%], valid : [loss = 2.265, top1 = 43.67%], test : [loss = 2.306, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.86%], valid : [loss = 0.516, top1 = 82.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9303/15625) 009303-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.11%], valid : [loss = 0.534, top1 = 85.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.85 ms.
cifar10        train : [loss = 0.098, top1 = 96.87%], test  : [loss = 0.361, top1 = 89.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.744, top1 = 78.46%], valid : [loss = 1.294, top1 = 64.60%], test : [loss = 1.282, top1 = 64.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.64%], valid : [loss = 2.566, top1 = 35.63%], test : [loss = 2.601, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.77%], valid : [loss = 0.901, top1 = 68.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9304/15625) 009304-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.36%], valid : [loss = 0.461, top1 = 86.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10        train : [loss = 0.161, top1 = 94.73%], test  : [loss = 0.355, top1 = 88.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 1.006, top1 = 71.39%], valid : [loss = 1.365, top1 = 61.66%], test : [loss = 1.365, top1 = 62.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 34.00%], valid : [loss = 2.690, top1 = 32.94%], test : [loss = 2.691, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9305/15625) 009305-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.613, top1 = 86.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.435, top1 = 90.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.29 ms.
cifar100       train : [loss = 0.257, top1 = 93.47%], valid : [loss = 1.539, top1 = 64.96%], test : [loss = 1.533, top1 = 64.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.45 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.42%], valid : [loss = 2.560, top1 = 37.97%], test : [loss = 2.565, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.82%], valid : [loss = 0.775, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9306/15625) 009306-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.557, top1 = 88.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.39 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.337, top1 = 92.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.66 ms.
cifar100       train : [loss = 0.149, top1 = 96.80%], valid : [loss = 1.309, top1 = 68.72%], test : [loss = 1.344, top1 = 68.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 1.955, top1 = 48.58%], valid : [loss = 2.341, top1 = 40.80%], test : [loss = 2.326, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.93%], valid : [loss = 0.740, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9307/15625) 009307-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.96 ms.
cifar10-valid  train : [loss = 1.702, top1 = 36.12%], valid : [loss = 1.726, top1 = 35.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10        train : [loss = 1.324, top1 = 51.94%], test  : [loss = 1.343, top1 = 51.59%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.15 ms.
cifar100       train : [loss = 3.917, top1 = 9.71%], valid : [loss = 3.916, top1 = 9.54%], test : [loss = 3.916, top1 = 10.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.83 ms.
ImageNet16-120 train : [loss = 3.967, top1 = 10.92%], valid : [loss = 3.965, top1 = 11.17%], test : [loss = 3.979, top1 = 10.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.974, top1 = 26.71%], valid : [loss = 1.972, top1 = 27.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9308/15625) 009308-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.527, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.348, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.31 ms.
cifar100       train : [loss = 0.168, top1 = 95.95%], valid : [loss = 1.316, top1 = 68.44%], test : [loss = 1.307, top1 = 68.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.13%], valid : [loss = 2.235, top1 = 42.53%], test : [loss = 2.255, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.24%], valid : [loss = 0.761, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9309/15625) 009309-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.300, top1 = 89.59%], valid : [loss = 0.552, top1 = 82.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.287, top1 = 90.20%], test  : [loss = 0.429, top1 = 85.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.62 ms.
cifar100       train : [loss = 1.462, top1 = 59.31%], valid : [loss = 1.719, top1 = 53.72%], test : [loss = 1.684, top1 = 54.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 3.008, top1 = 26.76%], valid : [loss = 2.999, top1 = 26.57%], test : [loss = 3.080, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.72%], valid : [loss = 1.022, top1 = 63.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9310/15625) 009310-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.75 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.555, top1 = 88.88%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.356, top1 = 92.30%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.22 ms.
cifar100       train : [loss = 0.166, top1 = 95.89%], valid : [loss = 1.544, top1 = 65.56%], test : [loss = 1.583, top1 = 64.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 36.66%], valid : [loss = 2.646, top1 = 32.80%], test : [loss = 2.679, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 65.80%], valid : [loss = 0.976, top1 = 65.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9311/15625) 009311-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.63 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.54 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.29 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9312/15625) 009312-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.95%], valid : [loss = 1.080, top1 = 64.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.27 ms.
cifar10        train : [loss = 0.778, top1 = 72.72%], test  : [loss = 0.901, top1 = 68.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.63 ms.
cifar100       train : [loss = 2.124, top1 = 44.25%], valid : [loss = 2.379, top1 = 39.74%], test : [loss = 2.417, top1 = 40.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 3.764, top1 = 13.90%], valid : [loss = 3.824, top1 = 14.10%], test : [loss = 3.826, top1 = 13.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.346, top1 = 51.14%], valid : [loss = 1.388, top1 = 50.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9313/15625) 009313-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.288, top1 = 92.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.48 ms.
cifar100       train : [loss = 0.171, top1 = 96.14%], valid : [loss = 1.289, top1 = 69.38%], test : [loss = 1.300, top1 = 69.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 1.791, top1 = 52.36%], valid : [loss = 2.247, top1 = 42.85%], test : [loss = 2.297, top1 = 42.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.69%], valid : [loss = 0.508, top1 = 82.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9314/15625) 009314-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.504, top1 = 88.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.13 ms.
cifar10        train : [loss = 0.031, top1 = 99.18%], test  : [loss = 0.357, top1 = 90.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.38 ms.
cifar100       train : [loss = 0.420, top1 = 88.06%], valid : [loss = 1.292, top1 = 66.96%], test : [loss = 1.278, top1 = 66.68%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.16%], valid : [loss = 2.380, top1 = 39.97%], test : [loss = 2.402, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.71%], valid : [loss = 0.606, top1 = 79.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9315/15625) 009315-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.530, top1 = 89.32%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.340, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.94 ms.
cifar100       train : [loss = 0.076, top1 = 98.84%], valid : [loss = 1.445, top1 = 68.67%], test : [loss = 1.441, top1 = 68.42%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.55%], valid : [loss = 2.360, top1 = 40.90%], test : [loss = 2.379, top1 = 42.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.25%], valid : [loss = 0.642, top1 = 78.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9316/15625) 009316-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.58%], valid : [loss = 0.529, top1 = 88.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.78 ms.
cifar10        train : [loss = 0.030, top1 = 99.07%], test  : [loss = 0.350, top1 = 91.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.63 ms.
cifar100       train : [loss = 0.461, top1 = 86.50%], valid : [loss = 1.259, top1 = 66.74%], test : [loss = 1.283, top1 = 66.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.84%], valid : [loss = 2.386, top1 = 39.68%], test : [loss = 2.392, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.73%], valid : [loss = 0.922, top1 = 67.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9317/15625) 009317-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.04%], valid : [loss = 0.477, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.20 ms.
cifar10        train : [loss = 0.299, top1 = 89.89%], test  : [loss = 0.401, top1 = 86.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.21 ms.
cifar100       train : [loss = 1.325, top1 = 63.30%], valid : [loss = 1.547, top1 = 57.46%], test : [loss = 1.497, top1 = 58.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.48%], valid : [loss = 2.911, top1 = 29.20%], test : [loss = 2.992, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9318/15625) 009318-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.70%], valid : [loss = 0.594, top1 = 87.73%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10        train : [loss = 0.019, top1 = 99.44%], test  : [loss = 0.398, top1 = 91.36%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.10 ms.
cifar100       train : [loss = 0.401, top1 = 88.51%], valid : [loss = 1.508, top1 = 62.78%], test : [loss = 1.488, top1 = 62.98%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.802, top1 = 29.49%], valid : [loss = 2.902, top1 = 26.73%], test : [loss = 2.893, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.207, top1 = 56.11%], valid : [loss = 1.210, top1 = 56.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9319/15625) 009319-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.31%], valid : [loss = 0.640, top1 = 85.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.60 ms.
cifar10        train : [loss = 0.072, top1 = 97.80%], test  : [loss = 0.427, top1 = 88.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.08 ms.
cifar100       train : [loss = 0.718, top1 = 79.23%], valid : [loss = 1.386, top1 = 62.76%], test : [loss = 1.390, top1 = 63.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.75%], valid : [loss = 2.645, top1 = 33.37%], test : [loss = 2.685, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.77%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9320/15625) 009320-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.544, top1 = 88.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.58 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.366, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.166, top1 = 96.27%], valid : [loss = 1.433, top1 = 67.82%], test : [loss = 1.416, top1 = 67.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.55%], valid : [loss = 2.412, top1 = 39.07%], test : [loss = 2.428, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.45%], valid : [loss = 0.698, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9321/15625) 009321-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.80%], valid : [loss = 0.644, top1 = 85.87%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10        train : [loss = 0.031, top1 = 99.19%], test  : [loss = 0.435, top1 = 89.56%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.16 ms.
cifar100       train : [loss = 0.360, top1 = 90.09%], valid : [loss = 1.508, top1 = 63.30%], test : [loss = 1.466, top1 = 64.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=21.43 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.16%], valid : [loss = 2.660, top1 = 35.27%], test : [loss = 2.680, top1 = 34.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 72.96%], valid : [loss = 0.814, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9322/15625) 009322-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.55%], valid : [loss = 0.644, top1 = 85.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.398, top1 = 89.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.68 ms.
cifar100       train : [loss = 0.530, top1 = 84.52%], valid : [loss = 1.455, top1 = 63.58%], test : [loss = 1.445, top1 = 63.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 39.08%], valid : [loss = 2.574, top1 = 35.33%], test : [loss = 2.598, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.53%], valid : [loss = 0.883, top1 = 68.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9323/15625) 009323-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.16%], valid : [loss = 0.515, top1 = 86.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10        train : [loss = 0.093, top1 = 97.09%], test  : [loss = 0.345, top1 = 89.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.747, top1 = 78.39%], valid : [loss = 1.310, top1 = 65.10%], test : [loss = 1.309, top1 = 64.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.85%], valid : [loss = 2.557, top1 = 34.93%], test : [loss = 2.576, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.84%], valid : [loss = 0.915, top1 = 67.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9324/15625) 009324-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.491, top1 = 88.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.325, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.97 ms.
cifar100       train : [loss = 0.282, top1 = 92.56%], valid : [loss = 1.337, top1 = 66.40%], test : [loss = 1.368, top1 = 66.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.003, top1 = 47.53%], valid : [loss = 2.361, top1 = 39.90%], test : [loss = 2.380, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.51%], valid : [loss = 0.620, top1 = 78.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9325/15625) 009325-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.426, top1 = 90.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.295, top1 = 93.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.45 ms.
cifar100       train : [loss = 0.137, top1 = 97.23%], valid : [loss = 1.283, top1 = 69.54%], test : [loss = 1.299, top1 = 69.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 1.758, top1 = 53.21%], valid : [loss = 2.232, top1 = 44.03%], test : [loss = 2.269, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.443, top1 = 84.41%], valid : [loss = 0.557, top1 = 81.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9326/15625) 009326-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.76 ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.17%], valid : [loss = 0.758, top1 = 73.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.558, top1 = 80.54%], test  : [loss = 0.629, top1 = 78.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.37 ms.
cifar100       train : [loss = 1.931, top1 = 47.33%], valid : [loss = 2.035, top1 = 45.06%], test : [loss = 2.037, top1 = 44.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.33 ms.
ImageNet16-120 train : [loss = 3.083, top1 = 24.85%], valid : [loss = 3.087, top1 = 25.20%], test : [loss = 3.088, top1 = 25.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.135, top1 = 58.85%], valid : [loss = 1.182, top1 = 57.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9327/15625) 009327-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.45%], valid : [loss = 0.604, top1 = 85.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.067, top1 = 97.93%], test  : [loss = 0.409, top1 = 88.63%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.53 ms.
cifar100       train : [loss = 0.715, top1 = 79.26%], valid : [loss = 1.376, top1 = 62.64%], test : [loss = 1.391, top1 = 62.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.52%], valid : [loss = 2.662, top1 = 33.23%], test : [loss = 2.720, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 74.94%], valid : [loss = 0.769, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9328/15625) 009328-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.215, top1 = 92.76%], valid : [loss = 0.497, top1 = 84.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.19 ms.
cifar10        train : [loss = 0.230, top1 = 92.22%], test  : [loss = 0.393, top1 = 86.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.45 ms.
cifar100       train : [loss = 1.260, top1 = 64.42%], valid : [loss = 1.541, top1 = 57.54%], test : [loss = 1.559, top1 = 56.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 3.117, top1 = 24.15%], valid : [loss = 3.124, top1 = 24.53%], test : [loss = 3.149, top1 = 24.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9329/15625) 009329-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.30%], valid : [loss = 0.614, top1 = 85.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.067, top1 = 98.00%], test  : [loss = 0.398, top1 = 88.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.91 ms.
cifar100       train : [loss = 0.716, top1 = 79.15%], valid : [loss = 1.375, top1 = 63.29%], test : [loss = 1.373, top1 = 63.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.10%], valid : [loss = 2.662, top1 = 33.60%], test : [loss = 2.683, top1 = 33.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9330/15625) 009330-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.679, top1 = 86.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.429, top1 = 90.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.92 ms.
cifar100       train : [loss = 0.196, top1 = 95.28%], valid : [loss = 1.576, top1 = 64.64%], test : [loss = 1.546, top1 = 65.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.31%], valid : [loss = 2.509, top1 = 37.97%], test : [loss = 2.511, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.20%], valid : [loss = 0.797, top1 = 72.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9331/15625) 009331-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.82%], valid : [loss = 0.616, top1 = 80.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10        train : [loss = 0.270, top1 = 90.69%], test  : [loss = 0.418, top1 = 86.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.84 ms.
cifar100       train : [loss = 1.520, top1 = 57.27%], valid : [loss = 1.751, top1 = 52.12%], test : [loss = 1.756, top1 = 52.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.949, top1 = 27.75%], valid : [loss = 2.946, top1 = 28.00%], test : [loss = 2.987, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.004, top1 = 63.96%], valid : [loss = 1.073, top1 = 62.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9332/15625) 009332-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.22%], valid : [loss = 0.459, top1 = 86.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.114, top1 = 96.49%], test  : [loss = 0.329, top1 = 89.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.57 ms.
cifar100       train : [loss = 0.857, top1 = 75.56%], valid : [loss = 1.288, top1 = 64.39%], test : [loss = 1.280, top1 = 63.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.84%], valid : [loss = 2.623, top1 = 34.73%], test : [loss = 2.648, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.09%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9333/15625) 009333-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.547, top1 = 88.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.44 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.365, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.201, top1 = 95.35%], valid : [loss = 1.404, top1 = 66.71%], test : [loss = 1.418, top1 = 66.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.71%], valid : [loss = 2.423, top1 = 39.16%], test : [loss = 2.445, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.53%], valid : [loss = 0.714, top1 = 75.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9334/15625) 009334-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.26%], valid : [loss = 0.551, top1 = 86.72%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.10 ms.
cifar10        train : [loss = 0.058, top1 = 98.19%], test  : [loss = 0.358, top1 = 90.15%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.85 ms.
cifar100       train : [loss = 0.647, top1 = 81.29%], valid : [loss = 1.304, top1 = 64.06%], test : [loss = 1.318, top1 = 64.76%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.58%], valid : [loss = 2.506, top1 = 36.77%], test : [loss = 2.531, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.76%], valid : [loss = 0.727, top1 = 74.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9335/15625) 009335-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.578, top1 = 88.50%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.12 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.354, top1 = 92.25%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.45 ms.
cifar100       train : [loss = 0.177, top1 = 96.01%], valid : [loss = 1.440, top1 = 67.42%], test : [loss = 1.403, top1 = 67.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.93%], valid : [loss = 2.447, top1 = 38.63%], test : [loss = 2.462, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.27%], valid : [loss = 0.700, top1 = 75.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9336/15625) 009336-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.488, top1 = 89.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.39 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.311, top1 = 92.54%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.26 ms.
cifar100       train : [loss = 0.295, top1 = 92.13%], valid : [loss = 1.253, top1 = 68.16%], test : [loss = 1.260, top1 = 68.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.66 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.94%], valid : [loss = 2.212, top1 = 42.90%], test : [loss = 2.231, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9337/15625) 009337-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.432, top1 = 89.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.10 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.300, top1 = 92.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.65 ms.
cifar100       train : [loss = 0.222, top1 = 94.55%], valid : [loss = 1.280, top1 = 68.50%], test : [loss = 1.289, top1 = 69.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.05%], valid : [loss = 2.278, top1 = 42.23%], test : [loss = 2.323, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.18%], valid : [loss = 0.542, top1 = 81.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9338/15625) 009338-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.09%], valid : [loss = 0.609, top1 = 84.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.13 ms.
cifar10        train : [loss = 0.083, top1 = 97.21%], test  : [loss = 0.408, top1 = 88.63%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.98 ms.
cifar100       train : [loss = 0.649, top1 = 80.76%], valid : [loss = 1.509, top1 = 61.38%], test : [loss = 1.507, top1 = 61.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 3.144, top1 = 23.35%], valid : [loss = 3.174, top1 = 22.40%], test : [loss = 3.195, top1 = 22.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 62.89%], valid : [loss = 1.067, top1 = 61.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9339/15625) 009339-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.16%], valid : [loss = 0.557, top1 = 86.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10        train : [loss = 0.064, top1 = 97.98%], test  : [loss = 0.376, top1 = 89.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.99 ms.
cifar100       train : [loss = 0.682, top1 = 79.88%], valid : [loss = 1.319, top1 = 64.78%], test : [loss = 1.332, top1 = 63.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.99%], valid : [loss = 2.523, top1 = 36.44%], test : [loss = 2.548, top1 = 36.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9340/15625) 009340-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.553, top1 = 87.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.339, top1 = 91.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.17 ms.
cifar100       train : [loss = 0.416, top1 = 88.06%], valid : [loss = 1.268, top1 = 66.96%], test : [loss = 1.281, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.61%], valid : [loss = 2.347, top1 = 40.73%], test : [loss = 2.369, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9341/15625) 009341-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.545, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.343, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.08 ms.
cifar100       train : [loss = 0.316, top1 = 91.33%], valid : [loss = 1.305, top1 = 66.94%], test : [loss = 1.279, top1 = 67.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.76%], valid : [loss = 2.478, top1 = 37.43%], test : [loss = 2.448, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9342/15625) 009342-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.585, top1 = 87.30%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.36 ms.
cifar10        train : [loss = 0.016, top1 = 99.67%], test  : [loss = 0.423, top1 = 89.94%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.11 ms.
cifar100       train : [loss = 0.269, top1 = 93.10%], valid : [loss = 1.429, top1 = 66.28%], test : [loss = 1.421, top1 = 66.10%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=23.78 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 45.06%], valid : [loss = 2.487, top1 = 38.30%], test : [loss = 2.534, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.30%], valid : [loss = 0.773, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9343/15625) 009343-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.22%], valid : [loss = 0.671, top1 = 77.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.532, top1 = 81.57%], test  : [loss = 0.620, top1 = 78.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.95 ms.
cifar100       train : [loss = 1.727, top1 = 53.18%], valid : [loss = 1.884, top1 = 49.78%], test : [loss = 1.897, top1 = 50.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.19%], valid : [loss = 3.332, top1 = 22.00%], test : [loss = 3.353, top1 = 21.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 54.05%], valid : [loss = 1.298, top1 = 53.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9344/15625) 009344-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.40%], valid : [loss = 0.462, top1 = 86.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.86 ms.
cifar10        train : [loss = 0.153, top1 = 95.01%], test  : [loss = 0.335, top1 = 89.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.10 ms.
cifar100       train : [loss = 1.007, top1 = 71.44%], valid : [loss = 1.374, top1 = 61.80%], test : [loss = 1.366, top1 = 61.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.62%], valid : [loss = 2.697, top1 = 32.17%], test : [loss = 2.727, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9345/15625) 009345-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.547, top1 = 88.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.343, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.331, top1 = 90.88%], valid : [loss = 1.298, top1 = 66.84%], test : [loss = 1.330, top1 = 66.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.96%], valid : [loss = 2.447, top1 = 37.80%], test : [loss = 2.441, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9346/15625) 009346-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.48%], valid : [loss = 0.670, top1 = 82.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.159, top1 = 94.58%], test  : [loss = 0.478, top1 = 86.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.97 ms.
cifar100       train : [loss = 1.009, top1 = 70.79%], valid : [loss = 1.711, top1 = 56.10%], test : [loss = 1.690, top1 = 56.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 3.061, top1 = 25.33%], valid : [loss = 3.117, top1 = 24.63%], test : [loss = 3.185, top1 = 22.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 63.80%], valid : [loss = 1.026, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9347/15625) 009347-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.493, top1 = 83.04%], valid : [loss = 0.646, top1 = 78.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.529, top1 = 81.75%], test  : [loss = 0.592, top1 = 79.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.80 ms.
cifar100       train : [loss = 1.683, top1 = 54.37%], valid : [loss = 1.851, top1 = 50.46%], test : [loss = 1.875, top1 = 50.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 3.339, top1 = 21.03%], valid : [loss = 3.336, top1 = 21.20%], test : [loss = 3.346, top1 = 21.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.62%], valid : [loss = 1.304, top1 = 53.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9348/15625) 009348-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10-valid  train : [loss = 1.260, top1 = 54.69%], valid : [loss = 1.301, top1 = 53.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.58 ms.
cifar10        train : [loss = 1.145, top1 = 59.16%], test  : [loss = 1.172, top1 = 58.26%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.48 ms.
cifar100       train : [loss = 2.724, top1 = 31.82%], valid : [loss = 2.807, top1 = 30.12%], test : [loss = 2.796, top1 = 30.64%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.12 ms.
ImageNet16-120 train : [loss = 3.871, top1 = 12.39%], valid : [loss = 3.867, top1 = 12.63%], test : [loss = 3.893, top1 = 12.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.716, top1 = 35.27%], valid : [loss = 1.724, top1 = 34.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9349/15625) 009349-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.698, top1 = 86.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.473, top1 = 89.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.226, top1 = 94.58%], valid : [loss = 1.579, top1 = 64.36%], test : [loss = 1.579, top1 = 64.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.70%], valid : [loss = 2.696, top1 = 34.53%], test : [loss = 2.680, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.12%], valid : [loss = 0.794, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9350/15625) 009350-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.36%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.27 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.300, top1 = 93.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.70 ms.
cifar100       train : [loss = 0.122, top1 = 97.57%], valid : [loss = 1.304, top1 = 69.28%], test : [loss = 1.274, top1 = 69.76%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.53%], valid : [loss = 2.253, top1 = 42.67%], test : [loss = 2.240, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 76.07%], valid : [loss = 0.738, top1 = 74.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9351/15625) 009351-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.483, top1 = 89.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.323, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.41 ms.
cifar100       train : [loss = 0.325, top1 = 91.35%], valid : [loss = 1.266, top1 = 67.48%], test : [loss = 1.245, top1 = 67.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.78%], valid : [loss = 2.330, top1 = 40.40%], test : [loss = 2.357, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9352/15625) 009352-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.509, top1 = 88.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.022, top1 = 99.43%], test  : [loss = 0.329, top1 = 91.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.27 ms.
cifar100       train : [loss = 0.409, top1 = 88.11%], valid : [loss = 1.284, top1 = 67.32%], test : [loss = 1.304, top1 = 67.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.64%], valid : [loss = 2.419, top1 = 38.07%], test : [loss = 2.452, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.91%], valid : [loss = 0.624, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9353/15625) 009353-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.561, top1 = 87.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.360, top1 = 91.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.99 ms.
cifar100       train : [loss = 0.395, top1 = 88.82%], valid : [loss = 1.392, top1 = 65.63%], test : [loss = 1.395, top1 = 65.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.89%], valid : [loss = 2.461, top1 = 37.99%], test : [loss = 2.486, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.756, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9354/15625) 009354-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.506, top1 = 88.96%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.322, top1 = 92.51%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.76 ms.
cifar100       train : [loss = 0.146, top1 = 97.07%], valid : [loss = 1.294, top1 = 69.26%], test : [loss = 1.296, top1 = 69.06%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=24.77 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.54%], valid : [loss = 2.255, top1 = 42.23%], test : [loss = 2.303, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.00%], valid : [loss = 0.631, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9355/15625) 009355-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.82 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.52%], valid : [loss = 0.667, top1 = 82.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.26 ms.
cifar10        train : [loss = 0.156, top1 = 94.70%], test  : [loss = 0.445, top1 = 87.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.87 ms.
cifar100       train : [loss = 0.985, top1 = 71.78%], valid : [loss = 1.662, top1 = 56.22%], test : [loss = 1.641, top1 = 56.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 3.111, top1 = 24.14%], valid : [loss = 3.175, top1 = 23.97%], test : [loss = 3.191, top1 = 22.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.75%], valid : [loss = 1.018, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9356/15625) 009356-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.228, top1 = 92.26%], valid : [loss = 0.570, top1 = 82.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.209, top1 = 92.86%], test  : [loss = 0.402, top1 = 87.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 1.300, top1 = 63.27%], valid : [loss = 1.544, top1 = 57.08%], test : [loss = 1.566, top1 = 57.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 2.704, top1 = 32.47%], valid : [loss = 2.743, top1 = 31.90%], test : [loss = 2.765, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.76%], valid : [loss = 0.966, top1 = 65.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9357/15625) 009357-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.076, top1 = 98.07%], valid : [loss = 0.452, top1 = 86.93%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.115, top1 = 96.49%], test  : [loss = 0.312, top1 = 90.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.33 ms.
cifar100       train : [loss = 0.862, top1 = 75.29%], valid : [loss = 1.280, top1 = 64.00%], test : [loss = 1.275, top1 = 63.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.48%], valid : [loss = 2.618, top1 = 35.17%], test : [loss = 2.669, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.34%], valid : [loss = 0.640, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9358/15625) 009358-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.79%], valid : [loss = 0.522, top1 = 85.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.81 ms.
cifar10        train : [loss = 0.123, top1 = 95.96%], test  : [loss = 0.369, top1 = 89.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.92 ms.
cifar100       train : [loss = 0.780, top1 = 77.67%], valid : [loss = 1.356, top1 = 63.44%], test : [loss = 1.362, top1 = 63.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.511, top1 = 36.34%], valid : [loss = 2.586, top1 = 34.57%], test : [loss = 2.656, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.76%], valid : [loss = 0.944, top1 = 66.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9359/15625) 009359-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.64%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.91 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.323, top1 = 92.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.79 ms.
cifar100       train : [loss = 0.077, top1 = 98.74%], valid : [loss = 1.387, top1 = 68.84%], test : [loss = 1.345, top1 = 68.80%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.09%], valid : [loss = 2.452, top1 = 37.77%], test : [loss = 2.467, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9360/15625) 009360-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.574, top1 = 87.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10        train : [loss = 0.021, top1 = 99.41%], test  : [loss = 0.382, top1 = 91.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.251, top1 = 93.39%], valid : [loss = 1.289, top1 = 67.92%], test : [loss = 1.297, top1 = 67.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.36%], valid : [loss = 2.503, top1 = 36.73%], test : [loss = 2.498, top1 = 37.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.41%], valid : [loss = 0.896, top1 = 68.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9361/15625) 009361-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.522, top1 = 88.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.368, top1 = 90.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.32 ms.
cifar100       train : [loss = 0.396, top1 = 88.54%], valid : [loss = 1.358, top1 = 65.69%], test : [loss = 1.362, top1 = 65.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.94%], valid : [loss = 2.426, top1 = 38.25%], test : [loss = 2.457, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.43%], valid : [loss = 0.633, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9362/15625) 009362-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.47%], valid : [loss = 0.859, top1 = 79.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.128, top1 = 95.72%], test  : [loss = 0.548, top1 = 84.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.21 ms.
cifar100       train : [loss = 0.843, top1 = 75.45%], valid : [loss = 1.659, top1 = 57.64%], test : [loss = 1.662, top1 = 57.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 26.21%], valid : [loss = 3.175, top1 = 24.40%], test : [loss = 3.214, top1 = 23.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.15%], valid : [loss = 1.084, top1 = 61.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9363/15625) 009363-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.500, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.55 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.353, top1 = 91.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.13 ms.
cifar100       train : [loss = 0.179, top1 = 95.67%], valid : [loss = 1.425, top1 = 67.64%], test : [loss = 1.407, top1 = 67.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 47.36%], valid : [loss = 2.349, top1 = 40.17%], test : [loss = 2.389, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.27%], valid : [loss = 0.634, top1 = 78.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9364/15625) 009364-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.583, top1 = 88.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.358, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.08 ms.
cifar100       train : [loss = 0.149, top1 = 96.63%], valid : [loss = 1.359, top1 = 67.59%], test : [loss = 1.360, top1 = 68.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.03%], valid : [loss = 2.396, top1 = 38.78%], test : [loss = 2.392, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.16%], valid : [loss = 0.976, top1 = 65.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9365/15625) 009365-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.77%], valid : [loss = 0.522, top1 = 88.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.356, top1 = 91.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 0.473, top1 = 86.10%], valid : [loss = 1.345, top1 = 65.86%], test : [loss = 1.351, top1 = 65.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 39.98%], valid : [loss = 2.541, top1 = 35.62%], test : [loss = 2.560, top1 = 35.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.28%], valid : [loss = 0.679, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9366/15625) 009366-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.489, top1 = 89.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.302, top1 = 92.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.83 ms.
cifar100       train : [loss = 0.262, top1 = 93.15%], valid : [loss = 1.214, top1 = 68.90%], test : [loss = 1.234, top1 = 68.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.37%], valid : [loss = 2.219, top1 = 42.43%], test : [loss = 2.246, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9367/15625) 009367-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.556, top1 = 87.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.10 ms.
cifar10        train : [loss = 0.030, top1 = 99.21%], test  : [loss = 0.347, top1 = 91.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.99 ms.
cifar100       train : [loss = 0.480, top1 = 86.42%], valid : [loss = 1.314, top1 = 65.43%], test : [loss = 1.304, top1 = 65.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.21%], valid : [loss = 2.474, top1 = 37.22%], test : [loss = 2.461, top1 = 37.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.93%], valid : [loss = 0.819, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9368/15625) 009368-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.584, top1 = 88.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.391, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.35 ms.
cifar100       train : [loss = 0.110, top1 = 97.97%], valid : [loss = 1.422, top1 = 67.95%], test : [loss = 1.478, top1 = 66.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.67%], valid : [loss = 2.447, top1 = 38.95%], test : [loss = 2.426, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.44%], valid : [loss = 0.732, top1 = 74.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9369/15625) 009369-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.487, top1 = 89.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.322, top1 = 92.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 0.328, top1 = 91.17%], valid : [loss = 1.255, top1 = 67.31%], test : [loss = 1.251, top1 = 68.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.73%], valid : [loss = 2.309, top1 = 40.18%], test : [loss = 2.354, top1 = 40.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9370/15625) 009370-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.475, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.313, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.27 ms.
cifar100       train : [loss = 0.321, top1 = 91.30%], valid : [loss = 1.243, top1 = 67.99%], test : [loss = 1.239, top1 = 68.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.77%], valid : [loss = 2.322, top1 = 40.58%], test : [loss = 2.365, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.29%], valid : [loss = 0.617, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9371/15625) 009371-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.59%], valid : [loss = 0.447, top1 = 87.82%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.01 ms.
cifar10        train : [loss = 0.056, top1 = 98.65%], test  : [loss = 0.320, top1 = 90.44%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.15 ms.
cifar100       train : [loss = 0.548, top1 = 85.00%], valid : [loss = 1.201, top1 = 67.55%], test : [loss = 1.199, top1 = 67.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.89%], valid : [loss = 2.445, top1 = 37.83%], test : [loss = 2.468, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.93%], valid : [loss = 0.621, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9372/15625) 009372-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.506, top1 = 89.79%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.49 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.295, top1 = 93.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.18 ms.
cifar100       train : [loss = 0.144, top1 = 96.84%], valid : [loss = 1.268, top1 = 69.82%], test : [loss = 1.256, top1 = 70.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 1.744, top1 = 53.45%], valid : [loss = 2.161, top1 = 44.93%], test : [loss = 2.149, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.92%], valid : [loss = 0.679, top1 = 76.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9373/15625) 009373-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.265, top1 = 90.89%], valid : [loss = 0.856, top1 = 75.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.78 ms.
cifar10        train : [loss = 0.298, top1 = 89.69%], test  : [loss = 0.612, top1 = 81.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.06 ms.
cifar100       train : [loss = 1.306, top1 = 63.19%], valid : [loss = 1.870, top1 = 51.56%], test : [loss = 1.864, top1 = 51.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 3.498, top1 = 17.24%], valid : [loss = 3.520, top1 = 17.00%], test : [loss = 3.529, top1 = 16.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.30%], valid : [loss = 1.275, top1 = 53.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9374/15625) 009374-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.22%], valid : [loss = 0.599, top1 = 86.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10        train : [loss = 0.021, top1 = 99.38%], test  : [loss = 0.394, top1 = 90.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.21 ms.
cifar100       train : [loss = 0.401, top1 = 88.59%], valid : [loss = 1.486, top1 = 63.53%], test : [loss = 1.478, top1 = 62.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 3.026, top1 = 24.96%], valid : [loss = 3.074, top1 = 24.20%], test : [loss = 3.073, top1 = 24.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.21%], valid : [loss = 1.221, top1 = 55.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9375/15625) 009375-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.528, top1 = 89.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.97 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.316, top1 = 92.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.83 ms.
cifar100       train : [loss = 0.145, top1 = 97.06%], valid : [loss = 1.291, top1 = 69.34%], test : [loss = 1.284, top1 = 69.15%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.85%], valid : [loss = 2.301, top1 = 42.28%], test : [loss = 2.297, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.28%], valid : [loss = 0.695, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9376/15625) 009376-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.53%], valid : [loss = 0.590, top1 = 86.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10        train : [loss = 0.042, top1 = 98.73%], test  : [loss = 0.383, top1 = 90.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.99 ms.
cifar100       train : [loss = 0.556, top1 = 83.68%], valid : [loss = 1.396, top1 = 64.40%], test : [loss = 1.409, top1 = 63.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.07%], valid : [loss = 2.633, top1 = 34.28%], test : [loss = 2.652, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.23%], valid : [loss = 0.754, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9377/15625) 009377-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.04%], valid : [loss = 0.873, top1 = 71.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10        train : [loss = 0.552, top1 = 80.72%], test  : [loss = 0.715, top1 = 75.72%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 1.776, top1 = 52.12%], valid : [loss = 2.049, top1 = 46.73%], test : [loss = 2.061, top1 = 46.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.87%], valid : [loss = 3.620, top1 = 16.90%], test : [loss = 3.667, top1 = 15.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9378/15625) 009378-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.221, top1 = 92.46%], valid : [loss = 0.551, top1 = 83.33%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=14.55 ms.
cifar10        train : [loss = 0.208, top1 = 92.94%], test  : [loss = 0.400, top1 = 87.35%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=13.33 ms.
cifar100       train : [loss = 1.258, top1 = 64.26%], valid : [loss = 1.568, top1 = 57.16%], test : [loss = 1.559, top1 = 57.61%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.702, top1 = 32.59%], valid : [loss = 2.730, top1 = 32.24%], test : [loss = 2.763, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.06%], valid : [loss = 1.020, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9379/15625) 009379-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.014, top1 = 99.77%], test  : [loss = 0.318, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.90 ms.
cifar100       train : [loss = 0.330, top1 = 91.03%], valid : [loss = 1.289, top1 = 67.21%], test : [loss = 1.285, top1 = 67.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.21%], valid : [loss = 2.377, top1 = 39.62%], test : [loss = 2.401, top1 = 39.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.474, top1 = 83.66%], valid : [loss = 0.561, top1 = 81.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9380/15625) 009380-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.20%], valid : [loss = 0.460, top1 = 86.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.154, top1 = 95.06%], test  : [loss = 0.336, top1 = 89.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 0.985, top1 = 71.93%], valid : [loss = 1.348, top1 = 62.38%], test : [loss = 1.343, top1 = 62.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.80%], valid : [loss = 2.681, top1 = 33.12%], test : [loss = 2.704, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9381/15625) 009381-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.548, top1 = 88.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.341, top1 = 91.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.01 ms.
cifar100       train : [loss = 0.293, top1 = 92.04%], valid : [loss = 1.295, top1 = 67.65%], test : [loss = 1.309, top1 = 67.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.52%], valid : [loss = 2.404, top1 = 39.13%], test : [loss = 2.400, top1 = 39.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.06%], valid : [loss = 0.857, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9382/15625) 009382-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.58%], valid : [loss = 0.746, top1 = 81.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.118, top1 = 96.15%], test  : [loss = 0.476, top1 = 86.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 0.934, top1 = 72.93%], valid : [loss = 1.624, top1 = 57.61%], test : [loss = 1.561, top1 = 58.93%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.54 ms.
ImageNet16-120 train : [loss = 2.866, top1 = 29.41%], valid : [loss = 2.961, top1 = 27.48%], test : [loss = 3.007, top1 = 26.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.76%], valid : [loss = 0.953, top1 = 66.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9383/15625) 009383-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.98%], valid : [loss = 0.474, top1 = 84.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.301, top1 = 89.94%], test  : [loss = 0.402, top1 = 86.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 1.338, top1 = 62.98%], valid : [loss = 1.536, top1 = 58.52%], test : [loss = 1.509, top1 = 58.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.64%], valid : [loss = 2.913, top1 = 29.32%], test : [loss = 2.939, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9384/15625) 009384-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.605, top1 = 86.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.026, top1 = 99.30%], test  : [loss = 0.384, top1 = 90.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.503, top1 = 85.38%], valid : [loss = 1.417, top1 = 63.65%], test : [loss = 1.412, top1 = 64.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.88%], valid : [loss = 2.544, top1 = 35.73%], test : [loss = 2.560, top1 = 35.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.77%], valid : [loss = 0.825, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9385/15625) 009385-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.476, top1 = 89.71%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.70 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.298, top1 = 92.71%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.41 ms.
cifar100       train : [loss = 0.214, top1 = 94.66%], valid : [loss = 1.245, top1 = 68.89%], test : [loss = 1.257, top1 = 69.18%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.59%], valid : [loss = 2.167, top1 = 44.33%], test : [loss = 2.205, top1 = 42.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.60%], valid : [loss = 0.615, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9386/15625) 009386-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.12%], valid : [loss = 0.460, top1 = 86.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.70 ms.
cifar10        train : [loss = 0.159, top1 = 94.77%], test  : [loss = 0.352, top1 = 88.69%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.18 ms.
cifar100       train : [loss = 0.994, top1 = 71.76%], valid : [loss = 1.362, top1 = 61.78%], test : [loss = 1.361, top1 = 61.82%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.86%], valid : [loss = 2.698, top1 = 32.22%], test : [loss = 2.691, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9387/15625) 009387-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.505, top1 = 89.44%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.57 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.323, top1 = 92.80%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.51 ms.
cifar100       train : [loss = 0.152, top1 = 96.81%], valid : [loss = 1.260, top1 = 69.66%], test : [loss = 1.307, top1 = 69.40%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.76%], valid : [loss = 2.296, top1 = 41.37%], test : [loss = 2.300, top1 = 41.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.74%], valid : [loss = 0.695, top1 = 75.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9388/15625) 009388-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.594, top1 = 87.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.381, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.65 ms.
cifar100       train : [loss = 0.409, top1 = 88.40%], valid : [loss = 1.425, top1 = 65.08%], test : [loss = 1.407, top1 = 65.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.20%], valid : [loss = 2.494, top1 = 37.57%], test : [loss = 2.520, top1 = 36.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.53%], valid : [loss = 0.827, top1 = 70.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9389/15625) 009389-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.529, top1 = 89.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.346, top1 = 92.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.22 ms.
cifar100       train : [loss = 0.081, top1 = 98.71%], valid : [loss = 1.437, top1 = 68.40%], test : [loss = 1.459, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.35%], valid : [loss = 2.336, top1 = 41.84%], test : [loss = 2.373, top1 = 41.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.15%], valid : [loss = 0.671, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9390/15625) 009390-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.488, top1 = 89.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.309, top1 = 92.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.93 ms.
cifar100       train : [loss = 0.243, top1 = 93.92%], valid : [loss = 1.255, top1 = 67.96%], test : [loss = 1.249, top1 = 68.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 1.959, top1 = 48.47%], valid : [loss = 2.268, top1 = 41.60%], test : [loss = 2.302, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.95%], valid : [loss = 0.641, top1 = 78.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9391/15625) 009391-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.552, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.353, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.27 ms.
cifar100       train : [loss = 0.161, top1 = 96.36%], valid : [loss = 1.320, top1 = 68.29%], test : [loss = 1.312, top1 = 69.03%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 1.955, top1 = 48.56%], valid : [loss = 2.319, top1 = 40.92%], test : [loss = 2.328, top1 = 40.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.41%], valid : [loss = 0.739, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9392/15625) 009392-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.26%], valid : [loss = 0.621, top1 = 85.31%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.074, top1 = 97.69%], test  : [loss = 0.375, top1 = 89.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.12 ms.
cifar100       train : [loss = 0.721, top1 = 79.04%], valid : [loss = 1.380, top1 = 62.97%], test : [loss = 1.371, top1 = 63.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.57%], valid : [loss = 2.671, top1 = 33.80%], test : [loss = 2.698, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.75%], valid : [loss = 0.799, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9393/15625) 009393-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.51%], valid : [loss = 0.578, top1 = 86.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.21 ms.
cifar10        train : [loss = 0.045, top1 = 98.64%], test  : [loss = 0.386, top1 = 90.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.574, top1 = 83.06%], valid : [loss = 1.411, top1 = 63.42%], test : [loss = 1.400, top1 = 64.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.55%], valid : [loss = 2.617, top1 = 34.55%], test : [loss = 2.666, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.09%], valid : [loss = 0.738, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9394/15625) 009394-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.07%], valid : [loss = 0.482, top1 = 84.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.298, top1 = 90.05%], test  : [loss = 0.397, top1 = 86.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 1.340, top1 = 62.84%], valid : [loss = 1.548, top1 = 57.73%], test : [loss = 1.526, top1 = 58.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.75%], valid : [loss = 2.904, top1 = 29.87%], test : [loss = 2.955, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9395/15625) 009395-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.80%], valid : [loss = 0.505, top1 = 88.06%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.97 ms.
cifar10        train : [loss = 0.030, top1 = 99.26%], test  : [loss = 0.352, top1 = 90.81%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.88 ms.
cifar100       train : [loss = 0.402, top1 = 88.58%], valid : [loss = 1.306, top1 = 66.81%], test : [loss = 1.281, top1 = 67.36%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.60%], valid : [loss = 2.372, top1 = 40.00%], test : [loss = 2.419, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.18%], valid : [loss = 0.625, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9396/15625) 009396-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.95%], valid : [loss = 0.749, top1 = 82.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10        train : [loss = 0.082, top1 = 97.33%], test  : [loss = 0.482, top1 = 87.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.86 ms.
cifar100       train : [loss = 0.763, top1 = 77.81%], valid : [loss = 1.531, top1 = 60.11%], test : [loss = 1.492, top1 = 60.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.766, top1 = 31.32%], valid : [loss = 2.886, top1 = 29.37%], test : [loss = 2.942, top1 = 28.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.64%], valid : [loss = 0.906, top1 = 68.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9397/15625) 009397-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.67%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.10 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.356, top1 = 92.66%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.58 ms.
cifar100       train : [loss = 0.085, top1 = 98.67%], valid : [loss = 1.435, top1 = 68.41%], test : [loss = 1.407, top1 = 69.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.72%], valid : [loss = 2.384, top1 = 41.08%], test : [loss = 2.385, top1 = 41.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.41%], valid : [loss = 0.665, top1 = 76.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9398/15625) 009398-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.65%], valid : [loss = 0.615, top1 = 84.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=17.06 ms.
cifar10        train : [loss = 0.083, top1 = 97.27%], test  : [loss = 0.420, top1 = 88.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.87 ms.
cifar100       train : [loss = 0.692, top1 = 79.52%], valid : [loss = 1.527, top1 = 59.98%], test : [loss = 1.544, top1 = 60.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 3.188, top1 = 22.19%], valid : [loss = 3.195, top1 = 22.20%], test : [loss = 3.227, top1 = 21.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.061, top1 = 61.75%], valid : [loss = 1.088, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9399/15625) 009399-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.510, top1 = 88.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.319, top1 = 92.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.78 ms.
cifar100       train : [loss = 0.321, top1 = 91.36%], valid : [loss = 1.270, top1 = 67.38%], test : [loss = 1.285, top1 = 67.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.97%], valid : [loss = 2.393, top1 = 38.97%], test : [loss = 2.410, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9400/15625) 009400-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.96%], valid : [loss = 0.746, top1 = 74.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.43 ms.
cifar10        train : [loss = 0.548, top1 = 81.03%], test  : [loss = 0.605, top1 = 79.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.70 ms.
cifar100       train : [loss = 2.170, top1 = 41.91%], valid : [loss = 2.268, top1 = 40.59%], test : [loss = 2.260, top1 = 41.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 3.262, top1 = 21.60%], valid : [loss = 3.218, top1 = 22.28%], test : [loss = 3.273, top1 = 21.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.173, top1 = 57.81%], valid : [loss = 1.222, top1 = 56.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9401/15625) 009401-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.590, top1 = 85.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.069, top1 = 97.95%], test  : [loss = 0.405, top1 = 88.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.74 ms.
cifar100       train : [loss = 0.718, top1 = 79.10%], valid : [loss = 1.392, top1 = 62.89%], test : [loss = 1.382, top1 = 63.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.94%], valid : [loss = 2.663, top1 = 33.12%], test : [loss = 2.685, top1 = 33.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9402/15625) 009402-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.58%], valid : [loss = 0.648, top1 = 83.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10        train : [loss = 0.147, top1 = 95.00%], test  : [loss = 0.458, top1 = 86.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.65 ms.
cifar100       train : [loss = 0.941, top1 = 72.73%], valid : [loss = 1.647, top1 = 57.04%], test : [loss = 1.623, top1 = 57.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 3.027, top1 = 25.83%], valid : [loss = 3.112, top1 = 25.07%], test : [loss = 3.128, top1 = 24.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.36%], valid : [loss = 0.982, top1 = 65.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9403/15625) 009403-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.19%], valid : [loss = 0.564, top1 = 86.80%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.64 ms.
cifar10        train : [loss = 0.062, top1 = 97.97%], test  : [loss = 0.356, top1 = 90.23%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.17 ms.
cifar100       train : [loss = 0.634, top1 = 81.38%], valid : [loss = 1.301, top1 = 65.38%], test : [loss = 1.300, top1 = 65.21%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.17 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.77%], valid : [loss = 2.475, top1 = 37.45%], test : [loss = 2.511, top1 = 36.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.58%], valid : [loss = 0.832, top1 = 70.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9404/15625) 009404-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.322, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.69 ms.
cifar100       train : [loss = 0.279, top1 = 92.58%], valid : [loss = 1.262, top1 = 67.62%], test : [loss = 1.271, top1 = 67.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.997, top1 = 47.61%], valid : [loss = 2.305, top1 = 40.77%], test : [loss = 2.329, top1 = 40.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.81%], valid : [loss = 0.703, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9405/15625) 009405-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.13%], valid : [loss = 0.858, top1 = 71.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.31 ms.
cifar10        train : [loss = 0.560, top1 = 80.46%], test  : [loss = 0.722, top1 = 75.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.75 ms.
cifar100       train : [loss = 1.787, top1 = 51.84%], valid : [loss = 2.053, top1 = 47.05%], test : [loss = 2.081, top1 = 45.89%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.76%], valid : [loss = 3.633, top1 = 16.46%], test : [loss = 3.659, top1 = 15.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9406/15625) 009406-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.94%], valid : [loss = 0.843, top1 = 72.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.24 ms.
cifar10        train : [loss = 0.558, top1 = 80.50%], test  : [loss = 0.711, top1 = 75.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.24 ms.
cifar100       train : [loss = 1.783, top1 = 52.03%], valid : [loss = 2.052, top1 = 46.97%], test : [loss = 2.062, top1 = 46.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.79%], valid : [loss = 3.641, top1 = 16.48%], test : [loss = 3.666, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9407/15625) 009407-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.640, top1 = 86.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.418, top1 = 90.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.88 ms.
cifar100       train : [loss = 0.196, top1 = 95.50%], valid : [loss = 1.517, top1 = 65.82%], test : [loss = 1.471, top1 = 66.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.88%], valid : [loss = 2.519, top1 = 37.30%], test : [loss = 2.525, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.94%], valid : [loss = 0.763, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9408/15625) 009408-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.500, top1 = 88.83%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.22%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.11 ms.
cifar100       train : [loss = 0.344, top1 = 90.60%], valid : [loss = 1.281, top1 = 67.05%], test : [loss = 1.290, top1 = 67.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.92%], valid : [loss = 2.412, top1 = 39.25%], test : [loss = 2.413, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9409/15625) 009409-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.209, top1 = 93.03%], valid : [loss = 0.487, top1 = 84.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10        train : [loss = 0.195, top1 = 93.44%], test  : [loss = 0.372, top1 = 88.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.83 ms.
cifar100       train : [loss = 1.119, top1 = 67.91%], valid : [loss = 1.469, top1 = 59.80%], test : [loss = 1.447, top1 = 59.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.95%], valid : [loss = 2.664, top1 = 33.40%], test : [loss = 2.697, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.69%], valid : [loss = 0.973, top1 = 65.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9410/15625) 009410-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.620, top1 = 87.08%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.11 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.404, top1 = 91.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.73 ms.
cifar100       train : [loss = 0.188, top1 = 95.72%], valid : [loss = 1.516, top1 = 65.39%], test : [loss = 1.517, top1 = 65.72%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.71%], valid : [loss = 2.463, top1 = 38.43%], test : [loss = 2.468, top1 = 38.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.74%], valid : [loss = 0.796, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9411/15625) 009411-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.544, top1 = 88.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.343, top1 = 92.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.307, top1 = 91.64%], valid : [loss = 1.313, top1 = 67.37%], test : [loss = 1.320, top1 = 66.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 44.06%], valid : [loss = 2.410, top1 = 38.77%], test : [loss = 2.432, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9412/15625) 009412-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.64%], valid : [loss = 0.866, top1 = 77.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.225, top1 = 92.27%], test  : [loss = 0.583, top1 = 82.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.37 ms.
cifar100       train : [loss = 1.174, top1 = 66.73%], valid : [loss = 1.802, top1 = 53.25%], test : [loss = 1.779, top1 = 54.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.74%], valid : [loss = 3.328, top1 = 21.63%], test : [loss = 3.369, top1 = 20.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 62.89%], valid : [loss = 1.077, top1 = 62.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9413/15625) 009413-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.27%], valid : [loss = 0.463, top1 = 86.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.113, top1 = 96.49%], test  : [loss = 0.332, top1 = 89.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.01 ms.
cifar100       train : [loss = 0.868, top1 = 75.25%], valid : [loss = 1.303, top1 = 63.91%], test : [loss = 1.297, top1 = 63.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.58%], valid : [loss = 2.638, top1 = 34.00%], test : [loss = 2.675, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9414/15625) 009414-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.555, top1 = 87.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.381, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 0.385, top1 = 89.16%], valid : [loss = 1.389, top1 = 65.81%], test : [loss = 1.408, top1 = 65.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.95%], valid : [loss = 2.468, top1 = 38.13%], test : [loss = 2.491, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.01%], valid : [loss = 0.768, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9415/15625) 009415-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.20 ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.36%], valid : [loss = 0.530, top1 = 82.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.09 ms.
cifar10        train : [loss = 0.401, top1 = 86.31%], test  : [loss = 0.469, top1 = 84.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.11 ms.
cifar100       train : [loss = 1.543, top1 = 57.61%], valid : [loss = 1.663, top1 = 54.63%], test : [loss = 1.652, top1 = 54.43%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.74 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.34%], valid : [loss = 3.020, top1 = 26.97%], test : [loss = 3.058, top1 = 25.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9416/15625) 009416-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9417/15625) 009417-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.58%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.11 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.343, top1 = 92.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.44 ms.
cifar100       train : [loss = 0.083, top1 = 98.59%], valid : [loss = 1.372, top1 = 68.98%], test : [loss = 1.376, top1 = 69.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.00%], valid : [loss = 2.296, top1 = 41.58%], test : [loss = 2.276, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 81.09%], valid : [loss = 0.614, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9418/15625) 009418-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.63%], valid : [loss = 0.613, top1 = 84.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.97 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.411, top1 = 88.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.19 ms.
cifar100       train : [loss = 0.666, top1 = 80.21%], valid : [loss = 1.500, top1 = 60.83%], test : [loss = 1.494, top1 = 61.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 3.166, top1 = 22.59%], valid : [loss = 3.177, top1 = 22.18%], test : [loss = 3.207, top1 = 22.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.061, top1 = 61.75%], valid : [loss = 1.088, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9419/15625) 009419-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.85%], valid : [loss = 0.962, top1 = 67.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.806, top1 = 71.61%], test  : [loss = 0.888, top1 = 68.85%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.18 ms.
cifar100       train : [loss = 2.125, top1 = 44.10%], valid : [loss = 2.297, top1 = 40.49%], test : [loss = 2.320, top1 = 41.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.23%], valid : [loss = 3.774, top1 = 14.12%], test : [loss = 3.776, top1 = 13.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9420/15625) 009420-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.141, top1 = 95.40%], valid : [loss = 0.839, top1 = 77.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10        train : [loss = 0.188, top1 = 93.47%], test  : [loss = 0.523, top1 = 84.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.85 ms.
cifar100       train : [loss = 1.100, top1 = 68.29%], valid : [loss = 1.740, top1 = 54.39%], test : [loss = 1.716, top1 = 55.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.870, top1 = 29.19%], valid : [loss = 2.991, top1 = 27.00%], test : [loss = 3.027, top1 = 26.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.98%], valid : [loss = 0.987, top1 = 65.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9421/15625) 009421-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.33%], valid : [loss = 0.618, top1 = 86.16%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.23 ms.
cifar10        train : [loss = 0.032, top1 = 99.11%], test  : [loss = 0.368, top1 = 90.91%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.04 ms.
cifar100       train : [loss = 0.582, top1 = 83.19%], valid : [loss = 1.412, top1 = 62.98%], test : [loss = 1.389, top1 = 63.50%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 2.427, top1 = 37.99%], valid : [loss = 2.534, top1 = 35.80%], test : [loss = 2.542, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 67.44%], valid : [loss = 0.940, top1 = 66.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9422/15625) 009422-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.32%], valid : [loss = 0.637, top1 = 85.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.399, top1 = 89.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 0.591, top1 = 82.69%], valid : [loss = 1.409, top1 = 63.94%], test : [loss = 1.381, top1 = 64.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.84%], valid : [loss = 2.635, top1 = 34.28%], test : [loss = 2.673, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.40%], valid : [loss = 0.959, top1 = 66.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9423/15625) 009423-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.91%], valid : [loss = 0.520, top1 = 82.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10        train : [loss = 0.402, top1 = 86.35%], test  : [loss = 0.466, top1 = 84.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.84 ms.
cifar100       train : [loss = 1.531, top1 = 57.68%], valid : [loss = 1.657, top1 = 54.34%], test : [loss = 1.657, top1 = 54.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.59 ms.
ImageNet16-120 train : [loss = 3.042, top1 = 26.33%], valid : [loss = 3.012, top1 = 27.30%], test : [loss = 3.046, top1 = 26.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.78%], valid : [loss = 1.138, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9424/15625) 009424-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.51%], valid : [loss = 0.581, top1 = 87.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10        train : [loss = 0.037, top1 = 98.85%], test  : [loss = 0.385, top1 = 90.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.77 ms.
cifar100       train : [loss = 0.485, top1 = 85.97%], valid : [loss = 1.402, top1 = 64.01%], test : [loss = 1.396, top1 = 63.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.571, top1 = 34.63%], valid : [loss = 2.652, top1 = 32.40%], test : [loss = 2.677, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.029, top1 = 62.74%], valid : [loss = 1.044, top1 = 62.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9425/15625) 009425-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.17%], valid : [loss = 0.477, top1 = 84.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.299, top1 = 90.10%], test  : [loss = 0.399, top1 = 86.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 1.320, top1 = 63.46%], valid : [loss = 1.514, top1 = 57.97%], test : [loss = 1.511, top1 = 58.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.69%], valid : [loss = 2.912, top1 = 28.82%], test : [loss = 2.961, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9426/15625) 009426-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.564, top1 = 87.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.392, top1 = 91.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.02 ms.
cifar100       train : [loss = 0.396, top1 = 88.76%], valid : [loss = 1.424, top1 = 64.95%], test : [loss = 1.375, top1 = 65.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.95%], valid : [loss = 2.496, top1 = 36.55%], test : [loss = 2.531, top1 = 36.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9427/15625) 009427-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.487, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.319, top1 = 92.45%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.96 ms.
cifar100       train : [loss = 0.162, top1 = 96.42%], valid : [loss = 1.311, top1 = 68.34%], test : [loss = 1.324, top1 = 68.77%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.09%], valid : [loss = 2.234, top1 = 42.61%], test : [loss = 2.232, top1 = 43.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.24%], valid : [loss = 0.600, top1 = 79.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9428/15625) 009428-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.463, top1 = 90.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.323, top1 = 93.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.49 ms.
cifar100       train : [loss = 0.087, top1 = 98.42%], valid : [loss = 1.385, top1 = 69.47%], test : [loss = 1.406, top1 = 69.05%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.53%], valid : [loss = 2.278, top1 = 43.81%], test : [loss = 2.323, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.37%], valid : [loss = 0.583, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9429/15625) 009429-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.477, top1 = 89.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.44 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.313, top1 = 92.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.162, top1 = 96.15%], valid : [loss = 1.387, top1 = 68.41%], test : [loss = 1.370, top1 = 67.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.65%], valid : [loss = 2.244, top1 = 42.75%], test : [loss = 2.276, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.419, top1 = 85.53%], valid : [loss = 0.522, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9430/15625) 009430-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.570, top1 = 87.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.371, top1 = 91.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 0.398, top1 = 88.78%], valid : [loss = 1.366, top1 = 65.51%], test : [loss = 1.355, top1 = 66.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.77%], valid : [loss = 2.506, top1 = 36.93%], test : [loss = 2.534, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.93%], valid : [loss = 0.780, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9431/15625) 009431-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.99%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.10 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.284, top1 = 93.85%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.77 ms.
cifar100       train : [loss = 0.033, top1 = 99.64%], valid : [loss = 1.386, top1 = 70.69%], test : [loss = 1.353, top1 = 71.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.47 ms.
ImageNet16-120 train : [loss = 1.405, top1 = 61.71%], valid : [loss = 2.232, top1 = 44.35%], test : [loss = 2.265, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.34%], valid : [loss = 0.534, top1 = 82.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9432/15625) 009432-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.568, top1 = 87.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.370, top1 = 91.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 0.402, top1 = 88.58%], valid : [loss = 1.360, top1 = 65.45%], test : [loss = 1.357, top1 = 65.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.49%], valid : [loss = 2.529, top1 = 36.37%], test : [loss = 2.551, top1 = 36.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.93%], valid : [loss = 0.780, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9433/15625) 009433-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.573, top1 = 87.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.391, top1 = 90.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.07 ms.
cifar100       train : [loss = 0.398, top1 = 88.67%], valid : [loss = 1.378, top1 = 65.51%], test : [loss = 1.377, top1 = 65.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.07%], valid : [loss = 2.486, top1 = 37.48%], test : [loss = 2.510, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.63%], valid : [loss = 0.829, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9434/15625) 009434-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.70%], valid : [loss = 0.647, top1 = 84.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10        train : [loss = 0.088, top1 = 97.11%], test  : [loss = 0.400, top1 = 88.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.82 ms.
cifar100       train : [loss = 0.766, top1 = 77.61%], valid : [loss = 1.419, top1 = 62.36%], test : [loss = 1.414, top1 = 62.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.19%], valid : [loss = 2.747, top1 = 32.27%], test : [loss = 2.776, top1 = 31.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.42%], valid : [loss = 0.844, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9435/15625) 009435-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.38%], valid : [loss = 0.543, top1 = 85.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10        train : [loss = 0.089, top1 = 97.23%], test  : [loss = 0.357, top1 = 89.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.73 ms.
cifar100       train : [loss = 0.666, top1 = 80.90%], valid : [loss = 1.335, top1 = 64.52%], test : [loss = 1.313, top1 = 64.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.18%], valid : [loss = 2.515, top1 = 36.42%], test : [loss = 2.516, top1 = 37.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.61%], valid : [loss = 0.911, top1 = 68.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9436/15625) 009436-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.79%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=19.69 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.327, top1 = 93.28%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=22.02 ms.
cifar100       train : [loss = 0.067, top1 = 98.99%], valid : [loss = 1.371, top1 = 69.27%], test : [loss = 1.331, top1 = 70.23%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=21.82 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.11%], valid : [loss = 2.334, top1 = 40.53%], test : [loss = 2.305, top1 = 41.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.87%], valid : [loss = 0.702, top1 = 75.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9437/15625) 009437-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.07 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.83 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9438/15625) 009438-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.12 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9439/15625) 009439-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.580, top1 = 87.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.35 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.393, top1 = 91.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.29 ms.
cifar100       train : [loss = 0.196, top1 = 95.44%], valid : [loss = 1.464, top1 = 66.33%], test : [loss = 1.433, top1 = 66.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.44%], valid : [loss = 2.429, top1 = 39.05%], test : [loss = 2.467, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.98%], valid : [loss = 0.690, top1 = 76.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9440/15625) 009440-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.17 ms.
cifar10-valid  train : [loss = 0.320, top1 = 89.06%], valid : [loss = 0.562, top1 = 81.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10        train : [loss = 0.283, top1 = 90.16%], test  : [loss = 0.441, top1 = 85.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.16 ms.
cifar100       train : [loss = 1.502, top1 = 57.94%], valid : [loss = 1.743, top1 = 52.55%], test : [loss = 1.739, top1 = 52.74%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.938, top1 = 27.86%], valid : [loss = 2.971, top1 = 27.85%], test : [loss = 3.006, top1 = 26.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.73%], valid : [loss = 1.070, top1 = 62.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9441/15625) 009441-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.466, top1 = 89.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.42 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.303, top1 = 92.82%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.70 ms.
cifar100       train : [loss = 0.249, top1 = 93.56%], valid : [loss = 1.228, top1 = 68.86%], test : [loss = 1.217, top1 = 69.77%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.18%], valid : [loss = 2.215, top1 = 42.65%], test : [loss = 2.228, top1 = 42.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.609, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9442/15625) 009442-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.517, top1 = 89.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.59 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.318, top1 = 92.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.85 ms.
cifar100       train : [loss = 0.118, top1 = 97.82%], valid : [loss = 1.282, top1 = 69.28%], test : [loss = 1.269, top1 = 69.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.55%], valid : [loss = 2.187, top1 = 43.53%], test : [loss = 2.187, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.61%], valid : [loss = 0.668, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9443/15625) 009443-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.325, top1 = 93.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.111, top1 = 97.91%], valid : [loss = 1.274, top1 = 70.21%], test : [loss = 1.289, top1 = 70.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.704, top1 = 54.33%], valid : [loss = 2.182, top1 = 43.80%], test : [loss = 2.203, top1 = 44.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9444/15625) 009444-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.35%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=16.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.322, top1 = 91.99%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=15.18 ms.
cifar100       train : [loss = 0.336, top1 = 90.79%], valid : [loss = 1.286, top1 = 67.45%], test : [loss = 1.292, top1 = 67.23%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.04%], valid : [loss = 2.366, top1 = 40.01%], test : [loss = 2.382, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.64%], valid : [loss = 0.571, top1 = 80.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9445/15625) 009445-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.27%], valid : [loss = 0.553, top1 = 87.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.061, top1 = 98.03%], test  : [loss = 0.360, top1 = 89.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 0.669, top1 = 80.35%], valid : [loss = 1.339, top1 = 64.41%], test : [loss = 1.320, top1 = 64.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.21%], valid : [loss = 2.527, top1 = 36.15%], test : [loss = 2.540, top1 = 36.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9446/15625) 009446-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.461, top1 = 89.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.323, top1 = 91.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.43 ms.
cifar100       train : [loss = 0.326, top1 = 91.25%], valid : [loss = 1.299, top1 = 66.88%], test : [loss = 1.326, top1 = 66.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.36%], valid : [loss = 2.349, top1 = 40.08%], test : [loss = 2.402, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9447/15625) 009447-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.49%], valid : [loss = 0.937, top1 = 77.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.170, top1 = 94.23%], test  : [loss = 0.568, top1 = 83.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.68 ms.
cifar100       train : [loss = 0.961, top1 = 72.24%], valid : [loss = 1.743, top1 = 55.80%], test : [loss = 1.742, top1 = 55.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 3.111, top1 = 25.02%], valid : [loss = 3.244, top1 = 22.42%], test : [loss = 3.282, top1 = 22.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.101, top1 = 59.94%], valid : [loss = 1.160, top1 = 58.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9448/15625) 009448-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.519, top1 = 89.38%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.36 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.332, top1 = 92.76%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.10 ms.
cifar100       train : [loss = 0.108, top1 = 98.10%], valid : [loss = 1.306, top1 = 69.49%], test : [loss = 1.304, top1 = 69.25%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.81%], valid : [loss = 2.286, top1 = 41.88%], test : [loss = 2.258, top1 = 43.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.97%], valid : [loss = 0.708, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9449/15625) 009449-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.624, top1 = 85.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.70 ms.
cifar10        train : [loss = 0.064, top1 = 98.05%], test  : [loss = 0.420, top1 = 88.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.91 ms.
cifar100       train : [loss = 0.681, top1 = 80.16%], valid : [loss = 1.411, top1 = 62.77%], test : [loss = 1.387, top1 = 63.39%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.77%], valid : [loss = 2.660, top1 = 33.60%], test : [loss = 2.719, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.96%], valid : [loss = 0.832, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9450/15625) 009450-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.599, top1 = 87.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.405, top1 = 91.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 0.202, top1 = 95.34%], valid : [loss = 1.458, top1 = 66.19%], test : [loss = 1.441, top1 = 66.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.29%], valid : [loss = 2.515, top1 = 37.10%], test : [loss = 2.521, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.50%], valid : [loss = 0.737, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9451/15625) 009451-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.511, top1 = 89.90%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.327, top1 = 93.34%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.50 ms.
cifar100       train : [loss = 0.043, top1 = 99.59%], valid : [loss = 1.340, top1 = 70.51%], test : [loss = 1.344, top1 = 70.49%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.46 ms.
ImageNet16-120 train : [loss = 1.858, top1 = 50.69%], valid : [loss = 2.297, top1 = 41.67%], test : [loss = 2.303, top1 = 41.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.82%], valid : [loss = 0.688, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9452/15625) 009452-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.568, top1 = 88.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.386, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.218, top1 = 94.87%], valid : [loss = 1.412, top1 = 66.34%], test : [loss = 1.380, top1 = 67.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.94%], valid : [loss = 2.440, top1 = 38.78%], test : [loss = 2.479, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.92%], valid : [loss = 0.759, top1 = 73.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9453/15625) 009453-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.593, top1 = 87.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.28 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.388, top1 = 92.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.23 ms.
cifar100       train : [loss = 0.097, top1 = 98.32%], valid : [loss = 1.515, top1 = 67.12%], test : [loss = 1.527, top1 = 67.01%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.85%], valid : [loss = 2.441, top1 = 39.32%], test : [loss = 2.458, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.73%], valid : [loss = 0.771, top1 = 72.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9454/15625) 009454-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.77%], valid : [loss = 0.556, top1 = 83.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10        train : [loss = 0.224, top1 = 92.36%], test  : [loss = 0.415, top1 = 86.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 1.229, top1 = 65.17%], valid : [loss = 1.601, top1 = 57.00%], test : [loss = 1.573, top1 = 57.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 28.20%], valid : [loss = 2.966, top1 = 27.67%], test : [loss = 3.030, top1 = 26.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.147, top1 = 58.74%], valid : [loss = 1.198, top1 = 57.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9455/15625) 009455-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.42%], valid : [loss = 0.554, top1 = 87.50%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.98 ms.
cifar10        train : [loss = 0.029, top1 = 99.12%], test  : [loss = 0.361, top1 = 91.15%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.67 ms.
cifar100       train : [loss = 0.349, top1 = 89.81%], valid : [loss = 1.281, top1 = 67.95%], test : [loss = 1.309, top1 = 67.20%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.54%], valid : [loss = 2.364, top1 = 39.40%], test : [loss = 2.363, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.85%], valid : [loss = 0.957, top1 = 65.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9456/15625) 009456-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.97%], valid : [loss = 0.739, top1 = 83.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.085, top1 = 97.28%], test  : [loss = 0.484, top1 = 87.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.84 ms.
cifar100       train : [loss = 0.785, top1 = 77.25%], valid : [loss = 1.506, top1 = 60.74%], test : [loss = 1.500, top1 = 61.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 2.809, top1 = 30.49%], valid : [loss = 2.938, top1 = 28.23%], test : [loss = 2.979, top1 = 27.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9457/15625) 009457-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.18%], valid : [loss = 0.547, top1 = 84.79%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10        train : [loss = 0.186, top1 = 93.68%], test  : [loss = 0.391, top1 = 87.78%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.44 ms.
cifar100       train : [loss = 1.018, top1 = 70.53%], valid : [loss = 1.459, top1 = 60.63%], test : [loss = 1.442, top1 = 60.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.746, top1 = 31.68%], valid : [loss = 2.809, top1 = 30.47%], test : [loss = 2.856, top1 = 29.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.53%], valid : [loss = 0.947, top1 = 66.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9458/15625) 009458-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.18%], valid : [loss = 0.553, top1 = 87.03%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.51 ms.
cifar10        train : [loss = 0.058, top1 = 98.18%], test  : [loss = 0.364, top1 = 90.25%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.23 ms.
cifar100       train : [loss = 0.628, top1 = 81.44%], valid : [loss = 1.287, top1 = 65.27%], test : [loss = 1.279, top1 = 65.13%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 39.84%], valid : [loss = 2.489, top1 = 37.05%], test : [loss = 2.510, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.25%], valid : [loss = 0.827, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9459/15625) 009459-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.482, top1 = 89.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.316, top1 = 92.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.26 ms.
cifar100       train : [loss = 0.258, top1 = 93.57%], valid : [loss = 1.183, top1 = 69.44%], test : [loss = 1.210, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 49.93%], valid : [loss = 2.231, top1 = 42.72%], test : [loss = 2.241, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9460/15625) 009460-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.463, top1 = 90.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.332, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.095, top1 = 98.29%], valid : [loss = 1.390, top1 = 69.40%], test : [loss = 1.314, top1 = 70.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.54%], valid : [loss = 2.327, top1 = 41.83%], test : [loss = 2.304, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.66%], valid : [loss = 0.637, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9461/15625) 009461-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.48%], valid : [loss = 0.531, top1 = 84.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10        train : [loss = 0.187, top1 = 93.72%], test  : [loss = 0.396, top1 = 87.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.54 ms.
cifar100       train : [loss = 1.194, top1 = 66.03%], valid : [loss = 1.520, top1 = 58.34%], test : [loss = 1.520, top1 = 58.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.79%], valid : [loss = 2.704, top1 = 32.83%], test : [loss = 2.748, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.899, top1 = 67.41%], valid : [loss = 0.954, top1 = 66.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9462/15625) 009462-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.524, top1 = 88.75%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.04 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.340, top1 = 91.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.94 ms.
cifar100       train : [loss = 0.350, top1 = 90.41%], valid : [loss = 1.292, top1 = 66.48%], test : [loss = 1.303, top1 = 66.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.151, top1 = 44.13%], valid : [loss = 2.422, top1 = 38.87%], test : [loss = 2.419, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9463/15625) 009463-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.486, top1 = 89.37%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.13 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.316, top1 = 92.56%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.67 ms.
cifar100       train : [loss = 0.147, top1 = 97.05%], valid : [loss = 1.298, top1 = 69.90%], test : [loss = 1.328, top1 = 68.40%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.80 ms.
ImageNet16-120 train : [loss = 1.828, top1 = 51.47%], valid : [loss = 2.267, top1 = 41.87%], test : [loss = 2.296, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.00%], valid : [loss = 0.841, top1 = 70.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9464/15625) 009464-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.16 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9465/15625) 009465-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.91 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9466/15625) 009466-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.22%], valid : [loss = 0.530, top1 = 84.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.183, top1 = 93.83%], test  : [loss = 0.388, top1 = 87.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 1.182, top1 = 66.37%], valid : [loss = 1.502, top1 = 58.87%], test : [loss = 1.497, top1 = 58.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.73%], valid : [loss = 2.683, top1 = 33.10%], test : [loss = 2.740, top1 = 32.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.01%], valid : [loss = 0.958, top1 = 65.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9467/15625) 009467-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.81%], valid : [loss = 0.517, top1 = 86.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.108, top1 = 96.55%], test  : [loss = 0.376, top1 = 88.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.779, top1 = 77.20%], valid : [loss = 1.351, top1 = 63.50%], test : [loss = 1.354, top1 = 62.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.60%], valid : [loss = 2.574, top1 = 35.00%], test : [loss = 2.596, top1 = 34.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.41%], valid : [loss = 0.925, top1 = 67.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9468/15625) 009468-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.510, top1 = 88.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.324, top1 = 92.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.61 ms.
cifar100       train : [loss = 0.343, top1 = 90.48%], valid : [loss = 1.284, top1 = 66.70%], test : [loss = 1.298, top1 = 67.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.86%], valid : [loss = 2.432, top1 = 38.80%], test : [loss = 2.414, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9469/15625) 009469-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.557, top1 = 88.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.01 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.406, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.79 ms.
cifar100       train : [loss = 0.173, top1 = 96.22%], valid : [loss = 1.401, top1 = 67.14%], test : [loss = 1.443, top1 = 67.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.08%], valid : [loss = 2.441, top1 = 39.63%], test : [loss = 2.402, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 77.72%], valid : [loss = 0.705, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9470/15625) 009470-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.14%], valid : [loss = 0.525, top1 = 84.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.186, top1 = 93.67%], test  : [loss = 0.387, top1 = 87.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.20 ms.
cifar100       train : [loss = 1.206, top1 = 65.69%], valid : [loss = 1.516, top1 = 58.55%], test : [loss = 1.510, top1 = 58.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.35%], valid : [loss = 2.705, top1 = 32.11%], test : [loss = 2.740, top1 = 31.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.03%], valid : [loss = 0.964, top1 = 65.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9471/15625) 009471-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.557, top1 = 87.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.380, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.383, top1 = 89.21%], valid : [loss = 1.369, top1 = 65.61%], test : [loss = 1.379, top1 = 65.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.80%], valid : [loss = 2.482, top1 = 37.09%], test : [loss = 2.490, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.57%], valid : [loss = 0.760, top1 = 73.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9472/15625) 009472-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.22%], valid : [loss = 0.666, top1 = 84.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.051, top1 = 98.45%], test  : [loss = 0.403, top1 = 89.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.51 ms.
cifar100       train : [loss = 0.664, top1 = 80.67%], valid : [loss = 1.460, top1 = 62.22%], test : [loss = 1.444, top1 = 62.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.471, top1 = 37.20%], valid : [loss = 2.621, top1 = 34.27%], test : [loss = 2.666, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.80%], valid : [loss = 0.853, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9473/15625) 009473-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.41%], valid : [loss = 0.466, top1 = 86.15%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=14.80 ms.
cifar10        train : [loss = 0.158, top1 = 94.87%], test  : [loss = 0.351, top1 = 88.83%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=12.67 ms.
cifar100       train : [loss = 1.004, top1 = 71.51%], valid : [loss = 1.355, top1 = 61.72%], test : [loss = 1.357, top1 = 62.00%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.93%], valid : [loss = 2.685, top1 = 33.04%], test : [loss = 2.711, top1 = 31.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9474/15625) 009474-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.533, top1 = 89.64%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.77 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.312, top1 = 93.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.37 ms.
cifar100       train : [loss = 0.114, top1 = 97.83%], valid : [loss = 1.309, top1 = 69.24%], test : [loss = 1.322, top1 = 69.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.02 ms.
ImageNet16-120 train : [loss = 1.686, top1 = 54.83%], valid : [loss = 2.179, top1 = 43.47%], test : [loss = 2.205, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.451, top1 = 84.52%], valid : [loss = 0.545, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9475/15625) 009475-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.43%], valid : [loss = 0.685, top1 = 84.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10        train : [loss = 0.052, top1 = 98.45%], test  : [loss = 0.454, top1 = 88.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.639, top1 = 81.30%], valid : [loss = 1.517, top1 = 60.92%], test : [loss = 1.495, top1 = 61.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.40%], valid : [loss = 2.828, top1 = 30.46%], test : [loss = 2.867, top1 = 29.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.82%], valid : [loss = 0.877, top1 = 69.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9476/15625) 009476-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.542, top1 = 88.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.333, top1 = 91.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 0.336, top1 = 90.79%], valid : [loss = 1.295, top1 = 67.58%], test : [loss = 1.308, top1 = 66.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.78%], valid : [loss = 2.441, top1 = 38.40%], test : [loss = 2.449, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9477/15625) 009477-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.541, top1 = 89.38%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.378, top1 = 92.65%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.83 ms.
cifar100       train : [loss = 0.036, top1 = 99.68%], valid : [loss = 1.445, top1 = 69.92%], test : [loss = 1.377, top1 = 70.02%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.570, top1 = 57.75%], valid : [loss = 2.431, top1 = 41.67%], test : [loss = 2.389, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.93%], valid : [loss = 0.680, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9478/15625) 009478-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.531, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10        train : [loss = 0.012, top1 = 99.66%], test  : [loss = 0.372, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.33 ms.
cifar100       train : [loss = 0.207, top1 = 94.67%], valid : [loss = 1.345, top1 = 67.30%], test : [loss = 1.352, top1 = 68.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 32.39%], valid : [loss = 2.788, top1 = 30.60%], test : [loss = 2.792, top1 = 30.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.028, top1 = 62.99%], valid : [loss = 1.051, top1 = 62.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9479/15625) 009479-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.616, top1 = 86.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.83 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.397, top1 = 90.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.508, top1 = 85.21%], valid : [loss = 1.388, top1 = 65.08%], test : [loss = 1.390, top1 = 64.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.42%], valid : [loss = 2.545, top1 = 37.17%], test : [loss = 2.545, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.55%], valid : [loss = 0.835, top1 = 70.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9480/15625) 009480-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.525, top1 = 88.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.348, top1 = 91.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.475, top1 = 86.11%], valid : [loss = 1.344, top1 = 65.68%], test : [loss = 1.330, top1 = 66.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.08%], valid : [loss = 2.520, top1 = 36.73%], test : [loss = 2.582, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.76%], valid : [loss = 0.686, top1 = 76.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9481/15625) 009481-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.500, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.319, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.268, top1 = 93.06%], valid : [loss = 1.183, top1 = 69.28%], test : [loss = 1.209, top1 = 68.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 1.926, top1 = 49.25%], valid : [loss = 2.231, top1 = 42.40%], test : [loss = 2.256, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9482/15625) 009482-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.435, top1 = 89.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.300, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.18 ms.
cifar100       train : [loss = 0.234, top1 = 94.25%], valid : [loss = 1.275, top1 = 68.64%], test : [loss = 1.244, top1 = 68.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.49%], valid : [loss = 2.266, top1 = 41.63%], test : [loss = 2.289, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.18%], valid : [loss = 0.542, top1 = 81.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9483/15625) 009483-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.434, top1 = 89.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=12.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.27 ms.
cifar100       train : [loss = 0.331, top1 = 91.19%], valid : [loss = 1.306, top1 = 67.42%], test : [loss = 1.306, top1 = 67.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.07%], valid : [loss = 2.377, top1 = 40.00%], test : [loss = 2.429, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.41%], valid : [loss = 0.544, top1 = 81.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9484/15625) 009484-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.500, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.321, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.10 ms.
cifar100       train : [loss = 0.354, top1 = 90.07%], valid : [loss = 1.256, top1 = 68.07%], test : [loss = 1.246, top1 = 68.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.63%], valid : [loss = 2.328, top1 = 40.36%], test : [loss = 2.341, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.86%], valid : [loss = 0.704, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9485/15625) 009485-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.555, top1 = 87.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.020, top1 = 99.50%], test  : [loss = 0.361, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.38 ms.
cifar100       train : [loss = 0.347, top1 = 90.32%], valid : [loss = 1.376, top1 = 65.16%], test : [loss = 1.333, top1 = 66.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.68%], valid : [loss = 2.482, top1 = 36.83%], test : [loss = 2.536, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.35%], valid : [loss = 0.947, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9486/15625) 009486-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.30%], valid : [loss = 0.463, top1 = 85.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.158, top1 = 94.86%], test  : [loss = 0.332, top1 = 89.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.41 ms.
cifar100       train : [loss = 1.012, top1 = 71.01%], valid : [loss = 1.343, top1 = 62.16%], test : [loss = 1.358, top1 = 61.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.62%], valid : [loss = 2.675, top1 = 32.23%], test : [loss = 2.726, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9487/15625) 009487-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.446, top1 = 90.06%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.44 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.320, top1 = 92.85%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.44 ms.
cifar100       train : [loss = 0.078, top1 = 98.64%], valid : [loss = 1.444, top1 = 67.64%], test : [loss = 1.506, top1 = 67.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.698, top1 = 54.69%], valid : [loss = 2.325, top1 = 42.50%], test : [loss = 2.330, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.452, top1 = 84.09%], valid : [loss = 0.566, top1 = 80.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9488/15625) 009488-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.502, top1 = 89.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.327, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.51 ms.
cifar100       train : [loss = 0.169, top1 = 96.01%], valid : [loss = 1.275, top1 = 69.46%], test : [loss = 1.254, top1 = 69.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.08%], valid : [loss = 2.213, top1 = 42.53%], test : [loss = 2.245, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.86%], valid : [loss = 0.849, top1 = 69.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9489/15625) 009489-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.12%], valid : [loss = 0.603, top1 = 84.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.096, top1 = 96.83%], test  : [loss = 0.413, top1 = 88.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.16 ms.
cifar100       train : [loss = 0.639, top1 = 81.01%], valid : [loss = 1.540, top1 = 60.74%], test : [loss = 1.514, top1 = 61.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 3.008, top1 = 25.72%], valid : [loss = 3.026, top1 = 25.37%], test : [loss = 3.075, top1 = 24.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.51%], valid : [loss = 1.068, top1 = 62.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9490/15625) 009490-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.572, top1 = 88.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.399, top1 = 91.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.129, top1 = 97.39%], valid : [loss = 1.529, top1 = 66.34%], test : [loss = 1.523, top1 = 66.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.00%], valid : [loss = 2.405, top1 = 40.10%], test : [loss = 2.407, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.34%], valid : [loss = 0.736, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9491/15625) 009491-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.524, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.342, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.90 ms.
cifar100       train : [loss = 0.307, top1 = 91.61%], valid : [loss = 1.279, top1 = 68.14%], test : [loss = 1.266, top1 = 67.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.99%], valid : [loss = 2.434, top1 = 38.80%], test : [loss = 2.412, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9492/15625) 009492-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.47%], valid : [loss = 0.558, top1 = 86.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.046, top1 = 98.71%], test  : [loss = 0.365, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.10 ms.
cifar100       train : [loss = 0.592, top1 = 82.71%], valid : [loss = 1.375, top1 = 64.16%], test : [loss = 1.351, top1 = 64.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.429, top1 = 38.18%], valid : [loss = 2.609, top1 = 35.60%], test : [loss = 2.647, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.99%], valid : [loss = 0.690, top1 = 76.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9493/15625) 009493-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.424, top1 = 91.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.281, top1 = 93.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.54 ms.
cifar100       train : [loss = 0.066, top1 = 99.08%], valid : [loss = 1.324, top1 = 70.14%], test : [loss = 1.340, top1 = 70.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.511, top1 = 59.08%], valid : [loss = 2.227, top1 = 46.07%], test : [loss = 2.237, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.367, top1 = 87.36%], valid : [loss = 0.499, top1 = 83.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9494/15625) 009494-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.66%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.311, top1 = 93.46%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.94 ms.
cifar100       train : [loss = 0.047, top1 = 99.46%], valid : [loss = 1.328, top1 = 70.96%], test : [loss = 1.372, top1 = 70.12%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.39%], valid : [loss = 2.248, top1 = 41.87%], test : [loss = 2.279, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.46%], valid : [loss = 0.833, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9495/15625) 009495-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=23.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.495, top1 = 89.60%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.284, top1 = 93.47%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.01 ms.
cifar100       train : [loss = 0.110, top1 = 98.08%], valid : [loss = 1.323, top1 = 68.96%], test : [loss = 1.318, top1 = 69.04%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.44%], valid : [loss = 2.169, top1 = 44.30%], test : [loss = 2.166, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.55%], valid : [loss = 0.615, top1 = 78.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9496/15625) 009496-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.70%], valid : [loss = 0.448, top1 = 87.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10        train : [loss = 0.059, top1 = 98.47%], test  : [loss = 0.309, top1 = 90.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.72 ms.
cifar100       train : [loss = 0.606, top1 = 83.27%], valid : [loss = 1.241, top1 = 65.92%], test : [loss = 1.204, top1 = 66.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.34%], valid : [loss = 2.452, top1 = 38.73%], test : [loss = 2.479, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.49%], valid : [loss = 0.635, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9497/15625) 009497-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.564, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.374, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.77 ms.
cifar100       train : [loss = 0.098, top1 = 98.20%], valid : [loss = 1.405, top1 = 68.54%], test : [loss = 1.381, top1 = 68.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.62%], valid : [loss = 2.418, top1 = 39.83%], test : [loss = 2.458, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.54%], valid : [loss = 0.726, top1 = 75.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9498/15625) 009498-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.16 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.86%], valid : [loss = 0.539, top1 = 85.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.099, top1 = 96.82%], test  : [loss = 0.369, top1 = 89.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.25 ms.
cifar100       train : [loss = 0.751, top1 = 78.00%], valid : [loss = 1.374, top1 = 63.18%], test : [loss = 1.341, top1 = 63.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.19%], valid : [loss = 2.606, top1 = 34.17%], test : [loss = 2.624, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.12%], valid : [loss = 0.873, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9499/15625) 009499-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.515, top1 = 89.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.347, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.61 ms.
cifar100       train : [loss = 0.121, top1 = 97.57%], valid : [loss = 1.329, top1 = 68.62%], test : [loss = 1.349, top1 = 69.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.31%], valid : [loss = 2.307, top1 = 40.53%], test : [loss = 2.282, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.72%], valid : [loss = 0.721, top1 = 74.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9500/15625) 009500-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.25%], valid : [loss = 0.461, top1 = 86.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.99 ms.
cifar10        train : [loss = 0.152, top1 = 95.00%], test  : [loss = 0.341, top1 = 88.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.89 ms.
cifar100       train : [loss = 1.011, top1 = 71.35%], valid : [loss = 1.378, top1 = 61.50%], test : [loss = 1.374, top1 = 61.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 34.02%], valid : [loss = 2.683, top1 = 32.47%], test : [loss = 2.699, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9501/15625) 009501-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.472, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.323, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.65 ms.
cifar100       train : [loss = 0.284, top1 = 92.43%], valid : [loss = 1.279, top1 = 68.16%], test : [loss = 1.291, top1 = 67.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.18%], valid : [loss = 2.326, top1 = 40.57%], test : [loss = 2.367, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.46%], valid : [loss = 0.591, top1 = 80.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9502/15625) 009502-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.509, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.333, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.96 ms.
cifar100       train : [loss = 0.350, top1 = 90.23%], valid : [loss = 1.244, top1 = 67.52%], test : [loss = 1.253, top1 = 67.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.91%], valid : [loss = 2.296, top1 = 41.93%], test : [loss = 2.355, top1 = 39.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.11%], valid : [loss = 0.735, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9503/15625) 009503-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.08%], valid : [loss = 0.526, top1 = 87.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10        train : [loss = 0.074, top1 = 97.62%], test  : [loss = 0.372, top1 = 89.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.89 ms.
cifar100       train : [loss = 0.728, top1 = 78.64%], valid : [loss = 1.362, top1 = 64.46%], test : [loss = 1.347, top1 = 64.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 35.98%], valid : [loss = 2.623, top1 = 34.03%], test : [loss = 2.679, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9504/15625) 009504-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.632, top1 = 84.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.072, top1 = 97.81%], test  : [loss = 0.416, top1 = 88.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.730, top1 = 78.79%], valid : [loss = 1.416, top1 = 62.46%], test : [loss = 1.381, top1 = 62.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 36.04%], valid : [loss = 2.673, top1 = 34.33%], test : [loss = 2.680, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9505/15625) 009505-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.92%], valid : [loss = 0.725, top1 = 74.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10        train : [loss = 0.567, top1 = 80.55%], test  : [loss = 0.621, top1 = 78.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 1.997, top1 = 46.64%], valid : [loss = 2.122, top1 = 44.07%], test : [loss = 2.108, top1 = 43.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 3.231, top1 = 22.38%], valid : [loss = 3.202, top1 = 23.49%], test : [loss = 3.238, top1 = 22.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.286, top1 = 53.61%], valid : [loss = 1.351, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9506/15625) 009506-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.427, top1 = 90.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.283, top1 = 93.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.19 ms.
cifar100       train : [loss = 0.104, top1 = 97.98%], valid : [loss = 1.331, top1 = 70.34%], test : [loss = 1.311, top1 = 70.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 1.650, top1 = 55.68%], valid : [loss = 2.211, top1 = 43.53%], test : [loss = 2.246, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.417, top1 = 85.59%], valid : [loss = 0.532, top1 = 82.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9507/15625) 009507-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.77%], valid : [loss = 0.560, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.339, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.273, top1 = 92.58%], valid : [loss = 1.383, top1 = 66.54%], test : [loss = 1.343, top1 = 67.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.27%], valid : [loss = 2.485, top1 = 36.30%], test : [loss = 2.503, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.51%], valid : [loss = 0.930, top1 = 66.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9508/15625) 009508-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.581, top1 = 88.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.015, top1 = 99.55%], test  : [loss = 0.390, top1 = 91.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.99 ms.
cifar100       train : [loss = 0.309, top1 = 91.49%], valid : [loss = 1.437, top1 = 64.98%], test : [loss = 1.426, top1 = 65.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.370, top1 = 39.14%], valid : [loss = 2.580, top1 = 35.23%], test : [loss = 2.553, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 65.11%], valid : [loss = 0.991, top1 = 64.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9509/15625) 009509-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.331, top1 = 91.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 0.327, top1 = 91.15%], valid : [loss = 1.321, top1 = 66.83%], test : [loss = 1.340, top1 = 66.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.28%], valid : [loss = 2.375, top1 = 39.24%], test : [loss = 2.393, top1 = 39.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9510/15625) 009510-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.284, top1 = 90.51%], valid : [loss = 0.476, top1 = 84.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.303, top1 = 89.93%], test  : [loss = 0.398, top1 = 86.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 1.326, top1 = 63.33%], valid : [loss = 1.520, top1 = 57.88%], test : [loss = 1.517, top1 = 58.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.75%], valid : [loss = 2.914, top1 = 28.97%], test : [loss = 2.968, top1 = 28.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9511/15625) 009511-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.553, top1 = 88.46%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.70 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.373, top1 = 91.68%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.04 ms.
cifar100       train : [loss = 0.263, top1 = 93.04%], valid : [loss = 1.270, top1 = 68.06%], test : [loss = 1.285, top1 = 68.26%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.71%], valid : [loss = 2.247, top1 = 42.10%], test : [loss = 2.300, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.844, top1 = 69.64%], valid : [loss = 0.900, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9512/15625) 009512-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.565, top1 = 87.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.64 ms.
cifar10        train : [loss = 0.029, top1 = 99.13%], test  : [loss = 0.349, top1 = 90.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.90 ms.
cifar100       train : [loss = 0.417, top1 = 88.11%], valid : [loss = 1.311, top1 = 66.58%], test : [loss = 1.329, top1 = 65.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.20%], valid : [loss = 2.423, top1 = 38.37%], test : [loss = 2.418, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.99%], valid : [loss = 0.893, top1 = 68.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9513/15625) 009513-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.507, top1 = 88.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.323, top1 = 92.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.00 ms.
cifar100       train : [loss = 0.365, top1 = 89.95%], valid : [loss = 1.285, top1 = 66.84%], test : [loss = 1.314, top1 = 66.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.48%], valid : [loss = 2.414, top1 = 38.73%], test : [loss = 2.456, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9514/15625) 009514-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.536, top1 = 88.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.382, top1 = 91.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.396, top1 = 88.79%], valid : [loss = 1.401, top1 = 65.73%], test : [loss = 1.379, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.92%], valid : [loss = 2.455, top1 = 38.32%], test : [loss = 2.514, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.66%], valid : [loss = 0.778, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9515/15625) 009515-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.549, top1 = 88.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.367, top1 = 92.12%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.89 ms.
cifar100       train : [loss = 0.154, top1 = 96.50%], valid : [loss = 1.344, top1 = 68.08%], test : [loss = 1.353, top1 = 68.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.72 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.83%], valid : [loss = 2.349, top1 = 40.97%], test : [loss = 2.318, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 71.68%], valid : [loss = 0.831, top1 = 70.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9516/15625) 009516-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.268, top1 = 90.95%], valid : [loss = 0.534, top1 = 83.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.246, top1 = 91.57%], test  : [loss = 0.398, top1 = 87.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 1.320, top1 = 62.65%], valid : [loss = 1.597, top1 = 56.45%], test : [loss = 1.574, top1 = 56.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 2.778, top1 = 31.13%], valid : [loss = 2.795, top1 = 30.76%], test : [loss = 2.831, top1 = 30.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 66.04%], valid : [loss = 0.991, top1 = 64.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9517/15625) 009517-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.598, top1 = 88.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.402, top1 = 91.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.91 ms.
cifar100       train : [loss = 0.107, top1 = 97.83%], valid : [loss = 1.563, top1 = 66.54%], test : [loss = 1.538, top1 = 66.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.87%], valid : [loss = 2.400, top1 = 39.90%], test : [loss = 2.395, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.97%], valid : [loss = 0.764, top1 = 73.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9518/15625) 009518-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.80%], valid : [loss = 0.605, top1 = 80.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.261, top1 = 91.12%], test  : [loss = 0.441, top1 = 85.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.51 ms.
cifar100       train : [loss = 1.323, top1 = 62.66%], valid : [loss = 1.683, top1 = 55.50%], test : [loss = 1.684, top1 = 55.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 2.995, top1 = 27.00%], valid : [loss = 3.031, top1 = 25.90%], test : [loss = 3.094, top1 = 25.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.175, top1 = 57.64%], valid : [loss = 1.224, top1 = 56.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9519/15625) 009519-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.79 ms.
cifar10-valid  train : [loss = 0.789, top1 = 72.17%], valid : [loss = 0.971, top1 = 67.10%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10        train : [loss = 0.760, top1 = 73.37%], test  : [loss = 0.835, top1 = 71.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.75 ms.
cifar100       train : [loss = 2.113, top1 = 44.43%], valid : [loss = 2.278, top1 = 42.04%], test : [loss = 2.311, top1 = 40.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.69 ms.
ImageNet16-120 train : [loss = 3.747, top1 = 14.16%], valid : [loss = 3.761, top1 = 14.60%], test : [loss = 3.777, top1 = 14.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9520/15625) 009520-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.64 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9521/15625) 009521-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.541, top1 = 88.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.348, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.91 ms.
cifar100       train : [loss = 0.249, top1 = 93.37%], valid : [loss = 1.326, top1 = 67.03%], test : [loss = 1.336, top1 = 67.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.08%], valid : [loss = 2.415, top1 = 38.36%], test : [loss = 2.423, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9522/15625) 009522-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.50%], valid : [loss = 0.562, top1 = 87.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10        train : [loss = 0.034, top1 = 98.97%], test  : [loss = 0.355, top1 = 91.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.69 ms.
cifar100       train : [loss = 0.533, top1 = 84.76%], valid : [loss = 1.334, top1 = 64.56%], test : [loss = 1.352, top1 = 64.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.569, top1 = 34.79%], valid : [loss = 2.639, top1 = 33.03%], test : [loss = 2.643, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9523/15625) 009523-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.35%], valid : [loss = 0.745, top1 = 74.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.572, top1 = 80.16%], test  : [loss = 0.637, top1 = 77.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 1.972, top1 = 46.88%], valid : [loss = 2.119, top1 = 44.06%], test : [loss = 2.120, top1 = 43.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 3.239, top1 = 22.29%], valid : [loss = 3.239, top1 = 23.02%], test : [loss = 3.262, top1 = 22.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9524/15625) 009524-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.542, top1 = 88.53%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.346, top1 = 92.06%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.05 ms.
cifar100       train : [loss = 0.278, top1 = 92.48%], valid : [loss = 1.304, top1 = 67.60%], test : [loss = 1.324, top1 = 67.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.79 ms.
ImageNet16-120 train : [loss = 2.091, top1 = 45.22%], valid : [loss = 2.367, top1 = 39.17%], test : [loss = 2.386, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.64%], valid : [loss = 0.820, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9525/15625) 009525-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.41%], valid : [loss = 0.547, top1 = 87.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.037, top1 = 98.82%], test  : [loss = 0.369, top1 = 90.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.46 ms.
cifar100       train : [loss = 0.445, top1 = 86.88%], valid : [loss = 1.247, top1 = 66.68%], test : [loss = 1.265, top1 = 67.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.89 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 41.88%], valid : [loss = 2.439, top1 = 37.97%], test : [loss = 2.453, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.90%], valid : [loss = 0.929, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9526/15625) 009526-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.627, top1 = 87.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.416, top1 = 91.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.63 ms.
cifar100       train : [loss = 0.142, top1 = 96.87%], valid : [loss = 1.541, top1 = 65.97%], test : [loss = 1.549, top1 = 65.95%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.12%], valid : [loss = 2.472, top1 = 38.30%], test : [loss = 2.509, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.91%], valid : [loss = 0.804, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9527/15625) 009527-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.616, top1 = 86.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.61 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.393, top1 = 90.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 0.523, top1 = 84.73%], valid : [loss = 1.463, top1 = 63.20%], test : [loss = 1.428, top1 = 64.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.89%], valid : [loss = 2.580, top1 = 35.70%], test : [loss = 2.579, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.68%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9528/15625) 009528-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.538, top1 = 89.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.83 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.330, top1 = 92.73%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.86 ms.
cifar100       train : [loss = 0.157, top1 = 96.50%], valid : [loss = 1.313, top1 = 68.48%], test : [loss = 1.311, top1 = 69.14%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.23%], valid : [loss = 2.319, top1 = 41.27%], test : [loss = 2.313, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.11%], valid : [loss = 0.661, top1 = 77.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9529/15625) 009529-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.70%], valid : [loss = 0.606, top1 = 84.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10        train : [loss = 0.091, top1 = 96.99%], test  : [loss = 0.429, top1 = 88.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.96 ms.
cifar100       train : [loss = 0.709, top1 = 79.06%], valid : [loss = 1.534, top1 = 60.04%], test : [loss = 1.540, top1 = 60.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 3.193, top1 = 22.15%], valid : [loss = 3.205, top1 = 22.07%], test : [loss = 3.250, top1 = 21.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9530/15625) 009530-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.91%], valid : [loss = 0.759, top1 = 82.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 0.067, top1 = 97.84%], test  : [loss = 0.451, top1 = 88.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.24 ms.
cifar100       train : [loss = 0.711, top1 = 79.23%], valid : [loss = 1.599, top1 = 59.60%], test : [loss = 1.548, top1 = 60.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 32.02%], valid : [loss = 2.876, top1 = 27.90%], test : [loss = 2.937, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.883, top1 = 68.23%], valid : [loss = 0.943, top1 = 66.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9531/15625) 009531-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9532/15625) 009532-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.507, top1 = 88.82%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.341, top1 = 91.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.50 ms.
cifar100       train : [loss = 0.351, top1 = 90.28%], valid : [loss = 1.257, top1 = 67.10%], test : [loss = 1.262, top1 = 67.68%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.65%], valid : [loss = 2.398, top1 = 37.97%], test : [loss = 2.447, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9533/15625) 009533-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.44%], valid : [loss = 0.527, top1 = 87.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.26 ms.
cifar10        train : [loss = 0.085, top1 = 97.24%], test  : [loss = 0.363, top1 = 89.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.32 ms.
cifar100       train : [loss = 0.714, top1 = 79.09%], valid : [loss = 1.305, top1 = 64.20%], test : [loss = 1.290, top1 = 64.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 38.86%], valid : [loss = 2.511, top1 = 37.20%], test : [loss = 2.503, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.90%], valid : [loss = 0.772, top1 = 73.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9534/15625) 009534-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.65%], valid : [loss = 0.543, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.073, top1 = 97.91%], test  : [loss = 0.343, top1 = 90.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.686, top1 = 80.14%], valid : [loss = 1.352, top1 = 63.92%], test : [loss = 1.296, top1 = 64.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.84%], valid : [loss = 2.512, top1 = 36.67%], test : [loss = 2.535, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 71.13%], valid : [loss = 0.869, top1 = 69.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9535/15625) 009535-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.10%], valid : [loss = 0.747, top1 = 80.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.161, top1 = 94.67%], test  : [loss = 0.524, top1 = 85.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.896, top1 = 73.77%], valid : [loss = 1.637, top1 = 57.64%], test : [loss = 1.667, top1 = 57.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 3.319, top1 = 20.34%], valid : [loss = 3.339, top1 = 20.47%], test : [loss = 3.368, top1 = 20.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.249, top1 = 54.31%], valid : [loss = 1.279, top1 = 53.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9536/15625) 009536-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.41%], valid : [loss = 0.616, top1 = 86.40%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.85 ms.
cifar10        train : [loss = 0.040, top1 = 98.83%], test  : [loss = 0.386, top1 = 89.70%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.98 ms.
cifar100       train : [loss = 0.433, top1 = 87.40%], valid : [loss = 1.395, top1 = 64.92%], test : [loss = 1.383, top1 = 64.84%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.44%], valid : [loss = 2.451, top1 = 37.60%], test : [loss = 2.488, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.54%], valid : [loss = 0.882, top1 = 68.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9537/15625) 009537-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.817, top1 = 82.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.045, top1 = 98.67%], test  : [loss = 0.494, top1 = 88.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 0.473, top1 = 86.55%], valid : [loss = 1.731, top1 = 58.58%], test : [loss = 1.719, top1 = 60.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.57%], valid : [loss = 2.865, top1 = 29.27%], test : [loss = 2.912, top1 = 29.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.53%], valid : [loss = 0.887, top1 = 68.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9538/15625) 009538-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.78 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.322, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.71 ms.
cifar100       train : [loss = 0.206, top1 = 95.19%], valid : [loss = 1.310, top1 = 68.76%], test : [loss = 1.270, top1 = 68.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.52%], valid : [loss = 2.272, top1 = 43.83%], test : [loss = 2.289, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.24%], valid : [loss = 0.523, top1 = 82.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9539/15625) 009539-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.543, top1 = 88.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.32 ms.
cifar10        train : [loss = 0.014, top1 = 99.62%], test  : [loss = 0.363, top1 = 91.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.222, top1 = 94.15%], valid : [loss = 1.367, top1 = 67.02%], test : [loss = 1.355, top1 = 67.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.87%], valid : [loss = 2.360, top1 = 40.03%], test : [loss = 2.331, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 69.16%], valid : [loss = 0.903, top1 = 67.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9540/15625) 009540-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.615, top1 = 86.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.369, top1 = 91.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.352, top1 = 90.15%], valid : [loss = 1.381, top1 = 65.94%], test : [loss = 1.406, top1 = 65.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.275, top1 = 41.55%], valid : [loss = 2.512, top1 = 37.03%], test : [loss = 2.491, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.11%], valid : [loss = 0.828, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9541/15625) 009541-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.488, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.346, top1 = 91.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.336, top1 = 90.82%], valid : [loss = 1.286, top1 = 66.88%], test : [loss = 1.289, top1 = 67.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.57%], valid : [loss = 2.433, top1 = 38.53%], test : [loss = 2.424, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9542/15625) 009542-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.48%], valid : [loss = 0.528, top1 = 87.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.037, top1 = 98.92%], test  : [loss = 0.358, top1 = 90.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.44 ms.
cifar100       train : [loss = 0.532, top1 = 84.18%], valid : [loss = 1.329, top1 = 66.20%], test : [loss = 1.345, top1 = 65.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 40.02%], valid : [loss = 2.512, top1 = 37.07%], test : [loss = 2.531, top1 = 36.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.01%], valid : [loss = 0.713, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9543/15625) 009543-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.418, top1 = 90.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.275, top1 = 93.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.172, top1 = 96.09%], valid : [loss = 1.275, top1 = 69.53%], test : [loss = 1.272, top1 = 69.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.34%], valid : [loss = 2.234, top1 = 43.09%], test : [loss = 2.264, top1 = 42.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.53%], valid : [loss = 0.520, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9544/15625) 009544-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9545/15625) 009545-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.10%], valid : [loss = 0.478, top1 = 84.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.297, top1 = 90.07%], test  : [loss = 0.397, top1 = 86.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 1.327, top1 = 63.28%], valid : [loss = 1.540, top1 = 57.92%], test : [loss = 1.509, top1 = 58.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.33 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.67%], valid : [loss = 2.906, top1 = 29.70%], test : [loss = 2.951, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9546/15625) 009546-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.46%], valid : [loss = 0.860, top1 = 70.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.670, top1 = 76.43%], test  : [loss = 0.756, top1 = 74.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.02 ms.
cifar100       train : [loss = 1.955, top1 = 48.10%], valid : [loss = 2.124, top1 = 45.17%], test : [loss = 2.137, top1 = 44.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 3.644, top1 = 15.82%], valid : [loss = 3.666, top1 = 16.26%], test : [loss = 3.687, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9547/15625) 009547-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.099, top1 = 96.69%], valid : [loss = 0.680, top1 = 82.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.146, top1 = 95.14%], test  : [loss = 0.451, top1 = 86.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.56 ms.
cifar100       train : [loss = 0.948, top1 = 72.32%], valid : [loss = 1.620, top1 = 57.58%], test : [loss = 1.622, top1 = 57.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.37 ms.
ImageNet16-120 train : [loss = 3.053, top1 = 25.59%], valid : [loss = 3.147, top1 = 23.77%], test : [loss = 3.159, top1 = 23.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9548/15625) 009548-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.522, top1 = 89.42%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.50 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.308, top1 = 93.22%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.81 ms.
cifar100       train : [loss = 0.057, top1 = 99.16%], valid : [loss = 1.350, top1 = 70.48%], test : [loss = 1.337, top1 = 69.84%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.790, top1 = 52.37%], valid : [loss = 2.305, top1 = 41.87%], test : [loss = 2.324, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.94%], valid : [loss = 0.816, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9549/15625) 009549-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.67%], valid : [loss = 0.515, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10        train : [loss = 0.029, top1 = 99.15%], test  : [loss = 0.356, top1 = 91.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.67 ms.
cifar100       train : [loss = 0.437, top1 = 87.25%], valid : [loss = 1.258, top1 = 67.04%], test : [loss = 1.258, top1 = 66.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.56%], valid : [loss = 2.402, top1 = 39.17%], test : [loss = 2.386, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.28%], valid : [loss = 0.827, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9550/15625) 009550-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.687, top1 = 84.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.01 ms.
cifar10        train : [loss = 0.053, top1 = 98.42%], test  : [loss = 0.471, top1 = 88.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.52 ms.
cifar100       train : [loss = 0.595, top1 = 82.52%], valid : [loss = 1.532, top1 = 61.86%], test : [loss = 1.506, top1 = 61.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.668, top1 = 33.32%], valid : [loss = 2.853, top1 = 30.27%], test : [loss = 2.868, top1 = 31.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.45%], valid : [loss = 0.892, top1 = 68.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9551/15625) 009551-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.89%], valid : [loss = 0.745, top1 = 74.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.66 ms.
cifar10        train : [loss = 0.508, top1 = 82.45%], test  : [loss = 0.579, top1 = 80.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.99 ms.
cifar100       train : [loss = 1.897, top1 = 48.64%], valid : [loss = 2.028, top1 = 46.09%], test : [loss = 2.040, top1 = 45.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 2.994, top1 = 26.76%], valid : [loss = 2.976, top1 = 27.68%], test : [loss = 3.007, top1 = 26.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 59.54%], valid : [loss = 1.178, top1 = 57.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9552/15625) 009552-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.96%], valid : [loss = 0.569, top1 = 86.73%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.91 ms.
cifar10        train : [loss = 0.063, top1 = 97.99%], test  : [loss = 0.383, top1 = 89.92%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.82 ms.
cifar100       train : [loss = 0.657, top1 = 80.60%], valid : [loss = 1.274, top1 = 65.64%], test : [loss = 1.300, top1 = 65.22%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.01%], valid : [loss = 2.475, top1 = 37.27%], test : [loss = 2.483, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.84%], valid : [loss = 0.773, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9553/15625) 009553-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.68%], valid : [loss = 0.758, top1 = 82.48%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.85 ms.
cifar10        train : [loss = 0.091, top1 = 97.14%], test  : [loss = 0.469, top1 = 87.29%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.91 ms.
cifar100       train : [loss = 0.840, top1 = 75.72%], valid : [loss = 1.580, top1 = 59.22%], test : [loss = 1.557, top1 = 58.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.805, top1 = 30.54%], valid : [loss = 2.926, top1 = 28.43%], test : [loss = 2.961, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 70.94%], valid : [loss = 0.863, top1 = 69.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9554/15625) 009554-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.490, top1 = 89.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.318, top1 = 92.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.350, top1 = 90.34%], valid : [loss = 1.274, top1 = 67.56%], test : [loss = 1.262, top1 = 68.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.19%], valid : [loss = 2.412, top1 = 38.40%], test : [loss = 2.420, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9555/15625) 009555-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.681, top1 = 86.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10        train : [loss = 0.021, top1 = 99.44%], test  : [loss = 0.466, top1 = 89.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 0.252, top1 = 93.28%], valid : [loss = 1.663, top1 = 62.04%], test : [loss = 1.668, top1 = 61.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.32%], valid : [loss = 2.528, top1 = 36.67%], test : [loss = 2.508, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.71%], valid : [loss = 0.857, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9556/15625) 009556-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.540, top1 = 88.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.376, top1 = 91.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.194, top1 = 95.22%], valid : [loss = 1.497, top1 = 66.22%], test : [loss = 1.430, top1 = 66.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.76%], valid : [loss = 2.418, top1 = 40.20%], test : [loss = 2.454, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 75.93%], valid : [loss = 0.738, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9557/15625) 009557-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.73%], valid : [loss = 0.468, top1 = 86.23%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.16 ms.
cifar10        train : [loss = 0.148, top1 = 95.31%], test  : [loss = 0.339, top1 = 89.21%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.15 ms.
cifar100       train : [loss = 0.969, top1 = 72.30%], valid : [loss = 1.328, top1 = 63.04%], test : [loss = 1.341, top1 = 62.36%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 33.97%], valid : [loss = 2.685, top1 = 32.70%], test : [loss = 2.717, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.40%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9558/15625) 009558-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=24.97 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.467, top1 = 89.41%]
cifar10        FLOP= 62.83 M, Params=0.456 MB, latency=21.80 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.302, top1 = 92.42%]
cifar100       FLOP= 62.84 M, Params=0.462 MB, latency=21.40 ms.
cifar100       train : [loss = 0.166, top1 = 96.61%], valid : [loss = 1.256, top1 = 69.32%], test : [loss = 1.283, top1 = 68.18%]
ImageNet16-120 FLOP= 15.72 M, Params=0.463 MB, latency=27.07 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 51.92%], valid : [loss = 2.224, top1 = 42.57%], test : [loss = 2.217, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.22%], valid : [loss = 0.739, top1 = 74.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9559/15625) 009559-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.498, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.317, top1 = 92.48%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.54 ms.
cifar100       train : [loss = 0.234, top1 = 94.34%], valid : [loss = 1.243, top1 = 68.89%], test : [loss = 1.254, top1 = 68.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.48%], valid : [loss = 2.287, top1 = 41.12%], test : [loss = 2.276, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.628, top1 = 78.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9560/15625) 009560-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.61%], valid : [loss = 0.886, top1 = 69.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10        train : [loss = 0.730, top1 = 74.37%], test  : [loss = 0.781, top1 = 72.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.73 ms.
cifar100       train : [loss = 2.294, top1 = 39.92%], valid : [loss = 2.402, top1 = 37.37%], test : [loss = 2.398, top1 = 37.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.09 ms.
ImageNet16-120 train : [loss = 3.532, top1 = 17.40%], valid : [loss = 3.516, top1 = 18.05%], test : [loss = 3.544, top1 = 16.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.456, top1 = 46.70%], valid : [loss = 1.503, top1 = 45.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9561/15625) 009561-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.20%], valid : [loss = 0.859, top1 = 75.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10        train : [loss = 0.306, top1 = 89.31%], test  : [loss = 0.602, top1 = 81.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.41 ms.
cifar100       train : [loss = 1.358, top1 = 61.77%], valid : [loss = 1.943, top1 = 49.62%], test : [loss = 1.951, top1 = 49.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 3.507, top1 = 17.13%], valid : [loss = 3.528, top1 = 17.60%], test : [loss = 3.530, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.218, top1 = 55.91%], valid : [loss = 1.257, top1 = 54.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9562/15625) 009562-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.62%], valid : [loss = 0.709, top1 = 76.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.396, top1 = 86.18%], test  : [loss = 0.525, top1 = 82.45%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.46 ms.
cifar100       train : [loss = 1.650, top1 = 54.30%], valid : [loss = 1.886, top1 = 49.48%], test : [loss = 1.878, top1 = 50.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 20.99%], valid : [loss = 3.321, top1 = 21.17%], test : [loss = 3.367, top1 = 19.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.98%], valid : [loss = 1.257, top1 = 55.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9563/15625) 009563-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.55%], valid : [loss = 0.465, top1 = 86.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.155, top1 = 94.94%], test  : [loss = 0.354, top1 = 88.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.81 ms.
cifar100       train : [loss = 1.007, top1 = 71.34%], valid : [loss = 1.362, top1 = 61.80%], test : [loss = 1.351, top1 = 61.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.44%], valid : [loss = 2.684, top1 = 33.80%], test : [loss = 2.719, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9564/15625) 009564-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.635, top1 = 87.14%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.77 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.434, top1 = 90.75%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.05 ms.
cifar100       train : [loss = 0.167, top1 = 96.27%], valid : [loss = 1.606, top1 = 64.34%], test : [loss = 1.606, top1 = 64.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.14%], valid : [loss = 2.457, top1 = 37.73%], test : [loss = 2.474, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.38%], valid : [loss = 0.814, top1 = 71.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9565/15625) 009565-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.30%], valid : [loss = 0.461, top1 = 86.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10        train : [loss = 0.114, top1 = 96.46%], test  : [loss = 0.329, top1 = 89.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 0.874, top1 = 75.15%], valid : [loss = 1.307, top1 = 63.75%], test : [loss = 1.285, top1 = 63.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.46 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.55%], valid : [loss = 2.631, top1 = 34.57%], test : [loss = 2.655, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9566/15625) 009566-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.531, top1 = 88.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.350, top1 = 90.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.30 ms.
cifar100       train : [loss = 0.405, top1 = 88.35%], valid : [loss = 1.218, top1 = 67.62%], test : [loss = 1.244, top1 = 67.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 41.90%], valid : [loss = 2.409, top1 = 39.30%], test : [loss = 2.487, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.64%], valid : [loss = 0.788, top1 = 72.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9567/15625) 009567-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.585, top1 = 87.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.380, top1 = 91.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.02 ms.
cifar100       train : [loss = 0.395, top1 = 88.87%], valid : [loss = 1.369, top1 = 66.32%], test : [loss = 1.356, top1 = 66.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.45%], valid : [loss = 2.548, top1 = 35.70%], test : [loss = 2.571, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.03%], valid : [loss = 0.777, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9568/15625) 009568-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.556, top1 = 87.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.380, top1 = 91.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.15 ms.
cifar100       train : [loss = 0.360, top1 = 89.83%], valid : [loss = 1.386, top1 = 66.06%], test : [loss = 1.385, top1 = 66.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.24%], valid : [loss = 2.522, top1 = 37.00%], test : [loss = 2.530, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.28%], valid : [loss = 0.786, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9569/15625) 009569-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.33%], valid : [loss = 0.453, top1 = 87.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.108, top1 = 96.77%], test  : [loss = 0.332, top1 = 89.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 0.857, top1 = 75.48%], valid : [loss = 1.286, top1 = 64.26%], test : [loss = 1.272, top1 = 64.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.54%], valid : [loss = 2.595, top1 = 35.03%], test : [loss = 2.661, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.46%], valid : [loss = 0.659, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9570/15625) 009570-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.70 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9571/15625) 009571-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.513, top1 = 89.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.70 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.326, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.63 ms.
cifar100       train : [loss = 0.134, top1 = 97.34%], valid : [loss = 1.294, top1 = 68.66%], test : [loss = 1.325, top1 = 68.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.687, top1 = 54.78%], valid : [loss = 2.174, top1 = 44.57%], test : [loss = 2.142, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.72%], valid : [loss = 0.625, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9572/15625) 009572-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.444, top1 = 90.82%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.311, top1 = 93.32%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.52 ms.
cifar100       train : [loss = 0.048, top1 = 99.38%], valid : [loss = 1.347, top1 = 70.52%], test : [loss = 1.346, top1 = 70.86%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.69 ms.
ImageNet16-120 train : [loss = 1.461, top1 = 60.36%], valid : [loss = 2.233, top1 = 44.53%], test : [loss = 2.221, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.381, top1 = 87.02%], valid : [loss = 0.509, top1 = 83.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9573/15625) 009573-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.65%], valid : [loss = 0.631, top1 = 86.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.032, top1 = 99.16%], test  : [loss = 0.416, top1 = 90.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.66 ms.
cifar100       train : [loss = 0.508, top1 = 85.14%], valid : [loss = 1.435, top1 = 62.98%], test : [loss = 1.454, top1 = 62.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.17%], valid : [loss = 2.566, top1 = 35.23%], test : [loss = 2.606, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9574/15625) 009574-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.494, top1 = 89.13%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.78 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.353, top1 = 91.73%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.59 ms.
cifar100       train : [loss = 0.332, top1 = 90.95%], valid : [loss = 1.276, top1 = 67.36%], test : [loss = 1.271, top1 = 67.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.18%], valid : [loss = 2.435, top1 = 38.00%], test : [loss = 2.425, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.41%], valid : [loss = 0.652, top1 = 77.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9575/15625) 009575-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.554, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.380, top1 = 91.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.203, top1 = 95.18%], valid : [loss = 1.432, top1 = 66.79%], test : [loss = 1.433, top1 = 66.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.68%], valid : [loss = 2.433, top1 = 39.30%], test : [loss = 2.432, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.40%], valid : [loss = 0.714, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9576/15625) 009576-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.171, top1 = 94.40%], valid : [loss = 0.534, top1 = 84.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.32 ms.
cifar10        train : [loss = 0.181, top1 = 93.89%], test  : [loss = 0.387, top1 = 87.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.64 ms.
cifar100       train : [loss = 1.204, top1 = 65.85%], valid : [loss = 1.521, top1 = 58.48%], test : [loss = 1.504, top1 = 58.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.652, top1 = 33.69%], valid : [loss = 2.701, top1 = 32.33%], test : [loss = 2.725, top1 = 32.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.50%], valid : [loss = 0.952, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9577/15625) 009577-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.22%], valid : [loss = 0.587, top1 = 81.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10        train : [loss = 0.258, top1 = 91.15%], test  : [loss = 0.408, top1 = 86.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 1.441, top1 = 59.59%], valid : [loss = 1.699, top1 = 53.93%], test : [loss = 1.699, top1 = 54.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 2.957, top1 = 27.56%], valid : [loss = 2.977, top1 = 27.90%], test : [loss = 3.019, top1 = 26.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9578/15625) 009578-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.56%], valid : [loss = 0.731, top1 = 74.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.42 ms.
cifar10        train : [loss = 0.560, top1 = 80.78%], test  : [loss = 0.619, top1 = 78.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 2.010, top1 = 46.29%], valid : [loss = 2.134, top1 = 44.03%], test : [loss = 2.111, top1 = 44.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 3.259, top1 = 21.99%], valid : [loss = 3.237, top1 = 22.92%], test : [loss = 3.270, top1 = 21.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.80%], valid : [loss = 1.355, top1 = 51.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9579/15625) 009579-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.20%], valid : [loss = 0.458, top1 = 86.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.116, top1 = 96.42%], test  : [loss = 0.333, top1 = 89.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 0.862, top1 = 75.28%], valid : [loss = 1.276, top1 = 64.12%], test : [loss = 1.291, top1 = 63.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.566, top1 = 35.20%], valid : [loss = 2.661, top1 = 33.67%], test : [loss = 2.675, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.46%], valid : [loss = 0.659, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9580/15625) 009580-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.504, top1 = 89.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.322, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.21 ms.
cifar100       train : [loss = 0.167, top1 = 96.36%], valid : [loss = 1.270, top1 = 69.06%], test : [loss = 1.302, top1 = 69.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.30%], valid : [loss = 2.223, top1 = 42.82%], test : [loss = 2.256, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.626, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9581/15625) 009581-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.650, top1 = 76.94%], valid : [loss = 0.764, top1 = 74.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.60 ms.
cifar10        train : [loss = 0.532, top1 = 81.42%], test  : [loss = 0.613, top1 = 79.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.22 ms.
cifar100       train : [loss = 2.004, top1 = 45.62%], valid : [loss = 2.118, top1 = 43.02%], test : [loss = 2.153, top1 = 42.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 25.89%], valid : [loss = 3.010, top1 = 27.43%], test : [loss = 3.050, top1 = 26.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.139, top1 = 58.72%], valid : [loss = 1.182, top1 = 57.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9582/15625) 009582-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.99%], valid : [loss = 0.583, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.365, top1 = 91.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.44 ms.
cifar100       train : [loss = 0.177, top1 = 96.21%], valid : [loss = 1.395, top1 = 67.44%], test : [loss = 1.386, top1 = 67.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 47.28%], valid : [loss = 2.482, top1 = 37.33%], test : [loss = 2.495, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.06%], valid : [loss = 0.697, top1 = 75.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9583/15625) 009583-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.54%], valid : [loss = 0.760, top1 = 73.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.529, top1 = 81.68%], test  : [loss = 0.607, top1 = 79.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.14 ms.
cifar100       train : [loss = 2.054, top1 = 44.72%], valid : [loss = 2.178, top1 = 42.27%], test : [loss = 2.182, top1 = 42.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.86 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 25.92%], valid : [loss = 3.023, top1 = 26.03%], test : [loss = 3.060, top1 = 25.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9584/15625) 009584-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.40 ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.24%], valid : [loss = 0.968, top1 = 66.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.95 ms.
cifar10        train : [loss = 0.783, top1 = 72.56%], test  : [loss = 0.873, top1 = 69.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.02 ms.
cifar100       train : [loss = 2.119, top1 = 44.40%], valid : [loss = 2.297, top1 = 41.52%], test : [loss = 2.319, top1 = 40.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.58 ms.
ImageNet16-120 train : [loss = 3.744, top1 = 14.33%], valid : [loss = 3.780, top1 = 14.13%], test : [loss = 3.788, top1 = 13.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9585/15625) 009585-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.54 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.76 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.39 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.95 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9586/15625) 009586-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.98%], valid : [loss = 0.415, top1 = 91.30%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.67 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.258, top1 = 94.25%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.76 ms.
cifar100       train : [loss = 0.017, top1 = 99.91%], valid : [loss = 1.304, top1 = 72.02%], test : [loss = 1.252, top1 = 72.40%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 1.088, top1 = 69.77%], valid : [loss = 2.305, top1 = 45.30%], test : [loss = 2.260, top1 = 46.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.315, top1 = 89.37%], valid : [loss = 0.464, top1 = 84.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9587/15625) 009587-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.527, top1 = 89.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.96 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.386, top1 = 92.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.40 ms.
cifar100       train : [loss = 0.099, top1 = 98.24%], valid : [loss = 1.444, top1 = 68.20%], test : [loss = 1.477, top1 = 68.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.90%], valid : [loss = 2.434, top1 = 39.53%], test : [loss = 2.433, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9588/15625) 009588-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.26 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9589/15625) 009589-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.19%], valid : [loss = 0.679, top1 = 77.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10        train : [loss = 0.383, top1 = 86.62%], test  : [loss = 0.505, top1 = 83.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.88 ms.
cifar100       train : [loss = 1.691, top1 = 53.36%], valid : [loss = 1.888, top1 = 49.56%], test : [loss = 1.875, top1 = 49.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.34%], valid : [loss = 3.213, top1 = 23.00%], test : [loss = 3.274, top1 = 21.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.147, top1 = 58.73%], valid : [loss = 1.204, top1 = 56.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9590/15625) 009590-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.34%], valid : [loss = 0.509, top1 = 87.55%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10        train : [loss = 0.045, top1 = 98.69%], test  : [loss = 0.335, top1 = 91.09%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.61 ms.
cifar100       train : [loss = 0.571, top1 = 83.60%], valid : [loss = 1.320, top1 = 65.10%], test : [loss = 1.299, top1 = 65.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.45%], valid : [loss = 2.476, top1 = 37.83%], test : [loss = 2.541, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.92%], valid : [loss = 0.883, top1 = 68.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9591/15625) 009591-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.24%], valid : [loss = 0.649, top1 = 84.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.053, top1 = 98.42%], test  : [loss = 0.410, top1 = 89.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.68 ms.
cifar100       train : [loss = 0.619, top1 = 81.83%], valid : [loss = 1.435, top1 = 62.86%], test : [loss = 1.420, top1 = 63.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.462, top1 = 37.50%], valid : [loss = 2.620, top1 = 34.61%], test : [loss = 2.634, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.80%], valid : [loss = 0.864, top1 = 69.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9592/15625) 009592-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.22%], valid : [loss = 0.871, top1 = 70.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.693, top1 = 75.80%], test  : [loss = 0.776, top1 = 73.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.92 ms.
cifar100       train : [loss = 1.972, top1 = 47.77%], valid : [loss = 2.120, top1 = 45.11%], test : [loss = 2.155, top1 = 44.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.79%], valid : [loss = 3.667, top1 = 16.12%], test : [loss = 3.694, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9593/15625) 009593-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.12 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.57%], valid : [loss = 0.577, top1 = 87.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.31 ms.
cifar10        train : [loss = 0.042, top1 = 98.75%], test  : [loss = 0.407, top1 = 89.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.60 ms.
cifar100       train : [loss = 0.554, top1 = 83.62%], valid : [loss = 1.426, top1 = 63.14%], test : [loss = 1.399, top1 = 63.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.88%], valid : [loss = 2.635, top1 = 34.50%], test : [loss = 2.646, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9594/15625) 009594-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.67%], valid : [loss = 0.496, top1 = 88.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.343, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.29 ms.
cifar100       train : [loss = 0.484, top1 = 85.71%], valid : [loss = 1.378, top1 = 65.12%], test : [loss = 1.372, top1 = 64.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.92%], valid : [loss = 2.537, top1 = 35.30%], test : [loss = 2.568, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.61%], valid : [loss = 0.697, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9595/15625) 009595-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.592, top1 = 87.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.383, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.415, top1 = 88.19%], valid : [loss = 1.383, top1 = 65.72%], test : [loss = 1.384, top1 = 65.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.81%], valid : [loss = 2.511, top1 = 36.67%], test : [loss = 2.510, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.25%], valid : [loss = 0.819, top1 = 71.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9596/15625) 009596-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.500, top1 = 90.07%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=25.21 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.302, top1 = 93.58%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=22.35 ms.
cifar100       train : [loss = 0.059, top1 = 99.14%], valid : [loss = 1.304, top1 = 70.90%], test : [loss = 1.313, top1 = 70.98%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=19.06 ms.
ImageNet16-120 train : [loss = 1.524, top1 = 58.83%], valid : [loss = 2.200, top1 = 44.60%], test : [loss = 2.141, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.92%], valid : [loss = 0.641, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9597/15625) 009597-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=137.54 M, Params=0.964 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.52%]
cifar10        FLOP=137.54 M, Params=0.964 MB, latency=19.21 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.324, top1 = 93.35%]
cifar100       FLOP=137.55 M, Params=0.970 MB, latency=17.78 ms.
cifar100       train : [loss = 0.069, top1 = 98.93%], valid : [loss = 1.388, top1 = 69.29%], test : [loss = 1.353, top1 = 69.65%]
ImageNet16-120 FLOP= 34.39 M, Params=0.972 MB, latency=19.11 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.15%], valid : [loss = 2.329, top1 = 40.86%], test : [loss = 2.331, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.14%], valid : [loss = 0.674, top1 = 76.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9598/15625) 009598-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.657, top1 = 85.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.035, top1 = 98.99%], test  : [loss = 0.448, top1 = 89.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.96 ms.
cifar100       train : [loss = 0.422, top1 = 88.24%], valid : [loss = 1.373, top1 = 64.88%], test : [loss = 1.382, top1 = 65.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.85%], valid : [loss = 2.598, top1 = 35.50%], test : [loss = 2.636, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.42%], valid : [loss = 0.799, top1 = 72.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9599/15625) 009599-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.520, top1 = 88.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.355, top1 = 91.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.19 ms.
cifar100       train : [loss = 0.296, top1 = 91.76%], valid : [loss = 1.366, top1 = 66.94%], test : [loss = 1.299, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.78%], valid : [loss = 2.329, top1 = 40.57%], test : [loss = 2.375, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.44%], valid : [loss = 0.624, top1 = 78.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9600/15625) 009600-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.49%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.73 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.309, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.40 ms.
cifar100       train : [loss = 0.120, top1 = 97.61%], valid : [loss = 1.269, top1 = 69.64%], test : [loss = 1.303, top1 = 69.35%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 51.96%], valid : [loss = 2.280, top1 = 42.14%], test : [loss = 2.265, top1 = 42.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.88%], valid : [loss = 0.660, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9601/15625) 009601-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.455, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.322, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 0.331, top1 = 90.92%], valid : [loss = 1.276, top1 = 67.58%], test : [loss = 1.300, top1 = 67.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.39%], valid : [loss = 2.340, top1 = 40.62%], test : [loss = 2.392, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.00%], valid : [loss = 0.556, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9602/15625) 009602-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.20%], valid : [loss = 0.882, top1 = 71.02%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10        train : [loss = 0.565, top1 = 80.38%], test  : [loss = 0.719, top1 = 75.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 1.768, top1 = 52.41%], valid : [loss = 2.038, top1 = 47.86%], test : [loss = 2.060, top1 = 46.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.48 ms.
ImageNet16-120 train : [loss = 3.592, top1 = 16.81%], valid : [loss = 3.648, top1 = 16.93%], test : [loss = 3.669, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9603/15625) 009603-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.44%], valid : [loss = 0.568, top1 = 87.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.034, top1 = 99.04%], test  : [loss = 0.366, top1 = 91.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.93 ms.
cifar100       train : [loss = 0.522, top1 = 85.01%], valid : [loss = 1.354, top1 = 64.42%], test : [loss = 1.372, top1 = 63.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 2.572, top1 = 34.64%], valid : [loss = 2.620, top1 = 33.47%], test : [loss = 2.663, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 70.20%], valid : [loss = 0.871, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9604/15625) 009604-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.534, top1 = 89.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.343, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.47 ms.
cifar100       train : [loss = 0.199, top1 = 95.35%], valid : [loss = 1.290, top1 = 68.06%], test : [loss = 1.288, top1 = 68.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.29%], valid : [loss = 2.258, top1 = 41.70%], test : [loss = 2.268, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.67%], valid : [loss = 0.798, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9605/15625) 009605-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.69%], valid : [loss = 0.592, top1 = 86.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.422, top1 = 89.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.26 ms.
cifar100       train : [loss = 0.528, top1 = 84.52%], valid : [loss = 1.386, top1 = 63.58%], test : [loss = 1.370, top1 = 63.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.48%], valid : [loss = 2.563, top1 = 35.83%], test : [loss = 2.596, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.89%], valid : [loss = 0.868, top1 = 69.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9606/15625) 009606-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.87%], valid : [loss = 0.865, top1 = 80.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.92 ms.
cifar10        train : [loss = 0.136, top1 = 95.35%], test  : [loss = 0.564, top1 = 84.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.63 ms.
cifar100       train : [loss = 0.879, top1 = 74.52%], valid : [loss = 1.687, top1 = 56.66%], test : [loss = 1.688, top1 = 57.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 3.017, top1 = 26.67%], valid : [loss = 3.131, top1 = 24.90%], test : [loss = 3.195, top1 = 24.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.044, top1 = 62.28%], valid : [loss = 1.106, top1 = 60.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9607/15625) 009607-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.58%], valid : [loss = 0.830, top1 = 71.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10        train : [loss = 0.715, top1 = 75.09%], test  : [loss = 0.792, top1 = 72.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.64 ms.
cifar100       train : [loss = 1.966, top1 = 47.74%], valid : [loss = 2.134, top1 = 44.68%], test : [loss = 2.156, top1 = 44.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.23 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.63%], valid : [loss = 3.679, top1 = 16.07%], test : [loss = 3.702, top1 = 14.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.386, top1 = 49.77%], valid : [loss = 1.406, top1 = 49.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9608/15625) 009608-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=21.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.500, top1 = 90.04%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=23.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.327, top1 = 92.90%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=21.49 ms.
cifar100       train : [loss = 0.108, top1 = 98.08%], valid : [loss = 1.306, top1 = 69.76%], test : [loss = 1.331, top1 = 68.94%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=19.64 ms.
ImageNet16-120 train : [loss = 1.585, top1 = 57.10%], valid : [loss = 2.128, top1 = 44.97%], test : [loss = 2.173, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.86%], valid : [loss = 0.669, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9609/15625) 009609-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.468, top1 = 89.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.314, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.78 ms.
cifar100       train : [loss = 0.297, top1 = 92.24%], valid : [loss = 1.239, top1 = 67.24%], test : [loss = 1.247, top1 = 68.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.34%], valid : [loss = 2.269, top1 = 42.07%], test : [loss = 2.315, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.13%], valid : [loss = 0.643, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9610/15625) 009610-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.33%], valid : [loss = 0.618, top1 = 85.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.073, top1 = 97.73%], test  : [loss = 0.393, top1 = 88.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 0.714, top1 = 79.19%], valid : [loss = 1.393, top1 = 63.22%], test : [loss = 1.397, top1 = 62.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.91%], valid : [loss = 2.646, top1 = 33.54%], test : [loss = 2.695, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9611/15625) 009611-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=10.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.456, top1 = 88.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.334, top1 = 91.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.01 ms.
cifar100       train : [loss = 0.327, top1 = 91.13%], valid : [loss = 1.302, top1 = 67.22%], test : [loss = 1.323, top1 = 67.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.87 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.36%], valid : [loss = 2.387, top1 = 40.00%], test : [loss = 2.412, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9612/15625) 009612-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.437, top1 = 90.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.25 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.304, top1 = 93.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.75 ms.
cifar100       train : [loss = 0.068, top1 = 98.94%], valid : [loss = 1.317, top1 = 70.58%], test : [loss = 1.379, top1 = 70.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 1.527, top1 = 58.79%], valid : [loss = 2.226, top1 = 44.43%], test : [loss = 2.251, top1 = 45.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.23%], valid : [loss = 0.509, top1 = 83.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9613/15625) 009613-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.29%], valid : [loss = 0.629, top1 = 85.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10        train : [loss = 0.061, top1 = 98.15%], test  : [loss = 0.423, top1 = 89.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.13 ms.
cifar100       train : [loss = 0.676, top1 = 80.22%], valid : [loss = 1.386, top1 = 63.43%], test : [loss = 1.367, top1 = 63.73%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.34%], valid : [loss = 2.658, top1 = 33.31%], test : [loss = 2.681, top1 = 32.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.68%], valid : [loss = 0.803, top1 = 71.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9614/15625) 009614-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.35%], valid : [loss = 0.460, top1 = 86.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.344, top1 = 88.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 0.974, top1 = 72.33%], valid : [loss = 1.348, top1 = 62.41%], test : [loss = 1.348, top1 = 62.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.82%], valid : [loss = 2.687, top1 = 33.02%], test : [loss = 2.715, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9615/15625) 009615-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.62 ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.59%], valid : [loss = 1.015, top1 = 65.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10        train : [loss = 0.807, top1 = 71.70%], test  : [loss = 0.887, top1 = 68.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.57 ms.
cifar100       train : [loss = 2.152, top1 = 43.74%], valid : [loss = 2.338, top1 = 40.50%], test : [loss = 2.350, top1 = 40.46%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.66 ms.
ImageNet16-120 train : [loss = 3.746, top1 = 14.27%], valid : [loss = 3.761, top1 = 14.63%], test : [loss = 3.761, top1 = 13.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9616/15625) 009616-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.61%], valid : [loss = 0.581, top1 = 85.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10        train : [loss = 0.069, top1 = 98.00%], test  : [loss = 0.375, top1 = 89.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.60 ms.
cifar100       train : [loss = 0.666, top1 = 80.68%], valid : [loss = 1.361, top1 = 63.74%], test : [loss = 1.359, top1 = 64.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.399, top1 = 38.75%], valid : [loss = 2.508, top1 = 36.73%], test : [loss = 2.544, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.39%], valid : [loss = 0.871, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9617/15625) 009617-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.553, top1 = 88.26%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.346, top1 = 92.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.03 ms.
cifar100       train : [loss = 0.138, top1 = 96.94%], valid : [loss = 1.429, top1 = 67.40%], test : [loss = 1.454, top1 = 67.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.04%], valid : [loss = 2.436, top1 = 37.87%], test : [loss = 2.414, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.20%], valid : [loss = 0.918, top1 = 67.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9618/15625) 009618-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.513, top1 = 89.44%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.309, top1 = 93.02%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.70 ms.
cifar100       train : [loss = 0.129, top1 = 97.53%], valid : [loss = 1.317, top1 = 69.52%], test : [loss = 1.281, top1 = 69.58%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 1.845, top1 = 51.18%], valid : [loss = 2.279, top1 = 42.07%], test : [loss = 2.251, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 77.11%], valid : [loss = 0.713, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9619/15625) 009619-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.97%], valid : [loss = 0.920, top1 = 67.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.74 ms.
cifar10        train : [loss = 0.653, top1 = 77.25%], test  : [loss = 0.703, top1 = 75.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.26 ms.
cifar100       train : [loss = 2.236, top1 = 40.40%], valid : [loss = 2.333, top1 = 38.80%], test : [loss = 2.348, top1 = 38.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 3.503, top1 = 17.59%], valid : [loss = 3.464, top1 = 18.23%], test : [loss = 3.505, top1 = 17.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.363, top1 = 50.38%], valid : [loss = 1.404, top1 = 49.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9620/15625) 009620-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.483, top1 = 90.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.332, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.40 ms.
cifar100       train : [loss = 0.143, top1 = 96.94%], valid : [loss = 1.343, top1 = 67.84%], test : [loss = 1.332, top1 = 69.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 1.705, top1 = 54.38%], valid : [loss = 2.194, top1 = 43.20%], test : [loss = 2.196, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.53%], valid : [loss = 0.669, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9621/15625) 009621-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.88%], valid : [loss = 0.544, top1 = 88.91%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10        train : [loss = 0.008, top1 = 99.79%], test  : [loss = 0.365, top1 = 92.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.25 ms.
cifar100       train : [loss = 0.186, top1 = 95.70%], valid : [loss = 1.470, top1 = 65.68%], test : [loss = 1.509, top1 = 64.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 2.441, top1 = 37.21%], valid : [loss = 2.617, top1 = 34.10%], test : [loss = 2.626, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.90%], valid : [loss = 0.900, top1 = 67.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9622/15625) 009622-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.649, top1 = 86.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.445, top1 = 90.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.39 ms.
cifar100       train : [loss = 0.243, top1 = 93.87%], valid : [loss = 1.432, top1 = 65.82%], test : [loss = 1.447, top1 = 66.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.199, top1 = 43.18%], valid : [loss = 2.551, top1 = 37.23%], test : [loss = 2.603, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.20%], valid : [loss = 0.764, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9623/15625) 009623-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.512, top1 = 88.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.346, top1 = 91.72%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.35 ms.
cifar100       train : [loss = 0.341, top1 = 90.83%], valid : [loss = 1.295, top1 = 66.24%], test : [loss = 1.274, top1 = 67.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.32%], valid : [loss = 2.421, top1 = 38.63%], test : [loss = 2.450, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.22%], valid : [loss = 0.657, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9624/15625) 009624-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.67%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.345, top1 = 92.88%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.19 ms.
cifar100       train : [loss = 0.114, top1 = 97.79%], valid : [loss = 1.372, top1 = 69.00%], test : [loss = 1.383, top1 = 68.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.46%], valid : [loss = 2.275, top1 = 41.73%], test : [loss = 2.289, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.03%], valid : [loss = 0.802, top1 = 72.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9625/15625) 009625-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.90 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9626/15625) 009626-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.498, top1 = 88.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.324, top1 = 92.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.07 ms.
cifar100       train : [loss = 0.349, top1 = 90.45%], valid : [loss = 1.242, top1 = 67.64%], test : [loss = 1.278, top1 = 67.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.58%], valid : [loss = 2.417, top1 = 39.10%], test : [loss = 2.388, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9627/15625) 009627-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.76 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.11%], valid : [loss = 0.682, top1 = 84.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10        train : [loss = 0.046, top1 = 98.65%], test  : [loss = 0.384, top1 = 89.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.29 ms.
cifar100       train : [loss = 0.655, top1 = 80.63%], valid : [loss = 1.500, top1 = 61.88%], test : [loss = 1.507, top1 = 61.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.457, top1 = 37.62%], valid : [loss = 2.623, top1 = 34.53%], test : [loss = 2.637, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.80%], valid : [loss = 0.853, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9628/15625) 009628-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.349, top1 = 87.83%], valid : [loss = 0.624, top1 = 79.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10        train : [loss = 0.290, top1 = 89.98%], test  : [loss = 0.450, top1 = 85.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.26 ms.
cifar100       train : [loss = 1.490, top1 = 57.98%], valid : [loss = 1.708, top1 = 53.30%], test : [loss = 1.741, top1 = 52.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.878, top1 = 28.93%], valid : [loss = 2.885, top1 = 29.00%], test : [loss = 2.946, top1 = 27.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.56%], valid : [loss = 1.053, top1 = 62.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9629/15625) 009629-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.15%], valid : [loss = 0.963, top1 = 66.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10        train : [loss = 0.768, top1 = 73.03%], test  : [loss = 0.854, top1 = 70.11%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.27 ms.
cifar100       train : [loss = 2.155, top1 = 43.51%], valid : [loss = 2.343, top1 = 41.08%], test : [loss = 2.376, top1 = 39.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 3.738, top1 = 14.25%], valid : [loss = 3.771, top1 = 14.13%], test : [loss = 3.769, top1 = 13.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.463, top1 = 46.40%], valid : [loss = 1.488, top1 = 45.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9630/15625) 009630-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.56%], valid : [loss = 0.593, top1 = 84.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.63 ms.
cifar10        train : [loss = 0.090, top1 = 97.04%], test  : [loss = 0.426, top1 = 87.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.728, top1 = 78.50%], valid : [loss = 1.509, top1 = 60.68%], test : [loss = 1.540, top1 = 60.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 3.210, top1 = 21.96%], valid : [loss = 3.204, top1 = 21.73%], test : [loss = 3.237, top1 = 21.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.050, top1 = 62.06%], valid : [loss = 1.066, top1 = 61.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9631/15625) 009631-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.479, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.336, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.65 ms.
cifar100       train : [loss = 0.267, top1 = 92.91%], valid : [loss = 1.343, top1 = 67.06%], test : [loss = 1.350, top1 = 67.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.11%], valid : [loss = 2.336, top1 = 40.37%], test : [loss = 2.393, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.493, top1 = 82.87%], valid : [loss = 0.595, top1 = 79.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9632/15625) 009632-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 74.63 M, Params=0.534 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.541, top1 = 88.61%]
cifar10        FLOP= 74.63 M, Params=0.534 MB, latency=19.07 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.352, top1 = 91.89%]
cifar100       FLOP= 74.64 M, Params=0.540 MB, latency=18.02 ms.
cifar100       train : [loss = 0.301, top1 = 91.61%], valid : [loss = 1.293, top1 = 67.70%], test : [loss = 1.291, top1 = 68.15%]
ImageNet16-120 FLOP= 18.67 M, Params=0.542 MB, latency=20.11 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.81%], valid : [loss = 2.312, top1 = 41.29%], test : [loss = 2.341, top1 = 40.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.74%], valid : [loss = 0.820, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9633/15625) 009633-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.78%], valid : [loss = 0.517, top1 = 86.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.076, top1 = 97.79%], test  : [loss = 0.337, top1 = 90.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.667, top1 = 80.60%], valid : [loss = 1.299, top1 = 65.52%], test : [loss = 1.290, top1 = 65.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.79%], valid : [loss = 2.536, top1 = 35.60%], test : [loss = 2.541, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.51%], valid : [loss = 0.883, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9634/15625) 009634-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.36%], valid : [loss = 0.598, top1 = 85.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.068, top1 = 97.99%], test  : [loss = 0.414, top1 = 88.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.26 ms.
cifar100       train : [loss = 0.699, top1 = 79.68%], valid : [loss = 1.379, top1 = 63.26%], test : [loss = 1.359, top1 = 63.81%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.97%], valid : [loss = 2.670, top1 = 33.29%], test : [loss = 2.697, top1 = 33.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9635/15625) 009635-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.442, top1 = 90.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.311, top1 = 93.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.85 ms.
cifar100       train : [loss = 0.060, top1 = 99.10%], valid : [loss = 1.384, top1 = 70.70%], test : [loss = 1.341, top1 = 71.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 1.505, top1 = 59.12%], valid : [loss = 2.247, top1 = 44.70%], test : [loss = 2.292, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.362, top1 = 87.60%], valid : [loss = 0.505, top1 = 83.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9636/15625) 009636-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.544, top1 = 89.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.376, top1 = 92.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.99 ms.
cifar100       train : [loss = 0.105, top1 = 98.05%], valid : [loss = 1.521, top1 = 66.08%], test : [loss = 1.476, top1 = 67.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.00%], valid : [loss = 2.467, top1 = 39.17%], test : [loss = 2.479, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9637/15625) 009637-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.574, top1 = 87.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.384, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.388, top1 = 89.05%], valid : [loss = 1.400, top1 = 65.22%], test : [loss = 1.390, top1 = 65.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.68%], valid : [loss = 2.472, top1 = 37.57%], test : [loss = 2.506, top1 = 37.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.17%], valid : [loss = 0.773, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9638/15625) 009638-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.68%], valid : [loss = 0.856, top1 = 72.02%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.20 ms.
cifar10        train : [loss = 0.559, top1 = 80.50%], test  : [loss = 0.727, top1 = 75.27%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.03 ms.
cifar100       train : [loss = 1.798, top1 = 51.43%], valid : [loss = 2.057, top1 = 47.16%], test : [loss = 2.077, top1 = 46.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.25 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.71%], valid : [loss = 3.637, top1 = 16.73%], test : [loss = 3.666, top1 = 14.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9639/15625) 009639-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.570, top1 = 87.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.385, top1 = 91.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.42 ms.
cifar100       train : [loss = 0.408, top1 = 88.26%], valid : [loss = 1.365, top1 = 64.88%], test : [loss = 1.380, top1 = 65.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.89%], valid : [loss = 2.493, top1 = 37.50%], test : [loss = 2.562, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.06%], valid : [loss = 0.835, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9640/15625) 009640-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.426, top1 = 91.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.297, top1 = 93.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.064, top1 = 99.07%], valid : [loss = 1.340, top1 = 70.24%], test : [loss = 1.356, top1 = 70.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.513, top1 = 59.00%], valid : [loss = 2.208, top1 = 45.30%], test : [loss = 2.245, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 86.99%], valid : [loss = 0.506, top1 = 83.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9641/15625) 009641-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.27%], valid : [loss = 0.444, top1 = 86.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10        train : [loss = 0.167, top1 = 94.64%], test  : [loss = 0.354, top1 = 88.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.52 ms.
cifar100       train : [loss = 1.007, top1 = 71.42%], valid : [loss = 1.361, top1 = 62.04%], test : [loss = 1.350, top1 = 62.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.15%], valid : [loss = 2.677, top1 = 33.00%], test : [loss = 2.717, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9642/15625) 009642-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.519, top1 = 88.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.337, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.348, top1 = 90.52%], valid : [loss = 1.254, top1 = 67.60%], test : [loss = 1.291, top1 = 66.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.21%], valid : [loss = 2.435, top1 = 38.77%], test : [loss = 2.434, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9643/15625) 009643-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.35%], valid : [loss = 0.862, top1 = 71.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10        train : [loss = 0.547, top1 = 80.89%], test  : [loss = 0.718, top1 = 75.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.16 ms.
cifar100       train : [loss = 1.773, top1 = 52.04%], valid : [loss = 2.042, top1 = 46.50%], test : [loss = 2.074, top1 = 46.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.85%], valid : [loss = 3.622, top1 = 16.47%], test : [loss = 3.677, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9644/15625) 009644-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.59%], valid : [loss = 0.458, top1 = 86.52%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.51 ms.
cifar10        train : [loss = 0.126, top1 = 96.06%], test  : [loss = 0.345, top1 = 89.03%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=13.85 ms.
cifar100       train : [loss = 0.738, top1 = 79.30%], valid : [loss = 1.281, top1 = 65.12%], test : [loss = 1.271, top1 = 64.72%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.517, top1 = 36.40%], valid : [loss = 2.623, top1 = 34.17%], test : [loss = 2.624, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9645/15625) 009645-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.07 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9646/15625) 009646-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.292, top1 = 89.97%], valid : [loss = 0.876, top1 = 74.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10        train : [loss = 0.302, top1 = 89.51%], test  : [loss = 0.605, top1 = 81.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.42 ms.
cifar100       train : [loss = 1.377, top1 = 61.37%], valid : [loss = 1.928, top1 = 50.10%], test : [loss = 1.953, top1 = 50.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 3.469, top1 = 17.88%], valid : [loss = 3.511, top1 = 17.23%], test : [loss = 3.485, top1 = 16.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9647/15625) 009647-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.544, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.348, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.283, top1 = 92.49%], valid : [loss = 1.310, top1 = 67.76%], test : [loss = 1.299, top1 = 67.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.090, top1 = 45.50%], valid : [loss = 2.380, top1 = 39.37%], test : [loss = 2.384, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.23%], valid : [loss = 0.851, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9648/15625) 009648-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.487, top1 = 90.30%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.33 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.307, top1 = 93.45%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.70 ms.
cifar100       train : [loss = 0.060, top1 = 99.20%], valid : [loss = 1.241, top1 = 71.66%], test : [loss = 1.210, top1 = 72.40%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.32 ms.
ImageNet16-120 train : [loss = 1.536, top1 = 58.38%], valid : [loss = 2.128, top1 = 44.97%], test : [loss = 2.134, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.84%], valid : [loss = 0.635, top1 = 78.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9649/15625) 009649-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.22%], valid : [loss = 0.460, top1 = 86.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.113, top1 = 96.55%], test  : [loss = 0.337, top1 = 89.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.93 ms.
cifar100       train : [loss = 0.859, top1 = 75.55%], valid : [loss = 1.312, top1 = 64.12%], test : [loss = 1.268, top1 = 64.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.565, top1 = 35.49%], valid : [loss = 2.628, top1 = 34.50%], test : [loss = 2.682, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.21%], valid : [loss = 0.663, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9650/15625) 009650-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.86%], valid : [loss = 0.482, top1 = 84.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.302, top1 = 89.94%], test  : [loss = 0.399, top1 = 86.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.47 ms.
cifar100       train : [loss = 1.337, top1 = 62.80%], valid : [loss = 1.562, top1 = 57.80%], test : [loss = 1.500, top1 = 58.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.67%], valid : [loss = 2.900, top1 = 30.47%], test : [loss = 2.978, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9651/15625) 009651-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.613, top1 = 87.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.28 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.383, top1 = 91.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.67 ms.
cifar100       train : [loss = 0.157, top1 = 96.61%], valid : [loss = 1.577, top1 = 64.80%], test : [loss = 1.533, top1 = 65.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.42 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.99%], valid : [loss = 2.443, top1 = 39.47%], test : [loss = 2.444, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.17%], valid : [loss = 0.796, top1 = 72.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9652/15625) 009652-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.449, top1 = 89.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.310, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.332, top1 = 90.96%], valid : [loss = 1.300, top1 = 67.56%], test : [loss = 1.309, top1 = 67.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.06%], valid : [loss = 2.380, top1 = 39.50%], test : [loss = 2.384, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.462, top1 = 84.10%], valid : [loss = 0.561, top1 = 80.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9653/15625) 009653-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.04%], valid : [loss = 0.621, top1 = 85.85%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.54 ms.
cifar10        train : [loss = 0.021, top1 = 99.33%], test  : [loss = 0.383, top1 = 91.37%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.82 ms.
cifar100       train : [loss = 0.289, top1 = 91.76%], valid : [loss = 1.420, top1 = 66.12%], test : [loss = 1.480, top1 = 66.06%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.92 ms.
ImageNet16-120 train : [loss = 2.894, top1 = 27.54%], valid : [loss = 2.986, top1 = 26.13%], test : [loss = 3.020, top1 = 25.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.343, top1 = 49.82%], valid : [loss = 1.354, top1 = 49.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9654/15625) 009654-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.29%], valid : [loss = 0.449, top1 = 87.09%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=14.75 ms.
cifar10        train : [loss = 0.116, top1 = 96.39%], test  : [loss = 0.328, top1 = 89.57%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=14.69 ms.
cifar100       train : [loss = 0.864, top1 = 75.42%], valid : [loss = 1.296, top1 = 64.11%], test : [loss = 1.279, top1 = 64.18%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=12.01 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.67%], valid : [loss = 2.620, top1 = 34.38%], test : [loss = 2.651, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.46%], valid : [loss = 0.659, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9655/15625) 009655-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.622, top1 = 86.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.08 ms.
cifar10        train : [loss = 0.031, top1 = 99.15%], test  : [loss = 0.399, top1 = 90.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.509, top1 = 85.16%], valid : [loss = 1.379, top1 = 64.52%], test : [loss = 1.327, top1 = 65.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.42%], valid : [loss = 2.527, top1 = 36.67%], test : [loss = 2.566, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.08%], valid : [loss = 0.827, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9656/15625) 009656-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.96%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.294, top1 = 93.50%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.62 ms.
cifar100       train : [loss = 0.056, top1 = 99.26%], valid : [loss = 1.370, top1 = 70.74%], test : [loss = 1.341, top1 = 71.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 1.504, top1 = 59.26%], valid : [loss = 2.199, top1 = 44.50%], test : [loss = 2.231, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.55%], valid : [loss = 0.509, top1 = 83.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9657/15625) 009657-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.539, top1 = 89.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.341, top1 = 92.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.16 ms.
cifar100       train : [loss = 0.143, top1 = 96.67%], valid : [loss = 1.356, top1 = 68.52%], test : [loss = 1.406, top1 = 68.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.63%], valid : [loss = 2.383, top1 = 40.03%], test : [loss = 2.327, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 67.81%], valid : [loss = 0.933, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9658/15625) 009658-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.567, top1 = 87.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.401, top1 = 91.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.406, top1 = 88.54%], valid : [loss = 1.399, top1 = 65.36%], test : [loss = 1.425, top1 = 65.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.57%], valid : [loss = 2.498, top1 = 36.97%], test : [loss = 2.563, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9659/15625) 009659-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.568, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.79 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.379, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.172, top1 = 96.28%], valid : [loss = 1.420, top1 = 66.64%], test : [loss = 1.442, top1 = 67.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 48.00%], valid : [loss = 2.451, top1 = 38.43%], test : [loss = 2.475, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9660/15625) 009660-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.78%], valid : [loss = 0.573, top1 = 82.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.40 ms.
cifar10        train : [loss = 0.208, top1 = 92.99%], test  : [loss = 0.410, top1 = 87.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.24 ms.
cifar100       train : [loss = 1.287, top1 = 63.50%], valid : [loss = 1.578, top1 = 56.36%], test : [loss = 1.578, top1 = 56.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.706, top1 = 32.40%], valid : [loss = 2.766, top1 = 31.90%], test : [loss = 2.762, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.37%], valid : [loss = 0.986, top1 = 64.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9661/15625) 009661-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.484, top1 = 89.85%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.323, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=15.75 ms.
cifar100       train : [loss = 0.084, top1 = 98.52%], valid : [loss = 1.392, top1 = 69.20%], test : [loss = 1.350, top1 = 69.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.49 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 51.72%], valid : [loss = 2.220, top1 = 43.00%], test : [loss = 2.225, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.71%], valid : [loss = 0.854, top1 = 69.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9662/15625) 009662-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.77%], valid : [loss = 0.486, top1 = 84.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=9.91 ms.
cifar10        train : [loss = 0.291, top1 = 90.06%], test  : [loss = 0.404, top1 = 86.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.48 ms.
cifar100       train : [loss = 1.272, top1 = 64.26%], valid : [loss = 1.495, top1 = 59.26%], test : [loss = 1.481, top1 = 58.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.873, top1 = 29.53%], valid : [loss = 2.874, top1 = 29.03%], test : [loss = 2.910, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.949, top1 = 66.03%], valid : [loss = 0.957, top1 = 65.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9663/15625) 009663-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.38 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.300, top1 = 92.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.145, top1 = 96.97%], valid : [loss = 1.341, top1 = 68.75%], test : [loss = 1.324, top1 = 68.75%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 1.773, top1 = 52.90%], valid : [loss = 2.262, top1 = 43.18%], test : [loss = 2.304, top1 = 42.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.96%], valid : [loss = 0.543, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9664/15625) 009664-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.75%], valid : [loss = 0.600, top1 = 87.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.60 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.400, top1 = 91.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.52 ms.
cifar100       train : [loss = 0.338, top1 = 90.54%], valid : [loss = 1.460, top1 = 63.72%], test : [loss = 1.415, top1 = 65.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.728, top1 = 31.01%], valid : [loss = 2.820, top1 = 28.30%], test : [loss = 2.801, top1 = 29.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.21%], valid : [loss = 1.221, top1 = 55.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9665/15625) 009665-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.03 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.75%], valid : [loss = 0.675, top1 = 76.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 0.533, top1 = 81.45%], test  : [loss = 0.590, top1 = 80.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.05 ms.
cifar100       train : [loss = 1.771, top1 = 52.11%], valid : [loss = 1.937, top1 = 49.00%], test : [loss = 1.927, top1 = 49.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 3.411, top1 = 19.74%], valid : [loss = 3.406, top1 = 20.53%], test : [loss = 3.419, top1 = 18.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.378, top1 = 49.92%], valid : [loss = 1.393, top1 = 49.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9666/15625) 009666-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.08 ms.
cifar10-valid  train : [loss = 0.304, top1 = 89.57%], valid : [loss = 0.505, top1 = 83.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.275, top1 = 90.63%], test  : [loss = 0.393, top1 = 86.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.55 ms.
cifar100       train : [loss = 1.318, top1 = 62.71%], valid : [loss = 1.526, top1 = 58.38%], test : [loss = 1.542, top1 = 56.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.831, top1 = 30.26%], valid : [loss = 2.833, top1 = 30.20%], test : [loss = 2.886, top1 = 29.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 64.06%], valid : [loss = 1.015, top1 = 63.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9667/15625) 009667-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.608, top1 = 86.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.44 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.433, top1 = 90.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.24 ms.
cifar100       train : [loss = 0.262, top1 = 93.19%], valid : [loss = 1.553, top1 = 63.36%], test : [loss = 1.516, top1 = 64.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.98 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.51%], valid : [loss = 2.606, top1 = 36.00%], test : [loss = 2.601, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.02%], valid : [loss = 0.809, top1 = 71.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9668/15625) 009668-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.535, top1 = 89.56%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.76 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.346, top1 = 92.86%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.38 ms.
cifar100       train : [loss = 0.080, top1 = 98.59%], valid : [loss = 1.381, top1 = 69.25%], test : [loss = 1.388, top1 = 69.19%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.70%], valid : [loss = 2.300, top1 = 40.93%], test : [loss = 2.308, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.18%], valid : [loss = 0.664, top1 = 77.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9669/15625) 009669-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.10%], valid : [loss = 0.558, top1 = 87.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10        train : [loss = 0.062, top1 = 98.04%], test  : [loss = 0.367, top1 = 89.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.46 ms.
cifar100       train : [loss = 0.641, top1 = 81.08%], valid : [loss = 1.296, top1 = 65.32%], test : [loss = 1.293, top1 = 65.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.399, top1 = 38.64%], valid : [loss = 2.543, top1 = 36.13%], test : [loss = 2.529, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9670/15625) 009670-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.53%], valid : [loss = 0.770, top1 = 73.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.537, top1 = 81.36%], test  : [loss = 0.614, top1 = 78.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.34 ms.
cifar100       train : [loss = 1.868, top1 = 49.01%], valid : [loss = 2.000, top1 = 45.92%], test : [loss = 2.023, top1 = 45.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 3.064, top1 = 25.30%], valid : [loss = 3.031, top1 = 25.83%], test : [loss = 3.093, top1 = 24.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.159, top1 = 57.98%], valid : [loss = 1.195, top1 = 57.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9671/15625) 009671-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.74 ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.92%], valid : [loss = 0.850, top1 = 71.06%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 0.685, top1 = 76.01%], test  : [loss = 0.771, top1 = 73.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.13 ms.
cifar100       train : [loss = 1.967, top1 = 47.69%], valid : [loss = 2.138, top1 = 44.37%], test : [loss = 2.158, top1 = 44.35%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.35 ms.
ImageNet16-120 train : [loss = 3.646, top1 = 15.81%], valid : [loss = 3.668, top1 = 15.91%], test : [loss = 3.691, top1 = 14.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9672/15625) 009672-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.534, top1 = 88.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.328, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.73 ms.
cifar100       train : [loss = 0.362, top1 = 89.97%], valid : [loss = 1.281, top1 = 66.94%], test : [loss = 1.274, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.60%], valid : [loss = 2.422, top1 = 38.88%], test : [loss = 2.416, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9673/15625) 009673-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.480, top1 = 89.70%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.334, top1 = 92.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.61 ms.
cifar100       train : [loss = 0.146, top1 = 96.87%], valid : [loss = 1.298, top1 = 69.00%], test : [loss = 1.306, top1 = 69.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.31%], valid : [loss = 2.222, top1 = 41.93%], test : [loss = 2.236, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.19%], valid : [loss = 0.676, top1 = 76.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9674/15625) 009674-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.631, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.72 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.375, top1 = 91.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.85 ms.
cifar100       train : [loss = 0.201, top1 = 95.23%], valid : [loss = 1.472, top1 = 66.12%], test : [loss = 1.461, top1 = 65.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.15%], valid : [loss = 2.459, top1 = 38.27%], test : [loss = 2.512, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.91%], valid : [loss = 0.789, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9675/15625) 009675-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.488, top1 = 89.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.44 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.293, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.12 ms.
cifar100       train : [loss = 0.266, top1 = 92.99%], valid : [loss = 1.245, top1 = 69.18%], test : [loss = 1.246, top1 = 67.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.41%], valid : [loss = 2.208, top1 = 42.70%], test : [loss = 2.262, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 82.02%], valid : [loss = 0.611, top1 = 78.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9676/15625) 009676-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.234, top1 = 91.99%], valid : [loss = 0.870, top1 = 76.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10        train : [loss = 0.295, top1 = 89.82%], test  : [loss = 0.624, top1 = 80.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.14 ms.
cifar100       train : [loss = 1.345, top1 = 62.08%], valid : [loss = 1.927, top1 = 50.46%], test : [loss = 1.920, top1 = 50.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 3.464, top1 = 17.84%], valid : [loss = 3.485, top1 = 17.67%], test : [loss = 3.487, top1 = 16.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.21%], valid : [loss = 1.209, top1 = 56.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9677/15625) 009677-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.491, top1 = 89.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.89 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.308, top1 = 92.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.27 ms.
cifar100       train : [loss = 0.271, top1 = 92.82%], valid : [loss = 1.230, top1 = 68.96%], test : [loss = 1.256, top1 = 68.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.32%], valid : [loss = 2.206, top1 = 42.68%], test : [loss = 2.210, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.71%], valid : [loss = 0.631, top1 = 78.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9678/15625) 009678-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.46%], valid : [loss = 0.567, top1 = 87.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.385, top1 = 90.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.69 ms.
cifar100       train : [loss = 0.502, top1 = 85.66%], valid : [loss = 1.376, top1 = 64.06%], test : [loss = 1.371, top1 = 64.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.718, top1 = 31.26%], valid : [loss = 2.776, top1 = 30.27%], test : [loss = 2.781, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 0.963, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9679/15625) 009679-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.64%], valid : [loss = 0.850, top1 = 75.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.316, top1 = 88.87%], test  : [loss = 0.641, top1 = 79.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.19 ms.
cifar100       train : [loss = 1.354, top1 = 61.91%], valid : [loss = 1.904, top1 = 50.36%], test : [loss = 1.911, top1 = 50.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 3.542, top1 = 16.52%], valid : [loss = 3.568, top1 = 16.53%], test : [loss = 3.572, top1 = 16.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.249, top1 = 54.42%], valid : [loss = 1.285, top1 = 53.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9680/15625) 009680-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.32%], valid : [loss = 0.442, top1 = 87.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.28 ms.
cifar10        train : [loss = 0.113, top1 = 96.54%], test  : [loss = 0.329, top1 = 89.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.56 ms.
cifar100       train : [loss = 0.865, top1 = 75.45%], valid : [loss = 1.297, top1 = 64.22%], test : [loss = 1.289, top1 = 64.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.81%], valid : [loss = 2.613, top1 = 33.43%], test : [loss = 2.637, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.676, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9681/15625) 009681-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10-valid  train : [loss = 1.815, top1 = 34.25%], valid : [loss = 1.834, top1 = 33.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.27 ms.
cifar10        train : [loss = 1.195, top1 = 57.21%], test  : [loss = 1.197, top1 = 56.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.06 ms.
cifar100       train : [loss = 3.773, top1 = 12.41%], valid : [loss = 3.857, top1 = 10.66%], test : [loss = 3.849, top1 = 11.55%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.28 ms.
ImageNet16-120 train : [loss = 3.750, top1 = 14.06%], valid : [loss = 3.710, top1 = 15.27%], test : [loss = 3.731, top1 = 14.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9682/15625) 009682-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.62%], valid : [loss = 0.475, top1 = 84.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.75 ms.
cifar10        train : [loss = 0.270, top1 = 90.93%], test  : [loss = 0.354, top1 = 87.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 1.292, top1 = 63.76%], valid : [loss = 1.473, top1 = 58.80%], test : [loss = 1.453, top1 = 59.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.81 ms.
ImageNet16-120 train : [loss = 2.820, top1 = 30.47%], valid : [loss = 2.794, top1 = 31.13%], test : [loss = 2.848, top1 = 29.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.82%], valid : [loss = 1.031, top1 = 63.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9683/15625) 009683-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.523, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.63%], test  : [loss = 0.354, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.99 ms.
cifar100       train : [loss = 0.302, top1 = 91.59%], valid : [loss = 1.328, top1 = 66.90%], test : [loss = 1.368, top1 = 66.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.94%], valid : [loss = 2.417, top1 = 38.40%], test : [loss = 2.414, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 70.99%], valid : [loss = 0.849, top1 = 70.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9684/15625) 009684-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.22%], valid : [loss = 0.651, top1 = 84.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.69 ms.
cifar10        train : [loss = 0.058, top1 = 98.20%], test  : [loss = 0.409, top1 = 89.29%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.64 ms.
cifar100       train : [loss = 0.680, top1 = 79.92%], valid : [loss = 1.395, top1 = 63.64%], test : [loss = 1.425, top1 = 62.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.18%], valid : [loss = 2.629, top1 = 34.37%], test : [loss = 2.647, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.86%], valid : [loss = 0.860, top1 = 69.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9685/15625) 009685-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.536, top1 = 89.32%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.49 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.345, top1 = 92.64%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.17 ms.
cifar100       train : [loss = 0.081, top1 = 98.42%], valid : [loss = 1.392, top1 = 68.82%], test : [loss = 1.360, top1 = 69.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.49%], valid : [loss = 2.320, top1 = 41.17%], test : [loss = 2.318, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.53%], valid : [loss = 0.677, top1 = 76.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9686/15625) 009686-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.464, top1 = 89.27%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.88 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.314, top1 = 91.96%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.67 ms.
cifar100       train : [loss = 0.285, top1 = 92.75%], valid : [loss = 1.191, top1 = 68.74%], test : [loss = 1.215, top1 = 68.96%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.83%], valid : [loss = 2.215, top1 = 42.80%], test : [loss = 2.225, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.42%], valid : [loss = 0.643, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9687/15625) 009687-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.29%], valid : [loss = 0.539, top1 = 84.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.178, top1 = 94.01%], test  : [loss = 0.391, top1 = 87.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.64 ms.
cifar100       train : [loss = 1.184, top1 = 66.34%], valid : [loss = 1.501, top1 = 59.21%], test : [loss = 1.494, top1 = 58.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.90%], valid : [loss = 2.691, top1 = 32.47%], test : [loss = 2.727, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9688/15625) 009688-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.490, top1 = 89.16%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.88 ms.
cifar10        train : [loss = 0.017, top1 = 99.63%], test  : [loss = 0.314, top1 = 92.08%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.66 ms.
cifar100       train : [loss = 0.279, top1 = 92.77%], valid : [loss = 1.189, top1 = 69.60%], test : [loss = 1.192, top1 = 69.12%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.83 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.54%], valid : [loss = 2.217, top1 = 42.10%], test : [loss = 2.256, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.20%], valid : [loss = 0.678, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9689/15625) 009689-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.408, top1 = 90.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.277, top1 = 93.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.36 ms.
cifar100       train : [loss = 0.190, top1 = 95.41%], valid : [loss = 1.289, top1 = 69.34%], test : [loss = 1.253, top1 = 69.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.43%], valid : [loss = 2.265, top1 = 41.80%], test : [loss = 2.276, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9690/15625) 009690-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.432, top1 = 90.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.306, top1 = 92.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.98 ms.
cifar100       train : [loss = 0.133, top1 = 97.37%], valid : [loss = 1.312, top1 = 68.92%], test : [loss = 1.322, top1 = 68.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.71%], valid : [loss = 2.255, top1 = 42.07%], test : [loss = 2.286, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.93%], valid : [loss = 0.576, top1 = 80.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9691/15625) 009691-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.491, top1 = 89.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.349, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.09 ms.
cifar100       train : [loss = 0.246, top1 = 93.75%], valid : [loss = 1.348, top1 = 67.50%], test : [loss = 1.291, top1 = 68.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.97%], valid : [loss = 2.384, top1 = 39.97%], test : [loss = 2.428, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.58%], valid : [loss = 0.640, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9692/15625) 009692-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.311, top1 = 93.36%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.30 ms.
cifar100       train : [loss = 0.060, top1 = 99.12%], valid : [loss = 1.375, top1 = 70.00%], test : [loss = 1.347, top1 = 70.00%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.65 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.57%], valid : [loss = 2.318, top1 = 41.00%], test : [loss = 2.308, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 78.26%], valid : [loss = 0.705, top1 = 75.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9693/15625) 009693-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.78%], valid : [loss = 0.646, top1 = 84.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.073, top1 = 97.57%], test  : [loss = 0.418, top1 = 88.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.592, top1 = 82.38%], valid : [loss = 1.561, top1 = 61.10%], test : [loss = 1.609, top1 = 60.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.948, top1 = 27.05%], valid : [loss = 2.999, top1 = 26.43%], test : [loss = 3.012, top1 = 26.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.08%], valid : [loss = 1.143, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9694/15625) 009694-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.74%], valid : [loss = 0.689, top1 = 85.31%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.34 ms.
cifar10        train : [loss = 0.035, top1 = 99.05%], test  : [loss = 0.442, top1 = 89.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.78 ms.
cifar100       train : [loss = 0.453, top1 = 87.32%], valid : [loss = 1.502, top1 = 62.76%], test : [loss = 1.504, top1 = 62.74%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.402, top1 = 38.79%], valid : [loss = 2.638, top1 = 34.40%], test : [loss = 2.705, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.09%], valid : [loss = 0.849, top1 = 70.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9695/15625) 009695-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.554, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.380, top1 = 91.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.06 ms.
cifar100       train : [loss = 0.203, top1 = 95.18%], valid : [loss = 1.432, top1 = 66.79%], test : [loss = 1.433, top1 = 66.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.68%], valid : [loss = 2.433, top1 = 39.30%], test : [loss = 2.432, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 78.15%], valid : [loss = 0.723, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9696/15625) 009696-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.61%], valid : [loss = 0.886, top1 = 77.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 0.213, top1 = 92.67%], test  : [loss = 0.578, top1 = 82.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.45 ms.
cifar100       train : [loss = 1.203, top1 = 65.92%], valid : [loss = 1.827, top1 = 52.78%], test : [loss = 1.796, top1 = 53.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 3.235, top1 = 22.69%], valid : [loss = 3.352, top1 = 21.03%], test : [loss = 3.377, top1 = 20.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9697/15625) 009697-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.77 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.300, top1 = 92.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 0.318, top1 = 91.62%], valid : [loss = 1.283, top1 = 67.10%], test : [loss = 1.263, top1 = 67.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.46%], valid : [loss = 2.331, top1 = 40.03%], test : [loss = 2.363, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9698/15625) 009698-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.434, top1 = 89.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.308, top1 = 92.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.73 ms.
cifar100       train : [loss = 0.335, top1 = 90.85%], valid : [loss = 1.312, top1 = 67.32%], test : [loss = 1.309, top1 = 66.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 45.97%], valid : [loss = 2.371, top1 = 39.47%], test : [loss = 2.434, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.41%], valid : [loss = 0.544, top1 = 81.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9699/15625) 009699-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.39%], valid : [loss = 0.872, top1 = 81.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10        train : [loss = 0.057, top1 = 98.22%], test  : [loss = 0.592, top1 = 85.48%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.30 ms.
cifar100       train : [loss = 0.448, top1 = 87.63%], valid : [loss = 1.910, top1 = 56.34%], test : [loss = 1.956, top1 = 55.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 33.26%], valid : [loss = 3.008, top1 = 28.13%], test : [loss = 3.002, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.88%], valid : [loss = 0.987, top1 = 64.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9700/15625) 009700-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.536, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.359, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.14 ms.
cifar100       train : [loss = 0.119, top1 = 97.79%], valid : [loss = 1.456, top1 = 67.62%], test : [loss = 1.437, top1 = 68.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.45%], valid : [loss = 2.377, top1 = 40.57%], test : [loss = 2.423, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.16%], valid : [loss = 0.711, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9701/15625) 009701-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.14%], valid : [loss = 1.311, top1 = 52.98%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.20 ms.
cifar10        train : [loss = 1.259, top1 = 54.77%], test  : [loss = 1.272, top1 = 54.79%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.61 ms.
cifar100       train : [loss = 2.734, top1 = 31.75%], valid : [loss = 2.817, top1 = 30.24%], test : [loss = 2.802, top1 = 30.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.07 ms.
ImageNet16-120 train : [loss = 3.914, top1 = 11.76%], valid : [loss = 3.915, top1 = 12.47%], test : [loss = 3.910, top1 = 12.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.737, top1 = 34.36%], valid : [loss = 1.720, top1 = 35.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9702/15625) 009702-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.312, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.88 ms.
cifar100       train : [loss = 0.212, top1 = 94.97%], valid : [loss = 1.271, top1 = 69.16%], test : [loss = 1.255, top1 = 69.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 1.843, top1 = 51.25%], valid : [loss = 2.241, top1 = 43.43%], test : [loss = 2.282, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.82%], valid : [loss = 0.547, top1 = 81.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9703/15625) 009703-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.463, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.79 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.309, top1 = 92.31%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.15 ms.
cifar100       train : [loss = 0.287, top1 = 92.52%], valid : [loss = 1.201, top1 = 68.86%], test : [loss = 1.198, top1 = 69.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.83%], valid : [loss = 2.202, top1 = 44.40%], test : [loss = 2.239, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.26%], valid : [loss = 0.600, top1 = 79.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9704/15625) 009704-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.39%], valid : [loss = 0.618, top1 = 85.48%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=16.45 ms.
cifar10        train : [loss = 0.058, top1 = 98.25%], test  : [loss = 0.408, top1 = 89.16%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=17.14 ms.
cifar100       train : [loss = 0.659, top1 = 80.85%], valid : [loss = 1.391, top1 = 63.23%], test : [loss = 1.381, top1 = 63.71%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.75%], valid : [loss = 2.618, top1 = 34.30%], test : [loss = 2.641, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.82%], valid : [loss = 0.760, top1 = 73.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9705/15625) 009705-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.262, top1 = 90.95%], valid : [loss = 0.867, top1 = 75.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10        train : [loss = 0.319, top1 = 88.95%], test  : [loss = 0.623, top1 = 80.30%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.49 ms.
cifar100       train : [loss = 1.403, top1 = 60.60%], valid : [loss = 1.948, top1 = 49.70%], test : [loss = 1.978, top1 = 49.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 3.470, top1 = 17.80%], valid : [loss = 3.497, top1 = 17.57%], test : [loss = 3.524, top1 = 16.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.30%], valid : [loss = 1.275, top1 = 53.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9706/15625) 009706-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.34%], valid : [loss = 0.606, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.100, top1 = 96.71%], test  : [loss = 0.385, top1 = 89.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.58 ms.
cifar100       train : [loss = 0.770, top1 = 77.22%], valid : [loss = 1.422, top1 = 62.10%], test : [loss = 1.394, top1 = 62.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 33.90%], valid : [loss = 2.741, top1 = 31.93%], test : [loss = 2.769, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.41%], valid : [loss = 1.058, top1 = 62.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9707/15625) 009707-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.637, top1 = 85.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.396, top1 = 89.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.65 ms.
cifar100       train : [loss = 0.550, top1 = 83.93%], valid : [loss = 1.436, top1 = 63.90%], test : [loss = 1.466, top1 = 62.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 38.83%], valid : [loss = 2.590, top1 = 34.77%], test : [loss = 2.613, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.88%], valid : [loss = 0.867, top1 = 68.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9708/15625) 009708-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.88%], valid : [loss = 0.646, top1 = 86.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.030, top1 = 99.27%], test  : [loss = 0.427, top1 = 89.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.35 ms.
cifar100       train : [loss = 0.391, top1 = 89.49%], valid : [loss = 1.417, top1 = 64.44%], test : [loss = 1.412, top1 = 65.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.23%], valid : [loss = 2.614, top1 = 34.50%], test : [loss = 2.662, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9709/15625) 009709-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.532, top1 = 89.49%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.28 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.365, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.61 ms.
cifar100       train : [loss = 0.100, top1 = 98.29%], valid : [loss = 1.445, top1 = 67.86%], test : [loss = 1.458, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.74 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.70%], valid : [loss = 2.426, top1 = 40.00%], test : [loss = 2.432, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.59%], valid : [loss = 0.721, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9710/15625) 009710-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.465, top1 = 88.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.311, top1 = 92.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.36 ms.
cifar100       train : [loss = 0.322, top1 = 91.28%], valid : [loss = 1.317, top1 = 66.84%], test : [loss = 1.249, top1 = 68.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.35%], valid : [loss = 2.377, top1 = 39.90%], test : [loss = 2.445, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.53%], valid : [loss = 0.547, top1 = 81.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9711/15625) 009711-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.525, top1 = 88.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.342, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.77 ms.
cifar100       train : [loss = 0.331, top1 = 90.99%], valid : [loss = 1.263, top1 = 67.52%], test : [loss = 1.296, top1 = 67.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 43.93%], valid : [loss = 2.412, top1 = 38.30%], test : [loss = 2.445, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9712/15625) 009712-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.66%], valid : [loss = 0.528, top1 = 83.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.287, top1 = 90.20%], test  : [loss = 0.405, top1 = 86.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 1.325, top1 = 62.75%], valid : [loss = 1.540, top1 = 57.56%], test : [loss = 1.537, top1 = 58.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 2.878, top1 = 29.27%], valid : [loss = 2.881, top1 = 29.31%], test : [loss = 2.909, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.15%], valid : [loss = 0.965, top1 = 65.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9713/15625) 009713-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.479, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.24 ms.
cifar100       train : [loss = 0.329, top1 = 91.19%], valid : [loss = 1.227, top1 = 68.04%], test : [loss = 1.247, top1 = 67.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.57%], valid : [loss = 2.316, top1 = 41.33%], test : [loss = 2.331, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9714/15625) 009714-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.44%], valid : [loss = 0.578, top1 = 87.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10        train : [loss = 0.031, top1 = 99.08%], test  : [loss = 0.370, top1 = 91.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.73 ms.
cifar100       train : [loss = 0.382, top1 = 89.24%], valid : [loss = 1.308, top1 = 66.56%], test : [loss = 1.295, top1 = 66.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.47 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.06%], valid : [loss = 2.629, top1 = 34.23%], test : [loss = 2.645, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.062, top1 = 61.29%], valid : [loss = 1.101, top1 = 60.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9715/15625) 009715-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.431, top1 = 90.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.296, top1 = 92.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.194, top1 = 95.28%], valid : [loss = 1.267, top1 = 69.86%], test : [loss = 1.249, top1 = 69.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.48%], valid : [loss = 2.227, top1 = 43.50%], test : [loss = 2.279, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9716/15625) 009716-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.33%], valid : [loss = 0.572, top1 = 85.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10        train : [loss = 0.110, top1 = 96.35%], test  : [loss = 0.399, top1 = 88.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.09 ms.
cifar100       train : [loss = 0.821, top1 = 75.68%], valid : [loss = 1.412, top1 = 61.22%], test : [loss = 1.412, top1 = 62.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.22%], valid : [loss = 2.751, top1 = 31.53%], test : [loss = 2.802, top1 = 30.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.91%], valid : [loss = 0.707, top1 = 75.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9717/15625) 009717-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.40%], valid : [loss = 0.531, top1 = 87.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.08 ms.
cifar10        train : [loss = 0.057, top1 = 98.32%], test  : [loss = 0.370, top1 = 89.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 0.645, top1 = 81.16%], valid : [loss = 1.318, top1 = 64.80%], test : [loss = 1.305, top1 = 65.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.28%], valid : [loss = 2.531, top1 = 35.83%], test : [loss = 2.570, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.77%], valid : [loss = 0.617, top1 = 78.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9718/15625) 009718-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.432, top1 = 91.03%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.36 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.287, top1 = 93.83%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.22 ms.
cifar100       train : [loss = 0.035, top1 = 99.66%], valid : [loss = 1.348, top1 = 71.42%], test : [loss = 1.284, top1 = 71.96%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 1.402, top1 = 61.77%], valid : [loss = 2.246, top1 = 44.13%], test : [loss = 2.225, top1 = 44.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.77%], valid : [loss = 0.469, top1 = 84.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9719/15625) 009719-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.20 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.53 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9720/15625) 009720-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.490, top1 = 89.08%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.42 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.328, top1 = 92.36%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=21.07 ms.
cifar100       train : [loss = 0.330, top1 = 91.03%], valid : [loss = 1.249, top1 = 67.58%], test : [loss = 1.295, top1 = 67.60%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.83%], valid : [loss = 2.415, top1 = 39.90%], test : [loss = 2.431, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.24%], valid : [loss = 0.705, top1 = 75.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9721/15625) 009721-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.537, top1 = 88.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.390, top1 = 91.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.198, top1 = 95.43%], valid : [loss = 1.429, top1 = 66.24%], test : [loss = 1.382, top1 = 66.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 47.09%], valid : [loss = 2.438, top1 = 39.20%], test : [loss = 2.446, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.42%], valid : [loss = 0.719, top1 = 75.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9722/15625) 009722-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.427, top1 = 90.91%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.55 ms.
cifar100       train : [loss = 0.066, top1 = 99.09%], valid : [loss = 1.325, top1 = 70.30%], test : [loss = 1.333, top1 = 70.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 1.541, top1 = 58.32%], valid : [loss = 2.225, top1 = 44.67%], test : [loss = 2.288, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9723/15625) 009723-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.96%], valid : [loss = 0.787, top1 = 73.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.21 ms.
cifar10        train : [loss = 0.510, top1 = 82.03%], test  : [loss = 0.593, top1 = 79.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 1.970, top1 = 46.48%], valid : [loss = 2.073, top1 = 44.18%], test : [loss = 2.105, top1 = 43.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.988, top1 = 26.92%], valid : [loss = 2.968, top1 = 27.63%], test : [loss = 2.984, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.159, top1 = 57.98%], valid : [loss = 1.195, top1 = 57.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9724/15625) 009724-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.51%], valid : [loss = 0.559, top1 = 82.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.259, top1 = 91.12%], test  : [loss = 0.403, top1 = 86.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 1.507, top1 = 57.86%], valid : [loss = 1.747, top1 = 52.95%], test : [loss = 1.729, top1 = 53.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.53 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.29%], valid : [loss = 2.954, top1 = 28.04%], test : [loss = 2.988, top1 = 27.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9725/15625) 009725-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.42 ms.
cifar10-valid  train : [loss = 1.318, top1 = 52.43%], valid : [loss = 1.367, top1 = 51.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.72 ms.
cifar10        train : [loss = 1.267, top1 = 54.51%], test  : [loss = 1.276, top1 = 54.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.34 ms.
cifar100       train : [loss = 2.871, top1 = 28.80%], valid : [loss = 2.967, top1 = 28.08%], test : [loss = 2.950, top1 = 27.58%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 3.971, top1 = 10.87%], valid : [loss = 3.964, top1 = 11.70%], test : [loss = 3.982, top1 = 10.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.856, top1 = 31.11%], valid : [loss = 1.819, top1 = 31.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9726/15625) 009726-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.63%], valid : [loss = 0.445, top1 = 88.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.054, top1 = 98.67%], test  : [loss = 0.318, top1 = 90.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.589, top1 = 83.99%], valid : [loss = 1.193, top1 = 67.60%], test : [loss = 1.202, top1 = 66.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.02%], valid : [loss = 2.468, top1 = 37.93%], test : [loss = 2.479, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.16%], valid : [loss = 0.650, top1 = 78.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9727/15625) 009727-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.507, top1 = 88.79%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=17.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.343, top1 = 91.84%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=16.79 ms.
cifar100       train : [loss = 0.328, top1 = 91.10%], valid : [loss = 1.289, top1 = 67.11%], test : [loss = 1.281, top1 = 67.49%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.17%], valid : [loss = 2.397, top1 = 38.93%], test : [loss = 2.408, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9728/15625) 009728-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.524, top1 = 89.84%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.40 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.340, top1 = 93.52%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.00 ms.
cifar100       train : [loss = 0.026, top1 = 99.81%], valid : [loss = 1.383, top1 = 70.90%], test : [loss = 1.407, top1 = 70.64%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=22.51 ms.
ImageNet16-120 train : [loss = 1.482, top1 = 59.80%], valid : [loss = 2.384, top1 = 42.07%], test : [loss = 2.387, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.34%], valid : [loss = 0.671, top1 = 77.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9729/15625) 009729-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.505, top1 = 89.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.309, top1 = 92.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.145, top1 = 96.96%], valid : [loss = 1.317, top1 = 69.12%], test : [loss = 1.310, top1 = 68.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.47%], valid : [loss = 2.282, top1 = 41.30%], test : [loss = 2.303, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9730/15625) 009730-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.469, top1 = 89.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.343, top1 = 91.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.19 ms.
cifar100       train : [loss = 0.354, top1 = 90.01%], valid : [loss = 1.313, top1 = 67.16%], test : [loss = 1.320, top1 = 66.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.72%], valid : [loss = 2.360, top1 = 39.37%], test : [loss = 2.453, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.25%], valid : [loss = 0.649, top1 = 77.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9731/15625) 009731-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.09%], valid : [loss = 0.457, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.163, top1 = 94.73%], test  : [loss = 0.346, top1 = 88.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.31 ms.
cifar100       train : [loss = 1.031, top1 = 70.64%], valid : [loss = 1.379, top1 = 61.20%], test : [loss = 1.397, top1 = 61.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.11%], valid : [loss = 2.691, top1 = 33.27%], test : [loss = 2.723, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9732/15625) 009732-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.566, top1 = 88.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.374, top1 = 91.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.90 ms.
cifar100       train : [loss = 0.128, top1 = 97.51%], valid : [loss = 1.467, top1 = 67.02%], test : [loss = 1.445, top1 = 67.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.69%], valid : [loss = 2.419, top1 = 39.59%], test : [loss = 2.422, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.20%], valid : [loss = 0.725, top1 = 74.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9733/15625) 009733-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.065, top1 = 98.04%], valid : [loss = 0.569, top1 = 85.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10        train : [loss = 0.108, top1 = 96.40%], test  : [loss = 0.405, top1 = 88.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.49 ms.
cifar100       train : [loss = 0.827, top1 = 75.72%], valid : [loss = 1.429, top1 = 62.04%], test : [loss = 1.415, top1 = 61.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.662, top1 = 33.22%], valid : [loss = 2.754, top1 = 32.10%], test : [loss = 2.826, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9734/15625) 009734-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.38%], valid : [loss = 0.858, top1 = 71.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.06 ms.
cifar10        train : [loss = 0.560, top1 = 80.34%], test  : [loss = 0.705, top1 = 75.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 1.759, top1 = 52.48%], valid : [loss = 2.034, top1 = 47.34%], test : [loss = 2.060, top1 = 46.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.86%], valid : [loss = 3.642, top1 = 16.23%], test : [loss = 3.666, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9735/15625) 009735-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.24%], valid : [loss = 0.459, top1 = 86.01%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=12.39 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.347, top1 = 88.97%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=11.60 ms.
cifar100       train : [loss = 0.992, top1 = 71.71%], valid : [loss = 1.351, top1 = 61.99%], test : [loss = 1.345, top1 = 62.16%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.92%], valid : [loss = 2.695, top1 = 33.00%], test : [loss = 2.697, top1 = 32.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9736/15625) 009736-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.38 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.90%], valid : [loss = 0.863, top1 = 71.68%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10        train : [loss = 0.560, top1 = 80.49%], test  : [loss = 0.723, top1 = 75.44%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.55 ms.
cifar100       train : [loss = 1.791, top1 = 51.82%], valid : [loss = 2.067, top1 = 46.62%], test : [loss = 2.066, top1 = 46.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.84 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.71%], valid : [loss = 3.645, top1 = 16.38%], test : [loss = 3.670, top1 = 15.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9737/15625) 009737-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.454, top1 = 89.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.321, top1 = 92.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.72 ms.
cifar100       train : [loss = 0.309, top1 = 91.87%], valid : [loss = 1.206, top1 = 68.66%], test : [loss = 1.246, top1 = 67.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.65 ms.
ImageNet16-120 train : [loss = 1.967, top1 = 48.21%], valid : [loss = 2.282, top1 = 42.33%], test : [loss = 2.310, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.50%], valid : [loss = 0.616, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9738/15625) 009738-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.496, top1 = 89.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.65 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.313, top1 = 92.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.97 ms.
cifar100       train : [loss = 0.232, top1 = 94.02%], valid : [loss = 1.236, top1 = 69.27%], test : [loss = 1.292, top1 = 68.59%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.40%], valid : [loss = 2.238, top1 = 42.42%], test : [loss = 2.255, top1 = 43.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 80.89%], valid : [loss = 0.626, top1 = 78.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9739/15625) 009739-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.609, top1 = 85.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.067, top1 = 97.99%], test  : [loss = 0.398, top1 = 88.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.97 ms.
cifar100       train : [loss = 0.709, top1 = 79.42%], valid : [loss = 1.382, top1 = 62.86%], test : [loss = 1.365, top1 = 63.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.07%], valid : [loss = 2.643, top1 = 33.72%], test : [loss = 2.675, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9740/15625) 009740-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.48%], valid : [loss = 0.465, top1 = 86.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.75 ms.
cifar10        train : [loss = 0.146, top1 = 95.14%], test  : [loss = 0.340, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.06 ms.
cifar100       train : [loss = 0.964, top1 = 72.33%], valid : [loss = 1.336, top1 = 62.54%], test : [loss = 1.323, top1 = 63.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.623, top1 = 34.06%], valid : [loss = 2.693, top1 = 32.90%], test : [loss = 2.692, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9741/15625) 009741-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.576, top1 = 87.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.384, top1 = 91.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.216, top1 = 94.87%], valid : [loss = 1.439, top1 = 66.24%], test : [loss = 1.428, top1 = 66.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.086, top1 = 45.54%], valid : [loss = 2.482, top1 = 37.43%], test : [loss = 2.503, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.70%], valid : [loss = 0.726, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9742/15625) 009742-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 0.316, top1 = 89.21%], valid : [loss = 0.592, top1 = 81.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.238, top1 = 91.88%], test  : [loss = 0.396, top1 = 86.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.94 ms.
cifar100       train : [loss = 1.432, top1 = 59.78%], valid : [loss = 1.712, top1 = 53.40%], test : [loss = 1.693, top1 = 53.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.950, top1 = 27.68%], valid : [loss = 2.956, top1 = 28.00%], test : [loss = 3.001, top1 = 26.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.41%], valid : [loss = 1.051, top1 = 62.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9743/15625) 009743-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.423, top1 = 91.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.288, top1 = 93.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.99 ms.
cifar100       train : [loss = 0.066, top1 = 99.09%], valid : [loss = 1.307, top1 = 70.70%], test : [loss = 1.277, top1 = 70.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 1.518, top1 = 58.91%], valid : [loss = 2.236, top1 = 44.20%], test : [loss = 2.254, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.44%], valid : [loss = 0.489, top1 = 83.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9744/15625) 009744-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.519, top1 = 88.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.340, top1 = 91.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.16 ms.
cifar100       train : [loss = 0.356, top1 = 90.19%], valid : [loss = 1.301, top1 = 67.14%], test : [loss = 1.280, top1 = 67.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.29%], valid : [loss = 2.440, top1 = 38.47%], test : [loss = 2.425, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9745/15625) 009745-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.486, top1 = 88.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.319, top1 = 92.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.323, top1 = 91.27%], valid : [loss = 1.248, top1 = 67.77%], test : [loss = 1.245, top1 = 67.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.73%], valid : [loss = 2.321, top1 = 40.46%], test : [loss = 2.347, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9746/15625) 009746-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.37%], valid : [loss = 0.459, top1 = 86.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.53 ms.
cifar10        train : [loss = 0.154, top1 = 94.89%], test  : [loss = 0.345, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.43 ms.
cifar100       train : [loss = 1.003, top1 = 71.71%], valid : [loss = 1.361, top1 = 62.00%], test : [loss = 1.353, top1 = 62.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.78%], valid : [loss = 2.688, top1 = 33.80%], test : [loss = 2.703, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.40%], valid : [loss = 0.792, top1 = 72.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9747/15625) 009747-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.94 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.572, top1 = 88.46%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.25 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.348, top1 = 92.24%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.21 ms.
cifar100       train : [loss = 0.148, top1 = 97.02%], valid : [loss = 1.285, top1 = 68.90%], test : [loss = 1.320, top1 = 68.44%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 2.255, top1 = 41.42%], valid : [loss = 2.456, top1 = 36.83%], test : [loss = 2.467, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.67%], valid : [loss = 1.010, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9748/15625) 009748-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.18 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.345, top1 = 92.69%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.95 ms.
cifar100       train : [loss = 0.083, top1 = 98.59%], valid : [loss = 1.387, top1 = 68.85%], test : [loss = 1.373, top1 = 69.23%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.787, top1 = 52.49%], valid : [loss = 2.287, top1 = 42.18%], test : [loss = 2.282, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.98%], valid : [loss = 0.654, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9749/15625) 009749-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.530, top1 = 89.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.333, top1 = 93.11%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.80 ms.
cifar100       train : [loss = 0.106, top1 = 98.03%], valid : [loss = 1.304, top1 = 70.04%], test : [loss = 1.288, top1 = 69.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.74%], valid : [loss = 2.322, top1 = 41.77%], test : [loss = 2.320, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.53%], valid : [loss = 0.749, top1 = 74.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9750/15625) 009750-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.25 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.56%], valid : [loss = 0.470, top1 = 86.29%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.84 ms.
cifar10        train : [loss = 0.117, top1 = 96.40%], test  : [loss = 0.334, top1 = 89.54%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.13 ms.
cifar100       train : [loss = 0.738, top1 = 79.42%], valid : [loss = 1.270, top1 = 64.93%], test : [loss = 1.271, top1 = 64.51%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.89 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.56%], valid : [loss = 2.607, top1 = 34.81%], test : [loss = 2.621, top1 = 33.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.88%], valid : [loss = 0.841, top1 = 70.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9751/15625) 009751-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.41%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.54 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.330, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.56 ms.
cifar100       train : [loss = 0.095, top1 = 98.28%], valid : [loss = 1.327, top1 = 69.50%], test : [loss = 1.325, top1 = 69.49%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 1.843, top1 = 51.15%], valid : [loss = 2.296, top1 = 42.13%], test : [loss = 2.291, top1 = 42.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.92%], valid : [loss = 0.719, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9752/15625) 009752-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.509, top1 = 88.74%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.330, top1 = 91.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.26 ms.
cifar100       train : [loss = 0.364, top1 = 89.99%], valid : [loss = 1.264, top1 = 67.11%], test : [loss = 1.266, top1 = 67.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.33 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.37%], valid : [loss = 2.408, top1 = 39.09%], test : [loss = 2.421, top1 = 38.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.00%], valid : [loss = 0.663, top1 = 77.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9753/15625) 009753-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.434, top1 = 89.85%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.291, top1 = 92.74%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.63 ms.
cifar100       train : [loss = 0.116, top1 = 98.05%], valid : [loss = 1.256, top1 = 70.59%], test : [loss = 1.248, top1 = 70.01%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.676, top1 = 55.18%], valid : [loss = 2.212, top1 = 44.19%], test : [loss = 2.224, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 86.17%], valid : [loss = 0.525, top1 = 82.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9754/15625) 009754-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.14%], valid : [loss = 0.749, top1 = 81.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10        train : [loss = 0.109, top1 = 96.49%], test  : [loss = 0.463, top1 = 86.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 0.885, top1 = 74.44%], valid : [loss = 1.559, top1 = 59.24%], test : [loss = 1.531, top1 = 59.77%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 2.747, top1 = 31.73%], valid : [loss = 2.835, top1 = 30.03%], test : [loss = 2.879, top1 = 29.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.79%], valid : [loss = 0.960, top1 = 66.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9755/15625) 009755-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.340, top1 = 91.97%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.56 ms.
cifar100       train : [loss = 0.333, top1 = 91.03%], valid : [loss = 1.288, top1 = 66.45%], test : [loss = 1.294, top1 = 67.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.97%], valid : [loss = 2.407, top1 = 38.61%], test : [loss = 2.411, top1 = 38.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9756/15625) 009756-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.461, top1 = 89.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.314, top1 = 92.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.309, top1 = 91.61%], valid : [loss = 1.321, top1 = 67.07%], test : [loss = 1.309, top1 = 67.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 47.04%], valid : [loss = 2.357, top1 = 40.68%], test : [loss = 2.366, top1 = 39.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.62%], valid : [loss = 0.568, top1 = 80.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9757/15625) 009757-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.043, top1 = 99.14%], valid : [loss = 0.495, top1 = 86.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.85 ms.
cifar10        train : [loss = 0.058, top1 = 98.31%], test  : [loss = 0.345, top1 = 90.40%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 0.570, top1 = 83.50%], valid : [loss = 1.248, top1 = 66.16%], test : [loss = 1.232, top1 = 66.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.25%], valid : [loss = 2.343, top1 = 40.11%], test : [loss = 2.361, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.10%], valid : [loss = 0.841, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9758/15625) 009758-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.468, top1 = 89.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.315, top1 = 92.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 0.321, top1 = 91.44%], valid : [loss = 1.252, top1 = 67.75%], test : [loss = 1.246, top1 = 67.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.69%], valid : [loss = 2.314, top1 = 40.57%], test : [loss = 2.342, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9759/15625) 009759-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.637, top1 = 87.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.31 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.408, top1 = 91.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.98 ms.
cifar100       train : [loss = 0.167, top1 = 96.18%], valid : [loss = 1.553, top1 = 65.17%], test : [loss = 1.557, top1 = 65.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.74%], valid : [loss = 2.485, top1 = 37.87%], test : [loss = 2.526, top1 = 37.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.23%], valid : [loss = 0.808, top1 = 71.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9760/15625) 009760-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.20%], valid : [loss = 0.448, top1 = 87.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.21 ms.
cifar10        train : [loss = 0.113, top1 = 96.48%], test  : [loss = 0.322, top1 = 89.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.60 ms.
cifar100       train : [loss = 0.857, top1 = 75.57%], valid : [loss = 1.283, top1 = 64.47%], test : [loss = 1.277, top1 = 64.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.74%], valid : [loss = 2.613, top1 = 34.41%], test : [loss = 2.663, top1 = 34.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.30%], valid : [loss = 0.658, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9761/15625) 009761-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.035, top1 = 98.94%], valid : [loss = 0.572, top1 = 86.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.15 ms.
cifar10        train : [loss = 0.058, top1 = 98.14%], test  : [loss = 0.368, top1 = 90.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.19 ms.
cifar100       train : [loss = 0.660, top1 = 80.42%], valid : [loss = 1.316, top1 = 64.39%], test : [loss = 1.318, top1 = 64.41%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.15%], valid : [loss = 2.517, top1 = 36.27%], test : [loss = 2.535, top1 = 36.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.53%], valid : [loss = 0.878, top1 = 68.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9762/15625) 009762-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.58%], valid : [loss = 0.445, top1 = 87.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10        train : [loss = 0.057, top1 = 98.58%], test  : [loss = 0.310, top1 = 90.72%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.81 ms.
cifar100       train : [loss = 0.542, top1 = 85.26%], valid : [loss = 1.202, top1 = 67.15%], test : [loss = 1.208, top1 = 67.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.85%], valid : [loss = 2.452, top1 = 38.31%], test : [loss = 2.476, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.29%], valid : [loss = 0.638, top1 = 77.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9763/15625) 009763-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.578, top1 = 87.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10        train : [loss = 0.043, top1 = 98.66%], test  : [loss = 0.406, top1 = 89.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.553, top1 = 83.71%], valid : [loss = 1.399, top1 = 64.05%], test : [loss = 1.400, top1 = 64.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.84%], valid : [loss = 2.612, top1 = 34.59%], test : [loss = 2.660, top1 = 34.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.82%], valid : [loss = 0.660, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9764/15625) 009764-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.01%], valid : [loss = 0.553, top1 = 86.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.88 ms.
cifar10        train : [loss = 0.059, top1 = 98.07%], test  : [loss = 0.365, top1 = 90.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.89 ms.
cifar100       train : [loss = 0.639, top1 = 81.06%], valid : [loss = 1.303, top1 = 64.95%], test : [loss = 1.319, top1 = 64.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.353, top1 = 39.67%], valid : [loss = 2.493, top1 = 37.20%], test : [loss = 2.521, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.06%], valid : [loss = 0.904, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9765/15625) 009765-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.528, top1 = 89.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.72 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.353, top1 = 92.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.82 ms.
cifar100       train : [loss = 0.100, top1 = 98.32%], valid : [loss = 1.447, top1 = 68.45%], test : [loss = 1.431, top1 = 68.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.65 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.61%], valid : [loss = 2.357, top1 = 40.47%], test : [loss = 2.381, top1 = 41.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.36%], valid : [loss = 0.693, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9766/15625) 009766-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.527, top1 = 88.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.343, top1 = 92.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.45 ms.
cifar100       train : [loss = 0.346, top1 = 90.60%], valid : [loss = 1.286, top1 = 66.83%], test : [loss = 1.306, top1 = 66.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.94%], valid : [loss = 2.412, top1 = 38.94%], test : [loss = 2.401, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9767/15625) 009767-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.646, top1 = 86.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.026, top1 = 99.30%], test  : [loss = 0.419, top1 = 90.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.35 ms.
cifar100       train : [loss = 0.470, top1 = 86.31%], valid : [loss = 1.427, top1 = 64.30%], test : [loss = 1.419, top1 = 64.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.98%], valid : [loss = 2.565, top1 = 35.64%], test : [loss = 2.605, top1 = 35.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.61%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9768/15625) 009768-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.37%], valid : [loss = 0.450, top1 = 86.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.152, top1 = 95.05%], test  : [loss = 0.347, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 0.972, top1 = 72.32%], valid : [loss = 1.355, top1 = 62.45%], test : [loss = 1.333, top1 = 62.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.78%], valid : [loss = 2.690, top1 = 32.71%], test : [loss = 2.709, top1 = 31.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9769/15625) 009769-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.649, top1 = 86.24%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.41 ms.
cifar10        train : [loss = 0.028, top1 = 99.26%], test  : [loss = 0.455, top1 = 89.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.47 ms.
cifar100       train : [loss = 0.331, top1 = 91.24%], valid : [loss = 1.478, top1 = 64.31%], test : [loss = 1.480, top1 = 64.21%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.16%], valid : [loss = 2.631, top1 = 34.43%], test : [loss = 2.645, top1 = 35.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.06%], valid : [loss = 0.788, top1 = 72.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9770/15625) 009770-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.537, top1 = 89.01%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.31 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.358, top1 = 92.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.69 ms.
cifar100       train : [loss = 0.065, top1 = 99.25%], valid : [loss = 1.422, top1 = 68.84%], test : [loss = 1.422, top1 = 68.73%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.91%], valid : [loss = 2.436, top1 = 39.66%], test : [loss = 2.434, top1 = 41.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.68%], valid : [loss = 0.701, top1 = 75.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9771/15625) 009771-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.531, top1 = 88.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.359, top1 = 91.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.98 ms.
cifar100       train : [loss = 0.299, top1 = 91.96%], valid : [loss = 1.305, top1 = 66.97%], test : [loss = 1.308, top1 = 67.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.32%], valid : [loss = 2.419, top1 = 38.32%], test : [loss = 2.452, top1 = 38.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.82%], valid : [loss = 0.821, top1 = 71.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9772/15625) 009772-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.481, top1 = 89.31%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.90 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.301, top1 = 92.41%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.30 ms.
cifar100       train : [loss = 0.245, top1 = 93.70%], valid : [loss = 1.220, top1 = 69.04%], test : [loss = 1.230, top1 = 69.05%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.55%], valid : [loss = 2.195, top1 = 43.22%], test : [loss = 2.202, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.22%], valid : [loss = 0.632, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9773/15625) 009773-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.229, top1 = 92.30%], valid : [loss = 0.552, top1 = 83.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.221, top1 = 92.44%], test  : [loss = 0.405, top1 = 86.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.70 ms.
cifar100       train : [loss = 1.286, top1 = 63.50%], valid : [loss = 1.599, top1 = 55.98%], test : [loss = 1.569, top1 = 57.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.701, top1 = 32.54%], valid : [loss = 2.715, top1 = 31.95%], test : [loss = 2.759, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.72%], valid : [loss = 1.006, top1 = 64.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9774/15625) 009774-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.603, top1 = 87.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.402, top1 = 91.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.204, top1 = 95.24%], valid : [loss = 1.455, top1 = 66.31%], test : [loss = 1.428, top1 = 66.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.18%], valid : [loss = 2.472, top1 = 37.40%], test : [loss = 2.511, top1 = 38.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9775/15625) 009775-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.11%], valid : [loss = 0.518, top1 = 84.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.98 ms.
cifar10        train : [loss = 0.162, top1 = 94.63%], test  : [loss = 0.377, top1 = 88.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 1.175, top1 = 66.77%], valid : [loss = 1.493, top1 = 59.25%], test : [loss = 1.486, top1 = 58.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.592, top1 = 34.81%], valid : [loss = 2.651, top1 = 33.55%], test : [loss = 2.685, top1 = 33.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.921, top1 = 67.06%], valid : [loss = 0.965, top1 = 65.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9776/15625) 009776-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.577, top1 = 88.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.14 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.381, top1 = 91.80%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.18 ms.
cifar100       train : [loss = 0.168, top1 = 96.41%], valid : [loss = 1.411, top1 = 67.41%], test : [loss = 1.443, top1 = 66.87%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.28%], valid : [loss = 2.449, top1 = 39.10%], test : [loss = 2.479, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.47%], valid : [loss = 0.683, top1 = 76.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9777/15625) 009777-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.609, top1 = 87.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.397, top1 = 91.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 0.147, top1 = 96.80%], valid : [loss = 1.492, top1 = 66.95%], test : [loss = 1.500, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.73%], valid : [loss = 2.509, top1 = 36.83%], test : [loss = 2.521, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.71%], valid : [loss = 0.842, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9778/15625) 009778-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.454, top1 = 90.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.083, top1 = 98.47%], valid : [loss = 1.426, top1 = 69.30%], test : [loss = 1.384, top1 = 69.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 56.02%], valid : [loss = 2.268, top1 = 42.92%], test : [loss = 2.291, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.82%], valid : [loss = 0.557, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9779/15625) 009779-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.482, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.301, top1 = 92.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.05 ms.
cifar100       train : [loss = 0.315, top1 = 91.55%], valid : [loss = 1.241, top1 = 67.95%], test : [loss = 1.252, top1 = 67.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.65%], valid : [loss = 2.319, top1 = 39.64%], test : [loss = 2.340, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.52%], valid : [loss = 0.621, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9780/15625) 009780-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.570, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.387, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 0.393, top1 = 88.92%], valid : [loss = 1.414, top1 = 65.16%], test : [loss = 1.382, top1 = 65.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.86%], valid : [loss = 2.507, top1 = 36.50%], test : [loss = 2.532, top1 = 36.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.26%], valid : [loss = 0.753, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9781/15625) 009781-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.562, top1 = 87.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.364, top1 = 91.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.45 ms.
cifar100       train : [loss = 0.287, top1 = 91.95%], valid : [loss = 1.307, top1 = 67.46%], test : [loss = 1.316, top1 = 67.13%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 43.96%], valid : [loss = 2.434, top1 = 38.12%], test : [loss = 2.427, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9782/15625) 009782-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.433, top1 = 90.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.283, top1 = 93.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.173, top1 = 95.99%], valid : [loss = 1.271, top1 = 69.69%], test : [loss = 1.269, top1 = 69.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.39 ms.
ImageNet16-120 train : [loss = 1.805, top1 = 52.06%], valid : [loss = 2.238, top1 = 42.57%], test : [loss = 2.297, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.03%], valid : [loss = 0.504, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9783/15625) 009783-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.75%], valid : [loss = 0.531, top1 = 88.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10        train : [loss = 0.025, top1 = 99.28%], test  : [loss = 0.355, top1 = 91.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.29 ms.
cifar100       train : [loss = 0.436, top1 = 87.36%], valid : [loss = 1.244, top1 = 67.22%], test : [loss = 1.237, top1 = 67.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.51%], valid : [loss = 2.371, top1 = 39.20%], test : [loss = 2.386, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.54%], valid : [loss = 0.814, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9784/15625) 009784-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.498, top1 = 89.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.85 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.315, top1 = 92.73%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.10 ms.
cifar100       train : [loss = 0.202, top1 = 95.13%], valid : [loss = 1.265, top1 = 69.25%], test : [loss = 1.264, top1 = 69.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.94%], valid : [loss = 2.174, top1 = 44.18%], test : [loss = 2.211, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.90%], valid : [loss = 0.721, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9785/15625) 009785-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.93%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.56 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.334, top1 = 93.10%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.21 ms.
cifar100       train : [loss = 0.072, top1 = 98.80%], valid : [loss = 1.317, top1 = 70.43%], test : [loss = 1.331, top1 = 70.49%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 55.11%], valid : [loss = 2.142, top1 = 44.60%], test : [loss = 2.154, top1 = 44.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.23%], valid : [loss = 0.853, top1 = 70.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9786/15625) 009786-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.81%], valid : [loss = 0.637, top1 = 84.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.090, top1 = 97.09%], test  : [loss = 0.403, top1 = 88.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.826, top1 = 75.90%], valid : [loss = 1.466, top1 = 61.29%], test : [loss = 1.424, top1 = 62.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.37%], valid : [loss = 2.736, top1 = 32.62%], test : [loss = 2.755, top1 = 31.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.51%], valid : [loss = 0.850, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9787/15625) 009787-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.40%], valid : [loss = 0.559, top1 = 87.02%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.59 ms.
cifar10        train : [loss = 0.047, top1 = 98.54%], test  : [loss = 0.379, top1 = 89.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.97 ms.
cifar100       train : [loss = 0.523, top1 = 84.81%], valid : [loss = 1.318, top1 = 64.94%], test : [loss = 1.319, top1 = 65.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.35%], valid : [loss = 2.422, top1 = 38.88%], test : [loss = 2.451, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.57%], valid : [loss = 0.825, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9788/15625) 009788-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.506, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.43 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.321, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.13 ms.
cifar100       train : [loss = 0.140, top1 = 97.25%], valid : [loss = 1.261, top1 = 69.80%], test : [loss = 1.260, top1 = 69.87%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.64%], valid : [loss = 2.173, top1 = 44.55%], test : [loss = 2.203, top1 = 44.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.48%], valid : [loss = 0.592, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9789/15625) 009789-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.22%], valid : [loss = 0.591, top1 = 85.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.069, top1 = 97.96%], test  : [loss = 0.390, top1 = 89.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.709, top1 = 79.47%], valid : [loss = 1.377, top1 = 63.32%], test : [loss = 1.349, top1 = 63.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.66%], valid : [loss = 2.646, top1 = 34.03%], test : [loss = 2.694, top1 = 33.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.88%], valid : [loss = 0.765, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9790/15625) 009790-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.538, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.43 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.353, top1 = 92.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.45 ms.
cifar100       train : [loss = 0.251, top1 = 93.22%], valid : [loss = 1.326, top1 = 67.55%], test : [loss = 1.343, top1 = 67.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.165, top1 = 43.78%], valid : [loss = 2.395, top1 = 39.53%], test : [loss = 2.430, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9791/15625) 009791-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.584, top1 = 87.14%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.57 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.374, top1 = 91.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.08 ms.
cifar100       train : [loss = 0.357, top1 = 90.04%], valid : [loss = 1.437, top1 = 64.65%], test : [loss = 1.411, top1 = 65.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.19%], valid : [loss = 2.488, top1 = 37.58%], test : [loss = 2.500, top1 = 37.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.30%], valid : [loss = 0.856, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9792/15625) 009792-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.513, top1 = 88.80%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.322, top1 = 92.23%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.70 ms.
cifar100       train : [loss = 0.232, top1 = 94.22%], valid : [loss = 1.239, top1 = 68.84%], test : [loss = 1.266, top1 = 68.65%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.59%], valid : [loss = 2.303, top1 = 40.85%], test : [loss = 2.299, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.10%], valid : [loss = 0.625, top1 = 78.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9793/15625) 009793-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.513, top1 = 88.72%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.91 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.322, top1 = 92.40%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.31 ms.
cifar100       train : [loss = 0.229, top1 = 94.38%], valid : [loss = 1.311, top1 = 67.43%], test : [loss = 1.294, top1 = 68.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 47.97%], valid : [loss = 2.328, top1 = 40.45%], test : [loss = 2.335, top1 = 40.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.49%], valid : [loss = 0.631, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9794/15625) 009794-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.76%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.331, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.07 ms.
cifar100       train : [loss = 0.333, top1 = 91.04%], valid : [loss = 1.278, top1 = 67.05%], test : [loss = 1.285, top1 = 67.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.12%], valid : [loss = 2.396, top1 = 38.98%], test : [loss = 2.413, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9795/15625) 009795-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.95 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.47%], valid : [loss = 0.547, top1 = 84.83%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.15 ms.
cifar10        train : [loss = 0.194, top1 = 93.50%], test  : [loss = 0.393, top1 = 87.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.09 ms.
cifar100       train : [loss = 1.001, top1 = 71.13%], valid : [loss = 1.415, top1 = 60.97%], test : [loss = 1.412, top1 = 61.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.724, top1 = 31.99%], valid : [loss = 2.760, top1 = 32.08%], test : [loss = 2.813, top1 = 30.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.68%], valid : [loss = 0.982, top1 = 65.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9796/15625) 009796-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.40%], valid : [loss = 0.626, top1 = 85.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.053, top1 = 98.44%], test  : [loss = 0.420, top1 = 89.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.23 ms.
cifar100       train : [loss = 0.633, top1 = 81.50%], valid : [loss = 1.411, top1 = 62.83%], test : [loss = 1.411, top1 = 63.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.458, top1 = 37.44%], valid : [loss = 2.601, top1 = 35.00%], test : [loss = 2.634, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.24%], valid : [loss = 0.819, top1 = 71.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9797/15625) 009797-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.33 ms.
cifar10-valid  train : [loss = 0.204, top1 = 93.23%], valid : [loss = 0.486, top1 = 84.91%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.184, top1 = 93.82%], test  : [loss = 0.371, top1 = 88.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.14 ms.
cifar100       train : [loss = 1.096, top1 = 68.60%], valid : [loss = 1.460, top1 = 60.44%], test : [loss = 1.438, top1 = 60.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.66%], valid : [loss = 2.688, top1 = 33.47%], test : [loss = 2.721, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.69%], valid : [loss = 0.973, top1 = 65.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9798/15625) 009798-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.78%], valid : [loss = 0.847, top1 = 72.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10        train : [loss = 0.559, top1 = 80.51%], test  : [loss = 0.717, top1 = 75.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.25 ms.
cifar100       train : [loss = 1.776, top1 = 52.10%], valid : [loss = 2.054, top1 = 46.72%], test : [loss = 2.067, top1 = 46.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.89%], valid : [loss = 3.638, top1 = 16.42%], test : [loss = 3.660, top1 = 15.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9799/15625) 009799-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.67 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.21%], valid : [loss = 0.598, top1 = 85.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.072, top1 = 97.77%], test  : [loss = 0.389, top1 = 89.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.81 ms.
cifar100       train : [loss = 0.717, top1 = 79.26%], valid : [loss = 1.379, top1 = 63.20%], test : [loss = 1.371, top1 = 63.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.07%], valid : [loss = 2.640, top1 = 33.87%], test : [loss = 2.688, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9800/15625) 009800-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.85%], valid : [loss = 0.459, top1 = 86.40%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=14.49 ms.
cifar10        train : [loss = 0.150, top1 = 95.17%], test  : [loss = 0.337, top1 = 89.13%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.05 ms.
cifar100       train : [loss = 0.951, top1 = 72.95%], valid : [loss = 1.321, top1 = 62.92%], test : [loss = 1.318, top1 = 62.95%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.29%], valid : [loss = 2.668, top1 = 33.03%], test : [loss = 2.690, top1 = 32.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 75.17%], valid : [loss = 0.769, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9801/15625) 009801-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.489, top1 = 89.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.311, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.34 ms.
cifar100       train : [loss = 0.272, top1 = 93.05%], valid : [loss = 1.184, top1 = 69.34%], test : [loss = 1.196, top1 = 69.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 49.90%], valid : [loss = 2.241, top1 = 42.48%], test : [loss = 2.235, top1 = 42.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9802/15625) 009802-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.494, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.74 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.323, top1 = 92.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.29 ms.
cifar100       train : [loss = 0.229, top1 = 94.49%], valid : [loss = 1.237, top1 = 68.87%], test : [loss = 1.244, top1 = 68.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.39%], valid : [loss = 2.286, top1 = 41.68%], test : [loss = 2.289, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.49%], valid : [loss = 0.645, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9803/15625) 009803-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.564, top1 = 87.75%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.52 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.357, top1 = 91.60%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.78 ms.
cifar100       train : [loss = 0.255, top1 = 92.98%], valid : [loss = 1.349, top1 = 67.56%], test : [loss = 1.342, top1 = 68.20%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.78 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 36.62%], valid : [loss = 2.583, top1 = 34.53%], test : [loss = 2.599, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.71%], valid : [loss = 0.980, top1 = 65.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9804/15625) 009804-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.78 ms.
cifar10-valid  train : [loss = 0.323, top1 = 88.90%], valid : [loss = 0.570, top1 = 81.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10        train : [loss = 0.283, top1 = 90.14%], test  : [loss = 0.439, top1 = 85.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.53 ms.
cifar100       train : [loss = 1.345, top1 = 62.04%], valid : [loss = 1.683, top1 = 55.72%], test : [loss = 1.692, top1 = 54.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 3.009, top1 = 26.88%], valid : [loss = 3.036, top1 = 26.23%], test : [loss = 3.087, top1 = 25.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.194, top1 = 56.78%], valid : [loss = 1.255, top1 = 54.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9805/15625) 009805-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.29%], valid : [loss = 0.455, top1 = 87.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10        train : [loss = 0.113, top1 = 96.45%], test  : [loss = 0.325, top1 = 89.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 0.860, top1 = 75.60%], valid : [loss = 1.306, top1 = 63.70%], test : [loss = 1.281, top1 = 63.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.70%], valid : [loss = 2.629, top1 = 33.80%], test : [loss = 2.640, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9806/15625) 009806-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.86 ms.
cifar100       train : [loss = 0.330, top1 = 90.99%], valid : [loss = 1.325, top1 = 66.67%], test : [loss = 1.336, top1 = 66.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.25%], valid : [loss = 2.390, top1 = 39.91%], test : [loss = 2.395, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9807/15625) 009807-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.584, top1 = 87.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.392, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.234, top1 = 94.05%], valid : [loss = 1.508, top1 = 65.27%], test : [loss = 1.478, top1 = 65.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 45.06%], valid : [loss = 2.497, top1 = 37.08%], test : [loss = 2.501, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 76.88%], valid : [loss = 0.732, top1 = 74.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9808/15625) 009808-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.449, top1 = 89.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.305, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.70 ms.
cifar100       train : [loss = 0.205, top1 = 95.24%], valid : [loss = 1.260, top1 = 68.86%], test : [loss = 1.263, top1 = 69.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.76%], valid : [loss = 2.264, top1 = 42.49%], test : [loss = 2.288, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.22%], valid : [loss = 0.527, top1 = 82.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9809/15625) 009809-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.558, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.394, top1 = 91.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.193, top1 = 95.49%], valid : [loss = 1.398, top1 = 67.15%], test : [loss = 1.415, top1 = 67.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.83%], valid : [loss = 2.468, top1 = 38.08%], test : [loss = 2.507, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.92%], valid : [loss = 0.714, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9810/15625) 009810-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.553, top1 = 88.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.375, top1 = 91.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.81 ms.
cifar100       train : [loss = 0.261, top1 = 92.88%], valid : [loss = 1.287, top1 = 68.00%], test : [loss = 1.313, top1 = 68.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.81%], valid : [loss = 2.290, top1 = 40.57%], test : [loss = 2.311, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.24%], valid : [loss = 0.816, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9811/15625) 009811-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.35%], valid : [loss = 0.843, top1 = 79.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.129, top1 = 95.54%], test  : [loss = 0.559, top1 = 84.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.88 ms.
cifar100       train : [loss = 0.845, top1 = 75.48%], valid : [loss = 1.652, top1 = 57.30%], test : [loss = 1.663, top1 = 57.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 3.046, top1 = 26.29%], valid : [loss = 3.165, top1 = 24.33%], test : [loss = 3.220, top1 = 23.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.42%], valid : [loss = 1.128, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9812/15625) 009812-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.12%], valid : [loss = 0.436, top1 = 87.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.111, top1 = 96.63%], test  : [loss = 0.314, top1 = 90.32%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.55 ms.
cifar100       train : [loss = 0.859, top1 = 75.57%], valid : [loss = 1.276, top1 = 64.80%], test : [loss = 1.277, top1 = 63.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.61%], valid : [loss = 2.626, top1 = 34.13%], test : [loss = 2.648, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.18%], valid : [loss = 0.676, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9813/15625) 009813-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.31%], valid : [loss = 0.550, top1 = 86.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10        train : [loss = 0.050, top1 = 98.64%], test  : [loss = 0.349, top1 = 90.66%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.48 ms.
cifar100       train : [loss = 0.510, top1 = 85.45%], valid : [loss = 1.326, top1 = 65.76%], test : [loss = 1.312, top1 = 65.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.86%], valid : [loss = 2.418, top1 = 39.17%], test : [loss = 2.449, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.67%], valid : [loss = 0.814, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9814/15625) 009814-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.557, top1 = 88.62%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=16.80 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.347, top1 = 92.54%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=21.01 ms.
cifar100       train : [loss = 0.050, top1 = 99.16%], valid : [loss = 1.443, top1 = 69.46%], test : [loss = 1.448, top1 = 69.00%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.81 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.77%], valid : [loss = 2.395, top1 = 39.30%], test : [loss = 2.410, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.57%], valid : [loss = 0.860, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9815/15625) 009815-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.503, top1 = 88.92%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.323, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.75 ms.
cifar100       train : [loss = 0.377, top1 = 89.54%], valid : [loss = 1.262, top1 = 66.22%], test : [loss = 1.289, top1 = 67.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.46%], valid : [loss = 2.404, top1 = 38.10%], test : [loss = 2.418, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9816/15625) 009816-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.20%], valid : [loss = 0.663, top1 = 77.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10        train : [loss = 0.525, top1 = 81.75%], test  : [loss = 0.597, top1 = 79.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.65 ms.
cifar100       train : [loss = 1.696, top1 = 54.08%], valid : [loss = 1.853, top1 = 50.74%], test : [loss = 1.889, top1 = 50.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.18%], valid : [loss = 3.307, top1 = 21.43%], test : [loss = 3.351, top1 = 21.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.14%], valid : [loss = 1.299, top1 = 53.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9817/15625) 009817-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.295, top1 = 93.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.37 ms.
cifar100       train : [loss = 0.064, top1 = 99.09%], valid : [loss = 1.328, top1 = 70.31%], test : [loss = 1.344, top1 = 70.55%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 1.548, top1 = 58.15%], valid : [loss = 2.282, top1 = 43.26%], test : [loss = 2.290, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9818/15625) 009818-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.483, top1 = 89.48%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=14.62 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.328, top1 = 92.56%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.76 ms.
cifar100       train : [loss = 0.209, top1 = 94.71%], valid : [loss = 1.374, top1 = 67.90%], test : [loss = 1.340, top1 = 67.92%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 1.936, top1 = 49.02%], valid : [loss = 2.322, top1 = 41.83%], test : [loss = 2.367, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.32%], valid : [loss = 0.679, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9819/15625) 009819-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.86%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.43 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.288, top1 = 93.57%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.30 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.350, top1 = 70.22%], test : [loss = 1.329, top1 = 70.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 1.544, top1 = 58.28%], valid : [loss = 2.266, top1 = 43.17%], test : [loss = 2.292, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.17%], valid : [loss = 0.505, top1 = 83.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9820/15625) 009820-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.52 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.73%], valid : [loss = 0.482, top1 = 84.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.65 ms.
cifar10        train : [loss = 0.303, top1 = 89.81%], test  : [loss = 0.398, top1 = 86.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.84 ms.
cifar100       train : [loss = 1.336, top1 = 62.94%], valid : [loss = 1.536, top1 = 57.42%], test : [loss = 1.523, top1 = 58.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.67%], valid : [loss = 2.894, top1 = 30.03%], test : [loss = 2.966, top1 = 27.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9821/15625) 009821-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.550, top1 = 88.47%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.345, top1 = 91.93%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.67 ms.
cifar100       train : [loss = 0.291, top1 = 92.03%], valid : [loss = 1.356, top1 = 67.22%], test : [loss = 1.322, top1 = 67.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.74 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 44.00%], valid : [loss = 2.414, top1 = 38.83%], test : [loss = 2.434, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.59%], valid : [loss = 0.829, top1 = 70.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9822/15625) 009822-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.534, top1 = 88.87%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.66 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.333, top1 = 92.61%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.47 ms.
cifar100       train : [loss = 0.148, top1 = 96.55%], valid : [loss = 1.382, top1 = 68.84%], test : [loss = 1.350, top1 = 68.88%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.21 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.03%], valid : [loss = 2.259, top1 = 41.77%], test : [loss = 2.254, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.17%], valid : [loss = 0.779, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9823/15625) 009823-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.02 ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.56%], valid : [loss = 0.647, top1 = 78.29%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.62 ms.
cifar10        train : [loss = 0.500, top1 = 82.76%], test  : [loss = 0.583, top1 = 80.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.10 ms.
cifar100       train : [loss = 1.720, top1 = 53.24%], valid : [loss = 1.861, top1 = 50.74%], test : [loss = 1.881, top1 = 50.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.44 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.21%], valid : [loss = 3.317, top1 = 22.03%], test : [loss = 3.329, top1 = 22.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9824/15625) 009824-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.511, top1 = 88.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.338, top1 = 92.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.37 ms.
cifar100       train : [loss = 0.342, top1 = 90.69%], valid : [loss = 1.272, top1 = 67.27%], test : [loss = 1.273, top1 = 67.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.22 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.75%], valid : [loss = 2.397, top1 = 38.92%], test : [loss = 2.421, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9825/15625) 009825-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.374, top1 = 86.76%], valid : [loss = 0.621, top1 = 79.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.317, top1 = 89.14%], test  : [loss = 0.448, top1 = 84.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.47 ms.
cifar100       train : [loss = 1.624, top1 = 55.16%], valid : [loss = 1.843, top1 = 49.48%], test : [loss = 1.839, top1 = 50.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 3.019, top1 = 26.26%], valid : [loss = 3.022, top1 = 27.10%], test : [loss = 3.072, top1 = 25.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.015, top1 = 63.32%], valid : [loss = 1.060, top1 = 62.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9826/15625) 009826-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.42%], valid : [loss = 0.839, top1 = 79.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.129, top1 = 95.63%], test  : [loss = 0.538, top1 = 85.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 0.844, top1 = 75.37%], valid : [loss = 1.694, top1 = 57.05%], test : [loss = 1.684, top1 = 57.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 26.30%], valid : [loss = 3.187, top1 = 23.94%], test : [loss = 3.206, top1 = 23.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 62.99%], valid : [loss = 1.089, top1 = 61.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9827/15625) 009827-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.517, top1 = 88.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.358, top1 = 91.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.11 ms.
cifar100       train : [loss = 0.340, top1 = 90.66%], valid : [loss = 1.277, top1 = 67.90%], test : [loss = 1.289, top1 = 66.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.50%], valid : [loss = 2.399, top1 = 38.83%], test : [loss = 2.403, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9828/15625) 009828-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.598, top1 = 87.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.416, top1 = 90.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.38 ms.
cifar100       train : [loss = 0.219, top1 = 94.54%], valid : [loss = 1.466, top1 = 65.98%], test : [loss = 1.507, top1 = 65.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.47 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 44.08%], valid : [loss = 2.547, top1 = 36.47%], test : [loss = 2.619, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.10%], valid : [loss = 0.676, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9829/15625) 009829-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.546, top1 = 88.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.370, top1 = 91.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.20 ms.
cifar100       train : [loss = 0.295, top1 = 91.98%], valid : [loss = 1.308, top1 = 67.36%], test : [loss = 1.284, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.09 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.77%], valid : [loss = 2.400, top1 = 38.53%], test : [loss = 2.402, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.06%], valid : [loss = 0.857, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9830/15625) 009830-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.569, top1 = 88.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.352, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.13 ms.
cifar100       train : [loss = 0.182, top1 = 95.47%], valid : [loss = 1.342, top1 = 67.82%], test : [loss = 1.362, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.93 ms.
ImageNet16-120 train : [loss = 2.097, top1 = 45.39%], valid : [loss = 2.410, top1 = 39.13%], test : [loss = 2.398, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 69.90%], valid : [loss = 0.888, top1 = 68.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9831/15625) 009831-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.70%], valid : [loss = 0.536, top1 = 84.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.130, top1 = 95.89%], test  : [loss = 0.381, top1 = 88.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.989, top1 = 71.43%], valid : [loss = 1.412, top1 = 61.35%], test : [loss = 1.414, top1 = 61.41%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.413, top1 = 38.45%], valid : [loss = 2.524, top1 = 36.66%], test : [loss = 2.553, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 69.06%], valid : [loss = 0.919, top1 = 68.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9832/15625) 009832-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.00%], valid : [loss = 0.466, top1 = 84.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10        train : [loss = 0.301, top1 = 89.86%], test  : [loss = 0.404, top1 = 86.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.84 ms.
cifar100       train : [loss = 1.320, top1 = 63.39%], valid : [loss = 1.513, top1 = 57.94%], test : [loss = 1.494, top1 = 58.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.932, top1 = 28.36%], valid : [loss = 2.913, top1 = 28.87%], test : [loss = 2.988, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.56%], valid : [loss = 0.745, top1 = 73.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9833/15625) 009833-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.73%], valid : [loss = 0.468, top1 = 86.39%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.41 ms.
cifar10        train : [loss = 0.124, top1 = 96.09%], test  : [loss = 0.334, top1 = 89.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.62 ms.
cifar100       train : [loss = 0.745, top1 = 79.08%], valid : [loss = 1.263, top1 = 65.36%], test : [loss = 1.265, top1 = 64.14%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.79 ms.
ImageNet16-120 train : [loss = 2.480, top1 = 37.14%], valid : [loss = 2.597, top1 = 35.00%], test : [loss = 2.613, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.18%], valid : [loss = 0.819, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9834/15625) 009834-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.05%], valid : [loss = 0.583, top1 = 86.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.063, top1 = 98.01%], test  : [loss = 0.386, top1 = 89.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.79 ms.
cifar100       train : [loss = 0.671, top1 = 80.20%], valid : [loss = 1.324, top1 = 63.68%], test : [loss = 1.311, top1 = 65.50%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.19%], valid : [loss = 2.522, top1 = 36.57%], test : [loss = 2.542, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.88%], valid : [loss = 0.782, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9835/15625) 009835-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.462, top1 = 89.25%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.60 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.296, top1 = 92.48%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.85 ms.
cifar100       train : [loss = 0.329, top1 = 91.18%], valid : [loss = 1.248, top1 = 68.10%], test : [loss = 1.271, top1 = 66.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.044, top1 = 46.45%], valid : [loss = 2.306, top1 = 40.43%], test : [loss = 2.349, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.50%], valid : [loss = 0.610, top1 = 79.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9836/15625) 009836-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.501, top1 = 89.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.31 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.314, top1 = 93.42%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.44 ms.
cifar100       train : [loss = 0.099, top1 = 98.15%], valid : [loss = 1.314, top1 = 69.62%], test : [loss = 1.312, top1 = 69.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 1.679, top1 = 55.06%], valid : [loss = 2.178, top1 = 45.13%], test : [loss = 2.132, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.46%], valid : [loss = 0.681, top1 = 76.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9837/15625) 009837-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.182, top1 = 94.13%], valid : [loss = 0.528, top1 = 83.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.83 ms.
cifar10        train : [loss = 0.173, top1 = 94.16%], test  : [loss = 0.400, top1 = 87.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.78 ms.
cifar100       train : [loss = 1.073, top1 = 69.01%], valid : [loss = 1.458, top1 = 60.60%], test : [loss = 1.432, top1 = 60.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.37%], valid : [loss = 2.691, top1 = 32.73%], test : [loss = 2.715, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.59%], valid : [loss = 0.962, top1 = 65.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9838/15625) 009838-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.11%], valid : [loss = 0.615, top1 = 85.25%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.58 ms.
cifar10        train : [loss = 0.078, top1 = 97.57%], test  : [loss = 0.381, top1 = 89.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.81 ms.
cifar100       train : [loss = 0.717, top1 = 79.25%], valid : [loss = 1.379, top1 = 63.60%], test : [loss = 1.343, top1 = 63.54%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 36.01%], valid : [loss = 2.658, top1 = 34.23%], test : [loss = 2.675, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.06%], valid : [loss = 0.777, top1 = 73.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9839/15625) 009839-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.23%], valid : [loss = 0.584, top1 = 85.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.105, top1 = 96.54%], test  : [loss = 0.390, top1 = 88.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 0.824, top1 = 75.86%], valid : [loss = 1.425, top1 = 61.40%], test : [loss = 1.399, top1 = 62.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.05%], valid : [loss = 2.801, top1 = 30.90%], test : [loss = 2.826, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9840/15625) 009840-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.59%], valid : [loss = 0.477, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10        train : [loss = 0.300, top1 = 89.93%], test  : [loss = 0.393, top1 = 86.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.21 ms.
cifar100       train : [loss = 1.328, top1 = 63.07%], valid : [loss = 1.532, top1 = 58.24%], test : [loss = 1.494, top1 = 57.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.66%], valid : [loss = 2.892, top1 = 30.23%], test : [loss = 2.965, top1 = 27.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9841/15625) 009841-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.287, top1 = 90.03%], valid : [loss = 0.556, top1 = 82.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10        train : [loss = 0.254, top1 = 91.36%], test  : [loss = 0.425, top1 = 86.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.72 ms.
cifar100       train : [loss = 1.364, top1 = 61.58%], valid : [loss = 1.631, top1 = 55.66%], test : [loss = 1.616, top1 = 55.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 2.882, top1 = 28.95%], valid : [loss = 2.865, top1 = 29.53%], test : [loss = 2.914, top1 = 28.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.48%], valid : [loss = 1.042, top1 = 63.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9842/15625) 009842-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.16%], valid : [loss = 0.553, top1 = 86.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10        train : [loss = 0.049, top1 = 98.70%], test  : [loss = 0.350, top1 = 90.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.54 ms.
cifar100       train : [loss = 0.511, top1 = 85.38%], valid : [loss = 1.306, top1 = 65.72%], test : [loss = 1.300, top1 = 66.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 41.90%], valid : [loss = 2.448, top1 = 38.10%], test : [loss = 2.451, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.74%], valid : [loss = 0.852, top1 = 70.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9843/15625) 009843-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.32%], valid : [loss = 0.709, top1 = 80.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.44 ms.
cifar10        train : [loss = 0.197, top1 = 93.14%], test  : [loss = 0.530, top1 = 84.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 0.894, top1 = 73.88%], valid : [loss = 1.654, top1 = 57.18%], test : [loss = 1.651, top1 = 57.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.14 ms.
ImageNet16-120 train : [loss = 3.476, top1 = 17.30%], valid : [loss = 3.483, top1 = 17.30%], test : [loss = 3.472, top1 = 17.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9844/15625) 009844-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.496, top1 = 88.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.358, top1 = 90.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.482, top1 = 85.98%], valid : [loss = 1.358, top1 = 65.42%], test : [loss = 1.372, top1 = 64.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 40.02%], valid : [loss = 2.507, top1 = 36.23%], test : [loss = 2.542, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.61%], valid : [loss = 0.697, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9845/15625) 009845-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.175, top1 = 94.22%], valid : [loss = 0.536, top1 = 84.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.182, top1 = 93.79%], test  : [loss = 0.391, top1 = 87.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.93 ms.
cifar100       train : [loss = 1.189, top1 = 66.14%], valid : [loss = 1.491, top1 = 58.70%], test : [loss = 1.515, top1 = 58.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.689, top1 = 33.11%], valid : [loss = 2.716, top1 = 32.87%], test : [loss = 2.752, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.09%], valid : [loss = 0.964, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9846/15625) 009846-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.502, top1 = 88.72%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.321, top1 = 92.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.30 ms.
cifar100       train : [loss = 0.340, top1 = 90.80%], valid : [loss = 1.250, top1 = 67.66%], test : [loss = 1.277, top1 = 67.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.97%], valid : [loss = 2.373, top1 = 39.13%], test : [loss = 2.433, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.43%], valid : [loss = 0.747, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9847/15625) 009847-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.14%], valid : [loss = 0.508, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.077, top1 = 97.73%], test  : [loss = 0.347, top1 = 89.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.79 ms.
cifar100       train : [loss = 0.696, top1 = 79.93%], valid : [loss = 1.286, top1 = 65.12%], test : [loss = 1.276, top1 = 65.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.94%], valid : [loss = 2.490, top1 = 36.50%], test : [loss = 2.549, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.87%], valid : [loss = 0.925, top1 = 67.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9848/15625) 009848-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.52%], valid : [loss = 0.453, top1 = 86.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10        train : [loss = 0.162, top1 = 94.72%], test  : [loss = 0.350, top1 = 88.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 1.030, top1 = 70.55%], valid : [loss = 1.366, top1 = 61.72%], test : [loss = 1.380, top1 = 60.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.60%], valid : [loss = 2.696, top1 = 32.93%], test : [loss = 2.697, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9849/15625) 009849-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.48%], valid : [loss = 0.696, top1 = 83.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.479, top1 = 87.66%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 0.805, top1 = 76.41%], valid : [loss = 1.653, top1 = 57.42%], test : [loss = 1.625, top1 = 58.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.742, top1 = 31.87%], valid : [loss = 2.911, top1 = 29.23%], test : [loss = 2.932, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.43%], valid : [loss = 0.956, top1 = 66.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9850/15625) 009850-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.68 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9851/15625) 009851-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.495, top1 = 89.97%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.15 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.313, top1 = 93.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.28 ms.
cifar100       train : [loss = 0.075, top1 = 98.90%], valid : [loss = 1.329, top1 = 69.92%], test : [loss = 1.335, top1 = 69.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 1.710, top1 = 54.20%], valid : [loss = 2.272, top1 = 43.03%], test : [loss = 2.196, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.73%], valid : [loss = 0.587, top1 = 79.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9852/15625) 009852-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.50 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.54 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9853/15625) 009853-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.95%], valid : [loss = 0.507, top1 = 85.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.33 ms.
cifar10        train : [loss = 0.170, top1 = 94.23%], test  : [loss = 0.379, top1 = 88.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.36 ms.
cifar100       train : [loss = 1.075, top1 = 69.03%], valid : [loss = 1.452, top1 = 60.39%], test : [loss = 1.460, top1 = 60.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.75%], valid : [loss = 2.628, top1 = 34.08%], test : [loss = 2.684, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.66%], valid : [loss = 0.930, top1 = 67.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9854/15625) 009854-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.544, top1 = 88.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.78 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.344, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.49 ms.
cifar100       train : [loss = 0.287, top1 = 91.97%], valid : [loss = 1.310, top1 = 68.08%], test : [loss = 1.348, top1 = 68.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.46%], valid : [loss = 2.428, top1 = 39.20%], test : [loss = 2.425, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9855/15625) 009855-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.539, top1 = 88.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.027, top1 = 99.23%], test  : [loss = 0.339, top1 = 91.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 0.432, top1 = 87.54%], valid : [loss = 1.249, top1 = 66.64%], test : [loss = 1.288, top1 = 66.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 2.246, top1 = 41.94%], valid : [loss = 2.421, top1 = 38.10%], test : [loss = 2.458, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9856/15625) 009856-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.181, top1 = 94.12%], valid : [loss = 0.532, top1 = 83.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10        train : [loss = 0.187, top1 = 93.76%], test  : [loss = 0.393, top1 = 87.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.26 ms.
cifar100       train : [loss = 1.189, top1 = 66.36%], valid : [loss = 1.515, top1 = 59.04%], test : [loss = 1.517, top1 = 58.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.34%], valid : [loss = 2.643, top1 = 34.00%], test : [loss = 2.706, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9857/15625) 009857-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.148, top1 = 95.23%], valid : [loss = 0.506, top1 = 85.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10        train : [loss = 0.165, top1 = 94.45%], test  : [loss = 0.372, top1 = 88.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.00 ms.
cifar100       train : [loss = 1.041, top1 = 70.16%], valid : [loss = 1.399, top1 = 61.53%], test : [loss = 1.391, top1 = 61.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.47 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.81%], valid : [loss = 2.644, top1 = 34.29%], test : [loss = 2.670, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.44%], valid : [loss = 0.917, top1 = 67.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9858/15625) 009858-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.556, top1 = 88.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.353, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.40 ms.
cifar100       train : [loss = 0.252, top1 = 93.39%], valid : [loss = 1.333, top1 = 67.20%], test : [loss = 1.311, top1 = 68.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.02%], valid : [loss = 2.465, top1 = 36.33%], test : [loss = 2.510, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.51%], valid : [loss = 0.930, top1 = 66.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9859/15625) 009859-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.21%], valid : [loss = 0.891, top1 = 70.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10        train : [loss = 0.561, top1 = 80.43%], test  : [loss = 0.730, top1 = 75.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.93 ms.
cifar100       train : [loss = 1.780, top1 = 52.21%], valid : [loss = 2.048, top1 = 47.24%], test : [loss = 2.063, top1 = 46.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.74%], valid : [loss = 3.635, top1 = 16.33%], test : [loss = 3.662, top1 = 16.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9860/15625) 009860-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.57%], valid : [loss = 0.970, top1 = 67.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10        train : [loss = 0.775, top1 = 72.63%], test  : [loss = 0.874, top1 = 69.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.78 ms.
cifar100       train : [loss = 2.126, top1 = 44.07%], valid : [loss = 2.293, top1 = 41.56%], test : [loss = 2.309, top1 = 41.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 3.743, top1 = 14.26%], valid : [loss = 3.774, top1 = 13.90%], test : [loss = 3.776, top1 = 13.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.463, top1 = 46.40%], valid : [loss = 1.488, top1 = 45.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9861/15625) 009861-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.483, top1 = 89.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.305, top1 = 92.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.58 ms.
cifar100       train : [loss = 0.231, top1 = 94.40%], valid : [loss = 1.231, top1 = 69.12%], test : [loss = 1.229, top1 = 69.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.78%], valid : [loss = 2.269, top1 = 42.27%], test : [loss = 2.297, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.74%], valid : [loss = 0.675, top1 = 76.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9862/15625) 009862-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.592, top1 = 87.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.80 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.401, top1 = 91.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.09 ms.
cifar100       train : [loss = 0.388, top1 = 89.02%], valid : [loss = 1.394, top1 = 65.26%], test : [loss = 1.368, top1 = 66.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.08%], valid : [loss = 2.514, top1 = 37.00%], test : [loss = 2.552, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9863/15625) 009863-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.83%], valid : [loss = 0.537, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.348, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.59 ms.
cifar100       train : [loss = 0.192, top1 = 95.17%], valid : [loss = 1.317, top1 = 68.16%], test : [loss = 1.320, top1 = 69.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 1.998, top1 = 47.64%], valid : [loss = 2.299, top1 = 41.40%], test : [loss = 2.340, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.43%], valid : [loss = 0.803, top1 = 71.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9864/15625) 009864-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.460, top1 = 89.80%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.48 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.300, top1 = 92.82%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.26 ms.
cifar100       train : [loss = 0.197, top1 = 95.29%], valid : [loss = 1.215, top1 = 70.04%], test : [loss = 1.210, top1 = 69.56%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.774, top1 = 52.59%], valid : [loss = 2.148, top1 = 44.03%], test : [loss = 2.155, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.58%], valid : [loss = 0.665, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9865/15625) 009865-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.24%], valid : [loss = 0.897, top1 = 69.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.684, top1 = 76.21%], test  : [loss = 0.761, top1 = 73.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.78 ms.
cifar100       train : [loss = 1.968, top1 = 47.54%], valid : [loss = 2.158, top1 = 45.18%], test : [loss = 2.163, top1 = 44.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.654, top1 = 15.70%], valid : [loss = 3.655, top1 = 15.63%], test : [loss = 3.697, top1 = 15.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9866/15625) 009866-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.49%], valid : [loss = 0.595, top1 = 86.77%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.50 ms.
cifar10        train : [loss = 0.031, top1 = 99.03%], test  : [loss = 0.401, top1 = 90.68%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.50 ms.
cifar100       train : [loss = 0.409, top1 = 88.23%], valid : [loss = 1.536, top1 = 62.26%], test : [loss = 1.536, top1 = 63.16%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.948, top1 = 26.70%], valid : [loss = 3.023, top1 = 25.23%], test : [loss = 3.058, top1 = 24.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.225, top1 = 55.71%], valid : [loss = 1.233, top1 = 55.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9867/15625) 009867-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.509, top1 = 88.21%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.359, top1 = 90.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.81 ms.
cifar100       train : [loss = 0.483, top1 = 85.82%], valid : [loss = 1.371, top1 = 65.30%], test : [loss = 1.369, top1 = 65.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.74%], valid : [loss = 2.513, top1 = 36.13%], test : [loss = 2.544, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.98%], valid : [loss = 0.734, top1 = 74.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9868/15625) 009868-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.572, top1 = 87.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.397, top1 = 91.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.90 ms.
cifar100       train : [loss = 0.390, top1 = 88.94%], valid : [loss = 1.386, top1 = 65.93%], test : [loss = 1.364, top1 = 65.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.14%], valid : [loss = 2.501, top1 = 37.57%], test : [loss = 2.522, top1 = 37.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9869/15625) 009869-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.422, top1 = 90.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.291, top1 = 92.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.75 ms.
cifar100       train : [loss = 0.114, top1 = 97.97%], valid : [loss = 1.275, top1 = 70.24%], test : [loss = 1.305, top1 = 69.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 1.712, top1 = 54.44%], valid : [loss = 2.243, top1 = 43.73%], test : [loss = 2.222, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.56%], valid : [loss = 0.528, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9870/15625) 009870-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.317, top1 = 91.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.330, top1 = 90.98%], valid : [loss = 1.285, top1 = 67.20%], test : [loss = 1.301, top1 = 67.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.42%], valid : [loss = 2.371, top1 = 39.84%], test : [loss = 2.372, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.23%], valid : [loss = 0.557, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9871/15625) 009871-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.80 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.63 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9872/15625) 009872-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.42%], valid : [loss = 0.640, top1 = 84.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.32 ms.
cifar10        train : [loss = 0.087, top1 = 97.20%], test  : [loss = 0.411, top1 = 88.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.775, top1 = 77.14%], valid : [loss = 1.459, top1 = 61.02%], test : [loss = 1.417, top1 = 61.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.04%], valid : [loss = 2.713, top1 = 33.23%], test : [loss = 2.780, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.75%], valid : [loss = 0.867, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9873/15625) 009873-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=22.41 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.54%], valid : [loss = 0.558, top1 = 87.56%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.61 ms.
cifar10        train : [loss = 0.037, top1 = 98.85%], test  : [loss = 0.376, top1 = 90.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.34 ms.
cifar100       train : [loss = 0.520, top1 = 84.96%], valid : [loss = 1.355, top1 = 64.62%], test : [loss = 1.345, top1 = 64.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.42%], valid : [loss = 2.626, top1 = 33.90%], test : [loss = 2.654, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.49%], valid : [loss = 0.973, top1 = 65.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9874/15625) 009874-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.309, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 0.331, top1 = 90.96%], valid : [loss = 1.283, top1 = 67.55%], test : [loss = 1.306, top1 = 67.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.39%], valid : [loss = 2.366, top1 = 39.96%], test : [loss = 2.376, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.00%], valid : [loss = 0.556, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9875/15625) 009875-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.664, top1 = 86.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.421, top1 = 90.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.72 ms.
cifar100       train : [loss = 0.277, top1 = 92.73%], valid : [loss = 1.716, top1 = 61.90%], test : [loss = 1.735, top1 = 60.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.221, top1 = 42.77%], valid : [loss = 2.599, top1 = 36.80%], test : [loss = 2.606, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.69%], valid : [loss = 0.825, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9876/15625) 009876-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.568, top1 = 87.79%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.47 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.331, top1 = 92.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.96 ms.
cifar100       train : [loss = 0.312, top1 = 91.16%], valid : [loss = 1.337, top1 = 66.52%], test : [loss = 1.342, top1 = 67.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.53 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.54%], valid : [loss = 2.502, top1 = 36.37%], test : [loss = 2.474, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.21%], valid : [loss = 0.980, top1 = 65.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9877/15625) 009877-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.343, top1 = 91.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.25 ms.
cifar100       train : [loss = 0.334, top1 = 90.86%], valid : [loss = 1.290, top1 = 67.11%], test : [loss = 1.295, top1 = 67.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.57%], valid : [loss = 2.397, top1 = 38.43%], test : [loss = 2.398, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9878/15625) 009878-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.21%], valid : [loss = 0.597, top1 = 85.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.106, top1 = 96.42%], test  : [loss = 0.413, top1 = 87.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.07 ms.
cifar100       train : [loss = 0.809, top1 = 76.20%], valid : [loss = 1.409, top1 = 62.28%], test : [loss = 1.399, top1 = 62.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 32.94%], valid : [loss = 2.746, top1 = 31.30%], test : [loss = 2.817, top1 = 31.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9879/15625) 009879-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.49%], valid : [loss = 0.844, top1 = 72.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.37 ms.
cifar10        train : [loss = 0.555, top1 = 80.67%], test  : [loss = 0.711, top1 = 75.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.90 ms.
cifar100       train : [loss = 1.770, top1 = 52.17%], valid : [loss = 2.041, top1 = 47.12%], test : [loss = 2.028, top1 = 48.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.70%], valid : [loss = 3.656, top1 = 16.67%], test : [loss = 3.653, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9880/15625) 009880-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.478, top1 = 89.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.308, top1 = 92.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.15 ms.
cifar100       train : [loss = 0.261, top1 = 93.24%], valid : [loss = 1.236, top1 = 69.26%], test : [loss = 1.250, top1 = 68.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.33 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.86%], valid : [loss = 2.231, top1 = 43.10%], test : [loss = 2.221, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9881/15625) 009881-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.703, top1 = 85.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.418, top1 = 90.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.268, top1 = 93.12%], valid : [loss = 1.539, top1 = 64.22%], test : [loss = 1.573, top1 = 63.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.44%], valid : [loss = 2.528, top1 = 36.57%], test : [loss = 2.585, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.35%], valid : [loss = 0.841, top1 = 70.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9882/15625) 009882-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.66%], valid : [loss = 0.518, top1 = 82.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 0.403, top1 = 86.18%], test  : [loss = 0.467, top1 = 84.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.56 ms.
cifar100       train : [loss = 1.514, top1 = 58.49%], valid : [loss = 1.646, top1 = 54.72%], test : [loss = 1.623, top1 = 54.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.31%], valid : [loss = 3.018, top1 = 26.93%], test : [loss = 3.058, top1 = 25.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.148, top1 = 59.02%], valid : [loss = 1.164, top1 = 58.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9883/15625) 009883-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.550, top1 = 89.08%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.91 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.373, top1 = 92.50%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.66 ms.
cifar100       train : [loss = 0.105, top1 = 98.05%], valid : [loss = 1.471, top1 = 68.10%], test : [loss = 1.457, top1 = 68.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.21%], valid : [loss = 2.452, top1 = 39.17%], test : [loss = 2.471, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.35%], valid : [loss = 0.711, top1 = 75.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9884/15625) 009884-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.54%], valid : [loss = 0.571, top1 = 87.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10        train : [loss = 0.036, top1 = 98.91%], test  : [loss = 0.359, top1 = 90.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.14 ms.
cifar100       train : [loss = 0.496, top1 = 85.81%], valid : [loss = 1.316, top1 = 65.52%], test : [loss = 1.296, top1 = 66.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.81 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 34.70%], valid : [loss = 2.626, top1 = 33.07%], test : [loss = 2.658, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.65%], valid : [loss = 0.816, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9885/15625) 009885-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.20%], valid : [loss = 0.567, top1 = 85.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.106, top1 = 96.42%], test  : [loss = 0.410, top1 = 88.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.830, top1 = 75.61%], valid : [loss = 1.411, top1 = 62.40%], test : [loss = 1.425, top1 = 61.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.09%], valid : [loss = 2.765, top1 = 32.70%], test : [loss = 2.795, top1 = 30.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9886/15625) 009886-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.40%], valid : [loss = 0.684, top1 = 84.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.058, top1 = 98.25%], test  : [loss = 0.488, top1 = 87.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 0.632, top1 = 81.48%], valid : [loss = 1.554, top1 = 60.92%], test : [loss = 1.502, top1 = 61.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.59%], valid : [loss = 2.782, top1 = 31.47%], test : [loss = 2.840, top1 = 29.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.85%], valid : [loss = 0.877, top1 = 69.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9887/15625) 009887-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.50%], valid : [loss = 0.621, top1 = 85.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.050, top1 = 98.48%], test  : [loss = 0.415, top1 = 89.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.69 ms.
cifar100       train : [loss = 0.629, top1 = 81.76%], valid : [loss = 1.414, top1 = 63.06%], test : [loss = 1.377, top1 = 63.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.49%], valid : [loss = 2.617, top1 = 34.57%], test : [loss = 2.627, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.33%], valid : [loss = 0.832, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9888/15625) 009888-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.06%], valid : [loss = 0.656, top1 = 82.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.00 ms.
cifar10        train : [loss = 0.146, top1 = 95.14%], test  : [loss = 0.487, top1 = 85.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.91 ms.
cifar100       train : [loss = 0.963, top1 = 72.07%], valid : [loss = 1.620, top1 = 56.62%], test : [loss = 1.622, top1 = 57.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 25.63%], valid : [loss = 3.120, top1 = 24.00%], test : [loss = 3.126, top1 = 24.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9889/15625) 009889-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.098, top1 = 97.01%], valid : [loss = 0.518, top1 = 85.69%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.91 ms.
cifar10        train : [loss = 0.163, top1 = 94.57%], test  : [loss = 0.363, top1 = 88.43%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.62 ms.
cifar100       train : [loss = 0.939, top1 = 73.09%], valid : [loss = 1.404, top1 = 62.06%], test : [loss = 1.361, top1 = 62.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.62%], valid : [loss = 2.669, top1 = 34.13%], test : [loss = 2.707, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.23%], valid : [loss = 0.963, top1 = 66.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9890/15625) 009890-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.36 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.510, top1 = 89.42%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.92 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.349, top1 = 92.63%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.18 ms.
cifar100       train : [loss = 0.106, top1 = 97.74%], valid : [loss = 1.376, top1 = 68.74%], test : [loss = 1.350, top1 = 69.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.35%], valid : [loss = 2.262, top1 = 42.43%], test : [loss = 2.255, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.66%], valid : [loss = 0.957, top1 = 65.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9891/15625) 009891-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.181, top1 = 93.91%], valid : [loss = 0.737, top1 = 79.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.187, top1 = 93.60%], test  : [loss = 0.510, top1 = 84.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.67 ms.
cifar100       train : [loss = 0.899, top1 = 73.87%], valid : [loss = 1.645, top1 = 57.68%], test : [loss = 1.656, top1 = 57.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 3.529, top1 = 16.24%], valid : [loss = 3.522, top1 = 15.43%], test : [loss = 3.526, top1 = 16.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.302, top1 = 52.16%], valid : [loss = 1.305, top1 = 52.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9892/15625) 009892-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.45%], valid : [loss = 0.853, top1 = 71.87%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.551, top1 = 80.72%], test  : [loss = 0.711, top1 = 75.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 1.770, top1 = 52.41%], valid : [loss = 2.045, top1 = 47.12%], test : [loss = 2.077, top1 = 46.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.87%], valid : [loss = 3.642, top1 = 16.64%], test : [loss = 3.666, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9893/15625) 009893-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.37%], valid : [loss = 0.459, top1 = 86.06%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.31 ms.
cifar10        train : [loss = 0.166, top1 = 94.57%], test  : [loss = 0.341, top1 = 88.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.66 ms.
cifar100       train : [loss = 1.000, top1 = 71.63%], valid : [loss = 1.377, top1 = 61.66%], test : [loss = 1.359, top1 = 61.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.61%], valid : [loss = 2.694, top1 = 32.37%], test : [loss = 2.715, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.04%], valid : [loss = 0.814, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9894/15625) 009894-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9895/15625) 009895-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.423, top1 = 89.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.307, top1 = 92.45%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.206, top1 = 95.17%], valid : [loss = 1.284, top1 = 68.68%], test : [loss = 1.252, top1 = 69.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.92%], valid : [loss = 2.265, top1 = 43.23%], test : [loss = 2.287, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.22%], valid : [loss = 0.527, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9896/15625) 009896-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.32%], valid : [loss = 0.453, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10        train : [loss = 0.109, top1 = 96.67%], test  : [loss = 0.332, top1 = 89.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.98 ms.
cifar100       train : [loss = 0.865, top1 = 75.49%], valid : [loss = 1.322, top1 = 63.52%], test : [loss = 1.297, top1 = 63.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.567, top1 = 35.18%], valid : [loss = 2.622, top1 = 33.93%], test : [loss = 2.656, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.46%], valid : [loss = 0.659, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9897/15625) 009897-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.50 ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.38%], valid : [loss = 0.848, top1 = 71.18%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.18 ms.
cifar10        train : [loss = 0.657, top1 = 77.00%], test  : [loss = 0.754, top1 = 74.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.61 ms.
cifar100       train : [loss = 1.967, top1 = 47.77%], valid : [loss = 2.143, top1 = 44.77%], test : [loss = 2.158, top1 = 44.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.80 ms.
ImageNet16-120 train : [loss = 3.656, top1 = 15.68%], valid : [loss = 3.683, top1 = 16.18%], test : [loss = 3.700, top1 = 14.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9898/15625) 009898-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.550, top1 = 88.40%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.352, top1 = 91.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.23 ms.
cifar100       train : [loss = 0.168, top1 = 96.04%], valid : [loss = 1.325, top1 = 68.60%], test : [loss = 1.316, top1 = 68.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.87%], valid : [loss = 2.430, top1 = 38.77%], test : [loss = 2.428, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.16%], valid : [loss = 0.895, top1 = 68.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9899/15625) 009899-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.453, top1 = 89.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.318, top1 = 92.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.65 ms.
cifar100       train : [loss = 0.118, top1 = 97.63%], valid : [loss = 1.382, top1 = 68.47%], test : [loss = 1.385, top1 = 68.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 1.746, top1 = 53.47%], valid : [loss = 2.266, top1 = 42.93%], test : [loss = 2.277, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.75%], valid : [loss = 0.568, top1 = 80.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9900/15625) 009900-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.60%], valid : [loss = 0.634, top1 = 86.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.036, top1 = 98.93%], test  : [loss = 0.414, top1 = 89.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.61 ms.
cifar100       train : [loss = 0.577, top1 = 83.11%], valid : [loss = 1.427, top1 = 63.50%], test : [loss = 1.425, top1 = 62.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.22%], valid : [loss = 2.560, top1 = 36.10%], test : [loss = 2.579, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.50%], valid : [loss = 0.863, top1 = 69.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9901/15625) 009901-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.43%], valid : [loss = 0.849, top1 = 75.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.320, top1 = 88.87%], test  : [loss = 0.640, top1 = 79.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.78 ms.
cifar100       train : [loss = 1.369, top1 = 61.69%], valid : [loss = 1.916, top1 = 49.90%], test : [loss = 1.915, top1 = 50.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 3.452, top1 = 18.06%], valid : [loss = 3.483, top1 = 18.47%], test : [loss = 3.502, top1 = 17.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.30%], valid : [loss = 1.275, top1 = 53.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9902/15625) 009902-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.68%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.330, top1 = 92.99%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.92 ms.
cifar100       train : [loss = 0.079, top1 = 98.78%], valid : [loss = 1.287, top1 = 69.66%], test : [loss = 1.317, top1 = 70.28%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 1.566, top1 = 57.73%], valid : [loss = 2.141, top1 = 44.93%], test : [loss = 2.145, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.44%], valid : [loss = 0.631, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9903/15625) 009903-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.465, top1 = 89.91%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.53 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.312, top1 = 92.84%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.12 ms.
cifar100       train : [loss = 0.084, top1 = 98.79%], valid : [loss = 1.284, top1 = 70.22%], test : [loss = 1.282, top1 = 70.40%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.06 ms.
ImageNet16-120 train : [loss = 1.601, top1 = 56.89%], valid : [loss = 2.181, top1 = 44.30%], test : [loss = 2.169, top1 = 45.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.19%], valid : [loss = 0.601, top1 = 79.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9904/15625) 009904-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.32%], valid : [loss = 0.634, top1 = 85.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.053, top1 = 98.41%], test  : [loss = 0.406, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.36 ms.
cifar100       train : [loss = 0.638, top1 = 81.47%], valid : [loss = 1.424, top1 = 63.15%], test : [loss = 1.403, top1 = 63.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.05%], valid : [loss = 2.607, top1 = 34.49%], test : [loss = 2.657, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.12%], valid : [loss = 0.838, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9905/15625) 009905-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.344, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.325, top1 = 91.30%], valid : [loss = 1.289, top1 = 67.68%], test : [loss = 1.310, top1 = 66.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.70%], valid : [loss = 2.368, top1 = 40.60%], test : [loss = 2.412, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9906/15625) 009906-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.42%], valid : [loss = 0.541, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.035, top1 = 98.93%], test  : [loss = 0.362, top1 = 90.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.437, top1 = 87.19%], valid : [loss = 1.293, top1 = 66.18%], test : [loss = 1.304, top1 = 66.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.34%], valid : [loss = 2.421, top1 = 38.20%], test : [loss = 2.452, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.27%], valid : [loss = 0.892, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9907/15625) 009907-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.531, top1 = 88.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.04 ms.
cifar10        train : [loss = 0.019, top1 = 99.48%], test  : [loss = 0.358, top1 = 91.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 0.364, top1 = 89.52%], valid : [loss = 1.295, top1 = 67.30%], test : [loss = 1.309, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.51%], valid : [loss = 2.372, top1 = 39.27%], test : [loss = 2.384, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.97%], valid : [loss = 0.868, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9908/15625) 009908-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=24.05 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.454, top1 = 89.64%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.43 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.286, top1 = 92.90%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.64 ms.
cifar100       train : [loss = 0.161, top1 = 96.60%], valid : [loss = 1.196, top1 = 70.24%], test : [loss = 1.235, top1 = 69.46%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.38%], valid : [loss = 2.137, top1 = 44.80%], test : [loss = 2.185, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.08%], valid : [loss = 0.605, top1 = 79.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9909/15625) 009909-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.07 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.76%], valid : [loss = 0.504, top1 = 88.79%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.97 ms.
cifar10        train : [loss = 0.018, top1 = 99.61%], test  : [loss = 0.323, top1 = 91.73%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.32 ms.
cifar100       train : [loss = 0.314, top1 = 91.81%], valid : [loss = 1.268, top1 = 67.70%], test : [loss = 1.282, top1 = 67.14%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.20%], valid : [loss = 2.294, top1 = 40.93%], test : [loss = 2.290, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.04%], valid : [loss = 0.828, top1 = 71.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9910/15625) 009910-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.521, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10        train : [loss = 0.024, top1 = 99.33%], test  : [loss = 0.341, top1 = 91.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.95 ms.
cifar100       train : [loss = 0.439, top1 = 87.24%], valid : [loss = 1.281, top1 = 66.64%], test : [loss = 1.282, top1 = 66.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.52%], valid : [loss = 2.391, top1 = 39.47%], test : [loss = 2.358, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.72%], valid : [loss = 0.787, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9911/15625) 009911-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.70 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.43%], valid : [loss = 0.610, top1 = 84.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 0.089, top1 = 97.08%], test  : [loss = 0.428, top1 = 88.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.43 ms.
cifar100       train : [loss = 0.677, top1 = 80.22%], valid : [loss = 1.533, top1 = 60.22%], test : [loss = 1.523, top1 = 61.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 3.237, top1 = 21.13%], valid : [loss = 3.250, top1 = 21.47%], test : [loss = 3.268, top1 = 20.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9912/15625) 009912-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.494, top1 = 89.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.310, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.42 ms.
cifar100       train : [loss = 0.206, top1 = 94.78%], valid : [loss = 1.367, top1 = 67.52%], test : [loss = 1.364, top1 = 67.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.43%], valid : [loss = 2.369, top1 = 41.07%], test : [loss = 2.364, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.74%], valid : [loss = 0.613, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9913/15625) 009913-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.62%], valid : [loss = 0.674, top1 = 77.41%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.94 ms.
cifar10        train : [loss = 0.501, top1 = 82.66%], test  : [loss = 0.592, top1 = 80.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.62 ms.
cifar100       train : [loss = 1.679, top1 = 54.63%], valid : [loss = 1.837, top1 = 50.96%], test : [loss = 1.860, top1 = 51.14%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.36%], valid : [loss = 3.317, top1 = 21.57%], test : [loss = 3.353, top1 = 21.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9914/15625) 009914-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.596, top1 = 87.15%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.422, top1 = 89.89%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.68 ms.
cifar100       train : [loss = 0.176, top1 = 96.50%], valid : [loss = 1.482, top1 = 65.40%], test : [loss = 1.481, top1 = 65.30%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.34%], valid : [loss = 2.604, top1 = 35.73%], test : [loss = 2.613, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.82%], valid : [loss = 0.746, top1 = 73.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9915/15625) 009915-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.79%], valid : [loss = 0.475, top1 = 85.08%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.98 ms.
cifar10        train : [loss = 0.242, top1 = 91.75%], test  : [loss = 0.391, top1 = 87.04%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.99 ms.
cifar100       train : [loss = 1.538, top1 = 57.59%], valid : [loss = 1.748, top1 = 52.26%], test : [loss = 1.745, top1 = 52.82%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 3.226, top1 = 22.38%], valid : [loss = 3.198, top1 = 21.97%], test : [loss = 3.242, top1 = 23.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.16%], valid : [loss = 0.993, top1 = 64.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9916/15625) 009916-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.427, top1 = 90.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.285, top1 = 93.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.25 ms.
cifar100       train : [loss = 0.066, top1 = 99.07%], valid : [loss = 1.315, top1 = 70.33%], test : [loss = 1.299, top1 = 70.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 1.525, top1 = 58.68%], valid : [loss = 2.212, top1 = 44.09%], test : [loss = 2.247, top1 = 43.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.80%], valid : [loss = 0.494, top1 = 83.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9917/15625) 009917-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.528, top1 = 89.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.333, top1 = 92.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.35 ms.
cifar100       train : [loss = 0.117, top1 = 97.64%], valid : [loss = 1.314, top1 = 69.41%], test : [loss = 1.302, top1 = 69.85%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 1.720, top1 = 54.08%], valid : [loss = 2.219, top1 = 43.60%], test : [loss = 2.209, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.25%], valid : [loss = 0.591, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9918/15625) 009918-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.89%], valid : [loss = 0.564, top1 = 84.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10        train : [loss = 0.124, top1 = 96.07%], test  : [loss = 0.383, top1 = 88.31%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.92 ms.
cifar100       train : [loss = 1.028, top1 = 70.54%], valid : [loss = 1.471, top1 = 59.91%], test : [loss = 1.469, top1 = 59.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.451, top1 = 37.78%], valid : [loss = 2.549, top1 = 35.83%], test : [loss = 2.603, top1 = 34.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.28%], valid : [loss = 0.897, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9919/15625) 009919-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.506, top1 = 89.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.37 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.344, top1 = 92.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.54 ms.
cifar100       train : [loss = 0.230, top1 = 93.87%], valid : [loss = 1.394, top1 = 66.72%], test : [loss = 1.405, top1 = 67.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.87 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.83%], valid : [loss = 2.323, top1 = 40.83%], test : [loss = 2.319, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.96%], valid : [loss = 0.663, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9920/15625) 009920-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.99 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.530, top1 = 89.22%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.369, top1 = 91.96%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.07 ms.
cifar100       train : [loss = 0.080, top1 = 99.06%], valid : [loss = 1.419, top1 = 68.08%], test : [loss = 1.398, top1 = 68.00%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=24.03 ms.
ImageNet16-120 train : [loss = 1.761, top1 = 53.27%], valid : [loss = 2.426, top1 = 39.70%], test : [loss = 2.403, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.86%], valid : [loss = 0.697, top1 = 76.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9921/15625) 009921-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.568, top1 = 88.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.377, top1 = 92.31%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.20 ms.
cifar100       train : [loss = 0.099, top1 = 98.22%], valid : [loss = 1.462, top1 = 68.12%], test : [loss = 1.420, top1 = 68.70%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.97%], valid : [loss = 2.418, top1 = 39.53%], test : [loss = 2.448, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.32%], valid : [loss = 0.706, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9922/15625) 009922-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.97%], valid : [loss = 0.489, top1 = 84.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.296, top1 = 90.01%], test  : [loss = 0.399, top1 = 86.48%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.99 ms.
cifar100       train : [loss = 1.330, top1 = 62.96%], valid : [loss = 1.533, top1 = 58.32%], test : [loss = 1.491, top1 = 58.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.56%], valid : [loss = 2.928, top1 = 28.30%], test : [loss = 2.967, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9923/15625) 009923-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.498, top1 = 90.56%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.314, top1 = 93.54%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.46 ms.
cifar100       train : [loss = 0.051, top1 = 99.26%], valid : [loss = 1.318, top1 = 70.70%], test : [loss = 1.292, top1 = 71.18%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.69 ms.
ImageNet16-120 train : [loss = 1.482, top1 = 59.72%], valid : [loss = 2.102, top1 = 46.40%], test : [loss = 2.157, top1 = 45.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.88%], valid : [loss = 0.595, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9924/15625) 009924-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.482, top1 = 89.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.308, top1 = 92.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.321, top1 = 91.35%], valid : [loss = 1.269, top1 = 67.65%], test : [loss = 1.250, top1 = 67.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.66%], valid : [loss = 2.338, top1 = 40.17%], test : [loss = 2.342, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9925/15625) 009925-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.450, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.314, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.322, top1 = 91.33%], valid : [loss = 1.290, top1 = 67.39%], test : [loss = 1.313, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.59%], valid : [loss = 2.369, top1 = 40.48%], test : [loss = 2.403, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.446, top1 = 84.49%], valid : [loss = 0.554, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9926/15625) 009926-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.56%], valid : [loss = 0.462, top1 = 86.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.112, top1 = 96.57%], test  : [loss = 0.333, top1 = 89.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 0.862, top1 = 75.32%], valid : [loss = 1.301, top1 = 64.58%], test : [loss = 1.285, top1 = 63.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 2.567, top1 = 35.26%], valid : [loss = 2.643, top1 = 33.83%], test : [loss = 2.692, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9927/15625) 009927-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.530, top1 = 89.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.335, top1 = 93.12%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.71 ms.
cifar100       train : [loss = 0.108, top1 = 97.82%], valid : [loss = 1.356, top1 = 69.55%], test : [loss = 1.350, top1 = 69.27%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.73%], valid : [loss = 2.194, top1 = 43.96%], test : [loss = 2.231, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.57%], valid : [loss = 0.590, top1 = 79.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9928/15625) 009928-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.581, top1 = 87.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.390, top1 = 91.73%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.98 ms.
cifar100       train : [loss = 0.363, top1 = 89.60%], valid : [loss = 1.433, top1 = 65.20%], test : [loss = 1.436, top1 = 65.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 42.14%], valid : [loss = 2.492, top1 = 37.57%], test : [loss = 2.499, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.66%], valid : [loss = 0.858, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9929/15625) 009929-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.98 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9930/15625) 009930-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.001, top1 = 99.99%], valid : [loss = 0.424, top1 = 91.55%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=21.47 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.278, top1 = 94.36%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.92 ms.
cifar100       train : [loss = 0.013, top1 = 99.94%], valid : [loss = 1.259, top1 = 73.49%], test : [loss = 1.237, top1 = 73.51%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=20.57 ms.
ImageNet16-120 train : [loss = 0.952, top1 = 73.23%], valid : [loss = 2.277, top1 = 46.37%], test : [loss = 2.303, top1 = 46.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.313, top1 = 89.40%], valid : [loss = 0.473, top1 = 84.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9931/15625) 009931-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.552, top1 = 87.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.64 ms.
cifar10        train : [loss = 0.026, top1 = 99.24%], test  : [loss = 0.356, top1 = 91.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.89 ms.
cifar100       train : [loss = 0.347, top1 = 89.88%], valid : [loss = 1.280, top1 = 67.08%], test : [loss = 1.293, top1 = 67.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.45 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.06%], valid : [loss = 2.383, top1 = 40.27%], test : [loss = 2.390, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.62%], valid : [loss = 0.980, top1 = 65.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9932/15625) 009932-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.50%], valid : [loss = 0.452, top1 = 86.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.11 ms.
cifar10        train : [loss = 0.149, top1 = 95.14%], test  : [loss = 0.345, top1 = 88.83%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.71 ms.
cifar100       train : [loss = 0.976, top1 = 72.37%], valid : [loss = 1.333, top1 = 62.62%], test : [loss = 1.351, top1 = 61.48%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.602, top1 = 34.57%], valid : [loss = 2.650, top1 = 34.53%], test : [loss = 2.689, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.66%], valid : [loss = 0.771, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9933/15625) 009933-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.90 ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.54%], valid : [loss = 0.526, top1 = 82.43%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.96 ms.
cifar10        train : [loss = 0.400, top1 = 86.24%], test  : [loss = 0.470, top1 = 84.07%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.05 ms.
cifar100       train : [loss = 1.550, top1 = 57.44%], valid : [loss = 1.662, top1 = 54.41%], test : [loss = 1.660, top1 = 54.59%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.57 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 26.38%], valid : [loss = 3.013, top1 = 27.14%], test : [loss = 3.059, top1 = 25.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9934/15625) 009934-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.29%], valid : [loss = 0.579, top1 = 85.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.23 ms.
cifar10        train : [loss = 0.104, top1 = 96.57%], test  : [loss = 0.381, top1 = 88.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.94 ms.
cifar100       train : [loss = 0.822, top1 = 75.84%], valid : [loss = 1.396, top1 = 62.68%], test : [loss = 1.428, top1 = 61.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.07%], valid : [loss = 2.764, top1 = 30.23%], test : [loss = 2.801, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9935/15625) 009935-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.20%], valid : [loss = 0.534, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10        train : [loss = 0.183, top1 = 93.82%], test  : [loss = 0.391, top1 = 87.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.42 ms.
cifar100       train : [loss = 1.176, top1 = 66.52%], valid : [loss = 1.511, top1 = 58.81%], test : [loss = 1.504, top1 = 58.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.46 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 34.03%], valid : [loss = 2.693, top1 = 33.04%], test : [loss = 2.738, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.50%], valid : [loss = 0.952, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9936/15625) 009936-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.506, top1 = 88.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.343, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.87 ms.
cifar100       train : [loss = 0.258, top1 = 93.37%], valid : [loss = 1.237, top1 = 68.20%], test : [loss = 1.271, top1 = 68.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.41%], valid : [loss = 2.296, top1 = 41.17%], test : [loss = 2.271, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.67%], valid : [loss = 0.615, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9937/15625) 009937-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.470, top1 = 89.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.301, top1 = 92.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.65 ms.
cifar100       train : [loss = 0.260, top1 = 93.16%], valid : [loss = 1.203, top1 = 69.09%], test : [loss = 1.240, top1 = 69.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.73%], valid : [loss = 2.233, top1 = 42.17%], test : [loss = 2.231, top1 = 42.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9938/15625) 009938-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.281, top1 = 90.44%], valid : [loss = 0.869, top1 = 75.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.310, top1 = 89.22%], test  : [loss = 0.630, top1 = 80.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 1.419, top1 = 60.18%], valid : [loss = 1.988, top1 = 49.26%], test : [loss = 1.975, top1 = 49.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 3.519, top1 = 16.82%], valid : [loss = 3.527, top1 = 17.20%], test : [loss = 3.547, top1 = 15.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.19%], valid : [loss = 1.301, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9939/15625) 009939-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.84%], valid : [loss = 0.915, top1 = 79.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10        train : [loss = 0.086, top1 = 97.28%], test  : [loss = 0.601, top1 = 84.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.16 ms.
cifar100       train : [loss = 0.514, top1 = 85.56%], valid : [loss = 1.819, top1 = 57.26%], test : [loss = 1.827, top1 = 56.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.845, top1 = 30.13%], valid : [loss = 3.118, top1 = 26.30%], test : [loss = 3.166, top1 = 24.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.16%], valid : [loss = 1.075, top1 = 61.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9940/15625) 009940-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.445, top1 = 89.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.301, top1 = 92.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.218, top1 = 94.63%], valid : [loss = 1.292, top1 = 68.29%], test : [loss = 1.285, top1 = 68.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.43%], valid : [loss = 2.275, top1 = 42.09%], test : [loss = 2.326, top1 = 41.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.423, top1 = 85.36%], valid : [loss = 0.550, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9941/15625) 009941-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.420, top1 = 91.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.51 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.276, top1 = 93.79%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.16 ms.
cifar100       train : [loss = 0.063, top1 = 99.13%], valid : [loss = 1.358, top1 = 70.64%], test : [loss = 1.354, top1 = 70.62%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.29 ms.
ImageNet16-120 train : [loss = 1.543, top1 = 58.26%], valid : [loss = 2.250, top1 = 44.37%], test : [loss = 2.289, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.351, top1 = 88.04%], valid : [loss = 0.495, top1 = 83.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9942/15625) 009942-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.51%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.315, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.41 ms.
cifar100       train : [loss = 0.284, top1 = 92.43%], valid : [loss = 1.341, top1 = 67.68%], test : [loss = 1.317, top1 = 67.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.56%], valid : [loss = 2.330, top1 = 40.60%], test : [loss = 2.395, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.90%], valid : [loss = 0.574, top1 = 80.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9943/15625) 009943-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.96%], valid : [loss = 0.664, top1 = 77.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10        train : [loss = 0.542, top1 = 81.29%], test  : [loss = 0.607, top1 = 79.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 1.699, top1 = 53.95%], valid : [loss = 1.844, top1 = 50.20%], test : [loss = 1.889, top1 = 50.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 3.380, top1 = 20.21%], valid : [loss = 3.355, top1 = 22.00%], test : [loss = 3.410, top1 = 19.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.349, top1 = 51.06%], valid : [loss = 1.374, top1 = 50.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9944/15625) 009944-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.493, top1 = 82.85%], valid : [loss = 0.655, top1 = 78.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.83 ms.
cifar10        train : [loss = 0.510, top1 = 82.28%], test  : [loss = 0.584, top1 = 80.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.43 ms.
cifar100       train : [loss = 1.702, top1 = 53.74%], valid : [loss = 1.859, top1 = 50.17%], test : [loss = 1.877, top1 = 50.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 21.43%], valid : [loss = 3.298, top1 = 21.46%], test : [loss = 3.344, top1 = 21.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9945/15625) 009945-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.236, top1 = 91.78%], valid : [loss = 0.517, top1 = 83.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10        train : [loss = 0.237, top1 = 91.89%], test  : [loss = 0.393, top1 = 87.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.14 ms.
cifar100       train : [loss = 1.262, top1 = 64.13%], valid : [loss = 1.537, top1 = 58.44%], test : [loss = 1.519, top1 = 58.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 2.874, top1 = 29.23%], valid : [loss = 2.889, top1 = 29.60%], test : [loss = 2.932, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 0.979, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9946/15625) 009946-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.562, top1 = 87.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.378, top1 = 91.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 0.398, top1 = 88.65%], valid : [loss = 1.403, top1 = 65.08%], test : [loss = 1.399, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.86%], valid : [loss = 2.483, top1 = 37.89%], test : [loss = 2.484, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.756, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9947/15625) 009947-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.474, top1 = 84.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10        train : [loss = 0.306, top1 = 90.01%], test  : [loss = 0.402, top1 = 86.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.33 ms.
cifar100       train : [loss = 1.327, top1 = 63.31%], valid : [loss = 1.534, top1 = 57.84%], test : [loss = 1.508, top1 = 57.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.78 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.67%], valid : [loss = 2.911, top1 = 29.80%], test : [loss = 2.971, top1 = 27.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9948/15625) 009948-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.39%], valid : [loss = 0.464, top1 = 85.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.153, top1 = 95.03%], test  : [loss = 0.341, top1 = 89.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.46 ms.
cifar100       train : [loss = 1.026, top1 = 70.60%], valid : [loss = 1.365, top1 = 62.36%], test : [loss = 1.364, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 33.89%], valid : [loss = 2.686, top1 = 33.10%], test : [loss = 2.698, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9949/15625) 009949-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.581, top1 = 87.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.03 ms.
cifar10        train : [loss = 0.040, top1 = 98.81%], test  : [loss = 0.418, top1 = 89.68%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.45 ms.
cifar100       train : [loss = 0.553, top1 = 83.52%], valid : [loss = 1.409, top1 = 63.74%], test : [loss = 1.430, top1 = 63.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 37.07%], valid : [loss = 2.624, top1 = 34.70%], test : [loss = 2.670, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.33%], valid : [loss = 0.729, top1 = 75.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9950/15625) 009950-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.424, top1 = 90.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.276, top1 = 93.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.87 ms.
cifar100       train : [loss = 0.066, top1 = 99.00%], valid : [loss = 1.349, top1 = 70.80%], test : [loss = 1.337, top1 = 70.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 1.544, top1 = 58.25%], valid : [loss = 2.234, top1 = 44.17%], test : [loss = 2.264, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9951/15625) 009951-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.14%], valid : [loss = 0.619, top1 = 85.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10        train : [loss = 0.075, top1 = 97.62%], test  : [loss = 0.398, top1 = 88.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.78 ms.
cifar100       train : [loss = 0.717, top1 = 79.08%], valid : [loss = 1.394, top1 = 62.62%], test : [loss = 1.389, top1 = 62.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.76%], valid : [loss = 2.678, top1 = 33.40%], test : [loss = 2.704, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9952/15625) 009952-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.570, top1 = 79.84%], valid : [loss = 0.739, top1 = 74.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10        train : [loss = 0.498, top1 = 82.62%], test  : [loss = 0.600, top1 = 79.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 1.857, top1 = 49.58%], valid : [loss = 2.039, top1 = 45.82%], test : [loss = 2.008, top1 = 47.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 3.514, top1 = 17.72%], valid : [loss = 3.524, top1 = 18.07%], test : [loss = 3.554, top1 = 16.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.10%], valid : [loss = 1.250, top1 = 55.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9953/15625) 009953-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.505, top1 = 88.20%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.73 ms.
cifar10        train : [loss = 0.024, top1 = 99.40%], test  : [loss = 0.363, top1 = 90.80%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.08 ms.
cifar100       train : [loss = 0.357, top1 = 90.27%], valid : [loss = 1.325, top1 = 67.26%], test : [loss = 1.309, top1 = 67.32%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 45.02%], valid : [loss = 2.388, top1 = 40.00%], test : [loss = 2.417, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.71%], valid : [loss = 0.616, top1 = 78.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9954/15625) 009954-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.573, top1 = 87.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.376, top1 = 91.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.59 ms.
cifar100       train : [loss = 0.379, top1 = 89.35%], valid : [loss = 1.400, top1 = 65.66%], test : [loss = 1.369, top1 = 66.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.98 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.99%], valid : [loss = 2.483, top1 = 37.37%], test : [loss = 2.530, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9955/15625) 009955-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.519, top1 = 88.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.344, top1 = 91.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 0.329, top1 = 91.04%], valid : [loss = 1.281, top1 = 67.68%], test : [loss = 1.290, top1 = 66.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.19%], valid : [loss = 2.414, top1 = 38.20%], test : [loss = 2.425, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9956/15625) 009956-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.11%], valid : [loss = 0.570, top1 = 86.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.50 ms.
cifar10        train : [loss = 0.063, top1 = 97.95%], test  : [loss = 0.378, top1 = 89.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.25 ms.
cifar100       train : [loss = 0.663, top1 = 80.39%], valid : [loss = 1.316, top1 = 64.82%], test : [loss = 1.314, top1 = 65.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.66%], valid : [loss = 2.478, top1 = 37.16%], test : [loss = 2.503, top1 = 36.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9957/15625) 009957-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.57%], valid : [loss = 0.640, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.31 ms.
cifar10        train : [loss = 0.045, top1 = 98.68%], test  : [loss = 0.416, top1 = 89.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.63 ms.
cifar100       train : [loss = 0.611, top1 = 82.15%], valid : [loss = 1.418, top1 = 63.30%], test : [loss = 1.435, top1 = 62.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.442, top1 = 37.96%], valid : [loss = 2.605, top1 = 34.83%], test : [loss = 2.614, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.04%], valid : [loss = 0.837, top1 = 71.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9958/15625) 009958-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.10%], valid : [loss = 0.656, top1 = 84.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.056, top1 = 98.26%], test  : [loss = 0.424, top1 = 89.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.64 ms.
cifar100       train : [loss = 0.653, top1 = 80.79%], valid : [loss = 1.425, top1 = 61.92%], test : [loss = 1.419, top1 = 63.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.501, top1 = 36.84%], valid : [loss = 2.625, top1 = 34.97%], test : [loss = 2.700, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.68%], valid : [loss = 0.873, top1 = 69.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9959/15625) 009959-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.79%], valid : [loss = 0.532, top1 = 85.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10        train : [loss = 0.091, top1 = 97.13%], test  : [loss = 0.356, top1 = 89.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.01 ms.
cifar100       train : [loss = 0.821, top1 = 76.19%], valid : [loss = 1.383, top1 = 62.90%], test : [loss = 1.400, top1 = 62.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.421, top1 = 38.31%], valid : [loss = 2.537, top1 = 35.60%], test : [loss = 2.545, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.57%], valid : [loss = 0.908, top1 = 67.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9960/15625) 009960-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.309, top1 = 89.30%], valid : [loss = 0.595, top1 = 81.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.265, top1 = 90.92%], test  : [loss = 0.410, top1 = 86.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.13 ms.
cifar100       train : [loss = 1.513, top1 = 57.72%], valid : [loss = 1.741, top1 = 52.61%], test : [loss = 1.736, top1 = 52.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.945, top1 = 27.78%], valid : [loss = 2.944, top1 = 27.92%], test : [loss = 3.013, top1 = 27.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.31%], valid : [loss = 0.993, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9961/15625) 009961-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.56%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.11 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.336, top1 = 92.99%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.01 ms.
cifar100       train : [loss = 0.036, top1 = 99.60%], valid : [loss = 1.541, top1 = 67.94%], test : [loss = 1.493, top1 = 68.94%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 1.653, top1 = 55.74%], valid : [loss = 2.342, top1 = 41.43%], test : [loss = 2.367, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.26%], valid : [loss = 0.667, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9962/15625) 009962-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.314, top1 = 89.22%], valid : [loss = 0.569, top1 = 82.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10        train : [loss = 0.283, top1 = 90.16%], test  : [loss = 0.431, top1 = 85.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.473, top1 = 58.67%], valid : [loss = 1.721, top1 = 53.58%], test : [loss = 1.706, top1 = 53.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.938, top1 = 27.90%], valid : [loss = 2.958, top1 = 27.56%], test : [loss = 3.015, top1 = 26.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9963/15625) 009963-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.595, top1 = 86.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.030, top1 = 99.20%], test  : [loss = 0.397, top1 = 90.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.15 ms.
cifar100       train : [loss = 0.498, top1 = 85.41%], valid : [loss = 1.404, top1 = 64.58%], test : [loss = 1.397, top1 = 64.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.92%], valid : [loss = 2.570, top1 = 35.99%], test : [loss = 2.593, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.29%], valid : [loss = 0.845, top1 = 70.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9964/15625) 009964-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.10%], valid : [loss = 0.455, top1 = 86.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.165, top1 = 94.58%], test  : [loss = 0.347, top1 = 88.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.42 ms.
cifar100       train : [loss = 0.996, top1 = 71.44%], valid : [loss = 1.359, top1 = 61.46%], test : [loss = 1.352, top1 = 62.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.34%], valid : [loss = 2.711, top1 = 32.63%], test : [loss = 2.724, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9965/15625) 009965-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.51%], valid : [loss = 0.472, top1 = 86.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.03 ms.
cifar10        train : [loss = 0.121, top1 = 96.22%], test  : [loss = 0.334, top1 = 89.26%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.61 ms.
cifar100       train : [loss = 0.783, top1 = 78.18%], valid : [loss = 1.307, top1 = 63.80%], test : [loss = 1.303, top1 = 64.00%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.74 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.88%], valid : [loss = 2.597, top1 = 35.03%], test : [loss = 2.610, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.80%], valid : [loss = 0.890, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9966/15625) 009966-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.23%], valid : [loss = 0.853, top1 = 72.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10        train : [loss = 0.552, top1 = 80.59%], test  : [loss = 0.715, top1 = 75.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.58 ms.
cifar100       train : [loss = 1.792, top1 = 51.75%], valid : [loss = 2.055, top1 = 46.76%], test : [loss = 2.081, top1 = 46.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.83%], valid : [loss = 3.633, top1 = 17.07%], test : [loss = 3.680, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9967/15625) 009967-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.504, top1 = 89.11%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.351, top1 = 92.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.88 ms.
cifar100       train : [loss = 0.115, top1 = 97.78%], valid : [loss = 1.452, top1 = 67.74%], test : [loss = 1.460, top1 = 67.49%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.65%], valid : [loss = 2.364, top1 = 40.41%], test : [loss = 2.372, top1 = 40.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.24%], valid : [loss = 0.681, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9968/15625) 009968-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.526, top1 = 89.50%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.52 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.333, top1 = 93.43%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.41 ms.
cifar100       train : [loss = 0.027, top1 = 99.81%], valid : [loss = 1.303, top1 = 72.00%], test : [loss = 1.351, top1 = 71.06%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=24.28 ms.
ImageNet16-120 train : [loss = 1.473, top1 = 60.11%], valid : [loss = 2.470, top1 = 40.80%], test : [loss = 2.409, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.72%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9969/15625) 009969-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.503, top1 = 89.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.44 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.327, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.10 ms.
cifar100       train : [loss = 0.122, top1 = 97.63%], valid : [loss = 1.277, top1 = 69.70%], test : [loss = 1.262, top1 = 69.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.39%], valid : [loss = 2.240, top1 = 42.70%], test : [loss = 2.255, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.25%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9970/15625) 009970-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.25%], valid : [loss = 0.986, top1 = 79.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.065, top1 = 97.98%], test  : [loss = 0.639, top1 = 84.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.545, top1 = 84.71%], valid : [loss = 1.907, top1 = 55.72%], test : [loss = 1.899, top1 = 56.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 2.832, top1 = 30.39%], valid : [loss = 3.156, top1 = 24.50%], test : [loss = 3.159, top1 = 25.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.21%], valid : [loss = 1.025, top1 = 63.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9971/15625) 009971-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.553, top1 = 88.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.015, top1 = 99.58%], test  : [loss = 0.361, top1 = 91.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.202, top1 = 94.81%], valid : [loss = 1.341, top1 = 67.86%], test : [loss = 1.361, top1 = 67.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.59 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.02%], valid : [loss = 2.776, top1 = 29.87%], test : [loss = 2.768, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.068, top1 = 61.33%], valid : [loss = 1.089, top1 = 60.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9972/15625) 009972-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.419, top1 = 90.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.263, top1 = 93.84%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.77 ms.
cifar100       train : [loss = 0.067, top1 = 99.11%], valid : [loss = 1.270, top1 = 71.92%], test : [loss = 1.233, top1 = 70.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.96 ms.
ImageNet16-120 train : [loss = 1.469, top1 = 60.00%], valid : [loss = 2.182, top1 = 45.30%], test : [loss = 2.203, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.365, top1 = 87.34%], valid : [loss = 0.496, top1 = 83.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9973/15625) 009973-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.514, top1 = 88.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.342, top1 = 91.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=18.13 ms.
cifar100       train : [loss = 0.374, top1 = 89.88%], valid : [loss = 1.260, top1 = 67.14%], test : [loss = 1.286, top1 = 67.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.67%], valid : [loss = 2.405, top1 = 38.07%], test : [loss = 2.409, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9974/15625) 009974-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.72%], valid : [loss = 0.547, top1 = 88.15%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.70 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.354, top1 = 91.60%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.13 ms.
cifar100       train : [loss = 0.280, top1 = 92.26%], valid : [loss = 1.364, top1 = 66.36%], test : [loss = 1.365, top1 = 67.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 2.441, top1 = 37.47%], valid : [loss = 2.574, top1 = 35.07%], test : [loss = 2.571, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.55%], valid : [loss = 0.945, top1 = 66.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9975/15625) 009975-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.549, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.19 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.365, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.173, top1 = 96.32%], valid : [loss = 1.410, top1 = 67.74%], test : [loss = 1.411, top1 = 67.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 47.97%], valid : [loss = 2.460, top1 = 38.10%], test : [loss = 2.492, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.42%], valid : [loss = 0.712, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9976/15625) 009976-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.32%], valid : [loss = 0.872, top1 = 71.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.19 ms.
cifar10        train : [loss = 0.563, top1 = 80.37%], test  : [loss = 0.725, top1 = 75.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.37 ms.
cifar100       train : [loss = 1.790, top1 = 51.77%], valid : [loss = 2.056, top1 = 47.12%], test : [loss = 2.092, top1 = 46.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.38 ms.
ImageNet16-120 train : [loss = 3.600, top1 = 16.50%], valid : [loss = 3.661, top1 = 16.10%], test : [loss = 3.686, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9977/15625) 009977-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.484, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.16 ms.
cifar100       train : [loss = 0.302, top1 = 91.90%], valid : [loss = 1.239, top1 = 68.38%], test : [loss = 1.264, top1 = 68.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 1.963, top1 = 48.52%], valid : [loss = 2.285, top1 = 41.70%], test : [loss = 2.298, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.75%], valid : [loss = 0.590, top1 = 79.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9978/15625) 009978-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.80%], valid : [loss = 0.463, top1 = 85.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.84 ms.
cifar10        train : [loss = 0.154, top1 = 95.01%], test  : [loss = 0.347, top1 = 89.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.52 ms.
cifar100       train : [loss = 1.004, top1 = 71.34%], valid : [loss = 1.380, top1 = 61.62%], test : [loss = 1.359, top1 = 61.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.86%], valid : [loss = 2.704, top1 = 32.23%], test : [loss = 2.709, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9979/15625) 009979-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.494, top1 = 89.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.338, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.19 ms.
cifar100       train : [loss = 0.177, top1 = 95.79%], valid : [loss = 1.316, top1 = 69.26%], test : [loss = 1.368, top1 = 68.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.77%], valid : [loss = 2.291, top1 = 41.97%], test : [loss = 2.328, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.33%], valid : [loss = 0.583, top1 = 80.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9980/15625) 009980-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.20 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.13 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9981/15625) 009981-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.54%], valid : [loss = 0.857, top1 = 72.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10        train : [loss = 0.553, top1 = 80.64%], test  : [loss = 0.713, top1 = 76.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.65 ms.
cifar100       train : [loss = 1.771, top1 = 52.06%], valid : [loss = 2.056, top1 = 47.64%], test : [loss = 2.066, top1 = 47.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.82%], valid : [loss = 3.625, top1 = 16.80%], test : [loss = 3.665, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9982/15625) 009982-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.514, top1 = 88.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.031, top1 = 99.16%], test  : [loss = 0.369, top1 = 90.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.483, top1 = 85.69%], valid : [loss = 1.328, top1 = 65.76%], test : [loss = 1.319, top1 = 66.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 2.348, top1 = 39.97%], valid : [loss = 2.531, top1 = 35.83%], test : [loss = 2.570, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.67%], valid : [loss = 0.690, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9983/15625) 009983-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.551, top1 = 89.07%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.92 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.355, top1 = 92.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.72 ms.
cifar100       train : [loss = 0.073, top1 = 98.88%], valid : [loss = 1.475, top1 = 68.69%], test : [loss = 1.451, top1 = 68.61%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.793, top1 = 52.44%], valid : [loss = 2.371, top1 = 40.90%], test : [loss = 2.396, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.93%], valid : [loss = 0.724, top1 = 74.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9984/15625) 009984-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 90.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.23 ms.
cifar10        train : [loss = 0.004, top1 = 99.97%], test  : [loss = 0.277, top1 = 93.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.25 ms.
cifar100       train : [loss = 0.098, top1 = 98.24%], valid : [loss = 1.353, top1 = 70.06%], test : [loss = 1.357, top1 = 69.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.671, top1 = 55.10%], valid : [loss = 2.222, top1 = 44.03%], test : [loss = 2.229, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 86.07%], valid : [loss = 0.533, top1 = 82.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9985/15625) 009985-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.345, top1 = 88.10%], valid : [loss = 0.565, top1 = 81.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10        train : [loss = 0.290, top1 = 89.92%], test  : [loss = 0.430, top1 = 85.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 1.564, top1 = 56.48%], valid : [loss = 1.783, top1 = 51.94%], test : [loss = 1.784, top1 = 51.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.96 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 27.72%], valid : [loss = 2.953, top1 = 26.73%], test : [loss = 3.008, top1 = 27.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.74%], valid : [loss = 1.064, top1 = 61.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9986/15625) 009986-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.469, top1 = 89.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.302, top1 = 92.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.76 ms.
cifar100       train : [loss = 0.306, top1 = 91.62%], valid : [loss = 1.233, top1 = 68.10%], test : [loss = 1.231, top1 = 68.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.27 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.09%], valid : [loss = 2.263, top1 = 41.83%], test : [loss = 2.216, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9987/15625) 009987-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.61 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.437, top1 = 89.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.85 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.297, top1 = 92.45%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.51 ms.
cifar100       train : [loss = 0.202, top1 = 95.33%], valid : [loss = 1.262, top1 = 68.92%], test : [loss = 1.241, top1 = 69.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.843, top1 = 51.27%], valid : [loss = 2.281, top1 = 42.13%], test : [loss = 2.284, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.42%], valid : [loss = 0.522, top1 = 82.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9988/15625) 009988-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.542, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.377, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.124, top1 = 97.56%], valid : [loss = 1.478, top1 = 66.76%], test : [loss = 1.428, top1 = 67.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.78%], valid : [loss = 2.417, top1 = 40.23%], test : [loss = 2.460, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.72%], valid : [loss = 0.748, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9989/15625) 009989-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.77%], valid : [loss = 0.645, top1 = 84.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10        train : [loss = 0.068, top1 = 97.83%], test  : [loss = 0.424, top1 = 88.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.83 ms.
cifar100       train : [loss = 0.752, top1 = 77.96%], valid : [loss = 1.423, top1 = 62.48%], test : [loss = 1.426, top1 = 62.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.41%], valid : [loss = 2.679, top1 = 33.67%], test : [loss = 2.715, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.06%], valid : [loss = 0.862, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9990/15625) 009990-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.640, top1 = 85.91%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10        train : [loss = 0.036, top1 = 99.04%], test  : [loss = 0.434, top1 = 89.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.12 ms.
cifar100       train : [loss = 0.449, top1 = 87.47%], valid : [loss = 1.435, top1 = 63.78%], test : [loss = 1.437, top1 = 64.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.32%], valid : [loss = 2.609, top1 = 35.26%], test : [loss = 2.623, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.42%], valid : [loss = 0.794, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9991/15625) 009991-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.54%], valid : [loss = 0.737, top1 = 80.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.73 ms.
cifar10        train : [loss = 0.165, top1 = 94.37%], test  : [loss = 0.519, top1 = 84.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.869, top1 = 74.51%], valid : [loss = 1.618, top1 = 57.88%], test : [loss = 1.635, top1 = 57.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 3.338, top1 = 19.89%], valid : [loss = 3.376, top1 = 19.47%], test : [loss = 3.356, top1 = 19.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.192, top1 = 56.42%], valid : [loss = 1.224, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9992/15625) 009992-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.81%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.38 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.320, top1 = 92.95%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.30 ms.
cifar100       train : [loss = 0.119, top1 = 97.66%], valid : [loss = 1.296, top1 = 70.64%], test : [loss = 1.328, top1 = 69.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.83 ms.
ImageNet16-120 train : [loss = 1.693, top1 = 54.68%], valid : [loss = 2.177, top1 = 43.27%], test : [loss = 2.179, top1 = 45.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.92%], valid : [loss = 0.633, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9993/15625) 009993-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.636, top1 = 86.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.35 ms.
cifar10        train : [loss = 0.038, top1 = 98.98%], test  : [loss = 0.418, top1 = 89.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.60 ms.
cifar100       train : [loss = 0.436, top1 = 87.69%], valid : [loss = 1.471, top1 = 63.76%], test : [loss = 1.483, top1 = 63.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.355, top1 = 39.96%], valid : [loss = 2.591, top1 = 35.37%], test : [loss = 2.637, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.48%], valid : [loss = 0.811, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9994/15625) 009994-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.527, top1 = 88.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.030, top1 = 99.11%], test  : [loss = 0.329, top1 = 91.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.20 ms.
cifar100       train : [loss = 0.451, top1 = 86.88%], valid : [loss = 1.240, top1 = 67.88%], test : [loss = 1.262, top1 = 67.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.55%], valid : [loss = 2.336, top1 = 40.47%], test : [loss = 2.369, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.31%], valid : [loss = 0.784, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9995/15625) 009995-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.524, top1 = 88.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.025, top1 = 99.29%], test  : [loss = 0.354, top1 = 91.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.62 ms.
cifar100       train : [loss = 0.404, top1 = 88.33%], valid : [loss = 1.238, top1 = 68.10%], test : [loss = 1.267, top1 = 67.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.45 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.20%], valid : [loss = 2.400, top1 = 38.10%], test : [loss = 2.444, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.99%], valid : [loss = 0.808, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9996/15625) 009996-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.607, top1 = 87.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.393, top1 = 91.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.31 ms.
cifar100       train : [loss = 0.211, top1 = 95.05%], valid : [loss = 1.405, top1 = 67.18%], test : [loss = 1.390, top1 = 67.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 45.97%], valid : [loss = 2.506, top1 = 37.60%], test : [loss = 2.543, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.94%], valid : [loss = 0.736, top1 = 74.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9997/15625) 009997-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.423, top1 = 91.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.43 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.297, top1 = 93.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.68 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.373, top1 = 69.76%], test : [loss = 1.285, top1 = 71.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 1.547, top1 = 58.23%], valid : [loss = 2.251, top1 = 42.93%], test : [loss = 2.305, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.24%], valid : [loss = 0.499, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9998/15625) 009998-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.576, top1 = 87.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.387, top1 = 91.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.45 ms.
cifar100       train : [loss = 0.387, top1 = 89.06%], valid : [loss = 1.374, top1 = 66.03%], test : [loss = 1.400, top1 = 65.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.89%], valid : [loss = 2.514, top1 = 37.01%], test : [loss = 2.543, top1 = 36.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The ( 9999/15625) 009999-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.72%], valid : [loss = 0.514, top1 = 86.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.074, top1 = 97.84%], test  : [loss = 0.345, top1 = 90.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.662, top1 = 80.89%], valid : [loss = 1.300, top1 = 65.18%], test : [loss = 1.271, top1 = 65.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.90%], valid : [loss = 2.501, top1 = 36.56%], test : [loss = 2.536, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 70.95%], valid : [loss = 0.871, top1 = 69.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10000/15625) 010000-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.417, top1 = 91.40%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.47 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.274, top1 = 93.88%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.64 ms.
cifar100       train : [loss = 0.027, top1 = 99.80%], valid : [loss = 1.269, top1 = 72.42%], test : [loss = 1.260, top1 = 73.16%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 1.229, top1 = 65.98%], valid : [loss = 2.215, top1 = 45.77%], test : [loss = 2.278, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.343, top1 = 88.15%], valid : [loss = 0.494, top1 = 83.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10001/15625) 010001-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.25 ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.71%], valid : [loss = 0.854, top1 = 70.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10        train : [loss = 0.691, top1 = 75.81%], test  : [loss = 0.776, top1 = 73.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 1.950, top1 = 48.00%], valid : [loss = 2.122, top1 = 44.84%], test : [loss = 2.133, top1 = 45.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.20 ms.
ImageNet16-120 train : [loss = 3.652, top1 = 15.75%], valid : [loss = 3.675, top1 = 15.83%], test : [loss = 3.698, top1 = 14.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10002/15625) 010002-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.446, top1 = 89.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.307, top1 = 92.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.06 ms.
cifar100       train : [loss = 0.185, top1 = 95.79%], valid : [loss = 1.267, top1 = 69.31%], test : [loss = 1.258, top1 = 69.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.84%], valid : [loss = 2.258, top1 = 42.50%], test : [loss = 2.279, top1 = 42.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.83%], valid : [loss = 0.532, top1 = 81.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10003/15625) 010003-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.420, top1 = 90.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.283, top1 = 93.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.29 ms.
cifar100       train : [loss = 0.151, top1 = 96.68%], valid : [loss = 1.218, top1 = 70.48%], test : [loss = 1.277, top1 = 69.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.92%], valid : [loss = 2.217, top1 = 43.63%], test : [loss = 2.280, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.36%], valid : [loss = 0.516, top1 = 82.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10004/15625) 010004-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.527, top1 = 89.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.07 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.322, top1 = 93.27%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.88 ms.
cifar100       train : [loss = 0.071, top1 = 98.86%], valid : [loss = 1.335, top1 = 69.50%], test : [loss = 1.341, top1 = 69.86%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.10%], valid : [loss = 2.343, top1 = 39.93%], test : [loss = 2.373, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10005/15625) 010005-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.533, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.358, top1 = 91.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.11 ms.
cifar100       train : [loss = 0.329, top1 = 90.86%], valid : [loss = 1.292, top1 = 67.28%], test : [loss = 1.295, top1 = 66.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.66%], valid : [loss = 2.450, top1 = 39.00%], test : [loss = 2.415, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10006/15625) 010006-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.80%], valid : [loss = 0.631, top1 = 84.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.081, top1 = 97.39%], test  : [loss = 0.411, top1 = 88.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.53 ms.
cifar100       train : [loss = 0.798, top1 = 76.43%], valid : [loss = 1.407, top1 = 62.20%], test : [loss = 1.386, top1 = 63.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.09%], valid : [loss = 2.767, top1 = 31.67%], test : [loss = 2.792, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10007/15625) 010007-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.468, top1 = 90.50%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.12 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.296, top1 = 93.91%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.69 ms.
cifar100       train : [loss = 0.057, top1 = 99.31%], valid : [loss = 1.216, top1 = 71.50%], test : [loss = 1.241, top1 = 71.10%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 1.494, top1 = 59.49%], valid : [loss = 2.151, top1 = 44.43%], test : [loss = 2.162, top1 = 46.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 78.04%], valid : [loss = 0.707, top1 = 75.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10008/15625) 010008-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.52 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.61 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.80 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.07 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10009/15625) 010009-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.608, top1 = 85.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10        train : [loss = 0.069, top1 = 97.89%], test  : [loss = 0.406, top1 = 88.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 0.718, top1 = 79.08%], valid : [loss = 1.383, top1 = 63.20%], test : [loss = 1.361, top1 = 63.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.19%], valid : [loss = 2.636, top1 = 34.42%], test : [loss = 2.700, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 74.08%], valid : [loss = 0.795, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10010/15625) 010010-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.46%], valid : [loss = 0.673, top1 = 84.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10        train : [loss = 0.058, top1 = 98.23%], test  : [loss = 0.452, top1 = 88.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.68 ms.
cifar100       train : [loss = 0.638, top1 = 81.24%], valid : [loss = 1.505, top1 = 61.36%], test : [loss = 1.469, top1 = 63.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.43%], valid : [loss = 2.814, top1 = 30.10%], test : [loss = 2.878, top1 = 30.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.96%], valid : [loss = 0.872, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10011/15625) 010011-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.555, top1 = 88.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.17 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.333, top1 = 92.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.85 ms.
cifar100       train : [loss = 0.288, top1 = 92.03%], valid : [loss = 1.346, top1 = 66.40%], test : [loss = 1.311, top1 = 67.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.89%], valid : [loss = 2.377, top1 = 39.37%], test : [loss = 2.394, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.12%], valid : [loss = 0.860, top1 = 69.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10012/15625) 010012-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.042, top1 = 99.04%], valid : [loss = 0.499, top1 = 87.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10        train : [loss = 0.078, top1 = 97.59%], test  : [loss = 0.346, top1 = 89.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.88 ms.
cifar100       train : [loss = 0.718, top1 = 79.11%], valid : [loss = 1.308, top1 = 64.77%], test : [loss = 1.295, top1 = 64.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.443, top1 = 37.94%], valid : [loss = 2.572, top1 = 34.97%], test : [loss = 2.590, top1 = 35.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.32%], valid : [loss = 0.657, top1 = 77.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10013/15625) 010013-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.607, top1 = 86.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.408, top1 = 90.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.71 ms.
cifar100       train : [loss = 0.513, top1 = 85.04%], valid : [loss = 1.440, top1 = 63.33%], test : [loss = 1.430, top1 = 63.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 38.98%], valid : [loss = 2.574, top1 = 35.09%], test : [loss = 2.599, top1 = 35.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10014/15625) 010014-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 91.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.301, top1 = 67.38%], test : [loss = 1.308, top1 = 67.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.41 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.34%], valid : [loss = 2.358, top1 = 40.52%], test : [loss = 2.410, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10015/15625) 010015-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.05 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.723, top1 = 85.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.023, top1 = 99.35%], test  : [loss = 0.478, top1 = 89.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.16 ms.
cifar100       train : [loss = 0.344, top1 = 90.64%], valid : [loss = 1.615, top1 = 62.26%], test : [loss = 1.672, top1 = 61.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 37.13%], valid : [loss = 2.837, top1 = 30.73%], test : [loss = 2.850, top1 = 31.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.23%], valid : [loss = 0.846, top1 = 70.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10016/15625) 010016-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.487, top1 = 88.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.311, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.57 ms.
cifar100       train : [loss = 0.319, top1 = 91.45%], valid : [loss = 1.229, top1 = 68.76%], test : [loss = 1.232, top1 = 68.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.84%], valid : [loss = 2.295, top1 = 40.50%], test : [loss = 2.332, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.70%], valid : [loss = 0.606, top1 = 79.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10017/15625) 010017-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.449, top1 = 89.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.82%], test  : [loss = 0.334, top1 = 91.48%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.04 ms.
cifar100       train : [loss = 0.332, top1 = 91.01%], valid : [loss = 1.322, top1 = 66.92%], test : [loss = 1.347, top1 = 65.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.95 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.21%], valid : [loss = 2.374, top1 = 40.23%], test : [loss = 2.388, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10018/15625) 010018-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.566, top1 = 88.54%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.384, top1 = 92.50%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.05 ms.
cifar100       train : [loss = 0.098, top1 = 97.87%], valid : [loss = 1.440, top1 = 68.46%], test : [loss = 1.491, top1 = 67.76%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.70 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.45%], valid : [loss = 2.414, top1 = 38.63%], test : [loss = 2.409, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.97%], valid : [loss = 0.931, top1 = 67.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10019/15625) 010019-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.668, top1 = 86.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.408, top1 = 91.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.55 ms.
cifar100       train : [loss = 0.181, top1 = 95.85%], valid : [loss = 1.542, top1 = 65.02%], test : [loss = 1.577, top1 = 64.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.12%], valid : [loss = 2.440, top1 = 38.03%], test : [loss = 2.513, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.25%], valid : [loss = 0.800, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10020/15625) 010020-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.591, top1 = 87.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.377, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.45 ms.
cifar100       train : [loss = 0.206, top1 = 95.22%], valid : [loss = 1.448, top1 = 65.76%], test : [loss = 1.468, top1 = 65.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 45.99%], valid : [loss = 2.519, top1 = 37.00%], test : [loss = 2.535, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10021/15625) 010021-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.303, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.51 ms.
cifar100       train : [loss = 0.335, top1 = 91.08%], valid : [loss = 1.317, top1 = 66.48%], test : [loss = 1.315, top1 = 66.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.17%], valid : [loss = 2.388, top1 = 39.70%], test : [loss = 2.422, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.89%], valid : [loss = 0.559, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10022/15625) 010022-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.522, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.342, top1 = 91.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.344, top1 = 90.52%], valid : [loss = 1.286, top1 = 66.70%], test : [loss = 1.271, top1 = 68.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.50%], valid : [loss = 2.385, top1 = 39.37%], test : [loss = 2.425, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10023/15625) 010023-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.616, top1 = 85.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10        train : [loss = 0.066, top1 = 98.06%], test  : [loss = 0.413, top1 = 88.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.80 ms.
cifar100       train : [loss = 0.703, top1 = 79.35%], valid : [loss = 1.386, top1 = 62.98%], test : [loss = 1.377, top1 = 63.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.81%], valid : [loss = 2.637, top1 = 33.97%], test : [loss = 2.698, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.16%], valid : [loss = 0.781, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10024/15625) 010024-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.539, top1 = 87.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10        train : [loss = 0.029, top1 = 99.18%], test  : [loss = 0.336, top1 = 91.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.62 ms.
cifar100       train : [loss = 0.413, top1 = 88.16%], valid : [loss = 1.233, top1 = 67.78%], test : [loss = 1.258, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.74%], valid : [loss = 2.397, top1 = 39.07%], test : [loss = 2.383, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10025/15625) 010025-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.624, top1 = 84.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.408, top1 = 89.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.85 ms.
cifar100       train : [loss = 0.714, top1 = 79.18%], valid : [loss = 1.410, top1 = 62.60%], test : [loss = 1.351, top1 = 64.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.15%], valid : [loss = 2.645, top1 = 33.67%], test : [loss = 2.657, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.35%], valid : [loss = 0.794, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10026/15625) 010026-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.574, top1 = 87.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.398, top1 = 90.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.371, top1 = 89.57%], valid : [loss = 1.378, top1 = 65.22%], test : [loss = 1.398, top1 = 64.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.22%], valid : [loss = 2.455, top1 = 38.60%], test : [loss = 2.470, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.10%], valid : [loss = 0.759, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10027/15625) 010027-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.557, top1 = 89.27%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.08 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.364, top1 = 92.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.73 ms.
cifar100       train : [loss = 0.103, top1 = 98.24%], valid : [loss = 1.470, top1 = 66.96%], test : [loss = 1.457, top1 = 67.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 51.06%], valid : [loss = 2.481, top1 = 38.20%], test : [loss = 2.418, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.61%], valid : [loss = 0.675, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10028/15625) 010028-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.472, top1 = 90.53%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.338, top1 = 93.16%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.53 ms.
cifar100       train : [loss = 0.042, top1 = 99.44%], valid : [loss = 1.449, top1 = 69.82%], test : [loss = 1.387, top1 = 70.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 1.469, top1 = 60.14%], valid : [loss = 2.248, top1 = 44.03%], test : [loss = 2.347, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 84.97%], valid : [loss = 0.550, top1 = 81.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10029/15625) 010029-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.529, top1 = 88.02%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10        train : [loss = 0.037, top1 = 98.91%], test  : [loss = 0.371, top1 = 90.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 0.542, top1 = 83.93%], valid : [loss = 1.352, top1 = 65.36%], test : [loss = 1.375, top1 = 65.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.33%], valid : [loss = 2.555, top1 = 36.50%], test : [loss = 2.577, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.52%], valid : [loss = 0.729, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10030/15625) 010030-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.497, top1 = 88.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.332, top1 = 92.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.06 ms.
cifar100       train : [loss = 0.345, top1 = 90.62%], valid : [loss = 1.289, top1 = 66.74%], test : [loss = 1.308, top1 = 67.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.64%], valid : [loss = 2.394, top1 = 38.73%], test : [loss = 2.417, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10031/15625) 010031-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.498, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.331, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.09 ms.
cifar100       train : [loss = 0.244, top1 = 93.82%], valid : [loss = 1.282, top1 = 68.60%], test : [loss = 1.287, top1 = 67.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 1.958, top1 = 48.46%], valid : [loss = 2.307, top1 = 40.57%], test : [loss = 2.306, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.64%], valid : [loss = 0.682, top1 = 76.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10032/15625) 010032-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.35%], valid : [loss = 0.748, top1 = 74.42%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.522, top1 = 82.05%], test  : [loss = 0.573, top1 = 80.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 2.000, top1 = 46.39%], valid : [loss = 2.102, top1 = 44.17%], test : [loss = 2.100, top1 = 44.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.51 ms.
ImageNet16-120 train : [loss = 3.169, top1 = 23.59%], valid : [loss = 3.123, top1 = 24.93%], test : [loss = 3.175, top1 = 23.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.142, top1 = 58.86%], valid : [loss = 1.188, top1 = 57.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10033/15625) 010033-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.21 ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.66%], valid : [loss = 0.528, top1 = 82.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.32 ms.
cifar10        train : [loss = 0.393, top1 = 86.53%], test  : [loss = 0.458, top1 = 84.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.21 ms.
cifar100       train : [loss = 1.541, top1 = 57.44%], valid : [loss = 1.672, top1 = 54.12%], test : [loss = 1.664, top1 = 55.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 3.026, top1 = 26.47%], valid : [loss = 2.989, top1 = 28.30%], test : [loss = 3.043, top1 = 25.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.123, top1 = 60.03%], valid : [loss = 1.152, top1 = 59.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10034/15625) 010034-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.86%], valid : [loss = 0.562, top1 = 87.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.66 ms.
cifar10        train : [loss = 0.023, top1 = 99.46%], test  : [loss = 0.413, top1 = 90.19%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.64 ms.
cifar100       train : [loss = 0.341, top1 = 90.93%], valid : [loss = 1.356, top1 = 65.92%], test : [loss = 1.359, top1 = 66.46%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.56%], valid : [loss = 2.551, top1 = 36.23%], test : [loss = 2.552, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.72%], valid : [loss = 0.725, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10035/15625) 010035-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.21%], valid : [loss = 0.595, top1 = 85.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.44 ms.
cifar10        train : [loss = 0.066, top1 = 98.03%], test  : [loss = 0.401, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.80 ms.
cifar100       train : [loss = 0.692, top1 = 79.95%], valid : [loss = 1.349, top1 = 64.30%], test : [loss = 1.352, top1 = 63.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.38%], valid : [loss = 2.657, top1 = 33.38%], test : [loss = 2.668, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.18%], valid : [loss = 0.770, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10036/15625) 010036-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.457, top1 = 89.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.295, top1 = 92.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.08 ms.
cifar100       train : [loss = 0.193, top1 = 95.54%], valid : [loss = 1.276, top1 = 69.08%], test : [loss = 1.264, top1 = 69.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.70%], valid : [loss = 2.249, top1 = 42.13%], test : [loss = 2.256, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 85.05%], valid : [loss = 0.546, top1 = 81.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10037/15625) 010037-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.43%], valid : [loss = 0.686, top1 = 84.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10        train : [loss = 0.051, top1 = 98.45%], test  : [loss = 0.448, top1 = 88.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.79 ms.
cifar100       train : [loss = 0.635, top1 = 81.47%], valid : [loss = 1.520, top1 = 61.76%], test : [loss = 1.489, top1 = 61.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.28%], valid : [loss = 2.822, top1 = 29.70%], test : [loss = 2.880, top1 = 29.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.75%], valid : [loss = 0.898, top1 = 68.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10038/15625) 010038-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.499, top1 = 88.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.328, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.346, top1 = 90.67%], valid : [loss = 1.289, top1 = 67.20%], test : [loss = 1.266, top1 = 67.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.62%], valid : [loss = 2.402, top1 = 38.83%], test : [loss = 2.430, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10039/15625) 010039-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.57%], valid : [loss = 0.681, top1 = 76.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.526, top1 = 81.76%], test  : [loss = 0.594, top1 = 80.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 1.700, top1 = 53.59%], valid : [loss = 1.876, top1 = 49.66%], test : [loss = 1.896, top1 = 49.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.98 ms.
ImageNet16-120 train : [loss = 3.398, top1 = 19.88%], valid : [loss = 3.380, top1 = 21.07%], test : [loss = 3.416, top1 = 19.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.349, top1 = 51.06%], valid : [loss = 1.374, top1 = 50.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10040/15625) 010040-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.85%], valid : [loss = 0.547, top1 = 88.64%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.14 ms.
cifar10        train : [loss = 0.009, top1 = 99.74%], test  : [loss = 0.359, top1 = 91.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.48 ms.
cifar100       train : [loss = 0.128, top1 = 97.11%], valid : [loss = 1.426, top1 = 68.14%], test : [loss = 1.463, top1 = 67.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 35.86%], valid : [loss = 2.677, top1 = 32.07%], test : [loss = 2.661, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.31%], valid : [loss = 0.993, top1 = 64.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10041/15625) 010041-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.470, top1 = 89.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.326, top1 = 91.29%], valid : [loss = 1.256, top1 = 67.41%], test : [loss = 1.248, top1 = 67.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.59%], valid : [loss = 2.304, top1 = 40.84%], test : [loss = 2.343, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.20%], valid : [loss = 0.590, top1 = 79.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10042/15625) 010042-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.39 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.26%], valid : [loss = 0.452, top1 = 86.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.56 ms.
cifar10        train : [loss = 0.115, top1 = 96.43%], test  : [loss = 0.329, top1 = 89.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.80 ms.
cifar100       train : [loss = 0.865, top1 = 75.24%], valid : [loss = 1.287, top1 = 64.46%], test : [loss = 1.258, top1 = 64.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.566, top1 = 35.37%], valid : [loss = 2.639, top1 = 34.13%], test : [loss = 2.667, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10043/15625) 010043-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.29 ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.19%], valid : [loss = 0.802, top1 = 72.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.639, top1 = 77.36%], test  : [loss = 0.711, top1 = 75.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.51 ms.
cifar100       train : [loss = 2.065, top1 = 44.21%], valid : [loss = 2.210, top1 = 40.36%], test : [loss = 2.204, top1 = 41.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 3.361, top1 = 19.92%], valid : [loss = 3.371, top1 = 20.30%], test : [loss = 3.404, top1 = 19.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.313, top1 = 52.47%], valid : [loss = 1.388, top1 = 50.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10044/15625) 010044-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.15%], valid : [loss = 0.861, top1 = 71.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.565, top1 = 80.04%], test  : [loss = 0.720, top1 = 75.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.83 ms.
cifar100       train : [loss = 1.770, top1 = 52.49%], valid : [loss = 2.053, top1 = 47.64%], test : [loss = 2.062, top1 = 46.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.76%], valid : [loss = 3.638, top1 = 16.70%], test : [loss = 3.655, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10045/15625) 010045-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.505, top1 = 88.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.309, top1 = 92.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.82 ms.
cifar100       train : [loss = 0.326, top1 = 91.32%], valid : [loss = 1.210, top1 = 67.46%], test : [loss = 1.286, top1 = 67.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.90%], valid : [loss = 2.334, top1 = 40.43%], test : [loss = 2.309, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.97%], valid : [loss = 0.596, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10046/15625) 010046-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.457, top1 = 90.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.25 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.327, top1 = 93.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.13 ms.
cifar100       train : [loss = 0.070, top1 = 98.72%], valid : [loss = 1.403, top1 = 70.20%], test : [loss = 1.421, top1 = 69.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 1.575, top1 = 57.60%], valid : [loss = 2.225, top1 = 43.93%], test : [loss = 2.251, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.423, top1 = 85.14%], valid : [loss = 0.558, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10047/15625) 010047-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.92 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.324, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.41 ms.
cifar100       train : [loss = 0.336, top1 = 90.89%], valid : [loss = 1.271, top1 = 67.29%], test : [loss = 1.286, top1 = 66.85%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.09%], valid : [loss = 2.403, top1 = 38.92%], test : [loss = 2.395, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10048/15625) 010048-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.95%], valid : [loss = 0.539, top1 = 84.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.164, top1 = 94.48%], test  : [loss = 0.383, top1 = 88.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 1.146, top1 = 67.32%], valid : [loss = 1.482, top1 = 59.10%], test : [loss = 1.473, top1 = 59.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.584, top1 = 35.04%], valid : [loss = 2.641, top1 = 34.33%], test : [loss = 2.683, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.32%], valid : [loss = 0.970, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10049/15625) 010049-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.487, top1 = 89.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.321, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.23 ms.
cifar100       train : [loss = 0.276, top1 = 92.69%], valid : [loss = 1.220, top1 = 68.79%], test : [loss = 1.242, top1 = 68.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.03%], valid : [loss = 2.235, top1 = 42.52%], test : [loss = 2.249, top1 = 42.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.32%], valid : [loss = 0.649, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10050/15625) 010050-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.71%], valid : [loss = 0.605, top1 = 86.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.029, top1 = 99.24%], test  : [loss = 0.390, top1 = 90.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.93 ms.
cifar100       train : [loss = 0.493, top1 = 85.56%], valid : [loss = 1.444, top1 = 63.74%], test : [loss = 1.397, top1 = 65.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.20%], valid : [loss = 2.561, top1 = 36.13%], test : [loss = 2.597, top1 = 35.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.84%], valid : [loss = 0.823, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10051/15625) 010051-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.485, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.316, top1 = 91.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.331, top1 = 91.04%], valid : [loss = 1.240, top1 = 67.61%], test : [loss = 1.252, top1 = 67.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.78%], valid : [loss = 2.297, top1 = 41.27%], test : [loss = 2.343, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.79%], valid : [loss = 0.593, top1 = 79.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10052/15625) 010052-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.47%], valid : [loss = 0.970, top1 = 75.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.221, top1 = 92.50%], test  : [loss = 0.627, top1 = 81.73%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 1.200, top1 = 66.18%], valid : [loss = 1.796, top1 = 53.90%], test : [loss = 1.811, top1 = 53.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 3.240, top1 = 22.57%], valid : [loss = 3.368, top1 = 21.33%], test : [loss = 3.398, top1 = 20.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.084, top1 = 61.13%], valid : [loss = 1.133, top1 = 59.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10053/15625) 010053-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.645, top1 = 85.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.08 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.424, top1 = 90.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.29 ms.
cifar100       train : [loss = 0.271, top1 = 92.82%], valid : [loss = 1.595, top1 = 63.04%], test : [loss = 1.603, top1 = 64.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.55%], valid : [loss = 2.515, top1 = 37.27%], test : [loss = 2.523, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.52%], valid : [loss = 0.873, top1 = 69.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10054/15625) 010054-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.530, top1 = 89.51%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.338, top1 = 92.94%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.76 ms.
cifar100       train : [loss = 0.075, top1 = 98.78%], valid : [loss = 1.340, top1 = 70.26%], test : [loss = 1.349, top1 = 69.30%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.90 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.68%], valid : [loss = 2.348, top1 = 40.07%], test : [loss = 2.348, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.80%], valid : [loss = 0.850, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10055/15625) 010055-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.227, top1 = 92.18%], valid : [loss = 0.580, top1 = 82.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10        train : [loss = 0.221, top1 = 92.56%], test  : [loss = 0.419, top1 = 86.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.76 ms.
cifar100       train : [loss = 1.292, top1 = 63.25%], valid : [loss = 1.597, top1 = 56.70%], test : [loss = 1.617, top1 = 56.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.729, top1 = 32.02%], valid : [loss = 2.769, top1 = 30.47%], test : [loss = 2.789, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.62%], valid : [loss = 0.952, top1 = 66.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10056/15625) 010056-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.503, top1 = 88.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.345, top1 = 91.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.12 ms.
cifar100       train : [loss = 0.324, top1 = 91.08%], valid : [loss = 1.300, top1 = 66.54%], test : [loss = 1.281, top1 = 67.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.91%], valid : [loss = 2.388, top1 = 38.47%], test : [loss = 2.406, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10057/15625) 010057-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.44%], valid : [loss = 0.597, top1 = 85.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.10 ms.
cifar10        train : [loss = 0.072, top1 = 97.66%], test  : [loss = 0.426, top1 = 88.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.658, top1 = 80.55%], valid : [loss = 1.515, top1 = 60.80%], test : [loss = 1.511, top1 = 61.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.933, top1 = 27.63%], valid : [loss = 2.992, top1 = 26.63%], test : [loss = 3.035, top1 = 26.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.003, top1 = 63.84%], valid : [loss = 1.040, top1 = 63.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10058/15625) 010058-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.42 ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.73%], valid : [loss = 0.658, top1 = 77.79%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10        train : [loss = 0.529, top1 = 81.66%], test  : [loss = 0.602, top1 = 79.65%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 1.700, top1 = 53.87%], valid : [loss = 1.862, top1 = 50.59%], test : [loss = 1.861, top1 = 50.91%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.21 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.26%], valid : [loss = 3.313, top1 = 21.34%], test : [loss = 3.344, top1 = 20.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10059/15625) 010059-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.591, top1 = 88.73%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.48 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.388, top1 = 92.51%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.39 ms.
cifar100       train : [loss = 0.050, top1 = 99.43%], valid : [loss = 1.439, top1 = 69.18%], test : [loss = 1.483, top1 = 69.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 1.704, top1 = 54.47%], valid : [loss = 2.414, top1 = 39.93%], test : [loss = 2.435, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 79.09%], valid : [loss = 0.692, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10060/15625) 010060-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.344, top1 = 88.18%], valid : [loss = 0.617, top1 = 80.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.85 ms.
cifar10        train : [loss = 0.292, top1 = 89.98%], test  : [loss = 0.446, top1 = 85.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.51 ms.
cifar100       train : [loss = 1.538, top1 = 57.00%], valid : [loss = 1.765, top1 = 52.49%], test : [loss = 1.771, top1 = 51.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 27.76%], valid : [loss = 2.953, top1 = 28.27%], test : [loss = 2.989, top1 = 26.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.008, top1 = 63.75%], valid : [loss = 1.058, top1 = 62.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10061/15625) 010061-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.00%], valid : [loss = 0.560, top1 = 86.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.076, top1 = 97.54%], test  : [loss = 0.377, top1 = 89.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.90 ms.
cifar100       train : [loss = 0.649, top1 = 80.60%], valid : [loss = 1.312, top1 = 64.22%], test : [loss = 1.281, top1 = 65.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.02%], valid : [loss = 2.436, top1 = 37.53%], test : [loss = 2.496, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.79%], valid : [loss = 0.887, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10062/15625) 010062-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.543, top1 = 80.98%], valid : [loss = 0.848, top1 = 72.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.85 ms.
cifar10        train : [loss = 0.550, top1 = 80.79%], test  : [loss = 0.722, top1 = 75.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.85 ms.
cifar100       train : [loss = 1.756, top1 = 52.51%], valid : [loss = 2.010, top1 = 48.28%], test : [loss = 2.045, top1 = 47.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.85%], valid : [loss = 3.633, top1 = 16.70%], test : [loss = 3.652, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10063/15625) 010063-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=22.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.484, top1 = 89.56%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.53 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.287, top1 = 93.63%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=22.83 ms.
cifar100       train : [loss = 0.079, top1 = 98.84%], valid : [loss = 1.346, top1 = 69.14%], test : [loss = 1.354, top1 = 68.96%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=21.75 ms.
ImageNet16-120 train : [loss = 1.603, top1 = 56.75%], valid : [loss = 2.193, top1 = 44.20%], test : [loss = 2.182, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.90%], valid : [loss = 0.721, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10064/15625) 010064-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.575, top1 = 88.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.59 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.378, top1 = 91.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.49 ms.
cifar100       train : [loss = 0.178, top1 = 96.13%], valid : [loss = 1.438, top1 = 67.26%], test : [loss = 1.478, top1 = 66.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.83 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.23%], valid : [loss = 2.445, top1 = 38.00%], test : [loss = 2.470, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.84%], valid : [loss = 0.701, top1 = 75.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10065/15625) 010065-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.517, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.332, top1 = 92.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.42 ms.
cifar100       train : [loss = 0.326, top1 = 91.28%], valid : [loss = 1.295, top1 = 66.96%], test : [loss = 1.283, top1 = 67.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.95%], valid : [loss = 2.405, top1 = 39.83%], test : [loss = 2.423, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.79%], valid : [loss = 0.648, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10066/15625) 010066-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.436, top1 = 89.88%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.81 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.296, top1 = 93.07%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.18 ms.
cifar100       train : [loss = 0.113, top1 = 98.09%], valid : [loss = 1.246, top1 = 70.48%], test : [loss = 1.241, top1 = 70.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.665, top1 = 55.32%], valid : [loss = 2.174, top1 = 44.57%], test : [loss = 2.216, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.405, top1 = 86.08%], valid : [loss = 0.534, top1 = 82.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10067/15625) 010067-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.45%], valid : [loss = 0.571, top1 = 87.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.034, top1 = 98.98%], test  : [loss = 0.371, top1 = 90.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.07 ms.
cifar100       train : [loss = 0.516, top1 = 85.12%], valid : [loss = 1.340, top1 = 65.21%], test : [loss = 1.350, top1 = 64.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.569, top1 = 34.74%], valid : [loss = 2.647, top1 = 33.29%], test : [loss = 2.662, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10068/15625) 010068-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.628, top1 = 86.07%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.91 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.394, top1 = 90.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.93 ms.
cifar100       train : [loss = 0.512, top1 = 85.05%], valid : [loss = 1.465, top1 = 63.33%], test : [loss = 1.472, top1 = 62.87%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.80%], valid : [loss = 2.538, top1 = 35.57%], test : [loss = 2.552, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.80%], valid : [loss = 0.803, top1 = 72.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10069/15625) 010069-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.490, top1 = 89.11%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.53 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.329, top1 = 92.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.52 ms.
cifar100       train : [loss = 0.235, top1 = 94.19%], valid : [loss = 1.226, top1 = 68.58%], test : [loss = 1.220, top1 = 68.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.31%], valid : [loss = 2.252, top1 = 42.80%], test : [loss = 2.261, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10070/15625) 010070-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.00%], valid : [loss = 0.726, top1 = 83.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10        train : [loss = 0.090, top1 = 97.11%], test  : [loss = 0.482, top1 = 86.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.24 ms.
cifar100       train : [loss = 0.836, top1 = 75.64%], valid : [loss = 1.612, top1 = 58.54%], test : [loss = 1.618, top1 = 58.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.24%], valid : [loss = 2.947, top1 = 27.90%], test : [loss = 2.996, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.35%], valid : [loss = 0.864, top1 = 70.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10071/15625) 010071-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.493, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.321, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.64 ms.
cifar100       train : [loss = 0.241, top1 = 94.04%], valid : [loss = 1.228, top1 = 68.96%], test : [loss = 1.235, top1 = 69.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.24%], valid : [loss = 2.274, top1 = 41.71%], test : [loss = 2.290, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10072/15625) 010072-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.77%], valid : [loss = 0.501, top1 = 85.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10        train : [loss = 0.101, top1 = 96.70%], test  : [loss = 0.350, top1 = 89.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.697, top1 = 79.96%], valid : [loss = 1.226, top1 = 66.30%], test : [loss = 1.227, top1 = 65.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.409, top1 = 38.63%], valid : [loss = 2.480, top1 = 36.80%], test : [loss = 2.481, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.65%], valid : [loss = 0.912, top1 = 67.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10073/15625) 010073-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.522, top1 = 89.72%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.47 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.307, top1 = 93.50%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.94 ms.
cifar100       train : [loss = 0.055, top1 = 99.29%], valid : [loss = 1.299, top1 = 70.56%], test : [loss = 1.314, top1 = 70.98%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.85 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.15%], valid : [loss = 2.249, top1 = 42.60%], test : [loss = 2.239, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.99%], valid : [loss = 0.838, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10074/15625) 010074-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.310, top1 = 89.33%], valid : [loss = 0.573, top1 = 81.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.296, top1 = 89.82%], test  : [loss = 0.433, top1 = 85.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.33 ms.
cifar100       train : [loss = 1.464, top1 = 58.92%], valid : [loss = 1.718, top1 = 54.12%], test : [loss = 1.694, top1 = 52.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 2.998, top1 = 26.87%], valid : [loss = 3.024, top1 = 27.20%], test : [loss = 3.080, top1 = 25.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.36%], valid : [loss = 1.009, top1 = 64.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10075/15625) 010075-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.592, top1 = 85.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.068, top1 = 97.95%], test  : [loss = 0.415, top1 = 88.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 0.717, top1 = 79.16%], valid : [loss = 1.402, top1 = 62.75%], test : [loss = 1.388, top1 = 63.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.29%], valid : [loss = 2.660, top1 = 33.93%], test : [loss = 2.677, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10076/15625) 010076-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.58%], valid : [loss = 0.546, top1 = 86.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.046, top1 = 98.58%], test  : [loss = 0.361, top1 = 90.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 0.468, top1 = 86.15%], valid : [loss = 1.344, top1 = 65.84%], test : [loss = 1.340, top1 = 65.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.34 ms.
ImageNet16-120 train : [loss = 2.839, top1 = 28.67%], valid : [loss = 2.887, top1 = 27.50%], test : [loss = 2.899, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.15%], valid : [loss = 1.147, top1 = 58.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10077/15625) 010077-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.41%], valid : [loss = 0.636, top1 = 85.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10        train : [loss = 0.056, top1 = 98.31%], test  : [loss = 0.402, top1 = 89.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.68 ms.
cifar100       train : [loss = 0.651, top1 = 81.03%], valid : [loss = 1.400, top1 = 63.23%], test : [loss = 1.362, top1 = 64.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 37.27%], valid : [loss = 2.611, top1 = 34.81%], test : [loss = 2.635, top1 = 33.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.66%], valid : [loss = 0.829, top1 = 70.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10078/15625) 010078-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.536, top1 = 88.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.72 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.350, top1 = 91.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.498, top1 = 85.81%], valid : [loss = 1.281, top1 = 66.04%], test : [loss = 1.315, top1 = 65.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.576, top1 = 34.42%], valid : [loss = 2.634, top1 = 34.00%], test : [loss = 2.641, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 68.00%], valid : [loss = 0.932, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10079/15625) 010079-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.501, top1 = 88.56%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=20.38 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.340, top1 = 91.90%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.49 ms.
cifar100       train : [loss = 0.358, top1 = 90.21%], valid : [loss = 1.266, top1 = 67.18%], test : [loss = 1.282, top1 = 67.14%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.62%], valid : [loss = 2.397, top1 = 38.93%], test : [loss = 2.431, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.87%], valid : [loss = 0.717, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10080/15625) 010080-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.581, top1 = 87.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.364, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 0.391, top1 = 88.92%], valid : [loss = 1.362, top1 = 65.48%], test : [loss = 1.397, top1 = 65.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.69%], valid : [loss = 2.436, top1 = 38.37%], test : [loss = 2.479, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.51%], valid : [loss = 0.766, top1 = 73.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10081/15625) 010081-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.26%], valid : [loss = 0.853, top1 = 79.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10        train : [loss = 0.126, top1 = 95.72%], test  : [loss = 0.556, top1 = 84.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.84 ms.
cifar100       train : [loss = 0.838, top1 = 75.80%], valid : [loss = 1.628, top1 = 58.12%], test : [loss = 1.654, top1 = 57.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.42%], valid : [loss = 3.176, top1 = 23.67%], test : [loss = 3.222, top1 = 23.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10082/15625) 010082-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.511, top1 = 88.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.340, top1 = 91.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.341, top1 = 90.66%], valid : [loss = 1.278, top1 = 67.13%], test : [loss = 1.275, top1 = 67.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.67%], valid : [loss = 2.413, top1 = 39.10%], test : [loss = 2.431, top1 = 38.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10083/15625) 010083-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.60%], valid : [loss = 0.453, top1 = 86.37%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.49 ms.
cifar10        train : [loss = 0.153, top1 = 94.94%], test  : [loss = 0.342, top1 = 88.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.97 ms.
cifar100       train : [loss = 0.969, top1 = 72.51%], valid : [loss = 1.358, top1 = 61.90%], test : [loss = 1.331, top1 = 62.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.14%], valid : [loss = 2.693, top1 = 32.20%], test : [loss = 2.684, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.40%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10084/15625) 010084-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.539, top1 = 88.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.333, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 0.345, top1 = 90.46%], valid : [loss = 1.284, top1 = 67.06%], test : [loss = 1.286, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 45.03%], valid : [loss = 2.425, top1 = 38.80%], test : [loss = 2.388, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.92%], valid : [loss = 0.769, top1 = 73.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10085/15625) 010085-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.478, top1 = 89.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.309, top1 = 92.37%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.81 ms.
cifar100       train : [loss = 0.223, top1 = 94.62%], valid : [loss = 1.241, top1 = 68.68%], test : [loss = 1.237, top1 = 69.17%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.54 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.60%], valid : [loss = 2.223, top1 = 42.83%], test : [loss = 2.245, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.36%], valid : [loss = 0.632, top1 = 78.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10086/15625) 010086-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.439, top1 = 90.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.12 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.29 ms.
cifar100       train : [loss = 0.060, top1 = 99.11%], valid : [loss = 1.392, top1 = 69.62%], test : [loss = 1.371, top1 = 70.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 1.517, top1 = 58.87%], valid : [loss = 2.222, top1 = 44.50%], test : [loss = 2.286, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.422, top1 = 85.13%], valid : [loss = 0.540, top1 = 81.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10087/15625) 010087-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.504, top1 = 90.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.336, top1 = 93.32%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.68 ms.
cifar100       train : [loss = 0.064, top1 = 98.84%], valid : [loss = 1.374, top1 = 69.88%], test : [loss = 1.363, top1 = 70.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 1.686, top1 = 54.79%], valid : [loss = 2.190, top1 = 42.77%], test : [loss = 2.159, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.87%], valid : [loss = 0.867, top1 = 69.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10088/15625) 010088-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.72%], valid : [loss = 0.543, top1 = 88.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.022, top1 = 99.40%], test  : [loss = 0.351, top1 = 91.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.56 ms.
cifar100       train : [loss = 0.392, top1 = 88.73%], valid : [loss = 1.241, top1 = 67.54%], test : [loss = 1.280, top1 = 67.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.17%], valid : [loss = 2.419, top1 = 37.90%], test : [loss = 2.456, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.87%], valid : [loss = 0.746, top1 = 74.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10089/15625) 010089-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.612, top1 = 85.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 0.067, top1 = 98.00%], test  : [loss = 0.394, top1 = 89.40%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.57 ms.
cifar100       train : [loss = 0.720, top1 = 78.98%], valid : [loss = 1.390, top1 = 62.56%], test : [loss = 1.381, top1 = 63.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.88%], valid : [loss = 2.670, top1 = 33.20%], test : [loss = 2.701, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10090/15625) 010090-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.50%], valid : [loss = 0.865, top1 = 70.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.76 ms.
cifar10        train : [loss = 0.686, top1 = 76.04%], test  : [loss = 0.772, top1 = 72.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.95 ms.
cifar100       train : [loss = 2.000, top1 = 47.01%], valid : [loss = 2.164, top1 = 43.56%], test : [loss = 2.182, top1 = 43.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 3.659, top1 = 15.68%], valid : [loss = 3.681, top1 = 15.43%], test : [loss = 3.689, top1 = 14.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.408, top1 = 48.65%], valid : [loss = 1.432, top1 = 48.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10091/15625) 010091-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.617, top1 = 86.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10        train : [loss = 0.016, top1 = 99.67%], test  : [loss = 0.417, top1 = 90.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.25 ms.
cifar100       train : [loss = 0.289, top1 = 92.51%], valid : [loss = 1.446, top1 = 64.72%], test : [loss = 1.423, top1 = 66.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.193, top1 = 43.16%], valid : [loss = 2.562, top1 = 35.60%], test : [loss = 2.558, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.41%], valid : [loss = 0.785, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10092/15625) 010092-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.516, top1 = 88.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.339, top1 = 92.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.73 ms.
cifar100       train : [loss = 0.340, top1 = 90.74%], valid : [loss = 1.274, top1 = 67.57%], test : [loss = 1.269, top1 = 67.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.79%], valid : [loss = 2.405, top1 = 38.49%], test : [loss = 2.420, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10093/15625) 010093-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10-valid  train : [loss = 1.263, top1 = 54.56%], valid : [loss = 1.306, top1 = 53.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10        train : [loss = 1.218, top1 = 56.31%], test  : [loss = 1.224, top1 = 55.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.09 ms.
cifar100       train : [loss = 2.772, top1 = 30.84%], valid : [loss = 2.860, top1 = 29.35%], test : [loss = 2.842, top1 = 29.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.86 ms.
ImageNet16-120 train : [loss = 3.905, top1 = 11.83%], valid : [loss = 3.911, top1 = 12.64%], test : [loss = 3.919, top1 = 11.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.734, top1 = 34.67%], valid : [loss = 1.724, top1 = 34.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10094/15625) 010094-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.69%], valid : [loss = 0.915, top1 = 68.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10        train : [loss = 0.704, top1 = 75.34%], test  : [loss = 0.793, top1 = 72.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.40 ms.
cifar100       train : [loss = 1.991, top1 = 47.27%], valid : [loss = 2.143, top1 = 44.08%], test : [loss = 2.169, top1 = 43.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 3.666, top1 = 15.42%], valid : [loss = 3.669, top1 = 16.20%], test : [loss = 3.715, top1 = 14.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.380, top1 = 49.35%], valid : [loss = 1.417, top1 = 48.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10095/15625) 010095-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.452, top1 = 89.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.309, top1 = 92.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.181, top1 = 95.90%], valid : [loss = 1.244, top1 = 69.28%], test : [loss = 1.270, top1 = 68.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.61%], valid : [loss = 2.225, top1 = 43.23%], test : [loss = 2.314, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.63%], valid : [loss = 0.522, top1 = 82.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10096/15625) 010096-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.59 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.486, top1 = 89.11%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.84 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.315, top1 = 92.20%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.65 ms.
cifar100       train : [loss = 0.271, top1 = 93.11%], valid : [loss = 1.245, top1 = 68.74%], test : [loss = 1.276, top1 = 69.08%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.80 ms.
ImageNet16-120 train : [loss = 1.932, top1 = 49.11%], valid : [loss = 2.289, top1 = 41.43%], test : [loss = 2.253, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.46%], valid : [loss = 0.638, top1 = 78.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10097/15625) 010097-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.63 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.464, top1 = 86.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.10 ms.
cifar10        train : [loss = 0.113, top1 = 96.47%], test  : [loss = 0.329, top1 = 89.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.39 ms.
cifar100       train : [loss = 0.848, top1 = 75.84%], valid : [loss = 1.291, top1 = 64.28%], test : [loss = 1.298, top1 = 63.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.50%], valid : [loss = 2.623, top1 = 34.37%], test : [loss = 2.658, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.30%], valid : [loss = 0.658, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10098/15625) 010098-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.573, top1 = 87.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.368, top1 = 90.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.72 ms.
cifar100       train : [loss = 0.467, top1 = 86.59%], valid : [loss = 1.297, top1 = 65.86%], test : [loss = 1.318, top1 = 65.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.522, top1 = 35.80%], valid : [loss = 2.612, top1 = 33.57%], test : [loss = 2.627, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.80%], valid : [loss = 0.906, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10099/15625) 010099-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.40%], valid : [loss = 0.653, top1 = 78.10%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.523, top1 = 81.93%], test  : [loss = 0.594, top1 = 80.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 1.689, top1 = 53.93%], valid : [loss = 1.845, top1 = 50.88%], test : [loss = 1.863, top1 = 50.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.68 ms.
ImageNet16-120 train : [loss = 3.341, top1 = 21.08%], valid : [loss = 3.323, top1 = 20.77%], test : [loss = 3.349, top1 = 21.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10100/15625) 010100-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.236, top1 = 92.02%], valid : [loss = 0.530, top1 = 83.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.78 ms.
cifar10        train : [loss = 0.246, top1 = 91.65%], test  : [loss = 0.393, top1 = 86.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.46 ms.
cifar100       train : [loss = 1.346, top1 = 62.19%], valid : [loss = 1.614, top1 = 56.13%], test : [loss = 1.604, top1 = 56.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.860, top1 = 29.40%], valid : [loss = 2.863, top1 = 29.70%], test : [loss = 2.925, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 0.979, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10101/15625) 010101-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.515, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.328, top1 = 92.54%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.74 ms.
cifar100       train : [loss = 0.183, top1 = 95.41%], valid : [loss = 1.407, top1 = 67.66%], test : [loss = 1.354, top1 = 67.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.26%], valid : [loss = 2.238, top1 = 42.50%], test : [loss = 2.251, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 73.81%], valid : [loss = 0.777, top1 = 72.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10102/15625) 010102-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.92%], valid : [loss = 0.725, top1 = 74.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.567, top1 = 80.55%], test  : [loss = 0.621, top1 = 78.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 1.997, top1 = 46.64%], valid : [loss = 2.122, top1 = 44.07%], test : [loss = 2.108, top1 = 43.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 3.231, top1 = 22.38%], valid : [loss = 3.202, top1 = 23.49%], test : [loss = 3.238, top1 = 22.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 53.41%], valid : [loss = 1.355, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10103/15625) 010103-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.66%], valid : [loss = 0.654, top1 = 86.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10        train : [loss = 0.023, top1 = 99.33%], test  : [loss = 0.379, top1 = 90.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.333, top1 = 90.69%], valid : [loss = 1.457, top1 = 64.00%], test : [loss = 1.447, top1 = 64.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.947, top1 = 26.35%], valid : [loss = 3.019, top1 = 25.63%], test : [loss = 3.020, top1 = 24.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10104/15625) 010104-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.76%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.334, top1 = 93.00%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.94 ms.
cifar100       train : [loss = 0.048, top1 = 99.29%], valid : [loss = 1.380, top1 = 70.58%], test : [loss = 1.396, top1 = 69.66%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 1.809, top1 = 51.75%], valid : [loss = 2.290, top1 = 41.73%], test : [loss = 2.260, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.58%], valid : [loss = 0.805, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10105/15625) 010105-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.537, top1 = 88.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.86 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.339, top1 = 92.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.80 ms.
cifar100       train : [loss = 0.125, top1 = 97.14%], valid : [loss = 1.387, top1 = 68.58%], test : [loss = 1.368, top1 = 68.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.03%], valid : [loss = 2.520, top1 = 36.27%], test : [loss = 2.504, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.844, top1 = 69.76%], valid : [loss = 0.882, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10106/15625) 010106-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.15%], valid : [loss = 0.650, top1 = 78.06%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.92 ms.
cifar10        train : [loss = 0.522, top1 = 81.94%], test  : [loss = 0.603, top1 = 79.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.58 ms.
cifar100       train : [loss = 1.725, top1 = 53.22%], valid : [loss = 1.888, top1 = 49.44%], test : [loss = 1.902, top1 = 50.22%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.31 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.23%], valid : [loss = 3.299, top1 = 21.17%], test : [loss = 3.370, top1 = 20.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10107/15625) 010107-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.05%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=15.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.00%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=14.13 ms.
cifar100       train : [loss = 0.322, top1 = 91.26%], valid : [loss = 1.304, top1 = 67.07%], test : [loss = 1.307, top1 = 67.19%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.36%], valid : [loss = 2.372, top1 = 39.87%], test : [loss = 2.400, top1 = 39.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10108/15625) 010108-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.521, top1 = 88.73%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.88 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.338, top1 = 91.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.19 ms.
cifar100       train : [loss = 0.362, top1 = 90.02%], valid : [loss = 1.279, top1 = 66.68%], test : [loss = 1.266, top1 = 67.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.98 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.47%], valid : [loss = 2.426, top1 = 38.33%], test : [loss = 2.421, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.79%], valid : [loss = 0.720, top1 = 74.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10109/15625) 010109-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.96%], valid : [loss = 0.450, top1 = 89.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.322, top1 = 92.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.331, top1 = 91.08%], valid : [loss = 1.310, top1 = 66.78%], test : [loss = 1.301, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.21%], valid : [loss = 2.356, top1 = 39.80%], test : [loss = 2.371, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.60%], valid : [loss = 0.532, top1 = 82.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10110/15625) 010110-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.10%], valid : [loss = 0.522, top1 = 84.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.214, top1 = 92.59%], test  : [loss = 0.379, top1 = 87.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.52 ms.
cifar100       train : [loss = 1.173, top1 = 66.39%], valid : [loss = 1.485, top1 = 59.70%], test : [loss = 1.482, top1 = 59.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.760, top1 = 31.57%], valid : [loss = 2.761, top1 = 31.90%], test : [loss = 2.808, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.36%], valid : [loss = 0.921, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10111/15625) 010111-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.470, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.46 ms.
cifar10        train : [loss = 0.014, top1 = 99.75%], test  : [loss = 0.316, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.31 ms.
cifar100       train : [loss = 0.332, top1 = 90.88%], valid : [loss = 1.224, top1 = 68.50%], test : [loss = 1.245, top1 = 68.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.50%], valid : [loss = 2.330, top1 = 40.07%], test : [loss = 2.323, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.62%], valid : [loss = 0.581, top1 = 80.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10112/15625) 010112-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.557, top1 = 88.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.388, top1 = 92.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.65 ms.
cifar100       train : [loss = 0.125, top1 = 97.61%], valid : [loss = 1.521, top1 = 66.48%], test : [loss = 1.489, top1 = 66.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.97 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.40%], valid : [loss = 2.402, top1 = 40.10%], test : [loss = 2.420, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.15%], valid : [loss = 0.751, top1 = 73.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10113/15625) 010113-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.317, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 0.331, top1 = 91.03%], valid : [loss = 1.265, top1 = 67.54%], test : [loss = 1.280, top1 = 66.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 44.99%], valid : [loss = 2.410, top1 = 38.77%], test : [loss = 2.392, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10114/15625) 010114-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.487, top1 = 89.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.330, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.65 ms.
cifar100       train : [loss = 0.172, top1 = 95.96%], valid : [loss = 1.354, top1 = 68.56%], test : [loss = 1.340, top1 = 67.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.57%], valid : [loss = 2.271, top1 = 42.20%], test : [loss = 2.337, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.26%], valid : [loss = 0.615, top1 = 79.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10115/15625) 010115-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.532, top1 = 88.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.24 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.369, top1 = 91.09%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.06 ms.
cifar100       train : [loss = 0.351, top1 = 90.55%], valid : [loss = 1.357, top1 = 65.88%], test : [loss = 1.354, top1 = 66.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.77%], valid : [loss = 2.305, top1 = 41.30%], test : [loss = 2.290, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.52%], valid : [loss = 0.843, top1 = 69.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10116/15625) 010116-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.48%], valid : [loss = 0.871, top1 = 71.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.45 ms.
cifar10        train : [loss = 0.548, top1 = 80.77%], test  : [loss = 0.708, top1 = 76.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.73 ms.
cifar100       train : [loss = 1.756, top1 = 52.75%], valid : [loss = 2.027, top1 = 47.42%], test : [loss = 2.057, top1 = 46.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.86%], valid : [loss = 3.643, top1 = 16.43%], test : [loss = 3.668, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10117/15625) 010117-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.536, top1 = 88.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.28 ms.
cifar10        train : [loss = 0.029, top1 = 99.10%], test  : [loss = 0.360, top1 = 91.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.01 ms.
cifar100       train : [loss = 0.417, top1 = 87.91%], valid : [loss = 1.226, top1 = 68.08%], test : [loss = 1.243, top1 = 67.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.44%], valid : [loss = 2.399, top1 = 39.17%], test : [loss = 2.414, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10118/15625) 010118-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 52.35 M, Params=0.382 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.444, top1 = 89.94%]
cifar10        FLOP= 52.35 M, Params=0.382 MB, latency=19.41 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.305, top1 = 92.64%]
cifar100       FLOP= 52.35 M, Params=0.388 MB, latency=17.69 ms.
cifar100       train : [loss = 0.192, top1 = 95.61%], valid : [loss = 1.263, top1 = 69.40%], test : [loss = 1.265, top1 = 69.19%]
ImageNet16-120 FLOP= 13.09 M, Params=0.389 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.78%], valid : [loss = 2.240, top1 = 42.34%], test : [loss = 2.263, top1 = 43.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.411, top1 = 85.98%], valid : [loss = 0.526, top1 = 82.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10119/15625) 010119-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.457, top1 = 90.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.308, top1 = 92.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.155, top1 = 96.60%], valid : [loss = 1.301, top1 = 69.30%], test : [loss = 1.293, top1 = 69.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 1.753, top1 = 53.33%], valid : [loss = 2.232, top1 = 43.27%], test : [loss = 2.257, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.12%], valid : [loss = 0.538, top1 = 82.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10120/15625) 010120-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.28 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10121/15625) 010121-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.586, top1 = 88.26%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.70 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.370, top1 = 92.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.04 ms.
cifar100       train : [loss = 0.121, top1 = 97.27%], valid : [loss = 1.403, top1 = 68.90%], test : [loss = 1.390, top1 = 68.98%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 40.97%], valid : [loss = 2.488, top1 = 36.17%], test : [loss = 2.490, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.48%], valid : [loss = 1.018, top1 = 63.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10122/15625) 010122-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.562, top1 = 88.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.12 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.391, top1 = 91.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.42 ms.
cifar100       train : [loss = 0.253, top1 = 93.31%], valid : [loss = 1.447, top1 = 66.40%], test : [loss = 1.474, top1 = 65.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 44.07%], valid : [loss = 2.460, top1 = 38.93%], test : [loss = 2.471, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.86%], valid : [loss = 0.765, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10123/15625) 010123-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.96%], valid : [loss = 0.457, top1 = 89.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.309, top1 = 92.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.336, top1 = 90.74%], valid : [loss = 1.299, top1 = 66.84%], test : [loss = 1.293, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.75 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.87%], valid : [loss = 2.367, top1 = 40.40%], test : [loss = 2.382, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.00%], valid : [loss = 0.556, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10124/15625) 010124-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.67 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.584, top1 = 87.50%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.90 ms.
cifar10        train : [loss = 0.040, top1 = 98.78%], test  : [loss = 0.391, top1 = 90.13%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.61 ms.
cifar100       train : [loss = 0.421, top1 = 87.89%], valid : [loss = 1.327, top1 = 66.36%], test : [loss = 1.369, top1 = 66.24%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.43%], valid : [loss = 2.411, top1 = 39.57%], test : [loss = 2.422, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.42%], valid : [loss = 0.791, top1 = 72.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10125/15625) 010125-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.584, top1 = 87.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.360, top1 = 91.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.09 ms.
cifar100       train : [loss = 0.264, top1 = 92.86%], valid : [loss = 1.339, top1 = 66.96%], test : [loss = 1.333, top1 = 67.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.70%], valid : [loss = 2.572, top1 = 35.33%], test : [loss = 2.591, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.67%], valid : [loss = 0.966, top1 = 65.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10126/15625) 010126-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.470, top1 = 89.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.298, top1 = 92.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.321, top1 = 91.31%], valid : [loss = 1.249, top1 = 68.18%], test : [loss = 1.253, top1 = 67.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.65%], valid : [loss = 2.308, top1 = 41.04%], test : [loss = 2.342, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10127/15625) 010127-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.68 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.556, top1 = 88.59%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.349, top1 = 91.94%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.81 ms.
cifar100       train : [loss = 0.312, top1 = 91.63%], valid : [loss = 1.377, top1 = 66.64%], test : [loss = 1.378, top1 = 66.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.51 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.56%], valid : [loss = 2.366, top1 = 40.73%], test : [loss = 2.353, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.28%], valid : [loss = 0.913, top1 = 67.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10128/15625) 010128-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.532, top1 = 89.34%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.328, top1 = 93.11%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.79 ms.
cifar100       train : [loss = 0.070, top1 = 98.89%], valid : [loss = 1.366, top1 = 69.38%], test : [loss = 1.373, top1 = 69.37%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.57%], valid : [loss = 2.382, top1 = 39.42%], test : [loss = 2.387, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10129/15625) 010129-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.565, top1 = 88.74%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.354, top1 = 92.34%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.21 ms.
cifar100       train : [loss = 0.089, top1 = 98.52%], valid : [loss = 1.528, top1 = 66.78%], test : [loss = 1.489, top1 = 67.64%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.27 ms.
ImageNet16-120 train : [loss = 1.828, top1 = 51.51%], valid : [loss = 2.367, top1 = 41.27%], test : [loss = 2.404, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.40%], valid : [loss = 0.718, top1 = 75.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10130/15625) 010130-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.50%], valid : [loss = 0.788, top1 = 83.13%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.436, top1 = 89.10%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.35 ms.
cifar100       train : [loss = 0.438, top1 = 87.45%], valid : [loss = 1.547, top1 = 62.28%], test : [loss = 1.576, top1 = 61.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.27%], valid : [loss = 2.648, top1 = 34.13%], test : [loss = 2.665, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.45%], valid : [loss = 0.864, top1 = 69.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10131/15625) 010131-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.416, top1 = 91.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.31 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.300, top1 = 93.35%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.84 ms.
cifar100       train : [loss = 0.044, top1 = 99.58%], valid : [loss = 1.305, top1 = 70.96%], test : [loss = 1.268, top1 = 71.50%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 1.443, top1 = 60.73%], valid : [loss = 2.214, top1 = 44.37%], test : [loss = 2.242, top1 = 44.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.64%], valid : [loss = 0.492, top1 = 83.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10132/15625) 010132-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.16%], valid : [loss = 0.478, top1 = 84.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10        train : [loss = 0.297, top1 = 90.03%], test  : [loss = 0.396, top1 = 86.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.17 ms.
cifar100       train : [loss = 1.334, top1 = 62.89%], valid : [loss = 1.554, top1 = 57.70%], test : [loss = 1.522, top1 = 58.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.74%], valid : [loss = 2.892, top1 = 29.07%], test : [loss = 2.963, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10133/15625) 010133-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.32%], valid : [loss = 0.620, top1 = 85.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10        train : [loss = 0.066, top1 = 98.05%], test  : [loss = 0.399, top1 = 88.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.07 ms.
cifar100       train : [loss = 0.709, top1 = 79.33%], valid : [loss = 1.385, top1 = 63.41%], test : [loss = 1.367, top1 = 63.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.16%], valid : [loss = 2.657, top1 = 33.70%], test : [loss = 2.704, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10134/15625) 010134-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.81%], valid : [loss = 0.483, top1 = 84.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10        train : [loss = 0.304, top1 = 89.70%], test  : [loss = 0.410, top1 = 86.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 1.328, top1 = 63.22%], valid : [loss = 1.541, top1 = 57.48%], test : [loss = 1.523, top1 = 57.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.49%], valid : [loss = 2.900, top1 = 29.77%], test : [loss = 2.959, top1 = 28.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10135/15625) 010135-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.60%], valid : [loss = 0.546, top1 = 88.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10        train : [loss = 0.025, top1 = 99.28%], test  : [loss = 0.355, top1 = 91.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.44 ms.
cifar100       train : [loss = 0.411, top1 = 88.15%], valid : [loss = 1.258, top1 = 67.36%], test : [loss = 1.268, top1 = 67.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.24%], valid : [loss = 2.413, top1 = 38.10%], test : [loss = 2.465, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10136/15625) 010136-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.541, top1 = 88.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.386, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.71 ms.
cifar100       train : [loss = 0.395, top1 = 88.94%], valid : [loss = 1.432, top1 = 65.12%], test : [loss = 1.432, top1 = 64.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.250, top1 = 42.07%], valid : [loss = 2.462, top1 = 37.57%], test : [loss = 2.484, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.42%], valid : [loss = 0.765, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10137/15625) 010137-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.484, top1 = 88.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.345, top1 = 91.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.83 ms.
cifar100       train : [loss = 0.337, top1 = 90.92%], valid : [loss = 1.304, top1 = 67.04%], test : [loss = 1.290, top1 = 66.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.31 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.56%], valid : [loss = 2.406, top1 = 39.37%], test : [loss = 2.400, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10138/15625) 010138-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.525, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.90 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.320, top1 = 92.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.24 ms.
cifar100       train : [loss = 0.112, top1 = 97.83%], valid : [loss = 1.371, top1 = 68.84%], test : [loss = 1.336, top1 = 69.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.35%], valid : [loss = 2.224, top1 = 43.87%], test : [loss = 2.236, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.53%], valid : [loss = 0.664, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10139/15625) 010139-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.524, top1 = 88.03%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.84 ms.
cifar10        train : [loss = 0.028, top1 = 99.18%], test  : [loss = 0.349, top1 = 91.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.28 ms.
cifar100       train : [loss = 0.487, top1 = 85.72%], valid : [loss = 1.322, top1 = 65.86%], test : [loss = 1.356, top1 = 66.22%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 39.95%], valid : [loss = 2.521, top1 = 35.20%], test : [loss = 2.573, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.80%], valid : [loss = 0.638, top1 = 78.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10140/15625) 010140-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.04%], valid : [loss = 0.867, top1 = 70.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.15 ms.
cifar10        train : [loss = 0.695, top1 = 75.66%], test  : [loss = 0.774, top1 = 73.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.13 ms.
cifar100       train : [loss = 1.956, top1 = 48.09%], valid : [loss = 2.132, top1 = 44.88%], test : [loss = 2.141, top1 = 44.67%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.78 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.81%], valid : [loss = 3.655, top1 = 15.63%], test : [loss = 3.687, top1 = 14.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10141/15625) 010141-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.560, top1 = 87.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.386, top1 = 91.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.91 ms.
cifar100       train : [loss = 0.355, top1 = 90.07%], valid : [loss = 1.414, top1 = 65.28%], test : [loss = 1.433, top1 = 65.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.22%], valid : [loss = 2.471, top1 = 36.87%], test : [loss = 2.505, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.89%], valid : [loss = 0.877, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10142/15625) 010142-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.12%], valid : [loss = 0.453, top1 = 86.19%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.74 ms.
cifar10        train : [loss = 0.168, top1 = 94.48%], test  : [loss = 0.352, top1 = 88.58%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.24 ms.
cifar100       train : [loss = 1.017, top1 = 71.07%], valid : [loss = 1.376, top1 = 61.35%], test : [loss = 1.361, top1 = 61.77%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.77%], valid : [loss = 2.683, top1 = 33.48%], test : [loss = 2.708, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.48%], valid : [loss = 0.804, top1 = 71.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10143/15625) 010143-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.07 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.58%], valid : [loss = 0.682, top1 = 77.05%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.82 ms.
cifar10        train : [loss = 0.531, top1 = 81.44%], test  : [loss = 0.604, top1 = 79.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.53 ms.
cifar100       train : [loss = 1.717, top1 = 53.34%], valid : [loss = 1.862, top1 = 50.50%], test : [loss = 1.898, top1 = 49.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 3.385, top1 = 20.12%], valid : [loss = 3.363, top1 = 20.97%], test : [loss = 3.404, top1 = 19.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.359, top1 = 50.73%], valid : [loss = 1.380, top1 = 50.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10144/15625) 010144-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.59 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.478, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.35 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.307, top1 = 92.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.87 ms.
cifar100       train : [loss = 0.256, top1 = 93.43%], valid : [loss = 1.248, top1 = 68.58%], test : [loss = 1.258, top1 = 68.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 48.95%], valid : [loss = 2.278, top1 = 41.77%], test : [loss = 2.292, top1 = 42.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.64%], valid : [loss = 0.576, top1 = 80.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10145/15625) 010145-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.588, top1 = 86.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10        train : [loss = 0.040, top1 = 98.83%], test  : [loss = 0.392, top1 = 90.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.84 ms.
cifar100       train : [loss = 0.550, top1 = 83.71%], valid : [loss = 1.427, top1 = 63.84%], test : [loss = 1.399, top1 = 63.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.66 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.93%], valid : [loss = 2.585, top1 = 34.40%], test : [loss = 2.649, top1 = 34.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10146/15625) 010146-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.09 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.10%], valid : [loss = 0.475, top1 = 84.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 0.302, top1 = 89.94%], test  : [loss = 0.398, top1 = 86.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.25 ms.
cifar100       train : [loss = 1.328, top1 = 63.21%], valid : [loss = 1.541, top1 = 57.71%], test : [loss = 1.511, top1 = 58.25%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.53 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.66%], valid : [loss = 2.889, top1 = 29.81%], test : [loss = 2.951, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10147/15625) 010147-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.69%], valid : [loss = 0.514, top1 = 86.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.06 ms.
cifar10        train : [loss = 0.092, top1 = 97.13%], test  : [loss = 0.358, top1 = 89.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 0.780, top1 = 77.34%], valid : [loss = 1.333, top1 = 64.01%], test : [loss = 1.319, top1 = 64.31%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.56%], valid : [loss = 2.649, top1 = 34.17%], test : [loss = 2.678, top1 = 33.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.83%], valid : [loss = 0.653, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10148/15625) 010148-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.05 ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.43%], valid : [loss = 0.971, top1 = 66.92%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 0.768, top1 = 73.10%], test  : [loss = 0.854, top1 = 70.10%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.83 ms.
cifar100       train : [loss = 2.172, top1 = 43.03%], valid : [loss = 2.364, top1 = 40.10%], test : [loss = 2.384, top1 = 39.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.49 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.24%], valid : [loss = 3.770, top1 = 14.62%], test : [loss = 3.783, top1 = 13.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 47.09%], valid : [loss = 1.475, top1 = 45.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10149/15625) 010149-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.32%], valid : [loss = 0.602, top1 = 85.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.071, top1 = 97.85%], test  : [loss = 0.396, top1 = 88.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.715, top1 = 79.28%], valid : [loss = 1.383, top1 = 63.22%], test : [loss = 1.371, top1 = 63.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 36.06%], valid : [loss = 2.651, top1 = 33.32%], test : [loss = 2.671, top1 = 33.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.46%], valid : [loss = 0.806, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10150/15625) 010150-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.92%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.64 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.309, top1 = 92.99%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.83 ms.
cifar100       train : [loss = 0.126, top1 = 97.69%], valid : [loss = 1.241, top1 = 70.28%], test : [loss = 1.273, top1 = 69.17%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.680, top1 = 54.94%], valid : [loss = 2.172, top1 = 43.92%], test : [loss = 2.184, top1 = 44.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.85%], valid : [loss = 0.615, top1 = 78.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10151/15625) 010151-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.50%], valid : [loss = 0.853, top1 = 72.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10        train : [loss = 0.543, top1 = 81.07%], test  : [loss = 0.712, top1 = 75.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.56 ms.
cifar100       train : [loss = 1.763, top1 = 52.50%], valid : [loss = 2.030, top1 = 47.29%], test : [loss = 2.053, top1 = 47.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.89 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 16.97%], valid : [loss = 3.624, top1 = 16.22%], test : [loss = 3.671, top1 = 15.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10152/15625) 010152-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.483, top1 = 89.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.306, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.323, top1 = 91.34%], valid : [loss = 1.238, top1 = 68.03%], test : [loss = 1.241, top1 = 67.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.83%], valid : [loss = 2.305, top1 = 40.68%], test : [loss = 2.331, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.49%], valid : [loss = 0.609, top1 = 79.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10153/15625) 010153-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.457, top1 = 89.41%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.07 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.299, top1 = 92.50%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.91 ms.
cifar100       train : [loss = 0.217, top1 = 94.79%], valid : [loss = 1.252, top1 = 68.79%], test : [loss = 1.218, top1 = 69.81%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.72%], valid : [loss = 2.242, top1 = 41.50%], test : [loss = 2.229, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.72%], valid : [loss = 0.589, top1 = 80.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10154/15625) 010154-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.429, top1 = 91.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.60 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.269, top1 = 94.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.91 ms.
cifar100       train : [loss = 0.043, top1 = 99.52%], valid : [loss = 1.275, top1 = 72.01%], test : [loss = 1.242, top1 = 71.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 1.361, top1 = 62.82%], valid : [loss = 2.189, top1 = 45.13%], test : [loss = 2.182, top1 = 46.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.327, top1 = 88.91%], valid : [loss = 0.481, top1 = 83.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10155/15625) 010155-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.410, top1 = 90.70%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.43 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.270, top1 = 93.38%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.88 ms.
cifar100       train : [loss = 0.159, top1 = 96.39%], valid : [loss = 1.266, top1 = 70.11%], test : [loss = 1.259, top1 = 70.26%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.81%], valid : [loss = 2.236, top1 = 43.40%], test : [loss = 2.240, top1 = 43.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.46%], valid : [loss = 0.515, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10156/15625) 010156-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.480, top1 = 89.58%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.295, top1 = 92.82%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.25 ms.
cifar100       train : [loss = 0.262, top1 = 93.09%], valid : [loss = 1.230, top1 = 69.31%], test : [loss = 1.220, top1 = 69.10%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.07 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.39%], valid : [loss = 2.222, top1 = 42.78%], test : [loss = 2.228, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.78%], valid : [loss = 0.611, top1 = 79.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10157/15625) 010157-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.06%], valid : [loss = 0.532, top1 = 84.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.84 ms.
cifar10        train : [loss = 0.176, top1 = 94.04%], test  : [loss = 0.383, top1 = 87.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 1.206, top1 = 65.76%], valid : [loss = 1.522, top1 = 58.26%], test : [loss = 1.514, top1 = 58.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.75%], valid : [loss = 2.692, top1 = 32.73%], test : [loss = 2.730, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.34%], valid : [loss = 0.956, top1 = 66.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10158/15625) 010158-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.23%], valid : [loss = 0.590, top1 = 85.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10        train : [loss = 0.070, top1 = 97.89%], test  : [loss = 0.414, top1 = 88.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.54 ms.
cifar100       train : [loss = 0.706, top1 = 79.44%], valid : [loss = 1.390, top1 = 63.77%], test : [loss = 1.379, top1 = 63.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.45 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.11%], valid : [loss = 2.653, top1 = 34.07%], test : [loss = 2.689, top1 = 33.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10159/15625) 010159-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.574, top1 = 87.96%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.63 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.400, top1 = 91.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.21 ms.
cifar100       train : [loss = 0.115, top1 = 98.09%], valid : [loss = 1.461, top1 = 67.16%], test : [loss = 1.413, top1 = 67.74%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 1.948, top1 = 48.90%], valid : [loss = 2.443, top1 = 39.57%], test : [loss = 2.453, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.52%], valid : [loss = 0.716, top1 = 75.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10160/15625) 010160-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.60%], valid : [loss = 1.115, top1 = 63.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 0.786, top1 = 72.31%], test  : [loss = 0.925, top1 = 68.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.75 ms.
cifar100       train : [loss = 2.128, top1 = 44.13%], valid : [loss = 2.400, top1 = 39.73%], test : [loss = 2.410, top1 = 39.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 3.757, top1 = 14.01%], valid : [loss = 3.808, top1 = 13.58%], test : [loss = 3.836, top1 = 13.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.78%], valid : [loss = 1.412, top1 = 49.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10161/15625) 010161-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.614, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.073, top1 = 97.75%], test  : [loss = 0.391, top1 = 88.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.721, top1 = 79.04%], valid : [loss = 1.394, top1 = 63.03%], test : [loss = 1.384, top1 = 63.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.72%], valid : [loss = 2.686, top1 = 33.47%], test : [loss = 2.700, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10162/15625) 010162-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.459, top1 = 89.29%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=14.48 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.330, top1 = 92.02%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=13.90 ms.
cifar100       train : [loss = 0.309, top1 = 91.60%], valid : [loss = 1.351, top1 = 66.90%], test : [loss = 1.330, top1 = 67.39%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.52%], valid : [loss = 2.362, top1 = 40.06%], test : [loss = 2.376, top1 = 40.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.77%], valid : [loss = 0.590, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10163/15625) 010163-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.67%], valid : [loss = 0.767, top1 = 77.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.66 ms.
cifar10        train : [loss = 0.222, top1 = 92.29%], test  : [loss = 0.510, top1 = 84.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.879, top1 = 74.29%], valid : [loss = 1.661, top1 = 57.45%], test : [loss = 1.678, top1 = 57.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 3.521, top1 = 16.52%], valid : [loss = 3.526, top1 = 16.68%], test : [loss = 3.526, top1 = 16.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.249, top1 = 54.25%], valid : [loss = 1.292, top1 = 53.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10164/15625) 010164-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.582, top1 = 88.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.392, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.07 ms.
cifar100       train : [loss = 0.200, top1 = 95.26%], valid : [loss = 1.408, top1 = 66.78%], test : [loss = 1.451, top1 = 66.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.17%], valid : [loss = 2.499, top1 = 37.57%], test : [loss = 2.512, top1 = 37.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.91%], valid : [loss = 0.789, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10165/15625) 010165-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.424, top1 = 91.33%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.80 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.271, top1 = 94.21%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.24 ms.
cifar100       train : [loss = 0.021, top1 = 99.82%], valid : [loss = 1.284, top1 = 72.96%], test : [loss = 1.269, top1 = 72.28%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.85 ms.
ImageNet16-120 train : [loss = 1.174, top1 = 67.49%], valid : [loss = 2.229, top1 = 45.20%], test : [loss = 2.276, top1 = 45.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.321, top1 = 89.11%], valid : [loss = 0.476, top1 = 84.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10166/15625) 010166-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.30%], valid : [loss = 0.453, top1 = 86.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10        train : [loss = 0.152, top1 = 95.14%], test  : [loss = 0.352, top1 = 88.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.09 ms.
cifar100       train : [loss = 0.990, top1 = 71.93%], valid : [loss = 1.339, top1 = 62.02%], test : [loss = 1.343, top1 = 62.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.78%], valid : [loss = 2.673, top1 = 33.58%], test : [loss = 2.702, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10167/15625) 010167-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.67%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=12.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.329, top1 = 92.02%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=11.44 ms.
cifar100       train : [loss = 0.339, top1 = 90.79%], valid : [loss = 1.288, top1 = 66.59%], test : [loss = 1.276, top1 = 67.13%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.77%], valid : [loss = 2.393, top1 = 38.91%], test : [loss = 2.389, top1 = 39.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10168/15625) 010168-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.63%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.329, top1 = 93.11%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.34 ms.
cifar100       train : [loss = 0.077, top1 = 98.70%], valid : [loss = 1.294, top1 = 70.69%], test : [loss = 1.299, top1 = 70.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.46 ms.
ImageNet16-120 train : [loss = 1.614, top1 = 56.60%], valid : [loss = 2.172, top1 = 43.85%], test : [loss = 2.180, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.82%], valid : [loss = 0.754, top1 = 74.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10169/15625) 010169-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.84%], valid : [loss = 0.616, top1 = 84.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.61 ms.
cifar10        train : [loss = 0.085, top1 = 97.17%], test  : [loss = 0.421, top1 = 88.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.37 ms.
cifar100       train : [loss = 0.720, top1 = 78.71%], valid : [loss = 1.572, top1 = 59.80%], test : [loss = 1.573, top1 = 59.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 3.186, top1 = 22.38%], valid : [loss = 3.187, top1 = 22.08%], test : [loss = 3.229, top1 = 21.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10170/15625) 010170-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.558, top1 = 87.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.376, top1 = 91.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.65 ms.
cifar100       train : [loss = 0.378, top1 = 89.33%], valid : [loss = 1.389, top1 = 65.14%], test : [loss = 1.377, top1 = 65.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.246, top1 = 42.04%], valid : [loss = 2.476, top1 = 37.33%], test : [loss = 2.476, top1 = 37.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.50%], valid : [loss = 0.740, top1 = 74.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10171/15625) 010171-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.622, top1 = 86.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.028, top1 = 99.33%], test  : [loss = 0.429, top1 = 89.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.367, top1 = 90.25%], valid : [loss = 1.424, top1 = 64.95%], test : [loss = 1.404, top1 = 65.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.31%], valid : [loss = 2.610, top1 = 34.78%], test : [loss = 2.632, top1 = 35.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.92%], valid : [loss = 0.761, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10172/15625) 010172-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.512, top1 = 89.63%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.11 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.331, top1 = 92.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.54 ms.
cifar100       train : [loss = 0.120, top1 = 97.34%], valid : [loss = 1.323, top1 = 68.89%], test : [loss = 1.312, top1 = 69.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.62%], valid : [loss = 2.235, top1 = 43.20%], test : [loss = 2.219, top1 = 44.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.75%], valid : [loss = 0.633, top1 = 78.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10173/15625) 010173-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.36%], valid : [loss = 0.649, top1 = 85.07%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=14.11 ms.
cifar10        train : [loss = 0.062, top1 = 98.13%], test  : [loss = 0.417, top1 = 88.80%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=13.83 ms.
cifar100       train : [loss = 0.695, top1 = 79.72%], valid : [loss = 1.437, top1 = 62.19%], test : [loss = 1.426, top1 = 62.70%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.46%], valid : [loss = 2.694, top1 = 32.94%], test : [loss = 2.728, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.12%], valid : [loss = 0.845, top1 = 70.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10174/15625) 010174-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.54 ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.62%], valid : [loss = 0.958, top1 = 67.25%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10        train : [loss = 0.796, top1 = 72.01%], test  : [loss = 0.878, top1 = 69.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.79 ms.
cifar100       train : [loss = 2.125, top1 = 44.20%], valid : [loss = 2.302, top1 = 40.65%], test : [loss = 2.325, top1 = 40.96%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.98 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.25%], valid : [loss = 3.774, top1 = 14.62%], test : [loss = 3.777, top1 = 13.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10175/15625) 010175-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.04 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.318, top1 = 91.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.68 ms.
cifar100       train : [loss = 0.327, top1 = 91.12%], valid : [loss = 1.309, top1 = 67.00%], test : [loss = 1.309, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.30%], valid : [loss = 2.371, top1 = 40.25%], test : [loss = 2.423, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.89%], valid : [loss = 0.559, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10176/15625) 010176-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.60%], valid : [loss = 0.452, top1 = 86.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.156, top1 = 94.86%], test  : [loss = 0.353, top1 = 88.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.985, top1 = 71.93%], valid : [loss = 1.331, top1 = 63.03%], test : [loss = 1.354, top1 = 62.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.02%], valid : [loss = 2.671, top1 = 32.55%], test : [loss = 2.686, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 73.14%], valid : [loss = 0.801, top1 = 71.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10177/15625) 010177-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.636, top1 = 85.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.08 ms.
cifar10        train : [loss = 0.030, top1 = 99.16%], test  : [loss = 0.391, top1 = 90.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.68 ms.
cifar100       train : [loss = 0.520, top1 = 84.81%], valid : [loss = 1.454, top1 = 63.27%], test : [loss = 1.432, top1 = 63.13%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.27%], valid : [loss = 2.523, top1 = 36.47%], test : [loss = 2.561, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.47%], valid : [loss = 0.886, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10178/15625) 010178-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.571, top1 = 88.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10        train : [loss = 0.015, top1 = 99.57%], test  : [loss = 0.395, top1 = 91.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.59 ms.
cifar100       train : [loss = 0.294, top1 = 91.95%], valid : [loss = 1.389, top1 = 66.42%], test : [loss = 1.413, top1 = 65.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.19%], valid : [loss = 2.401, top1 = 38.88%], test : [loss = 2.396, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.46%], valid : [loss = 0.786, top1 = 72.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10179/15625) 010179-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.513, top1 = 89.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.302, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.24 ms.
cifar100       train : [loss = 0.124, top1 = 97.61%], valid : [loss = 1.311, top1 = 69.15%], test : [loss = 1.276, top1 = 69.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.19%], valid : [loss = 2.299, top1 = 41.58%], test : [loss = 2.258, top1 = 42.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10180/15625) 010180-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.442, top1 = 89.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.298, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.31 ms.
cifar100       train : [loss = 0.197, top1 = 95.37%], valid : [loss = 1.255, top1 = 69.55%], test : [loss = 1.247, top1 = 69.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.58%], valid : [loss = 2.273, top1 = 42.38%], test : [loss = 2.284, top1 = 42.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.40%], valid : [loss = 0.521, top1 = 82.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10181/15625) 010181-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.64%], valid : [loss = 0.468, top1 = 86.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.154, top1 = 94.97%], test  : [loss = 0.340, top1 = 88.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 0.982, top1 = 72.00%], valid : [loss = 1.359, top1 = 62.27%], test : [loss = 1.352, top1 = 62.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.97%], valid : [loss = 2.679, top1 = 33.10%], test : [loss = 2.711, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10182/15625) 010182-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10-valid  train : [loss = 0.904, top1 = 68.03%], valid : [loss = 1.094, top1 = 62.76%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.41 ms.
cifar10        train : [loss = 0.886, top1 = 68.78%], test  : [loss = 0.952, top1 = 66.23%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.90 ms.
cifar100       train : [loss = 2.300, top1 = 40.42%], valid : [loss = 2.515, top1 = 37.04%], test : [loss = 2.518, top1 = 36.72%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.10 ms.
ImageNet16-120 train : [loss = 3.814, top1 = 13.10%], valid : [loss = 3.840, top1 = 13.97%], test : [loss = 3.837, top1 = 13.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.503, top1 = 44.78%], valid : [loss = 1.526, top1 = 44.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10183/15625) 010183-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.55%], valid : [loss = 0.573, top1 = 83.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.13 ms.
cifar10        train : [loss = 0.156, top1 = 94.88%], test  : [loss = 0.412, top1 = 87.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.65 ms.
cifar100       train : [loss = 1.084, top1 = 68.79%], valid : [loss = 1.495, top1 = 59.17%], test : [loss = 1.486, top1 = 59.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.580, top1 = 34.93%], valid : [loss = 2.648, top1 = 33.88%], test : [loss = 2.679, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.60%], valid : [loss = 0.913, top1 = 67.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10184/15625) 010184-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.97%], valid : [loss = 0.713, top1 = 83.69%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.25 ms.
cifar10        train : [loss = 0.091, top1 = 97.02%], test  : [loss = 0.487, top1 = 86.75%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.24 ms.
cifar100       train : [loss = 0.786, top1 = 77.10%], valid : [loss = 1.546, top1 = 60.42%], test : [loss = 1.521, top1 = 60.53%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.40 ms.
ImageNet16-120 train : [loss = 2.795, top1 = 30.71%], valid : [loss = 2.924, top1 = 28.07%], test : [loss = 2.971, top1 = 27.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.24%], valid : [loss = 0.848, top1 = 70.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10185/15625) 010185-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.340, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.176, top1 = 95.64%], valid : [loss = 1.395, top1 = 67.72%], test : [loss = 1.388, top1 = 67.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.81%], valid : [loss = 2.310, top1 = 42.05%], test : [loss = 2.323, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 83.92%], valid : [loss = 0.557, top1 = 80.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10186/15625) 010186-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.34%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.11 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.319, top1 = 92.66%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.03 ms.
cifar100       train : [loss = 0.152, top1 = 96.71%], valid : [loss = 1.331, top1 = 68.13%], test : [loss = 1.312, top1 = 68.43%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.61%], valid : [loss = 2.306, top1 = 40.97%], test : [loss = 2.310, top1 = 41.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.74%], valid : [loss = 0.695, top1 = 75.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10187/15625) 010187-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.56%], valid : [loss = 0.857, top1 = 71.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.554, top1 = 80.57%], test  : [loss = 0.718, top1 = 75.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 1.765, top1 = 52.23%], valid : [loss = 2.052, top1 = 46.92%], test : [loss = 2.069, top1 = 46.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.85%], valid : [loss = 3.631, top1 = 16.67%], test : [loss = 3.661, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10188/15625) 010188-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.419, top1 = 90.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.04 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.279, top1 = 93.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.13 ms.
cifar100       train : [loss = 0.185, top1 = 95.60%], valid : [loss = 1.268, top1 = 69.72%], test : [loss = 1.249, top1 = 69.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.67%], valid : [loss = 2.257, top1 = 42.53%], test : [loss = 2.264, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.29%], valid : [loss = 0.504, top1 = 83.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10189/15625) 010189-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.401, top1 = 91.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.97%], test  : [loss = 0.269, top1 = 93.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.32 ms.
cifar100       train : [loss = 0.052, top1 = 99.40%], valid : [loss = 1.305, top1 = 70.78%], test : [loss = 1.245, top1 = 71.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 1.433, top1 = 60.84%], valid : [loss = 2.194, top1 = 44.97%], test : [loss = 2.205, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 87.86%], valid : [loss = 0.490, top1 = 83.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10190/15625) 010190-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.31 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.46%], valid : [loss = 0.604, top1 = 84.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.419, top1 = 88.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.81 ms.
cifar100       train : [loss = 0.795, top1 = 76.59%], valid : [loss = 1.433, top1 = 62.10%], test : [loss = 1.408, top1 = 61.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.12%], valid : [loss = 2.761, top1 = 32.83%], test : [loss = 2.772, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10191/15625) 010191-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.509, top1 = 89.76%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.62 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.339, top1 = 93.10%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.05 ms.
cifar100       train : [loss = 0.095, top1 = 98.21%], valid : [loss = 1.334, top1 = 69.26%], test : [loss = 1.364, top1 = 69.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 1.762, top1 = 53.06%], valid : [loss = 2.230, top1 = 43.10%], test : [loss = 2.236, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.39%], valid : [loss = 0.780, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10192/15625) 010192-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.430, top1 = 90.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.290, top1 = 93.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.17 ms.
cifar100       train : [loss = 0.067, top1 = 98.97%], valid : [loss = 1.377, top1 = 70.04%], test : [loss = 1.322, top1 = 70.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 1.558, top1 = 57.96%], valid : [loss = 2.246, top1 = 43.67%], test : [loss = 2.239, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.408, top1 = 86.01%], valid : [loss = 0.531, top1 = 82.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10193/15625) 010193-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.72 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.576, top1 = 87.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=12.78 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.376, top1 = 90.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.53 ms.
cifar100       train : [loss = 0.395, top1 = 88.78%], valid : [loss = 1.369, top1 = 66.32%], test : [loss = 1.390, top1 = 65.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.254, top1 = 41.99%], valid : [loss = 2.470, top1 = 37.30%], test : [loss = 2.492, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.19%], valid : [loss = 0.783, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10194/15625) 010194-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.554, top1 = 89.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.14 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.389, top1 = 92.39%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.46 ms.
cifar100       train : [loss = 0.057, top1 = 99.35%], valid : [loss = 1.391, top1 = 69.78%], test : [loss = 1.429, top1 = 69.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.33%], valid : [loss = 2.346, top1 = 41.53%], test : [loss = 2.381, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.06%], valid : [loss = 0.634, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10195/15625) 010195-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.04 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.44%], valid : [loss = 0.874, top1 = 71.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 0.569, top1 = 80.14%], test  : [loss = 0.724, top1 = 75.65%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.32 ms.
cifar100       train : [loss = 1.795, top1 = 51.80%], valid : [loss = 2.059, top1 = 46.92%], test : [loss = 2.073, top1 = 46.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.67 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.78%], valid : [loss = 3.628, top1 = 16.57%], test : [loss = 3.655, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10196/15625) 010196-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.94%], valid : [loss = 0.653, top1 = 78.09%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.10 ms.
cifar10        train : [loss = 0.511, top1 = 82.31%], test  : [loss = 0.591, top1 = 80.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.66 ms.
cifar100       train : [loss = 1.691, top1 = 54.18%], valid : [loss = 1.859, top1 = 50.66%], test : [loss = 1.867, top1 = 50.82%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.68 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.32%], valid : [loss = 3.314, top1 = 21.50%], test : [loss = 3.351, top1 = 21.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10197/15625) 010197-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.517, top1 = 89.68%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=18.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.332, top1 = 93.06%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.31 ms.
cifar100       train : [loss = 0.074, top1 = 98.78%], valid : [loss = 1.327, top1 = 70.20%], test : [loss = 1.335, top1 = 70.84%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=24.02 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.02%], valid : [loss = 2.298, top1 = 40.77%], test : [loss = 2.277, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.25%], valid : [loss = 0.805, top1 = 71.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10198/15625) 010198-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.529, top1 = 88.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.331, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.89 ms.
cifar100       train : [loss = 0.162, top1 = 96.32%], valid : [loss = 1.339, top1 = 68.52%], test : [loss = 1.352, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.43%], valid : [loss = 2.311, top1 = 42.07%], test : [loss = 2.326, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.94%], valid : [loss = 0.742, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10199/15625) 010199-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.515, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.335, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.242, top1 = 93.69%], valid : [loss = 1.261, top1 = 68.62%], test : [loss = 1.265, top1 = 68.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.09%], valid : [loss = 2.254, top1 = 42.80%], test : [loss = 2.268, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.02%], valid : [loss = 0.673, top1 = 76.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10200/15625) 010200-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.433, top1 = 90.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.69 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.52%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.52 ms.
cifar100       train : [loss = 0.064, top1 = 99.10%], valid : [loss = 1.327, top1 = 70.05%], test : [loss = 1.335, top1 = 70.55%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 1.549, top1 = 58.16%], valid : [loss = 2.270, top1 = 43.17%], test : [loss = 2.279, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10201/15625) 010201-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.127, top1 = 95.97%], valid : [loss = 0.550, top1 = 84.49%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.02 ms.
cifar10        train : [loss = 0.187, top1 = 93.75%], test  : [loss = 0.395, top1 = 87.52%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.09 ms.
cifar100       train : [loss = 1.018, top1 = 70.54%], valid : [loss = 1.425, top1 = 61.48%], test : [loss = 1.407, top1 = 61.22%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 2.728, top1 = 31.91%], valid : [loss = 2.774, top1 = 30.97%], test : [loss = 2.865, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.28%], valid : [loss = 0.976, top1 = 65.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10202/15625) 010202-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.10%], valid : [loss = 0.635, top1 = 85.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.29 ms.
cifar10        train : [loss = 0.053, top1 = 98.37%], test  : [loss = 0.417, top1 = 89.68%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.07 ms.
cifar100       train : [loss = 0.638, top1 = 81.21%], valid : [loss = 1.437, top1 = 62.66%], test : [loss = 1.479, top1 = 62.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.95 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 39.01%], valid : [loss = 2.563, top1 = 35.73%], test : [loss = 2.583, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.57%], valid : [loss = 0.899, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10203/15625) 010203-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.592, top1 = 87.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.85 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.359, top1 = 91.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.40 ms.
cifar100       train : [loss = 0.350, top1 = 90.29%], valid : [loss = 1.484, top1 = 63.74%], test : [loss = 1.443, top1 = 65.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.01%], valid : [loss = 2.624, top1 = 33.53%], test : [loss = 2.636, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.199, top1 = 56.51%], valid : [loss = 1.215, top1 = 56.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10204/15625) 010204-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.62%], valid : [loss = 0.862, top1 = 71.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10        train : [loss = 0.549, top1 = 80.85%], test  : [loss = 0.711, top1 = 75.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.56 ms.
cifar100       train : [loss = 1.768, top1 = 52.45%], valid : [loss = 2.055, top1 = 46.96%], test : [loss = 2.075, top1 = 46.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.78%], valid : [loss = 3.626, top1 = 16.57%], test : [loss = 3.676, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10205/15625) 010205-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.06%], valid : [loss = 0.620, top1 = 84.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.069, top1 = 97.91%], test  : [loss = 0.409, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.38 ms.
cifar100       train : [loss = 0.716, top1 = 79.16%], valid : [loss = 1.379, top1 = 62.52%], test : [loss = 1.359, top1 = 63.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.65%], valid : [loss = 2.673, top1 = 32.90%], test : [loss = 2.682, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.75%], valid : [loss = 0.799, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10206/15625) 010206-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.527, top1 = 89.16%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.50 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.325, top1 = 92.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.31 ms.
cifar100       train : [loss = 0.152, top1 = 96.80%], valid : [loss = 1.289, top1 = 68.72%], test : [loss = 1.314, top1 = 68.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.80%], valid : [loss = 2.349, top1 = 40.00%], test : [loss = 2.337, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.48%], valid : [loss = 0.717, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10207/15625) 010207-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.596, top1 = 87.24%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=11.93 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.384, top1 = 91.05%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=11.95 ms.
cifar100       train : [loss = 0.391, top1 = 88.90%], valid : [loss = 1.390, top1 = 65.81%], test : [loss = 1.348, top1 = 66.28%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.06%], valid : [loss = 2.517, top1 = 36.72%], test : [loss = 2.534, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10208/15625) 010208-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.12%], valid : [loss = 0.576, top1 = 86.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.97 ms.
cifar10        train : [loss = 0.067, top1 = 97.78%], test  : [loss = 0.375, top1 = 90.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.04 ms.
cifar100       train : [loss = 0.644, top1 = 80.82%], valid : [loss = 1.331, top1 = 64.84%], test : [loss = 1.333, top1 = 64.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 39.81%], valid : [loss = 2.482, top1 = 37.17%], test : [loss = 2.525, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10209/15625) 010209-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.27%], valid : [loss = 0.458, top1 = 86.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.153, top1 = 95.07%], test  : [loss = 0.349, top1 = 88.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.97 ms.
cifar100       train : [loss = 0.978, top1 = 72.08%], valid : [loss = 1.335, top1 = 62.44%], test : [loss = 1.331, top1 = 62.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.47 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.78%], valid : [loss = 2.701, top1 = 32.60%], test : [loss = 2.710, top1 = 32.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10210/15625) 010210-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.510, top1 = 88.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.03 ms.
cifar100       train : [loss = 0.325, top1 = 91.32%], valid : [loss = 1.285, top1 = 67.28%], test : [loss = 1.286, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.07%], valid : [loss = 2.394, top1 = 39.66%], test : [loss = 2.405, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10211/15625) 010211-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.06 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10212/15625) 010212-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 83.80 M, Params=0.597 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.552, top1 = 89.10%]
cifar10        FLOP= 83.80 M, Params=0.597 MB, latency=19.52 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.371, top1 = 92.46%]
cifar100       FLOP= 83.81 M, Params=0.603 MB, latency=19.33 ms.
cifar100       train : [loss = 0.083, top1 = 98.62%], valid : [loss = 1.464, top1 = 68.49%], test : [loss = 1.445, top1 = 68.76%]
ImageNet16-120 FLOP= 20.96 M, Params=0.604 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.99%], valid : [loss = 2.378, top1 = 40.72%], test : [loss = 2.402, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.29%], valid : [loss = 0.664, top1 = 77.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10213/15625) 010213-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.529, top1 = 89.47%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.41 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.299, top1 = 93.41%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.61 ms.
cifar100       train : [loss = 0.107, top1 = 97.94%], valid : [loss = 1.341, top1 = 69.82%], test : [loss = 1.286, top1 = 70.50%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.61%], valid : [loss = 2.352, top1 = 39.73%], test : [loss = 2.296, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.72%], valid : [loss = 0.870, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10214/15625) 010214-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.08%], valid : [loss = 0.458, top1 = 86.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.111, top1 = 96.60%], test  : [loss = 0.331, top1 = 89.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.27 ms.
cifar100       train : [loss = 0.868, top1 = 75.21%], valid : [loss = 1.325, top1 = 63.26%], test : [loss = 1.321, top1 = 63.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.565, top1 = 35.29%], valid : [loss = 2.640, top1 = 33.33%], test : [loss = 2.654, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10215/15625) 010215-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.443, top1 = 89.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.287, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.205, top1 = 95.24%], valid : [loss = 1.247, top1 = 69.66%], test : [loss = 1.262, top1 = 68.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 51.01%], valid : [loss = 2.259, top1 = 41.83%], test : [loss = 2.289, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.29%], valid : [loss = 0.552, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10216/15625) 010216-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.590, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.08 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.384, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.407, top1 = 88.51%], valid : [loss = 1.414, top1 = 64.90%], test : [loss = 1.388, top1 = 65.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.18%], valid : [loss = 2.502, top1 = 36.92%], test : [loss = 2.508, top1 = 37.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 74.07%], valid : [loss = 0.800, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10217/15625) 010217-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.438, top1 = 90.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.299, top1 = 93.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.99 ms.
cifar100       train : [loss = 0.074, top1 = 98.85%], valid : [loss = 1.342, top1 = 70.42%], test : [loss = 1.319, top1 = 70.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 1.541, top1 = 58.38%], valid : [loss = 2.227, top1 = 44.47%], test : [loss = 2.222, top1 = 45.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.54%], valid : [loss = 0.511, top1 = 82.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10218/15625) 010218-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.558, top1 = 87.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.96 ms.
cifar10        train : [loss = 0.028, top1 = 99.15%], test  : [loss = 0.362, top1 = 91.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.423, top1 = 87.76%], valid : [loss = 1.296, top1 = 66.86%], test : [loss = 1.267, top1 = 66.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.227, top1 = 42.34%], valid : [loss = 2.416, top1 = 38.77%], test : [loss = 2.425, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.93%], valid : [loss = 0.810, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10219/15625) 010219-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.528, top1 = 88.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.341, top1 = 91.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 0.348, top1 = 90.53%], valid : [loss = 1.283, top1 = 66.95%], test : [loss = 1.306, top1 = 66.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.68%], valid : [loss = 2.404, top1 = 38.51%], test : [loss = 2.414, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10220/15625) 010220-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.515, top1 = 88.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.90 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.319, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.370, top1 = 89.75%], valid : [loss = 1.281, top1 = 66.68%], test : [loss = 1.290, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.77 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.64%], valid : [loss = 2.400, top1 = 39.30%], test : [loss = 2.445, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.56%], valid : [loss = 0.720, top1 = 75.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10221/15625) 010221-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.247, top1 = 91.83%], valid : [loss = 0.551, top1 = 82.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.10 ms.
cifar10        train : [loss = 0.241, top1 = 91.72%], test  : [loss = 0.434, top1 = 85.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.38 ms.
cifar100       train : [loss = 1.264, top1 = 64.31%], valid : [loss = 1.615, top1 = 56.54%], test : [loss = 1.626, top1 = 56.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.958, top1 = 27.77%], valid : [loss = 2.990, top1 = 27.43%], test : [loss = 3.042, top1 = 27.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 57.87%], valid : [loss = 1.223, top1 = 56.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10222/15625) 010222-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.19%], valid : [loss = 0.484, top1 = 84.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10        train : [loss = 0.302, top1 = 89.86%], test  : [loss = 0.403, top1 = 86.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.00 ms.
cifar100       train : [loss = 1.338, top1 = 62.94%], valid : [loss = 1.558, top1 = 57.24%], test : [loss = 1.507, top1 = 58.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.41%], valid : [loss = 2.905, top1 = 28.60%], test : [loss = 2.972, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.54%], valid : [loss = 0.746, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10223/15625) 010223-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.02%], valid : [loss = 0.640, top1 = 78.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.03 ms.
cifar10        train : [loss = 0.505, top1 = 82.42%], test  : [loss = 0.596, top1 = 79.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 1.733, top1 = 52.89%], valid : [loss = 1.880, top1 = 50.16%], test : [loss = 1.889, top1 = 49.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 3.344, top1 = 20.97%], valid : [loss = 3.341, top1 = 21.37%], test : [loss = 3.354, top1 = 21.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.275, top1 = 54.11%], valid : [loss = 1.300, top1 = 53.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10224/15625) 010224-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.21%], valid : [loss = 0.547, top1 = 86.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.053, top1 = 98.24%], test  : [loss = 0.389, top1 = 89.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.531, top1 = 84.40%], valid : [loss = 1.315, top1 = 64.66%], test : [loss = 1.330, top1 = 64.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 35.90%], valid : [loss = 2.642, top1 = 34.27%], test : [loss = 2.659, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 62.67%], valid : [loss = 1.064, top1 = 61.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10225/15625) 010225-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.526, top1 = 88.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.33 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.339, top1 = 91.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.328, top1 = 90.99%], valid : [loss = 1.318, top1 = 66.20%], test : [loss = 1.310, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.65%], valid : [loss = 2.446, top1 = 37.53%], test : [loss = 2.468, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.43%], valid : [loss = 0.802, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10226/15625) 010226-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.183, top1 = 93.67%], valid : [loss = 0.707, top1 = 80.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.177, top1 = 93.91%], test  : [loss = 0.508, top1 = 84.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.28 ms.
cifar100       train : [loss = 0.891, top1 = 74.03%], valid : [loss = 1.631, top1 = 57.78%], test : [loss = 1.653, top1 = 57.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 3.524, top1 = 16.49%], valid : [loss = 3.521, top1 = 16.87%], test : [loss = 3.529, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.38%], valid : [loss = 1.303, top1 = 52.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10227/15625) 010227-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.02%], valid : [loss = 0.495, top1 = 84.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10        train : [loss = 0.237, top1 = 91.89%], test  : [loss = 0.383, top1 = 87.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.18 ms.
cifar100       train : [loss = 1.240, top1 = 64.87%], valid : [loss = 1.547, top1 = 57.80%], test : [loss = 1.534, top1 = 58.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.12 ms.
ImageNet16-120 train : [loss = 2.790, top1 = 30.69%], valid : [loss = 2.799, top1 = 30.97%], test : [loss = 2.862, top1 = 29.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.958, top1 = 66.06%], valid : [loss = 0.996, top1 = 64.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10228/15625) 010228-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.482, top1 = 89.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.352, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.262, top1 = 93.15%], valid : [loss = 1.324, top1 = 66.80%], test : [loss = 1.318, top1 = 67.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.019, top1 = 47.11%], valid : [loss = 2.345, top1 = 40.30%], test : [loss = 2.418, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.25%], valid : [loss = 0.575, top1 = 80.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10229/15625) 010229-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.559, top1 = 87.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.360, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.415, top1 = 88.06%], valid : [loss = 1.231, top1 = 67.16%], test : [loss = 1.292, top1 = 66.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.25%], valid : [loss = 2.428, top1 = 38.07%], test : [loss = 2.445, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10230/15625) 010230-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.530, top1 = 89.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.07 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.342, top1 = 92.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.65 ms.
cifar100       train : [loss = 0.105, top1 = 97.88%], valid : [loss = 1.360, top1 = 69.30%], test : [loss = 1.355, top1 = 69.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.16 ms.
ImageNet16-120 train : [loss = 1.698, top1 = 54.47%], valid : [loss = 2.190, top1 = 44.37%], test : [loss = 2.201, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.16%], valid : [loss = 0.692, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10231/15625) 010231-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.501, top1 = 89.42%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.27 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.316, top1 = 92.87%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=17.24 ms.
cifar100       train : [loss = 0.067, top1 = 99.13%], valid : [loss = 1.308, top1 = 69.64%], test : [loss = 1.291, top1 = 69.66%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.53 ms.
ImageNet16-120 train : [loss = 1.811, top1 = 51.95%], valid : [loss = 2.263, top1 = 42.33%], test : [loss = 2.223, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.96%], valid : [loss = 0.743, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10232/15625) 010232-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.619, top1 = 85.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.075, top1 = 97.70%], test  : [loss = 0.395, top1 = 88.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.718, top1 = 79.17%], valid : [loss = 1.407, top1 = 62.85%], test : [loss = 1.388, top1 = 63.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.87%], valid : [loss = 2.654, top1 = 34.28%], test : [loss = 2.712, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10233/15625) 010233-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.492, top1 = 90.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.25 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.328, top1 = 92.70%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.54 ms.
cifar100       train : [loss = 0.122, top1 = 97.52%], valid : [loss = 1.254, top1 = 70.26%], test : [loss = 1.247, top1 = 70.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.15%], valid : [loss = 2.168, top1 = 43.90%], test : [loss = 2.167, top1 = 45.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.56%], valid : [loss = 0.764, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10234/15625) 010234-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.594, top1 = 87.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.47 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.384, top1 = 91.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.54 ms.
cifar100       train : [loss = 0.396, top1 = 88.62%], valid : [loss = 1.396, top1 = 64.54%], test : [loss = 1.390, top1 = 65.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.02%], valid : [loss = 2.525, top1 = 36.13%], test : [loss = 2.521, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10235/15625) 010235-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.588, top1 = 87.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.14 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.376, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.178, top1 = 96.02%], valid : [loss = 1.475, top1 = 66.44%], test : [loss = 1.495, top1 = 66.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 1.997, top1 = 47.51%], valid : [loss = 2.468, top1 = 38.77%], test : [loss = 2.481, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.62%], valid : [loss = 0.721, top1 = 75.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10236/15625) 010236-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.335, top1 = 88.52%], valid : [loss = 0.577, top1 = 81.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.71 ms.
cifar10        train : [loss = 0.273, top1 = 90.76%], test  : [loss = 0.429, top1 = 86.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.27 ms.
cifar100       train : [loss = 1.414, top1 = 60.48%], valid : [loss = 1.666, top1 = 54.92%], test : [loss = 1.655, top1 = 55.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.983, top1 = 27.11%], valid : [loss = 2.988, top1 = 27.03%], test : [loss = 3.031, top1 = 26.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.49%], valid : [loss = 1.041, top1 = 62.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10237/15625) 010237-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.65%], valid : [loss = 0.595, top1 = 84.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10        train : [loss = 0.118, top1 = 96.23%], test  : [loss = 0.378, top1 = 88.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=12.98 ms.
cifar100       train : [loss = 0.836, top1 = 75.54%], valid : [loss = 1.380, top1 = 63.08%], test : [loss = 1.400, top1 = 62.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.47%], valid : [loss = 2.633, top1 = 33.30%], test : [loss = 2.643, top1 = 34.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.76%], valid : [loss = 0.922, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10238/15625) 010238-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.96%], valid : [loss = 0.743, top1 = 83.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.22 ms.
cifar10        train : [loss = 0.061, top1 = 98.10%], test  : [loss = 0.432, top1 = 88.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.11 ms.
cifar100       train : [loss = 0.680, top1 = 80.08%], valid : [loss = 1.542, top1 = 61.16%], test : [loss = 1.516, top1 = 61.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.45%], valid : [loss = 2.823, top1 = 30.40%], test : [loss = 2.874, top1 = 30.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.44%], valid : [loss = 0.888, top1 = 68.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10239/15625) 010239-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.535, top1 = 89.56%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.346, top1 = 92.86%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.88 ms.
cifar100       train : [loss = 0.080, top1 = 98.59%], valid : [loss = 1.381, top1 = 69.25%], test : [loss = 1.388, top1 = 69.19%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.72 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.70%], valid : [loss = 2.300, top1 = 40.93%], test : [loss = 2.308, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.22%], valid : [loss = 0.706, top1 = 75.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10240/15625) 010240-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.78%], valid : [loss = 0.487, top1 = 84.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.61 ms.
cifar10        train : [loss = 0.303, top1 = 89.82%], test  : [loss = 0.410, top1 = 86.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.17 ms.
cifar100       train : [loss = 1.336, top1 = 63.09%], valid : [loss = 1.534, top1 = 57.66%], test : [loss = 1.498, top1 = 58.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.17 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.58%], valid : [loss = 2.890, top1 = 29.80%], test : [loss = 2.959, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10241/15625) 010241-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.528, top1 = 89.37%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.333, top1 = 92.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.16 ms.
cifar100       train : [loss = 0.080, top1 = 98.52%], valid : [loss = 1.393, top1 = 69.46%], test : [loss = 1.379, top1 = 69.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.17%], valid : [loss = 2.347, top1 = 40.38%], test : [loss = 2.328, top1 = 41.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.28%], valid : [loss = 0.858, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10242/15625) 010242-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.72%], valid : [loss = 0.596, top1 = 87.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10        train : [loss = 0.017, top1 = 99.51%], test  : [loss = 0.397, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.42 ms.
cifar100       train : [loss = 0.356, top1 = 90.00%], valid : [loss = 1.479, top1 = 63.59%], test : [loss = 1.473, top1 = 64.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 3.005, top1 = 25.52%], valid : [loss = 3.053, top1 = 24.33%], test : [loss = 3.059, top1 = 24.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10243/15625) 010243-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.460, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.310, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 0.326, top1 = 91.08%], valid : [loss = 1.308, top1 = 67.04%], test : [loss = 1.291, top1 = 67.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.09%], valid : [loss = 2.366, top1 = 40.09%], test : [loss = 2.380, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.474, top1 = 83.66%], valid : [loss = 0.561, top1 = 81.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10244/15625) 010244-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.321, top1 = 93.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.60 ms.
cifar100       train : [loss = 0.085, top1 = 98.51%], valid : [loss = 1.339, top1 = 69.60%], test : [loss = 1.303, top1 = 69.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 1.615, top1 = 56.49%], valid : [loss = 2.180, top1 = 44.00%], test : [loss = 2.156, top1 = 45.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.70%], valid : [loss = 0.676, top1 = 76.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10245/15625) 010245-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.504, top1 = 89.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.72 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.348, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.40 ms.
cifar100       train : [loss = 0.311, top1 = 91.59%], valid : [loss = 1.273, top1 = 67.76%], test : [loss = 1.263, top1 = 67.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.61%], valid : [loss = 2.357, top1 = 39.97%], test : [loss = 2.370, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.24%], valid : [loss = 0.677, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10246/15625) 010246-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.61%], valid : [loss = 0.555, top1 = 87.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.335, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.33 ms.
cifar100       train : [loss = 0.443, top1 = 87.03%], valid : [loss = 1.216, top1 = 68.02%], test : [loss = 1.229, top1 = 67.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 42.95%], valid : [loss = 2.355, top1 = 39.13%], test : [loss = 2.376, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10247/15625) 010247-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.588, top1 = 86.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.33 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.378, top1 = 91.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.99 ms.
cifar100       train : [loss = 0.385, top1 = 88.98%], valid : [loss = 1.405, top1 = 64.66%], test : [loss = 1.404, top1 = 64.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.22%], valid : [loss = 2.490, top1 = 36.40%], test : [loss = 2.510, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.59%], valid : [loss = 0.854, top1 = 69.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10248/15625) 010248-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.065, top1 = 98.25%], valid : [loss = 0.566, top1 = 85.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.41 ms.
cifar10        train : [loss = 0.086, top1 = 97.39%], test  : [loss = 0.362, top1 = 89.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.09 ms.
cifar100       train : [loss = 0.750, top1 = 78.33%], valid : [loss = 1.415, top1 = 63.02%], test : [loss = 1.385, top1 = 62.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.25 ms.
ImageNet16-120 train : [loss = 2.452, top1 = 37.64%], valid : [loss = 2.578, top1 = 35.93%], test : [loss = 2.625, top1 = 34.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.66%], valid : [loss = 0.854, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10249/15625) 010249-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.571, top1 = 88.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.59 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.391, top1 = 91.50%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.61 ms.
cifar100       train : [loss = 0.153, top1 = 96.75%], valid : [loss = 1.564, top1 = 65.12%], test : [loss = 1.536, top1 = 66.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.76 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.85%], valid : [loss = 2.429, top1 = 38.80%], test : [loss = 2.436, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.77%], valid : [loss = 0.767, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10250/15625) 010250-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.552, top1 = 88.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.027, top1 = 99.18%], test  : [loss = 0.363, top1 = 91.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.00 ms.
cifar100       train : [loss = 0.422, top1 = 87.72%], valid : [loss = 1.281, top1 = 66.34%], test : [loss = 1.274, top1 = 66.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.57%], valid : [loss = 2.485, top1 = 37.63%], test : [loss = 2.469, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.90%], valid : [loss = 0.922, top1 = 67.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10251/15625) 010251-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.307, top1 = 89.38%], valid : [loss = 0.539, top1 = 82.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.314, top1 = 89.19%], test  : [loss = 0.437, top1 = 85.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.45 ms.
cifar100       train : [loss = 1.463, top1 = 59.00%], valid : [loss = 1.706, top1 = 54.72%], test : [loss = 1.671, top1 = 54.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 3.009, top1 = 26.59%], valid : [loss = 3.023, top1 = 26.43%], test : [loss = 3.043, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 64.83%], valid : [loss = 1.025, top1 = 63.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10252/15625) 010252-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.38%], valid : [loss = 0.687, top1 = 77.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.343, top1 = 88.19%], test  : [loss = 0.480, top1 = 83.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.68 ms.
cifar100       train : [loss = 1.628, top1 = 54.98%], valid : [loss = 1.864, top1 = 49.88%], test : [loss = 1.856, top1 = 50.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.243, top1 = 22.37%], valid : [loss = 3.258, top1 = 22.30%], test : [loss = 3.323, top1 = 20.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.223, top1 = 55.87%], valid : [loss = 1.251, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10253/15625) 010253-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.24%], valid : [loss = 0.651, top1 = 84.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.21 ms.
cifar10        train : [loss = 0.053, top1 = 98.42%], test  : [loss = 0.405, top1 = 89.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.85 ms.
cifar100       train : [loss = 0.646, top1 = 81.20%], valid : [loss = 1.426, top1 = 63.00%], test : [loss = 1.413, top1 = 63.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.18%], valid : [loss = 2.615, top1 = 34.40%], test : [loss = 2.645, top1 = 34.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.74%], valid : [loss = 0.845, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10254/15625) 010254-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.15%], valid : [loss = 0.731, top1 = 75.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.55 ms.
cifar10        train : [loss = 0.501, top1 = 82.83%], test  : [loss = 0.580, top1 = 80.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 1.855, top1 = 49.68%], valid : [loss = 1.990, top1 = 47.03%], test : [loss = 1.987, top1 = 46.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 3.013, top1 = 26.45%], valid : [loss = 2.994, top1 = 27.36%], test : [loss = 3.020, top1 = 26.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.129, top1 = 59.56%], valid : [loss = 1.176, top1 = 58.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10255/15625) 010255-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.498, top1 = 88.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.319, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.76 ms.
cifar100       train : [loss = 0.318, top1 = 91.41%], valid : [loss = 1.228, top1 = 67.72%], test : [loss = 1.237, top1 = 67.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.76 ms.
ImageNet16-120 train : [loss = 2.044, top1 = 46.48%], valid : [loss = 2.308, top1 = 41.40%], test : [loss = 2.314, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.96%], valid : [loss = 0.599, top1 = 79.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10256/15625) 010256-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.86%], valid : [loss = 0.569, top1 = 88.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.84%], test  : [loss = 0.349, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.99 ms.
cifar100       train : [loss = 0.121, top1 = 97.38%], valid : [loss = 1.388, top1 = 68.36%], test : [loss = 1.416, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 43.96%], valid : [loss = 2.458, top1 = 37.13%], test : [loss = 2.455, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.72%], valid : [loss = 0.890, top1 = 68.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10257/15625) 010257-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.21%], valid : [loss = 0.469, top1 = 85.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.158, top1 = 94.81%], test  : [loss = 0.348, top1 = 88.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 1.009, top1 = 71.18%], valid : [loss = 1.350, top1 = 61.90%], test : [loss = 1.361, top1 = 61.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.65%], valid : [loss = 2.696, top1 = 32.83%], test : [loss = 2.709, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10258/15625) 010258-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.489, top1 = 89.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.320, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.48 ms.
cifar100       train : [loss = 0.344, top1 = 90.54%], valid : [loss = 1.260, top1 = 67.08%], test : [loss = 1.309, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.21%], valid : [loss = 2.409, top1 = 38.83%], test : [loss = 2.426, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10259/15625) 010259-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.15 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.88%], valid : [loss = 0.532, top1 = 87.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 0.078, top1 = 97.52%], test  : [loss = 0.364, top1 = 89.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 0.722, top1 = 78.72%], valid : [loss = 1.347, top1 = 64.26%], test : [loss = 1.363, top1 = 63.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.04%], valid : [loss = 2.633, top1 = 34.33%], test : [loss = 2.680, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10260/15625) 010260-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.22%], valid : [loss = 0.601, top1 = 85.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.069, top1 = 97.91%], test  : [loss = 0.386, top1 = 89.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.53 ms.
cifar100       train : [loss = 0.705, top1 = 79.36%], valid : [loss = 1.347, top1 = 64.28%], test : [loss = 1.390, top1 = 62.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.75 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.45%], valid : [loss = 2.687, top1 = 33.60%], test : [loss = 2.730, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10261/15625) 010261-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.03%], valid : [loss = 0.741, top1 = 82.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.07 ms.
cifar10        train : [loss = 0.085, top1 = 97.24%], test  : [loss = 0.512, top1 = 86.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.95 ms.
cifar100       train : [loss = 0.766, top1 = 77.75%], valid : [loss = 1.506, top1 = 60.88%], test : [loss = 1.494, top1 = 60.88%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.765, top1 = 31.35%], valid : [loss = 2.897, top1 = 28.83%], test : [loss = 2.941, top1 = 28.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.76%], valid : [loss = 0.914, top1 = 67.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10262/15625) 010262-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.17%], valid : [loss = 0.458, top1 = 86.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.80 ms.
cifar10        train : [loss = 0.165, top1 = 94.58%], test  : [loss = 0.354, top1 = 88.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.25 ms.
cifar100       train : [loss = 0.991, top1 = 71.78%], valid : [loss = 1.353, top1 = 62.82%], test : [loss = 1.345, top1 = 61.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.37%], valid : [loss = 2.690, top1 = 33.50%], test : [loss = 2.722, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10263/15625) 010263-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.600, top1 = 88.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.19 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.393, top1 = 91.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.85 ms.
cifar100       train : [loss = 0.126, top1 = 97.41%], valid : [loss = 1.462, top1 = 67.34%], test : [loss = 1.434, top1 = 67.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 1.956, top1 = 48.59%], valid : [loss = 2.466, top1 = 38.53%], test : [loss = 2.496, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.02%], valid : [loss = 0.777, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10264/15625) 010264-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.35%], valid : [loss = 0.723, top1 = 79.99%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.205, top1 = 92.74%], test  : [loss = 0.511, top1 = 84.70%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.32 ms.
cifar100       train : [loss = 0.897, top1 = 73.97%], valid : [loss = 1.626, top1 = 57.76%], test : [loss = 1.664, top1 = 57.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 3.486, top1 = 17.19%], valid : [loss = 3.507, top1 = 17.13%], test : [loss = 3.491, top1 = 16.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.63%], valid : [loss = 1.283, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10265/15625) 010265-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.550, top1 = 88.02%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.351, top1 = 91.94%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.04 ms.
cifar100       train : [loss = 0.216, top1 = 94.87%], valid : [loss = 1.380, top1 = 67.10%], test : [loss = 1.332, top1 = 67.40%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.19 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 40.82%], valid : [loss = 2.445, top1 = 37.87%], test : [loss = 2.466, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.25%], valid : [loss = 0.913, top1 = 67.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10266/15625) 010266-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.71 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10267/15625) 010267-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.514, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.330, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.44 ms.
cifar100       train : [loss = 0.298, top1 = 91.85%], valid : [loss = 1.263, top1 = 67.86%], test : [loss = 1.281, top1 = 67.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.92%], valid : [loss = 2.313, top1 = 40.07%], test : [loss = 2.324, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.64%], valid : [loss = 0.803, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10268/15625) 010268-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.488, top1 = 89.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.40 ms.
cifar10        train : [loss = 0.011, top1 = 99.84%], test  : [loss = 0.321, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.80 ms.
cifar100       train : [loss = 0.232, top1 = 94.23%], valid : [loss = 1.250, top1 = 68.56%], test : [loss = 1.262, top1 = 68.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.56%], valid : [loss = 2.285, top1 = 41.50%], test : [loss = 2.322, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10269/15625) 010269-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.50%], valid : [loss = 0.448, top1 = 87.72%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10        train : [loss = 0.054, top1 = 98.72%], test  : [loss = 0.332, top1 = 90.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.74 ms.
cifar100       train : [loss = 0.592, top1 = 83.65%], valid : [loss = 1.247, top1 = 66.00%], test : [loss = 1.192, top1 = 67.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.22 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 41.04%], valid : [loss = 2.472, top1 = 38.73%], test : [loss = 2.497, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10270/15625) 010270-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.55 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.59 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.06 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.66 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10271/15625) 010271-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.498, top1 = 89.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.315, top1 = 92.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.56 ms.
cifar100       train : [loss = 0.155, top1 = 96.67%], valid : [loss = 1.272, top1 = 69.00%], test : [loss = 1.241, top1 = 69.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.99 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.31%], valid : [loss = 2.289, top1 = 42.23%], test : [loss = 2.298, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10272/15625) 010272-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.345, top1 = 92.67%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.33 ms.
cifar100       train : [loss = 0.052, top1 = 99.48%], valid : [loss = 1.414, top1 = 68.70%], test : [loss = 1.442, top1 = 68.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=24.13 ms.
ImageNet16-120 train : [loss = 1.694, top1 = 54.69%], valid : [loss = 2.390, top1 = 41.03%], test : [loss = 2.415, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.12%], valid : [loss = 0.702, top1 = 75.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10273/15625) 010273-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.44 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.46 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.63 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.46 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10274/15625) 010274-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.529, top1 = 89.01%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=18.48 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.381, top1 = 91.83%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.15 ms.
cifar100       train : [loss = 0.049, top1 = 99.56%], valid : [loss = 1.493, top1 = 67.80%], test : [loss = 1.485, top1 = 68.40%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=24.65 ms.
ImageNet16-120 train : [loss = 1.656, top1 = 55.78%], valid : [loss = 2.433, top1 = 40.53%], test : [loss = 2.460, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.43%], valid : [loss = 0.688, top1 = 76.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10275/15625) 010275-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.51%], valid : [loss = 0.460, top1 = 87.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10        train : [loss = 0.056, top1 = 98.64%], test  : [loss = 0.304, top1 = 91.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.50 ms.
cifar100       train : [loss = 0.585, top1 = 84.02%], valid : [loss = 1.214, top1 = 66.36%], test : [loss = 1.176, top1 = 67.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 41.06%], valid : [loss = 2.468, top1 = 37.17%], test : [loss = 2.472, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10276/15625) 010276-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.578, top1 = 88.04%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.54 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.403, top1 = 91.11%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.23 ms.
cifar100       train : [loss = 0.156, top1 = 96.71%], valid : [loss = 1.465, top1 = 66.82%], test : [loss = 1.498, top1 = 66.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 1.969, top1 = 48.38%], valid : [loss = 2.448, top1 = 39.47%], test : [loss = 2.457, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.11%], valid : [loss = 0.739, top1 = 74.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10277/15625) 010277-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.501, top1 = 89.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.298, top1 = 92.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.64 ms.
cifar100       train : [loss = 0.241, top1 = 94.06%], valid : [loss = 1.262, top1 = 68.44%], test : [loss = 1.264, top1 = 69.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.30%], valid : [loss = 2.267, top1 = 42.30%], test : [loss = 2.321, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10278/15625) 010278-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.45 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.597, top1 = 87.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.391, top1 = 91.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.213, top1 = 94.94%], valid : [loss = 1.424, top1 = 66.24%], test : [loss = 1.404, top1 = 66.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.084, top1 = 45.67%], valid : [loss = 2.504, top1 = 38.37%], test : [loss = 2.532, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.87%], valid : [loss = 0.744, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10279/15625) 010279-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.433, top1 = 90.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.39 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.269, top1 = 93.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.01 ms.
cifar100       train : [loss = 0.095, top1 = 98.22%], valid : [loss = 1.364, top1 = 69.76%], test : [loss = 1.366, top1 = 70.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.78%], valid : [loss = 2.220, top1 = 43.63%], test : [loss = 2.248, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.383, top1 = 86.78%], valid : [loss = 0.497, top1 = 83.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10280/15625) 010280-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.25%], valid : [loss = 0.459, top1 = 86.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.87 ms.
cifar10        train : [loss = 0.112, top1 = 96.52%], test  : [loss = 0.333, top1 = 89.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.41 ms.
cifar100       train : [loss = 0.858, top1 = 75.48%], valid : [loss = 1.289, top1 = 63.88%], test : [loss = 1.293, top1 = 64.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.89 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.56%], valid : [loss = 2.632, top1 = 34.33%], test : [loss = 2.648, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10281/15625) 010281-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=141.48 M, Params=0.992 MB, latency=21.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.63%]
cifar10        FLOP=141.48 M, Params=0.992 MB, latency=20.23 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.323, top1 = 93.10%]
cifar100       FLOP=141.48 M, Params=0.998 MB, latency=18.70 ms.
cifar100       train : [loss = 0.069, top1 = 98.95%], valid : [loss = 1.368, top1 = 69.25%], test : [loss = 1.353, top1 = 70.39%]
ImageNet16-120 FLOP= 35.38 M, Params=1.000 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 1.761, top1 = 53.02%], valid : [loss = 2.285, top1 = 42.80%], test : [loss = 2.257, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.23%], valid : [loss = 0.620, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10282/15625) 010282-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.60 ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.62%], valid : [loss = 0.777, top1 = 73.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.85 ms.
cifar10        train : [loss = 0.584, top1 = 79.68%], test  : [loss = 0.646, top1 = 77.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.36 ms.
cifar100       train : [loss = 2.022, top1 = 45.58%], valid : [loss = 2.172, top1 = 42.35%], test : [loss = 2.156, top1 = 43.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.40%], valid : [loss = 3.230, top1 = 22.71%], test : [loss = 3.261, top1 = 22.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.280, top1 = 53.90%], valid : [loss = 1.324, top1 = 52.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10283/15625) 010283-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.38%], valid : [loss = 0.752, top1 = 74.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10        train : [loss = 0.582, top1 = 79.83%], test  : [loss = 0.644, top1 = 77.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.97 ms.
cifar100       train : [loss = 1.976, top1 = 46.73%], valid : [loss = 2.124, top1 = 43.67%], test : [loss = 2.122, top1 = 43.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.13 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.50%], valid : [loss = 3.241, top1 = 22.82%], test : [loss = 3.248, top1 = 22.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.21%], valid : [loss = 1.330, top1 = 51.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10284/15625) 010284-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.61 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.35 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.66 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10285/15625) 010285-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.55%], valid : [loss = 0.610, top1 = 86.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 0.040, top1 = 98.82%], test  : [loss = 0.392, top1 = 90.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.11 ms.
cifar100       train : [loss = 0.556, top1 = 83.74%], valid : [loss = 1.462, top1 = 62.72%], test : [loss = 1.396, top1 = 64.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.95%], valid : [loss = 2.615, top1 = 34.73%], test : [loss = 2.663, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10286/15625) 010286-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.35%], valid : [loss = 0.700, top1 = 84.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.054, top1 = 98.31%], test  : [loss = 0.453, top1 = 88.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.38 ms.
cifar100       train : [loss = 0.605, top1 = 82.23%], valid : [loss = 1.510, top1 = 61.70%], test : [loss = 1.484, top1 = 61.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 33.14%], valid : [loss = 2.850, top1 = 29.60%], test : [loss = 2.907, top1 = 29.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10287/15625) 010287-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.550, top1 = 88.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.45 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.378, top1 = 91.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.168, top1 = 96.32%], valid : [loss = 1.368, top1 = 67.78%], test : [loss = 1.427, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 48.00%], valid : [loss = 2.465, top1 = 39.00%], test : [loss = 2.481, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10288/15625) 010288-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.46%], valid : [loss = 0.582, top1 = 85.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.37 ms.
cifar10        train : [loss = 0.102, top1 = 96.61%], test  : [loss = 0.377, top1 = 88.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.06 ms.
cifar100       train : [loss = 0.815, top1 = 76.12%], valid : [loss = 1.423, top1 = 61.96%], test : [loss = 1.408, top1 = 62.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.44%], valid : [loss = 2.762, top1 = 31.57%], test : [loss = 2.782, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.86%], valid : [loss = 0.712, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10289/15625) 010289-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.18%], valid : [loss = 0.568, top1 = 86.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.059, top1 = 98.09%], test  : [loss = 0.367, top1 = 90.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.732, top1 = 78.66%], valid : [loss = 1.373, top1 = 63.60%], test : [loss = 1.333, top1 = 64.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.16%], valid : [loss = 2.530, top1 = 36.43%], test : [loss = 2.538, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10290/15625) 010290-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.539, top1 = 88.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.318, top1 = 92.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.59 ms.
cifar100       train : [loss = 0.217, top1 = 94.68%], valid : [loss = 1.249, top1 = 69.04%], test : [loss = 1.247, top1 = 69.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 49.03%], valid : [loss = 2.247, top1 = 42.57%], test : [loss = 2.272, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.85%], valid : [loss = 0.649, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10291/15625) 010291-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.596, top1 = 87.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.09 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.388, top1 = 90.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.89 ms.
cifar100       train : [loss = 0.423, top1 = 87.93%], valid : [loss = 1.403, top1 = 65.07%], test : [loss = 1.384, top1 = 65.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.00%], valid : [loss = 2.502, top1 = 36.06%], test : [loss = 2.512, top1 = 37.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.32%], valid : [loss = 0.813, top1 = 71.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10292/15625) 010292-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.01%], valid : [loss = 0.762, top1 = 73.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.60 ms.
cifar10        train : [loss = 0.571, top1 = 80.14%], test  : [loss = 0.629, top1 = 78.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.25 ms.
cifar100       train : [loss = 2.009, top1 = 45.83%], valid : [loss = 2.128, top1 = 44.28%], test : [loss = 2.154, top1 = 43.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.65 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.23%], valid : [loss = 3.220, top1 = 24.27%], test : [loss = 3.245, top1 = 21.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 54.10%], valid : [loss = 1.321, top1 = 52.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10293/15625) 010293-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.89 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.07%], valid : [loss = 0.479, top1 = 84.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.30 ms.
cifar10        train : [loss = 0.303, top1 = 89.80%], test  : [loss = 0.405, top1 = 86.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.96 ms.
cifar100       train : [loss = 1.320, top1 = 63.46%], valid : [loss = 1.528, top1 = 57.93%], test : [loss = 1.498, top1 = 58.51%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.94 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.69%], valid : [loss = 2.901, top1 = 29.81%], test : [loss = 2.950, top1 = 28.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10294/15625) 010294-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.44%], valid : [loss = 0.866, top1 = 71.22%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10        train : [loss = 0.554, top1 = 80.68%], test  : [loss = 0.718, top1 = 75.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.77 ms.
cifar100       train : [loss = 1.790, top1 = 51.80%], valid : [loss = 2.050, top1 = 47.20%], test : [loss = 2.063, top1 = 46.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.06 ms.
ImageNet16-120 train : [loss = 3.594, top1 = 16.73%], valid : [loss = 3.649, top1 = 16.27%], test : [loss = 3.660, top1 = 16.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10295/15625) 010295-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.544, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.341, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.59 ms.
cifar100       train : [loss = 0.297, top1 = 91.67%], valid : [loss = 1.304, top1 = 67.54%], test : [loss = 1.291, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.49%], valid : [loss = 2.402, top1 = 38.63%], test : [loss = 2.419, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 70.99%], valid : [loss = 0.849, top1 = 70.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10296/15625) 010296-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.326, top1 = 88.67%], valid : [loss = 0.590, top1 = 80.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.255, top1 = 91.32%], test  : [loss = 0.417, top1 = 86.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 1.355, top1 = 62.11%], valid : [loss = 1.602, top1 = 57.10%], test : [loss = 1.599, top1 = 56.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.890, top1 = 28.95%], valid : [loss = 2.910, top1 = 29.23%], test : [loss = 2.939, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.71%], valid : [loss = 1.020, top1 = 63.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10297/15625) 010297-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.564, top1 = 88.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.347, top1 = 92.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.64 ms.
cifar100       train : [loss = 0.259, top1 = 93.36%], valid : [loss = 1.279, top1 = 68.34%], test : [loss = 1.300, top1 = 68.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.28%], valid : [loss = 2.402, top1 = 40.73%], test : [loss = 2.380, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.69%], valid : [loss = 0.979, top1 = 65.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10298/15625) 010298-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.679, top1 = 86.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.28 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.449, top1 = 90.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.56 ms.
cifar100       train : [loss = 0.201, top1 = 95.36%], valid : [loss = 1.463, top1 = 66.20%], test : [loss = 1.450, top1 = 66.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.082, top1 = 45.94%], valid : [loss = 2.525, top1 = 37.10%], test : [loss = 2.528, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.16%], valid : [loss = 0.757, top1 = 73.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10299/15625) 010299-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.26%], valid : [loss = 0.865, top1 = 71.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.558, top1 = 80.53%], test  : [loss = 0.705, top1 = 76.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.57 ms.
cifar100       train : [loss = 1.775, top1 = 52.29%], valid : [loss = 2.046, top1 = 47.48%], test : [loss = 2.054, top1 = 46.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.77%], valid : [loss = 3.643, top1 = 16.50%], test : [loss = 3.661, top1 = 16.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.199, top1 = 56.76%], valid : [loss = 1.258, top1 = 55.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10300/15625) 010300-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.92%], valid : [loss = 0.521, top1 = 87.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.55 ms.
cifar10        train : [loss = 0.079, top1 = 97.47%], test  : [loss = 0.364, top1 = 89.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.54 ms.
cifar100       train : [loss = 0.716, top1 = 78.80%], valid : [loss = 1.339, top1 = 64.68%], test : [loss = 1.334, top1 = 64.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.00%], valid : [loss = 2.629, top1 = 34.17%], test : [loss = 2.662, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.93%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10301/15625) 010301-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.44 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10302/15625) 010302-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.74%], valid : [loss = 0.855, top1 = 71.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.23 ms.
cifar10        train : [loss = 0.546, top1 = 80.94%], test  : [loss = 0.719, top1 = 75.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.70 ms.
cifar100       train : [loss = 1.769, top1 = 52.32%], valid : [loss = 2.049, top1 = 46.68%], test : [loss = 2.065, top1 = 47.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.574, top1 = 16.99%], valid : [loss = 3.623, top1 = 16.37%], test : [loss = 3.654, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10303/15625) 010303-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.43%], valid : [loss = 0.598, top1 = 86.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10        train : [loss = 0.023, top1 = 99.30%], test  : [loss = 0.366, top1 = 91.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.00 ms.
cifar100       train : [loss = 0.212, top1 = 94.17%], valid : [loss = 1.441, top1 = 65.94%], test : [loss = 1.456, top1 = 66.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.730, top1 = 31.40%], valid : [loss = 2.824, top1 = 30.47%], test : [loss = 2.852, top1 = 28.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 62.79%], valid : [loss = 1.043, top1 = 62.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10304/15625) 010304-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.28 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10305/15625) 010305-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.66%], valid : [loss = 0.567, top1 = 86.36%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10        train : [loss = 0.085, top1 = 97.21%], test  : [loss = 0.374, top1 = 89.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.04 ms.
cifar100       train : [loss = 0.755, top1 = 77.90%], valid : [loss = 1.341, top1 = 63.67%], test : [loss = 1.337, top1 = 64.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.14%], valid : [loss = 2.577, top1 = 34.97%], test : [loss = 2.599, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.34%], valid : [loss = 0.797, top1 = 72.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10306/15625) 010306-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.289, top1 = 90.04%], valid : [loss = 0.531, top1 = 82.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.92 ms.
cifar10        train : [loss = 0.316, top1 = 89.13%], test  : [loss = 0.437, top1 = 85.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.315, top1 = 62.75%], valid : [loss = 1.576, top1 = 56.60%], test : [loss = 1.578, top1 = 56.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.44 ms.
ImageNet16-120 train : [loss = 3.073, top1 = 25.66%], valid : [loss = 3.069, top1 = 26.50%], test : [loss = 3.128, top1 = 25.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.216, top1 = 55.86%], valid : [loss = 1.258, top1 = 54.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10307/15625) 010307-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.44 ms.
cifar10-valid  train : [loss = 0.387, top1 = 86.49%], valid : [loss = 0.599, top1 = 80.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10        train : [loss = 0.332, top1 = 88.40%], test  : [loss = 0.445, top1 = 84.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 1.426, top1 = 59.95%], valid : [loss = 1.678, top1 = 54.74%], test : [loss = 1.699, top1 = 54.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 3.194, top1 = 23.25%], valid : [loss = 3.205, top1 = 23.23%], test : [loss = 3.245, top1 = 21.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.262, top1 = 54.00%], valid : [loss = 1.303, top1 = 53.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10308/15625) 010308-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.484, top1 = 89.07%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=17.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.313, top1 = 92.43%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=16.51 ms.
cifar100       train : [loss = 0.319, top1 = 91.48%], valid : [loss = 1.248, top1 = 67.69%], test : [loss = 1.256, top1 = 67.71%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.69%], valid : [loss = 2.318, top1 = 40.80%], test : [loss = 2.338, top1 = 40.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.97%], valid : [loss = 0.596, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10309/15625) 010309-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.32%], valid : [loss = 0.536, top1 = 84.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.182, top1 = 93.89%], test  : [loss = 0.378, top1 = 88.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.15 ms.
cifar100       train : [loss = 0.975, top1 = 71.73%], valid : [loss = 1.411, top1 = 61.26%], test : [loss = 1.394, top1 = 60.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.688, top1 = 32.72%], valid : [loss = 2.720, top1 = 31.33%], test : [loss = 2.790, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.83%], valid : [loss = 1.040, top1 = 63.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10310/15625) 010310-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.500, top1 = 89.96%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.28 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.318, top1 = 93.22%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.85 ms.
cifar100       train : [loss = 0.070, top1 = 98.85%], valid : [loss = 1.346, top1 = 69.78%], test : [loss = 1.382, top1 = 69.46%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.23 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.46%], valid : [loss = 2.357, top1 = 40.13%], test : [loss = 2.329, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.55%], valid : [loss = 0.703, top1 = 75.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10311/15625) 010311-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.54%], valid : [loss = 0.541, top1 = 87.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.95 ms.
cifar10        train : [loss = 0.029, top1 = 99.12%], test  : [loss = 0.349, top1 = 91.30%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.46 ms.
cifar100       train : [loss = 0.384, top1 = 88.90%], valid : [loss = 1.303, top1 = 66.56%], test : [loss = 1.302, top1 = 66.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.43%], valid : [loss = 2.383, top1 = 39.33%], test : [loss = 2.358, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.958, top1 = 65.62%], valid : [loss = 1.001, top1 = 64.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10312/15625) 010312-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.76%], valid : [loss = 0.736, top1 = 74.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10        train : [loss = 0.570, top1 = 80.27%], test  : [loss = 0.627, top1 = 78.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.12 ms.
cifar100       train : [loss = 1.970, top1 = 46.86%], valid : [loss = 2.122, top1 = 44.24%], test : [loss = 2.104, top1 = 44.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.46 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.30%], valid : [loss = 3.233, top1 = 23.14%], test : [loss = 3.268, top1 = 21.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10313/15625) 010313-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.519, top1 = 88.40%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.69 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.375, top1 = 90.97%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.49 ms.
cifar100       train : [loss = 0.302, top1 = 91.89%], valid : [loss = 1.347, top1 = 66.50%], test : [loss = 1.307, top1 = 67.82%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.73 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.60%], valid : [loss = 2.352, top1 = 40.10%], test : [loss = 2.380, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.75%], valid : [loss = 0.664, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10314/15625) 010314-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.475, top1 = 89.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.306, top1 = 92.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.37 ms.
cifar100       train : [loss = 0.318, top1 = 91.43%], valid : [loss = 1.240, top1 = 67.86%], test : [loss = 1.232, top1 = 68.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.34 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.79%], valid : [loss = 2.329, top1 = 40.37%], test : [loss = 2.321, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.17%], valid : [loss = 0.600, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10315/15625) 010315-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.414, top1 = 90.79%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.292, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.72 ms.
cifar100       train : [loss = 0.094, top1 = 98.36%], valid : [loss = 1.273, top1 = 70.96%], test : [loss = 1.302, top1 = 70.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 1.632, top1 = 56.02%], valid : [loss = 2.227, top1 = 44.13%], test : [loss = 2.221, top1 = 45.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.369, top1 = 87.40%], valid : [loss = 0.494, top1 = 83.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10316/15625) 010316-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.35%], valid : [loss = 0.545, top1 = 83.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.83 ms.
cifar10        train : [loss = 0.202, top1 = 93.24%], test  : [loss = 0.406, top1 = 87.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.18 ms.
cifar100       train : [loss = 1.249, top1 = 64.38%], valid : [loss = 1.559, top1 = 56.98%], test : [loss = 1.552, top1 = 57.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.11 ms.
ImageNet16-120 train : [loss = 2.705, top1 = 32.47%], valid : [loss = 2.725, top1 = 32.97%], test : [loss = 2.791, top1 = 30.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10317/15625) 010317-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.22%], valid : [loss = 0.848, top1 = 71.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.13 ms.
cifar10        train : [loss = 0.561, top1 = 80.49%], test  : [loss = 0.720, top1 = 75.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=17.43 ms.
cifar100       train : [loss = 1.805, top1 = 51.52%], valid : [loss = 2.107, top1 = 46.28%], test : [loss = 2.092, top1 = 46.88%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.77%], valid : [loss = 3.643, top1 = 16.43%], test : [loss = 3.667, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10318/15625) 010318-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.49%], valid : [loss = 0.445, top1 = 87.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.45 ms.
cifar10        train : [loss = 0.056, top1 = 98.60%], test  : [loss = 0.315, top1 = 90.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.07 ms.
cifar100       train : [loss = 0.592, top1 = 83.64%], valid : [loss = 1.238, top1 = 66.30%], test : [loss = 1.215, top1 = 66.53%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.16%], valid : [loss = 2.461, top1 = 37.90%], test : [loss = 2.487, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10319/15625) 010319-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.39%], valid : [loss = 0.484, top1 = 87.36%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.74 ms.
cifar10        train : [loss = 0.044, top1 = 98.66%], test  : [loss = 0.367, top1 = 90.70%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.42 ms.
cifar100       train : [loss = 0.493, top1 = 85.80%], valid : [loss = 1.198, top1 = 67.50%], test : [loss = 1.185, top1 = 68.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.45%], valid : [loss = 2.334, top1 = 39.83%], test : [loss = 2.362, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.52%], valid : [loss = 0.817, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10320/15625) 010320-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.50%], valid : [loss = 0.660, top1 = 77.66%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.57 ms.
cifar10        train : [loss = 0.533, top1 = 81.63%], test  : [loss = 0.595, top1 = 79.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.34 ms.
cifar100       train : [loss = 1.694, top1 = 53.87%], valid : [loss = 1.846, top1 = 50.48%], test : [loss = 1.891, top1 = 49.82%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.62 ms.
ImageNet16-120 train : [loss = 3.394, top1 = 20.06%], valid : [loss = 3.386, top1 = 20.30%], test : [loss = 3.413, top1 = 19.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10321/15625) 010321-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.481, top1 = 90.16%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.300, top1 = 93.19%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=17.77 ms.
cifar100       train : [loss = 0.097, top1 = 98.09%], valid : [loss = 1.256, top1 = 70.18%], test : [loss = 1.258, top1 = 71.02%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=26.10 ms.
ImageNet16-120 train : [loss = 1.727, top1 = 53.92%], valid : [loss = 2.176, top1 = 43.83%], test : [loss = 2.151, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.59%], valid : [loss = 0.859, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10322/15625) 010322-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10-valid  train : [loss = 1.263, top1 = 54.56%], valid : [loss = 1.306, top1 = 53.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10        train : [loss = 1.218, top1 = 56.31%], test  : [loss = 1.224, top1 = 55.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.54 ms.
cifar100       train : [loss = 2.772, top1 = 30.84%], valid : [loss = 2.860, top1 = 29.35%], test : [loss = 2.842, top1 = 29.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.67 ms.
ImageNet16-120 train : [loss = 3.905, top1 = 11.83%], valid : [loss = 3.911, top1 = 12.64%], test : [loss = 3.919, top1 = 11.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.737, top1 = 34.36%], valid : [loss = 1.720, top1 = 35.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10323/15625) 010323-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.518, top1 = 88.56%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.76 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.326, top1 = 92.34%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.62 ms.
cifar100       train : [loss = 0.354, top1 = 90.20%], valid : [loss = 1.304, top1 = 66.08%], test : [loss = 1.278, top1 = 67.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.20%], valid : [loss = 2.417, top1 = 39.07%], test : [loss = 2.412, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10324/15625) 010324-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.455, top1 = 90.20%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.297, top1 = 93.24%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.15 ms.
cifar100       train : [loss = 0.102, top1 = 98.27%], valid : [loss = 1.206, top1 = 70.54%], test : [loss = 1.242, top1 = 70.08%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 1.653, top1 = 55.44%], valid : [loss = 2.135, top1 = 44.67%], test : [loss = 2.139, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.06%], valid : [loss = 0.637, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10325/15625) 010325-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.11 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.557, top1 = 87.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.54 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.365, top1 = 90.87%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.25 ms.
cifar100       train : [loss = 0.642, top1 = 81.60%], valid : [loss = 1.457, top1 = 62.06%], test : [loss = 1.426, top1 = 62.92%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.506, top1 = 36.10%], valid : [loss = 2.601, top1 = 33.47%], test : [loss = 2.630, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.41%], valid : [loss = 0.972, top1 = 65.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10326/15625) 010326-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.543, top1 = 89.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.352, top1 = 92.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.59 ms.
cifar100       train : [loss = 0.081, top1 = 98.77%], valid : [loss = 1.449, top1 = 68.72%], test : [loss = 1.406, top1 = 69.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.52 ms.
ImageNet16-120 train : [loss = 1.735, top1 = 53.73%], valid : [loss = 2.371, top1 = 41.40%], test : [loss = 2.396, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.00%], valid : [loss = 0.663, top1 = 77.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10327/15625) 010327-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.64%], valid : [loss = 0.857, top1 = 75.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.313, top1 = 88.96%], test  : [loss = 0.622, top1 = 80.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.21 ms.
cifar100       train : [loss = 1.334, top1 = 62.67%], valid : [loss = 1.877, top1 = 51.44%], test : [loss = 1.917, top1 = 50.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 3.506, top1 = 17.09%], valid : [loss = 3.518, top1 = 16.90%], test : [loss = 3.527, top1 = 16.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.211, top1 = 56.25%], valid : [loss = 1.246, top1 = 54.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10328/15625) 010328-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.473, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.309, top1 = 92.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 0.320, top1 = 91.37%], valid : [loss = 1.236, top1 = 68.05%], test : [loss = 1.239, top1 = 68.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.66%], valid : [loss = 2.326, top1 = 40.89%], test : [loss = 2.337, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.59%], valid : [loss = 0.619, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10329/15625) 010329-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.501, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.25 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.321, top1 = 92.26%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.292, top1 = 92.41%], valid : [loss = 1.181, top1 = 68.94%], test : [loss = 1.199, top1 = 69.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.68 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.89%], valid : [loss = 2.230, top1 = 41.20%], test : [loss = 2.240, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.45%], valid : [loss = 0.715, top1 = 75.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10330/15625) 010330-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.40%], valid : [loss = 0.846, top1 = 71.44%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.74 ms.
cifar10        train : [loss = 0.657, top1 = 77.10%], test  : [loss = 0.744, top1 = 74.24%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 1.971, top1 = 47.52%], valid : [loss = 2.130, top1 = 44.96%], test : [loss = 2.164, top1 = 43.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.72%], valid : [loss = 3.667, top1 = 16.43%], test : [loss = 3.702, top1 = 14.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10331/15625) 010331-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.478, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.324, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.243, top1 = 94.03%], valid : [loss = 1.243, top1 = 68.54%], test : [loss = 1.266, top1 = 68.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.52%], valid : [loss = 2.255, top1 = 42.70%], test : [loss = 2.285, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10332/15625) 010332-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.473, top1 = 89.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.71%], test  : [loss = 0.317, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 0.328, top1 = 91.12%], valid : [loss = 1.343, top1 = 66.80%], test : [loss = 1.319, top1 = 66.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.05 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.40%], valid : [loss = 2.398, top1 = 38.80%], test : [loss = 2.395, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10333/15625) 010333-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.18%], valid : [loss = 0.623, top1 = 85.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.403, top1 = 88.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.715, top1 = 79.23%], valid : [loss = 1.419, top1 = 62.88%], test : [loss = 1.389, top1 = 63.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.77%], valid : [loss = 2.657, top1 = 33.80%], test : [loss = 2.701, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.18%], valid : [loss = 0.787, top1 = 72.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10334/15625) 010334-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.466, top1 = 89.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10        train : [loss = 0.012, top1 = 99.84%], test  : [loss = 0.319, top1 = 92.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 0.320, top1 = 91.44%], valid : [loss = 1.285, top1 = 67.42%], test : [loss = 1.226, top1 = 68.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.62%], valid : [loss = 2.346, top1 = 40.77%], test : [loss = 2.365, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10335/15625) 010335-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.451, top1 = 90.55%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.87 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.308, top1 = 93.48%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.89 ms.
cifar100       train : [loss = 0.060, top1 = 99.13%], valid : [loss = 1.366, top1 = 70.34%], test : [loss = 1.332, top1 = 71.32%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 1.517, top1 = 58.95%], valid : [loss = 2.185, top1 = 45.13%], test : [loss = 2.200, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.406, top1 = 86.14%], valid : [loss = 0.530, top1 = 82.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10336/15625) 010336-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.00%], valid : [loss = 0.571, top1 = 86.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.93 ms.
cifar10        train : [loss = 0.063, top1 = 97.99%], test  : [loss = 0.368, top1 = 90.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.00 ms.
cifar100       train : [loss = 0.649, top1 = 80.87%], valid : [loss = 1.324, top1 = 64.54%], test : [loss = 1.325, top1 = 64.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.27%], valid : [loss = 2.502, top1 = 36.03%], test : [loss = 2.535, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10337/15625) 010337-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.445, top1 = 91.06%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.77 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.277, top1 = 94.03%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.91 ms.
cifar100       train : [loss = 0.033, top1 = 99.70%], valid : [loss = 1.313, top1 = 71.54%], test : [loss = 1.312, top1 = 71.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 1.320, top1 = 63.83%], valid : [loss = 2.272, top1 = 44.07%], test : [loss = 2.243, top1 = 45.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.90%], valid : [loss = 0.481, top1 = 84.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10338/15625) 010338-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.80%], valid : [loss = 0.838, top1 = 71.70%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10        train : [loss = 0.673, top1 = 76.63%], test  : [loss = 0.757, top1 = 74.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.30 ms.
cifar100       train : [loss = 1.969, top1 = 47.52%], valid : [loss = 2.137, top1 = 45.04%], test : [loss = 2.148, top1 = 44.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.05 ms.
ImageNet16-120 train : [loss = 3.653, top1 = 15.82%], valid : [loss = 3.682, top1 = 15.47%], test : [loss = 3.697, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10339/15625) 010339-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.84%], valid : [loss = 0.718, top1 = 83.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10        train : [loss = 0.086, top1 = 97.29%], test  : [loss = 0.464, top1 = 87.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.73 ms.
cifar100       train : [loss = 0.833, top1 = 75.60%], valid : [loss = 1.516, top1 = 60.54%], test : [loss = 1.531, top1 = 59.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 2.818, top1 = 30.20%], valid : [loss = 2.943, top1 = 28.17%], test : [loss = 3.023, top1 = 26.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.31%], valid : [loss = 0.851, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10340/15625) 010340-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.32%], valid : [loss = 0.466, top1 = 86.04%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.68 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.349, top1 = 88.99%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=17.63 ms.
cifar100       train : [loss = 1.011, top1 = 71.37%], valid : [loss = 1.352, top1 = 61.91%], test : [loss = 1.360, top1 = 61.78%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.68%], valid : [loss = 2.697, top1 = 32.54%], test : [loss = 2.714, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10341/15625) 010341-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.56%], valid : [loss = 0.533, top1 = 82.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.396, top1 = 86.49%], test  : [loss = 0.461, top1 = 84.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.66 ms.
cifar100       train : [loss = 1.533, top1 = 57.65%], valid : [loss = 1.650, top1 = 54.14%], test : [loss = 1.659, top1 = 55.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.87%], valid : [loss = 3.011, top1 = 27.17%], test : [loss = 3.066, top1 = 26.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.54%], valid : [loss = 1.147, top1 = 59.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10342/15625) 010342-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.48%], valid : [loss = 0.570, top1 = 87.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.25 ms.
cifar10        train : [loss = 0.036, top1 = 98.92%], test  : [loss = 0.375, top1 = 90.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.474, top1 = 86.31%], valid : [loss = 1.304, top1 = 65.40%], test : [loss = 1.327, top1 = 65.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.32%], valid : [loss = 2.614, top1 = 32.83%], test : [loss = 2.640, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.45%], valid : [loss = 0.868, top1 = 69.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10343/15625) 010343-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.60%], valid : [loss = 0.552, top1 = 87.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.08 ms.
cifar10        train : [loss = 0.034, top1 = 98.99%], test  : [loss = 0.358, top1 = 91.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.95 ms.
cifar100       train : [loss = 0.518, top1 = 85.32%], valid : [loss = 1.339, top1 = 64.40%], test : [loss = 1.304, top1 = 64.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.509, top1 = 36.11%], valid : [loss = 2.635, top1 = 33.40%], test : [loss = 2.669, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.80%], valid : [loss = 0.906, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10344/15625) 010344-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.27%], valid : [loss = 0.459, top1 = 86.69%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.31 ms.
cifar10        train : [loss = 0.118, top1 = 96.36%], test  : [loss = 0.332, top1 = 89.40%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.57 ms.
cifar100       train : [loss = 0.747, top1 = 79.11%], valid : [loss = 1.284, top1 = 64.52%], test : [loss = 1.279, top1 = 64.52%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 37.13%], valid : [loss = 2.592, top1 = 34.67%], test : [loss = 2.607, top1 = 34.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 71.81%], valid : [loss = 0.838, top1 = 70.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10345/15625) 010345-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.98%], valid : [loss = 0.604, top1 = 85.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.076, top1 = 97.66%], test  : [loss = 0.403, top1 = 88.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 0.730, top1 = 78.62%], valid : [loss = 1.371, top1 = 63.68%], test : [loss = 1.355, top1 = 63.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.06%], valid : [loss = 2.659, top1 = 33.50%], test : [loss = 2.737, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.24%], valid : [loss = 0.786, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10346/15625) 010346-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.533, top1 = 88.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.337, top1 = 91.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.73 ms.
cifar100       train : [loss = 0.328, top1 = 90.89%], valid : [loss = 1.292, top1 = 66.92%], test : [loss = 1.301, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.69%], valid : [loss = 2.433, top1 = 38.00%], test : [loss = 2.422, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.43%], valid : [loss = 0.802, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10347/15625) 010347-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.70%], valid : [loss = 0.572, top1 = 87.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.373, top1 = 91.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.17 ms.
cifar100       train : [loss = 0.298, top1 = 91.73%], valid : [loss = 1.356, top1 = 67.10%], test : [loss = 1.334, top1 = 67.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.77%], valid : [loss = 2.493, top1 = 37.90%], test : [loss = 2.492, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.948, top1 = 65.96%], valid : [loss = 0.977, top1 = 64.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10348/15625) 010348-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.610, top1 = 87.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.398, top1 = 91.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.50 ms.
cifar100       train : [loss = 0.168, top1 = 96.09%], valid : [loss = 1.559, top1 = 64.82%], test : [loss = 1.548, top1 = 65.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.27%], valid : [loss = 2.387, top1 = 39.33%], test : [loss = 2.442, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 75.82%], valid : [loss = 0.765, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10349/15625) 010349-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.41%], valid : [loss = 0.526, top1 = 83.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.74 ms.
cifar10        train : [loss = 0.235, top1 = 91.98%], test  : [loss = 0.386, top1 = 87.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.91 ms.
cifar100       train : [loss = 1.341, top1 = 62.24%], valid : [loss = 1.605, top1 = 56.75%], test : [loss = 1.591, top1 = 56.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.851, top1 = 29.71%], valid : [loss = 2.853, top1 = 29.58%], test : [loss = 2.912, top1 = 28.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.28%], valid : [loss = 1.035, top1 = 63.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10350/15625) 010350-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.616, top1 = 87.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.393, top1 = 91.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.04 ms.
cifar100       train : [loss = 0.206, top1 = 95.05%], valid : [loss = 1.553, top1 = 65.44%], test : [loss = 1.568, top1 = 64.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.023, top1 = 46.98%], valid : [loss = 2.449, top1 = 38.33%], test : [loss = 2.482, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.19%], valid : [loss = 0.823, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10351/15625) 010351-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.035, top1 = 98.92%], valid : [loss = 0.568, top1 = 86.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.44 ms.
cifar10        train : [loss = 0.060, top1 = 98.06%], test  : [loss = 0.360, top1 = 90.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.43 ms.
cifar100       train : [loss = 0.653, top1 = 80.73%], valid : [loss = 1.311, top1 = 64.66%], test : [loss = 1.318, top1 = 64.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 2.415, top1 = 38.38%], valid : [loss = 2.550, top1 = 35.60%], test : [loss = 2.564, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10352/15625) 010352-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.596, top1 = 86.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.366, top1 = 91.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.56 ms.
cifar100       train : [loss = 0.351, top1 = 90.23%], valid : [loss = 1.414, top1 = 65.26%], test : [loss = 1.446, top1 = 65.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.38%], valid : [loss = 2.463, top1 = 38.20%], test : [loss = 2.490, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.44%], valid : [loss = 0.850, top1 = 69.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10353/15625) 010353-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.576, top1 = 88.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.364, top1 = 92.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.09 ms.
cifar100       train : [loss = 0.119, top1 = 97.59%], valid : [loss = 1.540, top1 = 67.00%], test : [loss = 1.535, top1 = 66.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 48.03%], valid : [loss = 2.436, top1 = 39.27%], test : [loss = 2.436, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.02%], valid : [loss = 0.735, top1 = 74.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10354/15625) 010354-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.39 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.27%], valid : [loss = 0.700, top1 = 83.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.11 ms.
cifar10        train : [loss = 0.063, top1 = 98.03%], test  : [loss = 0.472, top1 = 87.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 0.667, top1 = 80.50%], valid : [loss = 1.518, top1 = 61.00%], test : [loss = 1.525, top1 = 61.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.86 ms.
ImageNet16-120 train : [loss = 2.703, top1 = 32.61%], valid : [loss = 2.856, top1 = 29.23%], test : [loss = 2.882, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.35%], valid : [loss = 0.911, top1 = 68.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10355/15625) 010355-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.575, top1 = 87.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.357, top1 = 91.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.99 ms.
cifar100       train : [loss = 0.214, top1 = 94.15%], valid : [loss = 1.364, top1 = 67.52%], test : [loss = 1.373, top1 = 66.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 36.45%], valid : [loss = 2.619, top1 = 33.57%], test : [loss = 2.631, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.49%], valid : [loss = 0.970, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10356/15625) 010356-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.543, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.309, top1 = 92.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.77 ms.
cifar100       train : [loss = 0.169, top1 = 96.07%], valid : [loss = 1.282, top1 = 68.86%], test : [loss = 1.341, top1 = 68.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.73%], valid : [loss = 2.242, top1 = 42.67%], test : [loss = 2.239, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 78.05%], valid : [loss = 0.688, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10357/15625) 010357-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.18 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.14%], valid : [loss = 0.651, top1 = 78.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.39 ms.
cifar10        train : [loss = 0.504, top1 = 82.54%], test  : [loss = 0.575, top1 = 80.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.04 ms.
cifar100       train : [loss = 1.692, top1 = 54.34%], valid : [loss = 1.870, top1 = 50.94%], test : [loss = 1.872, top1 = 50.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.71 ms.
ImageNet16-120 train : [loss = 3.318, top1 = 21.44%], valid : [loss = 3.291, top1 = 21.77%], test : [loss = 3.343, top1 = 21.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10358/15625) 010358-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.091, top1 = 97.38%], valid : [loss = 0.467, top1 = 86.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.08 ms.
cifar10        train : [loss = 0.137, top1 = 95.62%], test  : [loss = 0.341, top1 = 89.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.64 ms.
cifar100       train : [loss = 0.781, top1 = 77.79%], valid : [loss = 1.299, top1 = 63.76%], test : [loss = 1.291, top1 = 64.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.15 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 37.11%], valid : [loss = 2.568, top1 = 35.03%], test : [loss = 2.601, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.44%], valid : [loss = 0.881, top1 = 68.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10359/15625) 010359-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.46 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.535, top1 = 89.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.79 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.354, top1 = 92.56%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.55 ms.
cifar100       train : [loss = 0.045, top1 = 99.45%], valid : [loss = 1.479, top1 = 68.60%], test : [loss = 1.415, top1 = 69.88%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.38%], valid : [loss = 2.390, top1 = 41.27%], test : [loss = 2.427, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.79%], valid : [loss = 0.694, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10360/15625) 010360-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.001, top1 = 100.00%], valid : [loss = 0.425, top1 = 91.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.02 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.296, top1 = 93.66%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.51 ms.
cifar100       train : [loss = 0.036, top1 = 99.64%], valid : [loss = 1.353, top1 = 71.02%], test : [loss = 1.300, top1 = 71.38%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.39 ms.
ImageNet16-120 train : [loss = 1.381, top1 = 62.19%], valid : [loss = 2.201, top1 = 45.23%], test : [loss = 2.199, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.346, top1 = 87.98%], valid : [loss = 0.477, top1 = 84.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10361/15625) 010361-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.44%], valid : [loss = 0.479, top1 = 85.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10        train : [loss = 0.155, top1 = 94.93%], test  : [loss = 0.356, top1 = 88.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 1.001, top1 = 71.74%], valid : [loss = 1.363, top1 = 61.64%], test : [loss = 1.333, top1 = 62.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.16 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.68%], valid : [loss = 2.670, top1 = 32.80%], test : [loss = 2.700, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.22%], valid : [loss = 0.782, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10362/15625) 010362-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.51%], valid : [loss = 0.526, top1 = 84.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.169, top1 = 94.27%], test  : [loss = 0.385, top1 = 87.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 1.116, top1 = 67.99%], valid : [loss = 1.479, top1 = 58.62%], test : [loss = 1.469, top1 = 59.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 35.94%], valid : [loss = 2.604, top1 = 34.30%], test : [loss = 2.629, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.65%], valid : [loss = 0.967, top1 = 66.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10363/15625) 010363-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.34%], valid : [loss = 0.525, top1 = 87.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10        train : [loss = 0.054, top1 = 98.40%], test  : [loss = 0.362, top1 = 90.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.629, top1 = 81.55%], valid : [loss = 1.338, top1 = 65.02%], test : [loss = 1.313, top1 = 65.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.48%], valid : [loss = 2.509, top1 = 36.54%], test : [loss = 2.545, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.79%], valid : [loss = 0.611, top1 = 79.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10364/15625) 010364-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.70%], valid : [loss = 0.848, top1 = 79.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.81 ms.
cifar10        train : [loss = 0.138, top1 = 95.34%], test  : [loss = 0.569, top1 = 84.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.62 ms.
cifar100       train : [loss = 0.890, top1 = 74.14%], valid : [loss = 1.703, top1 = 56.98%], test : [loss = 1.693, top1 = 57.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 3.044, top1 = 26.24%], valid : [loss = 3.185, top1 = 23.80%], test : [loss = 3.236, top1 = 23.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.40%], valid : [loss = 1.090, top1 = 61.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10365/15625) 010365-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.67%], valid : [loss = 0.567, top1 = 87.35%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.07 ms.
cifar10        train : [loss = 0.025, top1 = 99.23%], test  : [loss = 0.348, top1 = 91.44%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.42 ms.
cifar100       train : [loss = 0.403, top1 = 88.29%], valid : [loss = 1.287, top1 = 66.98%], test : [loss = 1.323, top1 = 66.50%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 2.202, top1 = 42.93%], valid : [loss = 2.412, top1 = 38.67%], test : [loss = 2.432, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.13%], valid : [loss = 0.950, top1 = 65.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10366/15625) 010366-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=11.68 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.15%], valid : [loss = 0.541, top1 = 86.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.072, top1 = 97.77%], test  : [loss = 0.369, top1 = 89.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.05 ms.
cifar100       train : [loss = 0.709, top1 = 79.10%], valid : [loss = 1.312, top1 = 64.60%], test : [loss = 1.333, top1 = 64.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.54%], valid : [loss = 2.632, top1 = 33.87%], test : [loss = 2.641, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.16%], valid : [loss = 0.713, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10367/15625) 010367-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.61%], valid : [loss = 0.858, top1 = 71.61%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10        train : [loss = 0.565, top1 = 80.14%], test  : [loss = 0.713, top1 = 75.70%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.87 ms.
cifar100       train : [loss = 1.793, top1 = 51.67%], valid : [loss = 2.065, top1 = 46.84%], test : [loss = 2.068, top1 = 46.58%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.37 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.75%], valid : [loss = 3.637, top1 = 16.63%], test : [loss = 3.660, top1 = 16.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10368/15625) 010368-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.25 ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.85%], valid : [loss = 0.655, top1 = 78.01%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.04 ms.
cifar10        train : [loss = 0.513, top1 = 82.19%], test  : [loss = 0.600, top1 = 79.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.99 ms.
cifar100       train : [loss = 1.692, top1 = 54.15%], valid : [loss = 1.849, top1 = 50.55%], test : [loss = 1.858, top1 = 50.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.29%], valid : [loss = 3.304, top1 = 21.51%], test : [loss = 3.339, top1 = 21.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10369/15625) 010369-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.425 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.469, top1 = 89.27%]
cifar10        FLOP= 58.90 M, Params=0.425 MB, latency=17.37 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.309, top1 = 92.41%]
cifar100       FLOP= 58.91 M, Params=0.431 MB, latency=17.67 ms.
cifar100       train : [loss = 0.323, top1 = 91.35%], valid : [loss = 1.256, top1 = 67.72%], test : [loss = 1.247, top1 = 68.13%]
ImageNet16-120 FLOP= 14.73 M, Params=0.433 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.68%], valid : [loss = 2.312, top1 = 40.64%], test : [loss = 2.327, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10370/15625) 010370-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.423, top1 = 90.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.293, top1 = 93.71%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.24 ms.
cifar100       train : [loss = 0.065, top1 = 99.08%], valid : [loss = 1.316, top1 = 70.32%], test : [loss = 1.333, top1 = 70.20%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 1.552, top1 = 58.06%], valid : [loss = 2.229, top1 = 43.77%], test : [loss = 2.247, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.67%], valid : [loss = 0.520, top1 = 82.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10371/15625) 010371-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.03%], valid : [loss = 0.857, top1 = 71.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.34 ms.
cifar10        train : [loss = 0.562, top1 = 80.43%], test  : [loss = 0.714, top1 = 75.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.19 ms.
cifar100       train : [loss = 1.769, top1 = 52.35%], valid : [loss = 2.042, top1 = 47.94%], test : [loss = 2.066, top1 = 46.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.83%], valid : [loss = 3.640, top1 = 16.03%], test : [loss = 3.671, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10372/15625) 010372-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.579, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.37 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.383, top1 = 91.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.59 ms.
cifar100       train : [loss = 0.379, top1 = 89.28%], valid : [loss = 1.416, top1 = 65.13%], test : [loss = 1.399, top1 = 65.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.63%], valid : [loss = 2.481, top1 = 37.08%], test : [loss = 2.514, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 73.09%], valid : [loss = 0.828, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10373/15625) 010373-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.23%], valid : [loss = 0.552, top1 = 83.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10        train : [loss = 0.188, top1 = 93.67%], test  : [loss = 0.393, top1 = 87.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.13 ms.
cifar100       train : [loss = 1.188, top1 = 66.07%], valid : [loss = 1.518, top1 = 58.78%], test : [loss = 1.520, top1 = 58.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.64%], valid : [loss = 2.693, top1 = 32.48%], test : [loss = 2.725, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.67%], valid : [loss = 0.982, top1 = 65.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10374/15625) 010374-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.16%], valid : [loss = 0.460, top1 = 86.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10        train : [loss = 0.113, top1 = 96.52%], test  : [loss = 0.331, top1 = 89.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.77 ms.
cifar100       train : [loss = 0.857, top1 = 75.77%], valid : [loss = 1.283, top1 = 64.22%], test : [loss = 1.294, top1 = 63.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.66%], valid : [loss = 2.632, top1 = 34.83%], test : [loss = 2.650, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.99%], valid : [loss = 0.651, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10375/15625) 010375-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.513, top1 = 90.03%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.48 ms.
cifar10        train : [loss = 0.002, top1 = 99.96%], test  : [loss = 0.347, top1 = 93.06%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.88 ms.
cifar100       train : [loss = 0.026, top1 = 99.85%], valid : [loss = 1.410, top1 = 70.22%], test : [loss = 1.368, top1 = 70.58%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.65 ms.
ImageNet16-120 train : [loss = 1.462, top1 = 60.30%], valid : [loss = 2.415, top1 = 40.80%], test : [loss = 2.400, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.48%], valid : [loss = 0.665, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10376/15625) 010376-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.69%], valid : [loss = 0.705, top1 = 80.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.198, top1 = 93.25%], test  : [loss = 0.507, top1 = 84.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 0.921, top1 = 73.16%], valid : [loss = 1.668, top1 = 57.06%], test : [loss = 1.645, top1 = 57.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 3.547, top1 = 16.07%], valid : [loss = 3.551, top1 = 15.93%], test : [loss = 3.545, top1 = 16.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 53.76%], valid : [loss = 1.278, top1 = 53.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10377/15625) 010377-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.607, top1 = 87.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.392, top1 = 91.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.22 ms.
cifar100       train : [loss = 0.209, top1 = 95.04%], valid : [loss = 1.419, top1 = 66.74%], test : [loss = 1.439, top1 = 66.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.77%], valid : [loss = 2.504, top1 = 38.17%], test : [loss = 2.515, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10378/15625) 010378-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.10%], valid : [loss = 0.727, top1 = 79.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.214, top1 = 92.55%], test  : [loss = 0.501, top1 = 84.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.29 ms.
cifar100       train : [loss = 0.885, top1 = 74.34%], valid : [loss = 1.631, top1 = 57.12%], test : [loss = 1.671, top1 = 56.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 3.467, top1 = 17.51%], valid : [loss = 3.477, top1 = 17.63%], test : [loss = 3.486, top1 = 17.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10379/15625) 010379-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.580, top1 = 87.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.06 ms.
cifar10        train : [loss = 0.031, top1 = 99.06%], test  : [loss = 0.387, top1 = 90.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.50 ms.
cifar100       train : [loss = 0.387, top1 = 88.93%], valid : [loss = 1.344, top1 = 66.22%], test : [loss = 1.363, top1 = 65.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.82%], valid : [loss = 2.424, top1 = 38.70%], test : [loss = 2.438, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 65.39%], valid : [loss = 0.989, top1 = 64.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10380/15625) 010380-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.38%], valid : [loss = 0.565, top1 = 87.27%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.53 ms.
cifar10        train : [loss = 0.035, top1 = 98.97%], test  : [loss = 0.367, top1 = 91.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.49 ms.
cifar100       train : [loss = 0.587, top1 = 82.96%], valid : [loss = 1.383, top1 = 63.92%], test : [loss = 1.343, top1 = 64.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.08%], valid : [loss = 2.610, top1 = 34.00%], test : [loss = 2.647, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.097, top1 = 60.46%], valid : [loss = 1.109, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10381/15625) 010381-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.590, top1 = 88.19%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.417, top1 = 90.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.74 ms.
cifar100       train : [loss = 0.146, top1 = 96.85%], valid : [loss = 1.582, top1 = 65.64%], test : [loss = 1.541, top1 = 65.74%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.66%], valid : [loss = 2.454, top1 = 38.43%], test : [loss = 2.493, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.40%], valid : [loss = 0.785, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10382/15625) 010382-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.41%], valid : [loss = 0.433, top1 = 88.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10        train : [loss = 0.058, top1 = 98.61%], test  : [loss = 0.325, top1 = 90.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.53 ms.
cifar100       train : [loss = 0.589, top1 = 83.81%], valid : [loss = 1.214, top1 = 66.48%], test : [loss = 1.205, top1 = 67.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 41.14%], valid : [loss = 2.458, top1 = 38.47%], test : [loss = 2.498, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10383/15625) 010383-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.470, top1 = 89.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.312, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.39 ms.
cifar100       train : [loss = 0.334, top1 = 90.97%], valid : [loss = 1.293, top1 = 67.82%], test : [loss = 1.293, top1 = 67.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.13%], valid : [loss = 2.341, top1 = 40.10%], test : [loss = 2.381, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.93%], valid : [loss = 0.518, top1 = 82.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10384/15625) 010384-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.067, top1 = 97.90%], valid : [loss = 0.582, top1 = 85.79%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.84 ms.
cifar10        train : [loss = 0.109, top1 = 96.29%], test  : [loss = 0.407, top1 = 88.85%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.23 ms.
cifar100       train : [loss = 0.783, top1 = 76.98%], valid : [loss = 1.433, top1 = 61.92%], test : [loss = 1.431, top1 = 61.48%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.589, top1 = 34.51%], valid : [loss = 2.676, top1 = 32.73%], test : [loss = 2.708, top1 = 31.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.101, top1 = 60.23%], valid : [loss = 1.121, top1 = 59.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10385/15625) 010385-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.562, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.42 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.376, top1 = 92.15%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.10 ms.
cifar100       train : [loss = 0.103, top1 = 98.08%], valid : [loss = 1.489, top1 = 67.32%], test : [loss = 1.438, top1 = 67.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.73 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.74%], valid : [loss = 2.399, top1 = 40.23%], test : [loss = 2.440, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 78.84%], valid : [loss = 0.703, top1 = 75.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10386/15625) 010386-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.75%], valid : [loss = 0.781, top1 = 78.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.75 ms.
cifar10        train : [loss = 0.180, top1 = 93.91%], test  : [loss = 0.508, top1 = 84.67%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.06 ms.
cifar100       train : [loss = 0.851, top1 = 74.94%], valid : [loss = 1.614, top1 = 57.62%], test : [loss = 1.621, top1 = 56.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 3.518, top1 = 16.70%], valid : [loss = 3.508, top1 = 16.97%], test : [loss = 3.516, top1 = 16.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.261, top1 = 53.94%], valid : [loss = 1.289, top1 = 53.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10387/15625) 010387-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.67%], valid : [loss = 0.718, top1 = 76.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.52 ms.
cifar10        train : [loss = 0.444, top1 = 84.64%], test  : [loss = 0.558, top1 = 81.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 1.726, top1 = 52.74%], valid : [loss = 1.967, top1 = 47.92%], test : [loss = 1.956, top1 = 49.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 3.380, top1 = 19.98%], valid : [loss = 3.399, top1 = 20.90%], test : [loss = 3.411, top1 = 19.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.186, top1 = 57.01%], valid : [loss = 1.240, top1 = 55.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10388/15625) 010388-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.541, top1 = 88.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.356, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.01 ms.
cifar100       train : [loss = 0.253, top1 = 93.19%], valid : [loss = 1.302, top1 = 67.40%], test : [loss = 1.247, top1 = 68.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.28%], valid : [loss = 2.411, top1 = 38.50%], test : [loss = 2.435, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.921, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10389/15625) 010389-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.502, top1 = 89.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.318, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.08 ms.
cifar100       train : [loss = 0.155, top1 = 96.85%], valid : [loss = 1.333, top1 = 68.90%], test : [loss = 1.333, top1 = 68.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.01 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.73%], valid : [loss = 2.266, top1 = 42.60%], test : [loss = 2.310, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.56%], valid : [loss = 0.727, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10390/15625) 010390-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.34%], valid : [loss = 0.611, top1 = 85.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.83 ms.
cifar10        train : [loss = 0.077, top1 = 97.60%], test  : [loss = 0.393, top1 = 89.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.54 ms.
cifar100       train : [loss = 0.734, top1 = 78.80%], valid : [loss = 1.433, top1 = 62.18%], test : [loss = 1.409, top1 = 62.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 36.07%], valid : [loss = 2.646, top1 = 34.33%], test : [loss = 2.679, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10391/15625) 010391-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.566, top1 = 87.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.040, top1 = 98.84%], test  : [loss = 0.349, top1 = 90.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.26 ms.
cifar100       train : [loss = 0.502, top1 = 85.64%], valid : [loss = 1.301, top1 = 65.02%], test : [loss = 1.332, top1 = 64.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.43%], valid : [loss = 2.621, top1 = 34.17%], test : [loss = 2.653, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10392/15625) 010392-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.501, top1 = 88.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.19 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.365, top1 = 91.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.92 ms.
cifar100       train : [loss = 0.487, top1 = 85.71%], valid : [loss = 1.313, top1 = 65.48%], test : [loss = 1.342, top1 = 65.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.30%], valid : [loss = 2.522, top1 = 36.43%], test : [loss = 2.554, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.96%], valid : [loss = 0.663, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10393/15625) 010393-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.599, top1 = 86.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.46 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.379, top1 = 91.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.330, top1 = 90.76%], valid : [loss = 1.394, top1 = 65.96%], test : [loss = 1.423, top1 = 65.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.58%], valid : [loss = 2.457, top1 = 38.27%], test : [loss = 2.487, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.10%], valid : [loss = 0.865, top1 = 69.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10394/15625) 010394-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.55%], valid : [loss = 0.626, top1 = 86.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.383, top1 = 90.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.84 ms.
cifar100       train : [loss = 0.526, top1 = 84.61%], valid : [loss = 1.435, top1 = 63.26%], test : [loss = 1.440, top1 = 63.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.30%], valid : [loss = 2.522, top1 = 36.83%], test : [loss = 2.576, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.47%], valid : [loss = 0.886, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10395/15625) 010395-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.486, top1 = 89.70%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.302, top1 = 93.26%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.82 ms.
cifar100       train : [loss = 0.131, top1 = 97.39%], valid : [loss = 1.269, top1 = 68.90%], test : [loss = 1.267, top1 = 69.34%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.16 ms.
ImageNet16-120 train : [loss = 1.695, top1 = 54.75%], valid : [loss = 2.162, top1 = 44.47%], test : [loss = 2.159, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.51%], valid : [loss = 0.583, top1 = 79.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10396/15625) 010396-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.442, top1 = 89.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.317, top1 = 91.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.67 ms.
cifar100       train : [loss = 0.321, top1 = 91.33%], valid : [loss = 1.295, top1 = 67.70%], test : [loss = 1.306, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.16%], valid : [loss = 2.382, top1 = 39.23%], test : [loss = 2.397, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.46%], valid : [loss = 0.555, top1 = 80.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10397/15625) 010397-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.618, top1 = 86.74%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.63 ms.
cifar10        train : [loss = 0.016, top1 = 99.69%], test  : [loss = 0.410, top1 = 90.34%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.16 ms.
cifar100       train : [loss = 0.154, top1 = 97.24%], valid : [loss = 1.446, top1 = 67.28%], test : [loss = 1.449, top1 = 66.42%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.65%], valid : [loss = 2.552, top1 = 37.30%], test : [loss = 2.595, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.21%], valid : [loss = 0.770, top1 = 73.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10398/15625) 010398-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.84%], valid : [loss = 0.726, top1 = 83.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10        train : [loss = 0.087, top1 = 97.14%], test  : [loss = 0.503, top1 = 86.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.39 ms.
cifar100       train : [loss = 0.817, top1 = 76.31%], valid : [loss = 1.556, top1 = 60.10%], test : [loss = 1.534, top1 = 60.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.834, top1 = 29.91%], valid : [loss = 2.957, top1 = 28.37%], test : [loss = 2.983, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.95%], valid : [loss = 0.863, top1 = 70.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10399/15625) 010399-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.81%], valid : [loss = 0.853, top1 = 77.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10        train : [loss = 0.180, top1 = 93.74%], test  : [loss = 0.532, top1 = 84.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.75 ms.
cifar100       train : [loss = 1.079, top1 = 68.99%], valid : [loss = 1.803, top1 = 53.60%], test : [loss = 1.818, top1 = 54.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 3.127, top1 = 24.73%], valid : [loss = 3.251, top1 = 22.57%], test : [loss = 3.268, top1 = 22.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 57.75%], valid : [loss = 1.214, top1 = 56.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10400/15625) 010400-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.489, top1 = 90.28%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=23.30 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.297, top1 = 93.53%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.50 ms.
cifar100       train : [loss = 0.070, top1 = 98.91%], valid : [loss = 1.278, top1 = 70.62%], test : [loss = 1.293, top1 = 70.78%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=23.43 ms.
ImageNet16-120 train : [loss = 1.609, top1 = 56.62%], valid : [loss = 2.115, top1 = 46.10%], test : [loss = 2.106, top1 = 46.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.12%], valid : [loss = 0.648, top1 = 77.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10401/15625) 010401-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.873, top1 = 70.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.71 ms.
cifar10        train : [loss = 0.681, top1 = 76.06%], test  : [loss = 0.767, top1 = 73.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 1.990, top1 = 47.24%], valid : [loss = 2.128, top1 = 44.88%], test : [loss = 2.173, top1 = 43.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.24 ms.
ImageNet16-120 train : [loss = 3.662, top1 = 15.49%], valid : [loss = 3.690, top1 = 15.63%], test : [loss = 3.690, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10402/15625) 010402-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.630, top1 = 87.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.53 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.450, top1 = 89.93%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.07 ms.
cifar100       train : [loss = 0.226, top1 = 94.44%], valid : [loss = 1.533, top1 = 64.00%], test : [loss = 1.551, top1 = 64.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.96%], valid : [loss = 2.562, top1 = 36.83%], test : [loss = 2.592, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.54%], valid : [loss = 0.798, top1 = 72.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10403/15625) 010403-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.72 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.02%], valid : [loss = 0.479, top1 = 84.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.48 ms.
cifar10        train : [loss = 0.297, top1 = 90.13%], test  : [loss = 0.398, top1 = 86.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.50 ms.
cifar100       train : [loss = 1.331, top1 = 62.96%], valid : [loss = 1.547, top1 = 58.34%], test : [loss = 1.519, top1 = 58.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.26 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.54%], valid : [loss = 2.910, top1 = 29.23%], test : [loss = 2.963, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10404/15625) 010404-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.58%], valid : [loss = 0.716, top1 = 76.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10        train : [loss = 0.452, top1 = 84.26%], test  : [loss = 0.586, top1 = 80.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 1.786, top1 = 51.41%], valid : [loss = 1.973, top1 = 48.01%], test : [loss = 1.978, top1 = 47.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 3.467, top1 = 18.44%], valid : [loss = 3.465, top1 = 18.78%], test : [loss = 3.491, top1 = 17.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.232, top1 = 55.46%], valid : [loss = 1.274, top1 = 54.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10405/15625) 010405-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.14%], valid : [loss = 0.580, top1 = 86.68%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.56 ms.
cifar10        train : [loss = 0.051, top1 = 98.38%], test  : [loss = 0.383, top1 = 90.30%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.45 ms.
cifar100       train : [loss = 0.569, top1 = 83.34%], valid : [loss = 1.392, top1 = 63.52%], test : [loss = 1.379, top1 = 63.04%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.17%], valid : [loss = 2.440, top1 = 37.63%], test : [loss = 2.465, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 69.52%], valid : [loss = 0.921, top1 = 67.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10406/15625) 010406-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.580, top1 = 88.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.395, top1 = 91.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.47 ms.
cifar100       train : [loss = 0.181, top1 = 96.00%], valid : [loss = 1.456, top1 = 66.64%], test : [loss = 1.452, top1 = 66.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.70%], valid : [loss = 2.447, top1 = 39.27%], test : [loss = 2.482, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.36%], valid : [loss = 0.712, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10407/15625) 010407-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.33%], valid : [loss = 0.498, top1 = 84.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10        train : [loss = 0.174, top1 = 94.20%], test  : [loss = 0.376, top1 = 88.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.48 ms.
cifar100       train : [loss = 1.052, top1 = 69.82%], valid : [loss = 1.413, top1 = 60.82%], test : [loss = 1.405, top1 = 60.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.47%], valid : [loss = 2.651, top1 = 34.37%], test : [loss = 2.699, top1 = 33.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.44%], valid : [loss = 0.915, top1 = 67.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10408/15625) 010408-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.03 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.10%], valid : [loss = 0.720, top1 = 83.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.50 ms.
cifar10        train : [loss = 0.084, top1 = 97.33%], test  : [loss = 0.477, top1 = 87.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.61 ms.
cifar100       train : [loss = 0.795, top1 = 76.97%], valid : [loss = 1.511, top1 = 60.62%], test : [loss = 1.514, top1 = 60.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.841, top1 = 29.92%], valid : [loss = 2.960, top1 = 27.80%], test : [loss = 3.007, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10409/15625) 010409-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.570, top1 = 88.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.386, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.73 ms.
cifar100       train : [loss = 0.084, top1 = 98.56%], valid : [loss = 1.445, top1 = 68.44%], test : [loss = 1.425, top1 = 69.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.96%], valid : [loss = 2.463, top1 = 39.10%], test : [loss = 2.452, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.45%], valid : [loss = 0.706, top1 = 75.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10410/15625) 010410-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.59%], valid : [loss = 0.614, top1 = 85.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.43 ms.
cifar10        train : [loss = 0.050, top1 = 98.50%], test  : [loss = 0.422, top1 = 89.17%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.46 ms.
cifar100       train : [loss = 0.489, top1 = 85.86%], valid : [loss = 1.534, top1 = 62.28%], test : [loss = 1.489, top1 = 62.60%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 37.55%], valid : [loss = 2.718, top1 = 33.27%], test : [loss = 2.751, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.84%], valid : [loss = 0.693, top1 = 76.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10411/15625) 010411-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.537, top1 = 89.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.345, top1 = 92.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.11 ms.
cifar100       train : [loss = 0.132, top1 = 97.03%], valid : [loss = 1.367, top1 = 67.90%], test : [loss = 1.373, top1 = 68.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.59%], valid : [loss = 2.243, top1 = 42.83%], test : [loss = 2.280, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.22%], valid : [loss = 0.656, top1 = 77.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10412/15625) 010412-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.414, top1 = 90.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.275, top1 = 93.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.31 ms.
cifar100       train : [loss = 0.161, top1 = 96.33%], valid : [loss = 1.298, top1 = 69.12%], test : [loss = 1.269, top1 = 69.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.61%], valid : [loss = 2.230, top1 = 42.77%], test : [loss = 2.261, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.95%], valid : [loss = 0.508, top1 = 82.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10413/15625) 010413-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.542, top1 = 88.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.377, top1 = 91.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.08 ms.
cifar100       train : [loss = 0.393, top1 = 88.87%], valid : [loss = 1.379, top1 = 66.05%], test : [loss = 1.383, top1 = 65.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.78%], valid : [loss = 2.478, top1 = 37.77%], test : [loss = 2.500, top1 = 37.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.32%], valid : [loss = 0.770, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10414/15625) 010414-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.519, top1 = 89.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.337, top1 = 92.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.12 ms.
cifar100       train : [loss = 0.125, top1 = 97.38%], valid : [loss = 1.337, top1 = 68.67%], test : [loss = 1.332, top1 = 69.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.73%], valid : [loss = 2.329, top1 = 41.20%], test : [loss = 2.320, top1 = 41.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.14%], valid : [loss = 0.808, top1 = 71.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10415/15625) 010415-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.45 ms.
cifar10-valid  train : [loss = 0.312, top1 = 89.10%], valid : [loss = 0.556, top1 = 82.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.255, top1 = 91.31%], test  : [loss = 0.404, top1 = 86.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.32 ms.
cifar100       train : [loss = 1.532, top1 = 57.20%], valid : [loss = 1.769, top1 = 52.88%], test : [loss = 1.748, top1 = 53.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 2.968, top1 = 27.20%], valid : [loss = 2.981, top1 = 27.50%], test : [loss = 3.044, top1 = 25.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10416/15625) 010416-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.554, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.380, top1 = 91.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.59 ms.
cifar100       train : [loss = 0.203, top1 = 95.18%], valid : [loss = 1.432, top1 = 66.79%], test : [loss = 1.433, top1 = 66.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.68%], valid : [loss = 2.433, top1 = 39.30%], test : [loss = 2.432, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 78.15%], valid : [loss = 0.723, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10417/15625) 010417-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.60%], valid : [loss = 0.453, top1 = 86.64%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.17 ms.
cifar10        train : [loss = 0.131, top1 = 95.78%], test  : [loss = 0.356, top1 = 88.69%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.24 ms.
cifar100       train : [loss = 0.790, top1 = 77.78%], valid : [loss = 1.282, top1 = 65.14%], test : [loss = 1.304, top1 = 63.78%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.85%], valid : [loss = 2.562, top1 = 35.13%], test : [loss = 2.585, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.80%], valid : [loss = 0.890, top1 = 68.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10418/15625) 010418-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.85 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.611, top1 = 87.48%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.15 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.393, top1 = 91.38%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.63 ms.
cifar100       train : [loss = 0.171, top1 = 96.31%], valid : [loss = 1.544, top1 = 64.78%], test : [loss = 1.512, top1 = 66.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 2.015, top1 = 47.20%], valid : [loss = 2.472, top1 = 38.60%], test : [loss = 2.465, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 74.78%], valid : [loss = 0.787, top1 = 72.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10419/15625) 010419-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.318, top1 = 88.93%], valid : [loss = 0.586, top1 = 81.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10        train : [loss = 0.265, top1 = 90.88%], test  : [loss = 0.418, top1 = 86.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.24 ms.
cifar100       train : [loss = 1.487, top1 = 58.38%], valid : [loss = 1.735, top1 = 53.45%], test : [loss = 1.728, top1 = 52.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 27.95%], valid : [loss = 2.939, top1 = 27.72%], test : [loss = 3.006, top1 = 26.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10420/15625) 010420-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.142, top1 = 95.52%], valid : [loss = 0.543, top1 = 84.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.160, top1 = 94.69%], test  : [loss = 0.408, top1 = 87.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.16 ms.
cifar100       train : [loss = 0.972, top1 = 71.91%], valid : [loss = 1.478, top1 = 60.42%], test : [loss = 1.459, top1 = 60.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.806, top1 = 30.59%], valid : [loss = 2.843, top1 = 30.10%], test : [loss = 2.881, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 68.26%], valid : [loss = 0.947, top1 = 66.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10421/15625) 010421-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.72%], valid : [loss = 0.893, top1 = 76.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.80 ms.
cifar10        train : [loss = 0.187, top1 = 93.56%], test  : [loss = 0.583, top1 = 82.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.61 ms.
cifar100       train : [loss = 1.040, top1 = 70.17%], valid : [loss = 1.781, top1 = 54.06%], test : [loss = 1.802, top1 = 54.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 3.115, top1 = 24.94%], valid : [loss = 3.218, top1 = 23.77%], test : [loss = 3.266, top1 = 21.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.82%], valid : [loss = 1.198, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10422/15625) 010422-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.11 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.574, top1 = 88.24%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.97 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.385, top1 = 92.04%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.45 ms.
cifar100       train : [loss = 0.110, top1 = 98.08%], valid : [loss = 1.504, top1 = 66.66%], test : [loss = 1.487, top1 = 67.44%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.45 ms.
ImageNet16-120 train : [loss = 1.948, top1 = 48.87%], valid : [loss = 2.468, top1 = 38.23%], test : [loss = 2.461, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.08%], valid : [loss = 0.743, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10423/15625) 010423-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.90%], valid : [loss = 0.710, top1 = 80.87%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.175, top1 = 93.90%], test  : [loss = 0.496, top1 = 85.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=21.46 ms.
cifar100       train : [loss = 0.880, top1 = 74.40%], valid : [loss = 1.650, top1 = 57.30%], test : [loss = 1.659, top1 = 57.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.63 ms.
ImageNet16-120 train : [loss = 3.500, top1 = 16.75%], valid : [loss = 3.498, top1 = 17.30%], test : [loss = 3.512, top1 = 16.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.299, top1 = 52.15%], valid : [loss = 1.328, top1 = 51.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10424/15625) 010424-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.553, top1 = 88.47%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.15 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.350, top1 = 92.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.56 ms.
cifar100       train : [loss = 0.298, top1 = 91.62%], valid : [loss = 1.339, top1 = 67.46%], test : [loss = 1.347, top1 = 66.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.89%], valid : [loss = 2.427, top1 = 39.63%], test : [loss = 2.404, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.04%], valid : [loss = 0.869, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10425/15625) 010425-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.523, top1 = 89.07%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.62 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.317, top1 = 92.59%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.23 ms.
cifar100       train : [loss = 0.261, top1 = 93.16%], valid : [loss = 1.314, top1 = 66.68%], test : [loss = 1.306, top1 = 67.38%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 1.790, top1 = 52.36%], valid : [loss = 2.189, top1 = 44.03%], test : [loss = 2.204, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.70%], valid : [loss = 0.720, top1 = 74.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10426/15625) 010426-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.539, top1 = 88.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.351, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.309, top1 = 91.45%], valid : [loss = 1.269, top1 = 68.04%], test : [loss = 1.303, top1 = 67.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.57%], valid : [loss = 2.434, top1 = 38.07%], test : [loss = 2.435, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.10%], valid : [loss = 0.890, top1 = 68.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10427/15625) 010427-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.559, top1 = 87.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.380, top1 = 91.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.94 ms.
cifar100       train : [loss = 0.361, top1 = 89.98%], valid : [loss = 1.405, top1 = 65.15%], test : [loss = 1.410, top1 = 65.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.281, top1 = 41.40%], valid : [loss = 2.496, top1 = 37.25%], test : [loss = 2.517, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.10%], valid : [loss = 0.770, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10428/15625) 010428-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.510, top1 = 89.76%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 93.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.94 ms.
cifar100       train : [loss = 0.099, top1 = 98.19%], valid : [loss = 1.336, top1 = 69.56%], test : [loss = 1.362, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.18 ms.
ImageNet16-120 train : [loss = 1.608, top1 = 56.70%], valid : [loss = 2.172, top1 = 44.03%], test : [loss = 2.178, top1 = 44.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.457, top1 = 84.43%], valid : [loss = 0.566, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10429/15625) 010429-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.647, top1 = 85.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.96 ms.
cifar10        train : [loss = 0.032, top1 = 99.20%], test  : [loss = 0.420, top1 = 89.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 0.410, top1 = 88.97%], valid : [loss = 1.455, top1 = 64.02%], test : [loss = 1.470, top1 = 63.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.98%], valid : [loss = 2.597, top1 = 34.57%], test : [loss = 2.654, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10430/15625) 010430-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.51%], valid : [loss = 0.438, top1 = 88.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.53 ms.
cifar10        train : [loss = 0.055, top1 = 98.65%], test  : [loss = 0.305, top1 = 90.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.94 ms.
cifar100       train : [loss = 0.591, top1 = 83.65%], valid : [loss = 1.219, top1 = 66.84%], test : [loss = 1.215, top1 = 66.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.93%], valid : [loss = 2.453, top1 = 37.60%], test : [loss = 2.486, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10431/15625) 010431-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.74%], valid : [loss = 0.485, top1 = 84.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.54 ms.
cifar10        train : [loss = 0.299, top1 = 89.86%], test  : [loss = 0.392, top1 = 87.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.16 ms.
cifar100       train : [loss = 1.343, top1 = 62.74%], valid : [loss = 1.556, top1 = 57.16%], test : [loss = 1.519, top1 = 57.34%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.08 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.55%], valid : [loss = 2.892, top1 = 29.40%], test : [loss = 2.967, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10432/15625) 010432-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.149, top1 = 95.22%], valid : [loss = 0.955, top1 = 75.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.49 ms.
cifar10        train : [loss = 0.228, top1 = 92.20%], test  : [loss = 0.598, top1 = 82.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.03 ms.
cifar100       train : [loss = 1.150, top1 = 67.06%], valid : [loss = 1.755, top1 = 54.14%], test : [loss = 1.735, top1 = 54.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 3.223, top1 = 22.65%], valid : [loss = 3.319, top1 = 22.17%], test : [loss = 3.370, top1 = 20.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.060, top1 = 61.93%], valid : [loss = 1.119, top1 = 59.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10433/15625) 010433-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.84%], valid : [loss = 0.471, top1 = 84.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.302, top1 = 89.93%], test  : [loss = 0.401, top1 = 86.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.28 ms.
cifar100       train : [loss = 1.337, top1 = 63.13%], valid : [loss = 1.522, top1 = 57.48%], test : [loss = 1.502, top1 = 58.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.74%], valid : [loss = 2.895, top1 = 29.67%], test : [loss = 2.950, top1 = 28.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10434/15625) 010434-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.58%], valid : [loss = 0.467, top1 = 86.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.55 ms.
cifar10        train : [loss = 0.149, top1 = 95.08%], test  : [loss = 0.350, top1 = 88.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.31 ms.
cifar100       train : [loss = 0.977, top1 = 72.57%], valid : [loss = 1.370, top1 = 61.64%], test : [loss = 1.362, top1 = 61.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.10%], valid : [loss = 2.666, top1 = 33.17%], test : [loss = 2.704, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10435/15625) 010435-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.59%], valid : [loss = 0.853, top1 = 72.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.89 ms.
cifar10        train : [loss = 0.555, top1 = 80.57%], test  : [loss = 0.725, top1 = 75.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.33 ms.
cifar100       train : [loss = 1.767, top1 = 52.39%], valid : [loss = 2.046, top1 = 46.10%], test : [loss = 2.055, top1 = 46.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.77%], valid : [loss = 3.648, top1 = 16.83%], test : [loss = 3.670, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10436/15625) 010436-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=21.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.504, top1 = 90.24%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=22.30 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.302, top1 = 93.79%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=21.40 ms.
cifar100       train : [loss = 0.037, top1 = 99.63%], valid : [loss = 1.303, top1 = 71.36%], test : [loss = 1.246, top1 = 72.04%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=19.45 ms.
ImageNet16-120 train : [loss = 1.635, top1 = 55.91%], valid : [loss = 2.164, top1 = 44.40%], test : [loss = 2.177, top1 = 45.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.66%], valid : [loss = 0.638, top1 = 77.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10437/15625) 010437-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.82 ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.60%], valid : [loss = 0.657, top1 = 77.96%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.76 ms.
cifar10        train : [loss = 0.512, top1 = 82.36%], test  : [loss = 0.593, top1 = 79.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.67 ms.
cifar100       train : [loss = 1.684, top1 = 54.25%], valid : [loss = 1.855, top1 = 50.93%], test : [loss = 1.862, top1 = 50.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.03 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.24%], valid : [loss = 3.309, top1 = 21.37%], test : [loss = 3.351, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10438/15625) 010438-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.239, top1 = 91.93%], valid : [loss = 0.534, top1 = 83.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10        train : [loss = 0.231, top1 = 92.11%], test  : [loss = 0.411, top1 = 86.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.11 ms.
cifar100       train : [loss = 1.312, top1 = 62.84%], valid : [loss = 1.601, top1 = 56.25%], test : [loss = 1.604, top1 = 56.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.32%], valid : [loss = 2.934, top1 = 28.01%], test : [loss = 2.961, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.36%], valid : [loss = 1.045, top1 = 63.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10439/15625) 010439-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 91.07%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.20 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.279, top1 = 93.83%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.93 ms.
cifar100       train : [loss = 0.043, top1 = 99.55%], valid : [loss = 1.332, top1 = 71.10%], test : [loss = 1.315, top1 = 71.59%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 1.422, top1 = 61.22%], valid : [loss = 2.218, top1 = 44.66%], test : [loss = 2.201, top1 = 45.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.362, top1 = 87.68%], valid : [loss = 0.499, top1 = 83.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10440/15625) 010440-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.17%], valid : [loss = 0.448, top1 = 86.39%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.15 ms.
cifar10        train : [loss = 0.159, top1 = 94.76%], test  : [loss = 0.343, top1 = 88.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.17 ms.
cifar100       train : [loss = 0.987, top1 = 71.99%], valid : [loss = 1.358, top1 = 62.06%], test : [loss = 1.361, top1 = 61.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.19%], valid : [loss = 2.670, top1 = 33.53%], test : [loss = 2.678, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10441/15625) 010441-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.20%], valid : [loss = 0.569, top1 = 86.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10        train : [loss = 0.062, top1 = 97.97%], test  : [loss = 0.400, top1 = 89.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.642, top1 = 81.00%], valid : [loss = 1.320, top1 = 64.68%], test : [loss = 1.339, top1 = 64.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 39.70%], valid : [loss = 2.492, top1 = 37.17%], test : [loss = 2.500, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.58%], valid : [loss = 0.783, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10442/15625) 010442-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.540, top1 = 88.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.325, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.92 ms.
cifar100       train : [loss = 0.360, top1 = 90.08%], valid : [loss = 1.258, top1 = 67.42%], test : [loss = 1.284, top1 = 66.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.61%], valid : [loss = 2.410, top1 = 38.63%], test : [loss = 2.421, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10443/15625) 010443-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.529, top1 = 88.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.342, top1 = 92.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.77 ms.
cifar100       train : [loss = 0.356, top1 = 90.13%], valid : [loss = 1.267, top1 = 67.40%], test : [loss = 1.247, top1 = 68.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.59 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.66%], valid : [loss = 2.444, top1 = 39.07%], test : [loss = 2.420, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10444/15625) 010444-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.04%], valid : [loss = 0.526, top1 = 87.35%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10        train : [loss = 0.067, top1 = 97.97%], test  : [loss = 0.351, top1 = 90.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.49 ms.
cifar100       train : [loss = 0.660, top1 = 80.73%], valid : [loss = 1.336, top1 = 64.22%], test : [loss = 1.313, top1 = 64.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.431, top1 = 38.29%], valid : [loss = 2.543, top1 = 35.60%], test : [loss = 2.601, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.68%], valid : [loss = 0.665, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10445/15625) 010445-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.55%], valid : [loss = 0.434, top1 = 87.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10        train : [loss = 0.055, top1 = 98.64%], test  : [loss = 0.301, top1 = 90.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.45 ms.
cifar100       train : [loss = 0.591, top1 = 83.68%], valid : [loss = 1.230, top1 = 66.24%], test : [loss = 1.241, top1 = 66.14%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.88%], valid : [loss = 2.463, top1 = 38.23%], test : [loss = 2.509, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.95%], valid : [loss = 0.638, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10446/15625) 010446-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.432, top1 = 89.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.302, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.41 ms.
cifar100       train : [loss = 0.219, top1 = 94.74%], valid : [loss = 1.276, top1 = 68.72%], test : [loss = 1.311, top1 = 67.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.95 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.30%], valid : [loss = 2.258, top1 = 41.90%], test : [loss = 2.299, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.34%], valid : [loss = 0.526, top1 = 82.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10447/15625) 010447-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.20%], valid : [loss = 0.457, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.155, top1 = 94.99%], test  : [loss = 0.343, top1 = 89.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.19 ms.
cifar100       train : [loss = 1.007, top1 = 71.27%], valid : [loss = 1.367, top1 = 61.78%], test : [loss = 1.359, top1 = 61.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.34%], valid : [loss = 2.707, top1 = 32.58%], test : [loss = 2.734, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10448/15625) 010448-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.33 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10449/15625) 010449-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.56 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10450/15625) 010450-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.248, top1 = 91.46%], valid : [loss = 0.569, top1 = 82.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10        train : [loss = 0.225, top1 = 92.32%], test  : [loss = 0.402, top1 = 87.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 1.186, top1 = 66.32%], valid : [loss = 1.537, top1 = 58.64%], test : [loss = 1.542, top1 = 57.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 2.966, top1 = 27.77%], valid : [loss = 2.972, top1 = 27.80%], test : [loss = 3.058, top1 = 26.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.30%], valid : [loss = 1.191, top1 = 57.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10451/15625) 010451-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.48%], valid : [loss = 0.876, top1 = 71.17%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.22 ms.
cifar10        train : [loss = 0.562, top1 = 80.37%], test  : [loss = 0.720, top1 = 75.74%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.35 ms.
cifar100       train : [loss = 1.783, top1 = 51.93%], valid : [loss = 2.056, top1 = 46.85%], test : [loss = 2.066, top1 = 46.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.42 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.78%], valid : [loss = 3.645, top1 = 16.02%], test : [loss = 3.666, top1 = 15.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10452/15625) 010452-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.262, top1 = 90.90%], valid : [loss = 0.833, top1 = 76.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10        train : [loss = 0.304, top1 = 89.41%], test  : [loss = 0.635, top1 = 80.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.55 ms.
cifar100       train : [loss = 1.382, top1 = 61.34%], valid : [loss = 1.978, top1 = 48.64%], test : [loss = 1.955, top1 = 50.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 3.477, top1 = 17.82%], valid : [loss = 3.519, top1 = 17.33%], test : [loss = 3.506, top1 = 17.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 54.08%], valid : [loss = 1.317, top1 = 52.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10453/15625) 010453-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.07 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.50%], valid : [loss = 0.537, top1 = 83.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.199, top1 = 93.23%], test  : [loss = 0.403, top1 = 87.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.19 ms.
cifar100       train : [loss = 1.233, top1 = 64.98%], valid : [loss = 1.544, top1 = 57.97%], test : [loss = 1.548, top1 = 57.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.696, top1 = 32.61%], valid : [loss = 2.743, top1 = 32.22%], test : [loss = 2.779, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.81%], valid : [loss = 0.975, top1 = 65.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10454/15625) 010454-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.626, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.402, top1 = 91.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.192, top1 = 95.61%], valid : [loss = 1.418, top1 = 67.32%], test : [loss = 1.417, top1 = 66.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.05%], valid : [loss = 2.500, top1 = 37.53%], test : [loss = 2.486, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.91%], valid : [loss = 0.789, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10455/15625) 010455-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.31 ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.36%], valid : [loss = 0.908, top1 = 68.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.98 ms.
cifar10        train : [loss = 0.770, top1 = 72.92%], test  : [loss = 0.817, top1 = 71.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.41 ms.
cifar100       train : [loss = 2.397, top1 = 37.51%], valid : [loss = 2.530, top1 = 35.04%], test : [loss = 2.527, top1 = 34.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 3.568, top1 = 16.90%], valid : [loss = 3.550, top1 = 17.73%], test : [loss = 3.586, top1 = 16.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.447, top1 = 46.50%], valid : [loss = 1.495, top1 = 44.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10456/15625) 010456-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.603, top1 = 85.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10        train : [loss = 0.070, top1 = 97.91%], test  : [loss = 0.397, top1 = 89.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.77 ms.
cifar100       train : [loss = 0.720, top1 = 78.89%], valid : [loss = 1.392, top1 = 63.50%], test : [loss = 1.373, top1 = 63.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.81%], valid : [loss = 2.656, top1 = 33.13%], test : [loss = 2.700, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.46%], valid : [loss = 0.806, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10457/15625) 010457-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.84 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.55%], valid : [loss = 0.617, top1 = 84.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10        train : [loss = 0.097, top1 = 96.83%], test  : [loss = 0.429, top1 = 88.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.51 ms.
cifar100       train : [loss = 0.731, top1 = 78.53%], valid : [loss = 1.594, top1 = 58.86%], test : [loss = 1.603, top1 = 58.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 21.82%], valid : [loss = 3.206, top1 = 21.17%], test : [loss = 3.254, top1 = 22.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.077, top1 = 61.24%], valid : [loss = 1.105, top1 = 60.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10458/15625) 010458-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.86%], valid : [loss = 0.562, top1 = 85.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=14.95 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.418, top1 = 88.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.99 ms.
cifar100       train : [loss = 0.712, top1 = 79.42%], valid : [loss = 1.377, top1 = 63.34%], test : [loss = 1.370, top1 = 63.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.09%], valid : [loss = 2.642, top1 = 34.17%], test : [loss = 2.667, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.37%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10459/15625) 010459-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.461, top1 = 88.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.36 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.313, top1 = 91.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.41 ms.
cifar100       train : [loss = 0.324, top1 = 91.24%], valid : [loss = 1.317, top1 = 67.44%], test : [loss = 1.333, top1 = 66.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.21 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.23%], valid : [loss = 2.397, top1 = 40.17%], test : [loss = 2.414, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10460/15625) 010460-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.533, top1 = 89.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.332, top1 = 92.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.05 ms.
cifar100       train : [loss = 0.131, top1 = 97.10%], valid : [loss = 1.293, top1 = 69.64%], test : [loss = 1.329, top1 = 69.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.23 ms.
ImageNet16-120 train : [loss = 1.828, top1 = 51.67%], valid : [loss = 2.214, top1 = 42.90%], test : [loss = 2.214, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.39%], valid : [loss = 0.837, top1 = 70.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10461/15625) 010461-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.235, top1 = 92.01%], valid : [loss = 0.515, top1 = 83.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.01 ms.
cifar10        train : [loss = 0.223, top1 = 92.44%], test  : [loss = 0.390, top1 = 87.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.48 ms.
cifar100       train : [loss = 1.299, top1 = 63.49%], valid : [loss = 1.564, top1 = 57.17%], test : [loss = 1.569, top1 = 57.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.795, top1 = 30.76%], valid : [loss = 2.814, top1 = 30.49%], test : [loss = 2.876, top1 = 29.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.68%], valid : [loss = 1.064, top1 = 62.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10462/15625) 010462-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.21 ms.
cifar10-valid  train : [loss = 0.387, top1 = 86.73%], valid : [loss = 0.523, top1 = 82.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.88 ms.
cifar10        train : [loss = 0.391, top1 = 86.67%], test  : [loss = 0.461, top1 = 84.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.516, top1 = 58.30%], valid : [loss = 1.646, top1 = 54.43%], test : [loss = 1.630, top1 = 54.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.31 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.48%], valid : [loss = 2.987, top1 = 27.65%], test : [loss = 3.055, top1 = 26.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 60.45%], valid : [loss = 1.137, top1 = 59.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10463/15625) 010463-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.27%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.320, top1 = 91.71%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.53 ms.
cifar100       train : [loss = 0.323, top1 = 91.04%], valid : [loss = 1.319, top1 = 67.82%], test : [loss = 1.344, top1 = 67.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.04%], valid : [loss = 2.347, top1 = 40.33%], test : [loss = 2.434, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.17%], valid : [loss = 0.539, top1 = 81.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10464/15625) 010464-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.71%], valid : [loss = 1.229, top1 = 56.42%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10        train : [loss = 1.112, top1 = 60.55%], test  : [loss = 1.117, top1 = 60.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.59 ms.
cifar100       train : [loss = 2.683, top1 = 32.75%], valid : [loss = 2.755, top1 = 31.87%], test : [loss = 2.744, top1 = 31.75%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.84 ms.
ImageNet16-120 train : [loss = 3.826, top1 = 13.05%], valid : [loss = 3.820, top1 = 13.81%], test : [loss = 3.835, top1 = 13.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.687, top1 = 36.40%], valid : [loss = 1.711, top1 = 34.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10465/15625) 010465-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.80%], valid : [loss = 0.476, top1 = 84.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.28 ms.
cifar10        train : [loss = 0.300, top1 = 90.02%], test  : [loss = 0.398, top1 = 86.55%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 1.324, top1 = 63.35%], valid : [loss = 1.526, top1 = 58.36%], test : [loss = 1.502, top1 = 58.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.58%], valid : [loss = 2.919, top1 = 28.90%], test : [loss = 2.978, top1 = 27.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10466/15625) 010466-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.81%], valid : [loss = 0.560, top1 = 88.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.24 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.365, top1 = 91.16%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.31 ms.
cifar100       train : [loss = 0.312, top1 = 91.42%], valid : [loss = 1.304, top1 = 67.00%], test : [loss = 1.320, top1 = 67.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.31%], valid : [loss = 2.252, top1 = 42.63%], test : [loss = 2.295, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.10%], valid : [loss = 0.815, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10467/15625) 010467-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.92%], valid : [loss = 0.981, top1 = 66.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.786, top1 = 72.42%], test  : [loss = 0.879, top1 = 69.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 2.163, top1 = 43.33%], valid : [loss = 2.317, top1 = 40.84%], test : [loss = 2.361, top1 = 39.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 3.756, top1 = 14.08%], valid : [loss = 3.779, top1 = 14.17%], test : [loss = 3.784, top1 = 14.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.437, top1 = 47.34%], valid : [loss = 1.465, top1 = 46.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10468/15625) 010468-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.522, top1 = 88.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.40 ms.
cifar100       train : [loss = 0.274, top1 = 92.65%], valid : [loss = 1.274, top1 = 68.17%], test : [loss = 1.258, top1 = 68.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.87%], valid : [loss = 2.285, top1 = 41.73%], test : [loss = 2.309, top1 = 41.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.66%], valid : [loss = 0.657, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10469/15625) 010469-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.52%], valid : [loss = 0.775, top1 = 81.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10        train : [loss = 0.090, top1 = 97.10%], test  : [loss = 0.500, top1 = 86.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.82 ms.
cifar100       train : [loss = 0.841, top1 = 75.60%], valid : [loss = 1.574, top1 = 58.80%], test : [loss = 1.551, top1 = 59.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 2.796, top1 = 30.70%], valid : [loss = 2.920, top1 = 28.33%], test : [loss = 2.972, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.31%], valid : [loss = 0.851, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10470/15625) 010470-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.45%], valid : [loss = 1.270, top1 = 54.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10        train : [loss = 1.180, top1 = 57.77%], test  : [loss = 1.196, top1 = 56.89%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.40 ms.
cifar100       train : [loss = 2.829, top1 = 29.69%], valid : [loss = 2.905, top1 = 29.36%], test : [loss = 2.891, top1 = 28.94%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.05 ms.
ImageNet16-120 train : [loss = 3.901, top1 = 11.88%], valid : [loss = 3.907, top1 = 12.30%], test : [loss = 3.917, top1 = 11.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.764, top1 = 33.36%], valid : [loss = 1.758, top1 = 33.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10471/15625) 010471-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.287, top1 = 90.12%], valid : [loss = 0.883, top1 = 74.70%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10        train : [loss = 0.300, top1 = 89.77%], test  : [loss = 0.638, top1 = 79.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.42 ms.
cifar100       train : [loss = 1.388, top1 = 61.20%], valid : [loss = 1.924, top1 = 49.48%], test : [loss = 1.940, top1 = 49.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 3.494, top1 = 17.48%], valid : [loss = 3.508, top1 = 17.90%], test : [loss = 3.504, top1 = 17.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10472/15625) 010472-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.497, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.76 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.321, top1 = 92.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.91 ms.
cifar100       train : [loss = 0.341, top1 = 90.74%], valid : [loss = 1.266, top1 = 67.02%], test : [loss = 1.264, top1 = 67.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.55%], valid : [loss = 2.410, top1 = 39.23%], test : [loss = 2.421, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10473/15625) 010473-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.79%], valid : [loss = 0.864, top1 = 71.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10        train : [loss = 0.558, top1 = 80.56%], test  : [loss = 0.709, top1 = 75.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 1.778, top1 = 51.95%], valid : [loss = 2.051, top1 = 46.99%], test : [loss = 2.061, top1 = 46.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.73%], valid : [loss = 3.651, top1 = 16.54%], test : [loss = 3.664, top1 = 15.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10474/15625) 010474-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.510, top1 = 89.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.347, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.80 ms.
cifar100       train : [loss = 0.324, top1 = 91.16%], valid : [loss = 1.305, top1 = 67.16%], test : [loss = 1.287, top1 = 66.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.73%], valid : [loss = 2.433, top1 = 38.17%], test : [loss = 2.432, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.96%], valid : [loss = 0.839, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10475/15625) 010475-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.588, top1 = 86.96%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.025, top1 = 99.41%], test  : [loss = 0.399, top1 = 89.98%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.31 ms.
cifar100       train : [loss = 0.340, top1 = 91.04%], valid : [loss = 1.371, top1 = 65.89%], test : [loss = 1.361, top1 = 65.79%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.47%], valid : [loss = 2.532, top1 = 36.80%], test : [loss = 2.524, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.55%], valid : [loss = 0.764, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10476/15625) 010476-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.454, top1 = 90.78%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.31 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.289, top1 = 93.83%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.34 ms.
cifar100       train : [loss = 0.043, top1 = 99.50%], valid : [loss = 1.339, top1 = 71.02%], test : [loss = 1.281, top1 = 72.42%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 1.462, top1 = 60.30%], valid : [loss = 2.224, top1 = 43.77%], test : [loss = 2.275, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.23%], valid : [loss = 0.594, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10477/15625) 010477-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.65%], valid : [loss = 0.859, top1 = 71.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.96 ms.
cifar10        train : [loss = 0.554, top1 = 80.67%], test  : [loss = 0.715, top1 = 75.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.47 ms.
cifar100       train : [loss = 1.795, top1 = 51.71%], valid : [loss = 2.069, top1 = 46.88%], test : [loss = 2.073, top1 = 46.56%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.71%], valid : [loss = 3.634, top1 = 16.23%], test : [loss = 3.674, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10478/15625) 010478-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.83%], valid : [loss = 0.883, top1 = 69.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10        train : [loss = 0.681, top1 = 75.65%], test  : [loss = 0.723, top1 = 74.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.99 ms.
cifar100       train : [loss = 2.278, top1 = 39.70%], valid : [loss = 2.373, top1 = 38.24%], test : [loss = 2.381, top1 = 37.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 3.509, top1 = 17.72%], valid : [loss = 3.478, top1 = 18.60%], test : [loss = 3.515, top1 = 17.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 49.58%], valid : [loss = 1.400, top1 = 48.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10479/15625) 010479-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.415, top1 = 89.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.43 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.306, top1 = 92.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.217, top1 = 94.68%], valid : [loss = 1.346, top1 = 67.88%], test : [loss = 1.367, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.51%], valid : [loss = 2.340, top1 = 41.07%], test : [loss = 2.364, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.50%], valid : [loss = 0.540, top1 = 81.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10480/15625) 010480-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.567, top1 = 87.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.355, top1 = 91.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.58 ms.
cifar100       train : [loss = 0.281, top1 = 92.02%], valid : [loss = 1.341, top1 = 67.34%], test : [loss = 1.341, top1 = 67.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.26%], valid : [loss = 2.505, top1 = 36.53%], test : [loss = 2.507, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.87%], valid : [loss = 0.946, top1 = 66.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10481/15625) 010481-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.47 ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.39%], valid : [loss = 0.869, top1 = 71.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10        train : [loss = 0.564, top1 = 80.41%], test  : [loss = 0.723, top1 = 75.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.84 ms.
cifar100       train : [loss = 1.778, top1 = 52.05%], valid : [loss = 2.036, top1 = 47.04%], test : [loss = 2.072, top1 = 46.71%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.57 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.70%], valid : [loss = 3.644, top1 = 16.09%], test : [loss = 3.660, top1 = 16.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10482/15625) 010482-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.12%], valid : [loss = 0.606, top1 = 85.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.074, top1 = 97.72%], test  : [loss = 0.400, top1 = 88.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 0.719, top1 = 79.13%], valid : [loss = 1.383, top1 = 63.29%], test : [loss = 1.367, top1 = 63.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.62%], valid : [loss = 2.668, top1 = 33.51%], test : [loss = 2.702, top1 = 32.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.59%], valid : [loss = 0.817, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10483/15625) 010483-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.43%], valid : [loss = 1.093, top1 = 68.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.07 ms.
cifar10        train : [loss = 0.474, top1 = 83.52%], test  : [loss = 0.805, top1 = 73.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.75 ms.
cifar100       train : [loss = 1.617, top1 = 55.65%], valid : [loss = 2.191, top1 = 44.90%], test : [loss = 2.194, top1 = 45.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 3.522, top1 = 17.69%], valid : [loss = 3.620, top1 = 16.00%], test : [loss = 3.674, top1 = 15.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.229, top1 = 55.34%], valid : [loss = 1.287, top1 = 54.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10484/15625) 010484-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.442, top1 = 90.82%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.58 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.293, top1 = 93.81%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.85 ms.
cifar100       train : [loss = 0.068, top1 = 99.02%], valid : [loss = 1.343, top1 = 70.42%], test : [loss = 1.324, top1 = 69.98%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 1.559, top1 = 57.82%], valid : [loss = 2.255, top1 = 43.87%], test : [loss = 2.276, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.17%], valid : [loss = 0.505, top1 = 83.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10485/15625) 010485-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.334, top1 = 88.38%], valid : [loss = 0.629, top1 = 79.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.281, top1 = 90.40%], test  : [loss = 0.429, top1 = 85.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 1.394, top1 = 60.81%], valid : [loss = 1.653, top1 = 54.40%], test : [loss = 1.659, top1 = 54.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.846, top1 = 29.59%], valid : [loss = 2.869, top1 = 30.37%], test : [loss = 2.871, top1 = 30.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 66.02%], valid : [loss = 0.990, top1 = 64.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10486/15625) 010486-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.496, top1 = 89.92%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.318, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.09 ms.
cifar100       train : [loss = 0.099, top1 = 98.20%], valid : [loss = 1.309, top1 = 70.12%], test : [loss = 1.276, top1 = 70.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 55.72%], valid : [loss = 2.191, top1 = 44.50%], test : [loss = 2.192, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 84.16%], valid : [loss = 0.557, top1 = 81.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10487/15625) 010487-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.85%], valid : [loss = 0.525, top1 = 86.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10        train : [loss = 0.073, top1 = 97.69%], test  : [loss = 0.347, top1 = 90.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.96 ms.
cifar100       train : [loss = 0.692, top1 = 79.45%], valid : [loss = 1.364, top1 = 64.08%], test : [loss = 1.353, top1 = 64.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.515, top1 = 36.34%], valid : [loss = 2.611, top1 = 34.57%], test : [loss = 2.671, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.94%], valid : [loss = 0.689, top1 = 76.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10488/15625) 010488-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.14%], valid : [loss = 0.471, top1 = 85.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10        train : [loss = 0.164, top1 = 94.64%], test  : [loss = 0.353, top1 = 88.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.09 ms.
cifar100       train : [loss = 1.003, top1 = 71.65%], valid : [loss = 1.332, top1 = 62.68%], test : [loss = 1.340, top1 = 62.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.50%], valid : [loss = 2.690, top1 = 32.90%], test : [loss = 2.747, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10489/15625) 010489-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.584, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.394, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 0.235, top1 = 94.08%], valid : [loss = 1.513, top1 = 64.99%], test : [loss = 1.479, top1 = 65.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.12%], valid : [loss = 2.489, top1 = 37.46%], test : [loss = 2.494, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.79%], valid : [loss = 0.736, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10490/15625) 010490-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.78%], valid : [loss = 0.756, top1 = 74.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.491, top1 = 82.83%], test  : [loss = 0.604, top1 = 79.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.52 ms.
cifar100       train : [loss = 2.008, top1 = 45.96%], valid : [loss = 2.218, top1 = 42.30%], test : [loss = 2.199, top1 = 42.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 3.529, top1 = 17.37%], valid : [loss = 3.517, top1 = 17.33%], test : [loss = 3.551, top1 = 17.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.237, top1 = 55.23%], valid : [loss = 1.271, top1 = 54.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10491/15625) 010491-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.24%], valid : [loss = 0.476, top1 = 84.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.20 ms.
cifar10        train : [loss = 0.302, top1 = 89.95%], test  : [loss = 0.405, top1 = 86.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.43 ms.
cifar100       train : [loss = 1.330, top1 = 63.11%], valid : [loss = 1.524, top1 = 57.86%], test : [loss = 1.510, top1 = 57.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.66%], valid : [loss = 2.905, top1 = 30.00%], test : [loss = 2.965, top1 = 29.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.27%], valid : [loss = 0.759, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10492/15625) 010492-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.614, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10        train : [loss = 0.073, top1 = 97.75%], test  : [loss = 0.391, top1 = 88.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.63 ms.
cifar100       train : [loss = 0.721, top1 = 79.04%], valid : [loss = 1.394, top1 = 63.03%], test : [loss = 1.384, top1 = 63.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.72%], valid : [loss = 2.686, top1 = 33.47%], test : [loss = 2.700, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10493/15625) 010493-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.558, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10        train : [loss = 0.010, top1 = 99.74%], test  : [loss = 0.366, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 0.197, top1 = 95.04%], valid : [loss = 1.303, top1 = 68.80%], test : [loss = 1.303, top1 = 68.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.12%], valid : [loss = 2.375, top1 = 39.27%], test : [loss = 2.340, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 72.87%], valid : [loss = 0.809, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10494/15625) 010494-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.99 ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.68%], valid : [loss = 0.723, top1 = 75.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.11 ms.
cifar10        train : [loss = 0.552, top1 = 80.73%], test  : [loss = 0.624, top1 = 79.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.21 ms.
cifar100       train : [loss = 1.811, top1 = 51.08%], valid : [loss = 1.948, top1 = 48.56%], test : [loss = 1.991, top1 = 48.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 3.391, top1 = 20.08%], valid : [loss = 3.359, top1 = 20.70%], test : [loss = 3.401, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.379, top1 = 49.75%], valid : [loss = 1.391, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10495/15625) 010495-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.22%], valid : [loss = 0.451, top1 = 87.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.05 ms.
cifar10        train : [loss = 0.114, top1 = 96.52%], test  : [loss = 0.322, top1 = 89.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 0.872, top1 = 74.92%], valid : [loss = 1.314, top1 = 63.50%], test : [loss = 1.293, top1 = 63.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.22 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.71%], valid : [loss = 2.626, top1 = 34.57%], test : [loss = 2.676, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10496/15625) 010496-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.442, top1 = 90.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.305, top1 = 93.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.41 ms.
cifar100       train : [loss = 0.083, top1 = 98.44%], valid : [loss = 1.440, top1 = 69.22%], test : [loss = 1.451, top1 = 68.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 1.659, top1 = 55.56%], valid : [loss = 2.266, top1 = 42.90%], test : [loss = 2.282, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.48%], valid : [loss = 0.584, top1 = 80.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10497/15625) 010497-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.95 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.651, top1 = 85.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.050, top1 = 98.56%], test  : [loss = 0.408, top1 = 89.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.613, top1 = 81.78%], valid : [loss = 1.407, top1 = 63.54%], test : [loss = 1.380, top1 = 63.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 2.501, top1 = 36.55%], valid : [loss = 2.645, top1 = 33.60%], test : [loss = 2.695, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.52%], valid : [loss = 0.966, top1 = 65.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10498/15625) 010498-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.597, top1 = 86.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.039, top1 = 98.82%], test  : [loss = 0.406, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.00 ms.
cifar100       train : [loss = 0.548, top1 = 83.98%], valid : [loss = 1.364, top1 = 64.42%], test : [loss = 1.373, top1 = 63.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.484, top1 = 37.23%], valid : [loss = 2.596, top1 = 34.83%], test : [loss = 2.653, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.52%], valid : [loss = 0.627, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10499/15625) 010499-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.529, top1 = 88.29%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.31 ms.
cifar10        train : [loss = 0.022, top1 = 99.43%], test  : [loss = 0.347, top1 = 91.31%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=23.21 ms.
cifar100       train : [loss = 0.349, top1 = 90.34%], valid : [loss = 1.271, top1 = 67.22%], test : [loss = 1.275, top1 = 67.72%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.82%], valid : [loss = 2.327, top1 = 40.33%], test : [loss = 2.318, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.37%], valid : [loss = 0.795, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10500/15625) 010500-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.82%], valid : [loss = 0.557, top1 = 88.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.342, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.87 ms.
cifar100       train : [loss = 0.150, top1 = 96.47%], valid : [loss = 1.391, top1 = 67.40%], test : [loss = 1.400, top1 = 68.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.75%], valid : [loss = 2.371, top1 = 39.70%], test : [loss = 2.348, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.45%], valid : [loss = 0.962, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10501/15625) 010501-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.564, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10        train : [loss = 0.033, top1 = 99.00%], test  : [loss = 0.377, top1 = 90.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.447, top1 = 86.99%], valid : [loss = 1.363, top1 = 65.03%], test : [loss = 1.380, top1 = 64.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 37.64%], valid : [loss = 2.572, top1 = 34.90%], test : [loss = 2.570, top1 = 34.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 66.96%], valid : [loss = 0.932, top1 = 66.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10502/15625) 010502-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.64%], valid : [loss = 0.462, top1 = 86.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.62 ms.
cifar10        train : [loss = 0.150, top1 = 95.10%], test  : [loss = 0.343, top1 = 88.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 0.967, top1 = 72.45%], valid : [loss = 1.353, top1 = 61.83%], test : [loss = 1.343, top1 = 62.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.22%], valid : [loss = 2.658, top1 = 33.32%], test : [loss = 2.703, top1 = 32.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10503/15625) 010503-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.27%], valid : [loss = 0.464, top1 = 86.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.24 ms.
cifar10        train : [loss = 0.113, top1 = 96.52%], test  : [loss = 0.332, top1 = 89.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.32 ms.
cifar100       train : [loss = 0.862, top1 = 75.41%], valid : [loss = 1.305, top1 = 64.01%], test : [loss = 1.294, top1 = 63.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.60%], valid : [loss = 2.635, top1 = 34.10%], test : [loss = 2.669, top1 = 32.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10504/15625) 010504-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.519, top1 = 88.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.325, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.351, top1 = 90.37%], valid : [loss = 1.264, top1 = 67.80%], test : [loss = 1.290, top1 = 67.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.29%], valid : [loss = 2.418, top1 = 39.27%], test : [loss = 2.399, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.27%], valid : [loss = 0.642, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10505/15625) 010505-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.72%], valid : [loss = 0.476, top1 = 85.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10        train : [loss = 0.218, top1 = 92.64%], test  : [loss = 0.369, top1 = 87.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.77 ms.
cifar100       train : [loss = 1.384, top1 = 61.45%], valid : [loss = 1.634, top1 = 55.48%], test : [loss = 1.610, top1 = 55.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 3.352, top1 = 20.24%], valid : [loss = 3.324, top1 = 20.53%], test : [loss = 3.347, top1 = 19.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.63%], valid : [loss = 1.028, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10506/15625) 010506-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.64%], valid : [loss = 0.445, top1 = 86.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.147, top1 = 95.30%], test  : [loss = 0.345, top1 = 88.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.68 ms.
cifar100       train : [loss = 0.971, top1 = 72.44%], valid : [loss = 1.341, top1 = 62.60%], test : [loss = 1.337, top1 = 62.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.36%], valid : [loss = 2.671, top1 = 33.20%], test : [loss = 2.700, top1 = 32.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10507/15625) 010507-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.99%], valid : [loss = 0.511, top1 = 85.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.118, top1 = 96.26%], test  : [loss = 0.366, top1 = 89.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.770, top1 = 77.73%], valid : [loss = 1.388, top1 = 62.92%], test : [loss = 1.352, top1 = 64.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 35.28%], valid : [loss = 2.665, top1 = 33.50%], test : [loss = 2.703, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.26%], valid : [loss = 0.936, top1 = 66.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10508/15625) 010508-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.31 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10509/15625) 010509-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.205, top1 = 93.06%], valid : [loss = 0.527, top1 = 83.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.174, top1 = 94.14%], test  : [loss = 0.383, top1 = 88.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.73 ms.
cifar100       train : [loss = 1.201, top1 = 65.76%], valid : [loss = 1.536, top1 = 57.74%], test : [loss = 1.537, top1 = 57.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 33.25%], valid : [loss = 2.683, top1 = 33.10%], test : [loss = 2.758, top1 = 31.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.32%], valid : [loss = 0.989, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10510/15625) 010510-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.576, top1 = 88.60%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.22 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.368, top1 = 92.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.98 ms.
cifar100       train : [loss = 0.102, top1 = 98.16%], valid : [loss = 1.431, top1 = 67.82%], test : [loss = 1.463, top1 = 67.84%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.51%], valid : [loss = 2.431, top1 = 38.77%], test : [loss = 2.478, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.31%], valid : [loss = 0.685, top1 = 76.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10511/15625) 010511-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.471, top1 = 89.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.03 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.338, top1 = 91.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.67 ms.
cifar100       train : [loss = 0.208, top1 = 94.93%], valid : [loss = 1.311, top1 = 68.82%], test : [loss = 1.323, top1 = 68.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.82%], valid : [loss = 2.346, top1 = 40.60%], test : [loss = 2.326, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.89%], valid : [loss = 0.562, top1 = 80.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10512/15625) 010512-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.91%], valid : [loss = 0.683, top1 = 83.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10        train : [loss = 0.084, top1 = 97.36%], test  : [loss = 0.476, top1 = 87.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.04 ms.
cifar100       train : [loss = 0.765, top1 = 77.56%], valid : [loss = 1.497, top1 = 61.08%], test : [loss = 1.480, top1 = 60.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.52 ms.
ImageNet16-120 train : [loss = 2.746, top1 = 31.66%], valid : [loss = 2.857, top1 = 29.20%], test : [loss = 2.905, top1 = 28.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.64%], valid : [loss = 0.855, top1 = 70.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10513/15625) 010513-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.583, top1 = 87.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10        train : [loss = 0.022, top1 = 99.44%], test  : [loss = 0.396, top1 = 90.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.440, top1 = 87.32%], valid : [loss = 1.381, top1 = 65.04%], test : [loss = 1.384, top1 = 65.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.40%], valid : [loss = 2.543, top1 = 36.40%], test : [loss = 2.568, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 71.06%], valid : [loss = 0.882, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10514/15625) 010514-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.462, top1 = 89.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.327, top1 = 91.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.49 ms.
cifar100       train : [loss = 0.329, top1 = 91.12%], valid : [loss = 1.325, top1 = 66.51%], test : [loss = 1.350, top1 = 66.79%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.32 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.32%], valid : [loss = 2.370, top1 = 39.63%], test : [loss = 2.400, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10515/15625) 010515-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.577, top1 = 87.31%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.74 ms.
cifar10        train : [loss = 0.020, top1 = 99.56%], test  : [loss = 0.406, top1 = 90.24%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.86 ms.
cifar100       train : [loss = 0.279, top1 = 92.98%], valid : [loss = 1.405, top1 = 65.62%], test : [loss = 1.402, top1 = 65.44%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.86 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.38%], valid : [loss = 2.508, top1 = 37.03%], test : [loss = 2.510, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.80%], valid : [loss = 0.755, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10516/15625) 010516-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.47%], valid : [loss = 0.853, top1 = 72.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10        train : [loss = 0.549, top1 = 80.76%], test  : [loss = 0.712, top1 = 75.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.79 ms.
cifar100       train : [loss = 1.771, top1 = 52.26%], valid : [loss = 2.047, top1 = 46.77%], test : [loss = 2.066, top1 = 47.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.89%], valid : [loss = 3.634, top1 = 16.38%], test : [loss = 3.668, top1 = 15.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10517/15625) 010517-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.538, top1 = 88.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.350, top1 = 91.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.42 ms.
cifar100       train : [loss = 0.431, top1 = 87.44%], valid : [loss = 1.261, top1 = 67.52%], test : [loss = 1.271, top1 = 67.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.41%], valid : [loss = 2.370, top1 = 39.70%], test : [loss = 2.384, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10518/15625) 010518-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.499, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.43 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.326, top1 = 92.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.90 ms.
cifar100       train : [loss = 0.325, top1 = 91.24%], valid : [loss = 1.278, top1 = 67.35%], test : [loss = 1.301, top1 = 67.17%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.03%], valid : [loss = 2.399, top1 = 39.01%], test : [loss = 2.417, top1 = 38.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10519/15625) 010519-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.289, top1 = 90.16%], valid : [loss = 0.605, top1 = 81.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.249, top1 = 91.56%], test  : [loss = 0.411, top1 = 86.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 1.428, top1 = 59.85%], valid : [loss = 1.697, top1 = 54.12%], test : [loss = 1.694, top1 = 54.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 2.885, top1 = 29.06%], valid : [loss = 2.907, top1 = 28.10%], test : [loss = 2.952, top1 = 27.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.18%], valid : [loss = 1.038, top1 = 63.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10520/15625) 010520-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.48 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10521/15625) 010521-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.486, top1 = 89.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.305, top1 = 92.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.48 ms.
cifar100       train : [loss = 0.150, top1 = 96.92%], valid : [loss = 1.316, top1 = 68.38%], test : [loss = 1.284, top1 = 69.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.20%], valid : [loss = 2.345, top1 = 39.90%], test : [loss = 2.322, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10522/15625) 010522-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.80%], valid : [loss = 0.853, top1 = 71.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10        train : [loss = 0.559, top1 = 80.47%], test  : [loss = 0.715, top1 = 76.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.99 ms.
cifar100       train : [loss = 1.765, top1 = 52.56%], valid : [loss = 2.067, top1 = 46.62%], test : [loss = 2.041, top1 = 47.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.86%], valid : [loss = 3.632, top1 = 16.53%], test : [loss = 3.657, top1 = 16.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10523/15625) 010523-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.64%], valid : [loss = 0.565, top1 = 87.80%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.80 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.335, top1 = 92.11%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.85 ms.
cifar100       train : [loss = 0.170, top1 = 95.75%], valid : [loss = 1.331, top1 = 68.36%], test : [loss = 1.342, top1 = 68.96%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.690, top1 = 32.00%], valid : [loss = 2.776, top1 = 31.03%], test : [loss = 2.803, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.42%], valid : [loss = 1.026, top1 = 63.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10524/15625) 010524-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.38%], valid : [loss = 0.575, top1 = 86.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10        train : [loss = 0.038, top1 = 98.80%], test  : [loss = 0.390, top1 = 90.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.50 ms.
cifar100       train : [loss = 0.517, top1 = 84.96%], valid : [loss = 1.335, top1 = 64.00%], test : [loss = 1.352, top1 = 64.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.592, top1 = 34.13%], valid : [loss = 2.622, top1 = 32.70%], test : [loss = 2.685, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.27%], valid : [loss = 0.949, top1 = 66.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10525/15625) 010525-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.544, top1 = 88.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.030, top1 = 99.10%], test  : [loss = 0.361, top1 = 91.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 0.417, top1 = 87.98%], valid : [loss = 1.247, top1 = 66.46%], test : [loss = 1.260, top1 = 67.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.16%], valid : [loss = 2.377, top1 = 39.77%], test : [loss = 2.421, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.46%], valid : [loss = 0.835, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10526/15625) 010526-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.23%], valid : [loss = 0.532, top1 = 84.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10        train : [loss = 0.185, top1 = 93.78%], test  : [loss = 0.388, top1 = 87.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.11 ms.
cifar100       train : [loss = 1.208, top1 = 65.65%], valid : [loss = 1.511, top1 = 58.67%], test : [loss = 1.501, top1 = 58.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 34.00%], valid : [loss = 2.673, top1 = 33.23%], test : [loss = 2.724, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.56%], valid : [loss = 0.979, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10527/15625) 010527-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.473, top1 = 89.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.314, top1 = 92.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.302, top1 = 92.09%], valid : [loss = 1.232, top1 = 68.68%], test : [loss = 1.250, top1 = 67.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 1.964, top1 = 48.34%], valid : [loss = 2.252, top1 = 42.27%], test : [loss = 2.308, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.13%], valid : [loss = 0.643, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10528/15625) 010528-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.36 ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.82%], valid : [loss = 0.668, top1 = 77.22%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10        train : [loss = 0.538, top1 = 81.31%], test  : [loss = 0.607, top1 = 79.74%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.24 ms.
cifar100       train : [loss = 1.749, top1 = 52.47%], valid : [loss = 1.894, top1 = 49.70%], test : [loss = 1.924, top1 = 49.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.46 ms.
ImageNet16-120 train : [loss = 3.391, top1 = 20.06%], valid : [loss = 3.382, top1 = 20.00%], test : [loss = 3.427, top1 = 18.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10529/15625) 010529-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.330, top1 = 92.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.41 ms.
cifar100       train : [loss = 0.324, top1 = 91.35%], valid : [loss = 1.289, top1 = 67.00%], test : [loss = 1.296, top1 = 67.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.91%], valid : [loss = 2.403, top1 = 39.60%], test : [loss = 2.420, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10530/15625) 010530-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.09 ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.15%], valid : [loss = 0.671, top1 = 77.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.28 ms.
cifar10        train : [loss = 0.507, top1 = 82.48%], test  : [loss = 0.584, top1 = 80.41%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.63 ms.
cifar100       train : [loss = 1.694, top1 = 54.04%], valid : [loss = 1.857, top1 = 50.35%], test : [loss = 1.880, top1 = 50.39%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.72 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.36%], valid : [loss = 3.309, top1 = 21.37%], test : [loss = 3.349, top1 = 21.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10531/15625) 010531-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.540, top1 = 88.41%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.353, top1 = 91.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.65 ms.
cifar100       train : [loss = 0.304, top1 = 91.69%], valid : [loss = 1.292, top1 = 67.03%], test : [loss = 1.312, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.64%], valid : [loss = 2.429, top1 = 38.84%], test : [loss = 2.454, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.859, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10532/15625) 010532-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.31%], valid : [loss = 0.668, top1 = 78.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10        train : [loss = 0.373, top1 = 87.05%], test  : [loss = 0.508, top1 = 83.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.28 ms.
cifar100       train : [loss = 1.608, top1 = 55.68%], valid : [loss = 1.859, top1 = 50.34%], test : [loss = 1.867, top1 = 50.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.76 ms.
ImageNet16-120 train : [loss = 3.274, top1 = 21.93%], valid : [loss = 3.288, top1 = 22.06%], test : [loss = 3.335, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.12%], valid : [loss = 1.224, top1 = 55.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10533/15625) 010533-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.11%], valid : [loss = 0.561, top1 = 86.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.048, top1 = 98.50%], test  : [loss = 0.381, top1 = 90.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.462, top1 = 86.33%], valid : [loss = 1.358, top1 = 65.22%], test : [loss = 1.375, top1 = 65.07%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.791, top1 = 29.79%], valid : [loss = 2.829, top1 = 28.43%], test : [loss = 2.846, top1 = 29.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.147, top1 = 58.43%], valid : [loss = 1.166, top1 = 57.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10534/15625) 010534-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.468, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.304, top1 = 92.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 0.331, top1 = 90.98%], valid : [loss = 1.314, top1 = 66.95%], test : [loss = 1.311, top1 = 67.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.16%], valid : [loss = 2.374, top1 = 39.43%], test : [loss = 2.415, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.03%], valid : [loss = 0.570, top1 = 80.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10535/15625) 010535-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.14%], valid : [loss = 0.452, top1 = 86.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.157, top1 = 94.87%], test  : [loss = 0.346, top1 = 88.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.11 ms.
cifar100       train : [loss = 1.005, top1 = 71.47%], valid : [loss = 1.355, top1 = 62.21%], test : [loss = 1.357, top1 = 61.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.65%], valid : [loss = 2.699, top1 = 32.71%], test : [loss = 2.724, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10536/15625) 010536-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.06%], valid : [loss = 0.667, top1 = 77.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.525, top1 = 81.89%], test  : [loss = 0.597, top1 = 79.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.23 ms.
cifar100       train : [loss = 1.697, top1 = 54.01%], valid : [loss = 1.868, top1 = 50.39%], test : [loss = 1.882, top1 = 50.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.78 ms.
ImageNet16-120 train : [loss = 3.341, top1 = 20.96%], valid : [loss = 3.329, top1 = 21.29%], test : [loss = 3.352, top1 = 21.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10537/15625) 010537-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.242, top1 = 91.65%], valid : [loss = 0.556, top1 = 82.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.221, top1 = 92.49%], test  : [loss = 0.400, top1 = 87.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 1.312, top1 = 62.80%], valid : [loss = 1.585, top1 = 56.73%], test : [loss = 1.599, top1 = 56.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.726, top1 = 32.00%], valid : [loss = 2.754, top1 = 31.42%], test : [loss = 2.786, top1 = 31.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.17%], valid : [loss = 1.030, top1 = 63.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10538/15625) 010538-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.43%], valid : [loss = 0.471, top1 = 85.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10        train : [loss = 0.159, top1 = 94.82%], test  : [loss = 0.345, top1 = 88.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.14 ms.
cifar100       train : [loss = 0.998, top1 = 71.61%], valid : [loss = 1.360, top1 = 61.92%], test : [loss = 1.361, top1 = 61.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.78%], valid : [loss = 2.690, top1 = 33.11%], test : [loss = 2.707, top1 = 32.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10539/15625) 010539-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.622, top1 = 86.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.032, top1 = 99.11%], test  : [loss = 0.402, top1 = 90.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.61 ms.
cifar100       train : [loss = 0.512, top1 = 85.09%], valid : [loss = 1.387, top1 = 64.46%], test : [loss = 1.365, top1 = 65.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.15%], valid : [loss = 2.563, top1 = 35.70%], test : [loss = 2.581, top1 = 35.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.54%], valid : [loss = 0.824, top1 = 71.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10540/15625) 010540-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.566, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.369, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.103, top1 = 98.18%], valid : [loss = 1.457, top1 = 68.03%], test : [loss = 1.444, top1 = 67.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.53%], valid : [loss = 2.419, top1 = 39.50%], test : [loss = 2.446, top1 = 39.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.63%], valid : [loss = 0.740, top1 = 74.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10541/15625) 010541-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.513, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.02 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.331, top1 = 92.68%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.29 ms.
cifar100       train : [loss = 0.120, top1 = 97.51%], valid : [loss = 1.321, top1 = 69.29%], test : [loss = 1.332, top1 = 69.01%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.91%], valid : [loss = 2.216, top1 = 43.51%], test : [loss = 2.234, top1 = 43.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.15%], valid : [loss = 0.683, top1 = 76.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10542/15625) 010542-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.26%], valid : [loss = 0.466, top1 = 85.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.156, top1 = 94.96%], test  : [loss = 0.341, top1 = 89.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 1.007, top1 = 71.24%], valid : [loss = 1.360, top1 = 61.83%], test : [loss = 1.364, top1 = 61.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.70%], valid : [loss = 2.702, top1 = 32.53%], test : [loss = 2.719, top1 = 32.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10543/15625) 010543-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.96%], valid : [loss = 0.474, top1 = 84.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10        train : [loss = 0.301, top1 = 89.89%], test  : [loss = 0.404, top1 = 86.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.329, top1 = 63.19%], valid : [loss = 1.537, top1 = 57.99%], test : [loss = 1.512, top1 = 58.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.65%], valid : [loss = 2.902, top1 = 29.41%], test : [loss = 2.954, top1 = 28.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10544/15625) 010544-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.659, top1 = 85.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10        train : [loss = 0.036, top1 = 98.95%], test  : [loss = 0.454, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.24 ms.
cifar100       train : [loss = 0.464, top1 = 86.78%], valid : [loss = 1.479, top1 = 63.60%], test : [loss = 1.456, top1 = 63.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.358, top1 = 39.70%], valid : [loss = 2.666, top1 = 33.76%], test : [loss = 2.684, top1 = 34.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.34%], valid : [loss = 0.873, top1 = 69.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10545/15625) 010545-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.416, top1 = 90.49%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.273, top1 = 93.50%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.69 ms.
cifar100       train : [loss = 0.089, top1 = 98.56%], valid : [loss = 1.273, top1 = 70.66%], test : [loss = 1.296, top1 = 70.41%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 1.614, top1 = 56.51%], valid : [loss = 2.214, top1 = 44.24%], test : [loss = 2.231, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.47%], valid : [loss = 0.491, top1 = 83.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10546/15625) 010546-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.497, top1 = 89.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.315, top1 = 92.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.77 ms.
cifar100       train : [loss = 0.122, top1 = 97.45%], valid : [loss = 1.327, top1 = 69.28%], test : [loss = 1.339, top1 = 69.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 1.679, top1 = 54.96%], valid : [loss = 2.198, top1 = 43.74%], test : [loss = 2.215, top1 = 43.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.27%], valid : [loss = 0.612, top1 = 79.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10547/15625) 010547-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.26%], valid : [loss = 0.617, top1 = 85.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.14 ms.
cifar10        train : [loss = 0.072, top1 = 97.78%], test  : [loss = 0.398, top1 = 88.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.42 ms.
cifar100       train : [loss = 0.712, top1 = 79.29%], valid : [loss = 1.398, top1 = 63.03%], test : [loss = 1.362, top1 = 63.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.21%], valid : [loss = 2.655, top1 = 34.33%], test : [loss = 2.669, top1 = 33.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10548/15625) 010548-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.466, top1 = 89.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.31%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.09 ms.
cifar100       train : [loss = 0.301, top1 = 92.03%], valid : [loss = 1.245, top1 = 68.07%], test : [loss = 1.254, top1 = 68.27%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.25%], valid : [loss = 2.293, top1 = 41.56%], test : [loss = 2.317, top1 = 41.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 83.09%], valid : [loss = 0.591, top1 = 79.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10549/15625) 010549-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.47%], valid : [loss = 0.464, top1 = 86.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 0.162, top1 = 94.73%], test  : [loss = 0.344, top1 = 88.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 1.000, top1 = 71.46%], valid : [loss = 1.363, top1 = 62.30%], test : [loss = 1.353, top1 = 62.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.13 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.69%], valid : [loss = 2.691, top1 = 32.53%], test : [loss = 2.719, top1 = 32.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10550/15625) 010550-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.77%], valid : [loss = 0.631, top1 = 86.51%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.14 ms.
cifar10        train : [loss = 0.019, top1 = 99.51%], test  : [loss = 0.424, top1 = 90.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.61 ms.
cifar100       train : [loss = 0.412, top1 = 88.23%], valid : [loss = 1.439, top1 = 64.79%], test : [loss = 1.430, top1 = 64.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.326, top1 = 40.34%], valid : [loss = 2.542, top1 = 36.17%], test : [loss = 2.571, top1 = 36.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.24%], valid : [loss = 0.868, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10551/15625) 010551-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.551, top1 = 88.26%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.349, top1 = 91.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.72 ms.
cifar100       train : [loss = 0.242, top1 = 93.37%], valid : [loss = 1.354, top1 = 67.27%], test : [loss = 1.365, top1 = 67.70%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.05%], valid : [loss = 2.508, top1 = 36.39%], test : [loss = 2.515, top1 = 36.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.94%], valid : [loss = 0.985, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10552/15625) 010552-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.462, top1 = 90.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.325, top1 = 93.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.16 ms.
cifar100       train : [loss = 0.088, top1 = 98.38%], valid : [loss = 1.419, top1 = 69.01%], test : [loss = 1.401, top1 = 69.03%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 1.654, top1 = 55.67%], valid : [loss = 2.272, top1 = 42.96%], test : [loss = 2.305, top1 = 43.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.37%], valid : [loss = 0.583, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10553/15625) 010553-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.478, top1 = 89.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.306, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.24 ms.
cifar100       train : [loss = 0.320, top1 = 91.45%], valid : [loss = 1.248, top1 = 67.72%], test : [loss = 1.249, top1 = 68.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.75%], valid : [loss = 2.303, top1 = 40.80%], test : [loss = 2.349, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.25%], valid : [loss = 0.620, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10554/15625) 010554-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.475, top1 = 89.02%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=18.36 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.305, top1 = 92.17%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=15.49 ms.
cifar100       train : [loss = 0.321, top1 = 91.42%], valid : [loss = 1.259, top1 = 67.53%], test : [loss = 1.261, top1 = 68.06%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.70%], valid : [loss = 2.309, top1 = 40.41%], test : [loss = 2.338, top1 = 40.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10555/15625) 010555-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.25 ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.42%], valid : [loss = 0.873, top1 = 71.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.34 ms.
cifar10        train : [loss = 0.559, top1 = 80.52%], test  : [loss = 0.712, top1 = 75.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.19 ms.
cifar100       train : [loss = 1.788, top1 = 51.96%], valid : [loss = 2.054, top1 = 46.99%], test : [loss = 2.076, top1 = 46.73%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.77 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.75%], valid : [loss = 3.647, top1 = 15.98%], test : [loss = 3.657, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10556/15625) 010556-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.496, top1 = 89.27%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.88 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.305, top1 = 92.62%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.94 ms.
cifar100       train : [loss = 0.169, top1 = 96.30%], valid : [loss = 1.281, top1 = 69.04%], test : [loss = 1.282, top1 = 68.84%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 1.772, top1 = 52.78%], valid : [loss = 2.198, top1 = 43.22%], test : [loss = 2.234, top1 = 43.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.15%], valid : [loss = 0.741, top1 = 73.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10557/15625) 010557-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.554, top1 = 88.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.354, top1 = 91.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.87 ms.
cifar100       train : [loss = 0.301, top1 = 91.80%], valid : [loss = 1.293, top1 = 66.95%], test : [loss = 1.322, top1 = 67.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.43%], valid : [loss = 2.442, top1 = 37.97%], test : [loss = 2.429, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.49%], valid : [loss = 0.811, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10558/15625) 010558-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.71%], valid : [loss = 0.854, top1 = 70.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.18 ms.
cifar10        train : [loss = 0.691, top1 = 75.81%], test  : [loss = 0.776, top1 = 73.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.37 ms.
cifar100       train : [loss = 1.950, top1 = 48.00%], valid : [loss = 2.122, top1 = 44.84%], test : [loss = 2.133, top1 = 45.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.45 ms.
ImageNet16-120 train : [loss = 3.652, top1 = 15.75%], valid : [loss = 3.675, top1 = 15.83%], test : [loss = 3.698, top1 = 14.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10559/15625) 010559-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.73%], valid : [loss = 0.462, top1 = 86.50%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.31 ms.
cifar10        train : [loss = 0.121, top1 = 96.24%], test  : [loss = 0.337, top1 = 89.39%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.42 ms.
cifar100       train : [loss = 0.749, top1 = 78.84%], valid : [loss = 1.276, top1 = 64.69%], test : [loss = 1.270, top1 = 64.62%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.89%], valid : [loss = 2.569, top1 = 35.13%], test : [loss = 2.600, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.69%], valid : [loss = 0.835, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10560/15625) 010560-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.543, top1 = 89.24%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.354, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.68 ms.
cifar100       train : [loss = 0.044, top1 = 99.57%], valid : [loss = 1.388, top1 = 70.00%], test : [loss = 1.383, top1 = 70.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.57 ms.
ImageNet16-120 train : [loss = 1.615, top1 = 56.65%], valid : [loss = 2.376, top1 = 41.95%], test : [loss = 2.374, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 80.91%], valid : [loss = 0.652, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10561/15625) 010561-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10-valid  train : [loss = 0.365, top1 = 87.30%], valid : [loss = 0.601, top1 = 80.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.304, top1 = 89.41%], test  : [loss = 0.444, top1 = 85.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.47 ms.
cifar100       train : [loss = 1.585, top1 = 55.96%], valid : [loss = 1.817, top1 = 51.14%], test : [loss = 1.823, top1 = 50.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.91 ms.
ImageNet16-120 train : [loss = 2.961, top1 = 27.49%], valid : [loss = 2.982, top1 = 26.97%], test : [loss = 3.036, top1 = 26.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.001, top1 = 63.71%], valid : [loss = 1.047, top1 = 62.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10562/15625) 010562-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.516, top1 = 88.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.331, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 0.330, top1 = 91.05%], valid : [loss = 1.266, top1 = 67.58%], test : [loss = 1.306, top1 = 67.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.88%], valid : [loss = 2.405, top1 = 39.67%], test : [loss = 2.428, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10563/15625) 010563-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.536, top1 = 89.28%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.81 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.369, top1 = 92.54%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.65 ms.
cifar100       train : [loss = 0.041, top1 = 99.66%], valid : [loss = 1.404, top1 = 69.97%], test : [loss = 1.381, top1 = 70.41%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.10 ms.
ImageNet16-120 train : [loss = 1.556, top1 = 58.15%], valid : [loss = 2.410, top1 = 41.20%], test : [loss = 2.388, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.21%], valid : [loss = 0.619, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10564/15625) 010564-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.467, top1 = 89.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.286, top1 = 93.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.51 ms.
cifar100       train : [loss = 0.270, top1 = 92.85%], valid : [loss = 1.223, top1 = 68.62%], test : [loss = 1.242, top1 = 68.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.32%], valid : [loss = 2.221, top1 = 42.80%], test : [loss = 2.235, top1 = 43.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10565/15625) 010565-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.517, top1 = 88.87%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.73 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.322, top1 = 92.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.73 ms.
cifar100       train : [loss = 0.212, top1 = 94.88%], valid : [loss = 1.237, top1 = 68.80%], test : [loss = 1.291, top1 = 68.51%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.37%], valid : [loss = 2.229, top1 = 42.88%], test : [loss = 2.252, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.46%], valid : [loss = 0.635, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10566/15625) 010566-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.491, top1 = 82.81%], valid : [loss = 0.708, top1 = 76.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.68 ms.
cifar10        train : [loss = 0.422, top1 = 85.30%], test  : [loss = 0.547, top1 = 81.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.05 ms.
cifar100       train : [loss = 1.673, top1 = 53.95%], valid : [loss = 1.904, top1 = 49.43%], test : [loss = 1.892, top1 = 50.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 20.91%], valid : [loss = 3.328, top1 = 21.40%], test : [loss = 3.376, top1 = 20.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.179, top1 = 57.31%], valid : [loss = 1.234, top1 = 55.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10567/15625) 010567-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.75%], valid : [loss = 0.632, top1 = 84.63%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.086, top1 = 97.18%], test  : [loss = 0.399, top1 = 88.78%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.24 ms.
cifar100       train : [loss = 0.783, top1 = 77.16%], valid : [loss = 1.412, top1 = 62.39%], test : [loss = 1.405, top1 = 62.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.18%], valid : [loss = 2.736, top1 = 32.10%], test : [loss = 2.738, top1 = 32.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.42%], valid : [loss = 0.842, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10568/15625) 010568-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.518, top1 = 89.15%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.311, top1 = 92.86%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.12 ms.
cifar100       train : [loss = 0.151, top1 = 96.85%], valid : [loss = 1.315, top1 = 68.59%], test : [loss = 1.311, top1 = 69.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.68%], valid : [loss = 2.309, top1 = 40.77%], test : [loss = 2.298, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.18%], valid : [loss = 0.697, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10569/15625) 010569-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.04%], valid : [loss = 0.675, top1 = 77.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.579, top1 = 79.84%], test  : [loss = 0.636, top1 = 78.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.60 ms.
cifar100       train : [loss = 1.776, top1 = 51.99%], valid : [loss = 1.929, top1 = 48.87%], test : [loss = 1.959, top1 = 48.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 3.410, top1 = 19.68%], valid : [loss = 3.399, top1 = 20.03%], test : [loss = 3.423, top1 = 18.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 51.05%], valid : [loss = 1.406, top1 = 49.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10570/15625) 010570-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.348, top1 = 87.87%], valid : [loss = 0.596, top1 = 80.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10        train : [loss = 0.291, top1 = 90.02%], test  : [loss = 0.433, top1 = 85.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 1.549, top1 = 56.83%], valid : [loss = 1.794, top1 = 51.33%], test : [loss = 1.781, top1 = 51.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.60%], valid : [loss = 2.980, top1 = 27.06%], test : [loss = 3.015, top1 = 26.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.54%], valid : [loss = 1.026, top1 = 63.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10571/15625) 010571-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10-valid  train : [loss = 1.238, top1 = 55.41%], valid : [loss = 1.285, top1 = 54.07%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10        train : [loss = 1.173, top1 = 58.10%], test  : [loss = 1.182, top1 = 57.74%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.22 ms.
cifar100       train : [loss = 2.680, top1 = 32.78%], valid : [loss = 2.762, top1 = 31.59%], test : [loss = 2.749, top1 = 31.91%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.34 ms.
ImageNet16-120 train : [loss = 3.867, top1 = 12.47%], valid : [loss = 3.870, top1 = 12.88%], test : [loss = 3.888, top1 = 12.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10572/15625) 010572-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.529, top1 = 89.13%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.64 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.327, top1 = 92.85%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.47 ms.
cifar100       train : [loss = 0.109, top1 = 97.55%], valid : [loss = 1.364, top1 = 68.93%], test : [loss = 1.403, top1 = 68.75%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.99 ms.
ImageNet16-120 train : [loss = 1.739, top1 = 53.51%], valid : [loss = 2.203, top1 = 43.07%], test : [loss = 2.233, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 72.98%], valid : [loss = 0.815, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10573/15625) 010573-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.60 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.59%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.71 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.315, top1 = 92.81%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.66 ms.
cifar100       train : [loss = 0.097, top1 = 98.28%], valid : [loss = 1.302, top1 = 69.81%], test : [loss = 1.309, top1 = 69.59%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.84 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.99%], valid : [loss = 2.252, top1 = 42.62%], test : [loss = 2.214, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.82%], valid : [loss = 0.659, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10574/15625) 010574-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.503, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.335, top1 = 91.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.66 ms.
cifar100       train : [loss = 0.273, top1 = 92.98%], valid : [loss = 1.193, top1 = 68.95%], test : [loss = 1.220, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.49%], valid : [loss = 2.224, top1 = 42.83%], test : [loss = 2.245, top1 = 42.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.32%], valid : [loss = 0.672, top1 = 76.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10575/15625) 010575-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.52%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.55 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.335, top1 = 93.25%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.60 ms.
cifar100       train : [loss = 0.063, top1 = 99.04%], valid : [loss = 1.376, top1 = 69.21%], test : [loss = 1.359, top1 = 69.80%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 1.795, top1 = 52.28%], valid : [loss = 2.317, top1 = 40.95%], test : [loss = 2.304, top1 = 41.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.52%], valid : [loss = 0.688, top1 = 76.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10576/15625) 010576-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.19 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10577/15625) 010577-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.439, top1 = 89.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.83 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.320, top1 = 92.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.96 ms.
cifar100       train : [loss = 0.225, top1 = 94.49%], valid : [loss = 1.267, top1 = 69.02%], test : [loss = 1.233, top1 = 69.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.19%], valid : [loss = 2.257, top1 = 43.28%], test : [loss = 2.312, top1 = 41.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.432, top1 = 85.01%], valid : [loss = 0.531, top1 = 82.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10578/15625) 010578-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.54%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.95 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.342, top1 = 93.05%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.20 ms.
cifar100       train : [loss = 0.068, top1 = 98.88%], valid : [loss = 1.425, top1 = 69.15%], test : [loss = 1.454, top1 = 68.80%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.50%], valid : [loss = 2.309, top1 = 40.75%], test : [loss = 2.302, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.16%], valid : [loss = 0.703, top1 = 75.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10579/15625) 010579-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.55%], valid : [loss = 0.839, top1 = 72.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.556, top1 = 80.74%], test  : [loss = 0.716, top1 = 75.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.71 ms.
cifar100       train : [loss = 1.770, top1 = 52.23%], valid : [loss = 2.033, top1 = 47.53%], test : [loss = 2.046, top1 = 47.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.81%], valid : [loss = 3.647, top1 = 16.50%], test : [loss = 3.681, top1 = 15.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10580/15625) 010580-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.575, top1 = 87.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.390, top1 = 91.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.98 ms.
cifar100       train : [loss = 0.410, top1 = 88.29%], valid : [loss = 1.385, top1 = 65.90%], test : [loss = 1.373, top1 = 65.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.314, top1 = 40.78%], valid : [loss = 2.512, top1 = 37.22%], test : [loss = 2.542, top1 = 36.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 73.84%], valid : [loss = 0.789, top1 = 72.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10581/15625) 010581-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.58%], valid : [loss = 0.457, top1 = 86.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.18 ms.
cifar10        train : [loss = 0.147, top1 = 95.18%], test  : [loss = 0.341, top1 = 89.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.29 ms.
cifar100       train : [loss = 0.979, top1 = 72.27%], valid : [loss = 1.337, top1 = 63.04%], test : [loss = 1.346, top1 = 62.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.13%], valid : [loss = 2.665, top1 = 33.17%], test : [loss = 2.704, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10582/15625) 010582-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.20%], valid : [loss = 0.477, top1 = 84.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.294, top1 = 90.26%], test  : [loss = 0.404, top1 = 86.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.85 ms.
cifar100       train : [loss = 1.318, top1 = 63.41%], valid : [loss = 1.529, top1 = 57.93%], test : [loss = 1.504, top1 = 58.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.87%], valid : [loss = 2.882, top1 = 30.45%], test : [loss = 2.952, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10583/15625) 010583-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.577, top1 = 87.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.71 ms.
cifar10        train : [loss = 0.015, top1 = 99.59%], test  : [loss = 0.383, top1 = 90.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.46 ms.
cifar100       train : [loss = 0.170, top1 = 95.74%], valid : [loss = 1.437, top1 = 66.62%], test : [loss = 1.434, top1 = 67.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 38.72%], valid : [loss = 2.571, top1 = 34.35%], test : [loss = 2.592, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.06%], valid : [loss = 0.910, top1 = 67.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10584/15625) 010584-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.564, top1 = 88.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.86 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.375, top1 = 91.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.28 ms.
cifar100       train : [loss = 0.169, top1 = 96.33%], valid : [loss = 1.513, top1 = 65.72%], test : [loss = 1.467, top1 = 66.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.76 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.71%], valid : [loss = 2.477, top1 = 37.77%], test : [loss = 2.478, top1 = 39.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.59%], valid : [loss = 0.744, top1 = 73.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10585/15625) 010585-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.531, top1 = 88.19%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.97 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.362, top1 = 91.50%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.68 ms.
cifar100       train : [loss = 0.327, top1 = 90.83%], valid : [loss = 1.415, top1 = 65.81%], test : [loss = 1.385, top1 = 66.23%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.204, top1 = 43.09%], valid : [loss = 2.431, top1 = 38.05%], test : [loss = 2.509, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.20%], valid : [loss = 0.762, top1 = 73.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10586/15625) 010586-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.09%], valid : [loss = 0.843, top1 = 72.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10        train : [loss = 0.540, top1 = 81.12%], test  : [loss = 0.697, top1 = 76.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 1.763, top1 = 52.48%], valid : [loss = 2.049, top1 = 47.31%], test : [loss = 2.060, top1 = 46.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 17.02%], valid : [loss = 3.634, top1 = 16.85%], test : [loss = 3.667, top1 = 15.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10587/15625) 010587-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.66%], valid : [loss = 0.857, top1 = 79.99%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10        train : [loss = 0.131, top1 = 95.50%], test  : [loss = 0.547, top1 = 84.59%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 0.856, top1 = 75.21%], valid : [loss = 1.691, top1 = 57.00%], test : [loss = 1.698, top1 = 57.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.35%], valid : [loss = 3.152, top1 = 23.83%], test : [loss = 3.187, top1 = 23.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.46%], valid : [loss = 1.117, top1 = 60.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10588/15625) 010588-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.555, top1 = 89.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.352, top1 = 92.41%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.43 ms.
cifar100       train : [loss = 0.148, top1 = 96.69%], valid : [loss = 1.302, top1 = 69.39%], test : [loss = 1.322, top1 = 68.73%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.87%], valid : [loss = 2.237, top1 = 42.30%], test : [loss = 2.252, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.40%], valid : [loss = 0.726, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10589/15625) 010589-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.322, top1 = 88.82%], valid : [loss = 0.580, top1 = 81.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.50 ms.
cifar10        train : [loss = 0.308, top1 = 89.38%], test  : [loss = 0.442, top1 = 85.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 1.332, top1 = 62.54%], valid : [loss = 1.614, top1 = 56.56%], test : [loss = 1.604, top1 = 56.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.81 ms.
ImageNet16-120 train : [loss = 3.093, top1 = 25.25%], valid : [loss = 3.112, top1 = 24.72%], test : [loss = 3.144, top1 = 24.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.55%], valid : [loss = 1.238, top1 = 55.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10590/15625) 010590-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.525, top1 = 88.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.94 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.334, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.48 ms.
cifar100       train : [loss = 0.337, top1 = 90.77%], valid : [loss = 1.295, top1 = 67.12%], test : [loss = 1.273, top1 = 67.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.83%], valid : [loss = 2.386, top1 = 39.28%], test : [loss = 2.413, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10591/15625) 010591-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.32%], valid : [loss = 0.469, top1 = 85.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.01 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.349, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.24 ms.
cifar100       train : [loss = 1.010, top1 = 71.35%], valid : [loss = 1.373, top1 = 61.45%], test : [loss = 1.367, top1 = 61.57%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.03%], valid : [loss = 2.677, top1 = 33.24%], test : [loss = 2.705, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10592/15625) 010592-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.20%], valid : [loss = 0.527, top1 = 84.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10        train : [loss = 0.179, top1 = 93.96%], test  : [loss = 0.393, top1 = 87.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.41 ms.
cifar100       train : [loss = 1.170, top1 = 66.51%], valid : [loss = 1.499, top1 = 58.79%], test : [loss = 1.488, top1 = 58.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.55%], valid : [loss = 2.707, top1 = 32.53%], test : [loss = 2.731, top1 = 32.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.42%], valid : [loss = 0.958, top1 = 66.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10593/15625) 010593-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.468, top1 = 89.62%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=22.47 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.299, top1 = 92.92%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=22.36 ms.
cifar100       train : [loss = 0.143, top1 = 97.16%], valid : [loss = 1.192, top1 = 70.55%], test : [loss = 1.218, top1 = 70.16%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=23.27 ms.
ImageNet16-120 train : [loss = 1.612, top1 = 56.55%], valid : [loss = 2.106, top1 = 45.90%], test : [loss = 2.129, top1 = 45.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.74%], valid : [loss = 0.712, top1 = 75.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10594/15625) 010594-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.46 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.521, top1 = 88.77%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.31 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.338, top1 = 91.88%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.11 ms.
cifar100       train : [loss = 0.324, top1 = 91.25%], valid : [loss = 1.284, top1 = 66.97%], test : [loss = 1.285, top1 = 67.69%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.83 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.15%], valid : [loss = 2.291, top1 = 40.88%], test : [loss = 2.282, top1 = 41.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.51%], valid : [loss = 0.789, top1 = 72.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10595/15625) 010595-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.483, top1 = 89.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.338, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.211, top1 = 94.55%], valid : [loss = 1.340, top1 = 68.12%], test : [loss = 1.354, top1 = 67.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.56%], valid : [loss = 2.283, top1 = 41.39%], test : [loss = 2.314, top1 = 41.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.487, top1 = 83.21%], valid : [loss = 0.590, top1 = 79.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10596/15625) 010596-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.517, top1 = 88.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.331, top1 = 92.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.75 ms.
cifar100       train : [loss = 0.332, top1 = 91.03%], valid : [loss = 1.278, top1 = 66.91%], test : [loss = 1.273, top1 = 67.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.86%], valid : [loss = 2.392, top1 = 39.30%], test : [loss = 2.414, top1 = 38.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10597/15625) 010597-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 74.63 M, Params=0.534 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.538, top1 = 88.69%]
cifar10        FLOP= 74.63 M, Params=0.534 MB, latency=19.51 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.359, top1 = 91.74%]
cifar100       FLOP= 74.64 M, Params=0.540 MB, latency=18.67 ms.
cifar100       train : [loss = 0.303, top1 = 91.59%], valid : [loss = 1.304, top1 = 67.45%], test : [loss = 1.283, top1 = 68.12%]
ImageNet16-120 FLOP= 18.67 M, Params=0.542 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.76%], valid : [loss = 2.314, top1 = 41.18%], test : [loss = 2.331, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.02%], valid : [loss = 0.779, top1 = 72.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10598/15625) 010598-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.486, top1 = 90.10%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.20 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.308, top1 = 93.48%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.75 ms.
cifar100       train : [loss = 0.051, top1 = 99.28%], valid : [loss = 1.333, top1 = 70.54%], test : [loss = 1.322, top1 = 70.63%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 1.616, top1 = 56.60%], valid : [loss = 2.142, top1 = 45.23%], test : [loss = 2.172, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.87%], valid : [loss = 0.785, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10599/15625) 010599-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.238, top1 = 91.83%], valid : [loss = 0.517, top1 = 83.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10        train : [loss = 0.243, top1 = 91.77%], test  : [loss = 0.399, top1 = 86.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.25 ms.
cifar100       train : [loss = 1.345, top1 = 62.09%], valid : [loss = 1.625, top1 = 55.81%], test : [loss = 1.601, top1 = 56.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.851, top1 = 29.65%], valid : [loss = 2.873, top1 = 29.71%], test : [loss = 2.927, top1 = 28.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.41%], valid : [loss = 0.984, top1 = 65.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10600/15625) 010600-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.12%], valid : [loss = 0.561, top1 = 86.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10        train : [loss = 0.063, top1 = 98.01%], test  : [loss = 0.357, top1 = 90.03%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.35 ms.
cifar100       train : [loss = 0.674, top1 = 80.11%], valid : [loss = 1.310, top1 = 64.61%], test : [loss = 1.313, top1 = 64.39%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.17%], valid : [loss = 2.510, top1 = 36.67%], test : [loss = 2.555, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.67%], valid : [loss = 0.831, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10601/15625) 010601-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.04%], valid : [loss = 0.860, top1 = 71.66%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10        train : [loss = 0.566, top1 = 80.27%], test  : [loss = 0.726, top1 = 75.20%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.30 ms.
cifar100       train : [loss = 1.780, top1 = 52.16%], valid : [loss = 2.051, top1 = 46.96%], test : [loss = 2.053, top1 = 46.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.27 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.69%], valid : [loss = 3.652, top1 = 16.30%], test : [loss = 3.670, top1 = 15.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10602/15625) 010602-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.87 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.84%], valid : [loss = 0.849, top1 = 72.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10        train : [loss = 0.549, top1 = 80.81%], test  : [loss = 0.713, top1 = 75.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 1.769, top1 = 52.34%], valid : [loss = 2.042, top1 = 47.19%], test : [loss = 2.057, top1 = 46.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 16.92%], valid : [loss = 3.626, top1 = 16.13%], test : [loss = 3.676, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10603/15625) 010603-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.445, top1 = 90.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.92 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.277, top1 = 93.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.69 ms.
cifar100       train : [loss = 0.052, top1 = 99.37%], valid : [loss = 1.266, top1 = 71.67%], test : [loss = 1.251, top1 = 71.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 1.410, top1 = 61.65%], valid : [loss = 2.175, top1 = 44.97%], test : [loss = 2.183, top1 = 45.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.338, top1 = 88.40%], valid : [loss = 0.480, top1 = 83.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10604/15625) 010604-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.341, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.347, top1 = 90.58%], valid : [loss = 1.276, top1 = 67.35%], test : [loss = 1.278, top1 = 67.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.91%], valid : [loss = 2.396, top1 = 38.82%], test : [loss = 2.391, top1 = 40.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10605/15625) 010605-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.303, top1 = 92.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.318, top1 = 91.53%], valid : [loss = 1.258, top1 = 67.26%], test : [loss = 1.257, top1 = 67.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.68%], valid : [loss = 2.310, top1 = 40.89%], test : [loss = 2.332, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.61%], valid : [loss = 0.617, top1 = 78.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10606/15625) 010606-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.575, top1 = 87.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.017, top1 = 99.62%], test  : [loss = 0.384, top1 = 91.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.54 ms.
cifar100       train : [loss = 0.395, top1 = 88.90%], valid : [loss = 1.399, top1 = 65.35%], test : [loss = 1.397, top1 = 65.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.79%], valid : [loss = 2.519, top1 = 36.60%], test : [loss = 2.541, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.03%], valid : [loss = 0.777, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10607/15625) 010607-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.536, top1 = 89.29%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.28 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.335, top1 = 93.23%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.50 ms.
cifar100       train : [loss = 0.077, top1 = 98.75%], valid : [loss = 1.383, top1 = 69.04%], test : [loss = 1.409, top1 = 68.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 47.81%], valid : [loss = 2.350, top1 = 40.28%], test : [loss = 2.370, top1 = 39.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.18%], valid : [loss = 0.664, top1 = 77.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10608/15625) 010608-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.548, top1 = 88.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.347, top1 = 91.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.73 ms.
cifar100       train : [loss = 0.291, top1 = 91.85%], valid : [loss = 1.308, top1 = 67.43%], test : [loss = 1.311, top1 = 67.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.83%], valid : [loss = 2.441, top1 = 37.58%], test : [loss = 2.451, top1 = 38.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10609/15625) 010609-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.57%], valid : [loss = 0.763, top1 = 73.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10        train : [loss = 0.546, top1 = 81.08%], test  : [loss = 0.600, top1 = 79.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.76 ms.
cifar100       train : [loss = 2.074, top1 = 44.36%], valid : [loss = 2.173, top1 = 42.77%], test : [loss = 2.175, top1 = 42.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.67 ms.
ImageNet16-120 train : [loss = 3.213, top1 = 22.62%], valid : [loss = 3.173, top1 = 23.68%], test : [loss = 3.228, top1 = 23.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.18%], valid : [loss = 1.250, top1 = 55.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10610/15625) 010610-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.01%], valid : [loss = 0.534, top1 = 84.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.190, top1 = 93.50%], test  : [loss = 0.383, top1 = 88.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.63 ms.
cifar100       train : [loss = 1.236, top1 = 64.82%], valid : [loss = 1.544, top1 = 58.01%], test : [loss = 1.558, top1 = 57.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 33.00%], valid : [loss = 2.739, top1 = 31.87%], test : [loss = 2.773, top1 = 31.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 65.02%], valid : [loss = 1.025, top1 = 63.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10611/15625) 010611-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.63%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.28 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.340, top1 = 93.04%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.01 ms.
cifar100       train : [loss = 0.082, top1 = 98.67%], valid : [loss = 1.380, top1 = 68.60%], test : [loss = 1.389, top1 = 69.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.74%], valid : [loss = 2.358, top1 = 40.17%], test : [loss = 2.377, top1 = 40.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.84%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10612/15625) 010612-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.09%], valid : [loss = 0.564, top1 = 86.63%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.02 ms.
cifar10        train : [loss = 0.064, top1 = 97.90%], test  : [loss = 0.380, top1 = 89.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.76 ms.
cifar100       train : [loss = 0.648, top1 = 80.98%], valid : [loss = 1.277, top1 = 65.70%], test : [loss = 1.304, top1 = 64.62%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.00 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 39.91%], valid : [loss = 2.480, top1 = 37.10%], test : [loss = 2.505, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.48%], valid : [loss = 0.822, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10613/15625) 010613-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.35%], valid : [loss = 0.551, top1 = 87.24%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.36 ms.
cifar10        train : [loss = 0.052, top1 = 98.38%], test  : [loss = 0.369, top1 = 90.08%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.63 ms.
cifar100       train : [loss = 0.552, top1 = 84.00%], valid : [loss = 1.292, top1 = 65.64%], test : [loss = 1.292, top1 = 65.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.38%], valid : [loss = 2.427, top1 = 38.57%], test : [loss = 2.464, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.56%], valid : [loss = 0.735, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10614/15625) 010614-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.87%], valid : [loss = 0.531, top1 = 86.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10        train : [loss = 0.076, top1 = 97.62%], test  : [loss = 0.364, top1 = 90.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 0.724, top1 = 78.76%], valid : [loss = 1.341, top1 = 64.10%], test : [loss = 1.349, top1 = 64.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.05%], valid : [loss = 2.627, top1 = 34.57%], test : [loss = 2.675, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 79.82%], valid : [loss = 0.656, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10615/15625) 010615-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.503, top1 = 88.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.329, top1 = 92.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.332, top1 = 91.08%], valid : [loss = 1.260, top1 = 67.41%], test : [loss = 1.265, top1 = 67.75%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.67%], valid : [loss = 2.302, top1 = 40.88%], test : [loss = 2.343, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10616/15625) 010616-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.539, top1 = 89.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.325, top1 = 92.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.55 ms.
cifar100       train : [loss = 0.162, top1 = 96.18%], valid : [loss = 1.355, top1 = 67.90%], test : [loss = 1.385, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.98%], valid : [loss = 2.342, top1 = 41.10%], test : [loss = 2.358, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.75%], valid : [loss = 0.999, top1 = 64.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10617/15625) 010617-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.578, top1 = 88.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.72 ms.
cifar10        train : [loss = 0.014, top1 = 99.62%], test  : [loss = 0.350, top1 = 92.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.58 ms.
cifar100       train : [loss = 0.248, top1 = 93.21%], valid : [loss = 1.410, top1 = 66.10%], test : [loss = 1.439, top1 = 66.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.11 ms.
ImageNet16-120 train : [loss = 2.609, top1 = 33.99%], valid : [loss = 2.694, top1 = 32.63%], test : [loss = 2.740, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.044, top1 = 62.09%], valid : [loss = 1.060, top1 = 61.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10618/15625) 010618-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.34%], valid : [loss = 0.451, top1 = 86.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.157, top1 = 94.87%], test  : [loss = 0.336, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.99 ms.
cifar100       train : [loss = 1.015, top1 = 70.83%], valid : [loss = 1.369, top1 = 62.00%], test : [loss = 1.342, top1 = 62.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.80%], valid : [loss = 2.684, top1 = 32.60%], test : [loss = 2.707, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10619/15625) 010619-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.81 ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.42%], valid : [loss = 0.765, top1 = 73.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.41 ms.
cifar10        train : [loss = 0.625, top1 = 78.69%], test  : [loss = 0.665, top1 = 76.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.99 ms.
cifar100       train : [loss = 2.062, top1 = 45.74%], valid : [loss = 2.146, top1 = 43.39%], test : [loss = 2.128, top1 = 44.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.78 ms.
ImageNet16-120 train : [loss = 3.284, top1 = 21.62%], valid : [loss = 3.247, top1 = 22.26%], test : [loss = 3.274, top1 = 20.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.315, top1 = 52.71%], valid : [loss = 1.360, top1 = 50.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10620/15625) 010620-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.526, top1 = 89.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.71 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.312, top1 = 92.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=20.17 ms.
cifar100       train : [loss = 0.135, top1 = 97.28%], valid : [loss = 1.296, top1 = 69.12%], test : [loss = 1.346, top1 = 68.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.70 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.89%], valid : [loss = 2.282, top1 = 42.33%], test : [loss = 2.258, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10621/15625) 010621-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.463, top1 = 89.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.305, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.07 ms.
cifar100       train : [loss = 0.280, top1 = 92.40%], valid : [loss = 1.358, top1 = 67.20%], test : [loss = 1.360, top1 = 66.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.007, top1 = 47.49%], valid : [loss = 2.312, top1 = 40.77%], test : [loss = 2.389, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.69%], valid : [loss = 0.607, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10622/15625) 010622-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.33%], valid : [loss = 0.851, top1 = 71.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.18 ms.
cifar10        train : [loss = 0.694, top1 = 75.71%], test  : [loss = 0.779, top1 = 73.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.21 ms.
cifar100       train : [loss = 1.965, top1 = 47.82%], valid : [loss = 2.141, top1 = 44.95%], test : [loss = 2.165, top1 = 44.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.23 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.74%], valid : [loss = 3.668, top1 = 15.81%], test : [loss = 3.687, top1 = 14.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10623/15625) 010623-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.03%], valid : [loss = 0.724, top1 = 83.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.84 ms.
cifar10        train : [loss = 0.055, top1 = 98.29%], test  : [loss = 0.417, top1 = 89.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.70 ms.
cifar100       train : [loss = 0.640, top1 = 81.20%], valid : [loss = 1.462, top1 = 62.90%], test : [loss = 1.445, top1 = 62.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 37.14%], valid : [loss = 2.638, top1 = 34.23%], test : [loss = 2.664, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.62%], valid : [loss = 0.884, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10624/15625) 010624-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.450, top1 = 89.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.310, top1 = 92.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.225, top1 = 94.56%], valid : [loss = 1.324, top1 = 68.04%], test : [loss = 1.273, top1 = 69.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.25%], valid : [loss = 2.285, top1 = 41.80%], test : [loss = 2.303, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.18%], valid : [loss = 0.542, top1 = 81.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10625/15625) 010625-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10-valid  train : [loss = 1.137, top1 = 59.73%], valid : [loss = 1.177, top1 = 58.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10        train : [loss = 1.078, top1 = 62.08%], test  : [loss = 1.079, top1 = 61.72%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.84 ms.
cifar100       train : [loss = 2.569, top1 = 35.00%], valid : [loss = 2.642, top1 = 33.94%], test : [loss = 2.624, top1 = 34.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.98 ms.
ImageNet16-120 train : [loss = 3.797, top1 = 13.48%], valid : [loss = 3.774, top1 = 14.56%], test : [loss = 3.794, top1 = 13.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10626/15625) 010626-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10627/15625) 010627-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.493, top1 = 88.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.96 ms.
cifar10        train : [loss = 0.029, top1 = 99.30%], test  : [loss = 0.355, top1 = 90.87%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.04 ms.
cifar100       train : [loss = 0.400, top1 = 88.84%], valid : [loss = 1.284, top1 = 67.06%], test : [loss = 1.281, top1 = 67.06%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.50%], valid : [loss = 2.390, top1 = 39.67%], test : [loss = 2.412, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.73%], valid : [loss = 0.607, top1 = 79.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10628/15625) 010628-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.458, top1 = 89.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.329, top1 = 91.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.47 ms.
cifar100       train : [loss = 0.207, top1 = 94.68%], valid : [loss = 1.375, top1 = 67.58%], test : [loss = 1.362, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.50%], valid : [loss = 2.303, top1 = 40.80%], test : [loss = 2.333, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.24%], valid : [loss = 0.635, top1 = 78.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10629/15625) 010629-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.27%], valid : [loss = 0.456, top1 = 86.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10        train : [loss = 0.111, top1 = 96.60%], test  : [loss = 0.327, top1 = 89.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.96 ms.
cifar100       train : [loss = 0.860, top1 = 75.57%], valid : [loss = 1.287, top1 = 64.26%], test : [loss = 1.268, top1 = 63.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.57%], valid : [loss = 2.620, top1 = 34.24%], test : [loss = 2.650, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.43%], valid : [loss = 0.664, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10630/15625) 010630-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.456, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.329, top1 = 91.02%], valid : [loss = 1.282, top1 = 67.33%], test : [loss = 1.296, top1 = 67.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.35%], valid : [loss = 2.352, top1 = 40.29%], test : [loss = 2.405, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.23%], valid : [loss = 0.557, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10631/15625) 010631-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.86 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.445, top1 = 90.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.98 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.291, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.00 ms.
cifar100       train : [loss = 0.188, top1 = 95.71%], valid : [loss = 1.277, top1 = 69.14%], test : [loss = 1.273, top1 = 68.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.28 ms.
ImageNet16-120 train : [loss = 1.813, top1 = 51.89%], valid : [loss = 2.236, top1 = 43.13%], test : [loss = 2.288, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 85.62%], valid : [loss = 0.534, top1 = 82.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10632/15625) 010632-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.513, top1 = 89.85%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.66 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.345, top1 = 93.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.71 ms.
cifar100       train : [loss = 0.069, top1 = 98.92%], valid : [loss = 1.333, top1 = 70.04%], test : [loss = 1.343, top1 = 69.68%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.78%], valid : [loss = 2.196, top1 = 44.17%], test : [loss = 2.194, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.47%], valid : [loss = 0.639, top1 = 78.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10633/15625) 010633-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.41 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.571, top1 = 87.94%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.341, top1 = 92.43%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.85 ms.
cifar100       train : [loss = 0.305, top1 = 91.42%], valid : [loss = 1.317, top1 = 67.46%], test : [loss = 1.378, top1 = 66.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.36 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.05%], valid : [loss = 2.448, top1 = 38.20%], test : [loss = 2.453, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 71.89%], valid : [loss = 0.833, top1 = 70.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10634/15625) 010634-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.31%], valid : [loss = 0.461, top1 = 86.46%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=21.14 ms.
cifar10        train : [loss = 0.104, top1 = 96.80%], test  : [loss = 0.332, top1 = 89.65%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=21.20 ms.
cifar100       train : [loss = 0.675, top1 = 81.31%], valid : [loss = 1.266, top1 = 64.32%], test : [loss = 1.281, top1 = 65.32%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.450, top1 = 37.72%], valid : [loss = 2.547, top1 = 35.43%], test : [loss = 2.580, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.67%], valid : [loss = 0.871, top1 = 69.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10635/15625) 010635-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.450, top1 = 89.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.304, top1 = 92.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.85 ms.
cifar100       train : [loss = 0.156, top1 = 96.67%], valid : [loss = 1.269, top1 = 68.90%], test : [loss = 1.256, top1 = 70.10%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.66 ms.
ImageNet16-120 train : [loss = 1.788, top1 = 52.47%], valid : [loss = 2.219, top1 = 42.90%], test : [loss = 2.270, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.09%], valid : [loss = 0.516, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10636/15625) 010636-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.427, top1 = 90.86%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.23 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.299, top1 = 93.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.13 ms.
cifar100       train : [loss = 0.050, top1 = 99.40%], valid : [loss = 1.335, top1 = 70.77%], test : [loss = 1.341, top1 = 70.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.478, top1 = 59.87%], valid : [loss = 2.245, top1 = 44.22%], test : [loss = 2.247, top1 = 44.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.85%], valid : [loss = 0.528, top1 = 82.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10637/15625) 010637-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.498, top1 = 90.12%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.81 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.315, top1 = 93.07%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.56 ms.
cifar100       train : [loss = 0.041, top1 = 99.55%], valid : [loss = 1.313, top1 = 70.20%], test : [loss = 1.375, top1 = 69.78%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 48.98%], valid : [loss = 2.298, top1 = 41.13%], test : [loss = 2.287, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.12%], valid : [loss = 0.716, top1 = 74.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10638/15625) 010638-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.53 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.96 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10639/15625) 010639-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.439, top1 = 89.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.333, top1 = 91.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.333, top1 = 91.00%], valid : [loss = 1.310, top1 = 67.06%], test : [loss = 1.335, top1 = 67.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.17%], valid : [loss = 2.371, top1 = 40.03%], test : [loss = 2.441, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.32%], valid : [loss = 0.547, top1 = 81.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10640/15625) 010640-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.497, top1 = 88.86%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.78 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.296, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.92 ms.
cifar100       train : [loss = 0.292, top1 = 92.50%], valid : [loss = 1.237, top1 = 67.76%], test : [loss = 1.212, top1 = 68.20%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.99%], valid : [loss = 2.225, top1 = 43.10%], test : [loss = 2.216, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.18%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10641/15625) 010641-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.469, top1 = 90.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.315, top1 = 93.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.074, top1 = 98.77%], valid : [loss = 1.391, top1 = 69.64%], test : [loss = 1.353, top1 = 70.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 1.585, top1 = 57.30%], valid : [loss = 2.232, top1 = 44.03%], test : [loss = 2.244, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.11%], valid : [loss = 0.553, top1 = 81.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10642/15625) 010642-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.50%], valid : [loss = 0.746, top1 = 74.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.476, top1 = 83.20%], test  : [loss = 0.597, top1 = 80.21%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 1.864, top1 = 49.39%], valid : [loss = 2.043, top1 = 45.80%], test : [loss = 2.038, top1 = 46.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.505, top1 = 17.63%], valid : [loss = 3.493, top1 = 18.90%], test : [loss = 3.526, top1 = 18.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.24%], valid : [loss = 1.245, top1 = 55.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10643/15625) 010643-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.64%], valid : [loss = 0.483, top1 = 84.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.47 ms.
cifar10        train : [loss = 0.299, top1 = 90.03%], test  : [loss = 0.397, top1 = 86.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 1.339, top1 = 62.91%], valid : [loss = 1.538, top1 = 57.84%], test : [loss = 1.526, top1 = 57.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.62%], valid : [loss = 2.911, top1 = 28.10%], test : [loss = 2.952, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10644/15625) 010644-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.40%], valid : [loss = 0.561, top1 = 82.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.42 ms.
cifar10        train : [loss = 0.285, top1 = 90.12%], test  : [loss = 0.416, top1 = 86.21%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.59 ms.
cifar100       train : [loss = 1.333, top1 = 62.26%], valid : [loss = 1.646, top1 = 55.68%], test : [loss = 1.636, top1 = 55.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.34%], valid : [loss = 3.075, top1 = 25.37%], test : [loss = 3.108, top1 = 25.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.252, top1 = 54.22%], valid : [loss = 1.303, top1 = 52.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10645/15625) 010645-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.48%], valid : [loss = 0.925, top1 = 75.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.87 ms.
cifar10        train : [loss = 0.219, top1 = 92.44%], test  : [loss = 0.609, top1 = 81.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.83 ms.
cifar100       train : [loss = 1.138, top1 = 67.39%], valid : [loss = 1.766, top1 = 54.30%], test : [loss = 1.766, top1 = 54.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 3.221, top1 = 22.86%], valid : [loss = 3.327, top1 = 22.20%], test : [loss = 3.362, top1 = 20.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.59%], valid : [loss = 1.130, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10646/15625) 010646-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.562, top1 = 87.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=14.26 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.379, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 0.408, top1 = 88.51%], valid : [loss = 1.392, top1 = 65.06%], test : [loss = 1.386, top1 = 65.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.78%], valid : [loss = 2.502, top1 = 37.50%], test : [loss = 2.541, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.88%], valid : [loss = 0.791, top1 = 72.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10647/15625) 010647-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.58%], valid : [loss = 0.450, top1 = 87.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10        train : [loss = 0.056, top1 = 98.66%], test  : [loss = 0.326, top1 = 90.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.78 ms.
cifar100       train : [loss = 0.593, top1 = 83.74%], valid : [loss = 1.198, top1 = 67.50%], test : [loss = 1.201, top1 = 66.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.24%], valid : [loss = 2.445, top1 = 37.77%], test : [loss = 2.496, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.12%], valid : [loss = 0.652, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10648/15625) 010648-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.437, top1 = 89.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.303, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.323, top1 = 91.40%], valid : [loss = 1.266, top1 = 67.98%], test : [loss = 1.302, top1 = 67.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.10%], valid : [loss = 2.404, top1 = 39.30%], test : [loss = 2.432, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.89%], valid : [loss = 0.559, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10649/15625) 010649-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.467, top1 = 89.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.322, top1 = 92.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.69 ms.
cifar100       train : [loss = 0.248, top1 = 93.69%], valid : [loss = 1.219, top1 = 69.20%], test : [loss = 1.241, top1 = 68.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.35%], valid : [loss = 2.207, top1 = 44.20%], test : [loss = 2.207, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.36%], valid : [loss = 0.634, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10650/15625) 010650-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.459, top1 = 89.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.327, top1 = 91.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 0.328, top1 = 91.05%], valid : [loss = 1.275, top1 = 67.71%], test : [loss = 1.283, top1 = 68.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.28%], valid : [loss = 2.349, top1 = 40.52%], test : [loss = 2.411, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.00%], valid : [loss = 0.556, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10651/15625) 010651-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.85%], valid : [loss = 0.543, top1 = 83.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.193, top1 = 93.44%], test  : [loss = 0.402, top1 = 87.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.86 ms.
cifar100       train : [loss = 1.263, top1 = 64.24%], valid : [loss = 1.570, top1 = 57.06%], test : [loss = 1.558, top1 = 57.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.687, top1 = 32.85%], valid : [loss = 2.707, top1 = 31.73%], test : [loss = 2.752, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.20%], valid : [loss = 1.001, top1 = 64.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10652/15625) 010652-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.48%], valid : [loss = 0.856, top1 = 72.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.547, top1 = 80.87%], test  : [loss = 0.708, top1 = 75.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 1.772, top1 = 52.21%], valid : [loss = 2.048, top1 = 46.60%], test : [loss = 2.057, top1 = 47.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.83%], valid : [loss = 3.643, top1 = 16.20%], test : [loss = 3.680, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10653/15625) 010653-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.16%], valid : [loss = 0.578, top1 = 81.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10        train : [loss = 0.257, top1 = 91.20%], test  : [loss = 0.396, top1 = 86.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.10 ms.
cifar100       train : [loss = 1.503, top1 = 57.98%], valid : [loss = 1.755, top1 = 52.83%], test : [loss = 1.748, top1 = 52.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.60%], valid : [loss = 2.960, top1 = 27.24%], test : [loss = 3.017, top1 = 26.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10654/15625) 010654-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.569, top1 = 88.98%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.19 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.338, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.41 ms.
cifar100       train : [loss = 0.072, top1 = 98.75%], valid : [loss = 1.379, top1 = 69.18%], test : [loss = 1.370, top1 = 69.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.680, top1 = 54.89%], valid : [loss = 2.249, top1 = 43.00%], test : [loss = 2.254, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.99%], valid : [loss = 0.738, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10655/15625) 010655-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.01%], valid : [loss = 0.466, top1 = 86.72%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.19 ms.
cifar10        train : [loss = 0.109, top1 = 96.66%], test  : [loss = 0.334, top1 = 89.23%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.59 ms.
cifar100       train : [loss = 0.720, top1 = 79.82%], valid : [loss = 1.284, top1 = 64.32%], test : [loss = 1.294, top1 = 64.78%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.97%], valid : [loss = 2.550, top1 = 36.40%], test : [loss = 2.548, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.69%], valid : [loss = 0.771, top1 = 72.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10656/15625) 010656-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.516, top1 = 88.09%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.29 ms.
cifar10        train : [loss = 0.020, top1 = 99.51%], test  : [loss = 0.305, top1 = 92.21%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.17 ms.
cifar100       train : [loss = 0.291, top1 = 92.33%], valid : [loss = 1.197, top1 = 69.38%], test : [loss = 1.185, top1 = 68.72%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.78%], valid : [loss = 2.221, top1 = 42.77%], test : [loss = 2.241, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.32%], valid : [loss = 0.708, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10657/15625) 010657-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.289, top1 = 90.06%], valid : [loss = 0.558, top1 = 82.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.274, top1 = 90.60%], test  : [loss = 0.427, top1 = 86.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.46 ms.
cifar100       train : [loss = 1.397, top1 = 60.70%], valid : [loss = 1.656, top1 = 54.90%], test : [loss = 1.652, top1 = 55.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 2.954, top1 = 27.78%], valid : [loss = 2.963, top1 = 27.70%], test : [loss = 3.014, top1 = 26.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 65.24%], valid : [loss = 1.038, top1 = 63.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10658/15625) 010658-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.405, top1 = 90.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.278, top1 = 93.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.08 ms.
cifar100       train : [loss = 0.172, top1 = 96.04%], valid : [loss = 1.275, top1 = 69.70%], test : [loss = 1.276, top1 = 69.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 1.795, top1 = 52.27%], valid : [loss = 2.235, top1 = 43.62%], test : [loss = 2.269, top1 = 42.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.94%], valid : [loss = 0.504, top1 = 82.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10659/15625) 010659-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.76 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.51 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10660/15625) 010660-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.607, top1 = 87.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.379, top1 = 91.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.138, top1 = 97.14%], valid : [loss = 1.469, top1 = 66.14%], test : [loss = 1.486, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.19 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.74%], valid : [loss = 2.473, top1 = 38.07%], test : [loss = 2.484, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.785, top1 = 72.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10661/15625) 010661-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.527, top1 = 88.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.75 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.336, top1 = 92.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.88 ms.
cifar100       train : [loss = 0.229, top1 = 94.00%], valid : [loss = 1.307, top1 = 67.96%], test : [loss = 1.289, top1 = 68.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.42%], valid : [loss = 2.416, top1 = 39.67%], test : [loss = 2.432, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.74%], valid : [loss = 0.906, top1 = 67.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10662/15625) 010662-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.48%], valid : [loss = 0.713, top1 = 80.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10        train : [loss = 0.203, top1 = 92.99%], test  : [loss = 0.516, top1 = 84.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.56 ms.
cifar100       train : [loss = 0.906, top1 = 73.71%], valid : [loss = 1.607, top1 = 57.90%], test : [loss = 1.649, top1 = 56.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 3.509, top1 = 16.70%], valid : [loss = 3.502, top1 = 17.83%], test : [loss = 3.505, top1 = 17.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.224, top1 = 55.53%], valid : [loss = 1.240, top1 = 55.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10663/15625) 010663-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.486, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.303, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.318, top1 = 91.45%], valid : [loss = 1.257, top1 = 67.64%], test : [loss = 1.273, top1 = 67.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.81%], valid : [loss = 2.324, top1 = 40.69%], test : [loss = 2.349, top1 = 39.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.49%], valid : [loss = 0.613, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10664/15625) 010664-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.02%], valid : [loss = 0.857, top1 = 71.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.50 ms.
cifar10        train : [loss = 0.558, top1 = 80.62%], test  : [loss = 0.720, top1 = 75.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.14 ms.
cifar100       train : [loss = 1.751, top1 = 52.80%], valid : [loss = 2.018, top1 = 47.80%], test : [loss = 2.044, top1 = 48.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.90%], valid : [loss = 3.630, top1 = 17.03%], test : [loss = 3.670, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10665/15625) 010665-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.524, top1 = 88.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.27 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.353, top1 = 91.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.66 ms.
cifar100       train : [loss = 0.470, top1 = 86.13%], valid : [loss = 1.342, top1 = 65.78%], test : [loss = 1.338, top1 = 65.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.16%], valid : [loss = 2.528, top1 = 36.30%], test : [loss = 2.571, top1 = 34.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.88%], valid : [loss = 0.661, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10666/15625) 010666-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.532, top1 = 88.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.335, top1 = 91.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.247, top1 = 93.82%], valid : [loss = 1.278, top1 = 68.02%], test : [loss = 1.241, top1 = 69.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 47.90%], valid : [loss = 2.293, top1 = 40.63%], test : [loss = 2.306, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.68%], valid : [loss = 0.683, top1 = 76.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10667/15625) 010667-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.61%], valid : [loss = 0.542, top1 = 87.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.026, top1 = 99.21%], test  : [loss = 0.346, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.412, top1 = 88.07%], valid : [loss = 1.231, top1 = 66.92%], test : [loss = 1.266, top1 = 67.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.16%], valid : [loss = 2.408, top1 = 38.63%], test : [loss = 2.426, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10668/15625) 010668-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.17%], valid : [loss = 0.555, top1 = 86.87%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=16.50 ms.
cifar10        train : [loss = 0.053, top1 = 98.34%], test  : [loss = 0.378, top1 = 90.03%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=15.28 ms.
cifar100       train : [loss = 0.595, top1 = 82.62%], valid : [loss = 1.295, top1 = 65.15%], test : [loss = 1.314, top1 = 65.09%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.69%], valid : [loss = 2.464, top1 = 37.38%], test : [loss = 2.481, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.07%], valid : [loss = 0.737, top1 = 74.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10669/15625) 010669-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.128, top1 = 95.76%], valid : [loss = 0.845, top1 = 78.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10        train : [loss = 0.167, top1 = 94.27%], test  : [loss = 0.478, top1 = 85.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 1.135, top1 = 67.45%], valid : [loss = 1.770, top1 = 54.18%], test : [loss = 1.819, top1 = 53.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.831, top1 = 29.98%], valid : [loss = 2.971, top1 = 27.03%], test : [loss = 3.004, top1 = 27.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 67.14%], valid : [loss = 0.992, top1 = 64.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10670/15625) 010670-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.500, top1 = 89.36%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.321, top1 = 92.50%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.48 ms.
cifar100       train : [loss = 0.150, top1 = 96.78%], valid : [loss = 1.294, top1 = 69.36%], test : [loss = 1.320, top1 = 69.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 1.788, top1 = 52.45%], valid : [loss = 2.197, top1 = 43.30%], test : [loss = 2.243, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.79%], valid : [loss = 0.641, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10671/15625) 010671-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.635, top1 = 86.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.018, top1 = 99.49%], test  : [loss = 0.423, top1 = 90.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.264, top1 = 93.00%], valid : [loss = 1.585, top1 = 63.08%], test : [loss = 1.591, top1 = 64.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.200, top1 = 42.98%], valid : [loss = 2.565, top1 = 35.23%], test : [loss = 2.611, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.45%], valid : [loss = 0.848, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10672/15625) 010672-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.29 ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.71%], valid : [loss = 0.532, top1 = 82.12%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.24 ms.
cifar10        train : [loss = 0.404, top1 = 86.19%], test  : [loss = 0.472, top1 = 83.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.17 ms.
cifar100       train : [loss = 1.566, top1 = 57.24%], valid : [loss = 1.679, top1 = 54.16%], test : [loss = 1.675, top1 = 54.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.57 ms.
ImageNet16-120 train : [loss = 3.049, top1 = 26.25%], valid : [loss = 3.016, top1 = 26.83%], test : [loss = 3.047, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10673/15625) 010673-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.04%], valid : [loss = 0.474, top1 = 84.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10        train : [loss = 0.300, top1 = 89.96%], test  : [loss = 0.409, top1 = 86.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 1.329, top1 = 63.30%], valid : [loss = 1.525, top1 = 58.52%], test : [loss = 1.513, top1 = 57.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.51%], valid : [loss = 2.895, top1 = 29.47%], test : [loss = 2.941, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10674/15625) 010674-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.550, top1 = 88.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.347, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.304, top1 = 91.78%], valid : [loss = 1.332, top1 = 66.64%], test : [loss = 1.337, top1 = 66.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.67%], valid : [loss = 2.365, top1 = 39.77%], test : [loss = 2.380, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.88%], valid : [loss = 0.808, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10675/15625) 010675-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.94%], valid : [loss = 0.861, top1 = 71.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.552, top1 = 80.78%], test  : [loss = 0.713, top1 = 75.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 1.791, top1 = 51.70%], valid : [loss = 2.056, top1 = 47.54%], test : [loss = 2.059, top1 = 46.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.77%], valid : [loss = 3.651, top1 = 16.40%], test : [loss = 3.667, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10676/15625) 010676-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.27 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.429, top1 = 91.22%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=18.88 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.295, top1 = 94.13%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.16 ms.
cifar100       train : [loss = 0.025, top1 = 99.81%], valid : [loss = 1.257, top1 = 71.94%], test : [loss = 1.242, top1 = 72.50%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.64 ms.
ImageNet16-120 train : [loss = 1.190, top1 = 67.01%], valid : [loss = 2.199, top1 = 46.77%], test : [loss = 2.245, top1 = 45.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.68%], valid : [loss = 0.469, top1 = 84.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10677/15625) 010677-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10678/15625) 010678-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.326, top1 = 91.23%], valid : [loss = 1.256, top1 = 67.55%], test : [loss = 1.248, top1 = 68.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.77%], valid : [loss = 2.321, top1 = 40.71%], test : [loss = 2.337, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10679/15625) 010679-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.78 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.62%], valid : [loss = 0.468, top1 = 85.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10        train : [loss = 0.154, top1 = 94.97%], test  : [loss = 0.343, top1 = 88.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.65 ms.
cifar100       train : [loss = 1.000, top1 = 71.57%], valid : [loss = 1.343, top1 = 62.40%], test : [loss = 1.348, top1 = 62.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.12 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.78%], valid : [loss = 2.678, top1 = 33.53%], test : [loss = 2.707, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10680/15625) 010680-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.60 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.78%], valid : [loss = 0.851, top1 = 80.83%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.085, top1 = 97.27%], test  : [loss = 0.493, top1 = 86.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.83 ms.
cifar100       train : [loss = 0.800, top1 = 76.71%], valid : [loss = 1.532, top1 = 59.70%], test : [loss = 1.519, top1 = 61.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.05%], valid : [loss = 2.942, top1 = 28.70%], test : [loss = 2.993, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.02%], valid : [loss = 0.848, top1 = 70.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10681/15625) 010681-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.659, top1 = 86.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.437, top1 = 89.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.19 ms.
cifar100       train : [loss = 0.299, top1 = 91.97%], valid : [loss = 1.547, top1 = 63.52%], test : [loss = 1.514, top1 = 64.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 43.03%], valid : [loss = 2.529, top1 = 36.50%], test : [loss = 2.570, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 71.92%], valid : [loss = 0.833, top1 = 70.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10682/15625) 010682-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.38%], valid : [loss = 0.701, top1 = 84.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.055, top1 = 98.32%], test  : [loss = 0.454, top1 = 88.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.88 ms.
cifar100       train : [loss = 0.625, top1 = 81.66%], valid : [loss = 1.553, top1 = 60.96%], test : [loss = 1.528, top1 = 61.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.39%], valid : [loss = 2.834, top1 = 29.73%], test : [loss = 2.893, top1 = 29.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.68%], valid : [loss = 0.892, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10683/15625) 010683-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.512, top1 = 88.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.309, top1 = 92.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.42 ms.
cifar100       train : [loss = 0.337, top1 = 90.78%], valid : [loss = 1.276, top1 = 67.18%], test : [loss = 1.284, top1 = 66.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.81%], valid : [loss = 2.405, top1 = 38.33%], test : [loss = 2.390, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10684/15625) 010684-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.527, top1 = 89.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.323, top1 = 92.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.03 ms.
cifar100       train : [loss = 0.151, top1 = 96.83%], valid : [loss = 1.260, top1 = 69.37%], test : [loss = 1.275, top1 = 69.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.82 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.40%], valid : [loss = 2.307, top1 = 41.16%], test : [loss = 2.299, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10685/15625) 010685-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.528, top1 = 88.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.376, top1 = 91.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.69 ms.
cifar100       train : [loss = 0.241, top1 = 93.57%], valid : [loss = 1.481, top1 = 65.60%], test : [loss = 1.500, top1 = 65.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 2.706, top1 = 31.75%], valid : [loss = 2.775, top1 = 29.97%], test : [loss = 2.863, top1 = 28.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.267, top1 = 53.76%], valid : [loss = 1.278, top1 = 53.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10686/15625) 010686-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.542, top1 = 87.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.32 ms.
cifar10        train : [loss = 0.035, top1 = 98.96%], test  : [loss = 0.331, top1 = 91.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.62 ms.
cifar100       train : [loss = 0.451, top1 = 86.71%], valid : [loss = 1.296, top1 = 66.64%], test : [loss = 1.269, top1 = 67.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.32%], valid : [loss = 2.427, top1 = 38.30%], test : [loss = 2.431, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.41%], valid : [loss = 0.968, top1 = 65.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10687/15625) 010687-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.514, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.324, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.23 ms.
cifar100       train : [loss = 0.134, top1 = 97.32%], valid : [loss = 1.276, top1 = 68.92%], test : [loss = 1.307, top1 = 68.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.47%], valid : [loss = 2.249, top1 = 43.10%], test : [loss = 2.258, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.26%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10688/15625) 010688-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.593, top1 = 87.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.06 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.390, top1 = 90.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.69 ms.
cifar100       train : [loss = 0.401, top1 = 88.65%], valid : [loss = 1.387, top1 = 65.50%], test : [loss = 1.384, top1 = 65.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.98%], valid : [loss = 2.489, top1 = 36.53%], test : [loss = 2.512, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.53%], valid : [loss = 0.827, top1 = 70.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10689/15625) 010689-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.44%], valid : [loss = 0.434, top1 = 88.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10        train : [loss = 0.053, top1 = 98.73%], test  : [loss = 0.311, top1 = 90.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.21 ms.
cifar100       train : [loss = 0.603, top1 = 83.25%], valid : [loss = 1.225, top1 = 66.84%], test : [loss = 1.212, top1 = 67.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.94%], valid : [loss = 2.479, top1 = 37.50%], test : [loss = 2.503, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10690/15625) 010690-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.632, top1 = 86.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.422, top1 = 90.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.72 ms.
cifar100       train : [loss = 0.218, top1 = 94.91%], valid : [loss = 1.581, top1 = 64.52%], test : [loss = 1.607, top1 = 64.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.94%], valid : [loss = 2.624, top1 = 35.27%], test : [loss = 2.613, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 74.95%], valid : [loss = 0.785, top1 = 72.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10691/15625) 010691-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.579, top1 = 88.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.66 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.366, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.79 ms.
cifar100       train : [loss = 0.174, top1 = 96.19%], valid : [loss = 1.380, top1 = 67.68%], test : [loss = 1.386, top1 = 67.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.86%], valid : [loss = 2.483, top1 = 38.07%], test : [loss = 2.510, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10692/15625) 010692-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.10%], valid : [loss = 0.451, top1 = 86.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.158, top1 = 94.85%], test  : [loss = 0.333, top1 = 89.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.85 ms.
cifar100       train : [loss = 0.993, top1 = 71.79%], valid : [loss = 1.355, top1 = 62.10%], test : [loss = 1.357, top1 = 61.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.39%], valid : [loss = 2.658, top1 = 33.77%], test : [loss = 2.686, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10693/15625) 010693-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.33 ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.69%], valid : [loss = 1.108, top1 = 63.08%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.797, top1 = 71.96%], test  : [loss = 0.935, top1 = 67.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.07 ms.
cifar100       train : [loss = 2.141, top1 = 43.93%], valid : [loss = 2.397, top1 = 39.68%], test : [loss = 2.422, top1 = 39.06%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.41 ms.
ImageNet16-120 train : [loss = 3.766, top1 = 13.86%], valid : [loss = 3.819, top1 = 13.87%], test : [loss = 3.834, top1 = 13.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10694/15625) 010694-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.304, top1 = 92.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.51 ms.
cifar100       train : [loss = 0.155, top1 = 96.72%], valid : [loss = 1.268, top1 = 69.06%], test : [loss = 1.287, top1 = 69.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.01%], valid : [loss = 2.288, top1 = 41.27%], test : [loss = 2.294, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 79.01%], valid : [loss = 0.676, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10695/15625) 010695-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.543, top1 = 88.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.87 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.372, top1 = 91.78%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.08 ms.
cifar100       train : [loss = 0.247, top1 = 93.41%], valid : [loss = 1.289, top1 = 68.22%], test : [loss = 1.299, top1 = 68.62%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.63%], valid : [loss = 2.490, top1 = 36.87%], test : [loss = 2.488, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.70%], valid : [loss = 0.919, top1 = 67.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10696/15625) 010696-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.66%], valid : [loss = 0.834, top1 = 72.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10        train : [loss = 0.569, top1 = 80.07%], test  : [loss = 0.720, top1 = 75.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.37 ms.
cifar100       train : [loss = 1.812, top1 = 51.35%], valid : [loss = 2.064, top1 = 47.10%], test : [loss = 2.070, top1 = 46.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.83%], valid : [loss = 3.632, top1 = 16.70%], test : [loss = 3.662, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.22%], valid : [loss = 1.258, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10697/15625) 010697-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.78%], valid : [loss = 0.857, top1 = 70.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.62 ms.
cifar10        train : [loss = 0.686, top1 = 75.95%], test  : [loss = 0.774, top1 = 73.42%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.93 ms.
cifar100       train : [loss = 1.958, top1 = 47.85%], valid : [loss = 2.143, top1 = 44.92%], test : [loss = 2.162, top1 = 44.44%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 3.648, top1 = 15.77%], valid : [loss = 3.665, top1 = 16.23%], test : [loss = 3.699, top1 = 14.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10698/15625) 010698-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.86 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.77%], valid : [loss = 0.509, top1 = 85.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10        train : [loss = 0.156, top1 = 94.82%], test  : [loss = 0.373, top1 = 88.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.12 ms.
cifar100       train : [loss = 1.097, top1 = 68.62%], valid : [loss = 1.476, top1 = 59.70%], test : [loss = 1.469, top1 = 60.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.94%], valid : [loss = 2.672, top1 = 33.74%], test : [loss = 2.718, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.52%], valid : [loss = 0.955, top1 = 66.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10699/15625) 010699-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.001, top1 = 100.00%], valid : [loss = 0.433, top1 = 91.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.06 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.287, top1 = 94.12%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.63 ms.
cifar100       train : [loss = 0.027, top1 = 99.73%], valid : [loss = 1.373, top1 = 71.54%], test : [loss = 1.353, top1 = 71.38%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 1.269, top1 = 65.06%], valid : [loss = 2.208, top1 = 45.80%], test : [loss = 2.205, top1 = 46.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.318, top1 = 89.32%], valid : [loss = 0.477, top1 = 84.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10700/15625) 010700-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.62%], valid : [loss = 0.541, top1 = 85.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10        train : [loss = 0.115, top1 = 96.31%], test  : [loss = 0.377, top1 = 89.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.911, top1 = 73.52%], valid : [loss = 1.478, top1 = 60.90%], test : [loss = 1.453, top1 = 60.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.57 ms.
ImageNet16-120 train : [loss = 2.571, top1 = 35.21%], valid : [loss = 2.683, top1 = 32.93%], test : [loss = 2.677, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.48%], valid : [loss = 0.934, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10701/15625) 010701-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.84%], valid : [loss = 0.535, top1 = 84.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.180, top1 = 93.87%], test  : [loss = 0.382, top1 = 87.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.25 ms.
cifar100       train : [loss = 1.194, top1 = 66.02%], valid : [loss = 1.517, top1 = 58.21%], test : [loss = 1.502, top1 = 58.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.87%], valid : [loss = 2.686, top1 = 32.88%], test : [loss = 2.724, top1 = 32.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.60%], valid : [loss = 0.959, top1 = 66.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10702/15625) 010702-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.57%], valid : [loss = 0.605, top1 = 84.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.24 ms.
cifar10        train : [loss = 0.095, top1 = 96.86%], test  : [loss = 0.434, top1 = 88.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.80 ms.
cifar100       train : [loss = 0.747, top1 = 78.18%], valid : [loss = 1.599, top1 = 59.30%], test : [loss = 1.585, top1 = 59.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 3.124, top1 = 23.52%], valid : [loss = 3.147, top1 = 22.00%], test : [loss = 3.179, top1 = 22.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10703/15625) 010703-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.307, top1 = 93.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.85 ms.
cifar100       train : [loss = 0.121, top1 = 97.75%], valid : [loss = 1.294, top1 = 69.23%], test : [loss = 1.302, top1 = 69.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 1.758, top1 = 53.09%], valid : [loss = 2.241, top1 = 43.28%], test : [loss = 2.233, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.25%], valid : [loss = 0.678, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10704/15625) 010704-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.501, top1 = 88.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.348, top1 = 91.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.24 ms.
cifar100       train : [loss = 0.265, top1 = 93.17%], valid : [loss = 1.322, top1 = 67.54%], test : [loss = 1.323, top1 = 68.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.56%], valid : [loss = 2.414, top1 = 39.67%], test : [loss = 2.469, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.67%], valid : [loss = 0.624, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10705/15625) 010705-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.619, top1 = 86.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.026, top1 = 99.30%], test  : [loss = 0.374, top1 = 90.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.67 ms.
cifar100       train : [loss = 0.472, top1 = 86.35%], valid : [loss = 1.451, top1 = 63.88%], test : [loss = 1.428, top1 = 63.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.63%], valid : [loss = 2.502, top1 = 36.83%], test : [loss = 2.526, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.02%], valid : [loss = 0.846, top1 = 70.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10706/15625) 010706-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.493, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.328, top1 = 91.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.83 ms.
cifar100       train : [loss = 0.196, top1 = 95.21%], valid : [loss = 1.365, top1 = 68.08%], test : [loss = 1.347, top1 = 67.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.21%], valid : [loss = 2.366, top1 = 39.93%], test : [loss = 2.401, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.77%], valid : [loss = 0.571, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10707/15625) 010707-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.501, top1 = 88.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.334, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.85 ms.
cifar100       train : [loss = 0.332, top1 = 91.04%], valid : [loss = 1.287, top1 = 66.98%], test : [loss = 1.282, top1 = 67.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 44.90%], valid : [loss = 2.402, top1 = 39.11%], test : [loss = 2.417, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10708/15625) 010708-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.88%], valid : [loss = 0.906, top1 = 68.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.91 ms.
cifar10        train : [loss = 0.702, top1 = 75.32%], test  : [loss = 0.759, top1 = 73.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.84 ms.
cifar100       train : [loss = 2.160, top1 = 42.67%], valid : [loss = 2.253, top1 = 41.14%], test : [loss = 2.261, top1 = 40.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 3.434, top1 = 18.96%], valid : [loss = 3.419, top1 = 19.31%], test : [loss = 3.433, top1 = 19.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 50.86%], valid : [loss = 1.381, top1 = 50.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10709/15625) 010709-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.668 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.487, top1 = 89.06%]
cifar10        FLOP= 94.29 M, Params=0.668 MB, latency=19.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.43%]
cifar100       FLOP= 94.30 M, Params=0.674 MB, latency=18.62 ms.
cifar100       train : [loss = 0.318, top1 = 91.52%], valid : [loss = 1.242, top1 = 67.79%], test : [loss = 1.255, top1 = 67.52%]
ImageNet16-120 FLOP= 23.58 M, Params=0.676 MB, latency=21.28 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.59%], valid : [loss = 2.338, top1 = 40.01%], test : [loss = 2.356, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.44%], valid : [loss = 0.586, top1 = 80.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10710/15625) 010710-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.535, top1 = 88.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.372, top1 = 91.55%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.308, top1 = 91.56%], valid : [loss = 1.374, top1 = 66.36%], test : [loss = 1.379, top1 = 65.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.95%], valid : [loss = 2.365, top1 = 39.90%], test : [loss = 2.421, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.07%], valid : [loss = 0.630, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10711/15625) 010711-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.565, top1 = 88.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.382, top1 = 91.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.42 ms.
cifar100       train : [loss = 0.279, top1 = 92.31%], valid : [loss = 1.377, top1 = 66.90%], test : [loss = 1.383, top1 = 66.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.095, top1 = 45.55%], valid : [loss = 2.354, top1 = 39.80%], test : [loss = 2.350, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.76%], valid : [loss = 0.963, top1 = 66.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10712/15625) 010712-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.45 ms.
cifar10-valid  train : [loss = 0.935, top1 = 67.29%], valid : [loss = 0.976, top1 = 66.21%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.94 ms.
cifar10        train : [loss = 0.916, top1 = 68.22%], test  : [loss = 0.909, top1 = 68.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.45 ms.
cifar100       train : [loss = 2.396, top1 = 38.79%], valid : [loss = 2.469, top1 = 37.36%], test : [loss = 2.455, top1 = 37.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.25 ms.
ImageNet16-120 train : [loss = 3.632, top1 = 15.92%], valid : [loss = 3.594, top1 = 17.02%], test : [loss = 3.640, top1 = 16.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.607, top1 = 39.57%], valid : [loss = 1.631, top1 = 38.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10713/15625) 010713-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.26 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10714/15625) 010714-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.268, top1 = 90.99%], valid : [loss = 0.475, top1 = 84.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10        train : [loss = 0.302, top1 = 89.82%], test  : [loss = 0.403, top1 = 86.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.44 ms.
cifar100       train : [loss = 1.326, top1 = 63.20%], valid : [loss = 1.527, top1 = 58.20%], test : [loss = 1.517, top1 = 58.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.63%], valid : [loss = 2.891, top1 = 30.27%], test : [loss = 2.957, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10715/15625) 010715-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.409, top1 = 91.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.272, top1 = 93.67%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.96 ms.
cifar100       train : [loss = 0.054, top1 = 99.32%], valid : [loss = 1.268, top1 = 72.10%], test : [loss = 1.258, top1 = 71.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 1.443, top1 = 60.69%], valid : [loss = 2.180, top1 = 45.60%], test : [loss = 2.213, top1 = 45.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.317, top1 = 89.34%], valid : [loss = 0.470, top1 = 84.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10716/15625) 010716-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.55%], valid : [loss = 0.863, top1 = 75.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10        train : [loss = 0.308, top1 = 89.33%], test  : [loss = 0.626, top1 = 80.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.78 ms.
cifar100       train : [loss = 1.370, top1 = 61.64%], valid : [loss = 1.931, top1 = 49.48%], test : [loss = 1.956, top1 = 49.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 3.508, top1 = 17.16%], valid : [loss = 3.551, top1 = 16.37%], test : [loss = 3.522, top1 = 17.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.243, top1 = 54.60%], valid : [loss = 1.282, top1 = 53.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10717/15625) 010717-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.97%], valid : [loss = 0.832, top1 = 72.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.565, top1 = 80.37%], test  : [loss = 0.710, top1 = 75.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.49 ms.
cifar100       train : [loss = 1.804, top1 = 51.37%], valid : [loss = 2.045, top1 = 47.28%], test : [loss = 2.086, top1 = 45.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.81%], valid : [loss = 3.639, top1 = 17.37%], test : [loss = 3.658, top1 = 16.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10718/15625) 010718-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.502, top1 = 89.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10        train : [loss = 0.021, top1 = 99.42%], test  : [loss = 0.333, top1 = 91.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 0.380, top1 = 89.02%], valid : [loss = 1.232, top1 = 67.94%], test : [loss = 1.284, top1 = 67.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.20%], valid : [loss = 2.336, top1 = 41.23%], test : [loss = 2.364, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.80%], valid : [loss = 0.902, top1 = 67.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10719/15625) 010719-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.641, top1 = 86.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.448, top1 = 89.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 0.295, top1 = 92.10%], valid : [loss = 1.536, top1 = 63.84%], test : [loss = 1.534, top1 = 64.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.215, top1 = 42.80%], valid : [loss = 2.570, top1 = 35.69%], test : [loss = 2.564, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 72.95%], valid : [loss = 0.815, top1 = 71.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10720/15625) 010720-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.492, top1 = 88.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10        train : [loss = 0.025, top1 = 99.41%], test  : [loss = 0.351, top1 = 90.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.64 ms.
cifar100       train : [loss = 0.363, top1 = 90.11%], valid : [loss = 1.314, top1 = 67.24%], test : [loss = 1.295, top1 = 67.14%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.45%], valid : [loss = 2.389, top1 = 39.80%], test : [loss = 2.389, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.90%], valid : [loss = 0.603, top1 = 79.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10721/15625) 010721-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=22.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.487, top1 = 90.35%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.310, top1 = 93.59%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.26 ms.
cifar100       train : [loss = 0.059, top1 = 99.18%], valid : [loss = 1.292, top1 = 70.26%], test : [loss = 1.310, top1 = 71.04%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=21.07 ms.
ImageNet16-120 train : [loss = 1.545, top1 = 58.22%], valid : [loss = 2.100, top1 = 45.10%], test : [loss = 2.115, top1 = 46.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.80%], valid : [loss = 0.670, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10722/15625) 010722-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.581, top1 = 87.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.12 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.392, top1 = 90.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.15 ms.
cifar100       train : [loss = 0.407, top1 = 88.46%], valid : [loss = 1.402, top1 = 65.12%], test : [loss = 1.407, top1 = 65.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.317, top1 = 40.60%], valid : [loss = 2.512, top1 = 36.84%], test : [loss = 2.549, top1 = 36.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.59%], valid : [loss = 0.806, top1 = 72.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10723/15625) 010723-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.06%], valid : [loss = 0.538, top1 = 87.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.00 ms.
cifar10        train : [loss = 0.064, top1 = 97.95%], test  : [loss = 0.364, top1 = 90.32%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.98 ms.
cifar100       train : [loss = 0.627, top1 = 81.47%], valid : [loss = 1.280, top1 = 65.42%], test : [loss = 1.295, top1 = 65.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.83 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.06%], valid : [loss = 2.461, top1 = 36.83%], test : [loss = 2.490, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.38%], valid : [loss = 0.712, top1 = 75.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10724/15625) 010724-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.04%], valid : [loss = 0.641, top1 = 84.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.046, top1 = 98.55%], test  : [loss = 0.391, top1 = 89.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.22 ms.
cifar100       train : [loss = 0.643, top1 = 81.21%], valid : [loss = 1.455, top1 = 62.02%], test : [loss = 1.439, top1 = 63.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.81%], valid : [loss = 2.641, top1 = 34.03%], test : [loss = 2.642, top1 = 34.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 70.91%], valid : [loss = 0.870, top1 = 69.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10725/15625) 010725-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.515, top1 = 88.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.348, top1 = 91.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.48 ms.
cifar100       train : [loss = 0.334, top1 = 91.04%], valid : [loss = 1.290, top1 = 66.64%], test : [loss = 1.275, top1 = 67.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.40%], valid : [loss = 2.383, top1 = 38.93%], test : [loss = 2.410, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.70%], valid : [loss = 0.626, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10726/15625) 010726-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.73%], valid : [loss = 0.557, top1 = 83.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.205, top1 = 93.00%], test  : [loss = 0.404, top1 = 87.18%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 1.302, top1 = 63.01%], valid : [loss = 1.583, top1 = 56.65%], test : [loss = 1.582, top1 = 56.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.728, top1 = 32.11%], valid : [loss = 2.754, top1 = 31.61%], test : [loss = 2.802, top1 = 31.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.08%], valid : [loss = 0.995, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10727/15625) 010727-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.527, top1 = 87.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.359, top1 = 91.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 0.488, top1 = 85.72%], valid : [loss = 1.334, top1 = 65.46%], test : [loss = 1.362, top1 = 65.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.08%], valid : [loss = 2.515, top1 = 36.80%], test : [loss = 2.522, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.67%], valid : [loss = 0.669, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10728/15625) 010728-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.579, top1 = 87.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10        train : [loss = 0.040, top1 = 98.81%], test  : [loss = 0.371, top1 = 90.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.11 ms.
cifar100       train : [loss = 0.541, top1 = 83.96%], valid : [loss = 1.401, top1 = 64.10%], test : [loss = 1.427, top1 = 63.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.78%], valid : [loss = 2.608, top1 = 35.07%], test : [loss = 2.653, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.36%], valid : [loss = 0.677, top1 = 76.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10729/15625) 010729-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.514, top1 = 88.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.327, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.13 ms.
cifar100       train : [loss = 0.337, top1 = 90.87%], valid : [loss = 1.291, top1 = 66.50%], test : [loss = 1.301, top1 = 67.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 2.099, top1 = 45.33%], valid : [loss = 2.393, top1 = 38.73%], test : [loss = 2.405, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.07%], valid : [loss = 0.643, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10730/15625) 010730-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.56 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.47%], valid : [loss = 0.495, top1 = 85.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.171, top1 = 94.26%], test  : [loss = 0.377, top1 = 88.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 1.048, top1 = 69.96%], valid : [loss = 1.408, top1 = 61.33%], test : [loss = 1.398, top1 = 61.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.49%], valid : [loss = 2.652, top1 = 34.43%], test : [loss = 2.698, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.901, top1 = 67.69%], valid : [loss = 0.948, top1 = 66.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10731/15625) 010731-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.014, top1 = 99.77%], test  : [loss = 0.311, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.326, top1 = 91.20%], valid : [loss = 1.298, top1 = 67.21%], test : [loss = 1.306, top1 = 67.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.24%], valid : [loss = 2.365, top1 = 39.23%], test : [loss = 2.399, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.83%], valid : [loss = 0.564, top1 = 81.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10732/15625) 010732-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.440, top1 = 89.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.322, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.09 ms.
cifar100       train : [loss = 0.213, top1 = 94.87%], valid : [loss = 1.266, top1 = 68.94%], test : [loss = 1.253, top1 = 68.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 50.95%], valid : [loss = 2.259, top1 = 42.33%], test : [loss = 2.262, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.40%], valid : [loss = 0.542, top1 = 81.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10733/15625) 010733-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.491, top1 = 90.49%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.19 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.320, top1 = 93.40%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.99 ms.
cifar100       train : [loss = 0.056, top1 = 99.19%], valid : [loss = 1.391, top1 = 69.76%], test : [loss = 1.377, top1 = 69.40%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 1.457, top1 = 60.25%], valid : [loss = 2.178, top1 = 44.90%], test : [loss = 2.181, top1 = 44.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.78%], valid : [loss = 0.583, top1 = 80.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10734/15625) 010734-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.562, top1 = 88.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.348, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.86 ms.
cifar100       train : [loss = 0.285, top1 = 92.03%], valid : [loss = 1.273, top1 = 68.10%], test : [loss = 1.326, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.04%], valid : [loss = 2.428, top1 = 39.27%], test : [loss = 2.414, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10735/15625) 010735-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.485, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.302, top1 = 92.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.58 ms.
cifar100       train : [loss = 0.314, top1 = 91.54%], valid : [loss = 1.247, top1 = 67.95%], test : [loss = 1.238, top1 = 68.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.62%], valid : [loss = 2.318, top1 = 40.38%], test : [loss = 2.339, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.98%], valid : [loss = 0.650, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10736/15625) 010736-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.33%], valid : [loss = 0.461, top1 = 86.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10        train : [loss = 0.159, top1 = 94.83%], test  : [loss = 0.352, top1 = 88.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.57 ms.
cifar100       train : [loss = 1.007, top1 = 71.38%], valid : [loss = 1.366, top1 = 61.31%], test : [loss = 1.362, top1 = 61.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.05%], valid : [loss = 2.681, top1 = 33.14%], test : [loss = 2.692, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10737/15625) 010737-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.492, top1 = 89.33%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.295, top1 = 92.93%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.92 ms.
cifar100       train : [loss = 0.253, top1 = 93.48%], valid : [loss = 1.235, top1 = 68.24%], test : [loss = 1.206, top1 = 68.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.01%], valid : [loss = 2.247, top1 = 41.93%], test : [loss = 2.242, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.64%], valid : [loss = 0.632, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10738/15625) 010738-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.15 ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.30%], valid : [loss = 0.769, top1 = 73.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.48 ms.
cifar10        train : [loss = 0.622, top1 = 78.83%], test  : [loss = 0.660, top1 = 77.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.52 ms.
cifar100       train : [loss = 2.200, top1 = 42.75%], valid : [loss = 2.273, top1 = 40.95%], test : [loss = 2.253, top1 = 41.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.78 ms.
ImageNet16-120 train : [loss = 3.290, top1 = 21.52%], valid : [loss = 3.256, top1 = 22.06%], test : [loss = 3.286, top1 = 20.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.315, top1 = 52.71%], valid : [loss = 1.360, top1 = 50.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10739/15625) 010739-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.539, top1 = 89.34%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.58 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.328, top1 = 93.36%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.57 ms.
cifar100       train : [loss = 0.060, top1 = 99.05%], valid : [loss = 1.385, top1 = 69.64%], test : [loss = 1.365, top1 = 71.06%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.959, top1 = 48.37%], valid : [loss = 2.364, top1 = 40.20%], test : [loss = 2.338, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 70.84%], valid : [loss = 0.856, top1 = 69.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10740/15625) 010740-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.59%], valid : [loss = 0.855, top1 = 72.00%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.45 ms.
cifar10        train : [loss = 0.563, top1 = 80.53%], test  : [loss = 0.722, top1 = 75.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.43 ms.
cifar100       train : [loss = 1.771, top1 = 52.20%], valid : [loss = 2.022, top1 = 47.32%], test : [loss = 2.073, top1 = 46.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.96 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.85%], valid : [loss = 3.621, top1 = 16.43%], test : [loss = 3.649, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10741/15625) 010741-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.25%], valid : [loss = 0.715, top1 = 75.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.344, top1 = 88.08%], test  : [loss = 0.474, top1 = 84.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.73 ms.
cifar100       train : [loss = 1.561, top1 = 56.69%], valid : [loss = 1.832, top1 = 51.16%], test : [loss = 1.812, top1 = 52.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 3.255, top1 = 22.16%], valid : [loss = 3.251, top1 = 22.40%], test : [loss = 3.324, top1 = 21.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.222, top1 = 56.01%], valid : [loss = 1.254, top1 = 54.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10742/15625) 010742-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.541, top1 = 88.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.368, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.177, top1 = 96.11%], valid : [loss = 1.403, top1 = 67.26%], test : [loss = 1.429, top1 = 66.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 48.14%], valid : [loss = 2.469, top1 = 38.40%], test : [loss = 2.496, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10743/15625) 010743-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.40 ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.86%], valid : [loss = 0.704, top1 = 77.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.56 ms.
cifar10        train : [loss = 0.465, top1 = 83.76%], test  : [loss = 0.596, top1 = 80.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.45 ms.
cifar100       train : [loss = 1.806, top1 = 50.63%], valid : [loss = 2.001, top1 = 47.96%], test : [loss = 1.982, top1 = 47.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 3.474, top1 = 18.37%], valid : [loss = 3.466, top1 = 18.60%], test : [loss = 3.497, top1 = 17.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.233, top1 = 55.32%], valid : [loss = 1.265, top1 = 54.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10744/15625) 010744-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.50%], valid : [loss = 0.477, top1 = 85.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.00 ms.
cifar10        train : [loss = 0.159, top1 = 94.71%], test  : [loss = 0.344, top1 = 88.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.89 ms.
cifar100       train : [loss = 1.001, top1 = 71.60%], valid : [loss = 1.366, top1 = 62.10%], test : [loss = 1.357, top1 = 61.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.40%], valid : [loss = 2.718, top1 = 31.47%], test : [loss = 2.725, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10745/15625) 010745-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.80 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.46%], valid : [loss = 0.852, top1 = 71.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.550, top1 = 80.71%], test  : [loss = 0.702, top1 = 76.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.89 ms.
cifar100       train : [loss = 1.749, top1 = 52.66%], valid : [loss = 2.060, top1 = 47.32%], test : [loss = 2.077, top1 = 46.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.76%], valid : [loss = 3.626, top1 = 15.60%], test : [loss = 3.674, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10746/15625) 010746-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.78%], valid : [loss = 0.560, top1 = 86.60%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.96 ms.
cifar10        train : [loss = 0.061, top1 = 98.07%], test  : [loss = 0.358, top1 = 90.03%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.55 ms.
cifar100       train : [loss = 0.641, top1 = 80.82%], valid : [loss = 1.308, top1 = 65.08%], test : [loss = 1.295, top1 = 64.40%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.402, top1 = 38.64%], valid : [loss = 2.531, top1 = 36.83%], test : [loss = 2.538, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 71.99%], valid : [loss = 0.856, top1 = 70.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10747/15625) 010747-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.405, top1 = 90.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.278, top1 = 93.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.84 ms.
cifar100       train : [loss = 0.090, top1 = 98.49%], valid : [loss = 1.294, top1 = 70.73%], test : [loss = 1.294, top1 = 70.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.628, top1 = 56.26%], valid : [loss = 2.236, top1 = 43.46%], test : [loss = 2.244, top1 = 44.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 86.99%], valid : [loss = 0.510, top1 = 83.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10748/15625) 010748-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.44%], valid : [loss = 0.566, top1 = 85.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.14 ms.
cifar10        train : [loss = 0.073, top1 = 97.78%], test  : [loss = 0.362, top1 = 89.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.640, top1 = 81.43%], valid : [loss = 1.359, top1 = 65.26%], test : [loss = 1.374, top1 = 64.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 2.422, top1 = 38.39%], valid : [loss = 2.537, top1 = 36.27%], test : [loss = 2.549, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.55%], valid : [loss = 0.850, top1 = 70.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10749/15625) 010749-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.507, top1 = 90.00%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.54 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.326, top1 = 93.36%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.06 ms.
cifar100       train : [loss = 0.035, top1 = 99.60%], valid : [loss = 1.301, top1 = 72.14%], test : [loss = 1.328, top1 = 71.46%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.42 ms.
ImageNet16-120 train : [loss = 1.567, top1 = 57.69%], valid : [loss = 2.151, top1 = 45.43%], test : [loss = 2.149, top1 = 45.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 78.01%], valid : [loss = 0.705, top1 = 75.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10750/15625) 010750-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.412, top1 = 91.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.286, top1 = 93.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.37 ms.
cifar100       train : [loss = 0.065, top1 = 99.07%], valid : [loss = 1.334, top1 = 70.62%], test : [loss = 1.354, top1 = 70.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 1.537, top1 = 58.52%], valid : [loss = 2.198, top1 = 44.70%], test : [loss = 2.280, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10751/15625) 010751-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.720, top1 = 85.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10        train : [loss = 0.020, top1 = 99.50%], test  : [loss = 0.464, top1 = 89.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.62 ms.
cifar100       train : [loss = 0.302, top1 = 92.10%], valid : [loss = 1.707, top1 = 60.88%], test : [loss = 1.699, top1 = 62.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.80%], valid : [loss = 2.650, top1 = 34.83%], test : [loss = 2.659, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 72.91%], valid : [loss = 0.819, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10752/15625) 010752-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.08 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.476, top1 = 90.08%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.32 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.316, top1 = 93.23%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.37 ms.
cifar100       train : [loss = 0.120, top1 = 97.55%], valid : [loss = 1.309, top1 = 69.14%], test : [loss = 1.338, top1 = 68.78%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.84 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.94%], valid : [loss = 2.165, top1 = 43.90%], test : [loss = 2.179, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.27%], valid : [loss = 0.645, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10753/15625) 010753-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.540, top1 = 88.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.347, top1 = 91.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.427, top1 = 87.73%], valid : [loss = 1.284, top1 = 66.78%], test : [loss = 1.264, top1 = 66.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.16%], valid : [loss = 2.409, top1 = 39.14%], test : [loss = 2.428, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10754/15625) 010754-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.562, top1 = 88.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.378, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.227, top1 = 94.33%], valid : [loss = 1.427, top1 = 66.17%], test : [loss = 1.430, top1 = 66.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.094, top1 = 45.45%], valid : [loss = 2.405, top1 = 39.40%], test : [loss = 2.435, top1 = 39.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.60%], valid : [loss = 0.736, top1 = 74.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10755/15625) 010755-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.23%], valid : [loss = 0.733, top1 = 75.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.58 ms.
cifar10        train : [loss = 0.514, top1 = 82.30%], test  : [loss = 0.589, top1 = 79.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.75 ms.
cifar100       train : [loss = 1.866, top1 = 49.43%], valid : [loss = 2.002, top1 = 46.75%], test : [loss = 1.997, top1 = 46.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 3.001, top1 = 26.65%], valid : [loss = 2.981, top1 = 27.87%], test : [loss = 3.010, top1 = 26.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 60.27%], valid : [loss = 1.159, top1 = 58.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10756/15625) 010756-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.43%], valid : [loss = 0.644, top1 = 85.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.99 ms.
cifar10        train : [loss = 0.045, top1 = 98.67%], test  : [loss = 0.409, top1 = 89.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.80 ms.
cifar100       train : [loss = 0.597, top1 = 82.58%], valid : [loss = 1.449, top1 = 62.48%], test : [loss = 1.452, top1 = 62.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.90%], valid : [loss = 2.583, top1 = 35.13%], test : [loss = 2.596, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.54%], valid : [loss = 0.925, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10757/15625) 010757-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.129, top1 = 96.10%], valid : [loss = 0.463, top1 = 86.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10        train : [loss = 0.153, top1 = 95.11%], test  : [loss = 0.352, top1 = 88.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.15 ms.
cifar100       train : [loss = 1.013, top1 = 71.15%], valid : [loss = 1.350, top1 = 61.92%], test : [loss = 1.377, top1 = 61.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.76%], valid : [loss = 2.694, top1 = 32.20%], test : [loss = 2.717, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10758/15625) 010758-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.52%], valid : [loss = 0.597, top1 = 86.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.68 ms.
cifar10        train : [loss = 0.034, top1 = 98.95%], test  : [loss = 0.364, top1 = 90.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 0.339, top1 = 90.42%], valid : [loss = 1.363, top1 = 65.86%], test : [loss = 1.359, top1 = 66.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.426, top1 = 37.77%], valid : [loss = 2.590, top1 = 35.27%], test : [loss = 2.600, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.058, top1 = 61.40%], valid : [loss = 1.087, top1 = 60.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10759/15625) 010759-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.03%], valid : [loss = 0.851, top1 = 71.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.559, top1 = 80.48%], test  : [loss = 0.713, top1 = 75.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.81 ms.
cifar100       train : [loss = 1.781, top1 = 51.96%], valid : [loss = 2.046, top1 = 47.13%], test : [loss = 2.068, top1 = 46.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.85%], valid : [loss = 3.630, top1 = 16.26%], test : [loss = 3.674, top1 = 15.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10760/15625) 010760-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.550, top1 = 87.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.365, top1 = 91.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 0.390, top1 = 88.90%], valid : [loss = 1.402, top1 = 65.28%], test : [loss = 1.382, top1 = 65.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.69%], valid : [loss = 2.486, top1 = 36.92%], test : [loss = 2.493, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10761/15625) 010761-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.506, top1 = 88.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.356, top1 = 91.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.43 ms.
cifar100       train : [loss = 0.343, top1 = 90.76%], valid : [loss = 1.292, top1 = 67.02%], test : [loss = 1.265, top1 = 67.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.78%], valid : [loss = 2.409, top1 = 39.13%], test : [loss = 2.391, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10762/15625) 010762-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10763/15625) 010763-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.54%], valid : [loss = 0.525, top1 = 83.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.91 ms.
cifar10        train : [loss = 0.247, top1 = 91.69%], test  : [loss = 0.413, top1 = 86.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 1.351, top1 = 62.19%], valid : [loss = 1.620, top1 = 55.80%], test : [loss = 1.602, top1 = 56.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.848, top1 = 29.70%], valid : [loss = 2.865, top1 = 29.27%], test : [loss = 2.908, top1 = 29.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.58%], valid : [loss = 1.030, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10764/15625) 010764-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.549, top1 = 88.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.019, top1 = 99.49%], test  : [loss = 0.354, top1 = 91.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.89 ms.
cifar100       train : [loss = 0.321, top1 = 90.85%], valid : [loss = 1.323, top1 = 66.38%], test : [loss = 1.295, top1 = 68.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.429, top1 = 37.86%], valid : [loss = 2.582, top1 = 36.00%], test : [loss = 2.598, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.92%], valid : [loss = 1.004, top1 = 63.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10765/15625) 010765-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.75 ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.19%], valid : [loss = 0.728, top1 = 74.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.545, top1 = 81.25%], test  : [loss = 0.601, top1 = 79.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.07 ms.
cifar100       train : [loss = 2.017, top1 = 45.97%], valid : [loss = 2.150, top1 = 43.47%], test : [loss = 2.137, top1 = 43.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 3.242, top1 = 22.17%], valid : [loss = 3.229, top1 = 22.81%], test : [loss = 3.255, top1 = 22.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.49%], valid : [loss = 1.351, top1 = 51.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10766/15625) 010766-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10-valid  train : [loss = 1.255, top1 = 55.07%], valid : [loss = 1.298, top1 = 53.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10        train : [loss = 1.202, top1 = 56.96%], test  : [loss = 1.217, top1 = 56.18%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 2.752, top1 = 31.26%], valid : [loss = 2.838, top1 = 30.12%], test : [loss = 2.821, top1 = 30.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.52 ms.
ImageNet16-120 train : [loss = 3.912, top1 = 11.72%], valid : [loss = 3.911, top1 = 12.19%], test : [loss = 3.931, top1 = 11.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.721, top1 = 35.14%], valid : [loss = 1.738, top1 = 33.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10767/15625) 010767-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.477, top1 = 90.42%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.41 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.310, top1 = 93.77%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.13 ms.
cifar100       train : [loss = 0.067, top1 = 99.07%], valid : [loss = 1.340, top1 = 69.82%], test : [loss = 1.354, top1 = 69.02%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.98 ms.
ImageNet16-120 train : [loss = 1.600, top1 = 56.86%], valid : [loss = 2.185, top1 = 45.87%], test : [loss = 2.149, top1 = 44.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.15%], valid : [loss = 0.731, top1 = 74.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10768/15625) 010768-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.46%], valid : [loss = 0.539, top1 = 85.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.44 ms.
cifar10        train : [loss = 0.120, top1 = 96.15%], test  : [loss = 0.369, top1 = 88.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.02 ms.
cifar100       train : [loss = 0.757, top1 = 78.03%], valid : [loss = 1.349, top1 = 64.10%], test : [loss = 1.307, top1 = 64.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.466, top1 = 37.45%], valid : [loss = 2.561, top1 = 35.47%], test : [loss = 2.593, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.62%], valid : [loss = 0.919, top1 = 67.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10769/15625) 010769-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.23%], valid : [loss = 0.455, top1 = 86.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.54 ms.
cifar10        train : [loss = 0.116, top1 = 96.43%], test  : [loss = 0.332, top1 = 89.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 0.855, top1 = 75.68%], valid : [loss = 1.295, top1 = 63.92%], test : [loss = 1.275, top1 = 64.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.63%], valid : [loss = 2.616, top1 = 34.92%], test : [loss = 2.646, top1 = 33.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.09%], valid : [loss = 0.653, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10770/15625) 010770-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.493, top1 = 90.03%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.19 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.307, top1 = 93.49%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=17.62 ms.
cifar100       train : [loss = 0.057, top1 = 99.22%], valid : [loss = 1.325, top1 = 70.18%], test : [loss = 1.320, top1 = 71.18%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.23 ms.
ImageNet16-120 train : [loss = 1.566, top1 = 57.82%], valid : [loss = 2.197, top1 = 43.83%], test : [loss = 2.176, top1 = 44.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 79.11%], valid : [loss = 0.682, top1 = 76.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10771/15625) 010771-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.600, top1 = 88.32%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.70 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.388, top1 = 91.85%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.11 ms.
cifar100       train : [loss = 0.078, top1 = 98.54%], valid : [loss = 1.579, top1 = 66.88%], test : [loss = 1.600, top1 = 66.80%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 1.964, top1 = 48.56%], valid : [loss = 2.414, top1 = 39.23%], test : [loss = 2.392, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 75.80%], valid : [loss = 0.755, top1 = 73.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10772/15625) 010772-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.502, top1 = 88.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.325, top1 = 92.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.28 ms.
cifar100       train : [loss = 0.322, top1 = 91.42%], valid : [loss = 1.273, top1 = 67.32%], test : [loss = 1.304, top1 = 68.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.95%], valid : [loss = 2.425, top1 = 38.87%], test : [loss = 2.404, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10773/15625) 010773-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.26%], valid : [loss = 0.448, top1 = 87.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.01 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.322, top1 = 89.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 0.867, top1 = 75.28%], valid : [loss = 1.284, top1 = 63.95%], test : [loss = 1.274, top1 = 64.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.63%], valid : [loss = 2.627, top1 = 34.43%], test : [loss = 2.681, top1 = 33.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.12%], valid : [loss = 0.667, top1 = 77.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10774/15625) 010774-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.335, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 0.280, top1 = 92.51%], valid : [loss = 1.263, top1 = 67.91%], test : [loss = 1.281, top1 = 67.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.58%], valid : [loss = 2.319, top1 = 40.20%], test : [loss = 2.314, top1 = 41.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.32%], valid : [loss = 0.769, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10775/15625) 010775-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.193, top1 = 93.53%], valid : [loss = 0.545, top1 = 83.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.201, top1 = 93.16%], test  : [loss = 0.409, top1 = 87.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 1.245, top1 = 64.64%], valid : [loss = 1.552, top1 = 57.66%], test : [loss = 1.563, top1 = 57.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.700, top1 = 32.56%], valid : [loss = 2.737, top1 = 32.22%], test : [loss = 2.787, top1 = 31.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.89%], valid : [loss = 0.993, top1 = 64.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10776/15625) 010776-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.221, top1 = 92.55%], valid : [loss = 0.532, top1 = 83.70%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.18 ms.
cifar10        train : [loss = 0.227, top1 = 92.31%], test  : [loss = 0.403, top1 = 86.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.84 ms.
cifar100       train : [loss = 1.292, top1 = 63.41%], valid : [loss = 1.601, top1 = 56.30%], test : [loss = 1.592, top1 = 55.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.835, top1 = 30.08%], valid : [loss = 2.864, top1 = 29.63%], test : [loss = 2.897, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.28%], valid : [loss = 1.028, top1 = 63.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10777/15625) 010777-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.510, top1 = 88.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.13 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.333, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.32 ms.
cifar100       train : [loss = 0.339, top1 = 90.74%], valid : [loss = 1.306, top1 = 67.28%], test : [loss = 1.304, top1 = 66.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.20%], valid : [loss = 2.446, top1 = 37.73%], test : [loss = 2.396, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.658, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10778/15625) 010778-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.468, top1 = 89.17%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.44 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.307, top1 = 92.52%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.94 ms.
cifar100       train : [loss = 0.266, top1 = 93.21%], valid : [loss = 1.255, top1 = 68.56%], test : [loss = 1.223, top1 = 68.84%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.51%], valid : [loss = 2.228, top1 = 42.83%], test : [loss = 2.252, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.91%], valid : [loss = 0.622, top1 = 78.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10779/15625) 010779-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.96 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.68%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.09 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.322, top1 = 93.24%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.07 ms.
cifar100       train : [loss = 0.068, top1 = 98.85%], valid : [loss = 1.380, top1 = 68.54%], test : [loss = 1.431, top1 = 69.10%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.56%], valid : [loss = 2.386, top1 = 39.57%], test : [loss = 2.403, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.32%], valid : [loss = 0.934, top1 = 66.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10780/15625) 010780-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.592, top1 = 87.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.015, top1 = 99.60%], test  : [loss = 0.389, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.419, top1 = 88.07%], valid : [loss = 1.437, top1 = 64.88%], test : [loss = 1.394, top1 = 64.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.74%], valid : [loss = 2.502, top1 = 36.03%], test : [loss = 2.539, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10781/15625) 010781-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.515, top1 = 89.57%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.351, top1 = 92.57%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.55 ms.
cifar100       train : [loss = 0.121, top1 = 97.40%], valid : [loss = 1.388, top1 = 69.28%], test : [loss = 1.370, top1 = 69.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.43 ms.
ImageNet16-120 train : [loss = 1.707, top1 = 54.36%], valid : [loss = 2.167, top1 = 44.63%], test : [loss = 2.180, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.53%], valid : [loss = 0.642, top1 = 77.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10782/15625) 010782-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.584, top1 = 87.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.395, top1 = 91.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.53 ms.
cifar100       train : [loss = 0.389, top1 = 89.02%], valid : [loss = 1.387, top1 = 65.78%], test : [loss = 1.368, top1 = 65.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.81 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.97%], valid : [loss = 2.516, top1 = 37.19%], test : [loss = 2.532, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10783/15625) 010783-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.536, top1 = 88.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.360, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.421, top1 = 87.81%], valid : [loss = 1.267, top1 = 67.36%], test : [loss = 1.261, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.41%], valid : [loss = 2.357, top1 = 40.22%], test : [loss = 2.382, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10784/15625) 010784-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.656, top1 = 86.03%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10        train : [loss = 0.022, top1 = 99.50%], test  : [loss = 0.456, top1 = 88.91%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.19 ms.
cifar100       train : [loss = 0.294, top1 = 92.54%], valid : [loss = 1.485, top1 = 63.42%], test : [loss = 1.491, top1 = 64.82%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.02%], valid : [loss = 2.599, top1 = 34.97%], test : [loss = 2.620, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.64%], valid : [loss = 0.771, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10785/15625) 010785-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.620, top1 = 87.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.373, top1 = 91.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.204, top1 = 95.28%], valid : [loss = 1.464, top1 = 65.92%], test : [loss = 1.415, top1 = 66.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 46.01%], valid : [loss = 2.492, top1 = 37.40%], test : [loss = 2.532, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10786/15625) 010786-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.573, top1 = 88.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.355, top1 = 91.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.212, top1 = 94.69%], valid : [loss = 1.339, top1 = 67.92%], test : [loss = 1.357, top1 = 67.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.25%], valid : [loss = 2.416, top1 = 38.87%], test : [loss = 2.415, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.23%], valid : [loss = 0.938, top1 = 67.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10787/15625) 010787-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.92%], valid : [loss = 0.480, top1 = 84.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.293, top1 = 90.24%], test  : [loss = 0.396, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.47 ms.
cifar100       train : [loss = 1.317, top1 = 63.56%], valid : [loss = 1.522, top1 = 57.56%], test : [loss = 1.508, top1 = 58.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.71%], valid : [loss = 2.882, top1 = 30.10%], test : [loss = 2.955, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10788/15625) 010788-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.503, top1 = 89.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.315, top1 = 92.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.38 ms.
cifar100       train : [loss = 0.159, top1 = 96.28%], valid : [loss = 1.324, top1 = 69.12%], test : [loss = 1.320, top1 = 68.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.06 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.08%], valid : [loss = 2.211, top1 = 43.53%], test : [loss = 2.235, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.60%], valid : [loss = 0.761, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10789/15625) 010789-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.645, top1 = 86.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.26 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.436, top1 = 89.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.37 ms.
cifar100       train : [loss = 0.426, top1 = 88.17%], valid : [loss = 1.400, top1 = 64.86%], test : [loss = 1.412, top1 = 64.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.75%], valid : [loss = 2.608, top1 = 34.53%], test : [loss = 2.617, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.10%], valid : [loss = 0.793, top1 = 72.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10790/15625) 010790-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.449, top1 = 89.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.340, top1 = 91.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.30 ms.
cifar100       train : [loss = 0.333, top1 = 90.83%], valid : [loss = 1.350, top1 = 66.84%], test : [loss = 1.311, top1 = 67.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.33%], valid : [loss = 2.357, top1 = 39.60%], test : [loss = 2.383, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10791/15625) 010791-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.512, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=14.88 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.331, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.03 ms.
cifar100       train : [loss = 0.244, top1 = 93.90%], valid : [loss = 1.269, top1 = 68.38%], test : [loss = 1.262, top1 = 68.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.93%], valid : [loss = 2.306, top1 = 41.00%], test : [loss = 2.315, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.22%], valid : [loss = 0.664, top1 = 76.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10792/15625) 010792-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.439, top1 = 90.17%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.293, top1 = 92.93%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.74 ms.
cifar100       train : [loss = 0.109, top1 = 98.24%], valid : [loss = 1.235, top1 = 70.38%], test : [loss = 1.261, top1 = 70.18%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.88 ms.
ImageNet16-120 train : [loss = 1.722, top1 = 53.92%], valid : [loss = 2.160, top1 = 44.30%], test : [loss = 2.170, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.55%], valid : [loss = 0.629, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10793/15625) 010793-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.89%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.32 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.324, top1 = 93.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.62 ms.
cifar100       train : [loss = 0.097, top1 = 98.21%], valid : [loss = 1.298, top1 = 69.92%], test : [loss = 1.278, top1 = 70.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.28%], valid : [loss = 2.125, top1 = 45.63%], test : [loss = 2.129, top1 = 45.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.30%], valid : [loss = 0.732, top1 = 74.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10794/15625) 010794-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.446, top1 = 89.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.311, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.211, top1 = 94.80%], valid : [loss = 1.283, top1 = 68.71%], test : [loss = 1.330, top1 = 68.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.36%], valid : [loss = 2.288, top1 = 42.13%], test : [loss = 2.315, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.440, top1 = 84.76%], valid : [loss = 0.544, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10795/15625) 010795-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.85%], valid : [loss = 0.626, top1 = 86.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10        train : [loss = 0.030, top1 = 99.28%], test  : [loss = 0.429, top1 = 89.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.89 ms.
cifar100       train : [loss = 0.409, top1 = 88.95%], valid : [loss = 1.472, top1 = 63.60%], test : [loss = 1.488, top1 = 63.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.94%], valid : [loss = 2.627, top1 = 34.83%], test : [loss = 2.643, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10796/15625) 010796-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.18%], valid : [loss = 0.548, top1 = 83.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.37 ms.
cifar10        train : [loss = 0.209, top1 = 92.90%], test  : [loss = 0.401, top1 = 87.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.53 ms.
cifar100       train : [loss = 1.307, top1 = 62.78%], valid : [loss = 1.584, top1 = 57.36%], test : [loss = 1.595, top1 = 56.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.718, top1 = 32.02%], valid : [loss = 2.760, top1 = 31.17%], test : [loss = 2.791, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.38%], valid : [loss = 0.990, top1 = 65.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10797/15625) 010797-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.59%], valid : [loss = 0.487, top1 = 84.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.303, top1 = 89.80%], test  : [loss = 0.408, top1 = 86.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 1.326, top1 = 63.54%], valid : [loss = 1.506, top1 = 58.54%], test : [loss = 1.510, top1 = 58.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.62%], valid : [loss = 2.910, top1 = 29.63%], test : [loss = 2.952, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10798/15625) 010798-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.50%], valid : [loss = 0.453, top1 = 86.68%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.04 ms.
cifar10        train : [loss = 0.125, top1 = 96.12%], test  : [loss = 0.342, top1 = 89.46%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.90 ms.
cifar100       train : [loss = 0.779, top1 = 78.16%], valid : [loss = 1.297, top1 = 63.64%], test : [loss = 1.280, top1 = 64.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.24%], valid : [loss = 2.574, top1 = 35.03%], test : [loss = 2.585, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10799/15625) 010799-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.87%], valid : [loss = 0.460, top1 = 86.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.150, top1 = 95.11%], test  : [loss = 0.339, top1 = 88.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.91 ms.
cifar100       train : [loss = 0.975, top1 = 72.33%], valid : [loss = 1.346, top1 = 62.45%], test : [loss = 1.352, top1 = 62.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.48%], valid : [loss = 2.658, top1 = 32.93%], test : [loss = 2.682, top1 = 33.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10800/15625) 010800-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.46%], valid : [loss = 0.572, top1 = 85.21%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10        train : [loss = 0.095, top1 = 96.86%], test  : [loss = 0.426, top1 = 88.16%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.46 ms.
cifar100       train : [loss = 0.698, top1 = 79.43%], valid : [loss = 1.519, top1 = 60.50%], test : [loss = 1.499, top1 = 62.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 21.50%], valid : [loss = 3.205, top1 = 22.20%], test : [loss = 3.246, top1 = 21.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.58%], valid : [loss = 1.025, top1 = 63.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10801/15625) 010801-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.44 ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.56%], valid : [loss = 0.872, top1 = 71.32%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.80 ms.
cifar10        train : [loss = 0.554, top1 = 80.79%], test  : [loss = 0.705, top1 = 76.04%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.58 ms.
cifar100       train : [loss = 1.784, top1 = 51.94%], valid : [loss = 2.051, top1 = 47.12%], test : [loss = 2.072, top1 = 46.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.60%], valid : [loss = 3.643, top1 = 16.60%], test : [loss = 3.664, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10802/15625) 010802-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.610, top1 = 86.42%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.80 ms.
cifar10        train : [loss = 0.028, top1 = 99.29%], test  : [loss = 0.425, top1 = 89.74%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.87 ms.
cifar100       train : [loss = 0.371, top1 = 89.97%], valid : [loss = 1.438, top1 = 64.74%], test : [loss = 1.430, top1 = 64.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.75%], valid : [loss = 2.608, top1 = 35.53%], test : [loss = 2.643, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.58%], valid : [loss = 0.755, top1 = 73.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10803/15625) 010803-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.542, top1 = 89.02%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.26 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.358, top1 = 92.22%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.24 ms.
cifar100       train : [loss = 0.104, top1 = 98.01%], valid : [loss = 1.341, top1 = 68.68%], test : [loss = 1.342, top1 = 69.86%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.15 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.10%], valid : [loss = 2.445, top1 = 38.63%], test : [loss = 2.469, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 1.081, top1 = 61.01%], valid : [loss = 1.100, top1 = 60.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10804/15625) 010804-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.534, top1 = 88.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.29 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.361, top1 = 92.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.67 ms.
cifar100       train : [loss = 0.141, top1 = 96.63%], valid : [loss = 1.349, top1 = 68.76%], test : [loss = 1.375, top1 = 68.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.53%], valid : [loss = 2.525, top1 = 36.13%], test : [loss = 2.508, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 68.24%], valid : [loss = 0.919, top1 = 67.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10805/15625) 010805-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.504, top1 = 89.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.334, top1 = 92.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.303, top1 = 91.77%], valid : [loss = 1.336, top1 = 67.06%], test : [loss = 1.378, top1 = 66.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.02%], valid : [loss = 2.261, top1 = 41.60%], test : [loss = 2.225, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.17%], valid : [loss = 0.780, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10806/15625) 010806-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.044, top1 = 99.01%], valid : [loss = 0.532, top1 = 86.38%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.89 ms.
cifar10        train : [loss = 0.062, top1 = 98.23%], test  : [loss = 0.366, top1 = 89.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.33 ms.
cifar100       train : [loss = 0.545, top1 = 84.42%], valid : [loss = 1.298, top1 = 65.60%], test : [loss = 1.284, top1 = 65.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.69%], valid : [loss = 2.440, top1 = 38.17%], test : [loss = 2.483, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 71.73%], valid : [loss = 0.861, top1 = 69.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10807/15625) 010807-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.132, top1 = 95.87%], valid : [loss = 0.539, top1 = 85.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10        train : [loss = 0.156, top1 = 94.69%], test  : [loss = 0.389, top1 = 88.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.944, top1 = 72.57%], valid : [loss = 1.463, top1 = 60.88%], test : [loss = 1.446, top1 = 60.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.56%], valid : [loss = 2.698, top1 = 32.10%], test : [loss = 2.750, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.48%], valid : [loss = 0.954, top1 = 66.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10808/15625) 010808-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.85%], valid : [loss = 0.518, top1 = 85.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.082, top1 = 97.48%], test  : [loss = 0.352, top1 = 89.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=10.93 ms.
cifar100       train : [loss = 0.737, top1 = 78.38%], valid : [loss = 1.335, top1 = 64.38%], test : [loss = 1.315, top1 = 64.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.352, top1 = 39.80%], valid : [loss = 2.465, top1 = 38.60%], test : [loss = 2.518, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.14%], valid : [loss = 0.938, top1 = 66.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10809/15625) 010809-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.457, top1 = 89.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.302, top1 = 92.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.36 ms.
cifar100       train : [loss = 0.226, top1 = 94.42%], valid : [loss = 1.260, top1 = 68.68%], test : [loss = 1.276, top1 = 68.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.32%], valid : [loss = 2.300, top1 = 41.97%], test : [loss = 2.341, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.436, top1 = 84.77%], valid : [loss = 0.554, top1 = 81.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10810/15625) 010810-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.646, top1 = 76.86%], valid : [loss = 0.746, top1 = 74.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.573, top1 = 79.91%], test  : [loss = 0.631, top1 = 78.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.83 ms.
cifar100       train : [loss = 1.979, top1 = 46.69%], valid : [loss = 2.137, top1 = 44.46%], test : [loss = 2.126, top1 = 43.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 3.208, top1 = 22.64%], valid : [loss = 3.202, top1 = 22.83%], test : [loss = 3.232, top1 = 22.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.282, top1 = 53.77%], valid : [loss = 1.334, top1 = 52.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10811/15625) 010811-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.470, top1 = 90.05%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.99 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.299, top1 = 92.90%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.10 ms.
cifar100       train : [loss = 0.184, top1 = 95.73%], valid : [loss = 1.221, top1 = 69.66%], test : [loss = 1.199, top1 = 70.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 1.788, top1 = 52.37%], valid : [loss = 2.198, top1 = 43.70%], test : [loss = 2.154, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.93%], valid : [loss = 0.726, top1 = 74.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10812/15625) 010812-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.68%], valid : [loss = 0.838, top1 = 80.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.26 ms.
cifar10        train : [loss = 0.087, top1 = 97.23%], test  : [loss = 0.459, top1 = 87.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 0.835, top1 = 75.90%], valid : [loss = 1.615, top1 = 59.12%], test : [loss = 1.594, top1 = 58.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 30.50%], valid : [loss = 2.926, top1 = 29.23%], test : [loss = 3.011, top1 = 27.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.33%], valid : [loss = 0.868, top1 = 69.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10813/15625) 010813-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.629, top1 = 86.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 0.025, top1 = 99.39%], test  : [loss = 0.444, top1 = 89.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.36 ms.
cifar100       train : [loss = 0.389, top1 = 89.53%], valid : [loss = 1.426, top1 = 64.98%], test : [loss = 1.405, top1 = 64.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.281, top1 = 41.35%], valid : [loss = 2.605, top1 = 35.47%], test : [loss = 2.615, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10814/15625) 010814-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.15%], valid : [loss = 0.540, top1 = 84.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10        train : [loss = 0.181, top1 = 93.93%], test  : [loss = 0.393, top1 = 87.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.93 ms.
cifar100       train : [loss = 1.203, top1 = 65.87%], valid : [loss = 1.524, top1 = 58.37%], test : [loss = 1.510, top1 = 58.63%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 34.66%], valid : [loss = 2.669, top1 = 33.57%], test : [loss = 2.699, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.76%], valid : [loss = 0.922, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10815/15625) 010815-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.38%], valid : [loss = 0.466, top1 = 85.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10        train : [loss = 0.157, top1 = 94.89%], test  : [loss = 0.343, top1 = 88.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.90 ms.
cifar100       train : [loss = 1.021, top1 = 71.05%], valid : [loss = 1.392, top1 = 61.58%], test : [loss = 1.355, top1 = 61.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.74%], valid : [loss = 2.666, top1 = 33.70%], test : [loss = 2.725, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10816/15625) 010816-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.546, top1 = 88.52%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.329, top1 = 91.86%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.71 ms.
cifar100       train : [loss = 0.300, top1 = 91.66%], valid : [loss = 1.317, top1 = 67.40%], test : [loss = 1.352, top1 = 67.10%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=23.69 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.93%], valid : [loss = 2.410, top1 = 38.80%], test : [loss = 2.427, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.42%], valid : [loss = 0.939, top1 = 66.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10817/15625) 010817-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.542, top1 = 80.99%], valid : [loss = 0.672, top1 = 77.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.44 ms.
cifar10        train : [loss = 0.570, top1 = 80.02%], test  : [loss = 0.631, top1 = 78.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.53 ms.
cifar100       train : [loss = 1.751, top1 = 52.70%], valid : [loss = 1.892, top1 = 49.44%], test : [loss = 1.924, top1 = 49.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 3.413, top1 = 19.64%], valid : [loss = 3.404, top1 = 20.07%], test : [loss = 3.425, top1 = 18.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.385, top1 = 49.67%], valid : [loss = 1.425, top1 = 48.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10818/15625) 010818-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.459, top1 = 89.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.316, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.328, top1 = 91.08%], valid : [loss = 1.297, top1 = 67.54%], test : [loss = 1.301, top1 = 67.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.22%], valid : [loss = 2.360, top1 = 40.79%], test : [loss = 2.382, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.461, top1 = 84.07%], valid : [loss = 0.561, top1 = 80.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10819/15625) 010819-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.145, top1 = 95.10%], valid : [loss = 0.744, top1 = 80.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10        train : [loss = 0.164, top1 = 94.42%], test  : [loss = 0.525, top1 = 84.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.36 ms.
cifar100       train : [loss = 0.857, top1 = 74.85%], valid : [loss = 1.652, top1 = 57.04%], test : [loss = 1.666, top1 = 57.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 3.355, top1 = 19.66%], valid : [loss = 3.351, top1 = 20.47%], test : [loss = 3.396, top1 = 19.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.203, top1 = 56.29%], valid : [loss = 1.241, top1 = 55.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10820/15625) 010820-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.458, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.75%], test  : [loss = 0.310, top1 = 92.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.10 ms.
cifar100       train : [loss = 0.331, top1 = 90.95%], valid : [loss = 1.287, top1 = 67.43%], test : [loss = 1.301, top1 = 66.79%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.54 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.39%], valid : [loss = 2.368, top1 = 40.26%], test : [loss = 2.397, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.93%], valid : [loss = 0.560, top1 = 81.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10821/15625) 010821-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.297, top1 = 89.87%], valid : [loss = 0.494, top1 = 83.99%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=13.54 ms.
cifar10        train : [loss = 0.268, top1 = 90.96%], test  : [loss = 0.371, top1 = 87.59%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=13.66 ms.
cifar100       train : [loss = 1.301, top1 = 63.52%], valid : [loss = 1.512, top1 = 57.97%], test : [loss = 1.493, top1 = 57.93%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.819, top1 = 30.53%], valid : [loss = 2.826, top1 = 30.37%], test : [loss = 2.855, top1 = 29.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.78%], valid : [loss = 1.069, top1 = 62.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10822/15625) 010822-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.536, top1 = 88.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.344, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.80 ms.
cifar100       train : [loss = 0.341, top1 = 90.71%], valid : [loss = 1.259, top1 = 67.14%], test : [loss = 1.286, top1 = 67.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.75%], valid : [loss = 2.404, top1 = 39.40%], test : [loss = 2.441, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10823/15625) 010823-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.34%], valid : [loss = 0.722, top1 = 75.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.54 ms.
cifar10        train : [loss = 0.457, top1 = 84.09%], test  : [loss = 0.576, top1 = 80.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.45 ms.
cifar100       train : [loss = 1.715, top1 = 53.06%], valid : [loss = 1.941, top1 = 49.28%], test : [loss = 1.928, top1 = 49.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 3.371, top1 = 19.98%], valid : [loss = 3.376, top1 = 20.17%], test : [loss = 3.416, top1 = 19.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.226, top1 = 55.61%], valid : [loss = 1.280, top1 = 53.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10824/15625) 010824-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.580, top1 = 87.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.381, top1 = 91.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.403, top1 = 88.51%], valid : [loss = 1.422, top1 = 64.28%], test : [loss = 1.381, top1 = 65.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.11%], valid : [loss = 2.486, top1 = 37.70%], test : [loss = 2.526, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10825/15625) 010825-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=23.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.487, top1 = 88.92%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.72 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.324, top1 = 92.09%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.42 ms.
cifar100       train : [loss = 0.228, top1 = 94.46%], valid : [loss = 1.254, top1 = 68.60%], test : [loss = 1.285, top1 = 68.50%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.15%], valid : [loss = 2.280, top1 = 41.93%], test : [loss = 2.288, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 78.12%], valid : [loss = 0.689, top1 = 76.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10826/15625) 010826-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.77%], valid : [loss = 0.595, top1 = 86.62%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.91 ms.
cifar10        train : [loss = 0.036, top1 = 99.04%], test  : [loss = 0.403, top1 = 89.66%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.06 ms.
cifar100       train : [loss = 0.397, top1 = 89.12%], valid : [loss = 1.403, top1 = 65.12%], test : [loss = 1.396, top1 = 65.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.19%], valid : [loss = 2.575, top1 = 35.50%], test : [loss = 2.577, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.94%], valid : [loss = 0.757, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10827/15625) 010827-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.313, top1 = 92.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.18 ms.
cifar100       train : [loss = 0.321, top1 = 91.35%], valid : [loss = 1.286, top1 = 67.75%], test : [loss = 1.295, top1 = 67.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.55%], valid : [loss = 2.361, top1 = 40.00%], test : [loss = 2.382, top1 = 40.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.20%], valid : [loss = 0.525, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10828/15625) 010828-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.465, top1 = 89.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.317, top1 = 91.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.87 ms.
cifar100       train : [loss = 0.331, top1 = 90.99%], valid : [loss = 1.298, top1 = 67.26%], test : [loss = 1.316, top1 = 66.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.23%], valid : [loss = 2.384, top1 = 39.43%], test : [loss = 2.446, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10829/15625) 010829-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.494, top1 = 89.12%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.21 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.311, top1 = 92.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.40 ms.
cifar100       train : [loss = 0.310, top1 = 91.69%], valid : [loss = 1.298, top1 = 67.34%], test : [loss = 1.306, top1 = 66.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.50 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.00%], valid : [loss = 2.185, top1 = 42.50%], test : [loss = 2.240, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.48%], valid : [loss = 0.730, top1 = 74.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10830/15625) 010830-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.18 ms.
cifar10-valid  train : [loss = 1.084, top1 = 61.56%], valid : [loss = 1.140, top1 = 59.81%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.65 ms.
cifar10        train : [loss = 1.056, top1 = 62.78%], test  : [loss = 1.059, top1 = 62.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.09 ms.
cifar100       train : [loss = 2.583, top1 = 34.77%], valid : [loss = 2.649, top1 = 33.24%], test : [loss = 2.627, top1 = 34.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.77 ms.
ImageNet16-120 train : [loss = 3.781, top1 = 13.76%], valid : [loss = 3.758, top1 = 14.17%], test : [loss = 3.786, top1 = 13.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10831/15625) 010831-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.514, top1 = 88.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.27 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.372, top1 = 90.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.75 ms.
cifar100       train : [loss = 0.481, top1 = 85.85%], valid : [loss = 1.338, top1 = 66.04%], test : [loss = 1.359, top1 = 65.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 40.06%], valid : [loss = 2.521, top1 = 35.97%], test : [loss = 2.557, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.28%], valid : [loss = 0.679, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10832/15625) 010832-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.337, top1 = 88.24%], valid : [loss = 0.583, top1 = 81.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.80 ms.
cifar10        train : [loss = 0.270, top1 = 90.68%], test  : [loss = 0.402, top1 = 86.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.82 ms.
cifar100       train : [loss = 1.443, top1 = 59.31%], valid : [loss = 1.701, top1 = 54.36%], test : [loss = 1.689, top1 = 54.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.965, top1 = 27.42%], valid : [loss = 2.970, top1 = 27.60%], test : [loss = 3.047, top1 = 26.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.980, top1 = 64.62%], valid : [loss = 1.041, top1 = 63.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10833/15625) 010833-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.571, top1 = 87.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.366, top1 = 91.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.51 ms.
cifar100       train : [loss = 0.295, top1 = 91.49%], valid : [loss = 1.368, top1 = 66.80%], test : [loss = 1.391, top1 = 66.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.36%], valid : [loss = 2.433, top1 = 38.63%], test : [loss = 2.443, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.80%], valid : [loss = 0.913, top1 = 67.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10834/15625) 010834-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.96 ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.53%], valid : [loss = 0.904, top1 = 69.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.01 ms.
cifar10        train : [loss = 0.677, top1 = 76.47%], test  : [loss = 0.760, top1 = 73.87%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.97 ms.
cifar100       train : [loss = 1.948, top1 = 48.21%], valid : [loss = 2.129, top1 = 45.60%], test : [loss = 2.143, top1 = 44.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.23 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.75%], valid : [loss = 3.673, top1 = 15.50%], test : [loss = 3.691, top1 = 14.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10835/15625) 010835-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.438, top1 = 90.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.282, top1 = 93.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.064, top1 = 99.01%], valid : [loss = 1.342, top1 = 70.94%], test : [loss = 1.331, top1 = 71.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 1.504, top1 = 59.30%], valid : [loss = 2.212, top1 = 44.33%], test : [loss = 2.223, top1 = 45.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.67%], valid : [loss = 0.488, top1 = 83.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10836/15625) 010836-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.540, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.353, top1 = 91.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.40 ms.
cifar100       train : [loss = 0.296, top1 = 91.81%], valid : [loss = 1.326, top1 = 67.76%], test : [loss = 1.357, top1 = 67.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.22%], valid : [loss = 2.406, top1 = 39.13%], test : [loss = 2.433, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 70.99%], valid : [loss = 0.849, top1 = 70.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10837/15625) 010837-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.502, top1 = 88.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.341, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.49 ms.
cifar100       train : [loss = 0.339, top1 = 90.84%], valid : [loss = 1.284, top1 = 67.06%], test : [loss = 1.303, top1 = 67.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.85 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.42%], valid : [loss = 2.427, top1 = 38.60%], test : [loss = 2.433, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10838/15625) 010838-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.409, top1 = 91.14%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.07 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.278, top1 = 93.60%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.23 ms.
cifar100       train : [loss = 0.043, top1 = 99.57%], valid : [loss = 1.298, top1 = 71.38%], test : [loss = 1.315, top1 = 70.74%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.25 ms.
ImageNet16-120 train : [loss = 1.445, top1 = 60.68%], valid : [loss = 2.235, top1 = 44.10%], test : [loss = 2.244, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.345, top1 = 88.15%], valid : [loss = 0.483, top1 = 83.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10839/15625) 010839-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.533, top1 = 88.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10        train : [loss = 0.028, top1 = 99.19%], test  : [loss = 0.358, top1 = 91.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.90 ms.
cifar100       train : [loss = 0.408, top1 = 88.23%], valid : [loss = 1.232, top1 = 67.18%], test : [loss = 1.260, top1 = 67.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.64%], valid : [loss = 2.412, top1 = 38.47%], test : [loss = 2.422, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 70.87%], valid : [loss = 0.866, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10840/15625) 010840-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.30%], valid : [loss = 0.572, top1 = 87.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.037, top1 = 98.90%], test  : [loss = 0.378, top1 = 90.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.46 ms.
cifar100       train : [loss = 0.533, top1 = 84.68%], valid : [loss = 1.341, top1 = 64.30%], test : [loss = 1.337, top1 = 65.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 36.87%], valid : [loss = 2.589, top1 = 34.57%], test : [loss = 2.593, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10841/15625) 010841-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.069, top1 = 97.87%], valid : [loss = 0.558, top1 = 85.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.32 ms.
cifar10        train : [loss = 0.101, top1 = 96.58%], test  : [loss = 0.402, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.86 ms.
cifar100       train : [loss = 0.686, top1 = 79.61%], valid : [loss = 1.363, top1 = 64.16%], test : [loss = 1.343, top1 = 63.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.441, top1 = 37.69%], valid : [loss = 2.564, top1 = 34.80%], test : [loss = 2.600, top1 = 34.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.83%], valid : [loss = 0.929, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10842/15625) 010842-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.21%], valid : [loss = 0.592, top1 = 85.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10        train : [loss = 0.117, top1 = 96.14%], test  : [loss = 0.403, top1 = 88.30%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.59 ms.
cifar100       train : [loss = 0.845, top1 = 75.02%], valid : [loss = 1.455, top1 = 61.44%], test : [loss = 1.420, top1 = 61.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.705, top1 = 32.34%], valid : [loss = 2.766, top1 = 31.37%], test : [loss = 2.820, top1 = 30.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.69%], valid : [loss = 0.715, top1 = 75.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10843/15625) 010843-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.80%], valid : [loss = 0.648, top1 = 78.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.499, top1 = 82.71%], test  : [loss = 0.579, top1 = 80.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 1.710, top1 = 53.75%], valid : [loss = 1.867, top1 = 49.96%], test : [loss = 1.876, top1 = 50.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 21.22%], valid : [loss = 3.331, top1 = 21.33%], test : [loss = 3.337, top1 = 21.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.259, top1 = 54.66%], valid : [loss = 1.285, top1 = 54.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10844/15625) 010844-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.472, top1 = 89.49%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.304, top1 = 93.10%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.58 ms.
cifar100       train : [loss = 0.146, top1 = 96.98%], valid : [loss = 1.278, top1 = 69.40%], test : [loss = 1.280, top1 = 68.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.740, top1 = 53.51%], valid : [loss = 2.220, top1 = 43.70%], test : [loss = 2.183, top1 = 44.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 82.11%], valid : [loss = 0.615, top1 = 79.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10845/15625) 010845-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.470, top1 = 89.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.67 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.324, top1 = 91.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.88 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.307, top1 = 66.84%], test : [loss = 1.322, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.30%], valid : [loss = 2.365, top1 = 40.08%], test : [loss = 2.410, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10846/15625) 010846-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.494, top1 = 83.16%], valid : [loss = 0.659, top1 = 77.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.536, top1 = 81.44%], test  : [loss = 0.606, top1 = 79.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.90 ms.
cifar100       train : [loss = 1.761, top1 = 52.52%], valid : [loss = 1.890, top1 = 50.44%], test : [loss = 1.920, top1 = 50.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 3.356, top1 = 20.81%], valid : [loss = 3.336, top1 = 20.93%], test : [loss = 3.364, top1 = 21.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 54.17%], valid : [loss = 1.296, top1 = 53.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10847/15625) 010847-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.563, top1 = 88.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.375, top1 = 92.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.22 ms.
cifar100       train : [loss = 0.165, top1 = 96.38%], valid : [loss = 1.361, top1 = 67.68%], test : [loss = 1.393, top1 = 67.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.98 ms.
ImageNet16-120 train : [loss = 1.977, top1 = 48.21%], valid : [loss = 2.447, top1 = 39.10%], test : [loss = 2.463, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 78.93%], valid : [loss = 0.691, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10848/15625) 010848-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.516, top1 = 81.77%], valid : [loss = 0.701, top1 = 76.34%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10        train : [loss = 0.436, top1 = 84.76%], test  : [loss = 0.574, top1 = 80.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.38 ms.
cifar100       train : [loss = 1.777, top1 = 51.72%], valid : [loss = 1.977, top1 = 47.62%], test : [loss = 1.955, top1 = 47.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.95 ms.
ImageNet16-120 train : [loss = 3.442, top1 = 18.85%], valid : [loss = 3.431, top1 = 19.47%], test : [loss = 3.462, top1 = 19.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.247, top1 = 54.68%], valid : [loss = 1.290, top1 = 53.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10849/15625) 010849-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.40 ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.19%], valid : [loss = 0.728, top1 = 74.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10        train : [loss = 0.545, top1 = 81.25%], test  : [loss = 0.601, top1 = 79.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.12 ms.
cifar100       train : [loss = 2.017, top1 = 45.97%], valid : [loss = 2.150, top1 = 43.47%], test : [loss = 2.137, top1 = 43.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 3.242, top1 = 22.17%], valid : [loss = 3.229, top1 = 22.81%], test : [loss = 3.255, top1 = 22.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.49%], valid : [loss = 1.351, top1 = 51.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10850/15625) 010850-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.09 ms.
cifar10-valid  train : [loss = 0.312, top1 = 89.42%], valid : [loss = 0.538, top1 = 83.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.75 ms.
cifar10        train : [loss = 0.269, top1 = 90.92%], test  : [loss = 0.428, top1 = 85.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 1.438, top1 = 59.96%], valid : [loss = 1.667, top1 = 54.60%], test : [loss = 1.657, top1 = 54.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.38%], valid : [loss = 2.936, top1 = 27.80%], test : [loss = 2.973, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.41%], valid : [loss = 1.063, top1 = 62.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10851/15625) 010851-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.472, top1 = 89.13%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.74 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.32%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.31 ms.
cifar100       train : [loss = 0.325, top1 = 91.19%], valid : [loss = 1.237, top1 = 67.70%], test : [loss = 1.240, top1 = 67.94%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.73 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.84%], valid : [loss = 2.311, top1 = 41.00%], test : [loss = 2.318, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 83.05%], valid : [loss = 0.586, top1 = 80.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10852/15625) 010852-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.69%], valid : [loss = 0.751, top1 = 82.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.097, top1 = 96.83%], test  : [loss = 0.492, top1 = 86.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.16 ms.
cifar100       train : [loss = 0.819, top1 = 76.04%], valid : [loss = 1.559, top1 = 59.52%], test : [loss = 1.523, top1 = 59.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.08 ms.
ImageNet16-120 train : [loss = 2.855, top1 = 29.49%], valid : [loss = 2.978, top1 = 27.37%], test : [loss = 3.020, top1 = 27.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 69.22%], valid : [loss = 0.925, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10853/15625) 010853-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.77%], valid : [loss = 0.846, top1 = 81.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.082, top1 = 97.49%], test  : [loss = 0.500, top1 = 86.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.49 ms.
cifar100       train : [loss = 0.805, top1 = 76.52%], valid : [loss = 1.547, top1 = 60.22%], test : [loss = 1.503, top1 = 60.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.32 ms.
ImageNet16-120 train : [loss = 2.827, top1 = 30.08%], valid : [loss = 2.967, top1 = 27.87%], test : [loss = 2.982, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10854/15625) 010854-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.37 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.55 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.74 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.10 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10855/15625) 010855-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.519, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.51 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.331, top1 = 92.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.39 ms.
cifar100       train : [loss = 0.124, top1 = 97.51%], valid : [loss = 1.313, top1 = 69.12%], test : [loss = 1.317, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.75%], valid : [loss = 2.325, top1 = 40.80%], test : [loss = 2.337, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.37%], valid : [loss = 0.692, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10856/15625) 010856-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.522, top1 = 88.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.338, top1 = 91.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.33 ms.
cifar100       train : [loss = 0.316, top1 = 91.50%], valid : [loss = 1.263, top1 = 67.61%], test : [loss = 1.259, top1 = 67.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.70%], valid : [loss = 2.321, top1 = 41.27%], test : [loss = 2.343, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.66%], valid : [loss = 0.696, top1 = 75.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10857/15625) 010857-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.548, top1 = 87.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.378, top1 = 91.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 0.381, top1 = 89.40%], valid : [loss = 1.410, top1 = 64.77%], test : [loss = 1.380, top1 = 65.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.253, top1 = 42.04%], valid : [loss = 2.477, top1 = 37.58%], test : [loss = 2.496, top1 = 36.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.64%], valid : [loss = 0.764, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10858/15625) 010858-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.93%], valid : [loss = 0.546, top1 = 86.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.91 ms.
cifar10        train : [loss = 0.064, top1 = 97.92%], test  : [loss = 0.373, top1 = 89.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.48 ms.
cifar100       train : [loss = 0.655, top1 = 80.72%], valid : [loss = 1.309, top1 = 64.58%], test : [loss = 1.320, top1 = 64.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.09%], valid : [loss = 2.522, top1 = 36.23%], test : [loss = 2.584, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10859/15625) 010859-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.527, top1 = 89.33%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.78 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.338, top1 = 92.45%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.45 ms.
cifar100       train : [loss = 0.199, top1 = 95.19%], valid : [loss = 1.298, top1 = 68.52%], test : [loss = 1.303, top1 = 68.46%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.71%], valid : [loss = 2.304, top1 = 41.10%], test : [loss = 2.297, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.41%], valid : [loss = 0.754, top1 = 74.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10860/15625) 010860-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.458, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.83 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.315, top1 = 92.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.252, top1 = 93.61%], valid : [loss = 1.256, top1 = 68.38%], test : [loss = 1.217, top1 = 69.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.47%], valid : [loss = 2.232, top1 = 41.83%], test : [loss = 2.246, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.00%], valid : [loss = 0.650, top1 = 77.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10861/15625) 010861-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=21.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.486, top1 = 90.22%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=23.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.296, top1 = 93.56%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=21.93 ms.
cifar100       train : [loss = 0.054, top1 = 99.38%], valid : [loss = 1.294, top1 = 70.40%], test : [loss = 1.282, top1 = 70.92%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=22.08 ms.
ImageNet16-120 train : [loss = 1.641, top1 = 55.97%], valid : [loss = 2.219, top1 = 43.13%], test : [loss = 2.226, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.93%], valid : [loss = 0.649, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10862/15625) 010862-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.65%], valid : [loss = 0.565, top1 = 87.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.89 ms.
cifar10        train : [loss = 0.017, top1 = 99.53%], test  : [loss = 0.373, top1 = 91.70%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.80 ms.
cifar100       train : [loss = 0.265, top1 = 92.56%], valid : [loss = 1.380, top1 = 66.62%], test : [loss = 1.352, top1 = 67.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 35.71%], valid : [loss = 2.618, top1 = 33.60%], test : [loss = 2.629, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 66.95%], valid : [loss = 0.954, top1 = 66.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10863/15625) 010863-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.57%], valid : [loss = 0.617, top1 = 84.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10        train : [loss = 0.091, top1 = 97.04%], test  : [loss = 0.420, top1 = 88.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.10 ms.
cifar100       train : [loss = 0.596, top1 = 82.45%], valid : [loss = 1.523, top1 = 61.98%], test : [loss = 1.532, top1 = 61.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 3.153, top1 = 22.96%], valid : [loss = 3.181, top1 = 22.10%], test : [loss = 3.203, top1 = 21.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.16%], valid : [loss = 1.074, top1 = 61.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10864/15625) 010864-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.95 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.50%], valid : [loss = 0.680, top1 = 84.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.90 ms.
cifar10        train : [loss = 0.054, top1 = 98.35%], test  : [loss = 0.442, top1 = 88.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.45 ms.
cifar100       train : [loss = 0.588, top1 = 82.76%], valid : [loss = 1.519, top1 = 61.60%], test : [loss = 1.496, top1 = 61.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 2.663, top1 = 33.51%], valid : [loss = 2.820, top1 = 31.00%], test : [loss = 2.846, top1 = 30.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.67%], valid : [loss = 0.942, top1 = 66.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10865/15625) 010865-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.04%], valid : [loss = 0.594, top1 = 85.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.073, top1 = 97.79%], test  : [loss = 0.399, top1 = 88.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.24 ms.
cifar100       train : [loss = 0.726, top1 = 79.05%], valid : [loss = 1.392, top1 = 62.22%], test : [loss = 1.418, top1 = 61.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 36.00%], valid : [loss = 2.641, top1 = 34.40%], test : [loss = 2.683, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.16%], valid : [loss = 0.783, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10866/15625) 010866-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.566, top1 = 87.88%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.30 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.382, top1 = 91.33%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.99 ms.
cifar100       train : [loss = 0.377, top1 = 89.38%], valid : [loss = 1.412, top1 = 65.37%], test : [loss = 1.381, top1 = 65.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.34%], valid : [loss = 2.504, top1 = 36.89%], test : [loss = 2.521, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.44%], valid : [loss = 0.743, top1 = 74.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10867/15625) 010867-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10-valid  train : [loss = 1.219, top1 = 56.19%], valid : [loss = 1.259, top1 = 55.10%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 1.141, top1 = 59.34%], test  : [loss = 1.152, top1 = 58.78%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.24 ms.
cifar100       train : [loss = 2.712, top1 = 32.19%], valid : [loss = 2.789, top1 = 30.93%], test : [loss = 2.773, top1 = 31.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.76 ms.
ImageNet16-120 train : [loss = 3.870, top1 = 12.41%], valid : [loss = 3.869, top1 = 12.71%], test : [loss = 3.887, top1 = 12.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10868/15625) 010868-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.32%], valid : [loss = 0.469, top1 = 85.93%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=15.28 ms.
cifar10        train : [loss = 0.158, top1 = 94.84%], test  : [loss = 0.348, top1 = 88.67%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=13.46 ms.
cifar100       train : [loss = 0.982, top1 = 72.10%], valid : [loss = 1.350, top1 = 62.26%], test : [loss = 1.347, top1 = 62.25%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.84%], valid : [loss = 2.691, top1 = 32.92%], test : [loss = 2.709, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10869/15625) 010869-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.52 ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.19%], valid : [loss = 0.780, top1 = 73.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10        train : [loss = 0.581, top1 = 79.83%], test  : [loss = 0.641, top1 = 78.04%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 2.106, top1 = 43.59%], valid : [loss = 2.244, top1 = 41.20%], test : [loss = 2.241, top1 = 40.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 3.315, top1 = 20.93%], valid : [loss = 3.297, top1 = 21.30%], test : [loss = 3.347, top1 = 20.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.287, top1 = 53.38%], valid : [loss = 1.344, top1 = 51.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10870/15625) 010870-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.520, top1 = 88.39%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.029, top1 = 99.14%], test  : [loss = 0.376, top1 = 90.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.93 ms.
cifar100       train : [loss = 0.483, top1 = 85.85%], valid : [loss = 1.346, top1 = 65.68%], test : [loss = 1.356, top1 = 65.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.317, top1 = 40.55%], valid : [loss = 2.523, top1 = 37.60%], test : [loss = 2.563, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.27%], valid : [loss = 0.716, top1 = 75.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10871/15625) 010871-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.33%], valid : [loss = 0.531, top1 = 87.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.81 ms.
cifar10        train : [loss = 0.061, top1 = 98.08%], test  : [loss = 0.370, top1 = 90.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.96 ms.
cifar100       train : [loss = 0.648, top1 = 80.89%], valid : [loss = 1.327, top1 = 63.95%], test : [loss = 1.314, top1 = 64.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.40%], valid : [loss = 2.509, top1 = 36.82%], test : [loss = 2.515, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.26%], valid : [loss = 0.775, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10872/15625) 010872-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.403, top1 = 91.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.271, top1 = 93.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.52 ms.
cifar100       train : [loss = 0.056, top1 = 99.27%], valid : [loss = 1.327, top1 = 70.86%], test : [loss = 1.310, top1 = 70.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 1.506, top1 = 59.06%], valid : [loss = 2.257, top1 = 43.43%], test : [loss = 2.261, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.386, top1 = 86.54%], valid : [loss = 0.512, top1 = 82.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10873/15625) 010873-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.585, top1 = 87.92%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.55 ms.
cifar10        train : [loss = 0.019, top1 = 99.46%], test  : [loss = 0.351, top1 = 91.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.17 ms.
cifar100       train : [loss = 0.262, top1 = 93.10%], valid : [loss = 1.257, top1 = 68.40%], test : [loss = 1.279, top1 = 68.16%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.78 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.01%], valid : [loss = 2.476, top1 = 37.13%], test : [loss = 2.479, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.59%], valid : [loss = 0.947, top1 = 66.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10874/15625) 010874-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.598, top1 = 87.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.368, top1 = 91.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.176, top1 = 95.34%], valid : [loss = 1.501, top1 = 65.88%], test : [loss = 1.457, top1 = 66.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 38.76%], valid : [loss = 2.582, top1 = 35.23%], test : [loss = 2.593, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.98%], valid : [loss = 0.920, top1 = 67.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10875/15625) 010875-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.540, top1 = 80.90%], valid : [loss = 0.731, top1 = 75.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10        train : [loss = 0.472, top1 = 83.44%], test  : [loss = 0.606, top1 = 79.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.14 ms.
cifar100       train : [loss = 1.782, top1 = 51.12%], valid : [loss = 1.980, top1 = 47.12%], test : [loss = 1.976, top1 = 48.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 3.459, top1 = 18.53%], valid : [loss = 3.455, top1 = 19.67%], test : [loss = 3.482, top1 = 17.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.238, top1 = 55.08%], valid : [loss = 1.272, top1 = 54.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10876/15625) 010876-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10877/15625) 010877-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.627, top1 = 85.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.068, top1 = 97.91%], test  : [loss = 0.402, top1 = 88.90%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 0.707, top1 = 79.53%], valid : [loss = 1.380, top1 = 63.52%], test : [loss = 1.368, top1 = 63.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 2.522, top1 = 36.26%], valid : [loss = 2.656, top1 = 33.77%], test : [loss = 2.669, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10878/15625) 010878-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.467, top1 = 89.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.39 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.333, top1 = 92.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.120, top1 = 97.44%], valid : [loss = 1.363, top1 = 69.02%], test : [loss = 1.402, top1 = 68.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.50%], valid : [loss = 2.273, top1 = 42.07%], test : [loss = 2.286, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.56%], valid : [loss = 0.625, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10879/15625) 010879-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.55 ms.
cifar10-valid  train : [loss = 0.381, top1 = 86.59%], valid : [loss = 0.625, top1 = 79.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10        train : [loss = 0.309, top1 = 89.33%], test  : [loss = 0.449, top1 = 85.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 1.630, top1 = 54.87%], valid : [loss = 1.861, top1 = 50.42%], test : [loss = 1.859, top1 = 50.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.33 ms.
ImageNet16-120 train : [loss = 2.988, top1 = 26.81%], valid : [loss = 3.007, top1 = 26.70%], test : [loss = 3.051, top1 = 25.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.001, top1 = 63.71%], valid : [loss = 1.047, top1 = 62.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10880/15625) 010880-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.548, top1 = 87.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.027, top1 = 99.25%], test  : [loss = 0.349, top1 = 91.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.416, top1 = 87.89%], valid : [loss = 1.258, top1 = 66.04%], test : [loss = 1.294, top1 = 66.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.69%], valid : [loss = 2.430, top1 = 38.70%], test : [loss = 2.475, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10881/15625) 010881-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.396, top1 = 85.73%], valid : [loss = 0.646, top1 = 78.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.34 ms.
cifar10        train : [loss = 0.337, top1 = 88.32%], test  : [loss = 0.461, top1 = 85.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.60 ms.
cifar100       train : [loss = 1.607, top1 = 55.30%], valid : [loss = 1.838, top1 = 50.76%], test : [loss = 1.849, top1 = 50.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 3.112, top1 = 24.40%], valid : [loss = 3.103, top1 = 24.87%], test : [loss = 3.164, top1 = 23.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.028, top1 = 63.05%], valid : [loss = 1.087, top1 = 61.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10882/15625) 010882-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.685, top1 = 86.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.478, top1 = 89.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.34 ms.
cifar100       train : [loss = 0.266, top1 = 93.05%], valid : [loss = 1.567, top1 = 64.08%], test : [loss = 1.576, top1 = 64.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.330, top1 = 40.24%], valid : [loss = 2.717, top1 = 33.63%], test : [loss = 2.758, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.94%], valid : [loss = 0.812, top1 = 71.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10883/15625) 010883-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.627, top1 = 86.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.034, top1 = 99.01%], test  : [loss = 0.419, top1 = 89.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.527, top1 = 84.56%], valid : [loss = 1.453, top1 = 63.64%], test : [loss = 1.425, top1 = 63.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.415, top1 = 38.46%], valid : [loss = 2.606, top1 = 35.03%], test : [loss = 2.634, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.70%], valid : [loss = 0.877, top1 = 68.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10884/15625) 010884-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.521, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.322, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.79 ms.
cifar100       train : [loss = 0.324, top1 = 91.28%], valid : [loss = 1.281, top1 = 67.15%], test : [loss = 1.269, top1 = 67.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.03%], valid : [loss = 2.403, top1 = 38.92%], test : [loss = 2.406, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10885/15625) 010885-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.507, top1 = 88.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.72 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.336, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.49 ms.
cifar100       train : [loss = 0.341, top1 = 90.67%], valid : [loss = 1.278, top1 = 67.42%], test : [loss = 1.294, top1 = 67.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.17%], valid : [loss = 2.432, top1 = 38.27%], test : [loss = 2.419, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10886/15625) 010886-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.300, top1 = 92.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.311, top1 = 91.64%], valid : [loss = 1.220, top1 = 68.26%], test : [loss = 1.262, top1 = 67.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.74%], valid : [loss = 2.296, top1 = 40.23%], test : [loss = 2.311, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10887/15625) 010887-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.450, top1 = 89.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.293, top1 = 92.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 0.238, top1 = 94.09%], valid : [loss = 1.269, top1 = 68.42%], test : [loss = 1.260, top1 = 68.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 49.88%], valid : [loss = 2.267, top1 = 43.33%], test : [loss = 2.313, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 85.06%], valid : [loss = 0.541, top1 = 81.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10888/15625) 010888-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.32 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.67%], valid : [loss = 0.476, top1 = 84.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.77 ms.
cifar10        train : [loss = 0.302, top1 = 89.91%], test  : [loss = 0.408, top1 = 86.13%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.26 ms.
cifar100       train : [loss = 1.337, top1 = 62.97%], valid : [loss = 1.544, top1 = 58.14%], test : [loss = 1.527, top1 = 57.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.03 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.51%], valid : [loss = 2.920, top1 = 29.43%], test : [loss = 2.965, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10889/15625) 010889-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.483, top1 = 89.56%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.18 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.330, top1 = 92.53%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.71 ms.
cifar100       train : [loss = 0.148, top1 = 96.71%], valid : [loss = 1.317, top1 = 69.74%], test : [loss = 1.282, top1 = 70.26%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.82 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.75%], valid : [loss = 2.203, top1 = 43.30%], test : [loss = 2.265, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.460, top1 = 83.88%], valid : [loss = 0.570, top1 = 80.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10890/15625) 010890-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.29%], valid : [loss = 0.543, top1 = 86.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.049, top1 = 98.62%], test  : [loss = 0.364, top1 = 90.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.522, top1 = 85.08%], valid : [loss = 1.312, top1 = 65.33%], test : [loss = 1.309, top1 = 65.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.21%], valid : [loss = 2.418, top1 = 38.73%], test : [loss = 2.445, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.50%], valid : [loss = 0.834, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10891/15625) 010891-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.03%], valid : [loss = 0.749, top1 = 81.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.140, top1 = 95.16%], test  : [loss = 0.504, top1 = 85.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.36 ms.
cifar100       train : [loss = 0.514, top1 = 85.01%], valid : [loss = 1.713, top1 = 58.40%], test : [loss = 1.754, top1 = 58.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.11 ms.
ImageNet16-120 train : [loss = 3.358, top1 = 19.26%], valid : [loss = 3.387, top1 = 18.97%], test : [loss = 3.415, top1 = 18.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.296, top1 = 52.24%], valid : [loss = 1.326, top1 = 51.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10892/15625) 010892-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.240, top1 = 91.86%], valid : [loss = 0.530, top1 = 83.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10        train : [loss = 0.242, top1 = 91.83%], test  : [loss = 0.383, top1 = 87.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.07 ms.
cifar100       train : [loss = 1.371, top1 = 61.45%], valid : [loss = 1.639, top1 = 55.49%], test : [loss = 1.620, top1 = 56.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.858, top1 = 29.47%], valid : [loss = 2.867, top1 = 29.88%], test : [loss = 2.925, top1 = 28.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 0.979, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10893/15625) 010893-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.64%], valid : [loss = 0.456, top1 = 86.31%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.89 ms.
cifar10        train : [loss = 0.153, top1 = 95.07%], test  : [loss = 0.345, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.51 ms.
cifar100       train : [loss = 0.968, top1 = 72.36%], valid : [loss = 1.339, top1 = 62.67%], test : [loss = 1.343, top1 = 62.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.06%], valid : [loss = 2.676, top1 = 33.04%], test : [loss = 2.702, top1 = 32.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.26%], valid : [loss = 0.756, top1 = 73.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10894/15625) 010894-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.01%], valid : [loss = 0.727, top1 = 76.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10        train : [loss = 0.375, top1 = 86.97%], test  : [loss = 0.504, top1 = 83.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.04 ms.
cifar100       train : [loss = 1.594, top1 = 56.04%], valid : [loss = 1.815, top1 = 51.14%], test : [loss = 1.839, top1 = 51.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 3.290, top1 = 21.57%], valid : [loss = 3.299, top1 = 21.67%], test : [loss = 3.331, top1 = 20.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.184, top1 = 57.42%], valid : [loss = 1.231, top1 = 56.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10895/15625) 010895-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.603, top1 = 86.52%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.027, top1 = 99.37%], test  : [loss = 0.409, top1 = 89.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.81 ms.
cifar100       train : [loss = 0.316, top1 = 91.90%], valid : [loss = 1.388, top1 = 66.20%], test : [loss = 1.364, top1 = 66.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.78%], valid : [loss = 2.503, top1 = 36.97%], test : [loss = 2.523, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.55%], valid : [loss = 0.764, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10896/15625) 010896-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.528, top1 = 89.53%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.98 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.339, top1 = 93.08%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.60 ms.
cifar100       train : [loss = 0.072, top1 = 98.84%], valid : [loss = 1.389, top1 = 68.79%], test : [loss = 1.396, top1 = 69.23%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.57%], valid : [loss = 2.295, top1 = 41.72%], test : [loss = 2.300, top1 = 41.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.48%], valid : [loss = 0.622, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10897/15625) 010897-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.538, top1 = 88.87%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.13 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.348, top1 = 92.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.34 ms.
cifar100       train : [loss = 0.195, top1 = 94.96%], valid : [loss = 1.392, top1 = 67.44%], test : [loss = 1.411, top1 = 66.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.74 ms.
ImageNet16-120 train : [loss = 2.443, top1 = 37.23%], valid : [loss = 2.577, top1 = 35.10%], test : [loss = 2.597, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.006, top1 = 63.96%], valid : [loss = 1.021, top1 = 63.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10898/15625) 010898-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.571, top1 = 87.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.393, top1 = 91.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.40 ms.
cifar100       train : [loss = 0.397, top1 = 88.82%], valid : [loss = 1.414, top1 = 65.01%], test : [loss = 1.420, top1 = 65.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.01 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.73%], valid : [loss = 2.517, top1 = 36.48%], test : [loss = 2.536, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10899/15625) 010899-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.217, top1 = 92.65%], valid : [loss = 0.547, top1 = 83.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.204, top1 = 93.01%], test  : [loss = 0.395, top1 = 87.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 1.295, top1 = 63.23%], valid : [loss = 1.575, top1 = 56.77%], test : [loss = 1.575, top1 = 56.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.725, top1 = 32.08%], valid : [loss = 2.745, top1 = 31.54%], test : [loss = 2.791, top1 = 30.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.82%], valid : [loss = 0.991, top1 = 64.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10900/15625) 010900-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.90%], valid : [loss = 0.474, top1 = 84.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.299, top1 = 89.97%], test  : [loss = 0.398, top1 = 86.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 1.322, top1 = 63.25%], valid : [loss = 1.539, top1 = 57.30%], test : [loss = 1.494, top1 = 59.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.39%], valid : [loss = 2.918, top1 = 28.77%], test : [loss = 2.943, top1 = 29.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10901/15625) 010901-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.478, top1 = 88.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.322, top1 = 92.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.21 ms.
cifar100       train : [loss = 0.251, top1 = 93.60%], valid : [loss = 1.254, top1 = 68.02%], test : [loss = 1.243, top1 = 68.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.69%], valid : [loss = 2.273, top1 = 41.53%], test : [loss = 2.300, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.84%], valid : [loss = 0.616, top1 = 78.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10902/15625) 010902-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.416, top1 = 90.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.261, top1 = 93.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=14.96 ms.
cifar100       train : [loss = 0.078, top1 = 98.86%], valid : [loss = 1.298, top1 = 71.10%], test : [loss = 1.279, top1 = 71.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 1.546, top1 = 58.23%], valid : [loss = 2.214, top1 = 45.23%], test : [loss = 2.201, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.79%], valid : [loss = 0.479, top1 = 83.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10903/15625) 010903-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.43%], valid : [loss = 0.644, top1 = 84.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.56 ms.
cifar10        train : [loss = 0.084, top1 = 97.33%], test  : [loss = 0.383, top1 = 89.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.83 ms.
cifar100       train : [loss = 0.795, top1 = 76.69%], valid : [loss = 1.424, top1 = 61.96%], test : [loss = 1.430, top1 = 61.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.14%], valid : [loss = 2.704, top1 = 32.77%], test : [loss = 2.749, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10904/15625) 010904-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.532, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.66 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.343, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.28 ms.
cifar100       train : [loss = 0.258, top1 = 93.06%], valid : [loss = 1.349, top1 = 66.86%], test : [loss = 1.326, top1 = 67.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.232, top1 = 42.21%], valid : [loss = 2.446, top1 = 37.90%], test : [loss = 2.491, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.921, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10905/15625) 010905-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.80%], valid : [loss = 0.676, top1 = 86.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.385, top1 = 91.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.77 ms.
cifar100       train : [loss = 0.216, top1 = 94.68%], valid : [loss = 1.579, top1 = 64.18%], test : [loss = 1.572, top1 = 64.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.69%], valid : [loss = 2.509, top1 = 37.37%], test : [loss = 2.523, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.00%], valid : [loss = 0.854, top1 = 70.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10906/15625) 010906-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.668 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.531, top1 = 88.65%]
cifar10        FLOP= 94.29 M, Params=0.668 MB, latency=17.46 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.354, top1 = 91.92%]
cifar100       FLOP= 94.30 M, Params=0.674 MB, latency=17.52 ms.
cifar100       train : [loss = 0.310, top1 = 91.27%], valid : [loss = 1.321, top1 = 67.01%], test : [loss = 1.330, top1 = 67.00%]
ImageNet16-120 FLOP= 23.58 M, Params=0.676 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.65%], valid : [loss = 2.425, top1 = 38.23%], test : [loss = 2.445, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.33%], valid : [loss = 0.832, top1 = 70.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10907/15625) 010907-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.41%], valid : [loss = 0.464, top1 = 85.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.162, top1 = 94.61%], test  : [loss = 0.350, top1 = 88.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 1.020, top1 = 70.99%], valid : [loss = 1.372, top1 = 62.02%], test : [loss = 1.370, top1 = 61.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.12%], valid : [loss = 2.676, top1 = 32.70%], test : [loss = 2.690, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10908/15625) 010908-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.46%], valid : [loss = 0.630, top1 = 85.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.14 ms.
cifar10        train : [loss = 0.051, top1 = 98.49%], test  : [loss = 0.425, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.18 ms.
cifar100       train : [loss = 0.635, top1 = 81.57%], valid : [loss = 1.419, top1 = 63.19%], test : [loss = 1.393, top1 = 63.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.59%], valid : [loss = 2.619, top1 = 34.29%], test : [loss = 2.673, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.52%], valid : [loss = 0.838, top1 = 70.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10909/15625) 010909-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.84%], valid : [loss = 0.593, top1 = 86.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.90 ms.
cifar10        train : [loss = 0.029, top1 = 99.26%], test  : [loss = 0.420, top1 = 89.65%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.44 ms.
cifar100       train : [loss = 0.399, top1 = 89.02%], valid : [loss = 1.379, top1 = 65.02%], test : [loss = 1.380, top1 = 65.14%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.79%], valid : [loss = 2.547, top1 = 36.10%], test : [loss = 2.571, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 76.09%], valid : [loss = 0.751, top1 = 73.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10910/15625) 010910-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.22%], valid : [loss = 0.614, top1 = 85.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.401, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.42 ms.
cifar100       train : [loss = 0.718, top1 = 79.13%], valid : [loss = 1.394, top1 = 63.11%], test : [loss = 1.388, top1 = 63.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.79%], valid : [loss = 2.657, top1 = 33.23%], test : [loss = 2.711, top1 = 33.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10911/15625) 010911-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.483, top1 = 89.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.298, top1 = 92.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.95 ms.
cifar100       train : [loss = 0.262, top1 = 93.20%], valid : [loss = 1.221, top1 = 69.04%], test : [loss = 1.200, top1 = 70.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.47%], valid : [loss = 2.226, top1 = 42.33%], test : [loss = 2.238, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10912/15625) 010912-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.530, top1 = 88.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.337, top1 = 92.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.64 ms.
cifar100       train : [loss = 0.345, top1 = 90.63%], valid : [loss = 1.283, top1 = 66.58%], test : [loss = 1.291, top1 = 67.66%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.36%], valid : [loss = 2.421, top1 = 39.23%], test : [loss = 2.421, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.65%], valid : [loss = 0.786, top1 = 72.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10913/15625) 010913-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.15 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.03 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10914/15625) 010914-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.505, top1 = 89.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.43 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.353, top1 = 92.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.137, top1 = 96.94%], valid : [loss = 1.341, top1 = 68.18%], test : [loss = 1.314, top1 = 69.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.801, top1 = 52.24%], valid : [loss = 2.200, top1 = 44.60%], test : [loss = 2.234, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.98%], valid : [loss = 0.673, top1 = 76.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10915/15625) 010915-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.98%], valid : [loss = 0.725, top1 = 75.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.89 ms.
cifar10        train : [loss = 0.550, top1 = 81.04%], test  : [loss = 0.601, top1 = 79.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.53 ms.
cifar100       train : [loss = 2.009, top1 = 46.37%], valid : [loss = 2.125, top1 = 44.49%], test : [loss = 2.105, top1 = 44.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.52%], valid : [loss = 3.203, top1 = 23.46%], test : [loss = 3.230, top1 = 22.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.286, top1 = 53.61%], valid : [loss = 1.351, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10916/15625) 010916-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.479, top1 = 89.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.69 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.315, top1 = 92.56%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.83 ms.
cifar100       train : [loss = 0.266, top1 = 93.11%], valid : [loss = 1.221, top1 = 69.10%], test : [loss = 1.224, top1 = 69.00%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.61%], valid : [loss = 2.211, top1 = 42.47%], test : [loss = 2.242, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.609, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10917/15625) 010917-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.42%], valid : [loss = 0.690, top1 = 84.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10        train : [loss = 0.053, top1 = 98.34%], test  : [loss = 0.425, top1 = 88.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.91 ms.
cifar100       train : [loss = 0.626, top1 = 81.81%], valid : [loss = 1.492, top1 = 61.70%], test : [loss = 1.494, top1 = 61.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.682, top1 = 33.02%], valid : [loss = 2.812, top1 = 30.63%], test : [loss = 2.884, top1 = 30.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.17%], valid : [loss = 0.860, top1 = 69.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10918/15625) 010918-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.46%], valid : [loss = 0.565, top1 = 87.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.034, top1 = 98.97%], test  : [loss = 0.365, top1 = 90.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.33 ms.
cifar100       train : [loss = 0.461, top1 = 86.94%], valid : [loss = 1.293, top1 = 65.50%], test : [loss = 1.300, top1 = 65.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.26%], valid : [loss = 2.621, top1 = 33.10%], test : [loss = 2.686, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.80%], valid : [loss = 0.906, top1 = 67.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10919/15625) 010919-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.64%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.331, top1 = 92.94%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.09 ms.
cifar100       train : [loss = 0.120, top1 = 97.58%], valid : [loss = 1.353, top1 = 69.12%], test : [loss = 1.352, top1 = 69.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.82 ms.
ImageNet16-120 train : [loss = 1.759, top1 = 52.94%], valid : [loss = 2.198, top1 = 43.00%], test : [loss = 2.226, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.27%], valid : [loss = 0.705, top1 = 75.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10920/15625) 010920-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.565, top1 = 88.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.64 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.377, top1 = 92.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.07 ms.
cifar100       train : [loss = 0.103, top1 = 98.11%], valid : [loss = 1.462, top1 = 68.25%], test : [loss = 1.454, top1 = 68.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.53%], valid : [loss = 2.420, top1 = 39.79%], test : [loss = 2.448, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.31%], valid : [loss = 0.685, top1 = 76.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10921/15625) 010921-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.541, top1 = 88.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.339, top1 = 92.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 0.311, top1 = 91.43%], valid : [loss = 1.332, top1 = 66.98%], test : [loss = 1.324, top1 = 67.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.089, top1 = 45.52%], valid : [loss = 2.393, top1 = 39.49%], test : [loss = 2.373, top1 = 39.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.88%], valid : [loss = 0.808, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10922/15625) 010922-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.28 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.47%], valid : [loss = 0.629, top1 = 85.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.058, top1 = 98.20%], test  : [loss = 0.414, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 0.661, top1 = 80.76%], valid : [loss = 1.395, top1 = 63.39%], test : [loss = 1.369, top1 = 63.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.476, top1 = 37.16%], valid : [loss = 2.612, top1 = 34.64%], test : [loss = 2.654, top1 = 34.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.58%], valid : [loss = 0.825, top1 = 71.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10923/15625) 010923-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.303, top1 = 89.51%], valid : [loss = 0.540, top1 = 82.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.260, top1 = 91.06%], test  : [loss = 0.420, top1 = 86.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.65 ms.
cifar100       train : [loss = 1.474, top1 = 58.71%], valid : [loss = 1.711, top1 = 53.67%], test : [loss = 1.711, top1 = 53.41%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.902, top1 = 28.53%], valid : [loss = 2.924, top1 = 28.53%], test : [loss = 2.956, top1 = 27.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.27%], valid : [loss = 1.068, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10924/15625) 010924-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.539, top1 = 89.22%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.60 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.351, top1 = 92.72%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.76 ms.
cifar100       train : [loss = 0.070, top1 = 98.93%], valid : [loss = 1.509, top1 = 68.10%], test : [loss = 1.499, top1 = 68.32%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.57 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.16%], valid : [loss = 2.383, top1 = 40.60%], test : [loss = 2.380, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.38%], valid : [loss = 0.693, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10925/15625) 010925-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.563, top1 = 87.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.388, top1 = 90.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.73 ms.
cifar100       train : [loss = 0.405, top1 = 88.52%], valid : [loss = 1.368, top1 = 65.85%], test : [loss = 1.384, top1 = 65.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.90%], valid : [loss = 2.520, top1 = 36.59%], test : [loss = 2.535, top1 = 36.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.12%], valid : [loss = 0.778, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10926/15625) 010926-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.96%], valid : [loss = 0.565, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10        train : [loss = 0.071, top1 = 97.69%], test  : [loss = 0.395, top1 = 89.41%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.21 ms.
cifar100       train : [loss = 0.627, top1 = 81.70%], valid : [loss = 1.359, top1 = 64.50%], test : [loss = 1.377, top1 = 63.25%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.15%], valid : [loss = 2.541, top1 = 36.10%], test : [loss = 2.545, top1 = 36.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.83%], valid : [loss = 0.910, top1 = 67.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10927/15625) 010927-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.502, top1 = 88.91%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.326, top1 = 92.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.62 ms.
cifar100       train : [loss = 0.325, top1 = 91.28%], valid : [loss = 1.266, top1 = 67.32%], test : [loss = 1.288, top1 = 66.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.25%], valid : [loss = 2.408, top1 = 38.84%], test : [loss = 2.414, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10928/15625) 010928-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.549, top1 = 88.42%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.67 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.353, top1 = 92.09%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.43 ms.
cifar100       train : [loss = 0.121, top1 = 97.21%], valid : [loss = 1.398, top1 = 68.11%], test : [loss = 1.393, top1 = 68.65%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.16%], valid : [loss = 2.788, top1 = 30.27%], test : [loss = 2.790, top1 = 30.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.03%], valid : [loss = 0.965, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10929/15625) 010929-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.571, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.15 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.378, top1 = 92.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.090, top1 = 98.41%], valid : [loss = 1.458, top1 = 68.38%], test : [loss = 1.465, top1 = 68.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.86 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.19%], valid : [loss = 2.439, top1 = 39.33%], test : [loss = 2.445, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.30%], valid : [loss = 0.725, top1 = 75.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10930/15625) 010930-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.656, top1 = 86.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.66 ms.
cifar10        train : [loss = 0.024, top1 = 99.38%], test  : [loss = 0.463, top1 = 89.28%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.95 ms.
cifar100       train : [loss = 0.336, top1 = 91.13%], valid : [loss = 1.459, top1 = 64.79%], test : [loss = 1.470, top1 = 64.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.64 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.81%], valid : [loss = 2.609, top1 = 34.78%], test : [loss = 2.612, top1 = 35.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.78%], valid : [loss = 0.766, top1 = 73.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10931/15625) 010931-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10932/15625) 010932-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.488, top1 = 89.42%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.72 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.327, top1 = 92.26%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.41 ms.
cifar100       train : [loss = 0.219, top1 = 94.70%], valid : [loss = 1.260, top1 = 69.05%], test : [loss = 1.268, top1 = 68.48%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=22.50 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.01%], valid : [loss = 2.169, top1 = 44.44%], test : [loss = 2.206, top1 = 43.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.51%], valid : [loss = 0.670, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10933/15625) 010933-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.481, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.84 ms.
cifar100       train : [loss = 0.325, top1 = 91.22%], valid : [loss = 1.248, top1 = 67.95%], test : [loss = 1.251, top1 = 67.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.64%], valid : [loss = 2.324, top1 = 40.72%], test : [loss = 2.341, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.29%], valid : [loss = 0.617, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10934/15625) 010934-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.043, top1 = 99.04%], valid : [loss = 0.545, top1 = 86.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.058, top1 = 98.40%], test  : [loss = 0.359, top1 = 90.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.87 ms.
cifar100       train : [loss = 0.558, top1 = 83.98%], valid : [loss = 1.293, top1 = 65.43%], test : [loss = 1.300, top1 = 65.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.251, top1 = 41.91%], valid : [loss = 2.425, top1 = 38.61%], test : [loss = 2.434, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.59%], valid : [loss = 0.911, top1 = 68.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10935/15625) 010935-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.429, top1 = 90.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.289, top1 = 93.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.09 ms.
cifar100       train : [loss = 0.060, top1 = 99.26%], valid : [loss = 1.314, top1 = 71.09%], test : [loss = 1.334, top1 = 70.35%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 1.494, top1 = 59.48%], valid : [loss = 2.219, top1 = 44.39%], test : [loss = 2.235, top1 = 45.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 88.09%], valid : [loss = 0.483, top1 = 84.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10936/15625) 010936-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.484, top1 = 88.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.301, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.83 ms.
cifar100       train : [loss = 0.314, top1 = 91.71%], valid : [loss = 1.271, top1 = 67.54%], test : [loss = 1.277, top1 = 67.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.73%], valid : [loss = 2.305, top1 = 40.79%], test : [loss = 2.342, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.70%], valid : [loss = 0.606, top1 = 79.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10937/15625) 010937-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.495, top1 = 89.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.321, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.17 ms.
cifar100       train : [loss = 0.162, top1 = 96.53%], valid : [loss = 1.320, top1 = 68.47%], test : [loss = 1.299, top1 = 69.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.42%], valid : [loss = 2.261, top1 = 41.77%], test : [loss = 2.264, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.82%], valid : [loss = 0.723, top1 = 75.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10938/15625) 010938-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.13%], valid : [loss = 0.754, top1 = 74.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.504, top1 = 82.41%], test  : [loss = 0.610, top1 = 79.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.04 ms.
cifar100       train : [loss = 1.848, top1 = 49.74%], valid : [loss = 2.056, top1 = 46.41%], test : [loss = 2.045, top1 = 46.21%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 3.466, top1 = 18.41%], valid : [loss = 3.468, top1 = 19.10%], test : [loss = 3.504, top1 = 17.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.253, top1 = 54.75%], valid : [loss = 1.297, top1 = 53.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10939/15625) 010939-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.480, top1 = 89.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.313, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.44 ms.
cifar100       train : [loss = 0.320, top1 = 91.40%], valid : [loss = 1.253, top1 = 67.97%], test : [loss = 1.272, top1 = 67.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.73%], valid : [loss = 2.303, top1 = 41.12%], test : [loss = 2.323, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.25%], valid : [loss = 0.620, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10940/15625) 010940-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.578, top1 = 87.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.74 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.396, top1 = 91.18%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.69 ms.
cifar100       train : [loss = 0.395, top1 = 88.79%], valid : [loss = 1.424, top1 = 65.25%], test : [loss = 1.419, top1 = 65.39%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.34%], valid : [loss = 2.494, top1 = 37.00%], test : [loss = 2.528, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.21%], valid : [loss = 0.791, top1 = 72.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10941/15625) 010941-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.326, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.89 ms.
cifar100       train : [loss = 0.327, top1 = 91.06%], valid : [loss = 1.316, top1 = 67.21%], test : [loss = 1.304, top1 = 67.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.29%], valid : [loss = 2.391, top1 = 39.40%], test : [loss = 2.422, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.09%], valid : [loss = 0.534, top1 = 81.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10942/15625) 010942-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.63%], valid : [loss = 0.570, top1 = 85.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.069, top1 = 97.93%], test  : [loss = 0.377, top1 = 89.59%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.73 ms.
cifar100       train : [loss = 0.661, top1 = 80.78%], valid : [loss = 1.362, top1 = 64.05%], test : [loss = 1.358, top1 = 64.09%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.403, top1 = 38.68%], valid : [loss = 2.527, top1 = 36.67%], test : [loss = 2.560, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.70%], valid : [loss = 0.881, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10943/15625) 010943-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.686, top1 = 84.22%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.40 ms.
cifar10        train : [loss = 0.062, top1 = 98.12%], test  : [loss = 0.437, top1 = 88.57%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=14.44 ms.
cifar100       train : [loss = 0.698, top1 = 79.61%], valid : [loss = 1.428, top1 = 62.41%], test : [loss = 1.412, top1 = 62.81%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 35.98%], valid : [loss = 2.653, top1 = 33.58%], test : [loss = 2.702, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.86%], valid : [loss = 0.835, top1 = 70.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10944/15625) 010944-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.149, top1 = 94.93%], valid : [loss = 0.581, top1 = 83.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.64 ms.
cifar10        train : [loss = 0.115, top1 = 96.12%], test  : [loss = 0.420, top1 = 88.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.46 ms.
cifar100       train : [loss = 0.673, top1 = 80.22%], valid : [loss = 1.603, top1 = 59.10%], test : [loss = 1.605, top1 = 59.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 3.529, top1 = 15.81%], valid : [loss = 3.510, top1 = 17.12%], test : [loss = 3.512, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 52.80%], valid : [loss = 1.279, top1 = 52.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10945/15625) 010945-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.40 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.32%], valid : [loss = 0.764, top1 = 73.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.03 ms.
cifar10        train : [loss = 0.564, top1 = 80.40%], test  : [loss = 0.637, top1 = 78.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 2.012, top1 = 45.52%], valid : [loss = 2.121, top1 = 43.47%], test : [loss = 2.135, top1 = 43.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 25.69%], valid : [loss = 3.042, top1 = 26.18%], test : [loss = 3.070, top1 = 25.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.194, top1 = 56.97%], valid : [loss = 1.245, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10946/15625) 010946-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.469, top1 = 89.36%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.41 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.294, top1 = 92.37%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.18 ms.
cifar100       train : [loss = 0.281, top1 = 92.70%], valid : [loss = 1.224, top1 = 68.89%], test : [loss = 1.206, top1 = 68.85%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.99 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.95%], valid : [loss = 2.220, top1 = 42.83%], test : [loss = 2.207, top1 = 43.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 81.86%], valid : [loss = 0.605, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10947/15625) 010947-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.67%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=15.94 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.329, top1 = 92.02%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=14.82 ms.
cifar100       train : [loss = 0.339, top1 = 90.79%], valid : [loss = 1.288, top1 = 66.59%], test : [loss = 1.276, top1 = 67.13%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.77%], valid : [loss = 2.393, top1 = 38.91%], test : [loss = 2.389, top1 = 39.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10948/15625) 010948-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 91.00%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.81 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.281, top1 = 93.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.00 ms.
cifar100       train : [loss = 0.037, top1 = 99.65%], valid : [loss = 1.340, top1 = 71.21%], test : [loss = 1.306, top1 = 71.51%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 1.369, top1 = 62.67%], valid : [loss = 2.215, top1 = 45.43%], test : [loss = 2.252, top1 = 45.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 87.89%], valid : [loss = 0.491, top1 = 83.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10949/15625) 010949-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.615, top1 = 85.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.070, top1 = 97.81%], test  : [loss = 0.409, top1 = 88.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.711, top1 = 79.42%], valid : [loss = 1.423, top1 = 62.76%], test : [loss = 1.397, top1 = 62.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.05%], valid : [loss = 2.662, top1 = 33.50%], test : [loss = 2.691, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.18%], valid : [loss = 0.787, top1 = 72.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10950/15625) 010950-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.18 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.72 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.08 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.61 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10951/15625) 010951-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.37%], valid : [loss = 0.448, top1 = 87.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.115, top1 = 96.47%], test  : [loss = 0.330, top1 = 89.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 0.867, top1 = 75.27%], valid : [loss = 1.296, top1 = 64.05%], test : [loss = 1.263, top1 = 64.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.83%], valid : [loss = 2.627, top1 = 34.37%], test : [loss = 2.661, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.12%], valid : [loss = 0.663, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10952/15625) 010952-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.30%], valid : [loss = 0.561, top1 = 87.13%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.39 ms.
cifar10        train : [loss = 0.048, top1 = 98.54%], test  : [loss = 0.367, top1 = 90.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.01 ms.
cifar100       train : [loss = 0.535, top1 = 84.49%], valid : [loss = 1.325, top1 = 64.72%], test : [loss = 1.334, top1 = 65.09%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.00%], valid : [loss = 2.436, top1 = 38.22%], test : [loss = 2.446, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.79%], valid : [loss = 0.696, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10953/15625) 010953-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.166, top1 = 94.56%], valid : [loss = 0.917, top1 = 76.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.223, top1 = 92.32%], test  : [loss = 0.597, top1 = 82.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.74 ms.
cifar100       train : [loss = 1.147, top1 = 67.48%], valid : [loss = 1.796, top1 = 53.74%], test : [loss = 1.794, top1 = 54.39%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.70%], valid : [loss = 3.337, top1 = 21.52%], test : [loss = 3.368, top1 = 21.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.59%], valid : [loss = 1.130, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10954/15625) 010954-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.88%], valid : [loss = 0.566, top1 = 83.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10        train : [loss = 0.258, top1 = 91.19%], test  : [loss = 0.440, top1 = 85.78%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.66 ms.
cifar100       train : [loss = 1.061, top1 = 69.61%], valid : [loss = 1.509, top1 = 59.24%], test : [loss = 1.505, top1 = 59.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.48%], valid : [loss = 2.978, top1 = 27.30%], test : [loss = 3.031, top1 = 26.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.144, top1 = 58.91%], valid : [loss = 1.179, top1 = 57.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10955/15625) 010955-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.65%], valid : [loss = 0.572, top1 = 87.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.024, top1 = 99.31%], test  : [loss = 0.377, top1 = 90.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.35 ms.
cifar100       train : [loss = 0.278, top1 = 92.29%], valid : [loss = 1.466, top1 = 65.10%], test : [loss = 1.467, top1 = 65.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 2.809, top1 = 29.52%], valid : [loss = 2.871, top1 = 27.90%], test : [loss = 2.916, top1 = 27.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 57.84%], valid : [loss = 1.168, top1 = 57.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10956/15625) 010956-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.78%], valid : [loss = 0.731, top1 = 74.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.568, top1 = 80.34%], test  : [loss = 0.626, top1 = 78.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 1.961, top1 = 47.16%], valid : [loss = 2.115, top1 = 44.28%], test : [loss = 2.108, top1 = 43.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 3.239, top1 = 22.25%], valid : [loss = 3.240, top1 = 22.71%], test : [loss = 3.253, top1 = 22.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10957/15625) 010957-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.484, top1 = 90.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.319, top1 = 93.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.99 ms.
cifar100       train : [loss = 0.118, top1 = 97.62%], valid : [loss = 1.224, top1 = 70.97%], test : [loss = 1.234, top1 = 71.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 1.757, top1 = 53.12%], valid : [loss = 2.166, top1 = 43.80%], test : [loss = 2.175, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.25%], valid : [loss = 0.757, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10958/15625) 010958-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.83%], valid : [loss = 0.773, top1 = 82.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.088, top1 = 97.20%], test  : [loss = 0.489, top1 = 86.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.66 ms.
cifar100       train : [loss = 0.806, top1 = 76.63%], valid : [loss = 1.529, top1 = 59.79%], test : [loss = 1.490, top1 = 61.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.800, top1 = 30.61%], valid : [loss = 2.914, top1 = 29.30%], test : [loss = 2.981, top1 = 27.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.89%], valid : [loss = 0.869, top1 = 69.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10959/15625) 010959-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.57%], valid : [loss = 0.465, top1 = 85.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.150, top1 = 95.19%], test  : [loss = 0.341, top1 = 89.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 0.985, top1 = 71.92%], valid : [loss = 1.354, top1 = 62.07%], test : [loss = 1.341, top1 = 62.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.10%], valid : [loss = 2.662, top1 = 33.55%], test : [loss = 2.685, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10960/15625) 010960-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.537, top1 = 88.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.41 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.349, top1 = 91.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.81 ms.
cifar100       train : [loss = 0.209, top1 = 94.59%], valid : [loss = 1.319, top1 = 67.87%], test : [loss = 1.317, top1 = 67.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 33.60%], valid : [loss = 2.710, top1 = 31.20%], test : [loss = 2.725, top1 = 30.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.37%], valid : [loss = 0.988, top1 = 64.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10961/15625) 010961-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.94%], valid : [loss = 0.725, top1 = 82.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10        train : [loss = 0.103, top1 = 96.62%], test  : [loss = 0.474, top1 = 86.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 0.838, top1 = 75.68%], valid : [loss = 1.628, top1 = 57.77%], test : [loss = 1.609, top1 = 58.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.821, top1 = 30.33%], valid : [loss = 2.963, top1 = 27.63%], test : [loss = 3.005, top1 = 26.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.18%], valid : [loss = 0.966, top1 = 65.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10962/15625) 010962-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.238, top1 = 91.97%], valid : [loss = 0.558, top1 = 82.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.227, top1 = 92.19%], test  : [loss = 0.401, top1 = 87.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 1.310, top1 = 62.72%], valid : [loss = 1.593, top1 = 56.30%], test : [loss = 1.586, top1 = 56.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.757, top1 = 31.44%], valid : [loss = 2.786, top1 = 30.55%], test : [loss = 2.821, top1 = 29.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.24%], valid : [loss = 0.987, top1 = 64.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10963/15625) 010963-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.85%], valid : [loss = 0.625, top1 = 79.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.303, top1 = 89.60%], test  : [loss = 0.452, top1 = 85.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.83 ms.
cifar100       train : [loss = 1.629, top1 = 54.96%], valid : [loss = 1.854, top1 = 50.67%], test : [loss = 1.856, top1 = 50.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.47 ms.
ImageNet16-120 train : [loss = 3.149, top1 = 23.99%], valid : [loss = 3.145, top1 = 24.33%], test : [loss = 3.223, top1 = 22.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.099, top1 = 60.77%], valid : [loss = 1.126, top1 = 59.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10964/15625) 010964-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.496, top1 = 89.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.12 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.341, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.192, top1 = 95.24%], valid : [loss = 1.363, top1 = 68.09%], test : [loss = 1.337, top1 = 68.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.67%], valid : [loss = 2.322, top1 = 41.80%], test : [loss = 2.318, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.85%], valid : [loss = 0.634, top1 = 78.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10965/15625) 010965-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.49%], valid : [loss = 0.485, top1 = 86.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10        train : [loss = 0.098, top1 = 96.86%], test  : [loss = 0.346, top1 = 89.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.690, top1 = 80.17%], valid : [loss = 1.229, top1 = 65.66%], test : [loss = 1.229, top1 = 66.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.19%], valid : [loss = 2.462, top1 = 36.73%], test : [loss = 2.512, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.24%], valid : [loss = 0.912, top1 = 67.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10966/15625) 010966-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.506, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.33 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.325, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.16 ms.
cifar100       train : [loss = 0.315, top1 = 91.45%], valid : [loss = 1.268, top1 = 67.28%], test : [loss = 1.286, top1 = 67.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 44.92%], valid : [loss = 2.401, top1 = 39.12%], test : [loss = 2.393, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.92%], valid : [loss = 0.761, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10967/15625) 010967-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.575, top1 = 88.70%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.371, top1 = 92.38%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.05 ms.
cifar100       train : [loss = 0.091, top1 = 98.41%], valid : [loss = 1.493, top1 = 67.63%], test : [loss = 1.480, top1 = 67.80%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.54%], valid : [loss = 2.407, top1 = 39.88%], test : [loss = 2.423, top1 = 40.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.93%], valid : [loss = 0.740, top1 = 74.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10968/15625) 010968-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.37%], valid : [loss = 0.447, top1 = 87.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.113, top1 = 96.53%], test  : [loss = 0.330, top1 = 89.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.48 ms.
cifar100       train : [loss = 0.864, top1 = 75.32%], valid : [loss = 1.288, top1 = 64.33%], test : [loss = 1.270, top1 = 64.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.68%], valid : [loss = 2.642, top1 = 33.28%], test : [loss = 2.656, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.12%], valid : [loss = 0.663, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10969/15625) 010969-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.72%], valid : [loss = 0.527, top1 = 85.40%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.74 ms.
cifar10        train : [loss = 0.166, top1 = 94.39%], test  : [loss = 0.385, top1 = 87.99%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.91 ms.
cifar100       train : [loss = 0.931, top1 = 73.02%], valid : [loss = 1.397, top1 = 62.24%], test : [loss = 1.390, top1 = 61.90%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.59%], valid : [loss = 2.711, top1 = 32.23%], test : [loss = 2.748, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.87%], valid : [loss = 0.985, top1 = 65.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10970/15625) 010970-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.485, top1 = 90.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.306, top1 = 93.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.82 ms.
cifar100       train : [loss = 0.133, top1 = 97.34%], valid : [loss = 1.272, top1 = 69.19%], test : [loss = 1.270, top1 = 69.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.32 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.36%], valid : [loss = 2.137, top1 = 45.35%], test : [loss = 2.163, top1 = 45.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.53%], valid : [loss = 0.710, top1 = 75.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10971/15625) 010971-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.096, top1 = 97.00%], valid : [loss = 0.668, top1 = 83.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10        train : [loss = 0.155, top1 = 94.77%], test  : [loss = 0.456, top1 = 86.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.17 ms.
cifar100       train : [loss = 0.965, top1 = 71.94%], valid : [loss = 1.641, top1 = 57.15%], test : [loss = 1.631, top1 = 57.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 3.123, top1 = 23.87%], valid : [loss = 3.153, top1 = 23.48%], test : [loss = 3.216, top1 = 22.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.31%], valid : [loss = 1.003, top1 = 64.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10972/15625) 010972-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.72%], valid : [loss = 0.514, top1 = 86.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10        train : [loss = 0.074, top1 = 97.84%], test  : [loss = 0.345, top1 = 90.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.662, top1 = 80.89%], valid : [loss = 1.300, top1 = 65.18%], test : [loss = 1.271, top1 = 65.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.90%], valid : [loss = 2.501, top1 = 36.56%], test : [loss = 2.536, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 70.95%], valid : [loss = 0.871, top1 = 69.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10973/15625) 010973-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.96%], valid : [loss = 0.737, top1 = 75.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.53 ms.
cifar10        train : [loss = 0.515, top1 = 82.18%], test  : [loss = 0.589, top1 = 79.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.05 ms.
cifar100       train : [loss = 1.991, top1 = 46.13%], valid : [loss = 2.106, top1 = 43.84%], test : [loss = 2.122, top1 = 43.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.992, top1 = 26.79%], valid : [loss = 2.979, top1 = 27.04%], test : [loss = 3.027, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.73%], valid : [loss = 1.201, top1 = 57.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10974/15625) 010974-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.73%], valid : [loss = 0.624, top1 = 87.00%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.00 ms.
cifar10        train : [loss = 0.023, top1 = 99.32%], test  : [loss = 0.381, top1 = 90.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.13 ms.
cifar100       train : [loss = 0.346, top1 = 90.26%], valid : [loss = 1.475, top1 = 63.74%], test : [loss = 1.415, top1 = 64.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.13%], valid : [loss = 2.972, top1 = 26.12%], test : [loss = 2.966, top1 = 26.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.137, top1 = 58.99%], valid : [loss = 1.141, top1 = 58.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10975/15625) 010975-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.418, top1 = 90.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.281, top1 = 93.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.38 ms.
cifar100       train : [loss = 0.071, top1 = 98.91%], valid : [loss = 1.349, top1 = 70.34%], test : [loss = 1.324, top1 = 70.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 1.590, top1 = 57.22%], valid : [loss = 2.244, top1 = 43.27%], test : [loss = 2.227, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.62%], valid : [loss = 0.509, top1 = 82.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10976/15625) 010976-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.59%], valid : [loss = 0.564, top1 = 87.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.042, top1 = 98.74%], test  : [loss = 0.410, top1 = 89.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.570, top1 = 83.12%], valid : [loss = 1.402, top1 = 63.94%], test : [loss = 1.405, top1 = 64.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.86%], valid : [loss = 2.629, top1 = 34.38%], test : [loss = 2.668, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.63%], valid : [loss = 0.678, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10977/15625) 010977-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.48%], valid : [loss = 0.631, top1 = 85.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.389, top1 = 90.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.81 ms.
cifar100       train : [loss = 0.558, top1 = 83.81%], valid : [loss = 1.432, top1 = 63.39%], test : [loss = 1.436, top1 = 63.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.10%], valid : [loss = 2.567, top1 = 35.85%], test : [loss = 2.605, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.68%], valid : [loss = 0.890, top1 = 68.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10978/15625) 010978-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.448, top1 = 89.27%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=16.92 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.317, top1 = 91.99%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=16.11 ms.
cifar100       train : [loss = 0.334, top1 = 90.84%], valid : [loss = 1.280, top1 = 67.77%], test : [loss = 1.294, top1 = 67.61%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 45.96%], valid : [loss = 2.363, top1 = 40.07%], test : [loss = 2.403, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.78%], valid : [loss = 0.555, top1 = 81.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10979/15625) 010979-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.599, top1 = 87.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.387, top1 = 91.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.68 ms.
cifar100       train : [loss = 0.202, top1 = 95.42%], valid : [loss = 1.446, top1 = 66.23%], test : [loss = 1.429, top1 = 66.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.51%], valid : [loss = 2.468, top1 = 38.08%], test : [loss = 2.498, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.42%], valid : [loss = 0.758, top1 = 73.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10980/15625) 010980-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.602, top1 = 86.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 0.033, top1 = 99.08%], test  : [loss = 0.416, top1 = 89.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.49 ms.
cifar100       train : [loss = 0.509, top1 = 85.12%], valid : [loss = 1.403, top1 = 64.18%], test : [loss = 1.416, top1 = 64.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.24%], valid : [loss = 2.545, top1 = 35.75%], test : [loss = 2.583, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10981/15625) 010981-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.95 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.46%], valid : [loss = 0.630, top1 = 85.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.85 ms.
cifar10        train : [loss = 0.051, top1 = 98.49%], test  : [loss = 0.425, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.36 ms.
cifar100       train : [loss = 0.635, top1 = 81.57%], valid : [loss = 1.419, top1 = 63.19%], test : [loss = 1.393, top1 = 63.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.59%], valid : [loss = 2.619, top1 = 34.29%], test : [loss = 2.673, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.52%], valid : [loss = 0.838, top1 = 70.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10982/15625) 010982-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.554, top1 = 88.53%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.84 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.354, top1 = 91.71%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.40 ms.
cifar100       train : [loss = 0.250, top1 = 93.34%], valid : [loss = 1.322, top1 = 67.45%], test : [loss = 1.327, top1 = 67.38%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.50%], valid : [loss = 2.447, top1 = 38.12%], test : [loss = 2.462, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.938, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10983/15625) 010983-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=20.70 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.570, top1 = 87.23%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=20.92 ms.
cifar10        train : [loss = 0.042, top1 = 98.72%], test  : [loss = 0.374, top1 = 90.37%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=19.45 ms.
cifar100       train : [loss = 0.420, top1 = 88.06%], valid : [loss = 1.305, top1 = 66.40%], test : [loss = 1.318, top1 = 66.65%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=17.85 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.32%], valid : [loss = 2.395, top1 = 39.55%], test : [loss = 2.405, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.50%], valid : [loss = 0.779, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10984/15625) 010984-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.97%], valid : [loss = 0.528, top1 = 87.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.073, top1 = 97.63%], test  : [loss = 0.359, top1 = 89.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 0.704, top1 = 79.21%], valid : [loss = 1.364, top1 = 63.98%], test : [loss = 1.324, top1 = 64.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.516, top1 = 36.42%], valid : [loss = 2.626, top1 = 34.77%], test : [loss = 2.667, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.678, top1 = 76.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10985/15625) 010985-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.562, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.378, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.38 ms.
cifar100       train : [loss = 0.112, top1 = 97.71%], valid : [loss = 1.487, top1 = 67.46%], test : [loss = 1.499, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.81%], valid : [loss = 2.414, top1 = 39.39%], test : [loss = 2.434, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.48%], valid : [loss = 0.753, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10986/15625) 010986-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.506, top1 = 89.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.60 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.341, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.49 ms.
cifar100       train : [loss = 0.151, top1 = 96.67%], valid : [loss = 1.265, top1 = 69.36%], test : [loss = 1.236, top1 = 69.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.48 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.44%], valid : [loss = 2.161, top1 = 43.77%], test : [loss = 2.177, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.17%], valid : [loss = 0.770, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10987/15625) 010987-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.655, top1 = 86.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.69 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.445, top1 = 89.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.94 ms.
cifar100       train : [loss = 0.296, top1 = 92.18%], valid : [loss = 1.566, top1 = 63.04%], test : [loss = 1.578, top1 = 62.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.208, top1 = 42.97%], valid : [loss = 2.577, top1 = 35.93%], test : [loss = 2.604, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.52%], valid : [loss = 0.824, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10988/15625) 010988-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=110.02 M, Params=0.777 MB, latency=21.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.60%]
cifar10        FLOP=110.02 M, Params=0.777 MB, latency=19.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 93.13%]
cifar100       FLOP=110.03 M, Params=0.783 MB, latency=19.90 ms.
cifar100       train : [loss = 0.133, top1 = 97.39%], valid : [loss = 1.263, top1 = 69.69%], test : [loss = 1.266, top1 = 69.53%]
ImageNet16-120 FLOP= 27.51 M, Params=0.785 MB, latency=20.99 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.16%], valid : [loss = 2.174, top1 = 44.06%], test : [loss = 2.183, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.76%], valid : [loss = 0.576, top1 = 80.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10989/15625) 010989-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.591, top1 = 86.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10        train : [loss = 0.025, top1 = 99.35%], test  : [loss = 0.390, top1 = 90.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.513, top1 = 85.06%], valid : [loss = 1.430, top1 = 64.01%], test : [loss = 1.426, top1 = 63.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 40.05%], valid : [loss = 2.532, top1 = 35.96%], test : [loss = 2.549, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.04%], valid : [loss = 0.817, top1 = 71.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10990/15625) 010990-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.547, top1 = 88.05%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.38 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.350, top1 = 91.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.79 ms.
cifar100       train : [loss = 0.338, top1 = 90.69%], valid : [loss = 1.278, top1 = 66.96%], test : [loss = 1.311, top1 = 66.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.07%], valid : [loss = 2.450, top1 = 38.50%], test : [loss = 2.449, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.78%], valid : [loss = 0.748, top1 = 73.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10991/15625) 010991-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10-valid  train : [loss = 0.196, top1 = 93.38%], valid : [loss = 0.505, top1 = 84.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.22 ms.
cifar10        train : [loss = 0.205, top1 = 93.05%], test  : [loss = 0.383, top1 = 87.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.10 ms.
cifar100       train : [loss = 1.167, top1 = 66.60%], valid : [loss = 1.471, top1 = 59.38%], test : [loss = 1.461, top1 = 59.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.750, top1 = 31.87%], valid : [loss = 2.757, top1 = 31.50%], test : [loss = 2.827, top1 = 30.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.10%], valid : [loss = 0.898, top1 = 68.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10992/15625) 010992-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.48 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.41%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.00 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.314, top1 = 93.52%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.10 ms.
cifar100       train : [loss = 0.057, top1 = 99.25%], valid : [loss = 1.355, top1 = 69.90%], test : [loss = 1.338, top1 = 69.98%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=26.08 ms.
ImageNet16-120 train : [loss = 1.641, top1 = 55.84%], valid : [loss = 2.186, top1 = 43.37%], test : [loss = 2.185, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.86%], valid : [loss = 0.715, top1 = 75.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10993/15625) 010993-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.290, top1 = 90.15%], valid : [loss = 0.469, top1 = 84.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.35 ms.
cifar10        train : [loss = 0.267, top1 = 90.99%], test  : [loss = 0.371, top1 = 87.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.30 ms.
cifar100       train : [loss = 1.452, top1 = 59.69%], valid : [loss = 1.608, top1 = 55.25%], test : [loss = 1.606, top1 = 55.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.60 ms.
ImageNet16-120 train : [loss = 2.829, top1 = 30.35%], valid : [loss = 2.814, top1 = 31.03%], test : [loss = 2.859, top1 = 29.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.34%], valid : [loss = 1.010, top1 = 64.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10994/15625) 010994-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.83 ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.12%], valid : [loss = 0.966, top1 = 66.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10        train : [loss = 0.761, top1 = 73.18%], test  : [loss = 0.855, top1 = 70.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.53 ms.
cifar100       train : [loss = 2.130, top1 = 44.35%], valid : [loss = 2.317, top1 = 40.96%], test : [loss = 2.314, top1 = 40.74%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 3.745, top1 = 14.16%], valid : [loss = 3.767, top1 = 14.53%], test : [loss = 3.783, top1 = 13.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10995/15625) 010995-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.485, top1 = 89.72%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.95 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.326, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.87 ms.
cifar100       train : [loss = 0.136, top1 = 97.30%], valid : [loss = 1.297, top1 = 69.26%], test : [loss = 1.307, top1 = 68.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.72 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.41%], valid : [loss = 2.289, top1 = 42.63%], test : [loss = 2.257, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.72%], valid : [loss = 0.700, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10996/15625) 010996-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.79 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.08 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10997/15625) 010997-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.14%], valid : [loss = 0.551, top1 = 86.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.20 ms.
cifar10        train : [loss = 0.068, top1 = 97.77%], test  : [loss = 0.363, top1 = 89.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.76 ms.
cifar100       train : [loss = 0.647, top1 = 80.94%], valid : [loss = 1.316, top1 = 64.60%], test : [loss = 1.326, top1 = 64.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.24%], valid : [loss = 2.475, top1 = 36.70%], test : [loss = 2.545, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.63%], valid : [loss = 0.843, top1 = 70.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10998/15625) 010998-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.26%], valid : [loss = 0.597, top1 = 86.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.09 ms.
cifar10        train : [loss = 0.050, top1 = 98.42%], test  : [loss = 0.403, top1 = 89.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.05 ms.
cifar100       train : [loss = 0.357, top1 = 89.68%], valid : [loss = 1.455, top1 = 63.96%], test : [loss = 1.522, top1 = 63.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 26.92%], valid : [loss = 3.015, top1 = 26.10%], test : [loss = 3.015, top1 = 25.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.102, top1 = 60.03%], valid : [loss = 1.128, top1 = 59.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (10999/15625) 010999-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.88%], valid : [loss = 0.702, top1 = 83.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.086, top1 = 97.28%], test  : [loss = 0.475, top1 = 86.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 0.806, top1 = 76.48%], valid : [loss = 1.519, top1 = 60.82%], test : [loss = 1.485, top1 = 61.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.833, top1 = 30.06%], valid : [loss = 2.981, top1 = 27.43%], test : [loss = 3.029, top1 = 26.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11000/15625) 011000-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.416, top1 = 90.30%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.272, top1 = 93.56%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.96 ms.
cifar100       train : [loss = 0.110, top1 = 98.00%], valid : [loss = 1.241, top1 = 71.18%], test : [loss = 1.223, top1 = 71.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.88 ms.
ImageNet16-120 train : [loss = 1.641, top1 = 55.91%], valid : [loss = 2.165, top1 = 44.63%], test : [loss = 2.185, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.36%], valid : [loss = 0.505, top1 = 82.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11001/15625) 011001-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.37 ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.69%], valid : [loss = 1.108, top1 = 63.08%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.02 ms.
cifar10        train : [loss = 0.797, top1 = 71.96%], test  : [loss = 0.935, top1 = 67.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.92 ms.
cifar100       train : [loss = 2.141, top1 = 43.93%], valid : [loss = 2.397, top1 = 39.68%], test : [loss = 2.422, top1 = 39.06%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.54 ms.
ImageNet16-120 train : [loss = 3.766, top1 = 13.86%], valid : [loss = 3.819, top1 = 13.87%], test : [loss = 3.834, top1 = 13.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11002/15625) 011002-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.63%], valid : [loss = 0.880, top1 = 79.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.35 ms.
cifar10        train : [loss = 0.131, top1 = 95.57%], test  : [loss = 0.538, top1 = 84.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.54 ms.
cifar100       train : [loss = 0.837, top1 = 75.64%], valid : [loss = 1.662, top1 = 57.78%], test : [loss = 1.689, top1 = 57.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 3.030, top1 = 26.69%], valid : [loss = 3.155, top1 = 23.60%], test : [loss = 3.207, top1 = 24.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11003/15625) 011003-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.097, top1 = 97.16%], valid : [loss = 0.514, top1 = 85.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.05 ms.
cifar10        train : [loss = 0.166, top1 = 94.49%], test  : [loss = 0.368, top1 = 88.31%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.01 ms.
cifar100       train : [loss = 1.004, top1 = 71.13%], valid : [loss = 1.403, top1 = 61.98%], test : [loss = 1.371, top1 = 62.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.14 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.44%], valid : [loss = 2.699, top1 = 32.23%], test : [loss = 2.742, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.07%], valid : [loss = 0.989, top1 = 65.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11004/15625) 011004-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.21%], valid : [loss = 0.723, top1 = 75.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.540, top1 = 81.16%], test  : [loss = 0.608, top1 = 78.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 1.754, top1 = 52.73%], valid : [loss = 1.909, top1 = 49.72%], test : [loss = 1.933, top1 = 49.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 3.402, top1 = 19.95%], valid : [loss = 3.380, top1 = 20.40%], test : [loss = 3.412, top1 = 19.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.90%], valid : [loss = 1.420, top1 = 48.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11005/15625) 011005-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.460, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.06 ms.
cifar100       train : [loss = 0.319, top1 = 91.50%], valid : [loss = 1.237, top1 = 68.14%], test : [loss = 1.234, top1 = 67.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.85%], valid : [loss = 2.320, top1 = 40.58%], test : [loss = 2.342, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.55%], valid : [loss = 0.648, top1 = 77.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11006/15625) 011006-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.506, top1 = 88.90%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.38 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.313, top1 = 92.18%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.34 ms.
cifar100       train : [loss = 0.242, top1 = 94.14%], valid : [loss = 1.262, top1 = 67.82%], test : [loss = 1.260, top1 = 68.96%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.72 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.20%], valid : [loss = 2.289, top1 = 41.60%], test : [loss = 2.299, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.42%], valid : [loss = 0.656, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11007/15625) 011007-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.325, top1 = 92.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 0.335, top1 = 90.88%], valid : [loss = 1.264, top1 = 67.52%], test : [loss = 1.279, top1 = 67.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.67%], valid : [loss = 2.394, top1 = 39.32%], test : [loss = 2.422, top1 = 38.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11008/15625) 011008-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.79%], valid : [loss = 0.563, top1 = 84.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10        train : [loss = 0.126, top1 = 96.01%], test  : [loss = 0.391, top1 = 88.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.96 ms.
cifar100       train : [loss = 1.020, top1 = 70.81%], valid : [loss = 1.458, top1 = 60.22%], test : [loss = 1.454, top1 = 60.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.447, top1 = 37.87%], valid : [loss = 2.545, top1 = 36.01%], test : [loss = 2.593, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.28%], valid : [loss = 0.897, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11009/15625) 011009-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.519, top1 = 89.96%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.350, top1 = 92.92%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=23.21 ms.
cifar100       train : [loss = 0.030, top1 = 99.75%], valid : [loss = 1.430, top1 = 70.10%], test : [loss = 1.420, top1 = 70.34%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.473, top1 = 60.01%], valid : [loss = 2.371, top1 = 41.67%], test : [loss = 2.404, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.17%], valid : [loss = 0.645, top1 = 78.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11010/15625) 011010-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.02%], valid : [loss = 0.534, top1 = 86.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.076, top1 = 97.54%], test  : [loss = 0.377, top1 = 89.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 0.719, top1 = 78.84%], valid : [loss = 1.363, top1 = 64.04%], test : [loss = 1.343, top1 = 64.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 2.522, top1 = 36.25%], valid : [loss = 2.626, top1 = 34.03%], test : [loss = 2.691, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11011/15625) 011011-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.535, top1 = 88.92%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.40 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.354, top1 = 92.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.39 ms.
cifar100       train : [loss = 0.114, top1 = 97.62%], valid : [loss = 1.378, top1 = 68.34%], test : [loss = 1.377, top1 = 67.86%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.46%], valid : [loss = 2.348, top1 = 40.00%], test : [loss = 2.308, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.92%], valid : [loss = 0.912, top1 = 67.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11012/15625) 011012-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.584, top1 = 87.94%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.85 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.384, top1 = 92.16%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.39 ms.
cifar100       train : [loss = 0.121, top1 = 97.70%], valid : [loss = 1.516, top1 = 66.28%], test : [loss = 1.490, top1 = 66.98%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.12 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.04%], valid : [loss = 2.384, top1 = 40.57%], test : [loss = 2.426, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.02%], valid : [loss = 0.809, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11013/15625) 011013-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.556, top1 = 89.16%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.53 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.361, top1 = 92.57%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.07 ms.
cifar100       train : [loss = 0.093, top1 = 98.29%], valid : [loss = 1.416, top1 = 69.30%], test : [loss = 1.469, top1 = 68.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 1.929, top1 = 49.02%], valid : [loss = 2.339, top1 = 41.17%], test : [loss = 2.328, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.75%], valid : [loss = 0.826, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11014/15625) 011014-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.502, top1 = 88.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.328, top1 = 92.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.61 ms.
cifar100       train : [loss = 0.333, top1 = 91.13%], valid : [loss = 1.310, top1 = 66.52%], test : [loss = 1.291, top1 = 67.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.48%], valid : [loss = 2.419, top1 = 37.93%], test : [loss = 2.425, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11015/15625) 011015-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.54%], valid : [loss = 0.840, top1 = 76.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.300, top1 = 89.69%], test  : [loss = 0.608, top1 = 80.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.84 ms.
cifar100       train : [loss = 1.347, top1 = 61.78%], valid : [loss = 1.916, top1 = 49.70%], test : [loss = 1.944, top1 = 50.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 3.451, top1 = 18.11%], valid : [loss = 3.482, top1 = 18.33%], test : [loss = 3.495, top1 = 18.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.153, top1 = 58.59%], valid : [loss = 1.198, top1 = 56.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11016/15625) 011016-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.476, top1 = 88.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.87 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.302, top1 = 92.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.48 ms.
cifar100       train : [loss = 0.266, top1 = 93.25%], valid : [loss = 1.215, top1 = 68.82%], test : [loss = 1.218, top1 = 68.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.10%], valid : [loss = 2.209, top1 = 42.67%], test : [loss = 2.232, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.86%], valid : [loss = 0.629, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11017/15625) 011017-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.95%], valid : [loss = 0.504, top1 = 87.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.072, top1 = 97.69%], test  : [loss = 0.358, top1 = 89.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.718, top1 = 78.69%], valid : [loss = 1.348, top1 = 63.84%], test : [loss = 1.349, top1 = 64.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.06%], valid : [loss = 2.600, top1 = 34.27%], test : [loss = 2.691, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.38%], valid : [loss = 0.686, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11018/15625) 011018-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10-valid  train : [loss = 1.833, top1 = 33.89%], valid : [loss = 1.857, top1 = 33.10%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.86 ms.
cifar10        train : [loss = 1.290, top1 = 53.33%], test  : [loss = 1.292, top1 = 52.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.84 ms.
cifar100       train : [loss = 3.802, top1 = 11.97%], valid : [loss = 3.904, top1 = 10.18%], test : [loss = 3.899, top1 = 10.74%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.52 ms.
ImageNet16-120 train : [loss = 3.908, top1 = 11.74%], valid : [loss = 3.884, top1 = 12.47%], test : [loss = 3.906, top1 = 11.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.50%], valid : [loss = 1.968, top1 = 27.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11019/15625) 011019-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.454, top1 = 89.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.14 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.312, top1 = 92.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.16 ms.
cifar100       train : [loss = 0.178, top1 = 95.80%], valid : [loss = 1.289, top1 = 68.92%], test : [loss = 1.277, top1 = 69.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 51.89%], valid : [loss = 2.258, top1 = 42.77%], test : [loss = 2.288, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.51%], valid : [loss = 0.511, top1 = 82.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11020/15625) 011020-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.630, top1 = 85.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.409, top1 = 88.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.87 ms.
cifar100       train : [loss = 0.715, top1 = 79.35%], valid : [loss = 1.349, top1 = 63.74%], test : [loss = 1.399, top1 = 62.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 36.59%], valid : [loss = 2.639, top1 = 33.83%], test : [loss = 2.664, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11021/15625) 011021-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.76 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.54%], valid : [loss = 0.442, top1 = 86.54%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10        train : [loss = 0.159, top1 = 94.90%], test  : [loss = 0.347, top1 = 88.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.05 ms.
cifar100       train : [loss = 0.994, top1 = 71.45%], valid : [loss = 1.356, top1 = 62.72%], test : [loss = 1.345, top1 = 62.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.74%], valid : [loss = 2.689, top1 = 33.57%], test : [loss = 2.712, top1 = 31.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11022/15625) 011022-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.419, top1 = 90.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.005, top1 = 99.96%], test  : [loss = 0.273, top1 = 93.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.54 ms.
cifar100       train : [loss = 0.108, top1 = 97.99%], valid : [loss = 1.310, top1 = 70.44%], test : [loss = 1.279, top1 = 70.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.63%], valid : [loss = 2.233, top1 = 43.93%], test : [loss = 2.237, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.92%], valid : [loss = 0.541, top1 = 81.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11023/15625) 011023-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.546, top1 = 88.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.336, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.300, top1 = 67.26%], test : [loss = 1.288, top1 = 67.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.33%], valid : [loss = 2.443, top1 = 37.30%], test : [loss = 2.436, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.82%], valid : [loss = 0.819, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11024/15625) 011024-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.504, top1 = 88.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.318, top1 = 92.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.80 ms.
cifar100       train : [loss = 0.327, top1 = 91.21%], valid : [loss = 1.327, top1 = 66.38%], test : [loss = 1.305, top1 = 67.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.07%], valid : [loss = 2.428, top1 = 38.80%], test : [loss = 2.439, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.658, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11025/15625) 011025-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.27 ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.74%], valid : [loss = 0.509, top1 = 82.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10        train : [loss = 0.401, top1 = 86.40%], test  : [loss = 0.462, top1 = 84.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 1.546, top1 = 57.68%], valid : [loss = 1.650, top1 = 55.18%], test : [loss = 1.645, top1 = 54.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=7.69 ms.
ImageNet16-120 train : [loss = 3.051, top1 = 26.10%], valid : [loss = 3.023, top1 = 26.47%], test : [loss = 3.082, top1 = 25.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.54%], valid : [loss = 1.147, top1 = 59.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11026/15625) 011026-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.525, top1 = 88.92%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.307, top1 = 92.69%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.55 ms.
cifar100       train : [loss = 0.192, top1 = 95.65%], valid : [loss = 1.239, top1 = 70.00%], test : [loss = 1.214, top1 = 69.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.77%], valid : [loss = 2.241, top1 = 42.30%], test : [loss = 2.228, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.68%], valid : [loss = 0.636, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11027/15625) 011027-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.539, top1 = 89.34%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.11 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.360, top1 = 92.52%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.17 ms.
cifar100       train : [loss = 0.078, top1 = 98.69%], valid : [loss = 1.354, top1 = 69.64%], test : [loss = 1.409, top1 = 69.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 45.79%], valid : [loss = 2.383, top1 = 39.07%], test : [loss = 2.412, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.43%], valid : [loss = 0.899, top1 = 68.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11028/15625) 011028-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.21%], valid : [loss = 0.522, top1 = 83.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.244, top1 = 91.65%], test  : [loss = 0.408, top1 = 86.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 1.336, top1 = 62.17%], valid : [loss = 1.622, top1 = 55.74%], test : [loss = 1.616, top1 = 55.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.810, top1 = 30.53%], valid : [loss = 2.814, top1 = 30.67%], test : [loss = 2.865, top1 = 29.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.20%], valid : [loss = 1.007, top1 = 64.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11029/15625) 011029-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10-valid  train : [loss = 0.930, top1 = 67.55%], valid : [loss = 0.973, top1 = 66.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.49 ms.
cifar10        train : [loss = 0.915, top1 = 68.28%], test  : [loss = 0.910, top1 = 68.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.17 ms.
cifar100       train : [loss = 2.389, top1 = 38.90%], valid : [loss = 2.458, top1 = 37.29%], test : [loss = 2.447, top1 = 38.01%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.84 ms.
ImageNet16-120 train : [loss = 3.630, top1 = 15.97%], valid : [loss = 3.587, top1 = 17.07%], test : [loss = 3.628, top1 = 16.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.607, top1 = 39.57%], valid : [loss = 1.631, top1 = 38.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11030/15625) 011030-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.576, top1 = 87.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10        train : [loss = 0.040, top1 = 98.81%], test  : [loss = 0.401, top1 = 89.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 0.562, top1 = 83.51%], valid : [loss = 1.415, top1 = 63.72%], test : [loss = 1.419, top1 = 63.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 2.494, top1 = 36.86%], valid : [loss = 2.626, top1 = 34.16%], test : [loss = 2.665, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11031/15625) 011031-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.539, top1 = 89.07%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.84 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.345, top1 = 92.36%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.66 ms.
cifar100       train : [loss = 0.232, top1 = 93.90%], valid : [loss = 1.327, top1 = 68.02%], test : [loss = 1.305, top1 = 67.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.61 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 47.92%], valid : [loss = 2.287, top1 = 40.83%], test : [loss = 2.318, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.56%], valid : [loss = 0.892, top1 = 68.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11032/15625) 011032-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.323, top1 = 91.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.34 ms.
cifar100       train : [loss = 0.329, top1 = 91.16%], valid : [loss = 1.330, top1 = 66.13%], test : [loss = 1.323, top1 = 66.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.25%], valid : [loss = 2.349, top1 = 40.31%], test : [loss = 2.413, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11033/15625) 011033-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.22%], valid : [loss = 0.474, top1 = 85.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.351, top1 = 88.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.34 ms.
cifar100       train : [loss = 0.985, top1 = 71.99%], valid : [loss = 1.350, top1 = 62.56%], test : [loss = 1.338, top1 = 62.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.68%], valid : [loss = 2.689, top1 = 32.57%], test : [loss = 2.710, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11034/15625) 011034-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.61%], valid : [loss = 0.581, top1 = 85.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.39 ms.
cifar10        train : [loss = 0.069, top1 = 98.00%], test  : [loss = 0.375, top1 = 89.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.44 ms.
cifar100       train : [loss = 0.666, top1 = 80.68%], valid : [loss = 1.361, top1 = 63.74%], test : [loss = 1.359, top1 = 64.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.399, top1 = 38.75%], valid : [loss = 2.508, top1 = 36.73%], test : [loss = 2.544, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.39%], valid : [loss = 0.871, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11035/15625) 011035-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.559, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.365, top1 = 92.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.095, top1 = 98.28%], valid : [loss = 1.457, top1 = 67.64%], test : [loss = 1.470, top1 = 67.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.33 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.25%], valid : [loss = 2.377, top1 = 40.27%], test : [loss = 2.416, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.21%], valid : [loss = 0.697, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11036/15625) 011036-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.61%], valid : [loss = 0.567, top1 = 84.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.04 ms.
cifar10        train : [loss = 0.107, top1 = 96.54%], test  : [loss = 0.384, top1 = 88.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.57 ms.
cifar100       train : [loss = 0.884, top1 = 74.06%], valid : [loss = 1.456, top1 = 61.40%], test : [loss = 1.466, top1 = 60.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.590, top1 = 34.72%], valid : [loss = 2.643, top1 = 34.03%], test : [loss = 2.676, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.12%], valid : [loss = 0.941, top1 = 66.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11037/15625) 011037-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.492, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.330, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.205, top1 = 94.92%], valid : [loss = 1.350, top1 = 67.82%], test : [loss = 1.342, top1 = 67.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.23%], valid : [loss = 2.292, top1 = 42.03%], test : [loss = 2.357, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 80.99%], valid : [loss = 0.631, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11038/15625) 011038-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.461, top1 = 89.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.310, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.308, top1 = 91.79%], valid : [loss = 1.239, top1 = 68.30%], test : [loss = 1.241, top1 = 67.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.83 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.17%], valid : [loss = 2.297, top1 = 40.57%], test : [loss = 2.292, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.50%], valid : [loss = 0.616, top1 = 78.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11039/15625) 011039-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.564, top1 = 87.97%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.14 ms.
cifar10        train : [loss = 0.019, top1 = 99.45%], test  : [loss = 0.377, top1 = 91.40%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.61 ms.
cifar100       train : [loss = 0.324, top1 = 91.09%], valid : [loss = 1.388, top1 = 65.82%], test : [loss = 1.369, top1 = 65.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 2.024, top1 = 46.92%], valid : [loss = 2.321, top1 = 40.53%], test : [loss = 2.318, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.677, top1 = 76.15%], valid : [loss = 0.745, top1 = 73.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11040/15625) 011040-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.28%], valid : [loss = 0.721, top1 = 83.91%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.25 ms.
cifar10        train : [loss = 0.062, top1 = 98.01%], test  : [loss = 0.450, top1 = 88.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.34 ms.
cifar100       train : [loss = 0.650, top1 = 80.82%], valid : [loss = 1.544, top1 = 61.02%], test : [loss = 1.512, top1 = 60.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 33.00%], valid : [loss = 2.853, top1 = 29.93%], test : [loss = 2.873, top1 = 29.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.33%], valid : [loss = 0.913, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11041/15625) 011041-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.615, top1 = 86.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.031, top1 = 99.14%], test  : [loss = 0.407, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.567, top1 = 83.65%], valid : [loss = 1.427, top1 = 64.34%], test : [loss = 1.367, top1 = 63.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.400, top1 = 38.81%], valid : [loss = 2.562, top1 = 35.43%], test : [loss = 2.607, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.47%], valid : [loss = 0.834, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11042/15625) 011042-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.300, top1 = 89.58%], valid : [loss = 0.512, top1 = 83.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10        train : [loss = 0.281, top1 = 90.31%], test  : [loss = 0.401, top1 = 86.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.50 ms.
cifar100       train : [loss = 1.331, top1 = 62.42%], valid : [loss = 1.542, top1 = 58.02%], test : [loss = 1.556, top1 = 57.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.881, top1 = 29.17%], valid : [loss = 2.870, top1 = 29.23%], test : [loss = 2.903, top1 = 29.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.87%], valid : [loss = 0.974, top1 = 65.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11043/15625) 011043-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.62%], valid : [loss = 0.573, top1 = 87.25%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.50 ms.
cifar10        train : [loss = 0.038, top1 = 98.85%], test  : [loss = 0.363, top1 = 90.34%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=20.25 ms.
cifar100       train : [loss = 0.442, top1 = 87.05%], valid : [loss = 1.343, top1 = 65.48%], test : [loss = 1.302, top1 = 66.64%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.40%], valid : [loss = 2.387, top1 = 40.20%], test : [loss = 2.420, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.62%], valid : [loss = 0.757, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11044/15625) 011044-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.68%], valid : [loss = 0.512, top1 = 86.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10        train : [loss = 0.093, top1 = 97.07%], test  : [loss = 0.363, top1 = 89.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.39 ms.
cifar100       train : [loss = 0.773, top1 = 77.56%], valid : [loss = 1.340, top1 = 63.80%], test : [loss = 1.320, top1 = 64.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.55%], valid : [loss = 2.639, top1 = 34.29%], test : [loss = 2.683, top1 = 33.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.32%], valid : [loss = 0.668, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11045/15625) 011045-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.501, top1 = 88.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.307, top1 = 92.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 0.289, top1 = 92.37%], valid : [loss = 1.230, top1 = 67.92%], test : [loss = 1.240, top1 = 68.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.07%], valid : [loss = 2.282, top1 = 41.67%], test : [loss = 2.291, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.62%], valid : [loss = 0.587, top1 = 79.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11046/15625) 011046-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.07 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.05%], valid : [loss = 0.661, top1 = 84.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.062, top1 = 98.12%], test  : [loss = 0.415, top1 = 88.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.665, top1 = 80.48%], valid : [loss = 1.412, top1 = 62.26%], test : [loss = 1.412, top1 = 62.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.504, top1 = 36.51%], valid : [loss = 2.623, top1 = 33.93%], test : [loss = 2.685, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.26%], valid : [loss = 0.886, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11047/15625) 011047-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.13%], valid : [loss = 0.994, top1 = 72.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10        train : [loss = 0.306, top1 = 89.11%], test  : [loss = 0.620, top1 = 80.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.47 ms.
cifar100       train : [loss = 1.344, top1 = 62.42%], valid : [loss = 1.967, top1 = 50.22%], test : [loss = 1.961, top1 = 49.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 3.273, top1 = 21.91%], valid : [loss = 3.385, top1 = 19.90%], test : [loss = 3.409, top1 = 19.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.107, top1 = 60.06%], valid : [loss = 1.163, top1 = 58.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11048/15625) 011048-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.456, top1 = 89.33%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=16.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.310, top1 = 92.03%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=15.44 ms.
cifar100       train : [loss = 0.316, top1 = 91.49%], valid : [loss = 1.299, top1 = 67.37%], test : [loss = 1.287, top1 = 68.01%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.44%], valid : [loss = 2.352, top1 = 40.29%], test : [loss = 2.415, top1 = 39.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.72%], valid : [loss = 0.570, top1 = 80.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11049/15625) 011049-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.338, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.15 ms.
cifar100       train : [loss = 0.275, top1 = 92.65%], valid : [loss = 1.272, top1 = 67.81%], test : [loss = 1.285, top1 = 67.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.54%], valid : [loss = 2.324, top1 = 40.40%], test : [loss = 2.321, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.62%], valid : [loss = 0.731, top1 = 74.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11050/15625) 011050-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.477, top1 = 88.95%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.307, top1 = 92.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.82 ms.
cifar100       train : [loss = 0.318, top1 = 91.46%], valid : [loss = 1.251, top1 = 67.74%], test : [loss = 1.274, top1 = 67.29%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.71%], valid : [loss = 2.316, top1 = 40.84%], test : [loss = 2.353, top1 = 40.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.47%], valid : [loss = 0.584, top1 = 80.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11051/15625) 011051-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10-valid  train : [loss = 1.835, top1 = 33.69%], valid : [loss = 1.858, top1 = 32.91%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.01 ms.
cifar10        train : [loss = 1.294, top1 = 53.30%], test  : [loss = 1.300, top1 = 52.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.94 ms.
cifar100       train : [loss = 3.802, top1 = 11.96%], valid : [loss = 3.904, top1 = 10.19%], test : [loss = 3.899, top1 = 10.65%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.26 ms.
ImageNet16-120 train : [loss = 3.940, top1 = 11.20%], valid : [loss = 3.937, top1 = 11.57%], test : [loss = 3.940, top1 = 11.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.51%], valid : [loss = 1.967, top1 = 27.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11052/15625) 011052-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.12%], valid : [loss = 0.556, top1 = 85.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.14 ms.
cifar10        train : [loss = 0.110, top1 = 96.39%], test  : [loss = 0.386, top1 = 88.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.75 ms.
cifar100       train : [loss = 0.811, top1 = 76.24%], valid : [loss = 1.416, top1 = 63.14%], test : [loss = 1.397, top1 = 63.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.54 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.27%], valid : [loss = 2.734, top1 = 32.47%], test : [loss = 2.831, top1 = 30.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11053/15625) 011053-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.103, top1 = 96.86%], valid : [loss = 0.548, top1 = 84.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10        train : [loss = 0.099, top1 = 96.91%], test  : [loss = 0.367, top1 = 89.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.59 ms.
cifar100       train : [loss = 0.825, top1 = 75.91%], valid : [loss = 1.380, top1 = 62.48%], test : [loss = 1.413, top1 = 62.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.71%], valid : [loss = 2.641, top1 = 33.80%], test : [loss = 2.651, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.36%], valid : [loss = 0.880, top1 = 68.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11054/15625) 011054-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.50 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.37%], valid : [loss = 0.571, top1 = 83.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.01 ms.
cifar10        train : [loss = 0.169, top1 = 94.43%], test  : [loss = 0.391, top1 = 87.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.95 ms.
cifar100       train : [loss = 1.161, top1 = 66.82%], valid : [loss = 1.495, top1 = 58.95%], test : [loss = 1.480, top1 = 59.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.74%], valid : [loss = 2.691, top1 = 33.08%], test : [loss = 2.701, top1 = 32.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 66.07%], valid : [loss = 0.990, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11055/15625) 011055-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.34%], valid : [loss = 0.570, top1 = 81.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.273, top1 = 90.62%], test  : [loss = 0.425, top1 = 86.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 1.375, top1 = 61.26%], valid : [loss = 1.646, top1 = 55.40%], test : [loss = 1.634, top1 = 55.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.877, top1 = 29.25%], valid : [loss = 2.887, top1 = 29.60%], test : [loss = 2.928, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 64.88%], valid : [loss = 1.020, top1 = 63.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11056/15625) 011056-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.45 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.448, top1 = 89.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.311, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.24 ms.
cifar100       train : [loss = 0.207, top1 = 95.17%], valid : [loss = 1.273, top1 = 69.24%], test : [loss = 1.249, top1 = 69.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 51.16%], valid : [loss = 2.238, top1 = 42.90%], test : [loss = 2.284, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.40%], valid : [loss = 0.521, top1 = 82.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11057/15625) 011057-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.03%], valid : [loss = 0.694, top1 = 83.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.041, top1 = 98.83%], test  : [loss = 0.413, top1 = 89.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.69 ms.
cifar100       train : [loss = 0.663, top1 = 80.42%], valid : [loss = 1.469, top1 = 61.88%], test : [loss = 1.452, top1 = 62.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.490, top1 = 36.86%], valid : [loss = 2.641, top1 = 34.33%], test : [loss = 2.684, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.74%], valid : [loss = 0.862, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11058/15625) 011058-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.323, top1 = 91.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 0.329, top1 = 91.16%], valid : [loss = 1.330, top1 = 66.13%], test : [loss = 1.323, top1 = 66.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.28 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.25%], valid : [loss = 2.349, top1 = 40.31%], test : [loss = 2.413, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11059/15625) 011059-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.583, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.437, top1 = 89.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.315, top1 = 91.26%], valid : [loss = 1.512, top1 = 64.52%], test : [loss = 1.489, top1 = 65.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.72%], valid : [loss = 2.597, top1 = 35.03%], test : [loss = 2.630, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.93%], valid : [loss = 0.660, top1 = 77.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11060/15625) 011060-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.489, top1 = 90.17%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.292, top1 = 93.49%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.53 ms.
cifar100       train : [loss = 0.102, top1 = 98.11%], valid : [loss = 1.302, top1 = 69.64%], test : [loss = 1.291, top1 = 69.60%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.13 ms.
ImageNet16-120 train : [loss = 1.689, top1 = 54.67%], valid : [loss = 2.154, top1 = 43.90%], test : [loss = 2.148, top1 = 44.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.12%], valid : [loss = 0.661, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11061/15625) 011061-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.309, top1 = 89.45%], valid : [loss = 0.555, top1 = 82.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.97 ms.
cifar10        train : [loss = 0.251, top1 = 91.42%], test  : [loss = 0.409, top1 = 86.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.13 ms.
cifar100       train : [loss = 1.447, top1 = 59.57%], valid : [loss = 1.688, top1 = 54.33%], test : [loss = 1.681, top1 = 54.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 27.92%], valid : [loss = 2.958, top1 = 28.17%], test : [loss = 3.007, top1 = 26.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 64.17%], valid : [loss = 1.051, top1 = 62.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11062/15625) 011062-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.466, top1 = 88.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.323, top1 = 92.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.61 ms.
cifar100       train : [loss = 0.332, top1 = 90.84%], valid : [loss = 1.282, top1 = 67.10%], test : [loss = 1.343, top1 = 67.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.25%], valid : [loss = 2.389, top1 = 40.47%], test : [loss = 2.426, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11063/15625) 011063-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.39%], valid : [loss = 0.695, top1 = 84.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.053, top1 = 98.40%], test  : [loss = 0.444, top1 = 88.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.35 ms.
cifar100       train : [loss = 0.636, top1 = 81.36%], valid : [loss = 1.517, top1 = 61.85%], test : [loss = 1.514, top1 = 61.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.14%], valid : [loss = 2.851, top1 = 29.89%], test : [loss = 2.889, top1 = 29.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11064/15625) 011064-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.565, top1 = 88.24%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.54 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.345, top1 = 92.33%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.53 ms.
cifar100       train : [loss = 0.114, top1 = 97.42%], valid : [loss = 1.471, top1 = 68.40%], test : [loss = 1.418, top1 = 68.30%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.758, top1 = 30.93%], valid : [loss = 2.915, top1 = 28.13%], test : [loss = 2.887, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 1.099, top1 = 59.90%], valid : [loss = 1.117, top1 = 59.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11065/15625) 011065-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.72%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.51 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.331, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.76 ms.
cifar100       train : [loss = 0.118, top1 = 97.62%], valid : [loss = 1.307, top1 = 69.08%], test : [loss = 1.326, top1 = 69.63%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.68%], valid : [loss = 2.182, top1 = 44.08%], test : [loss = 2.207, top1 = 44.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.446, top1 = 84.50%], valid : [loss = 0.558, top1 = 81.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11066/15625) 011066-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.89 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.19 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.01 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11067/15625) 011067-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.87%], valid : [loss = 0.477, top1 = 84.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.300, top1 = 89.93%], test  : [loss = 0.402, top1 = 86.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 1.339, top1 = 62.93%], valid : [loss = 1.546, top1 = 57.79%], test : [loss = 1.524, top1 = 58.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.62%], valid : [loss = 2.895, top1 = 29.18%], test : [loss = 2.953, top1 = 28.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11068/15625) 011068-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.86%], valid : [loss = 0.779, top1 = 73.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10        train : [loss = 0.555, top1 = 80.64%], test  : [loss = 0.606, top1 = 79.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 2.061, top1 = 44.32%], valid : [loss = 2.168, top1 = 42.35%], test : [loss = 2.154, top1 = 43.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 3.262, top1 = 21.61%], valid : [loss = 3.230, top1 = 22.41%], test : [loss = 3.264, top1 = 21.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.197, top1 = 56.65%], valid : [loss = 1.245, top1 = 55.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11069/15625) 011069-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.39 ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.75%], valid : [loss = 1.121, top1 = 62.90%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.68 ms.
cifar10        train : [loss = 0.806, top1 = 71.77%], test  : [loss = 0.955, top1 = 67.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.44 ms.
cifar100       train : [loss = 2.136, top1 = 44.04%], valid : [loss = 2.411, top1 = 39.08%], test : [loss = 2.408, top1 = 39.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.36 ms.
ImageNet16-120 train : [loss = 3.771, top1 = 13.79%], valid : [loss = 3.823, top1 = 14.27%], test : [loss = 3.835, top1 = 13.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11070/15625) 011070-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.504, top1 = 88.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.327, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.05 ms.
cifar100       train : [loss = 0.235, top1 = 94.26%], valid : [loss = 1.238, top1 = 69.22%], test : [loss = 1.221, top1 = 69.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.28 ms.
ImageNet16-120 train : [loss = 1.933, top1 = 49.00%], valid : [loss = 2.270, top1 = 41.30%], test : [loss = 2.296, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11071/15625) 011071-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.52%], valid : [loss = 0.609, top1 = 87.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10        train : [loss = 0.019, top1 = 99.46%], test  : [loss = 0.395, top1 = 91.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.79 ms.
cifar100       train : [loss = 0.379, top1 = 89.11%], valid : [loss = 1.524, top1 = 63.34%], test : [loss = 1.523, top1 = 62.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.727, top1 = 30.97%], valid : [loss = 2.807, top1 = 28.73%], test : [loss = 2.804, top1 = 30.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11072/15625) 011072-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.221, top1 = 92.52%], valid : [loss = 0.559, top1 = 83.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.44 ms.
cifar10        train : [loss = 0.213, top1 = 92.71%], test  : [loss = 0.415, top1 = 87.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.76 ms.
cifar100       train : [loss = 1.288, top1 = 63.52%], valid : [loss = 1.576, top1 = 56.18%], test : [loss = 1.594, top1 = 56.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.07 ms.
ImageNet16-120 train : [loss = 2.755, top1 = 31.59%], valid : [loss = 2.782, top1 = 31.80%], test : [loss = 2.799, top1 = 30.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 64.90%], valid : [loss = 1.001, top1 = 64.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11073/15625) 011073-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.46%], valid : [loss = 0.474, top1 = 85.84%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=17.84 ms.
cifar10        train : [loss = 0.162, top1 = 94.67%], test  : [loss = 0.350, top1 = 88.85%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=18.13 ms.
cifar100       train : [loss = 1.016, top1 = 71.08%], valid : [loss = 1.354, top1 = 62.10%], test : [loss = 1.370, top1 = 61.69%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.64%], valid : [loss = 2.707, top1 = 32.54%], test : [loss = 2.704, top1 = 32.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11074/15625) 011074-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.60%], valid : [loss = 0.659, top1 = 78.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10        train : [loss = 0.501, top1 = 82.77%], test  : [loss = 0.585, top1 = 80.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.96 ms.
cifar100       train : [loss = 1.673, top1 = 54.49%], valid : [loss = 1.847, top1 = 51.12%], test : [loss = 1.859, top1 = 50.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 3.340, top1 = 21.03%], valid : [loss = 3.337, top1 = 21.40%], test : [loss = 3.350, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11075/15625) 011075-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.36%], valid : [loss = 0.575, top1 = 87.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.354, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.93 ms.
cifar100       train : [loss = 0.410, top1 = 88.22%], valid : [loss = 1.365, top1 = 65.58%], test : [loss = 1.354, top1 = 65.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 2.507, top1 = 36.06%], valid : [loss = 2.631, top1 = 34.47%], test : [loss = 2.625, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 63.57%], valid : [loss = 1.022, top1 = 62.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11076/15625) 011076-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.624, top1 = 87.53%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.25 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.404, top1 = 91.15%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.76 ms.
cifar100       train : [loss = 0.171, top1 = 96.21%], valid : [loss = 1.573, top1 = 64.70%], test : [loss = 1.611, top1 = 64.88%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.26%], valid : [loss = 2.475, top1 = 38.47%], test : [loss = 2.492, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.68%], valid : [loss = 0.822, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11077/15625) 011077-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.51%], valid : [loss = 0.525, top1 = 82.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10        train : [loss = 0.402, top1 = 86.17%], test  : [loss = 0.471, top1 = 84.12%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.50 ms.
cifar100       train : [loss = 1.544, top1 = 57.71%], valid : [loss = 1.658, top1 = 54.48%], test : [loss = 1.655, top1 = 54.59%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.96 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 26.32%], valid : [loss = 3.017, top1 = 27.08%], test : [loss = 3.062, top1 = 25.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11078/15625) 011078-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.31%], valid : [loss = 0.595, top1 = 85.77%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.19 ms.
cifar10        train : [loss = 0.068, top1 = 97.92%], test  : [loss = 0.402, top1 = 88.97%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=15.88 ms.
cifar100       train : [loss = 0.699, top1 = 79.71%], valid : [loss = 1.389, top1 = 63.89%], test : [loss = 1.363, top1 = 63.87%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.35%], valid : [loss = 2.658, top1 = 34.10%], test : [loss = 2.675, top1 = 33.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 75.88%], valid : [loss = 0.739, top1 = 74.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11079/15625) 011079-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.407, top1 = 90.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.281, top1 = 93.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.68 ms.
cifar100       train : [loss = 0.189, top1 = 95.60%], valid : [loss = 1.276, top1 = 68.98%], test : [loss = 1.287, top1 = 69.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.45%], valid : [loss = 2.268, top1 = 43.23%], test : [loss = 2.294, top1 = 43.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11080/15625) 011080-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.481, top1 = 89.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.290, top1 = 92.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.33 ms.
cifar100       train : [loss = 0.282, top1 = 92.44%], valid : [loss = 1.215, top1 = 68.96%], test : [loss = 1.209, top1 = 69.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.99%], valid : [loss = 2.190, top1 = 43.10%], test : [loss = 2.239, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11081/15625) 011081-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.667, top1 = 85.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.415, top1 = 90.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.95 ms.
cifar100       train : [loss = 0.541, top1 = 84.28%], valid : [loss = 1.404, top1 = 63.98%], test : [loss = 1.444, top1 = 63.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 38.91%], valid : [loss = 2.549, top1 = 36.43%], test : [loss = 2.581, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.68%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11082/15625) 011082-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.599, top1 = 87.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.413, top1 = 90.82%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.65 ms.
cifar100       train : [loss = 0.225, top1 = 94.51%], valid : [loss = 1.495, top1 = 65.14%], test : [loss = 1.463, top1 = 66.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.84%], valid : [loss = 2.502, top1 = 36.83%], test : [loss = 2.532, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.50%], valid : [loss = 0.780, top1 = 72.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11083/15625) 011083-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.68%], valid : [loss = 0.588, top1 = 84.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10        train : [loss = 0.092, top1 = 96.94%], test  : [loss = 0.421, top1 = 88.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.68 ms.
cifar100       train : [loss = 0.703, top1 = 79.08%], valid : [loss = 1.558, top1 = 60.22%], test : [loss = 1.500, top1 = 61.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 3.191, top1 = 22.24%], valid : [loss = 3.182, top1 = 22.53%], test : [loss = 3.246, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11084/15625) 011084-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.40%], valid : [loss = 0.572, top1 = 85.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.11 ms.
cifar10        train : [loss = 0.110, top1 = 96.23%], test  : [loss = 0.391, top1 = 88.98%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.42 ms.
cifar100       train : [loss = 0.781, top1 = 76.96%], valid : [loss = 1.443, top1 = 62.26%], test : [loss = 1.396, top1 = 61.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.35%], valid : [loss = 2.643, top1 = 33.13%], test : [loss = 2.653, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.17%], valid : [loss = 0.995, top1 = 64.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11085/15625) 011085-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.78 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.53%], valid : [loss = 0.596, top1 = 87.10%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.27 ms.
cifar10        train : [loss = 0.036, top1 = 98.88%], test  : [loss = 0.400, top1 = 90.01%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.37 ms.
cifar100       train : [loss = 0.451, top1 = 87.12%], valid : [loss = 1.339, top1 = 66.22%], test : [loss = 1.332, top1 = 65.38%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.12 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.90%], valid : [loss = 2.414, top1 = 38.80%], test : [loss = 2.442, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.12%], valid : [loss = 0.827, top1 = 71.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11086/15625) 011086-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.479, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.306, top1 = 92.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.91 ms.
cifar100       train : [loss = 0.279, top1 = 92.82%], valid : [loss = 1.221, top1 = 68.95%], test : [loss = 1.221, top1 = 68.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.73%], valid : [loss = 2.236, top1 = 42.63%], test : [loss = 2.238, top1 = 43.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11087/15625) 011087-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.557, top1 = 88.26%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.87 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.352, top1 = 91.67%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.86 ms.
cifar100       train : [loss = 0.330, top1 = 90.96%], valid : [loss = 1.299, top1 = 66.68%], test : [loss = 1.297, top1 = 66.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.10%], valid : [loss = 2.416, top1 = 38.50%], test : [loss = 2.425, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.27%], valid : [loss = 0.760, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11088/15625) 011088-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.537, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.327, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.17 ms.
cifar100       train : [loss = 0.338, top1 = 90.77%], valid : [loss = 1.279, top1 = 66.84%], test : [loss = 1.269, top1 = 67.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.48%], valid : [loss = 2.425, top1 = 38.87%], test : [loss = 2.403, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11089/15625) 011089-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.73%], valid : [loss = 0.681, top1 = 85.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10        train : [loss = 0.036, top1 = 98.99%], test  : [loss = 0.465, top1 = 89.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.44 ms.
cifar100       train : [loss = 0.480, top1 = 86.54%], valid : [loss = 1.491, top1 = 62.78%], test : [loss = 1.496, top1 = 62.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 38.88%], valid : [loss = 2.669, top1 = 34.50%], test : [loss = 2.706, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.28%], valid : [loss = 0.850, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11090/15625) 011090-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.614, top1 = 86.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10        train : [loss = 0.032, top1 = 99.10%], test  : [loss = 0.407, top1 = 89.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.85 ms.
cifar100       train : [loss = 0.522, top1 = 84.74%], valid : [loss = 1.409, top1 = 64.10%], test : [loss = 1.438, top1 = 63.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.73 ms.
ImageNet16-120 train : [loss = 2.397, top1 = 38.86%], valid : [loss = 2.589, top1 = 34.93%], test : [loss = 2.587, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.26%], valid : [loss = 0.824, top1 = 70.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11091/15625) 011091-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.34%], valid : [loss = 0.577, top1 = 85.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.104, top1 = 96.55%], test  : [loss = 0.386, top1 = 88.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.53 ms.
cifar100       train : [loss = 0.825, top1 = 75.89%], valid : [loss = 1.441, top1 = 62.16%], test : [loss = 1.409, top1 = 62.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.40%], valid : [loss = 2.735, top1 = 33.00%], test : [loss = 2.792, top1 = 31.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.36%], valid : [loss = 0.691, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11092/15625) 011092-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.57%], valid : [loss = 0.553, top1 = 86.51%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.085, top1 = 97.16%], test  : [loss = 0.376, top1 = 89.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.05 ms.
cifar100       train : [loss = 0.758, top1 = 77.69%], valid : [loss = 1.327, top1 = 64.09%], test : [loss = 1.330, top1 = 64.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.457, top1 = 37.38%], valid : [loss = 2.552, top1 = 35.56%], test : [loss = 2.596, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.72%], valid : [loss = 0.746, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11093/15625) 011093-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.18%], valid : [loss = 0.852, top1 = 78.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10        train : [loss = 0.172, top1 = 94.03%], test  : [loss = 0.573, top1 = 83.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.63 ms.
cifar100       train : [loss = 1.011, top1 = 70.62%], valid : [loss = 1.715, top1 = 55.30%], test : [loss = 1.666, top1 = 56.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.52%], valid : [loss = 3.032, top1 = 26.30%], test : [loss = 3.077, top1 = 25.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.54%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11094/15625) 011094-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.64%], valid : [loss = 0.654, top1 = 78.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10        train : [loss = 0.510, top1 = 82.37%], test  : [loss = 0.583, top1 = 80.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.704, top1 = 53.88%], valid : [loss = 1.858, top1 = 50.20%], test : [loss = 1.873, top1 = 50.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.26%], valid : [loss = 3.306, top1 = 21.30%], test : [loss = 3.341, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11095/15625) 011095-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.545, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.351, top1 = 92.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.08 ms.
cifar100       train : [loss = 0.251, top1 = 93.47%], valid : [loss = 1.329, top1 = 67.50%], test : [loss = 1.369, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 39.86%], valid : [loss = 2.489, top1 = 35.90%], test : [loss = 2.519, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.896, top1 = 67.78%], valid : [loss = 0.923, top1 = 67.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11096/15625) 011096-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.610, top1 = 85.48%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=16.93 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.402, top1 = 88.82%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=16.62 ms.
cifar100       train : [loss = 0.707, top1 = 79.47%], valid : [loss = 1.371, top1 = 63.59%], test : [loss = 1.364, top1 = 63.55%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.57%], valid : [loss = 2.679, top1 = 33.04%], test : [loss = 2.711, top1 = 32.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.77%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11097/15625) 011097-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.516, top1 = 89.80%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.333, top1 = 93.01%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.21 ms.
cifar100       train : [loss = 0.060, top1 = 99.09%], valid : [loss = 1.418, top1 = 69.46%], test : [loss = 1.379, top1 = 70.00%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.15 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.16%], valid : [loss = 2.443, top1 = 38.50%], test : [loss = 2.469, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.63%], valid : [loss = 0.834, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11098/15625) 011098-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.57%], valid : [loss = 0.697, top1 = 84.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.054, top1 = 98.40%], test  : [loss = 0.444, top1 = 88.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.43 ms.
cifar100       train : [loss = 0.643, top1 = 81.23%], valid : [loss = 1.567, top1 = 60.76%], test : [loss = 1.523, top1 = 61.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.15 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.59%], valid : [loss = 2.801, top1 = 30.50%], test : [loss = 2.862, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11099/15625) 011099-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.91%], valid : [loss = 0.517, top1 = 86.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.071, top1 = 97.90%], test  : [loss = 0.340, top1 = 90.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.658, top1 = 81.05%], valid : [loss = 1.301, top1 = 64.91%], test : [loss = 1.301, top1 = 64.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.71%], valid : [loss = 2.472, top1 = 37.24%], test : [loss = 2.501, top1 = 36.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.36%], valid : [loss = 0.900, top1 = 68.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11100/15625) 011100-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.606, top1 = 86.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.020, top1 = 99.54%], test  : [loss = 0.421, top1 = 89.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.60 ms.
cifar100       train : [loss = 0.306, top1 = 91.79%], valid : [loss = 1.539, top1 = 63.88%], test : [loss = 1.498, top1 = 64.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 42.09%], valid : [loss = 2.532, top1 = 35.87%], test : [loss = 2.544, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.75%], valid : [loss = 0.804, top1 = 71.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11101/15625) 011101-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.501, top1 = 88.82%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.351, top1 = 91.73%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.34 ms.
cifar100       train : [loss = 0.357, top1 = 90.10%], valid : [loss = 1.316, top1 = 66.62%], test : [loss = 1.289, top1 = 66.34%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.10%], valid : [loss = 2.415, top1 = 38.80%], test : [loss = 2.442, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.64%], valid : [loss = 0.677, top1 = 76.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11102/15625) 011102-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.77%], valid : [loss = 0.647, top1 = 84.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.16 ms.
cifar10        train : [loss = 0.076, top1 = 97.59%], test  : [loss = 0.410, top1 = 88.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.99 ms.
cifar100       train : [loss = 0.759, top1 = 77.65%], valid : [loss = 1.477, top1 = 61.26%], test : [loss = 1.455, top1 = 61.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.33%], valid : [loss = 2.689, top1 = 33.73%], test : [loss = 2.725, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.26%], valid : [loss = 0.887, top1 = 68.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11103/15625) 011103-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.539, top1 = 88.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.358, top1 = 92.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.34 ms.
cifar100       train : [loss = 0.106, top1 = 98.16%], valid : [loss = 1.449, top1 = 68.08%], test : [loss = 1.487, top1 = 67.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.90 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.42%], valid : [loss = 2.378, top1 = 39.60%], test : [loss = 2.379, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.25%], valid : [loss = 0.664, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11104/15625) 011104-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.527, top1 = 89.61%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.324, top1 = 93.12%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.27 ms.
cifar100       train : [loss = 0.082, top1 = 98.42%], valid : [loss = 1.405, top1 = 69.18%], test : [loss = 1.389, top1 = 68.96%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.95%], valid : [loss = 2.318, top1 = 40.67%], test : [loss = 2.275, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.12%], valid : [loss = 0.826, top1 = 70.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11105/15625) 011105-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.523, top1 = 89.73%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.18 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.336, top1 = 93.19%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.63 ms.
cifar100       train : [loss = 0.071, top1 = 98.87%], valid : [loss = 1.356, top1 = 69.08%], test : [loss = 1.352, top1 = 69.87%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.82%], valid : [loss = 2.182, top1 = 43.81%], test : [loss = 2.179, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.82%], valid : [loss = 0.635, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11106/15625) 011106-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.549, top1 = 88.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.341, top1 = 92.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.93 ms.
cifar100       train : [loss = 0.292, top1 = 92.02%], valid : [loss = 1.330, top1 = 66.98%], test : [loss = 1.318, top1 = 68.02%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.51%], valid : [loss = 2.443, top1 = 37.90%], test : [loss = 2.434, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11107/15625) 011107-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.91%], valid : [loss = 0.457, top1 = 86.32%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.49 ms.
cifar10        train : [loss = 0.143, top1 = 95.26%], test  : [loss = 0.332, top1 = 89.41%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.54 ms.
cifar100       train : [loss = 0.905, top1 = 74.26%], valid : [loss = 1.317, top1 = 63.62%], test : [loss = 1.329, top1 = 63.42%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.69%], valid : [loss = 2.621, top1 = 33.97%], test : [loss = 2.671, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.27%], valid : [loss = 0.755, top1 = 73.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11108/15625) 011108-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.538, top1 = 87.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.036, top1 = 99.02%], test  : [loss = 0.371, top1 = 90.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.52 ms.
cifar100       train : [loss = 0.529, top1 = 84.60%], valid : [loss = 1.348, top1 = 65.15%], test : [loss = 1.327, top1 = 65.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.16%], valid : [loss = 2.481, top1 = 37.44%], test : [loss = 2.517, top1 = 36.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.29%], valid : [loss = 0.632, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11109/15625) 011109-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.433, top1 = 89.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.80 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.295, top1 = 92.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.204, top1 = 95.38%], valid : [loss = 1.264, top1 = 69.24%], test : [loss = 1.280, top1 = 68.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.83%], valid : [loss = 2.247, top1 = 41.87%], test : [loss = 2.311, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11110/15625) 011110-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.12%], valid : [loss = 0.561, top1 = 84.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.138, top1 = 95.38%], test  : [loss = 0.385, top1 = 88.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.878, top1 = 74.25%], valid : [loss = 1.431, top1 = 61.54%], test : [loss = 1.411, top1 = 61.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.594, top1 = 34.44%], valid : [loss = 2.655, top1 = 33.13%], test : [loss = 2.668, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 67.86%], valid : [loss = 0.937, top1 = 66.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11111/15625) 011111-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.40%], valid : [loss = 0.581, top1 = 80.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.74 ms.
cifar10        train : [loss = 0.320, top1 = 89.05%], test  : [loss = 0.464, top1 = 84.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.45 ms.
cifar100       train : [loss = 1.598, top1 = 55.73%], valid : [loss = 1.843, top1 = 50.70%], test : [loss = 1.825, top1 = 50.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 3.217, top1 = 22.65%], valid : [loss = 3.218, top1 = 23.37%], test : [loss = 3.256, top1 = 21.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.26%], valid : [loss = 1.136, top1 = 59.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11112/15625) 011112-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.321, top1 = 92.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.85 ms.
cifar100       train : [loss = 0.350, top1 = 90.44%], valid : [loss = 1.287, top1 = 67.07%], test : [loss = 1.306, top1 = 66.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.85%], valid : [loss = 2.402, top1 = 39.42%], test : [loss = 2.423, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11113/15625) 011113-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.49 ms.
cifar10-valid  train : [loss = 0.152, top1 = 95.04%], valid : [loss = 0.505, top1 = 85.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.05 ms.
cifar10        train : [loss = 0.168, top1 = 94.40%], test  : [loss = 0.360, top1 = 88.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.13 ms.
cifar100       train : [loss = 1.063, top1 = 69.47%], valid : [loss = 1.400, top1 = 61.13%], test : [loss = 1.409, top1 = 60.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.595, top1 = 34.87%], valid : [loss = 2.639, top1 = 34.28%], test : [loss = 2.668, top1 = 33.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.17%], valid : [loss = 0.931, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11114/15625) 011114-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.550, top1 = 88.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.355, top1 = 92.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.05 ms.
cifar100       train : [loss = 0.294, top1 = 91.77%], valid : [loss = 1.336, top1 = 67.09%], test : [loss = 1.317, top1 = 67.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.10%], valid : [loss = 2.447, top1 = 38.40%], test : [loss = 2.445, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11115/15625) 011115-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.529, top1 = 88.64%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.307, top1 = 92.50%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.62 ms.
cifar100       train : [loss = 0.247, top1 = 93.84%], valid : [loss = 1.213, top1 = 69.56%], test : [loss = 1.200, top1 = 69.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 1.920, top1 = 49.28%], valid : [loss = 2.260, top1 = 41.87%], test : [loss = 2.285, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.49%], valid : [loss = 0.645, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11116/15625) 011116-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.570, top1 = 88.41%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.367, top1 = 92.03%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.95 ms.
cifar100       train : [loss = 0.175, top1 = 96.09%], valid : [loss = 1.387, top1 = 67.86%], test : [loss = 1.414, top1 = 67.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.33 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.71%], valid : [loss = 2.488, top1 = 37.53%], test : [loss = 2.485, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.45%], valid : [loss = 0.685, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11117/15625) 011117-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.07%], valid : [loss = 0.569, top1 = 87.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.49 ms.
cifar10        train : [loss = 0.066, top1 = 97.89%], test  : [loss = 0.395, top1 = 89.30%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.17 ms.
cifar100       train : [loss = 0.692, top1 = 79.58%], valid : [loss = 1.320, top1 = 64.62%], test : [loss = 1.321, top1 = 64.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.05%], valid : [loss = 2.489, top1 = 37.47%], test : [loss = 2.492, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11118/15625) 011118-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.87%], valid : [loss = 0.509, top1 = 84.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10        train : [loss = 0.171, top1 = 94.20%], test  : [loss = 0.385, top1 = 87.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.32 ms.
cifar100       train : [loss = 1.102, top1 = 68.28%], valid : [loss = 1.472, top1 = 59.73%], test : [loss = 1.482, top1 = 59.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.63%], valid : [loss = 2.640, top1 = 33.87%], test : [loss = 2.682, top1 = 33.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.94%], valid : [loss = 0.936, top1 = 66.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11119/15625) 011119-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.34%], valid : [loss = 0.664, top1 = 85.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.94 ms.
cifar10        train : [loss = 0.056, top1 = 98.24%], test  : [loss = 0.468, top1 = 87.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.65 ms.
cifar100       train : [loss = 0.620, top1 = 81.89%], valid : [loss = 1.509, top1 = 61.22%], test : [loss = 1.487, top1 = 61.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.22%], valid : [loss = 2.828, top1 = 30.73%], test : [loss = 2.871, top1 = 30.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.59%], valid : [loss = 0.885, top1 = 68.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11120/15625) 011120-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.76%], valid : [loss = 0.573, top1 = 84.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.133, top1 = 95.62%], test  : [loss = 0.388, top1 = 88.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.98 ms.
cifar100       train : [loss = 0.794, top1 = 76.88%], valid : [loss = 1.365, top1 = 63.44%], test : [loss = 1.354, top1 = 63.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.75 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.77%], valid : [loss = 2.603, top1 = 34.10%], test : [loss = 2.635, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 69.00%], valid : [loss = 0.923, top1 = 67.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11121/15625) 011121-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.37 ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.86%], valid : [loss = 1.228, top1 = 56.37%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.40 ms.
cifar10        train : [loss = 1.117, top1 = 60.34%], test  : [loss = 1.116, top1 = 60.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.46 ms.
cifar100       train : [loss = 2.667, top1 = 32.86%], valid : [loss = 2.724, top1 = 32.58%], test : [loss = 2.725, top1 = 30.98%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.44 ms.
ImageNet16-120 train : [loss = 3.831, top1 = 12.97%], valid : [loss = 3.833, top1 = 13.97%], test : [loss = 3.835, top1 = 13.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.687, top1 = 36.40%], valid : [loss = 1.711, top1 = 34.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11122/15625) 011122-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.694, top1 = 85.02%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.54 ms.
cifar10        train : [loss = 0.036, top1 = 99.04%], test  : [loss = 0.479, top1 = 88.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.06 ms.
cifar100       train : [loss = 0.366, top1 = 90.27%], valid : [loss = 1.541, top1 = 63.42%], test : [loss = 1.522, top1 = 62.98%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 2.439, top1 = 37.90%], valid : [loss = 2.671, top1 = 33.13%], test : [loss = 2.701, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.29%], valid : [loss = 0.822, top1 = 71.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11123/15625) 011123-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.289, top1 = 93.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.82 ms.
cifar100       train : [loss = 0.161, top1 = 96.46%], valid : [loss = 1.267, top1 = 69.82%], test : [loss = 1.268, top1 = 71.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.00%], valid : [loss = 2.240, top1 = 42.93%], test : [loss = 2.266, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.411, top1 = 85.91%], valid : [loss = 0.531, top1 = 82.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11124/15625) 011124-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.488, top1 = 89.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.64 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.325, top1 = 92.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.72 ms.
cifar100       train : [loss = 0.149, top1 = 96.76%], valid : [loss = 1.357, top1 = 68.04%], test : [loss = 1.333, top1 = 68.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 1.796, top1 = 52.40%], valid : [loss = 2.249, top1 = 42.43%], test : [loss = 2.294, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.72%], valid : [loss = 0.587, top1 = 79.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11125/15625) 011125-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.44%], valid : [loss = 0.804, top1 = 72.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.87 ms.
cifar10        train : [loss = 0.536, top1 = 81.23%], test  : [loss = 0.647, top1 = 78.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.13 ms.
cifar100       train : [loss = 1.911, top1 = 48.34%], valid : [loss = 2.064, top1 = 45.82%], test : [loss = 2.068, top1 = 45.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.51%], valid : [loss = 3.584, top1 = 17.43%], test : [loss = 3.623, top1 = 16.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.286, top1 = 53.32%], valid : [loss = 1.322, top1 = 51.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11126/15625) 011126-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.72%], valid : [loss = 0.639, top1 = 84.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.62 ms.
cifar10        train : [loss = 0.087, top1 = 97.23%], test  : [loss = 0.382, top1 = 88.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.17 ms.
cifar100       train : [loss = 0.784, top1 = 77.02%], valid : [loss = 1.425, top1 = 62.08%], test : [loss = 1.416, top1 = 61.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.02%], valid : [loss = 2.730, top1 = 32.77%], test : [loss = 2.732, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.51%], valid : [loss = 0.850, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11127/15625) 011127-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.44%], valid : [loss = 0.543, top1 = 85.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.092, top1 = 97.12%], test  : [loss = 0.362, top1 = 89.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.30 ms.
cifar100       train : [loss = 0.840, top1 = 75.57%], valid : [loss = 1.397, top1 = 62.38%], test : [loss = 1.366, top1 = 62.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.42%], valid : [loss = 2.595, top1 = 34.10%], test : [loss = 2.650, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.86%], valid : [loss = 0.961, top1 = 66.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11128/15625) 011128-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.438, top1 = 89.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.288, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.74 ms.
cifar100       train : [loss = 0.113, top1 = 97.83%], valid : [loss = 1.304, top1 = 69.52%], test : [loss = 1.274, top1 = 69.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.740, top1 = 53.60%], valid : [loss = 2.214, top1 = 43.47%], test : [loss = 2.244, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.410, top1 = 85.92%], valid : [loss = 0.534, top1 = 82.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11129/15625) 011129-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.24%], valid : [loss = 0.526, top1 = 84.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.85 ms.
cifar10        train : [loss = 0.208, top1 = 92.99%], test  : [loss = 0.384, top1 = 87.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 1.228, top1 = 65.18%], valid : [loss = 1.523, top1 = 58.55%], test : [loss = 1.540, top1 = 58.11%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.786, top1 = 30.99%], valid : [loss = 2.818, top1 = 30.30%], test : [loss = 2.860, top1 = 29.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 66.17%], valid : [loss = 0.988, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11130/15625) 011130-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.608, top1 = 87.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.433, top1 = 90.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.98 ms.
cifar100       train : [loss = 0.212, top1 = 94.90%], valid : [loss = 1.383, top1 = 65.92%], test : [loss = 1.418, top1 = 66.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.22%], valid : [loss = 2.504, top1 = 38.60%], test : [loss = 2.524, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.87%], valid : [loss = 0.744, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11131/15625) 011131-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.571, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.78 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.368, top1 = 91.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.43 ms.
cifar100       train : [loss = 0.124, top1 = 97.85%], valid : [loss = 1.365, top1 = 68.42%], test : [loss = 1.380, top1 = 67.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.73%], valid : [loss = 2.478, top1 = 38.83%], test : [loss = 2.469, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.42%], valid : [loss = 0.743, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11132/15625) 011132-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.528, top1 = 88.37%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.02 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.326, top1 = 92.20%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.98 ms.
cifar100       train : [loss = 0.340, top1 = 90.76%], valid : [loss = 1.271, top1 = 66.78%], test : [loss = 1.286, top1 = 67.36%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.06%], valid : [loss = 2.390, top1 = 39.83%], test : [loss = 2.430, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 81.00%], valid : [loss = 0.620, top1 = 78.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11133/15625) 011133-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.552, top1 = 88.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.354, top1 = 91.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.41 ms.
cifar100       train : [loss = 0.344, top1 = 90.17%], valid : [loss = 1.270, top1 = 66.58%], test : [loss = 1.294, top1 = 66.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.03%], valid : [loss = 2.478, top1 = 36.43%], test : [loss = 2.492, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.81%], valid : [loss = 0.914, top1 = 67.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11134/15625) 011134-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.590, top1 = 87.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.385, top1 = 91.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.21 ms.
cifar100       train : [loss = 0.157, top1 = 96.65%], valid : [loss = 1.503, top1 = 65.94%], test : [loss = 1.463, top1 = 66.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.21%], valid : [loss = 2.469, top1 = 38.57%], test : [loss = 2.448, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.39%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11135/15625) 011135-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.607, top1 = 87.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.414, top1 = 90.68%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.87 ms.
cifar100       train : [loss = 0.412, top1 = 88.15%], valid : [loss = 1.504, top1 = 62.90%], test : [loss = 1.505, top1 = 62.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.821, top1 = 29.09%], valid : [loss = 2.884, top1 = 27.57%], test : [loss = 2.911, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11136/15625) 011136-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.569, top1 = 88.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.376, top1 = 91.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.91 ms.
cifar100       train : [loss = 0.178, top1 = 96.01%], valid : [loss = 1.422, top1 = 66.42%], test : [loss = 1.441, top1 = 66.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 48.02%], valid : [loss = 2.414, top1 = 39.70%], test : [loss = 2.468, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.06%], valid : [loss = 0.698, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11137/15625) 011137-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.590, top1 = 87.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.402, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.244, top1 = 93.91%], valid : [loss = 1.489, top1 = 65.26%], test : [loss = 1.480, top1 = 65.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.80%], valid : [loss = 2.516, top1 = 37.23%], test : [loss = 2.561, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.48%], valid : [loss = 0.754, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11138/15625) 011138-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.60%], valid : [loss = 0.794, top1 = 72.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.619, top1 = 78.31%], test  : [loss = 0.681, top1 = 76.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 2.188, top1 = 41.62%], valid : [loss = 2.336, top1 = 38.94%], test : [loss = 2.312, top1 = 39.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 3.356, top1 = 20.17%], valid : [loss = 3.343, top1 = 20.26%], test : [loss = 3.390, top1 = 19.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.54%], valid : [loss = 1.330, top1 = 52.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11139/15625) 011139-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.493, top1 = 88.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.323, top1 = 92.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.05 ms.
cifar100       train : [loss = 0.220, top1 = 94.70%], valid : [loss = 1.249, top1 = 68.44%], test : [loss = 1.242, top1 = 69.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.006, top1 = 47.32%], valid : [loss = 2.331, top1 = 41.30%], test : [loss = 2.334, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.76%], valid : [loss = 0.950, top1 = 66.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11140/15625) 011140-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.581, top1 = 87.25%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.66 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.372, top1 = 91.58%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.33 ms.
cifar100       train : [loss = 0.263, top1 = 92.85%], valid : [loss = 1.326, top1 = 67.24%], test : [loss = 1.320, top1 = 67.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 35.39%], valid : [loss = 2.621, top1 = 34.30%], test : [loss = 2.641, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.31%], valid : [loss = 0.966, top1 = 65.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11141/15625) 011141-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.363, top1 = 87.17%], valid : [loss = 0.619, top1 = 80.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=12.89 ms.
cifar10        train : [loss = 0.289, top1 = 90.12%], test  : [loss = 0.440, top1 = 85.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 1.418, top1 = 60.17%], valid : [loss = 1.650, top1 = 54.92%], test : [loss = 1.644, top1 = 55.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 3.012, top1 = 26.54%], valid : [loss = 2.984, top1 = 26.93%], test : [loss = 3.066, top1 = 25.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.993, top1 = 64.27%], valid : [loss = 1.048, top1 = 62.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11142/15625) 011142-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.447, top1 = 89.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.302, top1 = 92.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.91 ms.
cifar100       train : [loss = 0.187, top1 = 95.66%], valid : [loss = 1.261, top1 = 69.15%], test : [loss = 1.262, top1 = 69.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.88%], valid : [loss = 2.240, top1 = 42.73%], test : [loss = 2.263, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.83%], valid : [loss = 0.532, top1 = 81.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11143/15625) 011143-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.38%], valid : [loss = 0.672, top1 = 84.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10        train : [loss = 0.050, top1 = 98.54%], test  : [loss = 0.420, top1 = 89.32%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.94 ms.
cifar100       train : [loss = 0.634, top1 = 81.73%], valid : [loss = 1.411, top1 = 62.78%], test : [loss = 1.406, top1 = 63.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.59%], valid : [loss = 2.630, top1 = 33.50%], test : [loss = 2.691, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.10%], valid : [loss = 0.827, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11144/15625) 011144-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.42%], valid : [loss = 0.591, top1 = 85.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.116, top1 = 96.20%], test  : [loss = 0.384, top1 = 88.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.47 ms.
cifar100       train : [loss = 0.813, top1 = 76.14%], valid : [loss = 1.434, top1 = 61.62%], test : [loss = 1.401, top1 = 62.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.44%], valid : [loss = 2.752, top1 = 32.03%], test : [loss = 2.786, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.17%], valid : [loss = 0.719, top1 = 75.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11145/15625) 011145-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.420, top1 = 91.07%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.79 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.275, top1 = 93.97%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.51 ms.
cifar100       train : [loss = 0.044, top1 = 99.51%], valid : [loss = 1.350, top1 = 70.18%], test : [loss = 1.309, top1 = 70.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 1.446, top1 = 60.65%], valid : [loss = 2.216, top1 = 45.93%], test : [loss = 2.268, top1 = 45.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.83%], valid : [loss = 0.492, top1 = 83.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11146/15625) 011146-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.425, top1 = 91.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.269, top1 = 94.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.18 ms.
cifar100       train : [loss = 0.063, top1 = 99.10%], valid : [loss = 1.336, top1 = 70.74%], test : [loss = 1.304, top1 = 70.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 1.526, top1 = 58.68%], valid : [loss = 2.218, top1 = 43.97%], test : [loss = 2.274, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.42%], valid : [loss = 0.492, top1 = 84.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11147/15625) 011147-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.488, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.323, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.94 ms.
cifar100       train : [loss = 0.277, top1 = 92.73%], valid : [loss = 1.247, top1 = 68.14%], test : [loss = 1.240, top1 = 68.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.63%], valid : [loss = 2.228, top1 = 43.23%], test : [loss = 2.232, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.64%], valid : [loss = 0.680, top1 = 76.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11148/15625) 011148-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.98%], valid : [loss = 0.513, top1 = 87.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10        train : [loss = 0.074, top1 = 97.64%], test  : [loss = 0.351, top1 = 90.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.94 ms.
cifar100       train : [loss = 0.715, top1 = 78.82%], valid : [loss = 1.330, top1 = 65.22%], test : [loss = 1.312, top1 = 64.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.16%], valid : [loss = 2.618, top1 = 34.00%], test : [loss = 2.678, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.84%], valid : [loss = 0.664, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11149/15625) 011149-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.235, top1 = 92.01%], valid : [loss = 0.515, top1 = 83.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10        train : [loss = 0.223, top1 = 92.44%], test  : [loss = 0.390, top1 = 87.45%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.79 ms.
cifar100       train : [loss = 1.299, top1 = 63.49%], valid : [loss = 1.564, top1 = 57.17%], test : [loss = 1.569, top1 = 57.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.795, top1 = 30.76%], valid : [loss = 2.814, top1 = 30.49%], test : [loss = 2.876, top1 = 29.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.017, top1 = 63.66%], valid : [loss = 1.061, top1 = 62.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11150/15625) 011150-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.610, top1 = 87.33%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.06 ms.
cifar10        train : [loss = 0.018, top1 = 99.46%], test  : [loss = 0.379, top1 = 91.46%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.20 ms.
cifar100       train : [loss = 0.246, top1 = 93.39%], valid : [loss = 1.362, top1 = 66.92%], test : [loss = 1.401, top1 = 66.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.86%], valid : [loss = 2.432, top1 = 38.13%], test : [loss = 2.432, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.82%], valid : [loss = 0.885, top1 = 68.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11151/15625) 011151-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.20%], valid : [loss = 0.864, top1 = 79.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10        train : [loss = 0.137, top1 = 95.41%], test  : [loss = 0.537, top1 = 85.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.15 ms.
cifar100       train : [loss = 0.858, top1 = 75.08%], valid : [loss = 1.672, top1 = 57.14%], test : [loss = 1.656, top1 = 58.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.48%], valid : [loss = 3.173, top1 = 24.53%], test : [loss = 3.222, top1 = 23.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.76%], valid : [loss = 1.023, top1 = 63.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11152/15625) 011152-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.66%], valid : [loss = 1.235, top1 = 73.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10        train : [loss = 0.104, top1 = 96.76%], test  : [loss = 0.710, top1 = 81.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.44 ms.
cifar100       train : [loss = 0.744, top1 = 78.79%], valid : [loss = 1.967, top1 = 53.10%], test : [loss = 1.959, top1 = 53.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 3.100, top1 = 25.06%], valid : [loss = 3.344, top1 = 20.90%], test : [loss = 3.401, top1 = 20.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 60.10%], valid : [loss = 1.187, top1 = 57.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11153/15625) 011153-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.96%], valid : [loss = 0.455, top1 = 89.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.01 ms.
cifar100       train : [loss = 0.323, top1 = 91.28%], valid : [loss = 1.273, top1 = 66.38%], test : [loss = 1.245, top1 = 67.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.63%], valid : [loss = 2.325, top1 = 40.57%], test : [loss = 2.348, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.55%], valid : [loss = 0.590, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11154/15625) 011154-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.124, top1 = 95.85%], valid : [loss = 0.776, top1 = 80.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.155, top1 = 94.72%], test  : [loss = 0.482, top1 = 85.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.972, top1 = 71.64%], valid : [loss = 1.663, top1 = 56.30%], test : [loss = 1.628, top1 = 56.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 3.089, top1 = 24.66%], valid : [loss = 3.172, top1 = 24.60%], test : [loss = 3.185, top1 = 22.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.62%], valid : [loss = 1.007, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11155/15625) 011155-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.424, top1 = 90.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.288, top1 = 93.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.03 ms.
cifar100       train : [loss = 0.177, top1 = 95.99%], valid : [loss = 1.265, top1 = 70.08%], test : [loss = 1.286, top1 = 69.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 1.793, top1 = 52.44%], valid : [loss = 2.254, top1 = 43.10%], test : [loss = 2.280, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.14%], valid : [loss = 0.520, top1 = 82.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11156/15625) 011156-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.042, top1 = 99.01%], valid : [loss = 0.739, top1 = 83.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10        train : [loss = 0.092, top1 = 97.00%], test  : [loss = 0.485, top1 = 86.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.95 ms.
cifar100       train : [loss = 0.798, top1 = 76.63%], valid : [loss = 1.549, top1 = 60.22%], test : [loss = 1.541, top1 = 59.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.791, top1 = 30.77%], valid : [loss = 2.927, top1 = 28.80%], test : [loss = 2.968, top1 = 29.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.09%], valid : [loss = 0.883, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11157/15625) 011157-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.426, top1 = 90.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.285, top1 = 93.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.89 ms.
cifar100       train : [loss = 0.065, top1 = 99.10%], valid : [loss = 1.348, top1 = 69.36%], test : [loss = 1.359, top1 = 70.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 1.550, top1 = 58.07%], valid : [loss = 2.226, top1 = 43.70%], test : [loss = 2.306, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11158/15625) 011158-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.446, top1 = 89.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.18 ms.
cifar100       train : [loss = 0.321, top1 = 91.31%], valid : [loss = 1.287, top1 = 67.56%], test : [loss = 1.286, top1 = 67.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.48%], valid : [loss = 2.362, top1 = 40.29%], test : [loss = 2.397, top1 = 39.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.433, top1 = 85.12%], valid : [loss = 0.536, top1 = 81.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11159/15625) 011159-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.37%], valid : [loss = 0.571, top1 = 83.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.59 ms.
cifar10        train : [loss = 0.169, top1 = 94.43%], test  : [loss = 0.391, top1 = 87.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.36 ms.
cifar100       train : [loss = 1.161, top1 = 66.82%], valid : [loss = 1.495, top1 = 58.95%], test : [loss = 1.480, top1 = 59.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.96 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.74%], valid : [loss = 2.691, top1 = 33.08%], test : [loss = 2.701, top1 = 32.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 66.07%], valid : [loss = 0.990, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11160/15625) 011160-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.81%], valid : [loss = 0.639, top1 = 84.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.088, top1 = 97.16%], test  : [loss = 0.429, top1 = 88.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.28 ms.
cifar100       train : [loss = 0.780, top1 = 77.14%], valid : [loss = 1.451, top1 = 61.86%], test : [loss = 1.427, top1 = 62.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.97%], valid : [loss = 2.725, top1 = 32.23%], test : [loss = 2.741, top1 = 31.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.51%], valid : [loss = 0.850, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11161/15625) 011161-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.18%], valid : [loss = 0.590, top1 = 85.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.14 ms.
cifar10        train : [loss = 0.069, top1 = 97.87%], test  : [loss = 0.416, top1 = 88.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.14 ms.
cifar100       train : [loss = 0.722, top1 = 79.07%], valid : [loss = 1.415, top1 = 62.74%], test : [loss = 1.370, top1 = 63.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.29 ms.
ImageNet16-120 train : [loss = 2.520, top1 = 36.31%], valid : [loss = 2.606, top1 = 35.07%], test : [loss = 2.655, top1 = 34.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11162/15625) 011162-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.517, top1 = 89.38%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.75 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.359, top1 = 92.74%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.05 ms.
cifar100       train : [loss = 0.085, top1 = 98.68%], valid : [loss = 1.441, top1 = 68.64%], test : [loss = 1.420, top1 = 68.38%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 1.772, top1 = 52.90%], valid : [loss = 2.433, top1 = 40.37%], test : [loss = 2.398, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.577, top1 = 79.78%], valid : [loss = 0.676, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11163/15625) 011163-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.28%], valid : [loss = 0.448, top1 = 87.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10        train : [loss = 0.117, top1 = 96.37%], test  : [loss = 0.330, top1 = 89.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.869, top1 = 75.27%], valid : [loss = 1.299, top1 = 64.08%], test : [loss = 1.282, top1 = 63.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.78%], valid : [loss = 2.614, top1 = 34.63%], test : [loss = 2.657, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.76%], valid : [loss = 0.649, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11164/15625) 011164-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.336, top1 = 91.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.52 ms.
cifar100       train : [loss = 0.335, top1 = 90.90%], valid : [loss = 1.290, top1 = 67.35%], test : [loss = 1.290, top1 = 66.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.85%], valid : [loss = 2.418, top1 = 39.13%], test : [loss = 2.426, top1 = 38.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11165/15625) 011165-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.571, top1 = 87.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.017, top1 = 99.63%], test  : [loss = 0.390, top1 = 90.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.378, top1 = 89.34%], valid : [loss = 1.431, top1 = 64.34%], test : [loss = 1.400, top1 = 65.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.17%], valid : [loss = 2.511, top1 = 37.57%], test : [loss = 2.543, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.12%], valid : [loss = 0.817, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11166/15625) 011166-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10-valid  train : [loss = 1.241, top1 = 54.97%], valid : [loss = 1.289, top1 = 54.03%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 1.234, top1 = 55.88%], test  : [loss = 1.237, top1 = 55.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.23 ms.
cifar100       train : [loss = 2.760, top1 = 31.13%], valid : [loss = 2.846, top1 = 29.97%], test : [loss = 2.835, top1 = 30.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.71 ms.
ImageNet16-120 train : [loss = 3.909, top1 = 11.81%], valid : [loss = 3.906, top1 = 12.13%], test : [loss = 3.926, top1 = 11.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.740, top1 = 34.17%], valid : [loss = 1.741, top1 = 34.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11167/15625) 011167-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.453 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.425, top1 = 90.40%]
cifar10        FLOP= 62.83 M, Params=0.453 MB, latency=19.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.276, top1 = 93.23%]
cifar100       FLOP= 62.84 M, Params=0.459 MB, latency=16.81 ms.
cifar100       train : [loss = 0.151, top1 = 96.67%], valid : [loss = 1.280, top1 = 69.49%], test : [loss = 1.295, top1 = 69.53%]
ImageNet16-120 FLOP= 15.72 M, Params=0.461 MB, latency=19.10 ms.
ImageNet16-120 train : [loss = 1.745, top1 = 53.52%], valid : [loss = 2.220, top1 = 43.23%], test : [loss = 2.274, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.374, top1 = 87.28%], valid : [loss = 0.501, top1 = 83.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11168/15625) 011168-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.71 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11169/15625) 011169-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.686, top1 = 84.22%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=18.15 ms.
cifar10        train : [loss = 0.062, top1 = 98.12%], test  : [loss = 0.437, top1 = 88.57%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=17.48 ms.
cifar100       train : [loss = 0.698, top1 = 79.61%], valid : [loss = 1.428, top1 = 62.41%], test : [loss = 1.412, top1 = 62.81%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 35.98%], valid : [loss = 2.653, top1 = 33.58%], test : [loss = 2.702, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 73.05%], valid : [loss = 0.826, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11170/15625) 011170-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.452, top1 = 89.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.329, top1 = 91.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.50 ms.
cifar100       train : [loss = 0.327, top1 = 91.08%], valid : [loss = 1.301, top1 = 67.14%], test : [loss = 1.306, top1 = 66.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.36%], valid : [loss = 2.386, top1 = 39.66%], test : [loss = 2.410, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11171/15625) 011171-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.73%], valid : [loss = 0.542, top1 = 86.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10        train : [loss = 0.076, top1 = 97.63%], test  : [loss = 0.358, top1 = 89.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.46 ms.
cifar100       train : [loss = 0.715, top1 = 78.92%], valid : [loss = 1.341, top1 = 65.08%], test : [loss = 1.345, top1 = 64.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.11%], valid : [loss = 2.636, top1 = 34.13%], test : [loss = 2.699, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.84%], valid : [loss = 0.664, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11172/15625) 011172-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.15%], valid : [loss = 0.477, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.34 ms.
cifar10        train : [loss = 0.302, top1 = 89.91%], test  : [loss = 0.401, top1 = 86.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.57 ms.
cifar100       train : [loss = 1.328, top1 = 63.19%], valid : [loss = 1.533, top1 = 57.85%], test : [loss = 1.511, top1 = 58.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.52%], valid : [loss = 2.918, top1 = 29.02%], test : [loss = 2.973, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11173/15625) 011173-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.485, top1 = 89.25%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.78 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.309, top1 = 92.18%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.11 ms.
cifar100       train : [loss = 0.264, top1 = 93.14%], valid : [loss = 1.208, top1 = 68.54%], test : [loss = 1.202, top1 = 69.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.24%], valid : [loss = 2.204, top1 = 42.70%], test : [loss = 2.219, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.27%], valid : [loss = 0.604, top1 = 79.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11174/15625) 011174-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.423, top1 = 91.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.286, top1 = 93.70%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.78 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.349, top1 = 70.08%], test : [loss = 1.365, top1 = 70.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.540, top1 = 58.27%], valid : [loss = 2.245, top1 = 44.80%], test : [loss = 2.236, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11175/15625) 011175-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.559, top1 = 88.39%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.017, top1 = 99.55%], test  : [loss = 0.386, top1 = 91.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.37 ms.
cifar100       train : [loss = 0.204, top1 = 94.73%], valid : [loss = 1.304, top1 = 68.58%], test : [loss = 1.342, top1 = 68.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=24.20 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.01%], valid : [loss = 2.504, top1 = 36.67%], test : [loss = 2.516, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.949, top1 = 65.48%], valid : [loss = 0.982, top1 = 64.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11176/15625) 011176-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.515, top1 = 88.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.326, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.46 ms.
cifar100       train : [loss = 0.334, top1 = 90.95%], valid : [loss = 1.275, top1 = 67.18%], test : [loss = 1.280, top1 = 66.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.06%], valid : [loss = 2.407, top1 = 38.83%], test : [loss = 2.396, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11177/15625) 011177-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.13%], valid : [loss = 0.461, top1 = 85.81%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.55 ms.
cifar10        train : [loss = 0.157, top1 = 94.81%], test  : [loss = 0.346, top1 = 89.19%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.65 ms.
cifar100       train : [loss = 1.015, top1 = 71.27%], valid : [loss = 1.358, top1 = 62.10%], test : [loss = 1.359, top1 = 61.78%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.70%], valid : [loss = 2.687, top1 = 33.20%], test : [loss = 2.709, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11178/15625) 011178-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.30%], valid : [loss = 0.521, top1 = 87.48%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.44 ms.
cifar10        train : [loss = 0.059, top1 = 98.22%], test  : [loss = 0.364, top1 = 90.22%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=16.03 ms.
cifar100       train : [loss = 0.636, top1 = 81.33%], valid : [loss = 1.328, top1 = 65.15%], test : [loss = 1.311, top1 = 65.11%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 38.96%], valid : [loss = 2.516, top1 = 36.69%], test : [loss = 2.570, top1 = 35.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.96%], valid : [loss = 0.631, top1 = 78.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11179/15625) 011179-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.46%], valid : [loss = 0.578, top1 = 87.36%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10        train : [loss = 0.063, top1 = 98.05%], test  : [loss = 0.394, top1 = 89.77%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.20 ms.
cifar100       train : [loss = 0.326, top1 = 90.91%], valid : [loss = 1.369, top1 = 65.94%], test : [loss = 1.421, top1 = 65.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 2.807, top1 = 29.41%], valid : [loss = 2.882, top1 = 27.57%], test : [loss = 2.899, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.137, top1 = 58.99%], valid : [loss = 1.141, top1 = 58.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11180/15625) 011180-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.42%], valid : [loss = 0.778, top1 = 82.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.77 ms.
cifar10        train : [loss = 0.087, top1 = 97.15%], test  : [loss = 0.471, top1 = 87.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 0.799, top1 = 76.67%], valid : [loss = 1.511, top1 = 60.22%], test : [loss = 1.501, top1 = 60.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 2.811, top1 = 30.34%], valid : [loss = 2.941, top1 = 28.20%], test : [loss = 2.971, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.33%], valid : [loss = 0.868, top1 = 69.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11181/15625) 011181-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.497, top1 = 88.96%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.318, top1 = 92.08%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.09 ms.
cifar100       train : [loss = 0.338, top1 = 90.69%], valid : [loss = 1.273, top1 = 66.72%], test : [loss = 1.298, top1 = 67.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.84%], valid : [loss = 2.394, top1 = 38.20%], test : [loss = 2.407, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.32%], valid : [loss = 0.614, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11182/15625) 011182-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.306, top1 = 89.39%], valid : [loss = 0.564, top1 = 82.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.247, top1 = 91.60%], test  : [loss = 0.397, top1 = 86.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.07 ms.
cifar100       train : [loss = 1.403, top1 = 60.62%], valid : [loss = 1.662, top1 = 54.85%], test : [loss = 1.638, top1 = 55.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.39 ms.
ImageNet16-120 train : [loss = 2.939, top1 = 28.10%], valid : [loss = 2.942, top1 = 27.87%], test : [loss = 3.011, top1 = 27.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.997, top1 = 64.23%], valid : [loss = 1.019, top1 = 63.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11183/15625) 011183-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.89%], valid : [loss = 0.593, top1 = 86.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.50 ms.
cifar10        train : [loss = 0.025, top1 = 99.42%], test  : [loss = 0.389, top1 = 90.36%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.34 ms.
cifar100       train : [loss = 0.334, top1 = 91.37%], valid : [loss = 1.375, top1 = 66.22%], test : [loss = 1.385, top1 = 65.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.61%], valid : [loss = 2.511, top1 = 36.10%], test : [loss = 2.514, top1 = 37.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.36%], valid : [loss = 0.744, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11184/15625) 011184-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.09%], valid : [loss = 0.475, top1 = 84.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 0.301, top1 = 90.04%], test  : [loss = 0.407, top1 = 86.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.56 ms.
cifar100       train : [loss = 1.333, top1 = 62.98%], valid : [loss = 1.545, top1 = 57.74%], test : [loss = 1.536, top1 = 57.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.03 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.65%], valid : [loss = 2.910, top1 = 28.53%], test : [loss = 2.960, top1 = 29.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11185/15625) 011185-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.10%], valid : [loss = 0.471, top1 = 86.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10        train : [loss = 0.161, top1 = 94.69%], test  : [loss = 0.338, top1 = 89.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.83 ms.
cifar100       train : [loss = 1.013, top1 = 71.31%], valid : [loss = 1.346, top1 = 61.48%], test : [loss = 1.347, top1 = 62.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 33.99%], valid : [loss = 2.679, top1 = 33.07%], test : [loss = 2.721, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11186/15625) 011186-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.22%], valid : [loss = 0.464, top1 = 85.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.163, top1 = 94.78%], test  : [loss = 0.357, top1 = 88.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 1.003, top1 = 71.45%], valid : [loss = 1.355, top1 = 62.02%], test : [loss = 1.343, top1 = 62.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.68%], valid : [loss = 2.691, top1 = 32.47%], test : [loss = 2.718, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11187/15625) 011187-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=22.10 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.40%], valid : [loss = 0.458, top1 = 86.77%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=21.21 ms.
cifar10        train : [loss = 0.096, top1 = 97.20%], test  : [loss = 0.345, top1 = 89.50%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=21.24 ms.
cifar100       train : [loss = 0.581, top1 = 84.00%], valid : [loss = 1.264, top1 = 65.06%], test : [loss = 1.252, top1 = 66.04%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=23.03 ms.
ImageNet16-120 train : [loss = 2.431, top1 = 38.23%], valid : [loss = 2.568, top1 = 36.00%], test : [loss = 2.569, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.68%], valid : [loss = 0.857, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11188/15625) 011188-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.60%], valid : [loss = 0.521, top1 = 88.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.13 ms.
cifar10        train : [loss = 0.030, top1 = 99.05%], test  : [loss = 0.353, top1 = 90.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.419, top1 = 87.78%], valid : [loss = 1.262, top1 = 67.84%], test : [loss = 1.254, top1 = 68.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.187, top1 = 43.46%], valid : [loss = 2.364, top1 = 39.80%], test : [loss = 2.410, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.913, top1 = 67.31%], valid : [loss = 0.961, top1 = 65.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11189/15625) 011189-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.38%], valid : [loss = 0.551, top1 = 87.73%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.032, top1 = 98.98%], test  : [loss = 0.366, top1 = 90.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.61 ms.
cifar100       train : [loss = 0.336, top1 = 90.43%], valid : [loss = 1.293, top1 = 66.48%], test : [loss = 1.314, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 33.54%], valid : [loss = 2.664, top1 = 33.17%], test : [loss = 2.694, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.93%], valid : [loss = 1.196, top1 = 56.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11190/15625) 011190-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.534, top1 = 88.73%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.65%], test  : [loss = 0.341, top1 = 91.89%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.59 ms.
cifar100       train : [loss = 0.224, top1 = 93.92%], valid : [loss = 1.330, top1 = 67.88%], test : [loss = 1.313, top1 = 68.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.12%], valid : [loss = 2.289, top1 = 42.20%], test : [loss = 2.310, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.91%], valid : [loss = 0.869, top1 = 69.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11191/15625) 011191-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.553, top1 = 88.64%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.364, top1 = 92.07%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.00 ms.
cifar100       train : [loss = 0.233, top1 = 93.84%], valid : [loss = 1.306, top1 = 67.10%], test : [loss = 1.306, top1 = 67.86%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.49 ms.
ImageNet16-120 train : [loss = 2.091, top1 = 45.45%], valid : [loss = 2.380, top1 = 39.60%], test : [loss = 2.391, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.33%], valid : [loss = 0.797, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11192/15625) 011192-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.84%], valid : [loss = 0.605, top1 = 86.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.99 ms.
cifar10        train : [loss = 0.028, top1 = 99.33%], test  : [loss = 0.429, top1 = 88.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.94 ms.
cifar100       train : [loss = 0.387, top1 = 89.49%], valid : [loss = 1.421, top1 = 64.46%], test : [loss = 1.414, top1 = 65.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.10%], valid : [loss = 2.628, top1 = 34.10%], test : [loss = 2.659, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.24%], valid : [loss = 0.772, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11193/15625) 011193-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.83 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.67%], valid : [loss = 0.494, top1 = 86.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.95 ms.
cifar10        train : [loss = 0.095, top1 = 96.83%], test  : [loss = 0.348, top1 = 89.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.698, top1 = 79.58%], valid : [loss = 1.244, top1 = 66.10%], test : [loss = 1.227, top1 = 66.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.38%], valid : [loss = 2.435, top1 = 38.07%], test : [loss = 2.498, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.02%], valid : [loss = 0.954, top1 = 65.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11194/15625) 011194-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.445, top1 = 89.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.58 ms.
cifar100       train : [loss = 0.318, top1 = 91.43%], valid : [loss = 1.278, top1 = 67.83%], test : [loss = 1.287, top1 = 67.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.54%], valid : [loss = 2.357, top1 = 40.09%], test : [loss = 2.388, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.37%], valid : [loss = 0.562, top1 = 81.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11195/15625) 011195-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.481, top1 = 90.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.73 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.299, top1 = 93.12%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.26 ms.
cifar100       train : [loss = 0.123, top1 = 97.50%], valid : [loss = 1.335, top1 = 68.40%], test : [loss = 1.349, top1 = 69.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 1.667, top1 = 55.24%], valid : [loss = 2.189, top1 = 44.47%], test : [loss = 2.214, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.97%], valid : [loss = 0.606, top1 = 79.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11196/15625) 011196-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.593, top1 = 85.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10        train : [loss = 0.066, top1 = 98.06%], test  : [loss = 0.401, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.29 ms.
cifar100       train : [loss = 0.701, top1 = 79.66%], valid : [loss = 1.395, top1 = 62.99%], test : [loss = 1.363, top1 = 63.71%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.26%], valid : [loss = 2.627, top1 = 34.48%], test : [loss = 2.676, top1 = 33.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.00%], valid : [loss = 0.772, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11197/15625) 011197-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.350, top1 = 87.80%], valid : [loss = 0.597, top1 = 80.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 0.295, top1 = 89.93%], test  : [loss = 0.440, top1 = 85.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.32 ms.
cifar100       train : [loss = 1.553, top1 = 56.68%], valid : [loss = 1.796, top1 = 51.57%], test : [loss = 1.775, top1 = 51.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.949, top1 = 27.62%], valid : [loss = 2.966, top1 = 27.36%], test : [loss = 3.010, top1 = 26.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.89%], valid : [loss = 1.020, top1 = 63.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11198/15625) 011198-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.77%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.319, top1 = 93.37%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.95 ms.
cifar100       train : [loss = 0.067, top1 = 99.04%], valid : [loss = 1.340, top1 = 70.22%], test : [loss = 1.377, top1 = 69.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.74%], valid : [loss = 2.375, top1 = 39.80%], test : [loss = 2.379, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11199/15625) 011199-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.490, top1 = 89.74%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.298, top1 = 93.26%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.83 ms.
cifar100       train : [loss = 0.125, top1 = 97.66%], valid : [loss = 1.269, top1 = 69.86%], test : [loss = 1.257, top1 = 69.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.716, top1 = 54.15%], valid : [loss = 2.183, top1 = 43.52%], test : [loss = 2.175, top1 = 44.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.93%], valid : [loss = 0.572, top1 = 80.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11200/15625) 011200-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.70%], valid : [loss = 0.721, top1 = 80.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10        train : [loss = 0.194, top1 = 93.26%], test  : [loss = 0.502, top1 = 84.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.09 ms.
cifar100       train : [loss = 0.900, top1 = 73.59%], valid : [loss = 1.676, top1 = 57.44%], test : [loss = 1.670, top1 = 56.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.01 ms.
ImageNet16-120 train : [loss = 3.469, top1 = 17.34%], valid : [loss = 3.484, top1 = 17.97%], test : [loss = 3.472, top1 = 17.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11201/15625) 011201-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.92%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.61 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.331, top1 = 93.28%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.20 ms.
cifar100       train : [loss = 0.068, top1 = 99.08%], valid : [loss = 1.309, top1 = 70.44%], test : [loss = 1.330, top1 = 70.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.52 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.05%], valid : [loss = 2.377, top1 = 38.73%], test : [loss = 2.369, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11202/15625) 011202-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.586, top1 = 87.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.385, top1 = 91.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 0.372, top1 = 89.57%], valid : [loss = 1.415, top1 = 65.67%], test : [loss = 1.378, top1 = 65.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.21%], valid : [loss = 2.503, top1 = 37.10%], test : [loss = 2.530, top1 = 36.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.54%], valid : [loss = 0.782, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11203/15625) 011203-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.614, top1 = 86.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.404, top1 = 90.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.53 ms.
cifar100       train : [loss = 0.500, top1 = 85.42%], valid : [loss = 1.411, top1 = 64.26%], test : [loss = 1.388, top1 = 64.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.393, top1 = 39.01%], valid : [loss = 2.563, top1 = 35.37%], test : [loss = 2.591, top1 = 35.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.11%], valid : [loss = 0.831, top1 = 70.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11204/15625) 011204-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.534, top1 = 88.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.340, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.73 ms.
cifar100       train : [loss = 0.340, top1 = 90.62%], valid : [loss = 1.292, top1 = 67.36%], test : [loss = 1.288, top1 = 66.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.08%], valid : [loss = 2.415, top1 = 38.27%], test : [loss = 2.404, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11205/15625) 011205-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.38%], valid : [loss = 0.744, top1 = 74.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10        train : [loss = 0.565, top1 = 80.20%], test  : [loss = 0.639, top1 = 78.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.17 ms.
cifar100       train : [loss = 1.995, top1 = 45.77%], valid : [loss = 2.118, top1 = 43.93%], test : [loss = 2.118, top1 = 43.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.38%], valid : [loss = 3.040, top1 = 26.19%], test : [loss = 3.074, top1 = 24.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.152, top1 = 58.26%], valid : [loss = 1.186, top1 = 57.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11206/15625) 011206-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.578, top1 = 87.44%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.389, top1 = 90.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.71 ms.
cifar100       train : [loss = 0.405, top1 = 88.41%], valid : [loss = 1.397, top1 = 65.05%], test : [loss = 1.411, top1 = 65.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.04%], valid : [loss = 2.500, top1 = 37.18%], test : [loss = 2.508, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.69%], valid : [loss = 0.822, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11207/15625) 011207-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.47%], valid : [loss = 0.441, top1 = 87.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.75 ms.
cifar10        train : [loss = 0.057, top1 = 98.59%], test  : [loss = 0.321, top1 = 90.21%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.17 ms.
cifar100       train : [loss = 0.592, top1 = 83.68%], valid : [loss = 1.239, top1 = 66.31%], test : [loss = 1.215, top1 = 66.63%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.10%], valid : [loss = 2.467, top1 = 37.78%], test : [loss = 2.482, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11208/15625) 011208-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.47%], valid : [loss = 0.442, top1 = 87.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10        train : [loss = 0.113, top1 = 96.55%], test  : [loss = 0.324, top1 = 89.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.60 ms.
cifar100       train : [loss = 0.866, top1 = 75.41%], valid : [loss = 1.287, top1 = 64.22%], test : [loss = 1.274, top1 = 65.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.564, top1 = 35.49%], valid : [loss = 2.623, top1 = 34.70%], test : [loss = 2.659, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.89%], valid : [loss = 0.659, top1 = 77.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11209/15625) 011209-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.32%], valid : [loss = 0.450, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.115, top1 = 96.48%], test  : [loss = 0.334, top1 = 89.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.35 ms.
cifar100       train : [loss = 0.863, top1 = 75.44%], valid : [loss = 1.284, top1 = 64.12%], test : [loss = 1.295, top1 = 64.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.71%], valid : [loss = 2.636, top1 = 34.00%], test : [loss = 2.662, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11210/15625) 011210-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.54%], valid : [loss = 0.669, top1 = 77.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 0.530, top1 = 81.48%], test  : [loss = 0.594, top1 = 79.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.40 ms.
cifar100       train : [loss = 1.777, top1 = 52.13%], valid : [loss = 1.932, top1 = 48.62%], test : [loss = 1.972, top1 = 48.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 3.408, top1 = 19.78%], valid : [loss = 3.381, top1 = 21.47%], test : [loss = 3.433, top1 = 18.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.351, top1 = 51.46%], valid : [loss = 1.399, top1 = 49.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11211/15625) 011211-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.601, top1 = 86.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.393, top1 = 90.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.25 ms.
cifar100       train : [loss = 0.547, top1 = 83.81%], valid : [loss = 1.420, top1 = 64.08%], test : [loss = 1.402, top1 = 64.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.12%], valid : [loss = 2.572, top1 = 35.03%], test : [loss = 2.591, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.38%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11212/15625) 011212-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.83%], valid : [loss = 0.546, top1 = 88.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.346, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.50 ms.
cifar100       train : [loss = 0.253, top1 = 93.13%], valid : [loss = 1.325, top1 = 67.88%], test : [loss = 1.353, top1 = 67.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.43%], valid : [loss = 2.445, top1 = 38.30%], test : [loss = 2.437, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11213/15625) 011213-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.07%], valid : [loss = 0.574, top1 = 86.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.58 ms.
cifar10        train : [loss = 0.067, top1 = 97.85%], test  : [loss = 0.375, top1 = 89.92%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.56 ms.
cifar100       train : [loss = 0.679, top1 = 80.01%], valid : [loss = 1.311, top1 = 64.52%], test : [loss = 1.327, top1 = 64.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.38%], valid : [loss = 2.493, top1 = 37.63%], test : [loss = 2.523, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.95%], valid : [loss = 0.838, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11214/15625) 011214-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.281, top1 = 90.62%], valid : [loss = 0.476, top1 = 84.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.15 ms.
cifar10        train : [loss = 0.298, top1 = 90.00%], test  : [loss = 0.397, top1 = 86.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.33 ms.
cifar100       train : [loss = 1.331, top1 = 63.26%], valid : [loss = 1.523, top1 = 57.84%], test : [loss = 1.485, top1 = 58.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.80%], valid : [loss = 2.891, top1 = 29.47%], test : [loss = 2.945, top1 = 28.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11215/15625) 011215-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.90%], valid : [loss = 0.554, top1 = 86.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.37 ms.
cifar10        train : [loss = 0.063, top1 = 98.07%], test  : [loss = 0.372, top1 = 89.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.39 ms.
cifar100       train : [loss = 0.722, top1 = 78.77%], valid : [loss = 1.373, top1 = 63.70%], test : [loss = 1.344, top1 = 64.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.89%], valid : [loss = 2.469, top1 = 37.57%], test : [loss = 2.493, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11216/15625) 011216-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.534, top1 = 88.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.340, top1 = 91.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.12 ms.
cifar100       train : [loss = 0.305, top1 = 91.82%], valid : [loss = 1.297, top1 = 67.14%], test : [loss = 1.292, top1 = 67.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 44.01%], valid : [loss = 2.412, top1 = 39.63%], test : [loss = 2.438, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11217/15625) 011217-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.436, top1 = 90.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.274, top1 = 93.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.298, top1 = 70.62%], test : [loss = 1.313, top1 = 70.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 1.552, top1 = 58.23%], valid : [loss = 2.274, top1 = 43.20%], test : [loss = 2.289, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.24%], valid : [loss = 0.499, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11218/15625) 011218-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.444, top1 = 90.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.284, top1 = 93.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.23 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.350, top1 = 70.08%], test : [loss = 1.331, top1 = 70.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 1.544, top1 = 58.31%], valid : [loss = 2.226, top1 = 43.77%], test : [loss = 2.254, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.45%], valid : [loss = 0.512, top1 = 82.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11219/15625) 011219-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.522, top1 = 88.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.333, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.85 ms.
cifar100       train : [loss = 0.335, top1 = 90.84%], valid : [loss = 1.301, top1 = 66.42%], test : [loss = 1.293, top1 = 67.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.87%], valid : [loss = 2.368, top1 = 39.70%], test : [loss = 2.403, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.68%], valid : [loss = 0.746, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11220/15625) 011220-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.27%], valid : [loss = 0.595, top1 = 84.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.095, top1 = 96.94%], test  : [loss = 0.430, top1 = 88.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.98 ms.
cifar100       train : [loss = 0.733, top1 = 78.52%], valid : [loss = 1.546, top1 = 60.30%], test : [loss = 1.548, top1 = 60.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.35 ms.
ImageNet16-120 train : [loss = 3.186, top1 = 22.28%], valid : [loss = 3.188, top1 = 22.87%], test : [loss = 3.241, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.001, top1 = 64.26%], valid : [loss = 1.029, top1 = 63.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11221/15625) 011221-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.508, top1 = 88.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.328, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.93 ms.
cifar100       train : [loss = 0.341, top1 = 90.57%], valid : [loss = 1.289, top1 = 66.78%], test : [loss = 1.293, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 45.02%], valid : [loss = 2.388, top1 = 40.17%], test : [loss = 2.419, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11222/15625) 011222-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.23%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=14.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.318, top1 = 92.02%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=12.98 ms.
cifar100       train : [loss = 0.326, top1 = 91.13%], valid : [loss = 1.304, top1 = 67.11%], test : [loss = 1.310, top1 = 67.25%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.24%], valid : [loss = 2.374, top1 = 39.90%], test : [loss = 2.432, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.89%], valid : [loss = 0.559, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11223/15625) 011223-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.59 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.36%], valid : [loss = 0.481, top1 = 84.83%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10        train : [loss = 0.308, top1 = 89.48%], test  : [loss = 0.455, top1 = 84.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.13 ms.
cifar100       train : [loss = 1.305, top1 = 63.39%], valid : [loss = 1.568, top1 = 56.16%], test : [loss = 1.554, top1 = 56.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 3.024, top1 = 25.97%], valid : [loss = 3.007, top1 = 26.30%], test : [loss = 3.006, top1 = 25.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.85%], valid : [loss = 1.017, top1 = 63.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11224/15625) 011224-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.58 ms.
cifar10-valid  train : [loss = 1.852, top1 = 32.61%], valid : [loss = 1.857, top1 = 32.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10        train : [loss = 1.379, top1 = 49.69%], test  : [loss = 1.389, top1 = 49.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.21 ms.
cifar100       train : [loss = 3.900, top1 = 9.97%], valid : [loss = 3.901, top1 = 10.11%], test : [loss = 3.896, top1 = 10.27%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.20 ms.
ImageNet16-120 train : [loss = 4.032, top1 = 9.82%], valid : [loss = 4.025, top1 = 9.63%], test : [loss = 4.034, top1 = 10.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.981, top1 = 26.40%], valid : [loss = 1.985, top1 = 26.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11225/15625) 011225-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.555, top1 = 89.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.356, top1 = 92.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.101, top1 = 98.19%], valid : [loss = 1.408, top1 = 67.96%], test : [loss = 1.400, top1 = 68.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.50%], valid : [loss = 2.419, top1 = 39.30%], test : [loss = 2.417, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.06%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11226/15625) 011226-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.428, top1 = 90.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.288, top1 = 93.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.15 ms.
cifar100       train : [loss = 0.066, top1 = 99.05%], valid : [loss = 1.371, top1 = 69.58%], test : [loss = 1.357, top1 = 70.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 1.540, top1 = 58.29%], valid : [loss = 2.206, top1 = 44.33%], test : [loss = 2.270, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11227/15625) 011227-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.38 ms.
cifar10-valid  train : [loss = 1.851, top1 = 32.95%], valid : [loss = 1.863, top1 = 32.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.99 ms.
cifar10        train : [loss = 1.337, top1 = 51.38%], test  : [loss = 1.336, top1 = 51.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.27 ms.
cifar100       train : [loss = 3.878, top1 = 10.42%], valid : [loss = 3.911, top1 = 9.86%], test : [loss = 3.909, top1 = 10.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.45 ms.
ImageNet16-120 train : [loss = 3.998, top1 = 10.40%], valid : [loss = 3.988, top1 = 10.58%], test : [loss = 3.993, top1 = 10.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.970, top1 = 27.12%], valid : [loss = 1.970, top1 = 27.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11228/15625) 011228-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.73%], valid : [loss = 0.851, top1 = 71.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.562, top1 = 80.46%], test  : [loss = 0.708, top1 = 75.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.79 ms.
cifar100       train : [loss = 1.767, top1 = 52.44%], valid : [loss = 2.043, top1 = 47.12%], test : [loss = 2.065, top1 = 47.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.75%], valid : [loss = 3.645, top1 = 16.63%], test : [loss = 3.674, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11229/15625) 011229-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.228, top1 = 92.38%], valid : [loss = 0.551, top1 = 82.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.231, top1 = 92.02%], test  : [loss = 0.419, top1 = 86.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.02 ms.
cifar100       train : [loss = 1.311, top1 = 62.73%], valid : [loss = 1.605, top1 = 55.90%], test : [loss = 1.602, top1 = 55.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.762, top1 = 31.39%], valid : [loss = 2.796, top1 = 30.63%], test : [loss = 2.821, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.46%], valid : [loss = 1.015, top1 = 63.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11230/15625) 011230-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.97%], valid : [loss = 0.463, top1 = 88.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.329, top1 = 91.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.97 ms.
cifar100       train : [loss = 0.327, top1 = 91.15%], valid : [loss = 1.299, top1 = 67.36%], test : [loss = 1.312, top1 = 67.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.35%], valid : [loss = 2.371, top1 = 39.60%], test : [loss = 2.441, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11231/15625) 011231-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.01 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.82%], valid : [loss = 0.480, top1 = 84.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10        train : [loss = 0.307, top1 = 89.61%], test  : [loss = 0.411, top1 = 86.30%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.93 ms.
cifar100       train : [loss = 1.331, top1 = 63.16%], valid : [loss = 1.531, top1 = 57.28%], test : [loss = 1.523, top1 = 57.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.65%], valid : [loss = 2.922, top1 = 29.70%], test : [loss = 2.955, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11232/15625) 011232-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.45 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.264, top1 = 93.79%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.31 ms.
cifar100       train : [loss = 0.043, top1 = 99.57%], valid : [loss = 1.346, top1 = 70.72%], test : [loss = 1.295, top1 = 71.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.96 ms.
ImageNet16-120 train : [loss = 1.441, top1 = 60.72%], valid : [loss = 2.250, top1 = 44.63%], test : [loss = 2.251, top1 = 44.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.83%], valid : [loss = 0.492, top1 = 83.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11233/15625) 011233-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.531, top1 = 88.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.333, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.359, top1 = 90.21%], valid : [loss = 1.296, top1 = 67.58%], test : [loss = 1.306, top1 = 67.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.71%], valid : [loss = 2.401, top1 = 38.77%], test : [loss = 2.403, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11234/15625) 011234-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.507, top1 = 88.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.355, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.73 ms.
cifar100       train : [loss = 0.337, top1 = 90.72%], valid : [loss = 1.315, top1 = 66.70%], test : [loss = 1.302, top1 = 66.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.70%], valid : [loss = 2.447, top1 = 38.27%], test : [loss = 2.444, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.738, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11235/15625) 011235-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.502, top1 = 89.62%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.308, top1 = 93.45%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=23.59 ms.
cifar100       train : [loss = 0.084, top1 = 98.43%], valid : [loss = 1.274, top1 = 70.50%], test : [loss = 1.344, top1 = 70.20%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.71 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.43%], valid : [loss = 2.130, top1 = 46.07%], test : [loss = 2.195, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.14%], valid : [loss = 0.797, top1 = 71.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11236/15625) 011236-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.546, top1 = 88.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.82 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.345, top1 = 92.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.24 ms.
cifar100       train : [loss = 0.247, top1 = 93.40%], valid : [loss = 1.323, top1 = 67.23%], test : [loss = 1.331, top1 = 67.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.198, top1 = 42.96%], valid : [loss = 2.415, top1 = 37.98%], test : [loss = 2.421, top1 = 38.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11237/15625) 011237-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.544, top1 = 89.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.350, top1 = 92.94%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.98 ms.
cifar100       train : [loss = 0.052, top1 = 99.39%], valid : [loss = 1.410, top1 = 69.76%], test : [loss = 1.449, top1 = 68.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 1.776, top1 = 52.82%], valid : [loss = 2.428, top1 = 40.57%], test : [loss = 2.412, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.64%], valid : [loss = 0.729, top1 = 74.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11238/15625) 011238-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.481, top1 = 89.12%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=14.69 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.298, top1 = 92.61%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=13.30 ms.
cifar100       train : [loss = 0.316, top1 = 91.56%], valid : [loss = 1.255, top1 = 67.43%], test : [loss = 1.269, top1 = 67.85%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.67%], valid : [loss = 2.312, top1 = 40.43%], test : [loss = 2.359, top1 = 40.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11239/15625) 011239-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.436, top1 = 90.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.290, top1 = 93.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.58 ms.
cifar100       train : [loss = 0.107, top1 = 98.06%], valid : [loss = 1.323, top1 = 69.16%], test : [loss = 1.273, top1 = 70.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 1.643, top1 = 55.97%], valid : [loss = 2.216, top1 = 43.87%], test : [loss = 2.260, top1 = 44.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.18%], valid : [loss = 0.531, top1 = 82.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11240/15625) 011240-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.529, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.325, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.329, top1 = 91.00%], valid : [loss = 1.258, top1 = 68.06%], test : [loss = 1.279, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.099, top1 = 45.23%], valid : [loss = 2.383, top1 = 39.67%], test : [loss = 2.414, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.07%], valid : [loss = 0.643, top1 = 77.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11241/15625) 011241-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.99%], valid : [loss = 0.478, top1 = 84.51%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.301, top1 = 89.86%], test  : [loss = 0.401, top1 = 86.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 1.327, top1 = 63.22%], valid : [loss = 1.520, top1 = 58.12%], test : [loss = 1.497, top1 = 59.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 2.937, top1 = 28.25%], valid : [loss = 2.907, top1 = 28.93%], test : [loss = 2.959, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11242/15625) 011242-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.593, top1 = 87.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.393, top1 = 90.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.41 ms.
cifar100       train : [loss = 0.393, top1 = 88.86%], valid : [loss = 1.374, top1 = 66.12%], test : [loss = 1.384, top1 = 66.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.87%], valid : [loss = 2.514, top1 = 36.77%], test : [loss = 2.534, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11243/15625) 011243-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.185, top1 = 93.91%], valid : [loss = 0.956, top1 = 75.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.220, top1 = 92.49%], test  : [loss = 0.584, top1 = 82.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.15 ms.
cifar100       train : [loss = 1.177, top1 = 66.44%], valid : [loss = 1.751, top1 = 54.14%], test : [loss = 1.745, top1 = 54.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 3.256, top1 = 22.22%], valid : [loss = 3.358, top1 = 21.30%], test : [loss = 3.380, top1 = 20.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11244/15625) 011244-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.526, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.34 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.347, top1 = 92.05%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.11 ms.
cifar100       train : [loss = 0.122, top1 = 97.03%], valid : [loss = 1.432, top1 = 68.88%], test : [loss = 1.446, top1 = 68.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.08%], valid : [loss = 2.479, top1 = 37.67%], test : [loss = 2.481, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.28%], valid : [loss = 0.873, top1 = 69.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11245/15625) 011245-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.32%], valid : [loss = 0.555, top1 = 87.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.032, top1 = 99.01%], test  : [loss = 0.372, top1 = 90.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.33 ms.
cifar100       train : [loss = 0.538, top1 = 84.50%], valid : [loss = 1.352, top1 = 64.50%], test : [loss = 1.337, top1 = 65.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.36%], valid : [loss = 2.603, top1 = 34.10%], test : [loss = 2.673, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11246/15625) 011246-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.530, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.334, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.239, top1 = 93.63%], valid : [loss = 1.301, top1 = 67.60%], test : [loss = 1.339, top1 = 67.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.19 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.70%], valid : [loss = 2.442, top1 = 38.77%], test : [loss = 2.439, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.870, top1 = 68.74%], valid : [loss = 0.906, top1 = 67.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11247/15625) 011247-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.47 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.97%], valid : [loss = 0.595, top1 = 86.47%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.71 ms.
cifar10        train : [loss = 0.023, top1 = 99.37%], test  : [loss = 0.412, top1 = 90.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.10 ms.
cifar100       train : [loss = 0.412, top1 = 88.25%], valid : [loss = 1.448, top1 = 63.56%], test : [loss = 1.446, top1 = 63.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 2.975, top1 = 26.03%], valid : [loss = 3.053, top1 = 24.17%], test : [loss = 3.052, top1 = 25.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.137, top1 = 58.64%], valid : [loss = 1.141, top1 = 58.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11248/15625) 011248-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.17%], valid : [loss = 0.452, top1 = 87.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.115, top1 = 96.48%], test  : [loss = 0.337, top1 = 89.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.84 ms.
cifar100       train : [loss = 0.868, top1 = 75.37%], valid : [loss = 1.305, top1 = 63.91%], test : [loss = 1.286, top1 = 64.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.53%], valid : [loss = 2.627, top1 = 33.74%], test : [loss = 2.650, top1 = 33.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11249/15625) 011249-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.16%], valid : [loss = 0.578, top1 = 81.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10        train : [loss = 0.257, top1 = 91.20%], test  : [loss = 0.396, top1 = 86.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.49 ms.
cifar100       train : [loss = 1.503, top1 = 57.98%], valid : [loss = 1.755, top1 = 52.83%], test : [loss = 1.748, top1 = 52.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.60%], valid : [loss = 2.960, top1 = 27.24%], test : [loss = 3.017, top1 = 26.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11250/15625) 011250-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.486, top1 = 90.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.346, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.22 ms.
cifar100       train : [loss = 0.131, top1 = 97.23%], valid : [loss = 1.287, top1 = 69.76%], test : [loss = 1.319, top1 = 69.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.04 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.67%], valid : [loss = 2.145, top1 = 44.97%], test : [loss = 2.157, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.14%], valid : [loss = 0.663, top1 = 77.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11251/15625) 011251-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.547, top1 = 88.47%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.32 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.356, top1 = 91.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.86 ms.
cifar100       train : [loss = 0.251, top1 = 93.18%], valid : [loss = 1.324, top1 = 67.32%], test : [loss = 1.325, top1 = 68.20%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.30%], valid : [loss = 2.419, top1 = 38.13%], test : [loss = 2.438, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.938, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11252/15625) 011252-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.072, top1 = 97.95%], valid : [loss = 0.838, top1 = 80.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.137, top1 = 95.35%], test  : [loss = 0.564, top1 = 84.48%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.02 ms.
cifar100       train : [loss = 0.857, top1 = 75.07%], valid : [loss = 1.702, top1 = 57.12%], test : [loss = 1.695, top1 = 57.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 3.031, top1 = 26.47%], valid : [loss = 3.164, top1 = 24.23%], test : [loss = 3.196, top1 = 23.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.46%], valid : [loss = 1.117, top1 = 60.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11253/15625) 011253-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.432, top1 = 90.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.40 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.307, top1 = 92.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.25 ms.
cifar100       train : [loss = 0.169, top1 = 96.19%], valid : [loss = 1.333, top1 = 69.14%], test : [loss = 1.308, top1 = 68.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.785, top1 = 52.44%], valid : [loss = 2.245, top1 = 42.77%], test : [loss = 2.284, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.94%], valid : [loss = 0.520, top1 = 82.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11254/15625) 011254-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.515, top1 = 89.69%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.59 ms.
cifar10        train : [loss = 0.004, top1 = 99.90%], test  : [loss = 0.340, top1 = 92.80%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.99 ms.
cifar100       train : [loss = 0.076, top1 = 98.75%], valid : [loss = 1.379, top1 = 68.96%], test : [loss = 1.353, top1 = 69.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.69%], valid : [loss = 2.327, top1 = 40.70%], test : [loss = 2.319, top1 = 41.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.28%], valid : [loss = 0.863, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11255/15625) 011255-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.349, top1 = 87.91%], valid : [loss = 0.667, top1 = 78.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10        train : [loss = 0.276, top1 = 90.53%], test  : [loss = 0.465, top1 = 84.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.03 ms.
cifar100       train : [loss = 1.397, top1 = 61.15%], valid : [loss = 1.738, top1 = 53.28%], test : [loss = 1.740, top1 = 53.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 3.055, top1 = 25.93%], valid : [loss = 3.090, top1 = 25.77%], test : [loss = 3.102, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.071, top1 = 61.12%], valid : [loss = 1.122, top1 = 59.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11256/15625) 011256-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.34%], valid : [loss = 0.600, top1 = 85.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.070, top1 = 97.82%], test  : [loss = 0.417, top1 = 88.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.81 ms.
cifar100       train : [loss = 0.721, top1 = 79.07%], valid : [loss = 1.343, top1 = 63.66%], test : [loss = 1.341, top1 = 63.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.52%], valid : [loss = 2.678, top1 = 32.60%], test : [loss = 2.708, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.37%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11257/15625) 011257-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.485, top1 = 89.05%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.304, top1 = 92.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.73 ms.
cifar100       train : [loss = 0.249, top1 = 93.78%], valid : [loss = 1.243, top1 = 68.82%], test : [loss = 1.243, top1 = 68.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.55%], valid : [loss = 2.236, top1 = 42.00%], test : [loss = 2.282, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.25%], valid : [loss = 0.691, top1 = 75.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11258/15625) 011258-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.548, top1 = 88.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.92 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.346, top1 = 92.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.67 ms.
cifar100       train : [loss = 0.303, top1 = 91.74%], valid : [loss = 1.314, top1 = 66.96%], test : [loss = 1.323, top1 = 67.30%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.67%], valid : [loss = 2.446, top1 = 38.33%], test : [loss = 2.434, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 68.98%], valid : [loss = 0.892, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11259/15625) 011259-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.453 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.423, top1 = 90.40%]
cifar10        FLOP= 62.83 M, Params=0.453 MB, latency=19.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.277, top1 = 93.24%]
cifar100       FLOP= 62.84 M, Params=0.459 MB, latency=17.67 ms.
cifar100       train : [loss = 0.153, top1 = 96.64%], valid : [loss = 1.277, top1 = 69.65%], test : [loss = 1.289, top1 = 69.55%]
ImageNet16-120 FLOP= 15.72 M, Params=0.461 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.746, top1 = 53.48%], valid : [loss = 2.245, top1 = 42.64%], test : [loss = 2.266, top1 = 42.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.390, top1 = 86.46%], valid : [loss = 0.513, top1 = 82.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11260/15625) 011260-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.64%], valid : [loss = 0.651, top1 = 84.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10        train : [loss = 0.090, top1 = 97.08%], test  : [loss = 0.379, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.11 ms.
cifar100       train : [loss = 0.797, top1 = 76.76%], valid : [loss = 1.424, top1 = 61.62%], test : [loss = 1.415, top1 = 61.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.12%], valid : [loss = 2.728, top1 = 32.77%], test : [loss = 2.735, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.56%], valid : [loss = 0.842, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11261/15625) 011261-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.24%], valid : [loss = 0.471, top1 = 84.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.29 ms.
cifar10        train : [loss = 0.302, top1 = 89.84%], test  : [loss = 0.400, top1 = 86.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.15 ms.
cifar100       train : [loss = 1.336, top1 = 62.81%], valid : [loss = 1.542, top1 = 57.30%], test : [loss = 1.525, top1 = 57.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.79%], valid : [loss = 2.908, top1 = 29.10%], test : [loss = 2.939, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11262/15625) 011262-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.498, top1 = 88.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.336, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.68 ms.
cifar100       train : [loss = 0.349, top1 = 90.49%], valid : [loss = 1.266, top1 = 67.48%], test : [loss = 1.271, top1 = 66.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.14%], valid : [loss = 2.413, top1 = 38.20%], test : [loss = 2.402, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11263/15625) 011263-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.16%], valid : [loss = 0.539, top1 = 87.13%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.85 ms.
cifar10        train : [loss = 0.061, top1 = 98.00%], test  : [loss = 0.342, top1 = 90.49%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.83 ms.
cifar100       train : [loss = 0.733, top1 = 78.34%], valid : [loss = 1.382, top1 = 62.46%], test : [loss = 1.402, top1 = 62.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.380, top1 = 39.05%], valid : [loss = 2.542, top1 = 36.13%], test : [loss = 2.551, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.89%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11264/15625) 011264-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.31%], valid : [loss = 0.520, top1 = 86.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10        train : [loss = 0.085, top1 = 97.26%], test  : [loss = 0.360, top1 = 90.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.66 ms.
cifar100       train : [loss = 0.622, top1 = 82.17%], valid : [loss = 1.206, top1 = 66.90%], test : [loss = 1.202, top1 = 66.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.93%], valid : [loss = 2.414, top1 = 38.40%], test : [loss = 2.444, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.23%], valid : [loss = 0.885, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11265/15625) 011265-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.24%], valid : [loss = 0.455, top1 = 87.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.111, top1 = 96.53%], test  : [loss = 0.318, top1 = 90.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.862, top1 = 75.47%], valid : [loss = 1.290, top1 = 64.21%], test : [loss = 1.287, top1 = 63.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.67%], valid : [loss = 2.614, top1 = 34.97%], test : [loss = 2.655, top1 = 33.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11266/15625) 011266-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.13%], valid : [loss = 0.529, top1 = 84.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.24 ms.
cifar10        train : [loss = 0.184, top1 = 93.83%], test  : [loss = 0.383, top1 = 88.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.90 ms.
cifar100       train : [loss = 1.189, top1 = 66.19%], valid : [loss = 1.506, top1 = 58.78%], test : [loss = 1.493, top1 = 59.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.70%], valid : [loss = 2.705, top1 = 32.61%], test : [loss = 2.736, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11267/15625) 011267-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.455, top1 = 89.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.12 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.301, top1 = 92.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.08 ms.
cifar100       train : [loss = 0.318, top1 = 91.51%], valid : [loss = 1.289, top1 = 67.30%], test : [loss = 1.310, top1 = 67.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.48%], valid : [loss = 2.373, top1 = 40.50%], test : [loss = 2.422, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.460, top1 = 84.15%], valid : [loss = 0.567, top1 = 80.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11268/15625) 011268-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.462, top1 = 89.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.13 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.303, top1 = 92.31%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.81 ms.
cifar100       train : [loss = 0.286, top1 = 92.26%], valid : [loss = 1.339, top1 = 67.30%], test : [loss = 1.345, top1 = 67.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.58%], valid : [loss = 2.353, top1 = 41.10%], test : [loss = 2.373, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.35%], valid : [loss = 0.599, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11269/15625) 011269-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.06%], valid : [loss = 0.651, top1 = 78.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10        train : [loss = 0.529, top1 = 81.63%], test  : [loss = 0.607, top1 = 79.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.09 ms.
cifar100       train : [loss = 1.699, top1 = 54.07%], valid : [loss = 1.870, top1 = 50.84%], test : [loss = 1.868, top1 = 50.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.52 ms.
ImageNet16-120 train : [loss = 3.322, top1 = 21.35%], valid : [loss = 3.305, top1 = 21.40%], test : [loss = 3.349, top1 = 20.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11270/15625) 011270-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.438, top1 = 90.79%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=14.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.292, top1 = 93.64%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.12 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.367, top1 = 69.88%], test : [loss = 1.348, top1 = 70.24%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 1.547, top1 = 58.09%], valid : [loss = 2.224, top1 = 44.93%], test : [loss = 2.286, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.98%], valid : [loss = 0.497, top1 = 83.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11271/15625) 011271-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.94%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.86 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.284, top1 = 93.72%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.67 ms.
cifar100       train : [loss = 0.044, top1 = 99.44%], valid : [loss = 1.387, top1 = 70.36%], test : [loss = 1.353, top1 = 70.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 1.471, top1 = 60.05%], valid : [loss = 2.211, top1 = 44.50%], test : [loss = 2.224, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.419, top1 = 85.47%], valid : [loss = 0.539, top1 = 81.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11272/15625) 011272-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.526, top1 = 88.38%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.08 ms.
cifar10        train : [loss = 0.019, top1 = 99.55%], test  : [loss = 0.353, top1 = 91.37%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.79 ms.
cifar100       train : [loss = 0.312, top1 = 91.34%], valid : [loss = 1.288, top1 = 67.92%], test : [loss = 1.292, top1 = 68.26%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.11 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.52%], valid : [loss = 2.303, top1 = 41.53%], test : [loss = 2.347, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.48%], valid : [loss = 0.591, top1 = 79.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11273/15625) 011273-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.61%], valid : [loss = 0.576, top1 = 81.53%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.272, top1 = 90.66%], test  : [loss = 0.426, top1 = 86.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 1.506, top1 = 57.86%], valid : [loss = 1.740, top1 = 52.97%], test : [loss = 1.738, top1 = 52.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.12%], valid : [loss = 2.950, top1 = 27.82%], test : [loss = 2.981, top1 = 26.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.02%], valid : [loss = 1.073, top1 = 61.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11274/15625) 011274-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.557, top1 = 88.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.423, top1 = 90.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.12 ms.
cifar100       train : [loss = 0.143, top1 = 96.91%], valid : [loss = 1.480, top1 = 66.70%], test : [loss = 1.480, top1 = 66.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.25%], valid : [loss = 2.463, top1 = 38.63%], test : [loss = 2.466, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.12%], valid : [loss = 0.775, top1 = 73.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11275/15625) 011275-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.60%], valid : [loss = 0.510, top1 = 87.63%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.049, top1 = 98.55%], test  : [loss = 0.362, top1 = 90.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.85 ms.
cifar100       train : [loss = 0.548, top1 = 84.19%], valid : [loss = 1.298, top1 = 66.16%], test : [loss = 1.276, top1 = 66.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.90%], valid : [loss = 2.437, top1 = 38.90%], test : [loss = 2.479, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.52%], valid : [loss = 0.625, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11276/15625) 011276-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.43%], valid : [loss = 0.916, top1 = 78.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.131, top1 = 95.67%], test  : [loss = 0.549, top1 = 84.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.67 ms.
cifar100       train : [loss = 0.850, top1 = 75.23%], valid : [loss = 1.661, top1 = 57.26%], test : [loss = 1.668, top1 = 57.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 26.38%], valid : [loss = 3.166, top1 = 24.87%], test : [loss = 3.200, top1 = 22.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11277/15625) 011277-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.08%], valid : [loss = 0.621, top1 = 84.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10        train : [loss = 0.093, top1 = 96.93%], test  : [loss = 0.424, top1 = 88.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=15.58 ms.
cifar100       train : [loss = 0.737, top1 = 78.41%], valid : [loss = 1.576, top1 = 59.08%], test : [loss = 1.557, top1 = 59.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 3.197, top1 = 22.12%], valid : [loss = 3.199, top1 = 22.00%], test : [loss = 3.234, top1 = 21.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11278/15625) 011278-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.74%], valid : [loss = 0.532, top1 = 85.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.096, top1 = 96.94%], test  : [loss = 0.365, top1 = 89.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.79 ms.
cifar100       train : [loss = 0.793, top1 = 76.77%], valid : [loss = 1.380, top1 = 63.16%], test : [loss = 1.374, top1 = 63.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.468, top1 = 37.15%], valid : [loss = 2.579, top1 = 35.17%], test : [loss = 2.608, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.72%], valid : [loss = 0.936, top1 = 67.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11279/15625) 011279-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.495, top1 = 89.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.91 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.345, top1 = 92.66%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.21 ms.
cifar100       train : [loss = 0.156, top1 = 96.76%], valid : [loss = 1.318, top1 = 68.72%], test : [loss = 1.296, top1 = 68.88%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.25%], valid : [loss = 2.327, top1 = 40.33%], test : [loss = 2.306, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.38%], valid : [loss = 0.684, top1 = 76.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11280/15625) 011280-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.71%], valid : [loss = 0.653, top1 = 78.06%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 0.503, top1 = 82.61%], test  : [loss = 0.585, top1 = 80.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.09 ms.
cifar100       train : [loss = 1.676, top1 = 54.47%], valid : [loss = 1.850, top1 = 50.87%], test : [loss = 1.858, top1 = 51.01%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.95 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.27%], valid : [loss = 3.314, top1 = 21.47%], test : [loss = 3.361, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11281/15625) 011281-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.15%], valid : [loss = 0.586, top1 = 86.57%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.50 ms.
cifar10        train : [loss = 0.068, top1 = 97.79%], test  : [loss = 0.382, top1 = 89.67%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.16 ms.
cifar100       train : [loss = 0.641, top1 = 81.01%], valid : [loss = 1.296, top1 = 65.00%], test : [loss = 1.331, top1 = 65.02%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.362, top1 = 39.50%], valid : [loss = 2.525, top1 = 35.40%], test : [loss = 2.511, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.65%], valid : [loss = 0.854, top1 = 70.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11282/15625) 011282-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.521, top1 = 88.49%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.335, top1 = 91.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.21 ms.
cifar100       train : [loss = 0.349, top1 = 90.47%], valid : [loss = 1.286, top1 = 67.21%], test : [loss = 1.297, top1 = 66.91%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.79%], valid : [loss = 2.393, top1 = 39.09%], test : [loss = 2.421, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11283/15625) 011283-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.597, top1 = 87.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.394, top1 = 91.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.231, top1 = 94.27%], valid : [loss = 1.466, top1 = 65.87%], test : [loss = 1.445, top1 = 65.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.076, top1 = 45.86%], valid : [loss = 2.466, top1 = 38.24%], test : [loss = 2.502, top1 = 38.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.18%], valid : [loss = 0.716, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11284/15625) 011284-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.66%], valid : [loss = 0.671, top1 = 85.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10        train : [loss = 0.033, top1 = 99.05%], test  : [loss = 0.413, top1 = 90.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.34 ms.
cifar100       train : [loss = 0.515, top1 = 85.06%], valid : [loss = 1.369, top1 = 63.96%], test : [loss = 1.391, top1 = 64.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.431, top1 = 38.15%], valid : [loss = 2.576, top1 = 35.27%], test : [loss = 2.630, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.26%], valid : [loss = 0.889, top1 = 68.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11285/15625) 011285-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.04%], valid : [loss = 0.842, top1 = 75.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.44 ms.
cifar10        train : [loss = 0.304, top1 = 89.46%], test  : [loss = 0.601, top1 = 81.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.20 ms.
cifar100       train : [loss = 1.306, top1 = 63.29%], valid : [loss = 1.886, top1 = 51.06%], test : [loss = 1.919, top1 = 50.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 3.494, top1 = 17.36%], valid : [loss = 3.536, top1 = 16.80%], test : [loss = 3.513, top1 = 17.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.228, top1 = 55.30%], valid : [loss = 1.275, top1 = 53.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11286/15625) 011286-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.556, top1 = 88.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.386, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.68 ms.
cifar100       train : [loss = 0.122, top1 = 97.51%], valid : [loss = 1.488, top1 = 67.10%], test : [loss = 1.505, top1 = 66.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 1.937, top1 = 48.92%], valid : [loss = 2.425, top1 = 39.37%], test : [loss = 2.470, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.02%], valid : [loss = 0.777, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11287/15625) 011287-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.581, top1 = 88.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.381, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.76 ms.
cifar100       train : [loss = 0.092, top1 = 98.46%], valid : [loss = 1.446, top1 = 67.54%], test : [loss = 1.484, top1 = 67.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.15 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.34%], valid : [loss = 2.399, top1 = 41.13%], test : [loss = 2.381, top1 = 41.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.21%], valid : [loss = 0.686, top1 = 76.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11288/15625) 011288-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.546, top1 = 89.15%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=22.17 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.310, top1 = 93.49%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.32 ms.
cifar100       train : [loss = 0.078, top1 = 98.76%], valid : [loss = 1.333, top1 = 69.50%], test : [loss = 1.369, top1 = 69.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.17%], valid : [loss = 2.358, top1 = 40.77%], test : [loss = 2.327, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.29%], valid : [loss = 0.734, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11289/15625) 011289-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.53%], valid : [loss = 0.543, top1 = 87.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.68 ms.
cifar10        train : [loss = 0.030, top1 = 99.19%], test  : [loss = 0.389, top1 = 90.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.38 ms.
cifar100       train : [loss = 0.473, top1 = 86.58%], valid : [loss = 1.307, top1 = 65.66%], test : [loss = 1.315, top1 = 66.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.25%], valid : [loss = 2.618, top1 = 33.50%], test : [loss = 2.662, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 67.42%], valid : [loss = 0.959, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11290/15625) 011290-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.422, top1 = 90.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.292, top1 = 93.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.02 ms.
cifar100       train : [loss = 0.120, top1 = 97.62%], valid : [loss = 1.339, top1 = 69.48%], test : [loss = 1.306, top1 = 69.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 1.695, top1 = 54.68%], valid : [loss = 2.235, top1 = 43.23%], test : [loss = 2.250, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.62%], valid : [loss = 0.590, top1 = 80.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11291/15625) 011291-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.457, top1 = 89.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.312, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 0.316, top1 = 91.56%], valid : [loss = 1.308, top1 = 67.15%], test : [loss = 1.299, top1 = 67.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.92 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.26%], valid : [loss = 2.377, top1 = 39.07%], test : [loss = 2.411, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.86%], valid : [loss = 0.540, top1 = 81.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11292/15625) 011292-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.83%], valid : [loss = 0.485, top1 = 83.91%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10        train : [loss = 0.298, top1 = 90.10%], test  : [loss = 0.397, top1 = 86.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.55 ms.
cifar100       train : [loss = 1.323, top1 = 63.31%], valid : [loss = 1.520, top1 = 58.10%], test : [loss = 1.505, top1 = 58.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.64%], valid : [loss = 2.911, top1 = 30.33%], test : [loss = 2.962, top1 = 28.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11293/15625) 011293-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.666, top1 = 85.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10        train : [loss = 0.032, top1 = 99.13%], test  : [loss = 0.432, top1 = 89.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 0.378, top1 = 89.49%], valid : [loss = 1.435, top1 = 64.44%], test : [loss = 1.428, top1 = 64.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.64%], valid : [loss = 2.643, top1 = 34.80%], test : [loss = 2.626, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 77.10%], valid : [loss = 0.728, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11294/15625) 011294-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.526, top1 = 89.50%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.93 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.328, top1 = 93.38%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.84 ms.
cifar100       train : [loss = 0.063, top1 = 99.01%], valid : [loss = 1.382, top1 = 69.52%], test : [loss = 1.379, top1 = 69.76%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.76 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.87%], valid : [loss = 2.301, top1 = 41.43%], test : [loss = 2.294, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.85%], valid : [loss = 0.792, top1 = 72.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11295/15625) 011295-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.615, top1 = 86.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.78 ms.
cifar10        train : [loss = 0.027, top1 = 99.36%], test  : [loss = 0.417, top1 = 89.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.399, top1 = 89.40%], valid : [loss = 1.486, top1 = 63.36%], test : [loss = 1.478, top1 = 63.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.00%], valid : [loss = 2.605, top1 = 36.23%], test : [loss = 2.630, top1 = 34.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.92%], valid : [loss = 0.761, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11296/15625) 011296-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.512, top1 = 89.96%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.20 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.339, top1 = 93.20%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.55 ms.
cifar100       train : [loss = 0.021, top1 = 99.86%], valid : [loss = 1.386, top1 = 71.18%], test : [loss = 1.407, top1 = 70.56%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 1.419, top1 = 61.41%], valid : [loss = 2.412, top1 = 42.00%], test : [loss = 2.395, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.04%], valid : [loss = 0.626, top1 = 78.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11297/15625) 011297-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.522, top1 = 88.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.363, top1 = 91.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.25 ms.
cifar100       train : [loss = 0.392, top1 = 88.78%], valid : [loss = 1.341, top1 = 66.35%], test : [loss = 1.345, top1 = 66.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.208, top1 = 42.89%], valid : [loss = 2.431, top1 = 38.58%], test : [loss = 2.461, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.40%], valid : [loss = 0.609, top1 = 79.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11298/15625) 011298-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.429, top1 = 91.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.50 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.278, top1 = 93.74%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.80 ms.
cifar100       train : [loss = 0.040, top1 = 99.58%], valid : [loss = 1.344, top1 = 71.62%], test : [loss = 1.331, top1 = 71.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.60 ms.
ImageNet16-120 train : [loss = 1.380, top1 = 62.24%], valid : [loss = 2.232, top1 = 44.30%], test : [loss = 2.224, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.335, top1 = 88.79%], valid : [loss = 0.491, top1 = 83.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11299/15625) 011299-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.423, top1 = 90.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.279, top1 = 93.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.82 ms.
cifar100       train : [loss = 0.072, top1 = 98.96%], valid : [loss = 1.332, top1 = 69.94%], test : [loss = 1.313, top1 = 70.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 1.538, top1 = 58.44%], valid : [loss = 2.247, top1 = 43.13%], test : [loss = 2.261, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.358, top1 = 87.76%], valid : [loss = 0.491, top1 = 83.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11300/15625) 011300-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.410, top1 = 90.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.270, top1 = 93.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.77 ms.
cifar100       train : [loss = 0.190, top1 = 95.43%], valid : [loss = 1.324, top1 = 68.64%], test : [loss = 1.275, top1 = 70.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.65%], valid : [loss = 2.258, top1 = 42.90%], test : [loss = 2.287, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 86.93%], valid : [loss = 0.501, top1 = 83.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11301/15625) 011301-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.74%], valid : [loss = 0.447, top1 = 88.02%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.83 ms.
cifar10        train : [loss = 0.045, top1 = 99.07%], test  : [loss = 0.325, top1 = 90.41%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.13 ms.
cifar100       train : [loss = 0.441, top1 = 88.72%], valid : [loss = 1.198, top1 = 67.42%], test : [loss = 1.205, top1 = 68.22%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.34%], valid : [loss = 2.394, top1 = 39.60%], test : [loss = 2.420, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.00%], valid : [loss = 0.647, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11302/15625) 011302-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.99%], valid : [loss = 0.957, top1 = 66.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 0.765, top1 = 73.01%], test  : [loss = 0.812, top1 = 71.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.25 ms.
cifar100       train : [loss = 2.359, top1 = 37.93%], valid : [loss = 2.500, top1 = 36.28%], test : [loss = 2.479, top1 = 35.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 3.596, top1 = 16.36%], valid : [loss = 3.587, top1 = 17.30%], test : [loss = 3.605, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.448, top1 = 47.13%], valid : [loss = 1.511, top1 = 44.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11303/15625) 011303-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.295, top1 = 92.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 0.195, top1 = 95.29%], valid : [loss = 1.308, top1 = 68.74%], test : [loss = 1.317, top1 = 68.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.26%], valid : [loss = 2.282, top1 = 41.83%], test : [loss = 2.341, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.15%], valid : [loss = 0.552, top1 = 81.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11304/15625) 011304-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.85%], valid : [loss = 0.686, top1 = 83.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.075, top1 = 97.57%], test  : [loss = 0.421, top1 = 88.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.53 ms.
cifar100       train : [loss = 0.769, top1 = 77.39%], valid : [loss = 1.390, top1 = 62.98%], test : [loss = 1.425, top1 = 62.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.563, top1 = 35.33%], valid : [loss = 2.687, top1 = 32.97%], test : [loss = 2.740, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.49%], valid : [loss = 0.918, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11305/15625) 011305-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.54 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.49 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11306/15625) 011306-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.09 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.76 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11307/15625) 011307-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.430, top1 = 90.98%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.281, top1 = 93.84%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.10 ms.
cifar100       train : [loss = 0.040, top1 = 99.58%], valid : [loss = 1.304, top1 = 71.36%], test : [loss = 1.276, top1 = 71.88%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.370, top1 = 62.50%], valid : [loss = 2.181, top1 = 45.17%], test : [loss = 2.189, top1 = 45.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.348, top1 = 88.04%], valid : [loss = 0.487, top1 = 83.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11308/15625) 011308-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.40%], valid : [loss = 0.477, top1 = 84.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.301, top1 = 89.90%], test  : [loss = 0.404, top1 = 86.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.06 ms.
cifar100       train : [loss = 1.319, top1 = 63.22%], valid : [loss = 1.519, top1 = 58.56%], test : [loss = 1.507, top1 = 57.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.61%], valid : [loss = 2.928, top1 = 28.67%], test : [loss = 2.967, top1 = 28.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11309/15625) 011309-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.447, top1 = 90.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.287, top1 = 92.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.191, top1 = 95.44%], valid : [loss = 1.319, top1 = 68.58%], test : [loss = 1.321, top1 = 68.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.35 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.21%], valid : [loss = 2.264, top1 = 42.53%], test : [loss = 2.309, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.05%], valid : [loss = 0.550, top1 = 81.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11310/15625) 011310-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.50 ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.67%], valid : [loss = 0.770, top1 = 73.36%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.26 ms.
cifar10        train : [loss = 0.606, top1 = 78.87%], test  : [loss = 0.670, top1 = 76.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 2.015, top1 = 45.67%], valid : [loss = 2.171, top1 = 42.57%], test : [loss = 2.173, top1 = 42.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.233, top1 = 22.30%], valid : [loss = 3.241, top1 = 22.48%], test : [loss = 3.262, top1 = 22.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.292, top1 = 53.43%], valid : [loss = 1.331, top1 = 52.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11311/15625) 011311-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.90 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.76%], valid : [loss = 0.559, top1 = 83.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.212, top1 = 92.78%], test  : [loss = 0.404, top1 = 87.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.48 ms.
cifar100       train : [loss = 1.281, top1 = 63.60%], valid : [loss = 1.585, top1 = 56.77%], test : [loss = 1.591, top1 = 56.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.702, top1 = 32.49%], valid : [loss = 2.721, top1 = 32.49%], test : [loss = 2.768, top1 = 31.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.88%], valid : [loss = 1.031, top1 = 63.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11312/15625) 011312-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.480, top1 = 89.35%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.312, top1 = 92.33%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.40 ms.
cifar100       train : [loss = 0.242, top1 = 93.98%], valid : [loss = 1.269, top1 = 67.93%], test : [loss = 1.262, top1 = 68.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.50%], valid : [loss = 2.263, top1 = 41.89%], test : [loss = 2.273, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.85%], valid : [loss = 0.584, top1 = 80.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11313/15625) 011313-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.53%], valid : [loss = 0.734, top1 = 74.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.54 ms.
cifar10        train : [loss = 0.575, top1 = 80.04%], test  : [loss = 0.632, top1 = 78.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.87 ms.
cifar100       train : [loss = 1.962, top1 = 47.10%], valid : [loss = 2.096, top1 = 44.71%], test : [loss = 2.083, top1 = 44.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.226, top1 = 22.49%], valid : [loss = 3.221, top1 = 23.06%], test : [loss = 3.243, top1 = 22.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11314/15625) 011314-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.227, top1 = 92.23%], valid : [loss = 0.552, top1 = 83.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10        train : [loss = 0.219, top1 = 92.53%], test  : [loss = 0.404, top1 = 87.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.06 ms.
cifar100       train : [loss = 1.300, top1 = 63.09%], valid : [loss = 1.580, top1 = 56.74%], test : [loss = 1.578, top1 = 56.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.717, top1 = 32.21%], valid : [loss = 2.756, top1 = 31.22%], test : [loss = 2.792, top1 = 31.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 66.79%], valid : [loss = 0.970, top1 = 65.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11315/15625) 011315-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.09%], valid : [loss = 0.498, top1 = 87.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10        train : [loss = 0.073, top1 = 97.79%], test  : [loss = 0.342, top1 = 90.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.95 ms.
cifar100       train : [loss = 0.705, top1 = 79.51%], valid : [loss = 1.286, top1 = 65.29%], test : [loss = 1.284, top1 = 65.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.424, top1 = 38.23%], valid : [loss = 2.539, top1 = 36.21%], test : [loss = 2.564, top1 = 35.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.81%], valid : [loss = 0.630, top1 = 78.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11316/15625) 011316-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.47%], valid : [loss = 0.544, top1 = 83.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.203, top1 = 93.06%], test  : [loss = 0.401, top1 = 87.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.78 ms.
cifar100       train : [loss = 1.264, top1 = 64.09%], valid : [loss = 1.554, top1 = 57.37%], test : [loss = 1.553, top1 = 57.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.707, top1 = 32.54%], valid : [loss = 2.730, top1 = 32.08%], test : [loss = 2.783, top1 = 31.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.48%], valid : [loss = 0.990, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11317/15625) 011317-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.66 ms.
cifar10-valid  train : [loss = 1.856, top1 = 32.56%], valid : [loss = 1.863, top1 = 32.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.29 ms.
cifar10        train : [loss = 1.294, top1 = 53.23%], test  : [loss = 1.303, top1 = 52.77%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.21 ms.
cifar100       train : [loss = 3.850, top1 = 10.96%], valid : [loss = 3.917, top1 = 9.95%], test : [loss = 3.913, top1 = 10.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.09 ms.
ImageNet16-120 train : [loss = 3.989, top1 = 10.48%], valid : [loss = 3.977, top1 = 10.67%], test : [loss = 3.994, top1 = 10.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.969, top1 = 27.06%], valid : [loss = 1.969, top1 = 27.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11318/15625) 011318-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.474, top1 = 89.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.81 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.294, top1 = 92.96%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.08 ms.
cifar100       train : [loss = 0.216, top1 = 94.68%], valid : [loss = 1.232, top1 = 69.51%], test : [loss = 1.252, top1 = 69.16%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.70%], valid : [loss = 2.190, top1 = 43.19%], test : [loss = 2.212, top1 = 43.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.29%], valid : [loss = 0.596, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11319/15625) 011319-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.526, top1 = 88.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.354, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.386, top1 = 88.97%], valid : [loss = 1.331, top1 = 66.45%], test : [loss = 1.352, top1 = 66.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.203, top1 = 43.01%], valid : [loss = 2.405, top1 = 39.16%], test : [loss = 2.450, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.56%], valid : [loss = 0.639, top1 = 78.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11320/15625) 011320-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.493, top1 = 88.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.020, top1 = 99.48%], test  : [loss = 0.331, top1 = 91.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.42 ms.
cifar100       train : [loss = 0.349, top1 = 90.28%], valid : [loss = 1.218, top1 = 68.35%], test : [loss = 1.237, top1 = 68.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.44%], valid : [loss = 2.295, top1 = 41.12%], test : [loss = 2.316, top1 = 41.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.02%], valid : [loss = 0.741, top1 = 74.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11321/15625) 011321-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.432, top1 = 90.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.287, top1 = 93.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.16 ms.
cifar100       train : [loss = 0.110, top1 = 98.07%], valid : [loss = 1.306, top1 = 69.61%], test : [loss = 1.310, top1 = 69.39%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.80%], valid : [loss = 2.225, top1 = 43.44%], test : [loss = 2.250, top1 = 43.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.398, top1 = 86.33%], valid : [loss = 0.513, top1 = 82.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11322/15625) 011322-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.237, top1 = 91.92%], valid : [loss = 0.569, top1 = 82.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10        train : [loss = 0.231, top1 = 92.10%], test  : [loss = 0.417, top1 = 86.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.40 ms.
cifar100       train : [loss = 1.214, top1 = 65.52%], valid : [loss = 1.573, top1 = 57.53%], test : [loss = 1.577, top1 = 57.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.954, top1 = 27.99%], valid : [loss = 2.984, top1 = 27.51%], test : [loss = 3.043, top1 = 26.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.32%], valid : [loss = 1.211, top1 = 56.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11323/15625) 011323-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.03 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.96%], valid : [loss = 0.470, top1 = 84.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.297, top1 = 90.10%], test  : [loss = 0.397, top1 = 86.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.78 ms.
cifar100       train : [loss = 1.332, top1 = 63.22%], valid : [loss = 1.547, top1 = 58.02%], test : [loss = 1.521, top1 = 58.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.61%], valid : [loss = 2.909, top1 = 29.51%], test : [loss = 2.956, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11324/15625) 011324-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.75%], valid : [loss = 0.644, top1 = 84.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.402, top1 = 88.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.76 ms.
cifar100       train : [loss = 0.781, top1 = 77.07%], valid : [loss = 1.420, top1 = 62.23%], test : [loss = 1.423, top1 = 62.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.26%], valid : [loss = 2.735, top1 = 31.64%], test : [loss = 2.755, top1 = 31.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11325/15625) 011325-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.05 ms.
cifar10-valid  train : [loss = 1.247, top1 = 55.28%], valid : [loss = 1.292, top1 = 53.87%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10        train : [loss = 1.207, top1 = 56.70%], test  : [loss = 1.213, top1 = 56.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.65 ms.
cifar100       train : [loss = 2.758, top1 = 31.11%], valid : [loss = 2.842, top1 = 30.14%], test : [loss = 2.821, top1 = 30.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.47 ms.
ImageNet16-120 train : [loss = 3.911, top1 = 11.77%], valid : [loss = 3.917, top1 = 12.11%], test : [loss = 3.935, top1 = 11.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.721, top1 = 35.14%], valid : [loss = 1.738, top1 = 33.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11326/15625) 011326-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.13%], valid : [loss = 0.761, top1 = 73.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10        train : [loss = 0.574, top1 = 80.09%], test  : [loss = 0.637, top1 = 77.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.28 ms.
cifar100       train : [loss = 1.958, top1 = 47.19%], valid : [loss = 2.101, top1 = 44.22%], test : [loss = 2.086, top1 = 44.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.35%], valid : [loss = 3.245, top1 = 22.71%], test : [loss = 3.269, top1 = 21.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.41%], valid : [loss = 1.316, top1 = 52.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11327/15625) 011327-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.286, top1 = 90.21%], valid : [loss = 0.568, top1 = 81.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.47 ms.
cifar10        train : [loss = 0.260, top1 = 91.06%], test  : [loss = 0.435, top1 = 85.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.44 ms.
cifar100       train : [loss = 1.457, top1 = 59.10%], valid : [loss = 1.726, top1 = 53.41%], test : [loss = 1.719, top1 = 53.13%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.938, top1 = 27.79%], valid : [loss = 2.958, top1 = 28.78%], test : [loss = 2.988, top1 = 27.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.19%], valid : [loss = 1.033, top1 = 63.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11328/15625) 011328-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.19%], valid : [loss = 0.601, top1 = 85.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.62 ms.
cifar10        train : [loss = 0.072, top1 = 97.77%], test  : [loss = 0.392, top1 = 89.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.65 ms.
cifar100       train : [loss = 0.715, top1 = 79.33%], valid : [loss = 1.389, top1 = 62.95%], test : [loss = 1.376, top1 = 63.63%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.73%], valid : [loss = 2.652, top1 = 34.01%], test : [loss = 2.685, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11329/15625) 011329-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.536, top1 = 88.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10        train : [loss = 0.029, top1 = 99.16%], test  : [loss = 0.342, top1 = 91.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.35 ms.
cifar100       train : [loss = 0.466, top1 = 86.41%], valid : [loss = 1.243, top1 = 67.09%], test : [loss = 1.253, top1 = 66.59%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.194, top1 = 43.20%], valid : [loss = 2.375, top1 = 39.93%], test : [loss = 2.384, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.97%], valid : [loss = 0.817, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11330/15625) 011330-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.79 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.90 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.19 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.42 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11331/15625) 011331-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.53%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.322, top1 = 93.17%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.90 ms.
cifar100       train : [loss = 0.063, top1 = 99.04%], valid : [loss = 1.352, top1 = 69.92%], test : [loss = 1.368, top1 = 69.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.37%], valid : [loss = 2.319, top1 = 41.64%], test : [loss = 2.303, top1 = 41.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.65%], valid : [loss = 0.742, top1 = 74.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11332/15625) 011332-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.482, top1 = 90.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.67 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.312, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.69 ms.
cifar100       train : [loss = 0.108, top1 = 98.03%], valid : [loss = 1.292, top1 = 69.58%], test : [loss = 1.284, top1 = 69.37%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 1.632, top1 = 56.17%], valid : [loss = 2.175, top1 = 44.50%], test : [loss = 2.190, top1 = 44.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.74%], valid : [loss = 0.571, top1 = 80.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11333/15625) 011333-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.229, top1 = 92.37%], valid : [loss = 0.491, top1 = 84.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.246, top1 = 91.63%], test  : [loss = 0.406, top1 = 86.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.09 ms.
cifar100       train : [loss = 1.253, top1 = 64.75%], valid : [loss = 1.531, top1 = 57.76%], test : [loss = 1.534, top1 = 57.03%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 3.375, top1 = 19.97%], valid : [loss = 3.366, top1 = 19.60%], test : [loss = 3.390, top1 = 19.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11334/15625) 011334-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.43%], valid : [loss = 0.530, top1 = 84.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.44 ms.
cifar10        train : [loss = 0.181, top1 = 93.92%], test  : [loss = 0.380, top1 = 87.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.36 ms.
cifar100       train : [loss = 1.178, top1 = 66.45%], valid : [loss = 1.499, top1 = 59.19%], test : [loss = 1.489, top1 = 59.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.79%], valid : [loss = 2.686, top1 = 32.86%], test : [loss = 2.716, top1 = 32.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.42%], valid : [loss = 0.958, top1 = 66.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11335/15625) 011335-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.07%], valid : [loss = 0.585, top1 = 86.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10        train : [loss = 0.065, top1 = 97.92%], test  : [loss = 0.386, top1 = 89.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.93 ms.
cifar100       train : [loss = 0.661, top1 = 80.51%], valid : [loss = 1.338, top1 = 64.50%], test : [loss = 1.307, top1 = 64.93%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.92%], valid : [loss = 2.480, top1 = 37.10%], test : [loss = 2.496, top1 = 36.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11336/15625) 011336-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.460, top1 = 89.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.311, top1 = 91.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.16 ms.
cifar100       train : [loss = 0.328, top1 = 91.12%], valid : [loss = 1.301, top1 = 67.31%], test : [loss = 1.298, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.34%], valid : [loss = 2.357, top1 = 40.67%], test : [loss = 2.394, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.00%], valid : [loss = 0.556, top1 = 81.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11337/15625) 011337-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.25 ms.
cifar10-valid  train : [loss = 0.268, top1 = 90.85%], valid : [loss = 0.547, top1 = 82.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.95 ms.
cifar10        train : [loss = 0.258, top1 = 91.24%], test  : [loss = 0.411, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.13 ms.
cifar100       train : [loss = 1.356, top1 = 61.83%], valid : [loss = 1.612, top1 = 56.01%], test : [loss = 1.602, top1 = 56.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.906, top1 = 28.67%], valid : [loss = 2.901, top1 = 28.86%], test : [loss = 2.937, top1 = 28.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 63.74%], valid : [loss = 1.048, top1 = 63.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11338/15625) 011338-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.35%], valid : [loss = 0.520, top1 = 87.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.90 ms.
cifar10        train : [loss = 0.057, top1 = 98.23%], test  : [loss = 0.363, top1 = 90.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.19 ms.
cifar100       train : [loss = 0.633, top1 = 81.42%], valid : [loss = 1.317, top1 = 65.12%], test : [loss = 1.307, top1 = 65.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.370, top1 = 39.37%], valid : [loss = 2.503, top1 = 36.19%], test : [loss = 2.553, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.29%], valid : [loss = 0.625, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11339/15625) 011339-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.71%], valid : [loss = 0.764, top1 = 83.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.17 ms.
cifar10        train : [loss = 0.040, top1 = 98.89%], test  : [loss = 0.475, top1 = 88.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.11 ms.
cifar100       train : [loss = 0.461, top1 = 87.04%], valid : [loss = 1.567, top1 = 61.83%], test : [loss = 1.567, top1 = 61.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.412, top1 = 38.45%], valid : [loss = 2.699, top1 = 33.13%], test : [loss = 2.726, top1 = 33.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.80%], valid : [loss = 0.873, top1 = 69.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11340/15625) 011340-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.530, top1 = 88.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.92 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.368, top1 = 91.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.68 ms.
cifar100       train : [loss = 0.166, top1 = 96.30%], valid : [loss = 1.408, top1 = 67.78%], test : [loss = 1.410, top1 = 67.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 49.11%], valid : [loss = 2.356, top1 = 40.33%], test : [loss = 2.377, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.75%], valid : [loss = 0.668, top1 = 76.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11341/15625) 011341-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.57%], valid : [loss = 0.564, top1 = 87.45%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.08 ms.
cifar10        train : [loss = 0.030, top1 = 99.11%], test  : [loss = 0.354, top1 = 91.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.65 ms.
cifar100       train : [loss = 0.401, top1 = 88.22%], valid : [loss = 1.288, top1 = 66.91%], test : [loss = 1.297, top1 = 67.19%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.26%], valid : [loss = 2.399, top1 = 39.09%], test : [loss = 2.399, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.10%], valid : [loss = 0.977, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11342/15625) 011342-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.75 ms.
cifar10-valid  train : [loss = 1.802, top1 = 34.88%], valid : [loss = 1.823, top1 = 33.96%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.18 ms.
cifar10        train : [loss = 1.181, top1 = 57.73%], test  : [loss = 1.186, top1 = 57.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.78 ms.
cifar100       train : [loss = 3.770, top1 = 12.50%], valid : [loss = 3.857, top1 = 10.77%], test : [loss = 3.850, top1 = 11.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.35 ms.
ImageNet16-120 train : [loss = 3.765, top1 = 13.88%], valid : [loss = 3.730, top1 = 14.58%], test : [loss = 3.743, top1 = 14.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.929, top1 = 29.57%], valid : [loss = 1.935, top1 = 29.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11343/15625) 011343-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.20%], valid : [loss = 0.582, top1 = 86.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10        train : [loss = 0.055, top1 = 98.20%], test  : [loss = 0.374, top1 = 90.21%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.36 ms.
cifar100       train : [loss = 0.588, top1 = 82.49%], valid : [loss = 1.330, top1 = 65.13%], test : [loss = 1.336, top1 = 64.82%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.71%], valid : [loss = 2.465, top1 = 37.40%], test : [loss = 2.506, top1 = 36.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.40%], valid : [loss = 0.945, top1 = 66.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11344/15625) 011344-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.77%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.85 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.293, top1 = 93.04%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.99 ms.
cifar100       train : [loss = 0.188, top1 = 95.77%], valid : [loss = 1.247, top1 = 68.75%], test : [loss = 1.249, top1 = 69.11%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.50 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.20%], valid : [loss = 2.128, top1 = 45.26%], test : [loss = 2.145, top1 = 44.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.25%], valid : [loss = 0.710, top1 = 75.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11345/15625) 011345-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.551, top1 = 88.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.352, top1 = 91.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.326, top1 = 91.09%], valid : [loss = 1.287, top1 = 66.81%], test : [loss = 1.299, top1 = 67.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.80%], valid : [loss = 2.435, top1 = 38.26%], test : [loss = 2.441, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.96%], valid : [loss = 0.839, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11346/15625) 011346-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.36%], valid : [loss = 0.661, top1 = 82.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10        train : [loss = 0.136, top1 = 95.45%], test  : [loss = 0.419, top1 = 87.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.18 ms.
cifar100       train : [loss = 0.929, top1 = 72.97%], valid : [loss = 1.562, top1 = 58.76%], test : [loss = 1.535, top1 = 59.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.847, top1 = 29.51%], valid : [loss = 2.956, top1 = 27.91%], test : [loss = 2.968, top1 = 27.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.896, top1 = 68.00%], valid : [loss = 0.934, top1 = 66.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11347/15625) 011347-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.55%], valid : [loss = 0.462, top1 = 86.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10        train : [loss = 0.147, top1 = 95.30%], test  : [loss = 0.333, top1 = 89.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.97 ms.
cifar100       train : [loss = 0.974, top1 = 72.30%], valid : [loss = 1.361, top1 = 61.57%], test : [loss = 1.352, top1 = 62.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.609, top1 = 34.32%], valid : [loss = 2.660, top1 = 33.17%], test : [loss = 2.685, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11348/15625) 011348-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.42%], valid : [loss = 0.722, top1 = 80.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.203, top1 = 92.97%], test  : [loss = 0.519, top1 = 84.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.874, top1 = 74.42%], valid : [loss = 1.647, top1 = 57.13%], test : [loss = 1.656, top1 = 57.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 3.517, top1 = 16.53%], valid : [loss = 3.523, top1 = 16.92%], test : [loss = 3.519, top1 = 16.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.38%], valid : [loss = 1.303, top1 = 52.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11349/15625) 011349-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.51%], valid : [loss = 0.562, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10        train : [loss = 0.031, top1 = 99.08%], test  : [loss = 0.377, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 0.535, top1 = 84.57%], valid : [loss = 1.365, top1 = 64.58%], test : [loss = 1.360, top1 = 64.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.16%], valid : [loss = 2.618, top1 = 33.30%], test : [loss = 2.657, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11350/15625) 011350-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.554, top1 = 88.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.375, top1 = 92.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.97 ms.
cifar100       train : [loss = 0.108, top1 = 98.07%], valid : [loss = 1.518, top1 = 66.64%], test : [loss = 1.524, top1 = 67.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.75%], valid : [loss = 2.460, top1 = 38.55%], test : [loss = 2.480, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.20%], valid : [loss = 0.756, top1 = 74.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11351/15625) 011351-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.455, top1 = 90.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.28 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.304, top1 = 93.62%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.43 ms.
cifar100       train : [loss = 0.041, top1 = 99.47%], valid : [loss = 1.388, top1 = 70.43%], test : [loss = 1.385, top1 = 70.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 1.402, top1 = 61.90%], valid : [loss = 2.251, top1 = 44.23%], test : [loss = 2.299, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.90%], valid : [loss = 0.509, top1 = 82.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11352/15625) 011352-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.04%], valid : [loss = 0.864, top1 = 71.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.91 ms.
cifar10        train : [loss = 0.554, top1 = 80.68%], test  : [loss = 0.711, top1 = 75.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.46 ms.
cifar100       train : [loss = 1.783, top1 = 52.00%], valid : [loss = 2.066, top1 = 47.03%], test : [loss = 2.073, top1 = 46.55%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.94 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.82%], valid : [loss = 3.643, top1 = 16.03%], test : [loss = 3.668, top1 = 15.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11353/15625) 011353-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.444, top1 = 89.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.283, top1 = 92.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.82 ms.
cifar100       train : [loss = 0.197, top1 = 95.45%], valid : [loss = 1.265, top1 = 69.46%], test : [loss = 1.260, top1 = 69.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.32%], valid : [loss = 2.261, top1 = 42.20%], test : [loss = 2.281, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.40%], valid : [loss = 0.521, top1 = 82.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11354/15625) 011354-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.35%], valid : [loss = 0.574, top1 = 81.58%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=13.62 ms.
cifar10        train : [loss = 0.273, top1 = 90.57%], test  : [loss = 0.425, top1 = 86.19%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=12.47 ms.
cifar100       train : [loss = 1.460, top1 = 59.12%], valid : [loss = 1.700, top1 = 54.00%], test : [loss = 1.687, top1 = 54.27%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.903, top1 = 28.55%], valid : [loss = 2.913, top1 = 28.37%], test : [loss = 2.952, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.992, top1 = 64.32%], valid : [loss = 1.034, top1 = 63.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11355/15625) 011355-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.52%], valid : [loss = 0.641, top1 = 85.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.33 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.413, top1 = 89.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.01 ms.
cifar100       train : [loss = 0.519, top1 = 84.79%], valid : [loss = 1.422, top1 = 64.04%], test : [loss = 1.396, top1 = 64.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.38%], valid : [loss = 2.545, top1 = 35.90%], test : [loss = 2.614, top1 = 34.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.04%], valid : [loss = 0.868, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11356/15625) 011356-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.36%], valid : [loss = 0.555, top1 = 87.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.031, top1 = 99.10%], test  : [loss = 0.386, top1 = 90.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.51 ms.
cifar100       train : [loss = 0.337, top1 = 90.35%], valid : [loss = 1.346, top1 = 66.64%], test : [loss = 1.373, top1 = 66.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.04%], valid : [loss = 2.702, top1 = 31.97%], test : [loss = 2.707, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.10%], valid : [loss = 0.983, top1 = 64.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11357/15625) 011357-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.32%], valid : [loss = 0.551, top1 = 83.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.97 ms.
cifar10        train : [loss = 0.201, top1 = 93.18%], test  : [loss = 0.397, top1 = 87.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 1.248, top1 = 64.52%], valid : [loss = 1.561, top1 = 57.48%], test : [loss = 1.546, top1 = 57.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.19%], valid : [loss = 2.712, top1 = 32.62%], test : [loss = 2.757, top1 = 31.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 65.02%], valid : [loss = 1.025, top1 = 63.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11358/15625) 011358-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.236, top1 = 91.98%], valid : [loss = 0.517, top1 = 84.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.238, top1 = 91.89%], test  : [loss = 0.391, top1 = 87.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.37 ms.
cifar100       train : [loss = 1.344, top1 = 62.29%], valid : [loss = 1.598, top1 = 56.19%], test : [loss = 1.594, top1 = 56.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.75 ms.
ImageNet16-120 train : [loss = 2.854, top1 = 29.60%], valid : [loss = 2.855, top1 = 30.02%], test : [loss = 2.921, top1 = 28.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11359/15625) 011359-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.74%], valid : [loss = 0.661, top1 = 84.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10        train : [loss = 0.074, top1 = 97.64%], test  : [loss = 0.408, top1 = 88.74%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.50 ms.
cifar100       train : [loss = 0.740, top1 = 78.29%], valid : [loss = 1.418, top1 = 62.31%], test : [loss = 1.403, top1 = 62.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.45%], valid : [loss = 2.695, top1 = 33.02%], test : [loss = 2.715, top1 = 33.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.46%], valid : [loss = 0.854, top1 = 69.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11360/15625) 011360-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.560, top1 = 88.11%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.41 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.361, top1 = 91.96%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.49 ms.
cifar100       train : [loss = 0.174, top1 = 96.25%], valid : [loss = 1.435, top1 = 66.72%], test : [loss = 1.471, top1 = 66.17%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.64%], valid : [loss = 2.418, top1 = 39.20%], test : [loss = 2.437, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.17%], valid : [loss = 0.753, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11361/15625) 011361-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.611, top1 = 87.47%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.48 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.413, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.14 ms.
cifar100       train : [loss = 0.195, top1 = 95.55%], valid : [loss = 1.473, top1 = 65.89%], test : [loss = 1.484, top1 = 65.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.085, top1 = 45.79%], valid : [loss = 2.504, top1 = 37.23%], test : [loss = 2.546, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.25%], valid : [loss = 0.769, top1 = 73.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11362/15625) 011362-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.479, top1 = 89.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.327, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 0.268, top1 = 92.95%], valid : [loss = 1.341, top1 = 67.29%], test : [loss = 1.329, top1 = 67.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.57%], valid : [loss = 2.347, top1 = 40.21%], test : [loss = 2.383, top1 = 40.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.18%], valid : [loss = 0.603, top1 = 79.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11363/15625) 011363-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.600, top1 = 87.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.414, top1 = 90.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.77 ms.
cifar100       train : [loss = 0.206, top1 = 95.26%], valid : [loss = 1.456, top1 = 66.16%], test : [loss = 1.407, top1 = 66.79%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.29%], valid : [loss = 2.517, top1 = 37.15%], test : [loss = 2.510, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.50%], valid : [loss = 0.737, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11364/15625) 011364-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.79%], valid : [loss = 0.851, top1 = 72.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.548, top1 = 80.87%], test  : [loss = 0.707, top1 = 75.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 1.762, top1 = 52.38%], valid : [loss = 2.034, top1 = 47.35%], test : [loss = 2.054, top1 = 46.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.84 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.94%], valid : [loss = 3.621, top1 = 16.55%], test : [loss = 3.661, top1 = 16.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11365/15625) 011365-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.59%], valid : [loss = 0.551, top1 = 87.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.028, top1 = 99.14%], test  : [loss = 0.354, top1 = 91.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.03 ms.
cifar100       train : [loss = 0.416, top1 = 87.86%], valid : [loss = 1.263, top1 = 67.17%], test : [loss = 1.277, top1 = 66.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.75%], valid : [loss = 2.429, top1 = 38.47%], test : [loss = 2.442, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.06%], valid : [loss = 0.993, top1 = 65.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11366/15625) 011366-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.497, top1 = 89.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.57 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.312, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.41 ms.
cifar100       train : [loss = 0.172, top1 = 95.78%], valid : [loss = 1.265, top1 = 69.71%], test : [loss = 1.265, top1 = 69.41%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.31 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.27%], valid : [loss = 2.195, top1 = 42.73%], test : [loss = 2.191, top1 = 44.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.49%], valid : [loss = 0.708, top1 = 75.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11367/15625) 011367-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.41 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.47%], valid : [loss = 0.526, top1 = 88.04%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.40 ms.
cifar10        train : [loss = 0.030, top1 = 99.16%], test  : [loss = 0.342, top1 = 91.31%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.68 ms.
cifar100       train : [loss = 0.464, top1 = 86.82%], valid : [loss = 1.287, top1 = 65.82%], test : [loss = 1.313, top1 = 65.64%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 41.94%], valid : [loss = 2.425, top1 = 37.65%], test : [loss = 2.443, top1 = 38.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.47%], valid : [loss = 0.802, top1 = 72.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11368/15625) 011368-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.484, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.299, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.08 ms.
cifar100       train : [loss = 0.316, top1 = 91.50%], valid : [loss = 1.249, top1 = 67.66%], test : [loss = 1.237, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.026, top1 = 46.78%], valid : [loss = 2.318, top1 = 40.67%], test : [loss = 2.347, top1 = 40.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.60%], valid : [loss = 0.582, top1 = 80.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11369/15625) 011369-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.26%], valid : [loss = 0.488, top1 = 87.17%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.21 ms.
cifar10        train : [loss = 0.050, top1 = 98.58%], test  : [loss = 0.355, top1 = 90.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.50 ms.
cifar100       train : [loss = 0.521, top1 = 85.06%], valid : [loss = 1.215, top1 = 67.36%], test : [loss = 1.197, top1 = 67.75%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.03%], valid : [loss = 2.346, top1 = 40.82%], test : [loss = 2.376, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.19%], valid : [loss = 0.805, top1 = 71.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11370/15625) 011370-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.397 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.222, top1 = 92.55%], valid : [loss = 0.556, top1 = 83.21%]
cifar10        FLOP= 54.97 M, Params=0.397 MB, latency=14.55 ms.
cifar10        train : [loss = 0.217, top1 = 92.53%], test  : [loss = 0.405, top1 = 87.11%]
cifar100       FLOP= 54.97 M, Params=0.403 MB, latency=13.64 ms.
cifar100       train : [loss = 1.278, top1 = 63.73%], valid : [loss = 1.577, top1 = 57.17%], test : [loss = 1.584, top1 = 56.71%]
ImageNet16-120 FLOP= 13.75 M, Params=0.405 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.754, top1 = 31.55%], valid : [loss = 2.762, top1 = 31.67%], test : [loss = 2.811, top1 = 30.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.55%], valid : [loss = 1.031, top1 = 63.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11371/15625) 011371-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.26%], valid : [loss = 0.599, top1 = 85.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.400, top1 = 88.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 0.715, top1 = 79.32%], valid : [loss = 1.401, top1 = 63.17%], test : [loss = 1.387, top1 = 63.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.88%], valid : [loss = 2.650, top1 = 34.15%], test : [loss = 2.703, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.59%], valid : [loss = 0.817, top1 = 71.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11372/15625) 011372-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.496, top1 = 90.17%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.81 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.312, top1 = 93.70%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.50 ms.
cifar100       train : [loss = 0.062, top1 = 99.21%], valid : [loss = 1.358, top1 = 70.02%], test : [loss = 1.328, top1 = 69.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.69 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.39%], valid : [loss = 2.171, top1 = 44.07%], test : [loss = 2.198, top1 = 44.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.60%], valid : [loss = 0.640, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11373/15625) 011373-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.262, top1 = 91.26%], valid : [loss = 0.476, top1 = 84.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.294, top1 = 90.16%], test  : [loss = 0.397, top1 = 86.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.26 ms.
cifar100       train : [loss = 1.327, top1 = 63.38%], valid : [loss = 1.533, top1 = 58.30%], test : [loss = 1.507, top1 = 58.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.88%], valid : [loss = 2.892, top1 = 29.32%], test : [loss = 2.943, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11374/15625) 011374-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 89.05 M, Params=0.634 MB, latency=20.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.491, top1 = 89.54%]
cifar10        FLOP= 89.05 M, Params=0.634 MB, latency=19.88 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.309, top1 = 92.83%]
cifar100       FLOP= 89.05 M, Params=0.640 MB, latency=20.55 ms.
cifar100       train : [loss = 0.140, top1 = 97.18%], valid : [loss = 1.269, top1 = 69.27%], test : [loss = 1.266, top1 = 69.50%]
ImageNet16-120 FLOP= 22.27 M, Params=0.641 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.752, top1 = 53.23%], valid : [loss = 2.181, top1 = 44.13%], test : [loss = 2.199, top1 = 43.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.34%], valid : [loss = 0.652, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11375/15625) 011375-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 0.146, top1 = 95.41%], valid : [loss = 0.544, top1 = 84.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.00 ms.
cifar10        train : [loss = 0.156, top1 = 94.83%], test  : [loss = 0.383, top1 = 88.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.09 ms.
cifar100       train : [loss = 1.154, top1 = 67.12%], valid : [loss = 1.485, top1 = 59.06%], test : [loss = 1.484, top1 = 58.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.572, top1 = 35.23%], valid : [loss = 2.646, top1 = 33.88%], test : [loss = 2.673, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.66%], valid : [loss = 0.945, top1 = 66.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11376/15625) 011376-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.425, top1 = 90.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.278, top1 = 93.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.17 ms.
cifar100       train : [loss = 0.160, top1 = 96.41%], valid : [loss = 1.279, top1 = 69.85%], test : [loss = 1.265, top1 = 70.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 1.768, top1 = 52.88%], valid : [loss = 2.230, top1 = 43.68%], test : [loss = 2.286, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.46%], valid : [loss = 0.518, top1 = 82.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11377/15625) 011377-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.534, top1 = 89.40%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.91 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.340, top1 = 92.81%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.72 ms.
cifar100       train : [loss = 0.085, top1 = 98.36%], valid : [loss = 1.402, top1 = 69.08%], test : [loss = 1.403, top1 = 69.36%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 1.930, top1 = 49.14%], valid : [loss = 2.344, top1 = 40.74%], test : [loss = 2.341, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.50%], valid : [loss = 0.836, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11378/15625) 011378-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.510, top1 = 88.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.68 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.362, top1 = 90.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.38 ms.
cifar100       train : [loss = 0.476, top1 = 86.09%], valid : [loss = 1.330, top1 = 65.54%], test : [loss = 1.356, top1 = 65.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.81 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.33%], valid : [loss = 2.511, top1 = 37.42%], test : [loss = 2.542, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11379/15625) 011379-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.38%], valid : [loss = 0.700, top1 = 84.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10        train : [loss = 0.055, top1 = 98.30%], test  : [loss = 0.455, top1 = 88.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 0.633, top1 = 81.44%], valid : [loss = 1.516, top1 = 61.52%], test : [loss = 1.474, top1 = 61.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.20%], valid : [loss = 2.831, top1 = 31.05%], test : [loss = 2.870, top1 = 30.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11380/15625) 011380-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.74%], valid : [loss = 0.466, top1 = 86.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.72 ms.
cifar10        train : [loss = 0.119, top1 = 96.27%], test  : [loss = 0.341, top1 = 89.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.88 ms.
cifar100       train : [loss = 0.727, top1 = 79.59%], valid : [loss = 1.256, top1 = 65.04%], test : [loss = 1.267, top1 = 64.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.480, top1 = 37.10%], valid : [loss = 2.565, top1 = 35.28%], test : [loss = 2.593, top1 = 34.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.70%], valid : [loss = 0.879, top1 = 68.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11381/15625) 011381-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.00 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11382/15625) 011382-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.93%], valid : [loss = 0.478, top1 = 84.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.300, top1 = 90.02%], test  : [loss = 0.402, top1 = 86.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.21 ms.
cifar100       train : [loss = 1.333, top1 = 63.02%], valid : [loss = 1.542, top1 = 57.81%], test : [loss = 1.509, top1 = 58.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.75 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.57%], valid : [loss = 2.905, top1 = 29.52%], test : [loss = 2.970, top1 = 27.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11383/15625) 011383-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.460, top1 = 89.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.014, top1 = 99.75%], test  : [loss = 0.319, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.325, top1 = 91.17%], valid : [loss = 1.289, top1 = 67.50%], test : [loss = 1.288, top1 = 67.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.23%], valid : [loss = 2.357, top1 = 40.32%], test : [loss = 2.429, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.460, top1 = 84.20%], valid : [loss = 0.549, top1 = 81.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11384/15625) 011384-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.560, top1 = 88.94%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.341, top1 = 92.42%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.77 ms.
cifar100       train : [loss = 0.184, top1 = 95.54%], valid : [loss = 1.323, top1 = 68.34%], test : [loss = 1.287, top1 = 69.25%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.89%], valid : [loss = 2.240, top1 = 42.83%], test : [loss = 2.244, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.52%], valid : [loss = 0.824, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11385/15625) 011385-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.502, top1 = 90.16%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.84 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.336, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.22 ms.
cifar100       train : [loss = 0.111, top1 = 97.88%], valid : [loss = 1.303, top1 = 69.09%], test : [loss = 1.295, top1 = 70.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.18%], valid : [loss = 2.194, top1 = 44.32%], test : [loss = 2.206, top1 = 44.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.30%], valid : [loss = 0.613, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11386/15625) 011386-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.623, top1 = 77.90%], valid : [loss = 0.759, top1 = 74.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.54 ms.
cifar10        train : [loss = 0.554, top1 = 80.74%], test  : [loss = 0.628, top1 = 78.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.974, top1 = 46.43%], valid : [loss = 2.096, top1 = 44.02%], test : [loss = 2.105, top1 = 44.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.40 ms.
ImageNet16-120 train : [loss = 3.007, top1 = 26.53%], valid : [loss = 2.986, top1 = 27.08%], test : [loss = 3.028, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.145, top1 = 58.56%], valid : [loss = 1.191, top1 = 57.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11387/15625) 011387-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.23%], valid : [loss = 0.802, top1 = 82.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10        train : [loss = 0.074, top1 = 97.71%], test  : [loss = 0.528, top1 = 86.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.65 ms.
cifar100       train : [loss = 0.555, top1 = 84.06%], valid : [loss = 1.650, top1 = 59.47%], test : [loss = 1.695, top1 = 58.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.24%], valid : [loss = 2.980, top1 = 28.00%], test : [loss = 3.021, top1 = 27.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.70%], valid : [loss = 0.911, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11388/15625) 011388-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.579, top1 = 87.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.43 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.378, top1 = 91.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.14 ms.
cifar100       train : [loss = 0.420, top1 = 88.06%], valid : [loss = 1.393, top1 = 64.82%], test : [loss = 1.396, top1 = 65.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.20%], valid : [loss = 2.524, top1 = 36.85%], test : [loss = 2.523, top1 = 36.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.79%], valid : [loss = 0.860, top1 = 69.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11389/15625) 011389-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.487, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.311, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.39 ms.
cifar100       train : [loss = 0.318, top1 = 91.45%], valid : [loss = 1.247, top1 = 67.44%], test : [loss = 1.255, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.75%], valid : [loss = 2.317, top1 = 40.78%], test : [loss = 2.328, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.21%], valid : [loss = 0.618, top1 = 78.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11390/15625) 011390-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.38%], valid : [loss = 0.461, top1 = 86.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.154, top1 = 94.96%], test  : [loss = 0.340, top1 = 88.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.28 ms.
cifar100       train : [loss = 0.964, top1 = 72.48%], valid : [loss = 1.351, top1 = 62.33%], test : [loss = 1.342, top1 = 62.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.98%], valid : [loss = 2.686, top1 = 32.92%], test : [loss = 2.714, top1 = 32.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11391/15625) 011391-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.35%], valid : [loss = 0.452, top1 = 87.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.64 ms.
cifar10        train : [loss = 0.067, top1 = 98.19%], test  : [loss = 0.317, top1 = 90.22%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.52 ms.
cifar100       train : [loss = 0.609, top1 = 83.16%], valid : [loss = 1.263, top1 = 65.78%], test : [loss = 1.257, top1 = 65.65%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.25%], valid : [loss = 2.506, top1 = 37.13%], test : [loss = 2.531, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.84%], valid : [loss = 0.655, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11392/15625) 011392-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.561, top1 = 88.80%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.68 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.369, top1 = 92.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.56 ms.
cifar100       train : [loss = 0.199, top1 = 95.10%], valid : [loss = 1.299, top1 = 68.83%], test : [loss = 1.308, top1 = 68.71%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 47.92%], valid : [loss = 2.319, top1 = 40.77%], test : [loss = 2.321, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.46%], valid : [loss = 0.762, top1 = 73.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11393/15625) 011393-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.18%], valid : [loss = 0.674, top1 = 78.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 0.377, top1 = 86.89%], test  : [loss = 0.515, top1 = 82.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.23 ms.
cifar100       train : [loss = 1.513, top1 = 57.99%], valid : [loss = 1.798, top1 = 52.11%], test : [loss = 1.798, top1 = 52.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 3.286, top1 = 21.70%], valid : [loss = 3.312, top1 = 21.23%], test : [loss = 3.344, top1 = 20.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.159, top1 = 58.40%], valid : [loss = 1.199, top1 = 57.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11394/15625) 011394-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.223, top1 = 92.60%], valid : [loss = 0.680, top1 = 80.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10        train : [loss = 0.285, top1 = 90.06%], test  : [loss = 0.518, top1 = 83.31%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.76 ms.
cifar100       train : [loss = 1.261, top1 = 64.32%], valid : [loss = 1.715, top1 = 55.12%], test : [loss = 1.708, top1 = 54.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 3.240, top1 = 22.50%], valid : [loss = 3.309, top1 = 21.17%], test : [loss = 3.346, top1 = 20.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.201, top1 = 56.31%], valid : [loss = 1.242, top1 = 55.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11395/15625) 011395-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.447, top1 = 90.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.41 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.304, top1 = 93.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.62 ms.
cifar100       train : [loss = 0.067, top1 = 99.00%], valid : [loss = 1.318, top1 = 70.63%], test : [loss = 1.320, top1 = 70.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 1.537, top1 = 58.39%], valid : [loss = 2.219, top1 = 44.38%], test : [loss = 2.251, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.68%], valid : [loss = 0.490, top1 = 83.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11396/15625) 011396-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.536, top1 = 89.24%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.99 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.360, top1 = 92.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.40 ms.
cifar100       train : [loss = 0.157, top1 = 96.34%], valid : [loss = 1.335, top1 = 68.44%], test : [loss = 1.316, top1 = 69.40%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.66 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.31%], valid : [loss = 2.245, top1 = 42.18%], test : [loss = 2.236, top1 = 43.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.39%], valid : [loss = 0.725, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11397/15625) 011397-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.08%], valid : [loss = 0.473, top1 = 84.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10        train : [loss = 0.298, top1 = 90.04%], test  : [loss = 0.399, top1 = 86.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.90 ms.
cifar100       train : [loss = 1.317, top1 = 63.49%], valid : [loss = 1.527, top1 = 58.02%], test : [loss = 1.509, top1 = 57.97%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.69%], valid : [loss = 2.903, top1 = 29.53%], test : [loss = 2.950, top1 = 27.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11398/15625) 011398-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.491, top1 = 90.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.311, top1 = 93.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.07 ms.
cifar100       train : [loss = 0.115, top1 = 97.73%], valid : [loss = 1.279, top1 = 70.09%], test : [loss = 1.293, top1 = 69.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.74%], valid : [loss = 2.192, top1 = 43.80%], test : [loss = 2.203, top1 = 43.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11399/15625) 011399-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.552, top1 = 89.12%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.85 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.343, top1 = 92.84%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.53 ms.
cifar100       train : [loss = 0.132, top1 = 97.24%], valid : [loss = 1.305, top1 = 69.57%], test : [loss = 1.306, top1 = 69.05%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.37%], valid : [loss = 2.246, top1 = 42.83%], test : [loss = 2.263, top1 = 42.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.94%], valid : [loss = 0.724, top1 = 74.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11400/15625) 011400-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 91.30%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.68 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.282, top1 = 94.05%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.09 ms.
cifar100       train : [loss = 0.029, top1 = 99.74%], valid : [loss = 1.326, top1 = 72.39%], test : [loss = 1.301, top1 = 71.96%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 1.288, top1 = 64.53%], valid : [loss = 2.242, top1 = 44.62%], test : [loss = 2.266, top1 = 45.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.75%], valid : [loss = 0.453, top1 = 84.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11401/15625) 011401-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.56 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.337, top1 = 92.75%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.46 ms.
cifar100       train : [loss = 0.114, top1 = 97.71%], valid : [loss = 1.281, top1 = 69.74%], test : [loss = 1.280, top1 = 70.33%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.18 ms.
ImageNet16-120 train : [loss = 1.964, top1 = 48.29%], valid : [loss = 2.333, top1 = 40.85%], test : [loss = 2.330, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.28%], valid : [loss = 0.827, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11402/15625) 011402-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.28%], valid : [loss = 0.596, top1 = 85.84%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.61 ms.
cifar10        train : [loss = 0.077, top1 = 97.62%], test  : [loss = 0.390, top1 = 88.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.12 ms.
cifar100       train : [loss = 0.720, top1 = 78.98%], valid : [loss = 1.394, top1 = 63.30%], test : [loss = 1.383, top1 = 63.11%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.73%], valid : [loss = 2.661, top1 = 33.92%], test : [loss = 2.701, top1 = 33.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.82%], valid : [loss = 0.807, top1 = 71.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11403/15625) 011403-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.39%], valid : [loss = 0.846, top1 = 72.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10        train : [loss = 0.550, top1 = 80.70%], test  : [loss = 0.710, top1 = 76.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 1.762, top1 = 52.46%], valid : [loss = 2.052, top1 = 46.71%], test : [loss = 2.058, top1 = 47.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.83%], valid : [loss = 3.635, top1 = 16.59%], test : [loss = 3.663, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11404/15625) 011404-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.289, top1 = 90.16%], valid : [loss = 0.531, top1 = 82.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.81 ms.
cifar10        train : [loss = 0.284, top1 = 90.29%], test  : [loss = 0.434, top1 = 85.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 1.418, top1 = 60.07%], valid : [loss = 1.651, top1 = 55.44%], test : [loss = 1.650, top1 = 54.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 2.817, top1 = 30.32%], valid : [loss = 2.867, top1 = 29.83%], test : [loss = 2.881, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.88%], valid : [loss = 1.005, top1 = 64.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11405/15625) 011405-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.477, top1 = 89.45%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=22.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.325, top1 = 92.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.07 ms.
cifar100       train : [loss = 0.244, top1 = 94.02%], valid : [loss = 1.337, top1 = 66.90%], test : [loss = 1.330, top1 = 67.28%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 47.98%], valid : [loss = 2.331, top1 = 41.40%], test : [loss = 2.327, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.43%], valid : [loss = 0.644, top1 = 77.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11406/15625) 011406-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.17%], valid : [loss = 0.640, top1 = 85.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.056, top1 = 98.28%], test  : [loss = 0.401, top1 = 89.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.90 ms.
cifar100       train : [loss = 0.638, top1 = 81.34%], valid : [loss = 1.423, top1 = 63.14%], test : [loss = 1.419, top1 = 62.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.74%], valid : [loss = 2.676, top1 = 33.47%], test : [loss = 2.655, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.94%], valid : [loss = 0.898, top1 = 68.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11407/15625) 011407-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.13%], valid : [loss = 0.945, top1 = 75.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.223, top1 = 92.25%], test  : [loss = 0.583, top1 = 82.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.73 ms.
cifar100       train : [loss = 1.175, top1 = 66.72%], valid : [loss = 1.807, top1 = 53.80%], test : [loss = 1.814, top1 = 54.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.21 ms.
ImageNet16-120 train : [loss = 3.262, top1 = 22.14%], valid : [loss = 3.352, top1 = 21.13%], test : [loss = 3.406, top1 = 20.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.079, top1 = 61.48%], valid : [loss = 1.123, top1 = 59.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11408/15625) 011408-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.648, top1 = 86.58%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.68 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.422, top1 = 90.30%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.40 ms.
cifar100       train : [loss = 0.225, top1 = 94.60%], valid : [loss = 1.466, top1 = 65.96%], test : [loss = 1.465, top1 = 65.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.52%], valid : [loss = 2.531, top1 = 37.03%], test : [loss = 2.551, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.60%], valid : [loss = 0.811, top1 = 71.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11409/15625) 011409-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.71 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.02 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11410/15625) 011410-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.557, top1 = 88.68%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.03 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.372, top1 = 92.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.18 ms.
cifar100       train : [loss = 0.254, top1 = 93.04%], valid : [loss = 1.300, top1 = 67.66%], test : [loss = 1.320, top1 = 68.52%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 2.169, top1 = 43.64%], valid : [loss = 2.447, top1 = 37.73%], test : [loss = 2.412, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.14%], valid : [loss = 0.924, top1 = 67.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11411/15625) 011411-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.49%], valid : [loss = 0.697, top1 = 76.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10        train : [loss = 0.351, top1 = 87.69%], test  : [loss = 0.489, top1 = 83.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.53 ms.
cifar100       train : [loss = 1.665, top1 = 54.35%], valid : [loss = 1.881, top1 = 50.26%], test : [loss = 1.892, top1 = 50.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 23.05%], valid : [loss = 3.208, top1 = 23.03%], test : [loss = 3.280, top1 = 21.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.227, top1 = 55.65%], valid : [loss = 1.259, top1 = 54.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11412/15625) 011412-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.535, top1 = 89.16%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=23.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.314, top1 = 93.21%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=20.21 ms.
cifar100       train : [loss = 0.056, top1 = 99.09%], valid : [loss = 1.404, top1 = 70.30%], test : [loss = 1.366, top1 = 70.28%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=24.35 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.18%], valid : [loss = 2.537, top1 = 35.70%], test : [loss = 2.510, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.75%], valid : [loss = 0.949, top1 = 65.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11413/15625) 011413-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.32 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.16%], valid : [loss = 0.856, top1 = 71.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.555, top1 = 80.63%], test  : [loss = 0.719, top1 = 75.46%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.97 ms.
cifar100       train : [loss = 1.781, top1 = 51.98%], valid : [loss = 2.054, top1 = 46.94%], test : [loss = 2.074, top1 = 45.95%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.68 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.78%], valid : [loss = 3.640, top1 = 16.38%], test : [loss = 3.664, top1 = 15.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11414/15625) 011414-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.546, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.342, top1 = 92.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.93 ms.
cifar100       train : [loss = 0.122, top1 = 97.42%], valid : [loss = 1.409, top1 = 68.10%], test : [loss = 1.360, top1 = 69.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.58%], valid : [loss = 2.302, top1 = 41.87%], test : [loss = 2.302, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.22%], valid : [loss = 0.793, top1 = 72.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11415/15625) 011415-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.520, top1 = 88.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.334, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.15 ms.
cifar100       train : [loss = 0.242, top1 = 93.78%], valid : [loss = 1.234, top1 = 68.60%], test : [loss = 1.245, top1 = 68.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.50%], valid : [loss = 2.245, top1 = 41.57%], test : [loss = 2.259, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.48%], valid : [loss = 0.603, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11416/15625) 011416-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.63%], valid : [loss = 0.822, top1 = 82.44%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.11 ms.
cifar10        train : [loss = 0.040, top1 = 98.84%], test  : [loss = 0.472, top1 = 88.35%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.30 ms.
cifar100       train : [loss = 0.434, top1 = 87.95%], valid : [loss = 1.655, top1 = 60.98%], test : [loss = 1.621, top1 = 61.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.370, top1 = 39.23%], valid : [loss = 2.724, top1 = 32.87%], test : [loss = 2.737, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.12%], valid : [loss = 0.898, top1 = 67.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11417/15625) 011417-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.20%], valid : [loss = 0.459, top1 = 86.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.109, top1 = 96.59%], test  : [loss = 0.318, top1 = 90.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.850, top1 = 75.77%], valid : [loss = 1.295, top1 = 64.18%], test : [loss = 1.285, top1 = 64.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.567, top1 = 35.36%], valid : [loss = 2.647, top1 = 34.03%], test : [loss = 2.646, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 79.01%], valid : [loss = 0.670, top1 = 76.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11418/15625) 011418-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.488, top1 = 89.87%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.314, top1 = 93.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.88 ms.
cifar100       train : [loss = 0.130, top1 = 97.38%], valid : [loss = 1.284, top1 = 69.88%], test : [loss = 1.288, top1 = 69.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.15%], valid : [loss = 2.283, top1 = 42.17%], test : [loss = 2.233, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.53%], valid : [loss = 0.689, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11419/15625) 011419-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.575, top1 = 88.53%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.56 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.385, top1 = 92.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.14 ms.
cifar100       train : [loss = 0.101, top1 = 98.25%], valid : [loss = 1.471, top1 = 67.36%], test : [loss = 1.464, top1 = 68.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.19 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.24%], valid : [loss = 2.470, top1 = 39.80%], test : [loss = 2.467, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.26%], valid : [loss = 0.759, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11420/15625) 011420-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.582, top1 = 88.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.366, top1 = 92.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.179, top1 = 95.87%], valid : [loss = 1.390, top1 = 67.52%], test : [loss = 1.411, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.60%], valid : [loss = 2.455, top1 = 38.37%], test : [loss = 2.485, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11421/15625) 011421-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.79%], valid : [loss = 0.883, top1 = 71.08%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.33 ms.
cifar10        train : [loss = 0.569, top1 = 80.19%], test  : [loss = 0.737, top1 = 75.04%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.80 ms.
cifar100       train : [loss = 1.780, top1 = 52.10%], valid : [loss = 2.059, top1 = 46.66%], test : [loss = 2.059, top1 = 47.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.96%], valid : [loss = 3.628, top1 = 16.33%], test : [loss = 3.668, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 57.19%], valid : [loss = 1.261, top1 = 55.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11422/15625) 011422-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.487, top1 = 88.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.307, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.17 ms.
cifar100       train : [loss = 0.314, top1 = 91.72%], valid : [loss = 1.231, top1 = 67.36%], test : [loss = 1.242, top1 = 67.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.82%], valid : [loss = 2.347, top1 = 40.87%], test : [loss = 2.332, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.49%], valid : [loss = 0.613, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11423/15625) 011423-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.458, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.62 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.313, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.85 ms.
cifar100       train : [loss = 0.326, top1 = 91.13%], valid : [loss = 1.289, top1 = 67.44%], test : [loss = 1.302, top1 = 67.83%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.26%], valid : [loss = 2.368, top1 = 40.39%], test : [loss = 2.404, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 83.94%], valid : [loss = 0.548, top1 = 81.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11424/15625) 011424-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.512, top1 = 88.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.341, top1 = 91.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 0.345, top1 = 90.61%], valid : [loss = 1.279, top1 = 66.82%], test : [loss = 1.288, top1 = 66.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.14%], valid : [loss = 2.418, top1 = 38.93%], test : [loss = 2.430, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11425/15625) 011425-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.44%], valid : [loss = 1.080, top1 = 64.14%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10        train : [loss = 0.804, top1 = 71.87%], test  : [loss = 0.940, top1 = 67.34%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.43 ms.
cifar100       train : [loss = 2.150, top1 = 43.82%], valid : [loss = 2.418, top1 = 39.22%], test : [loss = 2.448, top1 = 39.42%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.39 ms.
ImageNet16-120 train : [loss = 3.772, top1 = 13.81%], valid : [loss = 3.824, top1 = 13.87%], test : [loss = 3.832, top1 = 13.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11426/15625) 011426-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.73%], valid : [loss = 0.597, top1 = 84.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10        train : [loss = 0.095, top1 = 96.88%], test  : [loss = 0.405, top1 = 88.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.14 ms.
cifar100       train : [loss = 0.698, top1 = 79.48%], valid : [loss = 1.541, top1 = 60.06%], test : [loss = 1.507, top1 = 61.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 3.208, top1 = 22.05%], valid : [loss = 3.232, top1 = 21.23%], test : [loss = 3.236, top1 = 21.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.077, top1 = 61.24%], valid : [loss = 1.105, top1 = 60.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11427/15625) 011427-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.82%], valid : [loss = 0.559, top1 = 88.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.349, top1 = 92.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.94 ms.
cifar100       train : [loss = 0.294, top1 = 91.80%], valid : [loss = 1.296, top1 = 67.42%], test : [loss = 1.314, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.090, top1 = 45.56%], valid : [loss = 2.365, top1 = 40.67%], test : [loss = 2.406, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11428/15625) 011428-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.098, top1 = 97.10%], valid : [loss = 0.507, top1 = 85.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.29 ms.
cifar10        train : [loss = 0.122, top1 = 95.89%], test  : [loss = 0.366, top1 = 88.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.698, top1 = 79.83%], valid : [loss = 1.220, top1 = 65.96%], test : [loss = 1.221, top1 = 65.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.69 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.21%], valid : [loss = 2.456, top1 = 37.87%], test : [loss = 2.473, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.48%], valid : [loss = 0.954, top1 = 66.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11429/15625) 011429-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.585, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.386, top1 = 91.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.30 ms.
cifar100       train : [loss = 0.402, top1 = 88.62%], valid : [loss = 1.404, top1 = 65.13%], test : [loss = 1.391, top1 = 65.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.96%], valid : [loss = 2.498, top1 = 37.43%], test : [loss = 2.523, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11430/15625) 011430-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.08%], valid : [loss = 0.476, top1 = 84.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10        train : [loss = 0.300, top1 = 89.92%], test  : [loss = 0.395, top1 = 86.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 1.345, top1 = 62.77%], valid : [loss = 1.532, top1 = 57.42%], test : [loss = 1.520, top1 = 57.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.02 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.61%], valid : [loss = 2.907, top1 = 29.17%], test : [loss = 2.961, top1 = 28.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11431/15625) 011431-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.317, top1 = 89.01%], valid : [loss = 0.571, top1 = 81.88%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.291, top1 = 90.03%], test  : [loss = 0.439, top1 = 85.45%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 1.468, top1 = 59.02%], valid : [loss = 1.712, top1 = 53.71%], test : [loss = 1.701, top1 = 53.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 3.001, top1 = 26.83%], valid : [loss = 3.004, top1 = 26.98%], test : [loss = 3.052, top1 = 26.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 65.29%], valid : [loss = 1.028, top1 = 63.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11432/15625) 011432-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.13 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.79%], valid : [loss = 0.474, top1 = 85.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.164, top1 = 94.63%], test  : [loss = 0.347, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.48 ms.
cifar100       train : [loss = 0.982, top1 = 72.28%], valid : [loss = 1.351, top1 = 62.64%], test : [loss = 1.363, top1 = 61.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.39%], valid : [loss = 2.667, top1 = 33.22%], test : [loss = 2.702, top1 = 31.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.25%], valid : [loss = 0.915, top1 = 67.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11433/15625) 011433-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.538, top1 = 88.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.349, top1 = 91.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.325, top1 = 90.72%], valid : [loss = 1.338, top1 = 66.44%], test : [loss = 1.355, top1 = 66.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.60%], valid : [loss = 2.554, top1 = 34.57%], test : [loss = 2.527, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.92%], valid : [loss = 1.004, top1 = 63.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11434/15625) 011434-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.27%], valid : [loss = 0.607, top1 = 85.77%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.10 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.402, top1 = 88.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.94 ms.
cifar100       train : [loss = 0.720, top1 = 78.97%], valid : [loss = 1.377, top1 = 63.15%], test : [loss = 1.364, top1 = 63.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.18%], valid : [loss = 2.649, top1 = 33.80%], test : [loss = 2.686, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11435/15625) 011435-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.416, top1 = 90.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.269, top1 = 93.45%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.05 ms.
cifar100       train : [loss = 0.183, top1 = 95.78%], valid : [loss = 1.278, top1 = 69.62%], test : [loss = 1.265, top1 = 70.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.72%], valid : [loss = 2.284, top1 = 41.60%], test : [loss = 2.266, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.380, top1 = 86.89%], valid : [loss = 0.513, top1 = 82.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11436/15625) 011436-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.60%], valid : [loss = 0.452, top1 = 87.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.28 ms.
cifar10        train : [loss = 0.051, top1 = 98.84%], test  : [loss = 0.323, top1 = 90.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.77 ms.
cifar100       train : [loss = 0.497, top1 = 86.85%], valid : [loss = 1.208, top1 = 67.40%], test : [loss = 1.210, top1 = 67.28%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.75%], valid : [loss = 2.422, top1 = 38.87%], test : [loss = 2.461, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.46%], valid : [loss = 0.635, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11437/15625) 011437-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.544, top1 = 88.86%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=16.15 ms.
cifar10        train : [loss = 0.007, top1 = 99.81%], test  : [loss = 0.374, top1 = 92.15%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.42 ms.
cifar100       train : [loss = 0.132, top1 = 97.07%], valid : [loss = 1.477, top1 = 67.04%], test : [loss = 1.519, top1 = 66.42%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 41.99%], valid : [loss = 2.463, top1 = 36.93%], test : [loss = 2.482, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.08%], valid : [loss = 1.037, top1 = 62.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11438/15625) 011438-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.505, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=20.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.308, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.89 ms.
cifar100       train : [loss = 0.354, top1 = 90.19%], valid : [loss = 1.298, top1 = 66.56%], test : [loss = 1.265, top1 = 67.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.52%], valid : [loss = 2.416, top1 = 38.83%], test : [loss = 2.434, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11439/15625) 011439-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.531, top1 = 89.41%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.68 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.347, top1 = 92.89%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.47 ms.
cifar100       train : [loss = 0.072, top1 = 98.92%], valid : [loss = 1.459, top1 = 68.22%], test : [loss = 1.432, top1 = 68.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.12%], valid : [loss = 2.351, top1 = 41.27%], test : [loss = 2.358, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.82%], valid : [loss = 0.679, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11440/15625) 011440-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.527, top1 = 89.03%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.97 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.330, top1 = 92.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.276, top1 = 92.46%], valid : [loss = 1.273, top1 = 68.07%], test : [loss = 1.256, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 1.991, top1 = 47.76%], valid : [loss = 2.284, top1 = 41.06%], test : [loss = 2.305, top1 = 41.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.50%], valid : [loss = 0.763, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11441/15625) 011441-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.53%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.322, top1 = 93.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.50 ms.
cifar100       train : [loss = 0.067, top1 = 99.06%], valid : [loss = 1.378, top1 = 69.66%], test : [loss = 1.331, top1 = 69.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.41%], valid : [loss = 2.397, top1 = 39.93%], test : [loss = 2.404, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11442/15625) 011442-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.526, top1 = 88.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.351, top1 = 91.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.57 ms.
cifar100       train : [loss = 0.327, top1 = 91.19%], valid : [loss = 1.328, top1 = 65.96%], test : [loss = 1.353, top1 = 66.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.00%], valid : [loss = 2.421, top1 = 38.77%], test : [loss = 2.441, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11443/15625) 011443-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.429, top1 = 91.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.09 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.286, top1 = 93.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.069, top1 = 98.99%], valid : [loss = 1.300, top1 = 70.62%], test : [loss = 1.308, top1 = 70.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 1.547, top1 = 58.17%], valid : [loss = 2.273, top1 = 43.90%], test : [loss = 2.250, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.85%], valid : [loss = 0.487, top1 = 83.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11444/15625) 011444-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.94 ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.65%], valid : [loss = 0.671, top1 = 77.42%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.26 ms.
cifar10        train : [loss = 0.505, top1 = 82.50%], test  : [loss = 0.583, top1 = 80.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.84 ms.
cifar100       train : [loss = 1.700, top1 = 54.09%], valid : [loss = 1.872, top1 = 50.48%], test : [loss = 1.876, top1 = 51.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.61 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 21.33%], valid : [loss = 3.305, top1 = 21.00%], test : [loss = 3.344, top1 = 21.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11445/15625) 011445-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.530, top1 = 88.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.342, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.57 ms.
cifar100       train : [loss = 0.322, top1 = 91.21%], valid : [loss = 1.293, top1 = 67.46%], test : [loss = 1.296, top1 = 67.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.151, top1 = 44.08%], valid : [loss = 2.411, top1 = 39.38%], test : [loss = 2.432, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11446/15625) 011446-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.92 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.97%], valid : [loss = 0.543, top1 = 86.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10        train : [loss = 0.071, top1 = 97.65%], test  : [loss = 0.384, top1 = 89.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 0.706, top1 = 79.02%], valid : [loss = 1.396, top1 = 63.54%], test : [loss = 1.333, top1 = 64.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.507, top1 = 36.50%], valid : [loss = 2.617, top1 = 34.43%], test : [loss = 2.699, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.24%], valid : [loss = 0.720, top1 = 75.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11447/15625) 011447-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.21 ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.35%], valid : [loss = 0.767, top1 = 73.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.50 ms.
cifar10        train : [loss = 0.634, top1 = 78.38%], test  : [loss = 0.671, top1 = 76.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.25 ms.
cifar100       train : [loss = 2.060, top1 = 45.79%], valid : [loss = 2.150, top1 = 43.73%], test : [loss = 2.125, top1 = 44.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=7.81 ms.
ImageNet16-120 train : [loss = 3.290, top1 = 21.48%], valid : [loss = 3.256, top1 = 22.03%], test : [loss = 3.288, top1 = 20.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.315, top1 = 52.71%], valid : [loss = 1.360, top1 = 50.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11448/15625) 011448-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.62%], valid : [loss = 0.571, top1 = 87.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.028, top1 = 99.20%], test  : [loss = 0.368, top1 = 91.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.92 ms.
cifar100       train : [loss = 0.437, top1 = 87.32%], valid : [loss = 1.252, top1 = 66.88%], test : [loss = 1.277, top1 = 66.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.266, top1 = 41.46%], valid : [loss = 2.431, top1 = 38.70%], test : [loss = 2.489, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.85%], valid : [loss = 0.917, top1 = 67.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11449/15625) 011449-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.40%], valid : [loss = 0.835, top1 = 76.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.282, top1 = 90.34%], test  : [loss = 0.632, top1 = 80.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.94 ms.
cifar100       train : [loss = 1.394, top1 = 60.94%], valid : [loss = 1.956, top1 = 49.46%], test : [loss = 1.934, top1 = 49.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 3.505, top1 = 17.13%], valid : [loss = 3.548, top1 = 16.73%], test : [loss = 3.530, top1 = 17.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11450/15625) 011450-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.656, top1 = 86.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.415, top1 = 90.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.34 ms.
cifar100       train : [loss = 0.232, top1 = 94.37%], valid : [loss = 1.682, top1 = 62.58%], test : [loss = 1.665, top1 = 62.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.52%], valid : [loss = 2.643, top1 = 35.17%], test : [loss = 2.669, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.62%], valid : [loss = 0.816, top1 = 70.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11451/15625) 011451-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.555, top1 = 87.51%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.66 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.384, top1 = 90.70%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.33 ms.
cifar100       train : [loss = 0.356, top1 = 90.03%], valid : [loss = 1.370, top1 = 65.76%], test : [loss = 1.406, top1 = 65.50%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 2.727, top1 = 31.35%], valid : [loss = 2.784, top1 = 31.03%], test : [loss = 2.786, top1 = 31.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.969, top1 = 64.82%], valid : [loss = 1.011, top1 = 63.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11452/15625) 011452-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.17%], valid : [loss = 0.724, top1 = 75.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.09 ms.
cifar10        train : [loss = 0.466, top1 = 83.79%], test  : [loss = 0.589, top1 = 80.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.92 ms.
cifar100       train : [loss = 1.786, top1 = 51.12%], valid : [loss = 1.989, top1 = 47.68%], test : [loss = 1.996, top1 = 47.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.01 ms.
ImageNet16-120 train : [loss = 3.429, top1 = 19.17%], valid : [loss = 3.441, top1 = 19.83%], test : [loss = 3.461, top1 = 17.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.229, top1 = 55.35%], valid : [loss = 1.266, top1 = 54.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11453/15625) 011453-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.548, top1 = 88.46%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.45 ms.
cifar10        train : [loss = 0.022, top1 = 99.39%], test  : [loss = 0.388, top1 = 91.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.84 ms.
cifar100       train : [loss = 0.164, top1 = 95.83%], valid : [loss = 1.477, top1 = 66.40%], test : [loss = 1.468, top1 = 67.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 27.67%], valid : [loss = 2.979, top1 = 26.60%], test : [loss = 3.014, top1 = 25.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.331, top1 = 51.29%], valid : [loss = 1.353, top1 = 50.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11454/15625) 011454-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.527, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.335, top1 = 92.65%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.149, top1 = 96.92%], valid : [loss = 1.309, top1 = 68.86%], test : [loss = 1.284, top1 = 69.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.72%], valid : [loss = 2.341, top1 = 40.40%], test : [loss = 2.318, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11455/15625) 011455-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.00 ms.
cifar10-valid  train : [loss = 0.042, top1 = 99.06%], valid : [loss = 0.534, top1 = 86.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.060, top1 = 98.32%], test  : [loss = 0.364, top1 = 89.63%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.51 ms.
cifar100       train : [loss = 0.551, top1 = 84.11%], valid : [loss = 1.291, top1 = 65.62%], test : [loss = 1.317, top1 = 65.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.04%], valid : [loss = 2.425, top1 = 38.90%], test : [loss = 2.438, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.61%], valid : [loss = 0.887, top1 = 68.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11456/15625) 011456-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.491, top1 = 90.25%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.62 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.309, top1 = 93.59%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=15.02 ms.
cifar100       train : [loss = 0.059, top1 = 99.21%], valid : [loss = 1.358, top1 = 70.20%], test : [loss = 1.312, top1 = 70.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 1.722, top1 = 54.07%], valid : [loss = 2.208, top1 = 43.13%], test : [loss = 2.209, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.77%], valid : [loss = 0.639, top1 = 77.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11457/15625) 011457-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.534, top1 = 89.55%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=18.39 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.353, top1 = 93.15%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.75 ms.
cifar100       train : [loss = 0.025, top1 = 99.86%], valid : [loss = 1.417, top1 = 70.64%], test : [loss = 1.411, top1 = 69.64%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.426, top1 = 61.29%], valid : [loss = 2.401, top1 = 41.13%], test : [loss = 2.405, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.77%], valid : [loss = 0.640, top1 = 77.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11458/15625) 011458-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.24%], valid : [loss = 0.579, top1 = 87.12%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.97 ms.
cifar10        train : [loss = 0.035, top1 = 98.91%], test  : [loss = 0.415, top1 = 89.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.85 ms.
cifar100       train : [loss = 0.361, top1 = 89.59%], valid : [loss = 1.493, top1 = 63.16%], test : [loss = 1.466, top1 = 64.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.32 ms.
ImageNet16-120 train : [loss = 2.816, top1 = 29.04%], valid : [loss = 2.871, top1 = 27.70%], test : [loss = 2.913, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.00%], valid : [loss = 1.206, top1 = 56.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11459/15625) 011459-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.50%], valid : [loss = 0.758, top1 = 80.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10        train : [loss = 0.131, top1 = 95.52%], test  : [loss = 0.461, top1 = 86.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.45 ms.
cifar100       train : [loss = 0.926, top1 = 73.02%], valid : [loss = 1.655, top1 = 56.96%], test : [loss = 1.607, top1 = 57.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.988, top1 = 26.41%], valid : [loss = 3.049, top1 = 25.57%], test : [loss = 3.087, top1 = 24.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.46%], valid : [loss = 1.065, top1 = 62.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11460/15625) 011460-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.71%], valid : [loss = 0.852, top1 = 71.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.560, top1 = 80.32%], test  : [loss = 0.717, top1 = 75.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.62 ms.
cifar100       train : [loss = 1.789, top1 = 51.69%], valid : [loss = 2.067, top1 = 47.08%], test : [loss = 2.076, top1 = 46.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.85%], valid : [loss = 3.657, top1 = 16.13%], test : [loss = 3.669, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11461/15625) 011461-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.468, top1 = 88.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.312, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.334, top1 = 90.85%], valid : [loss = 1.308, top1 = 67.23%], test : [loss = 1.292, top1 = 67.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.21%], valid : [loss = 2.379, top1 = 39.92%], test : [loss = 2.390, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.94%], valid : [loss = 0.567, top1 = 80.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11462/15625) 011462-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.538, top1 = 88.66%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.18 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.332, top1 = 92.17%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.46 ms.
cifar100       train : [loss = 0.308, top1 = 91.33%], valid : [loss = 1.302, top1 = 67.14%], test : [loss = 1.316, top1 = 67.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.27%], valid : [loss = 2.413, top1 = 38.65%], test : [loss = 2.441, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.61%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11463/15625) 011463-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.581, top1 = 87.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.86 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.397, top1 = 90.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 0.392, top1 = 88.86%], valid : [loss = 1.378, top1 = 65.77%], test : [loss = 1.384, top1 = 66.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.18%], valid : [loss = 2.515, top1 = 36.64%], test : [loss = 2.529, top1 = 36.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11464/15625) 011464-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.80%], valid : [loss = 0.469, top1 = 84.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=11.88 ms.
cifar10        train : [loss = 0.298, top1 = 89.96%], test  : [loss = 0.394, top1 = 86.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.91 ms.
cifar100       train : [loss = 1.326, top1 = 63.39%], valid : [loss = 1.534, top1 = 57.60%], test : [loss = 1.508, top1 = 58.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.65%], valid : [loss = 2.911, top1 = 29.30%], test : [loss = 2.958, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11465/15625) 011465-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.457, top1 = 90.90%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.10 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.318, top1 = 93.64%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.20 ms.
cifar100       train : [loss = 0.031, top1 = 99.68%], valid : [loss = 1.326, top1 = 71.16%], test : [loss = 1.335, top1 = 71.16%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 1.339, top1 = 63.35%], valid : [loss = 2.317, top1 = 43.63%], test : [loss = 2.318, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.317, top1 = 89.19%], valid : [loss = 0.478, top1 = 84.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11466/15625) 011466-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.02 ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.78%], valid : [loss = 0.700, top1 = 77.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.421, top1 = 85.38%], test  : [loss = 0.559, top1 = 81.42%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 1.769, top1 = 51.77%], valid : [loss = 1.972, top1 = 47.92%], test : [loss = 1.984, top1 = 47.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 3.451, top1 = 18.57%], valid : [loss = 3.466, top1 = 18.67%], test : [loss = 3.500, top1 = 18.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.07%], valid : [loss = 1.262, top1 = 54.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11467/15625) 011467-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.523, top1 = 88.89%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.42 ms.
cifar10        train : [loss = 0.011, top1 = 99.85%], test  : [loss = 0.330, top1 = 91.91%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.37 ms.
cifar100       train : [loss = 0.207, top1 = 95.05%], valid : [loss = 1.281, top1 = 68.44%], test : [loss = 1.272, top1 = 69.14%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.66%], valid : [loss = 2.241, top1 = 41.37%], test : [loss = 2.251, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.18%], valid : [loss = 0.771, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11468/15625) 011468-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.37%], valid : [loss = 0.707, top1 = 81.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10        train : [loss = 0.144, top1 = 95.10%], test  : [loss = 0.471, top1 = 86.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.14 ms.
cifar100       train : [loss = 0.992, top1 = 71.03%], valid : [loss = 1.638, top1 = 56.90%], test : [loss = 1.615, top1 = 57.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 25.40%], valid : [loss = 3.121, top1 = 24.33%], test : [loss = 3.157, top1 = 24.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11469/15625) 011469-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.02%], valid : [loss = 0.831, top1 = 72.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.560, top1 = 80.46%], test  : [loss = 0.714, top1 = 75.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.73 ms.
cifar100       train : [loss = 1.787, top1 = 51.82%], valid : [loss = 2.062, top1 = 47.62%], test : [loss = 2.062, top1 = 47.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.75%], valid : [loss = 3.641, top1 = 16.37%], test : [loss = 3.672, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11470/15625) 011470-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.52%], valid : [loss = 0.550, top1 = 85.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.43 ms.
cifar10        train : [loss = 0.066, top1 = 98.06%], test  : [loss = 0.348, top1 = 90.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.44 ms.
cifar100       train : [loss = 0.644, top1 = 81.15%], valid : [loss = 1.364, top1 = 64.70%], test : [loss = 1.360, top1 = 64.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.43%], valid : [loss = 2.478, top1 = 35.93%], test : [loss = 2.487, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.92%], valid : [loss = 0.889, top1 = 68.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11471/15625) 011471-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.51%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.34 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.299, top1 = 93.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.79 ms.
cifar100       train : [loss = 0.058, top1 = 99.22%], valid : [loss = 1.361, top1 = 69.95%], test : [loss = 1.372, top1 = 69.89%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.526, top1 = 58.78%], valid : [loss = 2.273, top1 = 43.82%], test : [loss = 2.293, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.401, top1 = 86.08%], valid : [loss = 0.526, top1 = 81.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11472/15625) 011472-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.441, top1 = 90.84%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.275, top1 = 93.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.85 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.325, top1 = 70.42%], test : [loss = 1.315, top1 = 70.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.47 ms.
ImageNet16-120 train : [loss = 1.537, top1 = 58.50%], valid : [loss = 2.215, top1 = 44.53%], test : [loss = 2.248, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11473/15625) 011473-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.561, top1 = 88.16%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.50 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.342, top1 = 91.77%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.15 ms.
cifar100       train : [loss = 0.239, top1 = 93.52%], valid : [loss = 1.359, top1 = 67.56%], test : [loss = 1.382, top1 = 66.48%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.46 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.78%], valid : [loss = 2.353, top1 = 40.07%], test : [loss = 2.375, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.45%], valid : [loss = 0.741, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11474/15625) 011474-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.712, top1 = 85.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.503, top1 = 88.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 0.337, top1 = 91.05%], valid : [loss = 1.656, top1 = 62.18%], test : [loss = 1.608, top1 = 62.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.442, top1 = 38.04%], valid : [loss = 2.751, top1 = 31.93%], test : [loss = 2.852, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.01%], valid : [loss = 0.837, top1 = 70.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11475/15625) 011475-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.26%], valid : [loss = 0.450, top1 = 87.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.109, top1 = 96.71%], test  : [loss = 0.331, top1 = 89.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.62 ms.
cifar100       train : [loss = 0.871, top1 = 75.23%], valid : [loss = 1.302, top1 = 64.01%], test : [loss = 1.293, top1 = 64.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.66%], valid : [loss = 2.621, top1 = 34.18%], test : [loss = 2.670, top1 = 33.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.34%], valid : [loss = 0.655, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11476/15625) 011476-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.455, top1 = 89.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.309, top1 = 92.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.78 ms.
cifar100       train : [loss = 0.328, top1 = 91.08%], valid : [loss = 1.324, top1 = 66.68%], test : [loss = 1.326, top1 = 67.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.91 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.35%], valid : [loss = 2.374, top1 = 40.28%], test : [loss = 2.392, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11477/15625) 011477-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10-valid  train : [loss = 1.246, top1 = 55.32%], valid : [loss = 1.296, top1 = 53.55%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.55 ms.
cifar10        train : [loss = 1.114, top1 = 60.20%], test  : [loss = 1.122, top1 = 59.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.09 ms.
cifar100       train : [loss = 2.630, top1 = 33.55%], valid : [loss = 2.712, top1 = 32.22%], test : [loss = 2.703, top1 = 32.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.84 ms.
ImageNet16-120 train : [loss = 3.830, top1 = 12.90%], valid : [loss = 3.818, top1 = 13.10%], test : [loss = 3.833, top1 = 13.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.687, top1 = 36.40%], valid : [loss = 1.711, top1 = 34.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11478/15625) 011478-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.563, top1 = 87.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.17 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.351, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 0.288, top1 = 92.07%], valid : [loss = 1.335, top1 = 67.30%], test : [loss = 1.344, top1 = 67.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.28%], valid : [loss = 2.440, top1 = 39.00%], test : [loss = 2.431, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11479/15625) 011479-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.43 ms.
cifar10-valid  train : [loss = 0.274, top1 = 91.04%], valid : [loss = 0.477, top1 = 84.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10        train : [loss = 0.304, top1 = 89.95%], test  : [loss = 0.407, top1 = 86.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.83 ms.
cifar100       train : [loss = 1.330, top1 = 63.01%], valid : [loss = 1.540, top1 = 57.66%], test : [loss = 1.510, top1 = 58.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.35 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.50%], valid : [loss = 2.920, top1 = 29.63%], test : [loss = 2.969, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11480/15625) 011480-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.517, top1 = 89.73%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.18 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.326, top1 = 93.13%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.53 ms.
cifar100       train : [loss = 0.082, top1 = 98.65%], valid : [loss = 1.352, top1 = 69.60%], test : [loss = 1.400, top1 = 68.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.45%], valid : [loss = 2.393, top1 = 39.13%], test : [loss = 2.360, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11481/15625) 011481-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.58%], valid : [loss = 0.860, top1 = 71.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.575, top1 = 79.91%], test  : [loss = 0.720, top1 = 75.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 1.793, top1 = 51.62%], valid : [loss = 2.063, top1 = 46.42%], test : [loss = 2.055, top1 = 47.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.79%], valid : [loss = 3.637, top1 = 16.57%], test : [loss = 3.673, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11482/15625) 011482-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.96%], valid : [loss = 0.469, top1 = 84.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10        train : [loss = 0.295, top1 = 90.22%], test  : [loss = 0.386, top1 = 87.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 1.332, top1 = 63.08%], valid : [loss = 1.524, top1 = 58.12%], test : [loss = 1.492, top1 = 57.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.79%], valid : [loss = 2.888, top1 = 28.77%], test : [loss = 2.957, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 75.03%], valid : [loss = 0.750, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11483/15625) 011483-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.479, top1 = 88.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.310, top1 = 92.24%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.63 ms.
cifar100       train : [loss = 0.324, top1 = 91.30%], valid : [loss = 1.249, top1 = 67.94%], test : [loss = 1.238, top1 = 68.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.65%], valid : [loss = 2.332, top1 = 39.87%], test : [loss = 2.353, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.585, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11484/15625) 011484-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.578, top1 = 87.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.377, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.28 ms.
cifar100       train : [loss = 0.392, top1 = 88.91%], valid : [loss = 1.379, top1 = 65.85%], test : [loss = 1.382, top1 = 65.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.97%], valid : [loss = 2.476, top1 = 37.93%], test : [loss = 2.486, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.51%], valid : [loss = 0.766, top1 = 73.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11485/15625) 011485-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.54%], valid : [loss = 0.564, top1 = 87.52%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.45 ms.
cifar10        train : [loss = 0.020, top1 = 99.43%], test  : [loss = 0.382, top1 = 90.93%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.67 ms.
cifar100       train : [loss = 0.213, top1 = 94.14%], valid : [loss = 1.381, top1 = 67.32%], test : [loss = 1.389, top1 = 68.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.666, top1 = 32.78%], valid : [loss = 2.793, top1 = 29.83%], test : [loss = 2.811, top1 = 30.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.08%], valid : [loss = 0.969, top1 = 65.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11486/15625) 011486-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.00%], valid : [loss = 0.609, top1 = 84.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.114, top1 = 96.29%], test  : [loss = 0.406, top1 = 88.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.40 ms.
cifar100       train : [loss = 0.863, top1 = 74.95%], valid : [loss = 1.489, top1 = 59.98%], test : [loss = 1.469, top1 = 60.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.705, top1 = 32.34%], valid : [loss = 2.837, top1 = 29.03%], test : [loss = 2.882, top1 = 29.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 70.31%], valid : [loss = 0.884, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11487/15625) 011487-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.71 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.296, top1 = 92.86%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.97 ms.
cifar100       train : [loss = 0.219, top1 = 94.79%], valid : [loss = 1.255, top1 = 67.60%], test : [loss = 1.235, top1 = 69.20%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.89%], valid : [loss = 2.196, top1 = 43.33%], test : [loss = 2.193, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.76%], valid : [loss = 0.607, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11488/15625) 011488-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.539, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.15 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.318, top1 = 92.84%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.82 ms.
cifar100       train : [loss = 0.125, top1 = 97.48%], valid : [loss = 1.313, top1 = 68.54%], test : [loss = 1.315, top1 = 69.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.78%], valid : [loss = 2.285, top1 = 42.23%], test : [loss = 2.305, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.61%], valid : [loss = 0.931, top1 = 67.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11489/15625) 011489-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.92%], valid : [loss = 0.518, top1 = 85.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.118, top1 = 96.10%], test  : [loss = 0.355, top1 = 89.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.29 ms.
cifar100       train : [loss = 0.878, top1 = 74.57%], valid : [loss = 1.422, top1 = 61.48%], test : [loss = 1.415, top1 = 62.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.09 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.71%], valid : [loss = 2.643, top1 = 33.67%], test : [loss = 2.683, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.875, top1 = 68.48%], valid : [loss = 0.940, top1 = 66.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11490/15625) 011490-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.677, top1 = 85.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.441, top1 = 89.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.327, top1 = 91.09%], valid : [loss = 1.603, top1 = 61.80%], test : [loss = 1.625, top1 = 61.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.37%], valid : [loss = 2.615, top1 = 34.90%], test : [loss = 2.596, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.46%], valid : [loss = 0.842, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11491/15625) 011491-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.30 ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.58%], valid : [loss = 0.848, top1 = 71.23%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.95 ms.
cifar10        train : [loss = 0.668, top1 = 76.62%], test  : [loss = 0.759, top1 = 73.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.57 ms.
cifar100       train : [loss = 1.960, top1 = 47.78%], valid : [loss = 2.131, top1 = 44.53%], test : [loss = 2.152, top1 = 44.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.97 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.72%], valid : [loss = 3.670, top1 = 15.78%], test : [loss = 3.698, top1 = 14.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11492/15625) 011492-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.52%], valid : [loss = 0.440, top1 = 87.89%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.16 ms.
cifar10        train : [loss = 0.055, top1 = 98.67%], test  : [loss = 0.314, top1 = 90.53%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.73 ms.
cifar100       train : [loss = 0.577, top1 = 84.40%], valid : [loss = 1.236, top1 = 67.18%], test : [loss = 1.198, top1 = 67.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.05%], valid : [loss = 2.487, top1 = 37.83%], test : [loss = 2.523, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.95%], valid : [loss = 0.660, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11493/15625) 011493-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.599, top1 = 87.09%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.65 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.390, top1 = 91.11%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.50 ms.
cifar100       train : [loss = 0.362, top1 = 89.80%], valid : [loss = 1.387, top1 = 65.58%], test : [loss = 1.421, top1 = 65.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.21%], valid : [loss = 2.499, top1 = 36.60%], test : [loss = 2.497, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 71.00%], valid : [loss = 0.873, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11494/15625) 011494-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.545, top1 = 88.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10        train : [loss = 0.030, top1 = 99.07%], test  : [loss = 0.345, top1 = 91.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.454, top1 = 86.87%], valid : [loss = 1.267, top1 = 67.00%], test : [loss = 1.266, top1 = 66.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.76 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.21%], valid : [loss = 2.396, top1 = 39.33%], test : [loss = 2.392, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.73%], valid : [loss = 0.922, top1 = 67.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11495/15625) 011495-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.77 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.68%], valid : [loss = 0.487, top1 = 84.04%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.38 ms.
cifar10        train : [loss = 0.302, top1 = 89.90%], test  : [loss = 0.401, top1 = 86.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.31 ms.
cifar100       train : [loss = 1.341, top1 = 62.76%], valid : [loss = 1.564, top1 = 56.82%], test : [loss = 1.510, top1 = 58.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.55 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.65%], valid : [loss = 2.893, top1 = 29.67%], test : [loss = 2.955, top1 = 28.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11496/15625) 011496-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.232, top1 = 92.31%], valid : [loss = 0.483, top1 = 84.63%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.68 ms.
cifar10        train : [loss = 0.251, top1 = 91.58%], test  : [loss = 0.405, top1 = 86.61%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=13.59 ms.
cifar100       train : [loss = 1.277, top1 = 64.11%], valid : [loss = 1.545, top1 = 57.26%], test : [loss = 1.544, top1 = 57.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 3.076, top1 = 25.02%], valid : [loss = 3.106, top1 = 24.33%], test : [loss = 3.099, top1 = 24.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.038, top1 = 62.55%], valid : [loss = 1.048, top1 = 62.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11497/15625) 011497-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.21%], valid : [loss = 0.446, top1 = 87.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.115, top1 = 96.44%], test  : [loss = 0.327, top1 = 89.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.870, top1 = 75.37%], valid : [loss = 1.305, top1 = 64.13%], test : [loss = 1.277, top1 = 64.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.79%], valid : [loss = 2.624, top1 = 34.11%], test : [loss = 2.661, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.76%], valid : [loss = 0.649, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11498/15625) 011498-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.22 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11499/15625) 011499-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.606, top1 = 87.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.56 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.393, top1 = 91.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.23 ms.
cifar100       train : [loss = 0.219, top1 = 94.84%], valid : [loss = 1.422, top1 = 66.46%], test : [loss = 1.457, top1 = 66.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.22%], valid : [loss = 2.522, top1 = 36.93%], test : [loss = 2.513, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.60%], valid : [loss = 0.756, top1 = 73.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11500/15625) 011500-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.517, top1 = 89.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.50 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.316, top1 = 92.64%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.78 ms.
cifar100       train : [loss = 0.156, top1 = 96.64%], valid : [loss = 1.265, top1 = 68.40%], test : [loss = 1.304, top1 = 69.30%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.86 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.16%], valid : [loss = 2.226, top1 = 42.63%], test : [loss = 2.240, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.73%], valid : [loss = 0.600, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11501/15625) 011501-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11502/15625) 011502-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.53%], valid : [loss = 0.458, top1 = 86.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10        train : [loss = 0.163, top1 = 94.71%], test  : [loss = 0.353, top1 = 88.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 0.999, top1 = 71.58%], valid : [loss = 1.359, top1 = 62.20%], test : [loss = 1.341, top1 = 62.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.45%], valid : [loss = 2.708, top1 = 32.37%], test : [loss = 2.723, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11503/15625) 011503-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.563, top1 = 88.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.389, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.36 ms.
cifar100       train : [loss = 0.113, top1 = 97.69%], valid : [loss = 1.542, top1 = 66.50%], test : [loss = 1.523, top1 = 66.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.42%], valid : [loss = 2.414, top1 = 39.68%], test : [loss = 2.436, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.33%], valid : [loss = 0.724, top1 = 74.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11504/15625) 011504-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.574, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.78 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.380, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.70 ms.
cifar100       train : [loss = 0.114, top1 = 97.79%], valid : [loss = 1.434, top1 = 67.84%], test : [loss = 1.465, top1 = 67.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.61%], valid : [loss = 2.487, top1 = 39.00%], test : [loss = 2.454, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.682, top1 = 75.86%], valid : [loss = 0.766, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11505/15625) 011505-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.311, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.327, top1 = 91.18%], valid : [loss = 1.304, top1 = 66.91%], test : [loss = 1.327, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.16%], valid : [loss = 2.383, top1 = 40.22%], test : [loss = 2.406, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11506/15625) 011506-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.584, top1 = 88.64%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.395, top1 = 92.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.65 ms.
cifar100       train : [loss = 0.048, top1 = 99.33%], valid : [loss = 1.536, top1 = 67.94%], test : [loss = 1.568, top1 = 68.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 1.735, top1 = 53.87%], valid : [loss = 2.399, top1 = 40.97%], test : [loss = 2.425, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.517, top1 = 81.68%], valid : [loss = 0.637, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11507/15625) 011507-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.21%], valid : [loss = 0.580, top1 = 85.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10        train : [loss = 0.109, top1 = 96.38%], test  : [loss = 0.404, top1 = 88.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.39 ms.
cifar100       train : [loss = 0.830, top1 = 75.50%], valid : [loss = 1.424, top1 = 61.60%], test : [loss = 1.406, top1 = 62.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.04%], valid : [loss = 2.758, top1 = 31.60%], test : [loss = 2.808, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11508/15625) 011508-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.82 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.31%], valid : [loss = 0.615, top1 = 85.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.58 ms.
cifar10        train : [loss = 0.070, top1 = 97.86%], test  : [loss = 0.410, top1 = 88.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.17 ms.
cifar100       train : [loss = 0.727, top1 = 78.75%], valid : [loss = 1.405, top1 = 62.90%], test : [loss = 1.367, top1 = 63.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.85%], valid : [loss = 2.657, top1 = 33.78%], test : [loss = 2.702, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11509/15625) 011509-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.51%], valid : [loss = 0.451, top1 = 86.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.160, top1 = 94.76%], test  : [loss = 0.347, top1 = 88.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.50 ms.
cifar100       train : [loss = 1.023, top1 = 70.75%], valid : [loss = 1.371, top1 = 61.36%], test : [loss = 1.364, top1 = 60.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.62%], valid : [loss = 2.714, top1 = 32.53%], test : [loss = 2.718, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.29%], valid : [loss = 0.766, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11510/15625) 011510-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.346, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.296, top1 = 91.85%], valid : [loss = 1.321, top1 = 67.52%], test : [loss = 1.296, top1 = 68.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.019, top1 = 47.18%], valid : [loss = 2.353, top1 = 40.53%], test : [loss = 2.356, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.66%], valid : [loss = 0.568, top1 = 80.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11511/15625) 011511-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.67%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=14.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.329, top1 = 92.02%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=14.35 ms.
cifar100       train : [loss = 0.339, top1 = 90.79%], valid : [loss = 1.288, top1 = 66.59%], test : [loss = 1.276, top1 = 67.13%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.77%], valid : [loss = 2.393, top1 = 38.91%], test : [loss = 2.389, top1 = 39.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11512/15625) 011512-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.521, top1 = 89.96%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.308, top1 = 93.41%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.52 ms.
cifar100       train : [loss = 0.037, top1 = 99.53%], valid : [loss = 1.331, top1 = 70.70%], test : [loss = 1.355, top1 = 70.76%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.36 ms.
ImageNet16-120 train : [loss = 1.554, top1 = 58.23%], valid : [loss = 2.203, top1 = 44.63%], test : [loss = 2.214, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.97%], valid : [loss = 0.686, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11513/15625) 011513-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.467, top1 = 89.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.327, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.90 ms.
cifar100       train : [loss = 0.274, top1 = 92.72%], valid : [loss = 1.331, top1 = 67.47%], test : [loss = 1.333, top1 = 67.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.41%], valid : [loss = 2.357, top1 = 39.80%], test : [loss = 2.385, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.12%], valid : [loss = 0.605, top1 = 79.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11514/15625) 011514-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.512, top1 = 89.18%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=18.59 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.328, top1 = 92.68%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=18.78 ms.
cifar100       train : [loss = 0.148, top1 = 96.70%], valid : [loss = 1.317, top1 = 68.61%], test : [loss = 1.352, top1 = 68.72%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=19.39 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.41%], valid : [loss = 2.332, top1 = 41.00%], test : [loss = 2.330, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 79.02%], valid : [loss = 0.682, top1 = 76.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11515/15625) 011515-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.60%], valid : [loss = 0.577, top1 = 87.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 0.042, top1 = 98.75%], test  : [loss = 0.398, top1 = 89.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.98 ms.
cifar100       train : [loss = 0.563, top1 = 83.39%], valid : [loss = 1.412, top1 = 64.16%], test : [loss = 1.415, top1 = 63.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.78%], valid : [loss = 2.635, top1 = 33.83%], test : [loss = 2.652, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11516/15625) 011516-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.612, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.029, top1 = 99.24%], test  : [loss = 0.407, top1 = 90.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.16 ms.
cifar100       train : [loss = 0.511, top1 = 84.89%], valid : [loss = 1.385, top1 = 64.14%], test : [loss = 1.431, top1 = 64.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 39.17%], valid : [loss = 2.551, top1 = 36.40%], test : [loss = 2.595, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 72.98%], valid : [loss = 0.816, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11517/15625) 011517-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.91%], valid : [loss = 0.595, top1 = 86.84%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=14.96 ms.
cifar10        train : [loss = 0.022, top1 = 99.49%], test  : [loss = 0.411, top1 = 89.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.48 ms.
cifar100       train : [loss = 0.290, top1 = 92.86%], valid : [loss = 1.391, top1 = 65.78%], test : [loss = 1.389, top1 = 65.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.75%], valid : [loss = 2.561, top1 = 36.27%], test : [loss = 2.557, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.52%], valid : [loss = 0.739, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11518/15625) 011518-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.32%], valid : [loss = 0.590, top1 = 84.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.423, top1 = 88.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 0.688, top1 = 79.65%], valid : [loss = 1.525, top1 = 60.22%], test : [loss = 1.499, top1 = 60.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 21.39%], valid : [loss = 3.250, top1 = 20.97%], test : [loss = 3.276, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.31%], valid : [loss = 1.040, top1 = 62.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11519/15625) 011519-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.84%], valid : [loss = 0.659, top1 = 84.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.077, top1 = 97.53%], test  : [loss = 0.410, top1 = 88.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.52 ms.
cifar100       train : [loss = 0.772, top1 = 77.26%], valid : [loss = 1.447, top1 = 61.64%], test : [loss = 1.424, top1 = 62.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.591, top1 = 34.87%], valid : [loss = 2.705, top1 = 32.03%], test : [loss = 2.743, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.51%], valid : [loss = 0.876, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11520/15625) 011520-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.454, top1 = 89.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 0.318, top1 = 91.34%], valid : [loss = 1.325, top1 = 67.00%], test : [loss = 1.317, top1 = 67.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.23%], valid : [loss = 2.356, top1 = 40.50%], test : [loss = 2.373, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.63%], valid : [loss = 0.557, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11521/15625) 011521-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.26%], valid : [loss = 0.588, top1 = 85.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.31 ms.
cifar10        train : [loss = 0.069, top1 = 97.97%], test  : [loss = 0.369, top1 = 89.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.55 ms.
cifar100       train : [loss = 0.677, top1 = 80.25%], valid : [loss = 1.365, top1 = 63.78%], test : [loss = 1.388, top1 = 62.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.414, top1 = 38.38%], valid : [loss = 2.512, top1 = 36.90%], test : [loss = 2.532, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.70%], valid : [loss = 0.881, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11522/15625) 011522-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.57 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.23%], valid : [loss = 0.468, top1 = 86.31%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.354, top1 = 88.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.58 ms.
cifar100       train : [loss = 0.992, top1 = 71.79%], valid : [loss = 1.376, top1 = 62.38%], test : [loss = 1.336, top1 = 62.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.652, top1 = 33.41%], valid : [loss = 2.728, top1 = 31.33%], test : [loss = 2.703, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11523/15625) 011523-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.82%], valid : [loss = 0.686, top1 = 83.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.086, top1 = 97.25%], test  : [loss = 0.489, top1 = 86.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.48 ms.
cifar100       train : [loss = 0.853, top1 = 75.21%], valid : [loss = 1.543, top1 = 59.16%], test : [loss = 1.534, top1 = 60.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.793, top1 = 30.73%], valid : [loss = 2.927, top1 = 28.47%], test : [loss = 2.965, top1 = 28.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11524/15625) 011524-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.461, top1 = 89.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 91.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.48 ms.
cifar100       train : [loss = 0.336, top1 = 90.87%], valid : [loss = 1.303, top1 = 67.20%], test : [loss = 1.298, top1 = 67.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.04%], valid : [loss = 2.388, top1 = 39.68%], test : [loss = 2.424, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11525/15625) 011525-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.96%], valid : [loss = 0.541, top1 = 87.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.99 ms.
cifar10        train : [loss = 0.077, top1 = 97.52%], test  : [loss = 0.345, top1 = 90.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.15 ms.
cifar100       train : [loss = 0.733, top1 = 78.39%], valid : [loss = 1.362, top1 = 64.60%], test : [loss = 1.329, top1 = 64.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.39 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.08%], valid : [loss = 2.646, top1 = 34.43%], test : [loss = 2.699, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11526/15625) 011526-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.45%], valid : [loss = 0.593, top1 = 87.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.64 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.363, top1 = 90.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.42 ms.
cifar100       train : [loss = 0.631, top1 = 81.75%], valid : [loss = 1.431, top1 = 62.36%], test : [loss = 1.417, top1 = 63.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 33.52%], valid : [loss = 2.658, top1 = 31.77%], test : [loss = 2.699, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.41%], valid : [loss = 0.963, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11527/15625) 011527-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.18%], valid : [loss = 0.617, top1 = 85.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.075, top1 = 97.71%], test  : [loss = 0.381, top1 = 89.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.03 ms.
cifar100       train : [loss = 0.721, top1 = 78.98%], valid : [loss = 1.396, top1 = 63.52%], test : [loss = 1.381, top1 = 63.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.85%], valid : [loss = 2.669, top1 = 33.90%], test : [loss = 2.711, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.24%], valid : [loss = 0.786, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11528/15625) 011528-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.513, top1 = 89.90%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.19 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.309, top1 = 93.35%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=17.24 ms.
cifar100       train : [loss = 0.064, top1 = 99.08%], valid : [loss = 1.335, top1 = 70.44%], test : [loss = 1.347, top1 = 70.88%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=23.61 ms.
ImageNet16-120 train : [loss = 1.636, top1 = 56.14%], valid : [loss = 2.175, top1 = 44.10%], test : [loss = 2.162, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.43%], valid : [loss = 0.643, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11529/15625) 011529-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.80%], valid : [loss = 0.628, top1 = 84.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.08 ms.
cifar10        train : [loss = 0.086, top1 = 97.19%], test  : [loss = 0.401, top1 = 88.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.10 ms.
cifar100       train : [loss = 0.775, top1 = 77.14%], valid : [loss = 1.429, top1 = 62.16%], test : [loss = 1.434, top1 = 62.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.03%], valid : [loss = 2.744, top1 = 30.97%], test : [loss = 2.756, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.24%], valid : [loss = 0.849, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11530/15625) 011530-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.415, top1 = 90.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.280, top1 = 93.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.46 ms.
cifar100       train : [loss = 0.186, top1 = 95.59%], valid : [loss = 1.311, top1 = 69.40%], test : [loss = 1.313, top1 = 68.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.66%], valid : [loss = 2.254, top1 = 43.10%], test : [loss = 2.345, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.02%], valid : [loss = 0.505, top1 = 83.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11531/15625) 011531-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.88%], valid : [loss = 0.480, top1 = 84.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.21 ms.
cifar10        train : [loss = 0.300, top1 = 89.92%], test  : [loss = 0.402, top1 = 86.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.45 ms.
cifar100       train : [loss = 1.326, top1 = 63.37%], valid : [loss = 1.531, top1 = 57.84%], test : [loss = 1.529, top1 = 57.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.70%], valid : [loss = 2.903, top1 = 29.43%], test : [loss = 2.973, top1 = 27.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11532/15625) 011532-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.562, top1 = 88.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.355, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.97 ms.
cifar100       train : [loss = 0.178, top1 = 95.96%], valid : [loss = 1.385, top1 = 67.78%], test : [loss = 1.374, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.19 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.20%], valid : [loss = 2.483, top1 = 37.63%], test : [loss = 2.511, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.99%], valid : [loss = 0.698, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11533/15625) 011533-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.415, top1 = 90.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.262, top1 = 93.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 0.186, top1 = 95.57%], valid : [loss = 1.253, top1 = 69.62%], test : [loss = 1.301, top1 = 69.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.37%], valid : [loss = 2.292, top1 = 41.77%], test : [loss = 2.294, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11534/15625) 011534-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.513, top1 = 88.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.323, top1 = 92.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.70 ms.
cifar100       train : [loss = 0.329, top1 = 91.10%], valid : [loss = 1.279, top1 = 67.03%], test : [loss = 1.280, top1 = 67.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.45 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.69%], valid : [loss = 2.408, top1 = 38.81%], test : [loss = 2.426, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11535/15625) 011535-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.576, top1 = 87.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.64 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.364, top1 = 91.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.21 ms.
cifar100       train : [loss = 0.407, top1 = 88.34%], valid : [loss = 1.361, top1 = 65.48%], test : [loss = 1.357, top1 = 66.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.91%], valid : [loss = 2.531, top1 = 37.10%], test : [loss = 2.533, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.57%], valid : [loss = 0.823, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11536/15625) 011536-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.530, top1 = 88.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.360, top1 = 91.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.09 ms.
cifar100       train : [loss = 0.299, top1 = 91.84%], valid : [loss = 1.293, top1 = 68.32%], test : [loss = 1.295, top1 = 67.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 44.87%], valid : [loss = 2.380, top1 = 40.07%], test : [loss = 2.391, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.02%], valid : [loss = 0.852, top1 = 69.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11537/15625) 011537-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.496, top1 = 89.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.320, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.23 ms.
cifar100       train : [loss = 0.245, top1 = 93.92%], valid : [loss = 1.245, top1 = 68.37%], test : [loss = 1.242, top1 = 69.05%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 1.929, top1 = 49.16%], valid : [loss = 2.276, top1 = 41.74%], test : [loss = 2.302, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11538/15625) 011538-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.56 ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.39%], valid : [loss = 0.712, top1 = 75.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.18 ms.
cifar10        train : [loss = 0.544, top1 = 81.33%], test  : [loss = 0.601, top1 = 79.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.21 ms.
cifar100       train : [loss = 1.945, top1 = 47.88%], valid : [loss = 2.062, top1 = 45.37%], test : [loss = 2.053, top1 = 45.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.41 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.36%], valid : [loss = 3.204, top1 = 22.74%], test : [loss = 3.239, top1 = 22.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.279, top1 = 53.96%], valid : [loss = 1.368, top1 = 50.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11539/15625) 011539-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.100, top1 = 96.92%], valid : [loss = 0.865, top1 = 78.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.139, top1 = 95.32%], test  : [loss = 0.491, top1 = 86.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.34 ms.
cifar100       train : [loss = 1.022, top1 = 70.22%], valid : [loss = 1.625, top1 = 56.34%], test : [loss = 1.666, top1 = 56.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.48%], valid : [loss = 3.050, top1 = 25.87%], test : [loss = 3.085, top1 = 25.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 67.81%], valid : [loss = 0.951, top1 = 66.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11540/15625) 011540-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.63 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.81%], valid : [loss = 0.471, top1 = 86.28%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.29 ms.
cifar10        train : [loss = 0.117, top1 = 96.41%], test  : [loss = 0.336, top1 = 89.49%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.07 ms.
cifar100       train : [loss = 0.768, top1 = 78.41%], valid : [loss = 1.287, top1 = 64.66%], test : [loss = 1.305, top1 = 64.50%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.33%], valid : [loss = 2.597, top1 = 34.97%], test : [loss = 2.655, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.41%], valid : [loss = 0.845, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11541/15625) 011541-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.614, top1 = 85.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10        train : [loss = 0.070, top1 = 97.91%], test  : [loss = 0.410, top1 = 88.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.59 ms.
cifar100       train : [loss = 0.714, top1 = 79.23%], valid : [loss = 1.378, top1 = 63.49%], test : [loss = 1.383, top1 = 63.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.02%], valid : [loss = 2.646, top1 = 34.41%], test : [loss = 2.686, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11542/15625) 011542-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.23%], valid : [loss = 0.656, top1 = 84.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10        train : [loss = 0.055, top1 = 98.34%], test  : [loss = 0.405, top1 = 89.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 0.632, top1 = 81.65%], valid : [loss = 1.409, top1 = 63.31%], test : [loss = 1.404, top1 = 63.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 37.18%], valid : [loss = 2.605, top1 = 34.87%], test : [loss = 2.652, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.38%], valid : [loss = 0.833, top1 = 70.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11543/15625) 011543-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.531, top1 = 88.69%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.31 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.363, top1 = 91.82%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.53 ms.
cifar100       train : [loss = 0.102, top1 = 98.31%], valid : [loss = 1.416, top1 = 68.34%], test : [loss = 1.429, top1 = 68.06%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.850, top1 = 51.22%], valid : [loss = 2.458, top1 = 39.03%], test : [loss = 2.411, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.64%], valid : [loss = 0.696, top1 = 76.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11544/15625) 011544-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.337, top1 = 88.26%], valid : [loss = 0.559, top1 = 82.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10        train : [loss = 0.289, top1 = 90.10%], test  : [loss = 0.432, top1 = 85.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 1.568, top1 = 56.27%], valid : [loss = 1.787, top1 = 51.75%], test : [loss = 1.776, top1 = 51.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 25.85%], valid : [loss = 3.046, top1 = 26.44%], test : [loss = 3.119, top1 = 24.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.034, top1 = 62.80%], valid : [loss = 1.079, top1 = 61.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11545/15625) 011545-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.38 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.23 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.86 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.96 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11546/15625) 011546-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.473, top1 = 89.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.327, top1 = 91.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.65 ms.
cifar100       train : [loss = 0.370, top1 = 89.36%], valid : [loss = 1.302, top1 = 67.28%], test : [loss = 1.288, top1 = 67.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 2.141, top1 = 44.42%], valid : [loss = 2.382, top1 = 39.10%], test : [loss = 2.468, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.31%], valid : [loss = 0.700, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11547/15625) 011547-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.88%], valid : [loss = 0.503, top1 = 85.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10        train : [loss = 0.168, top1 = 94.37%], test  : [loss = 0.365, top1 = 88.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.15 ms.
cifar100       train : [loss = 1.028, top1 = 70.38%], valid : [loss = 1.383, top1 = 61.44%], test : [loss = 1.376, top1 = 62.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.40%], valid : [loss = 2.650, top1 = 33.52%], test : [loss = 2.694, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.44%], valid : [loss = 0.917, top1 = 67.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11548/15625) 011548-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.47%], valid : [loss = 0.909, top1 = 76.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.58 ms.
cifar10        train : [loss = 0.209, top1 = 92.94%], test  : [loss = 0.581, top1 = 82.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.49 ms.
cifar100       train : [loss = 1.145, top1 = 67.27%], valid : [loss = 1.749, top1 = 53.80%], test : [loss = 1.719, top1 = 54.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.64 ms.
ImageNet16-120 train : [loss = 3.250, top1 = 22.41%], valid : [loss = 3.348, top1 = 21.60%], test : [loss = 3.404, top1 = 20.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11549/15625) 011549-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.620, top1 = 86.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.92 ms.
cifar10        train : [loss = 0.034, top1 = 99.05%], test  : [loss = 0.395, top1 = 90.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.28 ms.
cifar100       train : [loss = 0.546, top1 = 83.93%], valid : [loss = 1.418, top1 = 63.78%], test : [loss = 1.431, top1 = 63.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.397, top1 = 38.81%], valid : [loss = 2.580, top1 = 35.46%], test : [loss = 2.611, top1 = 34.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.88%], valid : [loss = 0.867, top1 = 68.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11550/15625) 011550-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.571, top1 = 87.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.409, top1 = 90.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 0.412, top1 = 88.28%], valid : [loss = 1.368, top1 = 64.74%], test : [loss = 1.416, top1 = 64.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.15 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.78%], valid : [loss = 2.532, top1 = 36.33%], test : [loss = 2.525, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11551/15625) 011551-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.68%], valid : [loss = 0.872, top1 = 71.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10        train : [loss = 0.553, top1 = 80.76%], test  : [loss = 0.722, top1 = 75.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.12 ms.
cifar100       train : [loss = 1.778, top1 = 52.10%], valid : [loss = 2.065, top1 = 47.66%], test : [loss = 2.047, top1 = 46.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.23 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.73%], valid : [loss = 3.642, top1 = 16.73%], test : [loss = 3.668, top1 = 15.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11552/15625) 011552-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.56 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.28%], valid : [loss = 0.528, top1 = 83.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10        train : [loss = 0.250, top1 = 91.49%], test  : [loss = 0.405, top1 = 86.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.70 ms.
cifar100       train : [loss = 1.305, top1 = 63.20%], valid : [loss = 1.586, top1 = 56.92%], test : [loss = 1.563, top1 = 57.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 2.861, top1 = 29.61%], valid : [loss = 2.874, top1 = 29.62%], test : [loss = 2.930, top1 = 28.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.80%], valid : [loss = 1.026, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11553/15625) 011553-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.638, top1 = 86.12%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10        train : [loss = 0.029, top1 = 99.31%], test  : [loss = 0.448, top1 = 89.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.21 ms.
cifar100       train : [loss = 0.346, top1 = 90.82%], valid : [loss = 1.422, top1 = 65.04%], test : [loss = 1.408, top1 = 64.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 2.251, top1 = 42.01%], valid : [loss = 2.602, top1 = 35.40%], test : [loss = 2.607, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.74%], valid : [loss = 0.816, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11554/15625) 011554-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.491, top1 = 89.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.21 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.335, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.330, top1 = 91.13%], valid : [loss = 1.273, top1 = 67.34%], test : [loss = 1.274, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.22%], valid : [loss = 2.408, top1 = 39.50%], test : [loss = 2.420, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11555/15625) 011555-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.564, top1 = 87.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.380, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 0.345, top1 = 90.42%], valid : [loss = 1.404, top1 = 66.44%], test : [loss = 1.398, top1 = 66.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.204, top1 = 42.98%], valid : [loss = 2.440, top1 = 37.97%], test : [loss = 2.462, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.60%], valid : [loss = 0.759, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11556/15625) 011556-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.36%], valid : [loss = 0.602, top1 = 85.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.068, top1 = 97.93%], test  : [loss = 0.399, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.69 ms.
cifar100       train : [loss = 0.696, top1 = 79.71%], valid : [loss = 1.392, top1 = 63.60%], test : [loss = 1.361, top1 = 64.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.34%], valid : [loss = 2.644, top1 = 33.93%], test : [loss = 2.678, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11557/15625) 011557-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.440, top1 = 89.79%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.87 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.308, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.42 ms.
cifar100       train : [loss = 0.119, top1 = 97.85%], valid : [loss = 1.286, top1 = 69.50%], test : [loss = 1.302, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 1.705, top1 = 54.33%], valid : [loss = 2.230, top1 = 43.50%], test : [loss = 2.226, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.414, top1 = 86.01%], valid : [loss = 0.528, top1 = 82.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11558/15625) 011558-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.452, top1 = 89.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=12.97 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.331, top1 = 91.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.91 ms.
cifar100       train : [loss = 0.293, top1 = 92.14%], valid : [loss = 1.317, top1 = 67.06%], test : [loss = 1.324, top1 = 68.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 46.98%], valid : [loss = 2.347, top1 = 40.20%], test : [loss = 2.345, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.448, top1 = 84.72%], valid : [loss = 0.542, top1 = 81.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11559/15625) 011559-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.48%], valid : [loss = 0.527, top1 = 86.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.108, top1 = 96.61%], test  : [loss = 0.367, top1 = 89.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.46 ms.
cifar100       train : [loss = 0.769, top1 = 77.83%], valid : [loss = 1.361, top1 = 63.58%], test : [loss = 1.305, top1 = 64.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.25 ms.
ImageNet16-120 train : [loss = 2.464, top1 = 37.57%], valid : [loss = 2.565, top1 = 35.50%], test : [loss = 2.592, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.37%], valid : [loss = 0.932, top1 = 67.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11560/15625) 011560-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.522, top1 = 88.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.33 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.344, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.86 ms.
cifar100       train : [loss = 0.327, top1 = 91.09%], valid : [loss = 1.280, top1 = 67.00%], test : [loss = 1.298, top1 = 66.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.165, top1 = 43.86%], valid : [loss = 2.418, top1 = 38.50%], test : [loss = 2.427, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 73.96%], valid : [loss = 0.788, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11561/15625) 011561-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.50 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.19%], valid : [loss = 0.679, top1 = 84.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10        train : [loss = 0.075, top1 = 97.65%], test  : [loss = 0.463, top1 = 87.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.33 ms.
cifar100       train : [loss = 0.747, top1 = 78.24%], valid : [loss = 1.487, top1 = 61.12%], test : [loss = 1.431, top1 = 61.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.688, top1 = 32.82%], valid : [loss = 2.798, top1 = 30.83%], test : [loss = 2.854, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.67%], valid : [loss = 0.832, top1 = 70.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11562/15625) 011562-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.12%], valid : [loss = 0.456, top1 = 86.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.64 ms.
cifar10        train : [loss = 0.155, top1 = 95.01%], test  : [loss = 0.348, top1 = 88.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.26 ms.
cifar100       train : [loss = 0.989, top1 = 71.82%], valid : [loss = 1.343, top1 = 62.57%], test : [loss = 1.337, top1 = 62.43%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.70%], valid : [loss = 2.709, top1 = 32.70%], test : [loss = 2.708, top1 = 32.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11563/15625) 011563-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.622, top1 = 86.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.404, top1 = 90.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.527, top1 = 84.48%], valid : [loss = 1.404, top1 = 63.64%], test : [loss = 1.432, top1 = 63.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 38.76%], valid : [loss = 2.561, top1 = 35.53%], test : [loss = 2.608, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.38%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11564/15625) 011564-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.423, top1 = 91.13%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.63%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.43 ms.
cifar100       train : [loss = 0.068, top1 = 98.99%], valid : [loss = 1.412, top1 = 69.18%], test : [loss = 1.318, top1 = 70.96%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 1.542, top1 = 58.31%], valid : [loss = 2.243, top1 = 43.20%], test : [loss = 2.247, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.98%], valid : [loss = 0.497, top1 = 83.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11565/15625) 011565-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.501, top1 = 90.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.320, top1 = 92.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.56 ms.
cifar100       train : [loss = 0.107, top1 = 98.05%], valid : [loss = 1.289, top1 = 69.74%], test : [loss = 1.258, top1 = 70.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.45%], valid : [loss = 2.178, top1 = 43.57%], test : [loss = 2.197, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11566/15625) 011566-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.24%], valid : [loss = 0.573, top1 = 86.33%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.45 ms.
cifar10        train : [loss = 0.037, top1 = 98.91%], test  : [loss = 0.340, top1 = 91.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.68 ms.
cifar100       train : [loss = 0.463, top1 = 86.86%], valid : [loss = 1.239, top1 = 66.14%], test : [loss = 1.251, top1 = 66.26%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 2.369, top1 = 39.18%], valid : [loss = 2.508, top1 = 36.47%], test : [loss = 2.482, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.883, top1 = 68.40%], valid : [loss = 0.905, top1 = 67.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11567/15625) 011567-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.552, top1 = 88.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.348, top1 = 92.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.196, top1 = 95.21%], valid : [loss = 1.316, top1 = 68.84%], test : [loss = 1.335, top1 = 68.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.69%], valid : [loss = 2.262, top1 = 41.10%], test : [loss = 2.285, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.11%], valid : [loss = 0.659, top1 = 77.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11568/15625) 011568-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.571, top1 = 87.55%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.88 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.370, top1 = 91.40%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.35 ms.
cifar100       train : [loss = 0.264, top1 = 92.85%], valid : [loss = 1.309, top1 = 67.72%], test : [loss = 1.329, top1 = 67.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.26%], valid : [loss = 2.620, top1 = 33.17%], test : [loss = 2.629, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.56%], valid : [loss = 0.969, top1 = 65.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11569/15625) 011569-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.538, top1 = 88.66%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.332, top1 = 92.17%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.75 ms.
cifar100       train : [loss = 0.308, top1 = 91.33%], valid : [loss = 1.302, top1 = 67.14%], test : [loss = 1.316, top1 = 67.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.27%], valid : [loss = 2.413, top1 = 38.65%], test : [loss = 2.441, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.37%], valid : [loss = 0.802, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11570/15625) 011570-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.443, top1 = 89.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.326, top1 = 91.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.33 ms.
cifar100       train : [loss = 0.334, top1 = 90.95%], valid : [loss = 1.304, top1 = 67.38%], test : [loss = 1.303, top1 = 67.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.49 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.25%], valid : [loss = 2.370, top1 = 39.67%], test : [loss = 2.418, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11571/15625) 011571-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.58%], valid : [loss = 0.523, top1 = 83.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.13 ms.
cifar10        train : [loss = 0.245, top1 = 91.67%], test  : [loss = 0.401, top1 = 86.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 1.347, top1 = 62.22%], valid : [loss = 1.640, top1 = 55.79%], test : [loss = 1.599, top1 = 56.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.839, top1 = 30.00%], valid : [loss = 2.847, top1 = 29.88%], test : [loss = 2.893, top1 = 28.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.956, top1 = 65.69%], valid : [loss = 1.006, top1 = 64.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11572/15625) 011572-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.02%], valid : [loss = 0.476, top1 = 84.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.298, top1 = 90.06%], test  : [loss = 0.403, top1 = 86.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.86 ms.
cifar100       train : [loss = 1.327, top1 = 63.19%], valid : [loss = 1.530, top1 = 58.30%], test : [loss = 1.513, top1 = 58.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.59%], valid : [loss = 2.903, top1 = 29.50%], test : [loss = 2.963, top1 = 28.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11573/15625) 011573-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.535, top1 = 89.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=13.45 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.383, top1 = 92.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.40 ms.
cifar100       train : [loss = 0.092, top1 = 98.50%], valid : [loss = 1.473, top1 = 67.90%], test : [loss = 1.488, top1 = 67.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.24%], valid : [loss = 2.420, top1 = 40.17%], test : [loss = 2.390, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.19%], valid : [loss = 0.701, top1 = 75.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11574/15625) 011574-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.531, top1 = 88.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.340, top1 = 91.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.08 ms.
cifar100       train : [loss = 0.357, top1 = 90.15%], valid : [loss = 1.269, top1 = 66.60%], test : [loss = 1.292, top1 = 66.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.79 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.70%], valid : [loss = 2.389, top1 = 39.30%], test : [loss = 2.428, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11575/15625) 011575-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.36 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11576/15625) 011576-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.71%], valid : [loss = 0.676, top1 = 83.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.075, top1 = 97.62%], test  : [loss = 0.409, top1 = 88.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.23 ms.
cifar100       train : [loss = 0.768, top1 = 77.42%], valid : [loss = 1.444, top1 = 61.60%], test : [loss = 1.434, top1 = 62.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.47%], valid : [loss = 2.678, top1 = 33.17%], test : [loss = 2.710, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.10%], valid : [loss = 0.865, top1 = 69.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11577/15625) 011577-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.38 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.516, top1 = 87.98%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.12 ms.
cifar10        train : [loss = 0.027, top1 = 99.27%], test  : [loss = 0.359, top1 = 90.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.22 ms.
cifar100       train : [loss = 0.482, top1 = 85.86%], valid : [loss = 1.368, top1 = 64.70%], test : [loss = 1.359, top1 = 65.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.320, top1 = 40.58%], valid : [loss = 2.508, top1 = 37.23%], test : [loss = 2.544, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11578/15625) 011578-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.541, top1 = 88.63%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.348, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.93 ms.
cifar100       train : [loss = 0.338, top1 = 90.80%], valid : [loss = 1.295, top1 = 67.32%], test : [loss = 1.280, top1 = 67.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.43%], valid : [loss = 2.393, top1 = 38.97%], test : [loss = 2.391, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.41%], valid : [loss = 0.782, top1 = 72.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11579/15625) 011579-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.555, top1 = 87.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.345, top1 = 91.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.15 ms.
cifar100       train : [loss = 0.422, top1 = 87.87%], valid : [loss = 1.271, top1 = 66.74%], test : [loss = 1.273, top1 = 66.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.24%], valid : [loss = 2.417, top1 = 39.47%], test : [loss = 2.450, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.86%], valid : [loss = 0.850, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11580/15625) 011580-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.547, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.394, top1 = 91.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 0.268, top1 = 92.72%], valid : [loss = 1.478, top1 = 65.26%], test : [loss = 1.440, top1 = 65.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.96 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.68%], valid : [loss = 2.497, top1 = 36.83%], test : [loss = 2.516, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.02%], valid : [loss = 0.635, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11581/15625) 011581-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 49.73 M, Params=0.363 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.47%], valid : [loss = 0.467, top1 = 85.93%]
cifar10        FLOP= 49.73 M, Params=0.363 MB, latency=17.03 ms.
cifar10        train : [loss = 0.160, top1 = 94.76%], test  : [loss = 0.351, top1 = 88.77%]
cifar100       FLOP= 49.73 M, Params=0.369 MB, latency=16.30 ms.
cifar100       train : [loss = 1.025, top1 = 70.92%], valid : [loss = 1.359, top1 = 61.78%], test : [loss = 1.371, top1 = 61.75%]
ImageNet16-120 FLOP= 12.44 M, Params=0.370 MB, latency=17.81 ms.
ImageNet16-120 train : [loss = 2.652, top1 = 33.58%], valid : [loss = 2.702, top1 = 32.70%], test : [loss = 2.710, top1 = 32.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11582/15625) 011582-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.86 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.47%], valid : [loss = 0.648, top1 = 84.36%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.084, top1 = 97.25%], test  : [loss = 0.429, top1 = 87.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.18 ms.
cifar100       train : [loss = 0.862, top1 = 74.92%], valid : [loss = 1.586, top1 = 58.88%], test : [loss = 1.544, top1 = 59.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.569, top1 = 35.21%], valid : [loss = 2.710, top1 = 32.27%], test : [loss = 2.738, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.843, top1 = 70.16%], valid : [loss = 0.901, top1 = 68.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11583/15625) 011583-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.89%], valid : [loss = 0.575, top1 = 87.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.018, top1 = 99.59%], test  : [loss = 0.393, top1 = 90.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.50 ms.
cifar100       train : [loss = 0.434, top1 = 87.53%], valid : [loss = 1.396, top1 = 64.96%], test : [loss = 1.398, top1 = 64.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.48%], valid : [loss = 2.513, top1 = 36.40%], test : [loss = 2.536, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.22%], valid : [loss = 0.792, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11584/15625) 011584-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.418, top1 = 91.28%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.27 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.293, top1 = 93.79%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.72 ms.
cifar100       train : [loss = 0.028, top1 = 99.73%], valid : [loss = 1.333, top1 = 71.88%], test : [loss = 1.335, top1 = 71.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.79 ms.
ImageNet16-120 train : [loss = 1.291, top1 = 64.56%], valid : [loss = 2.209, top1 = 46.40%], test : [loss = 2.218, top1 = 46.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.326, top1 = 88.85%], valid : [loss = 0.470, top1 = 84.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11585/15625) 011585-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.584, top1 = 88.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.393, top1 = 91.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.35 ms.
cifar100       train : [loss = 0.174, top1 = 96.04%], valid : [loss = 1.472, top1 = 66.28%], test : [loss = 1.535, top1 = 65.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.94 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.26%], valid : [loss = 2.494, top1 = 37.80%], test : [loss = 2.535, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.13%], valid : [loss = 0.765, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11586/15625) 011586-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.209, top1 = 93.01%], valid : [loss = 0.572, top1 = 83.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.212, top1 = 92.73%], test  : [loss = 0.386, top1 = 87.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.98 ms.
cifar100       train : [loss = 1.228, top1 = 65.03%], valid : [loss = 1.547, top1 = 57.66%], test : [loss = 1.549, top1 = 57.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 2.751, top1 = 31.54%], valid : [loss = 2.786, top1 = 30.90%], test : [loss = 2.833, top1 = 29.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.90%], valid : [loss = 1.005, top1 = 64.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11587/15625) 011587-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.555, top1 = 88.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.11 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.80 ms.
cifar100       train : [loss = 0.250, top1 = 93.42%], valid : [loss = 1.230, top1 = 68.66%], test : [loss = 1.253, top1 = 69.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.84 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.27%], valid : [loss = 2.222, top1 = 42.57%], test : [loss = 2.246, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.17%], valid : [loss = 0.780, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11588/15625) 011588-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.42%], valid : [loss = 0.576, top1 = 86.98%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.44 ms.
cifar10        train : [loss = 0.032, top1 = 98.97%], test  : [loss = 0.380, top1 = 90.71%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.82 ms.
cifar100       train : [loss = 0.412, top1 = 88.02%], valid : [loss = 1.340, top1 = 65.80%], test : [loss = 1.330, top1 = 65.72%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.202, top1 = 42.97%], valid : [loss = 2.396, top1 = 39.07%], test : [loss = 2.449, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.66%], valid : [loss = 0.906, top1 = 67.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11589/15625) 011589-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 0.144, top1 = 95.42%], valid : [loss = 0.540, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.91 ms.
cifar10        train : [loss = 0.155, top1 = 94.82%], test  : [loss = 0.377, top1 = 88.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 1.134, top1 = 67.60%], valid : [loss = 1.480, top1 = 59.47%], test : [loss = 1.470, top1 = 59.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.573, top1 = 35.22%], valid : [loss = 2.645, top1 = 33.82%], test : [loss = 2.667, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.58%], valid : [loss = 0.936, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11590/15625) 011590-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.550, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.386, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.105, top1 = 98.19%], valid : [loss = 1.488, top1 = 67.34%], test : [loss = 1.431, top1 = 68.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.20%], valid : [loss = 2.448, top1 = 39.47%], test : [loss = 2.439, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.14%], valid : [loss = 0.776, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11591/15625) 011591-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.573, top1 = 87.50%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.385, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.63 ms.
cifar100       train : [loss = 0.366, top1 = 89.78%], valid : [loss = 1.373, top1 = 65.50%], test : [loss = 1.390, top1 = 65.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.10%], valid : [loss = 2.500, top1 = 36.90%], test : [loss = 2.533, top1 = 37.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.54%], valid : [loss = 0.782, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11592/15625) 011592-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.516, top1 = 89.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.67 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.309, top1 = 92.72%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.157, top1 = 96.65%], valid : [loss = 1.296, top1 = 67.32%], test : [loss = 1.295, top1 = 68.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.20%], valid : [loss = 2.310, top1 = 41.10%], test : [loss = 2.301, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11593/15625) 011593-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.509, top1 = 88.33%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.21 ms.
cifar10        train : [loss = 0.027, top1 = 99.36%], test  : [loss = 0.362, top1 = 90.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.30 ms.
cifar100       train : [loss = 0.353, top1 = 90.42%], valid : [loss = 1.338, top1 = 66.82%], test : [loss = 1.340, top1 = 67.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.20%], valid : [loss = 2.413, top1 = 38.90%], test : [loss = 2.401, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.511, top1 = 82.17%], valid : [loss = 0.594, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11594/15625) 011594-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.75 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.38%], valid : [loss = 0.658, top1 = 82.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.148, top1 = 95.05%], test  : [loss = 0.478, top1 = 86.18%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.79 ms.
cifar100       train : [loss = 0.939, top1 = 72.86%], valid : [loss = 1.658, top1 = 56.28%], test : [loss = 1.649, top1 = 57.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 3.050, top1 = 25.59%], valid : [loss = 3.135, top1 = 24.00%], test : [loss = 3.169, top1 = 23.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11595/15625) 011595-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.78%], valid : [loss = 0.587, top1 = 81.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.03 ms.
cifar10        train : [loss = 0.216, top1 = 92.55%], test  : [loss = 0.414, top1 = 86.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.29 ms.
cifar100       train : [loss = 1.222, top1 = 65.46%], valid : [loss = 1.631, top1 = 57.04%], test : [loss = 1.594, top1 = 57.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.902, top1 = 29.06%], valid : [loss = 2.941, top1 = 28.10%], test : [loss = 3.010, top1 = 27.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 59.87%], valid : [loss = 1.172, top1 = 58.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11596/15625) 011596-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.29%], valid : [loss = 0.528, top1 = 82.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.25 ms.
cifar10        train : [loss = 0.389, top1 = 86.69%], test  : [loss = 0.461, top1 = 84.22%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.13 ms.
cifar100       train : [loss = 1.565, top1 = 57.07%], valid : [loss = 1.672, top1 = 53.60%], test : [loss = 1.661, top1 = 54.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.69 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.31%], valid : [loss = 3.008, top1 = 26.30%], test : [loss = 3.050, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11597/15625) 011597-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.513, top1 = 88.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.330, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.33 ms.
cifar100       train : [loss = 0.335, top1 = 90.80%], valid : [loss = 1.278, top1 = 67.30%], test : [loss = 1.287, top1 = 67.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.64%], valid : [loss = 2.407, top1 = 39.46%], test : [loss = 2.411, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11598/15625) 011598-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.507, top1 = 89.35%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.303, top1 = 93.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.20 ms.
cifar100       train : [loss = 0.127, top1 = 97.51%], valid : [loss = 1.302, top1 = 68.92%], test : [loss = 1.300, top1 = 69.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.38%], valid : [loss = 2.291, top1 = 41.60%], test : [loss = 2.280, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11599/15625) 011599-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.585, top1 = 88.07%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.55 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.355, top1 = 92.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.53 ms.
cifar100       train : [loss = 0.086, top1 = 98.90%], valid : [loss = 1.487, top1 = 66.38%], test : [loss = 1.461, top1 = 66.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.30%], valid : [loss = 2.423, top1 = 40.07%], test : [loss = 2.457, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.68%], valid : [loss = 0.669, top1 = 76.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11600/15625) 011600-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.45 ms.
cifar100       train : [loss = 0.326, top1 = 91.18%], valid : [loss = 1.313, top1 = 66.96%], test : [loss = 1.282, top1 = 67.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.28%], valid : [loss = 2.353, top1 = 39.37%], test : [loss = 2.389, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.46%], valid : [loss = 0.555, top1 = 80.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11601/15625) 011601-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.495, top1 = 89.61%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=15.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.308, top1 = 93.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=22.97 ms.
cifar100       train : [loss = 0.129, top1 = 97.48%], valid : [loss = 1.295, top1 = 69.38%], test : [loss = 1.270, top1 = 69.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.78%], valid : [loss = 2.279, top1 = 42.60%], test : [loss = 2.291, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.79%], valid : [loss = 0.645, top1 = 77.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11602/15625) 011602-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.530, top1 = 89.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.369, top1 = 92.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.62 ms.
cifar100       train : [loss = 0.136, top1 = 96.90%], valid : [loss = 1.361, top1 = 69.28%], test : [loss = 1.362, top1 = 69.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.39%], valid : [loss = 2.222, top1 = 43.00%], test : [loss = 2.261, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.46%], valid : [loss = 0.845, top1 = 70.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11603/15625) 011603-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.597, top1 = 87.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.415, top1 = 91.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.72 ms.
cifar100       train : [loss = 0.180, top1 = 95.93%], valid : [loss = 1.512, top1 = 65.90%], test : [loss = 1.454, top1 = 66.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.65 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.50%], valid : [loss = 2.477, top1 = 38.13%], test : [loss = 2.516, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.28%], valid : [loss = 0.780, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11604/15625) 011604-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.542, top1 = 80.82%], valid : [loss = 0.842, top1 = 72.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10        train : [loss = 0.570, top1 = 80.00%], test  : [loss = 0.715, top1 = 75.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.58 ms.
cifar100       train : [loss = 1.782, top1 = 52.30%], valid : [loss = 2.043, top1 = 47.02%], test : [loss = 2.082, top1 = 46.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.75%], valid : [loss = 3.637, top1 = 16.53%], test : [loss = 3.669, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11605/15625) 011605-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11606/15625) 011606-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.476, top1 = 89.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.310, top1 = 92.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.15 ms.
cifar100       train : [loss = 0.315, top1 = 91.56%], valid : [loss = 1.239, top1 = 68.12%], test : [loss = 1.253, top1 = 68.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.60%], valid : [loss = 2.328, top1 = 40.96%], test : [loss = 2.343, top1 = 40.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.21%], valid : [loss = 0.620, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11607/15625) 011607-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.196, top1 = 93.42%], valid : [loss = 0.537, top1 = 84.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10        train : [loss = 0.196, top1 = 93.34%], test  : [loss = 0.393, top1 = 87.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 1.252, top1 = 64.39%], valid : [loss = 1.559, top1 = 57.82%], test : [loss = 1.548, top1 = 57.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 2.699, top1 = 32.57%], valid : [loss = 2.729, top1 = 32.09%], test : [loss = 2.756, top1 = 32.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11608/15625) 011608-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.549, top1 = 87.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.71 ms.
cifar10        train : [loss = 0.040, top1 = 98.78%], test  : [loss = 0.358, top1 = 90.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 0.477, top1 = 86.18%], valid : [loss = 1.312, top1 = 65.48%], test : [loss = 1.344, top1 = 65.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.03 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 32.76%], valid : [loss = 2.731, top1 = 31.43%], test : [loss = 2.740, top1 = 31.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.122, top1 = 59.16%], valid : [loss = 1.147, top1 = 58.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11609/15625) 011609-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.375, top1 = 87.01%], valid : [loss = 0.631, top1 = 79.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10        train : [loss = 0.291, top1 = 90.06%], test  : [loss = 0.441, top1 = 85.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 1.563, top1 = 56.55%], valid : [loss = 1.791, top1 = 51.47%], test : [loss = 1.781, top1 = 51.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 3.092, top1 = 25.00%], valid : [loss = 3.092, top1 = 25.34%], test : [loss = 3.162, top1 = 23.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.93%], valid : [loss = 1.015, top1 = 63.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11610/15625) 011610-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.10%], valid : [loss = 0.691, top1 = 83.82%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.86 ms.
cifar10        train : [loss = 0.052, top1 = 98.46%], test  : [loss = 0.411, top1 = 89.25%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.55 ms.
cifar100       train : [loss = 0.639, top1 = 81.23%], valid : [loss = 1.430, top1 = 63.00%], test : [loss = 1.446, top1 = 62.94%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.09%], valid : [loss = 2.619, top1 = 34.20%], test : [loss = 2.666, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.82%], valid : [loss = 0.865, top1 = 69.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11611/15625) 011611-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.17%], valid : [loss = 0.716, top1 = 80.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10        train : [loss = 0.212, top1 = 92.51%], test  : [loss = 0.542, top1 = 83.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.31 ms.
cifar100       train : [loss = 0.881, top1 = 74.42%], valid : [loss = 1.661, top1 = 57.04%], test : [loss = 1.680, top1 = 56.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 3.552, top1 = 16.00%], valid : [loss = 3.541, top1 = 16.10%], test : [loss = 3.538, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.38%], valid : [loss = 1.303, top1 = 52.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11612/15625) 011612-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.06%], valid : [loss = 0.534, top1 = 87.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.03 ms.
cifar10        train : [loss = 0.077, top1 = 97.55%], test  : [loss = 0.385, top1 = 89.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.37 ms.
cifar100       train : [loss = 0.720, top1 = 78.72%], valid : [loss = 1.353, top1 = 64.40%], test : [loss = 1.340, top1 = 64.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.65 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.52%], valid : [loss = 2.613, top1 = 34.57%], test : [loss = 2.655, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.99%], valid : [loss = 0.683, top1 = 76.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11613/15625) 011613-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.75 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11614/15625) 011614-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.99 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.543, top1 = 89.51%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.328, top1 = 93.35%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.37 ms.
cifar100       train : [loss = 0.067, top1 = 98.94%], valid : [loss = 1.375, top1 = 69.74%], test : [loss = 1.398, top1 = 70.56%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.667, top1 = 55.21%], valid : [loss = 2.188, top1 = 43.67%], test : [loss = 2.210, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.65%], valid : [loss = 0.701, top1 = 75.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11615/15625) 011615-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.41%], valid : [loss = 0.562, top1 = 87.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.034, top1 = 98.97%], test  : [loss = 0.349, top1 = 91.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.90 ms.
cifar100       train : [loss = 0.588, top1 = 83.30%], valid : [loss = 1.417, top1 = 62.98%], test : [loss = 1.386, top1 = 63.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.39%], valid : [loss = 2.564, top1 = 34.20%], test : [loss = 2.602, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.12%], valid : [loss = 0.951, top1 = 65.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11616/15625) 011616-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.33%], valid : [loss = 0.456, top1 = 86.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.157, top1 = 94.96%], test  : [loss = 0.344, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.80 ms.
cifar100       train : [loss = 0.983, top1 = 72.00%], valid : [loss = 1.348, top1 = 62.34%], test : [loss = 1.342, top1 = 62.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.81%], valid : [loss = 2.670, top1 = 32.43%], test : [loss = 2.720, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11617/15625) 011617-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.492, top1 = 89.21%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.87 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.312, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=15.72 ms.
cifar100       train : [loss = 0.277, top1 = 92.71%], valid : [loss = 1.236, top1 = 68.62%], test : [loss = 1.233, top1 = 68.70%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.932, top1 = 48.98%], valid : [loss = 2.240, top1 = 42.71%], test : [loss = 2.260, top1 = 42.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.53%], valid : [loss = 0.604, top1 = 79.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11618/15625) 011618-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.20%], valid : [loss = 0.534, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.183, top1 = 93.82%], test  : [loss = 0.391, top1 = 87.64%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 1.176, top1 = 66.52%], valid : [loss = 1.511, top1 = 58.81%], test : [loss = 1.504, top1 = 58.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.72 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 34.03%], valid : [loss = 2.693, top1 = 33.04%], test : [loss = 2.738, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.27%], valid : [loss = 0.970, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11619/15625) 011619-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.510, top1 = 88.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.027, top1 = 99.26%], test  : [loss = 0.342, top1 = 91.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.88 ms.
cifar100       train : [loss = 0.476, top1 = 86.01%], valid : [loss = 1.351, top1 = 65.48%], test : [loss = 1.348, top1 = 65.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.27%], valid : [loss = 2.534, top1 = 36.10%], test : [loss = 2.561, top1 = 35.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11620/15625) 011620-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.607, top1 = 87.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.418, top1 = 90.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.175, top1 = 96.04%], valid : [loss = 1.506, top1 = 65.86%], test : [loss = 1.506, top1 = 65.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.30%], valid : [loss = 2.487, top1 = 37.00%], test : [loss = 2.480, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.04%], valid : [loss = 0.738, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11621/15625) 011621-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.62 ms.
cifar10-valid  train : [loss = 0.623, top1 = 77.90%], valid : [loss = 0.759, top1 = 74.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.47 ms.
cifar10        train : [loss = 0.554, top1 = 80.74%], test  : [loss = 0.628, top1 = 78.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.85 ms.
cifar100       train : [loss = 1.974, top1 = 46.43%], valid : [loss = 2.096, top1 = 44.02%], test : [loss = 2.105, top1 = 44.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 3.007, top1 = 26.53%], valid : [loss = 2.986, top1 = 27.08%], test : [loss = 3.028, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.145, top1 = 58.56%], valid : [loss = 1.191, top1 = 57.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11622/15625) 011622-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.20%], valid : [loss = 0.597, top1 = 84.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10        train : [loss = 0.092, top1 = 96.95%], test  : [loss = 0.429, top1 = 88.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.36 ms.
cifar100       train : [loss = 0.701, top1 = 79.20%], valid : [loss = 1.505, top1 = 60.56%], test : [loss = 1.513, top1 = 61.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 3.174, top1 = 22.57%], valid : [loss = 3.183, top1 = 22.77%], test : [loss = 3.206, top1 = 21.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.96%], valid : [loss = 1.085, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11623/15625) 011623-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.323, top1 = 91.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.292, top1 = 66.88%], test : [loss = 1.305, top1 = 67.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.10%], valid : [loss = 2.396, top1 = 39.60%], test : [loss = 2.433, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.450, top1 = 84.33%], valid : [loss = 0.557, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11624/15625) 011624-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.04%], valid : [loss = 0.672, top1 = 84.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10        train : [loss = 0.057, top1 = 98.21%], test  : [loss = 0.426, top1 = 88.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.633, top1 = 81.42%], valid : [loss = 1.461, top1 = 62.30%], test : [loss = 1.449, top1 = 62.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.402, top1 = 38.67%], valid : [loss = 2.575, top1 = 35.27%], test : [loss = 2.622, top1 = 34.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.52%], valid : [loss = 0.912, top1 = 67.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11625/15625) 011625-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10-valid  train : [loss = 0.094, top1 = 97.13%], valid : [loss = 0.852, top1 = 79.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10        train : [loss = 0.134, top1 = 95.55%], test  : [loss = 0.495, top1 = 85.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.61 ms.
cifar100       train : [loss = 1.021, top1 = 70.56%], valid : [loss = 1.712, top1 = 55.64%], test : [loss = 1.729, top1 = 56.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 2.886, top1 = 28.82%], valid : [loss = 2.994, top1 = 27.03%], test : [loss = 3.058, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.74%], valid : [loss = 0.913, top1 = 67.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11626/15625) 011626-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.43%], valid : [loss = 0.519, top1 = 83.70%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.244, top1 = 91.65%], test  : [loss = 0.392, top1 = 87.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.58 ms.
cifar100       train : [loss = 1.314, top1 = 63.02%], valid : [loss = 1.578, top1 = 56.99%], test : [loss = 1.574, top1 = 57.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.68 ms.
ImageNet16-120 train : [loss = 2.862, top1 = 29.48%], valid : [loss = 2.874, top1 = 29.99%], test : [loss = 2.924, top1 = 28.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.41%], valid : [loss = 0.984, top1 = 65.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11627/15625) 011627-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.517, top1 = 89.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.325, top1 = 92.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.36 ms.
cifar100       train : [loss = 0.150, top1 = 96.79%], valid : [loss = 1.268, top1 = 69.47%], test : [loss = 1.279, top1 = 69.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.25%], valid : [loss = 2.298, top1 = 41.51%], test : [loss = 2.298, top1 = 41.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11628/15625) 011628-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.523, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.355, top1 = 92.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.65 ms.
cifar100       train : [loss = 0.132, top1 = 97.04%], valid : [loss = 1.372, top1 = 68.26%], test : [loss = 1.345, top1 = 68.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.86%], valid : [loss = 2.374, top1 = 39.37%], test : [loss = 2.405, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.19%], valid : [loss = 0.877, top1 = 68.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11629/15625) 011629-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.23%], valid : [loss = 0.481, top1 = 84.20%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.07 ms.
cifar10        train : [loss = 0.299, top1 = 89.97%], test  : [loss = 0.399, top1 = 86.28%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.37 ms.
cifar100       train : [loss = 1.343, top1 = 62.57%], valid : [loss = 1.537, top1 = 58.30%], test : [loss = 1.524, top1 = 57.60%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.940, top1 = 28.13%], valid : [loss = 2.930, top1 = 28.90%], test : [loss = 2.974, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 75.24%], valid : [loss = 0.761, top1 = 73.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11630/15625) 011630-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.096, top1 = 96.84%], valid : [loss = 0.599, top1 = 84.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.122, top1 = 95.92%], test  : [loss = 0.414, top1 = 88.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.690, top1 = 79.73%], valid : [loss = 1.520, top1 = 60.38%], test : [loss = 1.538, top1 = 60.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 3.197, top1 = 22.10%], valid : [loss = 3.201, top1 = 21.67%], test : [loss = 3.252, top1 = 20.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.046, top1 = 62.05%], valid : [loss = 1.088, top1 = 61.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11631/15625) 011631-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.565, top1 = 88.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.58 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.391, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.71 ms.
cifar100       train : [loss = 0.152, top1 = 96.77%], valid : [loss = 1.407, top1 = 67.24%], test : [loss = 1.432, top1 = 67.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.79%], valid : [loss = 2.393, top1 = 39.40%], test : [loss = 2.408, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.52%], valid : [loss = 0.707, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11632/15625) 011632-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.630, top1 = 86.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 0.022, top1 = 99.46%], test  : [loss = 0.439, top1 = 90.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.96 ms.
cifar100       train : [loss = 0.304, top1 = 91.81%], valid : [loss = 1.578, top1 = 63.54%], test : [loss = 1.597, top1 = 63.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.216, top1 = 42.76%], valid : [loss = 2.551, top1 = 36.17%], test : [loss = 2.566, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.49%], valid : [loss = 0.828, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11633/15625) 011633-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.456, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.319, top1 = 91.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.31 ms.
cifar100       train : [loss = 0.330, top1 = 91.14%], valid : [loss = 1.320, top1 = 66.84%], test : [loss = 1.306, top1 = 67.41%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.04%], valid : [loss = 2.375, top1 = 40.18%], test : [loss = 2.417, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.76%], valid : [loss = 0.562, top1 = 81.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11634/15625) 011634-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.533, top1 = 88.75%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.335, top1 = 92.16%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.65 ms.
cifar100       train : [loss = 0.296, top1 = 91.72%], valid : [loss = 1.334, top1 = 67.86%], test : [loss = 1.350, top1 = 66.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.32%], valid : [loss = 2.408, top1 = 38.27%], test : [loss = 2.418, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 68.98%], valid : [loss = 0.892, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11635/15625) 011635-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.44%], valid : [loss = 0.445, top1 = 87.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.96 ms.
cifar10        train : [loss = 0.118, top1 = 96.30%], test  : [loss = 0.326, top1 = 89.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 0.878, top1 = 74.99%], valid : [loss = 1.287, top1 = 63.86%], test : [loss = 1.269, top1 = 64.64%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.31 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.71%], valid : [loss = 2.634, top1 = 34.23%], test : [loss = 2.650, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11636/15625) 011636-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.547, top1 = 88.44%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.94 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.352, top1 = 91.97%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.58 ms.
cifar100       train : [loss = 0.297, top1 = 91.65%], valid : [loss = 1.314, top1 = 67.94%], test : [loss = 1.334, top1 = 67.24%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.04%], valid : [loss = 2.419, top1 = 38.37%], test : [loss = 2.419, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.70%], valid : [loss = 0.873, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11637/15625) 011637-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.472, top1 = 89.57%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.61 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.299, top1 = 92.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.23 ms.
cifar100       train : [loss = 0.138, top1 = 97.28%], valid : [loss = 1.303, top1 = 68.99%], test : [loss = 1.273, top1 = 69.51%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.740, top1 = 53.54%], valid : [loss = 2.195, top1 = 43.71%], test : [loss = 2.212, top1 = 43.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.470, top1 = 83.93%], valid : [loss = 0.572, top1 = 80.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11638/15625) 011638-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.555, top1 = 89.29%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.68 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.329, top1 = 93.38%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.96 ms.
cifar100       train : [loss = 0.035, top1 = 99.71%], valid : [loss = 1.433, top1 = 69.98%], test : [loss = 1.401, top1 = 69.42%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 1.567, top1 = 57.63%], valid : [loss = 2.428, top1 = 41.33%], test : [loss = 2.401, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.64%], valid : [loss = 0.726, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11639/15625) 011639-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=16.55 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.31%], valid : [loss = 0.453, top1 = 87.03%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=15.49 ms.
cifar10        train : [loss = 0.114, top1 = 96.43%], test  : [loss = 0.330, top1 = 89.53%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=14.73 ms.
cifar100       train : [loss = 0.860, top1 = 75.35%], valid : [loss = 1.293, top1 = 63.89%], test : [loss = 1.278, top1 = 63.92%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.71%], valid : [loss = 2.631, top1 = 34.30%], test : [loss = 2.657, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.66%], valid : [loss = 0.650, top1 = 77.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11640/15625) 011640-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.98%], valid : [loss = 0.997, top1 = 66.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10        train : [loss = 0.783, top1 = 72.54%], test  : [loss = 0.851, top1 = 70.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.86 ms.
cifar100       train : [loss = 2.146, top1 = 43.66%], valid : [loss = 2.321, top1 = 41.12%], test : [loss = 2.339, top1 = 40.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 3.754, top1 = 14.14%], valid : [loss = 3.782, top1 = 14.33%], test : [loss = 3.790, top1 = 13.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.466, top1 = 46.26%], valid : [loss = 1.487, top1 = 45.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11641/15625) 011641-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.576, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.27 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.376, top1 = 92.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.172, top1 = 96.22%], valid : [loss = 1.373, top1 = 67.96%], test : [loss = 1.369, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 48.00%], valid : [loss = 2.503, top1 = 37.80%], test : [loss = 2.476, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.52%], valid : [loss = 0.715, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11642/15625) 011642-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.103, top1 = 96.60%], valid : [loss = 0.609, top1 = 83.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10        train : [loss = 0.117, top1 = 96.06%], test  : [loss = 0.417, top1 = 88.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.07 ms.
cifar100       train : [loss = 0.669, top1 = 80.17%], valid : [loss = 1.471, top1 = 61.44%], test : [loss = 1.556, top1 = 60.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 3.279, top1 = 20.46%], valid : [loss = 3.272, top1 = 20.37%], test : [loss = 3.287, top1 = 20.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.240, top1 = 54.70%], valid : [loss = 1.242, top1 = 54.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11643/15625) 011643-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.44%], valid : [loss = 0.571, top1 = 86.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10        train : [loss = 0.031, top1 = 99.11%], test  : [loss = 0.372, top1 = 90.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.462, top1 = 86.83%], valid : [loss = 1.317, top1 = 65.80%], test : [loss = 1.358, top1 = 65.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 35.81%], valid : [loss = 2.624, top1 = 33.83%], test : [loss = 2.638, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11644/15625) 011644-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.69%], valid : [loss = 0.659, top1 = 83.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10        train : [loss = 0.073, top1 = 97.71%], test  : [loss = 0.398, top1 = 88.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.29 ms.
cifar100       train : [loss = 0.776, top1 = 77.15%], valid : [loss = 1.419, top1 = 62.22%], test : [loss = 1.417, top1 = 61.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.65%], valid : [loss = 2.691, top1 = 32.93%], test : [loss = 2.739, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.81%], valid : [loss = 0.879, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11645/15625) 011645-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.86 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.63%], valid : [loss = 0.561, top1 = 82.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.78 ms.
cifar10        train : [loss = 0.258, top1 = 91.15%], test  : [loss = 0.411, top1 = 86.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 1.523, top1 = 57.47%], valid : [loss = 1.756, top1 = 52.79%], test : [loss = 1.749, top1 = 52.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.30 ms.
ImageNet16-120 train : [loss = 2.930, top1 = 28.04%], valid : [loss = 2.942, top1 = 27.88%], test : [loss = 2.999, top1 = 26.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11646/15625) 011646-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.62%], valid : [loss = 0.542, top1 = 87.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10        train : [loss = 0.025, top1 = 99.29%], test  : [loss = 0.339, top1 = 91.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.85 ms.
cifar100       train : [loss = 0.424, top1 = 87.76%], valid : [loss = 1.261, top1 = 67.38%], test : [loss = 1.292, top1 = 66.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.94 ms.
ImageNet16-120 train : [loss = 2.228, top1 = 42.33%], valid : [loss = 2.432, top1 = 38.40%], test : [loss = 2.441, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.35%], valid : [loss = 0.839, top1 = 70.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11647/15625) 011647-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.517, top1 = 89.53%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.38 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.333, top1 = 93.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.93 ms.
cifar100       train : [loss = 0.042, top1 = 99.52%], valid : [loss = 1.453, top1 = 69.08%], test : [loss = 1.441, top1 = 68.98%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 1.654, top1 = 55.62%], valid : [loss = 2.393, top1 = 40.17%], test : [loss = 2.387, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.04%], valid : [loss = 0.665, top1 = 77.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11648/15625) 011648-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.673, top1 = 85.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.054, top1 = 98.34%], test  : [loss = 0.405, top1 = 89.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.93 ms.
cifar100       train : [loss = 0.636, top1 = 81.53%], valid : [loss = 1.539, top1 = 61.18%], test : [loss = 1.519, top1 = 61.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.682, top1 = 33.13%], valid : [loss = 2.851, top1 = 29.93%], test : [loss = 2.879, top1 = 29.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.96%], valid : [loss = 0.872, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11649/15625) 011649-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.21 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.24%], valid : [loss = 0.716, top1 = 83.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.71 ms.
cifar10        train : [loss = 0.057, top1 = 98.28%], test  : [loss = 0.495, top1 = 87.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.33 ms.
cifar100       train : [loss = 0.656, top1 = 80.78%], valid : [loss = 1.520, top1 = 61.72%], test : [loss = 1.483, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 2.698, top1 = 32.67%], valid : [loss = 2.831, top1 = 30.67%], test : [loss = 2.870, top1 = 29.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.84%], valid : [loss = 0.884, top1 = 68.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11650/15625) 011650-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.50%], valid : [loss = 0.741, top1 = 74.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.80 ms.
cifar10        train : [loss = 0.568, top1 = 80.28%], test  : [loss = 0.630, top1 = 78.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.32 ms.
cifar100       train : [loss = 1.972, top1 = 46.88%], valid : [loss = 2.129, top1 = 43.98%], test : [loss = 2.123, top1 = 43.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 3.239, top1 = 22.25%], valid : [loss = 3.245, top1 = 22.62%], test : [loss = 3.260, top1 = 22.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.265, top1 = 54.62%], valid : [loss = 1.321, top1 = 53.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11651/15625) 011651-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.562, top1 = 89.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.376, top1 = 92.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.50 ms.
cifar100       train : [loss = 0.102, top1 = 98.24%], valid : [loss = 1.456, top1 = 67.96%], test : [loss = 1.465, top1 = 67.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.54%], valid : [loss = 2.404, top1 = 39.03%], test : [loss = 2.395, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11652/15625) 011652-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.29%], valid : [loss = 0.730, top1 = 82.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10        train : [loss = 0.084, top1 = 97.26%], test  : [loss = 0.449, top1 = 88.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.43 ms.
cifar100       train : [loss = 0.770, top1 = 77.33%], valid : [loss = 1.666, top1 = 57.38%], test : [loss = 1.587, top1 = 59.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.728, top1 = 32.09%], valid : [loss = 2.869, top1 = 28.67%], test : [loss = 2.911, top1 = 28.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.76%], valid : [loss = 0.967, top1 = 65.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11653/15625) 011653-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.54%], valid : [loss = 0.443, top1 = 88.02%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.53 ms.
cifar10        train : [loss = 0.060, top1 = 98.53%], test  : [loss = 0.325, top1 = 90.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.37 ms.
cifar100       train : [loss = 0.551, top1 = 84.96%], valid : [loss = 1.214, top1 = 67.74%], test : [loss = 1.213, top1 = 67.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.24%], valid : [loss = 2.457, top1 = 37.43%], test : [loss = 2.490, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.20%], valid : [loss = 0.633, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11654/15625) 011654-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.66%], valid : [loss = 0.582, top1 = 87.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.397, top1 = 91.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.49 ms.
cifar100       train : [loss = 0.377, top1 = 89.21%], valid : [loss = 1.320, top1 = 66.00%], test : [loss = 1.337, top1 = 66.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 39.67%], valid : [loss = 2.517, top1 = 36.53%], test : [loss = 2.545, top1 = 36.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.12%], valid : [loss = 0.868, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11655/15625) 011655-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.476, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.332, top1 = 91.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.239, top1 = 93.95%], valid : [loss = 1.309, top1 = 67.64%], test : [loss = 1.276, top1 = 68.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 1.979, top1 = 48.19%], valid : [loss = 2.370, top1 = 39.43%], test : [loss = 2.365, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.28%], valid : [loss = 0.595, top1 = 79.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11656/15625) 011656-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.98%], valid : [loss = 0.468, top1 = 84.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.77 ms.
cifar10        train : [loss = 0.300, top1 = 89.94%], test  : [loss = 0.395, top1 = 86.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.27 ms.
cifar100       train : [loss = 1.325, top1 = 63.28%], valid : [loss = 1.525, top1 = 58.42%], test : [loss = 1.505, top1 = 58.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.61%], valid : [loss = 2.927, top1 = 28.93%], test : [loss = 2.965, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.13%], valid : [loss = 0.731, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11657/15625) 011657-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.65%], valid : [loss = 0.588, top1 = 87.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10        train : [loss = 0.039, top1 = 98.80%], test  : [loss = 0.395, top1 = 90.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.54 ms.
cifar100       train : [loss = 0.565, top1 = 83.22%], valid : [loss = 1.412, top1 = 62.70%], test : [loss = 1.422, top1 = 63.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.03 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.93%], valid : [loss = 2.594, top1 = 34.83%], test : [loss = 2.685, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11658/15625) 011658-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.99%], valid : [loss = 0.727, top1 = 75.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 0.578, top1 = 80.00%], test  : [loss = 0.633, top1 = 78.18%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.73 ms.
cifar100       train : [loss = 1.950, top1 = 47.44%], valid : [loss = 2.089, top1 = 44.81%], test : [loss = 2.074, top1 = 44.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 3.244, top1 = 22.08%], valid : [loss = 3.235, top1 = 23.11%], test : [loss = 3.268, top1 = 21.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 54.01%], valid : [loss = 1.347, top1 = 51.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11659/15625) 011659-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.459, top1 = 89.52%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=16.82 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.304, top1 = 92.45%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.18 ms.
cifar100       train : [loss = 0.252, top1 = 93.56%], valid : [loss = 1.237, top1 = 68.90%], test : [loss = 1.219, top1 = 68.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.01%], valid : [loss = 2.248, top1 = 42.10%], test : [loss = 2.234, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.04%], valid : [loss = 0.641, top1 = 78.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11660/15625) 011660-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.65%], valid : [loss = 0.617, top1 = 84.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.087, top1 = 97.19%], test  : [loss = 0.411, top1 = 88.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 0.795, top1 = 76.84%], valid : [loss = 1.439, top1 = 62.66%], test : [loss = 1.440, top1 = 61.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.31%], valid : [loss = 2.737, top1 = 32.47%], test : [loss = 2.754, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11661/15625) 011661-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.458, top1 = 89.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.14 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.322, top1 = 92.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.30 ms.
cifar100       train : [loss = 0.180, top1 = 95.60%], valid : [loss = 1.309, top1 = 69.33%], test : [loss = 1.334, top1 = 68.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.30%], valid : [loss = 2.294, top1 = 42.13%], test : [loss = 2.332, top1 = 42.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.73%], valid : [loss = 0.560, top1 = 81.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11662/15625) 011662-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.523, top1 = 88.94%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.05 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.345, top1 = 92.01%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.08 ms.
cifar100       train : [loss = 0.289, top1 = 92.22%], valid : [loss = 1.280, top1 = 67.71%], test : [loss = 1.295, top1 = 67.93%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.71%], valid : [loss = 2.377, top1 = 39.28%], test : [loss = 2.382, top1 = 39.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.751, top1 = 73.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11663/15625) 011663-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.17%], valid : [loss = 0.840, top1 = 71.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.546, top1 = 80.87%], test  : [loss = 0.704, top1 = 76.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 1.772, top1 = 52.18%], valid : [loss = 2.049, top1 = 47.34%], test : [loss = 2.028, top1 = 47.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 3.574, top1 = 17.03%], valid : [loss = 3.620, top1 = 16.77%], test : [loss = 3.674, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11664/15625) 011664-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.50%], valid : [loss = 0.544, top1 = 86.89%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.087, top1 = 97.11%], test  : [loss = 0.362, top1 = 89.78%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.03 ms.
cifar100       train : [loss = 0.766, top1 = 77.44%], valid : [loss = 1.328, top1 = 63.80%], test : [loss = 1.333, top1 = 64.05%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.23%], valid : [loss = 2.567, top1 = 35.53%], test : [loss = 2.602, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.95%], valid : [loss = 0.743, top1 = 73.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11665/15625) 011665-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.53%], valid : [loss = 0.732, top1 = 82.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10        train : [loss = 0.091, top1 = 96.99%], test  : [loss = 0.453, top1 = 87.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.15 ms.
cifar100       train : [loss = 0.794, top1 = 76.72%], valid : [loss = 1.591, top1 = 59.24%], test : [loss = 1.594, top1 = 58.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.749, top1 = 31.77%], valid : [loss = 2.888, top1 = 29.07%], test : [loss = 2.937, top1 = 28.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.87%], valid : [loss = 0.921, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11666/15625) 011666-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.81%], valid : [loss = 0.550, top1 = 83.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.199, top1 = 93.29%], test  : [loss = 0.402, top1 = 87.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.99 ms.
cifar100       train : [loss = 1.232, top1 = 64.91%], valid : [loss = 1.559, top1 = 57.29%], test : [loss = 1.542, top1 = 57.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 33.03%], valid : [loss = 2.719, top1 = 32.11%], test : [loss = 2.762, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.30%], valid : [loss = 0.987, top1 = 65.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11667/15625) 011667-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.504, top1 = 89.72%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.55 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.308, top1 = 93.00%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.27 ms.
cifar100       train : [loss = 0.114, top1 = 97.90%], valid : [loss = 1.347, top1 = 68.66%], test : [loss = 1.325, top1 = 68.88%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.79 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.77%], valid : [loss = 2.230, top1 = 43.03%], test : [loss = 2.203, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.682, top1 = 75.83%], valid : [loss = 0.761, top1 = 73.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11668/15625) 011668-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.180, top1 = 94.10%], valid : [loss = 0.527, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.173, top1 = 94.18%], test  : [loss = 0.378, top1 = 88.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 1.233, top1 = 65.22%], valid : [loss = 1.529, top1 = 57.93%], test : [loss = 1.533, top1 = 57.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 34.20%], valid : [loss = 2.691, top1 = 32.96%], test : [loss = 2.710, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.70%], valid : [loss = 0.946, top1 = 66.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11669/15625) 011669-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.10 ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.61%], valid : [loss = 0.886, top1 = 69.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.28 ms.
cifar10        train : [loss = 0.730, top1 = 74.37%], test  : [loss = 0.781, top1 = 72.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.31 ms.
cifar100       train : [loss = 2.294, top1 = 39.92%], valid : [loss = 2.402, top1 = 37.37%], test : [loss = 2.398, top1 = 37.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 3.532, top1 = 17.40%], valid : [loss = 3.516, top1 = 18.05%], test : [loss = 3.544, top1 = 16.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.456, top1 = 46.70%], valid : [loss = 1.503, top1 = 45.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11670/15625) 011670-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.28%], valid : [loss = 0.509, top1 = 85.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10        train : [loss = 0.166, top1 = 94.49%], test  : [loss = 0.399, top1 = 87.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.47 ms.
cifar100       train : [loss = 1.019, top1 = 70.66%], valid : [loss = 1.368, top1 = 62.22%], test : [loss = 1.358, top1 = 62.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.692, top1 = 32.80%], valid : [loss = 2.744, top1 = 32.57%], test : [loss = 2.794, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.21%], valid : [loss = 0.987, top1 = 65.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11671/15625) 011671-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.67%], valid : [loss = 0.530, top1 = 88.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.45 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.346, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.439, top1 = 87.21%], valid : [loss = 1.234, top1 = 67.86%], test : [loss = 1.260, top1 = 67.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.33%], valid : [loss = 2.354, top1 = 40.37%], test : [loss = 2.410, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11672/15625) 011672-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.41%], valid : [loss = 0.555, top1 = 85.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.48 ms.
cifar10        train : [loss = 0.086, top1 = 97.48%], test  : [loss = 0.370, top1 = 89.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.73 ms.
cifar100       train : [loss = 0.638, top1 = 81.61%], valid : [loss = 1.358, top1 = 63.80%], test : [loss = 1.339, top1 = 63.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.419, top1 = 38.33%], valid : [loss = 2.542, top1 = 35.90%], test : [loss = 2.606, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.56%], valid : [loss = 0.844, top1 = 70.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11673/15625) 011673-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.304, top1 = 89.46%], valid : [loss = 0.583, top1 = 81.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10        train : [loss = 0.271, top1 = 90.81%], test  : [loss = 0.429, top1 = 86.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.41 ms.
cifar100       train : [loss = 1.395, top1 = 60.90%], valid : [loss = 1.684, top1 = 54.96%], test : [loss = 1.645, top1 = 55.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.951, top1 = 27.87%], valid : [loss = 2.973, top1 = 27.60%], test : [loss = 2.985, top1 = 26.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.06%], valid : [loss = 1.032, top1 = 63.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11674/15625) 011674-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.36 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.36%], valid : [loss = 0.565, top1 = 87.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.330, top1 = 91.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.35 ms.
cifar100       train : [loss = 0.549, top1 = 84.06%], valid : [loss = 1.350, top1 = 65.02%], test : [loss = 1.404, top1 = 63.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.59 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 32.93%], valid : [loss = 2.688, top1 = 31.77%], test : [loss = 2.699, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.069, top1 = 61.58%], valid : [loss = 1.074, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11675/15625) 011675-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.533, top1 = 87.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.388, top1 = 91.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.50 ms.
cifar100       train : [loss = 0.403, top1 = 88.68%], valid : [loss = 1.379, top1 = 65.66%], test : [loss = 1.362, top1 = 66.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.323, top1 = 40.38%], valid : [loss = 2.515, top1 = 36.60%], test : [loss = 2.545, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.67%], valid : [loss = 0.790, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11676/15625) 011676-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=14.10 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.18%], valid : [loss = 0.450, top1 = 87.18%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=14.29 ms.
cifar10        train : [loss = 0.117, top1 = 96.41%], test  : [loss = 0.328, top1 = 89.66%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=13.40 ms.
cifar100       train : [loss = 0.868, top1 = 75.25%], valid : [loss = 1.299, top1 = 64.05%], test : [loss = 1.284, top1 = 64.14%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.54%], valid : [loss = 2.627, top1 = 33.62%], test : [loss = 2.674, top1 = 32.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11677/15625) 011677-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.44%], valid : [loss = 0.856, top1 = 70.97%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.98 ms.
cifar10        train : [loss = 0.684, top1 = 76.11%], test  : [loss = 0.765, top1 = 73.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.93 ms.
cifar100       train : [loss = 1.964, top1 = 47.84%], valid : [loss = 2.138, top1 = 44.73%], test : [loss = 2.148, top1 = 44.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.62 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.75%], valid : [loss = 3.671, top1 = 15.56%], test : [loss = 3.693, top1 = 14.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11678/15625) 011678-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.50%], valid : [loss = 0.808, top1 = 80.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.122, top1 = 95.94%], test  : [loss = 0.543, top1 = 84.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.858, top1 = 74.89%], valid : [loss = 1.638, top1 = 57.92%], test : [loss = 1.650, top1 = 58.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 26.48%], valid : [loss = 3.156, top1 = 23.70%], test : [loss = 3.193, top1 = 24.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.42%], valid : [loss = 1.128, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11679/15625) 011679-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.586, top1 = 87.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.391, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 0.379, top1 = 89.29%], valid : [loss = 1.402, top1 = 65.39%], test : [loss = 1.425, top1 = 65.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.25%], valid : [loss = 2.505, top1 = 37.13%], test : [loss = 2.526, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.53%], valid : [loss = 0.839, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11680/15625) 011680-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.329, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.95 ms.
cifar100       train : [loss = 0.330, top1 = 91.07%], valid : [loss = 1.276, top1 = 67.32%], test : [loss = 1.288, top1 = 67.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.62 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.69%], valid : [loss = 2.404, top1 = 39.00%], test : [loss = 2.422, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11681/15625) 011681-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.496, top1 = 88.90%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.52 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.324, top1 = 92.09%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.99 ms.
cifar100       train : [loss = 0.347, top1 = 90.55%], valid : [loss = 1.293, top1 = 67.00%], test : [loss = 1.266, top1 = 67.14%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.90%], valid : [loss = 2.389, top1 = 38.90%], test : [loss = 2.417, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.85%], valid : [loss = 0.651, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11682/15625) 011682-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.12%], valid : [loss = 0.848, top1 = 80.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10        train : [loss = 0.125, top1 = 95.82%], test  : [loss = 0.543, top1 = 84.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.37 ms.
cifar100       train : [loss = 0.858, top1 = 75.07%], valid : [loss = 1.684, top1 = 57.18%], test : [loss = 1.678, top1 = 57.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.47%], valid : [loss = 3.176, top1 = 23.83%], test : [loss = 3.214, top1 = 24.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.46%], valid : [loss = 1.117, top1 = 60.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11683/15625) 011683-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.78%], valid : [loss = 0.579, top1 = 87.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10        train : [loss = 0.024, top1 = 99.35%], test  : [loss = 0.432, top1 = 90.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.340, top1 = 90.49%], valid : [loss = 1.511, top1 = 64.82%], test : [loss = 1.508, top1 = 64.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.96%], valid : [loss = 2.565, top1 = 36.23%], test : [loss = 2.623, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.42%], valid : [loss = 0.690, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11684/15625) 011684-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.504, top1 = 88.62%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.05 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.310, top1 = 92.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.76 ms.
cifar100       train : [loss = 0.353, top1 = 90.42%], valid : [loss = 1.310, top1 = 66.96%], test : [loss = 1.323, top1 = 66.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.86%], valid : [loss = 2.212, top1 = 43.90%], test : [loss = 2.235, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.18%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11685/15625) 011685-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.497, top1 = 90.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.300, top1 = 93.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.15 ms.
cifar100       train : [loss = 0.120, top1 = 97.58%], valid : [loss = 1.285, top1 = 69.46%], test : [loss = 1.285, top1 = 70.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.97%], valid : [loss = 2.204, top1 = 43.17%], test : [loss = 2.185, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11686/15625) 011686-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.423, top1 = 90.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.287, top1 = 92.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.07 ms.
cifar100       train : [loss = 0.198, top1 = 95.27%], valid : [loss = 1.262, top1 = 69.04%], test : [loss = 1.282, top1 = 68.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.11%], valid : [loss = 2.280, top1 = 42.30%], test : [loss = 2.313, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.40%], valid : [loss = 0.512, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11687/15625) 011687-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.98%], valid : [loss = 0.414, top1 = 89.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.294, top1 = 92.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.62 ms.
cifar100       train : [loss = 0.202, top1 = 95.32%], valid : [loss = 1.265, top1 = 69.14%], test : [loss = 1.285, top1 = 68.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.78%], valid : [loss = 2.232, top1 = 43.63%], test : [loss = 2.293, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11688/15625) 011688-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.628, top1 = 87.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.41 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.411, top1 = 91.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.08 ms.
cifar100       train : [loss = 0.140, top1 = 96.91%], valid : [loss = 1.546, top1 = 66.01%], test : [loss = 1.527, top1 = 66.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.12%], valid : [loss = 2.465, top1 = 38.33%], test : [loss = 2.491, top1 = 38.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.715, top1 = 74.66%], valid : [loss = 0.798, top1 = 71.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11689/15625) 011689-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.507, top1 = 88.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.346, top1 = 91.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 0.475, top1 = 86.14%], valid : [loss = 1.351, top1 = 65.82%], test : [loss = 1.342, top1 = 65.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.31%], valid : [loss = 2.513, top1 = 36.73%], test : [loss = 2.561, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11690/15625) 011690-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.00 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.75%], valid : [loss = 0.497, top1 = 85.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.92 ms.
cifar10        train : [loss = 0.171, top1 = 94.25%], test  : [loss = 0.378, top1 = 88.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.30 ms.
cifar100       train : [loss = 1.104, top1 = 68.39%], valid : [loss = 1.448, top1 = 60.24%], test : [loss = 1.454, top1 = 59.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.78%], valid : [loss = 2.651, top1 = 34.16%], test : [loss = 2.671, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.50%], valid : [loss = 0.940, top1 = 66.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11691/15625) 011691-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.533, top1 = 88.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.330, top1 = 92.30%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.309, top1 = 91.47%], valid : [loss = 1.301, top1 = 66.86%], test : [loss = 1.292, top1 = 67.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.220, top1 = 42.60%], valid : [loss = 2.454, top1 = 37.13%], test : [loss = 2.430, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.70%], valid : [loss = 0.836, top1 = 70.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11692/15625) 011692-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.431, top1 = 91.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.269, top1 = 94.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.054, top1 = 99.26%], valid : [loss = 1.343, top1 = 71.72%], test : [loss = 1.368, top1 = 71.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 1.479, top1 = 59.94%], valid : [loss = 2.165, top1 = 45.23%], test : [loss = 2.250, top1 = 44.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.331, top1 = 88.76%], valid : [loss = 0.479, top1 = 84.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11693/15625) 011693-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.458, top1 = 90.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.28 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.328, top1 = 93.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.81 ms.
cifar100       train : [loss = 0.072, top1 = 98.87%], valid : [loss = 1.420, top1 = 69.20%], test : [loss = 1.395, top1 = 70.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 1.686, top1 = 54.95%], valid : [loss = 2.349, top1 = 41.50%], test : [loss = 2.369, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.418, top1 = 85.66%], valid : [loss = 0.541, top1 = 81.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11694/15625) 011694-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.482, top1 = 89.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.63 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.328, top1 = 92.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.58 ms.
cifar100       train : [loss = 0.082, top1 = 98.50%], valid : [loss = 1.379, top1 = 69.62%], test : [loss = 1.403, top1 = 69.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.636, top1 = 56.13%], valid : [loss = 2.272, top1 = 43.97%], test : [loss = 2.262, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.83%], valid : [loss = 0.576, top1 = 80.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11695/15625) 011695-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.585, top1 = 87.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.388, top1 = 91.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.87 ms.
cifar100       train : [loss = 0.394, top1 = 88.82%], valid : [loss = 1.387, top1 = 65.83%], test : [loss = 1.382, top1 = 65.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.89%], valid : [loss = 2.474, top1 = 37.26%], test : [loss = 2.496, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.77%], valid : [loss = 0.786, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11696/15625) 011696-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.69%], valid : [loss = 0.633, top1 = 85.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.031, top1 = 99.10%], test  : [loss = 0.386, top1 = 90.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.499, top1 = 85.43%], valid : [loss = 1.405, top1 = 65.16%], test : [loss = 1.369, top1 = 65.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 39.01%], valid : [loss = 2.603, top1 = 35.50%], test : [loss = 2.583, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.20%], valid : [loss = 0.847, top1 = 70.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11697/15625) 011697-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.01%], valid : [loss = 0.746, top1 = 83.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10        train : [loss = 0.093, top1 = 96.96%], test  : [loss = 0.482, top1 = 87.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.03 ms.
cifar100       train : [loss = 0.838, top1 = 75.51%], valid : [loss = 1.572, top1 = 59.58%], test : [loss = 1.572, top1 = 58.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.814, top1 = 30.37%], valid : [loss = 2.928, top1 = 28.80%], test : [loss = 2.978, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.85%], valid : [loss = 0.881, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11698/15625) 011698-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.31%], valid : [loss = 0.450, top1 = 87.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.110, top1 = 96.65%], test  : [loss = 0.331, top1 = 89.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.863, top1 = 75.34%], valid : [loss = 1.298, top1 = 64.50%], test : [loss = 1.270, top1 = 64.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.79%], valid : [loss = 2.628, top1 = 34.10%], test : [loss = 2.679, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.06%], valid : [loss = 0.664, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11699/15625) 011699-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.130, top1 = 95.97%], valid : [loss = 0.470, top1 = 85.83%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.80 ms.
cifar10        train : [loss = 0.158, top1 = 94.86%], test  : [loss = 0.348, top1 = 88.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.12 ms.
cifar100       train : [loss = 1.007, top1 = 71.31%], valid : [loss = 1.356, top1 = 62.34%], test : [loss = 1.360, top1 = 61.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.76%], valid : [loss = 2.700, top1 = 33.00%], test : [loss = 2.693, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11700/15625) 011700-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.600, top1 = 87.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.403, top1 = 91.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.208, top1 = 95.14%], valid : [loss = 1.451, top1 = 65.93%], test : [loss = 1.430, top1 = 66.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.49 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.11%], valid : [loss = 2.482, top1 = 37.91%], test : [loss = 2.510, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11701/15625) 011701-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.23%], valid : [loss = 0.461, top1 = 86.81%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.03 ms.
cifar10        train : [loss = 0.112, top1 = 96.56%], test  : [loss = 0.330, top1 = 89.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.30 ms.
cifar100       train : [loss = 0.850, top1 = 75.77%], valid : [loss = 1.289, top1 = 64.10%], test : [loss = 1.274, top1 = 64.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.78%], valid : [loss = 2.624, top1 = 34.31%], test : [loss = 2.644, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.90%], valid : [loss = 0.648, top1 = 77.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11702/15625) 011702-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.55%], valid : [loss = 0.613, top1 = 86.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.034, top1 = 98.99%], test  : [loss = 0.401, top1 = 89.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.33 ms.
cifar100       train : [loss = 0.555, top1 = 83.85%], valid : [loss = 1.419, top1 = 63.46%], test : [loss = 1.410, top1 = 64.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.17%], valid : [loss = 2.586, top1 = 35.41%], test : [loss = 2.597, top1 = 35.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.86%], valid : [loss = 0.848, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11703/15625) 011703-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.480, top1 = 89.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.306, top1 = 92.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.323, top1 = 91.35%], valid : [loss = 1.243, top1 = 67.83%], test : [loss = 1.256, top1 = 67.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.66%], valid : [loss = 2.319, top1 = 40.56%], test : [loss = 2.327, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11704/15625) 011704-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.66%], valid : [loss = 0.753, top1 = 74.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10        train : [loss = 0.603, top1 = 79.03%], test  : [loss = 0.656, top1 = 77.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.49 ms.
cifar100       train : [loss = 2.032, top1 = 45.42%], valid : [loss = 2.156, top1 = 42.99%], test : [loss = 2.138, top1 = 43.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.61 ms.
ImageNet16-120 train : [loss = 3.299, top1 = 21.22%], valid : [loss = 3.287, top1 = 21.64%], test : [loss = 3.320, top1 = 20.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 53.39%], valid : [loss = 1.360, top1 = 51.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11705/15625) 011705-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.65 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.79%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=21.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.325, top1 = 93.05%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=21.27 ms.
cifar100       train : [loss = 0.070, top1 = 98.91%], valid : [loss = 1.349, top1 = 69.68%], test : [loss = 1.341, top1 = 69.91%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.58%], valid : [loss = 2.378, top1 = 39.48%], test : [loss = 2.359, top1 = 39.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.73%], valid : [loss = 0.699, top1 = 75.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11706/15625) 011706-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.542, top1 = 87.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.033, top1 = 99.01%], test  : [loss = 0.363, top1 = 90.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.77 ms.
cifar100       train : [loss = 0.408, top1 = 88.00%], valid : [loss = 1.278, top1 = 66.89%], test : [loss = 1.270, top1 = 67.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.41%], valid : [loss = 2.402, top1 = 39.29%], test : [loss = 2.410, top1 = 38.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 65.78%], valid : [loss = 0.996, top1 = 64.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11707/15625) 011707-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.39%], valid : [loss = 0.460, top1 = 86.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.84 ms.
cifar10        train : [loss = 0.156, top1 = 94.88%], test  : [loss = 0.350, top1 = 88.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.93 ms.
cifar100       train : [loss = 1.000, top1 = 71.60%], valid : [loss = 1.355, top1 = 62.01%], test : [loss = 1.352, top1 = 61.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.652, top1 = 33.49%], valid : [loss = 2.691, top1 = 32.64%], test : [loss = 2.724, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11708/15625) 011708-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.61%], valid : [loss = 0.462, top1 = 86.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10        train : [loss = 0.155, top1 = 94.93%], test  : [loss = 0.346, top1 = 88.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.980, top1 = 72.18%], valid : [loss = 1.351, top1 = 62.28%], test : [loss = 1.331, top1 = 62.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.616, top1 = 34.27%], valid : [loss = 2.680, top1 = 33.14%], test : [loss = 2.704, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.42%], valid : [loss = 0.775, top1 = 72.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11709/15625) 011709-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.557, top1 = 88.25%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.357, top1 = 91.60%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.34 ms.
cifar100       train : [loss = 0.210, top1 = 94.68%], valid : [loss = 1.335, top1 = 67.63%], test : [loss = 1.368, top1 = 67.79%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.65 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.41%], valid : [loss = 2.398, top1 = 38.94%], test : [loss = 2.402, top1 = 39.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.81%], valid : [loss = 0.909, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11710/15625) 011710-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=21.60 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.07%], valid : [loss = 0.468, top1 = 86.54%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=20.25 ms.
cifar10        train : [loss = 0.112, top1 = 96.54%], test  : [loss = 0.334, top1 = 89.35%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=19.30 ms.
cifar100       train : [loss = 0.724, top1 = 79.81%], valid : [loss = 1.267, top1 = 65.38%], test : [loss = 1.257, top1 = 65.00%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 37.61%], valid : [loss = 2.568, top1 = 36.01%], test : [loss = 2.584, top1 = 35.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.64%], valid : [loss = 0.737, top1 = 74.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11711/15625) 011711-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 91.16%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.91 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.280, top1 = 93.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.35 ms.
cifar100       train : [loss = 0.030, top1 = 99.75%], valid : [loss = 1.281, top1 = 72.21%], test : [loss = 1.267, top1 = 72.39%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 1.245, top1 = 65.67%], valid : [loss = 2.221, top1 = 45.58%], test : [loss = 2.224, top1 = 45.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.339, top1 = 88.60%], valid : [loss = 0.490, top1 = 83.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11712/15625) 011712-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.561, top1 = 87.70%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.28 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.373, top1 = 91.28%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.28 ms.
cifar100       train : [loss = 0.399, top1 = 88.71%], valid : [loss = 1.376, top1 = 65.63%], test : [loss = 1.383, top1 = 65.59%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.66%], valid : [loss = 2.509, top1 = 37.10%], test : [loss = 2.542, top1 = 36.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.69%], valid : [loss = 0.780, top1 = 72.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11713/15625) 011713-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.464, top1 = 89.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.14 ms.
cifar100       train : [loss = 0.325, top1 = 91.10%], valid : [loss = 1.316, top1 = 67.13%], test : [loss = 1.316, top1 = 67.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.28%], valid : [loss = 2.386, top1 = 39.84%], test : [loss = 2.399, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.482, top1 = 83.30%], valid : [loss = 0.571, top1 = 80.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11714/15625) 011714-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.52%], valid : [loss = 0.579, top1 = 81.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.301, top1 = 89.65%], test  : [loss = 0.460, top1 = 85.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 1.580, top1 = 56.07%], valid : [loss = 1.808, top1 = 51.41%], test : [loss = 1.797, top1 = 51.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 3.108, top1 = 24.70%], valid : [loss = 3.105, top1 = 25.16%], test : [loss = 3.160, top1 = 23.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.33%], valid : [loss = 1.054, top1 = 62.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11715/15625) 011715-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.77%], valid : [loss = 0.516, top1 = 88.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.022, top1 = 99.42%], test  : [loss = 0.334, top1 = 91.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 0.376, top1 = 89.59%], valid : [loss = 1.240, top1 = 67.50%], test : [loss = 1.251, top1 = 67.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.32%], valid : [loss = 2.306, top1 = 40.89%], test : [loss = 2.320, top1 = 40.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.61%], valid : [loss = 0.699, top1 = 75.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11716/15625) 011716-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11717/15625) 011717-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.511, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.316, top1 = 92.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.91 ms.
cifar100       train : [loss = 0.150, top1 = 96.89%], valid : [loss = 1.289, top1 = 68.97%], test : [loss = 1.276, top1 = 69.45%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.92%], valid : [loss = 2.311, top1 = 41.21%], test : [loss = 2.305, top1 = 41.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11718/15625) 011718-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.592, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.397, top1 = 91.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.41 ms.
cifar100       train : [loss = 0.196, top1 = 95.57%], valid : [loss = 1.441, top1 = 66.17%], test : [loss = 1.428, top1 = 66.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.51%], valid : [loss = 2.484, top1 = 37.99%], test : [loss = 2.509, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.58%], valid : [loss = 0.693, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11719/15625) 011719-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.553, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.358, top1 = 92.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.83 ms.
cifar100       train : [loss = 0.096, top1 = 98.36%], valid : [loss = 1.464, top1 = 67.44%], test : [loss = 1.406, top1 = 68.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.63%], valid : [loss = 2.446, top1 = 39.35%], test : [loss = 2.471, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.59%], valid : [loss = 0.721, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11720/15625) 011720-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.18 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.07%], valid : [loss = 0.479, top1 = 84.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.91 ms.
cifar10        train : [loss = 0.301, top1 = 89.99%], test  : [loss = 0.396, top1 = 86.65%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 1.327, top1 = 63.22%], valid : [loss = 1.535, top1 = 57.65%], test : [loss = 1.508, top1 = 58.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.58 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.63%], valid : [loss = 2.896, top1 = 29.92%], test : [loss = 2.948, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11721/15625) 011721-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.46%], valid : [loss = 0.861, top1 = 72.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.548, top1 = 80.85%], test  : [loss = 0.715, top1 = 76.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.66 ms.
cifar100       train : [loss = 1.760, top1 = 52.49%], valid : [loss = 2.056, top1 = 46.73%], test : [loss = 2.072, top1 = 46.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 16.94%], valid : [loss = 3.628, top1 = 17.02%], test : [loss = 3.663, top1 = 16.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11722/15625) 011722-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.455, top1 = 90.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.300, top1 = 93.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.03 ms.
cifar100       train : [loss = 0.069, top1 = 98.87%], valid : [loss = 1.360, top1 = 70.44%], test : [loss = 1.326, top1 = 71.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 1.541, top1 = 58.43%], valid : [loss = 2.216, top1 = 43.58%], test : [loss = 2.256, top1 = 44.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.33%], valid : [loss = 0.513, top1 = 83.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11723/15625) 011723-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.47 ms.
cifar10-valid  train : [loss = 0.284, top1 = 90.40%], valid : [loss = 0.468, top1 = 84.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.13 ms.
cifar10        train : [loss = 0.266, top1 = 91.11%], test  : [loss = 0.369, top1 = 87.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.51 ms.
cifar100       train : [loss = 1.283, top1 = 64.13%], valid : [loss = 1.473, top1 = 59.12%], test : [loss = 1.461, top1 = 59.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.826, top1 = 30.38%], valid : [loss = 2.823, top1 = 29.74%], test : [loss = 2.866, top1 = 28.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.58%], valid : [loss = 1.003, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11724/15625) 011724-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.75 ms.
cifar10-valid  train : [loss = 0.145, top1 = 95.29%], valid : [loss = 0.511, top1 = 85.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.22 ms.
cifar10        train : [loss = 0.163, top1 = 94.53%], test  : [loss = 0.369, top1 = 88.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.99 ms.
cifar100       train : [loss = 1.038, top1 = 70.16%], valid : [loss = 1.406, top1 = 61.62%], test : [loss = 1.401, top1 = 61.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.66 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.62%], valid : [loss = 2.659, top1 = 34.25%], test : [loss = 2.687, top1 = 32.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.63%], valid : [loss = 0.921, top1 = 67.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11725/15625) 011725-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.63%], valid : [loss = 0.616, top1 = 84.79%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.70 ms.
cifar10        train : [loss = 0.084, top1 = 97.30%], test  : [loss = 0.409, top1 = 88.60%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.80 ms.
cifar100       train : [loss = 0.768, top1 = 77.56%], valid : [loss = 1.411, top1 = 62.40%], test : [loss = 1.392, top1 = 62.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.14%], valid : [loss = 2.733, top1 = 32.18%], test : [loss = 2.770, top1 = 30.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 71.69%], valid : [loss = 0.842, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11726/15625) 011726-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.633, top1 = 86.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10        train : [loss = 0.029, top1 = 99.28%], test  : [loss = 0.430, top1 = 89.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.18 ms.
cifar100       train : [loss = 0.363, top1 = 90.29%], valid : [loss = 1.422, top1 = 64.87%], test : [loss = 1.398, top1 = 65.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.46%], valid : [loss = 2.598, top1 = 35.19%], test : [loss = 2.623, top1 = 36.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11727/15625) 011727-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.39 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.314, top1 = 92.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.51 ms.
cifar100       train : [loss = 0.329, top1 = 91.17%], valid : [loss = 1.266, top1 = 67.40%], test : [loss = 1.278, top1 = 67.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.91%], valid : [loss = 2.393, top1 = 39.49%], test : [loss = 2.403, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11728/15625) 011728-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.14%], valid : [loss = 0.647, top1 = 78.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10        train : [loss = 0.511, top1 = 82.31%], test  : [loss = 0.589, top1 = 80.03%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.42 ms.
cifar100       train : [loss = 1.675, top1 = 54.58%], valid : [loss = 1.844, top1 = 51.08%], test : [loss = 1.850, top1 = 51.12%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.95 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.34%], valid : [loss = 3.320, top1 = 21.49%], test : [loss = 3.353, top1 = 20.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11729/15625) 011729-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.452, top1 = 87.03%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.67 ms.
cifar10        train : [loss = 0.113, top1 = 96.54%], test  : [loss = 0.320, top1 = 89.83%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.36 ms.
cifar100       train : [loss = 0.853, top1 = 75.82%], valid : [loss = 1.286, top1 = 63.85%], test : [loss = 1.277, top1 = 64.29%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.81%], valid : [loss = 2.616, top1 = 34.39%], test : [loss = 2.657, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.23%], valid : [loss = 0.653, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11730/15625) 011730-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.552, top1 = 87.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.025, top1 = 99.32%], test  : [loss = 0.344, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.428, top1 = 87.73%], valid : [loss = 1.273, top1 = 66.76%], test : [loss = 1.298, top1 = 66.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.27%], valid : [loss = 2.401, top1 = 39.55%], test : [loss = 2.432, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11731/15625) 011731-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.590, top1 = 87.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.029, top1 = 99.16%], test  : [loss = 0.398, top1 = 90.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.30 ms.
cifar100       train : [loss = 0.283, top1 = 92.09%], valid : [loss = 1.377, top1 = 66.38%], test : [loss = 1.385, top1 = 66.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.572, top1 = 34.60%], valid : [loss = 2.693, top1 = 32.10%], test : [loss = 2.705, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.948, top1 = 65.44%], valid : [loss = 0.994, top1 = 64.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11732/15625) 011732-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.70%], valid : [loss = 0.728, top1 = 80.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10        train : [loss = 0.183, top1 = 93.68%], test  : [loss = 0.513, top1 = 84.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.94 ms.
cifar100       train : [loss = 0.876, top1 = 74.43%], valid : [loss = 1.633, top1 = 57.48%], test : [loss = 1.639, top1 = 57.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 3.437, top1 = 17.96%], valid : [loss = 3.452, top1 = 17.55%], test : [loss = 3.456, top1 = 17.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.254, top1 = 54.33%], valid : [loss = 1.278, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11733/15625) 011733-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.427, top1 = 90.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.292, top1 = 93.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.95 ms.
cifar100       train : [loss = 0.103, top1 = 98.19%], valid : [loss = 1.297, top1 = 70.08%], test : [loss = 1.315, top1 = 69.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 1.643, top1 = 55.90%], valid : [loss = 2.208, top1 = 44.25%], test : [loss = 2.251, top1 = 43.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.52%], valid : [loss = 0.507, top1 = 83.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11734/15625) 011734-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.06%], valid : [loss = 0.595, top1 = 86.12%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.69 ms.
cifar10        train : [loss = 0.062, top1 = 98.01%], test  : [loss = 0.392, top1 = 89.56%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.96 ms.
cifar100       train : [loss = 0.573, top1 = 83.36%], valid : [loss = 1.404, top1 = 64.06%], test : [loss = 1.416, top1 = 63.20%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.81 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.84%], valid : [loss = 2.504, top1 = 36.72%], test : [loss = 2.519, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.921, top1 = 67.08%], valid : [loss = 0.950, top1 = 66.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11735/15625) 011735-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.562, top1 = 88.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.388, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.04 ms.
cifar100       train : [loss = 0.130, top1 = 97.16%], valid : [loss = 1.507, top1 = 66.32%], test : [loss = 1.516, top1 = 66.21%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 48.08%], valid : [loss = 2.445, top1 = 39.18%], test : [loss = 2.483, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.79%], valid : [loss = 0.778, top1 = 73.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11736/15625) 011736-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.510, top1 = 88.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.85 ms.
cifar100       train : [loss = 0.325, top1 = 91.32%], valid : [loss = 1.285, top1 = 67.28%], test : [loss = 1.286, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.07%], valid : [loss = 2.394, top1 = 39.66%], test : [loss = 2.405, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11737/15625) 011737-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.424, top1 = 91.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.30 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.278, top1 = 93.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.83 ms.
cifar100       train : [loss = 0.060, top1 = 99.12%], valid : [loss = 1.329, top1 = 70.75%], test : [loss = 1.313, top1 = 70.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 1.502, top1 = 59.27%], valid : [loss = 2.214, top1 = 44.62%], test : [loss = 2.221, top1 = 44.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.346, top1 = 88.23%], valid : [loss = 0.487, top1 = 83.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11738/15625) 011738-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.611, top1 = 87.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.398, top1 = 91.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.99 ms.
cifar100       train : [loss = 0.125, top1 = 97.48%], valid : [loss = 1.532, top1 = 66.44%], test : [loss = 1.540, top1 = 66.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.97%], valid : [loss = 2.471, top1 = 38.00%], test : [loss = 2.487, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.51%], valid : [loss = 0.768, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11739/15625) 011739-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.554, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.03 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.381, top1 = 90.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.20 ms.
cifar100       train : [loss = 0.511, top1 = 85.34%], valid : [loss = 1.367, top1 = 64.61%], test : [loss = 1.359, top1 = 64.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.22%], valid : [loss = 2.626, top1 = 32.62%], test : [loss = 2.651, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.27%], valid : [loss = 0.949, top1 = 66.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11740/15625) 011740-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.40%], valid : [loss = 0.644, top1 = 78.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.80 ms.
cifar10        train : [loss = 0.488, top1 = 83.05%], test  : [loss = 0.575, top1 = 80.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.97 ms.
cifar100       train : [loss = 1.651, top1 = 55.10%], valid : [loss = 1.812, top1 = 51.84%], test : [loss = 1.842, top1 = 51.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.18%], valid : [loss = 3.300, top1 = 21.85%], test : [loss = 3.337, top1 = 21.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11741/15625) 011741-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.579, top1 = 87.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.84 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.393, top1 = 91.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.00 ms.
cifar100       train : [loss = 0.382, top1 = 89.28%], valid : [loss = 1.406, top1 = 65.69%], test : [loss = 1.382, top1 = 66.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.18%], valid : [loss = 2.499, top1 = 36.85%], test : [loss = 2.516, top1 = 37.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.18%], valid : [loss = 0.796, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11742/15625) 011742-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.489, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.326, top1 = 91.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.64 ms.
cifar100       train : [loss = 0.316, top1 = 91.50%], valid : [loss = 1.279, top1 = 67.38%], test : [loss = 1.260, top1 = 68.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.69%], valid : [loss = 2.331, top1 = 39.55%], test : [loss = 2.336, top1 = 40.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11743/15625) 011743-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.470, top1 = 89.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.301, top1 = 92.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.05 ms.
cifar100       train : [loss = 0.266, top1 = 93.18%], valid : [loss = 1.189, top1 = 69.42%], test : [loss = 1.218, top1 = 68.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.02%], valid : [loss = 2.220, top1 = 42.83%], test : [loss = 2.234, top1 = 43.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11744/15625) 011744-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.04%], valid : [loss = 0.556, top1 = 86.92%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.36 ms.
cifar10        train : [loss = 0.066, top1 = 97.88%], test  : [loss = 0.377, top1 = 90.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.78 ms.
cifar100       train : [loss = 0.659, top1 = 80.40%], valid : [loss = 1.326, top1 = 64.72%], test : [loss = 1.288, top1 = 65.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 39.96%], valid : [loss = 2.477, top1 = 36.78%], test : [loss = 2.496, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.71%], valid : [loss = 0.752, top1 = 73.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11745/15625) 011745-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.71%], valid : [loss = 0.468, top1 = 86.40%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.72 ms.
cifar10        train : [loss = 0.121, top1 = 96.25%], test  : [loss = 0.338, top1 = 89.31%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.89 ms.
cifar100       train : [loss = 0.739, top1 = 79.35%], valid : [loss = 1.256, top1 = 65.17%], test : [loss = 1.271, top1 = 64.78%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.86%], valid : [loss = 2.586, top1 = 34.72%], test : [loss = 2.609, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11746/15625) 011746-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.64 ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.67%], valid : [loss = 0.718, top1 = 75.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.05 ms.
cifar10        train : [loss = 0.555, top1 = 80.87%], test  : [loss = 0.607, top1 = 79.18%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.79 ms.
cifar100       train : [loss = 1.970, top1 = 47.07%], valid : [loss = 2.097, top1 = 44.33%], test : [loss = 2.104, top1 = 44.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 3.226, top1 = 22.49%], valid : [loss = 3.218, top1 = 22.49%], test : [loss = 3.255, top1 = 22.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.49%], valid : [loss = 1.351, top1 = 51.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11747/15625) 011747-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.01%], valid : [loss = 0.754, top1 = 74.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.526, top1 = 81.77%], test  : [loss = 0.597, top1 = 79.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.65 ms.
cifar100       train : [loss = 1.970, top1 = 46.56%], valid : [loss = 2.093, top1 = 43.94%], test : [loss = 2.103, top1 = 43.91%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 3.017, top1 = 26.27%], valid : [loss = 3.008, top1 = 26.59%], test : [loss = 3.039, top1 = 26.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11748/15625) 011748-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.75%], valid : [loss = 0.761, top1 = 82.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.086, top1 = 97.29%], test  : [loss = 0.504, top1 = 86.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.30 ms.
cifar100       train : [loss = 0.815, top1 = 76.42%], valid : [loss = 1.563, top1 = 59.88%], test : [loss = 1.533, top1 = 60.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.809, top1 = 30.54%], valid : [loss = 2.931, top1 = 28.35%], test : [loss = 2.968, top1 = 27.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.31%], valid : [loss = 0.851, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11749/15625) 011749-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.516, top1 = 88.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10        train : [loss = 0.019, top1 = 99.51%], test  : [loss = 0.336, top1 = 91.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.404, top1 = 88.40%], valid : [loss = 1.328, top1 = 66.01%], test : [loss = 1.312, top1 = 67.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.32%], valid : [loss = 2.391, top1 = 39.05%], test : [loss = 2.415, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.48%], valid : [loss = 0.655, top1 = 77.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11750/15625) 011750-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.73%], valid : [loss = 0.456, top1 = 86.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.151, top1 = 95.13%], test  : [loss = 0.339, top1 = 89.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 0.971, top1 = 72.44%], valid : [loss = 1.349, top1 = 62.63%], test : [loss = 1.331, top1 = 62.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.22%], valid : [loss = 2.664, top1 = 33.95%], test : [loss = 2.682, top1 = 32.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11751/15625) 011751-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.628, top1 = 86.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.41 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.419, top1 = 90.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.24 ms.
cifar100       train : [loss = 0.275, top1 = 92.88%], valid : [loss = 1.463, top1 = 65.25%], test : [loss = 1.415, top1 = 65.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.57%], valid : [loss = 2.575, top1 = 35.63%], test : [loss = 2.580, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.49%], valid : [loss = 0.821, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11752/15625) 011752-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.379, top1 = 87.01%], valid : [loss = 0.515, top1 = 82.80%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.406, top1 = 86.16%], test  : [loss = 0.478, top1 = 83.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.23 ms.
cifar100       train : [loss = 1.523, top1 = 58.22%], valid : [loss = 1.641, top1 = 54.80%], test : [loss = 1.640, top1 = 55.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 3.032, top1 = 26.40%], valid : [loss = 3.020, top1 = 26.85%], test : [loss = 3.050, top1 = 26.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 60.45%], valid : [loss = 1.137, top1 = 59.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11753/15625) 011753-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.516, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.353, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.51 ms.
cifar100       train : [loss = 0.258, top1 = 93.24%], valid : [loss = 1.259, top1 = 68.33%], test : [loss = 1.273, top1 = 68.57%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.11%], valid : [loss = 2.246, top1 = 42.45%], test : [loss = 2.266, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 74.98%], valid : [loss = 0.764, top1 = 73.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11754/15625) 011754-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.493, top1 = 90.25%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.29 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.50%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.80 ms.
cifar100       train : [loss = 0.038, top1 = 99.61%], valid : [loss = 1.321, top1 = 70.69%], test : [loss = 1.285, top1 = 71.43%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.31%], valid : [loss = 2.288, top1 = 41.68%], test : [loss = 2.303, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.68%], valid : [loss = 0.788, top1 = 72.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11755/15625) 011755-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.518, top1 = 89.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.324, top1 = 92.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.148, top1 = 96.94%], valid : [loss = 1.286, top1 = 69.45%], test : [loss = 1.287, top1 = 69.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.23%], valid : [loss = 2.316, top1 = 41.12%], test : [loss = 2.309, top1 = 41.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11756/15625) 011756-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.96%], valid : [loss = 0.852, top1 = 72.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10        train : [loss = 0.548, top1 = 80.70%], test  : [loss = 0.713, top1 = 76.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 1.778, top1 = 51.99%], valid : [loss = 2.073, top1 = 46.75%], test : [loss = 2.086, top1 = 46.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.89%], valid : [loss = 3.645, top1 = 16.93%], test : [loss = 3.666, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11757/15625) 011757-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.475, top1 = 89.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.321, top1 = 91.36%], valid : [loss = 1.253, top1 = 67.62%], test : [loss = 1.275, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.60%], valid : [loss = 2.311, top1 = 40.44%], test : [loss = 2.332, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11758/15625) 011758-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.01%], valid : [loss = 0.533, top1 = 87.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.072, top1 = 97.75%], test  : [loss = 0.358, top1 = 90.21%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.24 ms.
cifar100       train : [loss = 0.707, top1 = 79.10%], valid : [loss = 1.340, top1 = 64.10%], test : [loss = 1.358, top1 = 63.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.517, top1 = 36.31%], valid : [loss = 2.643, top1 = 33.85%], test : [loss = 2.675, top1 = 33.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.12%], valid : [loss = 0.652, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11759/15625) 011759-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11760/15625) 011760-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.57%], valid : [loss = 0.574, top1 = 87.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.040, top1 = 98.87%], test  : [loss = 0.389, top1 = 90.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.29 ms.
cifar100       train : [loss = 0.574, top1 = 83.13%], valid : [loss = 1.401, top1 = 63.74%], test : [loss = 1.388, top1 = 63.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.87%], valid : [loss = 2.596, top1 = 34.77%], test : [loss = 2.675, top1 = 33.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.95%], valid : [loss = 0.675, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11761/15625) 011761-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.505, top1 = 88.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.022, top1 = 99.44%], test  : [loss = 0.336, top1 = 91.60%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.372, top1 = 89.65%], valid : [loss = 1.248, top1 = 67.50%], test : [loss = 1.258, top1 = 67.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.03%], valid : [loss = 2.311, top1 = 41.01%], test : [loss = 2.328, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.61%], valid : [loss = 0.699, top1 = 75.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11762/15625) 011762-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.28%], valid : [loss = 0.499, top1 = 86.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10        train : [loss = 0.047, top1 = 98.66%], test  : [loss = 0.349, top1 = 90.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.48 ms.
cifar100       train : [loss = 0.501, top1 = 85.70%], valid : [loss = 1.227, top1 = 67.00%], test : [loss = 1.189, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.74%], valid : [loss = 2.326, top1 = 40.62%], test : [loss = 2.353, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.05%], valid : [loss = 0.844, top1 = 70.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11763/15625) 011763-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.85%], valid : [loss = 0.997, top1 = 66.02%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10        train : [loss = 0.770, top1 = 72.92%], test  : [loss = 0.863, top1 = 69.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.26 ms.
cifar100       train : [loss = 2.139, top1 = 43.89%], valid : [loss = 2.310, top1 = 40.66%], test : [loss = 2.338, top1 = 40.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.97 ms.
ImageNet16-120 train : [loss = 3.736, top1 = 14.38%], valid : [loss = 3.769, top1 = 14.74%], test : [loss = 3.774, top1 = 13.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11764/15625) 011764-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.09%], valid : [loss = 0.858, top1 = 70.96%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10        train : [loss = 0.672, top1 = 76.50%], test  : [loss = 0.760, top1 = 73.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.60 ms.
cifar100       train : [loss = 1.981, top1 = 47.42%], valid : [loss = 2.145, top1 = 44.64%], test : [loss = 2.164, top1 = 44.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.69%], valid : [loss = 3.677, top1 = 15.67%], test : [loss = 3.699, top1 = 14.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.423, top1 = 48.11%], valid : [loss = 1.432, top1 = 48.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11765/15625) 011765-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.24%], valid : [loss = 0.597, top1 = 85.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10        train : [loss = 0.068, top1 = 97.98%], test  : [loss = 0.409, top1 = 88.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.88 ms.
cifar100       train : [loss = 0.707, top1 = 79.36%], valid : [loss = 1.389, top1 = 63.32%], test : [loss = 1.355, top1 = 64.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.18%], valid : [loss = 2.655, top1 = 33.52%], test : [loss = 2.684, top1 = 33.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11766/15625) 011766-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.10 ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.73%], valid : [loss = 0.760, top1 = 74.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.564, top1 = 80.34%], test  : [loss = 0.641, top1 = 78.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.71 ms.
cifar100       train : [loss = 1.994, top1 = 45.82%], valid : [loss = 2.109, top1 = 43.65%], test : [loss = 2.123, top1 = 43.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 3.060, top1 = 25.40%], valid : [loss = 3.057, top1 = 25.53%], test : [loss = 3.077, top1 = 25.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.163, top1 = 57.98%], valid : [loss = 1.198, top1 = 57.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11767/15625) 011767-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.48%], valid : [loss = 0.862, top1 = 81.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.052, top1 = 98.47%], test  : [loss = 0.611, top1 = 85.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.86 ms.
cifar100       train : [loss = 0.454, top1 = 87.56%], valid : [loss = 1.877, top1 = 56.89%], test : [loss = 1.869, top1 = 57.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.789, top1 = 31.24%], valid : [loss = 3.138, top1 = 25.53%], test : [loss = 3.155, top1 = 25.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 65.24%], valid : [loss = 1.035, top1 = 63.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11768/15625) 011768-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.95%], valid : [loss = 0.721, top1 = 83.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10        train : [loss = 0.089, top1 = 97.15%], test  : [loss = 0.467, top1 = 87.11%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 0.805, top1 = 76.53%], valid : [loss = 1.546, top1 = 60.15%], test : [loss = 1.526, top1 = 60.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 2.807, top1 = 30.38%], valid : [loss = 2.932, top1 = 28.08%], test : [loss = 2.977, top1 = 28.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11769/15625) 011769-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.532, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.43 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.337, top1 = 92.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.25 ms.
cifar100       train : [loss = 0.097, top1 = 98.22%], valid : [loss = 1.392, top1 = 68.41%], test : [loss = 1.383, top1 = 69.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.05 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.23%], valid : [loss = 2.380, top1 = 39.70%], test : [loss = 2.365, top1 = 40.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.25%], valid : [loss = 0.867, top1 = 69.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11770/15625) 011770-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.555, top1 = 88.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.370, top1 = 91.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.164, top1 = 96.29%], valid : [loss = 1.443, top1 = 66.70%], test : [loss = 1.447, top1 = 67.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.90%], valid : [loss = 2.374, top1 = 39.40%], test : [loss = 2.411, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 78.98%], valid : [loss = 0.695, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11771/15625) 011771-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.480, top1 = 89.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.06 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.302, top1 = 92.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.19 ms.
cifar100       train : [loss = 0.256, top1 = 93.41%], valid : [loss = 1.219, top1 = 69.21%], test : [loss = 1.245, top1 = 68.96%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.69%], valid : [loss = 2.201, top1 = 43.70%], test : [loss = 2.231, top1 = 42.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.46%], valid : [loss = 0.658, top1 = 77.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11772/15625) 011772-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.31%], valid : [loss = 0.472, top1 = 84.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.299, top1 = 89.98%], test  : [loss = 0.399, top1 = 86.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 1.324, top1 = 63.30%], valid : [loss = 1.524, top1 = 58.23%], test : [loss = 1.510, top1 = 57.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.63%], valid : [loss = 2.919, top1 = 29.13%], test : [loss = 2.976, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.65%], valid : [loss = 0.751, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11773/15625) 011773-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.22%], valid : [loss = 0.526, top1 = 87.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.10 ms.
cifar10        train : [loss = 0.063, top1 = 98.12%], test  : [loss = 0.366, top1 = 90.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.20 ms.
cifar100       train : [loss = 0.677, top1 = 80.11%], valid : [loss = 1.328, top1 = 64.41%], test : [loss = 1.299, top1 = 64.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 36.81%], valid : [loss = 2.602, top1 = 34.32%], test : [loss = 2.626, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.35%], valid : [loss = 0.665, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11774/15625) 011774-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.76%], valid : [loss = 0.700, top1 = 76.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10        train : [loss = 0.538, top1 = 81.30%], test  : [loss = 0.604, top1 = 79.48%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.98 ms.
cifar100       train : [loss = 1.751, top1 = 52.52%], valid : [loss = 1.909, top1 = 49.42%], test : [loss = 1.923, top1 = 49.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 3.396, top1 = 19.85%], valid : [loss = 3.379, top1 = 19.93%], test : [loss = 3.412, top1 = 18.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.348, top1 = 51.09%], valid : [loss = 1.361, top1 = 51.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11775/15625) 011775-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.25%], valid : [loss = 0.536, top1 = 83.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.200, top1 = 93.22%], test  : [loss = 0.404, top1 = 87.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.93 ms.
cifar100       train : [loss = 1.236, top1 = 64.90%], valid : [loss = 1.530, top1 = 57.97%], test : [loss = 1.541, top1 = 57.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.699, top1 = 32.57%], valid : [loss = 2.742, top1 = 32.19%], test : [loss = 2.784, top1 = 30.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 65.89%], valid : [loss = 0.993, top1 = 64.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11776/15625) 011776-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.105, top1 = 97.01%], valid : [loss = 0.447, top1 = 86.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10        train : [loss = 0.146, top1 = 95.31%], test  : [loss = 0.337, top1 = 89.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.59 ms.
cifar100       train : [loss = 0.962, top1 = 72.63%], valid : [loss = 1.348, top1 = 62.11%], test : [loss = 1.338, top1 = 62.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.21%], valid : [loss = 2.690, top1 = 32.32%], test : [loss = 2.708, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.787, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11777/15625) 011777-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.489, top1 = 90.56%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.41 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.310, top1 = 93.63%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.32 ms.
cifar100       train : [loss = 0.053, top1 = 99.37%], valid : [loss = 1.304, top1 = 70.69%], test : [loss = 1.290, top1 = 70.72%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.62 ms.
ImageNet16-120 train : [loss = 1.476, top1 = 59.93%], valid : [loss = 2.109, top1 = 46.52%], test : [loss = 2.125, top1 = 46.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.50%], valid : [loss = 0.654, top1 = 77.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11778/15625) 011778-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.494, top1 = 90.11%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.97 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.328, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.53 ms.
cifar100       train : [loss = 0.137, top1 = 97.04%], valid : [loss = 1.326, top1 = 68.19%], test : [loss = 1.324, top1 = 69.07%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.23%], valid : [loss = 2.237, top1 = 42.37%], test : [loss = 2.253, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.96%], valid : [loss = 0.737, top1 = 74.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11779/15625) 011779-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.100, top1 = 97.17%], valid : [loss = 0.452, top1 = 86.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.64 ms.
cifar10        train : [loss = 0.141, top1 = 95.48%], test  : [loss = 0.344, top1 = 89.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.11 ms.
cifar100       train : [loss = 0.896, top1 = 74.57%], valid : [loss = 1.327, top1 = 62.66%], test : [loss = 1.313, top1 = 62.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.06%], valid : [loss = 2.592, top1 = 34.98%], test : [loss = 2.616, top1 = 34.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.47%], valid : [loss = 0.769, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11780/15625) 011780-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.77%], valid : [loss = 0.842, top1 = 72.56%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10        train : [loss = 0.549, top1 = 80.80%], test  : [loss = 0.713, top1 = 76.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.92 ms.
cifar100       train : [loss = 1.767, top1 = 52.31%], valid : [loss = 2.061, top1 = 47.24%], test : [loss = 2.068, top1 = 46.45%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 17.00%], valid : [loss = 3.637, top1 = 16.65%], test : [loss = 3.662, top1 = 15.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11781/15625) 011781-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.25%], valid : [loss = 0.529, top1 = 82.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10        train : [loss = 0.405, top1 = 86.22%], test  : [loss = 0.467, top1 = 84.20%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.90 ms.
cifar100       train : [loss = 1.526, top1 = 58.10%], valid : [loss = 1.646, top1 = 55.12%], test : [loss = 1.626, top1 = 55.18%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.40 ms.
ImageNet16-120 train : [loss = 3.028, top1 = 26.55%], valid : [loss = 2.995, top1 = 27.20%], test : [loss = 3.056, top1 = 26.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11782/15625) 011782-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.481, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.04 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.326, top1 = 92.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.21 ms.
cifar100       train : [loss = 0.318, top1 = 91.50%], valid : [loss = 1.264, top1 = 66.92%], test : [loss = 1.250, top1 = 68.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.56%], valid : [loss = 2.330, top1 = 40.54%], test : [loss = 2.360, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.95%], valid : [loss = 0.632, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11783/15625) 011783-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.502, top1 = 90.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.16 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.313, top1 = 93.34%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.29 ms.
cifar100       train : [loss = 0.060, top1 = 99.18%], valid : [loss = 1.332, top1 = 70.27%], test : [loss = 1.327, top1 = 70.61%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.599, top1 = 56.92%], valid : [loss = 2.192, top1 = 44.38%], test : [loss = 2.180, top1 = 44.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.74%], valid : [loss = 0.622, top1 = 78.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11784/15625) 011784-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.689, top1 = 86.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.467, top1 = 89.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.247, top1 = 93.87%], valid : [loss = 1.594, top1 = 63.56%], test : [loss = 1.600, top1 = 64.15%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 40.10%], valid : [loss = 2.744, top1 = 32.58%], test : [loss = 2.786, top1 = 32.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.72%], valid : [loss = 0.846, top1 = 70.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11785/15625) 011785-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.03%], valid : [loss = 0.861, top1 = 71.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10        train : [loss = 0.565, top1 = 80.22%], test  : [loss = 0.723, top1 = 75.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.27 ms.
cifar100       train : [loss = 1.777, top1 = 52.19%], valid : [loss = 2.053, top1 = 46.75%], test : [loss = 2.047, top1 = 46.73%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.26 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.72%], valid : [loss = 3.653, top1 = 16.51%], test : [loss = 3.677, top1 = 15.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11786/15625) 011786-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.64%], valid : [loss = 0.561, top1 = 87.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.029, top1 = 99.16%], test  : [loss = 0.385, top1 = 90.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.71 ms.
cifar100       train : [loss = 0.386, top1 = 89.03%], valid : [loss = 1.290, top1 = 66.68%], test : [loss = 1.300, top1 = 67.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.17%], valid : [loss = 2.440, top1 = 37.72%], test : [loss = 2.460, top1 = 37.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.47%], valid : [loss = 0.895, top1 = 68.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11787/15625) 011787-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.578, top1 = 87.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.390, top1 = 90.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 0.417, top1 = 88.15%], valid : [loss = 1.388, top1 = 65.17%], test : [loss = 1.381, top1 = 65.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.323, top1 = 40.36%], valid : [loss = 2.517, top1 = 36.65%], test : [loss = 2.566, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.25%], valid : [loss = 0.799, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11788/15625) 011788-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.679, top1 = 85.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.70 ms.
cifar10        train : [loss = 0.036, top1 = 98.96%], test  : [loss = 0.455, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.84 ms.
cifar100       train : [loss = 0.458, top1 = 87.15%], valid : [loss = 1.465, top1 = 63.27%], test : [loss = 1.467, top1 = 63.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.97%], valid : [loss = 2.681, top1 = 33.17%], test : [loss = 2.708, top1 = 34.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.09%], valid : [loss = 0.849, top1 = 70.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11789/15625) 011789-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.579, top1 = 88.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.011, top1 = 99.70%], test  : [loss = 0.362, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.41 ms.
cifar100       train : [loss = 0.273, top1 = 92.45%], valid : [loss = 1.349, top1 = 67.00%], test : [loss = 1.365, top1 = 67.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.26%], valid : [loss = 2.404, top1 = 39.22%], test : [loss = 2.409, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.14%], valid : [loss = 0.929, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11790/15625) 011790-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.30%], valid : [loss = 0.568, top1 = 81.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10        train : [loss = 0.287, top1 = 90.14%], test  : [loss = 0.421, top1 = 86.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.00 ms.
cifar100       train : [loss = 1.329, top1 = 62.58%], valid : [loss = 1.634, top1 = 55.78%], test : [loss = 1.647, top1 = 55.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 3.059, top1 = 25.98%], valid : [loss = 3.076, top1 = 25.88%], test : [loss = 3.134, top1 = 24.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.223, top1 = 55.96%], valid : [loss = 1.275, top1 = 53.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11791/15625) 011791-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.555, top1 = 87.88%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10        train : [loss = 0.024, top1 = 99.28%], test  : [loss = 0.343, top1 = 91.88%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.54 ms.
cifar100       train : [loss = 0.442, top1 = 87.21%], valid : [loss = 1.255, top1 = 67.34%], test : [loss = 1.271, top1 = 66.69%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.67 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.57%], valid : [loss = 2.365, top1 = 39.80%], test : [loss = 2.375, top1 = 38.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.43%], valid : [loss = 0.773, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11792/15625) 011792-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.01 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.547, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.365, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.53 ms.
cifar100       train : [loss = 0.052, top1 = 99.40%], valid : [loss = 1.484, top1 = 69.15%], test : [loss = 1.470, top1 = 69.17%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 1.723, top1 = 54.09%], valid : [loss = 2.406, top1 = 40.28%], test : [loss = 2.447, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.69%], valid : [loss = 0.703, top1 = 75.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11793/15625) 011793-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.54%], valid : [loss = 0.525, top1 = 87.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.045, top1 = 98.75%], test  : [loss = 0.367, top1 = 90.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.54 ms.
cifar100       train : [loss = 0.550, top1 = 83.92%], valid : [loss = 1.311, top1 = 66.28%], test : [loss = 1.309, top1 = 65.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.56%], valid : [loss = 2.462, top1 = 38.00%], test : [loss = 2.462, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.84%], valid : [loss = 0.640, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11794/15625) 011794-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.78%], valid : [loss = 0.539, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10        train : [loss = 0.070, top1 = 97.98%], test  : [loss = 0.353, top1 = 89.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 0.677, top1 = 80.15%], valid : [loss = 1.304, top1 = 65.50%], test : [loss = 1.269, top1 = 65.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.11%], valid : [loss = 2.503, top1 = 36.30%], test : [loss = 2.520, top1 = 36.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.51%], valid : [loss = 0.883, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11795/15625) 011795-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.519, top1 = 88.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10        train : [loss = 0.023, top1 = 99.42%], test  : [loss = 0.358, top1 = 91.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.25 ms.
cifar100       train : [loss = 0.425, top1 = 87.63%], valid : [loss = 1.345, top1 = 65.78%], test : [loss = 1.349, top1 = 65.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.12 ms.
ImageNet16-120 train : [loss = 2.276, top1 = 41.45%], valid : [loss = 2.500, top1 = 36.50%], test : [loss = 2.558, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.46%], valid : [loss = 0.710, top1 = 75.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11796/15625) 011796-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.434, top1 = 90.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.22 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.290, top1 = 93.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.35 ms.
cifar100       train : [loss = 0.068, top1 = 99.01%], valid : [loss = 1.336, top1 = 70.70%], test : [loss = 1.345, top1 = 70.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.28 ms.
ImageNet16-120 train : [loss = 1.534, top1 = 58.44%], valid : [loss = 2.215, top1 = 44.90%], test : [loss = 2.263, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.347, top1 = 88.05%], valid : [loss = 0.488, top1 = 83.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11797/15625) 011797-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.411, top1 = 90.78%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.261, top1 = 93.81%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=23.38 ms.
cifar100       train : [loss = 0.044, top1 = 99.55%], valid : [loss = 1.287, top1 = 71.56%], test : [loss = 1.270, top1 = 71.84%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.16 ms.
ImageNet16-120 train : [loss = 1.383, top1 = 62.27%], valid : [loss = 2.207, top1 = 45.73%], test : [loss = 2.248, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.71%], valid : [loss = 0.505, top1 = 83.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11798/15625) 011798-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.12 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.68%], valid : [loss = 0.621, top1 = 84.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.087, top1 = 97.15%], test  : [loss = 0.411, top1 = 88.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 0.708, top1 = 79.27%], valid : [loss = 1.550, top1 = 59.32%], test : [loss = 1.540, top1 = 60.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 3.196, top1 = 22.12%], valid : [loss = 3.193, top1 = 22.40%], test : [loss = 3.240, top1 = 21.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11799/15625) 011799-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.530, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.328, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.35 ms.
cifar100       train : [loss = 0.097, top1 = 98.15%], valid : [loss = 1.403, top1 = 68.86%], test : [loss = 1.403, top1 = 68.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.54%], valid : [loss = 2.386, top1 = 39.13%], test : [loss = 2.360, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.18%], valid : [loss = 0.848, top1 = 70.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11800/15625) 011800-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.533, top1 = 88.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.347, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.26 ms.
cifar100       train : [loss = 0.244, top1 = 93.52%], valid : [loss = 1.255, top1 = 68.81%], test : [loss = 1.258, top1 = 68.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.50%], valid : [loss = 2.229, top1 = 42.79%], test : [loss = 2.256, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.34%], valid : [loss = 0.718, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11801/15625) 011801-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.77%], valid : [loss = 0.518, top1 = 88.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.61 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.355, top1 = 91.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.68 ms.
cifar100       train : [loss = 0.480, top1 = 85.95%], valid : [loss = 1.352, top1 = 65.74%], test : [loss = 1.371, top1 = 65.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.36%], valid : [loss = 2.515, top1 = 36.07%], test : [loss = 2.545, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11802/15625) 011802-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.34%], valid : [loss = 0.705, top1 = 84.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.90 ms.
cifar10        train : [loss = 0.047, top1 = 98.58%], test  : [loss = 0.441, top1 = 88.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.10 ms.
cifar100       train : [loss = 0.580, top1 = 83.15%], valid : [loss = 1.558, top1 = 61.20%], test : [loss = 1.566, top1 = 61.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 34.00%], valid : [loss = 2.823, top1 = 30.77%], test : [loss = 2.860, top1 = 30.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 69.18%], valid : [loss = 0.917, top1 = 67.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11803/15625) 011803-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.73 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.494, top1 = 88.93%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.311, top1 = 92.33%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.46 ms.
cifar100       train : [loss = 0.280, top1 = 92.86%], valid : [loss = 1.189, top1 = 69.60%], test : [loss = 1.207, top1 = 69.14%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.17%], valid : [loss = 2.207, top1 = 42.30%], test : [loss = 2.241, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.33%], valid : [loss = 0.640, top1 = 78.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11804/15625) 011804-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.84 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11805/15625) 011805-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.534, top1 = 88.76%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.74 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.335, top1 = 92.54%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.40 ms.
cifar100       train : [loss = 0.148, top1 = 96.52%], valid : [loss = 1.338, top1 = 68.80%], test : [loss = 1.325, top1 = 69.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.84%], valid : [loss = 2.282, top1 = 41.83%], test : [loss = 2.283, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.32%], valid : [loss = 0.819, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11806/15625) 011806-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.103, top1 = 96.95%], valid : [loss = 0.453, top1 = 86.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.44 ms.
cifar10        train : [loss = 0.139, top1 = 95.42%], test  : [loss = 0.334, top1 = 88.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.18 ms.
cifar100       train : [loss = 0.912, top1 = 74.40%], valid : [loss = 1.334, top1 = 63.16%], test : [loss = 1.311, top1 = 63.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.86 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.93%], valid : [loss = 2.628, top1 = 34.67%], test : [loss = 2.632, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.47%], valid : [loss = 0.769, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11807/15625) 011807-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.18%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.332, top1 = 92.41%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.46 ms.
cifar100       train : [loss = 0.150, top1 = 96.79%], valid : [loss = 1.273, top1 = 68.98%], test : [loss = 1.304, top1 = 69.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.65%], valid : [loss = 2.274, top1 = 42.73%], test : [loss = 2.249, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.28%], valid : [loss = 0.695, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11808/15625) 011808-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.545, top1 = 88.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.027, top1 = 99.26%], test  : [loss = 0.341, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.37 ms.
cifar100       train : [loss = 0.415, top1 = 88.03%], valid : [loss = 1.255, top1 = 66.60%], test : [loss = 1.284, top1 = 67.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.29%], valid : [loss = 2.406, top1 = 39.00%], test : [loss = 2.433, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.96%], valid : [loss = 0.756, top1 = 73.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11809/15625) 011809-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.408, top1 = 85.82%], valid : [loss = 0.658, top1 = 78.36%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10        train : [loss = 0.390, top1 = 86.41%], test  : [loss = 0.529, top1 = 82.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.25 ms.
cifar100       train : [loss = 1.611, top1 = 55.16%], valid : [loss = 1.830, top1 = 50.56%], test : [loss = 1.815, top1 = 50.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 3.158, top1 = 23.77%], valid : [loss = 3.176, top1 = 24.77%], test : [loss = 3.216, top1 = 23.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 62.07%], valid : [loss = 1.111, top1 = 60.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11810/15625) 011810-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.494, top1 = 89.01%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.70 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.307, top1 = 92.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.68 ms.
cifar100       train : [loss = 0.325, top1 = 91.06%], valid : [loss = 1.287, top1 = 67.32%], test : [loss = 1.279, top1 = 68.30%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.06 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.63%], valid : [loss = 2.384, top1 = 38.57%], test : [loss = 2.422, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11811/15625) 011811-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.71 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.95%], valid : [loss = 0.862, top1 = 71.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.32 ms.
cifar10        train : [loss = 0.559, top1 = 80.52%], test  : [loss = 0.720, top1 = 75.61%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.22 ms.
cifar100       train : [loss = 1.781, top1 = 51.97%], valid : [loss = 2.057, top1 = 46.58%], test : [loss = 2.070, top1 = 46.43%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.77%], valid : [loss = 3.633, top1 = 16.74%], test : [loss = 3.665, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11812/15625) 011812-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.501, top1 = 88.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.336, top1 = 91.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.78 ms.
cifar100       train : [loss = 0.345, top1 = 90.46%], valid : [loss = 1.277, top1 = 67.10%], test : [loss = 1.302, top1 = 66.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.45%], valid : [loss = 2.420, top1 = 38.50%], test : [loss = 2.413, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11813/15625) 011813-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.10 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11814/15625) 011814-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.22%], valid : [loss = 0.574, top1 = 83.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.189, top1 = 93.63%], test  : [loss = 0.396, top1 = 87.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 1.187, top1 = 66.07%], valid : [loss = 1.530, top1 = 58.45%], test : [loss = 1.506, top1 = 58.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.53%], valid : [loss = 2.689, top1 = 33.17%], test : [loss = 2.721, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.20%], valid : [loss = 0.989, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11815/15625) 011815-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.596, top1 = 87.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.395, top1 = 91.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.55 ms.
cifar100       train : [loss = 0.367, top1 = 89.71%], valid : [loss = 1.378, top1 = 65.86%], test : [loss = 1.368, top1 = 66.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.94%], valid : [loss = 2.500, top1 = 36.60%], test : [loss = 2.525, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.18%], valid : [loss = 0.796, top1 = 71.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11816/15625) 011816-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.91 ms.
cifar10-valid  train : [loss = 0.295, top1 = 89.95%], valid : [loss = 0.478, top1 = 84.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.39 ms.
cifar10        train : [loss = 0.268, top1 = 91.06%], test  : [loss = 0.367, top1 = 87.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.80 ms.
cifar100       train : [loss = 1.283, top1 = 64.13%], valid : [loss = 1.469, top1 = 59.07%], test : [loss = 1.462, top1 = 58.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.43 ms.
ImageNet16-120 train : [loss = 2.827, top1 = 30.37%], valid : [loss = 2.819, top1 = 30.25%], test : [loss = 2.856, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.58%], valid : [loss = 1.003, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11817/15625) 011817-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.356, top1 = 87.35%], valid : [loss = 0.615, top1 = 80.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.12 ms.
cifar10        train : [loss = 0.272, top1 = 90.60%], test  : [loss = 0.420, top1 = 86.32%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.76 ms.
cifar100       train : [loss = 1.546, top1 = 56.75%], valid : [loss = 1.796, top1 = 51.82%], test : [loss = 1.767, top1 = 51.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 2.905, top1 = 28.44%], valid : [loss = 2.941, top1 = 28.20%], test : [loss = 2.976, top1 = 26.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.98%], valid : [loss = 1.091, top1 = 60.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11818/15625) 011818-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.65%], valid : [loss = 0.592, top1 = 80.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.73 ms.
cifar10        train : [loss = 0.264, top1 = 91.06%], test  : [loss = 0.414, top1 = 86.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.05 ms.
cifar100       train : [loss = 1.517, top1 = 57.66%], valid : [loss = 1.761, top1 = 52.34%], test : [loss = 1.756, top1 = 53.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.15 ms.
ImageNet16-120 train : [loss = 2.962, top1 = 27.39%], valid : [loss = 2.967, top1 = 28.13%], test : [loss = 3.031, top1 = 26.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.68%], valid : [loss = 1.015, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11819/15625) 011819-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.35 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.70%], valid : [loss = 0.614, top1 = 86.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10        train : [loss = 0.030, top1 = 99.20%], test  : [loss = 0.405, top1 = 90.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.69 ms.
cifar100       train : [loss = 0.524, top1 = 84.77%], valid : [loss = 1.434, top1 = 63.32%], test : [loss = 1.414, top1 = 64.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.372, top1 = 39.31%], valid : [loss = 2.549, top1 = 36.20%], test : [loss = 2.600, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11820/15625) 011820-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.520, top1 = 88.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.332, top1 = 92.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.340, top1 = 90.70%], valid : [loss = 1.284, top1 = 66.95%], test : [loss = 1.292, top1 = 67.03%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.89 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.58%], valid : [loss = 2.407, top1 = 39.26%], test : [loss = 2.421, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11821/15625) 011821-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.34%], valid : [loss = 0.528, top1 = 82.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10        train : [loss = 0.291, top1 = 89.94%], test  : [loss = 0.415, top1 = 86.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.80 ms.
cifar100       train : [loss = 1.324, top1 = 62.63%], valid : [loss = 1.558, top1 = 57.60%], test : [loss = 1.566, top1 = 57.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.873, top1 = 29.25%], valid : [loss = 2.871, top1 = 29.20%], test : [loss = 2.934, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.009, top1 = 63.81%], valid : [loss = 1.028, top1 = 63.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11822/15625) 011822-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.575, top1 = 87.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.389, top1 = 91.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 0.393, top1 = 88.94%], valid : [loss = 1.428, top1 = 64.63%], test : [loss = 1.405, top1 = 64.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.00%], valid : [loss = 2.524, top1 = 36.43%], test : [loss = 2.526, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11823/15625) 011823-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.561, top1 = 88.91%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.34 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.363, top1 = 92.67%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.24 ms.
cifar100       train : [loss = 0.043, top1 = 99.56%], valid : [loss = 1.443, top1 = 69.06%], test : [loss = 1.405, top1 = 69.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 1.592, top1 = 57.15%], valid : [loss = 2.411, top1 = 40.23%], test : [loss = 2.445, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 79.87%], valid : [loss = 0.692, top1 = 76.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11824/15625) 011824-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.24%], valid : [loss = 0.583, top1 = 85.31%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.42 ms.
cifar10        train : [loss = 0.077, top1 = 97.67%], test  : [loss = 0.382, top1 = 89.30%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.02 ms.
cifar100       train : [loss = 0.707, top1 = 79.30%], valid : [loss = 1.385, top1 = 63.66%], test : [loss = 1.381, top1 = 62.96%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.59 ms.
ImageNet16-120 train : [loss = 2.423, top1 = 38.13%], valid : [loss = 2.538, top1 = 35.80%], test : [loss = 2.566, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.80%], valid : [loss = 0.862, top1 = 69.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11825/15625) 011825-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.489, top1 = 90.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.327, top1 = 93.32%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.03 ms.
cifar100       train : [loss = 0.108, top1 = 97.86%], valid : [loss = 1.321, top1 = 69.54%], test : [loss = 1.273, top1 = 69.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.33%], valid : [loss = 2.197, top1 = 43.17%], test : [loss = 2.216, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.00%], valid : [loss = 0.724, top1 = 75.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11826/15625) 011826-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.00%], valid : [loss = 0.477, top1 = 84.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10        train : [loss = 0.299, top1 = 89.93%], test  : [loss = 0.400, top1 = 86.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.20 ms.
cifar100       train : [loss = 1.329, top1 = 63.10%], valid : [loss = 1.543, top1 = 57.72%], test : [loss = 1.512, top1 = 57.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.82%], valid : [loss = 2.863, top1 = 29.57%], test : [loss = 2.937, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11827/15625) 011827-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.614, top1 = 85.33%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.070, top1 = 97.91%], test  : [loss = 0.410, top1 = 88.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 0.714, top1 = 79.23%], valid : [loss = 1.378, top1 = 63.49%], test : [loss = 1.383, top1 = 63.53%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.02%], valid : [loss = 2.646, top1 = 34.41%], test : [loss = 2.686, top1 = 33.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11828/15625) 011828-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.329, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.08 ms.
cifar100       train : [loss = 0.153, top1 = 96.76%], valid : [loss = 1.273, top1 = 69.25%], test : [loss = 1.290, top1 = 69.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.22%], valid : [loss = 2.299, top1 = 41.70%], test : [loss = 2.296, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11829/15625) 011829-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.304, top1 = 92.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.80 ms.
cifar100       train : [loss = 0.210, top1 = 95.12%], valid : [loss = 1.280, top1 = 69.02%], test : [loss = 1.297, top1 = 69.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 1.845, top1 = 51.25%], valid : [loss = 2.276, top1 = 41.97%], test : [loss = 2.283, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.432, top1 = 85.26%], valid : [loss = 0.545, top1 = 81.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11830/15625) 011830-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.533, top1 = 89.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.333, top1 = 93.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.96 ms.
cifar100       train : [loss = 0.048, top1 = 99.55%], valid : [loss = 1.438, top1 = 68.64%], test : [loss = 1.412, top1 = 69.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.47 ms.
ImageNet16-120 train : [loss = 1.653, top1 = 55.79%], valid : [loss = 2.405, top1 = 40.63%], test : [loss = 2.448, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.16%], valid : [loss = 0.677, top1 = 76.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11831/15625) 011831-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.519, top1 = 89.87%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=21.57 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.328, top1 = 93.19%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.29 ms.
cifar100       train : [loss = 0.078, top1 = 98.72%], valid : [loss = 1.380, top1 = 68.90%], test : [loss = 1.349, top1 = 69.20%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.79%], valid : [loss = 2.333, top1 = 41.00%], test : [loss = 2.331, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.07%], valid : [loss = 0.775, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11832/15625) 011832-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.329, top1 = 92.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.42 ms.
cifar100       train : [loss = 0.350, top1 = 90.45%], valid : [loss = 1.259, top1 = 67.22%], test : [loss = 1.311, top1 = 67.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.45%], valid : [loss = 2.416, top1 = 38.07%], test : [loss = 2.426, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11833/15625) 011833-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.511, top1 = 82.23%], valid : [loss = 0.664, top1 = 77.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10        train : [loss = 0.519, top1 = 81.99%], test  : [loss = 0.592, top1 = 79.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.03 ms.
cifar100       train : [loss = 1.696, top1 = 53.86%], valid : [loss = 1.872, top1 = 49.66%], test : [loss = 1.878, top1 = 49.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.26%], valid : [loss = 3.330, top1 = 21.17%], test : [loss = 3.322, top1 = 21.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11834/15625) 011834-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.567, top1 = 87.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.019, top1 = 99.51%], test  : [loss = 0.395, top1 = 90.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.47 ms.
cifar100       train : [loss = 0.440, top1 = 87.44%], valid : [loss = 1.424, top1 = 64.52%], test : [loss = 1.397, top1 = 65.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 41.03%], valid : [loss = 2.497, top1 = 36.67%], test : [loss = 2.544, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.33%], valid : [loss = 0.790, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11835/15625) 011835-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.63%], valid : [loss = 0.463, top1 = 86.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.152, top1 = 95.00%], test  : [loss = 0.341, top1 = 89.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 1.007, top1 = 71.29%], valid : [loss = 1.344, top1 = 62.48%], test : [loss = 1.354, top1 = 62.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.80%], valid : [loss = 2.697, top1 = 32.50%], test : [loss = 2.736, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.36%], valid : [loss = 0.780, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11836/15625) 011836-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.465, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.294, top1 = 92.55%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.362, top1 = 89.94%], valid : [loss = 1.289, top1 = 66.66%], test : [loss = 1.262, top1 = 67.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.71%], valid : [loss = 2.309, top1 = 40.70%], test : [loss = 2.322, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11837/15625) 011837-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.457, top1 = 89.77%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.325, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.98 ms.
cifar100       train : [loss = 0.198, top1 = 95.15%], valid : [loss = 1.362, top1 = 67.77%], test : [loss = 1.374, top1 = 67.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.58%], valid : [loss = 2.311, top1 = 41.15%], test : [loss = 2.346, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.45%], valid : [loss = 0.574, top1 = 80.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11838/15625) 011838-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.09 ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.97%], valid : [loss = 0.842, top1 = 71.16%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.61 ms.
cifar10        train : [loss = 0.672, top1 = 76.50%], test  : [loss = 0.759, top1 = 73.72%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.45 ms.
cifar100       train : [loss = 2.015, top1 = 46.61%], valid : [loss = 2.184, top1 = 43.54%], test : [loss = 2.195, top1 = 43.98%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.49 ms.
ImageNet16-120 train : [loss = 3.662, top1 = 15.51%], valid : [loss = 3.693, top1 = 15.90%], test : [loss = 3.705, top1 = 14.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11839/15625) 011839-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.43%], valid : [loss = 0.548, top1 = 82.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.07 ms.
cifar10        train : [loss = 0.286, top1 = 90.25%], test  : [loss = 0.432, top1 = 85.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.10 ms.
cifar100       train : [loss = 1.586, top1 = 55.76%], valid : [loss = 1.796, top1 = 50.62%], test : [loss = 1.807, top1 = 51.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 27.96%], valid : [loss = 2.962, top1 = 28.97%], test : [loss = 3.001, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.74%], valid : [loss = 1.064, top1 = 61.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11840/15625) 011840-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.76 ms.
cifar10-valid  train : [loss = 0.261, top1 = 90.99%], valid : [loss = 0.867, top1 = 75.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10        train : [loss = 0.317, top1 = 88.79%], test  : [loss = 0.624, top1 = 80.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.58 ms.
cifar100       train : [loss = 1.398, top1 = 60.98%], valid : [loss = 1.918, top1 = 50.28%], test : [loss = 1.953, top1 = 49.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 3.501, top1 = 17.23%], valid : [loss = 3.528, top1 = 16.60%], test : [loss = 3.529, top1 = 17.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11841/15625) 011841-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.21%], valid : [loss = 0.551, top1 = 87.32%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.12 ms.
cifar10        train : [loss = 0.050, top1 = 98.40%], test  : [loss = 0.382, top1 = 90.53%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.47 ms.
cifar100       train : [loss = 0.510, top1 = 84.97%], valid : [loss = 1.345, top1 = 65.40%], test : [loss = 1.333, top1 = 65.50%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.69%], valid : [loss = 2.381, top1 = 40.13%], test : [loss = 2.377, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.64%], valid : [loss = 0.774, top1 = 72.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11842/15625) 011842-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.78%], valid : [loss = 0.838, top1 = 71.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.42 ms.
cifar10        train : [loss = 0.564, top1 = 80.47%], test  : [loss = 0.723, top1 = 75.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.88 ms.
cifar100       train : [loss = 1.794, top1 = 51.75%], valid : [loss = 2.051, top1 = 47.64%], test : [loss = 2.096, top1 = 46.18%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.88%], valid : [loss = 3.630, top1 = 16.73%], test : [loss = 3.662, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11843/15625) 011843-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 52.35 M, Params=0.382 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.533, top1 = 88.65%]
cifar10        FLOP= 52.35 M, Params=0.382 MB, latency=19.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.340, top1 = 92.07%]
cifar100       FLOP= 52.35 M, Params=0.388 MB, latency=18.45 ms.
cifar100       train : [loss = 0.270, top1 = 92.70%], valid : [loss = 1.278, top1 = 68.13%], test : [loss = 1.266, top1 = 68.59%]
ImageNet16-120 FLOP= 13.09 M, Params=0.389 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.976, top1 = 48.09%], valid : [loss = 2.273, top1 = 41.60%], test : [loss = 2.310, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.25%], valid : [loss = 0.677, top1 = 76.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11844/15625) 011844-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.85%], valid : [loss = 0.717, top1 = 83.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.093, top1 = 96.99%], test  : [loss = 0.486, top1 = 86.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 0.813, top1 = 76.27%], valid : [loss = 1.550, top1 = 59.84%], test : [loss = 1.532, top1 = 60.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.821, top1 = 30.22%], valid : [loss = 2.969, top1 = 28.17%], test : [loss = 3.000, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11845/15625) 011845-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.30%], valid : [loss = 0.745, top1 = 74.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.501, top1 = 82.66%], test  : [loss = 0.578, top1 = 80.21%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.29 ms.
cifar100       train : [loss = 2.035, top1 = 45.10%], valid : [loss = 2.154, top1 = 42.65%], test : [loss = 2.154, top1 = 42.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 3.022, top1 = 26.11%], valid : [loss = 3.005, top1 = 26.61%], test : [loss = 3.055, top1 = 25.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11846/15625) 011846-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.52%], valid : [loss = 0.696, top1 = 84.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.049, top1 = 98.56%], test  : [loss = 0.446, top1 = 89.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.616, top1 = 81.88%], valid : [loss = 1.559, top1 = 60.58%], test : [loss = 1.587, top1 = 60.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.18%], valid : [loss = 2.771, top1 = 31.13%], test : [loss = 2.822, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.863, top1 = 69.04%], valid : [loss = 0.928, top1 = 67.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11847/15625) 011847-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.34%], valid : [loss = 0.468, top1 = 86.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.169, top1 = 94.44%], test  : [loss = 0.351, top1 = 88.55%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.64 ms.
cifar100       train : [loss = 1.000, top1 = 71.54%], valid : [loss = 1.356, top1 = 62.20%], test : [loss = 1.356, top1 = 62.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.93%], valid : [loss = 2.704, top1 = 32.13%], test : [loss = 2.727, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.33%], valid : [loss = 0.787, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11848/15625) 011848-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.575, top1 = 87.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.70 ms.
cifar10        train : [loss = 0.016, top1 = 99.55%], test  : [loss = 0.368, top1 = 91.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.43 ms.
cifar100       train : [loss = 0.316, top1 = 91.01%], valid : [loss = 1.376, top1 = 66.28%], test : [loss = 1.364, top1 = 67.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.39%], valid : [loss = 2.468, top1 = 37.43%], test : [loss = 2.483, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.55%], valid : [loss = 0.900, top1 = 68.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11849/15625) 011849-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.660, top1 = 86.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.425, top1 = 90.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.94 ms.
cifar100       train : [loss = 0.289, top1 = 92.41%], valid : [loss = 1.541, top1 = 63.84%], test : [loss = 1.491, top1 = 65.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.51%], valid : [loss = 2.606, top1 = 34.97%], test : [loss = 2.606, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.54%], valid : [loss = 0.768, top1 = 72.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11850/15625) 011850-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.511, top1 = 88.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.325, top1 = 92.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.59 ms.
cifar100       train : [loss = 0.336, top1 = 90.93%], valid : [loss = 1.275, top1 = 67.21%], test : [loss = 1.288, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.99%], valid : [loss = 2.416, top1 = 38.73%], test : [loss = 2.402, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11851/15625) 011851-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.611, top1 = 86.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.407, top1 = 90.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.04 ms.
cifar100       train : [loss = 0.534, top1 = 84.31%], valid : [loss = 1.455, top1 = 63.01%], test : [loss = 1.438, top1 = 63.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.69 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.29%], valid : [loss = 2.518, top1 = 36.58%], test : [loss = 2.553, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.36%], valid : [loss = 0.861, top1 = 69.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11852/15625) 011852-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.513, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.347, top1 = 91.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.343, top1 = 90.67%], valid : [loss = 1.274, top1 = 66.98%], test : [loss = 1.291, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.06%], valid : [loss = 2.410, top1 = 39.33%], test : [loss = 2.386, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.16%], valid : [loss = 0.723, top1 = 75.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11853/15625) 011853-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.488, top1 = 89.52%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.83 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.327, top1 = 92.71%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.41 ms.
cifar100       train : [loss = 0.211, top1 = 94.73%], valid : [loss = 1.251, top1 = 68.88%], test : [loss = 1.283, top1 = 68.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 1.845, top1 = 51.15%], valid : [loss = 2.178, top1 = 43.37%], test : [loss = 2.234, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.59%], valid : [loss = 0.615, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11854/15625) 011854-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.04%], valid : [loss = 0.563, top1 = 86.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.01 ms.
cifar10        train : [loss = 0.062, top1 = 97.98%], test  : [loss = 0.391, top1 = 89.75%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.77 ms.
cifar100       train : [loss = 0.671, top1 = 80.34%], valid : [loss = 1.329, top1 = 64.10%], test : [loss = 1.307, top1 = 64.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.10%], valid : [loss = 2.506, top1 = 36.87%], test : [loss = 2.530, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.89%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11855/15625) 011855-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.356, top1 = 87.65%], valid : [loss = 0.577, top1 = 81.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10        train : [loss = 0.300, top1 = 89.67%], test  : [loss = 0.449, top1 = 85.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 1.533, top1 = 57.20%], valid : [loss = 1.746, top1 = 52.76%], test : [loss = 1.767, top1 = 52.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 2.955, top1 = 27.49%], valid : [loss = 2.977, top1 = 27.12%], test : [loss = 3.022, top1 = 26.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.63%], valid : [loss = 1.049, top1 = 62.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11856/15625) 011856-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.462, top1 = 89.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.315, top1 = 92.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.76 ms.
cifar100       train : [loss = 0.269, top1 = 93.02%], valid : [loss = 1.192, top1 = 68.84%], test : [loss = 1.186, top1 = 69.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.50%], valid : [loss = 2.258, top1 = 42.13%], test : [loss = 2.243, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11857/15625) 011857-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.547, top1 = 88.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.53 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.363, top1 = 92.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.18 ms.
cifar100       train : [loss = 0.171, top1 = 95.71%], valid : [loss = 1.362, top1 = 67.66%], test : [loss = 1.416, top1 = 67.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 32.29%], valid : [loss = 2.802, top1 = 30.27%], test : [loss = 2.794, top1 = 28.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.23%], valid : [loss = 1.017, top1 = 63.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11858/15625) 011858-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.704, top1 = 84.97%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.83 ms.
cifar10        train : [loss = 0.032, top1 = 99.14%], test  : [loss = 0.503, top1 = 88.04%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.52 ms.
cifar100       train : [loss = 0.378, top1 = 89.87%], valid : [loss = 1.585, top1 = 62.10%], test : [loss = 1.570, top1 = 61.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.41 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.15%], valid : [loss = 2.880, top1 = 29.43%], test : [loss = 2.897, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.66%], valid : [loss = 0.862, top1 = 69.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11859/15625) 011859-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.382, top1 = 86.78%], valid : [loss = 0.516, top1 = 82.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.46 ms.
cifar10        train : [loss = 0.398, top1 = 86.47%], test  : [loss = 0.467, top1 = 84.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.81 ms.
cifar100       train : [loss = 1.538, top1 = 57.70%], valid : [loss = 1.659, top1 = 54.70%], test : [loss = 1.651, top1 = 54.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.45%], valid : [loss = 2.995, top1 = 27.30%], test : [loss = 3.045, top1 = 26.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.127, top1 = 59.78%], valid : [loss = 1.138, top1 = 59.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11860/15625) 011860-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.93 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.00%], valid : [loss = 0.877, top1 = 71.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10        train : [loss = 0.570, top1 = 80.10%], test  : [loss = 0.732, top1 = 75.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.21 ms.
cifar100       train : [loss = 1.768, top1 = 52.53%], valid : [loss = 2.060, top1 = 46.62%], test : [loss = 2.092, top1 = 46.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.67 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.92%], valid : [loss = 3.619, top1 = 16.77%], test : [loss = 3.654, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11861/15625) 011861-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.58%], valid : [loss = 0.590, top1 = 86.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10        train : [loss = 0.042, top1 = 98.75%], test  : [loss = 0.401, top1 = 90.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.13 ms.
cifar100       train : [loss = 0.567, top1 = 83.25%], valid : [loss = 1.409, top1 = 63.78%], test : [loss = 1.407, top1 = 63.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.482, top1 = 37.02%], valid : [loss = 2.583, top1 = 35.73%], test : [loss = 2.666, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.10%], valid : [loss = 0.779, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11862/15625) 011862-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.90%], valid : [loss = 0.475, top1 = 84.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.302, top1 = 89.85%], test  : [loss = 0.399, top1 = 86.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.90 ms.
cifar100       train : [loss = 1.334, top1 = 62.87%], valid : [loss = 1.534, top1 = 57.83%], test : [loss = 1.514, top1 = 58.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.57%], valid : [loss = 2.899, top1 = 29.09%], test : [loss = 2.973, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11863/15625) 011863-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.564, top1 = 88.40%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.17 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.360, top1 = 92.07%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.63 ms.
cifar100       train : [loss = 0.245, top1 = 93.37%], valid : [loss = 1.331, top1 = 68.46%], test : [loss = 1.344, top1 = 67.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.64 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.52%], valid : [loss = 2.399, top1 = 39.17%], test : [loss = 2.447, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 68.79%], valid : [loss = 0.899, top1 = 68.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11864/15625) 011864-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.593, top1 = 86.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10        train : [loss = 0.030, top1 = 99.20%], test  : [loss = 0.395, top1 = 90.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 0.496, top1 = 85.46%], valid : [loss = 1.415, top1 = 64.43%], test : [loss = 1.389, top1 = 64.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 39.11%], valid : [loss = 2.560, top1 = 35.74%], test : [loss = 2.582, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.20%], valid : [loss = 0.847, top1 = 70.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11865/15625) 011865-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.48%], valid : [loss = 0.611, top1 = 83.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.129, top1 = 95.63%], test  : [loss = 0.405, top1 = 88.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.73 ms.
cifar100       train : [loss = 0.664, top1 = 80.44%], valid : [loss = 1.524, top1 = 60.84%], test : [loss = 1.516, top1 = 61.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 3.259, top1 = 20.83%], valid : [loss = 3.273, top1 = 20.77%], test : [loss = 3.304, top1 = 20.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 59.86%], valid : [loss = 1.141, top1 = 58.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11866/15625) 011866-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.520, top1 = 88.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.340, top1 = 92.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.68 ms.
cifar100       train : [loss = 0.342, top1 = 90.48%], valid : [loss = 1.262, top1 = 67.38%], test : [loss = 1.242, top1 = 67.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.36%], valid : [loss = 2.420, top1 = 39.20%], test : [loss = 2.411, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11867/15625) 011867-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.417, top1 = 90.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.291, top1 = 92.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.41 ms.
cifar100       train : [loss = 0.172, top1 = 96.11%], valid : [loss = 1.269, top1 = 70.10%], test : [loss = 1.282, top1 = 69.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 1.791, top1 = 52.40%], valid : [loss = 2.233, top1 = 43.23%], test : [loss = 2.242, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.94%], valid : [loss = 0.504, top1 = 82.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11868/15625) 011868-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.40 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11869/15625) 011869-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.609, top1 = 86.58%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.69 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.421, top1 = 89.70%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.43 ms.
cifar100       train : [loss = 0.361, top1 = 90.36%], valid : [loss = 1.400, top1 = 65.12%], test : [loss = 1.352, top1 = 66.06%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.35%], valid : [loss = 2.570, top1 = 35.80%], test : [loss = 2.582, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.25%], valid : [loss = 0.768, top1 = 73.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11870/15625) 011870-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.558, top1 = 88.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.383, top1 = 91.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.83 ms.
cifar100       train : [loss = 0.160, top1 = 96.52%], valid : [loss = 1.402, top1 = 67.50%], test : [loss = 1.412, top1 = 67.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 1.954, top1 = 48.62%], valid : [loss = 2.451, top1 = 38.97%], test : [loss = 2.456, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.45%], valid : [loss = 0.698, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11871/15625) 011871-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.588, top1 = 87.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.07 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.408, top1 = 90.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.70 ms.
cifar100       train : [loss = 0.209, top1 = 94.82%], valid : [loss = 1.481, top1 = 65.50%], test : [loss = 1.526, top1 = 65.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.092, top1 = 45.66%], valid : [loss = 2.441, top1 = 38.73%], test : [loss = 2.462, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.30%], valid : [loss = 0.710, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11872/15625) 011872-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.77 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.15%], valid : [loss = 0.649, top1 = 84.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10        train : [loss = 0.084, top1 = 97.34%], test  : [loss = 0.451, top1 = 87.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.51 ms.
cifar100       train : [loss = 0.751, top1 = 78.32%], valid : [loss = 1.468, top1 = 61.06%], test : [loss = 1.439, top1 = 61.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.704, top1 = 32.60%], valid : [loss = 2.851, top1 = 31.30%], test : [loss = 2.870, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.67%], valid : [loss = 0.832, top1 = 70.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11873/15625) 011873-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.44%], valid : [loss = 0.610, top1 = 85.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10        train : [loss = 0.048, top1 = 98.54%], test  : [loss = 0.392, top1 = 89.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.25 ms.
cifar100       train : [loss = 0.629, top1 = 81.57%], valid : [loss = 1.466, top1 = 62.62%], test : [loss = 1.418, top1 = 62.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.448, top1 = 37.64%], valid : [loss = 2.607, top1 = 34.30%], test : [loss = 2.644, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 71.90%], valid : [loss = 0.834, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11874/15625) 011874-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.39%], valid : [loss = 0.671, top1 = 84.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.36 ms.
cifar10        train : [loss = 0.059, top1 = 98.22%], test  : [loss = 0.443, top1 = 88.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.84 ms.
cifar100       train : [loss = 0.648, top1 = 80.98%], valid : [loss = 1.484, top1 = 62.20%], test : [loss = 1.452, top1 = 62.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 2.719, top1 = 32.30%], valid : [loss = 2.926, top1 = 28.73%], test : [loss = 2.916, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.90%], valid : [loss = 0.887, top1 = 68.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11875/15625) 011875-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10-valid  train : [loss = 1.170, top1 = 57.66%], valid : [loss = 1.226, top1 = 56.46%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.70 ms.
cifar10        train : [loss = 1.144, top1 = 59.16%], test  : [loss = 1.156, top1 = 58.52%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.22 ms.
cifar100       train : [loss = 2.721, top1 = 31.91%], valid : [loss = 2.806, top1 = 30.20%], test : [loss = 2.790, top1 = 30.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.64 ms.
ImageNet16-120 train : [loss = 3.862, top1 = 12.48%], valid : [loss = 3.851, top1 = 13.47%], test : [loss = 3.872, top1 = 12.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.720, top1 = 34.68%], valid : [loss = 1.729, top1 = 34.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11876/15625) 011876-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.435, top1 = 90.91%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.21 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.281, top1 = 93.71%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.34 ms.
cifar100       train : [loss = 0.056, top1 = 99.27%], valid : [loss = 1.324, top1 = 70.70%], test : [loss = 1.312, top1 = 70.88%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 1.484, top1 = 59.77%], valid : [loss = 2.279, top1 = 44.07%], test : [loss = 2.221, top1 = 45.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 86.99%], valid : [loss = 0.514, top1 = 82.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11877/15625) 011877-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.56 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11878/15625) 011878-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.88%], valid : [loss = 0.535, top1 = 87.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.077, top1 = 97.53%], test  : [loss = 0.369, top1 = 89.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.10 ms.
cifar100       train : [loss = 0.717, top1 = 78.92%], valid : [loss = 1.350, top1 = 63.70%], test : [loss = 1.338, top1 = 65.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 35.98%], valid : [loss = 2.624, top1 = 33.70%], test : [loss = 2.676, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11879/15625) 011879-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.442, top1 = 90.37%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.66 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.319, top1 = 93.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.68 ms.
cifar100       train : [loss = 0.056, top1 = 99.19%], valid : [loss = 1.414, top1 = 69.39%], test : [loss = 1.410, top1 = 69.33%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 1.558, top1 = 57.97%], valid : [loss = 2.267, top1 = 43.34%], test : [loss = 2.294, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.84%], valid : [loss = 0.585, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11880/15625) 011880-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.57%], valid : [loss = 0.588, top1 = 86.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.042, top1 = 98.77%], test  : [loss = 0.395, top1 = 89.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.31 ms.
cifar100       train : [loss = 0.573, top1 = 83.03%], valid : [loss = 1.375, top1 = 64.40%], test : [loss = 1.408, top1 = 63.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 36.48%], valid : [loss = 2.662, top1 = 33.57%], test : [loss = 2.699, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.60%], valid : [loss = 0.753, top1 = 73.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11881/15625) 011881-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.52%], valid : [loss = 0.670, top1 = 85.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.76 ms.
cifar10        train : [loss = 0.042, top1 = 98.74%], test  : [loss = 0.404, top1 = 89.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 0.535, top1 = 84.56%], valid : [loss = 1.434, top1 = 63.72%], test : [loss = 1.422, top1 = 64.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.26%], valid : [loss = 2.629, top1 = 33.80%], test : [loss = 2.662, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.97%], valid : [loss = 0.933, top1 = 67.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11882/15625) 011882-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=20.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.477, top1 = 90.59%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=20.49 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.324, top1 = 93.20%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=20.94 ms.
cifar100       train : [loss = 0.106, top1 = 98.08%], valid : [loss = 1.283, top1 = 70.32%], test : [loss = 1.265, top1 = 70.12%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=20.65 ms.
ImageNet16-120 train : [loss = 1.612, top1 = 56.62%], valid : [loss = 2.107, top1 = 45.73%], test : [loss = 2.114, top1 = 46.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.95%], valid : [loss = 0.672, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11883/15625) 011883-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.62%], valid : [loss = 0.525, top1 = 83.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.234, top1 = 92.01%], test  : [loss = 0.386, top1 = 87.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.42 ms.
cifar100       train : [loss = 1.324, top1 = 62.76%], valid : [loss = 1.586, top1 = 57.06%], test : [loss = 1.574, top1 = 56.97%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.849, top1 = 29.79%], valid : [loss = 2.860, top1 = 29.60%], test : [loss = 2.920, top1 = 28.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.985, top1 = 64.78%], valid : [loss = 1.025, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11884/15625) 011884-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.727, top1 = 84.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.10 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.437, top1 = 89.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.30 ms.
cifar100       train : [loss = 0.312, top1 = 91.65%], valid : [loss = 1.646, top1 = 62.58%], test : [loss = 1.634, top1 = 61.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.24%], valid : [loss = 2.638, top1 = 34.90%], test : [loss = 2.658, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.74%], valid : [loss = 0.824, top1 = 71.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11885/15625) 011885-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.10 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.351, top1 = 91.79%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.82 ms.
cifar100       train : [loss = 0.352, top1 = 90.51%], valid : [loss = 1.301, top1 = 66.32%], test : [loss = 1.279, top1 = 68.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.67%], valid : [loss = 2.426, top1 = 39.23%], test : [loss = 2.424, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11886/15625) 011886-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.39%], valid : [loss = 0.663, top1 = 85.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.30 ms.
cifar10        train : [loss = 0.053, top1 = 98.44%], test  : [loss = 0.465, top1 = 88.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.68 ms.
cifar100       train : [loss = 0.624, top1 = 81.81%], valid : [loss = 1.544, top1 = 60.84%], test : [loss = 1.495, top1 = 62.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.71%], valid : [loss = 2.829, top1 = 30.47%], test : [loss = 2.855, top1 = 29.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.59%], valid : [loss = 0.885, top1 = 68.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11887/15625) 011887-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.003, top1 = 100.00%], valid : [loss = 0.487, top1 = 90.02%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.303, top1 = 93.39%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.47 ms.
cifar100       train : [loss = 0.095, top1 = 98.40%], valid : [loss = 1.272, top1 = 70.40%], test : [loss = 1.274, top1 = 70.70%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.73 ms.
ImageNet16-120 train : [loss = 1.612, top1 = 56.61%], valid : [loss = 2.148, top1 = 44.60%], test : [loss = 2.134, top1 = 45.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.55%], valid : [loss = 0.623, top1 = 78.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11888/15625) 011888-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.63 ms.
cifar10-valid  train : [loss = 0.377, top1 = 86.79%], valid : [loss = 0.622, top1 = 79.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10        train : [loss = 0.350, top1 = 87.79%], test  : [loss = 0.507, top1 = 83.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.93 ms.
cifar100       train : [loss = 1.630, top1 = 54.92%], valid : [loss = 1.914, top1 = 49.68%], test : [loss = 1.896, top1 = 49.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 3.274, top1 = 21.72%], valid : [loss = 3.257, top1 = 22.00%], test : [loss = 3.323, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.73%], valid : [loss = 1.244, top1 = 55.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11889/15625) 011889-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.101, top1 = 96.96%], valid : [loss = 0.536, top1 = 85.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.90 ms.
cifar10        train : [loss = 0.183, top1 = 93.83%], test  : [loss = 0.385, top1 = 87.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.69 ms.
cifar100       train : [loss = 1.021, top1 = 70.70%], valid : [loss = 1.433, top1 = 61.48%], test : [loss = 1.415, top1 = 61.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.30%], valid : [loss = 2.691, top1 = 32.83%], test : [loss = 2.748, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.942, top1 = 66.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11890/15625) 011890-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.633, top1 = 87.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.449, top1 = 90.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.43 ms.
cifar100       train : [loss = 0.187, top1 = 95.82%], valid : [loss = 1.616, top1 = 64.76%], test : [loss = 1.603, top1 = 64.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.42 ms.
ImageNet16-120 train : [loss = 2.198, top1 = 43.38%], valid : [loss = 2.641, top1 = 34.93%], test : [loss = 2.705, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.47%], valid : [loss = 0.764, top1 = 73.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11891/15625) 011891-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.41%], valid : [loss = 0.466, top1 = 86.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.82 ms.
cifar10        train : [loss = 0.156, top1 = 94.86%], test  : [loss = 0.345, top1 = 88.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.19 ms.
cifar100       train : [loss = 0.974, top1 = 72.33%], valid : [loss = 1.345, top1 = 62.42%], test : [loss = 1.360, top1 = 62.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.13%], valid : [loss = 2.707, top1 = 33.07%], test : [loss = 2.717, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11892/15625) 011892-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10-valid  train : [loss = 1.631, top1 = 38.46%], valid : [loss = 1.647, top1 = 38.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=7.38 ms.
cifar10        train : [loss = 1.421, top1 = 47.80%], test  : [loss = 1.427, top1 = 47.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.08 ms.
cifar100       train : [loss = 3.882, top1 = 10.34%], valid : [loss = 3.914, top1 = 10.18%], test : [loss = 3.908, top1 = 10.26%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.41 ms.
ImageNet16-120 train : [loss = 4.022, top1 = 9.98%], valid : [loss = 4.011, top1 = 9.90%], test : [loss = 4.025, top1 = 9.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.983, top1 = 26.08%], valid : [loss = 1.986, top1 = 26.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11893/15625) 011893-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.557, top1 = 89.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.90%], test  : [loss = 0.383, top1 = 92.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 0.106, top1 = 98.03%], valid : [loss = 1.496, top1 = 67.08%], test : [loss = 1.462, top1 = 68.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.38%], valid : [loss = 2.452, top1 = 39.00%], test : [loss = 2.448, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11894/15625) 011894-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.609, top1 = 87.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.413, top1 = 90.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.208, top1 = 95.28%], valid : [loss = 1.426, top1 = 66.98%], test : [loss = 1.420, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.20%], valid : [loss = 2.512, top1 = 36.80%], test : [loss = 2.504, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.62%], valid : [loss = 0.751, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11895/15625) 011895-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.541, top1 = 88.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.370, top1 = 92.22%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.99 ms.
cifar100       train : [loss = 0.136, top1 = 97.35%], valid : [loss = 1.424, top1 = 67.93%], test : [loss = 1.426, top1 = 67.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.69%], valid : [loss = 2.397, top1 = 40.30%], test : [loss = 2.379, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.61%], valid : [loss = 0.658, top1 = 77.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11896/15625) 011896-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.558, top1 = 88.26%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=18.80 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.371, top1 = 91.89%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=18.84 ms.
cifar100       train : [loss = 0.173, top1 = 96.21%], valid : [loss = 1.442, top1 = 66.82%], test : [loss = 1.431, top1 = 67.08%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.42%], valid : [loss = 2.437, top1 = 39.29%], test : [loss = 2.451, top1 = 39.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 78.86%], valid : [loss = 0.689, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11897/15625) 011897-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.69%], valid : [loss = 0.480, top1 = 85.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.42 ms.
cifar10        train : [loss = 0.152, top1 = 95.06%], test  : [loss = 0.343, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.99 ms.
cifar100       train : [loss = 0.971, top1 = 72.61%], valid : [loss = 1.335, top1 = 62.34%], test : [loss = 1.315, top1 = 62.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.27%], valid : [loss = 2.654, top1 = 33.00%], test : [loss = 2.659, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11898/15625) 011898-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.49%], valid : [loss = 0.569, top1 = 87.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10        train : [loss = 0.033, top1 = 98.96%], test  : [loss = 0.357, top1 = 90.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.72 ms.
cifar100       train : [loss = 0.431, top1 = 87.31%], valid : [loss = 1.277, top1 = 67.02%], test : [loss = 1.337, top1 = 65.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.260, top1 = 41.68%], valid : [loss = 2.431, top1 = 38.67%], test : [loss = 2.468, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.872, top1 = 68.91%], valid : [loss = 0.923, top1 = 67.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11899/15625) 011899-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.35 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.495, top1 = 88.94%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.78 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.312, top1 = 92.04%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.46 ms.
cifar100       train : [loss = 0.281, top1 = 92.60%], valid : [loss = 1.192, top1 = 69.30%], test : [loss = 1.188, top1 = 69.26%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.54%], valid : [loss = 2.245, top1 = 42.07%], test : [loss = 2.266, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.70%], valid : [loss = 0.629, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11900/15625) 011900-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.477, top1 = 89.89%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.308, top1 = 92.83%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.71 ms.
cifar100       train : [loss = 0.094, top1 = 98.40%], valid : [loss = 1.295, top1 = 68.86%], test : [loss = 1.299, top1 = 69.70%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.850, top1 = 50.97%], valid : [loss = 2.269, top1 = 41.47%], test : [loss = 2.261, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.55%], valid : [loss = 0.798, top1 = 71.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11901/15625) 011901-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.456, top1 = 89.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.308, top1 = 92.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.06 ms.
cifar100       train : [loss = 0.319, top1 = 91.45%], valid : [loss = 1.208, top1 = 68.16%], test : [loss = 1.221, top1 = 68.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.70%], valid : [loss = 2.336, top1 = 40.27%], test : [loss = 2.346, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11902/15625) 011902-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.223, top1 = 92.41%], valid : [loss = 0.512, top1 = 84.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.46 ms.
cifar10        train : [loss = 0.237, top1 = 91.81%], test  : [loss = 0.385, top1 = 87.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.87 ms.
cifar100       train : [loss = 1.255, top1 = 64.59%], valid : [loss = 1.508, top1 = 58.64%], test : [loss = 1.527, top1 = 58.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 2.871, top1 = 29.12%], valid : [loss = 2.881, top1 = 29.17%], test : [loss = 2.953, top1 = 27.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.20%], valid : [loss = 0.991, top1 = 64.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11903/15625) 011903-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.69%], valid : [loss = 0.638, top1 = 85.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.030, top1 = 99.15%], test  : [loss = 0.407, top1 = 89.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.37 ms.
cifar100       train : [loss = 0.510, top1 = 85.17%], valid : [loss = 1.465, top1 = 63.20%], test : [loss = 1.432, top1 = 64.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.395, top1 = 38.96%], valid : [loss = 2.583, top1 = 35.10%], test : [loss = 2.595, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.66%], valid : [loss = 0.833, top1 = 70.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11904/15625) 011904-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.508, top1 = 88.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.21 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.354, top1 = 91.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.63 ms.
cifar100       train : [loss = 0.490, top1 = 85.57%], valid : [loss = 1.373, top1 = 65.26%], test : [loss = 1.342, top1 = 65.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.40%], valid : [loss = 2.534, top1 = 36.37%], test : [loss = 2.566, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.28%], valid : [loss = 0.679, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11905/15625) 011905-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.57%], valid : [loss = 0.459, top1 = 86.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.45 ms.
cifar10        train : [loss = 0.146, top1 = 95.24%], test  : [loss = 0.324, top1 = 89.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.37 ms.
cifar100       train : [loss = 0.980, top1 = 71.99%], valid : [loss = 1.361, top1 = 62.72%], test : [loss = 1.335, top1 = 62.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.09%], valid : [loss = 2.675, top1 = 32.87%], test : [loss = 2.711, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11906/15625) 011906-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.535, top1 = 88.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.347, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.00 ms.
cifar100       train : [loss = 0.215, top1 = 94.63%], valid : [loss = 1.297, top1 = 68.56%], test : [loss = 1.314, top1 = 68.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.89%], valid : [loss = 2.384, top1 = 40.33%], test : [loss = 2.373, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.46%], valid : [loss = 0.893, top1 = 68.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11907/15625) 011907-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.32 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.578, top1 = 87.95%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.382, top1 = 91.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.33 ms.
cifar100       train : [loss = 0.108, top1 = 98.01%], valid : [loss = 1.542, top1 = 66.46%], test : [loss = 1.523, top1 = 67.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.60%], valid : [loss = 2.451, top1 = 38.00%], test : [loss = 2.453, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 77.91%], valid : [loss = 0.720, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11908/15625) 011908-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.55 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11909/15625) 011909-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.564, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.033, top1 = 99.00%], test  : [loss = 0.377, top1 = 90.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.53 ms.
cifar100       train : [loss = 0.447, top1 = 86.99%], valid : [loss = 1.363, top1 = 65.03%], test : [loss = 1.380, top1 = 64.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 37.64%], valid : [loss = 2.572, top1 = 34.90%], test : [loss = 2.570, top1 = 34.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 66.96%], valid : [loss = 0.932, top1 = 66.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11910/15625) 011910-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.16%], valid : [loss = 0.539, top1 = 86.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10        train : [loss = 0.053, top1 = 98.55%], test  : [loss = 0.356, top1 = 90.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.44 ms.
cifar100       train : [loss = 0.515, top1 = 85.38%], valid : [loss = 1.283, top1 = 67.02%], test : [loss = 1.279, top1 = 67.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.35%], valid : [loss = 2.397, top1 = 39.53%], test : [loss = 2.412, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.43%], valid : [loss = 0.894, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11911/15625) 011911-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.79%], valid : [loss = 0.458, top1 = 86.31%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=16.54 ms.
cifar10        train : [loss = 0.151, top1 = 95.11%], test  : [loss = 0.338, top1 = 89.07%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=15.39 ms.
cifar100       train : [loss = 0.961, top1 = 72.78%], valid : [loss = 1.337, top1 = 62.58%], test : [loss = 1.335, top1 = 62.69%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.37%], valid : [loss = 2.648, top1 = 33.59%], test : [loss = 2.685, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.51%], valid : [loss = 0.738, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11912/15625) 011912-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.463, top1 = 89.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.327, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.82 ms.
cifar100       train : [loss = 0.326, top1 = 91.33%], valid : [loss = 1.252, top1 = 67.86%], test : [loss = 1.266, top1 = 67.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.72%], valid : [loss = 2.303, top1 = 40.67%], test : [loss = 2.355, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11913/15625) 011913-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.31%], valid : [loss = 0.539, top1 = 86.72%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.28 ms.
cifar10        train : [loss = 0.087, top1 = 97.13%], test  : [loss = 0.371, top1 = 89.17%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.03 ms.
cifar100       train : [loss = 0.656, top1 = 80.54%], valid : [loss = 1.299, top1 = 65.16%], test : [loss = 1.292, top1 = 65.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.06%], valid : [loss = 2.458, top1 = 36.73%], test : [loss = 2.487, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.80%], valid : [loss = 0.794, top1 = 72.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11914/15625) 011914-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.26%], valid : [loss = 0.515, top1 = 86.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10        train : [loss = 0.103, top1 = 96.69%], test  : [loss = 0.361, top1 = 89.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.750, top1 = 78.39%], valid : [loss = 1.364, top1 = 63.36%], test : [loss = 1.319, top1 = 64.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.70%], valid : [loss = 2.571, top1 = 34.80%], test : [loss = 2.584, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.77%], valid : [loss = 0.901, top1 = 68.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11915/15625) 011915-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.510, top1 = 90.06%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.314, top1 = 93.23%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.59 ms.
cifar100       train : [loss = 0.049, top1 = 99.22%], valid : [loss = 1.333, top1 = 71.28%], test : [loss = 1.344, top1 = 70.90%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 1.553, top1 = 57.93%], valid : [loss = 2.146, top1 = 46.10%], test : [loss = 2.138, top1 = 45.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.49%], valid : [loss = 0.719, top1 = 74.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11916/15625) 011916-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.70%], valid : [loss = 0.510, top1 = 84.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.194, top1 = 93.39%], test  : [loss = 0.384, top1 = 87.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.44 ms.
cifar100       train : [loss = 1.215, top1 = 65.44%], valid : [loss = 1.543, top1 = 58.34%], test : [loss = 1.513, top1 = 59.17%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.736, top1 = 31.91%], valid : [loss = 2.754, top1 = 31.34%], test : [loss = 2.813, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.038, top1 = 62.81%], valid : [loss = 1.089, top1 = 61.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11917/15625) 011917-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.49%], valid : [loss = 0.676, top1 = 76.96%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.21 ms.
cifar10        train : [loss = 0.521, top1 = 81.92%], test  : [loss = 0.577, top1 = 80.21%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.71 ms.
cifar100       train : [loss = 1.970, top1 = 47.43%], valid : [loss = 2.059, top1 = 45.66%], test : [loss = 2.100, top1 = 45.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.80 ms.
ImageNet16-120 train : [loss = 3.382, top1 = 20.23%], valid : [loss = 3.367, top1 = 20.47%], test : [loss = 3.414, top1 = 19.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11918/15625) 011918-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.566, top1 = 88.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.378, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.89 ms.
cifar100       train : [loss = 0.074, top1 = 98.92%], valid : [loss = 1.476, top1 = 68.02%], test : [loss = 1.464, top1 = 68.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 52.06%], valid : [loss = 2.371, top1 = 39.80%], test : [loss = 2.414, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.45%], valid : [loss = 0.651, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11919/15625) 011919-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.508, top1 = 88.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.345, top1 = 91.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.317, top1 = 91.38%], valid : [loss = 1.276, top1 = 67.38%], test : [loss = 1.282, top1 = 67.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.18%], valid : [loss = 2.359, top1 = 40.13%], test : [loss = 2.413, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.45%], valid : [loss = 0.631, top1 = 78.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11920/15625) 011920-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.121, top1 = 95.97%], valid : [loss = 0.630, top1 = 83.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.162, top1 = 94.52%], test  : [loss = 0.459, top1 = 86.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.74 ms.
cifar100       train : [loss = 1.010, top1 = 70.79%], valid : [loss = 1.672, top1 = 56.60%], test : [loss = 1.652, top1 = 57.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 3.114, top1 = 24.16%], valid : [loss = 3.159, top1 = 23.97%], test : [loss = 3.210, top1 = 23.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.009, top1 = 63.72%], valid : [loss = 1.051, top1 = 62.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11921/15625) 011921-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.576, top1 = 87.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.52 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.395, top1 = 90.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.40 ms.
cifar100       train : [loss = 0.397, top1 = 88.75%], valid : [loss = 1.395, top1 = 65.32%], test : [loss = 1.383, top1 = 65.63%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.78%], valid : [loss = 2.509, top1 = 36.70%], test : [loss = 2.541, top1 = 36.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11922/15625) 011922-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=21.20 ms.
cifar10-valid  train : [loss = 0.091, top1 = 97.56%], valid : [loss = 0.473, top1 = 86.30%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.19 ms.
cifar10        train : [loss = 0.122, top1 = 96.17%], test  : [loss = 0.336, top1 = 89.17%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.03 ms.
cifar100       train : [loss = 0.778, top1 = 78.04%], valid : [loss = 1.292, top1 = 64.18%], test : [loss = 1.281, top1 = 64.54%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.59%], valid : [loss = 2.604, top1 = 35.10%], test : [loss = 2.603, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.28%], valid : [loss = 0.961, top1 = 65.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11923/15625) 011923-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.698, top1 = 85.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.464, top1 = 89.06%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.16 ms.
cifar100       train : [loss = 0.360, top1 = 90.31%], valid : [loss = 1.517, top1 = 63.22%], test : [loss = 1.538, top1 = 63.04%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.42%], valid : [loss = 2.630, top1 = 34.07%], test : [loss = 2.638, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.24%], valid : [loss = 0.814, top1 = 71.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11924/15625) 011924-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.37 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.34%], valid : [loss = 0.622, top1 = 85.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.066, top1 = 97.98%], test  : [loss = 0.405, top1 = 89.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=15.79 ms.
cifar100       train : [loss = 0.713, top1 = 79.25%], valid : [loss = 1.437, top1 = 62.20%], test : [loss = 1.362, top1 = 63.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.93%], valid : [loss = 2.654, top1 = 34.97%], test : [loss = 2.729, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11925/15625) 011925-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.77%], valid : [loss = 0.589, top1 = 87.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.019, top1 = 99.46%], test  : [loss = 0.383, top1 = 91.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.65 ms.
cifar100       train : [loss = 0.301, top1 = 91.62%], valid : [loss = 1.420, top1 = 65.10%], test : [loss = 1.462, top1 = 65.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.03%], valid : [loss = 2.598, top1 = 33.67%], test : [loss = 2.649, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.083, top1 = 60.62%], valid : [loss = 1.102, top1 = 60.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11926/15625) 011926-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.554, top1 = 88.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.46 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.354, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.12 ms.
cifar100       train : [loss = 0.156, top1 = 96.53%], valid : [loss = 1.293, top1 = 68.82%], test : [loss = 1.268, top1 = 69.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.61 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 50.96%], valid : [loss = 2.237, top1 = 42.20%], test : [loss = 2.223, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.30%], valid : [loss = 0.735, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11927/15625) 011927-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.475, top1 = 89.20%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.322, top1 = 91.92%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.30 ms.
cifar100       train : [loss = 0.318, top1 = 91.44%], valid : [loss = 1.262, top1 = 67.62%], test : [loss = 1.270, top1 = 67.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.89%], valid : [loss = 2.334, top1 = 41.00%], test : [loss = 2.331, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.30%], valid : [loss = 0.598, top1 = 79.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11928/15625) 011928-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.95%], valid : [loss = 0.521, top1 = 89.33%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.74 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.343, top1 = 92.91%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.15 ms.
cifar100       train : [loss = 0.076, top1 = 98.84%], valid : [loss = 1.466, top1 = 68.54%], test : [loss = 1.437, top1 = 68.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 1.727, top1 = 53.99%], valid : [loss = 2.360, top1 = 40.77%], test : [loss = 2.371, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.82%], valid : [loss = 0.694, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11929/15625) 011929-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.452, top1 = 89.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.322, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.19 ms.
cifar100       train : [loss = 0.318, top1 = 91.40%], valid : [loss = 1.310, top1 = 66.92%], test : [loss = 1.328, top1 = 66.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.32%], valid : [loss = 2.391, top1 = 39.02%], test : [loss = 2.393, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.90%], valid : [loss = 0.549, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11930/15625) 011930-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.65 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.13 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11931/15625) 011931-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.99%], valid : [loss = 0.729, top1 = 83.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10        train : [loss = 0.077, top1 = 97.60%], test  : [loss = 0.502, top1 = 87.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.77 ms.
cifar100       train : [loss = 0.738, top1 = 78.37%], valid : [loss = 1.508, top1 = 61.24%], test : [loss = 1.530, top1 = 61.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.784, top1 = 31.01%], valid : [loss = 2.938, top1 = 28.20%], test : [loss = 2.970, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.60%], valid : [loss = 0.897, top1 = 68.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11932/15625) 011932-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.527, top1 = 88.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.33 ms.
cifar10        train : [loss = 0.025, top1 = 99.32%], test  : [loss = 0.349, top1 = 91.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.59 ms.
cifar100       train : [loss = 0.424, top1 = 87.79%], valid : [loss = 1.276, top1 = 66.68%], test : [loss = 1.326, top1 = 66.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.202, top1 = 42.89%], valid : [loss = 2.411, top1 = 38.90%], test : [loss = 2.416, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.52%], valid : [loss = 0.764, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11933/15625) 011933-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.291, top1 = 89.90%], valid : [loss = 0.991, top1 = 72.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.317, top1 = 88.94%], test  : [loss = 0.627, top1 = 79.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.59 ms.
cifar100       train : [loss = 1.372, top1 = 61.26%], valid : [loss = 1.927, top1 = 49.78%], test : [loss = 1.927, top1 = 49.64%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 3.196, top1 = 23.24%], valid : [loss = 3.323, top1 = 21.00%], test : [loss = 3.330, top1 = 20.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.168, top1 = 57.94%], valid : [loss = 1.229, top1 = 55.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11934/15625) 011934-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.553, top1 = 88.36%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.68 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.371, top1 = 92.23%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.04 ms.
cifar100       train : [loss = 0.082, top1 = 98.53%], valid : [loss = 1.501, top1 = 67.08%], test : [loss = 1.516, top1 = 67.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.14%], valid : [loss = 2.377, top1 = 39.50%], test : [loss = 2.366, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.77%], valid : [loss = 0.732, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11935/15625) 011935-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.272, top1 = 91.13%], valid : [loss = 0.479, top1 = 84.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.297, top1 = 90.11%], test  : [loss = 0.389, top1 = 87.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.06 ms.
cifar100       train : [loss = 1.343, top1 = 62.78%], valid : [loss = 1.548, top1 = 57.64%], test : [loss = 1.516, top1 = 58.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 28.44%], valid : [loss = 2.911, top1 = 29.47%], test : [loss = 2.974, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.09%], valid : [loss = 0.764, top1 = 73.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11936/15625) 011936-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.273, top1 = 91.02%], valid : [loss = 0.472, top1 = 84.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10        train : [loss = 0.302, top1 = 89.86%], test  : [loss = 0.398, top1 = 86.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.62 ms.
cifar100       train : [loss = 1.321, top1 = 63.51%], valid : [loss = 1.540, top1 = 57.66%], test : [loss = 1.504, top1 = 58.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.79%], valid : [loss = 2.891, top1 = 29.03%], test : [loss = 2.950, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 76.13%], valid : [loss = 0.731, top1 = 74.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11937/15625) 011937-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.493, top1 = 88.93%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.314, top1 = 92.48%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.51 ms.
cifar100       train : [loss = 0.228, top1 = 94.49%], valid : [loss = 1.236, top1 = 68.76%], test : [loss = 1.229, top1 = 68.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=24.74 ms.
ImageNet16-120 train : [loss = 1.929, top1 = 49.26%], valid : [loss = 2.263, top1 = 41.83%], test : [loss = 2.313, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.74%], valid : [loss = 0.675, top1 = 76.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11938/15625) 011938-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.562, top1 = 89.08%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.398, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.17 ms.
cifar100       train : [loss = 0.100, top1 = 98.23%], valid : [loss = 1.462, top1 = 67.30%], test : [loss = 1.456, top1 = 68.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.34%], valid : [loss = 2.422, top1 = 39.97%], test : [loss = 2.436, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11939/15625) 011939-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.33%], valid : [loss = 0.860, top1 = 72.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.550, top1 = 80.73%], test  : [loss = 0.705, top1 = 75.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.37 ms.
cifar100       train : [loss = 1.777, top1 = 51.93%], valid : [loss = 2.062, top1 = 47.02%], test : [loss = 2.081, top1 = 46.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.77%], valid : [loss = 3.639, top1 = 16.87%], test : [loss = 3.664, top1 = 16.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11940/15625) 011940-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.64%], valid : [loss = 0.536, top1 = 88.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.68 ms.
cifar10        train : [loss = 0.026, top1 = 99.22%], test  : [loss = 0.356, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.04 ms.
cifar100       train : [loss = 0.446, top1 = 87.10%], valid : [loss = 1.258, top1 = 67.36%], test : [loss = 1.293, top1 = 66.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.247, top1 = 41.92%], valid : [loss = 2.425, top1 = 38.70%], test : [loss = 2.468, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.99%], valid : [loss = 0.808, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11941/15625) 011941-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.48 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.13 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11942/15625) 011942-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.58%], valid : [loss = 0.641, top1 = 85.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10        train : [loss = 0.034, top1 = 99.06%], test  : [loss = 0.412, top1 = 89.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.526, top1 = 84.58%], valid : [loss = 1.374, top1 = 64.14%], test : [loss = 1.375, top1 = 64.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.24%], valid : [loss = 2.549, top1 = 36.33%], test : [loss = 2.589, top1 = 36.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.63%], valid : [loss = 0.867, top1 = 69.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11943/15625) 011943-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.502, top1 = 89.23%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.41 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.290, top1 = 93.25%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.08 ms.
cifar100       train : [loss = 0.108, top1 = 98.01%], valid : [loss = 1.296, top1 = 70.00%], test : [loss = 1.310, top1 = 69.44%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 1.705, top1 = 54.32%], valid : [loss = 2.206, top1 = 43.93%], test : [loss = 2.191, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.11%], valid : [loss = 0.627, top1 = 78.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11944/15625) 011944-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.484, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.319, top1 = 92.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.318, top1 = 91.37%], valid : [loss = 1.258, top1 = 67.55%], test : [loss = 1.276, top1 = 67.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.69%], valid : [loss = 2.313, top1 = 40.57%], test : [loss = 2.330, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11945/15625) 011945-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.574, top1 = 87.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.392, top1 = 91.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.78 ms.
cifar100       train : [loss = 0.389, top1 = 88.98%], valid : [loss = 1.384, top1 = 65.70%], test : [loss = 1.394, top1 = 65.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.92%], valid : [loss = 2.522, top1 = 36.77%], test : [loss = 2.536, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11946/15625) 011946-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10-valid  train : [loss = 0.281, top1 = 90.36%], valid : [loss = 0.489, top1 = 84.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10        train : [loss = 0.305, top1 = 90.00%], test  : [loss = 0.408, top1 = 86.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.19 ms.
cifar100       train : [loss = 1.330, top1 = 63.26%], valid : [loss = 1.531, top1 = 57.66%], test : [loss = 1.504, top1 = 58.56%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.01 ms.
ImageNet16-120 train : [loss = 2.927, top1 = 28.48%], valid : [loss = 2.891, top1 = 29.47%], test : [loss = 2.956, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11947/15625) 011947-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.596, top1 = 86.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.00 ms.
cifar10        train : [loss = 0.041, top1 = 98.76%], test  : [loss = 0.387, top1 = 89.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.568, top1 = 83.49%], valid : [loss = 1.418, top1 = 63.56%], test : [loss = 1.384, top1 = 64.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.56%], valid : [loss = 2.538, top1 = 36.20%], test : [loss = 2.581, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.39%], valid : [loss = 0.870, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11948/15625) 011948-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.533, top1 = 88.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.06 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.333, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.26 ms.
cifar100       train : [loss = 0.257, top1 = 93.45%], valid : [loss = 1.317, top1 = 67.56%], test : [loss = 1.295, top1 = 68.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.72%], valid : [loss = 2.311, top1 = 42.00%], test : [loss = 2.364, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.77%], valid : [loss = 0.724, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11949/15625) 011949-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.21%], valid : [loss = 0.463, top1 = 86.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10        train : [loss = 0.111, top1 = 96.66%], test  : [loss = 0.328, top1 = 89.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=18.22 ms.
cifar100       train : [loss = 0.865, top1 = 75.51%], valid : [loss = 1.287, top1 = 63.98%], test : [loss = 1.308, top1 = 64.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.92 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.65%], valid : [loss = 2.599, top1 = 34.40%], test : [loss = 2.651, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.12%], valid : [loss = 0.663, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11950/15625) 011950-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.51 ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.39%], valid : [loss = 0.964, top1 = 67.15%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10        train : [loss = 0.765, top1 = 73.23%], test  : [loss = 0.858, top1 = 70.28%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.37 ms.
cifar100       train : [loss = 2.136, top1 = 44.09%], valid : [loss = 2.310, top1 = 40.70%], test : [loss = 2.337, top1 = 40.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.17 ms.
ImageNet16-120 train : [loss = 3.747, top1 = 14.10%], valid : [loss = 3.777, top1 = 14.33%], test : [loss = 3.778, top1 = 14.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11951/15625) 011951-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.35%], valid : [loss = 0.547, top1 = 85.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.081, top1 = 97.50%], test  : [loss = 0.350, top1 = 90.02%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.98 ms.
cifar100       train : [loss = 0.680, top1 = 80.13%], valid : [loss = 1.376, top1 = 63.82%], test : [loss = 1.358, top1 = 64.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.464, top1 = 37.43%], valid : [loss = 2.554, top1 = 35.57%], test : [loss = 2.580, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.59%], valid : [loss = 0.877, top1 = 69.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11952/15625) 011952-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.570, top1 = 87.30%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.23 ms.
cifar10        train : [loss = 0.032, top1 = 99.07%], test  : [loss = 0.367, top1 = 90.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.73 ms.
cifar100       train : [loss = 0.671, top1 = 80.75%], valid : [loss = 1.484, top1 = 61.06%], test : [loss = 1.477, top1 = 62.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.509, top1 = 36.06%], valid : [loss = 2.617, top1 = 33.20%], test : [loss = 2.632, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.948, top1 = 66.00%], valid : [loss = 0.972, top1 = 64.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11953/15625) 011953-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.48%], valid : [loss = 0.781, top1 = 81.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 0.094, top1 = 96.97%], test  : [loss = 0.496, top1 = 86.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.97 ms.
cifar100       train : [loss = 0.848, top1 = 75.37%], valid : [loss = 1.570, top1 = 60.28%], test : [loss = 1.537, top1 = 59.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.886, top1 = 28.98%], valid : [loss = 3.007, top1 = 26.63%], test : [loss = 3.071, top1 = 26.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.913, top1 = 67.48%], valid : [loss = 0.975, top1 = 65.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11954/15625) 011954-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.563, top1 = 88.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.61 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.378, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.22 ms.
cifar100       train : [loss = 0.092, top1 = 98.38%], valid : [loss = 1.490, top1 = 67.02%], test : [loss = 1.432, top1 = 68.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 50.88%], valid : [loss = 2.412, top1 = 39.83%], test : [loss = 2.455, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.38%], valid : [loss = 0.704, top1 = 75.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11955/15625) 011955-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.45%], valid : [loss = 0.600, top1 = 86.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 0.036, top1 = 98.86%], test  : [loss = 0.388, top1 = 90.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.94 ms.
cifar100       train : [loss = 0.531, top1 = 84.60%], valid : [loss = 1.396, top1 = 63.38%], test : [loss = 1.399, top1 = 63.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.35%], valid : [loss = 2.611, top1 = 34.10%], test : [loss = 2.618, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.77%], valid : [loss = 0.996, top1 = 64.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11956/15625) 011956-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.36%], valid : [loss = 0.586, top1 = 86.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 0.044, top1 = 98.63%], test  : [loss = 0.333, top1 = 91.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.38 ms.
cifar100       train : [loss = 0.581, top1 = 82.74%], valid : [loss = 1.335, top1 = 64.24%], test : [loss = 1.355, top1 = 64.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.08%], valid : [loss = 2.563, top1 = 35.37%], test : [loss = 2.596, top1 = 34.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.82%], valid : [loss = 1.003, top1 = 64.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11957/15625) 011957-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.489, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.346, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.235, top1 = 93.95%], valid : [loss = 1.341, top1 = 67.81%], test : [loss = 1.351, top1 = 67.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.87%], valid : [loss = 2.286, top1 = 42.06%], test : [loss = 2.322, top1 = 41.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.90%], valid : [loss = 0.615, top1 = 79.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11958/15625) 011958-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.467, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.313, top1 = 92.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 0.329, top1 = 91.13%], valid : [loss = 1.286, top1 = 67.84%], test : [loss = 1.277, top1 = 67.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.15%], valid : [loss = 2.350, top1 = 40.43%], test : [loss = 2.384, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.451, top1 = 84.30%], valid : [loss = 0.551, top1 = 81.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11959/15625) 011959-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.580, top1 = 87.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.379, top1 = 91.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.24 ms.
cifar100       train : [loss = 0.405, top1 = 88.47%], valid : [loss = 1.395, top1 = 65.29%], test : [loss = 1.384, top1 = 65.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.07%], valid : [loss = 2.492, top1 = 37.60%], test : [loss = 2.525, top1 = 37.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.81%], valid : [loss = 0.782, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11960/15625) 011960-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.598, top1 = 87.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.380, top1 = 90.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.404, top1 = 88.55%], valid : [loss = 1.399, top1 = 66.16%], test : [loss = 1.392, top1 = 65.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.92%], valid : [loss = 2.497, top1 = 37.37%], test : [loss = 2.538, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.81%], valid : [loss = 0.782, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11961/15625) 011961-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.519, top1 = 88.58%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=16.11 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.327, top1 = 92.15%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=13.64 ms.
cifar100       train : [loss = 0.349, top1 = 90.49%], valid : [loss = 1.276, top1 = 66.90%], test : [loss = 1.279, top1 = 67.13%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.74%], valid : [loss = 2.390, top1 = 39.03%], test : [loss = 2.390, top1 = 39.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11962/15625) 011962-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.37%], valid : [loss = 0.549, top1 = 82.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.278, top1 = 90.45%], test  : [loss = 0.429, top1 = 86.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.19 ms.
cifar100       train : [loss = 1.387, top1 = 60.98%], valid : [loss = 1.625, top1 = 55.51%], test : [loss = 1.613, top1 = 56.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.41%], valid : [loss = 2.920, top1 = 28.33%], test : [loss = 2.972, top1 = 27.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.64%], valid : [loss = 1.018, top1 = 63.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11963/15625) 011963-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.200, top1 = 93.40%], valid : [loss = 0.551, top1 = 83.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.203, top1 = 93.04%], test  : [loss = 0.398, top1 = 87.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.27 ms.
cifar100       train : [loss = 1.263, top1 = 64.12%], valid : [loss = 1.570, top1 = 57.31%], test : [loss = 1.557, top1 = 57.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.700, top1 = 32.54%], valid : [loss = 2.729, top1 = 32.18%], test : [loss = 2.768, top1 = 31.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.48%], valid : [loss = 0.990, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11964/15625) 011964-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=131.65 M, Params=0.924 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.500, top1 = 89.02%]
cifar10        FLOP=131.65 M, Params=0.924 MB, latency=18.87 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.321, top1 = 92.05%]
cifar100       FLOP=131.65 M, Params=0.930 MB, latency=18.44 ms.
cifar100       train : [loss = 0.327, top1 = 91.26%], valid : [loss = 1.288, top1 = 66.57%], test : [loss = 1.261, top1 = 67.60%]
ImageNet16-120 FLOP= 32.92 M, Params=0.931 MB, latency=18.80 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 45.01%], valid : [loss = 2.404, top1 = 39.65%], test : [loss = 2.440, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.57%], valid : [loss = 0.640, top1 = 78.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11965/15625) 011965-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.12%], valid : [loss = 0.862, top1 = 71.74%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.49 ms.
cifar10        train : [loss = 0.569, top1 = 80.02%], test  : [loss = 0.723, top1 = 75.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.32 ms.
cifar100       train : [loss = 1.784, top1 = 51.96%], valid : [loss = 2.056, top1 = 46.84%], test : [loss = 2.078, top1 = 46.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.48 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.78%], valid : [loss = 3.636, top1 = 17.00%], test : [loss = 3.657, top1 = 16.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11966/15625) 011966-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.541, top1 = 80.86%], valid : [loss = 0.866, top1 = 71.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10        train : [loss = 0.567, top1 = 80.25%], test  : [loss = 0.712, top1 = 75.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.52 ms.
cifar100       train : [loss = 1.775, top1 = 52.31%], valid : [loss = 2.040, top1 = 47.06%], test : [loss = 2.053, top1 = 46.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.89%], valid : [loss = 3.624, top1 = 16.57%], test : [loss = 3.661, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.200, top1 = 56.59%], valid : [loss = 1.257, top1 = 55.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11967/15625) 011967-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.529, top1 = 87.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.021, top1 = 99.45%], test  : [loss = 0.352, top1 = 91.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.34 ms.
cifar100       train : [loss = 0.399, top1 = 88.53%], valid : [loss = 1.417, top1 = 65.44%], test : [loss = 1.375, top1 = 66.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.22%], valid : [loss = 2.483, top1 = 36.57%], test : [loss = 2.545, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.90%], valid : [loss = 0.701, top1 = 75.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11968/15625) 011968-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.252, top1 = 91.30%], valid : [loss = 0.527, top1 = 83.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10        train : [loss = 0.254, top1 = 91.35%], test  : [loss = 0.402, top1 = 86.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 1.322, top1 = 62.67%], valid : [loss = 1.600, top1 = 56.56%], test : [loss = 1.584, top1 = 57.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.858, top1 = 29.68%], valid : [loss = 2.875, top1 = 29.34%], test : [loss = 2.924, top1 = 29.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.80%], valid : [loss = 1.026, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11969/15625) 011969-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.66%], valid : [loss = 0.834, top1 = 71.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10        train : [loss = 0.698, top1 = 75.26%], test  : [loss = 0.782, top1 = 73.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 1.956, top1 = 48.28%], valid : [loss = 2.116, top1 = 44.86%], test : [loss = 2.155, top1 = 45.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.70%], valid : [loss = 3.673, top1 = 15.83%], test : [loss = 3.685, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11970/15625) 011970-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.586, top1 = 87.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.385, top1 = 91.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 0.372, top1 = 89.57%], valid : [loss = 1.415, top1 = 65.67%], test : [loss = 1.378, top1 = 65.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.21%], valid : [loss = 2.503, top1 = 37.10%], test : [loss = 2.530, top1 = 36.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.80%], valid : [loss = 0.772, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11971/15625) 011971-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.543, top1 = 88.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.332, top1 = 91.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.32 ms.
cifar100       train : [loss = 0.299, top1 = 91.91%], valid : [loss = 1.268, top1 = 68.30%], test : [loss = 1.304, top1 = 67.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 2.196, top1 = 43.13%], valid : [loss = 2.427, top1 = 38.43%], test : [loss = 2.411, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.22%], valid : [loss = 0.857, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11972/15625) 011972-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.89%], valid : [loss = 0.505, top1 = 88.21%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.34 ms.
cifar10        train : [loss = 0.020, top1 = 99.55%], test  : [loss = 0.333, top1 = 91.51%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.98 ms.
cifar100       train : [loss = 0.326, top1 = 91.24%], valid : [loss = 1.379, top1 = 66.38%], test : [loss = 1.371, top1 = 66.48%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.82%], valid : [loss = 2.433, top1 = 39.33%], test : [loss = 2.471, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.14%], valid : [loss = 0.631, top1 = 78.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11973/15625) 011973-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.424, top1 = 90.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.296, top1 = 93.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.21 ms.
cifar100       train : [loss = 0.194, top1 = 95.39%], valid : [loss = 1.266, top1 = 69.92%], test : [loss = 1.237, top1 = 70.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.73%], valid : [loss = 2.250, top1 = 42.90%], test : [loss = 2.271, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11974/15625) 011974-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.58%], valid : [loss = 0.500, top1 = 85.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.93 ms.
cifar10        train : [loss = 0.161, top1 = 94.67%], test  : [loss = 0.373, top1 = 88.42%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.82 ms.
cifar100       train : [loss = 0.976, top1 = 72.05%], valid : [loss = 1.379, top1 = 62.06%], test : [loss = 1.377, top1 = 62.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 32.99%], valid : [loss = 2.744, top1 = 31.67%], test : [loss = 2.791, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.942, top1 = 66.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11975/15625) 011975-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.532, top1 = 89.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.63 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.342, top1 = 92.49%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.78 ms.
cifar100       train : [loss = 0.147, top1 = 96.64%], valid : [loss = 1.318, top1 = 68.79%], test : [loss = 1.331, top1 = 68.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 1.959, top1 = 48.43%], valid : [loss = 2.326, top1 = 40.17%], test : [loss = 2.317, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.41%], valid : [loss = 0.777, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11976/15625) 011976-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.466, top1 = 89.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.320, top1 = 92.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.83 ms.
cifar100       train : [loss = 0.326, top1 = 91.32%], valid : [loss = 1.243, top1 = 67.28%], test : [loss = 1.281, top1 = 67.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.57%], valid : [loss = 2.324, top1 = 40.63%], test : [loss = 2.336, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11977/15625) 011977-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.57%], valid : [loss = 0.627, top1 = 85.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.29 ms.
cifar10        train : [loss = 0.076, top1 = 97.56%], test  : [loss = 0.401, top1 = 89.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.05 ms.
cifar100       train : [loss = 0.654, top1 = 80.83%], valid : [loss = 1.523, top1 = 61.18%], test : [loss = 1.490, top1 = 61.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 27.83%], valid : [loss = 2.992, top1 = 26.50%], test : [loss = 3.020, top1 = 25.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.54%], valid : [loss = 0.980, top1 = 65.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11978/15625) 011978-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.63 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.15%], valid : [loss = 0.750, top1 = 74.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.460, top1 = 84.00%], test  : [loss = 0.589, top1 = 80.09%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.63 ms.
cifar100       train : [loss = 1.797, top1 = 51.25%], valid : [loss = 1.982, top1 = 47.36%], test : [loss = 1.975, top1 = 48.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 3.471, top1 = 18.35%], valid : [loss = 3.456, top1 = 19.17%], test : [loss = 3.483, top1 = 18.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.248, top1 = 55.05%], valid : [loss = 1.280, top1 = 54.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11979/15625) 011979-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.522, top1 = 88.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.337, top1 = 92.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 0.342, top1 = 90.71%], valid : [loss = 1.277, top1 = 67.40%], test : [loss = 1.250, top1 = 68.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.84%], valid : [loss = 2.373, top1 = 39.60%], test : [loss = 2.416, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11980/15625) 011980-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.479, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.327, top1 = 91.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.29 ms.
cifar100       train : [loss = 0.334, top1 = 90.75%], valid : [loss = 1.336, top1 = 66.89%], test : [loss = 1.309, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.04%], valid : [loss = 2.338, top1 = 40.80%], test : [loss = 2.359, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.59%], valid : [loss = 0.612, top1 = 79.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11981/15625) 011981-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.584, top1 = 87.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.46 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.388, top1 = 91.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.81 ms.
cifar100       train : [loss = 0.373, top1 = 89.58%], valid : [loss = 1.420, top1 = 65.08%], test : [loss = 1.405, top1 = 65.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.02%], valid : [loss = 2.510, top1 = 37.12%], test : [loss = 2.534, top1 = 36.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.98%], valid : [loss = 0.807, top1 = 71.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11982/15625) 011982-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.297, top1 = 89.58%], valid : [loss = 0.552, top1 = 82.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 0.261, top1 = 91.09%], test  : [loss = 0.407, top1 = 86.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.61 ms.
cifar100       train : [loss = 1.522, top1 = 57.53%], valid : [loss = 1.760, top1 = 52.41%], test : [loss = 1.732, top1 = 53.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 27.91%], valid : [loss = 2.968, top1 = 27.53%], test : [loss = 3.008, top1 = 27.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11983/15625) 011983-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.542, top1 = 88.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.028, top1 = 99.15%], test  : [loss = 0.337, top1 = 91.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 0.437, top1 = 87.11%], valid : [loss = 1.271, top1 = 67.02%], test : [loss = 1.266, top1 = 67.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.23%], valid : [loss = 2.388, top1 = 38.80%], test : [loss = 2.391, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11984/15625) 011984-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.208, top1 = 92.99%], valid : [loss = 0.577, top1 = 82.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10        train : [loss = 0.212, top1 = 92.83%], test  : [loss = 0.421, top1 = 86.76%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.67 ms.
cifar100       train : [loss = 1.282, top1 = 63.43%], valid : [loss = 1.558, top1 = 57.68%], test : [loss = 1.579, top1 = 56.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.716, top1 = 32.29%], valid : [loss = 2.738, top1 = 31.97%], test : [loss = 2.770, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.85%], valid : [loss = 0.971, top1 = 65.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11985/15625) 011985-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.329, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.09 ms.
cifar100       train : [loss = 0.071, top1 = 98.80%], valid : [loss = 1.367, top1 = 69.46%], test : [loss = 1.347, top1 = 70.25%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.03 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.30%], valid : [loss = 2.216, top1 = 44.43%], test : [loss = 2.201, top1 = 44.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.93%], valid : [loss = 0.700, top1 = 75.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11986/15625) 011986-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.511, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.350, top1 = 92.31%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.40 ms.
cifar100       train : [loss = 0.158, top1 = 96.36%], valid : [loss = 1.315, top1 = 68.32%], test : [loss = 1.354, top1 = 68.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.85%], valid : [loss = 2.327, top1 = 41.90%], test : [loss = 2.333, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.39%], valid : [loss = 0.819, top1 = 71.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11987/15625) 011987-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.59%], valid : [loss = 0.573, top1 = 87.60%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.25 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.368, top1 = 91.48%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.07 ms.
cifar100       train : [loss = 0.281, top1 = 92.17%], valid : [loss = 1.317, top1 = 67.74%], test : [loss = 1.339, top1 = 67.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.451, top1 = 37.14%], valid : [loss = 2.578, top1 = 34.83%], test : [loss = 2.598, top1 = 34.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.35%], valid : [loss = 0.943, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11988/15625) 011988-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.514, top1 = 89.60%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.386, top1 = 92.24%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.53 ms.
cifar100       train : [loss = 0.066, top1 = 99.07%], valid : [loss = 1.459, top1 = 68.62%], test : [loss = 1.429, top1 = 68.88%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.750, top1 = 53.35%], valid : [loss = 2.335, top1 = 41.40%], test : [loss = 2.368, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.68%], valid : [loss = 0.675, top1 = 76.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11989/15625) 011989-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.486, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.309, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 0.262, top1 = 93.33%], valid : [loss = 1.214, top1 = 69.16%], test : [loss = 1.218, top1 = 69.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.86%], valid : [loss = 2.226, top1 = 42.79%], test : [loss = 2.228, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11990/15625) 011990-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.77%], valid : [loss = 0.596, top1 = 87.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.83 ms.
cifar10        train : [loss = 0.021, top1 = 99.39%], test  : [loss = 0.422, top1 = 90.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 0.370, top1 = 89.60%], valid : [loss = 1.496, top1 = 63.56%], test : [loss = 1.463, top1 = 64.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 30.75%], valid : [loss = 2.811, top1 = 29.77%], test : [loss = 2.811, top1 = 29.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11991/15625) 011991-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.604, top1 = 85.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.064, top1 = 98.09%], test  : [loss = 0.403, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 0.726, top1 = 78.84%], valid : [loss = 1.404, top1 = 63.32%], test : [loss = 1.385, top1 = 63.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.20 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.94%], valid : [loss = 2.643, top1 = 33.43%], test : [loss = 2.674, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11992/15625) 011992-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.581, top1 = 87.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.022, top1 = 99.41%], test  : [loss = 0.402, top1 = 90.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.281, top1 = 92.48%], valid : [loss = 1.316, top1 = 67.16%], test : [loss = 1.335, top1 = 67.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.358, top1 = 39.32%], valid : [loss = 2.508, top1 = 36.30%], test : [loss = 2.532, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.61%], valid : [loss = 0.928, top1 = 66.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11993/15625) 011993-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.515, top1 = 88.30%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.68 ms.
cifar10        train : [loss = 0.020, top1 = 99.53%], test  : [loss = 0.356, top1 = 91.37%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.54 ms.
cifar100       train : [loss = 0.309, top1 = 91.69%], valid : [loss = 1.317, top1 = 67.52%], test : [loss = 1.302, top1 = 66.76%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 47.07%], valid : [loss = 2.311, top1 = 40.87%], test : [loss = 2.365, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.73%], valid : [loss = 0.605, top1 = 79.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11994/15625) 011994-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.66%], valid : [loss = 0.484, top1 = 83.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10        train : [loss = 0.308, top1 = 89.81%], test  : [loss = 0.407, top1 = 85.93%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.63 ms.
cifar100       train : [loss = 1.340, top1 = 62.85%], valid : [loss = 1.551, top1 = 57.78%], test : [loss = 1.517, top1 = 57.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.58 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.49%], valid : [loss = 2.936, top1 = 28.77%], test : [loss = 2.970, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11995/15625) 011995-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.567, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.370, top1 = 91.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.02 ms.
cifar100       train : [loss = 0.658, top1 = 80.68%], valid : [loss = 1.468, top1 = 61.60%], test : [loss = 1.472, top1 = 61.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 2.577, top1 = 34.56%], valid : [loss = 2.670, top1 = 32.47%], test : [loss = 2.670, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11996/15625) 011996-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.68%], valid : [loss = 0.581, top1 = 87.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.93 ms.
cifar10        train : [loss = 0.039, top1 = 98.84%], test  : [loss = 0.405, top1 = 89.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.13 ms.
cifar100       train : [loss = 0.551, top1 = 83.69%], valid : [loss = 1.383, top1 = 64.54%], test : [loss = 1.409, top1 = 63.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.501, top1 = 36.70%], valid : [loss = 2.627, top1 = 34.13%], test : [loss = 2.650, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.52%], valid : [loss = 0.627, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11997/15625) 011997-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.573, top1 = 87.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.403, top1 = 90.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.374, top1 = 89.36%], valid : [loss = 1.427, top1 = 64.24%], test : [loss = 1.438, top1 = 65.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 41.91%], valid : [loss = 2.474, top1 = 37.47%], test : [loss = 2.543, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.68%], valid : [loss = 0.857, top1 = 69.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11998/15625) 011998-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.65%], valid : [loss = 0.459, top1 = 86.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10        train : [loss = 0.151, top1 = 94.97%], test  : [loss = 0.340, top1 = 89.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.83 ms.
cifar100       train : [loss = 0.964, top1 = 72.52%], valid : [loss = 1.346, top1 = 62.15%], test : [loss = 1.341, top1 = 62.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.26%], valid : [loss = 2.670, top1 = 33.39%], test : [loss = 2.697, top1 = 32.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (11999/15625) 011999-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.68%], valid : [loss = 0.864, top1 = 70.80%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10        train : [loss = 0.676, top1 = 76.28%], test  : [loss = 0.756, top1 = 73.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 1.954, top1 = 48.08%], valid : [loss = 2.116, top1 = 45.05%], test : [loss = 2.151, top1 = 44.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.50 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.70%], valid : [loss = 3.662, top1 = 16.13%], test : [loss = 3.689, top1 = 15.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12000/15625) 012000-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.545, top1 = 88.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.339, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.62 ms.
cifar100       train : [loss = 0.351, top1 = 90.37%], valid : [loss = 1.285, top1 = 66.82%], test : [loss = 1.293, top1 = 66.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.61%], valid : [loss = 2.394, top1 = 39.40%], test : [loss = 2.401, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12001/15625) 012001-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.574, top1 = 87.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.397, top1 = 90.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.08 ms.
cifar100       train : [loss = 0.389, top1 = 88.99%], valid : [loss = 1.384, top1 = 65.66%], test : [loss = 1.407, top1 = 65.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.50 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.19%], valid : [loss = 2.512, top1 = 36.92%], test : [loss = 2.517, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12002/15625) 012002-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.425, top1 = 90.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.278, top1 = 93.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.05 ms.
cifar100       train : [loss = 0.160, top1 = 96.41%], valid : [loss = 1.279, top1 = 69.85%], test : [loss = 1.265, top1 = 70.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 1.768, top1 = 52.88%], valid : [loss = 2.230, top1 = 43.68%], test : [loss = 2.286, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.71%], valid : [loss = 0.516, top1 = 82.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12003/15625) 012003-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.56%], valid : [loss = 0.505, top1 = 84.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10        train : [loss = 0.212, top1 = 92.80%], test  : [loss = 0.378, top1 = 88.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 1.168, top1 = 66.62%], valid : [loss = 1.466, top1 = 59.32%], test : [loss = 1.462, top1 = 59.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.93%], valid : [loss = 2.761, top1 = 31.77%], test : [loss = 2.814, top1 = 30.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.20%], valid : [loss = 0.900, top1 = 67.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12004/15625) 012004-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.51%], valid : [loss = 1.112, top1 = 63.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10        train : [loss = 0.793, top1 = 72.00%], test  : [loss = 0.920, top1 = 68.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.40 ms.
cifar100       train : [loss = 2.118, top1 = 44.48%], valid : [loss = 2.389, top1 = 40.26%], test : [loss = 2.387, top1 = 40.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 3.775, top1 = 13.76%], valid : [loss = 3.831, top1 = 13.93%], test : [loss = 3.835, top1 = 13.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.359, top1 = 50.69%], valid : [loss = 1.401, top1 = 49.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12005/15625) 012005-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.503, top1 = 89.77%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.44 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.317, top1 = 93.05%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=18.06 ms.
cifar100       train : [loss = 0.050, top1 = 99.43%], valid : [loss = 1.338, top1 = 70.40%], test : [loss = 1.344, top1 = 69.76%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.54 ms.
ImageNet16-120 train : [loss = 1.768, top1 = 52.83%], valid : [loss = 2.269, top1 = 41.70%], test : [loss = 2.234, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.29%], valid : [loss = 0.677, top1 = 76.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12006/15625) 012006-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.80%], valid : [loss = 0.464, top1 = 86.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10        train : [loss = 0.148, top1 = 95.29%], test  : [loss = 0.343, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.18 ms.
cifar100       train : [loss = 0.963, top1 = 72.64%], valid : [loss = 1.339, top1 = 62.32%], test : [loss = 1.346, top1 = 62.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.72%], valid : [loss = 2.678, top1 = 33.15%], test : [loss = 2.725, top1 = 31.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12007/15625) 012007-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.87%], valid : [loss = 0.535, top1 = 82.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.414, top1 = 85.88%], test  : [loss = 0.473, top1 = 84.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 1.552, top1 = 57.65%], valid : [loss = 1.677, top1 = 53.68%], test : [loss = 1.667, top1 = 54.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 3.066, top1 = 25.84%], valid : [loss = 3.023, top1 = 27.00%], test : [loss = 3.100, top1 = 25.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.135, top1 = 59.53%], valid : [loss = 1.156, top1 = 59.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12008/15625) 012008-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.514, top1 = 88.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.330, top1 = 92.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.94 ms.
cifar100       train : [loss = 0.342, top1 = 90.66%], valid : [loss = 1.301, top1 = 66.91%], test : [loss = 1.288, top1 = 67.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.57%], valid : [loss = 2.416, top1 = 39.03%], test : [loss = 2.417, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12009/15625) 012009-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.75%], valid : [loss = 0.495, top1 = 85.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.75 ms.
cifar10        train : [loss = 0.173, top1 = 94.16%], test  : [loss = 0.363, top1 = 88.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.31 ms.
cifar100       train : [loss = 1.056, top1 = 69.71%], valid : [loss = 1.423, top1 = 60.71%], test : [loss = 1.410, top1 = 60.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.32 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.27%], valid : [loss = 2.670, top1 = 33.46%], test : [loss = 2.701, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.56%], valid : [loss = 0.883, top1 = 68.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12010/15625) 012010-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.513, top1 = 89.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.316, top1 = 92.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.05 ms.
cifar100       train : [loss = 0.289, top1 = 91.96%], valid : [loss = 1.291, top1 = 67.58%], test : [loss = 1.283, top1 = 67.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.79 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.15%], valid : [loss = 2.299, top1 = 41.60%], test : [loss = 2.302, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 70.45%], valid : [loss = 0.870, top1 = 69.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12011/15625) 012011-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.551, top1 = 88.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.43 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.384, top1 = 91.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.22 ms.
cifar100       train : [loss = 0.146, top1 = 96.95%], valid : [loss = 1.466, top1 = 66.84%], test : [loss = 1.452, top1 = 66.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.70%], valid : [loss = 2.406, top1 = 39.27%], test : [loss = 2.421, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.15%], valid : [loss = 0.713, top1 = 75.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12012/15625) 012012-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.11%], valid : [loss = 0.865, top1 = 71.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10        train : [loss = 0.554, top1 = 80.64%], test  : [loss = 0.712, top1 = 75.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 1.755, top1 = 52.53%], valid : [loss = 2.057, top1 = 46.96%], test : [loss = 2.041, top1 = 47.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.79%], valid : [loss = 3.644, top1 = 15.97%], test : [loss = 3.655, top1 = 15.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12013/15625) 012013-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.450, top1 = 89.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.315, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.228, top1 = 94.39%], valid : [loss = 1.313, top1 = 68.29%], test : [loss = 1.293, top1 = 68.23%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.72%], valid : [loss = 2.284, top1 = 41.79%], test : [loss = 2.333, top1 = 41.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.92%], valid : [loss = 0.550, top1 = 81.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12014/15625) 012014-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.45 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.318, top1 = 93.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.67 ms.
cifar100       train : [loss = 0.073, top1 = 98.78%], valid : [loss = 1.375, top1 = 69.40%], test : [loss = 1.382, top1 = 69.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 1.569, top1 = 57.74%], valid : [loss = 2.222, top1 = 44.90%], test : [loss = 2.238, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.70%], valid : [loss = 0.526, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12015/15625) 012015-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.474, top1 = 89.83%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.30 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.294, top1 = 92.96%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.99 ms.
cifar100       train : [loss = 0.143, top1 = 97.00%], valid : [loss = 1.324, top1 = 69.04%], test : [loss = 1.305, top1 = 68.18%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.34%], valid : [loss = 2.131, top1 = 45.30%], test : [loss = 2.120, top1 = 45.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.61%], valid : [loss = 0.654, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12016/15625) 012016-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 87.74 M, Params=0.625 MB, latency=21.16 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.487, top1 = 89.67%]
cifar10        FLOP= 87.74 M, Params=0.625 MB, latency=21.77 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.298, top1 = 93.22%]
cifar100       FLOP= 87.74 M, Params=0.631 MB, latency=20.20 ms.
cifar100       train : [loss = 0.122, top1 = 97.66%], valid : [loss = 1.293, top1 = 69.41%], test : [loss = 1.284, top1 = 69.49%]
ImageNet16-120 FLOP= 21.94 M, Params=0.632 MB, latency=18.45 ms.
ImageNet16-120 train : [loss = 1.720, top1 = 54.09%], valid : [loss = 2.171, top1 = 44.28%], test : [loss = 2.188, top1 = 44.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.49%], valid : [loss = 0.629, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12017/15625) 012017-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.533, top1 = 89.21%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.40 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.341, top1 = 92.71%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.19 ms.
cifar100       train : [loss = 0.077, top1 = 98.46%], valid : [loss = 1.408, top1 = 68.56%], test : [loss = 1.436, top1 = 68.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.38 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.71%], valid : [loss = 2.315, top1 = 40.77%], test : [loss = 2.308, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.19%], valid : [loss = 0.910, top1 = 67.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12018/15625) 012018-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.317, top1 = 91.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.66 ms.
cifar100       train : [loss = 0.332, top1 = 90.92%], valid : [loss = 1.299, top1 = 66.86%], test : [loss = 1.303, top1 = 67.31%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.18%], valid : [loss = 2.365, top1 = 40.02%], test : [loss = 2.407, top1 = 39.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12019/15625) 012019-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.580, top1 = 87.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.377, top1 = 91.31%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.59 ms.
cifar100       train : [loss = 0.394, top1 = 88.69%], valid : [loss = 1.362, top1 = 66.14%], test : [loss = 1.383, top1 = 65.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.85%], valid : [loss = 2.522, top1 = 36.97%], test : [loss = 2.536, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12020/15625) 012020-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.553, top1 = 88.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.04 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.398, top1 = 91.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.46 ms.
cifar100       train : [loss = 0.180, top1 = 96.16%], valid : [loss = 1.398, top1 = 67.42%], test : [loss = 1.402, top1 = 67.50%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.84%], valid : [loss = 2.415, top1 = 39.17%], test : [loss = 2.438, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.78%], valid : [loss = 0.700, top1 = 76.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12021/15625) 012021-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.507, top1 = 88.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.38 ms.
cifar10        train : [loss = 0.032, top1 = 99.18%], test  : [loss = 0.367, top1 = 90.46%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.60 ms.
cifar100       train : [loss = 0.416, top1 = 88.30%], valid : [loss = 1.319, top1 = 66.32%], test : [loss = 1.273, top1 = 66.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.51%], valid : [loss = 2.405, top1 = 39.67%], test : [loss = 2.407, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.92%], valid : [loss = 0.614, top1 = 78.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12022/15625) 012022-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.57%], valid : [loss = 0.536, top1 = 86.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.099, top1 = 96.92%], test  : [loss = 0.365, top1 = 89.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 0.703, top1 = 79.67%], valid : [loss = 1.320, top1 = 64.35%], test : [loss = 1.298, top1 = 64.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.28%], valid : [loss = 2.536, top1 = 36.07%], test : [loss = 2.571, top1 = 35.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.90%], valid : [loss = 0.868, top1 = 69.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12023/15625) 012023-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.42%], valid : [loss = 0.652, top1 = 85.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.043, top1 = 98.67%], test  : [loss = 0.384, top1 = 90.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.93 ms.
cifar100       train : [loss = 0.590, top1 = 82.69%], valid : [loss = 1.406, top1 = 63.54%], test : [loss = 1.414, top1 = 63.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.474, top1 = 37.16%], valid : [loss = 2.644, top1 = 33.50%], test : [loss = 2.649, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 68.02%], valid : [loss = 0.950, top1 = 66.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12024/15625) 012024-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.544, top1 = 88.14%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.11 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.361, top1 = 91.60%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.43 ms.
cifar100       train : [loss = 0.309, top1 = 91.35%], valid : [loss = 1.320, top1 = 67.35%], test : [loss = 1.324, top1 = 67.38%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.232, top1 = 42.32%], valid : [loss = 2.451, top1 = 37.44%], test : [loss = 2.469, top1 = 37.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.99%], valid : [loss = 0.926, top1 = 67.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12025/15625) 012025-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.532, top1 = 89.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.342, top1 = 92.49%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.22 ms.
cifar100       train : [loss = 0.147, top1 = 96.64%], valid : [loss = 1.318, top1 = 68.79%], test : [loss = 1.331, top1 = 68.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 1.959, top1 = 48.43%], valid : [loss = 2.326, top1 = 40.17%], test : [loss = 2.317, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.67%], valid : [loss = 0.783, top1 = 72.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12026/15625) 012026-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.475, top1 = 89.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.321, top1 = 91.36%], valid : [loss = 1.253, top1 = 67.62%], test : [loss = 1.275, top1 = 67.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.60%], valid : [loss = 2.311, top1 = 40.44%], test : [loss = 2.332, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12027/15625) 012027-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=137.54 M, Params=0.964 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.52%]
cifar10        FLOP=137.54 M, Params=0.964 MB, latency=18.18 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.324, top1 = 93.35%]
cifar100       FLOP=137.55 M, Params=0.970 MB, latency=18.84 ms.
cifar100       train : [loss = 0.069, top1 = 98.93%], valid : [loss = 1.388, top1 = 69.29%], test : [loss = 1.353, top1 = 69.65%]
ImageNet16-120 FLOP= 34.39 M, Params=0.972 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.15%], valid : [loss = 2.329, top1 = 40.86%], test : [loss = 2.331, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.25%], valid : [loss = 0.601, top1 = 79.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12028/15625) 012028-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.56%], valid : [loss = 0.545, top1 = 87.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.344, top1 = 91.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.28 ms.
cifar100       train : [loss = 0.375, top1 = 89.06%], valid : [loss = 1.275, top1 = 67.32%], test : [loss = 1.320, top1 = 66.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.81%], valid : [loss = 2.407, top1 = 39.17%], test : [loss = 2.405, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.70%], valid : [loss = 0.941, top1 = 66.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12029/15625) 012029-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.467, top1 = 90.28%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.316, top1 = 93.12%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.42 ms.
cifar100       train : [loss = 0.056, top1 = 99.29%], valid : [loss = 1.401, top1 = 70.18%], test : [loss = 1.388, top1 = 70.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 1.620, top1 = 56.42%], valid : [loss = 2.345, top1 = 41.30%], test : [loss = 2.385, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.487, top1 = 82.78%], valid : [loss = 0.603, top1 = 79.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12030/15625) 012030-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.567, top1 = 87.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.57 ms.
cifar10        train : [loss = 0.034, top1 = 98.98%], test  : [loss = 0.348, top1 = 91.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.05 ms.
cifar100       train : [loss = 0.557, top1 = 83.78%], valid : [loss = 1.355, top1 = 64.46%], test : [loss = 1.381, top1 = 64.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.37%], valid : [loss = 2.620, top1 = 33.30%], test : [loss = 2.662, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 67.42%], valid : [loss = 0.941, top1 = 66.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12031/15625) 012031-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.753, top1 = 84.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.032, top1 = 99.12%], test  : [loss = 0.497, top1 = 88.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.348, top1 = 90.41%], valid : [loss = 1.694, top1 = 60.58%], test : [loss = 1.666, top1 = 61.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.55%], valid : [loss = 2.883, top1 = 29.93%], test : [loss = 2.951, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.56%], valid : [loss = 0.845, top1 = 70.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12032/15625) 012032-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.14%], valid : [loss = 0.640, top1 = 84.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10        train : [loss = 0.077, top1 = 97.46%], test  : [loss = 0.429, top1 = 88.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 0.633, top1 = 81.26%], valid : [loss = 1.496, top1 = 61.26%], test : [loss = 1.522, top1 = 61.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 25.42%], valid : [loss = 3.064, top1 = 25.10%], test : [loss = 3.111, top1 = 24.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.37%], valid : [loss = 1.009, top1 = 64.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12033/15625) 012033-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.21%], valid : [loss = 0.478, top1 = 84.34%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.296, top1 = 90.10%], test  : [loss = 0.399, top1 = 86.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.39 ms.
cifar100       train : [loss = 1.330, top1 = 63.22%], valid : [loss = 1.543, top1 = 57.81%], test : [loss = 1.511, top1 = 58.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.70%], valid : [loss = 2.906, top1 = 29.23%], test : [loss = 2.961, top1 = 28.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12034/15625) 012034-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.538, top1 = 88.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.353, top1 = 91.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.68 ms.
cifar100       train : [loss = 0.303, top1 = 91.63%], valid : [loss = 1.285, top1 = 67.41%], test : [loss = 1.310, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.64 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.69%], valid : [loss = 2.428, top1 = 38.71%], test : [loss = 2.435, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 70.67%], valid : [loss = 0.864, top1 = 69.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12035/15625) 012035-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.38%], valid : [loss = 0.857, top1 = 71.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10        train : [loss = 0.547, top1 = 80.87%], test  : [loss = 0.705, top1 = 76.22%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.68 ms.
cifar100       train : [loss = 1.772, top1 = 52.23%], valid : [loss = 2.061, top1 = 46.86%], test : [loss = 2.066, top1 = 46.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.82%], valid : [loss = 3.639, top1 = 16.74%], test : [loss = 3.664, top1 = 15.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12036/15625) 012036-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.42 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.456, top1 = 86.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.116, top1 = 96.40%], test  : [loss = 0.332, top1 = 89.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.10 ms.
cifar100       train : [loss = 0.867, top1 = 75.39%], valid : [loss = 1.298, top1 = 64.03%], test : [loss = 1.286, top1 = 63.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.46%], valid : [loss = 2.629, top1 = 33.94%], test : [loss = 2.650, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12037/15625) 012037-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.11%], valid : [loss = 0.868, top1 = 71.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.24 ms.
cifar10        train : [loss = 0.549, top1 = 80.82%], test  : [loss = 0.706, top1 = 75.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.18 ms.
cifar100       train : [loss = 1.770, top1 = 52.31%], valid : [loss = 2.047, top1 = 46.54%], test : [loss = 2.059, top1 = 47.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.89%], valid : [loss = 3.643, top1 = 16.17%], test : [loss = 3.687, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12038/15625) 012038-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.53%], valid : [loss = 0.449, top1 = 86.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.83 ms.
cifar10        train : [loss = 0.153, top1 = 95.05%], test  : [loss = 0.332, top1 = 89.24%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.83 ms.
cifar100       train : [loss = 0.973, top1 = 72.33%], valid : [loss = 1.329, top1 = 62.92%], test : [loss = 1.346, top1 = 61.66%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.89%], valid : [loss = 2.692, top1 = 32.90%], test : [loss = 2.692, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.17%], valid : [loss = 0.786, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12039/15625) 012039-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.470, top1 = 89.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.04 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.333, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.12 ms.
cifar100       train : [loss = 0.355, top1 = 90.09%], valid : [loss = 1.348, top1 = 66.32%], test : [loss = 1.316, top1 = 67.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.88%], valid : [loss = 2.386, top1 = 40.20%], test : [loss = 2.427, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.46%], valid : [loss = 0.654, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12040/15625) 012040-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.68 ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.32%], valid : [loss = 0.867, top1 = 71.24%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.51 ms.
cifar10        train : [loss = 0.568, top1 = 79.99%], test  : [loss = 0.731, top1 = 74.80%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.75 ms.
cifar100       train : [loss = 1.775, top1 = 52.15%], valid : [loss = 2.048, top1 = 47.62%], test : [loss = 2.040, top1 = 47.02%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.20 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.66%], valid : [loss = 3.644, top1 = 16.23%], test : [loss = 3.692, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12041/15625) 012041-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.640, top1 = 85.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.64 ms.
cifar10        train : [loss = 0.028, top1 = 99.32%], test  : [loss = 0.433, top1 = 88.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 0.392, top1 = 89.43%], valid : [loss = 1.408, top1 = 64.44%], test : [loss = 1.416, top1 = 64.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.28%], valid : [loss = 2.615, top1 = 34.53%], test : [loss = 2.648, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12042/15625) 012042-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.600, top1 = 87.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.417, top1 = 90.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.77 ms.
cifar100       train : [loss = 0.204, top1 = 95.14%], valid : [loss = 1.442, top1 = 66.18%], test : [loss = 1.469, top1 = 65.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.56%], valid : [loss = 2.418, top1 = 38.60%], test : [loss = 2.518, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.20%], valid : [loss = 0.700, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12043/15625) 012043-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.415, top1 = 90.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.277, top1 = 93.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.55 ms.
cifar100       train : [loss = 0.177, top1 = 95.84%], valid : [loss = 1.259, top1 = 69.68%], test : [loss = 1.249, top1 = 70.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 1.788, top1 = 52.45%], valid : [loss = 2.221, top1 = 43.13%], test : [loss = 2.291, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.35%], valid : [loss = 0.514, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12044/15625) 012044-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.548, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.365, top1 = 91.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.66 ms.
cifar100       train : [loss = 0.298, top1 = 91.59%], valid : [loss = 1.337, top1 = 66.94%], test : [loss = 1.299, top1 = 68.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 42.95%], valid : [loss = 2.455, top1 = 37.13%], test : [loss = 2.452, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.76%], valid : [loss = 0.940, top1 = 66.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12045/15625) 012045-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.529, top1 = 89.30%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.01 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.311, top1 = 93.22%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.00 ms.
cifar100       train : [loss = 0.056, top1 = 99.10%], valid : [loss = 1.370, top1 = 71.04%], test : [loss = 1.347, top1 = 70.34%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.90 ms.
ImageNet16-120 train : [loss = 2.138, top1 = 44.21%], valid : [loss = 2.428, top1 = 37.87%], test : [loss = 2.417, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.885, top1 = 68.24%], valid : [loss = 0.910, top1 = 67.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12046/15625) 012046-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10-valid  train : [loss = 0.971, top1 = 65.92%], valid : [loss = 1.010, top1 = 64.90%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.33 ms.
cifar10        train : [loss = 0.899, top1 = 68.88%], test  : [loss = 0.897, top1 = 68.59%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.85 ms.
cifar100       train : [loss = 2.365, top1 = 39.25%], valid : [loss = 2.435, top1 = 37.67%], test : [loss = 2.421, top1 = 38.37%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.81 ms.
ImageNet16-120 train : [loss = 3.636, top1 = 15.85%], valid : [loss = 3.608, top1 = 16.64%], test : [loss = 3.633, top1 = 16.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.610, top1 = 39.64%], valid : [loss = 1.669, top1 = 36.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12047/15625) 012047-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.87%], valid : [loss = 0.848, top1 = 71.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.569, top1 = 80.02%], test  : [loss = 0.731, top1 = 75.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 1.808, top1 = 51.41%], valid : [loss = 2.046, top1 = 47.70%], test : [loss = 2.049, top1 = 46.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.69%], valid : [loss = 3.634, top1 = 16.10%], test : [loss = 3.661, top1 = 15.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12048/15625) 012048-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.32%], valid : [loss = 0.755, top1 = 74.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10        train : [loss = 0.508, top1 = 82.43%], test  : [loss = 0.591, top1 = 79.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.99 ms.
cifar100       train : [loss = 1.978, top1 = 46.53%], valid : [loss = 2.110, top1 = 44.07%], test : [loss = 2.107, top1 = 43.65%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.978, top1 = 27.11%], valid : [loss = 2.954, top1 = 27.47%], test : [loss = 2.992, top1 = 26.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.56%], valid : [loss = 1.196, top1 = 57.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12049/15625) 012049-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.20%], valid : [loss = 0.586, top1 = 86.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10        train : [loss = 0.061, top1 = 98.22%], test  : [loss = 0.381, top1 = 89.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.60 ms.
cifar100       train : [loss = 0.707, top1 = 79.33%], valid : [loss = 1.367, top1 = 63.52%], test : [loss = 1.386, top1 = 63.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.88%], valid : [loss = 2.649, top1 = 33.77%], test : [loss = 2.689, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12050/15625) 012050-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.44%], valid : [loss = 0.511, top1 = 88.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.028, top1 = 99.14%], test  : [loss = 0.361, top1 = 91.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.394, top1 = 88.85%], valid : [loss = 1.318, top1 = 66.22%], test : [loss = 1.310, top1 = 66.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.220, top1 = 42.51%], valid : [loss = 2.396, top1 = 38.57%], test : [loss = 2.458, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.91%], valid : [loss = 0.792, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12051/15625) 012051-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.590, top1 = 87.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.47 ms.
cifar10        train : [loss = 0.021, top1 = 99.52%], test  : [loss = 0.387, top1 = 90.55%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.46 ms.
cifar100       train : [loss = 0.308, top1 = 92.07%], valid : [loss = 1.458, top1 = 64.44%], test : [loss = 1.427, top1 = 64.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 43.97%], valid : [loss = 2.537, top1 = 36.40%], test : [loss = 2.581, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.63%], valid : [loss = 0.703, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12052/15625) 012052-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.13%], valid : [loss = 0.462, top1 = 85.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.69 ms.
cifar10        train : [loss = 0.155, top1 = 94.89%], test  : [loss = 0.342, top1 = 88.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.23 ms.
cifar100       train : [loss = 1.005, top1 = 71.30%], valid : [loss = 1.363, top1 = 61.68%], test : [loss = 1.360, top1 = 61.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.73%], valid : [loss = 2.702, top1 = 31.90%], test : [loss = 2.715, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12053/15625) 012053-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.496, top1 = 89.97%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.15 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.307, top1 = 93.38%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.18 ms.
cifar100       train : [loss = 0.109, top1 = 97.90%], valid : [loss = 1.294, top1 = 70.22%], test : [loss = 1.269, top1 = 70.49%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.00 ms.
ImageNet16-120 train : [loss = 1.649, top1 = 55.64%], valid : [loss = 2.155, top1 = 44.57%], test : [loss = 2.171, top1 = 44.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.454, top1 = 84.44%], valid : [loss = 0.559, top1 = 80.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12054/15625) 012054-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.82%], valid : [loss = 0.495, top1 = 84.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.79 ms.
cifar10        train : [loss = 0.223, top1 = 92.44%], test  : [loss = 0.387, top1 = 87.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.74 ms.
cifar100       train : [loss = 1.251, top1 = 64.78%], valid : [loss = 1.532, top1 = 57.16%], test : [loss = 1.529, top1 = 57.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.907, top1 = 28.20%], valid : [loss = 2.919, top1 = 27.93%], test : [loss = 2.924, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12055/15625) 012055-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.50%], valid : [loss = 0.565, top1 = 87.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.03 ms.
cifar10        train : [loss = 0.019, top1 = 99.48%], test  : [loss = 0.370, top1 = 91.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.02 ms.
cifar100       train : [loss = 0.256, top1 = 92.87%], valid : [loss = 1.396, top1 = 67.16%], test : [loss = 1.383, top1 = 67.06%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.61 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 32.52%], valid : [loss = 2.752, top1 = 30.23%], test : [loss = 2.779, top1 = 29.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 64.98%], valid : [loss = 1.010, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12056/15625) 012056-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.246, top1 = 91.58%], valid : [loss = 0.534, top1 = 83.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.243, top1 = 91.71%], test  : [loss = 0.388, top1 = 87.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 1.325, top1 = 62.61%], valid : [loss = 1.575, top1 = 57.20%], test : [loss = 1.580, top1 = 56.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.34 ms.
ImageNet16-120 train : [loss = 2.856, top1 = 29.65%], valid : [loss = 2.859, top1 = 29.60%], test : [loss = 2.919, top1 = 28.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.46%], valid : [loss = 1.001, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12057/15625) 012057-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.703, top1 = 85.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.67 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.486, top1 = 89.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 0.284, top1 = 92.78%], valid : [loss = 1.590, top1 = 62.34%], test : [loss = 1.594, top1 = 63.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.403, top1 = 38.92%], valid : [loss = 2.742, top1 = 32.17%], test : [loss = 2.776, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.78%], valid : [loss = 0.846, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12058/15625) 012058-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.503, top1 = 89.04%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.03 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.322, top1 = 92.58%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.61 ms.
cifar100       train : [loss = 0.199, top1 = 94.97%], valid : [loss = 1.253, top1 = 69.24%], test : [loss = 1.257, top1 = 69.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.08%], valid : [loss = 2.183, top1 = 44.17%], test : [loss = 2.242, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.16%], valid : [loss = 0.735, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12059/15625) 012059-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.997, top1 = 79.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.086, top1 = 97.41%], test  : [loss = 0.658, top1 = 83.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.38 ms.
cifar100       train : [loss = 0.607, top1 = 83.16%], valid : [loss = 1.850, top1 = 56.40%], test : [loss = 1.870, top1 = 55.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.981, top1 = 27.46%], valid : [loss = 3.281, top1 = 22.33%], test : [loss = 3.314, top1 = 22.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.23%], valid : [loss = 1.089, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12060/15625) 012060-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.550, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.338, top1 = 92.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.54 ms.
cifar100       train : [loss = 0.122, top1 = 97.23%], valid : [loss = 1.483, top1 = 68.08%], test : [loss = 1.470, top1 = 67.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 43.65%], valid : [loss = 2.433, top1 = 38.30%], test : [loss = 2.433, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.58%], valid : [loss = 0.911, top1 = 67.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12061/15625) 012061-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.94%], valid : [loss = 0.595, top1 = 83.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.47 ms.
cifar10        train : [loss = 0.151, top1 = 94.96%], test  : [loss = 0.395, top1 = 88.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.10 ms.
cifar100       train : [loss = 1.133, top1 = 67.51%], valid : [loss = 1.549, top1 = 57.92%], test : [loss = 1.519, top1 = 58.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.29%], valid : [loss = 2.662, top1 = 32.73%], test : [loss = 2.713, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.49%], valid : [loss = 0.906, top1 = 67.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12062/15625) 012062-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.461, top1 = 89.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 0.328, top1 = 91.05%], valid : [loss = 1.332, top1 = 66.48%], test : [loss = 1.316, top1 = 67.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.95 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.25%], valid : [loss = 2.365, top1 = 39.98%], test : [loss = 2.413, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12063/15625) 012063-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.10%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.323, top1 = 91.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.21 ms.
cifar100       train : [loss = 0.334, top1 = 90.88%], valid : [loss = 1.297, top1 = 67.64%], test : [loss = 1.277, top1 = 67.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.07%], valid : [loss = 2.384, top1 = 40.27%], test : [loss = 2.407, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 85.02%], valid : [loss = 0.545, top1 = 81.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12064/15625) 012064-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.86%], valid : [loss = 0.761, top1 = 74.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.560, top1 = 80.57%], test  : [loss = 0.639, top1 = 78.18%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.51 ms.
cifar100       train : [loss = 1.979, top1 = 46.32%], valid : [loss = 2.099, top1 = 43.95%], test : [loss = 2.106, top1 = 43.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 3.019, top1 = 26.25%], valid : [loss = 3.002, top1 = 26.82%], test : [loss = 3.039, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.152, top1 = 58.57%], valid : [loss = 1.192, top1 = 57.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12065/15625) 012065-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.317, top1 = 89.03%], valid : [loss = 0.569, top1 = 81.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.296, top1 = 89.81%], test  : [loss = 0.428, top1 = 85.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 1.318, top1 = 62.85%], valid : [loss = 1.593, top1 = 56.51%], test : [loss = 1.592, top1 = 56.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 3.072, top1 = 25.70%], valid : [loss = 3.071, top1 = 25.56%], test : [loss = 3.135, top1 = 25.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.219, top1 = 55.87%], valid : [loss = 1.253, top1 = 54.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12066/15625) 012066-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.565, top1 = 88.52%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.61 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.402, top1 = 91.57%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=22.83 ms.
cifar100       train : [loss = 0.064, top1 = 99.27%], valid : [loss = 1.480, top1 = 68.44%], test : [loss = 1.448, top1 = 68.06%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.52 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.63%], valid : [loss = 2.429, top1 = 40.07%], test : [loss = 2.444, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.46%], valid : [loss = 0.700, top1 = 76.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12067/15625) 012067-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.82 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.524, top1 = 88.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.336, top1 = 91.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.15 ms.
cifar100       train : [loss = 0.342, top1 = 90.68%], valid : [loss = 1.311, top1 = 66.60%], test : [loss = 1.271, top1 = 67.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 45.01%], valid : [loss = 2.380, top1 = 39.93%], test : [loss = 2.399, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12068/15625) 012068-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.500, top1 = 89.92%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.316, top1 = 93.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.06 ms.
cifar100       train : [loss = 0.076, top1 = 98.86%], valid : [loss = 1.349, top1 = 69.37%], test : [loss = 1.308, top1 = 70.48%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.604, top1 = 56.82%], valid : [loss = 2.188, top1 = 44.19%], test : [loss = 2.187, top1 = 45.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.490, top1 = 83.13%], valid : [loss = 0.580, top1 = 80.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12069/15625) 012069-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.23%], valid : [loss = 0.611, top1 = 84.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.092, top1 = 96.96%], test  : [loss = 0.416, top1 = 88.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.10 ms.
cifar100       train : [loss = 0.699, top1 = 79.28%], valid : [loss = 1.470, top1 = 61.48%], test : [loss = 1.504, top1 = 61.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 3.209, top1 = 21.93%], valid : [loss = 3.198, top1 = 21.80%], test : [loss = 3.250, top1 = 20.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 63.04%], valid : [loss = 1.057, top1 = 62.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12070/15625) 012070-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.29%], valid : [loss = 0.550, top1 = 84.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10        train : [loss = 0.156, top1 = 94.81%], test  : [loss = 0.381, top1 = 88.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.869, top1 = 74.70%], valid : [loss = 1.457, top1 = 60.52%], test : [loss = 1.435, top1 = 61.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.802, top1 = 30.66%], valid : [loss = 2.836, top1 = 30.83%], test : [loss = 2.892, top1 = 29.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.893, top1 = 67.98%], valid : [loss = 0.942, top1 = 66.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12071/15625) 012071-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.573, top1 = 87.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.02 ms.
cifar10        train : [loss = 0.020, top1 = 99.46%], test  : [loss = 0.371, top1 = 91.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.80 ms.
cifar100       train : [loss = 0.298, top1 = 92.07%], valid : [loss = 1.328, top1 = 66.78%], test : [loss = 1.343, top1 = 66.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.251, top1 = 41.84%], valid : [loss = 2.459, top1 = 37.83%], test : [loss = 2.493, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 71.34%], valid : [loss = 0.872, top1 = 69.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12072/15625) 012072-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.90 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.43%], valid : [loss = 0.654, top1 = 84.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10        train : [loss = 0.049, top1 = 98.54%], test  : [loss = 0.424, top1 = 88.95%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.06 ms.
cifar100       train : [loss = 0.621, top1 = 81.77%], valid : [loss = 1.414, top1 = 63.82%], test : [loss = 1.379, top1 = 63.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.487, top1 = 36.99%], valid : [loss = 2.607, top1 = 35.03%], test : [loss = 2.666, top1 = 34.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.95%], valid : [loss = 0.832, top1 = 70.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12073/15625) 012073-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.633, top1 = 86.08%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=16.68 ms.
cifar10        train : [loss = 0.037, top1 = 98.94%], test  : [loss = 0.438, top1 = 89.20%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=16.93 ms.
cifar100       train : [loss = 0.466, top1 = 86.83%], valid : [loss = 1.438, top1 = 64.08%], test : [loss = 1.417, top1 = 64.35%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.369, top1 = 39.41%], valid : [loss = 2.592, top1 = 34.93%], test : [loss = 2.613, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.40%], valid : [loss = 0.755, top1 = 73.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12074/15625) 012074-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.568, top1 = 88.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.06 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.376, top1 = 92.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.21 ms.
cifar100       train : [loss = 0.165, top1 = 96.51%], valid : [loss = 1.439, top1 = 67.48%], test : [loss = 1.408, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.33%], valid : [loss = 2.497, top1 = 38.90%], test : [loss = 2.493, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.60%], valid : [loss = 0.790, top1 = 72.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12075/15625) 012075-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.421, top1 = 90.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.278, top1 = 93.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.183, top1 = 95.63%], valid : [loss = 1.259, top1 = 69.90%], test : [loss = 1.252, top1 = 69.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.49 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.58%], valid : [loss = 2.231, top1 = 43.13%], test : [loss = 2.284, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 86.93%], valid : [loss = 0.501, top1 = 83.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12076/15625) 012076-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.518, top1 = 89.68%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.24 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.309, top1 = 93.61%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=23.15 ms.
cifar100       train : [loss = 0.038, top1 = 99.61%], valid : [loss = 1.327, top1 = 70.78%], test : [loss = 1.323, top1 = 71.26%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.72%], valid : [loss = 2.298, top1 = 40.27%], test : [loss = 2.302, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.64%], valid : [loss = 0.704, top1 = 75.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12077/15625) 012077-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.592, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.49 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.397, top1 = 91.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.196, top1 = 95.57%], valid : [loss = 1.441, top1 = 66.17%], test : [loss = 1.428, top1 = 66.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.51%], valid : [loss = 2.484, top1 = 37.99%], test : [loss = 2.509, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.68%], valid : [loss = 0.704, top1 = 75.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12078/15625) 012078-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.499, top1 = 89.60%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.28 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.304, top1 = 93.26%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.63 ms.
cifar100       train : [loss = 0.141, top1 = 97.18%], valid : [loss = 1.296, top1 = 70.10%], test : [loss = 1.316, top1 = 69.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.70 ms.
ImageNet16-120 train : [loss = 1.801, top1 = 52.08%], valid : [loss = 2.265, top1 = 42.73%], test : [loss = 2.237, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.84%], valid : [loss = 0.628, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12079/15625) 012079-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.45 ms.
cifar10-valid  train : [loss = 1.229, top1 = 55.91%], valid : [loss = 1.266, top1 = 54.74%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10        train : [loss = 1.144, top1 = 59.21%], test  : [loss = 1.153, top1 = 58.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.60 ms.
cifar100       train : [loss = 2.701, top1 = 32.33%], valid : [loss = 2.781, top1 = 31.27%], test : [loss = 2.763, top1 = 31.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.31 ms.
ImageNet16-120 train : [loss = 3.876, top1 = 12.30%], valid : [loss = 3.874, top1 = 12.76%], test : [loss = 3.895, top1 = 12.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12080/15625) 012080-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=23.06 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.464, top1 = 90.45%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.315, top1 = 93.36%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.61 ms.
cifar100       train : [loss = 0.085, top1 = 98.68%], valid : [loss = 1.292, top1 = 69.42%], test : [loss = 1.284, top1 = 70.02%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.26 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.65%], valid : [loss = 2.158, top1 = 45.07%], test : [loss = 2.147, top1 = 45.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.39%], valid : [loss = 0.681, top1 = 76.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12081/15625) 012081-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.514, top1 = 88.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.322, top1 = 92.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.29 ms.
cifar100       train : [loss = 0.351, top1 = 90.52%], valid : [loss = 1.297, top1 = 66.44%], test : [loss = 1.300, top1 = 66.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.66%], valid : [loss = 2.395, top1 = 38.97%], test : [loss = 2.398, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12082/15625) 012082-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.488, top1 = 89.28%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.53 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.311, top1 = 92.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.67 ms.
cifar100       train : [loss = 0.231, top1 = 94.32%], valid : [loss = 1.259, top1 = 68.80%], test : [loss = 1.251, top1 = 68.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.76%], valid : [loss = 2.266, top1 = 41.80%], test : [loss = 2.266, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.44%], valid : [loss = 0.596, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12083/15625) 012083-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.572, top1 = 88.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.01 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.380, top1 = 91.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.70 ms.
cifar100       train : [loss = 0.202, top1 = 95.31%], valid : [loss = 1.395, top1 = 66.80%], test : [loss = 1.426, top1 = 65.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.34%], valid : [loss = 2.449, top1 = 38.97%], test : [loss = 2.440, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.697, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12084/15625) 012084-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.77 ms.
cifar10-valid  train : [loss = 1.852, top1 = 32.61%], valid : [loss = 1.857, top1 = 32.77%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.18 ms.
cifar10        train : [loss = 1.379, top1 = 49.69%], test  : [loss = 1.389, top1 = 49.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 3.900, top1 = 9.97%], valid : [loss = 3.901, top1 = 10.11%], test : [loss = 3.896, top1 = 10.27%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.98 ms.
ImageNet16-120 train : [loss = 4.032, top1 = 9.82%], valid : [loss = 4.025, top1 = 9.63%], test : [loss = 4.034, top1 = 10.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.981, top1 = 26.35%], valid : [loss = 1.985, top1 = 26.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12085/15625) 012085-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.51%], valid : [loss = 0.575, top1 = 87.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10        train : [loss = 0.041, top1 = 98.82%], test  : [loss = 0.372, top1 = 90.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=15.08 ms.
cifar100       train : [loss = 0.548, top1 = 83.98%], valid : [loss = 1.471, top1 = 62.60%], test : [loss = 1.438, top1 = 63.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.480, top1 = 37.16%], valid : [loss = 2.611, top1 = 34.57%], test : [loss = 2.670, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12086/15625) 012086-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.62%], valid : [loss = 0.534, top1 = 88.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.05 ms.
cifar10        train : [loss = 0.026, top1 = 99.24%], test  : [loss = 0.378, top1 = 91.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.435, top1 = 87.52%], valid : [loss = 1.248, top1 = 67.28%], test : [loss = 1.276, top1 = 66.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.09%], valid : [loss = 2.424, top1 = 39.97%], test : [loss = 2.444, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12087/15625) 012087-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.63%], valid : [loss = 0.756, top1 = 79.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10        train : [loss = 0.173, top1 = 93.99%], test  : [loss = 0.508, top1 = 85.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.07 ms.
cifar100       train : [loss = 0.886, top1 = 74.13%], valid : [loss = 1.657, top1 = 57.50%], test : [loss = 1.639, top1 = 57.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 3.474, top1 = 17.31%], valid : [loss = 3.477, top1 = 18.03%], test : [loss = 3.500, top1 = 17.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.325, top1 = 51.20%], valid : [loss = 1.343, top1 = 50.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12088/15625) 012088-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.82%], valid : [loss = 0.514, top1 = 88.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.61 ms.
cifar10        train : [loss = 0.029, top1 = 99.23%], test  : [loss = 0.364, top1 = 90.58%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.66 ms.
cifar100       train : [loss = 0.438, top1 = 87.40%], valid : [loss = 1.303, top1 = 66.64%], test : [loss = 1.314, top1 = 66.90%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.190, top1 = 43.45%], valid : [loss = 2.416, top1 = 38.60%], test : [loss = 2.434, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.78%], valid : [loss = 0.602, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12089/15625) 012089-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.40%], valid : [loss = 0.944, top1 = 78.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.43 ms.
cifar10        train : [loss = 0.097, top1 = 96.97%], test  : [loss = 0.670, top1 = 83.13%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.66 ms.
cifar100       train : [loss = 0.647, top1 = 81.87%], valid : [loss = 1.969, top1 = 54.26%], test : [loss = 1.908, top1 = 54.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.978, top1 = 27.48%], valid : [loss = 3.287, top1 = 22.97%], test : [loss = 3.315, top1 = 21.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.998, top1 = 64.27%], valid : [loss = 1.052, top1 = 62.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12090/15625) 012090-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.47%], valid : [loss = 0.839, top1 = 75.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.327, top1 = 88.59%], test  : [loss = 0.626, top1 = 80.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.09 ms.
cifar100       train : [loss = 1.386, top1 = 61.20%], valid : [loss = 1.923, top1 = 49.76%], test : [loss = 1.927, top1 = 50.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 3.525, top1 = 16.87%], valid : [loss = 3.532, top1 = 17.19%], test : [loss = 3.543, top1 = 16.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.243, top1 = 54.60%], valid : [loss = 1.282, top1 = 53.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12091/15625) 012091-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.95 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12092/15625) 012092-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.539, top1 = 89.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.338, top1 = 92.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.37 ms.
cifar100       train : [loss = 0.135, top1 = 97.05%], valid : [loss = 1.345, top1 = 68.31%], test : [loss = 1.362, top1 = 68.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.003, top1 = 47.33%], valid : [loss = 2.324, top1 = 40.83%], test : [loss = 2.328, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.28%], valid : [loss = 0.825, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12093/15625) 012093-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.561, top1 = 87.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10        train : [loss = 0.033, top1 = 99.01%], test  : [loss = 0.356, top1 = 91.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 0.489, top1 = 86.04%], valid : [loss = 1.325, top1 = 65.43%], test : [loss = 1.333, top1 = 65.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 35.66%], valid : [loss = 2.603, top1 = 34.12%], test : [loss = 2.612, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12094/15625) 012094-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.56 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.07%], valid : [loss = 0.841, top1 = 72.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10        train : [loss = 0.569, top1 = 80.18%], test  : [loss = 0.727, top1 = 75.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 1.782, top1 = 52.06%], valid : [loss = 2.056, top1 = 46.47%], test : [loss = 2.072, top1 = 46.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.83%], valid : [loss = 3.646, top1 = 16.53%], test : [loss = 3.669, top1 = 15.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.189, top1 = 57.35%], valid : [loss = 1.249, top1 = 55.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12095/15625) 012095-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.129, top1 = 96.08%], valid : [loss = 0.469, top1 = 85.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.159, top1 = 94.81%], test  : [loss = 0.351, top1 = 88.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.05 ms.
cifar100       train : [loss = 0.995, top1 = 71.63%], valid : [loss = 1.354, top1 = 62.39%], test : [loss = 1.357, top1 = 61.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.06 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.72%], valid : [loss = 2.689, top1 = 32.72%], test : [loss = 2.719, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12096/15625) 012096-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.83%], valid : [loss = 0.844, top1 = 75.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.325, top1 = 88.80%], test  : [loss = 0.649, top1 = 79.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 1.358, top1 = 61.72%], valid : [loss = 1.917, top1 = 50.41%], test : [loss = 1.905, top1 = 50.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 3.484, top1 = 17.57%], valid : [loss = 3.520, top1 = 18.00%], test : [loss = 3.501, top1 = 17.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.257, top1 = 54.19%], valid : [loss = 1.301, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12097/15625) 012097-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.76 ms.
cifar10-valid  train : [loss = 0.210, top1 = 93.01%], valid : [loss = 0.517, top1 = 84.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.197, top1 = 93.32%], test  : [loss = 0.382, top1 = 88.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.17 ms.
cifar100       train : [loss = 1.224, top1 = 65.10%], valid : [loss = 1.519, top1 = 58.43%], test : [loss = 1.502, top1 = 59.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.731, top1 = 32.07%], valid : [loss = 2.737, top1 = 32.24%], test : [loss = 2.814, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.051, top1 = 62.19%], valid : [loss = 1.093, top1 = 61.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12098/15625) 012098-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.461, top1 = 89.42%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.21%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.74 ms.
cifar100       train : [loss = 0.305, top1 = 91.95%], valid : [loss = 1.241, top1 = 68.03%], test : [loss = 1.252, top1 = 67.95%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.966, top1 = 48.25%], valid : [loss = 2.293, top1 = 41.24%], test : [loss = 2.282, top1 = 41.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.486, top1 = 82.97%], valid : [loss = 0.567, top1 = 80.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12099/15625) 012099-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.507, top1 = 89.31%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.63 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.314, top1 = 92.76%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=22.98 ms.
cifar100       train : [loss = 0.190, top1 = 95.53%], valid : [loss = 1.248, top1 = 69.61%], test : [loss = 1.260, top1 = 69.05%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.65%], valid : [loss = 2.179, top1 = 44.42%], test : [loss = 2.159, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.46%], valid : [loss = 0.709, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12100/15625) 012100-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.11%], valid : [loss = 0.670, top1 = 82.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.93 ms.
cifar10        train : [loss = 0.150, top1 = 94.93%], test  : [loss = 0.464, top1 = 86.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.05 ms.
cifar100       train : [loss = 0.972, top1 = 71.87%], valid : [loss = 1.647, top1 = 57.23%], test : [loss = 1.640, top1 = 57.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 3.091, top1 = 24.49%], valid : [loss = 3.148, top1 = 24.45%], test : [loss = 3.179, top1 = 23.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.66%], valid : [loss = 0.986, top1 = 65.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12101/15625) 012101-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.82 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.537, top1 = 89.01%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.83 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.328, top1 = 92.56%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.38 ms.
cifar100       train : [loss = 0.109, top1 = 97.95%], valid : [loss = 1.339, top1 = 69.27%], test : [loss = 1.328, top1 = 69.51%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.66 ms.
ImageNet16-120 train : [loss = 1.828, top1 = 51.50%], valid : [loss = 2.297, top1 = 42.00%], test : [loss = 2.300, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.43%], valid : [loss = 0.751, top1 = 73.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12102/15625) 012102-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.67%], valid : [loss = 0.659, top1 = 84.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10        train : [loss = 0.060, top1 = 98.05%], test  : [loss = 0.415, top1 = 89.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.95 ms.
cifar100       train : [loss = 0.426, top1 = 87.69%], valid : [loss = 1.547, top1 = 62.08%], test : [loss = 1.572, top1 = 62.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 29.66%], valid : [loss = 2.894, top1 = 29.20%], test : [loss = 2.918, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 62.46%], valid : [loss = 1.067, top1 = 61.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12103/15625) 012103-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.23%], valid : [loss = 0.477, top1 = 84.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10        train : [loss = 0.302, top1 = 89.92%], test  : [loss = 0.402, top1 = 86.44%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.52 ms.
cifar100       train : [loss = 1.329, top1 = 63.17%], valid : [loss = 1.526, top1 = 57.98%], test : [loss = 1.502, top1 = 58.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.68%], valid : [loss = 2.897, top1 = 29.42%], test : [loss = 2.946, top1 = 28.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12104/15625) 012104-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.493, top1 = 89.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.65 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.316, top1 = 92.92%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.37 ms.
cifar100       train : [loss = 0.139, top1 = 97.16%], valid : [loss = 1.328, top1 = 68.68%], test : [loss = 1.322, top1 = 68.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.84%], valid : [loss = 2.280, top1 = 41.87%], test : [loss = 2.286, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.34%], valid : [loss = 0.808, top1 = 71.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12105/15625) 012105-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.49 ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.52%], valid : [loss = 1.323, top1 = 52.61%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.06 ms.
cifar10        train : [loss = 1.223, top1 = 56.20%], test  : [loss = 1.243, top1 = 55.12%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.41 ms.
cifar100       train : [loss = 2.790, top1 = 30.52%], valid : [loss = 2.889, top1 = 29.09%], test : [loss = 2.873, top1 = 29.63%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.64 ms.
ImageNet16-120 train : [loss = 3.942, top1 = 11.27%], valid : [loss = 3.948, top1 = 11.32%], test : [loss = 3.961, top1 = 11.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.756, top1 = 33.81%], valid : [loss = 1.750, top1 = 33.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12106/15625) 012106-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.342, top1 = 91.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.07 ms.
cifar100       train : [loss = 0.336, top1 = 90.89%], valid : [loss = 1.266, top1 = 67.66%], test : [loss = 1.274, top1 = 67.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.33 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.91%], valid : [loss = 2.398, top1 = 39.12%], test : [loss = 2.419, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12107/15625) 012107-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.532, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.342, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.108, top1 = 98.11%], valid : [loss = 1.399, top1 = 68.62%], test : [loss = 1.418, top1 = 68.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.32%], valid : [loss = 2.373, top1 = 40.45%], test : [loss = 2.407, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12108/15625) 012108-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.12 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.384, top1 = 91.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.91 ms.
cifar100       train : [loss = 0.169, top1 = 96.40%], valid : [loss = 1.400, top1 = 67.20%], test : [loss = 1.377, top1 = 67.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.23%], valid : [loss = 2.448, top1 = 38.53%], test : [loss = 2.464, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.70%], valid : [loss = 0.689, top1 = 75.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12109/15625) 012109-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.575, top1 = 87.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.393, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.36 ms.
cifar100       train : [loss = 0.398, top1 = 88.79%], valid : [loss = 1.356, top1 = 65.68%], test : [loss = 1.363, top1 = 66.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.93%], valid : [loss = 2.502, top1 = 37.18%], test : [loss = 2.542, top1 = 36.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.67%], valid : [loss = 0.790, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12110/15625) 012110-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.46 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.77%], valid : [loss = 0.846, top1 = 72.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.17 ms.
cifar10        train : [loss = 0.559, top1 = 80.33%], test  : [loss = 0.714, top1 = 75.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.27 ms.
cifar100       train : [loss = 1.778, top1 = 52.02%], valid : [loss = 2.045, top1 = 47.09%], test : [loss = 2.061, top1 = 46.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.85%], valid : [loss = 3.635, top1 = 16.48%], test : [loss = 3.680, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.199, top1 = 56.76%], valid : [loss = 1.258, top1 = 55.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12111/15625) 012111-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.31%], valid : [loss = 0.457, top1 = 86.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.73 ms.
cifar10        train : [loss = 0.109, top1 = 96.68%], test  : [loss = 0.318, top1 = 89.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.85 ms.
cifar100       train : [loss = 0.817, top1 = 76.94%], valid : [loss = 1.283, top1 = 64.46%], test : [loss = 1.270, top1 = 64.44%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.36%], valid : [loss = 2.600, top1 = 35.23%], test : [loss = 2.632, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.13%], valid : [loss = 0.667, top1 = 76.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12112/15625) 012112-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.43%], valid : [loss = 0.871, top1 = 79.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10        train : [loss = 0.136, top1 = 95.42%], test  : [loss = 0.543, top1 = 84.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.03 ms.
cifar100       train : [loss = 0.853, top1 = 75.10%], valid : [loss = 1.674, top1 = 57.82%], test : [loss = 1.690, top1 = 57.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.42%], valid : [loss = 3.171, top1 = 24.38%], test : [loss = 3.197, top1 = 23.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12113/15625) 012113-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.523, top1 = 88.73%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.30 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.331, top1 = 92.25%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.99 ms.
cifar100       train : [loss = 0.337, top1 = 90.82%], valid : [loss = 1.285, top1 = 66.77%], test : [loss = 1.266, top1 = 67.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.90 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.69%], valid : [loss = 2.392, top1 = 39.02%], test : [loss = 2.420, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.79%], valid : [loss = 0.720, top1 = 74.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12114/15625) 012114-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.21%], valid : [loss = 0.576, top1 = 85.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10        train : [loss = 0.113, top1 = 96.17%], test  : [loss = 0.391, top1 = 88.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.20 ms.
cifar100       train : [loss = 0.820, top1 = 75.84%], valid : [loss = 1.391, top1 = 62.66%], test : [loss = 1.404, top1 = 62.56%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 32.99%], valid : [loss = 2.758, top1 = 31.47%], test : [loss = 2.813, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.99%], valid : [loss = 0.724, top1 = 75.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12115/15625) 012115-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 57.59 M, Params=0.419 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.470, top1 = 89.23%]
cifar10        FLOP= 57.59 M, Params=0.419 MB, latency=21.49 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.314, top1 = 92.20%]
cifar100       FLOP= 57.60 M, Params=0.425 MB, latency=19.41 ms.
cifar100       train : [loss = 0.261, top1 = 93.38%], valid : [loss = 1.200, top1 = 69.48%], test : [loss = 1.214, top1 = 68.73%]
ImageNet16-120 FLOP= 14.41 M, Params=0.426 MB, latency=21.78 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.20%], valid : [loss = 2.203, top1 = 43.27%], test : [loss = 2.246, top1 = 42.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.72%], valid : [loss = 0.671, top1 = 77.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12116/15625) 012116-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.84%], valid : [loss = 0.647, top1 = 83.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.18 ms.
cifar10        train : [loss = 0.097, top1 = 96.82%], test  : [loss = 0.426, top1 = 87.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.01 ms.
cifar100       train : [loss = 0.849, top1 = 74.95%], valid : [loss = 1.516, top1 = 60.20%], test : [loss = 1.509, top1 = 59.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.577, top1 = 34.98%], valid : [loss = 2.716, top1 = 33.05%], test : [loss = 2.753, top1 = 31.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.64%], valid : [loss = 0.941, top1 = 66.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12117/15625) 012117-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=24.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.517, top1 = 89.90%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.54 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.310, top1 = 93.31%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=21.02 ms.
cifar100       train : [loss = 0.059, top1 = 99.19%], valid : [loss = 1.296, top1 = 70.52%], test : [loss = 1.322, top1 = 70.31%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=22.20 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 51.01%], valid : [loss = 2.258, top1 = 42.33%], test : [loss = 2.274, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.60%], valid : [loss = 0.803, top1 = 72.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12118/15625) 012118-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.516, top1 = 89.71%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=22.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.316, top1 = 93.36%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=20.70 ms.
cifar100       train : [loss = 0.042, top1 = 99.41%], valid : [loss = 1.466, top1 = 69.14%], test : [loss = 1.478, top1 = 68.78%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=19.92 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.61%], valid : [loss = 2.315, top1 = 40.87%], test : [loss = 2.305, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.66%], valid : [loss = 0.856, top1 = 69.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12119/15625) 012119-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.30%], valid : [loss = 0.914, top1 = 77.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10        train : [loss = 0.166, top1 = 94.34%], test  : [loss = 0.586, top1 = 83.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.77 ms.
cifar100       train : [loss = 0.940, top1 = 72.71%], valid : [loss = 1.715, top1 = 56.10%], test : [loss = 1.731, top1 = 55.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 3.154, top1 = 24.25%], valid : [loss = 3.294, top1 = 21.83%], test : [loss = 3.310, top1 = 22.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.102, top1 = 60.26%], valid : [loss = 1.162, top1 = 58.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12120/15625) 012120-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.470, top1 = 89.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.94 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.322, top1 = 92.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.02 ms.
cifar100       train : [loss = 0.177, top1 = 95.76%], valid : [loss = 1.333, top1 = 68.66%], test : [loss = 1.331, top1 = 68.45%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.55%], valid : [loss = 2.276, top1 = 41.80%], test : [loss = 2.316, top1 = 42.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.22%], valid : [loss = 0.541, top1 = 81.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12121/15625) 012121-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 52.35 M, Params=0.382 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.18%]
cifar10        FLOP= 52.35 M, Params=0.382 MB, latency=18.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.17%]
cifar100       FLOP= 52.35 M, Params=0.388 MB, latency=16.76 ms.
cifar100       train : [loss = 0.326, top1 = 91.17%], valid : [loss = 1.247, top1 = 68.22%], test : [loss = 1.259, top1 = 68.08%]
ImageNet16-120 FLOP= 13.09 M, Params=0.389 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.46%], valid : [loss = 2.333, top1 = 40.80%], test : [loss = 2.342, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.71%], valid : [loss = 0.606, top1 = 79.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12122/15625) 012122-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.76%], valid : [loss = 0.456, top1 = 86.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10        train : [loss = 0.154, top1 = 94.97%], test  : [loss = 0.347, top1 = 88.90%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 0.967, top1 = 72.43%], valid : [loss = 1.333, top1 = 62.80%], test : [loss = 1.345, top1 = 62.53%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.76%], valid : [loss = 2.693, top1 = 32.13%], test : [loss = 2.708, top1 = 32.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12123/15625) 012123-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.99 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.428, top1 = 90.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.286, top1 = 93.72%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.35 ms.
cifar100       train : [loss = 0.050, top1 = 99.33%], valid : [loss = 1.367, top1 = 70.74%], test : [loss = 1.325, top1 = 70.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.26 ms.
ImageNet16-120 train : [loss = 1.458, top1 = 60.35%], valid : [loss = 2.200, top1 = 44.70%], test : [loss = 2.214, top1 = 45.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.93%], valid : [loss = 0.489, top1 = 83.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12124/15625) 012124-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.552, top1 = 88.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.379, top1 = 92.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.31 ms.
cifar100       train : [loss = 0.073, top1 = 98.94%], valid : [loss = 1.462, top1 = 67.64%], test : [loss = 1.461, top1 = 68.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 51.14%], valid : [loss = 2.439, top1 = 39.23%], test : [loss = 2.449, top1 = 39.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.42%], valid : [loss = 0.707, top1 = 75.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12125/15625) 012125-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.53%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.323, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.55 ms.
cifar100       train : [loss = 0.150, top1 = 96.82%], valid : [loss = 1.331, top1 = 68.82%], test : [loss = 1.326, top1 = 68.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.27%], valid : [loss = 2.298, top1 = 41.52%], test : [loss = 2.307, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.11%], valid : [loss = 0.792, top1 = 72.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12126/15625) 012126-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.57 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.461, top1 = 89.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.02 ms.
cifar100       train : [loss = 0.328, top1 = 91.05%], valid : [loss = 1.332, top1 = 66.48%], test : [loss = 1.316, top1 = 67.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.86 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.25%], valid : [loss = 2.365, top1 = 39.98%], test : [loss = 2.413, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12127/15625) 012127-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.56%], valid : [loss = 0.470, top1 = 85.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10        train : [loss = 0.149, top1 = 95.18%], test  : [loss = 0.335, top1 = 89.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.41 ms.
cifar100       train : [loss = 0.973, top1 = 72.23%], valid : [loss = 1.344, top1 = 62.60%], test : [loss = 1.336, top1 = 62.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.40 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.18%], valid : [loss = 2.677, top1 = 33.05%], test : [loss = 2.705, top1 = 32.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.22%], valid : [loss = 0.782, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12128/15625) 012128-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.575, top1 = 88.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.372, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.02 ms.
cifar100       train : [loss = 0.107, top1 = 97.98%], valid : [loss = 1.474, top1 = 67.88%], test : [loss = 1.481, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 50.04%], valid : [loss = 2.427, top1 = 39.55%], test : [loss = 2.470, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.46%], valid : [loss = 0.783, top1 = 73.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12129/15625) 012129-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.43%], valid : [loss = 0.590, top1 = 80.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.61 ms.
cifar10        train : [loss = 0.277, top1 = 90.43%], test  : [loss = 0.428, top1 = 85.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.96 ms.
cifar100       train : [loss = 1.561, top1 = 56.70%], valid : [loss = 1.787, top1 = 52.18%], test : [loss = 1.767, top1 = 52.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 3.067, top1 = 25.44%], valid : [loss = 3.066, top1 = 25.28%], test : [loss = 3.130, top1 = 24.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.84%], valid : [loss = 1.077, top1 = 61.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12130/15625) 012130-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.520, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.57 ms.
cifar100       train : [loss = 0.130, top1 = 97.42%], valid : [loss = 1.292, top1 = 68.97%], test : [loss = 1.297, top1 = 69.37%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.08 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.62%], valid : [loss = 2.283, top1 = 41.52%], test : [loss = 2.263, top1 = 42.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.49%], valid : [loss = 0.728, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12131/15625) 012131-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.19 ms.
cifar10-valid  train : [loss = 0.139, top1 = 95.55%], valid : [loss = 0.573, top1 = 83.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.03 ms.
cifar10        train : [loss = 0.156, top1 = 94.88%], test  : [loss = 0.412, top1 = 87.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.48 ms.
cifar100       train : [loss = 1.084, top1 = 68.79%], valid : [loss = 1.495, top1 = 59.17%], test : [loss = 1.486, top1 = 59.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.580, top1 = 34.93%], valid : [loss = 2.648, top1 = 33.88%], test : [loss = 2.679, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 69.21%], valid : [loss = 0.933, top1 = 66.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12132/15625) 012132-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.99%], valid : [loss = 0.851, top1 = 71.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10        train : [loss = 0.703, top1 = 75.34%], test  : [loss = 0.783, top1 = 72.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.92 ms.
cifar100       train : [loss = 1.958, top1 = 48.10%], valid : [loss = 2.131, top1 = 44.89%], test : [loss = 2.159, top1 = 45.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 3.653, top1 = 15.71%], valid : [loss = 3.672, top1 = 15.92%], test : [loss = 3.697, top1 = 14.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.386, top1 = 49.77%], valid : [loss = 1.406, top1 = 49.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12133/15625) 012133-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.70%], valid : [loss = 0.606, top1 = 84.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.091, top1 = 96.99%], test  : [loss = 0.429, top1 = 88.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 0.709, top1 = 79.06%], valid : [loss = 1.534, top1 = 60.04%], test : [loss = 1.540, top1 = 60.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 3.193, top1 = 22.15%], valid : [loss = 3.205, top1 = 22.07%], test : [loss = 3.250, top1 = 21.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12134/15625) 012134-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.20 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.86%], valid : [loss = 0.628, top1 = 86.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.52 ms.
cifar10        train : [loss = 0.028, top1 = 99.33%], test  : [loss = 0.429, top1 = 89.50%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.94 ms.
cifar100       train : [loss = 0.373, top1 = 90.06%], valid : [loss = 1.424, top1 = 65.00%], test : [loss = 1.431, top1 = 64.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.33 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.25%], valid : [loss = 2.608, top1 = 35.27%], test : [loss = 2.621, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.56%], valid : [loss = 0.771, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12135/15625) 012135-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.528, top1 = 88.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.353, top1 = 91.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.48 ms.
cifar100       train : [loss = 0.240, top1 = 93.75%], valid : [loss = 1.255, top1 = 68.63%], test : [loss = 1.253, top1 = 68.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 1.926, top1 = 49.22%], valid : [loss = 2.234, top1 = 42.18%], test : [loss = 2.261, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.34%], valid : [loss = 0.718, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12136/15625) 012136-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.553, top1 = 88.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.401, top1 = 91.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.90 ms.
cifar100       train : [loss = 0.170, top1 = 96.17%], valid : [loss = 1.462, top1 = 66.39%], test : [loss = 1.477, top1 = 66.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.41%], valid : [loss = 2.433, top1 = 39.20%], test : [loss = 2.436, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.18%], valid : [loss = 0.702, top1 = 75.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12137/15625) 012137-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.504, top1 = 88.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.030, top1 = 99.14%], test  : [loss = 0.359, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 0.485, top1 = 85.66%], valid : [loss = 1.342, top1 = 65.96%], test : [loss = 1.344, top1 = 65.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.20%], valid : [loss = 2.527, top1 = 36.67%], test : [loss = 2.549, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.50%], valid : [loss = 0.695, top1 = 76.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12138/15625) 012138-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.73%], valid : [loss = 0.503, top1 = 88.11%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.79 ms.
cifar10        train : [loss = 0.036, top1 = 99.00%], test  : [loss = 0.345, top1 = 90.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.22 ms.
cifar100       train : [loss = 0.434, top1 = 87.72%], valid : [loss = 1.282, top1 = 67.34%], test : [loss = 1.276, top1 = 66.97%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.17%], valid : [loss = 2.405, top1 = 39.07%], test : [loss = 2.420, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.43%], valid : [loss = 0.614, top1 = 78.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12139/15625) 012139-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.50%], valid : [loss = 0.443, top1 = 87.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.13 ms.
cifar10        train : [loss = 0.056, top1 = 98.63%], test  : [loss = 0.307, top1 = 90.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.28 ms.
cifar100       train : [loss = 0.575, top1 = 84.21%], valid : [loss = 1.224, top1 = 66.80%], test : [loss = 1.222, top1 = 66.41%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.281, top1 = 41.50%], valid : [loss = 2.458, top1 = 38.18%], test : [loss = 2.473, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12140/15625) 012140-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.497, top1 = 90.00%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.15 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.307, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.63 ms.
cifar100       train : [loss = 0.146, top1 = 96.62%], valid : [loss = 1.352, top1 = 68.67%], test : [loss = 1.370, top1 = 67.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.76 ms.
ImageNet16-120 train : [loss = 1.679, top1 = 54.98%], valid : [loss = 2.154, top1 = 44.17%], test : [loss = 2.180, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.57%], valid : [loss = 0.694, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12141/15625) 012141-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.65%], valid : [loss = 0.641, top1 = 78.43%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10        train : [loss = 0.497, top1 = 82.68%], test  : [loss = 0.586, top1 = 80.23%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.41 ms.
cifar100       train : [loss = 1.650, top1 = 55.15%], valid : [loss = 1.821, top1 = 51.95%], test : [loss = 1.842, top1 = 51.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.49 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.39%], valid : [loss = 3.322, top1 = 21.97%], test : [loss = 3.348, top1 = 20.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12142/15625) 012142-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.38%], valid : [loss = 0.530, top1 = 83.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10        train : [loss = 0.251, top1 = 91.44%], test  : [loss = 0.406, top1 = 86.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.71 ms.
cifar100       train : [loss = 1.275, top1 = 63.99%], valid : [loss = 1.579, top1 = 57.39%], test : [loss = 1.573, top1 = 57.45%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.865, top1 = 29.50%], valid : [loss = 2.858, top1 = 29.78%], test : [loss = 2.927, top1 = 28.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 64.92%], valid : [loss = 1.016, top1 = 64.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12143/15625) 012143-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.543, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.356, top1 = 92.97%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.25 ms.
cifar100       train : [loss = 0.047, top1 = 99.54%], valid : [loss = 1.394, top1 = 69.32%], test : [loss = 1.409, top1 = 69.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 1.740, top1 = 53.60%], valid : [loss = 2.364, top1 = 40.68%], test : [loss = 2.384, top1 = 41.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.73%], valid : [loss = 0.677, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12144/15625) 012144-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.90%], valid : [loss = 0.461, top1 = 86.62%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.49 ms.
cifar10        train : [loss = 0.123, top1 = 96.15%], test  : [loss = 0.342, top1 = 89.10%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.80 ms.
cifar100       train : [loss = 0.734, top1 = 79.44%], valid : [loss = 1.269, top1 = 65.03%], test : [loss = 1.259, top1 = 64.85%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 2.483, top1 = 37.05%], valid : [loss = 2.586, top1 = 35.03%], test : [loss = 2.596, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12145/15625) 012145-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.21 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.82%], valid : [loss = 0.466, top1 = 86.09%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.62 ms.
cifar10        train : [loss = 0.143, top1 = 95.37%], test  : [loss = 0.340, top1 = 89.10%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.37 ms.
cifar100       train : [loss = 0.973, top1 = 72.23%], valid : [loss = 1.357, top1 = 62.58%], test : [loss = 1.352, top1 = 62.17%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.25 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.48%], valid : [loss = 2.651, top1 = 33.75%], test : [loss = 2.671, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.66%], valid : [loss = 0.771, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12146/15625) 012146-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.13%], valid : [loss = 0.564, top1 = 86.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.064, top1 = 97.94%], test  : [loss = 0.366, top1 = 90.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.651, top1 = 80.83%], valid : [loss = 1.318, top1 = 64.44%], test : [loss = 1.319, top1 = 64.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.33%], valid : [loss = 2.523, top1 = 36.22%], test : [loss = 2.523, top1 = 35.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12147/15625) 012147-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.55%], valid : [loss = 0.857, top1 = 75.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.67 ms.
cifar10        train : [loss = 0.309, top1 = 89.23%], test  : [loss = 0.627, top1 = 80.76%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.74 ms.
cifar100       train : [loss = 1.351, top1 = 62.09%], valid : [loss = 1.939, top1 = 49.53%], test : [loss = 1.931, top1 = 49.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 3.470, top1 = 17.85%], valid : [loss = 3.505, top1 = 18.07%], test : [loss = 3.509, top1 = 17.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.244, top1 = 54.64%], valid : [loss = 1.281, top1 = 53.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12148/15625) 012148-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.499, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.98 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.319, top1 = 92.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.39 ms.
cifar100       train : [loss = 0.171, top1 = 96.19%], valid : [loss = 1.302, top1 = 68.27%], test : [loss = 1.318, top1 = 68.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.93 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.89%], valid : [loss = 2.243, top1 = 42.42%], test : [loss = 2.253, top1 = 43.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.82%], valid : [loss = 0.723, top1 = 75.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12149/15625) 012149-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.552, top1 = 88.03%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.38 ms.
cifar10        train : [loss = 0.021, top1 = 99.41%], test  : [loss = 0.364, top1 = 91.47%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.40 ms.
cifar100       train : [loss = 0.256, top1 = 93.03%], valid : [loss = 1.358, top1 = 67.25%], test : [loss = 1.388, top1 = 66.82%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 44.99%], valid : [loss = 2.390, top1 = 39.37%], test : [loss = 2.422, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.20%], valid : [loss = 0.950, top1 = 66.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12150/15625) 012150-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12151/15625) 012151-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.67 ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.62%], valid : [loss = 0.777, top1 = 73.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.52 ms.
cifar10        train : [loss = 0.584, top1 = 79.68%], test  : [loss = 0.646, top1 = 77.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.55 ms.
cifar100       train : [loss = 2.022, top1 = 45.58%], valid : [loss = 2.172, top1 = 42.35%], test : [loss = 2.156, top1 = 43.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.40%], valid : [loss = 3.230, top1 = 22.71%], test : [loss = 3.261, top1 = 22.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.280, top1 = 53.56%], valid : [loss = 1.322, top1 = 52.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12152/15625) 012152-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.376, top1 = 86.79%], valid : [loss = 0.618, top1 = 79.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.302, top1 = 89.66%], test  : [loss = 0.442, top1 = 85.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.81 ms.
cifar100       train : [loss = 1.520, top1 = 57.47%], valid : [loss = 1.748, top1 = 53.30%], test : [loss = 1.737, top1 = 52.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.04%], valid : [loss = 3.045, top1 = 26.27%], test : [loss = 3.086, top1 = 25.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.019, top1 = 63.23%], valid : [loss = 1.071, top1 = 61.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12153/15625) 012153-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.39%], valid : [loss = 0.662, top1 = 77.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.514, top1 = 82.19%], test  : [loss = 0.587, top1 = 80.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.00 ms.
cifar100       train : [loss = 1.687, top1 = 54.21%], valid : [loss = 1.858, top1 = 50.59%], test : [loss = 1.864, top1 = 50.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.31%], valid : [loss = 3.307, top1 = 21.96%], test : [loss = 3.337, top1 = 21.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12154/15625) 012154-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.28%], valid : [loss = 0.544, top1 = 87.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.35 ms.
cifar10        train : [loss = 0.056, top1 = 98.27%], test  : [loss = 0.359, top1 = 90.22%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=19.07 ms.
cifar100       train : [loss = 0.642, top1 = 81.14%], valid : [loss = 1.303, top1 = 64.88%], test : [loss = 1.288, top1 = 65.24%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.71%], valid : [loss = 2.490, top1 = 36.73%], test : [loss = 2.538, top1 = 35.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.76%], valid : [loss = 0.727, top1 = 74.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12155/15625) 012155-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.522, top1 = 89.40%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.40 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.308, top1 = 92.75%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.16 ms.
cifar100       train : [loss = 0.216, top1 = 94.59%], valid : [loss = 1.265, top1 = 68.60%], test : [loss = 1.274, top1 = 68.93%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 49.86%], valid : [loss = 2.211, top1 = 43.05%], test : [loss = 2.233, top1 = 42.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.90%], valid : [loss = 0.715, top1 = 75.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12156/15625) 012156-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=23.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.489, top1 = 90.27%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=23.18 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.316, top1 = 93.27%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=22.86 ms.
cifar100       train : [loss = 0.098, top1 = 98.08%], valid : [loss = 1.311, top1 = 69.65%], test : [loss = 1.333, top1 = 69.35%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=22.30 ms.
ImageNet16-120 train : [loss = 1.557, top1 = 57.91%], valid : [loss = 2.114, top1 = 45.20%], test : [loss = 2.112, top1 = 46.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.11%], valid : [loss = 0.657, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12157/15625) 012157-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.63%], valid : [loss = 0.660, top1 = 83.86%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.40 ms.
cifar10        train : [loss = 0.070, top1 = 97.79%], test  : [loss = 0.412, top1 = 88.66%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.50 ms.
cifar100       train : [loss = 0.778, top1 = 77.20%], valid : [loss = 1.445, top1 = 61.85%], test : [loss = 1.444, top1 = 61.65%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.69%], valid : [loss = 2.689, top1 = 32.40%], test : [loss = 2.695, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.60%], valid : [loss = 0.910, top1 = 67.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12158/15625) 012158-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 100.00%], valid : [loss = 0.406, top1 = 90.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.268, top1 = 93.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.23 ms.
cifar100       train : [loss = 0.089, top1 = 98.55%], valid : [loss = 1.286, top1 = 69.67%], test : [loss = 1.286, top1 = 70.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 1.623, top1 = 56.30%], valid : [loss = 2.191, top1 = 44.60%], test : [loss = 2.231, top1 = 44.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.95%], valid : [loss = 0.511, top1 = 82.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12159/15625) 012159-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.554, top1 = 87.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.402, top1 = 90.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.13 ms.
cifar100       train : [loss = 0.392, top1 = 88.98%], valid : [loss = 1.376, top1 = 65.44%], test : [loss = 1.392, top1 = 65.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.04%], valid : [loss = 2.491, top1 = 37.03%], test : [loss = 2.524, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.67%], valid : [loss = 0.790, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12160/15625) 012160-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.84 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.53%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.327, top1 = 93.08%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.97 ms.
cifar100       train : [loss = 0.088, top1 = 98.39%], valid : [loss = 1.327, top1 = 70.08%], test : [loss = 1.330, top1 = 69.75%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.45%], valid : [loss = 2.356, top1 = 40.02%], test : [loss = 2.357, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.06%], valid : [loss = 0.903, top1 = 68.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12161/15625) 012161-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.483, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.313, top1 = 92.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.30 ms.
cifar100       train : [loss = 0.229, top1 = 94.39%], valid : [loss = 1.264, top1 = 68.39%], test : [loss = 1.271, top1 = 68.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.51%], valid : [loss = 2.273, top1 = 41.55%], test : [loss = 2.279, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12162/15625) 012162-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.603, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.397, top1 = 91.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.204, top1 = 95.26%], valid : [loss = 1.422, top1 = 67.20%], test : [loss = 1.413, top1 = 66.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.36%], valid : [loss = 2.482, top1 = 38.18%], test : [loss = 2.508, top1 = 37.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12163/15625) 012163-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.37%], valid : [loss = 0.568, top1 = 86.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.06 ms.
cifar10        train : [loss = 0.106, top1 = 96.52%], test  : [loss = 0.389, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.24 ms.
cifar100       train : [loss = 0.811, top1 = 76.19%], valid : [loss = 1.384, top1 = 62.96%], test : [loss = 1.400, top1 = 62.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.40%], valid : [loss = 2.767, top1 = 31.77%], test : [loss = 2.797, top1 = 31.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.86%], valid : [loss = 0.712, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12164/15625) 012164-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.518, top1 = 89.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.313, top1 = 92.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.150, top1 = 96.89%], valid : [loss = 1.268, top1 = 69.59%], test : [loss = 1.270, top1 = 69.39%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.57%], valid : [loss = 2.292, top1 = 41.27%], test : [loss = 2.306, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12165/15625) 012165-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.44 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.588, top1 = 87.84%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.88 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.375, top1 = 91.72%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.53 ms.
cifar100       train : [loss = 0.150, top1 = 96.82%], valid : [loss = 1.514, top1 = 66.26%], test : [loss = 1.509, top1 = 66.50%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 1.942, top1 = 48.93%], valid : [loss = 2.432, top1 = 39.57%], test : [loss = 2.425, top1 = 39.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.65%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12166/15625) 012166-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.209, top1 = 93.01%], valid : [loss = 0.555, top1 = 83.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.197, top1 = 93.36%], test  : [loss = 0.404, top1 = 87.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 1.253, top1 = 64.36%], valid : [loss = 1.549, top1 = 57.87%], test : [loss = 1.535, top1 = 57.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.702, top1 = 32.56%], valid : [loss = 2.717, top1 = 31.90%], test : [loss = 2.775, top1 = 30.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12167/15625) 012167-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.84%], valid : [loss = 0.509, top1 = 86.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.86 ms.
cifar10        train : [loss = 0.070, top1 = 97.92%], test  : [loss = 0.344, top1 = 90.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.39 ms.
cifar100       train : [loss = 0.640, top1 = 81.43%], valid : [loss = 1.293, top1 = 65.53%], test : [loss = 1.290, top1 = 65.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.54%], valid : [loss = 2.495, top1 = 36.90%], test : [loss = 2.545, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.66%], valid : [loss = 0.853, top1 = 70.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12168/15625) 012168-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.44%], valid : [loss = 0.644, top1 = 85.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.32 ms.
cifar10        train : [loss = 0.050, top1 = 98.46%], test  : [loss = 0.436, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.44 ms.
cifar100       train : [loss = 0.611, top1 = 82.00%], valid : [loss = 1.445, top1 = 62.86%], test : [loss = 1.418, top1 = 63.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.445, top1 = 37.88%], valid : [loss = 2.577, top1 = 35.68%], test : [loss = 2.607, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.777, top1 = 72.06%], valid : [loss = 0.848, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12169/15625) 012169-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.33%], valid : [loss = 0.699, top1 = 84.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.27 ms.
cifar10        train : [loss = 0.052, top1 = 98.47%], test  : [loss = 0.449, top1 = 88.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.611, top1 = 82.09%], valid : [loss = 1.490, top1 = 62.11%], test : [loss = 1.468, top1 = 62.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.70%], valid : [loss = 2.801, top1 = 30.35%], test : [loss = 2.872, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.81%], valid : [loss = 0.897, top1 = 68.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12170/15625) 012170-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.319, top1 = 91.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.89 ms.
cifar100       train : [loss = 0.309, top1 = 91.72%], valid : [loss = 1.316, top1 = 66.79%], test : [loss = 1.296, top1 = 67.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.028, top1 = 46.93%], valid : [loss = 2.334, top1 = 40.49%], test : [loss = 2.384, top1 = 40.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.62%], valid : [loss = 0.568, top1 = 80.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12171/15625) 012171-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.40%], valid : [loss = 0.464, top1 = 86.16%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.15 ms.
cifar10        train : [loss = 0.166, top1 = 94.46%], test  : [loss = 0.344, top1 = 88.69%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.38 ms.
cifar100       train : [loss = 0.995, top1 = 71.71%], valid : [loss = 1.328, top1 = 63.32%], test : [loss = 1.345, top1 = 62.18%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.76%], valid : [loss = 2.686, top1 = 33.77%], test : [loss = 2.710, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12172/15625) 012172-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.229, top1 = 92.32%], valid : [loss = 0.532, top1 = 83.59%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.240, top1 = 91.71%], test  : [loss = 0.412, top1 = 86.62%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.50 ms.
cifar100       train : [loss = 1.325, top1 = 62.36%], valid : [loss = 1.581, top1 = 56.60%], test : [loss = 1.586, top1 = 56.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.22 ms.
ImageNet16-120 train : [loss = 2.769, top1 = 31.25%], valid : [loss = 2.794, top1 = 30.93%], test : [loss = 2.839, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.19%], valid : [loss = 0.985, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12173/15625) 012173-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.484, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.15 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.322, top1 = 92.40%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.46 ms.
cifar100       train : [loss = 0.164, top1 = 96.43%], valid : [loss = 1.300, top1 = 68.42%], test : [loss = 1.316, top1 = 68.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.59 ms.
ImageNet16-120 train : [loss = 1.802, top1 = 52.11%], valid : [loss = 2.220, top1 = 42.71%], test : [loss = 2.239, top1 = 42.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.98%], valid : [loss = 0.609, top1 = 79.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12174/15625) 012174-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.35%], valid : [loss = 0.602, top1 = 85.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.068, top1 = 97.99%], test  : [loss = 0.411, top1 = 88.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.77 ms.
cifar100       train : [loss = 0.700, top1 = 79.53%], valid : [loss = 1.369, top1 = 63.53%], test : [loss = 1.359, top1 = 63.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.97%], valid : [loss = 2.668, top1 = 33.32%], test : [loss = 2.698, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.95%], valid : [loss = 0.777, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12175/15625) 012175-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.428, top1 = 90.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.10 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.294, top1 = 93.60%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.16 ms.
cifar100       train : [loss = 0.086, top1 = 98.54%], valid : [loss = 1.362, top1 = 70.04%], test : [loss = 1.331, top1 = 69.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.53%], valid : [loss = 2.257, top1 = 43.07%], test : [loss = 2.239, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.455, top1 = 84.22%], valid : [loss = 0.568, top1 = 80.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12176/15625) 012176-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.82%], valid : [loss = 0.526, top1 = 84.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10        train : [loss = 0.175, top1 = 94.06%], test  : [loss = 0.386, top1 = 87.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 1.192, top1 = 66.06%], valid : [loss = 1.512, top1 = 58.86%], test : [loss = 1.512, top1 = 58.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.07 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 33.21%], valid : [loss = 2.693, top1 = 33.03%], test : [loss = 2.774, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.09%], valid : [loss = 0.964, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12177/15625) 012177-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.80%], valid : [loss = 0.736, top1 = 80.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.183, top1 = 93.65%], test  : [loss = 0.515, top1 = 84.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.17 ms.
cifar100       train : [loss = 0.871, top1 = 74.55%], valid : [loss = 1.650, top1 = 57.28%], test : [loss = 1.674, top1 = 56.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 3.514, top1 = 16.56%], valid : [loss = 3.523, top1 = 17.03%], test : [loss = 3.504, top1 = 16.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.63%], valid : [loss = 1.283, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12178/15625) 012178-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.452, top1 = 89.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.338, top1 = 92.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.42 ms.
cifar100       train : [loss = 0.198, top1 = 95.02%], valid : [loss = 1.375, top1 = 67.28%], test : [loss = 1.353, top1 = 67.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.67%], valid : [loss = 2.330, top1 = 40.96%], test : [loss = 2.350, top1 = 41.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.82%], valid : [loss = 0.566, top1 = 80.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12179/15625) 012179-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.87%], valid : [loss = 0.578, top1 = 85.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.09 ms.
cifar10        train : [loss = 0.062, top1 = 98.26%], test  : [loss = 0.384, top1 = 89.54%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.02 ms.
cifar100       train : [loss = 0.626, top1 = 82.00%], valid : [loss = 1.363, top1 = 65.12%], test : [loss = 1.342, top1 = 64.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.427, top1 = 38.06%], valid : [loss = 2.514, top1 = 36.37%], test : [loss = 2.580, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 69.80%], valid : [loss = 0.900, top1 = 67.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12180/15625) 012180-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.517, top1 = 89.63%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.89 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.319, top1 = 93.33%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.71 ms.
cifar100       train : [loss = 0.073, top1 = 98.85%], valid : [loss = 1.379, top1 = 69.00%], test : [loss = 1.402, top1 = 68.98%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.18%], valid : [loss = 2.315, top1 = 41.53%], test : [loss = 2.356, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12181/15625) 012181-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.47 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12182/15625) 012182-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.551, top1 = 88.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.32 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.352, top1 = 92.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.44 ms.
cifar100       train : [loss = 0.130, top1 = 96.96%], valid : [loss = 1.444, top1 = 67.30%], test : [loss = 1.392, top1 = 68.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.35 ms.
ImageNet16-120 train : [loss = 2.223, top1 = 42.39%], valid : [loss = 2.427, top1 = 38.83%], test : [loss = 2.461, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.46%], valid : [loss = 0.937, top1 = 67.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12183/15625) 012183-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.85%], valid : [loss = 0.483, top1 = 86.20%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.34 ms.
cifar10        train : [loss = 0.121, top1 = 96.19%], test  : [loss = 0.343, top1 = 89.05%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.04 ms.
cifar100       train : [loss = 0.722, top1 = 79.80%], valid : [loss = 1.284, top1 = 64.42%], test : [loss = 1.281, top1 = 64.46%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.11%], valid : [loss = 2.576, top1 = 35.87%], test : [loss = 2.607, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 1.073, top1 = 61.54%], valid : [loss = 1.087, top1 = 61.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12184/15625) 012184-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.523, top1 = 89.61%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.82 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.330, top1 = 93.14%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.80 ms.
cifar100       train : [loss = 0.068, top1 = 98.96%], valid : [loss = 1.339, top1 = 69.64%], test : [loss = 1.363, top1 = 69.54%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 2.095, top1 = 45.18%], valid : [loss = 2.397, top1 = 40.20%], test : [loss = 2.426, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.34%], valid : [loss = 0.844, top1 = 69.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12185/15625) 012185-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.03 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.27%], valid : [loss = 0.530, top1 = 84.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.96 ms.
cifar10        train : [loss = 0.206, top1 = 93.04%], test  : [loss = 0.403, top1 = 87.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.17 ms.
cifar100       train : [loss = 1.275, top1 = 63.86%], valid : [loss = 1.544, top1 = 57.60%], test : [loss = 1.567, top1 = 57.02%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 31.96%], valid : [loss = 2.781, top1 = 31.07%], test : [loss = 2.805, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.38%], valid : [loss = 0.990, top1 = 65.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12186/15625) 012186-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.470, top1 = 89.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.320, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.84 ms.
cifar100       train : [loss = 0.197, top1 = 95.31%], valid : [loss = 1.365, top1 = 67.90%], test : [loss = 1.296, top1 = 70.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.86%], valid : [loss = 2.245, top1 = 42.80%], test : [loss = 2.320, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.73%], valid : [loss = 0.533, top1 = 81.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12187/15625) 012187-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.32%], valid : [loss = 0.466, top1 = 86.04%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=15.00 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.349, top1 = 88.99%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=14.15 ms.
cifar100       train : [loss = 1.011, top1 = 71.37%], valid : [loss = 1.352, top1 = 61.91%], test : [loss = 1.360, top1 = 61.78%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.68%], valid : [loss = 2.697, top1 = 32.54%], test : [loss = 2.714, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.69%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12188/15625) 012188-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.34 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.42%], valid : [loss = 0.670, top1 = 77.67%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10        train : [loss = 0.508, top1 = 82.50%], test  : [loss = 0.587, top1 = 80.13%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.60 ms.
cifar100       train : [loss = 1.683, top1 = 54.11%], valid : [loss = 1.843, top1 = 51.22%], test : [loss = 1.856, top1 = 51.14%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.24 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.36%], valid : [loss = 3.297, top1 = 22.07%], test : [loss = 3.338, top1 = 21.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12189/15625) 012189-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.473, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.308, top1 = 92.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.37 ms.
cifar100       train : [loss = 0.314, top1 = 91.57%], valid : [loss = 1.232, top1 = 68.13%], test : [loss = 1.225, top1 = 68.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.58%], valid : [loss = 2.311, top1 = 40.98%], test : [loss = 2.361, top1 = 39.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12190/15625) 012190-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.85%], valid : [loss = 0.474, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.301, top1 = 89.98%], test  : [loss = 0.398, top1 = 86.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 1.320, top1 = 63.32%], valid : [loss = 1.529, top1 = 58.34%], test : [loss = 1.518, top1 = 58.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.40%], valid : [loss = 2.908, top1 = 29.20%], test : [loss = 2.957, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12191/15625) 012191-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.597, top1 = 87.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.400, top1 = 91.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.12 ms.
cifar100       train : [loss = 0.192, top1 = 95.46%], valid : [loss = 1.501, top1 = 65.54%], test : [loss = 1.532, top1 = 65.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 2.021, top1 = 47.11%], valid : [loss = 2.406, top1 = 38.37%], test : [loss = 2.468, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.80%], valid : [loss = 0.803, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12192/15625) 012192-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.15%], valid : [loss = 0.638, top1 = 83.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.094, top1 = 96.93%], test  : [loss = 0.416, top1 = 88.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.63 ms.
cifar100       train : [loss = 0.731, top1 = 78.34%], valid : [loss = 1.512, top1 = 60.16%], test : [loss = 1.494, top1 = 62.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 3.122, top1 = 23.72%], valid : [loss = 3.117, top1 = 24.80%], test : [loss = 3.188, top1 = 22.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.002, top1 = 63.90%], valid : [loss = 1.038, top1 = 63.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12193/15625) 012193-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.554, top1 = 88.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.337, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.80 ms.
cifar100       train : [loss = 0.302, top1 = 91.75%], valid : [loss = 1.298, top1 = 67.78%], test : [loss = 1.314, top1 = 67.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.55 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.50%], valid : [loss = 2.453, top1 = 37.83%], test : [loss = 2.435, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12194/15625) 012194-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.474, top1 = 89.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.314, top1 = 92.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.323, top1 = 91.37%], valid : [loss = 1.239, top1 = 68.17%], test : [loss = 1.223, top1 = 68.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.71%], valid : [loss = 2.318, top1 = 40.37%], test : [loss = 2.345, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12195/15625) 012195-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.20%], valid : [loss = 0.578, top1 = 85.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.45 ms.
cifar10        train : [loss = 0.107, top1 = 96.49%], test  : [loss = 0.400, top1 = 88.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.55 ms.
cifar100       train : [loss = 0.822, top1 = 75.90%], valid : [loss = 1.407, top1 = 62.47%], test : [loss = 1.410, top1 = 62.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 32.99%], valid : [loss = 2.769, top1 = 31.58%], test : [loss = 2.809, top1 = 30.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12196/15625) 012196-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.515, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.06 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.354, top1 = 91.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.69 ms.
cifar100       train : [loss = 0.327, top1 = 90.99%], valid : [loss = 1.332, top1 = 66.16%], test : [loss = 1.337, top1 = 66.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.22%], valid : [loss = 2.390, top1 = 39.50%], test : [loss = 2.428, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.43%], valid : [loss = 0.802, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12197/15625) 012197-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.77 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.305, top1 = 93.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.46 ms.
cifar100       train : [loss = 0.153, top1 = 96.84%], valid : [loss = 1.290, top1 = 68.24%], test : [loss = 1.330, top1 = 68.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.28 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.59%], valid : [loss = 2.306, top1 = 41.07%], test : [loss = 2.286, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12198/15625) 012198-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.521, top1 = 89.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.310, top1 = 92.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.232, top1 = 93.90%], valid : [loss = 1.275, top1 = 68.66%], test : [loss = 1.270, top1 = 69.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.29%], valid : [loss = 2.226, top1 = 42.50%], test : [loss = 2.248, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.44%], valid : [loss = 0.742, top1 = 74.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12199/15625) 012199-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.88%], valid : [loss = 0.507, top1 = 85.93%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10        train : [loss = 0.166, top1 = 94.42%], test  : [loss = 0.360, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.56 ms.
cifar100       train : [loss = 1.039, top1 = 70.24%], valid : [loss = 1.403, top1 = 61.36%], test : [loss = 1.385, top1 = 61.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.78%], valid : [loss = 2.706, top1 = 33.03%], test : [loss = 2.722, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.64%], valid : [loss = 1.003, top1 = 64.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12200/15625) 012200-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.32%], valid : [loss = 0.611, top1 = 85.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.070, top1 = 97.89%], test  : [loss = 0.408, top1 = 88.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.45 ms.
cifar100       train : [loss = 0.721, top1 = 78.90%], valid : [loss = 1.398, top1 = 62.98%], test : [loss = 1.358, top1 = 63.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.44 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.98%], valid : [loss = 2.658, top1 = 33.78%], test : [loss = 2.689, top1 = 33.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12201/15625) 012201-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.464, top1 = 90.48%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=18.96 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.299, top1 = 93.59%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.60 ms.
cifar100       train : [loss = 0.054, top1 = 99.35%], valid : [loss = 1.294, top1 = 70.62%], test : [loss = 1.303, top1 = 70.82%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 1.583, top1 = 57.32%], valid : [loss = 2.196, top1 = 44.33%], test : [loss = 2.169, top1 = 45.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.61%], valid : [loss = 0.615, top1 = 79.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12202/15625) 012202-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.35%], valid : [loss = 0.609, top1 = 85.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.075, top1 = 97.69%], test  : [loss = 0.415, top1 = 88.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 0.719, top1 = 79.11%], valid : [loss = 1.412, top1 = 63.10%], test : [loss = 1.358, top1 = 63.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 36.00%], valid : [loss = 2.646, top1 = 33.53%], test : [loss = 2.688, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.46%], valid : [loss = 0.806, top1 = 72.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12203/15625) 012203-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.35%], valid : [loss = 0.638, top1 = 85.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.14 ms.
cifar10        train : [loss = 0.041, top1 = 98.81%], test  : [loss = 0.412, top1 = 89.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.593, top1 = 82.52%], valid : [loss = 1.447, top1 = 62.60%], test : [loss = 1.416, top1 = 64.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.480, top1 = 37.10%], valid : [loss = 2.639, top1 = 33.83%], test : [loss = 2.648, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.71%], valid : [loss = 0.924, top1 = 67.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12204/15625) 012204-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=13.92 ms.
cifar10-valid  train : [loss = 0.300, top1 = 89.77%], valid : [loss = 0.496, top1 = 84.06%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=14.46 ms.
cifar10        train : [loss = 0.268, top1 = 90.95%], test  : [loss = 0.376, top1 = 87.51%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=13.62 ms.
cifar100       train : [loss = 1.299, top1 = 63.63%], valid : [loss = 1.506, top1 = 58.23%], test : [loss = 1.497, top1 = 58.00%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 2.815, top1 = 30.64%], valid : [loss = 2.818, top1 = 30.36%], test : [loss = 2.846, top1 = 29.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 63.11%], valid : [loss = 1.066, top1 = 62.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12205/15625) 012205-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.85%], valid : [loss = 0.535, top1 = 88.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.348, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.41 ms.
cifar100       train : [loss = 0.248, top1 = 93.22%], valid : [loss = 1.305, top1 = 67.22%], test : [loss = 1.315, top1 = 67.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.48 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 43.99%], valid : [loss = 2.414, top1 = 39.10%], test : [loss = 2.383, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12206/15625) 012206-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.12%], valid : [loss = 0.644, top1 = 83.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.089, top1 = 97.06%], test  : [loss = 0.417, top1 = 88.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.29 ms.
cifar100       train : [loss = 0.733, top1 = 78.33%], valid : [loss = 1.597, top1 = 58.62%], test : [loss = 1.616, top1 = 59.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 3.202, top1 = 21.94%], valid : [loss = 3.211, top1 = 21.57%], test : [loss = 3.235, top1 = 21.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.075, top1 = 60.74%], valid : [loss = 1.110, top1 = 59.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12207/15625) 012207-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.93%], valid : [loss = 0.450, top1 = 86.61%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.36 ms.
cifar10        train : [loss = 0.151, top1 = 95.11%], test  : [loss = 0.339, top1 = 88.90%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.61 ms.
cifar100       train : [loss = 0.973, top1 = 72.26%], valid : [loss = 1.336, top1 = 62.64%], test : [loss = 1.329, top1 = 62.28%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.54%], valid : [loss = 2.648, top1 = 33.57%], test : [loss = 2.682, top1 = 32.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.51%], valid : [loss = 0.738, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12208/15625) 012208-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.15%], valid : [loss = 0.645, top1 = 78.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10        train : [loss = 0.515, top1 = 82.27%], test  : [loss = 0.596, top1 = 79.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.35 ms.
cifar100       train : [loss = 1.686, top1 = 54.35%], valid : [loss = 1.845, top1 = 50.77%], test : [loss = 1.870, top1 = 50.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.41 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.26%], valid : [loss = 3.320, top1 = 21.28%], test : [loss = 3.341, top1 = 21.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12209/15625) 012209-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.99%], valid : [loss = 0.977, top1 = 75.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.42 ms.
cifar10        train : [loss = 0.238, top1 = 91.88%], test  : [loss = 0.620, top1 = 81.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 1.192, top1 = 66.09%], valid : [loss = 1.784, top1 = 53.74%], test : [loss = 1.812, top1 = 53.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 3.230, top1 = 22.71%], valid : [loss = 3.335, top1 = 22.60%], test : [loss = 3.363, top1 = 20.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.68%], valid : [loss = 1.091, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12210/15625) 012210-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.82%], valid : [loss = 0.729, top1 = 74.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.87 ms.
cifar10        train : [loss = 0.569, top1 = 80.32%], test  : [loss = 0.624, top1 = 78.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 2.082, top1 = 44.32%], valid : [loss = 2.213, top1 = 41.69%], test : [loss = 2.197, top1 = 42.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 3.294, top1 = 21.38%], valid : [loss = 3.275, top1 = 22.17%], test : [loss = 3.313, top1 = 21.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.92%], valid : [loss = 1.350, top1 = 51.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12211/15625) 012211-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.481, top1 = 89.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.323, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.32 ms.
cifar100       train : [loss = 0.246, top1 = 93.80%], valid : [loss = 1.258, top1 = 68.48%], test : [loss = 1.260, top1 = 68.33%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.96%], valid : [loss = 2.225, top1 = 42.82%], test : [loss = 2.257, top1 = 42.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.32%], valid : [loss = 0.585, top1 = 79.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12212/15625) 012212-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.519, top1 = 89.61%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.94 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.336, top1 = 92.86%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.31 ms.
cifar100       train : [loss = 0.086, top1 = 98.49%], valid : [loss = 1.280, top1 = 70.54%], test : [loss = 1.303, top1 = 70.54%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=24.22 ms.
ImageNet16-120 train : [loss = 1.631, top1 = 56.17%], valid : [loss = 2.168, top1 = 44.67%], test : [loss = 2.201, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.03%], valid : [loss = 0.811, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12213/15625) 012213-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.473, top1 = 89.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.316, top1 = 91.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.61 ms.
cifar100       train : [loss = 0.312, top1 = 91.80%], valid : [loss = 1.240, top1 = 67.76%], test : [loss = 1.234, top1 = 68.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.71%], valid : [loss = 2.334, top1 = 39.77%], test : [loss = 2.313, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.17%], valid : [loss = 0.600, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12214/15625) 012214-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.529, top1 = 88.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.26 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.331, top1 = 91.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.69 ms.
cifar100       train : [loss = 0.342, top1 = 90.73%], valid : [loss = 1.301, top1 = 66.54%], test : [loss = 1.311, top1 = 66.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.36%], valid : [loss = 2.398, top1 = 39.03%], test : [loss = 2.410, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.66%], valid : [loss = 0.633, top1 = 78.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12215/15625) 012215-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.571, top1 = 87.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.394, top1 = 90.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 0.385, top1 = 89.08%], valid : [loss = 1.398, top1 = 65.50%], test : [loss = 1.376, top1 = 66.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.88%], valid : [loss = 2.494, top1 = 35.20%], test : [loss = 2.556, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12216/15625) 012216-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.527, top1 = 88.49%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.28 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.329, top1 = 92.08%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.32 ms.
cifar100       train : [loss = 0.303, top1 = 91.89%], valid : [loss = 1.257, top1 = 67.72%], test : [loss = 1.270, top1 = 68.52%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.21%], valid : [loss = 2.339, top1 = 39.77%], test : [loss = 2.354, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.36%], valid : [loss = 0.812, top1 = 71.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12217/15625) 012217-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.610, top1 = 87.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.424, top1 = 90.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.92 ms.
cifar100       train : [loss = 0.217, top1 = 94.57%], valid : [loss = 1.526, top1 = 65.04%], test : [loss = 1.520, top1 = 65.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.30%], valid : [loss = 2.535, top1 = 36.80%], test : [loss = 2.534, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.37%], valid : [loss = 0.747, top1 = 73.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12218/15625) 012218-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.538, top1 = 89.20%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.344, top1 = 92.98%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.20 ms.
cifar100       train : [loss = 0.034, top1 = 99.68%], valid : [loss = 1.403, top1 = 69.86%], test : [loss = 1.404, top1 = 69.64%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.29 ms.
ImageNet16-120 train : [loss = 1.583, top1 = 57.22%], valid : [loss = 2.388, top1 = 41.00%], test : [loss = 2.436, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.28%], valid : [loss = 0.696, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12219/15625) 012219-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.463, top1 = 89.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.312, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.321, top1 = 91.40%], valid : [loss = 1.246, top1 = 67.92%], test : [loss = 1.231, top1 = 68.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.64%], valid : [loss = 2.324, top1 = 40.93%], test : [loss = 2.322, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12220/15625) 012220-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.98%], valid : [loss = 0.476, top1 = 89.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.80 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.325, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.91 ms.
cifar100       train : [loss = 0.214, top1 = 94.93%], valid : [loss = 1.254, top1 = 68.32%], test : [loss = 1.244, top1 = 69.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.73%], valid : [loss = 2.263, top1 = 41.80%], test : [loss = 2.266, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.88%], valid : [loss = 0.603, top1 = 79.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12221/15625) 012221-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.52%], valid : [loss = 0.748, top1 = 82.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10        train : [loss = 0.089, top1 = 97.13%], test  : [loss = 0.488, top1 = 86.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 0.800, top1 = 76.55%], valid : [loss = 1.561, top1 = 60.24%], test : [loss = 1.536, top1 = 59.92%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.79 ms.
ImageNet16-120 train : [loss = 2.877, top1 = 29.15%], valid : [loss = 3.000, top1 = 27.17%], test : [loss = 3.073, top1 = 26.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.86%], valid : [loss = 0.879, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12222/15625) 012222-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.555, top1 = 88.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.85 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.382, top1 = 92.05%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.23 ms.
cifar100       train : [loss = 0.109, top1 = 98.05%], valid : [loss = 1.507, top1 = 66.80%], test : [loss = 1.505, top1 = 67.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.70%], valid : [loss = 2.438, top1 = 38.23%], test : [loss = 2.458, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.68%], valid : [loss = 0.748, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12223/15625) 012223-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.484, top1 = 90.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.309, top1 = 93.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.111, top1 = 97.83%], valid : [loss = 1.275, top1 = 70.29%], test : [loss = 1.294, top1 = 69.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.27 ms.
ImageNet16-120 train : [loss = 1.728, top1 = 53.88%], valid : [loss = 2.184, top1 = 44.32%], test : [loss = 2.195, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12224/15625) 012224-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.93%], valid : [loss = 1.096, top1 = 63.42%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10        train : [loss = 0.793, top1 = 72.12%], test  : [loss = 0.908, top1 = 68.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.10 ms.
cifar100       train : [loss = 2.134, top1 = 43.89%], valid : [loss = 2.400, top1 = 39.20%], test : [loss = 2.393, top1 = 39.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 3.771, top1 = 13.80%], valid : [loss = 3.836, top1 = 13.33%], test : [loss = 3.842, top1 = 13.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.359, top1 = 50.69%], valid : [loss = 1.401, top1 = 49.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12225/15625) 012225-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.32%], valid : [loss = 0.628, top1 = 85.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10        train : [loss = 0.064, top1 = 98.03%], test  : [loss = 0.419, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.46 ms.
cifar100       train : [loss = 0.679, top1 = 80.24%], valid : [loss = 1.398, top1 = 63.35%], test : [loss = 1.362, top1 = 63.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.516, top1 = 36.37%], valid : [loss = 2.645, top1 = 33.46%], test : [loss = 2.678, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.05%], valid : [loss = 0.799, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12226/15625) 012226-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.80%], valid : [loss = 0.614, top1 = 84.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10        train : [loss = 0.094, top1 = 96.85%], test  : [loss = 0.425, top1 = 88.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 0.692, top1 = 79.46%], valid : [loss = 1.518, top1 = 60.30%], test : [loss = 1.515, top1 = 61.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 3.198, top1 = 22.22%], valid : [loss = 3.203, top1 = 22.13%], test : [loss = 3.243, top1 = 22.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12227/15625) 012227-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.65%], valid : [loss = 0.507, top1 = 86.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.96 ms.
cifar10        train : [loss = 0.096, top1 = 96.90%], test  : [loss = 0.357, top1 = 89.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.76 ms.
cifar100       train : [loss = 0.785, top1 = 77.27%], valid : [loss = 1.363, top1 = 63.48%], test : [loss = 1.339, top1 = 64.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.52%], valid : [loss = 2.653, top1 = 33.53%], test : [loss = 2.680, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.32%], valid : [loss = 0.668, top1 = 77.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12228/15625) 012228-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.01%], valid : [loss = 0.571, top1 = 86.65%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10        train : [loss = 0.055, top1 = 98.17%], test  : [loss = 0.370, top1 = 90.31%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.66 ms.
cifar100       train : [loss = 0.600, top1 = 82.20%], valid : [loss = 1.338, top1 = 64.38%], test : [loss = 1.313, top1 = 65.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.79%], valid : [loss = 2.531, top1 = 34.70%], test : [loss = 2.566, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.15%], valid : [loss = 0.929, top1 = 67.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12229/15625) 012229-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.465, top1 = 89.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.296, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.65 ms.
cifar100       train : [loss = 0.322, top1 = 91.31%], valid : [loss = 1.228, top1 = 67.94%], test : [loss = 1.263, top1 = 68.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.55%], valid : [loss = 2.334, top1 = 41.03%], test : [loss = 2.314, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.55%], valid : [loss = 0.648, top1 = 77.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12230/15625) 012230-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.36%], valid : [loss = 0.951, top1 = 75.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.42 ms.
cifar10        train : [loss = 0.227, top1 = 92.18%], test  : [loss = 0.603, top1 = 81.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.64 ms.
cifar100       train : [loss = 1.178, top1 = 66.58%], valid : [loss = 1.811, top1 = 52.76%], test : [loss = 1.783, top1 = 53.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 3.240, top1 = 22.55%], valid : [loss = 3.346, top1 = 21.30%], test : [loss = 3.396, top1 = 19.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12231/15625) 012231-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.455, top1 = 89.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.313, top1 = 91.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.56 ms.
cifar100       train : [loss = 0.329, top1 = 91.12%], valid : [loss = 1.318, top1 = 66.70%], test : [loss = 1.318, top1 = 67.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.68 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.31%], valid : [loss = 2.376, top1 = 40.23%], test : [loss = 2.399, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12232/15625) 012232-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.581, top1 = 87.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.44 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.385, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.90 ms.
cifar100       train : [loss = 0.385, top1 = 89.07%], valid : [loss = 1.384, top1 = 66.26%], test : [loss = 1.370, top1 = 65.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.76%], valid : [loss = 2.530, top1 = 35.80%], test : [loss = 2.540, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.20%], valid : [loss = 0.783, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12233/15625) 012233-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.530, top1 = 88.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.025, top1 = 99.27%], test  : [loss = 0.336, top1 = 91.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.41 ms.
cifar100       train : [loss = 0.424, top1 = 87.98%], valid : [loss = 1.282, top1 = 66.96%], test : [loss = 1.278, top1 = 66.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.15%], valid : [loss = 2.406, top1 = 38.83%], test : [loss = 2.439, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.86%], valid : [loss = 0.850, top1 = 70.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12234/15625) 012234-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.498, top1 = 88.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.333, top1 = 90.94%], valid : [loss = 1.223, top1 = 68.36%], test : [loss = 1.303, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.75%], valid : [loss = 2.311, top1 = 40.70%], test : [loss = 2.317, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12235/15625) 012235-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.64%], valid : [loss = 0.874, top1 = 71.10%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 0.558, top1 = 80.42%], test  : [loss = 0.728, top1 = 75.80%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.72 ms.
cifar100       train : [loss = 1.785, top1 = 52.05%], valid : [loss = 2.048, top1 = 46.80%], test : [loss = 2.073, top1 = 47.20%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 16.61%], valid : [loss = 3.645, top1 = 16.57%], test : [loss = 3.673, top1 = 15.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12236/15625) 012236-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.65 ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.37%], valid : [loss = 0.647, top1 = 78.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.37 ms.
cifar10        train : [loss = 0.512, top1 = 82.20%], test  : [loss = 0.589, top1 = 80.04%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.27 ms.
cifar100       train : [loss = 1.692, top1 = 54.05%], valid : [loss = 1.848, top1 = 50.43%], test : [loss = 1.857, top1 = 50.96%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.21 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.39%], valid : [loss = 3.314, top1 = 21.59%], test : [loss = 3.341, top1 = 21.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12237/15625) 012237-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.287, top1 = 90.30%], valid : [loss = 0.565, top1 = 82.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.61 ms.
cifar10        train : [loss = 0.261, top1 = 91.08%], test  : [loss = 0.422, top1 = 86.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.58 ms.
cifar100       train : [loss = 1.377, top1 = 61.14%], valid : [loss = 1.639, top1 = 56.16%], test : [loss = 1.613, top1 = 55.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.67 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.20%], valid : [loss = 2.922, top1 = 28.70%], test : [loss = 2.966, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 64.77%], valid : [loss = 1.021, top1 = 63.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12238/15625) 012238-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.512, top1 = 88.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.334, top1 = 91.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.45 ms.
cifar100       train : [loss = 0.361, top1 = 90.05%], valid : [loss = 1.279, top1 = 66.40%], test : [loss = 1.271, top1 = 67.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.49%], valid : [loss = 2.396, top1 = 38.73%], test : [loss = 2.413, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12239/15625) 012239-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.11 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.325, top1 = 91.27%], valid : [loss = 1.256, top1 = 67.59%], test : [loss = 1.241, top1 = 68.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.58%], valid : [loss = 2.318, top1 = 40.49%], test : [loss = 2.350, top1 = 40.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12240/15625) 012240-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.558, top1 = 89.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.352, top1 = 92.50%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=18.87 ms.
cifar100       train : [loss = 0.100, top1 = 98.21%], valid : [loss = 1.486, top1 = 67.52%], test : [loss = 1.450, top1 = 67.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.99%], valid : [loss = 2.441, top1 = 39.07%], test : [loss = 2.443, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12241/15625) 012241-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.544, top1 = 88.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.354, top1 = 91.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.02 ms.
cifar100       train : [loss = 0.297, top1 = 91.97%], valid : [loss = 1.280, top1 = 67.58%], test : [loss = 1.281, top1 = 68.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 43.98%], valid : [loss = 2.416, top1 = 39.10%], test : [loss = 2.420, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.92%], valid : [loss = 0.859, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12242/15625) 012242-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.540, top1 = 88.80%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.337, top1 = 92.47%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=21.88 ms.
cifar100       train : [loss = 0.084, top1 = 98.17%], valid : [loss = 1.433, top1 = 68.50%], test : [loss = 1.443, top1 = 69.44%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.52%], valid : [loss = 2.492, top1 = 36.53%], test : [loss = 2.540, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.24%], valid : [loss = 0.914, top1 = 67.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12243/15625) 012243-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.546, top1 = 88.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.335, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.300, top1 = 91.71%], valid : [loss = 1.325, top1 = 66.98%], test : [loss = 1.301, top1 = 67.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.53%], valid : [loss = 2.425, top1 = 38.47%], test : [loss = 2.448, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12244/15625) 012244-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.543, top1 = 88.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.342, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.99 ms.
cifar100       train : [loss = 0.219, top1 = 94.33%], valid : [loss = 1.326, top1 = 67.78%], test : [loss = 1.323, top1 = 67.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 1.972, top1 = 48.15%], valid : [loss = 2.272, top1 = 41.97%], test : [loss = 2.331, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.38%], valid : [loss = 0.852, top1 = 69.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12245/15625) 012245-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.554, top1 = 88.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.355, top1 = 91.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.23 ms.
cifar100       train : [loss = 0.267, top1 = 92.85%], valid : [loss = 1.321, top1 = 67.64%], test : [loss = 1.329, top1 = 68.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.68%], valid : [loss = 2.350, top1 = 40.77%], test : [loss = 2.381, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.15%], valid : [loss = 0.803, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12246/15625) 012246-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.581, top1 = 87.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.375, top1 = 91.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.65 ms.
cifar100       train : [loss = 0.375, top1 = 89.57%], valid : [loss = 1.411, top1 = 66.08%], test : [loss = 1.387, top1 = 65.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.87%], valid : [loss = 2.469, top1 = 37.67%], test : [loss = 2.503, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12247/15625) 012247-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.573, top1 = 88.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.90%], test  : [loss = 0.350, top1 = 92.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.05 ms.
cifar100       train : [loss = 0.100, top1 = 98.22%], valid : [loss = 1.418, top1 = 68.78%], test : [loss = 1.434, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.52%], valid : [loss = 2.432, top1 = 39.60%], test : [loss = 2.431, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 76.97%], valid : [loss = 0.726, top1 = 74.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12248/15625) 012248-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.466, top1 = 89.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.322, top1 = 91.35%], valid : [loss = 1.231, top1 = 68.10%], test : [loss = 1.237, top1 = 68.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.68%], valid : [loss = 2.324, top1 = 40.70%], test : [loss = 2.340, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.92%], valid : [loss = 0.617, top1 = 79.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12249/15625) 012249-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.533, top1 = 89.70%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.82 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.311, top1 = 93.13%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.34 ms.
cifar100       train : [loss = 0.121, top1 = 97.52%], valid : [loss = 1.366, top1 = 68.64%], test : [loss = 1.292, top1 = 69.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 1.680, top1 = 54.93%], valid : [loss = 2.174, top1 = 44.30%], test : [loss = 2.183, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.19%], valid : [loss = 0.579, top1 = 80.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12250/15625) 012250-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.048, top1 = 98.74%], valid : [loss = 0.635, top1 = 84.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10        train : [loss = 0.087, top1 = 97.23%], test  : [loss = 0.400, top1 = 88.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 0.770, top1 = 77.52%], valid : [loss = 1.409, top1 = 62.38%], test : [loss = 1.400, top1 = 62.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.39%], valid : [loss = 2.717, top1 = 32.50%], test : [loss = 2.732, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.60%], valid : [loss = 0.834, top1 = 70.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12251/15625) 012251-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.446, top1 = 90.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.281, top1 = 93.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.25 ms.
cifar100       train : [loss = 0.160, top1 = 96.46%], valid : [loss = 1.285, top1 = 69.06%], test : [loss = 1.313, top1 = 68.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 1.780, top1 = 52.58%], valid : [loss = 2.259, top1 = 42.87%], test : [loss = 2.242, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.432, top1 = 84.86%], valid : [loss = 0.550, top1 = 81.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12252/15625) 012252-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.496, top1 = 88.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.316, top1 = 92.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 0.321, top1 = 91.36%], valid : [loss = 1.241, top1 = 67.85%], test : [loss = 1.248, top1 = 68.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.68%], valid : [loss = 2.321, top1 = 40.60%], test : [loss = 2.343, top1 = 41.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12253/15625) 012253-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.76%], valid : [loss = 0.581, top1 = 88.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10        train : [loss = 0.052, top1 = 98.31%], test  : [loss = 0.394, top1 = 90.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.77 ms.
cifar100       train : [loss = 0.328, top1 = 90.93%], valid : [loss = 1.431, top1 = 65.02%], test : [loss = 1.424, top1 = 65.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 27.08%], valid : [loss = 3.003, top1 = 26.00%], test : [loss = 2.987, top1 = 25.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 56.70%], valid : [loss = 1.179, top1 = 56.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12254/15625) 012254-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.531, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.03 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.340, top1 = 92.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.73 ms.
cifar100       train : [loss = 0.201, top1 = 94.82%], valid : [loss = 1.320, top1 = 68.26%], test : [loss = 1.309, top1 = 69.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.79 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.41%], valid : [loss = 2.249, top1 = 41.43%], test : [loss = 2.261, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.23%], valid : [loss = 0.788, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12255/15625) 012255-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.08%], valid : [loss = 0.542, top1 = 86.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=17.01 ms.
cifar10        train : [loss = 0.104, top1 = 96.47%], test  : [loss = 0.338, top1 = 89.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.62 ms.
cifar100       train : [loss = 0.785, top1 = 76.89%], valid : [loss = 1.344, top1 = 63.38%], test : [loss = 1.333, top1 = 64.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.59%], valid : [loss = 2.596, top1 = 34.63%], test : [loss = 2.622, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.80%], valid : [loss = 0.854, top1 = 70.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12256/15625) 012256-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.95 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.494, top1 = 88.93%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.02 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.303, top1 = 92.40%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.06 ms.
cifar100       train : [loss = 0.272, top1 = 92.97%], valid : [loss = 1.225, top1 = 68.74%], test : [loss = 1.219, top1 = 69.12%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.11%], valid : [loss = 2.199, top1 = 42.67%], test : [loss = 2.247, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.38%], valid : [loss = 0.671, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12257/15625) 012257-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.95 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.493, top1 = 88.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.319, top1 = 92.14%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.01 ms.
cifar100       train : [loss = 0.332, top1 = 90.89%], valid : [loss = 1.315, top1 = 66.42%], test : [loss = 1.279, top1 = 67.64%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.77%], valid : [loss = 2.418, top1 = 38.77%], test : [loss = 2.401, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.14%], valid : [loss = 0.626, top1 = 78.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12258/15625) 012258-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.698, top1 = 85.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.81 ms.
cifar10        train : [loss = 0.021, top1 = 99.46%], test  : [loss = 0.434, top1 = 90.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.96 ms.
cifar100       train : [loss = 0.294, top1 = 92.41%], valid : [loss = 1.616, top1 = 62.08%], test : [loss = 1.606, top1 = 62.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.46%], valid : [loss = 2.533, top1 = 37.37%], test : [loss = 2.564, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.75%], valid : [loss = 0.870, top1 = 69.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12259/15625) 012259-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.335, top1 = 88.37%], valid : [loss = 0.565, top1 = 81.69%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10        train : [loss = 0.279, top1 = 90.43%], test  : [loss = 0.428, top1 = 86.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.28 ms.
cifar100       train : [loss = 1.620, top1 = 55.25%], valid : [loss = 1.843, top1 = 50.20%], test : [loss = 1.835, top1 = 50.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 2.955, top1 = 27.47%], valid : [loss = 2.974, top1 = 27.23%], test : [loss = 3.044, top1 = 26.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.031, top1 = 62.74%], valid : [loss = 1.064, top1 = 61.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12260/15625) 012260-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.36%], valid : [loss = 0.826, top1 = 72.50%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.59 ms.
cifar10        train : [loss = 0.561, top1 = 80.39%], test  : [loss = 0.715, top1 = 75.92%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.88 ms.
cifar100       train : [loss = 1.795, top1 = 51.66%], valid : [loss = 2.062, top1 = 46.60%], test : [loss = 2.067, top1 = 46.86%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 3.601, top1 = 16.62%], valid : [loss = 3.643, top1 = 15.77%], test : [loss = 3.697, top1 = 15.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.184, top1 = 57.48%], valid : [loss = 1.234, top1 = 56.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12261/15625) 012261-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.21%], valid : [loss = 0.538, top1 = 84.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.144, top1 = 95.17%], test  : [loss = 0.363, top1 = 88.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.833, top1 = 75.77%], valid : [loss = 1.421, top1 = 61.80%], test : [loss = 1.404, top1 = 62.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.54%], valid : [loss = 2.702, top1 = 32.53%], test : [loss = 2.750, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.40%], valid : [loss = 0.966, top1 = 65.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12262/15625) 012262-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.98%], valid : [loss = 0.544, top1 = 85.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.07 ms.
cifar10        train : [loss = 0.082, top1 = 97.43%], test  : [loss = 0.342, top1 = 90.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.46 ms.
cifar100       train : [loss = 0.733, top1 = 78.75%], valid : [loss = 1.355, top1 = 64.14%], test : [loss = 1.357, top1 = 63.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 2.420, top1 = 38.17%], valid : [loss = 2.542, top1 = 35.53%], test : [loss = 2.550, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.77%], valid : [loss = 0.965, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12263/15625) 012263-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.10%], valid : [loss = 0.674, top1 = 83.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10        train : [loss = 0.088, top1 = 97.13%], test  : [loss = 0.454, top1 = 87.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.88 ms.
cifar100       train : [loss = 0.631, top1 = 81.43%], valid : [loss = 1.474, top1 = 61.16%], test : [loss = 1.467, top1 = 62.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.01 ms.
ImageNet16-120 train : [loss = 2.990, top1 = 26.43%], valid : [loss = 3.031, top1 = 25.73%], test : [loss = 3.057, top1 = 25.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.37%], valid : [loss = 1.009, top1 = 64.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12264/15625) 012264-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.46%], valid : [loss = 0.554, top1 = 87.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.19 ms.
cifar10        train : [loss = 0.032, top1 = 99.05%], test  : [loss = 0.360, top1 = 91.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.25 ms.
cifar100       train : [loss = 0.538, top1 = 84.66%], valid : [loss = 1.348, top1 = 64.18%], test : [loss = 1.318, top1 = 65.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.91 ms.
ImageNet16-120 train : [loss = 2.569, top1 = 34.78%], valid : [loss = 2.655, top1 = 32.27%], test : [loss = 2.677, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 70.42%], valid : [loss = 0.871, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12265/15625) 012265-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12266/15625) 012266-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.76 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12267/15625) 012267-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.40 ms.
cifar10-valid  train : [loss = 0.102, top1 = 96.94%], valid : [loss = 0.792, top1 = 80.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10        train : [loss = 0.156, top1 = 94.73%], test  : [loss = 0.528, top1 = 84.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.40 ms.
cifar100       train : [loss = 0.895, top1 = 74.06%], valid : [loss = 1.607, top1 = 57.96%], test : [loss = 1.611, top1 = 57.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 3.007, top1 = 26.13%], valid : [loss = 3.080, top1 = 25.63%], test : [loss = 3.118, top1 = 24.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 64.74%], valid : [loss = 1.018, top1 = 63.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12268/15625) 012268-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.77%], valid : [loss = 0.479, top1 = 84.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.07 ms.
cifar10        train : [loss = 0.300, top1 = 89.92%], test  : [loss = 0.396, top1 = 86.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.39 ms.
cifar100       train : [loss = 1.338, top1 = 62.96%], valid : [loss = 1.539, top1 = 57.85%], test : [loss = 1.520, top1 = 57.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.926, top1 = 28.52%], valid : [loss = 2.910, top1 = 29.31%], test : [loss = 2.965, top1 = 27.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12269/15625) 012269-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.12%], valid : [loss = 0.451, top1 = 86.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.113, top1 = 96.53%], test  : [loss = 0.322, top1 = 89.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.36 ms.
cifar100       train : [loss = 0.855, top1 = 75.66%], valid : [loss = 1.283, top1 = 64.82%], test : [loss = 1.259, top1 = 64.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.94%], valid : [loss = 2.607, top1 = 34.87%], test : [loss = 2.660, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.12%], valid : [loss = 0.635, top1 = 78.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12270/15625) 012270-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.474, top1 = 89.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.300, top1 = 92.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.44 ms.
cifar100       train : [loss = 0.244, top1 = 93.64%], valid : [loss = 1.220, top1 = 69.34%], test : [loss = 1.187, top1 = 69.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.43%], valid : [loss = 2.228, top1 = 42.13%], test : [loss = 2.238, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12271/15625) 012271-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.575, top1 = 87.43%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=13.30 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.400, top1 = 90.94%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=11.61 ms.
cifar100       train : [loss = 0.393, top1 = 88.83%], valid : [loss = 1.408, top1 = 65.05%], test : [loss = 1.385, top1 = 65.43%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.88%], valid : [loss = 2.515, top1 = 36.47%], test : [loss = 2.535, top1 = 36.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12272/15625) 012272-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.522, top1 = 89.29%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=17.83 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.352, top1 = 92.34%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=15.44 ms.
cifar100       train : [loss = 0.136, top1 = 97.24%], valid : [loss = 1.408, top1 = 68.03%], test : [loss = 1.412, top1 = 68.05%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.78%], valid : [loss = 2.396, top1 = 40.04%], test : [loss = 2.425, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.09%], valid : [loss = 0.723, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12273/15625) 012273-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.130, top1 = 96.05%], valid : [loss = 0.465, top1 = 85.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10        train : [loss = 0.158, top1 = 94.84%], test  : [loss = 0.340, top1 = 89.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 1.008, top1 = 71.35%], valid : [loss = 1.344, top1 = 62.14%], test : [loss = 1.354, top1 = 62.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.14%], valid : [loss = 2.728, top1 = 32.63%], test : [loss = 2.747, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 73.14%], valid : [loss = 0.801, top1 = 71.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12274/15625) 012274-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.532, top1 = 89.68%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=16.58 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.320, top1 = 93.42%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.40 ms.
cifar100       train : [loss = 0.046, top1 = 99.43%], valid : [loss = 1.322, top1 = 71.22%], test : [loss = 1.380, top1 = 70.32%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.17%], valid : [loss = 2.303, top1 = 41.90%], test : [loss = 2.308, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.28%], valid : [loss = 0.683, top1 = 76.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12275/15625) 012275-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.24%], valid : [loss = 0.860, top1 = 69.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.737, top1 = 73.96%], test  : [loss = 0.797, top1 = 72.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.15 ms.
cifar100       train : [loss = 2.272, top1 = 39.94%], valid : [loss = 2.369, top1 = 38.00%], test : [loss = 2.375, top1 = 38.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 3.526, top1 = 17.21%], valid : [loss = 3.518, top1 = 17.50%], test : [loss = 3.516, top1 = 17.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.361, top1 = 50.05%], valid : [loss = 1.397, top1 = 49.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12276/15625) 012276-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.529, top1 = 88.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.355, top1 = 91.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.267, top1 = 92.97%], valid : [loss = 1.243, top1 = 68.70%], test : [loss = 1.218, top1 = 69.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.91%], valid : [loss = 2.230, top1 = 43.33%], test : [loss = 2.286, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.78%], valid : [loss = 0.711, top1 = 75.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12277/15625) 012277-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.616, top1 = 85.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10        train : [loss = 0.073, top1 = 97.76%], test  : [loss = 0.395, top1 = 88.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.20 ms.
cifar100       train : [loss = 0.724, top1 = 78.88%], valid : [loss = 1.391, top1 = 63.19%], test : [loss = 1.369, top1 = 63.41%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.95%], valid : [loss = 2.659, top1 = 33.90%], test : [loss = 2.683, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12278/15625) 012278-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.540, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.341, top1 = 92.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.85 ms.
cifar100       train : [loss = 0.183, top1 = 95.35%], valid : [loss = 1.382, top1 = 67.84%], test : [loss = 1.406, top1 = 66.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 1.969, top1 = 48.17%], valid : [loss = 2.308, top1 = 41.63%], test : [loss = 2.350, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 67.98%], valid : [loss = 0.923, top1 = 66.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12279/15625) 012279-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.333, top1 = 92.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.59 ms.
cifar100       train : [loss = 0.336, top1 = 90.85%], valid : [loss = 1.277, top1 = 66.79%], test : [loss = 1.281, top1 = 67.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.71%], valid : [loss = 2.415, top1 = 39.20%], test : [loss = 2.399, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12280/15625) 012280-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.483, top1 = 89.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.309, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.77 ms.
cifar100       train : [loss = 0.143, top1 = 97.16%], valid : [loss = 1.262, top1 = 69.56%], test : [loss = 1.264, top1 = 69.91%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.52 ms.
ImageNet16-120 train : [loss = 1.744, top1 = 53.45%], valid : [loss = 2.187, top1 = 43.74%], test : [loss = 2.230, top1 = 43.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.22%], valid : [loss = 0.572, top1 = 80.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12281/15625) 012281-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.99%], valid : [loss = 0.573, top1 = 86.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.065, top1 = 97.96%], test  : [loss = 0.385, top1 = 89.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 0.671, top1 = 80.29%], valid : [loss = 1.314, top1 = 64.72%], test : [loss = 1.281, top1 = 64.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.408, top1 = 38.43%], valid : [loss = 2.547, top1 = 35.23%], test : [loss = 2.545, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12282/15625) 012282-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.234, top1 = 92.07%], valid : [loss = 0.573, top1 = 82.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10        train : [loss = 0.200, top1 = 93.28%], test  : [loss = 0.393, top1 = 87.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.27 ms.
cifar100       train : [loss = 1.273, top1 = 63.58%], valid : [loss = 1.590, top1 = 57.02%], test : [loss = 1.592, top1 = 55.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.698, top1 = 32.46%], valid : [loss = 2.714, top1 = 33.10%], test : [loss = 2.743, top1 = 31.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.52%], valid : [loss = 1.052, top1 = 62.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12283/15625) 012283-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.513, top1 = 88.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.029, top1 = 99.14%], test  : [loss = 0.369, top1 = 91.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.74 ms.
cifar100       train : [loss = 0.435, top1 = 87.29%], valid : [loss = 1.305, top1 = 65.78%], test : [loss = 1.278, top1 = 66.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 42.00%], valid : [loss = 2.446, top1 = 38.03%], test : [loss = 2.463, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.81%], valid : [loss = 0.905, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12284/15625) 012284-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.572, top1 = 87.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.022, top1 = 99.43%], test  : [loss = 0.379, top1 = 91.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.469, top1 = 86.49%], valid : [loss = 1.383, top1 = 64.96%], test : [loss = 1.394, top1 = 64.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.32%], valid : [loss = 2.462, top1 = 37.96%], test : [loss = 2.500, top1 = 37.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.76%], valid : [loss = 0.811, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12285/15625) 012285-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.596, top1 = 87.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.388, top1 = 90.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.423, top1 = 87.93%], valid : [loss = 1.403, top1 = 65.07%], test : [loss = 1.384, top1 = 65.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.00%], valid : [loss = 2.502, top1 = 36.06%], test : [loss = 2.512, top1 = 37.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.16%], valid : [loss = 0.814, top1 = 71.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12286/15625) 012286-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.62 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.83%], valid : [loss = 0.485, top1 = 84.01%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10        train : [loss = 0.300, top1 = 90.06%], test  : [loss = 0.400, top1 = 86.76%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.58 ms.
cifar100       train : [loss = 1.355, top1 = 62.62%], valid : [loss = 1.561, top1 = 57.34%], test : [loss = 1.535, top1 = 57.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.58%], valid : [loss = 2.896, top1 = 29.60%], test : [loss = 2.974, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12287/15625) 012287-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.33%], valid : [loss = 0.452, top1 = 86.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.151, top1 = 95.16%], test  : [loss = 0.340, top1 = 89.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.36 ms.
cifar100       train : [loss = 1.006, top1 = 71.46%], valid : [loss = 1.369, top1 = 61.82%], test : [loss = 1.348, top1 = 62.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.86%], valid : [loss = 2.702, top1 = 32.33%], test : [loss = 2.712, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12288/15625) 012288-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.459, top1 = 90.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.330, top1 = 93.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.47 ms.
cifar100       train : [loss = 0.087, top1 = 98.39%], valid : [loss = 1.406, top1 = 69.45%], test : [loss = 1.414, top1 = 68.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 1.664, top1 = 55.53%], valid : [loss = 2.276, top1 = 43.53%], test : [loss = 2.315, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.37%], valid : [loss = 0.583, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12289/15625) 012289-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.70%], valid : [loss = 0.570, top1 = 86.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10        train : [loss = 0.071, top1 = 97.65%], test  : [loss = 0.378, top1 = 89.66%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=17.30 ms.
cifar100       train : [loss = 0.695, top1 = 79.60%], valid : [loss = 1.319, top1 = 64.38%], test : [loss = 1.304, top1 = 64.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.51%], valid : [loss = 2.491, top1 = 37.13%], test : [loss = 2.502, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.43%], valid : [loss = 0.780, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12290/15625) 012290-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.35%], valid : [loss = 0.523, top1 = 87.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10        train : [loss = 0.056, top1 = 98.29%], test  : [loss = 0.356, top1 = 90.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.39 ms.
cifar100       train : [loss = 0.629, top1 = 81.42%], valid : [loss = 1.344, top1 = 64.99%], test : [loss = 1.314, top1 = 65.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.50%], valid : [loss = 2.501, top1 = 37.10%], test : [loss = 2.536, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.25%], valid : [loss = 0.631, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12291/15625) 012291-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10-valid  train : [loss = 0.951, top1 = 66.47%], valid : [loss = 0.988, top1 = 65.76%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10        train : [loss = 0.957, top1 = 66.63%], test  : [loss = 0.955, top1 = 66.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.52 ms.
cifar100       train : [loss = 2.415, top1 = 38.07%], valid : [loss = 2.491, top1 = 36.48%], test : [loss = 2.480, top1 = 37.04%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.11 ms.
ImageNet16-120 train : [loss = 3.644, top1 = 15.66%], valid : [loss = 3.608, top1 = 16.67%], test : [loss = 3.649, top1 = 15.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.596, top1 = 40.44%], valid : [loss = 1.651, top1 = 37.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12292/15625) 012292-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.77%], valid : [loss = 0.743, top1 = 74.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10        train : [loss = 0.601, top1 = 79.10%], test  : [loss = 0.662, top1 = 77.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.09 ms.
cifar100       train : [loss = 1.995, top1 = 46.21%], valid : [loss = 2.148, top1 = 43.56%], test : [loss = 2.114, top1 = 44.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 3.236, top1 = 22.31%], valid : [loss = 3.232, top1 = 23.53%], test : [loss = 3.253, top1 = 22.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.299, top1 = 53.14%], valid : [loss = 1.349, top1 = 51.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12293/15625) 012293-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.479, top1 = 88.95%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.22 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.316, top1 = 91.87%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.49 ms.
cifar100       train : [loss = 0.275, top1 = 92.90%], valid : [loss = 1.211, top1 = 69.09%], test : [loss = 1.215, top1 = 68.95%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.40%], valid : [loss = 2.237, top1 = 42.37%], test : [loss = 2.272, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.66%], valid : [loss = 0.647, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12294/15625) 012294-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.48%], valid : [loss = 0.570, top1 = 85.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10        train : [loss = 0.074, top1 = 97.80%], test  : [loss = 0.377, top1 = 89.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.66 ms.
cifar100       train : [loss = 0.701, top1 = 79.53%], valid : [loss = 1.396, top1 = 62.96%], test : [loss = 1.379, top1 = 62.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.449, top1 = 37.60%], valid : [loss = 2.550, top1 = 35.67%], test : [loss = 2.595, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.55%], valid : [loss = 0.863, top1 = 69.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12295/15625) 012295-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 91.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.285, top1 = 93.60%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.43 ms.
cifar100       train : [loss = 0.066, top1 = 99.01%], valid : [loss = 1.330, top1 = 70.84%], test : [loss = 1.343, top1 = 71.16%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 1.531, top1 = 58.60%], valid : [loss = 2.258, top1 = 44.33%], test : [loss = 2.267, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12296/15625) 012296-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.495, top1 = 89.58%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.309, top1 = 93.33%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.33 ms.
cifar100       train : [loss = 0.120, top1 = 97.68%], valid : [loss = 1.279, top1 = 69.36%], test : [loss = 1.288, top1 = 69.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.56%], valid : [loss = 2.291, top1 = 41.97%], test : [loss = 2.270, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.08%], valid : [loss = 0.674, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12297/15625) 012297-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.48%], valid : [loss = 0.457, top1 = 86.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.161, top1 = 94.79%], test  : [loss = 0.349, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.09 ms.
cifar100       train : [loss = 0.988, top1 = 71.85%], valid : [loss = 1.359, top1 = 62.24%], test : [loss = 1.338, top1 = 62.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.46%], valid : [loss = 2.698, top1 = 33.23%], test : [loss = 2.722, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12298/15625) 012298-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.82 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.20%], valid : [loss = 0.455, top1 = 86.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.15 ms.
cifar10        train : [loss = 0.159, top1 = 94.74%], test  : [loss = 0.349, top1 = 88.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.44 ms.
cifar100       train : [loss = 1.016, top1 = 70.93%], valid : [loss = 1.374, top1 = 61.52%], test : [loss = 1.360, top1 = 62.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.84%], valid : [loss = 2.682, top1 = 32.50%], test : [loss = 2.721, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.36%], valid : [loss = 0.780, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12299/15625) 012299-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.76%], valid : [loss = 0.627, top1 = 79.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.69 ms.
cifar10        train : [loss = 0.313, top1 = 89.12%], test  : [loss = 0.462, top1 = 84.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.61 ms.
cifar100       train : [loss = 1.419, top1 = 60.06%], valid : [loss = 1.694, top1 = 54.30%], test : [loss = 1.700, top1 = 53.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 3.116, top1 = 24.68%], valid : [loss = 3.129, top1 = 24.03%], test : [loss = 3.187, top1 = 23.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 54.42%], valid : [loss = 1.304, top1 = 53.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12300/15625) 012300-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.441, top1 = 89.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.299, top1 = 92.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.63 ms.
cifar100       train : [loss = 0.208, top1 = 95.06%], valid : [loss = 1.290, top1 = 68.92%], test : [loss = 1.263, top1 = 69.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.29%], valid : [loss = 2.229, top1 = 43.83%], test : [loss = 2.281, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.409, top1 = 85.89%], valid : [loss = 0.529, top1 = 82.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12301/15625) 012301-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.529, top1 = 88.82%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.56 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.352, top1 = 91.99%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.47 ms.
cifar100       train : [loss = 0.134, top1 = 96.98%], valid : [loss = 1.436, top1 = 67.18%], test : [loss = 1.449, top1 = 67.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 47.87%], valid : [loss = 2.328, top1 = 41.83%], test : [loss = 2.328, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.897, top1 = 67.59%], valid : [loss = 0.925, top1 = 66.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12302/15625) 012302-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=7.81 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.79%], valid : [loss = 0.479, top1 = 84.30%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.78 ms.
cifar10        train : [loss = 0.303, top1 = 89.91%], test  : [loss = 0.403, top1 = 86.31%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.26 ms.
cifar100       train : [loss = 1.330, top1 = 63.05%], valid : [loss = 1.530, top1 = 57.71%], test : [loss = 1.514, top1 = 57.93%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.70 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.65%], valid : [loss = 2.914, top1 = 29.46%], test : [loss = 2.960, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12303/15625) 012303-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.80 ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.57%], valid : [loss = 0.763, top1 = 73.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.546, top1 = 81.08%], test  : [loss = 0.600, top1 = 79.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.81 ms.
cifar100       train : [loss = 2.074, top1 = 44.36%], valid : [loss = 2.173, top1 = 42.77%], test : [loss = 2.175, top1 = 42.53%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 3.213, top1 = 22.62%], valid : [loss = 3.173, top1 = 23.68%], test : [loss = 3.228, top1 = 23.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.212, top1 = 56.18%], valid : [loss = 1.250, top1 = 55.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12304/15625) 012304-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.10%], valid : [loss = 0.546, top1 = 87.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.41 ms.
cifar10        train : [loss = 0.055, top1 = 98.24%], test  : [loss = 0.380, top1 = 89.97%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.85 ms.
cifar100       train : [loss = 0.532, top1 = 84.64%], valid : [loss = 1.389, top1 = 63.10%], test : [loss = 1.356, top1 = 64.90%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.16%], valid : [loss = 2.468, top1 = 36.53%], test : [loss = 2.499, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.48%], valid : [loss = 0.774, top1 = 72.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12305/15625) 012305-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.31%], valid : [loss = 0.459, top1 = 86.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.114, top1 = 96.48%], test  : [loss = 0.334, top1 = 89.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 0.876, top1 = 75.12%], valid : [loss = 1.305, top1 = 63.77%], test : [loss = 1.287, top1 = 63.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.58%], valid : [loss = 2.631, top1 = 34.74%], test : [loss = 2.666, top1 = 33.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12306/15625) 012306-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.579, top1 = 88.42%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.80 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.363, top1 = 92.27%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.31 ms.
cifar100       train : [loss = 0.080, top1 = 98.69%], valid : [loss = 1.416, top1 = 68.62%], test : [loss = 1.489, top1 = 67.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.63%], valid : [loss = 2.408, top1 = 40.30%], test : [loss = 2.396, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.29%], valid : [loss = 0.724, top1 = 75.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12307/15625) 012307-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.141, top1 = 95.29%], valid : [loss = 0.697, top1 = 81.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.97 ms.
cifar10        train : [loss = 0.195, top1 = 93.30%], test  : [loss = 0.505, top1 = 85.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.31 ms.
cifar100       train : [loss = 0.898, top1 = 73.69%], valid : [loss = 1.638, top1 = 57.62%], test : [loss = 1.653, top1 = 56.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 3.470, top1 = 17.46%], valid : [loss = 3.472, top1 = 17.40%], test : [loss = 3.477, top1 = 16.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 52.86%], valid : [loss = 1.308, top1 = 52.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12308/15625) 012308-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.48 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.85 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12309/15625) 012309-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.84%], valid : [loss = 0.590, top1 = 86.75%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.48 ms.
cifar10        train : [loss = 0.030, top1 = 99.27%], test  : [loss = 0.398, top1 = 89.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.99 ms.
cifar100       train : [loss = 0.379, top1 = 89.86%], valid : [loss = 1.418, top1 = 64.72%], test : [loss = 1.403, top1 = 65.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.75 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.11%], valid : [loss = 2.590, top1 = 35.40%], test : [loss = 2.607, top1 = 35.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.01%], valid : [loss = 0.766, top1 = 73.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12310/15625) 012310-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.667, top1 = 85.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10        train : [loss = 0.026, top1 = 99.32%], test  : [loss = 0.462, top1 = 89.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.56 ms.
cifar100       train : [loss = 0.312, top1 = 91.86%], valid : [loss = 1.577, top1 = 63.12%], test : [loss = 1.572, top1 = 63.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.429, top1 = 38.26%], valid : [loss = 2.762, top1 = 31.00%], test : [loss = 2.816, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.82%], valid : [loss = 0.827, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12311/15625) 012311-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.507, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.56 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.346, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.77 ms.
cifar100       train : [loss = 0.180, top1 = 95.47%], valid : [loss = 1.422, top1 = 67.16%], test : [loss = 1.379, top1 = 67.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 1.926, top1 = 49.19%], valid : [loss = 2.290, top1 = 41.90%], test : [loss = 2.300, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.78%], valid : [loss = 0.685, top1 = 76.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12312/15625) 012312-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.96%], valid : [loss = 0.724, top1 = 83.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.084, top1 = 97.31%], test  : [loss = 0.483, top1 = 86.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.14 ms.
cifar100       train : [loss = 0.788, top1 = 77.00%], valid : [loss = 1.509, top1 = 60.61%], test : [loss = 1.497, top1 = 61.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.796, top1 = 30.73%], valid : [loss = 2.914, top1 = 28.42%], test : [loss = 2.969, top1 = 27.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12313/15625) 012313-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.503, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.327, top1 = 92.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=17.21 ms.
cifar100       train : [loss = 0.331, top1 = 91.00%], valid : [loss = 1.297, top1 = 67.16%], test : [loss = 1.309, top1 = 66.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.11%], valid : [loss = 2.395, top1 = 39.57%], test : [loss = 2.443, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12314/15625) 012314-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.37%], valid : [loss = 0.482, top1 = 84.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.68 ms.
cifar10        train : [loss = 0.273, top1 = 90.86%], test  : [loss = 0.421, top1 = 85.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.25 ms.
cifar100       train : [loss = 1.240, top1 = 65.18%], valid : [loss = 1.526, top1 = 57.36%], test : [loss = 1.542, top1 = 57.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.793, top1 = 0.83%], test : [loss = 4.793, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12315/15625) 012315-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.32 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.69%], valid : [loss = 0.611, top1 = 86.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.46 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.405, top1 = 89.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.46 ms.
cifar100       train : [loss = 0.519, top1 = 84.95%], valid : [loss = 1.435, top1 = 62.98%], test : [loss = 1.410, top1 = 64.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 39.10%], valid : [loss = 2.576, top1 = 35.13%], test : [loss = 2.585, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12316/15625) 012316-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.618, top1 = 85.37%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=15.64 ms.
cifar10        train : [loss = 0.070, top1 = 97.81%], test  : [loss = 0.408, top1 = 88.74%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=15.18 ms.
cifar100       train : [loss = 0.716, top1 = 79.21%], valid : [loss = 1.392, top1 = 62.67%], test : [loss = 1.363, top1 = 63.80%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.91%], valid : [loss = 2.653, top1 = 33.90%], test : [loss = 2.700, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12317/15625) 012317-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.79%], valid : [loss = 0.458, top1 = 86.31%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.73 ms.
cifar10        train : [loss = 0.151, top1 = 95.11%], test  : [loss = 0.338, top1 = 89.07%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=16.62 ms.
cifar100       train : [loss = 0.961, top1 = 72.78%], valid : [loss = 1.337, top1 = 62.58%], test : [loss = 1.335, top1 = 62.69%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.37%], valid : [loss = 2.648, top1 = 33.59%], test : [loss = 2.685, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.41%], valid : [loss = 0.788, top1 = 71.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12318/15625) 012318-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.81%], valid : [loss = 0.455, top1 = 86.30%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10        train : [loss = 0.151, top1 = 94.98%], test  : [loss = 0.340, top1 = 88.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.93 ms.
cifar100       train : [loss = 1.001, top1 = 71.63%], valid : [loss = 1.389, top1 = 61.00%], test : [loss = 1.358, top1 = 62.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.09 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.08%], valid : [loss = 2.686, top1 = 32.37%], test : [loss = 2.710, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.787, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12319/15625) 012319-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.628, top1 = 86.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.18 ms.
cifar10        train : [loss = 0.025, top1 = 99.36%], test  : [loss = 0.453, top1 = 89.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.25 ms.
cifar100       train : [loss = 0.319, top1 = 91.60%], valid : [loss = 1.462, top1 = 64.54%], test : [loss = 1.447, top1 = 64.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.232, top1 = 42.46%], valid : [loss = 2.548, top1 = 35.80%], test : [loss = 2.580, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.44%], valid : [loss = 0.708, top1 = 75.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12320/15625) 012320-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.739, top1 = 73.99%], valid : [loss = 0.891, top1 = 69.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.671, top1 = 76.47%], test  : [loss = 0.761, top1 = 73.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.81 ms.
cifar100       train : [loss = 1.984, top1 = 47.35%], valid : [loss = 2.145, top1 = 44.57%], test : [loss = 2.179, top1 = 43.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.72%], valid : [loss = 3.673, top1 = 15.79%], test : [loss = 3.697, top1 = 14.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.376, top1 = 49.82%], valid : [loss = 1.395, top1 = 49.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12321/15625) 012321-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.91 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.32 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.65 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.98 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12322/15625) 012322-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.607, top1 = 85.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10        train : [loss = 0.067, top1 = 97.98%], test  : [loss = 0.421, top1 = 88.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.55 ms.
cifar100       train : [loss = 0.715, top1 = 79.18%], valid : [loss = 1.372, top1 = 62.88%], test : [loss = 1.338, top1 = 64.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.21%], valid : [loss = 2.656, top1 = 33.87%], test : [loss = 2.694, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12323/15625) 012323-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.096, top1 = 96.99%], valid : [loss = 0.868, top1 = 78.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10        train : [loss = 0.124, top1 = 95.76%], test  : [loss = 0.538, top1 = 85.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.877, top1 = 74.38%], valid : [loss = 1.638, top1 = 57.24%], test : [loss = 1.670, top1 = 57.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 26.22%], valid : [loss = 3.208, top1 = 23.23%], test : [loss = 3.225, top1 = 23.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 62.94%], valid : [loss = 1.106, top1 = 60.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12324/15625) 012324-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.73%], valid : [loss = 0.659, top1 = 84.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10        train : [loss = 0.078, top1 = 97.51%], test  : [loss = 0.413, top1 = 88.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.61 ms.
cifar100       train : [loss = 0.780, top1 = 77.14%], valid : [loss = 1.460, top1 = 61.03%], test : [loss = 1.443, top1 = 61.61%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.571, top1 = 35.18%], valid : [loss = 2.710, top1 = 32.87%], test : [loss = 2.723, top1 = 32.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.10%], valid : [loss = 0.865, top1 = 69.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12325/15625) 012325-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.537, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.14 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.345, top1 = 91.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.83 ms.
cifar100       train : [loss = 0.425, top1 = 87.65%], valid : [loss = 1.280, top1 = 66.46%], test : [loss = 1.227, top1 = 67.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 2.174, top1 = 43.52%], valid : [loss = 2.379, top1 = 39.80%], test : [loss = 2.371, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.15%], valid : [loss = 0.836, top1 = 70.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12326/15625) 012326-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.069, top1 = 97.90%], valid : [loss = 0.844, top1 = 80.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.90 ms.
cifar10        train : [loss = 0.126, top1 = 95.84%], test  : [loss = 0.570, top1 = 84.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.30 ms.
cifar100       train : [loss = 0.846, top1 = 75.33%], valid : [loss = 1.673, top1 = 57.08%], test : [loss = 1.663, top1 = 57.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.45%], valid : [loss = 3.158, top1 = 24.77%], test : [loss = 3.216, top1 = 22.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.46%], valid : [loss = 1.117, top1 = 60.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12327/15625) 012327-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.48 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.537, top1 = 89.47%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.367, top1 = 92.57%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.78 ms.
cifar100       train : [loss = 0.035, top1 = 99.69%], valid : [loss = 1.450, top1 = 69.72%], test : [loss = 1.385, top1 = 70.52%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.18 ms.
ImageNet16-120 train : [loss = 1.530, top1 = 58.66%], valid : [loss = 2.403, top1 = 42.20%], test : [loss = 2.409, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.40%], valid : [loss = 0.688, top1 = 76.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12328/15625) 012328-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.94%], valid : [loss = 0.486, top1 = 84.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.298, top1 = 90.00%], test  : [loss = 0.403, top1 = 86.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.339, top1 = 62.96%], valid : [loss = 1.539, top1 = 57.20%], test : [loss = 1.517, top1 = 57.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.62%], valid : [loss = 2.913, top1 = 29.17%], test : [loss = 2.960, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12329/15625) 012329-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.63%], valid : [loss = 0.868, top1 = 71.37%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10        train : [loss = 0.560, top1 = 80.50%], test  : [loss = 0.703, top1 = 75.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 1.777, top1 = 52.30%], valid : [loss = 2.047, top1 = 46.62%], test : [loss = 2.055, top1 = 47.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.77%], valid : [loss = 3.643, top1 = 16.87%], test : [loss = 3.673, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.164, top1 = 58.19%], valid : [loss = 1.234, top1 = 56.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12330/15625) 012330-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10-valid  train : [loss = 1.248, top1 = 55.37%], valid : [loss = 1.294, top1 = 53.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10        train : [loss = 1.229, top1 = 55.87%], test  : [loss = 1.242, top1 = 55.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.90 ms.
cifar100       train : [loss = 2.763, top1 = 31.06%], valid : [loss = 2.846, top1 = 29.81%], test : [loss = 2.830, top1 = 30.23%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.73 ms.
ImageNet16-120 train : [loss = 3.912, top1 = 11.73%], valid : [loss = 3.909, top1 = 12.28%], test : [loss = 3.929, top1 = 11.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.764, top1 = 33.36%], valid : [loss = 1.758, top1 = 33.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12331/15625) 012331-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.357, top1 = 87.44%], valid : [loss = 0.588, top1 = 80.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.05 ms.
cifar10        train : [loss = 0.284, top1 = 90.33%], test  : [loss = 0.434, top1 = 85.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.13 ms.
cifar100       train : [loss = 1.556, top1 = 56.68%], valid : [loss = 1.775, top1 = 51.66%], test : [loss = 1.770, top1 = 51.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 3.079, top1 = 25.25%], valid : [loss = 3.071, top1 = 25.03%], test : [loss = 3.106, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.024, top1 = 63.18%], valid : [loss = 1.063, top1 = 62.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12332/15625) 012332-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.486, top1 = 88.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.324, top1 = 92.05%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.52 ms.
cifar100       train : [loss = 0.324, top1 = 91.28%], valid : [loss = 1.253, top1 = 67.11%], test : [loss = 1.250, top1 = 68.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.90 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.56%], valid : [loss = 2.344, top1 = 40.52%], test : [loss = 2.355, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.95%], valid : [loss = 0.632, top1 = 78.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12333/15625) 012333-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.85 ms.
cifar10-valid  train : [loss = 0.797, top1 = 72.09%], valid : [loss = 0.978, top1 = 66.76%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.70 ms.
cifar10        train : [loss = 0.755, top1 = 73.45%], test  : [loss = 0.842, top1 = 70.52%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.94 ms.
cifar100       train : [loss = 2.119, top1 = 44.39%], valid : [loss = 2.271, top1 = 41.50%], test : [loss = 2.311, top1 = 40.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.81 ms.
ImageNet16-120 train : [loss = 3.743, top1 = 14.23%], valid : [loss = 3.761, top1 = 14.50%], test : [loss = 3.765, top1 = 13.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12334/15625) 012334-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.521, top1 = 88.56%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.347, top1 = 91.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.46 ms.
cifar100       train : [loss = 0.326, top1 = 90.96%], valid : [loss = 1.287, top1 = 67.08%], test : [loss = 1.280, top1 = 66.84%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.88%], valid : [loss = 2.426, top1 = 37.83%], test : [loss = 2.415, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.15%], valid : [loss = 0.801, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12335/15625) 012335-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.61%], valid : [loss = 0.483, top1 = 84.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.38 ms.
cifar10        train : [loss = 0.298, top1 = 89.99%], test  : [loss = 0.399, top1 = 86.76%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.91 ms.
cifar100       train : [loss = 1.336, top1 = 62.88%], valid : [loss = 1.532, top1 = 57.68%], test : [loss = 1.518, top1 = 57.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.932, top1 = 28.58%], valid : [loss = 2.896, top1 = 29.23%], test : [loss = 2.979, top1 = 27.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.42%], valid : [loss = 0.775, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12336/15625) 012336-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.58%], valid : [loss = 0.822, top1 = 81.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.23 ms.
cifar10        train : [loss = 0.090, top1 = 97.19%], test  : [loss = 0.494, top1 = 86.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.85 ms.
cifar100       train : [loss = 0.807, top1 = 76.37%], valid : [loss = 1.527, top1 = 59.82%], test : [loss = 1.509, top1 = 59.92%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.816, top1 = 30.32%], valid : [loss = 2.943, top1 = 29.07%], test : [loss = 3.013, top1 = 26.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.28%], valid : [loss = 0.864, top1 = 70.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12337/15625) 012337-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.30%], valid : [loss = 0.560, top1 = 87.08%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.70 ms.
cifar10        train : [loss = 0.043, top1 = 98.73%], test  : [loss = 0.372, top1 = 90.79%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.84 ms.
cifar100       train : [loss = 0.459, top1 = 86.89%], valid : [loss = 1.327, top1 = 65.34%], test : [loss = 1.299, top1 = 66.42%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.211, top1 = 42.86%], valid : [loss = 2.439, top1 = 38.10%], test : [loss = 2.422, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.44%], valid : [loss = 0.842, top1 = 70.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12338/15625) 012338-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.34%], valid : [loss = 0.641, top1 = 85.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10        train : [loss = 0.071, top1 = 97.79%], test  : [loss = 0.414, top1 = 88.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.51 ms.
cifar100       train : [loss = 0.690, top1 = 79.87%], valid : [loss = 1.420, top1 = 62.79%], test : [loss = 1.398, top1 = 63.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.70%], valid : [loss = 2.669, top1 = 33.43%], test : [loss = 2.713, top1 = 32.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.60%], valid : [loss = 0.810, top1 = 71.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12339/15625) 012339-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.27%], valid : [loss = 0.511, top1 = 86.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.090, top1 = 97.05%], test  : [loss = 0.348, top1 = 89.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 0.661, top1 = 81.01%], valid : [loss = 1.194, top1 = 67.25%], test : [loss = 1.183, top1 = 67.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.54%], valid : [loss = 2.473, top1 = 37.95%], test : [loss = 2.495, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.96%], valid : [loss = 0.917, top1 = 67.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12340/15625) 012340-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.284, top1 = 90.19%], valid : [loss = 0.556, top1 = 82.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.253, top1 = 91.30%], test  : [loss = 0.418, top1 = 85.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.33 ms.
cifar100       train : [loss = 1.313, top1 = 63.08%], valid : [loss = 1.589, top1 = 56.88%], test : [loss = 1.557, top1 = 58.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.848, top1 = 29.75%], valid : [loss = 2.855, top1 = 30.47%], test : [loss = 2.884, top1 = 29.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.957, top1 = 65.60%], valid : [loss = 1.017, top1 = 63.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12341/15625) 012341-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.62%], valid : [loss = 0.644, top1 = 84.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.70 ms.
cifar10        train : [loss = 0.086, top1 = 97.22%], test  : [loss = 0.401, top1 = 88.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.91 ms.
cifar100       train : [loss = 0.774, top1 = 77.40%], valid : [loss = 1.400, top1 = 62.26%], test : [loss = 1.399, top1 = 62.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.14%], valid : [loss = 2.705, top1 = 32.10%], test : [loss = 2.774, top1 = 31.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.42%], valid : [loss = 0.844, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12342/15625) 012342-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.558, top1 = 87.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.368, top1 = 91.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.39 ms.
cifar100       train : [loss = 0.325, top1 = 91.07%], valid : [loss = 1.445, top1 = 65.00%], test : [loss = 1.474, top1 = 64.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.29%], valid : [loss = 2.475, top1 = 37.37%], test : [loss = 2.500, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.37%], valid : [loss = 0.879, top1 = 68.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12343/15625) 012343-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.80%], valid : [loss = 0.464, top1 = 86.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10        train : [loss = 0.148, top1 = 95.29%], test  : [loss = 0.343, top1 = 88.91%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.71 ms.
cifar100       train : [loss = 0.963, top1 = 72.64%], valid : [loss = 1.339, top1 = 62.32%], test : [loss = 1.346, top1 = 62.29%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.72%], valid : [loss = 2.678, top1 = 33.15%], test : [loss = 2.725, top1 = 31.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12344/15625) 012344-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.612, top1 = 87.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.387, top1 = 90.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.34 ms.
cifar100       train : [loss = 0.239, top1 = 94.05%], valid : [loss = 1.549, top1 = 64.36%], test : [loss = 1.580, top1 = 63.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.49%], valid : [loss = 2.501, top1 = 38.00%], test : [loss = 2.497, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.32%], valid : [loss = 0.762, top1 = 73.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12345/15625) 012345-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.307, top1 = 89.36%], valid : [loss = 0.572, top1 = 81.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10        train : [loss = 0.264, top1 = 90.94%], test  : [loss = 0.411, top1 = 86.48%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.15 ms.
cifar100       train : [loss = 1.517, top1 = 57.68%], valid : [loss = 1.753, top1 = 52.35%], test : [loss = 1.741, top1 = 52.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 2.954, top1 = 27.58%], valid : [loss = 2.949, top1 = 27.87%], test : [loss = 3.020, top1 = 26.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.56%], valid : [loss = 1.024, top1 = 63.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12346/15625) 012346-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.25%], valid : [loss = 0.451, top1 = 86.18%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.50 ms.
cifar10        train : [loss = 0.154, top1 = 94.98%], test  : [loss = 0.341, top1 = 88.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.34 ms.
cifar100       train : [loss = 1.024, top1 = 70.60%], valid : [loss = 1.366, top1 = 61.90%], test : [loss = 1.367, top1 = 62.02%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.71%], valid : [loss = 2.686, top1 = 32.90%], test : [loss = 2.733, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.00%], valid : [loss = 0.791, top1 = 71.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12347/15625) 012347-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.69 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12348/15625) 012348-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.496, top1 = 88.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.306, top1 = 92.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.341, top1 = 90.63%], valid : [loss = 1.260, top1 = 67.44%], test : [loss = 1.281, top1 = 67.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.60%], valid : [loss = 2.333, top1 = 40.90%], test : [loss = 2.366, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.64%], valid : [loss = 0.603, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12349/15625) 012349-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.53%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.99 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.323, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.96 ms.
cifar100       train : [loss = 0.150, top1 = 96.82%], valid : [loss = 1.331, top1 = 68.82%], test : [loss = 1.326, top1 = 68.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.27%], valid : [loss = 2.298, top1 = 41.52%], test : [loss = 2.307, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.33%], valid : [loss = 0.771, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12350/15625) 012350-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.478, top1 = 89.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.325, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.64 ms.
cifar100       train : [loss = 0.281, top1 = 92.64%], valid : [loss = 1.189, top1 = 69.84%], test : [loss = 1.237, top1 = 68.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.05%], valid : [loss = 2.210, top1 = 42.90%], test : [loss = 2.253, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12351/15625) 012351-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.55%], valid : [loss = 0.923, top1 = 76.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.48 ms.
cifar10        train : [loss = 0.220, top1 = 92.37%], test  : [loss = 0.586, top1 = 82.06%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=17.92 ms.
cifar100       train : [loss = 1.137, top1 = 67.54%], valid : [loss = 1.747, top1 = 54.50%], test : [loss = 1.738, top1 = 54.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 23.18%], valid : [loss = 3.328, top1 = 21.67%], test : [loss = 3.345, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.64%], valid : [loss = 1.084, top1 = 61.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12352/15625) 012352-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.60%], valid : [loss = 0.560, top1 = 82.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10        train : [loss = 0.247, top1 = 91.58%], test  : [loss = 0.395, top1 = 86.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.88 ms.
cifar100       train : [loss = 1.423, top1 = 60.05%], valid : [loss = 1.673, top1 = 54.85%], test : [loss = 1.653, top1 = 55.15%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.32%], valid : [loss = 2.937, top1 = 28.08%], test : [loss = 3.007, top1 = 27.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.90%], valid : [loss = 1.008, top1 = 64.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12353/15625) 012353-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.643, top1 = 86.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.030, top1 = 99.18%], test  : [loss = 0.413, top1 = 90.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.544, top1 = 84.17%], valid : [loss = 1.448, top1 = 62.74%], test : [loss = 1.431, top1 = 63.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 2.397, top1 = 38.85%], valid : [loss = 2.607, top1 = 34.73%], test : [loss = 2.599, top1 = 34.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.38%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12354/15625) 012354-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.60%], valid : [loss = 0.530, top1 = 84.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.54 ms.
cifar10        train : [loss = 0.160, top1 = 94.65%], test  : [loss = 0.382, top1 = 88.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.18 ms.
cifar100       train : [loss = 1.121, top1 = 68.05%], valid : [loss = 1.484, top1 = 59.14%], test : [loss = 1.459, top1 = 59.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.576, top1 = 35.09%], valid : [loss = 2.652, top1 = 33.20%], test : [loss = 2.694, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 66.91%], valid : [loss = 0.975, top1 = 65.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12355/15625) 012355-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.64 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.455, top1 = 89.56%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.307, top1 = 92.40%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.87 ms.
cifar100       train : [loss = 0.277, top1 = 92.90%], valid : [loss = 1.232, top1 = 68.48%], test : [loss = 1.210, top1 = 68.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.24 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.82%], valid : [loss = 2.199, top1 = 43.87%], test : [loss = 2.185, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.25%], valid : [loss = 0.801, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12356/15625) 012356-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.546, top1 = 88.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.337, top1 = 91.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.36 ms.
cifar100       train : [loss = 0.331, top1 = 90.80%], valid : [loss = 1.267, top1 = 68.18%], test : [loss = 1.292, top1 = 68.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.084, top1 = 45.63%], valid : [loss = 2.353, top1 = 39.87%], test : [loss = 2.370, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 73.16%], valid : [loss = 0.806, top1 = 71.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12357/15625) 012357-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.561, top1 = 87.52%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.411, top1 = 90.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 0.410, top1 = 88.32%], valid : [loss = 1.422, top1 = 65.02%], test : [loss = 1.442, top1 = 65.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.84%], valid : [loss = 2.471, top1 = 38.00%], test : [loss = 2.534, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 74.00%], valid : [loss = 0.812, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12358/15625) 012358-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.457, top1 = 86.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.110, top1 = 96.61%], test  : [loss = 0.329, top1 = 89.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.26 ms.
cifar100       train : [loss = 0.864, top1 = 75.43%], valid : [loss = 1.296, top1 = 64.41%], test : [loss = 1.284, top1 = 64.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.61%], valid : [loss = 2.628, top1 = 34.13%], test : [loss = 2.657, top1 = 34.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12359/15625) 012359-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.476, top1 = 89.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 0.313, top1 = 91.71%], valid : [loss = 1.251, top1 = 68.22%], test : [loss = 1.249, top1 = 68.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.84%], valid : [loss = 2.309, top1 = 40.93%], test : [loss = 2.338, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12360/15625) 012360-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.524, top1 = 88.43%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.85 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.324, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.39 ms.
cifar100       train : [loss = 0.332, top1 = 91.03%], valid : [loss = 1.303, top1 = 67.70%], test : [loss = 1.266, top1 = 67.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.09%], valid : [loss = 2.394, top1 = 38.33%], test : [loss = 2.406, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12361/15625) 012361-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.43%], valid : [loss = 0.860, top1 = 71.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.89 ms.
cifar10        train : [loss = 0.558, top1 = 80.46%], test  : [loss = 0.715, top1 = 75.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.62 ms.
cifar100       train : [loss = 1.787, top1 = 51.77%], valid : [loss = 2.056, top1 = 47.28%], test : [loss = 2.073, top1 = 46.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.78%], valid : [loss = 3.633, top1 = 16.70%], test : [loss = 3.657, top1 = 16.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12362/15625) 012362-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.54 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.324, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.79 ms.
cifar100       train : [loss = 0.122, top1 = 97.50%], valid : [loss = 1.331, top1 = 68.97%], test : [loss = 1.337, top1 = 68.83%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.79%], valid : [loss = 2.209, top1 = 43.23%], test : [loss = 2.233, top1 = 43.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.16%], valid : [loss = 0.669, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12363/15625) 012363-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.05%], valid : [loss = 0.550, top1 = 87.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10        train : [loss = 0.060, top1 = 98.04%], test  : [loss = 0.362, top1 = 90.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=18.10 ms.
cifar100       train : [loss = 0.654, top1 = 80.88%], valid : [loss = 1.333, top1 = 64.10%], test : [loss = 1.329, top1 = 64.62%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.418, top1 = 38.24%], valid : [loss = 2.537, top1 = 36.23%], test : [loss = 2.560, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12364/15625) 012364-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.14 ms.
cifar10-valid  train : [loss = 0.154, top1 = 95.03%], valid : [loss = 0.504, top1 = 85.02%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10        train : [loss = 0.172, top1 = 94.16%], test  : [loss = 0.376, top1 = 88.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.78 ms.
cifar100       train : [loss = 1.090, top1 = 68.71%], valid : [loss = 1.438, top1 = 61.00%], test : [loss = 1.436, top1 = 61.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.57%], valid : [loss = 2.670, top1 = 33.90%], test : [loss = 2.706, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 68.10%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12365/15625) 012365-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.16%], valid : [loss = 0.900, top1 = 68.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10        train : [loss = 0.716, top1 = 74.89%], test  : [loss = 0.773, top1 = 72.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.45 ms.
cifar100       train : [loss = 2.187, top1 = 42.03%], valid : [loss = 2.270, top1 = 40.10%], test : [loss = 2.281, top1 = 40.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 3.486, top1 = 17.87%], valid : [loss = 3.480, top1 = 18.83%], test : [loss = 3.496, top1 = 17.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.373, top1 = 49.78%], valid : [loss = 1.409, top1 = 48.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12366/15625) 012366-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.568, top1 = 89.20%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.39 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.364, top1 = 92.51%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.99 ms.
cifar100       train : [loss = 0.132, top1 = 97.21%], valid : [loss = 1.339, top1 = 68.72%], test : [loss = 1.374, top1 = 68.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.38%], valid : [loss = 2.326, top1 = 41.10%], test : [loss = 2.289, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.45%], valid : [loss = 0.822, top1 = 70.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12367/15625) 012367-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10-valid  train : [loss = 1.243, top1 = 55.29%], valid : [loss = 1.300, top1 = 53.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10        train : [loss = 1.229, top1 = 55.92%], test  : [loss = 1.237, top1 = 55.36%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.39 ms.
cifar100       train : [loss = 2.780, top1 = 30.60%], valid : [loss = 2.877, top1 = 29.30%], test : [loss = 2.871, top1 = 29.98%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.32 ms.
ImageNet16-120 train : [loss = 3.920, top1 = 11.60%], valid : [loss = 3.923, top1 = 12.13%], test : [loss = 3.945, top1 = 11.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.802, top1 = 31.99%], valid : [loss = 1.785, top1 = 32.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12368/15625) 012368-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.72 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.47%], valid : [loss = 0.566, top1 = 85.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.56 ms.
cifar10        train : [loss = 0.090, top1 = 97.16%], test  : [loss = 0.369, top1 = 89.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.41 ms.
cifar100       train : [loss = 0.731, top1 = 78.60%], valid : [loss = 1.400, top1 = 62.88%], test : [loss = 1.390, top1 = 63.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.451, top1 = 37.62%], valid : [loss = 2.565, top1 = 34.83%], test : [loss = 2.615, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.898, top1 = 68.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12369/15625) 012369-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.442, top1 = 89.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.53 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.330, top1 = 91.16%], valid : [loss = 1.296, top1 = 66.80%], test : [loss = 1.285, top1 = 67.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.17%], valid : [loss = 2.366, top1 = 39.57%], test : [loss = 2.389, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.32%], valid : [loss = 0.547, top1 = 81.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12370/15625) 012370-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.70 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12371/15625) 012371-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.644, top1 = 86.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.74 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.413, top1 = 90.66%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.13 ms.
cifar100       train : [loss = 0.231, top1 = 94.07%], valid : [loss = 1.650, top1 = 63.10%], test : [loss = 1.632, top1 = 62.82%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.25%], valid : [loss = 2.464, top1 = 38.07%], test : [loss = 2.521, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.55%], valid : [loss = 0.850, top1 = 69.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12372/15625) 012372-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.54%], valid : [loss = 0.559, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.11 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.367, top1 = 91.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.518, top1 = 85.11%], valid : [loss = 1.301, top1 = 65.04%], test : [loss = 1.325, top1 = 65.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.590, top1 = 34.38%], valid : [loss = 2.666, top1 = 32.03%], test : [loss = 2.698, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12373/15625) 012373-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.478, top1 = 89.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.324, top1 = 91.23%], valid : [loss = 1.259, top1 = 67.39%], test : [loss = 1.271, top1 = 67.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.56%], valid : [loss = 2.316, top1 = 41.12%], test : [loss = 2.336, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12374/15625) 012374-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.525, top1 = 88.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.337, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.19 ms.
cifar100       train : [loss = 0.250, top1 = 93.29%], valid : [loss = 1.420, top1 = 66.08%], test : [loss = 1.445, top1 = 66.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.10%], valid : [loss = 2.490, top1 = 36.53%], test : [loss = 2.492, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.48%], valid : [loss = 0.627, top1 = 78.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12375/15625) 012375-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.538, top1 = 88.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.357, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.46 ms.
cifar100       train : [loss = 0.144, top1 = 97.05%], valid : [loss = 1.420, top1 = 68.20%], test : [loss = 1.399, top1 = 67.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.01%], valid : [loss = 2.372, top1 = 40.57%], test : [loss = 2.418, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.26%], valid : [loss = 0.657, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12376/15625) 012376-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.41%], valid : [loss = 0.454, top1 = 86.17%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.44 ms.
cifar10        train : [loss = 0.157, top1 = 94.96%], test  : [loss = 0.347, top1 = 88.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.04 ms.
cifar100       train : [loss = 0.994, top1 = 71.49%], valid : [loss = 1.371, top1 = 61.72%], test : [loss = 1.363, top1 = 61.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.92%], valid : [loss = 2.694, top1 = 33.90%], test : [loss = 2.714, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12377/15625) 012377-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.32%], valid : [loss = 0.611, top1 = 80.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10        train : [loss = 0.347, top1 = 87.92%], test  : [loss = 0.457, top1 = 85.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.49 ms.
cifar100       train : [loss = 1.457, top1 = 59.45%], valid : [loss = 1.709, top1 = 53.70%], test : [loss = 1.742, top1 = 53.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 3.149, top1 = 24.15%], valid : [loss = 3.118, top1 = 24.60%], test : [loss = 3.212, top1 = 23.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.285, top1 = 53.22%], valid : [loss = 1.330, top1 = 51.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12378/15625) 012378-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.60%], valid : [loss = 0.794, top1 = 72.55%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.619, top1 = 78.31%], test  : [loss = 0.681, top1 = 76.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.31 ms.
cifar100       train : [loss = 2.188, top1 = 41.62%], valid : [loss = 2.336, top1 = 38.94%], test : [loss = 2.312, top1 = 39.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 3.356, top1 = 20.17%], valid : [loss = 3.343, top1 = 20.26%], test : [loss = 3.390, top1 = 19.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.273, top1 = 53.78%], valid : [loss = 1.324, top1 = 52.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12379/15625) 012379-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.38%], valid : [loss = 0.570, top1 = 87.22%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.53 ms.
cifar10        train : [loss = 0.049, top1 = 98.47%], test  : [loss = 0.381, top1 = 90.23%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.58 ms.
cifar100       train : [loss = 0.484, top1 = 86.22%], valid : [loss = 1.342, top1 = 65.36%], test : [loss = 1.288, top1 = 66.42%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.40%], valid : [loss = 2.394, top1 = 38.73%], test : [loss = 2.370, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.90%], valid : [loss = 0.832, top1 = 71.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12380/15625) 012380-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.59%], valid : [loss = 0.672, top1 = 82.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10        train : [loss = 0.152, top1 = 94.88%], test  : [loss = 0.487, top1 = 86.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 0.962, top1 = 72.11%], valid : [loss = 1.617, top1 = 56.78%], test : [loss = 1.638, top1 = 56.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.27%], valid : [loss = 3.118, top1 = 24.70%], test : [loss = 3.177, top1 = 22.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12381/15625) 012381-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.554, top1 = 87.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.88 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.368, top1 = 91.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.02 ms.
cifar100       train : [loss = 0.643, top1 = 81.61%], valid : [loss = 1.457, top1 = 61.52%], test : [loss = 1.430, top1 = 62.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 2.453, top1 = 37.38%], valid : [loss = 2.567, top1 = 34.97%], test : [loss = 2.551, top1 = 34.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.12%], valid : [loss = 0.951, top1 = 65.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12382/15625) 012382-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.94 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.533, top1 = 87.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.02 ms.
cifar10        train : [loss = 0.023, top1 = 99.42%], test  : [loss = 0.360, top1 = 90.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.30 ms.
cifar100       train : [loss = 0.394, top1 = 89.00%], valid : [loss = 1.365, top1 = 65.26%], test : [loss = 1.315, top1 = 67.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.45%], valid : [loss = 2.487, top1 = 38.43%], test : [loss = 2.505, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.30%], valid : [loss = 0.623, top1 = 79.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12383/15625) 012383-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.472, top1 = 89.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.312, top1 = 92.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.74 ms.
cifar100       train : [loss = 0.188, top1 = 95.41%], valid : [loss = 1.322, top1 = 68.30%], test : [loss = 1.265, top1 = 69.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.80%], valid : [loss = 2.249, top1 = 42.13%], test : [loss = 2.290, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.06%], valid : [loss = 0.544, top1 = 81.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12384/15625) 012384-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.418, top1 = 91.43%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.07 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.288, top1 = 93.85%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.85 ms.
cifar100       train : [loss = 0.038, top1 = 99.54%], valid : [loss = 1.322, top1 = 71.26%], test : [loss = 1.318, top1 = 71.46%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.52 ms.
ImageNet16-120 train : [loss = 1.350, top1 = 62.99%], valid : [loss = 2.241, top1 = 44.20%], test : [loss = 2.212, top1 = 45.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.343, top1 = 88.26%], valid : [loss = 0.498, top1 = 83.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12385/15625) 012385-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 0.350, top1 = 90.46%], valid : [loss = 1.254, top1 = 67.14%], test : [loss = 1.299, top1 = 66.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.80%], valid : [loss = 2.451, top1 = 38.33%], test : [loss = 2.417, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12386/15625) 012386-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.573, top1 = 87.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.382, top1 = 91.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.09 ms.
cifar100       train : [loss = 0.375, top1 = 89.53%], valid : [loss = 1.394, top1 = 65.56%], test : [loss = 1.385, top1 = 65.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.70%], valid : [loss = 2.471, top1 = 37.43%], test : [loss = 2.501, top1 = 37.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.22%], valid : [loss = 0.760, top1 = 73.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12387/15625) 012387-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.129, top1 = 96.06%], valid : [loss = 0.468, top1 = 85.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.90 ms.
cifar10        train : [loss = 0.162, top1 = 94.70%], test  : [loss = 0.352, top1 = 88.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 1.009, top1 = 71.18%], valid : [loss = 1.364, top1 = 62.08%], test : [loss = 1.374, top1 = 61.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.40 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.76%], valid : [loss = 2.714, top1 = 32.10%], test : [loss = 2.718, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12388/15625) 012388-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.556, top1 = 88.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.09 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.346, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.61 ms.
cifar100       train : [loss = 0.139, top1 = 96.87%], valid : [loss = 1.370, top1 = 68.40%], test : [loss = 1.349, top1 = 69.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.950, top1 = 48.64%], valid : [loss = 2.317, top1 = 40.47%], test : [loss = 2.281, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.98%], valid : [loss = 0.916, top1 = 67.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12389/15625) 012389-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.65%], valid : [loss = 0.449, top1 = 86.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.70 ms.
cifar10        train : [loss = 0.128, top1 = 95.88%], test  : [loss = 0.337, top1 = 89.12%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.84 ms.
cifar100       train : [loss = 0.767, top1 = 78.52%], valid : [loss = 1.263, top1 = 64.56%], test : [loss = 1.297, top1 = 64.44%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.508, top1 = 36.47%], valid : [loss = 2.588, top1 = 34.33%], test : [loss = 2.621, top1 = 33.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.64%], valid : [loss = 0.869, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12390/15625) 012390-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.00 ms.
cifar10-valid  train : [loss = 0.371, top1 = 86.99%], valid : [loss = 0.626, top1 = 79.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10        train : [loss = 0.326, top1 = 88.65%], test  : [loss = 0.466, top1 = 84.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.16 ms.
cifar100       train : [loss = 1.526, top1 = 57.54%], valid : [loss = 1.764, top1 = 51.08%], test : [loss = 1.774, top1 = 52.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.00%], valid : [loss = 2.935, top1 = 27.90%], test : [loss = 2.990, top1 = 26.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.029, top1 = 63.11%], valid : [loss = 1.089, top1 = 61.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12391/15625) 012391-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.429, top1 = 89.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.294, top1 = 92.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.208, top1 = 95.08%], valid : [loss = 1.268, top1 = 68.93%], test : [loss = 1.249, top1 = 69.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.61%], valid : [loss = 2.272, top1 = 42.58%], test : [loss = 2.293, top1 = 42.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12392/15625) 012392-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.53 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.65%], valid : [loss = 0.867, top1 = 71.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.34 ms.
cifar10        train : [loss = 0.554, top1 = 80.71%], test  : [loss = 0.722, top1 = 75.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.68 ms.
cifar100       train : [loss = 1.783, top1 = 52.06%], valid : [loss = 2.049, top1 = 46.89%], test : [loss = 2.073, top1 = 46.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.68 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.69%], valid : [loss = 3.639, top1 = 16.73%], test : [loss = 3.675, top1 = 15.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12393/15625) 012393-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.038, top1 = 98.92%], valid : [loss = 0.575, top1 = 86.43%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.80 ms.
cifar10        train : [loss = 0.068, top1 = 97.82%], test  : [loss = 0.383, top1 = 89.84%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.89 ms.
cifar100       train : [loss = 0.654, top1 = 80.70%], valid : [loss = 1.327, top1 = 64.20%], test : [loss = 1.296, top1 = 64.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.348, top1 = 39.74%], valid : [loss = 2.484, top1 = 36.83%], test : [loss = 2.514, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.88%], valid : [loss = 0.780, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12394/15625) 012394-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.36%], valid : [loss = 0.565, top1 = 87.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10        train : [loss = 0.026, top1 = 99.18%], test  : [loss = 0.363, top1 = 91.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.353, top1 = 89.99%], valid : [loss = 1.316, top1 = 65.90%], test : [loss = 1.354, top1 = 65.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.11 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 34.89%], valid : [loss = 2.634, top1 = 33.67%], test : [loss = 2.643, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 59.28%], valid : [loss = 1.142, top1 = 58.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12395/15625) 012395-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.32%], valid : [loss = 0.538, top1 = 83.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.204, top1 = 93.16%], test  : [loss = 0.405, top1 = 86.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.02 ms.
cifar100       train : [loss = 1.259, top1 = 64.23%], valid : [loss = 1.559, top1 = 57.16%], test : [loss = 1.564, top1 = 57.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.39%], valid : [loss = 2.727, top1 = 32.33%], test : [loss = 2.729, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 66.91%], valid : [loss = 0.983, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12396/15625) 012396-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.471, top1 = 89.64%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.81 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.326, top1 = 92.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.18 ms.
cifar100       train : [loss = 0.215, top1 = 94.57%], valid : [loss = 1.226, top1 = 68.82%], test : [loss = 1.259, top1 = 69.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.25%], valid : [loss = 2.220, top1 = 42.80%], test : [loss = 2.233, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.16%], valid : [loss = 0.693, top1 = 76.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12397/15625) 012397-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.566, top1 = 88.14%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.41 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.339, top1 = 92.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.62 ms.
cifar100       train : [loss = 0.262, top1 = 92.84%], valid : [loss = 1.350, top1 = 67.54%], test : [loss = 1.333, top1 = 67.38%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.07%], valid : [loss = 2.445, top1 = 37.87%], test : [loss = 2.432, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.910, top1 = 67.26%], valid : [loss = 0.934, top1 = 66.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12398/15625) 012398-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.38%], valid : [loss = 0.871, top1 = 79.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10        train : [loss = 0.126, top1 = 95.83%], test  : [loss = 0.554, top1 = 84.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.33 ms.
cifar100       train : [loss = 0.830, top1 = 75.81%], valid : [loss = 1.660, top1 = 58.26%], test : [loss = 1.657, top1 = 58.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 3.033, top1 = 26.41%], valid : [loss = 3.185, top1 = 24.00%], test : [loss = 3.191, top1 = 23.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12399/15625) 012399-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=23.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.480, top1 = 90.39%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=21.68 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.295, top1 = 93.51%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=23.05 ms.
cifar100       train : [loss = 0.034, top1 = 99.66%], valid : [loss = 1.339, top1 = 70.26%], test : [loss = 1.315, top1 = 70.96%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=21.99 ms.
ImageNet16-120 train : [loss = 1.614, top1 = 56.67%], valid : [loss = 2.195, top1 = 43.77%], test : [loss = 2.216, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.86%], valid : [loss = 0.701, top1 = 75.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12400/15625) 012400-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.633, top1 = 86.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.55 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.428, top1 = 90.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.253, top1 = 93.41%], valid : [loss = 1.640, top1 = 62.18%], test : [loss = 1.644, top1 = 62.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.29%], valid : [loss = 2.502, top1 = 37.43%], test : [loss = 2.517, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.12%], valid : [loss = 0.765, top1 = 72.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12401/15625) 012401-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=21.77 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.45%], valid : [loss = 0.572, top1 = 87.32%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=19.06 ms.
cifar10        train : [loss = 0.039, top1 = 98.77%], test  : [loss = 0.404, top1 = 89.86%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=19.68 ms.
cifar100       train : [loss = 0.421, top1 = 87.86%], valid : [loss = 1.333, top1 = 65.52%], test : [loss = 1.312, top1 = 66.04%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=19.36 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.86%], valid : [loss = 2.339, top1 = 40.27%], test : [loss = 2.364, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 75.06%], valid : [loss = 0.756, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12402/15625) 012402-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.56 ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.25%], valid : [loss = 0.521, top1 = 82.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10        train : [loss = 0.407, top1 = 86.30%], test  : [loss = 0.466, top1 = 84.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.95 ms.
cifar100       train : [loss = 1.548, top1 = 57.64%], valid : [loss = 1.668, top1 = 54.32%], test : [loss = 1.651, top1 = 55.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 3.054, top1 = 26.11%], valid : [loss = 3.036, top1 = 26.63%], test : [loss = 3.075, top1 = 26.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.54%], valid : [loss = 1.147, top1 = 59.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12403/15625) 012403-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.20%], valid : [loss = 0.692, top1 = 84.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10        train : [loss = 0.051, top1 = 98.43%], test  : [loss = 0.443, top1 = 88.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.96 ms.
cifar100       train : [loss = 0.600, top1 = 82.59%], valid : [loss = 1.514, top1 = 61.06%], test : [loss = 1.531, top1 = 61.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.83 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 34.01%], valid : [loss = 2.798, top1 = 31.20%], test : [loss = 2.865, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.38%], valid : [loss = 0.926, top1 = 67.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12404/15625) 012404-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.446, top1 = 89.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.295, top1 = 92.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.34 ms.
cifar100       train : [loss = 0.187, top1 = 95.65%], valid : [loss = 1.363, top1 = 68.06%], test : [loss = 1.288, top1 = 68.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.81%], valid : [loss = 2.269, top1 = 43.23%], test : [loss = 2.314, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.78%], valid : [loss = 0.528, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12405/15625) 012405-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.32%], valid : [loss = 0.620, top1 = 85.27%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.066, top1 = 98.05%], test  : [loss = 0.399, top1 = 88.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.73 ms.
cifar100       train : [loss = 0.709, top1 = 79.33%], valid : [loss = 1.385, top1 = 63.41%], test : [loss = 1.367, top1 = 63.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.16%], valid : [loss = 2.657, top1 = 33.70%], test : [loss = 2.704, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12406/15625) 012406-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.27%], valid : [loss = 0.718, top1 = 84.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.055, top1 = 98.29%], test  : [loss = 0.442, top1 = 88.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.640, top1 = 81.40%], valid : [loss = 1.523, top1 = 61.62%], test : [loss = 1.504, top1 = 60.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.62%], valid : [loss = 2.792, top1 = 30.53%], test : [loss = 2.872, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.38%], valid : [loss = 0.866, top1 = 69.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12407/15625) 012407-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.50%], valid : [loss = 0.873, top1 = 79.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.136, top1 = 95.27%], test  : [loss = 0.548, top1 = 84.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.55 ms.
cifar100       train : [loss = 0.870, top1 = 74.79%], valid : [loss = 1.676, top1 = 57.50%], test : [loss = 1.675, top1 = 57.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.48 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 26.22%], valid : [loss = 3.197, top1 = 24.03%], test : [loss = 3.209, top1 = 24.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.42%], valid : [loss = 1.128, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12408/15625) 012408-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.74%], valid : [loss = 0.923, top1 = 68.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.765, top1 = 72.83%], test  : [loss = 0.818, top1 = 71.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 2.356, top1 = 38.50%], valid : [loss = 2.504, top1 = 36.18%], test : [loss = 2.477, top1 = 36.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.92 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.48%], valid : [loss = 3.569, top1 = 17.20%], test : [loss = 3.587, top1 = 15.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.456, top1 = 46.40%], valid : [loss = 1.497, top1 = 45.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12409/15625) 012409-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.69%], valid : [loss = 0.454, top1 = 86.29%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.21 ms.
cifar10        train : [loss = 0.155, top1 = 94.94%], test  : [loss = 0.339, top1 = 88.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.96 ms.
cifar100       train : [loss = 0.967, top1 = 72.51%], valid : [loss = 1.342, top1 = 62.45%], test : [loss = 1.329, top1 = 62.29%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.616, top1 = 34.18%], valid : [loss = 2.675, top1 = 33.33%], test : [loss = 2.695, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12410/15625) 012410-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.562, top1 = 88.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.66 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.361, top1 = 92.70%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.36 ms.
cifar100       train : [loss = 0.103, top1 = 98.23%], valid : [loss = 1.449, top1 = 68.12%], test : [loss = 1.474, top1 = 68.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.68%], valid : [loss = 2.403, top1 = 39.93%], test : [loss = 2.453, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12411/15625) 012411-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.476, top1 = 90.38%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.03 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.310, top1 = 93.57%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.77 ms.
cifar100       train : [loss = 0.064, top1 = 99.06%], valid : [loss = 1.309, top1 = 70.24%], test : [loss = 1.319, top1 = 70.66%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=25.98 ms.
ImageNet16-120 train : [loss = 1.591, top1 = 57.12%], valid : [loss = 2.153, top1 = 45.40%], test : [loss = 2.140, top1 = 46.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.51%], valid : [loss = 0.689, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12412/15625) 012412-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.64%], valid : [loss = 0.846, top1 = 79.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.38 ms.
cifar10        train : [loss = 0.129, top1 = 95.50%], test  : [loss = 0.525, top1 = 84.91%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.22 ms.
cifar100       train : [loss = 0.872, top1 = 74.33%], valid : [loss = 1.655, top1 = 57.36%], test : [loss = 1.655, top1 = 58.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.57%], valid : [loss = 3.190, top1 = 24.00%], test : [loss = 3.190, top1 = 23.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.111, top1 = 59.89%], valid : [loss = 1.161, top1 = 57.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12413/15625) 012413-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.539, top1 = 89.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.350, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.54 ms.
cifar100       train : [loss = 0.036, top1 = 99.64%], valid : [loss = 1.456, top1 = 69.26%], test : [loss = 1.389, top1 = 70.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 1.563, top1 = 57.84%], valid : [loss = 2.402, top1 = 40.53%], test : [loss = 2.391, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.82%], valid : [loss = 0.699, top1 = 75.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12414/15625) 012414-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.84%], valid : [loss = 0.590, top1 = 88.24%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.31 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.382, top1 = 91.61%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.75 ms.
cifar100       train : [loss = 0.277, top1 = 92.49%], valid : [loss = 1.493, top1 = 63.78%], test : [loss = 1.492, top1 = 64.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 2.357, top1 = 38.94%], valid : [loss = 2.504, top1 = 35.07%], test : [loss = 2.537, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.144, top1 = 58.70%], valid : [loss = 1.167, top1 = 57.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12415/15625) 012415-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.457, top1 = 90.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.60 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.294, top1 = 93.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.54 ms.
cifar100       train : [loss = 0.029, top1 = 99.74%], valid : [loss = 1.329, top1 = 71.50%], test : [loss = 1.321, top1 = 71.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.295, top1 = 64.42%], valid : [loss = 2.267, top1 = 44.70%], test : [loss = 2.255, top1 = 46.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.324, top1 = 89.12%], valid : [loss = 0.482, top1 = 83.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12416/15625) 012416-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.538, top1 = 88.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.21 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.326, top1 = 92.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=13.88 ms.
cifar100       train : [loss = 0.271, top1 = 92.84%], valid : [loss = 1.257, top1 = 68.20%], test : [loss = 1.297, top1 = 67.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.58%], valid : [loss = 2.312, top1 = 40.57%], test : [loss = 2.331, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.66%], valid : [loss = 0.703, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12417/15625) 012417-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.447, top1 = 89.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.313, top1 = 92.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.221, top1 = 94.56%], valid : [loss = 1.292, top1 = 68.26%], test : [loss = 1.305, top1 = 68.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.41 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.51%], valid : [loss = 2.316, top1 = 42.37%], test : [loss = 2.325, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.32%], valid : [loss = 0.541, top1 = 81.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12418/15625) 012418-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.578, top1 = 87.67%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.49 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.376, top1 = 91.05%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.79 ms.
cifar100       train : [loss = 0.404, top1 = 88.59%], valid : [loss = 1.380, top1 = 65.78%], test : [loss = 1.373, top1 = 66.30%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.50%], valid : [loss = 2.519, top1 = 36.73%], test : [loss = 2.524, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 74.80%], valid : [loss = 0.778, top1 = 73.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12419/15625) 012419-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.86%], valid : [loss = 0.645, top1 = 78.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.66 ms.
cifar10        train : [loss = 0.522, top1 = 81.94%], test  : [loss = 0.595, top1 = 79.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.08 ms.
cifar100       train : [loss = 1.687, top1 = 54.25%], valid : [loss = 1.853, top1 = 49.80%], test : [loss = 1.882, top1 = 50.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 3.337, top1 = 21.09%], valid : [loss = 3.318, top1 = 21.73%], test : [loss = 3.341, top1 = 21.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 54.05%], valid : [loss = 1.298, top1 = 53.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12420/15625) 012420-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.95 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.87 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12421/15625) 012421-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.457, top1 = 90.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.264, top1 = 93.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.79 ms.
cifar100       train : [loss = 0.061, top1 = 99.28%], valid : [loss = 1.272, top1 = 70.04%], test : [loss = 1.287, top1 = 71.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 1.498, top1 = 59.49%], valid : [loss = 2.201, top1 = 44.10%], test : [loss = 2.197, top1 = 45.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 87.17%], valid : [loss = 0.522, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12422/15625) 012422-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.650, top1 = 86.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.437, top1 = 90.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.06 ms.
cifar100       train : [loss = 0.214, top1 = 94.87%], valid : [loss = 1.617, top1 = 63.22%], test : [loss = 1.597, top1 = 64.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.02%], valid : [loss = 2.522, top1 = 36.73%], test : [loss = 2.551, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.78%], valid : [loss = 0.808, top1 = 71.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12423/15625) 012423-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.514, top1 = 88.30%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.28 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.357, top1 = 91.06%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.87 ms.
cifar100       train : [loss = 0.468, top1 = 86.16%], valid : [loss = 1.366, top1 = 65.70%], test : [loss = 1.374, top1 = 65.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.99 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.25%], valid : [loss = 2.544, top1 = 36.60%], test : [loss = 2.539, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.59%], valid : [loss = 0.655, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12424/15625) 012424-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.446, top1 = 89.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.302, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.85 ms.
cifar100       train : [loss = 0.208, top1 = 95.06%], valid : [loss = 1.286, top1 = 69.34%], test : [loss = 1.235, top1 = 69.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 1.846, top1 = 51.13%], valid : [loss = 2.233, top1 = 42.57%], test : [loss = 2.285, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.10%], valid : [loss = 0.523, top1 = 82.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12425/15625) 012425-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.80%], valid : [loss = 0.903, top1 = 76.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.212, top1 = 92.69%], test  : [loss = 0.592, top1 = 81.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 1.135, top1 = 67.60%], valid : [loss = 1.776, top1 = 54.16%], test : [loss = 1.775, top1 = 54.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 3.236, top1 = 22.59%], valid : [loss = 3.331, top1 = 22.33%], test : [loss = 3.361, top1 = 20.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.68%], valid : [loss = 1.091, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12426/15625) 012426-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.16%], valid : [loss = 0.544, top1 = 86.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.78 ms.
cifar10        train : [loss = 0.107, top1 = 96.49%], test  : [loss = 0.392, top1 = 88.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.11 ms.
cifar100       train : [loss = 0.812, top1 = 76.15%], valid : [loss = 1.391, top1 = 62.22%], test : [loss = 1.389, top1 = 62.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.43 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.04%], valid : [loss = 2.751, top1 = 31.63%], test : [loss = 2.795, top1 = 30.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12427/15625) 012427-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.493, top1 = 89.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.33 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.318, top1 = 92.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.80 ms.
cifar100       train : [loss = 0.260, top1 = 93.22%], valid : [loss = 1.261, top1 = 68.74%], test : [loss = 1.275, top1 = 67.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.61 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.25%], valid : [loss = 2.192, top1 = 43.40%], test : [loss = 2.221, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.70%], valid : [loss = 0.653, top1 = 77.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12428/15625) 012428-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.05%], valid : [loss = 0.542, top1 = 87.01%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.35 ms.
cifar10        train : [loss = 0.061, top1 = 98.10%], test  : [loss = 0.348, top1 = 90.35%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.99 ms.
cifar100       train : [loss = 0.635, top1 = 81.25%], valid : [loss = 1.306, top1 = 64.18%], test : [loss = 1.324, top1 = 65.02%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.96%], valid : [loss = 2.525, top1 = 35.33%], test : [loss = 2.579, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.89%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12429/15625) 012429-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.462, top1 = 89.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.322, top1 = 92.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.77 ms.
cifar100       train : [loss = 0.258, top1 = 93.24%], valid : [loss = 1.347, top1 = 67.20%], test : [loss = 1.319, top1 = 67.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.64%], valid : [loss = 2.339, top1 = 41.12%], test : [loss = 2.362, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.467, top1 = 83.73%], valid : [loss = 0.565, top1 = 80.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12430/15625) 012430-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.15%], valid : [loss = 0.476, top1 = 84.29%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.38 ms.
cifar10        train : [loss = 0.301, top1 = 89.89%], test  : [loss = 0.397, top1 = 86.41%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.01 ms.
cifar100       train : [loss = 1.324, top1 = 63.27%], valid : [loss = 1.543, top1 = 57.64%], test : [loss = 1.496, top1 = 58.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.936, top1 = 28.28%], valid : [loss = 2.892, top1 = 29.93%], test : [loss = 2.989, top1 = 28.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.82%], valid : [loss = 0.764, top1 = 73.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12431/15625) 012431-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.513, top1 = 88.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.336, top1 = 91.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.04 ms.
cifar100       train : [loss = 0.239, top1 = 94.05%], valid : [loss = 1.298, top1 = 66.66%], test : [loss = 1.283, top1 = 68.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 1.961, top1 = 48.48%], valid : [loss = 2.334, top1 = 39.90%], test : [loss = 2.336, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.11%], valid : [loss = 0.700, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12432/15625) 012432-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.518, top1 = 89.41%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=23.08 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.308, top1 = 93.24%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.12 ms.
cifar100       train : [loss = 0.077, top1 = 98.83%], valid : [loss = 1.285, top1 = 70.14%], test : [loss = 1.284, top1 = 70.24%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=24.20 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 55.10%], valid : [loss = 2.243, top1 = 43.93%], test : [loss = 2.239, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.78%], valid : [loss = 0.732, top1 = 74.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12433/15625) 012433-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.58%], valid : [loss = 0.611, top1 = 86.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.034, top1 = 99.06%], test  : [loss = 0.410, top1 = 89.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.96 ms.
cifar100       train : [loss = 0.514, top1 = 84.97%], valid : [loss = 1.432, top1 = 63.86%], test : [loss = 1.411, top1 = 64.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.14%], valid : [loss = 2.583, top1 = 35.33%], test : [loss = 2.589, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.48%], valid : [loss = 0.854, top1 = 69.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12434/15625) 012434-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.75 ms.
cifar10-valid  train : [loss = 0.543, top1 = 80.90%], valid : [loss = 0.732, top1 = 75.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10        train : [loss = 0.440, top1 = 84.81%], test  : [loss = 0.590, top1 = 80.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.38 ms.
cifar100       train : [loss = 1.815, top1 = 50.54%], valid : [loss = 2.016, top1 = 46.08%], test : [loss = 1.992, top1 = 47.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 3.454, top1 = 18.74%], valid : [loss = 3.445, top1 = 18.40%], test : [loss = 3.491, top1 = 17.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.222, top1 = 55.74%], valid : [loss = 1.263, top1 = 54.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12435/15625) 012435-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.59%], valid : [loss = 0.456, top1 = 87.88%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=14.97 ms.
cifar10        train : [loss = 0.053, top1 = 98.75%], test  : [loss = 0.324, top1 = 90.42%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=19.59 ms.
cifar100       train : [loss = 0.520, top1 = 86.02%], valid : [loss = 1.275, top1 = 65.60%], test : [loss = 1.270, top1 = 65.98%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.61 ms.
ImageNet16-120 train : [loss = 2.249, top1 = 41.97%], valid : [loss = 2.454, top1 = 38.73%], test : [loss = 2.470, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.32%], valid : [loss = 0.625, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12436/15625) 012436-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.62%], valid : [loss = 0.536, top1 = 88.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.359, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.73 ms.
cifar100       train : [loss = 0.442, top1 = 87.20%], valid : [loss = 1.273, top1 = 67.06%], test : [loss = 1.241, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.19%], valid : [loss = 2.352, top1 = 40.80%], test : [loss = 2.373, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12437/15625) 012437-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.26%], valid : [loss = 0.481, top1 = 84.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.68 ms.
cifar10        train : [loss = 0.296, top1 = 90.31%], test  : [loss = 0.407, top1 = 86.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.96 ms.
cifar100       train : [loss = 1.330, top1 = 63.00%], valid : [loss = 1.537, top1 = 57.76%], test : [loss = 1.523, top1 = 57.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.81%], valid : [loss = 2.890, top1 = 28.93%], test : [loss = 2.961, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12438/15625) 012438-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.456, top1 = 87.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.116, top1 = 96.47%], test  : [loss = 0.323, top1 = 89.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.29 ms.
cifar100       train : [loss = 0.866, top1 = 75.33%], valid : [loss = 1.312, top1 = 63.61%], test : [loss = 1.273, top1 = 64.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.00 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.53%], valid : [loss = 2.650, top1 = 33.57%], test : [loss = 2.658, top1 = 32.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12439/15625) 012439-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.280, top1 = 90.62%], valid : [loss = 0.481, top1 = 84.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.298, top1 = 90.02%], test  : [loss = 0.399, top1 = 86.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 1.321, top1 = 63.26%], valid : [loss = 1.534, top1 = 57.81%], test : [loss = 1.504, top1 = 58.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.78%], valid : [loss = 2.899, top1 = 29.66%], test : [loss = 2.953, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12440/15625) 012440-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.468, top1 = 88.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.22 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.307, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 0.327, top1 = 91.09%], valid : [loss = 1.309, top1 = 67.00%], test : [loss = 1.308, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.32%], valid : [loss = 2.385, top1 = 39.76%], test : [loss = 2.403, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.37%], valid : [loss = 0.560, top1 = 81.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12441/15625) 012441-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.33%], valid : [loss = 0.611, top1 = 85.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.402, top1 = 88.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.01 ms.
cifar100       train : [loss = 0.709, top1 = 79.35%], valid : [loss = 1.383, top1 = 63.02%], test : [loss = 1.368, top1 = 63.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.82%], valid : [loss = 2.662, top1 = 33.43%], test : [loss = 2.712, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12442/15625) 012442-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.592, top1 = 87.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.388, top1 = 90.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.32 ms.
cifar100       train : [loss = 0.396, top1 = 88.69%], valid : [loss = 1.400, top1 = 65.64%], test : [loss = 1.393, top1 = 65.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.94%], valid : [loss = 2.514, top1 = 36.97%], test : [loss = 2.546, top1 = 36.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12443/15625) 012443-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.055, top1 = 98.44%], valid : [loss = 0.605, top1 = 85.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10        train : [loss = 0.105, top1 = 96.53%], test  : [loss = 0.401, top1 = 88.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.55 ms.
cifar100       train : [loss = 0.837, top1 = 75.53%], valid : [loss = 1.401, top1 = 62.64%], test : [loss = 1.405, top1 = 62.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.683, top1 = 32.75%], valid : [loss = 2.785, top1 = 31.13%], test : [loss = 2.826, top1 = 29.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.06%], valid : [loss = 0.700, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12444/15625) 012444-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.523, top1 = 88.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.328, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.361, top1 = 89.75%], valid : [loss = 1.246, top1 = 67.57%], test : [loss = 1.254, top1 = 67.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.74%], valid : [loss = 2.308, top1 = 40.45%], test : [loss = 2.336, top1 = 40.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.71%], valid : [loss = 0.815, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12445/15625) 012445-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.92%], valid : [loss = 0.477, top1 = 84.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.63 ms.
cifar10        train : [loss = 0.294, top1 = 90.20%], test  : [loss = 0.394, top1 = 86.29%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.42 ms.
cifar100       train : [loss = 1.346, top1 = 62.91%], valid : [loss = 1.542, top1 = 57.38%], test : [loss = 1.531, top1 = 58.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.64%], valid : [loss = 2.911, top1 = 29.87%], test : [loss = 2.968, top1 = 27.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.56%], valid : [loss = 0.745, top1 = 73.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12446/15625) 012446-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.511, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.344, top1 = 91.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.04 ms.
cifar100       train : [loss = 0.351, top1 = 90.24%], valid : [loss = 1.273, top1 = 67.12%], test : [loss = 1.306, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.45 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.51%], valid : [loss = 2.410, top1 = 37.87%], test : [loss = 2.412, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12447/15625) 012447-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.60%], valid : [loss = 0.585, top1 = 87.62%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.06 ms.
cifar10        train : [loss = 0.019, top1 = 99.47%], test  : [loss = 0.429, top1 = 90.48%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.41 ms.
cifar100       train : [loss = 0.320, top1 = 91.21%], valid : [loss = 1.443, top1 = 64.76%], test : [loss = 1.417, top1 = 64.56%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.55 ms.
ImageNet16-120 train : [loss = 3.128, top1 = 23.01%], valid : [loss = 3.159, top1 = 22.43%], test : [loss = 3.168, top1 = 21.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.83%], valid : [loss = 1.205, top1 = 56.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12448/15625) 012448-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.20%], valid : [loss = 0.608, top1 = 85.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.65 ms.
cifar10        train : [loss = 0.073, top1 = 97.71%], test  : [loss = 0.390, top1 = 89.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.712, top1 = 79.26%], valid : [loss = 1.390, top1 = 63.11%], test : [loss = 1.391, top1 = 62.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.88%], valid : [loss = 2.660, top1 = 33.47%], test : [loss = 2.694, top1 = 32.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12449/15625) 012449-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.520, top1 = 88.04%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.05 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.334, top1 = 91.58%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.77 ms.
cifar100       train : [loss = 0.404, top1 = 88.90%], valid : [loss = 1.283, top1 = 66.12%], test : [loss = 1.295, top1 = 66.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.56 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.40%], valid : [loss = 2.289, top1 = 41.07%], test : [loss = 2.307, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.76%], valid : [loss = 0.765, top1 = 73.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12450/15625) 012450-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.076, top1 = 97.91%], valid : [loss = 0.571, top1 = 85.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.22 ms.
cifar10        train : [loss = 0.111, top1 = 96.33%], test  : [loss = 0.363, top1 = 89.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.90 ms.
cifar100       train : [loss = 0.770, top1 = 77.65%], valid : [loss = 1.339, top1 = 63.88%], test : [loss = 1.303, top1 = 64.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 35.99%], valid : [loss = 2.590, top1 = 35.00%], test : [loss = 2.617, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 68.89%], valid : [loss = 0.913, top1 = 67.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12451/15625) 012451-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.424, top1 = 91.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.295, top1 = 93.70%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.87 ms.
cifar100       train : [loss = 0.066, top1 = 99.07%], valid : [loss = 1.360, top1 = 70.10%], test : [loss = 1.347, top1 = 70.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 1.547, top1 = 58.27%], valid : [loss = 2.220, top1 = 44.17%], test : [loss = 2.273, top1 = 44.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12452/15625) 012452-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.533, top1 = 88.34%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.89 ms.
cifar10        train : [loss = 0.021, top1 = 99.46%], test  : [loss = 0.365, top1 = 91.35%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.43 ms.
cifar100       train : [loss = 0.368, top1 = 89.69%], valid : [loss = 1.329, top1 = 67.28%], test : [loss = 1.291, top1 = 67.28%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.21%], valid : [loss = 2.384, top1 = 40.03%], test : [loss = 2.383, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.62%], valid : [loss = 0.621, top1 = 78.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12453/15625) 012453-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.07%], valid : [loss = 0.478, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 0.299, top1 = 89.96%], test  : [loss = 0.399, top1 = 86.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.40 ms.
cifar100       train : [loss = 1.316, top1 = 63.73%], valid : [loss = 1.523, top1 = 57.74%], test : [loss = 1.510, top1 = 58.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.71 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.60%], valid : [loss = 2.898, top1 = 29.73%], test : [loss = 2.984, top1 = 26.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12454/15625) 012454-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.77 ms.
cifar10-valid  train : [loss = 0.034, top1 = 98.97%], valid : [loss = 0.570, top1 = 86.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.77 ms.
cifar10        train : [loss = 0.067, top1 = 97.85%], test  : [loss = 0.383, top1 = 89.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.77 ms.
cifar100       train : [loss = 0.789, top1 = 77.07%], valid : [loss = 1.386, top1 = 62.74%], test : [loss = 1.401, top1 = 62.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.344, top1 = 39.88%], valid : [loss = 2.448, top1 = 37.43%], test : [loss = 2.509, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 74.30%], valid : [loss = 0.791, top1 = 72.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12455/15625) 012455-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.88%], valid : [loss = 0.526, top1 = 87.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.54 ms.
cifar10        train : [loss = 0.074, top1 = 97.67%], test  : [loss = 0.346, top1 = 90.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.27 ms.
cifar100       train : [loss = 0.711, top1 = 79.03%], valid : [loss = 1.342, top1 = 64.52%], test : [loss = 1.318, top1 = 64.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.14%], valid : [loss = 2.636, top1 = 33.60%], test : [loss = 2.685, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.84%], valid : [loss = 0.664, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12456/15625) 012456-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.515, top1 = 89.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.327, top1 = 92.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.15 ms.
cifar100       train : [loss = 0.141, top1 = 97.02%], valid : [loss = 1.333, top1 = 67.66%], test : [loss = 1.334, top1 = 70.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.03%], valid : [loss = 2.193, top1 = 44.07%], test : [loss = 2.189, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.78%], valid : [loss = 0.694, top1 = 75.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12457/15625) 012457-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.76%], valid : [loss = 0.591, top1 = 87.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10        train : [loss = 0.022, top1 = 99.43%], test  : [loss = 0.396, top1 = 90.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.56 ms.
cifar100       train : [loss = 0.429, top1 = 87.64%], valid : [loss = 1.414, top1 = 65.18%], test : [loss = 1.402, top1 = 64.78%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.314, top1 = 40.63%], valid : [loss = 2.517, top1 = 37.30%], test : [loss = 2.558, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 71.06%], valid : [loss = 0.882, top1 = 69.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12458/15625) 012458-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.78%], valid : [loss = 0.529, top1 = 88.02%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.44 ms.
cifar10        train : [loss = 0.028, top1 = 99.28%], test  : [loss = 0.361, top1 = 90.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.483, top1 = 85.77%], valid : [loss = 1.344, top1 = 65.40%], test : [loss = 1.353, top1 = 65.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.51 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.13%], valid : [loss = 2.502, top1 = 37.47%], test : [loss = 2.554, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12459/15625) 012459-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.66%], valid : [loss = 0.611, top1 = 84.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10        train : [loss = 0.085, top1 = 97.25%], test  : [loss = 0.399, top1 = 88.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.83 ms.
cifar100       train : [loss = 0.700, top1 = 79.34%], valid : [loss = 1.513, top1 = 59.80%], test : [loss = 1.547, top1 = 60.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 3.220, top1 = 21.55%], valid : [loss = 3.237, top1 = 21.93%], test : [loss = 3.265, top1 = 20.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.065, top1 = 61.71%], valid : [loss = 1.070, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12460/15625) 012460-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.34%], valid : [loss = 0.631, top1 = 85.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.80 ms.
cifar10        train : [loss = 0.054, top1 = 98.41%], test  : [loss = 0.402, top1 = 89.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 0.676, top1 = 80.17%], valid : [loss = 1.403, top1 = 63.30%], test : [loss = 1.374, top1 = 64.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.13%], valid : [loss = 2.619, top1 = 34.23%], test : [loss = 2.625, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.88%], valid : [loss = 0.826, top1 = 71.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12461/15625) 012461-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.550, top1 = 87.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.406, top1 = 90.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.73 ms.
cifar100       train : [loss = 0.352, top1 = 90.14%], valid : [loss = 1.338, top1 = 66.18%], test : [loss = 1.328, top1 = 67.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.32%], valid : [loss = 2.476, top1 = 37.27%], test : [loss = 2.492, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.12%], valid : [loss = 0.868, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12462/15625) 012462-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.91%], valid : [loss = 0.480, top1 = 84.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10        train : [loss = 0.302, top1 = 89.96%], test  : [loss = 0.407, top1 = 86.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.338, top1 = 62.87%], valid : [loss = 1.544, top1 = 57.49%], test : [loss = 1.512, top1 = 58.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.57%], valid : [loss = 2.906, top1 = 29.44%], test : [loss = 2.973, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12463/15625) 012463-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.16 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12464/15625) 012464-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.883 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.97%]
cifar10        FLOP=125.75 M, Params=0.883 MB, latency=19.16 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.91%]
cifar100       FLOP=125.75 M, Params=0.889 MB, latency=18.32 ms.
cifar100       train : [loss = 0.048, top1 = 99.48%], valid : [loss = 1.365, top1 = 70.41%], test : [loss = 1.327, top1 = 70.78%]
ImageNet16-120 FLOP= 31.44 M, Params=0.891 MB, latency=19.04 ms.
ImageNet16-120 train : [loss = 1.456, top1 = 60.43%], valid : [loss = 2.250, top1 = 43.77%], test : [loss = 2.250, top1 = 44.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.340, top1 = 88.36%], valid : [loss = 0.481, top1 = 84.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12465/15625) 012465-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.55%], valid : [loss = 0.448, top1 = 87.88%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.29 ms.
cifar10        train : [loss = 0.054, top1 = 98.70%], test  : [loss = 0.309, top1 = 90.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.61 ms.
cifar100       train : [loss = 0.588, top1 = 83.78%], valid : [loss = 1.241, top1 = 66.14%], test : [loss = 1.206, top1 = 66.76%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.06%], valid : [loss = 2.448, top1 = 38.03%], test : [loss = 2.490, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.95%], valid : [loss = 0.660, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12466/15625) 012466-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.405, top1 = 91.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.42 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.266, top1 = 93.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.77 ms.
cifar100       train : [loss = 0.045, top1 = 99.51%], valid : [loss = 1.328, top1 = 70.80%], test : [loss = 1.333, top1 = 70.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.47 ms.
ImageNet16-120 train : [loss = 1.402, top1 = 61.89%], valid : [loss = 2.163, top1 = 45.33%], test : [loss = 2.193, top1 = 46.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.38%], valid : [loss = 0.480, top1 = 83.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12467/15625) 012467-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.10%], valid : [loss = 0.498, top1 = 84.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.47 ms.
cifar10        train : [loss = 0.241, top1 = 91.86%], test  : [loss = 0.398, top1 = 86.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.28 ms.
cifar100       train : [loss = 1.213, top1 = 65.91%], valid : [loss = 1.503, top1 = 58.70%], test : [loss = 1.512, top1 = 58.06%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 3.441, top1 = 18.79%], valid : [loss = 3.422, top1 = 19.67%], test : [loss = 3.472, top1 = 18.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.82%], valid : [loss = 1.022, top1 = 63.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12468/15625) 012468-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.02%], valid : [loss = 0.845, top1 = 71.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.88 ms.
cifar10        train : [loss = 0.563, top1 = 80.29%], test  : [loss = 0.707, top1 = 75.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 1.795, top1 = 51.82%], valid : [loss = 2.071, top1 = 47.04%], test : [loss = 2.061, top1 = 46.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 16.68%], valid : [loss = 3.655, top1 = 16.57%], test : [loss = 3.676, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.193, top1 = 56.80%], valid : [loss = 1.245, top1 = 55.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12469/15625) 012469-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.520, top1 = 89.60%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.328, top1 = 93.14%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.32 ms.
cifar100       train : [loss = 0.070, top1 = 98.95%], valid : [loss = 1.358, top1 = 69.46%], test : [loss = 1.336, top1 = 69.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.89%], valid : [loss = 2.362, top1 = 39.83%], test : [loss = 2.395, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12470/15625) 012470-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.04%], valid : [loss = 0.933, top1 = 77.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.19 ms.
cifar10        train : [loss = 0.157, top1 = 94.57%], test  : [loss = 0.566, top1 = 84.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 0.910, top1 = 73.57%], valid : [loss = 1.633, top1 = 57.32%], test : [loss = 1.628, top1 = 58.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 3.061, top1 = 25.92%], valid : [loss = 3.177, top1 = 24.73%], test : [loss = 3.227, top1 = 23.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.98%], valid : [loss = 1.112, top1 = 59.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12471/15625) 012471-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.325, top1 = 92.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.57 ms.
cifar100       train : [loss = 0.268, top1 = 92.94%], valid : [loss = 1.205, top1 = 69.54%], test : [loss = 1.275, top1 = 68.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.25%], valid : [loss = 2.240, top1 = 42.00%], test : [loss = 2.251, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.35%], valid : [loss = 0.638, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12472/15625) 012472-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.144, top1 = 95.36%], valid : [loss = 0.555, top1 = 84.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10        train : [loss = 0.194, top1 = 93.44%], test  : [loss = 0.409, top1 = 87.06%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.52 ms.
cifar100       train : [loss = 1.049, top1 = 69.36%], valid : [loss = 1.554, top1 = 58.18%], test : [loss = 1.570, top1 = 58.06%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 32.87%], valid : [loss = 2.743, top1 = 31.57%], test : [loss = 2.792, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.29%], valid : [loss = 0.964, top1 = 65.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12473/15625) 012473-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.575, top1 = 87.28%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.60 ms.
cifar10        train : [loss = 0.018, top1 = 99.54%], test  : [loss = 0.340, top1 = 91.92%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.98 ms.
cifar100       train : [loss = 0.269, top1 = 92.33%], valid : [loss = 1.314, top1 = 67.68%], test : [loss = 1.377, top1 = 67.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.460, top1 = 37.08%], valid : [loss = 2.584, top1 = 34.93%], test : [loss = 2.590, top1 = 34.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.34%], valid : [loss = 1.013, top1 = 63.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12474/15625) 012474-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.45 ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.05%], valid : [loss = 0.633, top1 = 78.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.72 ms.
cifar10        train : [loss = 0.527, top1 = 81.73%], test  : [loss = 0.599, top1 = 79.42%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.85 ms.
cifar100       train : [loss = 1.718, top1 = 53.78%], valid : [loss = 1.871, top1 = 49.66%], test : [loss = 1.900, top1 = 49.46%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.50 ms.
ImageNet16-120 train : [loss = 3.318, top1 = 21.37%], valid : [loss = 3.312, top1 = 21.83%], test : [loss = 3.348, top1 = 20.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12475/15625) 012475-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.09%], valid : [loss = 0.478, top1 = 84.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10        train : [loss = 0.299, top1 = 90.00%], test  : [loss = 0.398, top1 = 86.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.93 ms.
cifar100       train : [loss = 1.337, top1 = 62.91%], valid : [loss = 1.536, top1 = 57.75%], test : [loss = 1.510, top1 = 58.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.66%], valid : [loss = 2.907, top1 = 29.10%], test : [loss = 2.959, top1 = 28.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12476/15625) 012476-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.390, top1 = 91.36%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.256, top1 = 93.94%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.84 ms.
cifar100       train : [loss = 0.054, top1 = 99.35%], valid : [loss = 1.277, top1 = 71.06%], test : [loss = 1.278, top1 = 70.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.412, top1 = 61.56%], valid : [loss = 2.190, top1 = 45.67%], test : [loss = 2.191, top1 = 44.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 88.06%], valid : [loss = 0.498, top1 = 83.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12477/15625) 012477-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.493, top1 = 90.22%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.302, top1 = 93.49%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.22 ms.
cifar100       train : [loss = 0.067, top1 = 99.00%], valid : [loss = 1.337, top1 = 69.58%], test : [loss = 1.322, top1 = 70.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.28 ms.
ImageNet16-120 train : [loss = 1.590, top1 = 57.08%], valid : [loss = 2.165, top1 = 45.73%], test : [loss = 2.178, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.74%], valid : [loss = 0.622, top1 = 78.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12478/15625) 012478-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.476, top1 = 89.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.313, top1 = 92.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.140, top1 = 97.14%], valid : [loss = 1.265, top1 = 69.43%], test : [loss = 1.286, top1 = 69.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 1.764, top1 = 53.05%], valid : [loss = 2.174, top1 = 44.04%], test : [loss = 2.211, top1 = 43.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.22%], valid : [loss = 0.628, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12479/15625) 012479-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.236, top1 = 91.88%], valid : [loss = 0.524, top1 = 83.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10        train : [loss = 0.239, top1 = 91.86%], test  : [loss = 0.386, top1 = 87.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 1.330, top1 = 62.50%], valid : [loss = 1.602, top1 = 56.89%], test : [loss = 1.578, top1 = 56.71%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.840, top1 = 29.93%], valid : [loss = 2.868, top1 = 29.22%], test : [loss = 2.911, top1 = 28.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.41%], valid : [loss = 0.984, top1 = 65.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12480/15625) 012480-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.43%], valid : [loss = 0.609, top1 = 86.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10        train : [loss = 0.040, top1 = 98.78%], test  : [loss = 0.409, top1 = 89.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.98 ms.
cifar100       train : [loss = 0.403, top1 = 88.36%], valid : [loss = 1.534, top1 = 62.67%], test : [loss = 1.565, top1 = 62.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.759, top1 = 30.68%], valid : [loss = 2.848, top1 = 29.16%], test : [loss = 2.870, top1 = 28.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.07%], valid : [loss = 1.020, top1 = 63.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12481/15625) 012481-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.543, top1 = 89.23%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.67 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.356, top1 = 92.74%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.42 ms.
cifar100       train : [loss = 0.082, top1 = 98.42%], valid : [loss = 1.413, top1 = 68.77%], test : [loss = 1.431, top1 = 68.77%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.65 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.50%], valid : [loss = 2.311, top1 = 41.37%], test : [loss = 2.289, top1 = 42.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.51%], valid : [loss = 0.856, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12482/15625) 012482-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.54%], valid : [loss = 0.657, top1 = 77.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.538, top1 = 81.40%], test  : [loss = 0.613, top1 = 79.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 1.698, top1 = 54.02%], valid : [loss = 1.857, top1 = 50.77%], test : [loss = 1.869, top1 = 51.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 3.342, top1 = 21.03%], valid : [loss = 3.317, top1 = 21.10%], test : [loss = 3.356, top1 = 21.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.261, top1 = 54.63%], valid : [loss = 1.284, top1 = 54.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12483/15625) 012483-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.561, top1 = 89.17%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.46 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.341, top1 = 93.01%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.14 ms.
cifar100       train : [loss = 0.079, top1 = 98.62%], valid : [loss = 1.430, top1 = 68.37%], test : [loss = 1.410, top1 = 68.79%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.56%], valid : [loss = 2.412, top1 = 38.62%], test : [loss = 2.410, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.18%], valid : [loss = 1.010, top1 = 63.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12484/15625) 012484-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.83%], valid : [loss = 0.515, top1 = 84.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.186, top1 = 93.74%], test  : [loss = 0.379, top1 = 87.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 1.224, top1 = 65.24%], valid : [loss = 1.541, top1 = 58.07%], test : [loss = 1.529, top1 = 58.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 2.741, top1 = 31.91%], valid : [loss = 2.750, top1 = 31.70%], test : [loss = 2.817, top1 = 30.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.038, top1 = 62.81%], valid : [loss = 1.089, top1 = 61.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12485/15625) 012485-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.16 ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.62%], valid : [loss = 0.861, top1 = 71.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10        train : [loss = 0.561, top1 = 80.40%], test  : [loss = 0.709, top1 = 75.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.93 ms.
cifar100       train : [loss = 1.777, top1 = 52.26%], valid : [loss = 2.031, top1 = 47.27%], test : [loss = 2.075, top1 = 46.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.75%], valid : [loss = 3.643, top1 = 16.13%], test : [loss = 3.664, top1 = 15.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12486/15625) 012486-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.48%], valid : [loss = 0.916, top1 = 76.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.220, top1 = 92.42%], test  : [loss = 0.597, top1 = 82.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 1.168, top1 = 66.77%], valid : [loss = 1.786, top1 = 53.75%], test : [loss = 1.786, top1 = 54.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.61 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.82%], valid : [loss = 3.340, top1 = 21.19%], test : [loss = 3.377, top1 = 20.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.014, top1 = 63.92%], valid : [loss = 1.068, top1 = 62.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12487/15625) 012487-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.500, top1 = 88.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.335, top1 = 92.06%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.70 ms.
cifar100       train : [loss = 0.326, top1 = 91.17%], valid : [loss = 1.295, top1 = 67.13%], test : [loss = 1.293, top1 = 67.33%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.09%], valid : [loss = 2.399, top1 = 39.20%], test : [loss = 2.410, top1 = 39.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.17%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12488/15625) 012488-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.500, top1 = 88.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.315, top1 = 92.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.84 ms.
cifar100       train : [loss = 0.308, top1 = 91.74%], valid : [loss = 1.265, top1 = 67.95%], test : [loss = 1.260, top1 = 67.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.09%], valid : [loss = 2.307, top1 = 40.73%], test : [loss = 2.328, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.31%], valid : [loss = 0.619, top1 = 78.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12489/15625) 012489-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.486, top1 = 89.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.315, top1 = 93.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.34 ms.
cifar100       train : [loss = 0.084, top1 = 98.46%], valid : [loss = 1.410, top1 = 69.81%], test : [loss = 1.398, top1 = 69.50%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.05%], valid : [loss = 2.311, top1 = 42.50%], test : [loss = 2.285, top1 = 42.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.60%], valid : [loss = 0.635, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12490/15625) 012490-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.48%], valid : [loss = 0.610, top1 = 86.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10        train : [loss = 0.037, top1 = 98.95%], test  : [loss = 0.414, top1 = 89.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.588, top1 = 82.62%], valid : [loss = 1.422, top1 = 62.92%], test : [loss = 1.419, top1 = 63.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.354, top1 = 39.76%], valid : [loss = 2.540, top1 = 36.02%], test : [loss = 2.569, top1 = 36.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.44%], valid : [loss = 0.911, top1 = 67.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12491/15625) 012491-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=21.92 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.492, top1 = 89.95%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=21.57 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.297, top1 = 93.62%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.51 ms.
cifar100       train : [loss = 0.031, top1 = 99.66%], valid : [loss = 1.381, top1 = 70.64%], test : [loss = 1.375, top1 = 70.41%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=22.55 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.12%], valid : [loss = 2.314, top1 = 40.97%], test : [loss = 2.320, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.58%], valid : [loss = 0.815, top1 = 71.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12492/15625) 012492-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.519, top1 = 89.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.87 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.337, top1 = 92.90%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.23 ms.
cifar100       train : [loss = 0.090, top1 = 98.34%], valid : [loss = 1.285, top1 = 70.57%], test : [loss = 1.320, top1 = 70.75%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 47.84%], valid : [loss = 2.327, top1 = 40.48%], test : [loss = 2.328, top1 = 40.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.76%], valid : [loss = 0.810, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12493/15625) 012493-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.560, top1 = 87.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.372, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.68 ms.
cifar100       train : [loss = 0.383, top1 = 89.21%], valid : [loss = 1.391, top1 = 65.17%], test : [loss = 1.383, top1 = 65.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.04%], valid : [loss = 2.458, top1 = 37.46%], test : [loss = 2.477, top1 = 37.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.70%], valid : [loss = 0.741, top1 = 74.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12494/15625) 012494-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.492, top1 = 90.08%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.315, top1 = 93.12%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.22 ms.
cifar100       train : [loss = 0.120, top1 = 97.65%], valid : [loss = 1.322, top1 = 69.18%], test : [loss = 1.349, top1 = 69.53%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.722, top1 = 53.98%], valid : [loss = 2.195, top1 = 43.52%], test : [loss = 2.226, top1 = 43.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.70%], valid : [loss = 0.608, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12495/15625) 012495-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.478, top1 = 89.45%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.331, top1 = 92.27%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.18 ms.
cifar100       train : [loss = 0.194, top1 = 95.38%], valid : [loss = 1.320, top1 = 68.23%], test : [loss = 1.279, top1 = 69.00%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.72%], valid : [loss = 2.288, top1 = 41.62%], test : [loss = 2.300, top1 = 41.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.52%], valid : [loss = 0.583, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12496/15625) 012496-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.37%], valid : [loss = 0.539, top1 = 87.10%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.17 ms.
cifar10        train : [loss = 0.055, top1 = 98.36%], test  : [loss = 0.354, top1 = 90.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.49 ms.
cifar100       train : [loss = 0.628, top1 = 81.51%], valid : [loss = 1.326, top1 = 65.33%], test : [loss = 1.309, top1 = 65.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.73%], valid : [loss = 2.497, top1 = 37.42%], test : [loss = 2.541, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.29%], valid : [loss = 0.625, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12497/15625) 012497-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.48%], valid : [loss = 0.446, top1 = 86.47%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.10 ms.
cifar10        train : [loss = 0.151, top1 = 95.09%], test  : [loss = 0.339, top1 = 89.09%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.56 ms.
cifar100       train : [loss = 0.980, top1 = 72.23%], valid : [loss = 1.341, top1 = 62.54%], test : [loss = 1.336, top1 = 62.39%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 2.631, top1 = 33.95%], valid : [loss = 2.680, top1 = 32.75%], test : [loss = 2.703, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12498/15625) 012498-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.65 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.90%], valid : [loss = 0.782, top1 = 82.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.085, top1 = 97.29%], test  : [loss = 0.485, top1 = 86.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 0.803, top1 = 76.52%], valid : [loss = 1.526, top1 = 60.46%], test : [loss = 1.515, top1 = 60.81%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.810, top1 = 30.36%], valid : [loss = 2.934, top1 = 28.48%], test : [loss = 2.994, top1 = 28.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12499/15625) 012499-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.619, top1 = 85.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.075, top1 = 97.70%], test  : [loss = 0.395, top1 = 88.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.718, top1 = 79.17%], valid : [loss = 1.407, top1 = 62.85%], test : [loss = 1.388, top1 = 63.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.87%], valid : [loss = 2.654, top1 = 34.28%], test : [loss = 2.712, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12500/15625) 012500-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.500, top1 = 89.44%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.317, top1 = 92.67%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.27 ms.
cifar100       train : [loss = 0.136, top1 = 97.23%], valid : [loss = 1.318, top1 = 68.85%], test : [loss = 1.306, top1 = 69.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.27%], valid : [loss = 2.278, top1 = 42.58%], test : [loss = 2.287, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.62%], valid : [loss = 0.628, top1 = 78.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12501/15625) 012501-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.533, top1 = 89.57%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.10 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.327, top1 = 93.10%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.98 ms.
cifar100       train : [loss = 0.056, top1 = 99.14%], valid : [loss = 1.364, top1 = 69.93%], test : [loss = 1.373, top1 = 69.80%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 47.73%], valid : [loss = 2.349, top1 = 40.02%], test : [loss = 2.356, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.16%], valid : [loss = 0.885, top1 = 68.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12502/15625) 012502-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.79%], valid : [loss = 0.452, top1 = 86.40%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10        train : [loss = 0.148, top1 = 95.21%], test  : [loss = 0.334, top1 = 89.28%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.35 ms.
cifar100       train : [loss = 0.963, top1 = 72.60%], valid : [loss = 1.343, top1 = 62.25%], test : [loss = 1.346, top1 = 62.09%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.97%], valid : [loss = 2.693, top1 = 32.62%], test : [loss = 2.711, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.35%], valid : [loss = 0.721, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12503/15625) 012503-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.556, top1 = 88.65%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.365, top1 = 92.53%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.65 ms.
cifar100       train : [loss = 0.086, top1 = 98.53%], valid : [loss = 1.471, top1 = 67.69%], test : [loss = 1.492, top1 = 67.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 51.00%], valid : [loss = 2.431, top1 = 39.15%], test : [loss = 2.442, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.50%], valid : [loss = 0.751, top1 = 73.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12504/15625) 012504-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.522, top1 = 88.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.314, top1 = 92.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.66 ms.
cifar100       train : [loss = 0.327, top1 = 91.11%], valid : [loss = 1.287, top1 = 67.16%], test : [loss = 1.319, top1 = 66.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.83%], valid : [loss = 2.387, top1 = 39.18%], test : [loss = 2.417, top1 = 38.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12505/15625) 012505-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.518, top1 = 88.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.321, top1 = 92.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 0.328, top1 = 91.19%], valid : [loss = 1.271, top1 = 67.29%], test : [loss = 1.298, top1 = 67.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.71%], valid : [loss = 2.406, top1 = 39.20%], test : [loss = 2.407, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12506/15625) 012506-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.474, top1 = 89.16%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.304, top1 = 92.61%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.71 ms.
cifar100       train : [loss = 0.260, top1 = 93.25%], valid : [loss = 1.209, top1 = 69.19%], test : [loss = 1.221, top1 = 69.11%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.28%], valid : [loss = 2.180, top1 = 43.15%], test : [loss = 2.187, top1 = 43.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.93%], valid : [loss = 0.748, top1 = 73.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12507/15625) 012507-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.43%], valid : [loss = 0.453, top1 = 86.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.14 ms.
cifar10        train : [loss = 0.147, top1 = 95.29%], test  : [loss = 0.344, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.33 ms.
cifar100       train : [loss = 0.960, top1 = 72.74%], valid : [loss = 1.334, top1 = 62.63%], test : [loss = 1.330, top1 = 62.99%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 34.58%], valid : [loss = 2.656, top1 = 33.65%], test : [loss = 2.683, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12508/15625) 012508-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.434, top1 = 90.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.302, top1 = 92.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.19 ms.
cifar100       train : [loss = 0.163, top1 = 96.35%], valid : [loss = 1.286, top1 = 69.02%], test : [loss = 1.286, top1 = 69.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 1.769, top1 = 52.87%], valid : [loss = 2.252, top1 = 42.73%], test : [loss = 2.289, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 84.87%], valid : [loss = 0.542, top1 = 81.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12509/15625) 012509-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.587, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.379, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.168, top1 = 96.37%], valid : [loss = 1.393, top1 = 66.63%], test : [loss = 1.455, top1 = 67.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 1.977, top1 = 48.19%], valid : [loss = 2.478, top1 = 38.88%], test : [loss = 2.470, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12510/15625) 012510-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10-valid  train : [loss = 1.638, top1 = 39.29%], valid : [loss = 1.658, top1 = 38.51%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10        train : [loss = 1.326, top1 = 51.91%], test  : [loss = 1.337, top1 = 51.01%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.39 ms.
cifar100       train : [loss = 3.874, top1 = 10.52%], valid : [loss = 3.925, top1 = 9.60%], test : [loss = 3.923, top1 = 10.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.06 ms.
ImageNet16-120 train : [loss = 3.990, top1 = 10.52%], valid : [loss = 3.984, top1 = 10.92%], test : [loss = 4.004, top1 = 10.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.985, top1 = 26.02%], valid : [loss = 1.993, top1 = 25.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12511/15625) 012511-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10-valid  train : [loss = 1.244, top1 = 55.16%], valid : [loss = 1.292, top1 = 53.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10        train : [loss = 1.176, top1 = 57.97%], test  : [loss = 1.182, top1 = 57.70%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.33 ms.
cifar100       train : [loss = 2.744, top1 = 31.49%], valid : [loss = 2.824, top1 = 30.22%], test : [loss = 2.801, top1 = 30.63%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.54 ms.
ImageNet16-120 train : [loss = 3.868, top1 = 12.42%], valid : [loss = 3.865, top1 = 13.05%], test : [loss = 3.882, top1 = 12.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.714, top1 = 35.38%], valid : [loss = 1.720, top1 = 34.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12512/15625) 012512-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.578, top1 = 87.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.389, top1 = 91.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 0.389, top1 = 88.99%], valid : [loss = 1.381, top1 = 65.96%], test : [loss = 1.392, top1 = 65.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.78%], valid : [loss = 2.512, top1 = 36.91%], test : [loss = 2.530, top1 = 36.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12513/15625) 012513-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.153, top1 = 95.01%], valid : [loss = 0.504, top1 = 85.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10        train : [loss = 0.172, top1 = 94.22%], test  : [loss = 0.365, top1 = 88.52%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.87 ms.
cifar100       train : [loss = 1.026, top1 = 70.46%], valid : [loss = 1.393, top1 = 61.41%], test : [loss = 1.378, top1 = 62.07%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.78 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.56%], valid : [loss = 2.634, top1 = 34.30%], test : [loss = 2.689, top1 = 33.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.44%], valid : [loss = 0.917, top1 = 67.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12514/15625) 012514-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.22%], valid : [loss = 0.675, top1 = 84.57%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.067, top1 = 97.90%], test  : [loss = 0.456, top1 = 88.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.34 ms.
cifar100       train : [loss = 0.689, top1 = 79.92%], valid : [loss = 1.450, top1 = 62.22%], test : [loss = 1.426, top1 = 62.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.65%], valid : [loss = 2.695, top1 = 32.25%], test : [loss = 2.722, top1 = 32.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.45%], valid : [loss = 0.872, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12515/15625) 012515-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.547, top1 = 88.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.348, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.01 ms.
cifar100       train : [loss = 0.286, top1 = 92.01%], valid : [loss = 1.351, top1 = 67.07%], test : [loss = 1.313, top1 = 67.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.40%], valid : [loss = 2.442, top1 = 38.68%], test : [loss = 2.427, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.28%], valid : [loss = 0.900, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12516/15625) 012516-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.50%], valid : [loss = 0.457, top1 = 86.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.153, top1 = 95.04%], test  : [loss = 0.339, top1 = 88.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.13 ms.
cifar100       train : [loss = 0.984, top1 = 71.92%], valid : [loss = 1.349, top1 = 62.33%], test : [loss = 1.339, top1 = 62.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.20%], valid : [loss = 2.660, top1 = 33.62%], test : [loss = 2.695, top1 = 32.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.75%], valid : [loss = 0.791, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12517/15625) 012517-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.10%], valid : [loss = 0.685, top1 = 84.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.087, top1 = 97.21%], test  : [loss = 0.473, top1 = 87.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.50 ms.
cifar100       train : [loss = 0.814, top1 = 76.28%], valid : [loss = 1.599, top1 = 59.40%], test : [loss = 1.553, top1 = 59.90%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.776, top1 = 31.03%], valid : [loss = 2.902, top1 = 29.23%], test : [loss = 2.951, top1 = 28.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.31%], valid : [loss = 0.870, top1 = 69.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12518/15625) 012518-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.420, top1 = 90.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.288, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.21 ms.
cifar100       train : [loss = 0.112, top1 = 98.00%], valid : [loss = 1.318, top1 = 69.57%], test : [loss = 1.292, top1 = 70.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 1.687, top1 = 54.85%], valid : [loss = 2.205, top1 = 43.80%], test : [loss = 2.219, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.405, top1 = 86.00%], valid : [loss = 0.529, top1 = 82.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12519/15625) 012519-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.67%], valid : [loss = 0.473, top1 = 86.40%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.83 ms.
cifar10        train : [loss = 0.122, top1 = 96.17%], test  : [loss = 0.341, top1 = 89.18%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.44 ms.
cifar100       train : [loss = 0.735, top1 = 79.46%], valid : [loss = 1.265, top1 = 64.95%], test : [loss = 1.272, top1 = 64.71%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 2.501, top1 = 36.75%], valid : [loss = 2.600, top1 = 34.57%], test : [loss = 2.631, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12520/15625) 012520-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.497, top1 = 89.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.92 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.318, top1 = 93.30%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.60 ms.
cifar100       train : [loss = 0.071, top1 = 98.95%], valid : [loss = 1.333, top1 = 69.78%], test : [loss = 1.360, top1 = 69.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 1.978, top1 = 47.92%], valid : [loss = 2.345, top1 = 40.22%], test : [loss = 2.345, top1 = 40.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.90%], valid : [loss = 0.702, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12521/15625) 012521-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.43%], valid : [loss = 0.887, top1 = 76.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10        train : [loss = 0.211, top1 = 92.74%], test  : [loss = 0.576, top1 = 82.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 1.128, top1 = 67.83%], valid : [loss = 1.791, top1 = 53.84%], test : [loss = 1.744, top1 = 55.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 3.237, top1 = 22.61%], valid : [loss = 3.364, top1 = 20.67%], test : [loss = 3.374, top1 = 20.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.68%], valid : [loss = 1.091, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12522/15625) 012522-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.60%], valid : [loss = 0.458, top1 = 86.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.73 ms.
cifar10        train : [loss = 0.129, top1 = 95.89%], test  : [loss = 0.343, top1 = 88.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.83 ms.
cifar100       train : [loss = 0.775, top1 = 78.31%], valid : [loss = 1.290, top1 = 64.66%], test : [loss = 1.308, top1 = 64.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.19%], valid : [loss = 2.595, top1 = 34.13%], test : [loss = 2.605, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12523/15625) 012523-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.520, top1 = 88.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.331, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.19 ms.
cifar100       train : [loss = 0.344, top1 = 90.64%], valid : [loss = 1.269, top1 = 67.44%], test : [loss = 1.291, top1 = 66.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.66%], valid : [loss = 2.431, top1 = 38.90%], test : [loss = 2.429, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.12%], valid : [loss = 0.680, top1 = 76.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12524/15625) 012524-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.77%], valid : [loss = 0.552, top1 = 88.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.35 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.358, top1 = 91.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.57 ms.
cifar100       train : [loss = 0.320, top1 = 91.02%], valid : [loss = 1.370, top1 = 66.60%], test : [loss = 1.354, top1 = 67.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.47 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.00%], valid : [loss = 2.463, top1 = 38.27%], test : [loss = 2.477, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 69.11%], valid : [loss = 0.895, top1 = 68.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12525/15625) 012525-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.512, top1 = 89.63%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.82 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.331, top1 = 92.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.11 ms.
cifar100       train : [loss = 0.120, top1 = 97.34%], valid : [loss = 1.323, top1 = 68.89%], test : [loss = 1.312, top1 = 69.99%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.62%], valid : [loss = 2.235, top1 = 43.20%], test : [loss = 2.219, top1 = 44.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 83.14%], valid : [loss = 0.588, top1 = 80.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12526/15625) 012526-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.485, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.316, top1 = 91.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 0.331, top1 = 91.04%], valid : [loss = 1.240, top1 = 67.61%], test : [loss = 1.252, top1 = 67.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.78%], valid : [loss = 2.297, top1 = 41.27%], test : [loss = 2.343, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.79%], valid : [loss = 0.593, top1 = 79.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12527/15625) 012527-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.72%], valid : [loss = 0.751, top1 = 75.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10        train : [loss = 0.501, top1 = 82.31%], test  : [loss = 0.619, top1 = 79.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.77 ms.
cifar100       train : [loss = 1.898, top1 = 48.61%], valid : [loss = 2.097, top1 = 44.48%], test : [loss = 2.070, top1 = 46.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 3.507, top1 = 17.83%], valid : [loss = 3.517, top1 = 18.17%], test : [loss = 3.553, top1 = 17.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.243, top1 = 54.84%], valid : [loss = 1.275, top1 = 54.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12528/15625) 012528-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.413, top1 = 90.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.289, top1 = 93.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.72 ms.
cifar100       train : [loss = 0.107, top1 = 98.09%], valid : [loss = 1.307, top1 = 69.82%], test : [loss = 1.285, top1 = 70.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 1.664, top1 = 55.38%], valid : [loss = 2.246, top1 = 43.73%], test : [loss = 2.241, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.23%], valid : [loss = 0.518, top1 = 82.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12529/15625) 012529-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.596, top1 = 87.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10        train : [loss = 0.017, top1 = 99.61%], test  : [loss = 0.399, top1 = 90.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.06 ms.
cifar100       train : [loss = 0.393, top1 = 88.82%], valid : [loss = 1.402, top1 = 65.26%], test : [loss = 1.385, top1 = 65.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.10%], valid : [loss = 2.483, top1 = 37.30%], test : [loss = 2.503, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.58%], valid : [loss = 0.858, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12530/15625) 012530-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.524, top1 = 89.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.299, top1 = 93.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.95 ms.
cifar100       train : [loss = 0.133, top1 = 97.28%], valid : [loss = 1.294, top1 = 68.30%], test : [loss = 1.302, top1 = 69.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.71%], valid : [loss = 2.303, top1 = 41.80%], test : [loss = 2.287, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12531/15625) 012531-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.557, top1 = 87.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.66 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.374, top1 = 91.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.10 ms.
cifar100       train : [loss = 0.350, top1 = 90.29%], valid : [loss = 1.365, top1 = 66.32%], test : [loss = 1.400, top1 = 65.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.11 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.57%], valid : [loss = 2.457, top1 = 37.67%], test : [loss = 2.476, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.52%], valid : [loss = 0.792, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12532/15625) 012532-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.486, top1 = 88.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.311, top1 = 92.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.325, top1 = 91.30%], valid : [loss = 1.255, top1 = 68.12%], test : [loss = 1.261, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.51%], valid : [loss = 2.306, top1 = 40.53%], test : [loss = 2.344, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12533/15625) 012533-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.30%], valid : [loss = 0.561, top1 = 85.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10        train : [loss = 0.104, top1 = 96.50%], test  : [loss = 0.416, top1 = 88.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.42 ms.
cifar100       train : [loss = 0.817, top1 = 75.79%], valid : [loss = 1.410, top1 = 62.14%], test : [loss = 1.397, top1 = 62.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.03%], valid : [loss = 2.790, top1 = 31.37%], test : [loss = 2.811, top1 = 31.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.05%], valid : [loss = 0.718, top1 = 75.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12534/15625) 012534-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.531, top1 = 88.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.345, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 0.299, top1 = 91.81%], valid : [loss = 1.313, top1 = 67.11%], test : [loss = 1.295, top1 = 67.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.68%], valid : [loss = 2.430, top1 = 38.40%], test : [loss = 2.435, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12535/15625) 012535-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.04 ms.
cifar10-valid  train : [loss = 0.093, top1 = 97.34%], valid : [loss = 0.520, top1 = 85.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.107, top1 = 96.59%], test  : [loss = 0.369, top1 = 89.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.850, top1 = 75.35%], valid : [loss = 1.435, top1 = 61.58%], test : [loss = 1.413, top1 = 62.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.563, top1 = 35.27%], valid : [loss = 2.688, top1 = 33.07%], test : [loss = 2.683, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.36%], valid : [loss = 0.863, top1 = 69.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12536/15625) 012536-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.54 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.566, top1 = 87.48%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.48 ms.
cifar10        train : [loss = 0.028, top1 = 99.14%], test  : [loss = 0.383, top1 = 90.97%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.19 ms.
cifar100       train : [loss = 0.315, top1 = 91.26%], valid : [loss = 1.320, top1 = 67.62%], test : [loss = 1.330, top1 = 66.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.48 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.78%], valid : [loss = 2.419, top1 = 38.37%], test : [loss = 2.429, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 66.88%], valid : [loss = 0.949, top1 = 65.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12537/15625) 012537-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.509, top1 = 88.95%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.347, top1 = 91.83%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.79 ms.
cifar100       train : [loss = 0.340, top1 = 90.62%], valid : [loss = 1.293, top1 = 66.62%], test : [loss = 1.284, top1 = 67.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.05%], valid : [loss = 2.403, top1 = 39.23%], test : [loss = 2.440, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12538/15625) 012538-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.491, top1 = 89.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.333, top1 = 91.83%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.65 ms.
cifar100       train : [loss = 0.285, top1 = 92.43%], valid : [loss = 1.298, top1 = 66.88%], test : [loss = 1.320, top1 = 67.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.05%], valid : [loss = 2.411, top1 = 39.03%], test : [loss = 2.429, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.96%], valid : [loss = 0.807, top1 = 71.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12539/15625) 012539-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.579, top1 = 87.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.424, top1 = 90.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.49 ms.
cifar100       train : [loss = 0.250, top1 = 93.37%], valid : [loss = 1.518, top1 = 65.36%], test : [loss = 1.556, top1 = 64.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.32%], valid : [loss = 2.582, top1 = 36.10%], test : [loss = 2.615, top1 = 34.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.08%], valid : [loss = 0.679, top1 = 76.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12540/15625) 012540-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.70%], valid : [loss = 0.454, top1 = 86.33%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.71 ms.
cifar10        train : [loss = 0.150, top1 = 95.15%], test  : [loss = 0.332, top1 = 89.23%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=16.71 ms.
cifar100       train : [loss = 0.957, top1 = 72.84%], valid : [loss = 1.337, top1 = 62.83%], test : [loss = 1.336, top1 = 62.43%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.42%], valid : [loss = 2.659, top1 = 33.67%], test : [loss = 2.681, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.66%], valid : [loss = 0.809, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12541/15625) 012541-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.83%], valid : [loss = 0.867, top1 = 71.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.35 ms.
cifar10        train : [loss = 0.566, top1 = 80.32%], test  : [loss = 0.717, top1 = 75.73%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.09 ms.
cifar100       train : [loss = 1.784, top1 = 51.85%], valid : [loss = 2.051, top1 = 47.18%], test : [loss = 2.065, top1 = 46.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 3.592, top1 = 16.68%], valid : [loss = 3.638, top1 = 15.70%], test : [loss = 3.671, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12542/15625) 012542-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.453 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.420, top1 = 90.41%]
cifar10        FLOP= 62.83 M, Params=0.453 MB, latency=19.33 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.281, top1 = 93.16%]
cifar100       FLOP= 62.84 M, Params=0.459 MB, latency=18.13 ms.
cifar100       train : [loss = 0.150, top1 = 96.70%], valid : [loss = 1.276, top1 = 69.49%], test : [loss = 1.284, top1 = 69.61%]
ImageNet16-120 FLOP= 15.72 M, Params=0.461 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.56%], valid : [loss = 2.242, top1 = 43.04%], test : [loss = 2.267, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.68%], valid : [loss = 0.504, top1 = 83.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12543/15625) 012543-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.06%], valid : [loss = 0.556, top1 = 85.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.121, top1 = 96.06%], test  : [loss = 0.381, top1 = 88.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.23 ms.
cifar100       train : [loss = 0.859, top1 = 75.07%], valid : [loss = 1.388, top1 = 62.18%], test : [loss = 1.398, top1 = 62.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.44%], valid : [loss = 2.631, top1 = 33.33%], test : [loss = 2.637, top1 = 34.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.40%], valid : [loss = 0.902, top1 = 68.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12544/15625) 012544-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.524, top1 = 88.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.333, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.09 ms.
cifar100       train : [loss = 0.332, top1 = 90.97%], valid : [loss = 1.315, top1 = 66.84%], test : [loss = 1.288, top1 = 67.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.77%], valid : [loss = 2.406, top1 = 38.90%], test : [loss = 2.427, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12545/15625) 012545-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.515, top1 = 88.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.322, top1 = 92.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.65 ms.
cifar100       train : [loss = 0.333, top1 = 90.92%], valid : [loss = 1.252, top1 = 67.52%], test : [loss = 1.288, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.65%], valid : [loss = 2.391, top1 = 39.53%], test : [loss = 2.384, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12546/15625) 012546-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.59%], valid : [loss = 0.992, top1 = 76.52%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.02 ms.
cifar10        train : [loss = 0.147, top1 = 95.11%], test  : [loss = 0.675, top1 = 81.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.16 ms.
cifar100       train : [loss = 0.871, top1 = 75.23%], valid : [loss = 2.168, top1 = 49.08%], test : [loss = 2.173, top1 = 48.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 3.103, top1 = 25.14%], valid : [loss = 3.365, top1 = 20.87%], test : [loss = 3.385, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.088, top1 = 61.07%], valid : [loss = 1.145, top1 = 58.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12547/15625) 012547-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.60%], valid : [loss = 0.670, top1 = 82.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.158, top1 = 94.56%], test  : [loss = 0.474, top1 = 85.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.27 ms.
cifar100       train : [loss = 1.000, top1 = 70.97%], valid : [loss = 1.654, top1 = 55.76%], test : [loss = 1.620, top1 = 57.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 25.69%], valid : [loss = 3.132, top1 = 24.03%], test : [loss = 3.163, top1 = 23.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.62%], valid : [loss = 1.007, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12548/15625) 012548-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.05 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.461, top1 = 89.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.307, top1 = 92.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.34 ms.
cifar100       train : [loss = 0.312, top1 = 91.58%], valid : [loss = 1.281, top1 = 67.62%], test : [loss = 1.274, top1 = 68.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.74%], valid : [loss = 2.314, top1 = 40.30%], test : [loss = 2.352, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12549/15625) 012549-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.443, top1 = 89.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.62 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.273, top1 = 93.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.79 ms.
cifar100       train : [loss = 0.204, top1 = 95.23%], valid : [loss = 1.248, top1 = 69.34%], test : [loss = 1.242, top1 = 69.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.83 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.14%], valid : [loss = 2.294, top1 = 41.97%], test : [loss = 2.350, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.23%], valid : [loss = 0.559, top1 = 81.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12550/15625) 012550-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.34 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.75%], valid : [loss = 0.863, top1 = 71.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10        train : [loss = 0.557, top1 = 80.65%], test  : [loss = 0.710, top1 = 75.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.21 ms.
cifar100       train : [loss = 1.762, top1 = 52.48%], valid : [loss = 2.042, top1 = 46.78%], test : [loss = 2.050, top1 = 47.26%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.88 ms.
ImageNet16-120 train : [loss = 3.596, top1 = 16.64%], valid : [loss = 3.649, top1 = 16.40%], test : [loss = 3.657, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12551/15625) 012551-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.478, top1 = 89.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.310, top1 = 92.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.269, top1 = 93.07%], valid : [loss = 1.346, top1 = 67.44%], test : [loss = 1.341, top1 = 67.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.28%], valid : [loss = 2.350, top1 = 40.37%], test : [loss = 2.389, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 82.12%], valid : [loss = 0.605, top1 = 79.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12552/15625) 012552-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.529, top1 = 89.48%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.85 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.350, top1 = 92.81%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.61 ms.
cifar100       train : [loss = 0.035, top1 = 99.73%], valid : [loss = 1.399, top1 = 70.44%], test : [loss = 1.384, top1 = 70.28%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.555, top1 = 58.02%], valid : [loss = 2.437, top1 = 41.13%], test : [loss = 2.443, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 79.96%], valid : [loss = 0.682, top1 = 76.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12553/15625) 012553-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.552, top1 = 89.11%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.83 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.334, top1 = 92.83%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.73 ms.
cifar100       train : [loss = 0.076, top1 = 98.60%], valid : [loss = 1.378, top1 = 69.68%], test : [loss = 1.388, top1 = 69.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.63%], valid : [loss = 2.310, top1 = 41.10%], test : [loss = 2.304, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.59%], valid : [loss = 0.805, top1 = 71.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12554/15625) 012554-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.599, top1 = 87.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.402, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 0.197, top1 = 95.35%], valid : [loss = 1.525, top1 = 65.66%], test : [loss = 1.537, top1 = 65.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 2.084, top1 = 45.75%], valid : [loss = 2.508, top1 = 36.87%], test : [loss = 2.571, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.91%], valid : [loss = 0.734, top1 = 74.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12555/15625) 012555-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.428, top1 = 90.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.276, top1 = 93.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.21 ms.
cifar100       train : [loss = 0.187, top1 = 95.61%], valid : [loss = 1.240, top1 = 69.20%], test : [loss = 1.265, top1 = 70.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 1.806, top1 = 52.01%], valid : [loss = 2.269, top1 = 42.63%], test : [loss = 2.286, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.39%], valid : [loss = 0.495, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12556/15625) 012556-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.29%], valid : [loss = 0.616, top1 = 85.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.074, top1 = 97.73%], test  : [loss = 0.400, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.718, top1 = 79.12%], valid : [loss = 1.400, top1 = 62.81%], test : [loss = 1.388, top1 = 63.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.77%], valid : [loss = 2.675, top1 = 33.53%], test : [loss = 2.698, top1 = 33.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12557/15625) 012557-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.68%], valid : [loss = 0.736, top1 = 84.19%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.04 ms.
cifar10        train : [loss = 0.039, top1 = 98.92%], test  : [loss = 0.457, top1 = 88.73%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.12 ms.
cifar100       train : [loss = 0.510, top1 = 85.65%], valid : [loss = 1.685, top1 = 59.36%], test : [loss = 1.696, top1 = 59.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.85%], valid : [loss = 2.665, top1 = 32.93%], test : [loss = 2.684, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.80%], valid : [loss = 0.873, top1 = 69.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12558/15625) 012558-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.494, top1 = 89.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.03 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.324, top1 = 92.12%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.26 ms.
cifar100       train : [loss = 0.218, top1 = 94.90%], valid : [loss = 1.207, top1 = 69.20%], test : [loss = 1.267, top1 = 69.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.39%], valid : [loss = 2.254, top1 = 41.30%], test : [loss = 2.301, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.76%], valid : [loss = 0.609, top1 = 78.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12559/15625) 012559-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.533, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.337, top1 = 92.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.163, top1 = 96.36%], valid : [loss = 1.328, top1 = 67.78%], test : [loss = 1.314, top1 = 68.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 1.929, top1 = 48.99%], valid : [loss = 2.333, top1 = 40.60%], test : [loss = 2.325, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.80%], valid : [loss = 0.684, top1 = 76.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12560/15625) 012560-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.86 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.576, top1 = 88.27%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.98 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.356, top1 = 92.11%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.51 ms.
cifar100       train : [loss = 0.206, top1 = 94.68%], valid : [loss = 1.339, top1 = 68.26%], test : [loss = 1.351, top1 = 68.40%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.21%], valid : [loss = 2.492, top1 = 37.13%], test : [loss = 2.494, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.22%], valid : [loss = 0.948, top1 = 65.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12561/15625) 012561-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.99 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.46 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.89 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.73 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12562/15625) 012562-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.30%], valid : [loss = 0.448, top1 = 86.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.98 ms.
cifar10        train : [loss = 0.118, top1 = 96.29%], test  : [loss = 0.320, top1 = 89.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.872, top1 = 75.06%], valid : [loss = 1.318, top1 = 63.44%], test : [loss = 1.273, top1 = 64.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.66%], valid : [loss = 2.633, top1 = 34.37%], test : [loss = 2.635, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.18%], valid : [loss = 0.633, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12563/15625) 012563-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.59%], valid : [loss = 0.674, top1 = 77.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.64 ms.
cifar10        train : [loss = 0.574, top1 = 79.85%], test  : [loss = 0.646, top1 = 77.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.65 ms.
cifar100       train : [loss = 1.748, top1 = 52.76%], valid : [loss = 1.905, top1 = 48.86%], test : [loss = 1.929, top1 = 49.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 3.399, top1 = 19.79%], valid : [loss = 3.374, top1 = 21.07%], test : [loss = 3.415, top1 = 18.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.379, top1 = 49.75%], valid : [loss = 1.391, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12564/15625) 012564-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.549, top1 = 89.27%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.338, top1 = 92.83%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.95 ms.
cifar100       train : [loss = 0.069, top1 = 98.95%], valid : [loss = 1.445, top1 = 69.22%], test : [loss = 1.427, top1 = 69.14%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.711, top1 = 54.28%], valid : [loss = 2.336, top1 = 42.03%], test : [loss = 2.374, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.11%], valid : [loss = 0.626, top1 = 78.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12565/15625) 012565-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.590, top1 = 87.95%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.379, top1 = 91.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.55 ms.
cifar100       train : [loss = 0.309, top1 = 91.51%], valid : [loss = 1.418, top1 = 64.88%], test : [loss = 1.403, top1 = 64.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.430, top1 = 37.62%], valid : [loss = 2.558, top1 = 34.93%], test : [loss = 2.578, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.083, top1 = 60.62%], valid : [loss = 1.102, top1 = 60.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12566/15625) 012566-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12567/15625) 012567-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.468, top1 = 89.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.323, top1 = 92.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.35 ms.
cifar100       train : [loss = 0.327, top1 = 91.22%], valid : [loss = 1.233, top1 = 68.14%], test : [loss = 1.246, top1 = 67.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.89 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.73%], valid : [loss = 2.331, top1 = 40.87%], test : [loss = 2.338, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12568/15625) 012568-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.43%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=19.78 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.319, top1 = 92.78%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=18.03 ms.
cifar100       train : [loss = 0.136, top1 = 97.24%], valid : [loss = 1.302, top1 = 69.08%], test : [loss = 1.317, top1 = 69.01%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=18.81 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.66%], valid : [loss = 2.295, top1 = 41.66%], test : [loss = 2.293, top1 = 42.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 76.07%], valid : [loss = 0.738, top1 = 74.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12569/15625) 012569-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.514, top1 = 89.49%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.313, top1 = 93.49%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.29 ms.
cifar100       train : [loss = 0.161, top1 = 96.20%], valid : [loss = 1.377, top1 = 67.66%], test : [loss = 1.342, top1 = 68.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.09%], valid : [loss = 2.170, top1 = 43.93%], test : [loss = 2.214, top1 = 43.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.76%], valid : [loss = 0.738, top1 = 74.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12570/15625) 012570-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.181, top1 = 94.05%], valid : [loss = 0.554, top1 = 83.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10        train : [loss = 0.177, top1 = 93.94%], test  : [loss = 0.406, top1 = 87.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.61 ms.
cifar100       train : [loss = 1.197, top1 = 65.75%], valid : [loss = 1.523, top1 = 57.94%], test : [loss = 1.532, top1 = 57.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.55%], valid : [loss = 2.674, top1 = 33.67%], test : [loss = 2.686, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.42%], valid : [loss = 0.969, top1 = 65.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12571/15625) 012571-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.562, top1 = 87.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=12.96 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.390, top1 = 91.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.89 ms.
cifar100       train : [loss = 0.386, top1 = 89.09%], valid : [loss = 1.438, top1 = 64.28%], test : [loss = 1.364, top1 = 66.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.40%], valid : [loss = 2.493, top1 = 36.63%], test : [loss = 2.503, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.97%], valid : [loss = 0.772, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12572/15625) 012572-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.465, top1 = 90.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.53 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.298, top1 = 93.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.71 ms.
cifar100       train : [loss = 0.117, top1 = 97.86%], valid : [loss = 1.257, top1 = 70.40%], test : [loss = 1.259, top1 = 69.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 1.710, top1 = 54.31%], valid : [loss = 2.182, top1 = 43.73%], test : [loss = 2.181, top1 = 45.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.65%], valid : [loss = 0.634, top1 = 78.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12573/15625) 012573-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12574/15625) 012574-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.430, top1 = 90.87%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.63 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.57 ms.
cifar100       train : [loss = 0.044, top1 = 99.55%], valid : [loss = 1.311, top1 = 71.20%], test : [loss = 1.251, top1 = 72.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 1.409, top1 = 61.61%], valid : [loss = 2.209, top1 = 45.53%], test : [loss = 2.195, top1 = 45.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.327, top1 = 88.92%], valid : [loss = 0.467, top1 = 84.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12575/15625) 012575-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.61 ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.04%], valid : [loss = 0.867, top1 = 70.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.97 ms.
cifar10        train : [loss = 0.695, top1 = 75.66%], test  : [loss = 0.774, top1 = 73.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.18 ms.
cifar100       train : [loss = 1.956, top1 = 48.09%], valid : [loss = 2.132, top1 = 44.88%], test : [loss = 2.141, top1 = 44.67%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.12 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.81%], valid : [loss = 3.655, top1 = 15.63%], test : [loss = 3.687, top1 = 14.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12576/15625) 012576-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.438, top1 = 90.88%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.298, top1 = 93.66%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.75 ms.
cifar100       train : [loss = 0.052, top1 = 99.34%], valid : [loss = 1.381, top1 = 70.60%], test : [loss = 1.330, top1 = 70.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.487, top1 = 59.60%], valid : [loss = 2.236, top1 = 44.47%], test : [loss = 2.271, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 85.06%], valid : [loss = 0.557, top1 = 81.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12577/15625) 012577-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.512, top1 = 89.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.302, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.68 ms.
cifar100       train : [loss = 0.122, top1 = 97.58%], valid : [loss = 1.265, top1 = 69.86%], test : [loss = 1.305, top1 = 69.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.47 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.66%], valid : [loss = 2.284, top1 = 41.77%], test : [loss = 2.273, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12578/15625) 012578-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.78%], valid : [loss = 0.510, top1 = 88.49%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.52 ms.
cifar10        train : [loss = 0.023, top1 = 99.41%], test  : [loss = 0.355, top1 = 91.34%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.57 ms.
cifar100       train : [loss = 0.393, top1 = 88.81%], valid : [loss = 1.368, top1 = 65.86%], test : [loss = 1.338, top1 = 66.48%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.12%], valid : [loss = 2.385, top1 = 39.70%], test : [loss = 2.422, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.16%], valid : [loss = 0.622, top1 = 78.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12579/15625) 012579-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.517, top1 = 89.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=22.62 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.318, top1 = 93.21%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.11 ms.
cifar100       train : [loss = 0.132, top1 = 97.35%], valid : [loss = 1.294, top1 = 69.12%], test : [loss = 1.321, top1 = 68.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.24%], valid : [loss = 2.234, top1 = 42.00%], test : [loss = 2.265, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.62%], valid : [loss = 0.778, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12580/15625) 012580-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.130, top1 = 96.04%], valid : [loss = 0.459, top1 = 86.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10        train : [loss = 0.160, top1 = 94.71%], test  : [loss = 0.348, top1 = 88.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.16 ms.
cifar100       train : [loss = 0.985, top1 = 72.04%], valid : [loss = 1.343, top1 = 61.62%], test : [loss = 1.356, top1 = 62.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.65%], valid : [loss = 2.696, top1 = 32.80%], test : [loss = 2.725, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.32%], valid : [loss = 0.770, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12581/15625) 012581-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.519, top1 = 89.70%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.316, top1 = 93.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.25 ms.
cifar100       train : [loss = 0.156, top1 = 96.51%], valid : [loss = 1.359, top1 = 67.64%], test : [loss = 1.392, top1 = 68.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.24%], valid : [loss = 2.243, top1 = 42.70%], test : [loss = 2.225, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.34%], valid : [loss = 0.647, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12582/15625) 012582-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.00%], valid : [loss = 0.472, top1 = 86.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10        train : [loss = 0.161, top1 = 94.73%], test  : [loss = 0.349, top1 = 88.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.15 ms.
cifar100       train : [loss = 1.021, top1 = 71.12%], valid : [loss = 1.399, top1 = 60.98%], test : [loss = 1.366, top1 = 61.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.70%], valid : [loss = 2.705, top1 = 33.03%], test : [loss = 2.738, top1 = 31.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12583/15625) 012583-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.28%], valid : [loss = 0.575, top1 = 85.85%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.109, top1 = 96.30%], test  : [loss = 0.398, top1 = 88.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 0.820, top1 = 76.01%], valid : [loss = 1.397, top1 = 62.82%], test : [loss = 1.420, top1 = 62.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.02%], valid : [loss = 2.744, top1 = 32.83%], test : [loss = 2.809, top1 = 31.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.86%], valid : [loss = 0.713, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12584/15625) 012584-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.56 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.40%], valid : [loss = 0.463, top1 = 86.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.149, top1 = 95.16%], test  : [loss = 0.331, top1 = 89.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.76 ms.
cifar100       train : [loss = 1.010, top1 = 71.21%], valid : [loss = 1.357, top1 = 61.80%], test : [loss = 1.342, top1 = 62.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.24%], valid : [loss = 2.663, top1 = 33.50%], test : [loss = 2.680, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12585/15625) 012585-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.246, top1 = 91.58%], valid : [loss = 0.501, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.66 ms.
cifar10        train : [loss = 0.212, top1 = 92.79%], test  : [loss = 0.368, top1 = 87.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.78 ms.
cifar100       train : [loss = 1.134, top1 = 67.69%], valid : [loss = 1.430, top1 = 60.08%], test : [loss = 1.428, top1 = 60.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.53 ms.
ImageNet16-120 train : [loss = 2.767, top1 = 31.40%], valid : [loss = 2.769, top1 = 32.10%], test : [loss = 2.819, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 66.93%], valid : [loss = 0.953, top1 = 66.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12586/15625) 012586-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.591, top1 = 88.08%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.35 ms.
cifar10        train : [loss = 0.014, top1 = 99.59%], test  : [loss = 0.371, top1 = 91.79%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.02 ms.
cifar100       train : [loss = 0.243, top1 = 93.49%], valid : [loss = 1.445, top1 = 65.52%], test : [loss = 1.512, top1 = 64.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.54 ms.
ImageNet16-120 train : [loss = 2.880, top1 = 27.97%], valid : [loss = 2.972, top1 = 26.30%], test : [loss = 2.986, top1 = 25.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.407, top1 = 48.24%], valid : [loss = 1.421, top1 = 47.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12587/15625) 012587-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.80%], valid : [loss = 0.603, top1 = 87.86%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.02 ms.
cifar10        train : [loss = 0.016, top1 = 99.55%], test  : [loss = 0.352, top1 = 92.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.67 ms.
cifar100       train : [loss = 0.181, top1 = 95.53%], valid : [loss = 1.344, top1 = 68.70%], test : [loss = 1.369, top1 = 68.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.31%], valid : [loss = 2.763, top1 = 30.27%], test : [loss = 2.746, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 64.95%], valid : [loss = 1.005, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12588/15625) 012588-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.377, top1 = 86.86%], valid : [loss = 0.622, top1 = 79.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10        train : [loss = 0.325, top1 = 88.84%], test  : [loss = 0.469, top1 = 84.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=9.12 ms.
cifar100       train : [loss = 1.595, top1 = 55.75%], valid : [loss = 1.843, top1 = 51.82%], test : [loss = 1.850, top1 = 50.46%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.38 ms.
ImageNet16-120 train : [loss = 3.129, top1 = 24.29%], valid : [loss = 3.139, top1 = 23.87%], test : [loss = 3.193, top1 = 23.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.106, top1 = 60.28%], valid : [loss = 1.144, top1 = 58.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12589/15625) 012589-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.06 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.593, top1 = 87.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.413, top1 = 90.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.33 ms.
cifar100       train : [loss = 0.199, top1 = 95.48%], valid : [loss = 1.430, top1 = 66.42%], test : [loss = 1.420, top1 = 66.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.077, top1 = 45.91%], valid : [loss = 2.517, top1 = 37.40%], test : [loss = 2.512, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.15%], valid : [loss = 0.738, top1 = 74.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12590/15625) 012590-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.64%], valid : [loss = 0.852, top1 = 72.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.88 ms.
cifar10        train : [loss = 0.568, top1 = 80.19%], test  : [loss = 0.712, top1 = 75.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.41 ms.
cifar100       train : [loss = 1.808, top1 = 51.24%], valid : [loss = 2.072, top1 = 45.74%], test : [loss = 2.090, top1 = 46.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.91%], valid : [loss = 3.641, top1 = 16.73%], test : [loss = 3.662, top1 = 15.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.62%], valid : [loss = 1.245, top1 = 55.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12591/15625) 012591-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.40%], valid : [loss = 0.554, top1 = 85.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10        train : [loss = 0.081, top1 = 97.45%], test  : [loss = 0.342, top1 = 90.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.16 ms.
cifar100       train : [loss = 0.650, top1 = 81.02%], valid : [loss = 1.332, top1 = 63.48%], test : [loss = 1.335, top1 = 64.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.04%], valid : [loss = 2.502, top1 = 36.20%], test : [loss = 2.514, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.29%], valid : [loss = 0.866, top1 = 69.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12592/15625) 012592-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.611, top1 = 86.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.407, top1 = 90.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.51 ms.
cifar100       train : [loss = 0.534, top1 = 84.31%], valid : [loss = 1.455, top1 = 63.01%], test : [loss = 1.438, top1 = 63.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.29%], valid : [loss = 2.518, top1 = 36.58%], test : [loss = 2.553, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.71%], valid : [loss = 0.852, top1 = 70.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12593/15625) 012593-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.33%], valid : [loss = 0.961, top1 = 75.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.77 ms.
cifar10        train : [loss = 0.228, top1 = 92.29%], test  : [loss = 0.582, top1 = 82.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.41 ms.
cifar100       train : [loss = 1.174, top1 = 66.73%], valid : [loss = 1.806, top1 = 53.94%], test : [loss = 1.785, top1 = 54.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 3.232, top1 = 22.64%], valid : [loss = 3.318, top1 = 21.97%], test : [loss = 3.365, top1 = 20.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12594/15625) 012594-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.438, top1 = 89.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.308, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.29 ms.
cifar100       train : [loss = 0.318, top1 = 91.49%], valid : [loss = 1.338, top1 = 66.86%], test : [loss = 1.304, top1 = 67.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.43%], valid : [loss = 2.373, top1 = 39.00%], test : [loss = 2.392, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.85%], valid : [loss = 0.540, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12595/15625) 012595-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.500, top1 = 88.75%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.332, top1 = 91.85%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.18 ms.
cifar100       train : [loss = 0.279, top1 = 92.76%], valid : [loss = 1.218, top1 = 68.36%], test : [loss = 1.234, top1 = 68.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.48%], valid : [loss = 2.227, top1 = 42.20%], test : [loss = 2.255, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.60%], valid : [loss = 0.761, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12596/15625) 012596-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.496, top1 = 89.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.323, top1 = 92.89%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.27 ms.
cifar100       train : [loss = 0.122, top1 = 97.69%], valid : [loss = 1.306, top1 = 68.90%], test : [loss = 1.327, top1 = 69.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 1.801, top1 = 52.00%], valid : [loss = 2.257, top1 = 42.60%], test : [loss = 2.303, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.26%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12597/15625) 012597-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.531, top1 = 87.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.032, top1 = 99.11%], test  : [loss = 0.369, top1 = 90.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=21.49 ms.
cifar100       train : [loss = 0.521, top1 = 85.13%], valid : [loss = 1.317, top1 = 64.80%], test : [loss = 1.333, top1 = 65.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.56%], valid : [loss = 2.467, top1 = 38.50%], test : [loss = 2.469, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 72.06%], valid : [loss = 0.834, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12598/15625) 012598-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=21.17 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.492, top1 = 90.30%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=21.59 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.314, top1 = 93.21%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=19.63 ms.
cifar100       train : [loss = 0.068, top1 = 99.07%], valid : [loss = 1.254, top1 = 71.04%], test : [loss = 1.286, top1 = 70.50%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=18.13 ms.
ImageNet16-120 train : [loss = 1.602, top1 = 56.83%], valid : [loss = 2.146, top1 = 44.03%], test : [loss = 2.164, top1 = 44.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.90%], valid : [loss = 0.635, top1 = 78.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12599/15625) 012599-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.416, top1 = 89.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.309, top1 = 92.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.212, top1 = 94.87%], valid : [loss = 1.243, top1 = 69.14%], test : [loss = 1.266, top1 = 68.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.00 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.15%], valid : [loss = 2.277, top1 = 41.77%], test : [loss = 2.303, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.399, top1 = 86.10%], valid : [loss = 0.523, top1 = 82.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12600/15625) 012600-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.600, top1 = 86.74%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.68 ms.
cifar10        train : [loss = 0.033, top1 = 99.15%], test  : [loss = 0.396, top1 = 89.77%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.79 ms.
cifar100       train : [loss = 0.383, top1 = 89.59%], valid : [loss = 1.354, top1 = 66.08%], test : [loss = 1.339, top1 = 66.10%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.76 ms.
ImageNet16-120 train : [loss = 2.223, top1 = 42.70%], valid : [loss = 2.524, top1 = 36.30%], test : [loss = 2.548, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.84%], valid : [loss = 0.748, top1 = 73.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12601/15625) 012601-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.373, top1 = 92.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.46 ms.
cifar100       train : [loss = 0.110, top1 = 97.87%], valid : [loss = 1.487, top1 = 67.44%], test : [loss = 1.462, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 50.02%], valid : [loss = 2.402, top1 = 39.93%], test : [loss = 2.408, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.69%], valid : [loss = 0.726, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12602/15625) 012602-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.131, top1 = 95.87%], valid : [loss = 0.461, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.30 ms.
cifar10        train : [loss = 0.165, top1 = 94.56%], test  : [loss = 0.338, top1 = 89.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 1.009, top1 = 71.07%], valid : [loss = 1.368, top1 = 61.48%], test : [loss = 1.357, top1 = 62.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.52%], valid : [loss = 2.689, top1 = 32.40%], test : [loss = 2.711, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.25%], valid : [loss = 0.797, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12603/15625) 012603-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.729, top1 = 84.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.42 ms.
cifar10        train : [loss = 0.037, top1 = 98.98%], test  : [loss = 0.508, top1 = 87.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.22 ms.
cifar100       train : [loss = 0.437, top1 = 87.68%], valid : [loss = 1.561, top1 = 62.04%], test : [loss = 1.602, top1 = 62.16%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.06%], valid : [loss = 2.705, top1 = 32.83%], test : [loss = 2.727, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 72.14%], valid : [loss = 0.846, top1 = 70.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12604/15625) 012604-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.88%], valid : [loss = 0.845, top1 = 72.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.566, top1 = 80.41%], test  : [loss = 0.713, top1 = 75.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.07 ms.
cifar100       train : [loss = 1.760, top1 = 52.62%], valid : [loss = 2.040, top1 = 47.24%], test : [loss = 2.035, top1 = 47.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.70%], valid : [loss = 3.649, top1 = 16.40%], test : [loss = 3.677, top1 = 14.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12605/15625) 012605-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.609, top1 = 87.36%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.57 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.381, top1 = 91.65%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.37 ms.
cifar100       train : [loss = 0.175, top1 = 96.15%], valid : [loss = 1.557, top1 = 65.24%], test : [loss = 1.586, top1 = 65.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.97%], valid : [loss = 2.468, top1 = 38.27%], test : [loss = 2.473, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.20%], valid : [loss = 0.787, top1 = 72.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12606/15625) 012606-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.470, top1 = 90.48%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.28 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.314, top1 = 93.54%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=24.87 ms.
cifar100       train : [loss = 0.047, top1 = 99.44%], valid : [loss = 1.245, top1 = 71.92%], test : [loss = 1.249, top1 = 71.98%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=21.68 ms.
ImageNet16-120 train : [loss = 1.597, top1 = 56.85%], valid : [loss = 2.149, top1 = 44.63%], test : [loss = 2.123, top1 = 46.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.55%], valid : [loss = 0.651, top1 = 77.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12607/15625) 012607-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.45 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.45%], valid : [loss = 0.457, top1 = 86.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.86 ms.
cifar10        train : [loss = 0.159, top1 = 94.84%], test  : [loss = 0.332, top1 = 89.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.07 ms.
cifar100       train : [loss = 0.977, top1 = 72.21%], valid : [loss = 1.336, top1 = 62.80%], test : [loss = 1.332, top1 = 62.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.69%], valid : [loss = 2.702, top1 = 33.23%], test : [loss = 2.721, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12608/15625) 012608-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.446, top1 = 90.80%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.88 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.300, top1 = 93.69%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.26 ms.
cifar100       train : [loss = 0.043, top1 = 99.49%], valid : [loss = 1.383, top1 = 70.20%], test : [loss = 1.323, top1 = 70.94%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.459, top1 = 60.26%], valid : [loss = 2.247, top1 = 43.87%], test : [loss = 2.276, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.419, top1 = 85.66%], valid : [loss = 0.528, top1 = 82.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12609/15625) 012609-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.50%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.40 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.315, top1 = 93.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.45 ms.
cifar100       train : [loss = 0.140, top1 = 97.10%], valid : [loss = 1.313, top1 = 68.44%], test : [loss = 1.302, top1 = 68.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.92 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.66%], valid : [loss = 2.290, top1 = 41.43%], test : [loss = 2.296, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.58%], valid : [loss = 0.690, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12610/15625) 012610-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.446, top1 = 89.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.305, top1 = 92.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.17 ms.
cifar100       train : [loss = 0.190, top1 = 95.70%], valid : [loss = 1.317, top1 = 68.50%], test : [loss = 1.295, top1 = 68.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.45 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.49%], valid : [loss = 2.277, top1 = 42.37%], test : [loss = 2.282, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.75%], valid : [loss = 0.546, top1 = 81.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12611/15625) 012611-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.48%], valid : [loss = 0.905, top1 = 78.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10        train : [loss = 0.133, top1 = 95.50%], test  : [loss = 0.546, top1 = 84.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.73 ms.
cifar100       train : [loss = 0.826, top1 = 75.85%], valid : [loss = 1.653, top1 = 57.48%], test : [loss = 1.640, top1 = 57.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 3.059, top1 = 26.09%], valid : [loss = 3.172, top1 = 24.33%], test : [loss = 3.221, top1 = 23.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.15%], valid : [loss = 1.084, top1 = 61.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12612/15625) 012612-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.554, top1 = 87.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.028, top1 = 99.18%], test  : [loss = 0.365, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.78 ms.
cifar100       train : [loss = 0.434, top1 = 87.31%], valid : [loss = 1.274, top1 = 67.04%], test : [loss = 1.300, top1 = 66.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.44%], valid : [loss = 2.404, top1 = 39.30%], test : [loss = 2.400, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.06%], valid : [loss = 0.857, top1 = 69.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12613/15625) 012613-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.356, top1 = 87.49%], valid : [loss = 0.585, top1 = 81.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.302, top1 = 89.43%], test  : [loss = 0.447, top1 = 85.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.65 ms.
cifar100       train : [loss = 1.552, top1 = 56.66%], valid : [loss = 1.771, top1 = 51.92%], test : [loss = 1.777, top1 = 51.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 3.125, top1 = 24.45%], valid : [loss = 3.140, top1 = 24.23%], test : [loss = 3.174, top1 = 23.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.93%], valid : [loss = 1.015, top1 = 63.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12614/15625) 012614-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.33%], valid : [loss = 0.468, top1 = 85.83%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=17.42 ms.
cifar10        train : [loss = 0.153, top1 = 95.04%], test  : [loss = 0.336, top1 = 88.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.44 ms.
cifar100       train : [loss = 0.992, top1 = 71.55%], valid : [loss = 1.347, top1 = 62.44%], test : [loss = 1.341, top1 = 62.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=18.86 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.11%], valid : [loss = 2.664, top1 = 33.10%], test : [loss = 2.698, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12615/15625) 012615-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.269, top1 = 90.98%], valid : [loss = 0.478, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.295, top1 = 90.10%], test  : [loss = 0.397, top1 = 86.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 1.327, top1 = 63.07%], valid : [loss = 1.525, top1 = 57.92%], test : [loss = 1.511, top1 = 58.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.67%], valid : [loss = 2.905, top1 = 29.76%], test : [loss = 2.949, top1 = 28.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12616/15625) 012616-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.32%], valid : [loss = 0.541, top1 = 87.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.25 ms.
cifar10        train : [loss = 0.037, top1 = 98.84%], test  : [loss = 0.332, top1 = 91.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.69 ms.
cifar100       train : [loss = 0.461, top1 = 86.24%], valid : [loss = 1.255, top1 = 66.16%], test : [loss = 1.272, top1 = 66.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.75 ms.
ImageNet16-120 train : [loss = 2.274, top1 = 41.54%], valid : [loss = 2.417, top1 = 38.93%], test : [loss = 2.444, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.77%], valid : [loss = 1.060, top1 = 62.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12617/15625) 012617-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.437, top1 = 90.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=12.97 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.306, top1 = 93.43%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.91 ms.
cifar100       train : [loss = 0.071, top1 = 98.93%], valid : [loss = 1.354, top1 = 70.62%], test : [loss = 1.386, top1 = 69.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.575, top1 = 57.74%], valid : [loss = 2.236, top1 = 44.23%], test : [loss = 2.268, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.69%], valid : [loss = 0.516, top1 = 82.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12618/15625) 012618-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.552, top1 = 89.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.345, top1 = 92.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.07 ms.
cifar100       train : [loss = 0.134, top1 = 97.06%], valid : [loss = 1.348, top1 = 68.44%], test : [loss = 1.370, top1 = 68.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.68%], valid : [loss = 2.350, top1 = 39.30%], test : [loss = 2.322, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.65%], valid : [loss = 0.823, top1 = 70.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12619/15625) 012619-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.612, top1 = 86.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.92 ms.
cifar10        train : [loss = 0.030, top1 = 99.31%], test  : [loss = 0.428, top1 = 89.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.60 ms.
cifar100       train : [loss = 0.381, top1 = 89.74%], valid : [loss = 1.409, top1 = 65.52%], test : [loss = 1.364, top1 = 65.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.33%], valid : [loss = 2.606, top1 = 34.50%], test : [loss = 2.632, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.24%], valid : [loss = 0.772, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12620/15625) 012620-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.414, top1 = 90.65%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.90 ms.
cifar10        train : [loss = 0.006, top1 = 99.94%], test  : [loss = 0.276, top1 = 93.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.27 ms.
cifar100       train : [loss = 0.124, top1 = 97.41%], valid : [loss = 1.334, top1 = 68.96%], test : [loss = 1.295, top1 = 69.44%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 1.719, top1 = 54.07%], valid : [loss = 2.198, top1 = 44.47%], test : [loss = 2.259, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.74%], valid : [loss = 0.490, top1 = 83.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12621/15625) 012621-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.788, top1 = 72.04%], valid : [loss = 1.112, top1 = 62.98%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=11.10 ms.
cifar10        train : [loss = 0.777, top1 = 72.74%], test  : [loss = 0.913, top1 = 68.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.04 ms.
cifar100       train : [loss = 2.166, top1 = 43.46%], valid : [loss = 2.448, top1 = 38.38%], test : [loss = 2.461, top1 = 38.34%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 3.765, top1 = 13.83%], valid : [loss = 3.829, top1 = 13.73%], test : [loss = 3.833, top1 = 13.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12622/15625) 012622-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.46%], valid : [loss = 0.685, top1 = 76.80%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.70 ms.
cifar10        train : [loss = 0.506, top1 = 82.50%], test  : [loss = 0.589, top1 = 80.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.59 ms.
cifar100       train : [loss = 1.703, top1 = 53.67%], valid : [loss = 1.861, top1 = 50.96%], test : [loss = 1.879, top1 = 50.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.88 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.25%], valid : [loss = 3.338, top1 = 20.93%], test : [loss = 3.346, top1 = 21.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 54.05%], valid : [loss = 1.298, top1 = 53.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12623/15625) 012623-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.19%], valid : [loss = 0.458, top1 = 86.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.118, top1 = 96.35%], test  : [loss = 0.327, top1 = 89.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.01 ms.
cifar100       train : [loss = 0.867, top1 = 75.29%], valid : [loss = 1.307, top1 = 64.04%], test : [loss = 1.288, top1 = 64.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.564, top1 = 35.41%], valid : [loss = 2.642, top1 = 33.76%], test : [loss = 2.668, top1 = 32.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.48%], valid : [loss = 0.680, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12624/15625) 012624-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.496, top1 = 88.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.350, top1 = 91.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.89 ms.
cifar100       train : [loss = 0.336, top1 = 90.81%], valid : [loss = 1.286, top1 = 66.22%], test : [loss = 1.322, top1 = 66.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.83%], valid : [loss = 2.415, top1 = 39.20%], test : [loss = 2.419, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.62%], valid : [loss = 0.700, top1 = 75.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12625/15625) 012625-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.290, top1 = 89.98%], valid : [loss = 0.560, top1 = 82.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.256, top1 = 91.16%], test  : [loss = 0.414, top1 = 86.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 1.373, top1 = 61.26%], valid : [loss = 1.638, top1 = 55.46%], test : [loss = 1.622, top1 = 55.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 30.40%], valid : [loss = 2.828, top1 = 29.90%], test : [loss = 2.873, top1 = 29.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.25%], valid : [loss = 1.035, top1 = 62.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12626/15625) 012626-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.540, top1 = 89.07%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.56 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.358, top1 = 92.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.22 ms.
cifar100       train : [loss = 0.153, top1 = 96.60%], valid : [loss = 1.444, top1 = 67.08%], test : [loss = 1.435, top1 = 66.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 39.52%], valid : [loss = 2.543, top1 = 35.53%], test : [loss = 2.513, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.157, top1 = 57.73%], valid : [loss = 1.166, top1 = 57.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12627/15625) 012627-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.429, top1 = 90.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10        train : [loss = 0.006, top1 = 99.94%], test  : [loss = 0.275, top1 = 93.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.113, top1 = 97.94%], valid : [loss = 1.296, top1 = 69.96%], test : [loss = 1.286, top1 = 69.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 1.688, top1 = 54.87%], valid : [loss = 2.214, top1 = 44.11%], test : [loss = 2.252, top1 = 43.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.23%], valid : [loss = 0.517, top1 = 82.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12628/15625) 012628-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.561, top1 = 87.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.409, top1 = 90.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.24 ms.
cifar100       train : [loss = 0.397, top1 = 88.72%], valid : [loss = 1.405, top1 = 64.84%], test : [loss = 1.396, top1 = 65.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.01%], valid : [loss = 2.503, top1 = 36.73%], test : [loss = 2.518, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12629/15625) 012629-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.457, top1 = 83.64%], valid : [loss = 0.685, top1 = 77.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10        train : [loss = 0.423, top1 = 85.18%], test  : [loss = 0.545, top1 = 81.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.04 ms.
cifar100       train : [loss = 1.687, top1 = 53.12%], valid : [loss = 1.918, top1 = 48.66%], test : [loss = 1.916, top1 = 48.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.180, top1 = 23.24%], valid : [loss = 3.162, top1 = 24.03%], test : [loss = 3.246, top1 = 22.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.38%], valid : [loss = 1.090, top1 = 61.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12630/15625) 012630-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.501, top1 = 89.62%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.21 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.311, top1 = 93.05%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.58 ms.
cifar100       train : [loss = 0.085, top1 = 98.55%], valid : [loss = 1.324, top1 = 69.62%], test : [loss = 1.310, top1 = 69.82%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.79 ms.
ImageNet16-120 train : [loss = 1.797, top1 = 52.31%], valid : [loss = 2.250, top1 = 42.47%], test : [loss = 2.253, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.53%], valid : [loss = 0.734, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12631/15625) 012631-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.565, top1 = 87.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.387, top1 = 90.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.19 ms.
cifar100       train : [loss = 0.401, top1 = 88.70%], valid : [loss = 1.389, top1 = 65.25%], test : [loss = 1.387, top1 = 65.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.42%], valid : [loss = 2.474, top1 = 37.80%], test : [loss = 2.510, top1 = 37.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.06%], valid : [loss = 0.753, top1 = 73.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12632/15625) 012632-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.584, top1 = 87.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.19 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.388, top1 = 91.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.38 ms.
cifar100       train : [loss = 0.373, top1 = 89.58%], valid : [loss = 1.420, top1 = 65.08%], test : [loss = 1.405, top1 = 65.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.294, top1 = 41.02%], valid : [loss = 2.510, top1 = 37.12%], test : [loss = 2.534, top1 = 36.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.98%], valid : [loss = 0.807, top1 = 71.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12633/15625) 012633-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.33%], valid : [loss = 0.681, top1 = 84.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.64 ms.
cifar10        train : [loss = 0.050, top1 = 98.42%], test  : [loss = 0.405, top1 = 89.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.88 ms.
cifar100       train : [loss = 0.620, top1 = 81.86%], valid : [loss = 1.507, top1 = 61.98%], test : [loss = 1.514, top1 = 62.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.16%], valid : [loss = 2.839, top1 = 29.80%], test : [loss = 2.858, top1 = 29.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.42%], valid : [loss = 0.881, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12634/15625) 012634-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.562, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10        train : [loss = 0.017, top1 = 99.53%], test  : [loss = 0.345, top1 = 91.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 0.306, top1 = 91.65%], valid : [loss = 1.289, top1 = 67.38%], test : [loss = 1.310, top1 = 67.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.24%], valid : [loss = 2.457, top1 = 38.10%], test : [loss = 2.478, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.56%], valid : [loss = 0.923, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12635/15625) 012635-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.578, top1 = 88.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.18 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.368, top1 = 92.05%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.62 ms.
cifar100       train : [loss = 0.123, top1 = 97.54%], valid : [loss = 1.509, top1 = 67.04%], test : [loss = 1.509, top1 = 66.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.45%], valid : [loss = 2.418, top1 = 39.97%], test : [loss = 2.408, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.40%], valid : [loss = 0.755, top1 = 73.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12636/15625) 012636-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.18%], valid : [loss = 0.591, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.56 ms.
cifar10        train : [loss = 0.067, top1 = 97.84%], test  : [loss = 0.370, top1 = 89.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 0.653, top1 = 80.80%], valid : [loss = 1.318, top1 = 64.50%], test : [loss = 1.297, top1 = 65.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.405, top1 = 38.53%], valid : [loss = 2.524, top1 = 36.17%], test : [loss = 2.559, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.81%], valid : [loss = 0.800, top1 = 72.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12637/15625) 012637-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.61%], valid : [loss = 0.676, top1 = 77.18%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.540, top1 = 81.19%], test  : [loss = 0.601, top1 = 79.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.69 ms.
cifar100       train : [loss = 1.757, top1 = 52.25%], valid : [loss = 1.908, top1 = 49.28%], test : [loss = 1.932, top1 = 48.76%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 3.401, top1 = 19.79%], valid : [loss = 3.392, top1 = 20.63%], test : [loss = 3.414, top1 = 19.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.349, top1 = 51.06%], valid : [loss = 1.374, top1 = 50.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12638/15625) 012638-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.525, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.331, top1 = 92.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.34 ms.
cifar100       train : [loss = 0.239, top1 = 93.93%], valid : [loss = 1.286, top1 = 68.50%], test : [loss = 1.270, top1 = 68.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 1.941, top1 = 48.94%], valid : [loss = 2.252, top1 = 42.73%], test : [loss = 2.285, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 78.16%], valid : [loss = 0.703, top1 = 75.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12639/15625) 012639-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.65 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.86%], valid : [loss = 0.427, top1 = 88.51%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=17.98 ms.
cifar10        train : [loss = 0.032, top1 = 99.44%], test  : [loss = 0.310, top1 = 90.99%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.83 ms.
cifar100       train : [loss = 0.363, top1 = 91.18%], valid : [loss = 1.253, top1 = 67.68%], test : [loss = 1.239, top1 = 68.00%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.86%], valid : [loss = 2.331, top1 = 41.30%], test : [loss = 2.357, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.76%], valid : [loss = 0.643, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12640/15625) 012640-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.29%], valid : [loss = 0.839, top1 = 75.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10        train : [loss = 0.264, top1 = 90.88%], test  : [loss = 0.563, top1 = 82.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 1.205, top1 = 65.35%], valid : [loss = 1.781, top1 = 53.14%], test : [loss = 1.794, top1 = 52.88%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 3.359, top1 = 19.63%], valid : [loss = 3.383, top1 = 18.73%], test : [loss = 3.390, top1 = 19.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.325, top1 = 51.27%], valid : [loss = 1.376, top1 = 49.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12641/15625) 012641-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.544, top1 = 88.34%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.15 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.360, top1 = 91.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.82 ms.
cifar100       train : [loss = 0.307, top1 = 91.60%], valid : [loss = 1.379, top1 = 66.40%], test : [loss = 1.404, top1 = 66.70%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.44%], valid : [loss = 2.476, top1 = 38.03%], test : [loss = 2.520, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.45%], valid : [loss = 0.813, top1 = 71.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12642/15625) 012642-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.53%], valid : [loss = 0.824, top1 = 80.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.130, top1 = 95.56%], test  : [loss = 0.536, top1 = 84.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.35 ms.
cifar100       train : [loss = 0.858, top1 = 75.20%], valid : [loss = 1.659, top1 = 57.72%], test : [loss = 1.637, top1 = 57.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 26.41%], valid : [loss = 3.191, top1 = 24.57%], test : [loss = 3.220, top1 = 23.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.52%], valid : [loss = 1.049, top1 = 62.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12643/15625) 012643-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.04%], valid : [loss = 0.562, top1 = 87.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10        train : [loss = 0.036, top1 = 98.87%], test  : [loss = 0.367, top1 = 90.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.51 ms.
cifar100       train : [loss = 0.320, top1 = 90.88%], valid : [loss = 1.349, top1 = 67.00%], test : [loss = 1.363, top1 = 66.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.790, top1 = 29.89%], valid : [loss = 2.859, top1 = 28.57%], test : [loss = 2.895, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 61.98%], valid : [loss = 1.066, top1 = 61.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12644/15625) 012644-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.41%], valid : [loss = 0.549, top1 = 87.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.05 ms.
cifar10        train : [loss = 0.044, top1 = 98.66%], test  : [loss = 0.380, top1 = 90.13%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.39 ms.
cifar100       train : [loss = 0.549, top1 = 84.02%], valid : [loss = 1.279, top1 = 65.83%], test : [loss = 1.323, top1 = 65.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.31%], valid : [loss = 2.454, top1 = 37.59%], test : [loss = 2.466, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.25%], valid : [loss = 0.734, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12645/15625) 012645-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.427, top1 = 91.00%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.301, top1 = 93.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.98 ms.
cifar100       train : [loss = 0.068, top1 = 99.02%], valid : [loss = 1.313, top1 = 70.32%], test : [loss = 1.337, top1 = 70.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 1.554, top1 = 57.98%], valid : [loss = 2.224, top1 = 44.33%], test : [loss = 2.266, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.70%], valid : [loss = 0.489, top1 = 83.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12646/15625) 012646-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.562, top1 = 88.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.369, top1 = 91.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.19 ms.
cifar100       train : [loss = 0.192, top1 = 95.23%], valid : [loss = 1.356, top1 = 67.58%], test : [loss = 1.355, top1 = 68.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 36.86%], valid : [loss = 2.561, top1 = 34.23%], test : [loss = 2.596, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.951, top1 = 65.84%], valid : [loss = 0.975, top1 = 65.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12647/15625) 012647-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.88%], valid : [loss = 0.570, top1 = 87.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.49 ms.
cifar10        train : [loss = 0.020, top1 = 99.54%], test  : [loss = 0.383, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.439, top1 = 87.48%], valid : [loss = 1.389, top1 = 64.98%], test : [loss = 1.397, top1 = 65.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.340, top1 = 40.10%], valid : [loss = 2.545, top1 = 35.57%], test : [loss = 2.548, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.78%], valid : [loss = 0.799, top1 = 72.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12648/15625) 012648-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.76%], valid : [loss = 0.496, top1 = 88.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.311, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.347, top1 = 90.48%], valid : [loss = 1.197, top1 = 67.46%], test : [loss = 1.282, top1 = 67.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.57%], valid : [loss = 2.292, top1 = 41.67%], test : [loss = 2.289, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.52%], valid : [loss = 0.771, top1 = 73.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12649/15625) 012649-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.644, top1 = 86.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.019, top1 = 99.49%], test  : [loss = 0.413, top1 = 90.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.86 ms.
cifar100       train : [loss = 0.285, top1 = 92.34%], valid : [loss = 1.590, top1 = 63.84%], test : [loss = 1.577, top1 = 63.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.06%], valid : [loss = 2.494, top1 = 37.93%], test : [loss = 2.515, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.81%], valid : [loss = 0.851, top1 = 70.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12650/15625) 012650-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.468, top1 = 90.25%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.33 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.312, top1 = 93.16%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.64 ms.
cifar100       train : [loss = 0.100, top1 = 98.13%], valid : [loss = 1.263, top1 = 70.28%], test : [loss = 1.309, top1 = 69.28%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.76 ms.
ImageNet16-120 train : [loss = 1.625, top1 = 56.13%], valid : [loss = 2.164, top1 = 44.77%], test : [loss = 2.195, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.28%], valid : [loss = 0.598, top1 = 79.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12651/15625) 012651-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.42 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.348, top1 = 92.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.41 ms.
cifar100       train : [loss = 0.134, top1 = 97.06%], valid : [loss = 1.524, top1 = 67.64%], test : [loss = 1.495, top1 = 66.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 1.966, top1 = 48.53%], valid : [loss = 2.477, top1 = 38.47%], test : [loss = 2.506, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.78%], valid : [loss = 0.634, top1 = 78.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12652/15625) 012652-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.508, top1 = 88.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.349, top1 = 92.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.27 ms.
cifar100       train : [loss = 0.117, top1 = 97.69%], valid : [loss = 1.436, top1 = 67.82%], test : [loss = 1.443, top1 = 67.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.64%], valid : [loss = 2.374, top1 = 40.21%], test : [loss = 2.378, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.24%], valid : [loss = 0.681, top1 = 76.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12653/15625) 012653-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.25%], valid : [loss = 0.456, top1 = 86.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.116, top1 = 96.40%], test  : [loss = 0.332, top1 = 89.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.05 ms.
cifar100       train : [loss = 0.867, top1 = 75.39%], valid : [loss = 1.298, top1 = 64.03%], test : [loss = 1.286, top1 = 63.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.86 ms.
ImageNet16-120 train : [loss = 2.559, top1 = 35.46%], valid : [loss = 2.629, top1 = 33.94%], test : [loss = 2.650, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12654/15625) 012654-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.17 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.60%], valid : [loss = 0.548, top1 = 83.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 0.207, top1 = 92.98%], test  : [loss = 0.395, top1 = 87.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 1.264, top1 = 64.14%], valid : [loss = 1.562, top1 = 57.05%], test : [loss = 1.580, top1 = 57.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.73 ms.
ImageNet16-120 train : [loss = 2.696, top1 = 32.71%], valid : [loss = 2.720, top1 = 31.96%], test : [loss = 2.778, top1 = 30.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.48%], valid : [loss = 1.011, top1 = 64.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12655/15625) 012655-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.601, top1 = 87.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.383, top1 = 91.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.344, top1 = 90.53%], valid : [loss = 1.417, top1 = 65.28%], test : [loss = 1.388, top1 = 65.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.41%], valid : [loss = 2.481, top1 = 37.83%], test : [loss = 2.508, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.23%], valid : [loss = 0.853, top1 = 69.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12656/15625) 012656-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.53%], valid : [loss = 0.457, top1 = 86.11%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10        train : [loss = 0.156, top1 = 94.92%], test  : [loss = 0.345, top1 = 88.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.59 ms.
cifar100       train : [loss = 0.979, top1 = 72.18%], valid : [loss = 1.346, top1 = 62.80%], test : [loss = 1.354, top1 = 62.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.82 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.80%], valid : [loss = 2.685, top1 = 33.17%], test : [loss = 2.706, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12657/15625) 012657-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.645, top1 = 86.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.46 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.401, top1 = 90.42%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.31 ms.
cifar100       train : [loss = 0.506, top1 = 85.33%], valid : [loss = 1.454, top1 = 62.90%], test : [loss = 1.441, top1 = 64.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.21 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 39.22%], valid : [loss = 2.565, top1 = 36.33%], test : [loss = 2.618, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12658/15625) 012658-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.554, top1 = 88.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.330, top1 = 92.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.173, top1 = 95.74%], valid : [loss = 1.313, top1 = 68.08%], test : [loss = 1.308, top1 = 69.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.703, top1 = 31.90%], valid : [loss = 2.807, top1 = 29.93%], test : [loss = 2.802, top1 = 29.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.895, top1 = 67.78%], valid : [loss = 0.926, top1 = 67.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12659/15625) 012659-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.49 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.387, top1 = 92.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.60 ms.
cifar100       train : [loss = 0.104, top1 = 98.09%], valid : [loss = 1.441, top1 = 67.56%], test : [loss = 1.452, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.77%], valid : [loss = 2.450, top1 = 38.30%], test : [loss = 2.485, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.21%], valid : [loss = 0.784, top1 = 72.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12660/15625) 012660-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.36%], valid : [loss = 0.572, top1 = 87.19%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=16.88 ms.
cifar10        train : [loss = 0.048, top1 = 98.51%], test  : [loss = 0.399, top1 = 89.92%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.67 ms.
cifar100       train : [loss = 0.466, top1 = 86.73%], valid : [loss = 1.366, top1 = 66.08%], test : [loss = 1.346, top1 = 66.02%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.70%], valid : [loss = 2.366, top1 = 40.93%], test : [loss = 2.365, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.99%], valid : [loss = 0.815, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12661/15625) 012661-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.39%], valid : [loss = 0.618, top1 = 85.48%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=15.88 ms.
cifar10        train : [loss = 0.058, top1 = 98.25%], test  : [loss = 0.408, top1 = 89.16%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=17.36 ms.
cifar100       train : [loss = 0.659, top1 = 80.85%], valid : [loss = 1.391, top1 = 63.23%], test : [loss = 1.381, top1 = 63.71%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.75%], valid : [loss = 2.618, top1 = 34.30%], test : [loss = 2.641, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.74%], valid : [loss = 0.785, top1 = 72.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12662/15625) 012662-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.134, top1 = 95.63%], valid : [loss = 0.717, top1 = 80.99%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10        train : [loss = 0.181, top1 = 93.80%], test  : [loss = 0.514, top1 = 85.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.86 ms.
cifar100       train : [loss = 0.899, top1 = 73.79%], valid : [loss = 1.674, top1 = 56.62%], test : [loss = 1.681, top1 = 56.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 3.472, top1 = 17.34%], valid : [loss = 3.487, top1 = 16.83%], test : [loss = 3.493, top1 = 16.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12663/15625) 012663-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.422, top1 = 91.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.71 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.70%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.82 ms.
cifar100       train : [loss = 0.066, top1 = 99.14%], valid : [loss = 1.300, top1 = 71.12%], test : [loss = 1.347, top1 = 69.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.00 ms.
ImageNet16-120 train : [loss = 1.554, top1 = 58.09%], valid : [loss = 2.266, top1 = 42.73%], test : [loss = 2.271, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.344, top1 = 88.22%], valid : [loss = 0.485, top1 = 83.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12664/15625) 012664-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.26%], valid : [loss = 0.455, top1 = 86.22%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.60 ms.
cifar10        train : [loss = 0.164, top1 = 94.63%], test  : [loss = 0.361, top1 = 88.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.32 ms.
cifar100       train : [loss = 1.004, top1 = 71.47%], valid : [loss = 1.338, top1 = 62.88%], test : [loss = 1.345, top1 = 61.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.55%], valid : [loss = 2.707, top1 = 32.67%], test : [loss = 2.713, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12665/15625) 012665-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.45%], valid : [loss = 0.663, top1 = 77.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.497, top1 = 82.85%], test  : [loss = 0.573, top1 = 80.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.16 ms.
cifar100       train : [loss = 1.704, top1 = 53.56%], valid : [loss = 1.859, top1 = 50.22%], test : [loss = 1.870, top1 = 50.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 3.330, top1 = 21.17%], valid : [loss = 3.308, top1 = 21.17%], test : [loss = 3.338, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.14%], valid : [loss = 1.299, top1 = 53.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12666/15625) 012666-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.488, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.353, top1 = 91.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.96 ms.
cifar100       train : [loss = 0.411, top1 = 88.19%], valid : [loss = 1.314, top1 = 66.77%], test : [loss = 1.300, top1 = 67.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.47%], valid : [loss = 2.416, top1 = 39.20%], test : [loss = 2.412, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.06%], valid : [loss = 0.568, top1 = 80.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12667/15625) 012667-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.500, top1 = 88.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.345, top1 = 91.65%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.38 ms.
cifar100       train : [loss = 0.351, top1 = 90.39%], valid : [loss = 1.277, top1 = 67.50%], test : [loss = 1.312, top1 = 67.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.49%], valid : [loss = 2.437, top1 = 39.23%], test : [loss = 2.460, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12668/15625) 012668-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.474, top1 = 89.34%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.308, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=20.56 ms.
cifar100       train : [loss = 0.298, top1 = 92.15%], valid : [loss = 1.226, top1 = 68.14%], test : [loss = 1.230, top1 = 67.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.45%], valid : [loss = 2.228, top1 = 41.47%], test : [loss = 2.245, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12669/15625) 012669-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.71%], valid : [loss = 0.520, top1 = 82.42%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10        train : [loss = 0.393, top1 = 86.61%], test  : [loss = 0.455, top1 = 84.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.38 ms.
cifar100       train : [loss = 1.516, top1 = 58.28%], valid : [loss = 1.655, top1 = 53.86%], test : [loss = 1.635, top1 = 55.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 3.039, top1 = 26.33%], valid : [loss = 3.024, top1 = 27.13%], test : [loss = 3.052, top1 = 25.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.126, top1 = 59.54%], valid : [loss = 1.147, top1 = 59.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12670/15625) 012670-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.47 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.88%], valid : [loss = 0.487, top1 = 83.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.50 ms.
cifar10        train : [loss = 0.306, top1 = 89.71%], test  : [loss = 0.404, top1 = 86.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.56 ms.
cifar100       train : [loss = 1.334, top1 = 63.20%], valid : [loss = 1.542, top1 = 57.58%], test : [loss = 1.515, top1 = 58.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.79 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.71%], valid : [loss = 2.903, top1 = 30.03%], test : [loss = 2.952, top1 = 26.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12671/15625) 012671-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.47%], valid : [loss = 0.538, top1 = 84.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10        train : [loss = 0.178, top1 = 94.01%], test  : [loss = 0.388, top1 = 87.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.74 ms.
cifar100       train : [loss = 1.210, top1 = 65.58%], valid : [loss = 1.540, top1 = 57.96%], test : [loss = 1.521, top1 = 58.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.18%], valid : [loss = 2.673, top1 = 32.81%], test : [loss = 2.712, top1 = 32.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 67.94%], valid : [loss = 0.949, top1 = 66.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12672/15625) 012672-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=23.37 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.518, top1 = 89.28%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.94 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.306, top1 = 93.11%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=17.65 ms.
cifar100       train : [loss = 0.156, top1 = 96.73%], valid : [loss = 1.332, top1 = 67.48%], test : [loss = 1.338, top1 = 68.68%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.07 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.80%], valid : [loss = 2.289, top1 = 41.03%], test : [loss = 2.263, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.34%], valid : [loss = 0.695, top1 = 75.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12673/15625) 012673-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.36%], valid : [loss = 0.457, top1 = 86.49%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=19.50 ms.
cifar10        train : [loss = 0.108, top1 = 96.76%], test  : [loss = 0.341, top1 = 89.26%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=19.36 ms.
cifar100       train : [loss = 0.705, top1 = 80.40%], valid : [loss = 1.319, top1 = 64.70%], test : [loss = 1.291, top1 = 64.26%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 2.431, top1 = 38.20%], valid : [loss = 2.574, top1 = 36.17%], test : [loss = 2.565, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.68%], valid : [loss = 0.851, top1 = 69.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12674/15625) 012674-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.94%], valid : [loss = 0.600, top1 = 86.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.073, top1 = 97.59%], test  : [loss = 0.368, top1 = 90.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.73 ms.
cifar100       train : [loss = 0.650, top1 = 80.78%], valid : [loss = 1.322, top1 = 64.96%], test : [loss = 1.287, top1 = 65.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.15%], valid : [loss = 2.492, top1 = 36.77%], test : [loss = 2.515, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.16%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12675/15625) 012675-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.530, top1 = 89.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.362, top1 = 92.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.47 ms.
cifar100       train : [loss = 0.144, top1 = 97.11%], valid : [loss = 1.404, top1 = 67.48%], test : [loss = 1.387, top1 = 68.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.09%], valid : [loss = 2.429, top1 = 39.73%], test : [loss = 2.464, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.10%], valid : [loss = 0.664, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12676/15625) 012676-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.39%], valid : [loss = 0.474, top1 = 85.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.163, top1 = 94.63%], test  : [loss = 0.358, top1 = 88.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.18 ms.
cifar100       train : [loss = 0.999, top1 = 71.26%], valid : [loss = 1.360, top1 = 61.72%], test : [loss = 1.339, top1 = 61.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 33.88%], valid : [loss = 2.690, top1 = 32.57%], test : [loss = 2.691, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12677/15625) 012677-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.19 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.504, top1 = 90.05%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.312, top1 = 93.31%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.11 ms.
cifar100       train : [loss = 0.059, top1 = 99.21%], valid : [loss = 1.309, top1 = 70.85%], test : [loss = 1.326, top1 = 70.57%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 1.578, top1 = 57.41%], valid : [loss = 2.162, top1 = 44.87%], test : [loss = 2.170, top1 = 45.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.99%], valid : [loss = 0.593, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12678/15625) 012678-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.523, top1 = 88.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.323, top1 = 91.34%], valid : [loss = 1.295, top1 = 67.98%], test : [loss = 1.302, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.00%], valid : [loss = 2.404, top1 = 38.93%], test : [loss = 2.413, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12679/15625) 012679-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.485, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.321, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.93 ms.
cifar100       train : [loss = 0.303, top1 = 91.77%], valid : [loss = 1.237, top1 = 67.60%], test : [loss = 1.225, top1 = 68.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.74%], valid : [loss = 2.234, top1 = 42.07%], test : [loss = 2.242, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.19%], valid : [loss = 0.669, top1 = 76.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12680/15625) 012680-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=22.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.511, top1 = 89.65%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.332, top1 = 93.34%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.47 ms.
cifar100       train : [loss = 0.070, top1 = 98.94%], valid : [loss = 1.348, top1 = 69.54%], test : [loss = 1.364, top1 = 69.66%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 2.014, top1 = 47.10%], valid : [loss = 2.372, top1 = 40.00%], test : [loss = 2.358, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.84%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12681/15625) 012681-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.00%], valid : [loss = 0.481, top1 = 84.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.83 ms.
cifar10        train : [loss = 0.303, top1 = 89.75%], test  : [loss = 0.405, top1 = 86.48%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.81 ms.
cifar100       train : [loss = 1.323, top1 = 63.40%], valid : [loss = 1.535, top1 = 57.79%], test : [loss = 1.503, top1 = 58.37%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.55 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.67%], valid : [loss = 2.901, top1 = 29.40%], test : [loss = 2.947, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12682/15625) 012682-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.494, top1 = 89.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.327, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.57 ms.
cifar100       train : [loss = 0.341, top1 = 90.80%], valid : [loss = 1.271, top1 = 67.16%], test : [loss = 1.303, top1 = 66.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.57%], valid : [loss = 2.411, top1 = 38.33%], test : [loss = 2.434, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.08%], valid : [loss = 0.659, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12683/15625) 012683-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.590, top1 = 87.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.391, top1 = 90.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.429, top1 = 87.78%], valid : [loss = 1.379, top1 = 65.02%], test : [loss = 1.395, top1 = 65.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.31%], valid : [loss = 2.522, top1 = 36.27%], test : [loss = 2.553, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.22%], valid : [loss = 0.792, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12684/15625) 012684-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.58%], valid : [loss = 0.617, top1 = 84.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.00 ms.
cifar10        train : [loss = 0.091, top1 = 97.12%], test  : [loss = 0.376, top1 = 89.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.797, top1 = 76.71%], valid : [loss = 1.430, top1 = 62.16%], test : [loss = 1.384, top1 = 62.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.01%], valid : [loss = 2.762, top1 = 31.27%], test : [loss = 2.744, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.43%], valid : [loss = 0.873, top1 = 69.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12685/15625) 012685-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.570, top1 = 88.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.84 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.379, top1 = 91.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.169, top1 = 96.34%], valid : [loss = 1.407, top1 = 67.40%], test : [loss = 1.406, top1 = 67.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 1.980, top1 = 48.09%], valid : [loss = 2.466, top1 = 37.57%], test : [loss = 2.512, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.99%], valid : [loss = 0.698, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12686/15625) 012686-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.456, top1 = 89.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.325, top1 = 91.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.02 ms.
cifar100       train : [loss = 0.324, top1 = 91.22%], valid : [loss = 1.310, top1 = 67.44%], test : [loss = 1.336, top1 = 66.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.27%], valid : [loss = 2.380, top1 = 40.13%], test : [loss = 2.410, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12687/15625) 012687-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.453, top1 = 90.90%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.97 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.307, top1 = 93.53%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.80 ms.
cifar100       train : [loss = 0.036, top1 = 99.64%], valid : [loss = 1.328, top1 = 70.58%], test : [loss = 1.336, top1 = 71.18%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 1.414, top1 = 61.47%], valid : [loss = 2.239, top1 = 44.83%], test : [loss = 2.282, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 82.88%], valid : [loss = 0.605, top1 = 79.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12688/15625) 012688-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.559, top1 = 87.95%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.380, top1 = 91.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.87 ms.
cifar100       train : [loss = 0.361, top1 = 89.98%], valid : [loss = 1.405, top1 = 65.15%], test : [loss = 1.410, top1 = 65.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.281, top1 = 41.40%], valid : [loss = 2.496, top1 = 37.25%], test : [loss = 2.517, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.10%], valid : [loss = 0.770, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12689/15625) 012689-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.494, top1 = 89.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.317, top1 = 92.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.83 ms.
cifar100       train : [loss = 0.241, top1 = 93.70%], valid : [loss = 1.264, top1 = 68.18%], test : [loss = 1.250, top1 = 69.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.02 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.46%], valid : [loss = 2.234, top1 = 41.83%], test : [loss = 2.253, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.48%], valid : [loss = 0.603, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12690/15625) 012690-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.489, top1 = 90.02%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.332, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.53 ms.
cifar100       train : [loss = 0.125, top1 = 97.34%], valid : [loss = 1.334, top1 = 68.60%], test : [loss = 1.351, top1 = 68.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.61 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.75%], valid : [loss = 2.185, top1 = 44.63%], test : [loss = 2.230, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.56%], valid : [loss = 0.723, top1 = 74.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12691/15625) 012691-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.63%], valid : [loss = 0.695, top1 = 77.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.80 ms.
cifar10        train : [loss = 0.395, top1 = 86.21%], test  : [loss = 0.526, top1 = 82.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.04 ms.
cifar100       train : [loss = 1.662, top1 = 54.21%], valid : [loss = 1.898, top1 = 49.90%], test : [loss = 1.888, top1 = 49.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 3.304, top1 = 21.26%], valid : [loss = 3.291, top1 = 22.17%], test : [loss = 3.350, top1 = 20.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 56.98%], valid : [loss = 1.257, top1 = 55.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12692/15625) 012692-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=24.10 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.94%], valid : [loss = 0.535, top1 = 89.58%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=24.97 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.297, top1 = 93.61%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=22.05 ms.
cifar100       train : [loss = 0.055, top1 = 99.25%], valid : [loss = 1.467, top1 = 68.02%], test : [loss = 1.441, top1 = 68.74%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=21.77 ms.
ImageNet16-120 train : [loss = 1.682, top1 = 54.92%], valid : [loss = 2.265, top1 = 43.50%], test : [loss = 2.254, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.46%], valid : [loss = 0.791, top1 = 72.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12693/15625) 012693-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.78 ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.17%], valid : [loss = 0.844, top1 = 71.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10        train : [loss = 0.674, top1 = 76.41%], test  : [loss = 0.761, top1 = 73.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.62 ms.
cifar100       train : [loss = 1.962, top1 = 47.77%], valid : [loss = 2.129, top1 = 44.58%], test : [loss = 2.162, top1 = 44.44%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.27 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.72%], valid : [loss = 3.678, top1 = 15.50%], test : [loss = 3.694, top1 = 14.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12694/15625) 012694-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.30%], valid : [loss = 0.461, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10        train : [loss = 0.175, top1 = 94.24%], test  : [loss = 0.375, top1 = 88.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 1.003, top1 = 71.55%], valid : [loss = 1.359, top1 = 61.94%], test : [loss = 1.345, top1 = 61.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.662, top1 = 33.36%], valid : [loss = 2.710, top1 = 32.27%], test : [loss = 2.739, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.25%], valid : [loss = 0.797, top1 = 71.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12695/15625) 012695-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.482, top1 = 89.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.294, top1 = 92.33%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.25 ms.
cifar100       train : [loss = 0.321, top1 = 91.41%], valid : [loss = 1.275, top1 = 67.12%], test : [loss = 1.263, top1 = 67.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.46 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.67%], valid : [loss = 2.340, top1 = 40.70%], test : [loss = 2.323, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.68%], valid : [loss = 0.591, top1 = 79.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12696/15625) 012696-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.574, top1 = 88.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.362, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.54 ms.
cifar100       train : [loss = 0.101, top1 = 97.99%], valid : [loss = 1.572, top1 = 66.44%], test : [loss = 1.559, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.63 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 48.04%], valid : [loss = 2.400, top1 = 40.23%], test : [loss = 2.405, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.16%], valid : [loss = 0.704, top1 = 75.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12697/15625) 012697-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.84%], valid : [loss = 0.657, top1 = 85.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.029, top1 = 99.22%], test  : [loss = 0.427, top1 = 89.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.28 ms.
cifar100       train : [loss = 0.428, top1 = 88.35%], valid : [loss = 1.516, top1 = 61.78%], test : [loss = 1.483, top1 = 62.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.98%], valid : [loss = 2.637, top1 = 34.00%], test : [loss = 2.621, top1 = 35.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12698/15625) 012698-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.538, top1 = 88.90%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.89 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.350, top1 = 92.59%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.02 ms.
cifar100       train : [loss = 0.122, top1 = 97.30%], valid : [loss = 1.393, top1 = 68.32%], test : [loss = 1.371, top1 = 68.42%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 2.189, top1 = 43.00%], valid : [loss = 2.422, top1 = 38.33%], test : [loss = 2.473, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.876, top1 = 68.55%], valid : [loss = 0.906, top1 = 67.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12699/15625) 012699-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.58%], valid : [loss = 0.568, top1 = 87.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.039, top1 = 98.84%], test  : [loss = 0.379, top1 = 90.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.11 ms.
cifar100       train : [loss = 0.550, top1 = 83.76%], valid : [loss = 1.424, top1 = 63.52%], test : [loss = 1.417, top1 = 63.24%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 2.487, top1 = 37.08%], valid : [loss = 2.600, top1 = 34.93%], test : [loss = 2.679, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.27%], valid : [loss = 0.707, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12700/15625) 012700-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.468, top1 = 89.00%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.317, top1 = 91.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.36 ms.
cifar100       train : [loss = 0.328, top1 = 91.14%], valid : [loss = 1.298, top1 = 67.26%], test : [loss = 1.313, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.11%], valid : [loss = 2.361, top1 = 40.56%], test : [loss = 2.420, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12701/15625) 012701-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.527, top1 = 89.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.51 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.342, top1 = 92.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.16 ms.
cifar100       train : [loss = 0.220, top1 = 94.26%], valid : [loss = 1.290, top1 = 68.30%], test : [loss = 1.287, top1 = 68.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.51%], valid : [loss = 2.292, top1 = 41.60%], test : [loss = 2.285, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.00%], valid : [loss = 0.741, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12702/15625) 012702-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.503, top1 = 89.40%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.60 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.325, top1 = 92.87%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.78 ms.
cifar100       train : [loss = 0.091, top1 = 97.98%], valid : [loss = 1.422, top1 = 68.86%], test : [loss = 1.408, top1 = 69.30%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 1.791, top1 = 52.34%], valid : [loss = 2.179, top1 = 44.83%], test : [loss = 2.208, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 71.05%], valid : [loss = 0.861, top1 = 69.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12703/15625) 012703-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.99%], valid : [loss = 0.526, top1 = 87.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.071, top1 = 97.79%], test  : [loss = 0.363, top1 = 89.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.29 ms.
cifar100       train : [loss = 0.710, top1 = 79.14%], valid : [loss = 1.370, top1 = 64.22%], test : [loss = 1.344, top1 = 64.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.28%], valid : [loss = 2.610, top1 = 34.37%], test : [loss = 2.676, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.12%], valid : [loss = 0.652, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12704/15625) 012704-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.54%], valid : [loss = 0.634, top1 = 85.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10        train : [loss = 0.028, top1 = 99.22%], test  : [loss = 0.399, top1 = 90.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.82 ms.
cifar100       train : [loss = 0.507, top1 = 85.18%], valid : [loss = 1.414, top1 = 63.18%], test : [loss = 1.396, top1 = 63.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 2.360, top1 = 39.61%], valid : [loss = 2.533, top1 = 36.57%], test : [loss = 2.580, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.94%], valid : [loss = 0.837, top1 = 70.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12705/15625) 012705-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.325, top1 = 88.74%], valid : [loss = 0.559, top1 = 81.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.261, top1 = 91.22%], test  : [loss = 0.393, top1 = 87.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.29 ms.
cifar100       train : [loss = 1.444, top1 = 59.41%], valid : [loss = 1.706, top1 = 54.06%], test : [loss = 1.708, top1 = 53.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.90%], valid : [loss = 2.940, top1 = 28.47%], test : [loss = 3.005, top1 = 26.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12706/15625) 012706-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.71%], valid : [loss = 0.701, top1 = 77.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.457, top1 = 83.92%], test  : [loss = 0.578, top1 = 80.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.21 ms.
cifar100       train : [loss = 1.702, top1 = 53.31%], valid : [loss = 1.912, top1 = 49.44%], test : [loss = 1.938, top1 = 48.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 3.372, top1 = 20.06%], valid : [loss = 3.376, top1 = 20.50%], test : [loss = 3.425, top1 = 18.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.201, top1 = 56.51%], valid : [loss = 1.253, top1 = 54.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12707/15625) 012707-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 52.35 M, Params=0.382 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.508, top1 = 88.89%]
cifar10        FLOP= 52.35 M, Params=0.382 MB, latency=18.50 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.324, top1 = 92.02%]
cifar100       FLOP= 52.35 M, Params=0.388 MB, latency=17.73 ms.
cifar100       train : [loss = 0.281, top1 = 92.69%], valid : [loss = 1.212, top1 = 69.04%], test : [loss = 1.200, top1 = 68.87%]
ImageNet16-120 FLOP= 13.09 M, Params=0.389 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.46%], valid : [loss = 2.248, top1 = 43.28%], test : [loss = 2.263, top1 = 41.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 79.95%], valid : [loss = 0.652, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12708/15625) 012708-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.488, top1 = 88.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.40 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.350, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.32 ms.
cifar100       train : [loss = 0.413, top1 = 88.11%], valid : [loss = 1.307, top1 = 66.91%], test : [loss = 1.319, top1 = 66.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.51%], valid : [loss = 2.405, top1 = 39.54%], test : [loss = 2.415, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.21%], valid : [loss = 0.619, top1 = 78.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12709/15625) 012709-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.477, top1 = 89.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.306, top1 = 92.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.40 ms.
cifar100       train : [loss = 0.235, top1 = 94.00%], valid : [loss = 1.287, top1 = 67.50%], test : [loss = 1.234, top1 = 69.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.30%], valid : [loss = 2.244, top1 = 42.37%], test : [loss = 2.280, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.83%], valid : [loss = 0.608, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12710/15625) 012710-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.629, top1 = 87.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.32 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.415, top1 = 91.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.195, top1 = 95.47%], valid : [loss = 1.472, top1 = 65.58%], test : [loss = 1.558, top1 = 64.46%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.18 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.67%], valid : [loss = 2.505, top1 = 37.83%], test : [loss = 2.509, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.87%], valid : [loss = 0.796, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12711/15625) 012711-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.485, top1 = 89.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.310, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.89 ms.
cifar100       train : [loss = 0.278, top1 = 92.77%], valid : [loss = 1.240, top1 = 68.50%], test : [loss = 1.239, top1 = 68.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.48%], valid : [loss = 2.217, top1 = 42.70%], test : [loss = 2.234, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12712/15625) 012712-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.477, top1 = 89.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.305, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.315, top1 = 91.55%], valid : [loss = 1.252, top1 = 67.77%], test : [loss = 1.278, top1 = 67.85%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.81%], valid : [loss = 2.323, top1 = 40.49%], test : [loss = 2.341, top1 = 40.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 81.92%], valid : [loss = 0.602, top1 = 79.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12713/15625) 012713-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.35%], valid : [loss = 0.762, top1 = 73.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10        train : [loss = 0.603, top1 = 79.07%], test  : [loss = 0.669, top1 = 77.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.00 ms.
cifar100       train : [loss = 1.950, top1 = 47.16%], valid : [loss = 2.118, top1 = 44.44%], test : [loss = 2.095, top1 = 44.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.22%], valid : [loss = 3.251, top1 = 22.23%], test : [loss = 3.263, top1 = 21.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.297, top1 = 53.25%], valid : [loss = 1.333, top1 = 51.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12714/15625) 012714-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.56%], valid : [loss = 0.543, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.13 ms.
cifar10        train : [loss = 0.037, top1 = 98.82%], test  : [loss = 0.358, top1 = 90.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.452, top1 = 86.66%], valid : [loss = 1.236, top1 = 67.24%], test : [loss = 1.250, top1 = 67.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.58%], valid : [loss = 2.355, top1 = 39.93%], test : [loss = 2.387, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.66%], valid : [loss = 0.900, top1 = 68.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12715/15625) 012715-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.27%], valid : [loss = 0.460, top1 = 86.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.330, top1 = 89.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.44 ms.
cifar100       train : [loss = 0.865, top1 = 75.27%], valid : [loss = 1.303, top1 = 64.03%], test : [loss = 1.293, top1 = 64.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.61%], valid : [loss = 2.626, top1 = 34.51%], test : [loss = 2.674, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12716/15625) 012716-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.516, top1 = 88.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.371, top1 = 91.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.21 ms.
cifar100       train : [loss = 0.351, top1 = 89.98%], valid : [loss = 1.364, top1 = 66.18%], test : [loss = 1.391, top1 = 66.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.36%], valid : [loss = 2.464, top1 = 37.27%], test : [loss = 2.524, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.82%], valid : [loss = 0.715, top1 = 75.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12717/15625) 012717-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.197, top1 = 93.35%], valid : [loss = 0.528, top1 = 84.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10        train : [loss = 0.210, top1 = 92.90%], test  : [loss = 0.399, top1 = 87.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 1.275, top1 = 63.80%], valid : [loss = 1.561, top1 = 57.07%], test : [loss = 1.561, top1 = 57.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 2.701, top1 = 32.53%], valid : [loss = 2.743, top1 = 31.86%], test : [loss = 2.764, top1 = 31.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.54%], valid : [loss = 0.992, top1 = 64.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12718/15625) 012718-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.441, top1 = 90.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.293, top1 = 93.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.43 ms.
cifar100       train : [loss = 0.080, top1 = 98.67%], valid : [loss = 1.339, top1 = 69.82%], test : [loss = 1.311, top1 = 70.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 1.630, top1 = 56.28%], valid : [loss = 2.267, top1 = 41.63%], test : [loss = 2.267, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.04%], valid : [loss = 0.537, top1 = 82.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12719/15625) 012719-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.60%], valid : [loss = 0.755, top1 = 74.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.577, top1 = 79.95%], test  : [loss = 0.648, top1 = 77.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.65 ms.
cifar100       train : [loss = 1.990, top1 = 46.05%], valid : [loss = 2.105, top1 = 44.04%], test : [loss = 2.118, top1 = 43.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 3.053, top1 = 25.55%], valid : [loss = 3.047, top1 = 26.13%], test : [loss = 3.071, top1 = 25.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.163, top1 = 57.98%], valid : [loss = 1.198, top1 = 57.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12720/15625) 012720-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.26%], valid : [loss = 0.839, top1 = 72.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.559, top1 = 80.42%], test  : [loss = 0.713, top1 = 75.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 1.775, top1 = 52.24%], valid : [loss = 2.047, top1 = 47.04%], test : [loss = 2.020, top1 = 48.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.79%], valid : [loss = 3.648, top1 = 16.37%], test : [loss = 3.658, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12721/15625) 012721-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10-valid  train : [loss = 1.851, top1 = 32.66%], valid : [loss = 1.857, top1 = 32.66%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10        train : [loss = 1.358, top1 = 50.52%], test  : [loss = 1.365, top1 = 50.43%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.29 ms.
cifar100       train : [loss = 3.918, top1 = 9.67%], valid : [loss = 3.915, top1 = 9.72%], test : [loss = 3.916, top1 = 10.36%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.56 ms.
ImageNet16-120 train : [loss = 4.045, top1 = 9.67%], valid : [loss = 4.038, top1 = 9.80%], test : [loss = 4.045, top1 = 9.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.981, top1 = 26.36%], valid : [loss = 1.986, top1 = 26.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12722/15625) 012722-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.322, top1 = 88.78%], valid : [loss = 0.571, top1 = 81.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.263, top1 = 90.98%], test  : [loss = 0.405, top1 = 86.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.01 ms.
cifar100       train : [loss = 1.508, top1 = 57.86%], valid : [loss = 1.749, top1 = 52.92%], test : [loss = 1.737, top1 = 53.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 28.09%], valid : [loss = 2.964, top1 = 27.88%], test : [loss = 2.991, top1 = 27.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12723/15625) 012723-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.514, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.339, top1 = 91.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.13 ms.
cifar100       train : [loss = 0.347, top1 = 90.38%], valid : [loss = 1.283, top1 = 66.82%], test : [loss = 1.251, top1 = 68.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.76%], valid : [loss = 2.395, top1 = 38.67%], test : [loss = 2.406, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12724/15625) 012724-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.77 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.454, top1 = 90.48%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.63 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.294, top1 = 93.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.71 ms.
cifar100       train : [loss = 0.065, top1 = 98.99%], valid : [loss = 1.396, top1 = 69.34%], test : [loss = 1.373, top1 = 70.56%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 1.598, top1 = 56.98%], valid : [loss = 2.238, top1 = 43.83%], test : [loss = 2.221, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.80%], valid : [loss = 0.582, top1 = 80.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12725/15625) 012725-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.567, top1 = 87.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.381, top1 = 91.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.386, top1 = 89.11%], valid : [loss = 1.403, top1 = 64.96%], test : [loss = 1.381, top1 = 65.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.263, top1 = 41.75%], valid : [loss = 2.480, top1 = 37.39%], test : [loss = 2.491, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.17%], valid : [loss = 0.773, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12726/15625) 012726-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.78%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=20.40 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.306, top1 = 93.54%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=19.58 ms.
cifar100       train : [loss = 0.030, top1 = 99.63%], valid : [loss = 1.366, top1 = 71.10%], test : [loss = 1.415, top1 = 70.44%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.835, top1 = 51.20%], valid : [loss = 2.295, top1 = 41.33%], test : [loss = 2.284, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.63%], valid : [loss = 0.837, top1 = 70.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12727/15625) 012727-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.47 ms.
cifar10-valid  train : [loss = 0.948, top1 = 66.79%], valid : [loss = 0.990, top1 = 65.75%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.86 ms.
cifar10        train : [loss = 0.901, top1 = 68.69%], test  : [loss = 0.901, top1 = 68.44%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.45 ms.
cifar100       train : [loss = 2.363, top1 = 39.31%], valid : [loss = 2.431, top1 = 37.57%], test : [loss = 2.416, top1 = 38.63%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.94 ms.
ImageNet16-120 train : [loss = 3.632, top1 = 15.95%], valid : [loss = 3.603, top1 = 16.70%], test : [loss = 3.623, top1 = 16.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.610, top1 = 39.64%], valid : [loss = 1.669, top1 = 36.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12728/15625) 012728-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.14%], valid : [loss = 0.461, top1 = 86.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.78 ms.
cifar10        train : [loss = 0.112, top1 = 96.51%], test  : [loss = 0.329, top1 = 89.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.46 ms.
cifar100       train : [loss = 0.859, top1 = 75.67%], valid : [loss = 1.290, top1 = 64.65%], test : [loss = 1.281, top1 = 63.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.55%], valid : [loss = 2.632, top1 = 33.89%], test : [loss = 2.678, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12729/15625) 012729-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.531, top1 = 89.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.334, top1 = 92.50%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.23 ms.
cifar100       train : [loss = 0.189, top1 = 95.27%], valid : [loss = 1.326, top1 = 68.22%], test : [loss = 1.352, top1 = 67.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.51%], valid : [loss = 2.219, top1 = 42.20%], test : [loss = 2.239, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.36%], valid : [loss = 0.645, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12730/15625) 012730-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.20%], valid : [loss = 0.563, top1 = 86.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.062, top1 = 98.04%], test  : [loss = 0.370, top1 = 89.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.20 ms.
cifar100       train : [loss = 0.659, top1 = 80.56%], valid : [loss = 1.307, top1 = 64.94%], test : [loss = 1.309, top1 = 64.41%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.13%], valid : [loss = 2.505, top1 = 36.53%], test : [loss = 2.542, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12731/15625) 012731-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.39%], valid : [loss = 0.869, top1 = 71.34%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10        train : [loss = 0.564, top1 = 80.41%], test  : [loss = 0.723, top1 = 75.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 1.778, top1 = 52.05%], valid : [loss = 2.036, top1 = 47.04%], test : [loss = 2.072, top1 = 46.71%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.48 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.70%], valid : [loss = 3.644, top1 = 16.09%], test : [loss = 3.660, top1 = 16.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12732/15625) 012732-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10-valid  train : [loss = 0.499, top1 = 82.65%], valid : [loss = 0.658, top1 = 77.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.48 ms.
cifar10        train : [loss = 0.507, top1 = 82.49%], test  : [loss = 0.589, top1 = 80.16%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.90 ms.
cifar100       train : [loss = 1.687, top1 = 54.19%], valid : [loss = 1.861, top1 = 50.53%], test : [loss = 1.862, top1 = 50.93%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.91 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.23%], valid : [loss = 3.321, top1 = 21.17%], test : [loss = 3.350, top1 = 20.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12733/15625) 012733-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.38%], valid : [loss = 0.596, top1 = 86.73%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.50 ms.
cifar10        train : [loss = 0.052, top1 = 98.31%], test  : [loss = 0.400, top1 = 89.83%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.76 ms.
cifar100       train : [loss = 0.503, top1 = 85.31%], valid : [loss = 1.359, top1 = 64.40%], test : [loss = 1.375, top1 = 64.68%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.52%], valid : [loss = 2.471, top1 = 37.50%], test : [loss = 2.499, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.85%], valid : [loss = 0.891, top1 = 68.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12734/15625) 012734-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.10%], valid : [loss = 0.573, top1 = 86.72%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.38 ms.
cifar10        train : [loss = 0.067, top1 = 97.80%], test  : [loss = 0.381, top1 = 89.73%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.50 ms.
cifar100       train : [loss = 0.655, top1 = 80.65%], valid : [loss = 1.339, top1 = 64.00%], test : [loss = 1.346, top1 = 64.48%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.76%], valid : [loss = 2.490, top1 = 36.70%], test : [loss = 2.518, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 76.08%], valid : [loss = 0.761, top1 = 73.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12735/15625) 012735-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.69%], valid : [loss = 0.590, top1 = 87.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.64 ms.
cifar10        train : [loss = 0.023, top1 = 99.28%], test  : [loss = 0.392, top1 = 90.80%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.96 ms.
cifar100       train : [loss = 0.338, top1 = 90.50%], valid : [loss = 1.462, top1 = 64.32%], test : [loss = 1.462, top1 = 63.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 2.895, top1 = 27.60%], valid : [loss = 2.993, top1 = 25.60%], test : [loss = 2.987, top1 = 25.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12736/15625) 012736-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.453, top1 = 89.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.301, top1 = 92.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.209, top1 = 95.12%], valid : [loss = 1.254, top1 = 69.16%], test : [loss = 1.242, top1 = 69.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 50.94%], valid : [loss = 2.261, top1 = 42.40%], test : [loss = 2.305, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.22%], valid : [loss = 0.527, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12737/15625) 012737-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.27%], valid : [loss = 0.447, top1 = 86.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.112, top1 = 96.58%], test  : [loss = 0.322, top1 = 89.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.18 ms.
cifar100       train : [loss = 0.863, top1 = 75.32%], valid : [loss = 1.314, top1 = 64.02%], test : [loss = 1.287, top1 = 64.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.65%], valid : [loss = 2.636, top1 = 34.23%], test : [loss = 2.658, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.69%], valid : [loss = 0.644, top1 = 77.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12738/15625) 012738-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.40 ms.
cifar10-valid  train : [loss = 1.848, top1 = 32.86%], valid : [loss = 1.853, top1 = 32.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.96 ms.
cifar10        train : [loss = 1.396, top1 = 49.11%], test  : [loss = 1.394, top1 = 49.21%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.20 ms.
cifar100       train : [loss = 3.892, top1 = 10.12%], valid : [loss = 3.897, top1 = 10.28%], test : [loss = 3.888, top1 = 10.30%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.16 ms.
ImageNet16-120 train : [loss = 4.030, top1 = 9.80%], valid : [loss = 4.021, top1 = 10.17%], test : [loss = 4.012, top1 = 9.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.982, top1 = 26.24%], valid : [loss = 1.981, top1 = 26.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12739/15625) 012739-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.543, top1 = 89.44%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.09 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.322, top1 = 93.05%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.32 ms.
cifar100       train : [loss = 0.107, top1 = 97.89%], valid : [loss = 1.324, top1 = 69.82%], test : [loss = 1.331, top1 = 70.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.94 ms.
ImageNet16-120 train : [loss = 1.937, top1 = 48.95%], valid : [loss = 2.231, top1 = 42.83%], test : [loss = 2.239, top1 = 42.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.42%], valid : [loss = 0.847, top1 = 70.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12740/15625) 012740-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.29%], valid : [loss = 0.455, top1 = 86.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10        train : [loss = 0.115, top1 = 96.43%], test  : [loss = 0.328, top1 = 89.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 0.869, top1 = 75.19%], valid : [loss = 1.318, top1 = 63.26%], test : [loss = 1.289, top1 = 64.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.69%], valid : [loss = 2.617, top1 = 34.38%], test : [loss = 2.649, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12741/15625) 012741-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.600, top1 = 87.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.62 ms.
cifar10        train : [loss = 0.018, top1 = 99.58%], test  : [loss = 0.403, top1 = 90.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.05 ms.
cifar100       train : [loss = 0.408, top1 = 88.35%], valid : [loss = 1.403, top1 = 64.85%], test : [loss = 1.397, top1 = 65.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.93%], valid : [loss = 2.507, top1 = 37.19%], test : [loss = 2.545, top1 = 36.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.58%], valid : [loss = 0.858, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12742/15625) 012742-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.577, top1 = 87.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.383, top1 = 91.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.33 ms.
cifar100       train : [loss = 0.392, top1 = 88.88%], valid : [loss = 1.406, top1 = 65.09%], test : [loss = 1.406, top1 = 65.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.77%], valid : [loss = 2.513, top1 = 36.90%], test : [loss = 2.530, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12743/15625) 012743-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.55%], valid : [loss = 0.708, top1 = 84.38%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.41 ms.
cifar10        train : [loss = 0.044, top1 = 98.68%], test  : [loss = 0.433, top1 = 88.95%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.57 ms.
cifar100       train : [loss = 0.507, top1 = 85.51%], valid : [loss = 1.648, top1 = 60.24%], test : [loss = 1.669, top1 = 59.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.397, top1 = 38.78%], valid : [loss = 2.715, top1 = 32.90%], test : [loss = 2.727, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.836, top1 = 70.16%], valid : [loss = 0.894, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12744/15625) 012744-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.10 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.63%], valid : [loss = 0.672, top1 = 77.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.13 ms.
cifar10        train : [loss = 0.521, top1 = 81.84%], test  : [loss = 0.590, top1 = 79.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.70 ms.
cifar100       train : [loss = 1.715, top1 = 53.65%], valid : [loss = 1.866, top1 = 49.74%], test : [loss = 1.893, top1 = 49.74%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.89 ms.
ImageNet16-120 train : [loss = 3.391, top1 = 20.04%], valid : [loss = 3.383, top1 = 20.90%], test : [loss = 3.412, top1 = 18.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12745/15625) 012745-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.513, top1 = 89.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.336, top1 = 92.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.22 ms.
cifar100       train : [loss = 0.146, top1 = 96.69%], valid : [loss = 1.366, top1 = 67.90%], test : [loss = 1.369, top1 = 68.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.29%], valid : [loss = 2.236, top1 = 42.00%], test : [loss = 2.220, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.49%], valid : [loss = 0.730, top1 = 74.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12746/15625) 012746-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.40 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.29 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.27 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12747/15625) 012747-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.521, top1 = 88.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.355, top1 = 91.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.16 ms.
cifar100       train : [loss = 0.334, top1 = 90.92%], valid : [loss = 1.280, top1 = 67.33%], test : [loss = 1.276, top1 = 67.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.86%], valid : [loss = 2.402, top1 = 39.31%], test : [loss = 2.383, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.92%], valid : [loss = 0.769, top1 = 73.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12748/15625) 012748-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.668 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.484, top1 = 89.18%]
cifar10        FLOP= 94.29 M, Params=0.668 MB, latency=18.45 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.311, top1 = 92.39%]
cifar100       FLOP= 94.30 M, Params=0.674 MB, latency=19.01 ms.
cifar100       train : [loss = 0.316, top1 = 91.54%], valid : [loss = 1.247, top1 = 67.73%], test : [loss = 1.240, top1 = 67.72%]
ImageNet16-120 FLOP= 23.58 M, Params=0.676 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.57%], valid : [loss = 2.343, top1 = 40.29%], test : [loss = 2.351, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.86%], valid : [loss = 0.588, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12749/15625) 012749-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.85 ms.
cifar10-valid  train : [loss = 1.100, top1 = 61.05%], valid : [loss = 1.135, top1 = 59.80%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.25 ms.
cifar10        train : [loss = 1.121, top1 = 60.47%], test  : [loss = 1.120, top1 = 60.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.96 ms.
cifar100       train : [loss = 2.564, top1 = 35.37%], valid : [loss = 2.635, top1 = 33.42%], test : [loss = 2.617, top1 = 34.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.78 ms.
ImageNet16-120 train : [loss = 3.790, top1 = 13.59%], valid : [loss = 3.769, top1 = 14.87%], test : [loss = 3.791, top1 = 14.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.641, top1 = 38.75%], valid : [loss = 1.707, top1 = 35.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12750/15625) 012750-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.62 ms.
cifar10-valid  train : [loss = 1.301, top1 = 52.94%], valid : [loss = 1.351, top1 = 51.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.72 ms.
cifar10        train : [loss = 1.240, top1 = 55.53%], test  : [loss = 1.249, top1 = 55.15%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.22 ms.
cifar100       train : [loss = 2.795, top1 = 30.24%], valid : [loss = 2.884, top1 = 28.74%], test : [loss = 2.881, top1 = 28.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.56 ms.
ImageNet16-120 train : [loss = 3.941, top1 = 11.40%], valid : [loss = 3.946, top1 = 11.60%], test : [loss = 3.958, top1 = 10.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.775, top1 = 33.12%], valid : [loss = 1.763, top1 = 33.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12751/15625) 012751-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.638, top1 = 85.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.63 ms.
cifar10        train : [loss = 0.029, top1 = 99.15%], test  : [loss = 0.429, top1 = 89.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.40 ms.
cifar100       train : [loss = 0.483, top1 = 85.93%], valid : [loss = 1.392, top1 = 64.92%], test : [loss = 1.395, top1 = 65.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.03 ms.
ImageNet16-120 train : [loss = 2.438, top1 = 37.93%], valid : [loss = 2.632, top1 = 34.93%], test : [loss = 2.660, top1 = 34.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.30%], valid : [loss = 0.867, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12752/15625) 012752-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.45%], valid : [loss = 0.588, top1 = 86.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.051, top1 = 98.40%], test  : [loss = 0.406, top1 = 89.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.64 ms.
cifar100       train : [loss = 0.618, top1 = 81.72%], valid : [loss = 1.408, top1 = 62.86%], test : [loss = 1.416, top1 = 63.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 35.96%], valid : [loss = 2.639, top1 = 34.73%], test : [loss = 2.677, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.25%], valid : [loss = 0.745, top1 = 74.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12753/15625) 012753-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.204, top1 = 93.11%], valid : [loss = 0.526, top1 = 84.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.195, top1 = 93.48%], test  : [loss = 0.395, top1 = 87.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.51 ms.
cifar100       train : [loss = 1.219, top1 = 65.47%], valid : [loss = 1.521, top1 = 58.12%], test : [loss = 1.535, top1 = 58.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.89 ms.
ImageNet16-120 train : [loss = 2.661, top1 = 33.27%], valid : [loss = 2.690, top1 = 33.53%], test : [loss = 2.742, top1 = 31.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.34%], valid : [loss = 0.980, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12754/15625) 012754-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.291, top1 = 92.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 0.193, top1 = 95.43%], valid : [loss = 1.280, top1 = 68.92%], test : [loss = 1.297, top1 = 68.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.42%], valid : [loss = 2.297, top1 = 42.46%], test : [loss = 2.295, top1 = 41.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.40%], valid : [loss = 0.512, top1 = 82.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12755/15625) 012755-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.305, top1 = 89.50%], valid : [loss = 0.574, top1 = 81.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.42 ms.
cifar10        train : [loss = 0.231, top1 = 92.03%], test  : [loss = 0.388, top1 = 87.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.81 ms.
cifar100       train : [loss = 1.357, top1 = 61.78%], valid : [loss = 1.633, top1 = 55.80%], test : [loss = 1.610, top1 = 56.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 2.845, top1 = 29.65%], valid : [loss = 2.856, top1 = 30.47%], test : [loss = 2.887, top1 = 29.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.08%], valid : [loss = 1.019, top1 = 63.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12756/15625) 012756-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.70%], valid : [loss = 0.543, top1 = 88.02%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.89 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.348, top1 = 91.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=15.54 ms.
cifar100       train : [loss = 0.402, top1 = 88.22%], valid : [loss = 1.253, top1 = 67.52%], test : [loss = 1.312, top1 = 67.02%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.47 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.01%], valid : [loss = 2.442, top1 = 38.50%], test : [loss = 2.437, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.863, top1 = 69.06%], valid : [loss = 0.923, top1 = 67.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12757/15625) 012757-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.096, top1 = 97.19%], valid : [loss = 0.539, top1 = 85.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10        train : [loss = 0.107, top1 = 96.57%], test  : [loss = 0.352, top1 = 89.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.15 ms.
cifar100       train : [loss = 0.752, top1 = 78.23%], valid : [loss = 1.349, top1 = 64.42%], test : [loss = 1.348, top1 = 63.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.11%], valid : [loss = 2.531, top1 = 35.13%], test : [loss = 2.588, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.55%], valid : [loss = 0.903, top1 = 68.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12758/15625) 012758-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.529, top1 = 89.09%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=17.46 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.361, top1 = 92.22%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=17.06 ms.
cifar100       train : [loss = 0.136, top1 = 97.24%], valid : [loss = 1.412, top1 = 68.03%], test : [loss = 1.418, top1 = 67.88%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.81%], valid : [loss = 2.390, top1 = 40.06%], test : [loss = 2.438, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.67%], valid : [loss = 0.716, top1 = 75.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12759/15625) 012759-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.484, top1 = 90.28%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=23.03 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.304, top1 = 93.36%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.24 ms.
cifar100       train : [loss = 0.040, top1 = 99.60%], valid : [loss = 1.338, top1 = 70.76%], test : [loss = 1.296, top1 = 70.64%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 49.98%], valid : [loss = 2.296, top1 = 40.97%], test : [loss = 2.294, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.32%], valid : [loss = 0.788, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12760/15625) 012760-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.482, top1 = 89.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.308, top1 = 92.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 0.321, top1 = 91.35%], valid : [loss = 1.269, top1 = 67.65%], test : [loss = 1.250, top1 = 67.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.66%], valid : [loss = 2.338, top1 = 40.17%], test : [loss = 2.342, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12761/15625) 012761-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.418, top1 = 91.01%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.83 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.277, top1 = 94.03%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.94 ms.
cifar100       train : [loss = 0.029, top1 = 99.77%], valid : [loss = 1.277, top1 = 73.02%], test : [loss = 1.264, top1 = 72.86%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.250, top1 = 65.51%], valid : [loss = 2.257, top1 = 44.83%], test : [loss = 2.246, top1 = 45.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.315, top1 = 89.33%], valid : [loss = 0.466, top1 = 84.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12762/15625) 012762-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12763/15625) 012763-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.586, top1 = 88.26%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.65 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.392, top1 = 92.04%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.48 ms.
cifar100       train : [loss = 0.111, top1 = 97.86%], valid : [loss = 1.538, top1 = 66.60%], test : [loss = 1.571, top1 = 66.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.47 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.38%], valid : [loss = 2.410, top1 = 39.57%], test : [loss = 2.418, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 75.77%], valid : [loss = 0.752, top1 = 73.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12764/15625) 012764-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.573, top1 = 87.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10        train : [loss = 0.040, top1 = 98.80%], test  : [loss = 0.390, top1 = 90.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.54 ms.
cifar100       train : [loss = 0.507, top1 = 85.61%], valid : [loss = 1.354, top1 = 64.62%], test : [loss = 1.304, top1 = 65.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.48 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 35.65%], valid : [loss = 2.655, top1 = 33.13%], test : [loss = 2.662, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 70.77%], valid : [loss = 0.843, top1 = 70.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12765/15625) 012765-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.131, top1 = 95.94%], valid : [loss = 0.465, top1 = 85.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.156, top1 = 95.02%], test  : [loss = 0.344, top1 = 88.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.28 ms.
cifar100       train : [loss = 1.033, top1 = 70.46%], valid : [loss = 1.380, top1 = 61.46%], test : [loss = 1.353, top1 = 61.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.40%], valid : [loss = 2.686, top1 = 33.20%], test : [loss = 2.723, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12766/15625) 012766-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.415, top1 = 85.42%], valid : [loss = 0.647, top1 = 78.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.16 ms.
cifar10        train : [loss = 0.400, top1 = 86.05%], test  : [loss = 0.541, top1 = 82.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.36 ms.
cifar100       train : [loss = 1.602, top1 = 55.73%], valid : [loss = 1.863, top1 = 49.96%], test : [loss = 1.865, top1 = 51.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 3.294, top1 = 21.57%], valid : [loss = 3.281, top1 = 22.10%], test : [loss = 3.307, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.50%], valid : [loss = 1.246, top1 = 55.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12767/15625) 012767-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.500, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.321, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.354, top1 = 90.07%], valid : [loss = 1.256, top1 = 68.07%], test : [loss = 1.246, top1 = 68.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.63%], valid : [loss = 2.328, top1 = 40.36%], test : [loss = 2.341, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.12%], valid : [loss = 0.743, top1 = 74.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12768/15625) 012768-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.59%], valid : [loss = 0.677, top1 = 83.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.078, top1 = 97.52%], test  : [loss = 0.439, top1 = 88.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.74 ms.
cifar100       train : [loss = 0.769, top1 = 77.35%], valid : [loss = 1.427, top1 = 61.68%], test : [loss = 1.433, top1 = 62.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.569, top1 = 35.25%], valid : [loss = 2.672, top1 = 32.73%], test : [loss = 2.722, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.36%], valid : [loss = 0.904, top1 = 67.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12769/15625) 012769-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.65%], valid : [loss = 0.634, top1 = 86.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.405, top1 = 90.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.51 ms.
cifar100       train : [loss = 0.565, top1 = 83.53%], valid : [loss = 1.444, top1 = 63.34%], test : [loss = 1.434, top1 = 63.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.07%], valid : [loss = 2.579, top1 = 34.43%], test : [loss = 2.619, top1 = 35.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.48%], valid : [loss = 0.854, top1 = 69.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12770/15625) 012770-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.39%], valid : [loss = 0.662, top1 = 77.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.20 ms.
cifar10        train : [loss = 0.514, top1 = 82.19%], test  : [loss = 0.587, top1 = 80.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.83 ms.
cifar100       train : [loss = 1.687, top1 = 54.21%], valid : [loss = 1.858, top1 = 50.59%], test : [loss = 1.864, top1 = 50.77%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.31%], valid : [loss = 3.307, top1 = 21.96%], test : [loss = 3.337, top1 = 21.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12771/15625) 012771-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.563, top1 = 87.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.43 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.386, top1 = 91.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.13 ms.
cifar100       train : [loss = 0.217, top1 = 94.64%], valid : [loss = 1.479, top1 = 65.81%], test : [loss = 1.475, top1 = 66.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.93 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.62%], valid : [loss = 2.474, top1 = 37.69%], test : [loss = 2.492, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.22%], valid : [loss = 0.787, top1 = 72.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12772/15625) 012772-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.18%], valid : [loss = 0.607, top1 = 82.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10        train : [loss = 0.209, top1 = 92.88%], test  : [loss = 0.414, top1 = 86.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.65 ms.
cifar100       train : [loss = 1.058, top1 = 69.73%], valid : [loss = 1.448, top1 = 59.74%], test : [loss = 1.498, top1 = 58.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.759, top1 = 31.37%], valid : [loss = 2.840, top1 = 30.40%], test : [loss = 2.858, top1 = 29.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.32%], valid : [loss = 0.966, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12773/15625) 012773-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.12%], valid : [loss = 0.766, top1 = 73.80%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.495, top1 = 82.85%], test  : [loss = 0.560, top1 = 80.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 2.053, top1 = 44.25%], valid : [loss = 2.178, top1 = 41.22%], test : [loss = 2.177, top1 = 41.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 3.075, top1 = 24.94%], valid : [loss = 3.048, top1 = 25.47%], test : [loss = 3.093, top1 = 24.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.160, top1 = 57.88%], valid : [loss = 1.208, top1 = 56.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12774/15625) 012774-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.556, top1 = 87.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.345, top1 = 91.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.33 ms.
cifar100       train : [loss = 0.334, top1 = 90.82%], valid : [loss = 1.311, top1 = 66.91%], test : [loss = 1.310, top1 = 67.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.198, top1 = 43.02%], valid : [loss = 2.455, top1 = 38.17%], test : [loss = 2.455, top1 = 38.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.83%], valid : [loss = 0.816, top1 = 71.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12775/15625) 012775-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.632, top1 = 86.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.017, top1 = 99.56%], test  : [loss = 0.432, top1 = 90.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.26 ms.
cifar100       train : [loss = 0.292, top1 = 92.16%], valid : [loss = 1.536, top1 = 64.70%], test : [loss = 1.547, top1 = 64.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.54%], valid : [loss = 2.577, top1 = 35.30%], test : [loss = 2.572, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 72.95%], valid : [loss = 0.815, top1 = 71.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12776/15625) 012776-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.442, top1 = 90.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.308, top1 = 93.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.68 ms.
cifar100       train : [loss = 0.074, top1 = 98.81%], valid : [loss = 1.373, top1 = 69.64%], test : [loss = 1.378, top1 = 69.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 1.576, top1 = 57.49%], valid : [loss = 2.251, top1 = 43.10%], test : [loss = 2.290, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.84%], valid : [loss = 0.513, top1 = 82.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12777/15625) 012777-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.99%], valid : [loss = 0.518, top1 = 87.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.071, top1 = 97.75%], test  : [loss = 0.343, top1 = 90.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.711, top1 = 79.14%], valid : [loss = 1.341, top1 = 63.74%], test : [loss = 1.335, top1 = 64.38%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 35.92%], valid : [loss = 2.646, top1 = 33.47%], test : [loss = 2.696, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.27%], valid : [loss = 0.659, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12778/15625) 012778-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.85 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.491, top1 = 89.37%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.37 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.318, top1 = 92.54%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.87 ms.
cifar100       train : [loss = 0.213, top1 = 94.66%], valid : [loss = 1.292, top1 = 67.92%], test : [loss = 1.257, top1 = 69.08%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.45 ms.
ImageNet16-120 train : [loss = 1.801, top1 = 52.11%], valid : [loss = 2.191, top1 = 43.70%], test : [loss = 2.184, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.87%], valid : [loss = 0.789, top1 = 72.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12779/15625) 012779-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.512, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.309, top1 = 93.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.50 ms.
cifar100       train : [loss = 0.128, top1 = 97.50%], valid : [loss = 1.277, top1 = 69.72%], test : [loss = 1.292, top1 = 70.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.85%], valid : [loss = 2.283, top1 = 42.13%], test : [loss = 2.277, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12780/15625) 012780-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.82%], valid : [loss = 0.837, top1 = 72.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.549, top1 = 80.94%], test  : [loss = 0.703, top1 = 75.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.47 ms.
cifar100       train : [loss = 1.783, top1 = 52.10%], valid : [loss = 2.050, top1 = 47.32%], test : [loss = 2.048, top1 = 46.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.81%], valid : [loss = 3.628, top1 = 17.20%], test : [loss = 3.669, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.42%], valid : [loss = 1.248, top1 = 55.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12781/15625) 012781-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.28 ms.
cifar10-valid  train : [loss = 0.300, top1 = 89.65%], valid : [loss = 0.476, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.89 ms.
cifar10        train : [loss = 0.270, top1 = 90.94%], test  : [loss = 0.372, top1 = 87.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.79 ms.
cifar100       train : [loss = 1.277, top1 = 64.20%], valid : [loss = 1.479, top1 = 58.69%], test : [loss = 1.453, top1 = 59.33%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 2.819, top1 = 30.50%], valid : [loss = 2.805, top1 = 30.96%], test : [loss = 2.843, top1 = 29.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.82%], valid : [loss = 1.031, top1 = 63.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12782/15625) 012782-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.34%], valid : [loss = 0.621, top1 = 85.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.99 ms.
cifar10        train : [loss = 0.054, top1 = 98.29%], test  : [loss = 0.419, top1 = 89.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.81 ms.
cifar100       train : [loss = 0.648, top1 = 80.88%], valid : [loss = 1.499, top1 = 62.08%], test : [loss = 1.441, top1 = 62.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 2.463, top1 = 37.52%], valid : [loss = 2.620, top1 = 33.97%], test : [loss = 2.644, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.14%], valid : [loss = 0.870, top1 = 69.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12783/15625) 012783-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.562, top1 = 88.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.385, top1 = 91.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.99 ms.
cifar100       train : [loss = 0.146, top1 = 96.75%], valid : [loss = 1.497, top1 = 66.82%], test : [loss = 1.455, top1 = 66.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.52%], valid : [loss = 2.422, top1 = 39.27%], test : [loss = 2.443, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.00%], valid : [loss = 0.750, top1 = 74.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12784/15625) 012784-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10-valid  train : [loss = 1.849, top1 = 33.13%], valid : [loss = 1.863, top1 = 32.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 1.396, top1 = 48.61%], test  : [loss = 1.398, top1 = 48.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.34 ms.
cifar100       train : [loss = 3.911, top1 = 9.84%], valid : [loss = 3.909, top1 = 9.83%], test : [loss = 3.909, top1 = 10.15%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 3.962, top1 = 11.02%], valid : [loss = 3.953, top1 = 11.62%], test : [loss = 3.969, top1 = 11.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.970, top1 = 27.07%], valid : [loss = 1.970, top1 = 27.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12785/15625) 012785-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.78%], valid : [loss = 0.500, top1 = 84.32%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.56 ms.
cifar10        train : [loss = 0.214, top1 = 92.84%], test  : [loss = 0.363, top1 = 88.07%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.28 ms.
cifar100       train : [loss = 1.277, top1 = 64.04%], valid : [loss = 1.574, top1 = 56.62%], test : [loss = 1.564, top1 = 57.22%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.70 ms.
ImageNet16-120 train : [loss = 2.970, top1 = 26.91%], valid : [loss = 2.966, top1 = 27.20%], test : [loss = 2.997, top1 = 25.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.82%], valid : [loss = 1.022, top1 = 63.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12786/15625) 012786-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.517, top1 = 88.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10        train : [loss = 0.026, top1 = 99.31%], test  : [loss = 0.349, top1 = 91.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.72 ms.
cifar100       train : [loss = 0.482, top1 = 85.88%], valid : [loss = 1.359, top1 = 65.34%], test : [loss = 1.352, top1 = 65.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.80%], valid : [loss = 2.512, top1 = 37.30%], test : [loss = 2.591, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.44%], valid : [loss = 0.624, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12787/15625) 012787-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.31%], valid : [loss = 0.610, top1 = 85.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.078, top1 = 97.58%], test  : [loss = 0.399, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.34 ms.
cifar100       train : [loss = 0.734, top1 = 78.53%], valid : [loss = 1.392, top1 = 62.84%], test : [loss = 1.354, top1 = 63.98%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.86 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 36.06%], valid : [loss = 2.670, top1 = 34.37%], test : [loss = 2.683, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.63%], valid : [loss = 0.784, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12788/15625) 012788-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.350, top1 = 87.84%], valid : [loss = 0.611, top1 = 80.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.286, top1 = 90.14%], test  : [loss = 0.439, top1 = 85.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.08 ms.
cifar100       train : [loss = 1.543, top1 = 56.90%], valid : [loss = 1.784, top1 = 51.89%], test : [loss = 1.776, top1 = 51.99%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 2.905, top1 = 28.51%], valid : [loss = 2.937, top1 = 28.17%], test : [loss = 2.971, top1 = 27.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.026, top1 = 62.91%], valid : [loss = 1.085, top1 = 61.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12789/15625) 012789-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.543, top1 = 88.74%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.16 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.351, top1 = 92.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.09 ms.
cifar100       train : [loss = 0.252, top1 = 93.30%], valid : [loss = 1.284, top1 = 68.66%], test : [loss = 1.310, top1 = 68.70%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.08%], valid : [loss = 2.440, top1 = 38.17%], test : [loss = 2.449, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.938, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12790/15625) 012790-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.90%], valid : [loss = 0.601, top1 = 87.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.400, top1 = 90.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.11 ms.
cifar100       train : [loss = 0.413, top1 = 88.29%], valid : [loss = 1.419, top1 = 64.82%], test : [loss = 1.382, top1 = 64.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.82%], valid : [loss = 2.525, top1 = 36.07%], test : [loss = 2.543, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.96%], valid : [loss = 0.838, top1 = 70.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12791/15625) 012791-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.48%], valid : [loss = 0.448, top1 = 87.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.66 ms.
cifar10        train : [loss = 0.056, top1 = 98.63%], test  : [loss = 0.315, top1 = 90.43%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.87 ms.
cifar100       train : [loss = 0.589, top1 = 83.76%], valid : [loss = 1.238, top1 = 66.11%], test : [loss = 1.219, top1 = 66.51%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.25%], valid : [loss = 2.468, top1 = 38.04%], test : [loss = 2.488, top1 = 37.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12792/15625) 012792-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.520, top1 = 89.11%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.99 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.351, top1 = 92.22%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.96 ms.
cifar100       train : [loss = 0.219, top1 = 94.31%], valid : [loss = 1.298, top1 = 68.56%], test : [loss = 1.323, top1 = 67.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.79%], valid : [loss = 2.231, top1 = 42.57%], test : [loss = 2.243, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.37%], valid : [loss = 0.669, top1 = 76.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12793/15625) 012793-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.16%], valid : [loss = 0.532, top1 = 86.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.23 ms.
cifar10        train : [loss = 0.062, top1 = 98.19%], test  : [loss = 0.370, top1 = 89.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.24 ms.
cifar100       train : [loss = 0.538, top1 = 84.65%], valid : [loss = 1.321, top1 = 65.14%], test : [loss = 1.282, top1 = 65.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.69%], valid : [loss = 2.426, top1 = 37.93%], test : [loss = 2.421, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.74%], valid : [loss = 0.842, top1 = 69.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12794/15625) 012794-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.492, top1 = 89.50%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.328, top1 = 92.73%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.68 ms.
cifar100       train : [loss = 0.102, top1 = 98.24%], valid : [loss = 1.311, top1 = 69.54%], test : [loss = 1.302, top1 = 69.62%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.70 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.85%], valid : [loss = 2.297, top1 = 41.90%], test : [loss = 2.278, top1 = 43.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.08%], valid : [loss = 0.639, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12795/15625) 012795-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.52%], valid : [loss = 0.653, top1 = 85.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.394, top1 = 90.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.76 ms.
cifar100       train : [loss = 0.570, top1 = 83.20%], valid : [loss = 1.422, top1 = 63.36%], test : [loss = 1.378, top1 = 63.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.90 ms.
ImageNet16-120 train : [loss = 2.397, top1 = 38.90%], valid : [loss = 2.562, top1 = 36.27%], test : [loss = 2.630, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.47%], valid : [loss = 0.834, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12796/15625) 012796-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.484, top1 = 89.42%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.306, top1 = 92.51%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.82 ms.
cifar100       train : [loss = 0.270, top1 = 92.87%], valid : [loss = 1.233, top1 = 68.85%], test : [loss = 1.261, top1 = 68.53%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.13 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.39%], valid : [loss = 2.204, top1 = 42.67%], test : [loss = 2.201, top1 = 43.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.70%], valid : [loss = 0.653, top1 = 77.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12797/15625) 012797-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.560, top1 = 87.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.024, top1 = 99.27%], test  : [loss = 0.374, top1 = 90.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.61 ms.
cifar100       train : [loss = 0.221, top1 = 94.12%], valid : [loss = 1.333, top1 = 68.04%], test : [loss = 1.358, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 35.52%], valid : [loss = 2.646, top1 = 32.47%], test : [loss = 2.684, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.898, top1 = 67.86%], valid : [loss = 0.932, top1 = 66.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12798/15625) 012798-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.79%], valid : [loss = 0.695, top1 = 76.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10        train : [loss = 0.499, top1 = 82.78%], test  : [loss = 0.578, top1 = 80.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.60 ms.
cifar100       train : [loss = 1.724, top1 = 53.32%], valid : [loss = 1.879, top1 = 50.20%], test : [loss = 1.885, top1 = 49.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 3.338, top1 = 21.04%], valid : [loss = 3.332, top1 = 20.90%], test : [loss = 3.342, top1 = 21.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.292, top1 = 53.12%], valid : [loss = 1.304, top1 = 53.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12799/15625) 012799-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.421, top1 = 91.16%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.44 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.280, top1 = 93.83%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.67 ms.
cifar100       train : [loss = 0.050, top1 = 99.46%], valid : [loss = 1.320, top1 = 71.26%], test : [loss = 1.270, top1 = 71.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.439, top1 = 60.81%], valid : [loss = 2.197, top1 = 45.27%], test : [loss = 2.270, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.81%], valid : [loss = 0.484, top1 = 83.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12800/15625) 012800-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.81%], valid : [loss = 0.907, top1 = 79.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.13 ms.
cifar10        train : [loss = 0.127, top1 = 95.76%], test  : [loss = 0.537, top1 = 84.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.48 ms.
cifar100       train : [loss = 0.845, top1 = 75.35%], valid : [loss = 1.713, top1 = 57.62%], test : [loss = 1.645, top1 = 57.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 3.022, top1 = 26.71%], valid : [loss = 3.167, top1 = 23.90%], test : [loss = 3.217, top1 = 23.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12801/15625) 012801-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.08%], valid : [loss = 0.669, top1 = 83.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.15 ms.
cifar10        train : [loss = 0.086, top1 = 97.17%], test  : [loss = 0.398, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.65 ms.
cifar100       train : [loss = 0.803, top1 = 76.47%], valid : [loss = 1.493, top1 = 60.44%], test : [loss = 1.437, top1 = 61.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.19%], valid : [loss = 2.741, top1 = 32.17%], test : [loss = 2.790, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.24%], valid : [loss = 0.893, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12802/15625) 012802-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.13%], valid : [loss = 0.455, top1 = 86.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.81 ms.
cifar10        train : [loss = 0.166, top1 = 94.52%], test  : [loss = 0.354, top1 = 88.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.34 ms.
cifar100       train : [loss = 1.001, top1 = 71.53%], valid : [loss = 1.339, top1 = 62.50%], test : [loss = 1.332, top1 = 62.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.13 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.72%], valid : [loss = 2.699, top1 = 32.40%], test : [loss = 2.721, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.16%], valid : [loss = 0.767, top1 = 72.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12803/15625) 012803-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.14%], valid : [loss = 0.650, top1 = 84.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.061, top1 = 98.07%], test  : [loss = 0.404, top1 = 88.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.59 ms.
cifar100       train : [loss = 0.646, top1 = 81.03%], valid : [loss = 1.489, top1 = 61.96%], test : [loss = 1.451, top1 = 62.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.59%], valid : [loss = 2.672, top1 = 34.33%], test : [loss = 2.700, top1 = 33.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.04%], valid : [loss = 0.894, top1 = 68.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12804/15625) 012804-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.66%], valid : [loss = 0.437, top1 = 86.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10        train : [loss = 0.153, top1 = 95.01%], test  : [loss = 0.337, top1 = 88.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.11 ms.
cifar100       train : [loss = 0.988, top1 = 71.89%], valid : [loss = 1.363, top1 = 61.92%], test : [loss = 1.382, top1 = 62.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.70 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.96%], valid : [loss = 2.707, top1 = 33.27%], test : [loss = 2.695, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12805/15625) 012805-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.11%], valid : [loss = 0.848, top1 = 72.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10        train : [loss = 0.567, top1 = 80.06%], test  : [loss = 0.716, top1 = 75.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.63 ms.
cifar100       train : [loss = 1.778, top1 = 51.97%], valid : [loss = 2.033, top1 = 47.24%], test : [loss = 2.051, top1 = 47.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.75%], valid : [loss = 3.618, top1 = 16.27%], test : [loss = 3.671, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12806/15625) 012806-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.426, top1 = 90.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.279, top1 = 93.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.77 ms.
cifar100       train : [loss = 0.184, top1 = 95.63%], valid : [loss = 1.286, top1 = 69.38%], test : [loss = 1.266, top1 = 69.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.69%], valid : [loss = 2.235, top1 = 42.87%], test : [loss = 2.310, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.29%], valid : [loss = 0.504, top1 = 83.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12807/15625) 012807-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.529, top1 = 88.28%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.53 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.348, top1 = 91.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.45 ms.
cifar100       train : [loss = 0.329, top1 = 91.03%], valid : [loss = 1.287, top1 = 66.66%], test : [loss = 1.322, top1 = 66.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.32 ms.
ImageNet16-120 train : [loss = 2.162, top1 = 43.83%], valid : [loss = 2.417, top1 = 38.30%], test : [loss = 2.428, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.50%], valid : [loss = 0.832, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12808/15625) 012808-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.79%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.32 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.358, top1 = 92.69%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=20.82 ms.
cifar100       train : [loss = 0.063, top1 = 99.13%], valid : [loss = 1.446, top1 = 68.42%], test : [loss = 1.447, top1 = 68.20%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 1.744, top1 = 53.56%], valid : [loss = 2.378, top1 = 40.17%], test : [loss = 2.419, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.24%], valid : [loss = 0.681, top1 = 76.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12809/15625) 012809-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.28%], valid : [loss = 0.617, top1 = 85.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.383, top1 = 89.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.85 ms.
cifar100       train : [loss = 0.713, top1 = 79.49%], valid : [loss = 1.381, top1 = 63.60%], test : [loss = 1.387, top1 = 63.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.92%], valid : [loss = 2.668, top1 = 33.07%], test : [loss = 2.695, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12810/15625) 012810-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.49%], valid : [loss = 0.467, top1 = 86.14%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10        train : [loss = 0.163, top1 = 94.66%], test  : [loss = 0.344, top1 = 88.54%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.80 ms.
cifar100       train : [loss = 1.012, top1 = 71.44%], valid : [loss = 1.355, top1 = 63.02%], test : [loss = 1.338, top1 = 62.88%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.66%], valid : [loss = 2.682, top1 = 32.97%], test : [loss = 2.714, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12811/15625) 012811-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.544, top1 = 89.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.366, top1 = 92.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.43 ms.
cifar100       train : [loss = 0.074, top1 = 98.85%], valid : [loss = 1.483, top1 = 68.72%], test : [loss = 1.434, top1 = 68.72%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 1.795, top1 = 52.27%], valid : [loss = 2.353, top1 = 40.93%], test : [loss = 2.395, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.57%], valid : [loss = 0.693, top1 = 76.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12812/15625) 012812-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.332, top1 = 91.94%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.76 ms.
cifar100       train : [loss = 0.349, top1 = 90.46%], valid : [loss = 1.264, top1 = 66.80%], test : [loss = 1.310, top1 = 67.46%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.90 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 44.91%], valid : [loss = 2.421, top1 = 38.37%], test : [loss = 2.373, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.43%], valid : [loss = 0.747, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12813/15625) 012813-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.594, top1 = 87.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10        train : [loss = 0.047, top1 = 98.53%], test  : [loss = 0.374, top1 = 90.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.89 ms.
cifar100       train : [loss = 0.383, top1 = 89.03%], valid : [loss = 1.471, top1 = 63.24%], test : [loss = 1.539, top1 = 62.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.803, top1 = 29.64%], valid : [loss = 2.869, top1 = 28.27%], test : [loss = 2.895, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12814/15625) 012814-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.520, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.349, top1 = 91.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.66 ms.
cifar100       train : [loss = 0.308, top1 = 91.27%], valid : [loss = 1.328, top1 = 66.70%], test : [loss = 1.312, top1 = 67.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.82%], valid : [loss = 2.479, top1 = 37.27%], test : [loss = 2.496, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 67.97%], valid : [loss = 0.932, top1 = 67.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12815/15625) 012815-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.226, top1 = 92.44%], valid : [loss = 0.496, top1 = 84.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.78 ms.
cifar10        train : [loss = 0.219, top1 = 92.54%], test  : [loss = 0.395, top1 = 87.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.73 ms.
cifar100       train : [loss = 1.424, top1 = 60.56%], valid : [loss = 1.656, top1 = 54.74%], test : [loss = 1.631, top1 = 55.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 3.490, top1 = 17.92%], valid : [loss = 3.473, top1 = 18.20%], test : [loss = 3.520, top1 = 17.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.021, top1 = 63.63%], valid : [loss = 1.028, top1 = 63.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12816/15625) 012816-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.05%], valid : [loss = 0.866, top1 = 71.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10        train : [loss = 0.559, top1 = 80.50%], test  : [loss = 0.713, top1 = 75.92%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.15 ms.
cifar100       train : [loss = 1.770, top1 = 52.23%], valid : [loss = 2.062, top1 = 46.48%], test : [loss = 2.064, top1 = 46.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.83%], valid : [loss = 3.641, top1 = 16.36%], test : [loss = 3.671, top1 = 15.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12817/15625) 012817-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.495, top1 = 89.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.327, top1 = 92.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.80 ms.
cifar100       train : [loss = 0.129, top1 = 97.10%], valid : [loss = 1.357, top1 = 69.22%], test : [loss = 1.354, top1 = 68.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.65 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.88%], valid : [loss = 2.214, top1 = 43.47%], test : [loss = 2.194, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.01%], valid : [loss = 0.740, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12818/15625) 012818-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.65 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.10 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.64 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.92 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12819/15625) 012819-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.524, top1 = 89.51%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.349, top1 = 93.05%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.92 ms.
cifar100       train : [loss = 0.035, top1 = 99.74%], valid : [loss = 1.383, top1 = 70.66%], test : [loss = 1.392, top1 = 69.98%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 1.558, top1 = 57.93%], valid : [loss = 2.402, top1 = 41.17%], test : [loss = 2.411, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.54%], valid : [loss = 0.669, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12820/15625) 012820-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.52%], valid : [loss = 0.427, top1 = 88.18%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10        train : [loss = 0.057, top1 = 98.62%], test  : [loss = 0.311, top1 = 90.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.08 ms.
cifar100       train : [loss = 0.599, top1 = 83.49%], valid : [loss = 1.213, top1 = 66.96%], test : [loss = 1.199, top1 = 67.72%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.16 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.15%], valid : [loss = 2.484, top1 = 37.27%], test : [loss = 2.489, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.57%], valid : [loss = 0.611, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12821/15625) 012821-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.33%], valid : [loss = 0.545, top1 = 86.60%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.54 ms.
cifar10        train : [loss = 0.043, top1 = 98.87%], test  : [loss = 0.358, top1 = 90.38%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.66 ms.
cifar100       train : [loss = 0.498, top1 = 85.88%], valid : [loss = 1.314, top1 = 65.84%], test : [loss = 1.284, top1 = 66.11%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.12%], valid : [loss = 2.419, top1 = 38.03%], test : [loss = 2.432, top1 = 38.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.97%], valid : [loss = 0.821, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12822/15625) 012822-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.462, top1 = 89.32%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=18.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.313, top1 = 92.16%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=18.84 ms.
cifar100       train : [loss = 0.259, top1 = 93.46%], valid : [loss = 1.223, top1 = 68.77%], test : [loss = 1.232, top1 = 69.05%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=17.08 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.39%], valid : [loss = 2.254, top1 = 41.84%], test : [loss = 2.264, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.76%], valid : [loss = 0.597, top1 = 79.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12823/15625) 012823-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.90 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.16%], valid : [loss = 0.607, top1 = 85.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.30 ms.
cifar10        train : [loss = 0.059, top1 = 98.21%], test  : [loss = 0.412, top1 = 88.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.18 ms.
cifar100       train : [loss = 0.671, top1 = 80.16%], valid : [loss = 1.451, top1 = 61.76%], test : [loss = 1.406, top1 = 63.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 2.510, top1 = 36.53%], valid : [loss = 2.625, top1 = 33.63%], test : [loss = 2.661, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.68%], valid : [loss = 0.854, top1 = 70.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12824/15625) 012824-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.592, top1 = 87.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.389, top1 = 91.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.99 ms.
cifar100       train : [loss = 0.388, top1 = 89.04%], valid : [loss = 1.407, top1 = 64.78%], test : [loss = 1.378, top1 = 65.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.93 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.21%], valid : [loss = 2.501, top1 = 36.93%], test : [loss = 2.535, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12825/15625) 012825-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.408, top1 = 85.76%], valid : [loss = 0.638, top1 = 79.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10        train : [loss = 0.356, top1 = 87.70%], test  : [loss = 0.485, top1 = 83.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 1.667, top1 = 53.89%], valid : [loss = 1.876, top1 = 49.60%], test : [loss = 1.880, top1 = 49.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 22.53%], valid : [loss = 3.218, top1 = 22.40%], test : [loss = 3.270, top1 = 21.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.069, top1 = 61.31%], valid : [loss = 1.107, top1 = 60.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12826/15625) 012826-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.83%], valid : [loss = 0.515, top1 = 85.69%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.63 ms.
cifar10        train : [loss = 0.165, top1 = 94.68%], test  : [loss = 0.390, top1 = 88.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.36 ms.
cifar100       train : [loss = 0.930, top1 = 73.18%], valid : [loss = 1.333, top1 = 62.78%], test : [loss = 1.347, top1 = 62.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.688, top1 = 33.09%], valid : [loss = 2.734, top1 = 31.00%], test : [loss = 2.787, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.896, top1 = 68.08%], valid : [loss = 0.940, top1 = 66.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12827/15625) 012827-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.535, top1 = 88.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.339, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.14 ms.
cifar100       train : [loss = 0.282, top1 = 92.46%], valid : [loss = 1.278, top1 = 67.78%], test : [loss = 1.267, top1 = 67.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 2.011, top1 = 47.19%], valid : [loss = 2.336, top1 = 40.23%], test : [loss = 2.325, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.76%], valid : [loss = 0.733, top1 = 74.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12828/15625) 012828-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.63%], valid : [loss = 0.917, top1 = 76.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.93 ms.
cifar10        train : [loss = 0.233, top1 = 92.05%], test  : [loss = 0.578, top1 = 82.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.05 ms.
cifar100       train : [loss = 1.177, top1 = 66.94%], valid : [loss = 1.839, top1 = 53.16%], test : [loss = 1.784, top1 = 54.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 3.226, top1 = 22.78%], valid : [loss = 3.351, top1 = 20.90%], test : [loss = 3.367, top1 = 20.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12829/15625) 012829-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.635, top1 = 86.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.032, top1 = 99.17%], test  : [loss = 0.426, top1 = 89.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.51 ms.
cifar100       train : [loss = 0.395, top1 = 89.34%], valid : [loss = 1.447, top1 = 64.88%], test : [loss = 1.416, top1 = 64.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.32%], valid : [loss = 2.608, top1 = 34.70%], test : [loss = 2.641, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12830/15625) 012830-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.11%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.98 ms.
cifar100       train : [loss = 0.328, top1 = 91.06%], valid : [loss = 1.313, top1 = 67.26%], test : [loss = 1.304, top1 = 67.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.23 ms.
ImageNet16-120 train : [loss = 2.053, top1 = 46.38%], valid : [loss = 2.370, top1 = 40.18%], test : [loss = 2.402, top1 = 39.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.83%], valid : [loss = 0.564, top1 = 81.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12831/15625) 012831-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.66 ms.
cifar10-valid  train : [loss = 0.135, top1 = 95.66%], valid : [loss = 0.563, top1 = 84.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.155, top1 = 94.88%], test  : [loss = 0.388, top1 = 88.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.00 ms.
cifar100       train : [loss = 1.067, top1 = 69.24%], valid : [loss = 1.462, top1 = 59.64%], test : [loss = 1.467, top1 = 59.88%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 36.15%], valid : [loss = 2.634, top1 = 34.30%], test : [loss = 2.641, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.53%], valid : [loss = 0.907, top1 = 68.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12832/15625) 012832-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.13%], valid : [loss = 0.566, top1 = 85.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.53 ms.
cifar10        train : [loss = 0.053, top1 = 98.55%], test  : [loss = 0.351, top1 = 90.17%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.18 ms.
cifar100       train : [loss = 0.531, top1 = 84.75%], valid : [loss = 1.296, top1 = 65.68%], test : [loss = 1.294, top1 = 65.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.78 ms.
ImageNet16-120 train : [loss = 2.320, top1 = 40.46%], valid : [loss = 2.460, top1 = 38.10%], test : [loss = 2.504, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.52%], valid : [loss = 0.824, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12833/15625) 012833-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.13%], valid : [loss = 0.676, top1 = 84.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.80 ms.
cifar10        train : [loss = 0.066, top1 = 97.90%], test  : [loss = 0.428, top1 = 88.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.61 ms.
cifar100       train : [loss = 0.700, top1 = 79.33%], valid : [loss = 1.507, top1 = 61.08%], test : [loss = 1.485, top1 = 61.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.475, top1 = 37.24%], valid : [loss = 2.627, top1 = 33.90%], test : [loss = 2.652, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.75%], valid : [loss = 0.886, top1 = 68.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12834/15625) 012834-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.24%], valid : [loss = 0.606, top1 = 85.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.071, top1 = 97.89%], test  : [loss = 0.384, top1 = 89.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.47 ms.
cifar100       train : [loss = 0.726, top1 = 79.01%], valid : [loss = 1.378, top1 = 63.06%], test : [loss = 1.337, top1 = 64.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.05%], valid : [loss = 2.672, top1 = 33.00%], test : [loss = 2.698, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12835/15625) 012835-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.518, top1 = 88.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.349, top1 = 91.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.58 ms.
cifar100       train : [loss = 0.347, top1 = 90.60%], valid : [loss = 1.302, top1 = 66.76%], test : [loss = 1.278, top1 = 67.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.47%], valid : [loss = 2.404, top1 = 38.37%], test : [loss = 2.412, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.66%], valid : [loss = 0.633, top1 = 78.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12836/15625) 012836-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.33 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.83%], valid : [loss = 0.856, top1 = 71.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10        train : [loss = 0.556, top1 = 80.61%], test  : [loss = 0.720, top1 = 75.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.36 ms.
cifar100       train : [loss = 1.791, top1 = 51.73%], valid : [loss = 2.064, top1 = 46.44%], test : [loss = 2.067, top1 = 46.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.91 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.73%], valid : [loss = 3.645, top1 = 16.23%], test : [loss = 3.671, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12837/15625) 012837-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.455, top1 = 89.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.320, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.94 ms.
cifar100       train : [loss = 0.326, top1 = 91.11%], valid : [loss = 1.313, top1 = 67.15%], test : [loss = 1.299, top1 = 67.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.16%], valid : [loss = 2.367, top1 = 39.68%], test : [loss = 2.408, top1 = 39.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.446, top1 = 84.50%], valid : [loss = 0.547, top1 = 81.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12838/15625) 012838-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.548, top1 = 89.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.21 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.375, top1 = 92.46%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.53 ms.
cifar100       train : [loss = 0.072, top1 = 98.77%], valid : [loss = 1.408, top1 = 69.58%], test : [loss = 1.387, top1 = 69.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.94 ms.
ImageNet16-120 train : [loss = 1.721, top1 = 53.98%], valid : [loss = 2.283, top1 = 42.27%], test : [loss = 2.265, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.34%], valid : [loss = 0.676, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12839/15625) 012839-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.424, top1 = 90.67%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.32 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.292, top1 = 93.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.85 ms.
cifar100       train : [loss = 0.076, top1 = 98.80%], valid : [loss = 1.368, top1 = 69.44%], test : [loss = 1.365, top1 = 69.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.613, top1 = 56.51%], valid : [loss = 2.220, top1 = 43.00%], test : [loss = 2.247, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.401, top1 = 86.40%], valid : [loss = 0.530, top1 = 82.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12840/15625) 012840-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.536, top1 = 88.33%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.17 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.360, top1 = 91.08%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.38 ms.
cifar100       train : [loss = 0.404, top1 = 88.45%], valid : [loss = 1.252, top1 = 67.42%], test : [loss = 1.260, top1 = 66.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 2.227, top1 = 42.34%], valid : [loss = 2.421, top1 = 38.87%], test : [loss = 2.460, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.18%], valid : [loss = 0.808, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12841/15625) 012841-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.09%], valid : [loss = 0.478, top1 = 84.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.299, top1 = 90.00%], test  : [loss = 0.398, top1 = 86.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.40 ms.
cifar100       train : [loss = 1.337, top1 = 62.91%], valid : [loss = 1.536, top1 = 57.75%], test : [loss = 1.510, top1 = 58.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.66%], valid : [loss = 2.907, top1 = 29.10%], test : [loss = 2.959, top1 = 28.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12842/15625) 012842-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.545, top1 = 87.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10        train : [loss = 0.028, top1 = 99.20%], test  : [loss = 0.338, top1 = 91.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.86 ms.
cifar100       train : [loss = 0.469, top1 = 86.40%], valid : [loss = 1.295, top1 = 66.38%], test : [loss = 1.279, top1 = 66.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.30%], valid : [loss = 2.335, top1 = 40.67%], test : [loss = 2.395, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.31%], valid : [loss = 0.784, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12843/15625) 012843-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.516, top1 = 89.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.336, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.88 ms.
cifar100       train : [loss = 0.108, top1 = 98.06%], valid : [loss = 1.444, top1 = 67.70%], test : [loss = 1.427, top1 = 68.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.12%], valid : [loss = 2.407, top1 = 39.13%], test : [loss = 2.369, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.67%], valid : [loss = 0.716, top1 = 75.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12844/15625) 012844-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.59%], valid : [loss = 0.453, top1 = 86.37%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=17.49 ms.
cifar10        train : [loss = 0.150, top1 = 95.16%], test  : [loss = 0.337, top1 = 89.08%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=16.63 ms.
cifar100       train : [loss = 0.965, top1 = 72.67%], valid : [loss = 1.341, top1 = 62.66%], test : [loss = 1.344, top1 = 62.50%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.32%], valid : [loss = 2.652, top1 = 33.76%], test : [loss = 2.690, top1 = 32.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.61%], valid : [loss = 0.787, top1 = 72.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12845/15625) 012845-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.550, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.28 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.366, top1 = 92.30%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.14 ms.
cifar100       train : [loss = 0.064, top1 = 99.13%], valid : [loss = 1.503, top1 = 68.24%], test : [loss = 1.501, top1 = 68.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.799, top1 = 52.17%], valid : [loss = 2.369, top1 = 40.87%], test : [loss = 2.391, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.45%], valid : [loss = 0.668, top1 = 77.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12846/15625) 012846-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.47%], valid : [loss = 0.540, top1 = 86.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.084, top1 = 97.40%], test  : [loss = 0.354, top1 = 89.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.808, top1 = 76.42%], valid : [loss = 1.398, top1 = 62.64%], test : [loss = 1.400, top1 = 62.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.510, top1 = 36.16%], valid : [loss = 2.586, top1 = 34.37%], test : [loss = 2.636, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.50%], valid : [loss = 0.847, top1 = 70.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12847/15625) 012847-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.096, top1 = 97.06%], valid : [loss = 0.584, top1 = 84.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=17.37 ms.
cifar10        train : [loss = 0.124, top1 = 95.94%], test  : [loss = 0.400, top1 = 88.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.776, top1 = 77.22%], valid : [loss = 1.435, top1 = 60.76%], test : [loss = 1.442, top1 = 61.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.38%], valid : [loss = 2.715, top1 = 32.30%], test : [loss = 2.744, top1 = 32.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.77%], valid : [loss = 0.878, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12848/15625) 012848-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.492, top1 = 89.98%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.39 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.321, top1 = 93.29%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.18 ms.
cifar100       train : [loss = 0.070, top1 = 98.97%], valid : [loss = 1.394, top1 = 69.12%], test : [loss = 1.366, top1 = 70.04%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.65 ms.
ImageNet16-120 train : [loss = 1.651, top1 = 55.71%], valid : [loss = 2.214, top1 = 44.50%], test : [loss = 2.176, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.78%], valid : [loss = 0.637, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12849/15625) 012849-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.44%], valid : [loss = 0.577, top1 = 86.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.084, top1 = 97.19%], test  : [loss = 0.374, top1 = 89.61%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.01 ms.
cifar100       train : [loss = 0.652, top1 = 80.78%], valid : [loss = 1.327, top1 = 64.66%], test : [loss = 1.323, top1 = 65.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.320, top1 = 40.35%], valid : [loss = 2.463, top1 = 36.97%], test : [loss = 2.454, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.95%], valid : [loss = 0.807, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12850/15625) 012850-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.70%], valid : [loss = 0.474, top1 = 85.10%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.83 ms.
cifar10        train : [loss = 0.213, top1 = 92.86%], test  : [loss = 0.372, top1 = 87.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.99 ms.
cifar100       train : [loss = 1.202, top1 = 66.04%], valid : [loss = 1.490, top1 = 58.66%], test : [loss = 1.482, top1 = 58.12%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 3.104, top1 = 24.56%], valid : [loss = 3.102, top1 = 25.23%], test : [loss = 3.119, top1 = 25.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 59.67%], valid : [loss = 1.123, top1 = 59.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12851/15625) 012851-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.657, top1 = 86.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.422, top1 = 91.07%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.71 ms.
cifar100       train : [loss = 0.200, top1 = 95.27%], valid : [loss = 1.563, top1 = 65.04%], test : [loss = 1.555, top1 = 64.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.09%], valid : [loss = 2.439, top1 = 38.60%], test : [loss = 2.463, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 73.94%], valid : [loss = 0.815, top1 = 71.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12852/15625) 012852-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.525, top1 = 88.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.334, top1 = 92.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.29 ms.
cifar100       train : [loss = 0.340, top1 = 90.69%], valid : [loss = 1.257, top1 = 67.84%], test : [loss = 1.277, top1 = 67.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.73%], valid : [loss = 2.403, top1 = 38.86%], test : [loss = 2.416, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12853/15625) 012853-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.543, top1 = 88.55%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.377, top1 = 91.20%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.90 ms.
cifar100       train : [loss = 0.220, top1 = 94.32%], valid : [loss = 1.319, top1 = 68.34%], test : [loss = 1.351, top1 = 67.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.564, top1 = 34.74%], valid : [loss = 2.687, top1 = 32.23%], test : [loss = 2.681, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.07%], valid : [loss = 0.959, top1 = 65.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12854/15625) 012854-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.507, top1 = 89.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.330, top1 = 92.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.44 ms.
cifar100       train : [loss = 0.116, top1 = 97.84%], valid : [loss = 1.306, top1 = 68.64%], test : [loss = 1.294, top1 = 69.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.55%], valid : [loss = 2.170, top1 = 44.27%], test : [loss = 2.167, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12855/15625) 012855-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.458, top1 = 90.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.96 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.304, top1 = 92.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.07 ms.
cifar100       train : [loss = 0.100, top1 = 98.04%], valid : [loss = 1.352, top1 = 69.68%], test : [loss = 1.322, top1 = 69.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 1.661, top1 = 55.53%], valid : [loss = 2.204, top1 = 43.97%], test : [loss = 2.244, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.52%], valid : [loss = 0.548, top1 = 81.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12856/15625) 012856-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.94%], valid : [loss = 0.537, top1 = 85.80%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.087, top1 = 97.30%], test  : [loss = 0.359, top1 = 89.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.790, top1 = 77.03%], valid : [loss = 1.401, top1 = 62.45%], test : [loss = 1.380, top1 = 62.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 36.80%], valid : [loss = 2.595, top1 = 34.46%], test : [loss = 2.622, top1 = 34.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.03%], valid : [loss = 0.862, top1 = 69.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12857/15625) 012857-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.51%], valid : [loss = 0.450, top1 = 87.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.056, top1 = 98.61%], test  : [loss = 0.311, top1 = 90.51%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.09 ms.
cifar100       train : [loss = 0.597, top1 = 83.42%], valid : [loss = 1.256, top1 = 65.54%], test : [loss = 1.225, top1 = 66.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.98%], valid : [loss = 2.473, top1 = 37.87%], test : [loss = 2.506, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12858/15625) 012858-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.527, top1 = 88.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.329, top1 = 91.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.315, top1 = 91.62%], valid : [loss = 1.297, top1 = 66.94%], test : [loss = 1.297, top1 = 67.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.85%], valid : [loss = 2.398, top1 = 38.67%], test : [loss = 2.442, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12859/15625) 012859-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.09 ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.49%], valid : [loss = 0.861, top1 = 71.58%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.51 ms.
cifar10        train : [loss = 0.556, top1 = 80.55%], test  : [loss = 0.718, top1 = 75.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.84 ms.
cifar100       train : [loss = 1.787, top1 = 51.72%], valid : [loss = 2.069, top1 = 45.80%], test : [loss = 2.089, top1 = 45.70%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.47 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.75%], valid : [loss = 3.632, top1 = 16.87%], test : [loss = 3.656, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12860/15625) 012860-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.568, top1 = 87.51%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.385, top1 = 91.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.30 ms.
cifar100       train : [loss = 0.406, top1 = 88.40%], valid : [loss = 1.411, top1 = 65.21%], test : [loss = 1.415, top1 = 65.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.01 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.07%], valid : [loss = 2.506, top1 = 36.94%], test : [loss = 2.509, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.69%], valid : [loss = 0.822, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12861/15625) 012861-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.535, top1 = 88.97%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=19.02 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.354, top1 = 92.30%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=20.15 ms.
cifar100       train : [loss = 0.133, top1 = 97.42%], valid : [loss = 1.407, top1 = 68.02%], test : [loss = 1.388, top1 = 68.57%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=18.87 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.68%], valid : [loss = 2.360, top1 = 41.00%], test : [loss = 2.388, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.60%], valid : [loss = 0.645, top1 = 77.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12862/15625) 012862-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.524, top1 = 89.17%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.323, top1 = 92.67%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.36 ms.
cifar100       train : [loss = 0.143, top1 = 97.08%], valid : [loss = 1.297, top1 = 68.98%], test : [loss = 1.319, top1 = 69.02%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 1.865, top1 = 50.65%], valid : [loss = 2.315, top1 = 40.77%], test : [loss = 2.288, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 79.24%], valid : [loss = 0.678, top1 = 76.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12863/15625) 012863-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.588, top1 = 88.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.60 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.376, top1 = 91.59%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.49 ms.
cifar100       train : [loss = 0.204, top1 = 95.18%], valid : [loss = 1.405, top1 = 66.04%], test : [loss = 1.403, top1 = 66.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.25 ms.
ImageNet16-120 train : [loss = 2.363, top1 = 38.89%], valid : [loss = 2.506, top1 = 36.10%], test : [loss = 2.545, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.070, top1 = 61.67%], valid : [loss = 1.107, top1 = 60.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12864/15625) 012864-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.484, top1 = 89.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.337, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.81 ms.
cifar100       train : [loss = 0.214, top1 = 94.46%], valid : [loss = 1.331, top1 = 68.06%], test : [loss = 1.339, top1 = 68.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 1.953, top1 = 48.67%], valid : [loss = 2.297, top1 = 42.10%], test : [loss = 2.339, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.56%], valid : [loss = 0.565, top1 = 81.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12865/15625) 012865-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.589, top1 = 87.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.362, top1 = 91.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.78 ms.
cifar100       train : [loss = 0.345, top1 = 90.60%], valid : [loss = 1.439, top1 = 64.36%], test : [loss = 1.436, top1 = 65.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.46%], valid : [loss = 2.469, top1 = 37.20%], test : [loss = 2.405, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.66%], valid : [loss = 0.804, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12866/15625) 012866-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.42 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.545, top1 = 89.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.37 ms.
cifar10        train : [loss = 0.011, top1 = 99.71%], test  : [loss = 0.357, top1 = 92.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.28 ms.
cifar100       train : [loss = 0.146, top1 = 96.46%], valid : [loss = 1.336, top1 = 68.56%], test : [loss = 1.368, top1 = 68.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.370, top1 = 38.94%], valid : [loss = 2.498, top1 = 36.13%], test : [loss = 2.547, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 64.97%], valid : [loss = 0.990, top1 = 64.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12867/15625) 012867-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.625, top1 = 87.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.376, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.47 ms.
cifar100       train : [loss = 0.216, top1 = 94.91%], valid : [loss = 1.487, top1 = 65.02%], test : [loss = 1.441, top1 = 65.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.85%], valid : [loss = 2.519, top1 = 37.17%], test : [loss = 2.507, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12868/15625) 012868-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.96%], valid : [loss = 0.464, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.58 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.337, top1 = 90.81%], valid : [loss = 1.290, top1 = 67.30%], test : [loss = 1.305, top1 = 67.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.30%], valid : [loss = 2.362, top1 = 40.27%], test : [loss = 2.359, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.79%], valid : [loss = 0.542, top1 = 81.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12869/15625) 012869-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.374, top1 = 86.87%], valid : [loss = 0.620, top1 = 79.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 0.323, top1 = 88.90%], test  : [loss = 0.450, top1 = 85.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.72 ms.
cifar100       train : [loss = 1.591, top1 = 55.50%], valid : [loss = 1.806, top1 = 51.58%], test : [loss = 1.802, top1 = 51.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 2.986, top1 = 26.94%], valid : [loss = 2.991, top1 = 27.07%], test : [loss = 3.071, top1 = 24.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.001, top1 = 63.71%], valid : [loss = 1.047, top1 = 62.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12870/15625) 012870-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.01 ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.92%], valid : [loss = 0.863, top1 = 70.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.10 ms.
cifar10        train : [loss = 0.671, top1 = 76.43%], test  : [loss = 0.765, top1 = 73.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 1.961, top1 = 47.76%], valid : [loss = 2.130, top1 = 44.95%], test : [loss = 2.147, top1 = 44.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.00 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.78%], valid : [loss = 3.671, top1 = 15.92%], test : [loss = 3.697, top1 = 14.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12871/15625) 012871-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.546, top1 = 88.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.374, top1 = 91.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.09 ms.
cifar100       train : [loss = 0.271, top1 = 92.68%], valid : [loss = 1.436, top1 = 66.58%], test : [loss = 1.437, top1 = 66.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.61%], valid : [loss = 2.506, top1 = 37.59%], test : [loss = 2.537, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.80%], valid : [loss = 0.705, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12872/15625) 012872-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.671, top1 = 86.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.435, top1 = 89.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.83 ms.
cifar100       train : [loss = 0.301, top1 = 92.14%], valid : [loss = 1.565, top1 = 63.73%], test : [loss = 1.549, top1 = 63.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.46%], valid : [loss = 2.572, top1 = 35.90%], test : [loss = 2.599, top1 = 36.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.12%], valid : [loss = 0.814, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12873/15625) 012873-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.74%], valid : [loss = 0.560, top1 = 82.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10        train : [loss = 0.259, top1 = 91.10%], test  : [loss = 0.436, top1 = 85.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.66 ms.
cifar100       train : [loss = 1.352, top1 = 61.93%], valid : [loss = 1.678, top1 = 55.07%], test : [loss = 1.675, top1 = 55.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 3.001, top1 = 26.91%], valid : [loss = 3.041, top1 = 26.46%], test : [loss = 3.092, top1 = 25.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 56.98%], valid : [loss = 1.238, top1 = 55.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12874/15625) 012874-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.89%], valid : [loss = 0.575, top1 = 86.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.074, top1 = 97.54%], test  : [loss = 0.364, top1 = 90.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.59 ms.
cifar100       train : [loss = 0.682, top1 = 79.81%], valid : [loss = 1.343, top1 = 64.61%], test : [loss = 1.322, top1 = 64.59%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.372, top1 = 39.24%], valid : [loss = 2.516, top1 = 35.93%], test : [loss = 2.537, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.20%], valid : [loss = 0.889, top1 = 68.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12875/15625) 012875-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.552, top1 = 87.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.348, top1 = 91.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.25 ms.
cifar100       train : [loss = 0.351, top1 = 90.23%], valid : [loss = 1.313, top1 = 66.67%], test : [loss = 1.324, top1 = 66.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.13 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.34%], valid : [loss = 2.462, top1 = 37.67%], test : [loss = 2.461, top1 = 37.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.81%], valid : [loss = 0.914, top1 = 67.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12876/15625) 012876-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.08%], valid : [loss = 0.484, top1 = 84.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.84 ms.
cifar10        train : [loss = 0.299, top1 = 89.93%], test  : [loss = 0.399, top1 = 86.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 1.333, top1 = 62.99%], valid : [loss = 1.535, top1 = 57.91%], test : [loss = 1.501, top1 = 58.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.71%], valid : [loss = 2.905, top1 = 29.30%], test : [loss = 2.942, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12877/15625) 012877-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.296, top1 = 89.82%], valid : [loss = 0.554, top1 = 82.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10        train : [loss = 0.263, top1 = 90.92%], test  : [loss = 0.405, top1 = 86.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.25 ms.
cifar100       train : [loss = 1.480, top1 = 58.60%], valid : [loss = 1.722, top1 = 53.51%], test : [loss = 1.714, top1 = 53.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.35 ms.
ImageNet16-120 train : [loss = 2.937, top1 = 27.91%], valid : [loss = 2.959, top1 = 28.40%], test : [loss = 2.995, top1 = 27.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.76%], valid : [loss = 1.016, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12878/15625) 012878-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.342, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.91 ms.
cifar100       train : [loss = 0.348, top1 = 90.47%], valid : [loss = 1.303, top1 = 66.93%], test : [loss = 1.276, top1 = 67.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.59%], valid : [loss = 2.414, top1 = 39.34%], test : [loss = 2.411, top1 = 39.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12879/15625) 012879-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.556, top1 = 88.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.64 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.375, top1 = 91.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.22 ms.
cifar100       train : [loss = 0.142, top1 = 97.13%], valid : [loss = 1.473, top1 = 66.97%], test : [loss = 1.477, top1 = 66.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.53 ms.
ImageNet16-120 train : [loss = 1.948, top1 = 48.79%], valid : [loss = 2.406, top1 = 39.67%], test : [loss = 2.429, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.46%], valid : [loss = 0.734, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12880/15625) 012880-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.540, top1 = 89.25%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.339, top1 = 92.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.92 ms.
cifar100       train : [loss = 0.101, top1 = 98.04%], valid : [loss = 1.341, top1 = 69.60%], test : [loss = 1.365, top1 = 69.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.83 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.95%], valid : [loss = 2.350, top1 = 40.12%], test : [loss = 2.324, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 73.08%], valid : [loss = 0.812, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12881/15625) 012881-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.85%], valid : [loss = 0.688, top1 = 76.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10        train : [loss = 0.635, top1 = 77.93%], test  : [loss = 0.683, top1 = 76.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.73 ms.
cifar100       train : [loss = 1.768, top1 = 52.09%], valid : [loss = 1.918, top1 = 48.82%], test : [loss = 1.938, top1 = 49.23%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.36 ms.
ImageNet16-120 train : [loss = 3.381, top1 = 20.18%], valid : [loss = 3.361, top1 = 20.63%], test : [loss = 3.408, top1 = 18.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12882/15625) 012882-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.530, top1 = 89.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.90 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.336, top1 = 92.79%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.55 ms.
cifar100       train : [loss = 0.126, top1 = 97.43%], valid : [loss = 1.322, top1 = 68.87%], test : [loss = 1.329, top1 = 69.19%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.14%], valid : [loss = 2.321, top1 = 41.46%], test : [loss = 2.296, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.20%], valid : [loss = 0.793, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12883/15625) 012883-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.310, top1 = 89.24%], valid : [loss = 0.560, top1 = 82.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.10 ms.
cifar10        train : [loss = 0.266, top1 = 90.87%], test  : [loss = 0.424, top1 = 86.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.47 ms.
cifar100       train : [loss = 1.445, top1 = 59.41%], valid : [loss = 1.684, top1 = 54.46%], test : [loss = 1.678, top1 = 54.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 2.881, top1 = 28.95%], valid : [loss = 2.898, top1 = 28.79%], test : [loss = 2.939, top1 = 28.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.992, top1 = 64.32%], valid : [loss = 1.034, top1 = 63.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12884/15625) 012884-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.052, top1 = 98.44%], valid : [loss = 0.597, top1 = 85.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.072, top1 = 97.66%], test  : [loss = 0.426, top1 = 88.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 0.658, top1 = 80.55%], valid : [loss = 1.515, top1 = 60.80%], test : [loss = 1.511, top1 = 61.47%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 2.933, top1 = 27.63%], valid : [loss = 2.992, top1 = 26.63%], test : [loss = 3.035, top1 = 26.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 65.04%], valid : [loss = 1.010, top1 = 63.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12885/15625) 012885-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.546, top1 = 88.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10        train : [loss = 0.025, top1 = 99.27%], test  : [loss = 0.357, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.38 ms.
cifar100       train : [loss = 0.404, top1 = 88.33%], valid : [loss = 1.247, top1 = 66.94%], test : [loss = 1.274, top1 = 67.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.220, top1 = 42.50%], valid : [loss = 2.399, top1 = 38.80%], test : [loss = 2.430, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.67%], valid : [loss = 0.864, top1 = 69.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12886/15625) 012886-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.69%], valid : [loss = 0.768, top1 = 73.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10        train : [loss = 0.534, top1 = 81.37%], test  : [loss = 0.602, top1 = 79.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.06 ms.
cifar100       train : [loss = 1.945, top1 = 47.80%], valid : [loss = 2.075, top1 = 45.51%], test : [loss = 2.082, top1 = 45.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 3.291, top1 = 21.30%], valid : [loss = 3.257, top1 = 22.57%], test : [loss = 3.294, top1 = 21.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.352, top1 = 50.83%], valid : [loss = 1.386, top1 = 49.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12887/15625) 012887-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=23.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.471, top1 = 90.18%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=23.55 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.314, top1 = 93.31%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=22.02 ms.
cifar100       train : [loss = 0.053, top1 = 99.43%], valid : [loss = 1.264, top1 = 70.82%], test : [loss = 1.252, top1 = 71.74%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=20.74 ms.
ImageNet16-120 train : [loss = 1.553, top1 = 58.17%], valid : [loss = 2.135, top1 = 46.00%], test : [loss = 2.120, top1 = 46.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.17%], valid : [loss = 0.683, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12888/15625) 012888-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.560, top1 = 89.01%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.81 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.395, top1 = 92.23%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.09 ms.
cifar100       train : [loss = 0.073, top1 = 98.88%], valid : [loss = 1.453, top1 = 68.65%], test : [loss = 1.460, top1 = 68.74%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.21%], valid : [loss = 2.380, top1 = 41.00%], test : [loss = 2.396, top1 = 40.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.90%], valid : [loss = 0.748, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12889/15625) 012889-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.65%], valid : [loss = 0.522, top1 = 86.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.084, top1 = 97.30%], test  : [loss = 0.366, top1 = 89.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 0.738, top1 = 78.52%], valid : [loss = 1.332, top1 = 64.40%], test : [loss = 1.302, top1 = 64.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.71%], valid : [loss = 2.591, top1 = 35.37%], test : [loss = 2.638, top1 = 34.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.32%], valid : [loss = 0.674, top1 = 76.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12890/15625) 012890-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.601, top1 = 86.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.95 ms.
cifar10        train : [loss = 0.024, top1 = 99.33%], test  : [loss = 0.385, top1 = 90.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.294, top1 = 91.73%], valid : [loss = 1.429, top1 = 65.51%], test : [loss = 1.411, top1 = 65.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.23%], valid : [loss = 2.677, top1 = 32.52%], test : [loss = 2.687, top1 = 32.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.934, top1 = 66.74%], valid : [loss = 0.974, top1 = 65.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12891/15625) 012891-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.34%], valid : [loss = 0.537, top1 = 83.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.210, top1 = 92.82%], test  : [loss = 0.407, top1 = 87.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.58 ms.
cifar100       train : [loss = 1.244, top1 = 64.64%], valid : [loss = 1.555, top1 = 57.27%], test : [loss = 1.544, top1 = 57.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.715, top1 = 32.39%], valid : [loss = 2.751, top1 = 30.97%], test : [loss = 2.782, top1 = 31.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12892/15625) 012892-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.53%], valid : [loss = 0.461, top1 = 86.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.152, top1 = 95.03%], test  : [loss = 0.336, top1 = 89.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.75 ms.
cifar100       train : [loss = 0.967, top1 = 72.47%], valid : [loss = 1.349, top1 = 62.70%], test : [loss = 1.342, top1 = 62.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.01 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 34.00%], valid : [loss = 2.684, top1 = 32.88%], test : [loss = 2.710, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12893/15625) 012893-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.80%], valid : [loss = 0.620, top1 = 86.19%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.13 ms.
cifar10        train : [loss = 0.028, top1 = 99.32%], test  : [loss = 0.420, top1 = 89.55%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.42 ms.
cifar100       train : [loss = 0.372, top1 = 90.09%], valid : [loss = 1.396, top1 = 64.71%], test : [loss = 1.401, top1 = 64.83%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.279, top1 = 41.44%], valid : [loss = 2.606, top1 = 35.20%], test : [loss = 2.620, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.74%], valid : [loss = 0.772, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12894/15625) 012894-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.71%], valid : [loss = 0.734, top1 = 80.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10        train : [loss = 0.185, top1 = 93.62%], test  : [loss = 0.507, top1 = 84.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.08 ms.
cifar100       train : [loss = 0.885, top1 = 74.10%], valid : [loss = 1.643, top1 = 57.46%], test : [loss = 1.674, top1 = 56.56%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 3.455, top1 = 17.72%], valid : [loss = 3.456, top1 = 18.07%], test : [loss = 3.471, top1 = 17.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.63%], valid : [loss = 1.283, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12895/15625) 012895-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.550, top1 = 88.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.349, top1 = 91.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.61 ms.
cifar100       train : [loss = 0.418, top1 = 87.95%], valid : [loss = 1.279, top1 = 67.22%], test : [loss = 1.290, top1 = 67.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.22%], valid : [loss = 2.414, top1 = 39.05%], test : [loss = 2.423, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.07%], valid : [loss = 0.842, top1 = 70.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12896/15625) 012896-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.90%], valid : [loss = 0.475, top1 = 84.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10        train : [loss = 0.302, top1 = 89.85%], test  : [loss = 0.399, top1 = 86.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 1.334, top1 = 62.87%], valid : [loss = 1.534, top1 = 57.83%], test : [loss = 1.514, top1 = 58.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.98 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.57%], valid : [loss = 2.899, top1 = 29.09%], test : [loss = 2.973, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12897/15625) 012897-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.472, top1 = 89.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.301, top1 = 92.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.89 ms.
cifar100       train : [loss = 0.320, top1 = 91.41%], valid : [loss = 1.262, top1 = 67.66%], test : [loss = 1.270, top1 = 67.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.61%], valid : [loss = 2.306, top1 = 41.00%], test : [loss = 2.334, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12898/15625) 012898-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.564, top1 = 88.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.381, top1 = 91.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 0.202, top1 = 95.19%], valid : [loss = 1.446, top1 = 66.52%], test : [loss = 1.437, top1 = 66.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.72%], valid : [loss = 2.415, top1 = 39.38%], test : [loss = 2.426, top1 = 39.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.40%], valid : [loss = 0.714, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12899/15625) 012899-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.595, top1 = 87.05%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.39 ms.
cifar10        train : [loss = 0.020, top1 = 99.55%], test  : [loss = 0.416, top1 = 90.10%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.90 ms.
cifar100       train : [loss = 0.205, top1 = 95.66%], valid : [loss = 1.459, top1 = 65.03%], test : [loss = 1.427, top1 = 66.11%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.11%], valid : [loss = 2.547, top1 = 36.88%], test : [loss = 2.559, top1 = 37.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.24%], valid : [loss = 0.769, top1 = 73.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12900/15625) 012900-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.44%], valid : [loss = 0.607, top1 = 86.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.384, top1 = 90.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.98 ms.
cifar100       train : [loss = 0.544, top1 = 84.03%], valid : [loss = 1.462, top1 = 62.77%], test : [loss = 1.427, top1 = 63.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 39.87%], valid : [loss = 2.540, top1 = 35.95%], test : [loss = 2.559, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.25%], valid : [loss = 0.906, top1 = 68.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12901/15625) 012901-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.536, top1 = 88.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.368, top1 = 91.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.97 ms.
cifar100       train : [loss = 0.198, top1 = 95.42%], valid : [loss = 1.402, top1 = 66.68%], test : [loss = 1.424, top1 = 66.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.97%], valid : [loss = 2.466, top1 = 38.98%], test : [loss = 2.466, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.52%], valid : [loss = 0.706, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12902/15625) 012902-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.03 ms.
cifar10-valid  train : [loss = 1.837, top1 = 33.47%], valid : [loss = 1.854, top1 = 32.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10        train : [loss = 1.326, top1 = 51.91%], test  : [loss = 1.321, top1 = 51.71%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.11 ms.
cifar100       train : [loss = 3.842, top1 = 11.11%], valid : [loss = 3.877, top1 = 10.35%], test : [loss = 3.871, top1 = 11.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.25 ms.
ImageNet16-120 train : [loss = 3.885, top1 = 12.12%], valid : [loss = 3.866, top1 = 12.94%], test : [loss = 3.876, top1 = 12.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12903/15625) 012903-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.43%], valid : [loss = 0.694, top1 = 82.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10        train : [loss = 0.139, top1 = 95.30%], test  : [loss = 0.470, top1 = 86.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.22 ms.
cifar100       train : [loss = 0.941, top1 = 72.66%], valid : [loss = 1.628, top1 = 57.24%], test : [loss = 1.635, top1 = 57.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 3.026, top1 = 25.84%], valid : [loss = 3.117, top1 = 24.87%], test : [loss = 3.134, top1 = 23.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12904/15625) 012904-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.590, top1 = 87.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.411, top1 = 90.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.46 ms.
cifar100       train : [loss = 0.274, top1 = 92.87%], valid : [loss = 1.526, top1 = 64.18%], test : [loss = 1.498, top1 = 64.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.99%], valid : [loss = 2.470, top1 = 37.33%], test : [loss = 2.523, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.66%], valid : [loss = 0.806, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12905/15625) 012905-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.511, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.020, top1 = 99.50%], test  : [loss = 0.366, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.409, top1 = 88.22%], valid : [loss = 1.364, top1 = 66.16%], test : [loss = 1.351, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.274, top1 = 41.46%], valid : [loss = 2.491, top1 = 37.02%], test : [loss = 2.527, top1 = 36.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.40%], valid : [loss = 0.728, top1 = 75.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12906/15625) 012906-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.04%], valid : [loss = 0.528, top1 = 86.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.074, top1 = 97.60%], test  : [loss = 0.351, top1 = 90.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.47 ms.
cifar100       train : [loss = 0.705, top1 = 79.32%], valid : [loss = 1.385, top1 = 63.78%], test : [loss = 1.344, top1 = 64.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 35.89%], valid : [loss = 2.656, top1 = 34.03%], test : [loss = 2.675, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.93%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12907/15625) 012907-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.52%], valid : [loss = 0.453, top1 = 86.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.89 ms.
cifar10        train : [loss = 0.157, top1 = 94.95%], test  : [loss = 0.342, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 0.972, top1 = 72.44%], valid : [loss = 1.343, top1 = 62.71%], test : [loss = 1.346, top1 = 62.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.31%], valid : [loss = 2.679, top1 = 32.85%], test : [loss = 2.697, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.73%], valid : [loss = 0.774, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12908/15625) 012908-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10-valid  train : [loss = 1.843, top1 = 33.35%], valid : [loss = 1.857, top1 = 32.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.37 ms.
cifar10        train : [loss = 1.273, top1 = 54.14%], test  : [loss = 1.276, top1 = 53.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.86 ms.
cifar100       train : [loss = 3.871, top1 = 10.61%], valid : [loss = 3.870, top1 = 10.41%], test : [loss = 3.866, top1 = 11.04%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.45 ms.
ImageNet16-120 train : [loss = 3.876, top1 = 12.30%], valid : [loss = 3.851, top1 = 13.05%], test : [loss = 3.861, top1 = 11.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12909/15625) 012909-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12910/15625) 012910-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.542, top1 = 89.24%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.344, top1 = 92.72%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.24 ms.
cifar100       train : [loss = 0.075, top1 = 98.67%], valid : [loss = 1.410, top1 = 69.19%], test : [loss = 1.426, top1 = 69.11%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.083, top1 = 45.52%], valid : [loss = 2.363, top1 = 39.95%], test : [loss = 2.383, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.77%], valid : [loss = 0.888, top1 = 68.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12911/15625) 012911-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.477, top1 = 89.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.21%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.78 ms.
cifar100       train : [loss = 0.313, top1 = 91.60%], valid : [loss = 1.256, top1 = 67.82%], test : [loss = 1.252, top1 = 68.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.67%], valid : [loss = 2.323, top1 = 40.50%], test : [loss = 2.356, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.03%], valid : [loss = 0.625, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12912/15625) 012912-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.32%], valid : [loss = 0.864, top1 = 71.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.555, top1 = 80.58%], test  : [loss = 0.710, top1 = 75.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.05 ms.
cifar100       train : [loss = 1.765, top1 = 52.36%], valid : [loss = 2.044, top1 = 47.13%], test : [loss = 2.043, top1 = 47.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.79%], valid : [loss = 3.638, top1 = 16.72%], test : [loss = 3.669, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12913/15625) 012913-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.68 ms.
cifar10-valid  train : [loss = 0.509, top1 = 82.27%], valid : [loss = 0.663, top1 = 77.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.49 ms.
cifar10        train : [loss = 0.509, top1 = 82.42%], test  : [loss = 0.585, top1 = 80.24%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.79 ms.
cifar100       train : [loss = 1.692, top1 = 54.06%], valid : [loss = 1.861, top1 = 50.54%], test : [loss = 1.864, top1 = 51.01%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.80 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.20%], valid : [loss = 3.311, top1 = 21.78%], test : [loss = 3.349, top1 = 20.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12914/15625) 012914-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.484, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.320, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.48 ms.
cifar100       train : [loss = 0.226, top1 = 94.53%], valid : [loss = 1.233, top1 = 68.89%], test : [loss = 1.251, top1 = 68.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.49%], valid : [loss = 2.266, top1 = 41.82%], test : [loss = 2.279, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12915/15625) 012915-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.62%], valid : [loss = 0.438, top1 = 87.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.77 ms.
cifar10        train : [loss = 0.054, top1 = 98.67%], test  : [loss = 0.316, top1 = 90.57%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.33 ms.
cifar100       train : [loss = 0.572, top1 = 84.26%], valid : [loss = 1.213, top1 = 67.14%], test : [loss = 1.195, top1 = 66.95%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.57%], valid : [loss = 2.463, top1 = 38.00%], test : [loss = 2.494, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.94%], valid : [loss = 0.632, top1 = 78.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12916/15625) 012916-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=23.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.514, top1 = 89.93%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.298, top1 = 93.47%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.22 ms.
cifar100       train : [loss = 0.043, top1 = 99.51%], valid : [loss = 1.349, top1 = 70.47%], test : [loss = 1.362, top1 = 70.04%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 1.832, top1 = 51.30%], valid : [loss = 2.274, top1 = 41.82%], test : [loss = 2.268, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.921, top1 = 67.45%], valid : [loss = 0.960, top1 = 66.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12917/15625) 012917-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.552, top1 = 88.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.24 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.362, top1 = 92.68%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.50 ms.
cifar100       train : [loss = 0.057, top1 = 99.28%], valid : [loss = 1.427, top1 = 69.38%], test : [loss = 1.435, top1 = 69.48%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.17 ms.
ImageNet16-120 train : [loss = 1.710, top1 = 54.27%], valid : [loss = 2.385, top1 = 40.80%], test : [loss = 2.406, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.48%], valid : [loss = 0.724, top1 = 74.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12918/15625) 012918-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.12%], valid : [loss = 0.474, top1 = 84.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10        train : [loss = 0.295, top1 = 90.14%], test  : [loss = 0.399, top1 = 86.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.45 ms.
cifar100       train : [loss = 1.316, top1 = 63.52%], valid : [loss = 1.524, top1 = 58.07%], test : [loss = 1.494, top1 = 58.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.905, top1 = 28.86%], valid : [loss = 2.887, top1 = 30.15%], test : [loss = 2.930, top1 = 27.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12919/15625) 012919-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.512, top1 = 90.27%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.12 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.311, top1 = 93.49%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.63 ms.
cifar100       train : [loss = 0.045, top1 = 99.48%], valid : [loss = 1.328, top1 = 71.03%], test : [loss = 1.318, top1 = 71.00%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=23.03 ms.
ImageNet16-120 train : [loss = 1.565, top1 = 57.73%], valid : [loss = 2.182, top1 = 45.12%], test : [loss = 2.179, top1 = 44.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 82.05%], valid : [loss = 0.626, top1 = 78.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12920/15625) 012920-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.148, top1 = 94.98%], valid : [loss = 0.659, top1 = 82.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.127, top1 = 95.68%], test  : [loss = 0.459, top1 = 87.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.53 ms.
cifar100       train : [loss = 0.629, top1 = 81.48%], valid : [loss = 1.562, top1 = 59.95%], test : [loss = 1.581, top1 = 59.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 3.435, top1 = 18.04%], valid : [loss = 3.450, top1 = 17.90%], test : [loss = 3.449, top1 = 17.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.319, top1 = 51.29%], valid : [loss = 1.325, top1 = 51.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12921/15625) 012921-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.46%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.96 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.331, top1 = 92.21%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.29 ms.
cifar100       train : [loss = 0.335, top1 = 90.84%], valid : [loss = 1.258, top1 = 67.72%], test : [loss = 1.271, top1 = 67.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.95%], valid : [loss = 2.381, top1 = 38.77%], test : [loss = 2.407, top1 = 38.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.11%], valid : [loss = 0.610, top1 = 79.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12922/15625) 012922-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.48 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.509, top1 = 89.71%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.293, top1 = 93.38%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.65 ms.
cifar100       train : [loss = 0.113, top1 = 97.75%], valid : [loss = 1.289, top1 = 70.18%], test : [loss = 1.248, top1 = 70.78%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.72 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.71%], valid : [loss = 2.159, top1 = 45.27%], test : [loss = 2.147, top1 = 45.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.80%], valid : [loss = 0.665, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12923/15625) 012923-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.41%], valid : [loss = 0.531, top1 = 86.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.24 ms.
cifar10        train : [loss = 0.094, top1 = 97.10%], test  : [loss = 0.362, top1 = 89.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=20.98 ms.
cifar100       train : [loss = 0.707, top1 = 79.62%], valid : [loss = 1.331, top1 = 64.76%], test : [loss = 1.303, top1 = 64.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.474, top1 = 37.26%], valid : [loss = 2.545, top1 = 36.13%], test : [loss = 2.563, top1 = 35.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.23%], valid : [loss = 0.891, top1 = 68.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12924/15625) 012924-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.576, top1 = 88.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.415, top1 = 91.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.12 ms.
cifar100       train : [loss = 0.209, top1 = 95.05%], valid : [loss = 1.424, top1 = 66.80%], test : [loss = 1.445, top1 = 67.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.05 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.09%], valid : [loss = 2.508, top1 = 37.67%], test : [loss = 2.526, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.66%], valid : [loss = 0.750, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12925/15625) 012925-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12926/15625) 012926-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.566, top1 = 88.18%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.25 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.373, top1 = 91.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.10 ms.
cifar100       train : [loss = 0.189, top1 = 95.40%], valid : [loss = 1.344, top1 = 67.64%], test : [loss = 1.407, top1 = 67.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.84%], valid : [loss = 2.359, top1 = 39.13%], test : [loss = 2.372, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.882, top1 = 68.34%], valid : [loss = 0.920, top1 = 67.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12927/15625) 012927-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.22%], valid : [loss = 0.476, top1 = 84.54%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.76 ms.
cifar10        train : [loss = 0.302, top1 = 89.89%], test  : [loss = 0.404, top1 = 86.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 1.340, top1 = 62.89%], valid : [loss = 1.545, top1 = 57.90%], test : [loss = 1.496, top1 = 58.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.78%], valid : [loss = 2.908, top1 = 28.70%], test : [loss = 2.954, top1 = 27.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12928/15625) 012928-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.537, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.348, top1 = 92.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.15 ms.
cifar100       train : [loss = 0.231, top1 = 93.95%], valid : [loss = 1.309, top1 = 68.00%], test : [loss = 1.314, top1 = 68.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.13 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.93%], valid : [loss = 2.313, top1 = 41.40%], test : [loss = 2.340, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.52%], valid : [loss = 0.694, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12929/15625) 012929-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.604, top1 = 85.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.067, top1 = 97.99%], test  : [loss = 0.403, top1 = 88.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.56 ms.
cifar100       train : [loss = 0.713, top1 = 79.28%], valid : [loss = 1.376, top1 = 63.18%], test : [loss = 1.362, top1 = 63.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.07%], valid : [loss = 2.655, top1 = 33.98%], test : [loss = 2.683, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12930/15625) 012930-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.569, top1 = 88.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.59 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.365, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 0.172, top1 = 96.35%], valid : [loss = 1.419, top1 = 67.94%], test : [loss = 1.413, top1 = 66.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 1.982, top1 = 47.93%], valid : [loss = 2.411, top1 = 38.10%], test : [loss = 2.497, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12931/15625) 012931-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.630, top1 = 86.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.398, top1 = 90.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.52 ms.
cifar100       train : [loss = 0.534, top1 = 84.35%], valid : [loss = 1.457, top1 = 62.82%], test : [loss = 1.438, top1 = 63.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.30%], valid : [loss = 2.511, top1 = 36.26%], test : [loss = 2.555, top1 = 36.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.37%], valid : [loss = 0.837, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12932/15625) 012932-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.620, top1 = 85.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10        train : [loss = 0.065, top1 = 98.12%], test  : [loss = 0.411, top1 = 88.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 0.715, top1 = 79.08%], valid : [loss = 1.413, top1 = 62.98%], test : [loss = 1.393, top1 = 63.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.61 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.12%], valid : [loss = 2.637, top1 = 34.23%], test : [loss = 2.674, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12933/15625) 012933-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.532, top1 = 89.53%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.48 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.343, top1 = 92.84%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.47 ms.
cifar100       train : [loss = 0.072, top1 = 98.86%], valid : [loss = 1.433, top1 = 67.90%], test : [loss = 1.391, top1 = 69.34%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 1.643, top1 = 55.93%], valid : [loss = 2.268, top1 = 43.27%], test : [loss = 2.242, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.87%], valid : [loss = 0.585, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12934/15625) 012934-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.567, top1 = 87.68%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.67 ms.
cifar10        train : [loss = 0.018, top1 = 99.49%], test  : [loss = 0.361, top1 = 91.46%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.07 ms.
cifar100       train : [loss = 0.303, top1 = 91.41%], valid : [loss = 1.337, top1 = 67.08%], test : [loss = 1.352, top1 = 67.32%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.430, top1 = 37.88%], valid : [loss = 2.565, top1 = 34.40%], test : [loss = 2.582, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.919, top1 = 66.56%], valid : [loss = 0.967, top1 = 65.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12935/15625) 012935-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.74 ms.
cifar10-valid  train : [loss = 1.267, top1 = 54.44%], valid : [loss = 1.314, top1 = 52.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10        train : [loss = 1.190, top1 = 57.66%], test  : [loss = 1.195, top1 = 57.29%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.48 ms.
cifar100       train : [loss = 2.734, top1 = 31.63%], valid : [loss = 2.820, top1 = 30.84%], test : [loss = 2.811, top1 = 30.69%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.64 ms.
ImageNet16-120 train : [loss = 3.879, top1 = 12.26%], valid : [loss = 3.866, top1 = 13.42%], test : [loss = 3.889, top1 = 12.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.714, top1 = 35.38%], valid : [loss = 1.720, top1 = 34.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12936/15625) 012936-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.10 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.573, top1 = 87.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.94 ms.
cifar10        train : [loss = 0.034, top1 = 99.01%], test  : [loss = 0.366, top1 = 90.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.42 ms.
cifar100       train : [loss = 0.484, top1 = 86.21%], valid : [loss = 1.328, top1 = 64.92%], test : [loss = 1.334, top1 = 65.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.90 ms.
ImageNet16-120 train : [loss = 2.579, top1 = 34.45%], valid : [loss = 2.666, top1 = 32.70%], test : [loss = 2.693, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.97%], valid : [loss = 0.957, top1 = 65.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12937/15625) 012937-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.569, top1 = 88.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.38 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.381, top1 = 91.86%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.24 ms.
cifar100       train : [loss = 0.136, top1 = 97.27%], valid : [loss = 1.399, top1 = 67.48%], test : [loss = 1.424, top1 = 67.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.66%], valid : [loss = 2.453, top1 = 39.77%], test : [loss = 2.492, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.23%], valid : [loss = 0.750, top1 = 73.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12938/15625) 012938-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.36%], valid : [loss = 0.673, top1 = 84.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.49 ms.
cifar10        train : [loss = 0.056, top1 = 98.26%], test  : [loss = 0.437, top1 = 88.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.96 ms.
cifar100       train : [loss = 0.633, top1 = 81.49%], valid : [loss = 1.544, top1 = 61.78%], test : [loss = 1.467, top1 = 62.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.662, top1 = 33.39%], valid : [loss = 2.805, top1 = 30.17%], test : [loss = 2.882, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12939/15625) 012939-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.640 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.495, top1 = 88.95%]
cifar10        FLOP= 90.36 M, Params=0.640 MB, latency=18.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.322, top1 = 92.34%]
cifar100       FLOP= 90.36 M, Params=0.646 MB, latency=17.16 ms.
cifar100       train : [loss = 0.324, top1 = 91.24%], valid : [loss = 1.281, top1 = 66.77%], test : [loss = 1.279, top1 = 67.36%]
ImageNet16-120 FLOP= 22.60 M, Params=0.648 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.88%], valid : [loss = 2.402, top1 = 38.99%], test : [loss = 2.422, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12940/15625) 012940-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.504, top1 = 89.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.320, top1 = 92.86%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.42 ms.
cifar100       train : [loss = 0.111, top1 = 97.73%], valid : [loss = 1.298, top1 = 70.06%], test : [loss = 1.271, top1 = 70.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.10%], valid : [loss = 2.295, top1 = 41.40%], test : [loss = 2.305, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.94%], valid : [loss = 0.751, top1 = 73.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12941/15625) 012941-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.14%], valid : [loss = 0.878, top1 = 70.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10        train : [loss = 0.557, top1 = 80.56%], test  : [loss = 0.715, top1 = 75.95%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.35 ms.
cifar100       train : [loss = 1.788, top1 = 51.94%], valid : [loss = 2.035, top1 = 47.36%], test : [loss = 2.082, top1 = 46.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.21 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.75%], valid : [loss = 3.626, top1 = 16.37%], test : [loss = 3.665, top1 = 14.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12942/15625) 012942-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.20%], valid : [loss = 0.860, top1 = 74.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10        train : [loss = 0.310, top1 = 89.15%], test  : [loss = 0.623, top1 = 80.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.88 ms.
cifar100       train : [loss = 1.335, top1 = 62.30%], valid : [loss = 1.887, top1 = 50.98%], test : [loss = 1.899, top1 = 50.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 3.520, top1 = 16.94%], valid : [loss = 3.545, top1 = 17.17%], test : [loss = 3.550, top1 = 16.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.243, top1 = 54.60%], valid : [loss = 1.282, top1 = 53.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12943/15625) 012943-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.505, top1 = 89.77%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.325, top1 = 93.16%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.18 ms.
cifar100       train : [loss = 0.080, top1 = 98.45%], valid : [loss = 1.393, top1 = 69.74%], test : [loss = 1.332, top1 = 70.34%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 1.672, top1 = 55.06%], valid : [loss = 2.176, top1 = 44.73%], test : [loss = 2.165, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.38%], valid : [loss = 0.863, top1 = 69.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12944/15625) 012944-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.496, top1 = 88.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10        train : [loss = 0.021, top1 = 99.46%], test  : [loss = 0.354, top1 = 91.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.22 ms.
cifar100       train : [loss = 0.414, top1 = 88.05%], valid : [loss = 1.301, top1 = 67.07%], test : [loss = 1.301, top1 = 67.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.45%], valid : [loss = 2.399, top1 = 39.47%], test : [loss = 2.412, top1 = 39.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.68%], valid : [loss = 0.593, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12945/15625) 012945-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.53%], valid : [loss = 0.599, top1 = 86.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10        train : [loss = 0.039, top1 = 98.80%], test  : [loss = 0.397, top1 = 90.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.14 ms.
cifar100       train : [loss = 0.561, top1 = 83.52%], valid : [loss = 1.392, top1 = 64.40%], test : [loss = 1.406, top1 = 63.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.493, top1 = 36.91%], valid : [loss = 2.624, top1 = 34.77%], test : [loss = 2.689, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.36%], valid : [loss = 0.677, top1 = 76.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12946/15625) 012946-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=24.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.504, top1 = 89.89%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.79 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.323, top1 = 93.03%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.51 ms.
cifar100       train : [loss = 0.073, top1 = 98.84%], valid : [loss = 1.405, top1 = 69.02%], test : [loss = 1.376, top1 = 70.16%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=23.01 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.55%], valid : [loss = 2.370, top1 = 39.93%], test : [loss = 2.316, top1 = 41.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.89%], valid : [loss = 0.775, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12947/15625) 012947-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.447, top1 = 89.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.305, top1 = 92.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.216, top1 = 94.67%], valid : [loss = 1.292, top1 = 68.38%], test : [loss = 1.281, top1 = 68.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 1.869, top1 = 50.60%], valid : [loss = 2.270, top1 = 42.38%], test : [loss = 2.324, top1 = 41.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.32%], valid : [loss = 0.541, top1 = 81.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12948/15625) 012948-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.72%], valid : [loss = 0.476, top1 = 86.07%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.60 ms.
cifar10        train : [loss = 0.123, top1 = 96.18%], test  : [loss = 0.339, top1 = 89.14%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.19 ms.
cifar100       train : [loss = 0.763, top1 = 78.60%], valid : [loss = 1.284, top1 = 65.06%], test : [loss = 1.264, top1 = 64.64%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.497, top1 = 36.76%], valid : [loss = 2.597, top1 = 34.20%], test : [loss = 2.598, top1 = 34.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.41%], valid : [loss = 0.845, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12949/15625) 012949-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.567, top1 = 87.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.373, top1 = 91.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.398, top1 = 88.67%], valid : [loss = 1.404, top1 = 65.30%], test : [loss = 1.402, top1 = 64.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.86%], valid : [loss = 2.474, top1 = 37.93%], test : [loss = 2.490, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.60%], valid : [loss = 0.762, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12950/15625) 012950-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.535, top1 = 88.84%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.26 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.347, top1 = 92.52%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.12 ms.
cifar100       train : [loss = 0.106, top1 = 97.63%], valid : [loss = 1.414, top1 = 68.08%], test : [loss = 1.445, top1 = 68.72%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.44%], valid : [loss = 2.486, top1 = 36.83%], test : [loss = 2.483, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.13%], valid : [loss = 1.013, top1 = 63.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12951/15625) 012951-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.28%], valid : [loss = 0.849, top1 = 72.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10        train : [loss = 0.556, top1 = 80.50%], test  : [loss = 0.725, top1 = 75.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.42 ms.
cifar100       train : [loss = 1.774, top1 = 52.09%], valid : [loss = 2.055, top1 = 47.08%], test : [loss = 2.050, top1 = 46.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.49 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.80%], valid : [loss = 3.649, top1 = 16.00%], test : [loss = 3.679, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12952/15625) 012952-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.21%], valid : [loss = 0.472, top1 = 84.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.17 ms.
cifar10        train : [loss = 0.303, top1 = 89.97%], test  : [loss = 0.399, top1 = 86.52%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.86 ms.
cifar100       train : [loss = 1.333, top1 = 63.17%], valid : [loss = 1.536, top1 = 57.85%], test : [loss = 1.510, top1 = 58.37%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.28 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.59%], valid : [loss = 2.892, top1 = 30.07%], test : [loss = 2.962, top1 = 27.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12953/15625) 012953-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.584, top1 = 87.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.388, top1 = 91.06%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.86 ms.
cifar100       train : [loss = 0.409, top1 = 88.31%], valid : [loss = 1.389, top1 = 65.33%], test : [loss = 1.374, top1 = 65.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.09%], valid : [loss = 2.496, top1 = 37.43%], test : [loss = 2.514, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.81%], valid : [loss = 0.782, top1 = 72.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12954/15625) 012954-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.84%], valid : [loss = 0.547, top1 = 88.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.346, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.96 ms.
cifar100       train : [loss = 0.248, top1 = 93.44%], valid : [loss = 1.277, top1 = 68.64%], test : [loss = 1.349, top1 = 67.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.14%], valid : [loss = 2.417, top1 = 38.57%], test : [loss = 2.395, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12955/15625) 012955-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.423, top1 = 90.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.86 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.278, top1 = 93.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.158, top1 = 96.49%], valid : [loss = 1.275, top1 = 69.87%], test : [loss = 1.272, top1 = 69.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 52.93%], valid : [loss = 2.225, top1 = 44.09%], test : [loss = 2.269, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.71%], valid : [loss = 0.516, top1 = 82.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12956/15625) 012956-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.424, top1 = 90.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.295, top1 = 93.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.23 ms.
cifar100       train : [loss = 0.065, top1 = 99.13%], valid : [loss = 1.343, top1 = 70.20%], test : [loss = 1.320, top1 = 70.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.550, top1 = 58.22%], valid : [loss = 2.285, top1 = 43.00%], test : [loss = 2.309, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.24%], valid : [loss = 0.499, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12957/15625) 012957-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.77%], valid : [loss = 0.534, top1 = 84.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10        train : [loss = 0.184, top1 = 93.81%], test  : [loss = 0.394, top1 = 87.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 1.173, top1 = 66.55%], valid : [loss = 1.496, top1 = 59.22%], test : [loss = 1.489, top1 = 59.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.20 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.73%], valid : [loss = 2.688, top1 = 32.64%], test : [loss = 2.732, top1 = 32.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 67.17%], valid : [loss = 0.970, top1 = 65.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12958/15625) 012958-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.01%], valid : [loss = 0.851, top1 = 71.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.02 ms.
cifar10        train : [loss = 0.572, top1 = 80.06%], test  : [loss = 0.720, top1 = 75.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.64 ms.
cifar100       train : [loss = 1.764, top1 = 52.69%], valid : [loss = 2.040, top1 = 46.62%], test : [loss = 2.067, top1 = 46.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.68%], valid : [loss = 3.622, top1 = 17.10%], test : [loss = 3.659, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12959/15625) 012959-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.06%], valid : [loss = 0.565, top1 = 86.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.32 ms.
cifar10        train : [loss = 0.069, top1 = 97.70%], test  : [loss = 0.366, top1 = 90.26%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.85 ms.
cifar100       train : [loss = 0.640, top1 = 81.06%], valid : [loss = 1.315, top1 = 65.04%], test : [loss = 1.319, top1 = 65.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.377, top1 = 39.04%], valid : [loss = 2.507, top1 = 36.87%], test : [loss = 2.546, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.32%], valid : [loss = 0.863, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12960/15625) 012960-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.324, top1 = 88.81%], valid : [loss = 0.572, top1 = 81.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10        train : [loss = 0.297, top1 = 89.87%], test  : [loss = 0.450, top1 = 85.35%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.94 ms.
cifar100       train : [loss = 1.575, top1 = 56.23%], valid : [loss = 1.812, top1 = 51.17%], test : [loss = 1.794, top1 = 52.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.94 ms.
ImageNet16-120 train : [loss = 3.092, top1 = 24.99%], valid : [loss = 3.097, top1 = 24.80%], test : [loss = 3.156, top1 = 24.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.010, top1 = 63.69%], valid : [loss = 1.044, top1 = 62.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12961/15625) 012961-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.543, top1 = 80.93%], valid : [loss = 0.872, top1 = 71.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10        train : [loss = 0.549, top1 = 80.81%], test  : [loss = 0.697, top1 = 75.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 1.779, top1 = 52.06%], valid : [loss = 2.065, top1 = 47.26%], test : [loss = 2.038, top1 = 47.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 16.98%], valid : [loss = 3.619, top1 = 17.07%], test : [loss = 3.670, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12962/15625) 012962-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.62%], valid : [loss = 0.851, top1 = 71.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.573, top1 = 79.93%], test  : [loss = 0.723, top1 = 75.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.43 ms.
cifar100       train : [loss = 1.803, top1 = 51.58%], valid : [loss = 2.085, top1 = 46.80%], test : [loss = 2.066, top1 = 46.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.63%], valid : [loss = 3.629, top1 = 16.60%], test : [loss = 3.671, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.80%], valid : [loss = 1.231, top1 = 56.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12963/15625) 012963-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.510, top1 = 88.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.330, top1 = 92.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.337, top1 = 90.82%], valid : [loss = 1.270, top1 = 67.25%], test : [loss = 1.257, top1 = 67.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.81%], valid : [loss = 2.408, top1 = 38.80%], test : [loss = 2.404, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12964/15625) 012964-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.51%], valid : [loss = 0.452, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.51 ms.
cifar10        train : [loss = 0.157, top1 = 94.86%], test  : [loss = 0.338, top1 = 89.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.24 ms.
cifar100       train : [loss = 0.999, top1 = 71.74%], valid : [loss = 1.355, top1 = 62.36%], test : [loss = 1.354, top1 = 61.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.49%], valid : [loss = 2.713, top1 = 32.77%], test : [loss = 2.746, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12965/15625) 012965-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.552, top1 = 88.49%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.68 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.354, top1 = 91.68%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.81 ms.
cifar100       train : [loss = 0.289, top1 = 92.02%], valid : [loss = 1.329, top1 = 66.90%], test : [loss = 1.364, top1 = 66.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.151, top1 = 44.11%], valid : [loss = 2.393, top1 = 38.27%], test : [loss = 2.411, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 68.98%], valid : [loss = 0.892, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12966/15625) 012966-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.49%], valid : [loss = 0.593, top1 = 82.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10        train : [loss = 0.229, top1 = 92.11%], test  : [loss = 0.462, top1 = 85.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.59 ms.
cifar100       train : [loss = 0.959, top1 = 72.19%], valid : [loss = 1.617, top1 = 56.92%], test : [loss = 1.596, top1 = 57.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 3.531, top1 = 16.15%], valid : [loss = 3.528, top1 = 16.17%], test : [loss = 3.536, top1 = 16.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.145, top1 = 58.12%], valid : [loss = 1.172, top1 = 57.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12967/15625) 012967-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.424, top1 = 90.87%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.00 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.277, top1 = 93.96%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.87 ms.
cifar100       train : [loss = 0.039, top1 = 99.63%], valid : [loss = 1.217, top1 = 72.76%], test : [loss = 1.255, top1 = 72.06%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 1.326, top1 = 63.57%], valid : [loss = 2.168, top1 = 46.43%], test : [loss = 2.215, top1 = 46.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.84%], valid : [loss = 0.487, top1 = 83.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12968/15625) 012968-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.67%], valid : [loss = 0.451, top1 = 86.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.154, top1 = 95.02%], test  : [loss = 0.335, top1 = 89.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.17 ms.
cifar100       train : [loss = 0.961, top1 = 72.65%], valid : [loss = 1.346, top1 = 62.73%], test : [loss = 1.345, top1 = 62.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.19%], valid : [loss = 2.669, top1 = 33.35%], test : [loss = 2.691, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.19%], valid : [loss = 0.808, top1 = 71.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12969/15625) 012969-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.526, top1 = 88.89%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.379, top1 = 91.83%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.20 ms.
cifar100       train : [loss = 0.267, top1 = 92.90%], valid : [loss = 1.263, top1 = 68.12%], test : [loss = 1.252, top1 = 68.50%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.18%], valid : [loss = 2.296, top1 = 41.27%], test : [loss = 2.322, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.12%], valid : [loss = 0.738, top1 = 74.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12970/15625) 012970-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.87%], valid : [loss = 0.436, top1 = 88.35%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.17 ms.
cifar10        train : [loss = 0.033, top1 = 99.40%], test  : [loss = 0.302, top1 = 90.97%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.02 ms.
cifar100       train : [loss = 0.380, top1 = 90.51%], valid : [loss = 1.224, top1 = 67.26%], test : [loss = 1.201, top1 = 68.14%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 45.16%], valid : [loss = 2.420, top1 = 39.07%], test : [loss = 2.428, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.72%], valid : [loss = 0.635, top1 = 78.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12971/15625) 012971-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.36%], valid : [loss = 0.646, top1 = 85.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.60 ms.
cifar10        train : [loss = 0.040, top1 = 98.80%], test  : [loss = 0.412, top1 = 89.64%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.574, top1 = 82.96%], valid : [loss = 1.494, top1 = 62.36%], test : [loss = 1.458, top1 = 63.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.314, top1 = 40.68%], valid : [loss = 2.530, top1 = 36.13%], test : [loss = 2.503, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.868, top1 = 68.78%], valid : [loss = 0.925, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12972/15625) 012972-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.35%], valid : [loss = 0.567, top1 = 87.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.039, top1 = 98.77%], test  : [loss = 0.383, top1 = 90.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.36 ms.
cifar100       train : [loss = 0.466, top1 = 86.73%], valid : [loss = 1.285, top1 = 65.88%], test : [loss = 1.303, top1 = 66.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 32.90%], valid : [loss = 2.704, top1 = 32.00%], test : [loss = 2.694, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.81%], valid : [loss = 0.844, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12973/15625) 012973-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.559, top1 = 87.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.370, top1 = 91.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.64 ms.
cifar100       train : [loss = 0.380, top1 = 89.31%], valid : [loss = 1.395, top1 = 64.96%], test : [loss = 1.381, top1 = 65.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.10%], valid : [loss = 2.463, top1 = 37.59%], test : [loss = 2.481, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.90%], valid : [loss = 0.727, top1 = 74.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12974/15625) 012974-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.69%], valid : [loss = 0.900, top1 = 76.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10        train : [loss = 0.239, top1 = 91.80%], test  : [loss = 0.634, top1 = 81.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.41 ms.
cifar100       train : [loss = 1.135, top1 = 67.71%], valid : [loss = 1.770, top1 = 53.82%], test : [loss = 1.783, top1 = 54.26%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 3.223, top1 = 22.85%], valid : [loss = 3.349, top1 = 20.97%], test : [loss = 3.352, top1 = 20.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.060, top1 = 61.93%], valid : [loss = 1.119, top1 = 59.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12975/15625) 012975-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.460, top1 = 89.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10        train : [loss = 0.009, top1 = 99.89%], test  : [loss = 0.301, top1 = 92.30%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.21 ms.
cifar100       train : [loss = 0.209, top1 = 94.98%], valid : [loss = 1.253, top1 = 68.94%], test : [loss = 1.259, top1 = 68.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.64%], valid : [loss = 2.266, top1 = 42.37%], test : [loss = 2.294, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 85.10%], valid : [loss = 0.550, top1 = 81.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12976/15625) 012976-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.722, top1 = 85.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.473, top1 = 89.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.57 ms.
cifar100       train : [loss = 0.248, top1 = 93.67%], valid : [loss = 1.645, top1 = 62.42%], test : [loss = 1.694, top1 = 62.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.24%], valid : [loss = 2.720, top1 = 32.87%], test : [loss = 2.753, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 71.98%], valid : [loss = 0.843, top1 = 70.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12977/15625) 012977-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.487, top1 = 88.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.308, top1 = 92.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.48 ms.
cifar100       train : [loss = 0.331, top1 = 90.97%], valid : [loss = 1.254, top1 = 67.38%], test : [loss = 1.276, top1 = 67.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.27 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.37%], valid : [loss = 2.305, top1 = 41.00%], test : [loss = 2.332, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12978/15625) 012978-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.79%], valid : [loss = 0.554, top1 = 83.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.197, top1 = 93.31%], test  : [loss = 0.403, top1 = 87.16%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.99 ms.
cifar100       train : [loss = 1.223, top1 = 65.10%], valid : [loss = 1.561, top1 = 57.09%], test : [loss = 1.542, top1 = 58.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 33.01%], valid : [loss = 2.719, top1 = 32.42%], test : [loss = 2.754, top1 = 31.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 66.90%], valid : [loss = 0.969, top1 = 66.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12979/15625) 012979-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.89 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12980/15625) 012980-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.88%], valid : [loss = 0.562, top1 = 86.68%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.48 ms.
cifar10        train : [loss = 0.074, top1 = 97.58%], test  : [loss = 0.348, top1 = 90.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.46 ms.
cifar100       train : [loss = 0.656, top1 = 80.69%], valid : [loss = 1.340, top1 = 64.00%], test : [loss = 1.296, top1 = 65.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.83%], valid : [loss = 2.515, top1 = 36.13%], test : [loss = 2.568, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.42%], valid : [loss = 0.898, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12981/15625) 012981-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.24%], valid : [loss = 0.604, top1 = 85.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.396, top1 = 89.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.75 ms.
cifar100       train : [loss = 0.710, top1 = 79.34%], valid : [loss = 1.404, top1 = 62.38%], test : [loss = 1.387, top1 = 63.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.77%], valid : [loss = 2.646, top1 = 33.63%], test : [loss = 2.693, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12982/15625) 012982-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.08%], valid : [loss = 0.580, top1 = 86.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.97 ms.
cifar10        train : [loss = 0.029, top1 = 99.10%], test  : [loss = 0.409, top1 = 90.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.53 ms.
cifar100       train : [loss = 0.396, top1 = 88.91%], valid : [loss = 1.537, top1 = 63.02%], test : [loss = 1.545, top1 = 62.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.803, top1 = 29.37%], valid : [loss = 2.860, top1 = 27.63%], test : [loss = 2.891, top1 = 26.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.42%], valid : [loss = 1.150, top1 = 58.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12983/15625) 012983-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.26%], valid : [loss = 0.632, top1 = 85.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10        train : [loss = 0.045, top1 = 98.62%], test  : [loss = 0.401, top1 = 89.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.95 ms.
cifar100       train : [loss = 0.379, top1 = 89.21%], valid : [loss = 1.598, top1 = 61.34%], test : [loss = 1.579, top1 = 62.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 3.061, top1 = 24.60%], valid : [loss = 3.105, top1 = 23.20%], test : [loss = 3.122, top1 = 23.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.008, top1 = 63.45%], valid : [loss = 1.040, top1 = 62.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12984/15625) 012984-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.222, top1 = 92.49%], valid : [loss = 0.546, top1 = 83.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10        train : [loss = 0.195, top1 = 93.40%], test  : [loss = 0.387, top1 = 87.71%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.16 ms.
cifar100       train : [loss = 1.274, top1 = 63.83%], valid : [loss = 1.564, top1 = 57.12%], test : [loss = 1.582, top1 = 56.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.18%], valid : [loss = 2.701, top1 = 31.43%], test : [loss = 2.746, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.34%], valid : [loss = 0.989, top1 = 64.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12985/15625) 012985-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.503, top1 = 88.82%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.30 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.337, top1 = 91.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.75 ms.
cifar100       train : [loss = 0.326, top1 = 91.19%], valid : [loss = 1.294, top1 = 66.59%], test : [loss = 1.293, top1 = 67.62%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.19%], valid : [loss = 2.406, top1 = 38.88%], test : [loss = 2.418, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.74%], valid : [loss = 0.669, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12986/15625) 012986-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.510, top1 = 88.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10        train : [loss = 0.028, top1 = 99.19%], test  : [loss = 0.345, top1 = 91.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 0.438, top1 = 87.27%], valid : [loss = 1.316, top1 = 65.94%], test : [loss = 1.306, top1 = 66.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.00%], valid : [loss = 2.428, top1 = 38.57%], test : [loss = 2.453, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12987/15625) 012987-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.09%], valid : [loss = 0.990, top1 = 74.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.85 ms.
cifar10        train : [loss = 0.214, top1 = 92.58%], test  : [loss = 0.590, top1 = 82.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.04 ms.
cifar100       train : [loss = 1.202, top1 = 66.11%], valid : [loss = 1.792, top1 = 53.74%], test : [loss = 1.777, top1 = 53.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.66 ms.
ImageNet16-120 train : [loss = 3.237, top1 = 22.59%], valid : [loss = 3.359, top1 = 20.83%], test : [loss = 3.394, top1 = 20.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12988/15625) 012988-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.43%], valid : [loss = 0.461, top1 = 86.33%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.16 ms.
cifar10        train : [loss = 0.161, top1 = 94.77%], test  : [loss = 0.347, top1 = 88.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.01 ms.
cifar100       train : [loss = 0.984, top1 = 72.02%], valid : [loss = 1.361, top1 = 62.16%], test : [loss = 1.334, top1 = 62.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.36 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.84%], valid : [loss = 2.702, top1 = 32.73%], test : [loss = 2.710, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12989/15625) 012989-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.483, top1 = 88.88%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.06 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.320, top1 = 91.97%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.03 ms.
cifar100       train : [loss = 0.249, top1 = 93.81%], valid : [loss = 1.255, top1 = 67.80%], test : [loss = 1.258, top1 = 68.90%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=22.65 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.66%], valid : [loss = 2.260, top1 = 42.07%], test : [loss = 2.259, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.30%], valid : [loss = 0.721, top1 = 74.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12990/15625) 012990-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.494, top1 = 88.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.022, top1 = 99.38%], test  : [loss = 0.345, top1 = 91.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.412, top1 = 87.99%], valid : [loss = 1.291, top1 = 67.12%], test : [loss = 1.319, top1 = 66.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.51%], valid : [loss = 2.409, top1 = 38.57%], test : [loss = 2.447, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.54%], valid : [loss = 0.633, top1 = 78.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12991/15625) 012991-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.564, top1 = 88.81%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.370, top1 = 92.22%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=23.19 ms.
cifar100       train : [loss = 0.130, top1 = 97.22%], valid : [loss = 1.579, top1 = 64.44%], test : [loss = 1.545, top1 = 65.48%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 40.64%], valid : [loss = 2.491, top1 = 35.10%], test : [loss = 2.508, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.080, top1 = 60.75%], valid : [loss = 1.125, top1 = 59.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12992/15625) 012992-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.93%], valid : [loss = 0.580, top1 = 87.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.404, top1 = 91.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.395, top1 = 88.75%], valid : [loss = 1.411, top1 = 65.00%], test : [loss = 1.428, top1 = 65.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.85%], valid : [loss = 2.529, top1 = 35.83%], test : [loss = 2.508, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.26%], valid : [loss = 0.753, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12993/15625) 012993-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.19%], valid : [loss = 0.647, top1 = 78.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.16 ms.
cifar10        train : [loss = 0.531, top1 = 81.78%], test  : [loss = 0.600, top1 = 79.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.51 ms.
cifar100       train : [loss = 1.715, top1 = 53.44%], valid : [loss = 1.860, top1 = 50.48%], test : [loss = 1.868, top1 = 51.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 3.349, top1 = 20.98%], valid : [loss = 3.321, top1 = 21.73%], test : [loss = 3.361, top1 = 20.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.267, top1 = 54.38%], valid : [loss = 1.304, top1 = 53.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12994/15625) 012994-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.89 ms.
cifar10-valid  train : [loss = 0.843, top1 = 69.96%], valid : [loss = 0.919, top1 = 68.26%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.64 ms.
cifar10        train : [loss = 0.695, top1 = 75.53%], test  : [loss = 0.742, top1 = 74.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 2.154, top1 = 42.74%], valid : [loss = 2.249, top1 = 40.56%], test : [loss = 2.257, top1 = 40.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.78 ms.
ImageNet16-120 train : [loss = 3.497, top1 = 17.82%], valid : [loss = 3.488, top1 = 18.30%], test : [loss = 3.503, top1 = 17.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.374, top1 = 49.68%], valid : [loss = 1.416, top1 = 48.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12995/15625) 012995-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.70%], valid : [loss = 0.628, top1 = 83.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10        train : [loss = 0.144, top1 = 95.15%], test  : [loss = 0.425, top1 = 87.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.12 ms.
cifar100       train : [loss = 0.953, top1 = 72.22%], valid : [loss = 1.501, top1 = 59.77%], test : [loss = 1.490, top1 = 59.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 2.843, top1 = 29.79%], valid : [loss = 2.924, top1 = 27.94%], test : [loss = 2.973, top1 = 27.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.75%], valid : [loss = 0.997, top1 = 64.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12996/15625) 012996-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.628, top1 = 78.06%], valid : [loss = 0.840, top1 = 71.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10        train : [loss = 0.506, top1 = 82.44%], test  : [loss = 0.631, top1 = 78.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.95 ms.
cifar100       train : [loss = 1.794, top1 = 51.29%], valid : [loss = 2.041, top1 = 47.40%], test : [loss = 2.030, top1 = 46.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 3.575, top1 = 16.67%], valid : [loss = 3.569, top1 = 17.23%], test : [loss = 3.639, top1 = 16.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.301, top1 = 52.82%], valid : [loss = 1.341, top1 = 51.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12997/15625) 012997-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.304, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.317, top1 = 91.46%], valid : [loss = 1.259, top1 = 67.39%], test : [loss = 1.286, top1 = 67.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.82%], valid : [loss = 2.327, top1 = 40.57%], test : [loss = 2.355, top1 = 40.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.98%], valid : [loss = 0.650, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12998/15625) 012998-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.560, top1 = 87.97%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.368, top1 = 91.78%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.06 ms.
cifar100       train : [loss = 0.384, top1 = 89.31%], valid : [loss = 1.386, top1 = 65.28%], test : [loss = 1.389, top1 = 65.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.18%], valid : [loss = 2.514, top1 = 37.47%], test : [loss = 2.509, top1 = 36.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.54%], valid : [loss = 0.782, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (12999/15625) 012999-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.567, top1 = 87.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.383, top1 = 91.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.58 ms.
cifar100       train : [loss = 0.219, top1 = 94.59%], valid : [loss = 1.487, top1 = 65.72%], test : [loss = 1.479, top1 = 65.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.70%], valid : [loss = 2.470, top1 = 37.53%], test : [loss = 2.482, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.22%], valid : [loss = 0.787, top1 = 72.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13000/15625) 013000-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.48%], valid : [loss = 0.580, top1 = 81.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.50 ms.
cifar10        train : [loss = 0.265, top1 = 90.91%], test  : [loss = 0.421, top1 = 86.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.28 ms.
cifar100       train : [loss = 1.498, top1 = 58.06%], valid : [loss = 1.737, top1 = 52.85%], test : [loss = 1.728, top1 = 53.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.934, top1 = 27.96%], valid : [loss = 2.957, top1 = 27.72%], test : [loss = 2.994, top1 = 26.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.02%], valid : [loss = 1.073, top1 = 61.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13001/15625) 013001-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.48%], valid : [loss = 0.465, top1 = 86.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10        train : [loss = 0.156, top1 = 94.86%], test  : [loss = 0.350, top1 = 88.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.60 ms.
cifar100       train : [loss = 1.013, top1 = 71.13%], valid : [loss = 1.368, top1 = 61.88%], test : [loss = 1.374, top1 = 61.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 33.95%], valid : [loss = 2.669, top1 = 32.20%], test : [loss = 2.714, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13002/15625) 013002-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.33%], valid : [loss = 0.577, top1 = 86.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10        train : [loss = 0.038, top1 = 98.80%], test  : [loss = 0.361, top1 = 91.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.02 ms.
cifar100       train : [loss = 0.444, top1 = 87.21%], valid : [loss = 1.330, top1 = 65.18%], test : [loss = 1.352, top1 = 65.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.32 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.09%], valid : [loss = 2.665, top1 = 32.80%], test : [loss = 2.718, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.074, top1 = 61.10%], valid : [loss = 1.089, top1 = 60.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13003/15625) 013003-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.519, top1 = 88.57%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=16.00 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.332, top1 = 92.01%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=14.89 ms.
cifar100       train : [loss = 0.339, top1 = 90.81%], valid : [loss = 1.287, top1 = 66.71%], test : [loss = 1.280, top1 = 66.99%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.84%], valid : [loss = 2.377, top1 = 39.68%], test : [loss = 2.395, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13004/15625) 013004-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.242, top1 = 91.78%], valid : [loss = 0.554, top1 = 82.68%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.235, top1 = 91.92%], test  : [loss = 0.420, top1 = 86.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.70 ms.
cifar100       train : [loss = 1.307, top1 = 62.79%], valid : [loss = 1.565, top1 = 56.46%], test : [loss = 1.599, top1 = 55.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=19.04 ms.
ImageNet16-120 train : [loss = 2.727, top1 = 32.02%], valid : [loss = 2.759, top1 = 31.73%], test : [loss = 2.793, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.12%], valid : [loss = 1.002, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13005/15625) 013005-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.21%], valid : [loss = 0.540, top1 = 87.05%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.49 ms.
cifar10        train : [loss = 0.054, top1 = 98.26%], test  : [loss = 0.370, top1 = 90.06%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.18 ms.
cifar100       train : [loss = 0.654, top1 = 80.70%], valid : [loss = 1.342, top1 = 63.88%], test : [loss = 1.322, top1 = 64.74%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.32%], valid : [loss = 2.505, top1 = 36.90%], test : [loss = 2.537, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.26%], valid : [loss = 0.815, top1 = 71.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13006/15625) 013006-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.63 ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.20%], valid : [loss = 0.640, top1 = 78.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.26 ms.
cifar10        train : [loss = 0.513, top1 = 82.15%], test  : [loss = 0.593, top1 = 80.05%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.34 ms.
cifar100       train : [loss = 1.676, top1 = 54.47%], valid : [loss = 1.842, top1 = 50.75%], test : [loss = 1.870, top1 = 50.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.71 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.26%], valid : [loss = 3.318, top1 = 21.07%], test : [loss = 3.352, top1 = 21.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13007/15625) 013007-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.643, top1 = 86.92%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.85 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.424, top1 = 90.41%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.49 ms.
cifar100       train : [loss = 0.224, top1 = 94.49%], valid : [loss = 1.584, top1 = 63.88%], test : [loss = 1.607, top1 = 63.64%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.66%], valid : [loss = 2.434, top1 = 38.70%], test : [loss = 2.482, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.70%], valid : [loss = 0.815, top1 = 71.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13008/15625) 013008-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.664, top1 = 86.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.446, top1 = 90.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.42 ms.
cifar100       train : [loss = 0.224, top1 = 94.62%], valid : [loss = 1.479, top1 = 65.72%], test : [loss = 1.504, top1 = 65.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.44%], valid : [loss = 2.569, top1 = 35.73%], test : [loss = 2.527, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.04%], valid : [loss = 0.802, top1 = 72.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13009/15625) 013009-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.64 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.522, top1 = 88.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.349, top1 = 91.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.70 ms.
cifar100       train : [loss = 0.322, top1 = 91.20%], valid : [loss = 1.317, top1 = 67.44%], test : [loss = 1.307, top1 = 66.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.70 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 43.88%], valid : [loss = 2.410, top1 = 39.03%], test : [loss = 2.415, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.27%], valid : [loss = 0.760, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13010/15625) 013010-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.20%], valid : [loss = 0.572, top1 = 87.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=17.64 ms.
cifar10        train : [loss = 0.047, top1 = 98.57%], test  : [loss = 0.374, top1 = 90.60%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.80 ms.
cifar100       train : [loss = 0.311, top1 = 90.97%], valid : [loss = 1.419, top1 = 64.74%], test : [loss = 1.395, top1 = 66.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 2.895, top1 = 27.74%], valid : [loss = 2.974, top1 = 26.47%], test : [loss = 2.989, top1 = 26.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.073, top1 = 61.12%], valid : [loss = 1.082, top1 = 60.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13011/15625) 013011-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.62 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.319, top1 = 92.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.51 ms.
cifar100       train : [loss = 0.362, top1 = 90.10%], valid : [loss = 1.284, top1 = 66.72%], test : [loss = 1.307, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.151, top1 = 44.06%], valid : [loss = 2.408, top1 = 37.63%], test : [loss = 2.410, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13012/15625) 013012-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.042, top1 = 99.15%], valid : [loss = 0.492, top1 = 86.98%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10        train : [loss = 0.063, top1 = 98.15%], test  : [loss = 0.340, top1 = 90.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.68 ms.
cifar100       train : [loss = 0.581, top1 = 83.23%], valid : [loss = 1.245, top1 = 66.02%], test : [loss = 1.230, top1 = 66.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.95%], valid : [loss = 2.363, top1 = 40.53%], test : [loss = 2.356, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 71.92%], valid : [loss = 0.848, top1 = 70.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13013/15625) 013013-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.55 ms.
cifar10-valid  train : [loss = 1.837, top1 = 33.51%], valid : [loss = 1.855, top1 = 32.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.82 ms.
cifar10        train : [loss = 1.308, top1 = 52.63%], test  : [loss = 1.302, top1 = 52.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.80 ms.
cifar100       train : [loss = 3.839, top1 = 11.17%], valid : [loss = 3.875, top1 = 10.41%], test : [loss = 3.867, top1 = 11.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.16 ms.
ImageNet16-120 train : [loss = 3.877, top1 = 12.25%], valid : [loss = 3.859, top1 = 12.79%], test : [loss = 3.870, top1 = 12.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.951, top1 = 28.34%], valid : [loss = 1.957, top1 = 28.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13014/15625) 013014-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.535, top1 = 89.41%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.17 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.311, top1 = 93.26%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.61 ms.
cifar100       train : [loss = 0.082, top1 = 98.58%], valid : [loss = 1.321, top1 = 69.36%], test : [loss = 1.358, top1 = 69.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.45%], valid : [loss = 2.306, top1 = 40.70%], test : [loss = 2.277, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.23%], valid : [loss = 0.845, top1 = 70.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13015/15625) 013015-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.522, top1 = 88.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.014, top1 = 99.73%], test  : [loss = 0.347, top1 = 91.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 0.350, top1 = 90.37%], valid : [loss = 1.288, top1 = 66.38%], test : [loss = 1.275, top1 = 66.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.93%], valid : [loss = 2.413, top1 = 39.23%], test : [loss = 2.422, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.27%], valid : [loss = 0.642, top1 = 77.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13016/15625) 013016-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.606, top1 = 88.24%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.40 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.377, top1 = 92.26%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.69 ms.
cifar100       train : [loss = 0.065, top1 = 98.88%], valid : [loss = 1.524, top1 = 67.58%], test : [loss = 1.518, top1 = 67.88%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.82%], valid : [loss = 2.362, top1 = 39.97%], test : [loss = 2.369, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.58%], valid : [loss = 0.702, top1 = 75.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13017/15625) 013017-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.473, top1 = 89.82%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.82 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.313, top1 = 92.76%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.23 ms.
cifar100       train : [loss = 0.155, top1 = 96.71%], valid : [loss = 1.258, top1 = 69.44%], test : [loss = 1.224, top1 = 69.44%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 1.751, top1 = 53.29%], valid : [loss = 2.168, top1 = 44.07%], test : [loss = 2.196, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.59%], valid : [loss = 0.616, top1 = 78.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13018/15625) 013018-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.472, top1 = 89.64%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.22 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.282, top1 = 93.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.65 ms.
cifar100       train : [loss = 0.287, top1 = 92.35%], valid : [loss = 1.226, top1 = 68.78%], test : [loss = 1.255, top1 = 68.02%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.65 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.43%], valid : [loss = 2.219, top1 = 42.77%], test : [loss = 2.245, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.84%], valid : [loss = 0.586, top1 = 80.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13019/15625) 013019-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.509, top1 = 89.86%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.49 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.323, top1 = 93.11%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.33 ms.
cifar100       train : [loss = 0.051, top1 = 99.32%], valid : [loss = 1.337, top1 = 70.40%], test : [loss = 1.339, top1 = 70.64%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.27 ms.
ImageNet16-120 train : [loss = 1.801, top1 = 52.07%], valid : [loss = 2.249, top1 = 43.00%], test : [loss = 2.260, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.39%], valid : [loss = 0.783, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13020/15625) 013020-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.55%], valid : [loss = 0.760, top1 = 73.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10        train : [loss = 0.540, top1 = 81.41%], test  : [loss = 0.602, top1 = 79.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.55 ms.
cifar100       train : [loss = 2.022, top1 = 45.57%], valid : [loss = 2.119, top1 = 44.05%], test : [loss = 2.123, top1 = 43.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 3.178, top1 = 23.30%], valid : [loss = 3.136, top1 = 24.49%], test : [loss = 3.187, top1 = 23.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.170, top1 = 57.88%], valid : [loss = 1.216, top1 = 57.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13021/15625) 013021-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.19%], valid : [loss = 0.453, top1 = 86.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.110, top1 = 96.59%], test  : [loss = 0.341, top1 = 89.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.863, top1 = 75.62%], valid : [loss = 1.275, top1 = 64.46%], test : [loss = 1.296, top1 = 63.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.65%], valid : [loss = 2.660, top1 = 33.97%], test : [loss = 2.690, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.46%], valid : [loss = 0.659, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13022/15625) 013022-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.369, top1 = 92.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.087, top1 = 98.54%], valid : [loss = 1.453, top1 = 67.96%], test : [loss = 1.482, top1 = 67.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 51.82%], valid : [loss = 2.395, top1 = 39.77%], test : [loss = 2.431, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 79.95%], valid : [loss = 0.670, top1 = 76.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13023/15625) 013023-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=19.16 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.533, top1 = 88.96%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=19.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.342, top1 = 92.47%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=18.82 ms.
cifar100       train : [loss = 0.133, top1 = 97.41%], valid : [loss = 1.409, top1 = 68.21%], test : [loss = 1.380, top1 = 68.03%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.76%], valid : [loss = 2.361, top1 = 41.06%], test : [loss = 2.386, top1 = 41.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.38%], valid : [loss = 0.656, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13024/15625) 013024-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.26%], valid : [loss = 0.836, top1 = 72.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.91 ms.
cifar10        train : [loss = 0.564, top1 = 80.43%], test  : [loss = 0.726, top1 = 75.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.82 ms.
cifar100       train : [loss = 1.776, top1 = 52.16%], valid : [loss = 2.050, top1 = 47.22%], test : [loss = 2.048, top1 = 47.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.68%], valid : [loss = 3.648, top1 = 15.87%], test : [loss = 3.674, top1 = 15.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13025/15625) 013025-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.67%], valid : [loss = 0.547, top1 = 83.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.196, top1 = 93.32%], test  : [loss = 0.395, top1 = 87.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.88 ms.
cifar100       train : [loss = 1.270, top1 = 63.99%], valid : [loss = 1.558, top1 = 57.27%], test : [loss = 1.559, top1 = 57.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.701, top1 = 32.53%], valid : [loss = 2.739, top1 = 31.69%], test : [loss = 2.784, top1 = 31.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.42%], valid : [loss = 0.987, top1 = 65.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13026/15625) 013026-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.595, top1 = 87.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.018, top1 = 99.59%], test  : [loss = 0.393, top1 = 90.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.414, top1 = 88.44%], valid : [loss = 1.395, top1 = 65.70%], test : [loss = 1.371, top1 = 66.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.69 ms.
ImageNet16-120 train : [loss = 2.310, top1 = 40.78%], valid : [loss = 2.555, top1 = 36.83%], test : [loss = 2.541, top1 = 36.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.32%], valid : [loss = 0.791, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13027/15625) 013027-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.583, top1 = 87.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.016, top1 = 99.58%], test  : [loss = 0.382, top1 = 91.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.42 ms.
cifar100       train : [loss = 0.373, top1 = 89.42%], valid : [loss = 1.423, top1 = 65.52%], test : [loss = 1.408, top1 = 66.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.30 ms.
ImageNet16-120 train : [loss = 2.274, top1 = 41.41%], valid : [loss = 2.516, top1 = 37.43%], test : [loss = 2.506, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.05%], valid : [loss = 0.838, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13028/15625) 013028-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.54%], valid : [loss = 0.601, top1 = 80.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10        train : [loss = 0.286, top1 = 90.14%], test  : [loss = 0.417, top1 = 86.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.09 ms.
cifar100       train : [loss = 1.454, top1 = 59.29%], valid : [loss = 1.704, top1 = 54.28%], test : [loss = 1.693, top1 = 54.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.998, top1 = 26.74%], valid : [loss = 3.005, top1 = 27.03%], test : [loss = 3.060, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.32%], valid : [loss = 1.040, top1 = 63.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13029/15625) 013029-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.548, top1 = 88.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.383, top1 = 91.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.180, top1 = 96.12%], valid : [loss = 1.405, top1 = 67.62%], test : [loss = 1.426, top1 = 67.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.92%], valid : [loss = 2.476, top1 = 38.77%], test : [loss = 2.476, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13030/15625) 013030-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.97%], valid : [loss = 0.653, top1 = 82.16%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.96 ms.
cifar10        train : [loss = 0.192, top1 = 93.54%], test  : [loss = 0.407, top1 = 86.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.31 ms.
cifar100       train : [loss = 1.047, top1 = 69.74%], valid : [loss = 1.575, top1 = 57.86%], test : [loss = 1.539, top1 = 58.76%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.697, top1 = 32.60%], valid : [loss = 2.753, top1 = 31.97%], test : [loss = 2.817, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.19%], valid : [loss = 0.994, top1 = 65.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13031/15625) 013031-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.340, top1 = 92.22%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.15 ms.
cifar100       train : [loss = 0.334, top1 = 90.94%], valid : [loss = 1.289, top1 = 67.24%], test : [loss = 1.259, top1 = 67.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 2.137, top1 = 44.49%], valid : [loss = 2.431, top1 = 38.40%], test : [loss = 2.446, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13032/15625) 013032-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.506, top1 = 89.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.317, top1 = 93.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.61 ms.
cifar100       train : [loss = 0.113, top1 = 97.79%], valid : [loss = 1.324, top1 = 69.66%], test : [loss = 1.314, top1 = 69.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 1.723, top1 = 54.01%], valid : [loss = 2.190, top1 = 42.90%], test : [loss = 2.205, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.53%], valid : [loss = 0.669, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13033/15625) 013033-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.587, top1 = 87.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.13 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.386, top1 = 91.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.85 ms.
cifar100       train : [loss = 0.378, top1 = 89.34%], valid : [loss = 1.406, top1 = 65.41%], test : [loss = 1.407, top1 = 65.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.60%], valid : [loss = 2.484, top1 = 37.31%], test : [loss = 2.507, top1 = 37.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.43%], valid : [loss = 0.841, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13034/15625) 013034-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.08%], valid : [loss = 0.542, top1 = 83.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.10 ms.
cifar10        train : [loss = 0.242, top1 = 91.73%], test  : [loss = 0.389, top1 = 87.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.68 ms.
cifar100       train : [loss = 1.287, top1 = 63.65%], valid : [loss = 1.545, top1 = 57.91%], test : [loss = 1.548, top1 = 57.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.15 ms.
ImageNet16-120 train : [loss = 2.833, top1 = 30.03%], valid : [loss = 2.834, top1 = 31.20%], test : [loss = 2.906, top1 = 29.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.06%], valid : [loss = 0.996, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13035/15625) 013035-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.54%], valid : [loss = 0.996, top1 = 65.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.75 ms.
cifar10        train : [loss = 0.778, top1 = 72.56%], test  : [loss = 0.861, top1 = 70.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.56 ms.
cifar100       train : [loss = 2.119, top1 = 44.46%], valid : [loss = 2.306, top1 = 41.42%], test : [loss = 2.334, top1 = 40.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.42 ms.
ImageNet16-120 train : [loss = 3.748, top1 = 14.19%], valid : [loss = 3.778, top1 = 14.10%], test : [loss = 3.773, top1 = 14.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.449, top1 = 47.06%], valid : [loss = 1.471, top1 = 46.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13036/15625) 013036-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.54%], valid : [loss = 0.564, top1 = 87.34%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.88 ms.
cifar10        train : [loss = 0.041, top1 = 98.75%], test  : [loss = 0.374, top1 = 90.20%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.77 ms.
cifar100       train : [loss = 0.442, top1 = 87.48%], valid : [loss = 1.264, top1 = 66.76%], test : [loss = 1.263, top1 = 67.52%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=22.85 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 44.03%], valid : [loss = 2.389, top1 = 39.00%], test : [loss = 2.407, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.66%], valid : [loss = 0.825, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13037/15625) 013037-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.21%], valid : [loss = 0.595, top1 = 85.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.80 ms.
cifar10        train : [loss = 0.066, top1 = 98.03%], test  : [loss = 0.401, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 0.692, top1 = 79.95%], valid : [loss = 1.349, top1 = 64.30%], test : [loss = 1.352, top1 = 63.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.38%], valid : [loss = 2.657, top1 = 33.38%], test : [loss = 2.668, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.18%], valid : [loss = 0.770, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13038/15625) 013038-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.929, top1 = 81.19%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10        train : [loss = 0.039, top1 = 98.90%], test  : [loss = 0.626, top1 = 85.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.20 ms.
cifar100       train : [loss = 0.400, top1 = 89.05%], valid : [loss = 1.884, top1 = 57.16%], test : [loss = 1.875, top1 = 56.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.729, top1 = 32.54%], valid : [loss = 3.099, top1 = 26.53%], test : [loss = 3.107, top1 = 25.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 65.38%], valid : [loss = 1.032, top1 = 63.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13039/15625) 013039-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.62%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.93 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.328, top1 = 93.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.68 ms.
cifar100       train : [loss = 0.076, top1 = 98.70%], valid : [loss = 1.321, top1 = 70.44%], test : [loss = 1.308, top1 = 70.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.73 ms.
ImageNet16-120 train : [loss = 1.636, top1 = 56.04%], valid : [loss = 2.162, top1 = 45.13%], test : [loss = 2.190, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.06%], valid : [loss = 0.708, top1 = 75.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13040/15625) 013040-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.47%], valid : [loss = 0.636, top1 = 85.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10        train : [loss = 0.054, top1 = 98.40%], test  : [loss = 0.401, top1 = 89.28%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.15 ms.
cifar100       train : [loss = 0.655, top1 = 80.97%], valid : [loss = 1.373, top1 = 63.58%], test : [loss = 1.365, top1 = 64.30%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.31%], valid : [loss = 2.588, top1 = 34.83%], test : [loss = 2.612, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.88%], valid : [loss = 0.826, top1 = 71.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13041/15625) 013041-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10-valid  train : [loss = 0.098, top1 = 97.04%], valid : [loss = 0.548, top1 = 84.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.147, top1 = 95.18%], test  : [loss = 0.393, top1 = 87.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.43 ms.
cifar100       train : [loss = 0.859, top1 = 75.22%], valid : [loss = 1.387, top1 = 62.26%], test : [loss = 1.403, top1 = 61.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.65 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.23%], valid : [loss = 2.696, top1 = 32.97%], test : [loss = 2.727, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.37%], valid : [loss = 0.961, top1 = 66.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13042/15625) 013042-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.71%], valid : [loss = 0.520, top1 = 84.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.35 ms.
cifar10        train : [loss = 0.214, top1 = 92.63%], test  : [loss = 0.389, top1 = 87.81%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.85 ms.
cifar100       train : [loss = 1.183, top1 = 66.22%], valid : [loss = 1.538, top1 = 58.20%], test : [loss = 1.520, top1 = 58.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.736, top1 = 32.14%], valid : [loss = 2.750, top1 = 32.03%], test : [loss = 2.816, top1 = 31.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 68.29%], valid : [loss = 0.934, top1 = 66.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13043/15625) 013043-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.18%], valid : [loss = 0.851, top1 = 71.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10        train : [loss = 0.551, top1 = 80.70%], test  : [loss = 0.721, top1 = 75.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.08 ms.
cifar100       train : [loss = 1.802, top1 = 51.47%], valid : [loss = 2.063, top1 = 46.46%], test : [loss = 2.103, top1 = 46.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.74%], valid : [loss = 3.638, top1 = 16.27%], test : [loss = 3.670, top1 = 16.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 56.36%], valid : [loss = 1.273, top1 = 54.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13044/15625) 013044-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.582, top1 = 87.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.355, top1 = 91.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.05 ms.
cifar100       train : [loss = 0.299, top1 = 91.55%], valid : [loss = 1.373, top1 = 66.39%], test : [loss = 1.370, top1 = 66.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.18%], valid : [loss = 2.440, top1 = 38.29%], test : [loss = 2.445, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.18%], valid : [loss = 0.893, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13045/15625) 013045-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.523, top1 = 89.25%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.46 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.305, top1 = 93.06%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.58 ms.
cifar100       train : [loss = 0.159, top1 = 96.66%], valid : [loss = 1.288, top1 = 69.46%], test : [loss = 1.296, top1 = 69.72%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.87%], valid : [loss = 2.225, top1 = 43.13%], test : [loss = 2.242, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.20%], valid : [loss = 0.701, top1 = 75.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13046/15625) 013046-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.25 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.529, top1 = 88.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.97 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.351, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.93 ms.
cifar100       train : [loss = 0.144, top1 = 97.13%], valid : [loss = 1.396, top1 = 68.18%], test : [loss = 1.409, top1 = 67.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.33 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 50.05%], valid : [loss = 2.407, top1 = 39.29%], test : [loss = 2.432, top1 = 40.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 78.98%], valid : [loss = 0.690, top1 = 76.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13047/15625) 013047-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.05%], valid : [loss = 0.483, top1 = 84.23%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.48 ms.
cifar10        train : [loss = 0.297, top1 = 90.10%], test  : [loss = 0.397, top1 = 86.39%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.80 ms.
cifar100       train : [loss = 1.327, top1 = 63.21%], valid : [loss = 1.530, top1 = 57.88%], test : [loss = 1.493, top1 = 58.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.60%], valid : [loss = 2.890, top1 = 29.73%], test : [loss = 2.968, top1 = 27.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.46%], valid : [loss = 0.750, top1 = 73.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13048/15625) 013048-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.577, top1 = 87.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.13 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.376, top1 = 91.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 0.402, top1 = 88.64%], valid : [loss = 1.384, top1 = 65.41%], test : [loss = 1.395, top1 = 65.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.02%], valid : [loss = 2.503, top1 = 36.83%], test : [loss = 2.540, top1 = 36.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13049/15625) 013049-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.533, top1 = 89.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.385, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.77 ms.
cifar100       train : [loss = 0.099, top1 = 98.23%], valid : [loss = 1.443, top1 = 67.94%], test : [loss = 1.445, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.51%], valid : [loss = 2.386, top1 = 40.03%], test : [loss = 2.437, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.92%], valid : [loss = 0.715, top1 = 75.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13050/15625) 013050-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.01 ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.26%], valid : [loss = 0.649, top1 = 78.35%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.86 ms.
cifar10        train : [loss = 0.501, top1 = 82.71%], test  : [loss = 0.585, top1 = 80.73%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.60 ms.
cifar100       train : [loss = 1.689, top1 = 54.08%], valid : [loss = 1.863, top1 = 50.98%], test : [loss = 1.864, top1 = 51.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.89 ms.
ImageNet16-120 train : [loss = 3.320, top1 = 21.46%], valid : [loss = 3.292, top1 = 21.27%], test : [loss = 3.344, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13051/15625) 013051-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.84 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.65%], valid : [loss = 0.547, top1 = 88.01%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.93 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.336, top1 = 91.83%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.23 ms.
cifar100       train : [loss = 0.402, top1 = 88.47%], valid : [loss = 1.220, top1 = 67.66%], test : [loss = 1.257, top1 = 67.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.50%], valid : [loss = 2.423, top1 = 38.97%], test : [loss = 2.430, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 71.98%], valid : [loss = 0.834, top1 = 70.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13052/15625) 013052-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.563, top1 = 88.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.353, top1 = 92.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.68 ms.
cifar100       train : [loss = 0.175, top1 = 96.19%], valid : [loss = 1.394, top1 = 67.08%], test : [loss = 1.397, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.49%], valid : [loss = 2.494, top1 = 37.00%], test : [loss = 2.526, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13053/15625) 013053-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.460, top1 = 89.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.340, top1 = 92.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.278, top1 = 92.43%], valid : [loss = 1.359, top1 = 67.20%], test : [loss = 1.348, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.19 ms.
ImageNet16-120 train : [loss = 2.016, top1 = 47.30%], valid : [loss = 2.324, top1 = 40.33%], test : [loss = 2.366, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.465, top1 = 83.86%], valid : [loss = 0.554, top1 = 81.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13054/15625) 013054-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.24 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.508, top1 = 89.89%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.312, top1 = 93.36%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.53 ms.
cifar100       train : [loss = 0.049, top1 = 99.37%], valid : [loss = 1.340, top1 = 70.34%], test : [loss = 1.356, top1 = 69.42%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.28 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.36%], valid : [loss = 2.300, top1 = 41.57%], test : [loss = 2.320, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.25%], valid : [loss = 0.824, top1 = 71.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13055/15625) 013055-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.39%], valid : [loss = 0.452, top1 = 87.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10        train : [loss = 0.065, top1 = 98.29%], test  : [loss = 0.321, top1 = 90.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.70 ms.
cifar100       train : [loss = 0.636, top1 = 82.33%], valid : [loss = 1.268, top1 = 65.68%], test : [loss = 1.246, top1 = 66.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.351, top1 = 39.92%], valid : [loss = 2.526, top1 = 36.57%], test : [loss = 2.541, top1 = 36.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.92%], valid : [loss = 0.635, top1 = 78.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13056/15625) 013056-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.79%], valid : [loss = 0.599, top1 = 87.84%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.41 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.409, top1 = 91.30%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.90 ms.
cifar100       train : [loss = 0.139, top1 = 96.78%], valid : [loss = 1.571, top1 = 64.26%], test : [loss = 1.596, top1 = 64.46%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=16.86 ms.
ImageNet16-120 train : [loss = 3.124, top1 = 23.03%], valid : [loss = 3.135, top1 = 22.60%], test : [loss = 3.141, top1 = 22.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.01%], valid : [loss = 1.002, top1 = 64.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13057/15625) 013057-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.96%], valid : [loss = 0.484, top1 = 84.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.299, top1 = 90.13%], test  : [loss = 0.401, top1 = 86.52%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 1.335, top1 = 63.01%], valid : [loss = 1.552, top1 = 57.14%], test : [loss = 1.505, top1 = 58.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.906, top1 = 28.97%], valid : [loss = 2.879, top1 = 30.13%], test : [loss = 2.971, top1 = 27.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13058/15625) 013058-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.441, top1 = 89.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=10.78 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.322, top1 = 91.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.50 ms.
cifar100       train : [loss = 0.330, top1 = 90.91%], valid : [loss = 1.315, top1 = 66.56%], test : [loss = 1.327, top1 = 67.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.21 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.24%], valid : [loss = 2.349, top1 = 40.23%], test : [loss = 2.393, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13059/15625) 013059-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.34%], valid : [loss = 0.459, top1 = 86.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10        train : [loss = 0.114, top1 = 96.41%], test  : [loss = 0.331, top1 = 89.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.57 ms.
cifar100       train : [loss = 0.862, top1 = 75.60%], valid : [loss = 1.294, top1 = 63.84%], test : [loss = 1.286, top1 = 64.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.62%], valid : [loss = 2.607, top1 = 34.67%], test : [loss = 2.649, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.23%], valid : [loss = 0.635, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13060/15625) 013060-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.68 ms.
cifar10-valid  train : [loss = 1.304, top1 = 52.69%], valid : [loss = 1.349, top1 = 51.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.24 ms.
cifar10        train : [loss = 1.292, top1 = 53.61%], test  : [loss = 1.293, top1 = 53.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.58 ms.
cifar100       train : [loss = 2.846, top1 = 29.35%], valid : [loss = 2.929, top1 = 28.06%], test : [loss = 2.918, top1 = 27.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.47 ms.
ImageNet16-120 train : [loss = 4.010, top1 = 10.18%], valid : [loss = 4.016, top1 = 10.37%], test : [loss = 4.030, top1 = 9.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.826, top1 = 31.54%], valid : [loss = 1.809, top1 = 31.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13061/15625) 013061-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.130, top1 = 96.02%], valid : [loss = 0.454, top1 = 86.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.154, top1 = 94.98%], test  : [loss = 0.342, top1 = 88.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.87 ms.
cifar100       train : [loss = 0.987, top1 = 71.81%], valid : [loss = 1.365, top1 = 62.22%], test : [loss = 1.333, top1 = 62.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.81%], valid : [loss = 2.688, top1 = 33.70%], test : [loss = 2.724, top1 = 31.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13062/15625) 013062-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.45%], valid : [loss = 0.451, top1 = 87.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.118, top1 = 96.26%], test  : [loss = 0.324, top1 = 89.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.68 ms.
cifar100       train : [loss = 0.875, top1 = 75.03%], valid : [loss = 1.333, top1 = 63.54%], test : [loss = 1.302, top1 = 63.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.77%], valid : [loss = 2.632, top1 = 34.47%], test : [loss = 2.661, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13063/15625) 013063-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.530, top1 = 89.03%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=16.82 ms.
cifar10        train : [loss = 0.007, top1 = 99.82%], test  : [loss = 0.352, top1 = 92.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.11 ms.
cifar100       train : [loss = 0.119, top1 = 97.27%], valid : [loss = 1.360, top1 = 68.80%], test : [loss = 1.376, top1 = 69.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 2.454, top1 = 37.11%], valid : [loss = 2.639, top1 = 32.33%], test : [loss = 2.660, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 67.01%], valid : [loss = 0.972, top1 = 65.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13064/15625) 013064-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.48%], valid : [loss = 0.692, top1 = 84.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10        train : [loss = 0.052, top1 = 98.46%], test  : [loss = 0.437, top1 = 88.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.48 ms.
cifar100       train : [loss = 0.639, top1 = 81.29%], valid : [loss = 1.555, top1 = 61.16%], test : [loss = 1.522, top1 = 61.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.687, top1 = 33.14%], valid : [loss = 2.832, top1 = 30.37%], test : [loss = 2.932, top1 = 29.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 70.08%], valid : [loss = 0.886, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13065/15625) 013065-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.516, top1 = 88.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.329, top1 = 91.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 0.335, top1 = 90.83%], valid : [loss = 1.278, top1 = 67.10%], test : [loss = 1.262, top1 = 67.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.96%], valid : [loss = 2.430, top1 = 38.57%], test : [loss = 2.414, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13066/15625) 013066-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.578, top1 = 87.69%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.30 ms.
cifar10        train : [loss = 0.018, top1 = 99.55%], test  : [loss = 0.381, top1 = 91.10%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.64 ms.
cifar100       train : [loss = 0.364, top1 = 89.81%], valid : [loss = 1.418, top1 = 65.56%], test : [loss = 1.449, top1 = 65.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.34%], valid : [loss = 2.454, top1 = 38.27%], test : [loss = 2.485, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.64%], valid : [loss = 0.867, top1 = 69.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13067/15625) 013067-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.91 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.00%], valid : [loss = 0.637, top1 = 83.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10        train : [loss = 0.119, top1 = 96.02%], test  : [loss = 0.454, top1 = 86.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.90 ms.
cifar100       train : [loss = 0.647, top1 = 80.91%], valid : [loss = 1.500, top1 = 61.54%], test : [loss = 1.497, top1 = 62.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.17 ms.
ImageNet16-120 train : [loss = 3.070, top1 = 24.58%], valid : [loss = 3.099, top1 = 23.90%], test : [loss = 3.118, top1 = 24.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.033, top1 = 62.62%], valid : [loss = 1.084, top1 = 61.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13068/15625) 013068-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=24.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.518, top1 = 89.40%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.50 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.301, top1 = 92.71%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=23.47 ms.
cifar100       train : [loss = 0.110, top1 = 98.11%], valid : [loss = 1.303, top1 = 69.10%], test : [loss = 1.303, top1 = 69.76%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.07 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.14%], valid : [loss = 2.249, top1 = 42.00%], test : [loss = 2.278, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.23%], valid : [loss = 0.774, top1 = 73.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13069/15625) 013069-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.11%], valid : [loss = 0.550, top1 = 86.13%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.03 ms.
cifar10        train : [loss = 0.053, top1 = 98.50%], test  : [loss = 0.365, top1 = 89.60%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.03 ms.
cifar100       train : [loss = 0.582, top1 = 83.22%], valid : [loss = 1.317, top1 = 64.90%], test : [loss = 1.294, top1 = 65.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 41.91%], valid : [loss = 2.412, top1 = 38.20%], test : [loss = 2.441, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.50%], valid : [loss = 0.867, top1 = 69.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13070/15625) 013070-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.85 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13071/15625) 013071-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.327, top1 = 92.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.352, top1 = 90.35%], valid : [loss = 1.280, top1 = 66.88%], test : [loss = 1.269, top1 = 67.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.50%], valid : [loss = 2.421, top1 = 38.80%], test : [loss = 2.439, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13072/15625) 013072-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.551, top1 = 88.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.373, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.39 ms.
cifar100       train : [loss = 0.167, top1 = 96.18%], valid : [loss = 1.500, top1 = 65.99%], test : [loss = 1.491, top1 = 66.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.46%], valid : [loss = 2.406, top1 = 39.26%], test : [loss = 2.422, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.10%], valid : [loss = 0.768, top1 = 73.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13073/15625) 013073-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.55%], valid : [loss = 0.919, top1 = 67.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10        train : [loss = 0.746, top1 = 73.63%], test  : [loss = 0.798, top1 = 71.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.49 ms.
cifar100       train : [loss = 2.374, top1 = 37.73%], valid : [loss = 2.511, top1 = 35.08%], test : [loss = 2.471, top1 = 36.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.82 ms.
ImageNet16-120 train : [loss = 3.575, top1 = 16.79%], valid : [loss = 3.561, top1 = 17.53%], test : [loss = 3.590, top1 = 16.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.448, top1 = 47.00%], valid : [loss = 1.500, top1 = 45.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13074/15625) 013074-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.129, top1 = 96.07%], valid : [loss = 0.464, top1 = 85.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.36 ms.
cifar10        train : [loss = 0.165, top1 = 94.56%], test  : [loss = 0.336, top1 = 89.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.28 ms.
cifar100       train : [loss = 1.002, top1 = 71.65%], valid : [loss = 1.359, top1 = 61.66%], test : [loss = 1.338, top1 = 61.88%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.31%], valid : [loss = 2.699, top1 = 31.77%], test : [loss = 2.713, top1 = 31.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13075/15625) 013075-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.569, top1 = 87.92%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.99 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.357, top1 = 91.80%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.93 ms.
cifar100       train : [loss = 0.266, top1 = 92.70%], valid : [loss = 1.309, top1 = 68.02%], test : [loss = 1.285, top1 = 68.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.444, top1 = 37.44%], valid : [loss = 2.579, top1 = 34.93%], test : [loss = 2.590, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.86%], valid : [loss = 0.969, top1 = 65.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13076/15625) 013076-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.059, top1 = 98.49%], valid : [loss = 0.537, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.100, top1 = 96.87%], test  : [loss = 0.369, top1 = 89.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.766, top1 = 77.82%], valid : [loss = 1.345, top1 = 63.42%], test : [loss = 1.324, top1 = 64.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.93 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.08%], valid : [loss = 2.543, top1 = 35.84%], test : [loss = 2.573, top1 = 35.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.816, top1 = 70.66%], valid : [loss = 0.868, top1 = 69.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13077/15625) 013077-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.19%], valid : [loss = 0.453, top1 = 87.07%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.18 ms.
cifar10        train : [loss = 0.112, top1 = 96.49%], test  : [loss = 0.323, top1 = 89.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.51 ms.
cifar100       train : [loss = 0.853, top1 = 75.79%], valid : [loss = 1.288, top1 = 63.94%], test : [loss = 1.270, top1 = 64.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 2.548, top1 = 35.77%], valid : [loss = 2.625, top1 = 34.11%], test : [loss = 2.650, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.09%], valid : [loss = 0.643, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13078/15625) 013078-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.40 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13079/15625) 013079-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.484, top1 = 89.43%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.20 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.309, top1 = 92.81%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.49 ms.
cifar100       train : [loss = 0.191, top1 = 95.34%], valid : [loss = 1.234, top1 = 69.80%], test : [loss = 1.260, top1 = 69.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 1.800, top1 = 52.04%], valid : [loss = 2.197, top1 = 42.70%], test : [loss = 2.239, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 84.15%], valid : [loss = 0.560, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13080/15625) 013080-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.64 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.77%], valid : [loss = 0.859, top1 = 71.69%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.54 ms.
cifar10        train : [loss = 0.556, top1 = 80.72%], test  : [loss = 0.720, top1 = 75.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.00 ms.
cifar100       train : [loss = 1.784, top1 = 51.96%], valid : [loss = 2.057, top1 = 46.73%], test : [loss = 2.066, top1 = 46.60%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.56 ms.
ImageNet16-120 train : [loss = 3.592, top1 = 16.65%], valid : [loss = 3.645, top1 = 16.30%], test : [loss = 3.664, top1 = 16.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13081/15625) 013081-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.56 ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.02%], valid : [loss = 0.859, top1 = 71.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.16 ms.
cifar10        train : [loss = 0.559, top1 = 80.46%], test  : [loss = 0.718, top1 = 75.32%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.98 ms.
cifar100       train : [loss = 1.776, top1 = 52.04%], valid : [loss = 2.051, top1 = 46.81%], test : [loss = 2.068, top1 = 46.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.88 ms.
ImageNet16-120 train : [loss = 3.583, top1 = 16.80%], valid : [loss = 3.635, top1 = 16.51%], test : [loss = 3.657, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13082/15625) 013082-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.547, top1 = 89.14%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.06 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.357, top1 = 92.97%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.78 ms.
cifar100       train : [loss = 0.073, top1 = 98.61%], valid : [loss = 1.424, top1 = 68.38%], test : [loss = 1.421, top1 = 69.20%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.64%], valid : [loss = 2.335, top1 = 40.80%], test : [loss = 2.340, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.19%], valid : [loss = 0.785, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13083/15625) 013083-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.35%], valid : [loss = 1.085, top1 = 63.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.771, top1 = 72.99%], test  : [loss = 0.919, top1 = 68.12%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.81 ms.
cifar100       train : [loss = 2.115, top1 = 44.45%], valid : [loss = 2.397, top1 = 39.88%], test : [loss = 2.397, top1 = 39.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 3.760, top1 = 13.91%], valid : [loss = 3.815, top1 = 13.83%], test : [loss = 3.822, top1 = 12.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.356, top1 = 50.71%], valid : [loss = 1.405, top1 = 48.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13084/15625) 013084-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.577, top1 = 87.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.382, top1 = 91.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.09 ms.
cifar100       train : [loss = 0.381, top1 = 89.21%], valid : [loss = 1.448, top1 = 64.48%], test : [loss = 1.425, top1 = 64.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 2.276, top1 = 41.43%], valid : [loss = 2.506, top1 = 37.67%], test : [loss = 2.523, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.48%], valid : [loss = 0.782, top1 = 72.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13085/15625) 013085-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.618, top1 = 86.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.038, top1 = 98.88%], test  : [loss = 0.391, top1 = 90.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 0.604, top1 = 82.10%], valid : [loss = 1.452, top1 = 62.48%], test : [loss = 1.412, top1 = 63.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.392, top1 = 38.95%], valid : [loss = 2.561, top1 = 35.20%], test : [loss = 2.595, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.08%], valid : [loss = 0.843, top1 = 70.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13086/15625) 013086-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.20%], valid : [loss = 0.579, top1 = 86.77%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=19.78 ms.
cifar10        train : [loss = 0.051, top1 = 98.35%], test  : [loss = 0.379, top1 = 90.09%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.02 ms.
cifar100       train : [loss = 0.619, top1 = 81.76%], valid : [loss = 1.354, top1 = 63.92%], test : [loss = 1.364, top1 = 64.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.57 ms.
ImageNet16-120 train : [loss = 2.328, top1 = 40.09%], valid : [loss = 2.493, top1 = 36.47%], test : [loss = 2.541, top1 = 36.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.86%], valid : [loss = 0.877, top1 = 68.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13087/15625) 013087-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.56%], valid : [loss = 0.860, top1 = 71.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.47 ms.
cifar10        train : [loss = 0.555, top1 = 80.50%], test  : [loss = 0.714, top1 = 75.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.31 ms.
cifar100       train : [loss = 1.773, top1 = 52.23%], valid : [loss = 2.061, top1 = 47.10%], test : [loss = 2.067, top1 = 46.42%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 3.574, top1 = 16.94%], valid : [loss = 3.614, top1 = 16.97%], test : [loss = 3.638, top1 = 16.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13088/15625) 013088-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.18%], valid : [loss = 0.455, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.162, top1 = 94.70%], test  : [loss = 0.350, top1 = 88.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 1.023, top1 = 70.97%], valid : [loss = 1.377, top1 = 61.58%], test : [loss = 1.383, top1 = 61.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.53%], valid : [loss = 2.721, top1 = 31.87%], test : [loss = 2.734, top1 = 31.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13089/15625) 013089-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.537, top1 = 88.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.349, top1 = 91.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.80 ms.
cifar100       train : [loss = 0.415, top1 = 87.90%], valid : [loss = 1.227, top1 = 67.80%], test : [loss = 1.260, top1 = 67.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.29%], valid : [loss = 2.389, top1 = 38.37%], test : [loss = 2.389, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13090/15625) 013090-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.68%], valid : [loss = 0.441, top1 = 86.52%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.83 ms.
cifar10        train : [loss = 0.151, top1 = 95.05%], test  : [loss = 0.336, top1 = 89.03%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.98 ms.
cifar100       train : [loss = 0.980, top1 = 72.11%], valid : [loss = 1.346, top1 = 63.20%], test : [loss = 1.330, top1 = 62.18%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.609, top1 = 34.38%], valid : [loss = 2.621, top1 = 34.60%], test : [loss = 2.695, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.755, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13091/15625) 013091-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.469, top1 = 89.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.317, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.73 ms.
cifar100       train : [loss = 0.323, top1 = 91.32%], valid : [loss = 1.249, top1 = 67.53%], test : [loss = 1.255, top1 = 67.99%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.75%], valid : [loss = 2.304, top1 = 41.06%], test : [loss = 2.346, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.88%], valid : [loss = 0.559, top1 = 81.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13092/15625) 013092-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.554, top1 = 88.88%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.86 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.358, top1 = 92.39%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.97 ms.
cifar100       train : [loss = 0.091, top1 = 98.66%], valid : [loss = 1.370, top1 = 69.50%], test : [loss = 1.352, top1 = 69.36%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.29%], valid : [loss = 2.432, top1 = 39.70%], test : [loss = 2.399, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.17%], valid : [loss = 0.721, top1 = 75.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13093/15625) 013093-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.21%], valid : [loss = 0.461, top1 = 86.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.162, top1 = 94.64%], test  : [loss = 0.353, top1 = 88.57%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.015, top1 = 70.97%], valid : [loss = 1.366, top1 = 62.46%], test : [loss = 1.369, top1 = 61.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.56%], valid : [loss = 2.682, top1 = 33.30%], test : [loss = 2.708, top1 = 31.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.75%], valid : [loss = 0.791, top1 = 72.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13094/15625) 013094-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.421, top1 = 89.90%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.83 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.307, top1 = 92.58%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.60 ms.
cifar100       train : [loss = 0.208, top1 = 95.12%], valid : [loss = 1.297, top1 = 68.96%], test : [loss = 1.275, top1 = 69.16%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.69 ms.
ImageNet16-120 train : [loss = 1.856, top1 = 50.77%], valid : [loss = 2.279, top1 = 41.97%], test : [loss = 2.304, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.403, top1 = 86.10%], valid : [loss = 0.529, top1 = 82.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13095/15625) 013095-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.89%], valid : [loss = 0.502, top1 = 85.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.167, top1 = 94.43%], test  : [loss = 0.362, top1 = 88.96%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.12 ms.
cifar100       train : [loss = 1.022, top1 = 70.58%], valid : [loss = 1.376, top1 = 61.99%], test : [loss = 1.375, top1 = 61.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.597, top1 = 34.85%], valid : [loss = 2.645, top1 = 33.82%], test : [loss = 2.681, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.17%], valid : [loss = 0.931, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13096/15625) 013096-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.47%], valid : [loss = 0.461, top1 = 87.56%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10        train : [loss = 0.058, top1 = 98.52%], test  : [loss = 0.303, top1 = 90.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.45 ms.
cifar100       train : [loss = 0.608, top1 = 83.05%], valid : [loss = 1.222, top1 = 66.68%], test : [loss = 1.218, top1 = 66.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.84%], valid : [loss = 2.474, top1 = 37.17%], test : [loss = 2.492, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13097/15625) 013097-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.523, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.333, top1 = 91.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.35 ms.
cifar100       train : [loss = 0.350, top1 = 90.35%], valid : [loss = 1.295, top1 = 66.68%], test : [loss = 1.293, top1 = 67.27%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.69%], valid : [loss = 2.410, top1 = 39.12%], test : [loss = 2.407, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13098/15625) 013098-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.72%], valid : [loss = 0.475, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10        train : [loss = 0.304, top1 = 89.75%], test  : [loss = 0.390, top1 = 86.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 1.342, top1 = 62.69%], valid : [loss = 1.529, top1 = 58.16%], test : [loss = 1.526, top1 = 57.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.61%], valid : [loss = 2.900, top1 = 29.57%], test : [loss = 2.962, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13099/15625) 013099-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.532, top1 = 88.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.341, top1 = 91.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.27 ms.
cifar100       train : [loss = 0.329, top1 = 90.95%], valid : [loss = 1.278, top1 = 67.42%], test : [loss = 1.284, top1 = 67.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.68%], valid : [loss = 2.403, top1 = 38.50%], test : [loss = 2.421, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.97%], valid : [loss = 0.663, top1 = 77.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13100/15625) 013100-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.91 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.600, top1 = 87.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.413, top1 = 91.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.24 ms.
cifar100       train : [loss = 0.204, top1 = 94.88%], valid : [loss = 1.521, top1 = 65.70%], test : [loss = 1.529, top1 = 64.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.092, top1 = 45.61%], valid : [loss = 2.484, top1 = 37.20%], test : [loss = 2.527, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 72.81%], valid : [loss = 0.829, top1 = 71.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13101/15625) 013101-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.29%], valid : [loss = 0.560, top1 = 82.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.267, top1 = 90.74%], test  : [loss = 0.449, top1 = 85.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.63 ms.
cifar100       train : [loss = 1.328, top1 = 62.47%], valid : [loss = 1.654, top1 = 55.52%], test : [loss = 1.664, top1 = 55.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 3.012, top1 = 26.59%], valid : [loss = 3.060, top1 = 25.07%], test : [loss = 3.140, top1 = 25.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.30%], valid : [loss = 1.253, top1 = 55.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13102/15625) 013102-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.49 ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.50%], valid : [loss = 0.652, top1 = 78.04%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.72 ms.
cifar10        train : [loss = 0.503, top1 = 82.54%], test  : [loss = 0.587, top1 = 79.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.96 ms.
cifar100       train : [loss = 1.690, top1 = 54.29%], valid : [loss = 1.834, top1 = 51.44%], test : [loss = 1.853, top1 = 50.56%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.21%], valid : [loss = 3.316, top1 = 21.20%], test : [loss = 3.333, top1 = 21.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13103/15625) 013103-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.504, top1 = 88.83%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.52 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.326, top1 = 92.17%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.71 ms.
cifar100       train : [loss = 0.328, top1 = 91.16%], valid : [loss = 1.255, top1 = 67.54%], test : [loss = 1.280, top1 = 67.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.21%], valid : [loss = 2.408, top1 = 39.17%], test : [loss = 2.433, top1 = 40.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.76%], valid : [loss = 0.685, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13104/15625) 013104-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.71%], valid : [loss = 0.457, top1 = 86.42%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.49 ms.
cifar10        train : [loss = 0.162, top1 = 94.74%], test  : [loss = 0.354, top1 = 88.66%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.79 ms.
cifar100       train : [loss = 0.994, top1 = 71.88%], valid : [loss = 1.351, top1 = 62.82%], test : [loss = 1.343, top1 = 62.32%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=22.96 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.78%], valid : [loss = 2.699, top1 = 32.23%], test : [loss = 2.717, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.59%], valid : [loss = 0.816, top1 = 71.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13105/15625) 013105-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.19%], valid : [loss = 0.608, top1 = 80.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10        train : [loss = 0.291, top1 = 90.04%], test  : [loss = 0.434, top1 = 85.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.54 ms.
cifar100       train : [loss = 1.542, top1 = 56.89%], valid : [loss = 1.774, top1 = 51.98%], test : [loss = 1.767, top1 = 52.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.09 ms.
ImageNet16-120 train : [loss = 2.953, top1 = 27.57%], valid : [loss = 2.971, top1 = 27.33%], test : [loss = 3.019, top1 = 26.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.89%], valid : [loss = 1.020, top1 = 63.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13106/15625) 013106-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.631, top1 = 87.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.17 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.386, top1 = 91.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.10 ms.
cifar100       train : [loss = 0.230, top1 = 94.25%], valid : [loss = 1.575, top1 = 64.28%], test : [loss = 1.611, top1 = 63.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.71%], valid : [loss = 2.547, top1 = 36.23%], test : [loss = 2.578, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.71%], valid : [loss = 0.866, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13107/15625) 013107-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.526, top1 = 89.38%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.372, top1 = 92.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.72 ms.
cifar100       train : [loss = 0.108, top1 = 97.66%], valid : [loss = 1.371, top1 = 69.60%], test : [loss = 1.423, top1 = 68.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.98 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.61%], valid : [loss = 2.225, top1 = 44.57%], test : [loss = 2.228, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.14%], valid : [loss = 0.810, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13108/15625) 013108-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.596, top1 = 85.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10        train : [loss = 0.069, top1 = 97.89%], test  : [loss = 0.398, top1 = 88.99%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.52 ms.
cifar100       train : [loss = 0.704, top1 = 79.59%], valid : [loss = 1.373, top1 = 63.83%], test : [loss = 1.367, top1 = 63.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.93%], valid : [loss = 2.659, top1 = 33.99%], test : [loss = 2.697, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.36%], valid : [loss = 0.758, top1 = 73.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13109/15625) 013109-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.536, top1 = 89.41%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.43 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.359, top1 = 92.87%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.51 ms.
cifar100       train : [loss = 0.044, top1 = 99.52%], valid : [loss = 1.470, top1 = 69.80%], test : [loss = 1.424, top1 = 69.52%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 1.621, top1 = 56.47%], valid : [loss = 2.356, top1 = 40.80%], test : [loss = 2.378, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.66%], valid : [loss = 0.652, top1 = 77.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13110/15625) 013110-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.558, top1 = 87.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.23 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.363, top1 = 91.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.15 ms.
cifar100       train : [loss = 0.316, top1 = 91.08%], valid : [loss = 1.357, top1 = 66.04%], test : [loss = 1.402, top1 = 66.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.237, top1 = 42.05%], valid : [loss = 2.452, top1 = 37.57%], test : [loss = 2.482, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 69.30%], valid : [loss = 0.899, top1 = 68.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13111/15625) 013111-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.93%], valid : [loss = 0.519, top1 = 89.67%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.52 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.317, top1 = 93.25%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.93 ms.
cifar100       train : [loss = 0.100, top1 = 98.22%], valid : [loss = 1.304, top1 = 70.08%], test : [loss = 1.276, top1 = 70.50%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 1.656, top1 = 55.54%], valid : [loss = 2.142, top1 = 44.63%], test : [loss = 2.186, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.60%], valid : [loss = 0.668, top1 = 77.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13112/15625) 013112-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.68 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.423, top1 = 91.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.286, top1 = 93.72%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.29 ms.
cifar100       train : [loss = 0.058, top1 = 99.24%], valid : [loss = 1.326, top1 = 70.81%], test : [loss = 1.313, top1 = 70.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.86 ms.
ImageNet16-120 train : [loss = 1.492, top1 = 59.52%], valid : [loss = 2.222, top1 = 44.48%], test : [loss = 2.246, top1 = 43.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.346, top1 = 88.28%], valid : [loss = 0.487, top1 = 83.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13113/15625) 013113-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.24%], valid : [loss = 0.469, top1 = 85.91%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.32 ms.
cifar10        train : [loss = 0.160, top1 = 94.76%], test  : [loss = 0.354, top1 = 88.26%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.56 ms.
cifar100       train : [loss = 0.979, top1 = 71.95%], valid : [loss = 1.342, top1 = 62.94%], test : [loss = 1.343, top1 = 63.14%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.33%], valid : [loss = 2.688, top1 = 32.53%], test : [loss = 2.700, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.79%], valid : [loss = 0.789, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13114/15625) 013114-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.517, top1 = 89.42%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.27 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.355, top1 = 92.56%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.73 ms.
cifar100       train : [loss = 0.069, top1 = 99.00%], valid : [loss = 1.505, top1 = 68.58%], test : [loss = 1.457, top1 = 68.62%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 1.735, top1 = 53.78%], valid : [loss = 2.335, top1 = 40.67%], test : [loss = 2.394, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.24%], valid : [loss = 0.681, top1 = 76.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13115/15625) 013115-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.587, top1 = 87.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.381, top1 = 91.54%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.02 ms.
cifar100       train : [loss = 0.379, top1 = 89.36%], valid : [loss = 1.401, top1 = 65.91%], test : [loss = 1.424, top1 = 65.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.18%], valid : [loss = 2.501, top1 = 37.12%], test : [loss = 2.521, top1 = 37.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.97%], valid : [loss = 0.772, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13116/15625) 013116-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.490, top1 = 82.87%], valid : [loss = 0.640, top1 = 78.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10        train : [loss = 0.512, top1 = 82.18%], test  : [loss = 0.592, top1 = 79.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.32 ms.
cifar100       train : [loss = 1.674, top1 = 54.48%], valid : [loss = 1.852, top1 = 50.34%], test : [loss = 1.856, top1 = 51.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 3.333, top1 = 21.16%], valid : [loss = 3.308, top1 = 22.07%], test : [loss = 3.350, top1 = 21.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13117/15625) 013117-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.489, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.330, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.10 ms.
cifar100       train : [loss = 0.331, top1 = 91.15%], valid : [loss = 1.258, top1 = 67.33%], test : [loss = 1.255, top1 = 68.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.43 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.71%], valid : [loss = 2.296, top1 = 40.77%], test : [loss = 2.343, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13118/15625) 013118-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.64%], valid : [loss = 0.550, top1 = 83.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10        train : [loss = 0.227, top1 = 92.22%], test  : [loss = 0.415, top1 = 86.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 1.212, top1 = 65.63%], valid : [loss = 1.585, top1 = 57.61%], test : [loss = 1.580, top1 = 57.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.942, top1 = 28.23%], valid : [loss = 2.972, top1 = 27.68%], test : [loss = 3.029, top1 = 27.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.154, top1 = 58.32%], valid : [loss = 1.211, top1 = 56.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13119/15625) 013119-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.14%], valid : [loss = 0.573, top1 = 86.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.99 ms.
cifar10        train : [loss = 0.072, top1 = 97.63%], test  : [loss = 0.396, top1 = 89.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.55 ms.
cifar100       train : [loss = 0.674, top1 = 80.11%], valid : [loss = 1.296, top1 = 64.78%], test : [loss = 1.310, top1 = 64.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=22.28 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 38.75%], valid : [loss = 2.521, top1 = 35.83%], test : [loss = 2.512, top1 = 37.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.58%], valid : [loss = 0.783, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13120/15625) 013120-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.00%], valid : [loss = 0.841, top1 = 72.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10        train : [loss = 0.565, top1 = 80.15%], test  : [loss = 0.719, top1 = 75.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.91 ms.
cifar100       train : [loss = 1.783, top1 = 52.08%], valid : [loss = 2.047, top1 = 46.85%], test : [loss = 2.063, top1 = 46.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.82%], valid : [loss = 3.649, top1 = 16.77%], test : [loss = 3.664, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13121/15625) 013121-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.371, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.28 ms.
cifar100       train : [loss = 0.087, top1 = 98.72%], valid : [loss = 1.454, top1 = 67.44%], test : [loss = 1.456, top1 = 68.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.56%], valid : [loss = 2.432, top1 = 39.80%], test : [loss = 2.451, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.54%], valid : [loss = 0.662, top1 = 77.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13122/15625) 013122-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.07%], valid : [loss = 0.605, top1 = 84.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.109, top1 = 96.35%], test  : [loss = 0.398, top1 = 88.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.17 ms.
cifar100       train : [loss = 0.827, top1 = 75.83%], valid : [loss = 1.418, top1 = 62.46%], test : [loss = 1.411, top1 = 62.34%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.04%], valid : [loss = 2.779, top1 = 32.10%], test : [loss = 2.815, top1 = 31.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13123/15625) 013123-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.539, top1 = 89.34%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=23.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.324, top1 = 92.95%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.32 ms.
cifar100       train : [loss = 0.087, top1 = 98.33%], valid : [loss = 1.328, top1 = 69.50%], test : [loss = 1.299, top1 = 70.42%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.31 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.42%], valid : [loss = 2.284, top1 = 41.70%], test : [loss = 2.298, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.26%], valid : [loss = 0.855, top1 = 69.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13124/15625) 013124-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.336, top1 = 91.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.42 ms.
cifar100       train : [loss = 0.347, top1 = 90.35%], valid : [loss = 1.297, top1 = 66.30%], test : [loss = 1.276, top1 = 67.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.71 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.78%], valid : [loss = 2.395, top1 = 38.83%], test : [loss = 2.417, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 79.07%], valid : [loss = 0.668, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13125/15625) 013125-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.96%], valid : [loss = 0.573, top1 = 86.94%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.07 ms.
cifar10        train : [loss = 0.068, top1 = 97.80%], test  : [loss = 0.364, top1 = 90.30%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.07 ms.
cifar100       train : [loss = 0.655, top1 = 80.62%], valid : [loss = 1.316, top1 = 64.32%], test : [loss = 1.352, top1 = 64.08%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.80%], valid : [loss = 2.485, top1 = 37.37%], test : [loss = 2.530, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13126/15625) 013126-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.89 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13127/15625) 013127-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.487, top1 = 90.19%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.94 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.307, top1 = 93.53%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.48 ms.
cifar100       train : [loss = 0.063, top1 = 99.19%], valid : [loss = 1.329, top1 = 69.62%], test : [loss = 1.296, top1 = 71.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.44 ms.
ImageNet16-120 train : [loss = 1.613, top1 = 56.69%], valid : [loss = 2.180, top1 = 44.63%], test : [loss = 2.166, top1 = 45.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 82.08%], valid : [loss = 0.599, top1 = 79.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13128/15625) 013128-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.540, top1 = 88.80%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.359, top1 = 92.28%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.96 ms.
cifar100       train : [loss = 0.144, top1 = 97.09%], valid : [loss = 1.459, top1 = 66.80%], test : [loss = 1.447, top1 = 67.34%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.13%], valid : [loss = 2.399, top1 = 40.13%], test : [loss = 2.427, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.35%], valid : [loss = 0.727, top1 = 74.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13129/15625) 013129-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.500, top1 = 89.12%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10        train : [loss = 0.009, top1 = 99.88%], test  : [loss = 0.344, top1 = 92.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.04 ms.
cifar100       train : [loss = 0.228, top1 = 94.35%], valid : [loss = 1.258, top1 = 68.46%], test : [loss = 1.280, top1 = 68.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.31%], valid : [loss = 2.292, top1 = 40.90%], test : [loss = 2.321, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.49%], valid : [loss = 0.631, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13130/15625) 013130-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.844, top1 = 69.64%], valid : [loss = 0.940, top1 = 67.16%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10        train : [loss = 0.758, top1 = 73.23%], test  : [loss = 0.805, top1 = 72.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.38 ms.
cifar100       train : [loss = 2.374, top1 = 38.03%], valid : [loss = 2.497, top1 = 35.56%], test : [loss = 2.487, top1 = 35.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 3.546, top1 = 17.21%], valid : [loss = 3.531, top1 = 18.07%], test : [loss = 3.535, top1 = 17.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.447, top1 = 46.71%], valid : [loss = 1.504, top1 = 44.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13131/15625) 013131-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.66%], valid : [loss = 0.491, top1 = 84.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.17 ms.
cifar10        train : [loss = 0.209, top1 = 92.94%], test  : [loss = 0.377, top1 = 87.55%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.31 ms.
cifar100       train : [loss = 1.243, top1 = 65.01%], valid : [loss = 1.522, top1 = 57.94%], test : [loss = 1.544, top1 = 57.56%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.944, top1 = 27.62%], valid : [loss = 2.960, top1 = 27.27%], test : [loss = 2.975, top1 = 27.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.12%], valid : [loss = 1.031, top1 = 63.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13132/15625) 013132-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.511, top1 = 89.89%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.41 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.331, top1 = 93.15%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.46 ms.
cifar100       train : [loss = 0.061, top1 = 99.20%], valid : [loss = 1.407, top1 = 68.80%], test : [loss = 1.416, top1 = 68.46%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.27 ms.
ImageNet16-120 train : [loss = 1.828, top1 = 51.34%], valid : [loss = 2.280, top1 = 42.00%], test : [loss = 2.246, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.96%], valid : [loss = 0.644, top1 = 77.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13133/15625) 013133-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.509, top1 = 88.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.320, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.75 ms.
cifar100       train : [loss = 0.356, top1 = 90.31%], valid : [loss = 1.280, top1 = 66.72%], test : [loss = 1.272, top1 = 67.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.50%], valid : [loss = 2.409, top1 = 38.47%], test : [loss = 2.424, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13134/15625) 013134-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.423, top1 = 89.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.87 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.291, top1 = 92.59%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.69 ms.
cifar100       train : [loss = 0.209, top1 = 95.06%], valid : [loss = 1.245, top1 = 69.08%], test : [loss = 1.248, top1 = 69.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 51.05%], valid : [loss = 2.238, top1 = 42.83%], test : [loss = 2.270, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.22%], valid : [loss = 0.516, top1 = 82.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13135/15625) 013135-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.35 ms.
cifar10-valid  train : [loss = 0.295, top1 = 89.95%], valid : [loss = 0.478, top1 = 84.28%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.54 ms.
cifar10        train : [loss = 0.268, top1 = 91.06%], test  : [loss = 0.367, top1 = 87.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.22 ms.
cifar100       train : [loss = 1.283, top1 = 64.13%], valid : [loss = 1.469, top1 = 59.07%], test : [loss = 1.462, top1 = 58.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.827, top1 = 30.37%], valid : [loss = 2.819, top1 = 30.25%], test : [loss = 2.856, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.58%], valid : [loss = 1.003, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13136/15625) 013136-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.12%], valid : [loss = 0.457, top1 = 86.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10        train : [loss = 0.116, top1 = 96.40%], test  : [loss = 0.321, top1 = 89.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.20 ms.
cifar100       train : [loss = 0.845, top1 = 76.00%], valid : [loss = 1.277, top1 = 64.10%], test : [loss = 1.275, top1 = 64.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.67%], valid : [loss = 2.616, top1 = 34.00%], test : [loss = 2.667, top1 = 34.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.34%], valid : [loss = 0.640, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13137/15625) 013137-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.26 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.531, top1 = 89.20%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.13 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.346, top1 = 92.82%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.51 ms.
cifar100       train : [loss = 0.055, top1 = 99.45%], valid : [loss = 1.397, top1 = 69.46%], test : [loss = 1.445, top1 = 68.42%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=25.72 ms.
ImageNet16-120 train : [loss = 1.639, top1 = 56.08%], valid : [loss = 2.430, top1 = 40.80%], test : [loss = 2.464, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.47%], valid : [loss = 0.647, top1 = 77.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13138/15625) 013138-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.01%], valid : [loss = 0.594, top1 = 80.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10        train : [loss = 0.330, top1 = 88.66%], test  : [loss = 0.455, top1 = 84.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.97 ms.
cifar100       train : [loss = 1.563, top1 = 56.47%], valid : [loss = 1.800, top1 = 52.16%], test : [loss = 1.801, top1 = 51.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.06%], valid : [loss = 2.932, top1 = 27.40%], test : [loss = 2.996, top1 = 27.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.35%], valid : [loss = 1.044, top1 = 62.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13139/15625) 013139-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.503, top1 = 88.95%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.65 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.316, top1 = 92.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.80 ms.
cifar100       train : [loss = 0.328, top1 = 91.02%], valid : [loss = 1.270, top1 = 67.49%], test : [loss = 1.300, top1 = 67.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.96%], valid : [loss = 2.428, top1 = 38.87%], test : [loss = 2.430, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.41%], valid : [loss = 0.652, top1 = 77.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13140/15625) 013140-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.18 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.25%], valid : [loss = 0.619, top1 = 85.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10        train : [loss = 0.065, top1 = 97.85%], test  : [loss = 0.406, top1 = 89.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.07 ms.
cifar100       train : [loss = 0.639, top1 = 80.96%], valid : [loss = 1.451, top1 = 63.12%], test : [loss = 1.411, top1 = 63.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.32%], valid : [loss = 2.650, top1 = 33.63%], test : [loss = 2.714, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.33%], valid : [loss = 0.775, top1 = 73.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13141/15625) 013141-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.16%], valid : [loss = 0.538, top1 = 83.83%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 0.198, top1 = 93.30%], test  : [loss = 0.395, top1 = 87.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 1.247, top1 = 64.51%], valid : [loss = 1.559, top1 = 57.67%], test : [loss = 1.543, top1 = 57.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.691, top1 = 32.72%], valid : [loss = 2.730, top1 = 32.17%], test : [loss = 2.762, top1 = 31.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13142/15625) 013142-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.502, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.336, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.38 ms.
cifar100       train : [loss = 0.333, top1 = 90.99%], valid : [loss = 1.280, top1 = 67.10%], test : [loss = 1.276, top1 = 67.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.94%], valid : [loss = 2.423, top1 = 38.47%], test : [loss = 2.390, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13143/15625) 013143-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 1.208, top1 = 56.66%], valid : [loss = 1.265, top1 = 54.97%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.31 ms.
cifar10        train : [loss = 1.176, top1 = 58.05%], test  : [loss = 1.179, top1 = 57.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.63 ms.
cifar100       train : [loss = 2.675, top1 = 32.87%], valid : [loss = 2.753, top1 = 31.54%], test : [loss = 2.747, top1 = 31.79%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.22 ms.
ImageNet16-120 train : [loss = 3.868, top1 = 12.40%], valid : [loss = 3.864, top1 = 13.37%], test : [loss = 3.882, top1 = 12.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.683, top1 = 36.77%], valid : [loss = 1.676, top1 = 36.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13144/15625) 013144-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.498, top1 = 88.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10        train : [loss = 0.021, top1 = 99.48%], test  : [loss = 0.337, top1 = 91.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.80 ms.
cifar100       train : [loss = 0.406, top1 = 88.35%], valid : [loss = 1.296, top1 = 66.91%], test : [loss = 1.306, top1 = 66.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.57%], valid : [loss = 2.399, top1 = 39.27%], test : [loss = 2.434, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.58%], valid : [loss = 0.640, top1 = 77.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13145/15625) 013145-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.481, top1 = 88.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.313, top1 = 92.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.12 ms.
cifar100       train : [loss = 0.320, top1 = 91.33%], valid : [loss = 1.228, top1 = 68.84%], test : [loss = 1.263, top1 = 67.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.046, top1 = 46.50%], valid : [loss = 2.319, top1 = 41.20%], test : [loss = 2.331, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13146/15625) 013146-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.588, top1 = 85.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.26 ms.
cifar10        train : [loss = 0.068, top1 = 97.89%], test  : [loss = 0.393, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.42 ms.
cifar100       train : [loss = 0.702, top1 = 79.50%], valid : [loss = 1.381, top1 = 63.56%], test : [loss = 1.364, top1 = 63.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.34%], valid : [loss = 2.639, top1 = 34.35%], test : [loss = 2.655, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.72%], valid : [loss = 0.769, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13147/15625) 013147-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.601, top1 = 86.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.031, top1 = 99.16%], test  : [loss = 0.384, top1 = 90.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.509, top1 = 85.15%], valid : [loss = 1.416, top1 = 64.16%], test : [loss = 1.378, top1 = 65.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.84%], valid : [loss = 2.556, top1 = 35.53%], test : [loss = 2.590, top1 = 35.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 73.80%], valid : [loss = 0.800, top1 = 71.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13148/15625) 013148-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.40%], valid : [loss = 0.869, top1 = 71.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.555, top1 = 80.53%], test  : [loss = 0.712, top1 = 75.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.53 ms.
cifar100       train : [loss = 1.774, top1 = 52.14%], valid : [loss = 2.061, top1 = 47.00%], test : [loss = 2.069, top1 = 46.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.82%], valid : [loss = 3.629, top1 = 16.47%], test : [loss = 3.660, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13149/15625) 013149-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.83%], valid : [loss = 0.577, top1 = 88.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.352, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.43 ms.
cifar100       train : [loss = 0.272, top1 = 92.30%], valid : [loss = 1.342, top1 = 67.38%], test : [loss = 1.363, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.54%], valid : [loss = 2.434, top1 = 38.43%], test : [loss = 2.418, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.08%], valid : [loss = 1.048, top1 = 62.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13150/15625) 013150-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.566, top1 = 88.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.81 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.372, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.19 ms.
cifar100       train : [loss = 0.125, top1 = 97.62%], valid : [loss = 1.455, top1 = 67.22%], test : [loss = 1.493, top1 = 67.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.96 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.17%], valid : [loss = 2.428, top1 = 39.60%], test : [loss = 2.418, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.62%], valid : [loss = 0.707, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13151/15625) 013151-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.212, top1 = 92.84%], valid : [loss = 0.546, top1 = 83.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.81 ms.
cifar10        train : [loss = 0.214, top1 = 92.63%], test  : [loss = 0.408, top1 = 86.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.47 ms.
cifar100       train : [loss = 1.270, top1 = 63.93%], valid : [loss = 1.579, top1 = 57.28%], test : [loss = 1.575, top1 = 56.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 31.72%], valid : [loss = 2.781, top1 = 31.00%], test : [loss = 2.799, top1 = 30.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 65.80%], valid : [loss = 0.992, top1 = 64.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13152/15625) 013152-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.32 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.95%], valid : [loss = 0.474, top1 = 85.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10        train : [loss = 0.166, top1 = 94.65%], test  : [loss = 0.358, top1 = 88.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.22 ms.
cifar100       train : [loss = 1.013, top1 = 71.42%], valid : [loss = 1.351, top1 = 62.16%], test : [loss = 1.342, top1 = 61.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.69%], valid : [loss = 2.676, top1 = 32.73%], test : [loss = 2.708, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.22%], valid : [loss = 0.782, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13153/15625) 013153-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.04%], valid : [loss = 0.476, top1 = 84.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 0.298, top1 = 90.04%], test  : [loss = 0.398, top1 = 86.59%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 1.334, top1 = 63.04%], valid : [loss = 1.544, top1 = 57.49%], test : [loss = 1.509, top1 = 58.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.64%], valid : [loss = 2.911, top1 = 28.93%], test : [loss = 2.966, top1 = 28.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13154/15625) 013154-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.76%], valid : [loss = 0.558, top1 = 82.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10        train : [loss = 0.258, top1 = 91.19%], test  : [loss = 0.388, top1 = 86.98%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.99 ms.
cifar100       train : [loss = 1.510, top1 = 57.86%], valid : [loss = 1.731, top1 = 52.56%], test : [loss = 1.780, top1 = 51.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 2.966, top1 = 27.27%], valid : [loss = 2.961, top1 = 27.80%], test : [loss = 3.037, top1 = 26.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.76%], valid : [loss = 1.016, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13155/15625) 013155-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.76%], valid : [loss = 0.614, top1 = 86.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10        train : [loss = 0.024, top1 = 99.35%], test  : [loss = 0.429, top1 = 90.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.33 ms.
cifar100       train : [loss = 0.351, top1 = 90.45%], valid : [loss = 1.591, top1 = 62.42%], test : [loss = 1.552, top1 = 62.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.40%], valid : [loss = 2.526, top1 = 36.37%], test : [loss = 2.566, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.87%], valid : [loss = 0.859, top1 = 69.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13156/15625) 013156-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.543, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.354, top1 = 91.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.24 ms.
cifar100       train : [loss = 0.292, top1 = 92.00%], valid : [loss = 1.293, top1 = 67.30%], test : [loss = 1.319, top1 = 66.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.54%], valid : [loss = 2.434, top1 = 38.10%], test : [loss = 2.460, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13157/15625) 013157-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.659, top1 = 86.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.420, top1 = 90.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.31 ms.
cifar100       train : [loss = 0.161, top1 = 96.53%], valid : [loss = 1.585, top1 = 65.60%], test : [loss = 1.573, top1 = 65.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 1.998, top1 = 47.56%], valid : [loss = 2.527, top1 = 36.83%], test : [loss = 2.509, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.76%], valid : [loss = 0.780, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13158/15625) 013158-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.90%], valid : [loss = 0.846, top1 = 72.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.41 ms.
cifar10        train : [loss = 0.548, top1 = 80.78%], test  : [loss = 0.715, top1 = 75.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.85 ms.
cifar100       train : [loss = 1.761, top1 = 52.48%], valid : [loss = 2.041, top1 = 46.98%], test : [loss = 2.039, top1 = 47.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.77 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.76%], valid : [loss = 3.636, top1 = 17.37%], test : [loss = 3.658, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13159/15625) 013159-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.13%], valid : [loss = 0.604, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10        train : [loss = 0.072, top1 = 97.78%], test  : [loss = 0.401, top1 = 89.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.70 ms.
cifar100       train : [loss = 0.719, top1 = 79.07%], valid : [loss = 1.395, top1 = 61.86%], test : [loss = 1.357, top1 = 63.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.91 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.60%], valid : [loss = 2.650, top1 = 34.20%], test : [loss = 2.703, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.24%], valid : [loss = 0.786, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13160/15625) 013160-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.429, top1 = 90.33%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.284, top1 = 93.23%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.40 ms.
cifar100       train : [loss = 0.152, top1 = 96.67%], valid : [loss = 1.297, top1 = 69.47%], test : [loss = 1.258, top1 = 70.20%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.17%], valid : [loss = 2.202, top1 = 43.68%], test : [loss = 2.255, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.386, top1 = 86.76%], valid : [loss = 0.503, top1 = 83.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13161/15625) 013161-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.38%], valid : [loss = 0.750, top1 = 74.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.38 ms.
cifar10        train : [loss = 0.527, top1 = 81.69%], test  : [loss = 0.602, top1 = 79.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 2.007, top1 = 45.74%], valid : [loss = 2.119, top1 = 43.61%], test : [loss = 2.127, top1 = 43.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.986, top1 = 26.90%], valid : [loss = 2.969, top1 = 27.24%], test : [loss = 3.016, top1 = 26.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.73%], valid : [loss = 1.201, top1 = 57.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13162/15625) 013162-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.511, top1 = 89.79%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.82 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.330, top1 = 92.96%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.58 ms.
cifar100       train : [loss = 0.064, top1 = 99.00%], valid : [loss = 1.353, top1 = 69.46%], test : [loss = 1.320, top1 = 70.80%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 1.676, top1 = 55.12%], valid : [loss = 2.230, top1 = 43.23%], test : [loss = 2.221, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.20%], valid : [loss = 0.624, top1 = 78.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13163/15625) 013163-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.24%], valid : [loss = 0.866, top1 = 71.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.79 ms.
cifar10        train : [loss = 0.555, top1 = 80.59%], test  : [loss = 0.709, top1 = 75.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.07 ms.
cifar100       train : [loss = 1.772, top1 = 52.19%], valid : [loss = 2.052, top1 = 46.67%], test : [loss = 2.060, top1 = 46.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.80%], valid : [loss = 3.641, top1 = 16.20%], test : [loss = 3.669, top1 = 16.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13164/15625) 013164-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.77%], valid : [loss = 0.740, top1 = 80.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.149, top1 = 95.10%], test  : [loss = 0.498, top1 = 85.85%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.46 ms.
cifar100       train : [loss = 0.967, top1 = 71.91%], valid : [loss = 1.644, top1 = 57.08%], test : [loss = 1.619, top1 = 57.66%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.40%], valid : [loss = 3.127, top1 = 24.77%], test : [loss = 3.161, top1 = 23.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13165/15625) 013165-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.10 ms.
cifar10-valid  train : [loss = 0.131, top1 = 95.92%], valid : [loss = 0.448, top1 = 86.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.31 ms.
cifar10        train : [loss = 0.151, top1 = 95.10%], test  : [loss = 0.348, top1 = 88.72%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.83 ms.
cifar100       train : [loss = 1.001, top1 = 71.57%], valid : [loss = 1.348, top1 = 61.88%], test : [loss = 1.359, top1 = 61.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.99 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.38%], valid : [loss = 2.715, top1 = 32.03%], test : [loss = 2.725, top1 = 32.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.30%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13166/15625) 013166-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 90.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.37 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.279, top1 = 93.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.34 ms.
cifar100       train : [loss = 0.066, top1 = 99.04%], valid : [loss = 1.340, top1 = 70.70%], test : [loss = 1.334, top1 = 70.70%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.73 ms.
ImageNet16-120 train : [loss = 1.544, top1 = 58.28%], valid : [loss = 2.226, top1 = 44.00%], test : [loss = 2.275, top1 = 43.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.352, top1 = 87.98%], valid : [loss = 0.497, top1 = 83.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13167/15625) 013167-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.16%], valid : [loss = 0.468, top1 = 85.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.165, top1 = 94.53%], test  : [loss = 0.344, top1 = 89.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.28 ms.
cifar100       train : [loss = 1.014, top1 = 70.98%], valid : [loss = 1.361, top1 = 61.46%], test : [loss = 1.358, top1 = 61.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.64%], valid : [loss = 2.695, top1 = 32.40%], test : [loss = 2.718, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.00%], valid : [loss = 0.792, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13168/15625) 013168-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.44%], valid : [loss = 0.886, top1 = 78.96%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.129, top1 = 95.71%], test  : [loss = 0.552, top1 = 83.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.94 ms.
cifar100       train : [loss = 0.868, top1 = 74.74%], valid : [loss = 1.715, top1 = 57.68%], test : [loss = 1.730, top1 = 56.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 3.028, top1 = 26.59%], valid : [loss = 3.164, top1 = 24.73%], test : [loss = 3.197, top1 = 23.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13169/15625) 013169-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.43 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.540, top1 = 88.74%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.331, top1 = 92.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.28 ms.
cifar100       train : [loss = 0.230, top1 = 94.20%], valid : [loss = 1.202, top1 = 68.90%], test : [loss = 1.220, top1 = 69.30%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 1.812, top1 = 51.76%], valid : [loss = 2.195, top1 = 43.93%], test : [loss = 2.211, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.43%], valid : [loss = 0.668, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13170/15625) 013170-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.45 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.93%], valid : [loss = 0.869, top1 = 71.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.89 ms.
cifar10        train : [loss = 0.560, top1 = 80.49%], test  : [loss = 0.715, top1 = 75.66%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.81 ms.
cifar100       train : [loss = 1.772, top1 = 52.32%], valid : [loss = 2.047, top1 = 46.74%], test : [loss = 2.065, top1 = 46.80%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.72%], valid : [loss = 3.636, top1 = 16.93%], test : [loss = 3.673, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13171/15625) 013171-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.412, top1 = 90.72%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.61 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.264, top1 = 93.53%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.84 ms.
cifar100       train : [loss = 0.118, top1 = 97.84%], valid : [loss = 1.215, top1 = 71.48%], test : [loss = 1.255, top1 = 70.52%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 1.629, top1 = 56.32%], valid : [loss = 2.155, top1 = 44.47%], test : [loss = 2.175, top1 = 44.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.12%], valid : [loss = 0.499, top1 = 82.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13172/15625) 013172-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.51%], valid : [loss = 0.461, top1 = 86.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.75 ms.
cifar10        train : [loss = 0.156, top1 = 94.99%], test  : [loss = 0.345, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.45 ms.
cifar100       train : [loss = 1.011, top1 = 71.37%], valid : [loss = 1.385, top1 = 61.92%], test : [loss = 1.356, top1 = 62.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.88%], valid : [loss = 2.668, top1 = 32.90%], test : [loss = 2.719, top1 = 32.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13173/15625) 013173-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.35%], valid : [loss = 0.602, top1 = 85.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10        train : [loss = 0.064, top1 = 98.08%], test  : [loss = 0.410, top1 = 88.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.63 ms.
cifar100       train : [loss = 0.716, top1 = 79.29%], valid : [loss = 1.397, top1 = 62.40%], test : [loss = 1.359, top1 = 63.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.14%], valid : [loss = 2.657, top1 = 33.23%], test : [loss = 2.688, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13174/15625) 013174-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.471, top1 = 89.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.318, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.44 ms.
cifar100       train : [loss = 0.320, top1 = 91.43%], valid : [loss = 1.237, top1 = 67.99%], test : [loss = 1.239, top1 = 68.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.54%], valid : [loss = 2.324, top1 = 40.76%], test : [loss = 2.344, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.20%], valid : [loss = 0.590, top1 = 79.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13175/15625) 013175-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.53%], valid : [loss = 0.448, top1 = 87.92%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.71 ms.
cifar10        train : [loss = 0.053, top1 = 98.73%], test  : [loss = 0.309, top1 = 90.84%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.29 ms.
cifar100       train : [loss = 0.554, top1 = 84.99%], valid : [loss = 1.223, top1 = 67.16%], test : [loss = 1.224, top1 = 67.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.08 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.88%], valid : [loss = 2.464, top1 = 37.90%], test : [loss = 2.460, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.29%], valid : [loss = 0.638, top1 = 77.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13176/15625) 013176-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.36 ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.64%], valid : [loss = 0.730, top1 = 75.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.63 ms.
cifar10        train : [loss = 0.485, top1 = 83.36%], test  : [loss = 0.564, top1 = 80.57%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.10 ms.
cifar100       train : [loss = 1.839, top1 = 50.14%], valid : [loss = 1.955, top1 = 47.51%], test : [loss = 1.943, top1 = 47.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.68 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.17%], valid : [loss = 2.998, top1 = 27.79%], test : [loss = 3.025, top1 = 26.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.169, top1 = 58.09%], valid : [loss = 1.203, top1 = 56.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13177/15625) 013177-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.476, top1 = 89.01%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.311, top1 = 92.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.16 ms.
cifar100       train : [loss = 0.350, top1 = 90.36%], valid : [loss = 1.314, top1 = 66.66%], test : [loss = 1.299, top1 = 66.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.58%], valid : [loss = 2.376, top1 = 39.37%], test : [loss = 2.402, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.08%], valid : [loss = 0.659, top1 = 77.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13178/15625) 013178-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.79%], valid : [loss = 0.546, top1 = 88.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.333, top1 = 91.83%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.90 ms.
cifar100       train : [loss = 0.272, top1 = 93.15%], valid : [loss = 1.378, top1 = 66.50%], test : [loss = 1.358, top1 = 66.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.83 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.21%], valid : [loss = 2.418, top1 = 38.20%], test : [loss = 2.414, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 67.02%], valid : [loss = 0.960, top1 = 65.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13179/15625) 013179-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.85 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.22 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13180/15625) 013180-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.546, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.67 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.331, top1 = 92.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.93 ms.
cifar100       train : [loss = 0.144, top1 = 96.71%], valid : [loss = 1.263, top1 = 69.72%], test : [loss = 1.247, top1 = 69.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 1.744, top1 = 53.41%], valid : [loss = 2.177, top1 = 44.33%], test : [loss = 2.191, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.55%], valid : [loss = 0.770, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13181/15625) 013181-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.73%], valid : [loss = 0.555, top1 = 85.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10        train : [loss = 0.108, top1 = 96.33%], test  : [loss = 0.379, top1 = 89.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 0.789, top1 = 76.81%], valid : [loss = 1.409, top1 = 62.32%], test : [loss = 1.398, top1 = 62.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 36.91%], valid : [loss = 2.601, top1 = 34.58%], test : [loss = 2.640, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.33%], valid : [loss = 0.909, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13182/15625) 013182-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.565, top1 = 87.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.23 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.374, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.392, top1 = 88.96%], valid : [loss = 1.379, top1 = 65.94%], test : [loss = 1.388, top1 = 65.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.250, top1 = 42.00%], valid : [loss = 2.452, top1 = 38.41%], test : [loss = 2.487, top1 = 37.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.04%], valid : [loss = 0.713, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13183/15625) 013183-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.74%], valid : [loss = 0.595, top1 = 81.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.251, top1 = 91.32%], test  : [loss = 0.408, top1 = 86.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 1.396, top1 = 60.73%], valid : [loss = 1.647, top1 = 55.04%], test : [loss = 1.654, top1 = 55.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.848, top1 = 29.57%], valid : [loss = 2.862, top1 = 29.37%], test : [loss = 2.874, top1 = 29.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.12%], valid : [loss = 0.995, top1 = 64.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13184/15625) 013184-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.61 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13185/15625) 013185-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.21%], valid : [loss = 0.460, top1 = 86.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.157, top1 = 94.95%], test  : [loss = 0.350, top1 = 88.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.57 ms.
cifar100       train : [loss = 0.983, top1 = 71.88%], valid : [loss = 1.340, top1 = 62.63%], test : [loss = 1.342, top1 = 62.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.66 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.77%], valid : [loss = 2.705, top1 = 32.47%], test : [loss = 2.709, top1 = 32.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13186/15625) 013186-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.230, top1 = 92.23%], valid : [loss = 0.508, top1 = 84.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.76 ms.
cifar10        train : [loss = 0.222, top1 = 92.48%], test  : [loss = 0.399, top1 = 87.19%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 1.362, top1 = 61.83%], valid : [loss = 1.638, top1 = 55.40%], test : [loss = 1.642, top1 = 55.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.853, top1 = 29.47%], valid : [loss = 2.877, top1 = 30.30%], test : [loss = 2.903, top1 = 29.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.973, top1 = 64.90%], valid : [loss = 1.010, top1 = 64.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13187/15625) 013187-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.18 ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.77%], valid : [loss = 0.651, top1 = 78.04%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10        train : [loss = 0.516, top1 = 82.17%], test  : [loss = 0.598, top1 = 79.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.73 ms.
cifar100       train : [loss = 1.669, top1 = 54.50%], valid : [loss = 1.844, top1 = 50.43%], test : [loss = 1.842, top1 = 50.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.99 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.42%], valid : [loss = 3.323, top1 = 21.38%], test : [loss = 3.343, top1 = 21.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13188/15625) 013188-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.540, top1 = 88.72%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.62 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.329, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.76 ms.
cifar100       train : [loss = 0.153, top1 = 96.27%], valid : [loss = 1.362, top1 = 68.30%], test : [loss = 1.394, top1 = 68.30%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.00%], valid : [loss = 2.364, top1 = 40.30%], test : [loss = 2.365, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.11%], valid : [loss = 0.846, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13189/15625) 013189-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.42%], valid : [loss = 0.945, top1 = 76.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 0.229, top1 = 92.13%], test  : [loss = 0.602, top1 = 81.58%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.27 ms.
cifar100       train : [loss = 1.153, top1 = 67.30%], valid : [loss = 1.773, top1 = 54.96%], test : [loss = 1.728, top1 = 55.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.66%], valid : [loss = 3.329, top1 = 21.57%], test : [loss = 3.393, top1 = 19.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.025, top1 = 63.36%], valid : [loss = 1.075, top1 = 61.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13190/15625) 013190-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.08 ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.26%], valid : [loss = 0.947, top1 = 67.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.796, top1 = 71.71%], test  : [loss = 0.844, top1 = 70.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.00 ms.
cifar100       train : [loss = 2.364, top1 = 38.11%], valid : [loss = 2.493, top1 = 35.66%], test : [loss = 2.461, top1 = 36.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.62 ms.
ImageNet16-120 train : [loss = 3.618, top1 = 15.84%], valid : [loss = 3.604, top1 = 16.83%], test : [loss = 3.623, top1 = 15.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.453, top1 = 46.95%], valid : [loss = 1.498, top1 = 44.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13191/15625) 013191-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.554, top1 = 87.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.38 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.346, top1 = 91.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.63 ms.
cifar100       train : [loss = 0.411, top1 = 88.27%], valid : [loss = 1.256, top1 = 66.28%], test : [loss = 1.272, top1 = 66.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.78 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.38%], valid : [loss = 2.398, top1 = 39.13%], test : [loss = 2.406, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.99%], valid : [loss = 0.808, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13192/15625) 013192-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.47%], valid : [loss = 0.528, top1 = 83.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.244, top1 = 91.67%], test  : [loss = 0.394, top1 = 87.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 1.328, top1 = 62.52%], valid : [loss = 1.582, top1 = 57.03%], test : [loss = 1.573, top1 = 57.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.857, top1 = 29.57%], valid : [loss = 2.862, top1 = 29.89%], test : [loss = 2.934, top1 = 28.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13193/15625) 013193-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.07 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.604, top1 = 86.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10        train : [loss = 0.023, top1 = 99.41%], test  : [loss = 0.393, top1 = 90.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.96 ms.
cifar100       train : [loss = 0.503, top1 = 85.25%], valid : [loss = 1.443, top1 = 63.26%], test : [loss = 1.439, top1 = 63.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.283, top1 = 41.31%], valid : [loss = 2.509, top1 = 36.60%], test : [loss = 2.533, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.29%], valid : [loss = 0.847, top1 = 70.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13194/15625) 013194-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.58 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.511, top1 = 89.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.318, top1 = 93.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.50 ms.
cifar100       train : [loss = 0.128, top1 = 97.08%], valid : [loss = 1.339, top1 = 68.86%], test : [loss = 1.345, top1 = 69.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.92%], valid : [loss = 2.196, top1 = 43.73%], test : [loss = 2.202, top1 = 44.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.01%], valid : [loss = 0.740, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13195/15625) 013195-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.26%], valid : [loss = 0.479, top1 = 84.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.302, top1 = 90.04%], test  : [loss = 0.391, top1 = 86.46%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.92 ms.
cifar100       train : [loss = 1.325, top1 = 63.23%], valid : [loss = 1.506, top1 = 59.30%], test : [loss = 1.520, top1 = 57.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.65%], valid : [loss = 2.873, top1 = 28.93%], test : [loss = 2.966, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13196/15625) 013196-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.33%], valid : [loss = 0.616, top1 = 85.36%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10        train : [loss = 0.070, top1 = 97.92%], test  : [loss = 0.411, top1 = 88.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.15 ms.
cifar100       train : [loss = 0.716, top1 = 79.31%], valid : [loss = 1.380, top1 = 63.02%], test : [loss = 1.368, top1 = 63.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 35.95%], valid : [loss = 2.653, top1 = 34.53%], test : [loss = 2.680, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13197/15625) 013197-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.566, top1 = 88.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.373, top1 = 91.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.13 ms.
cifar100       train : [loss = 0.174, top1 = 96.28%], valid : [loss = 1.429, top1 = 66.96%], test : [loss = 1.395, top1 = 67.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.74%], valid : [loss = 2.499, top1 = 38.17%], test : [loss = 2.464, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13198/15625) 013198-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.557, top1 = 88.97%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.28 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.378, top1 = 92.59%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.13 ms.
cifar100       train : [loss = 0.111, top1 = 97.75%], valid : [loss = 1.482, top1 = 67.86%], test : [loss = 1.489, top1 = 67.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.59%], valid : [loss = 2.443, top1 = 38.50%], test : [loss = 2.463, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.70%], valid : [loss = 0.698, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13199/15625) 013199-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.45 ms.
cifar10-valid  train : [loss = 1.258, top1 = 54.56%], valid : [loss = 1.304, top1 = 53.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10        train : [loss = 1.259, top1 = 54.87%], test  : [loss = 1.255, top1 = 54.95%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.49 ms.
cifar100       train : [loss = 2.732, top1 = 31.67%], valid : [loss = 2.826, top1 = 30.10%], test : [loss = 2.812, top1 = 30.96%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.18 ms.
ImageNet16-120 train : [loss = 3.908, top1 = 11.81%], valid : [loss = 3.904, top1 = 12.60%], test : [loss = 3.921, top1 = 12.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.736, top1 = 34.44%], valid : [loss = 1.737, top1 = 34.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13200/15625) 013200-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.40%], valid : [loss = 0.476, top1 = 85.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10        train : [loss = 0.155, top1 = 94.93%], test  : [loss = 0.352, top1 = 88.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.57 ms.
cifar100       train : [loss = 0.993, top1 = 71.79%], valid : [loss = 1.370, top1 = 61.45%], test : [loss = 1.359, top1 = 61.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.06%], valid : [loss = 2.670, top1 = 33.47%], test : [loss = 2.698, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13201/15625) 013201-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.76%], valid : [loss = 1.097, top1 = 63.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10        train : [loss = 0.789, top1 = 72.24%], test  : [loss = 0.920, top1 = 68.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 2.146, top1 = 43.68%], valid : [loss = 2.459, top1 = 38.68%], test : [loss = 2.449, top1 = 38.90%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.91 ms.
ImageNet16-120 train : [loss = 3.766, top1 = 13.81%], valid : [loss = 3.828, top1 = 13.23%], test : [loss = 3.834, top1 = 14.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.78%], valid : [loss = 1.412, top1 = 49.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13202/15625) 013202-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.47%], valid : [loss = 0.829, top1 = 76.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10        train : [loss = 0.316, top1 = 88.97%], test  : [loss = 0.618, top1 = 80.57%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 1.399, top1 = 60.85%], valid : [loss = 1.982, top1 = 49.30%], test : [loss = 1.959, top1 = 49.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 3.476, top1 = 17.57%], valid : [loss = 3.507, top1 = 17.03%], test : [loss = 3.515, top1 = 16.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13203/15625) 013203-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.519, top1 = 88.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.51 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.319, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.90 ms.
cifar100       train : [loss = 0.332, top1 = 90.92%], valid : [loss = 1.267, top1 = 67.30%], test : [loss = 1.297, top1 = 66.76%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.41%], valid : [loss = 2.406, top1 = 38.77%], test : [loss = 2.409, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13204/15625) 013204-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.39%], valid : [loss = 0.675, top1 = 84.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.052, top1 = 98.43%], test  : [loss = 0.454, top1 = 88.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.635, top1 = 81.40%], valid : [loss = 1.511, top1 = 61.18%], test : [loss = 1.480, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.16%], valid : [loss = 2.844, top1 = 30.16%], test : [loss = 2.882, top1 = 29.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.19%], valid : [loss = 0.858, top1 = 69.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13205/15625) 013205-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.44%], valid : [loss = 0.567, top1 = 87.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10        train : [loss = 0.036, top1 = 98.87%], test  : [loss = 0.362, top1 = 90.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.50 ms.
cifar100       train : [loss = 0.459, top1 = 86.43%], valid : [loss = 1.255, top1 = 67.16%], test : [loss = 1.296, top1 = 67.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.60 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.05%], valid : [loss = 2.444, top1 = 37.10%], test : [loss = 2.434, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.57%], valid : [loss = 0.906, top1 = 67.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13206/15625) 013206-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.585, top1 = 87.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.394, top1 = 90.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.38 ms.
cifar100       train : [loss = 0.387, top1 = 89.10%], valid : [loss = 1.388, top1 = 65.48%], test : [loss = 1.410, top1 = 65.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.25%], valid : [loss = 2.507, top1 = 37.57%], test : [loss = 2.531, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13207/15625) 013207-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.08%], valid : [loss = 0.617, top1 = 85.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.71 ms.
cifar10        train : [loss = 0.046, top1 = 98.57%], test  : [loss = 0.401, top1 = 89.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.10 ms.
cifar100       train : [loss = 0.647, top1 = 80.84%], valid : [loss = 1.478, top1 = 61.98%], test : [loss = 1.454, top1 = 60.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.52 ms.
ImageNet16-120 train : [loss = 2.364, top1 = 39.32%], valid : [loss = 2.577, top1 = 35.13%], test : [loss = 2.572, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.62%], valid : [loss = 0.902, top1 = 68.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13208/15625) 013208-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.22%], valid : [loss = 0.526, top1 = 87.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.039, top1 = 98.79%], test  : [loss = 0.366, top1 = 90.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 0.469, top1 = 86.09%], valid : [loss = 1.297, top1 = 66.28%], test : [loss = 1.314, top1 = 65.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 32.98%], valid : [loss = 2.727, top1 = 31.93%], test : [loss = 2.719, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.53%], valid : [loss = 1.001, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13209/15625) 013209-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.96%], valid : [loss = 0.952, top1 = 76.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10        train : [loss = 0.206, top1 = 92.91%], test  : [loss = 0.602, top1 = 81.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.29 ms.
cifar100       train : [loss = 1.189, top1 = 66.12%], valid : [loss = 1.826, top1 = 53.36%], test : [loss = 1.800, top1 = 53.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 3.230, top1 = 22.58%], valid : [loss = 3.339, top1 = 22.10%], test : [loss = 3.352, top1 = 21.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.68%], valid : [loss = 1.091, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13210/15625) 013210-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.51 ms.
cifar10-valid  train : [loss = 0.965, top1 = 66.17%], valid : [loss = 1.005, top1 = 65.10%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.21 ms.
cifar10        train : [loss = 0.909, top1 = 68.51%], test  : [loss = 0.914, top1 = 67.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.70 ms.
cifar100       train : [loss = 2.378, top1 = 39.22%], valid : [loss = 2.446, top1 = 37.09%], test : [loss = 2.433, top1 = 37.97%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.79 ms.
ImageNet16-120 train : [loss = 3.642, top1 = 15.76%], valid : [loss = 3.610, top1 = 17.03%], test : [loss = 3.639, top1 = 16.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.610, top1 = 39.64%], valid : [loss = 1.669, top1 = 36.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13211/15625) 013211-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.67 ms.
cifar10-valid  train : [loss = 0.233, top1 = 92.09%], valid : [loss = 0.511, top1 = 84.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.241, top1 = 91.80%], test  : [loss = 0.394, top1 = 87.09%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 1.376, top1 = 61.38%], valid : [loss = 1.662, top1 = 55.05%], test : [loss = 1.630, top1 = 55.47%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.859, top1 = 29.46%], valid : [loss = 2.873, top1 = 29.20%], test : [loss = 2.935, top1 = 28.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.959, top1 = 65.78%], valid : [loss = 0.984, top1 = 65.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13212/15625) 013212-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.52%], valid : [loss = 0.866, top1 = 72.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10        train : [loss = 0.551, top1 = 80.82%], test  : [loss = 0.708, top1 = 75.62%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.16 ms.
cifar100       train : [loss = 1.770, top1 = 52.08%], valid : [loss = 2.048, top1 = 47.02%], test : [loss = 2.073, top1 = 46.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.91%], valid : [loss = 3.638, top1 = 16.43%], test : [loss = 3.670, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.198, top1 = 56.35%], valid : [loss = 1.263, top1 = 54.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13213/15625) 013213-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.504, top1 = 88.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.341, top1 = 91.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 0.337, top1 = 90.89%], valid : [loss = 1.238, top1 = 68.10%], test : [loss = 1.277, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.79%], valid : [loss = 2.403, top1 = 39.70%], test : [loss = 2.414, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13214/15625) 013214-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.499, top1 = 89.35%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.271, top1 = 93.38%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.62 ms.
cifar100       train : [loss = 0.251, top1 = 93.49%], valid : [loss = 1.218, top1 = 68.82%], test : [loss = 1.238, top1 = 68.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 1.905, top1 = 49.64%], valid : [loss = 2.239, top1 = 42.50%], test : [loss = 2.244, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.58%], valid : [loss = 0.634, top1 = 78.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13215/15625) 013215-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.65%], valid : [loss = 0.461, top1 = 86.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.150, top1 = 95.11%], test  : [loss = 0.342, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.63 ms.
cifar100       train : [loss = 0.979, top1 = 72.12%], valid : [loss = 1.339, top1 = 62.31%], test : [loss = 1.339, top1 = 62.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.31%], valid : [loss = 2.664, top1 = 33.60%], test : [loss = 2.694, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13216/15625) 013216-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.15%], valid : [loss = 0.461, top1 = 86.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.163, top1 = 94.70%], test  : [loss = 0.362, top1 = 88.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.43 ms.
cifar100       train : [loss = 0.995, top1 = 71.55%], valid : [loss = 1.348, top1 = 62.44%], test : [loss = 1.356, top1 = 62.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.78%], valid : [loss = 2.689, top1 = 32.43%], test : [loss = 2.720, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13217/15625) 013217-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.551, top1 = 88.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.85 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.346, top1 = 91.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.49 ms.
cifar100       train : [loss = 0.401, top1 = 88.56%], valid : [loss = 1.283, top1 = 66.92%], test : [loss = 1.263, top1 = 66.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.77 ms.
ImageNet16-120 train : [loss = 2.219, top1 = 42.66%], valid : [loss = 2.433, top1 = 36.60%], test : [loss = 2.442, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.96%], valid : [loss = 0.848, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13218/15625) 013218-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.490, top1 = 88.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.40 ms.
cifar10        train : [loss = 0.028, top1 = 99.23%], test  : [loss = 0.353, top1 = 91.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.08 ms.
cifar100       train : [loss = 0.466, top1 = 86.35%], valid : [loss = 1.383, top1 = 65.04%], test : [loss = 1.322, top1 = 66.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.54%], valid : [loss = 2.567, top1 = 34.83%], test : [loss = 2.586, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.28%], valid : [loss = 0.679, top1 = 76.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13219/15625) 013219-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.622, top1 = 86.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.032, top1 = 99.14%], test  : [loss = 0.401, top1 = 90.37%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.541, top1 = 84.17%], valid : [loss = 1.407, top1 = 64.16%], test : [loss = 1.388, top1 = 63.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.373, top1 = 39.31%], valid : [loss = 2.558, top1 = 35.53%], test : [loss = 2.588, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.39%], valid : [loss = 0.876, top1 = 69.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13220/15625) 013220-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.68%], valid : [loss = 0.540, top1 = 87.80%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.53 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.354, top1 = 91.91%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.28 ms.
cifar100       train : [loss = 0.265, top1 = 92.56%], valid : [loss = 1.383, top1 = 66.68%], test : [loss = 1.370, top1 = 66.90%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.34 ms.
ImageNet16-120 train : [loss = 2.530, top1 = 35.52%], valid : [loss = 2.653, top1 = 32.27%], test : [loss = 2.632, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.25%], valid : [loss = 0.998, top1 = 64.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13221/15625) 013221-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.38%], valid : [loss = 0.637, top1 = 85.72%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.81 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.394, top1 = 90.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.29 ms.
cifar100       train : [loss = 0.519, top1 = 84.93%], valid : [loss = 1.394, top1 = 64.78%], test : [loss = 1.419, top1 = 64.02%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.319, top1 = 40.48%], valid : [loss = 2.528, top1 = 36.13%], test : [loss = 2.536, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.10%], valid : [loss = 0.873, top1 = 69.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13222/15625) 013222-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.133, top1 = 95.98%], valid : [loss = 0.464, top1 = 85.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.167, top1 = 94.55%], test  : [loss = 0.342, top1 = 88.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 1.007, top1 = 71.27%], valid : [loss = 1.375, top1 = 61.82%], test : [loss = 1.372, top1 = 60.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.83%], valid : [loss = 2.692, top1 = 32.83%], test : [loss = 2.717, top1 = 31.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 73.14%], valid : [loss = 0.801, top1 = 71.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13223/15625) 013223-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.466, top1 = 89.23%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=19.22 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.312, top1 = 92.14%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=18.67 ms.
cifar100       train : [loss = 0.255, top1 = 93.49%], valid : [loss = 1.233, top1 = 68.80%], test : [loss = 1.248, top1 = 68.95%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.39%], valid : [loss = 2.262, top1 = 41.62%], test : [loss = 2.269, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.69%], valid : [loss = 0.619, top1 = 79.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13224/15625) 013224-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.461, top1 = 89.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.90%], test  : [loss = 0.315, top1 = 92.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.172, top1 = 96.19%], valid : [loss = 1.337, top1 = 68.92%], test : [loss = 1.329, top1 = 68.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.70 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.59%], valid : [loss = 2.262, top1 = 42.40%], test : [loss = 2.324, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.411, top1 = 85.72%], valid : [loss = 0.535, top1 = 82.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13225/15625) 013225-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.454, top1 = 89.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.92 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.294, top1 = 93.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.38 ms.
cifar100       train : [loss = 0.120, top1 = 97.76%], valid : [loss = 1.273, top1 = 70.00%], test : [loss = 1.277, top1 = 69.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.38 ms.
ImageNet16-120 train : [loss = 1.691, top1 = 54.70%], valid : [loss = 2.167, top1 = 44.23%], test : [loss = 2.179, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.492, top1 = 83.26%], valid : [loss = 0.599, top1 = 79.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13226/15625) 013226-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.88%], valid : [loss = 0.520, top1 = 89.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10        train : [loss = 0.007, top1 = 99.82%], test  : [loss = 0.325, top1 = 92.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.96 ms.
cifar100       train : [loss = 0.143, top1 = 96.51%], valid : [loss = 1.291, top1 = 69.64%], test : [loss = 1.338, top1 = 69.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 52.98%], valid : [loss = 2.194, top1 = 44.17%], test : [loss = 2.207, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.93%], valid : [loss = 0.709, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13227/15625) 013227-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.82%], valid : [loss = 0.551, top1 = 86.98%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.39 ms.
cifar10        train : [loss = 0.063, top1 = 97.92%], test  : [loss = 0.377, top1 = 89.92%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.92 ms.
cifar100       train : [loss = 0.585, top1 = 82.87%], valid : [loss = 1.292, top1 = 65.84%], test : [loss = 1.289, top1 = 65.52%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.70%], valid : [loss = 2.420, top1 = 38.27%], test : [loss = 2.422, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.18%], valid : [loss = 0.815, top1 = 71.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13228/15625) 013228-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.18%], valid : [loss = 0.647, top1 = 81.42%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.193, top1 = 93.46%], test  : [loss = 0.464, top1 = 85.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.41 ms.
cifar100       train : [loss = 0.948, top1 = 72.45%], valid : [loss = 1.569, top1 = 57.56%], test : [loss = 1.568, top1 = 59.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 2.938, top1 = 28.00%], valid : [loss = 3.005, top1 = 26.27%], test : [loss = 3.018, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.025, top1 = 63.50%], valid : [loss = 1.074, top1 = 61.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13229/15625) 013229-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.42%], valid : [loss = 0.603, top1 = 86.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10        train : [loss = 0.049, top1 = 98.39%], test  : [loss = 0.402, top1 = 89.54%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.48 ms.
cifar100       train : [loss = 0.545, top1 = 84.10%], valid : [loss = 1.423, top1 = 63.80%], test : [loss = 1.383, top1 = 64.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.218, top1 = 42.57%], valid : [loss = 2.448, top1 = 37.70%], test : [loss = 2.474, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 71.08%], valid : [loss = 0.848, top1 = 69.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13230/15625) 013230-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.741, top1 = 84.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.027, top1 = 99.24%], test  : [loss = 0.459, top1 = 88.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.56 ms.
cifar100       train : [loss = 0.342, top1 = 90.77%], valid : [loss = 1.541, top1 = 63.58%], test : [loss = 1.596, top1 = 62.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.238, top1 = 42.33%], valid : [loss = 2.608, top1 = 35.30%], test : [loss = 2.664, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.13%], valid : [loss = 0.845, top1 = 70.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13231/15625) 013231-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.90%], valid : [loss = 0.609, top1 = 84.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10        train : [loss = 0.080, top1 = 97.37%], test  : [loss = 0.426, top1 = 88.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.95 ms.
cifar100       train : [loss = 0.734, top1 = 78.49%], valid : [loss = 1.570, top1 = 59.22%], test : [loss = 1.585, top1 = 59.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 3.168, top1 = 22.65%], valid : [loss = 3.176, top1 = 23.60%], test : [loss = 3.207, top1 = 22.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.061, top1 = 61.75%], valid : [loss = 1.088, top1 = 61.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13232/15625) 013232-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.630, top1 = 87.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.52 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.433, top1 = 91.16%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.30 ms.
cifar100       train : [loss = 0.168, top1 = 96.32%], valid : [loss = 1.535, top1 = 65.08%], test : [loss = 1.505, top1 = 66.08%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.36 ms.
ImageNet16-120 train : [loss = 2.012, top1 = 47.37%], valid : [loss = 2.457, top1 = 38.50%], test : [loss = 2.489, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.14%], valid : [loss = 0.814, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13233/15625) 013233-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.53 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.86 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13234/15625) 013234-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.500, top1 = 89.84%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.44 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.311, top1 = 93.21%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.58 ms.
cifar100       train : [loss = 0.074, top1 = 98.83%], valid : [loss = 1.374, top1 = 69.06%], test : [loss = 1.315, top1 = 70.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.570, top1 = 57.56%], valid : [loss = 2.161, top1 = 44.60%], test : [loss = 2.184, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.35%], valid : [loss = 0.597, top1 = 79.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13235/15625) 013235-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.24 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.527, top1 = 88.26%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.351, top1 = 91.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.61 ms.
cifar100       train : [loss = 0.339, top1 = 90.72%], valid : [loss = 1.292, top1 = 67.18%], test : [loss = 1.278, top1 = 66.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.61%], valid : [loss = 2.450, top1 = 37.20%], test : [loss = 2.453, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.20%], valid : [loss = 0.834, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13236/15625) 013236-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.095, top1 = 96.82%], valid : [loss = 0.610, top1 = 84.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.69 ms.
cifar10        train : [loss = 0.071, top1 = 97.66%], test  : [loss = 0.409, top1 = 88.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.06 ms.
cifar100       train : [loss = 0.562, top1 = 83.44%], valid : [loss = 1.592, top1 = 61.06%], test : [loss = 1.586, top1 = 60.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 3.204, top1 = 22.07%], valid : [loss = 3.234, top1 = 21.20%], test : [loss = 3.249, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 57.88%], valid : [loss = 1.166, top1 = 57.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13237/15625) 013237-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.503, top1 = 89.47%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.301, top1 = 92.98%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.19 ms.
cifar100       train : [loss = 0.127, top1 = 97.62%], valid : [loss = 1.301, top1 = 69.00%], test : [loss = 1.285, top1 = 69.64%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.94 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.20%], valid : [loss = 2.177, top1 = 44.00%], test : [loss = 2.167, top1 = 45.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.87%], valid : [loss = 0.634, top1 = 78.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13238/15625) 013238-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.32%], valid : [loss = 0.598, top1 = 85.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.13 ms.
cifar10        train : [loss = 0.074, top1 = 97.66%], test  : [loss = 0.394, top1 = 88.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.05 ms.
cifar100       train : [loss = 0.720, top1 = 79.08%], valid : [loss = 1.377, top1 = 63.94%], test : [loss = 1.358, top1 = 63.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.72%], valid : [loss = 2.674, top1 = 33.33%], test : [loss = 2.702, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.24%], valid : [loss = 0.786, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13239/15625) 013239-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.434, top1 = 90.36%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.292, top1 = 93.31%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.96 ms.
cifar100       train : [loss = 0.176, top1 = 96.07%], valid : [loss = 1.239, top1 = 69.80%], test : [loss = 1.275, top1 = 69.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.89 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.57%], valid : [loss = 2.257, top1 = 42.20%], test : [loss = 2.271, top1 = 42.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.19%], valid : [loss = 0.503, top1 = 83.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13240/15625) 013240-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.34%], valid : [loss = 0.465, top1 = 86.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10        train : [loss = 0.161, top1 = 94.71%], test  : [loss = 0.358, top1 = 88.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.40 ms.
cifar100       train : [loss = 0.971, top1 = 72.33%], valid : [loss = 1.331, top1 = 62.90%], test : [loss = 1.342, top1 = 62.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.67%], valid : [loss = 2.686, top1 = 33.03%], test : [loss = 2.704, top1 = 33.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13241/15625) 013241-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.522, top1 = 89.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.357, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.74 ms.
cifar100       train : [loss = 0.283, top1 = 92.45%], valid : [loss = 1.290, top1 = 67.44%], test : [loss = 1.290, top1 = 67.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.26%], valid : [loss = 2.368, top1 = 39.13%], test : [loss = 2.408, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 72.02%], valid : [loss = 0.831, top1 = 70.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13242/15625) 013242-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.631, top1 = 87.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.408, top1 = 91.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.188, top1 = 95.51%], valid : [loss = 1.595, top1 = 64.58%], test : [loss = 1.572, top1 = 65.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.48%], valid : [loss = 2.469, top1 = 37.43%], test : [loss = 2.490, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.12%], valid : [loss = 0.825, top1 = 71.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13243/15625) 013243-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.130, top1 = 95.96%], valid : [loss = 0.460, top1 = 86.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10        train : [loss = 0.159, top1 = 94.92%], test  : [loss = 0.341, top1 = 88.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 1.009, top1 = 71.11%], valid : [loss = 1.364, top1 = 62.42%], test : [loss = 1.346, top1 = 62.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.660, top1 = 33.30%], valid : [loss = 2.729, top1 = 31.77%], test : [loss = 2.737, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13244/15625) 013244-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.538, top1 = 89.20%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.74 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.357, top1 = 92.81%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.22 ms.
cifar100       train : [loss = 0.105, top1 = 98.19%], valid : [loss = 1.475, top1 = 67.26%], test : [loss = 1.459, top1 = 67.78%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.54%], valid : [loss = 2.428, top1 = 39.33%], test : [loss = 2.435, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.06%], valid : [loss = 0.728, top1 = 74.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13245/15625) 013245-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.067, top1 = 97.95%], valid : [loss = 0.537, top1 = 86.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10        train : [loss = 0.093, top1 = 96.94%], test  : [loss = 0.393, top1 = 88.93%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=17.54 ms.
cifar100       train : [loss = 0.894, top1 = 73.87%], valid : [loss = 1.477, top1 = 60.70%], test : [loss = 1.452, top1 = 60.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.469, top1 = 37.07%], valid : [loss = 2.619, top1 = 34.50%], test : [loss = 2.644, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.83%], valid : [loss = 0.929, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13246/15625) 013246-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.44%], valid : [loss = 0.533, top1 = 85.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.184, top1 = 93.84%], test  : [loss = 0.382, top1 = 87.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.28 ms.
cifar100       train : [loss = 1.002, top1 = 70.89%], valid : [loss = 1.422, top1 = 60.78%], test : [loss = 1.405, top1 = 61.52%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.59%], valid : [loss = 2.786, top1 = 30.60%], test : [loss = 2.860, top1 = 30.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 65.02%], valid : [loss = 1.029, top1 = 63.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13247/15625) 013247-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.481, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.82%], test  : [loss = 0.299, top1 = 92.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.320, top1 = 91.23%], valid : [loss = 1.257, top1 = 67.46%], test : [loss = 1.250, top1 = 68.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.70%], valid : [loss = 2.297, top1 = 41.10%], test : [loss = 2.347, top1 = 40.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13248/15625) 013248-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.77%], valid : [loss = 0.534, top1 = 84.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.184, top1 = 93.81%], test  : [loss = 0.394, top1 = 87.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 1.173, top1 = 66.55%], valid : [loss = 1.496, top1 = 59.22%], test : [loss = 1.489, top1 = 59.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.73%], valid : [loss = 2.688, top1 = 32.64%], test : [loss = 2.732, top1 = 32.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.926, top1 = 66.68%], valid : [loss = 0.982, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13249/15625) 013249-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.473, top1 = 89.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.39 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.305, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.24 ms.
cifar100       train : [loss = 0.318, top1 = 91.51%], valid : [loss = 1.248, top1 = 67.51%], test : [loss = 1.273, top1 = 67.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.70%], valid : [loss = 2.315, top1 = 40.87%], test : [loss = 2.360, top1 = 40.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 82.96%], valid : [loss = 0.575, top1 = 80.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13250/15625) 013250-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.51%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.43 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.308, top1 = 93.42%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.06 ms.
cifar100       train : [loss = 0.071, top1 = 98.99%], valid : [loss = 1.327, top1 = 69.68%], test : [loss = 1.323, top1 = 69.92%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 1.757, top1 = 53.28%], valid : [loss = 2.252, top1 = 43.43%], test : [loss = 2.226, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.60%], valid : [loss = 0.768, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13251/15625) 013251-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.465, top1 = 89.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.78 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.305, top1 = 92.51%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.94 ms.
cifar100       train : [loss = 0.321, top1 = 91.53%], valid : [loss = 1.277, top1 = 67.26%], test : [loss = 1.248, top1 = 67.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.34%], valid : [loss = 2.296, top1 = 41.20%], test : [loss = 2.297, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.96%], valid : [loss = 0.610, top1 = 79.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13252/15625) 013252-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.554, top1 = 88.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.349, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 0.290, top1 = 91.90%], valid : [loss = 1.287, top1 = 67.28%], test : [loss = 1.340, top1 = 67.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.28%], valid : [loss = 2.421, top1 = 37.77%], test : [loss = 2.424, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13253/15625) 013253-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.87%], valid : [loss = 0.646, top1 = 84.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.051, top1 = 98.40%], test  : [loss = 0.410, top1 = 89.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.87 ms.
cifar100       train : [loss = 0.742, top1 = 78.07%], valid : [loss = 1.495, top1 = 60.98%], test : [loss = 1.548, top1 = 60.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.19%], valid : [loss = 2.568, top1 = 35.27%], test : [loss = 2.620, top1 = 35.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 69.98%], valid : [loss = 0.888, top1 = 68.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13254/15625) 013254-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.571, top1 = 87.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.358, top1 = 91.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.43 ms.
cifar100       train : [loss = 0.404, top1 = 88.49%], valid : [loss = 1.377, top1 = 64.94%], test : [loss = 1.400, top1 = 65.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.77%], valid : [loss = 2.486, top1 = 38.03%], test : [loss = 2.490, top1 = 37.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.64%], valid : [loss = 0.764, top1 = 73.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13255/15625) 013255-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.58%], valid : [loss = 0.468, top1 = 86.46%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.69 ms.
cifar10        train : [loss = 0.117, top1 = 96.24%], test  : [loss = 0.342, top1 = 89.11%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.46 ms.
cifar100       train : [loss = 0.744, top1 = 79.19%], valid : [loss = 1.289, top1 = 64.76%], test : [loss = 1.298, top1 = 64.26%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 37.00%], valid : [loss = 2.585, top1 = 35.13%], test : [loss = 2.592, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.41%], valid : [loss = 0.845, top1 = 70.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13256/15625) 013256-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.545, top1 = 89.31%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.379, top1 = 92.48%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.42 ms.
cifar100       train : [loss = 0.104, top1 = 98.12%], valid : [loss = 1.470, top1 = 68.38%], test : [loss = 1.438, top1 = 68.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 1.881, top1 = 50.34%], valid : [loss = 2.446, top1 = 38.67%], test : [loss = 2.432, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13257/15625) 013257-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.21 ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.20%], valid : [loss = 0.848, top1 = 72.14%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10        train : [loss = 0.570, top1 = 80.09%], test  : [loss = 0.722, top1 = 75.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.70 ms.
cifar100       train : [loss = 1.783, top1 = 52.12%], valid : [loss = 2.039, top1 = 47.50%], test : [loss = 2.063, top1 = 47.42%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.43 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.77%], valid : [loss = 3.636, top1 = 16.90%], test : [loss = 3.665, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.195, top1 = 56.96%], valid : [loss = 1.251, top1 = 55.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13258/15625) 013258-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.10%], valid : [loss = 0.485, top1 = 84.27%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 0.304, top1 = 89.93%], test  : [loss = 0.404, top1 = 86.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.49 ms.
cifar100       train : [loss = 1.329, top1 = 63.02%], valid : [loss = 1.534, top1 = 57.72%], test : [loss = 1.507, top1 = 58.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.68%], valid : [loss = 2.895, top1 = 29.57%], test : [loss = 2.951, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13259/15625) 013259-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.66%], valid : [loss = 0.479, top1 = 86.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.097, top1 = 96.78%], test  : [loss = 0.351, top1 = 89.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.692, top1 = 79.97%], valid : [loss = 1.239, top1 = 66.34%], test : [loss = 1.204, top1 = 66.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.39%], valid : [loss = 2.447, top1 = 38.20%], test : [loss = 2.491, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.02%], valid : [loss = 0.954, top1 = 65.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13260/15625) 013260-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.29%], valid : [loss = 0.843, top1 = 72.26%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10        train : [loss = 0.560, top1 = 80.28%], test  : [loss = 0.711, top1 = 75.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.35 ms.
cifar100       train : [loss = 1.782, top1 = 52.09%], valid : [loss = 2.055, top1 = 46.43%], test : [loss = 2.061, top1 = 46.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.37 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.80%], valid : [loss = 3.645, top1 = 16.43%], test : [loss = 3.674, top1 = 15.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13261/15625) 013261-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.477, top1 = 89.15%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.66 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.310, top1 = 92.18%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.62 ms.
cifar100       train : [loss = 0.238, top1 = 94.24%], valid : [loss = 1.244, top1 = 68.47%], test : [loss = 1.253, top1 = 68.60%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.57 ms.
ImageNet16-120 train : [loss = 1.902, top1 = 49.83%], valid : [loss = 2.235, top1 = 42.60%], test : [loss = 2.233, top1 = 42.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.53%], valid : [loss = 0.593, top1 = 79.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13262/15625) 013262-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.623, top1 = 87.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.413, top1 = 90.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.82 ms.
cifar100       train : [loss = 0.221, top1 = 94.36%], valid : [loss = 1.515, top1 = 65.48%], test : [loss = 1.521, top1 = 65.49%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.92%], valid : [loss = 2.498, top1 = 36.90%], test : [loss = 2.497, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.32%], valid : [loss = 0.771, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13263/15625) 013263-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.33%], valid : [loss = 0.621, top1 = 85.33%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10        train : [loss = 0.066, top1 = 97.96%], test  : [loss = 0.423, top1 = 88.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.88 ms.
cifar100       train : [loss = 0.685, top1 = 80.01%], valid : [loss = 1.404, top1 = 63.26%], test : [loss = 1.394, top1 = 63.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.86%], valid : [loss = 2.656, top1 = 33.66%], test : [loss = 2.710, top1 = 33.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.60%], valid : [loss = 0.810, top1 = 71.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13264/15625) 013264-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.433, top1 = 89.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.302, top1 = 92.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.214, top1 = 94.84%], valid : [loss = 1.288, top1 = 68.76%], test : [loss = 1.271, top1 = 69.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.70%], valid : [loss = 2.252, top1 = 42.51%], test : [loss = 2.297, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13265/15625) 013265-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.540, top1 = 88.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.352, top1 = 91.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 0.297, top1 = 91.63%], valid : [loss = 1.327, top1 = 67.17%], test : [loss = 1.325, top1 = 67.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.00%], valid : [loss = 2.426, top1 = 38.20%], test : [loss = 2.441, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13266/15625) 013266-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.566, top1 = 87.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10        train : [loss = 0.034, top1 = 98.97%], test  : [loss = 0.363, top1 = 90.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 0.548, top1 = 84.14%], valid : [loss = 1.373, top1 = 64.18%], test : [loss = 1.367, top1 = 64.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.594, top1 = 34.13%], valid : [loss = 2.665, top1 = 32.49%], test : [loss = 2.691, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13267/15625) 013267-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.80%], valid : [loss = 0.854, top1 = 70.90%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10        train : [loss = 0.688, top1 = 75.83%], test  : [loss = 0.774, top1 = 73.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.45 ms.
cifar100       train : [loss = 1.975, top1 = 47.51%], valid : [loss = 2.140, top1 = 44.61%], test : [loss = 2.166, top1 = 44.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.73%], valid : [loss = 3.673, top1 = 15.42%], test : [loss = 3.691, top1 = 15.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.69%], valid : [loss = 1.407, top1 = 49.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13268/15625) 013268-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.56 ms.
cifar10-valid  train : [loss = 0.100, top1 = 96.94%], valid : [loss = 0.863, top1 = 79.01%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.15 ms.
cifar10        train : [loss = 0.143, top1 = 95.18%], test  : [loss = 0.508, top1 = 85.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.63 ms.
cifar100       train : [loss = 1.001, top1 = 71.22%], valid : [loss = 1.667, top1 = 55.53%], test : [loss = 1.654, top1 = 56.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.39%], valid : [loss = 3.047, top1 = 26.23%], test : [loss = 3.091, top1 = 26.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.54%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13269/15625) 013269-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.34 ms.
cifar10-valid  train : [loss = 1.140, top1 = 59.29%], valid : [loss = 1.185, top1 = 58.05%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.40 ms.
cifar10        train : [loss = 1.049, top1 = 63.01%], test  : [loss = 1.051, top1 = 62.57%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.03 ms.
cifar100       train : [loss = 2.569, top1 = 34.98%], valid : [loss = 2.640, top1 = 33.91%], test : [loss = 2.624, top1 = 34.37%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.25 ms.
ImageNet16-120 train : [loss = 3.783, top1 = 13.68%], valid : [loss = 3.768, top1 = 14.56%], test : [loss = 3.785, top1 = 14.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.638, top1 = 38.93%], valid : [loss = 1.699, top1 = 35.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13270/15625) 013270-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.31%], valid : [loss = 0.901, top1 = 68.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.733, top1 = 73.99%], test  : [loss = 0.784, top1 = 72.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 2.343, top1 = 38.62%], valid : [loss = 2.471, top1 = 36.61%], test : [loss = 2.458, top1 = 36.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 3.552, top1 = 17.10%], valid : [loss = 3.545, top1 = 17.93%], test : [loss = 3.565, top1 = 16.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.450, top1 = 46.60%], valid : [loss = 1.500, top1 = 44.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13271/15625) 013271-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.02 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.69%], valid : [loss = 0.524, top1 = 88.41%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.98 ms.
cifar10        train : [loss = 0.029, top1 = 99.17%], test  : [loss = 0.346, top1 = 91.47%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.99 ms.
cifar100       train : [loss = 0.458, top1 = 86.60%], valid : [loss = 1.255, top1 = 67.11%], test : [loss = 1.273, top1 = 66.79%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.78 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.44%], valid : [loss = 2.377, top1 = 39.79%], test : [loss = 2.390, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.83%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13272/15625) 013272-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.80%], valid : [loss = 0.852, top1 = 72.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10        train : [loss = 0.552, top1 = 80.78%], test  : [loss = 0.710, top1 = 75.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.07 ms.
cifar100       train : [loss = 1.771, top1 = 52.24%], valid : [loss = 2.048, top1 = 47.39%], test : [loss = 2.059, top1 = 46.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.93%], valid : [loss = 3.635, top1 = 16.38%], test : [loss = 3.665, top1 = 15.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13273/15625) 013273-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.89%], valid : [loss = 0.553, top1 = 88.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.012, top1 = 99.69%], test  : [loss = 0.347, top1 = 92.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.83 ms.
cifar100       train : [loss = 0.227, top1 = 94.08%], valid : [loss = 1.310, top1 = 68.35%], test : [loss = 1.297, top1 = 68.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.03%], valid : [loss = 2.234, top1 = 42.26%], test : [loss = 2.252, top1 = 42.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.98%], valid : [loss = 0.836, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13274/15625) 013274-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.95%], valid : [loss = 0.526, top1 = 86.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.073, top1 = 97.62%], test  : [loss = 0.353, top1 = 90.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.13 ms.
cifar100       train : [loss = 0.711, top1 = 79.11%], valid : [loss = 1.372, top1 = 64.12%], test : [loss = 1.341, top1 = 64.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.14%], valid : [loss = 2.640, top1 = 34.18%], test : [loss = 2.685, top1 = 32.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.93%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13275/15625) 013275-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.90%], valid : [loss = 0.459, top1 = 86.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10        train : [loss = 0.154, top1 = 95.02%], test  : [loss = 0.340, top1 = 89.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.974, top1 = 72.20%], valid : [loss = 1.338, top1 = 62.78%], test : [loss = 1.338, top1 = 62.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.64%], valid : [loss = 2.689, top1 = 32.55%], test : [loss = 2.705, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.28%], valid : [loss = 0.791, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13276/15625) 013276-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.529, top1 = 88.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 0.348, top1 = 90.50%], valid : [loss = 1.281, top1 = 67.20%], test : [loss = 1.296, top1 = 66.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.14 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.84%], valid : [loss = 2.395, top1 = 39.11%], test : [loss = 2.422, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13277/15625) 013277-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.509, top1 = 89.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.19 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.318, top1 = 92.97%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.97 ms.
cifar100       train : [loss = 0.126, top1 = 97.31%], valid : [loss = 1.288, top1 = 70.04%], test : [loss = 1.292, top1 = 69.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.50 ms.
ImageNet16-120 train : [loss = 1.894, top1 = 50.03%], valid : [loss = 2.220, top1 = 42.50%], test : [loss = 2.232, top1 = 43.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.61%], valid : [loss = 0.774, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13278/15625) 013278-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.61 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13279/15625) 013279-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.48 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.510, top1 = 89.83%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.70 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.314, top1 = 93.34%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.66 ms.
cifar100       train : [loss = 0.072, top1 = 98.87%], valid : [loss = 1.366, top1 = 69.25%], test : [loss = 1.376, top1 = 69.43%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.67%], valid : [loss = 2.370, top1 = 39.92%], test : [loss = 2.363, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.27%], valid : [loss = 0.704, top1 = 75.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13280/15625) 013280-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.567, top1 = 87.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.388, top1 = 91.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.18 ms.
cifar100       train : [loss = 0.396, top1 = 88.78%], valid : [loss = 1.409, top1 = 65.34%], test : [loss = 1.399, top1 = 65.25%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.81%], valid : [loss = 2.519, top1 = 36.38%], test : [loss = 2.542, top1 = 36.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13281/15625) 013281-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.20 ms.
cifar10-valid  train : [loss = 1.709, top1 = 37.16%], valid : [loss = 1.733, top1 = 36.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.67 ms.
cifar10        train : [loss = 1.313, top1 = 52.28%], test  : [loss = 1.324, top1 = 51.78%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.49 ms.
cifar100       train : [loss = 3.860, top1 = 10.75%], valid : [loss = 3.917, top1 = 10.08%], test : [loss = 3.915, top1 = 10.54%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 3.943, top1 = 11.23%], valid : [loss = 3.938, top1 = 11.67%], test : [loss = 3.953, top1 = 11.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.969, top1 = 27.11%], valid : [loss = 1.968, top1 = 27.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13282/15625) 013282-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.566, top1 = 88.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.24 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.394, top1 = 91.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.92 ms.
cifar100       train : [loss = 0.178, top1 = 96.05%], valid : [loss = 1.456, top1 = 66.38%], test : [loss = 1.445, top1 = 66.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.54%], valid : [loss = 2.434, top1 = 38.93%], test : [loss = 2.466, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.26%], valid : [loss = 0.753, top1 = 73.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13283/15625) 013283-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.59%], valid : [loss = 0.625, top1 = 83.45%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.74 ms.
cifar10        train : [loss = 0.153, top1 = 94.82%], test  : [loss = 0.456, top1 = 86.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.20 ms.
cifar100       train : [loss = 0.990, top1 = 71.30%], valid : [loss = 1.674, top1 = 56.69%], test : [loss = 1.678, top1 = 56.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 3.093, top1 = 24.54%], valid : [loss = 3.151, top1 = 24.58%], test : [loss = 3.186, top1 = 23.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.66%], valid : [loss = 0.986, top1 = 65.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13284/15625) 013284-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.452, top1 = 89.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.316, top1 = 91.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.328, top1 = 91.15%], valid : [loss = 1.320, top1 = 66.81%], test : [loss = 1.327, top1 = 66.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.08 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.26%], valid : [loss = 2.391, top1 = 39.88%], test : [loss = 2.398, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13285/15625) 013285-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.73%], valid : [loss = 0.600, top1 = 87.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.019, top1 = 99.46%], test  : [loss = 0.377, top1 = 91.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.61 ms.
cifar100       train : [loss = 0.384, top1 = 89.15%], valid : [loss = 1.493, top1 = 63.49%], test : [loss = 1.475, top1 = 63.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 32.65%], valid : [loss = 2.733, top1 = 30.87%], test : [loss = 2.748, top1 = 30.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.33%], valid : [loss = 1.063, top1 = 61.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13286/15625) 013286-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.13 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13287/15625) 013287-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.24%], valid : [loss = 0.462, top1 = 86.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.48 ms.
cifar10        train : [loss = 0.115, top1 = 96.42%], test  : [loss = 0.330, top1 = 89.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.37 ms.
cifar100       train : [loss = 0.857, top1 = 75.64%], valid : [loss = 1.280, top1 = 64.35%], test : [loss = 1.277, top1 = 63.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.89%], valid : [loss = 2.612, top1 = 34.66%], test : [loss = 2.653, top1 = 33.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.90%], valid : [loss = 0.648, top1 = 77.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13288/15625) 013288-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.35 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.47%], valid : [loss = 0.622, top1 = 86.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.33 ms.
cifar10        train : [loss = 0.034, top1 = 99.07%], test  : [loss = 0.410, top1 = 89.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.43 ms.
cifar100       train : [loss = 0.549, top1 = 83.95%], valid : [loss = 1.445, top1 = 63.27%], test : [loss = 1.464, top1 = 62.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.48%], valid : [loss = 2.559, top1 = 35.55%], test : [loss = 2.584, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.849, top1 = 69.64%], valid : [loss = 0.895, top1 = 68.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13289/15625) 013289-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.61 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.574, top1 = 87.02%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.82 ms.
cifar10        train : [loss = 0.024, top1 = 99.46%], test  : [loss = 0.423, top1 = 89.78%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.39 ms.
cifar100       train : [loss = 0.327, top1 = 91.45%], valid : [loss = 1.370, top1 = 65.95%], test : [loss = 1.353, top1 = 65.96%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.09%], valid : [loss = 2.506, top1 = 36.67%], test : [loss = 2.512, top1 = 37.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.12%], valid : [loss = 0.776, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13290/15625) 013290-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.685, top1 = 85.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.033, top1 = 99.07%], test  : [loss = 0.445, top1 = 89.38%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.32 ms.
cifar100       train : [loss = 0.393, top1 = 89.12%], valid : [loss = 1.477, top1 = 63.53%], test : [loss = 1.458, top1 = 64.13%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.57%], valid : [loss = 2.639, top1 = 34.02%], test : [loss = 2.648, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.10%], valid : [loss = 0.783, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13291/15625) 013291-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.435, top1 = 90.60%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.283, top1 = 93.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.73 ms.
cifar100       train : [loss = 0.121, top1 = 97.50%], valid : [loss = 1.275, top1 = 70.36%], test : [loss = 1.271, top1 = 70.48%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 1.667, top1 = 55.35%], valid : [loss = 2.187, top1 = 44.83%], test : [loss = 2.205, top1 = 44.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.364, top1 = 87.60%], valid : [loss = 0.498, top1 = 83.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13292/15625) 013292-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.500, top1 = 88.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.81 ms.
cifar100       train : [loss = 0.316, top1 = 91.52%], valid : [loss = 1.245, top1 = 68.04%], test : [loss = 1.260, top1 = 67.87%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.45%], valid : [loss = 2.310, top1 = 40.68%], test : [loss = 2.335, top1 = 41.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.93%], valid : [loss = 0.656, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13293/15625) 013293-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.569, top1 = 87.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.387, top1 = 91.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.76 ms.
cifar100       train : [loss = 0.395, top1 = 88.72%], valid : [loss = 1.397, top1 = 64.92%], test : [loss = 1.391, top1 = 65.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.91%], valid : [loss = 2.514, top1 = 37.13%], test : [loss = 2.524, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13294/15625) 013294-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.77%], valid : [loss = 0.630, top1 = 84.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10        train : [loss = 0.086, top1 = 97.20%], test  : [loss = 0.397, top1 = 88.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.82 ms.
cifar100       train : [loss = 0.784, top1 = 77.13%], valid : [loss = 1.432, top1 = 61.83%], test : [loss = 1.408, top1 = 62.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.27%], valid : [loss = 2.728, top1 = 32.19%], test : [loss = 2.751, top1 = 31.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13295/15625) 013295-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.481, top1 = 89.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.22 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.334, top1 = 93.09%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.39 ms.
cifar100       train : [loss = 0.069, top1 = 98.89%], valid : [loss = 1.450, top1 = 68.83%], test : [loss = 1.416, top1 = 69.17%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.643, top1 = 55.86%], valid : [loss = 2.344, top1 = 41.92%], test : [loss = 2.358, top1 = 41.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.45%], valid : [loss = 0.622, top1 = 78.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13296/15625) 013296-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.63%], valid : [loss = 0.575, top1 = 87.25%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.60 ms.
cifar10        train : [loss = 0.040, top1 = 98.83%], test  : [loss = 0.385, top1 = 90.47%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.73 ms.
cifar100       train : [loss = 0.449, top1 = 87.10%], valid : [loss = 1.286, top1 = 66.74%], test : [loss = 1.282, top1 = 66.49%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.23%], valid : [loss = 2.364, top1 = 39.97%], test : [loss = 2.385, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 74.71%], valid : [loss = 0.787, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13297/15625) 013297-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.519, top1 = 88.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.350, top1 = 91.73%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.366, top1 = 89.95%], valid : [loss = 1.274, top1 = 67.15%], test : [loss = 1.297, top1 = 66.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.69%], valid : [loss = 2.407, top1 = 39.10%], test : [loss = 2.396, top1 = 39.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13298/15625) 013298-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.31%], valid : [loss = 0.627, top1 = 85.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10        train : [loss = 0.043, top1 = 98.73%], test  : [loss = 0.396, top1 = 89.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.11 ms.
cifar100       train : [loss = 0.551, top1 = 83.93%], valid : [loss = 1.431, top1 = 63.25%], test : [loss = 1.447, top1 = 62.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.19%], valid : [loss = 2.528, top1 = 36.03%], test : [loss = 2.554, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.40%], valid : [loss = 0.934, top1 = 66.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13299/15625) 013299-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.514, top1 = 88.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10        train : [loss = 0.029, top1 = 99.19%], test  : [loss = 0.359, top1 = 90.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.14 ms.
cifar100       train : [loss = 0.476, top1 = 86.08%], valid : [loss = 1.329, top1 = 65.91%], test : [loss = 1.345, top1 = 65.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.37%], valid : [loss = 2.511, top1 = 37.22%], test : [loss = 2.547, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13300/15625) 013300-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.554, top1 = 88.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.365, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.123, top1 = 97.66%], valid : [loss = 1.458, top1 = 67.47%], test : [loss = 1.469, top1 = 67.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.94%], valid : [loss = 2.480, top1 = 38.12%], test : [loss = 2.480, top1 = 38.85%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.68%], valid : [loss = 0.755, top1 = 74.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13301/15625) 013301-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.514, top1 = 89.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.23 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.314, top1 = 93.32%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.95 ms.
cifar100       train : [loss = 0.073, top1 = 98.88%], valid : [loss = 1.329, top1 = 69.34%], test : [loss = 1.351, top1 = 69.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.83 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.20%], valid : [loss = 2.372, top1 = 39.17%], test : [loss = 2.362, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13302/15625) 013302-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.579, top1 = 88.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.384, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.10 ms.
cifar100       train : [loss = 0.111, top1 = 97.73%], valid : [loss = 1.551, top1 = 66.53%], test : [loss = 1.553, top1 = 66.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.45%], valid : [loss = 2.411, top1 = 39.27%], test : [loss = 2.437, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.88%], valid : [loss = 0.736, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13303/15625) 013303-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.67%], valid : [loss = 0.524, top1 = 84.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.135, top1 = 95.69%], test  : [loss = 0.378, top1 = 88.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.88 ms.
cifar100       train : [loss = 0.958, top1 = 72.28%], valid : [loss = 1.390, top1 = 61.96%], test : [loss = 1.383, top1 = 61.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.404, top1 = 38.75%], valid : [loss = 2.522, top1 = 36.44%], test : [loss = 2.556, top1 = 36.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.45%], valid : [loss = 0.908, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13304/15625) 013304-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.88%], valid : [loss = 0.504, top1 = 85.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.172, top1 = 94.20%], test  : [loss = 0.376, top1 = 88.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.52 ms.
cifar100       train : [loss = 1.086, top1 = 68.86%], valid : [loss = 1.431, top1 = 60.61%], test : [loss = 1.433, top1 = 60.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.16 ms.
ImageNet16-120 train : [loss = 2.600, top1 = 34.80%], valid : [loss = 2.650, top1 = 34.12%], test : [loss = 2.670, top1 = 33.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.50%], valid : [loss = 0.940, top1 = 66.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13305/15625) 013305-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.48%], valid : [loss = 0.457, top1 = 86.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10        train : [loss = 0.154, top1 = 94.97%], test  : [loss = 0.342, top1 = 88.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 0.992, top1 = 71.74%], valid : [loss = 1.351, top1 = 61.94%], test : [loss = 1.334, top1 = 61.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.72%], valid : [loss = 2.710, top1 = 32.30%], test : [loss = 2.710, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13306/15625) 013306-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.592, top1 = 87.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.382, top1 = 91.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.418, top1 = 88.03%], valid : [loss = 1.419, top1 = 64.79%], test : [loss = 1.379, top1 = 65.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.73%], valid : [loss = 2.516, top1 = 36.05%], test : [loss = 2.506, top1 = 37.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.25%], valid : [loss = 0.819, top1 = 71.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13307/15625) 013307-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.40 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.51%], valid : [loss = 0.584, top1 = 86.91%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=20.01 ms.
cifar10        train : [loss = 0.040, top1 = 98.78%], test  : [loss = 0.388, top1 = 90.09%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.58 ms.
cifar100       train : [loss = 0.462, top1 = 86.54%], valid : [loss = 1.317, top1 = 66.10%], test : [loss = 1.315, top1 = 66.08%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.73%], valid : [loss = 2.423, top1 = 39.02%], test : [loss = 2.449, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.86%], valid : [loss = 0.844, top1 = 70.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13308/15625) 013308-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.522, top1 = 89.38%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.78 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.338, top1 = 92.66%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.57 ms.
cifar100       train : [loss = 0.135, top1 = 97.11%], valid : [loss = 1.321, top1 = 69.06%], test : [loss = 1.329, top1 = 69.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.36 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.84%], valid : [loss = 2.235, top1 = 42.68%], test : [loss = 2.225, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.85%], valid : [loss = 0.723, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13309/15625) 013309-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.47%], valid : [loss = 0.617, top1 = 86.11%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10        train : [loss = 0.045, top1 = 98.68%], test  : [loss = 0.405, top1 = 89.58%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 0.553, top1 = 83.86%], valid : [loss = 1.429, top1 = 63.32%], test : [loss = 1.427, top1 = 63.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.95%], valid : [loss = 2.555, top1 = 36.07%], test : [loss = 2.603, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.70%], valid : [loss = 0.880, top1 = 69.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13310/15625) 013310-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.546, top1 = 88.19%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.51 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.360, top1 = 91.41%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.70 ms.
cifar100       train : [loss = 0.429, top1 = 87.60%], valid : [loss = 1.235, top1 = 67.66%], test : [loss = 1.241, top1 = 67.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 2.191, top1 = 43.27%], valid : [loss = 2.364, top1 = 39.83%], test : [loss = 2.386, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.51%], valid : [loss = 0.801, top1 = 71.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13311/15625) 013311-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.81%], valid : [loss = 0.628, top1 = 84.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10        train : [loss = 0.090, top1 = 97.13%], test  : [loss = 0.407, top1 = 88.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.796, top1 = 76.64%], valid : [loss = 1.442, top1 = 61.73%], test : [loss = 1.405, top1 = 62.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.43%], valid : [loss = 2.719, top1 = 32.65%], test : [loss = 2.761, top1 = 31.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.51%], valid : [loss = 0.850, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13312/15625) 013312-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.320, top1 = 91.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.96 ms.
cifar100       train : [loss = 0.323, top1 = 91.27%], valid : [loss = 1.306, top1 = 66.81%], test : [loss = 1.321, top1 = 66.90%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.23%], valid : [loss = 2.370, top1 = 39.93%], test : [loss = 2.416, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13313/15625) 013313-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.40%], valid : [loss = 0.464, top1 = 85.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.158, top1 = 94.86%], test  : [loss = 0.344, top1 = 88.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 0.987, top1 = 71.84%], valid : [loss = 1.354, top1 = 62.32%], test : [loss = 1.353, top1 = 61.77%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.82%], valid : [loss = 2.695, top1 = 33.02%], test : [loss = 2.717, top1 = 32.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13314/15625) 013314-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.34 ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.64%], valid : [loss = 1.019, top1 = 67.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.68 ms.
cifar10        train : [loss = 0.589, top1 = 79.34%], test  : [loss = 0.840, top1 = 72.15%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.53 ms.
cifar100       train : [loss = 1.857, top1 = 49.94%], valid : [loss = 2.372, top1 = 40.12%], test : [loss = 2.360, top1 = 40.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 3.811, top1 = 12.20%], valid : [loss = 3.815, top1 = 12.72%], test : [loss = 3.828, top1 = 12.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.369, top1 = 49.79%], valid : [loss = 1.431, top1 = 48.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13315/15625) 013315-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.616, top1 = 87.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.414, top1 = 91.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.98 ms.
cifar100       train : [loss = 0.163, top1 = 96.43%], valid : [loss = 1.472, top1 = 67.28%], test : [loss = 1.498, top1 = 66.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.16%], valid : [loss = 2.481, top1 = 37.87%], test : [loss = 2.492, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.84%], valid : [loss = 0.788, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13316/15625) 013316-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.481, top1 = 89.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.324, top1 = 92.11%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.04 ms.
cifar100       train : [loss = 0.291, top1 = 92.29%], valid : [loss = 1.182, top1 = 69.22%], test : [loss = 1.222, top1 = 68.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 1.937, top1 = 48.83%], valid : [loss = 2.253, top1 = 42.47%], test : [loss = 2.269, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.32%], valid : [loss = 0.649, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13317/15625) 013317-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.455, top1 = 89.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.49 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.297, top1 = 92.78%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.30 ms.
cifar100       train : [loss = 0.255, top1 = 93.46%], valid : [loss = 1.220, top1 = 68.76%], test : [loss = 1.210, top1 = 69.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.94%], valid : [loss = 2.212, top1 = 42.67%], test : [loss = 2.230, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13318/15625) 013318-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.640, top1 = 87.65%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.451, top1 = 90.60%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.72 ms.
cifar100       train : [loss = 0.118, top1 = 97.80%], valid : [loss = 1.586, top1 = 64.96%], test : [loss = 1.558, top1 = 66.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.36%], valid : [loss = 2.614, top1 = 35.67%], test : [loss = 2.609, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.20%], valid : [loss = 0.753, top1 = 73.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13319/15625) 013319-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.492, top1 = 89.07%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.16 ms.
cifar10        train : [loss = 0.015, top1 = 99.70%], test  : [loss = 0.286, top1 = 92.74%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.61 ms.
cifar100       train : [loss = 0.265, top1 = 93.31%], valid : [loss = 1.201, top1 = 68.34%], test : [loss = 1.174, top1 = 69.06%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.99%], valid : [loss = 2.210, top1 = 43.17%], test : [loss = 2.226, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.18%], valid : [loss = 0.640, top1 = 78.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13320/15625) 013320-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.40%], valid : [loss = 0.448, top1 = 86.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.78 ms.
cifar10        train : [loss = 0.150, top1 = 95.06%], test  : [loss = 0.331, top1 = 89.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.55 ms.
cifar100       train : [loss = 0.990, top1 = 71.74%], valid : [loss = 1.341, top1 = 61.46%], test : [loss = 1.349, top1 = 63.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.81%], valid : [loss = 2.667, top1 = 33.00%], test : [loss = 2.705, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13321/15625) 013321-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.94%], valid : [loss = 0.465, top1 = 84.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10        train : [loss = 0.300, top1 = 89.84%], test  : [loss = 0.397, top1 = 86.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.92 ms.
cifar100       train : [loss = 1.330, top1 = 63.07%], valid : [loss = 1.535, top1 = 57.94%], test : [loss = 1.501, top1 = 57.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.67 ms.
ImageNet16-120 train : [loss = 2.940, top1 = 28.23%], valid : [loss = 2.902, top1 = 29.40%], test : [loss = 2.987, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.64%], valid : [loss = 0.725, top1 = 74.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13322/15625) 013322-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.50%], valid : [loss = 0.854, top1 = 79.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10        train : [loss = 0.131, top1 = 95.60%], test  : [loss = 0.540, top1 = 85.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.47 ms.
cifar100       train : [loss = 0.827, top1 = 75.85%], valid : [loss = 1.715, top1 = 56.86%], test : [loss = 1.701, top1 = 57.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 3.031, top1 = 26.60%], valid : [loss = 3.173, top1 = 24.17%], test : [loss = 3.207, top1 = 24.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13323/15625) 013323-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=22.09 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.488, top1 = 89.48%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=21.67 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.296, top1 = 92.92%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=19.27 ms.
cifar100       train : [loss = 0.114, top1 = 97.95%], valid : [loss = 1.250, top1 = 70.32%], test : [loss = 1.233, top1 = 70.46%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=22.26 ms.
ImageNet16-120 train : [loss = 1.748, top1 = 53.58%], valid : [loss = 2.214, top1 = 44.23%], test : [loss = 2.256, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.48%], valid : [loss = 0.696, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13324/15625) 013324-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.60 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.12 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13325/15625) 013325-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.424, top1 = 91.06%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.03 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.285, top1 = 93.86%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.81 ms.
cifar100       train : [loss = 0.057, top1 = 99.25%], valid : [loss = 1.331, top1 = 70.71%], test : [loss = 1.324, top1 = 70.69%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.503, top1 = 59.24%], valid : [loss = 2.228, top1 = 44.48%], test : [loss = 2.262, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.349, top1 = 88.10%], valid : [loss = 0.482, top1 = 84.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13326/15625) 013326-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=141.48 M, Params=0.992 MB, latency=21.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.63%]
cifar10        FLOP=141.48 M, Params=0.992 MB, latency=21.57 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.323, top1 = 93.10%]
cifar100       FLOP=141.48 M, Params=0.998 MB, latency=20.71 ms.
cifar100       train : [loss = 0.069, top1 = 98.95%], valid : [loss = 1.368, top1 = 69.25%], test : [loss = 1.353, top1 = 70.39%]
ImageNet16-120 FLOP= 35.38 M, Params=1.000 MB, latency=22.54 ms.
ImageNet16-120 train : [loss = 1.761, top1 = 53.02%], valid : [loss = 2.285, top1 = 42.80%], test : [loss = 2.257, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.32%], valid : [loss = 0.635, top1 = 78.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13327/15625) 013327-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.47%], valid : [loss = 0.456, top1 = 86.29%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.45 ms.
cifar10        train : [loss = 0.159, top1 = 94.86%], test  : [loss = 0.352, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.47 ms.
cifar100       train : [loss = 1.030, top1 = 70.62%], valid : [loss = 1.374, top1 = 61.28%], test : [loss = 1.374, top1 = 61.74%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.84 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.75%], valid : [loss = 2.663, top1 = 33.60%], test : [loss = 2.697, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13328/15625) 013328-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.449, top1 = 89.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.317, top1 = 92.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.74 ms.
cifar100       train : [loss = 0.316, top1 = 91.57%], valid : [loss = 1.305, top1 = 67.09%], test : [loss = 1.292, top1 = 67.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.29%], valid : [loss = 2.367, top1 = 40.06%], test : [loss = 2.396, top1 = 38.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 84.24%], valid : [loss = 0.560, top1 = 80.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13329/15625) 013329-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.21%], valid : [loss = 0.464, top1 = 85.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.162, top1 = 94.67%], test  : [loss = 0.352, top1 = 88.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 1.026, top1 = 70.91%], valid : [loss = 1.376, top1 = 61.57%], test : [loss = 1.372, top1 = 61.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.49%], valid : [loss = 2.711, top1 = 32.36%], test : [loss = 2.729, top1 = 31.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13330/15625) 013330-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.423, top1 = 90.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.299, top1 = 92.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.82 ms.
cifar100       train : [loss = 0.118, top1 = 97.70%], valid : [loss = 1.327, top1 = 69.64%], test : [loss = 1.330, top1 = 69.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 1.695, top1 = 54.65%], valid : [loss = 2.237, top1 = 43.06%], test : [loss = 2.257, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.427, top1 = 85.14%], valid : [loss = 0.552, top1 = 81.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13331/15625) 013331-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.06%], valid : [loss = 0.596, top1 = 85.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10        train : [loss = 0.071, top1 = 97.82%], test  : [loss = 0.402, top1 = 88.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.11 ms.
cifar100       train : [loss = 0.717, top1 = 79.31%], valid : [loss = 1.391, top1 = 62.72%], test : [loss = 1.366, top1 = 63.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.74 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.80%], valid : [loss = 2.673, top1 = 32.57%], test : [loss = 2.688, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.51%], valid : [loss = 0.816, top1 = 71.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13332/15625) 013332-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.794, top1 = 72.02%], valid : [loss = 0.962, top1 = 67.02%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10        train : [loss = 0.797, top1 = 71.93%], test  : [loss = 0.882, top1 = 69.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.84 ms.
cifar100       train : [loss = 2.143, top1 = 43.96%], valid : [loss = 2.329, top1 = 41.22%], test : [loss = 2.349, top1 = 40.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.14 ms.
ImageNet16-120 train : [loss = 3.752, top1 = 14.04%], valid : [loss = 3.775, top1 = 15.03%], test : [loss = 3.779, top1 = 13.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.454, top1 = 46.72%], valid : [loss = 1.494, top1 = 45.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13333/15625) 013333-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.24%], valid : [loss = 0.736, top1 = 83.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.29 ms.
cifar10        train : [loss = 0.048, top1 = 98.62%], test  : [loss = 0.471, top1 = 88.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.67 ms.
cifar100       train : [loss = 0.640, top1 = 81.35%], valid : [loss = 1.537, top1 = 60.86%], test : [loss = 1.483, top1 = 61.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.701, top1 = 32.68%], valid : [loss = 2.870, top1 = 30.47%], test : [loss = 2.910, top1 = 29.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.34%], valid : [loss = 0.885, top1 = 68.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13334/15625) 013334-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10-valid  train : [loss = 1.852, top1 = 32.96%], valid : [loss = 1.863, top1 = 32.47%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10        train : [loss = 1.316, top1 = 52.37%], test  : [loss = 1.334, top1 = 51.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.16 ms.
cifar100       train : [loss = 3.909, top1 = 9.84%], valid : [loss = 3.908, top1 = 9.88%], test : [loss = 3.908, top1 = 10.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.31 ms.
ImageNet16-120 train : [loss = 3.947, top1 = 11.27%], valid : [loss = 3.923, top1 = 11.97%], test : [loss = 3.946, top1 = 11.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.969, top1 = 27.11%], valid : [loss = 1.968, top1 = 27.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13335/15625) 013335-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.59 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.494, top1 = 88.90%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.43 ms.
cifar10        train : [loss = 0.018, top1 = 99.58%], test  : [loss = 0.351, top1 = 91.35%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.59 ms.
cifar100       train : [loss = 0.314, top1 = 91.62%], valid : [loss = 1.266, top1 = 67.64%], test : [loss = 1.274, top1 = 67.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.79 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.82%], valid : [loss = 2.230, top1 = 43.17%], test : [loss = 2.229, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.64%], valid : [loss = 0.746, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13336/15625) 013336-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.512, top1 = 89.64%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.10 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.307, top1 = 93.29%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.54 ms.
cifar100       train : [loss = 0.117, top1 = 97.72%], valid : [loss = 1.318, top1 = 69.34%], test : [loss = 1.317, top1 = 69.36%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.84 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.97%], valid : [loss = 2.276, top1 = 42.27%], test : [loss = 2.264, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.20%], valid : [loss = 0.696, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13337/15625) 013337-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.43%], valid : [loss = 0.546, top1 = 83.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.22 ms.
cifar10        train : [loss = 0.212, top1 = 92.86%], test  : [loss = 0.403, top1 = 87.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.16 ms.
cifar100       train : [loss = 1.228, top1 = 64.96%], valid : [loss = 1.530, top1 = 57.98%], test : [loss = 1.538, top1 = 58.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.12%], valid : [loss = 2.737, top1 = 31.40%], test : [loss = 2.776, top1 = 31.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.77%], valid : [loss = 0.982, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13338/15625) 013338-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.574, top1 = 87.57%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.38 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.365, top1 = 91.66%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.20 ms.
cifar100       train : [loss = 0.376, top1 = 89.50%], valid : [loss = 1.390, top1 = 66.29%], test : [loss = 1.404, top1 = 65.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.17%], valid : [loss = 2.489, top1 = 37.15%], test : [loss = 2.511, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 74.54%], valid : [loss = 0.782, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13339/15625) 013339-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.399, top1 = 85.85%], valid : [loss = 0.636, top1 = 78.89%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10        train : [loss = 0.327, top1 = 88.60%], test  : [loss = 0.453, top1 = 85.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 1.671, top1 = 53.89%], valid : [loss = 1.895, top1 = 49.56%], test : [loss = 1.855, top1 = 50.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 3.232, top1 = 22.20%], valid : [loss = 3.194, top1 = 23.17%], test : [loss = 3.286, top1 = 21.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.048, top1 = 62.30%], valid : [loss = 1.098, top1 = 60.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13340/15625) 013340-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.96%], valid : [loss = 0.524, top1 = 87.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.078, top1 = 97.56%], test  : [loss = 0.357, top1 = 89.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.04 ms.
cifar100       train : [loss = 0.725, top1 = 78.58%], valid : [loss = 1.327, top1 = 64.92%], test : [loss = 1.339, top1 = 63.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 2.537, top1 = 35.96%], valid : [loss = 2.623, top1 = 34.40%], test : [loss = 2.678, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.93%], valid : [loss = 0.664, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13341/15625) 013341-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.572, top1 = 87.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.385, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.62 ms.
cifar100       train : [loss = 0.390, top1 = 88.96%], valid : [loss = 1.407, top1 = 65.04%], test : [loss = 1.390, top1 = 65.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.26 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.77%], valid : [loss = 2.470, top1 = 37.41%], test : [loss = 2.500, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.21%], valid : [loss = 0.744, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13342/15625) 013342-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.575, top1 = 87.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.389, top1 = 91.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 0.393, top1 = 88.94%], valid : [loss = 1.428, top1 = 64.63%], test : [loss = 1.405, top1 = 64.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.00%], valid : [loss = 2.524, top1 = 36.43%], test : [loss = 2.526, top1 = 36.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13343/15625) 013343-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.577, top1 = 88.54%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.26 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.369, top1 = 91.81%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.89 ms.
cifar100       train : [loss = 0.085, top1 = 98.83%], valid : [loss = 1.463, top1 = 67.74%], test : [loss = 1.528, top1 = 66.02%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.08%], valid : [loss = 2.420, top1 = 39.20%], test : [loss = 2.440, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.38%], valid : [loss = 0.724, top1 = 74.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13344/15625) 013344-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.10 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.38%], valid : [loss = 0.561, top1 = 84.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10        train : [loss = 0.193, top1 = 93.48%], test  : [loss = 0.402, top1 = 87.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.93 ms.
cifar100       train : [loss = 0.984, top1 = 71.52%], valid : [loss = 1.392, top1 = 62.00%], test : [loss = 1.383, top1 = 62.24%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.775, top1 = 31.12%], valid : [loss = 2.814, top1 = 30.33%], test : [loss = 2.871, top1 = 29.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.51%], valid : [loss = 0.980, top1 = 65.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13345/15625) 013345-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.547, top1 = 88.99%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.51 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.341, top1 = 92.48%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.59 ms.
cifar100       train : [loss = 0.173, top1 = 95.97%], valid : [loss = 1.518, top1 = 64.98%], test : [loss = 1.523, top1 = 65.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.64 ms.
ImageNet16-120 train : [loss = 2.314, top1 = 40.00%], valid : [loss = 2.496, top1 = 35.53%], test : [loss = 2.527, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.64%], valid : [loss = 0.864, top1 = 69.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13346/15625) 013346-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.130, top1 = 95.88%], valid : [loss = 0.458, top1 = 86.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.157, top1 = 94.83%], test  : [loss = 0.345, top1 = 88.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.41 ms.
cifar100       train : [loss = 1.000, top1 = 71.52%], valid : [loss = 1.360, top1 = 61.94%], test : [loss = 1.357, top1 = 62.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.66%], valid : [loss = 2.675, top1 = 33.07%], test : [loss = 2.694, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13347/15625) 013347-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.612, top1 = 87.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.388, top1 = 91.36%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.24 ms.
cifar100       train : [loss = 0.194, top1 = 95.38%], valid : [loss = 1.507, top1 = 65.08%], test : [loss = 1.519, top1 = 65.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.96 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.95%], valid : [loss = 2.473, top1 = 39.33%], test : [loss = 2.483, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.25%], valid : [loss = 0.776, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13348/15625) 013348-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.98 ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.67%], valid : [loss = 0.743, top1 = 74.91%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.504, top1 = 82.58%], test  : [loss = 0.588, top1 = 79.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.82 ms.
cifar100       train : [loss = 1.957, top1 = 46.88%], valid : [loss = 2.073, top1 = 44.73%], test : [loss = 2.084, top1 = 44.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.83 ms.
ImageNet16-120 train : [loss = 2.993, top1 = 26.78%], valid : [loss = 2.980, top1 = 26.94%], test : [loss = 3.016, top1 = 26.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.73%], valid : [loss = 1.201, top1 = 57.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13349/15625) 013349-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.487, top1 = 88.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.289, top1 = 92.52%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.40 ms.
cifar100       train : [loss = 0.322, top1 = 91.30%], valid : [loss = 1.251, top1 = 67.96%], test : [loss = 1.242, top1 = 68.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.72%], valid : [loss = 2.331, top1 = 40.27%], test : [loss = 2.339, top1 = 40.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13350/15625) 013350-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.66%], valid : [loss = 0.760, top1 = 73.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10        train : [loss = 0.531, top1 = 81.71%], test  : [loss = 0.594, top1 = 79.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.32 ms.
cifar100       train : [loss = 2.049, top1 = 44.99%], valid : [loss = 2.146, top1 = 43.37%], test : [loss = 2.149, top1 = 42.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 3.180, top1 = 23.30%], valid : [loss = 3.145, top1 = 24.46%], test : [loss = 3.189, top1 = 23.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.196, top1 = 57.07%], valid : [loss = 1.234, top1 = 56.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13351/15625) 013351-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.62%], valid : [loss = 0.541, top1 = 83.89%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 0.202, top1 = 93.13%], test  : [loss = 0.408, top1 = 87.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.80 ms.
cifar100       train : [loss = 1.252, top1 = 64.38%], valid : [loss = 1.556, top1 = 57.90%], test : [loss = 1.555, top1 = 57.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.20%], valid : [loss = 2.708, top1 = 32.63%], test : [loss = 2.754, top1 = 31.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 66.87%], valid : [loss = 0.964, top1 = 66.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13352/15625) 013352-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.70%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.297, top1 = 93.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.87 ms.
cifar100       train : [loss = 0.074, top1 = 98.86%], valid : [loss = 1.321, top1 = 70.78%], test : [loss = 1.353, top1 = 70.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 1.579, top1 = 57.46%], valid : [loss = 2.260, top1 = 43.40%], test : [loss = 2.260, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.384, top1 = 86.84%], valid : [loss = 0.513, top1 = 82.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13353/15625) 013353-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.541, top1 = 88.17%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.343, top1 = 91.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.38 ms.
cifar100       train : [loss = 0.453, top1 = 86.70%], valid : [loss = 1.274, top1 = 66.76%], test : [loss = 1.303, top1 = 66.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.208, top1 = 42.75%], valid : [loss = 2.406, top1 = 38.40%], test : [loss = 2.448, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.67%], valid : [loss = 0.864, top1 = 69.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13354/15625) 013354-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.511, top1 = 89.80%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.322, top1 = 93.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.06 ms.
cifar100       train : [loss = 0.087, top1 = 98.52%], valid : [loss = 1.271, top1 = 70.10%], test : [loss = 1.274, top1 = 70.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 1.610, top1 = 56.55%], valid : [loss = 2.140, top1 = 45.17%], test : [loss = 2.152, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.78%], valid : [loss = 0.696, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13355/15625) 013355-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.62%], valid : [loss = 0.875, top1 = 79.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.128, top1 = 95.66%], test  : [loss = 0.549, top1 = 84.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.88 ms.
cifar100       train : [loss = 0.837, top1 = 75.37%], valid : [loss = 1.686, top1 = 57.28%], test : [loss = 1.703, top1 = 56.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.50%], valid : [loss = 3.188, top1 = 23.80%], test : [loss = 3.215, top1 = 23.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13356/15625) 013356-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.58 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.588, top1 = 88.21%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.26 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.390, top1 = 91.80%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.74 ms.
cifar100       train : [loss = 0.104, top1 = 98.05%], valid : [loss = 1.499, top1 = 67.40%], test : [loss = 1.600, top1 = 65.18%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.55 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.29%], valid : [loss = 2.350, top1 = 41.43%], test : [loss = 2.393, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 74.88%], valid : [loss = 0.769, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13357/15625) 013357-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.90%], valid : [loss = 0.636, top1 = 86.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10        train : [loss = 0.027, top1 = 99.33%], test  : [loss = 0.411, top1 = 89.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.90 ms.
cifar100       train : [loss = 0.398, top1 = 89.22%], valid : [loss = 1.417, top1 = 65.42%], test : [loss = 1.368, top1 = 66.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.66%], valid : [loss = 2.625, top1 = 34.40%], test : [loss = 2.649, top1 = 34.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.42%], valid : [loss = 0.769, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13358/15625) 013358-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.579, top1 = 87.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.403, top1 = 90.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.49 ms.
cifar100       train : [loss = 0.387, top1 = 89.12%], valid : [loss = 1.394, top1 = 65.71%], test : [loss = 1.366, top1 = 65.99%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.03%], valid : [loss = 2.522, top1 = 36.91%], test : [loss = 2.518, top1 = 37.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13359/15625) 013359-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.54 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.421, top1 = 90.43%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.36 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.297, top1 = 92.78%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.21 ms.
cifar100       train : [loss = 0.122, top1 = 97.73%], valid : [loss = 1.273, top1 = 69.86%], test : [loss = 1.289, top1 = 69.60%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.40%], valid : [loss = 2.217, top1 = 43.90%], test : [loss = 2.260, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.413, top1 = 85.82%], valid : [loss = 0.537, top1 = 82.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13360/15625) 013360-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.59%], valid : [loss = 0.453, top1 = 86.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10        train : [loss = 0.153, top1 = 94.97%], test  : [loss = 0.337, top1 = 89.24%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.86 ms.
cifar100       train : [loss = 0.978, top1 = 72.18%], valid : [loss = 1.365, top1 = 61.70%], test : [loss = 1.358, top1 = 61.84%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.28%], valid : [loss = 2.670, top1 = 33.37%], test : [loss = 2.709, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13361/15625) 013361-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=22.14 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.82%], valid : [loss = 0.472, top1 = 86.23%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=21.39 ms.
cifar10        train : [loss = 0.119, top1 = 96.21%], test  : [loss = 0.349, top1 = 89.06%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=25.41 ms.
cifar100       train : [loss = 0.756, top1 = 78.81%], valid : [loss = 1.272, top1 = 65.34%], test : [loss = 1.270, top1 = 64.58%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=22.89 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.72%], valid : [loss = 2.602, top1 = 34.60%], test : [loss = 2.609, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.33%], valid : [loss = 0.886, top1 = 68.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13362/15625) 013362-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.48%], valid : [loss = 0.568, top1 = 87.26%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.03 ms.
cifar10        train : [loss = 0.034, top1 = 98.99%], test  : [loss = 0.386, top1 = 90.04%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=20.68 ms.
cifar100       train : [loss = 0.441, top1 = 87.24%], valid : [loss = 1.319, top1 = 66.20%], test : [loss = 1.299, top1 = 66.88%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.19%], valid : [loss = 2.406, top1 = 39.03%], test : [loss = 2.414, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.38%], valid : [loss = 0.798, top1 = 71.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13363/15625) 013363-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.447, top1 = 90.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.02 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.280, top1 = 93.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.91 ms.
cifar100       train : [loss = 0.057, top1 = 99.20%], valid : [loss = 1.274, top1 = 71.56%], test : [loss = 1.301, top1 = 71.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.97 ms.
ImageNet16-120 train : [loss = 1.482, top1 = 59.71%], valid : [loss = 2.199, top1 = 44.23%], test : [loss = 2.239, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.86%], valid : [loss = 0.473, top1 = 84.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13364/15625) 013364-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.09 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.528, top1 = 89.07%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.314, top1 = 92.87%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.43 ms.
cifar100       train : [loss = 0.102, top1 = 98.00%], valid : [loss = 1.313, top1 = 70.08%], test : [loss = 1.377, top1 = 68.72%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.53 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.38%], valid : [loss = 2.297, top1 = 40.90%], test : [loss = 2.284, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.52%], valid : [loss = 0.797, top1 = 72.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13365/15625) 013365-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.500, top1 = 88.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.89 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.324, top1 = 92.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.342, top1 = 90.73%], valid : [loss = 1.265, top1 = 67.30%], test : [loss = 1.280, top1 = 67.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.21%], valid : [loss = 2.404, top1 = 38.80%], test : [loss = 2.447, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.738, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13366/15625) 013366-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.530, top1 = 88.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.04 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.329, top1 = 92.55%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.42 ms.
cifar100       train : [loss = 0.208, top1 = 94.85%], valid : [loss = 1.326, top1 = 68.32%], test : [loss = 1.317, top1 = 67.84%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.08%], valid : [loss = 2.365, top1 = 39.93%], test : [loss = 2.352, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 71.84%], valid : [loss = 0.833, top1 = 70.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13367/15625) 013367-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.524, top1 = 89.07%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.65 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.335, top1 = 92.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.202, top1 = 95.08%], valid : [loss = 1.246, top1 = 69.24%], test : [loss = 1.273, top1 = 68.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.43 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.13%], valid : [loss = 2.250, top1 = 41.83%], test : [loss = 2.243, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.16%], valid : [loss = 0.679, top1 = 76.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13368/15625) 013368-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.530, top1 = 89.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.55 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.356, top1 = 92.73%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.96 ms.
cifar100       train : [loss = 0.071, top1 = 98.92%], valid : [loss = 1.449, top1 = 68.78%], test : [loss = 1.472, top1 = 68.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.23%], valid : [loss = 2.356, top1 = 42.10%], test : [loss = 2.408, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.24%], valid : [loss = 0.681, top1 = 76.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13369/15625) 013369-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.58%], valid : [loss = 1.081, top1 = 63.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10        train : [loss = 0.809, top1 = 71.66%], test  : [loss = 0.941, top1 = 67.47%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=15.78 ms.
cifar100       train : [loss = 2.179, top1 = 42.99%], valid : [loss = 2.462, top1 = 38.50%], test : [loss = 2.478, top1 = 37.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 3.771, top1 = 13.80%], valid : [loss = 3.815, top1 = 13.37%], test : [loss = 3.835, top1 = 13.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.64%], valid : [loss = 1.400, top1 = 49.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13370/15625) 013370-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.39%], valid : [loss = 0.451, top1 = 87.69%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.81 ms.
cifar10        train : [loss = 0.068, top1 = 98.17%], test  : [loss = 0.315, top1 = 90.25%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.20 ms.
cifar100       train : [loss = 0.613, top1 = 83.10%], valid : [loss = 1.264, top1 = 65.73%], test : [loss = 1.262, top1 = 65.57%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 40.09%], valid : [loss = 2.509, top1 = 37.29%], test : [loss = 2.528, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.81%], valid : [loss = 0.646, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13371/15625) 013371-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.530, top1 = 89.54%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.09 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.374, top1 = 92.34%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.96 ms.
cifar100       train : [loss = 0.041, top1 = 99.57%], valid : [loss = 1.454, top1 = 68.78%], test : [loss = 1.471, top1 = 68.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.90 ms.
ImageNet16-120 train : [loss = 1.627, top1 = 56.37%], valid : [loss = 2.379, top1 = 41.23%], test : [loss = 2.343, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.62%], valid : [loss = 0.614, top1 = 79.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13372/15625) 013372-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.558, top1 = 89.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.383, top1 = 92.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.35 ms.
cifar100       train : [loss = 0.101, top1 = 98.22%], valid : [loss = 1.494, top1 = 66.90%], test : [loss = 1.458, top1 = 68.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.55%], valid : [loss = 2.427, top1 = 39.77%], test : [loss = 2.463, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13373/15625) 013373-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.498, top1 = 88.92%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.52 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.318, top1 = 92.13%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.40 ms.
cifar100       train : [loss = 0.314, top1 = 91.49%], valid : [loss = 1.194, top1 = 69.02%], test : [loss = 1.241, top1 = 68.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.71 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.83%], valid : [loss = 2.228, top1 = 42.43%], test : [loss = 2.218, top1 = 43.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.51%], valid : [loss = 0.735, top1 = 74.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13374/15625) 013374-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.514, top1 = 89.40%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.82 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.340, top1 = 92.68%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.07 ms.
cifar100       train : [loss = 0.108, top1 = 97.81%], valid : [loss = 1.381, top1 = 69.12%], test : [loss = 1.388, top1 = 69.14%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.76 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.23%], valid : [loss = 2.299, top1 = 41.17%], test : [loss = 2.271, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.37%], valid : [loss = 0.770, top1 = 73.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13375/15625) 013375-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.496, top1 = 88.97%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.65 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.322, top1 = 92.12%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.86 ms.
cifar100       train : [loss = 0.258, top1 = 93.51%], valid : [loss = 1.224, top1 = 68.22%], test : [loss = 1.208, top1 = 69.06%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.25%], valid : [loss = 2.304, top1 = 40.90%], test : [loss = 2.324, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.42%], valid : [loss = 0.655, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13376/15625) 013376-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.97%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.43 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.280, top1 = 93.75%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.20 ms.
cifar100       train : [loss = 0.062, top1 = 99.12%], valid : [loss = 1.339, top1 = 70.56%], test : [loss = 1.344, top1 = 70.64%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 1.539, top1 = 58.40%], valid : [loss = 2.245, top1 = 43.73%], test : [loss = 2.278, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.351, top1 = 88.04%], valid : [loss = 0.495, top1 = 83.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13377/15625) 013377-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.555, top1 = 88.63%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.67 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.347, top1 = 91.79%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=19.04 ms.
cifar100       train : [loss = 0.295, top1 = 91.66%], valid : [loss = 1.354, top1 = 67.04%], test : [loss = 1.348, top1 = 67.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.68%], valid : [loss = 2.448, top1 = 38.80%], test : [loss = 2.445, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 68.98%], valid : [loss = 0.892, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13378/15625) 013378-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.32 ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.32%], valid : [loss = 0.883, top1 = 72.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.58 ms.
cifar10        train : [loss = 0.451, top1 = 84.13%], test  : [loss = 0.709, top1 = 76.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.53 ms.
cifar100       train : [loss = 1.537, top1 = 57.17%], valid : [loss = 2.082, top1 = 45.34%], test : [loss = 2.068, top1 = 46.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.666, top1 = 14.41%], valid : [loss = 3.657, top1 = 15.60%], test : [loss = 3.666, top1 = 13.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.340, top1 = 50.60%], valid : [loss = 1.397, top1 = 49.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13379/15625) 013379-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.38 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.468, top1 = 89.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.72 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.307, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.13 ms.
cifar100       train : [loss = 0.219, top1 = 94.72%], valid : [loss = 1.291, top1 = 68.22%], test : [loss = 1.272, top1 = 68.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 49.89%], valid : [loss = 2.257, top1 = 42.30%], test : [loss = 2.281, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.35%], valid : [loss = 0.623, top1 = 78.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13380/15625) 013380-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.98%], valid : [loss = 0.487, top1 = 84.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.296, top1 = 90.16%], test  : [loss = 0.398, top1 = 86.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.97 ms.
cifar100       train : [loss = 1.336, top1 = 62.88%], valid : [loss = 1.531, top1 = 57.42%], test : [loss = 1.513, top1 = 58.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.41 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.84%], valid : [loss = 2.900, top1 = 30.20%], test : [loss = 2.953, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13381/15625) 013381-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.452, top1 = 89.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.297, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.53 ms.
cifar100       train : [loss = 0.214, top1 = 94.86%], valid : [loss = 1.260, top1 = 69.30%], test : [loss = 1.234, top1 = 69.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.18 ms.
ImageNet16-120 train : [loss = 1.850, top1 = 51.01%], valid : [loss = 2.248, top1 = 43.53%], test : [loss = 2.291, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.400, top1 = 86.22%], valid : [loss = 0.527, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13382/15625) 013382-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=23.12 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.546, top1 = 89.46%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.62 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.336, top1 = 93.03%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=18.85 ms.
cifar100       train : [loss = 0.044, top1 = 99.40%], valid : [loss = 1.395, top1 = 69.72%], test : [loss = 1.417, top1 = 70.44%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=25.84 ms.
ImageNet16-120 train : [loss = 1.931, top1 = 48.98%], valid : [loss = 2.305, top1 = 39.87%], test : [loss = 2.302, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 71.99%], valid : [loss = 0.838, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13383/15625) 013383-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.547, top1 = 88.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.341, top1 = 92.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.270, top1 = 92.72%], valid : [loss = 1.273, top1 = 68.08%], test : [loss = 1.282, top1 = 67.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.79 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 47.90%], valid : [loss = 2.292, top1 = 41.83%], test : [loss = 2.316, top1 = 41.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.82%], valid : [loss = 0.693, top1 = 76.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13384/15625) 013384-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.21%], valid : [loss = 0.464, top1 = 85.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.162, top1 = 94.67%], test  : [loss = 0.352, top1 = 88.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 1.026, top1 = 70.91%], valid : [loss = 1.376, top1 = 61.57%], test : [loss = 1.372, top1 = 61.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.49%], valid : [loss = 2.711, top1 = 32.36%], test : [loss = 2.729, top1 = 31.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13385/15625) 013385-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.66%], valid : [loss = 0.830, top1 = 81.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.088, top1 = 97.17%], test  : [loss = 0.508, top1 = 86.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.64 ms.
cifar100       train : [loss = 0.794, top1 = 76.88%], valid : [loss = 1.504, top1 = 60.62%], test : [loss = 1.526, top1 = 60.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.65 ms.
ImageNet16-120 train : [loss = 2.796, top1 = 30.77%], valid : [loss = 2.950, top1 = 28.03%], test : [loss = 2.976, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.90%], valid : [loss = 0.894, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13386/15625) 013386-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.02 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.84%], valid : [loss = 0.476, top1 = 84.63%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.29 ms.
cifar10        train : [loss = 0.296, top1 = 90.22%], test  : [loss = 0.400, top1 = 86.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.80 ms.
cifar100       train : [loss = 1.331, top1 = 63.07%], valid : [loss = 1.518, top1 = 58.08%], test : [loss = 1.523, top1 = 57.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.14 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.70%], valid : [loss = 2.917, top1 = 29.97%], test : [loss = 2.940, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13387/15625) 013387-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.336, top1 = 92.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.27 ms.
cifar100       train : [loss = 0.348, top1 = 90.60%], valid : [loss = 1.275, top1 = 66.78%], test : [loss = 1.287, top1 = 67.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.84%], valid : [loss = 2.407, top1 = 38.97%], test : [loss = 2.420, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13388/15625) 013388-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.60 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.643, top1 = 87.46%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.008, top1 = 99.79%], test  : [loss = 0.412, top1 = 91.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.78 ms.
cifar100       train : [loss = 0.114, top1 = 97.67%], valid : [loss = 1.620, top1 = 65.64%], test : [loss = 1.610, top1 = 65.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.014, top1 = 47.42%], valid : [loss = 2.469, top1 = 37.47%], test : [loss = 2.500, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.46%], valid : [loss = 0.785, top1 = 72.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13389/15625) 013389-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.466, top1 = 89.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.318, top1 = 92.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.45 ms.
cifar100       train : [loss = 0.330, top1 = 91.12%], valid : [loss = 1.332, top1 = 66.58%], test : [loss = 1.344, top1 = 67.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.20%], valid : [loss = 2.376, top1 = 39.73%], test : [loss = 2.424, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13390/15625) 013390-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.69 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.393, top1 = 91.48%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.89 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.268, top1 = 94.11%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=17.97 ms.
cifar100       train : [loss = 0.023, top1 = 99.82%], valid : [loss = 1.290, top1 = 72.40%], test : [loss = 1.236, top1 = 72.20%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.76 ms.
ImageNet16-120 train : [loss = 1.213, top1 = 66.52%], valid : [loss = 2.241, top1 = 46.50%], test : [loss = 2.276, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.49%], valid : [loss = 0.477, top1 = 84.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13391/15625) 013391-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.15 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.76%], valid : [loss = 0.546, top1 = 87.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.02 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.330, top1 = 91.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.10 ms.
cifar100       train : [loss = 0.433, top1 = 87.50%], valid : [loss = 1.257, top1 = 66.96%], test : [loss = 1.281, top1 = 66.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.68%], valid : [loss = 2.399, top1 = 39.23%], test : [loss = 2.411, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.54%], valid : [loss = 0.814, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13392/15625) 013392-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.56%], valid : [loss = 0.731, top1 = 74.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10        train : [loss = 0.560, top1 = 80.78%], test  : [loss = 0.619, top1 = 78.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.56 ms.
cifar100       train : [loss = 2.010, top1 = 46.29%], valid : [loss = 2.134, top1 = 44.03%], test : [loss = 2.111, top1 = 44.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 3.259, top1 = 21.99%], valid : [loss = 3.237, top1 = 22.92%], test : [loss = 3.270, top1 = 21.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 54.80%], valid : [loss = 1.355, top1 = 51.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13393/15625) 013393-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.514, top1 = 89.46%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.62 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.314, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.79 ms.
cifar100       train : [loss = 0.122, top1 = 97.65%], valid : [loss = 1.286, top1 = 69.92%], test : [loss = 1.292, top1 = 69.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.13 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.12%], valid : [loss = 2.309, top1 = 40.93%], test : [loss = 2.289, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.49%], valid : [loss = 0.728, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13394/15625) 013394-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.95%], valid : [loss = 0.507, top1 = 85.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.82 ms.
cifar10        train : [loss = 0.171, top1 = 94.23%], test  : [loss = 0.362, top1 = 88.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 1.032, top1 = 70.31%], valid : [loss = 1.387, top1 = 61.47%], test : [loss = 1.373, top1 = 62.23%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.71 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.58%], valid : [loss = 2.637, top1 = 33.98%], test : [loss = 2.685, top1 = 33.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 68.10%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13395/15625) 013395-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.73 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.694, top1 = 84.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.459, top1 = 88.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.32 ms.
cifar100       train : [loss = 0.611, top1 = 82.01%], valid : [loss = 1.509, top1 = 61.38%], test : [loss = 1.443, top1 = 63.06%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.690, top1 = 32.89%], valid : [loss = 2.854, top1 = 30.13%], test : [loss = 2.877, top1 = 29.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.71%], valid : [loss = 0.887, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13396/15625) 013396-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.563, top1 = 88.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.340, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.99 ms.
cifar100       train : [loss = 0.210, top1 = 94.87%], valid : [loss = 1.298, top1 = 68.62%], test : [loss = 1.293, top1 = 67.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.32%], valid : [loss = 2.382, top1 = 39.40%], test : [loss = 2.356, top1 = 40.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.803, top1 = 71.14%], valid : [loss = 0.833, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13397/15625) 013397-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.506, top1 = 88.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.67 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.335, top1 = 92.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.97 ms.
cifar100       train : [loss = 0.345, top1 = 90.54%], valid : [loss = 1.254, top1 = 67.36%], test : [loss = 1.319, top1 = 67.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.81%], valid : [loss = 2.416, top1 = 38.30%], test : [loss = 2.404, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13398/15625) 013398-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.73 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.511, top1 = 89.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.318, top1 = 93.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.75 ms.
cifar100       train : [loss = 0.128, top1 = 97.08%], valid : [loss = 1.339, top1 = 68.86%], test : [loss = 1.345, top1 = 69.33%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.724, top1 = 53.92%], valid : [loss = 2.196, top1 = 43.73%], test : [loss = 2.202, top1 = 44.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.52%], valid : [loss = 0.658, top1 = 77.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13399/15625) 013399-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.493, top1 = 89.54%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.43 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.322, top1 = 92.63%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.01 ms.
cifar100       train : [loss = 0.172, top1 = 96.03%], valid : [loss = 1.244, top1 = 69.82%], test : [loss = 1.202, top1 = 70.62%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 1.766, top1 = 53.09%], valid : [loss = 2.164, top1 = 43.63%], test : [loss = 2.219, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.61%], valid : [loss = 0.656, top1 = 77.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13400/15625) 013400-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.562, top1 = 88.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.378, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.90 ms.
cifar100       train : [loss = 0.227, top1 = 94.33%], valid : [loss = 1.427, top1 = 66.17%], test : [loss = 1.430, top1 = 66.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.094, top1 = 45.45%], valid : [loss = 2.405, top1 = 39.40%], test : [loss = 2.435, top1 = 39.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.42%], valid : [loss = 0.738, top1 = 74.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13401/15625) 013401-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.281, top1 = 90.65%], valid : [loss = 0.475, top1 = 84.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10        train : [loss = 0.296, top1 = 90.20%], test  : [loss = 0.393, top1 = 87.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.91 ms.
cifar100       train : [loss = 1.318, top1 = 63.46%], valid : [loss = 1.526, top1 = 58.10%], test : [loss = 1.496, top1 = 58.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.91%], valid : [loss = 2.892, top1 = 29.33%], test : [loss = 2.948, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13402/15625) 013402-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.98%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.01 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.290, top1 = 93.48%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.83 ms.
cifar100       train : [loss = 0.060, top1 = 99.19%], valid : [loss = 1.407, top1 = 69.52%], test : [loss = 1.384, top1 = 70.64%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 1.517, top1 = 58.80%], valid : [loss = 2.253, top1 = 44.43%], test : [loss = 2.287, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.356, top1 = 87.90%], valid : [loss = 0.488, top1 = 83.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13403/15625) 013403-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=22.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.495, top1 = 90.22%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=19.66 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.342, top1 = 93.51%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=22.87 ms.
cifar100       train : [loss = 0.017, top1 = 99.90%], valid : [loss = 1.363, top1 = 71.54%], test : [loss = 1.356, top1 = 71.56%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=20.74 ms.
ImageNet16-120 train : [loss = 1.373, top1 = 62.64%], valid : [loss = 2.422, top1 = 42.17%], test : [loss = 2.463, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.523, top1 = 81.67%], valid : [loss = 0.651, top1 = 77.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13404/15625) 013404-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.53%], valid : [loss = 0.914, top1 = 68.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.739, top1 = 73.88%], test  : [loss = 0.784, top1 = 72.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.34 ms.
cifar100       train : [loss = 2.347, top1 = 38.64%], valid : [loss = 2.467, top1 = 36.11%], test : [loss = 2.457, top1 = 36.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.62 ms.
ImageNet16-120 train : [loss = 3.551, top1 = 17.12%], valid : [loss = 3.546, top1 = 17.84%], test : [loss = 3.562, top1 = 16.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.453, top1 = 46.67%], valid : [loss = 1.503, top1 = 44.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13405/15625) 013405-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.513, top1 = 89.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.347, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.99 ms.
cifar100       train : [loss = 0.156, top1 = 96.57%], valid : [loss = 1.299, top1 = 69.62%], test : [loss = 1.304, top1 = 69.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.931, top1 = 49.17%], valid : [loss = 2.311, top1 = 40.83%], test : [loss = 2.311, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.94%], valid : [loss = 0.742, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13406/15625) 013406-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.29 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.48%], valid : [loss = 0.583, top1 = 86.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10        train : [loss = 0.045, top1 = 98.63%], test  : [loss = 0.388, top1 = 89.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.72 ms.
cifar100       train : [loss = 0.586, top1 = 82.67%], valid : [loss = 1.411, top1 = 64.04%], test : [loss = 1.452, top1 = 62.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.96%], valid : [loss = 2.605, top1 = 34.43%], test : [loss = 2.653, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.95%], valid : [loss = 0.675, top1 = 76.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13407/15625) 013407-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.189, top1 = 93.72%], valid : [loss = 0.552, top1 = 83.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.189, top1 = 93.64%], test  : [loss = 0.384, top1 = 87.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.61 ms.
cifar100       train : [loss = 1.177, top1 = 66.36%], valid : [loss = 1.516, top1 = 58.70%], test : [loss = 1.496, top1 = 59.05%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.733, top1 = 31.89%], valid : [loss = 2.759, top1 = 31.31%], test : [loss = 2.806, top1 = 31.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.58%], valid : [loss = 0.984, top1 = 65.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13408/15625) 013408-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.88%], valid : [loss = 0.558, top1 = 88.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.73 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.353, top1 = 92.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.60 ms.
cifar100       train : [loss = 0.114, top1 = 97.42%], valid : [loss = 1.381, top1 = 68.88%], test : [loss = 1.363, top1 = 69.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 1.836, top1 = 51.28%], valid : [loss = 2.338, top1 = 40.27%], test : [loss = 2.331, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 72.82%], valid : [loss = 0.806, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13409/15625) 013409-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.72 ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.98%], valid : [loss = 0.977, top1 = 66.80%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.90 ms.
cifar10        train : [loss = 0.795, top1 = 72.18%], test  : [loss = 0.881, top1 = 68.80%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.35 ms.
cifar100       train : [loss = 2.122, top1 = 44.06%], valid : [loss = 2.312, top1 = 41.12%], test : [loss = 2.311, top1 = 41.24%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.736, top1 = 14.40%], valid : [loss = 3.755, top1 = 14.83%], test : [loss = 3.773, top1 = 13.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13410/15625) 013410-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.475, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.16 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.319, top1 = 92.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=22.21 ms.
cifar100       train : [loss = 0.228, top1 = 94.39%], valid : [loss = 1.212, top1 = 69.42%], test : [loss = 1.245, top1 = 68.88%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.38%], valid : [loss = 2.313, top1 = 41.00%], test : [loss = 2.322, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 82.06%], valid : [loss = 0.605, top1 = 79.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13411/15625) 013411-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.17%], valid : [loss = 0.458, top1 = 86.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.65 ms.
cifar10        train : [loss = 0.159, top1 = 94.76%], test  : [loss = 0.348, top1 = 88.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 1.027, top1 = 70.90%], valid : [loss = 1.371, top1 = 61.49%], test : [loss = 1.367, top1 = 61.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.58%], valid : [loss = 2.705, top1 = 32.43%], test : [loss = 2.720, top1 = 31.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13412/15625) 013412-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.18%], valid : [loss = 0.788, top1 = 72.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10        train : [loss = 0.564, top1 = 80.15%], test  : [loss = 0.609, top1 = 79.26%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.04 ms.
cifar100       train : [loss = 2.109, top1 = 43.12%], valid : [loss = 2.211, top1 = 41.52%], test : [loss = 2.221, top1 = 41.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 3.297, top1 = 20.82%], valid : [loss = 3.247, top1 = 21.97%], test : [loss = 3.310, top1 = 20.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.138, top1 = 58.84%], valid : [loss = 1.184, top1 = 57.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13413/15625) 013413-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.454, top1 = 89.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.320, top1 = 91.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.02 ms.
cifar100       train : [loss = 0.326, top1 = 91.22%], valid : [loss = 1.329, top1 = 66.69%], test : [loss = 1.309, top1 = 67.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.16%], valid : [loss = 2.378, top1 = 40.12%], test : [loss = 2.418, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13414/15625) 013414-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.533, top1 = 89.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.371, top1 = 92.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.172, top1 = 96.23%], valid : [loss = 1.400, top1 = 66.54%], test : [loss = 1.391, top1 = 67.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.58%], valid : [loss = 2.487, top1 = 37.33%], test : [loss = 2.483, top1 = 37.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13415/15625) 013415-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.80 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.570, top1 = 88.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.66 ms.
cifar10        train : [loss = 0.014, top1 = 99.61%], test  : [loss = 0.357, top1 = 91.79%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.93 ms.
cifar100       train : [loss = 0.194, top1 = 95.23%], valid : [loss = 1.359, top1 = 67.68%], test : [loss = 1.324, top1 = 68.86%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.48 ms.
ImageNet16-120 train : [loss = 2.014, top1 = 47.36%], valid : [loss = 2.314, top1 = 40.97%], test : [loss = 2.295, top1 = 41.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 69.30%], valid : [loss = 0.899, top1 = 68.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13416/15625) 013416-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.426, top1 = 90.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.73 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.276, top1 = 93.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.47 ms.
cifar100       train : [loss = 0.130, top1 = 97.55%], valid : [loss = 1.295, top1 = 69.82%], test : [loss = 1.310, top1 = 68.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.81 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.68%], valid : [loss = 2.227, top1 = 43.40%], test : [loss = 2.265, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.417, top1 = 85.74%], valid : [loss = 0.531, top1 = 82.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13417/15625) 013417-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.465, top1 = 90.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.93 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.308, top1 = 93.78%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.77 ms.
cifar100       train : [loss = 0.032, top1 = 99.60%], valid : [loss = 1.349, top1 = 71.90%], test : [loss = 1.370, top1 = 71.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 1.347, top1 = 62.96%], valid : [loss = 2.224, top1 = 45.30%], test : [loss = 2.243, top1 = 45.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.328, top1 = 88.76%], valid : [loss = 0.481, top1 = 84.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13418/15625) 013418-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.543, top1 = 88.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.82 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.374, top1 = 91.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.390, top1 = 89.08%], valid : [loss = 1.373, top1 = 65.86%], test : [loss = 1.364, top1 = 65.91%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.28%], valid : [loss = 2.469, top1 = 38.08%], test : [loss = 2.478, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.87%], valid : [loss = 0.735, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13419/15625) 013419-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.36%], valid : [loss = 0.632, top1 = 85.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10        train : [loss = 0.038, top1 = 98.92%], test  : [loss = 0.421, top1 = 89.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.26 ms.
cifar100       train : [loss = 0.567, top1 = 83.34%], valid : [loss = 1.414, top1 = 63.18%], test : [loss = 1.446, top1 = 63.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.76 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.38%], valid : [loss = 2.553, top1 = 36.07%], test : [loss = 2.556, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.46%], valid : [loss = 0.864, top1 = 69.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13420/15625) 013420-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.44%], valid : [loss = 0.536, top1 = 83.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10        train : [loss = 0.253, top1 = 91.36%], test  : [loss = 0.403, top1 = 86.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.69 ms.
cifar100       train : [loss = 1.298, top1 = 63.44%], valid : [loss = 1.593, top1 = 57.13%], test : [loss = 1.567, top1 = 57.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 2.852, top1 = 29.73%], valid : [loss = 2.844, top1 = 30.16%], test : [loss = 2.918, top1 = 28.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.27%], valid : [loss = 1.030, top1 = 63.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13421/15625) 013421-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.55 ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.72%], valid : [loss = 0.902, top1 = 68.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.658, top1 = 76.88%], test  : [loss = 0.761, top1 = 73.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.67 ms.
cifar100       train : [loss = 1.950, top1 = 48.08%], valid : [loss = 2.125, top1 = 44.70%], test : [loss = 2.135, top1 = 45.76%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 3.657, top1 = 15.66%], valid : [loss = 3.694, top1 = 15.07%], test : [loss = 3.699, top1 = 14.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13422/15625) 013422-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.494, top1 = 90.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 93.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.09 ms.
cifar100       train : [loss = 0.110, top1 = 97.88%], valid : [loss = 1.319, top1 = 69.78%], test : [loss = 1.272, top1 = 70.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 1.734, top1 = 53.80%], valid : [loss = 2.193, top1 = 44.03%], test : [loss = 2.195, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13423/15625) 013423-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.553, top1 = 88.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.363, top1 = 91.55%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.92 ms.
cifar100       train : [loss = 0.290, top1 = 91.99%], valid : [loss = 1.327, top1 = 67.84%], test : [loss = 1.331, top1 = 67.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.31%], valid : [loss = 2.402, top1 = 39.03%], test : [loss = 2.411, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13424/15625) 013424-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.471, top1 = 89.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.327, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.01 ms.
cifar100       train : [loss = 0.277, top1 = 92.58%], valid : [loss = 1.329, top1 = 67.45%], test : [loss = 1.339, top1 = 67.38%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.84 ms.
ImageNet16-120 train : [loss = 2.004, top1 = 47.46%], valid : [loss = 2.358, top1 = 39.94%], test : [loss = 2.382, top1 = 39.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.507, top1 = 82.18%], valid : [loss = 0.603, top1 = 79.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13425/15625) 013425-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.541, top1 = 88.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.341, top1 = 92.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.91 ms.
cifar100       train : [loss = 0.246, top1 = 93.54%], valid : [loss = 1.326, top1 = 67.40%], test : [loss = 1.315, top1 = 67.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.240, top1 = 42.17%], valid : [loss = 2.440, top1 = 38.80%], test : [loss = 2.454, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13426/15625) 013426-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.40 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.541, top1 = 89.04%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.51 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.468, top1 = 89.88%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=23.75 ms.
cifar100       train : [loss = 0.185, top1 = 95.61%], valid : [loss = 1.408, top1 = 66.74%], test : [loss = 1.428, top1 = 66.22%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.46 ms.
ImageNet16-120 train : [loss = 2.273, top1 = 41.33%], valid : [loss = 2.496, top1 = 37.30%], test : [loss = 2.468, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.77%], valid : [loss = 0.988, top1 = 64.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13427/15625) 013427-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.45%], valid : [loss = 0.622, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.62 ms.
cifar10        train : [loss = 0.071, top1 = 97.90%], test  : [loss = 0.415, top1 = 88.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.64 ms.
cifar100       train : [loss = 0.700, top1 = 79.49%], valid : [loss = 1.374, top1 = 63.68%], test : [loss = 1.369, top1 = 62.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.519, top1 = 36.44%], valid : [loss = 2.633, top1 = 34.17%], test : [loss = 2.662, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13428/15625) 013428-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.56%], valid : [loss = 0.615, top1 = 86.16%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.38 ms.
cifar10        train : [loss = 0.035, top1 = 98.96%], test  : [loss = 0.379, top1 = 90.29%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.88 ms.
cifar100       train : [loss = 0.534, top1 = 84.39%], valid : [loss = 1.412, top1 = 63.26%], test : [loss = 1.442, top1 = 63.88%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.49%], valid : [loss = 2.548, top1 = 35.33%], test : [loss = 2.580, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.98%], valid : [loss = 0.824, top1 = 71.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13429/15625) 013429-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.89 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.99 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13430/15625) 013430-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.54%], valid : [loss = 0.449, top1 = 87.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10        train : [loss = 0.053, top1 = 98.69%], test  : [loss = 0.312, top1 = 90.58%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.585, top1 = 83.85%], valid : [loss = 1.253, top1 = 66.22%], test : [loss = 1.214, top1 = 66.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.85 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.15%], valid : [loss = 2.491, top1 = 37.53%], test : [loss = 2.494, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13431/15625) 013431-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.515, top1 = 89.96%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.04 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.312, top1 = 93.55%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.83 ms.
cifar100       train : [loss = 0.057, top1 = 99.31%], valid : [loss = 1.335, top1 = 70.22%], test : [loss = 1.352, top1 = 69.22%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.03 ms.
ImageNet16-120 train : [loss = 1.548, top1 = 58.18%], valid : [loss = 2.150, top1 = 44.90%], test : [loss = 2.180, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.09%], valid : [loss = 0.624, top1 = 78.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13432/15625) 013432-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.38 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.74%], valid : [loss = 0.836, top1 = 81.40%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.83 ms.
cifar10        train : [loss = 0.084, top1 = 97.36%], test  : [loss = 0.493, top1 = 86.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.71 ms.
cifar100       train : [loss = 0.782, top1 = 77.00%], valid : [loss = 1.485, top1 = 60.76%], test : [loss = 1.478, top1 = 61.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.796, top1 = 30.63%], valid : [loss = 2.911, top1 = 28.80%], test : [loss = 2.964, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.45%], valid : [loss = 0.881, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13433/15625) 013433-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.59%], valid : [loss = 0.618, top1 = 85.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.83 ms.
cifar10        train : [loss = 0.053, top1 = 98.43%], test  : [loss = 0.418, top1 = 89.02%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.78 ms.
cifar100       train : [loss = 0.596, top1 = 82.62%], valid : [loss = 1.389, top1 = 63.72%], test : [loss = 1.419, top1 = 63.16%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.51%], valid : [loss = 2.615, top1 = 34.27%], test : [loss = 2.667, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.732, top1 = 74.32%], valid : [loss = 0.791, top1 = 72.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13434/15625) 013434-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.33%], valid : [loss = 0.464, top1 = 86.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10        train : [loss = 0.160, top1 = 94.70%], test  : [loss = 0.349, top1 = 88.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.91 ms.
cifar100       train : [loss = 0.993, top1 = 71.71%], valid : [loss = 1.352, top1 = 62.21%], test : [loss = 1.351, top1 = 62.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.52 ms.
ImageNet16-120 train : [loss = 2.628, top1 = 33.91%], valid : [loss = 2.681, top1 = 33.24%], test : [loss = 2.704, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13435/15625) 013435-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.127, top1 = 96.18%], valid : [loss = 0.462, top1 = 85.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.70 ms.
cifar10        train : [loss = 0.161, top1 = 94.75%], test  : [loss = 0.346, top1 = 88.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.59 ms.
cifar100       train : [loss = 0.996, top1 = 71.70%], valid : [loss = 1.335, top1 = 63.14%], test : [loss = 1.329, top1 = 62.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.643, top1 = 33.69%], valid : [loss = 2.694, top1 = 32.70%], test : [loss = 2.731, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13436/15625) 013436-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.02 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.432, top1 = 90.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.299, top1 = 93.31%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.62 ms.
cifar100       train : [loss = 0.058, top1 = 99.22%], valid : [loss = 1.366, top1 = 70.05%], test : [loss = 1.366, top1 = 69.83%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.527, top1 = 58.78%], valid : [loss = 2.276, top1 = 43.78%], test : [loss = 2.293, top1 = 43.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.401, top1 = 86.08%], valid : [loss = 0.526, top1 = 81.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13437/15625) 013437-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.78%], valid : [loss = 0.628, top1 = 84.69%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.92 ms.
cifar10        train : [loss = 0.071, top1 = 97.72%], test  : [loss = 0.411, top1 = 88.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.44 ms.
cifar100       train : [loss = 0.716, top1 = 78.95%], valid : [loss = 1.451, top1 = 62.28%], test : [loss = 1.470, top1 = 60.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 35.71%], valid : [loss = 2.686, top1 = 33.50%], test : [loss = 2.690, top1 = 34.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 70.96%], valid : [loss = 0.871, top1 = 69.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13438/15625) 013438-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.516, top1 = 88.63%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.327, top1 = 92.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.14 ms.
cifar100       train : [loss = 0.349, top1 = 90.56%], valid : [loss = 1.253, top1 = 67.34%], test : [loss = 1.316, top1 = 66.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.58%], valid : [loss = 2.399, top1 = 39.50%], test : [loss = 2.416, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13439/15625) 013439-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.614, top1 = 87.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.416, top1 = 90.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.227, top1 = 94.44%], valid : [loss = 1.649, top1 = 62.70%], test : [loss = 1.647, top1 = 62.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.095, top1 = 45.42%], valid : [loss = 2.502, top1 = 37.80%], test : [loss = 2.501, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.749, top1 = 73.34%], valid : [loss = 0.813, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13440/15625) 013440-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.18 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.70%], valid : [loss = 0.571, top1 = 87.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.027, top1 = 99.15%], test  : [loss = 0.369, top1 = 91.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.18 ms.
cifar100       train : [loss = 0.364, top1 = 89.76%], valid : [loss = 1.348, top1 = 66.20%], test : [loss = 1.331, top1 = 65.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.189, top1 = 43.20%], valid : [loss = 2.400, top1 = 39.47%], test : [loss = 2.409, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.18%], valid : [loss = 1.030, top1 = 62.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13441/15625) 013441-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.50%], valid : [loss = 0.450, top1 = 87.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.12 ms.
cifar10        train : [loss = 0.057, top1 = 98.56%], test  : [loss = 0.313, top1 = 90.45%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.37 ms.
cifar100       train : [loss = 0.583, top1 = 83.91%], valid : [loss = 1.207, top1 = 66.28%], test : [loss = 1.227, top1 = 66.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.14%], valid : [loss = 2.462, top1 = 38.37%], test : [loss = 2.491, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.56%], valid : [loss = 0.656, top1 = 77.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13442/15625) 013442-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.45 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.501, top1 = 88.86%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.32 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.322, top1 = 91.90%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.59 ms.
cifar100       train : [loss = 0.264, top1 = 93.15%], valid : [loss = 1.181, top1 = 69.36%], test : [loss = 1.207, top1 = 69.32%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.79 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.61%], valid : [loss = 2.232, top1 = 42.23%], test : [loss = 2.238, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.56%], valid : [loss = 0.719, top1 = 75.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13443/15625) 013443-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.511, top1 = 88.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.345, top1 = 91.51%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.20 ms.
cifar100       train : [loss = 0.326, top1 = 91.18%], valid : [loss = 1.266, top1 = 67.50%], test : [loss = 1.266, top1 = 67.74%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.100, top1 = 45.32%], valid : [loss = 2.385, top1 = 39.57%], test : [loss = 2.406, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13444/15625) 013444-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.92 ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.75%], valid : [loss = 0.655, top1 = 77.88%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10        train : [loss = 0.514, top1 = 82.22%], test  : [loss = 0.593, top1 = 79.96%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.94 ms.
cifar100       train : [loss = 1.704, top1 = 53.78%], valid : [loss = 1.871, top1 = 50.23%], test : [loss = 1.869, top1 = 50.81%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.13 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.25%], valid : [loss = 3.314, top1 = 21.50%], test : [loss = 3.348, top1 = 21.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13445/15625) 013445-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.480, top1 = 88.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.321, top1 = 92.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.36 ms.
cifar100       train : [loss = 0.308, top1 = 92.00%], valid : [loss = 1.244, top1 = 67.36%], test : [loss = 1.264, top1 = 67.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 1.994, top1 = 47.73%], valid : [loss = 2.297, top1 = 41.53%], test : [loss = 2.318, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.14%], valid : [loss = 0.595, top1 = 79.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13446/15625) 013446-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.19%], valid : [loss = 0.951, top1 = 66.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10        train : [loss = 0.777, top1 = 72.38%], test  : [loss = 0.825, top1 = 71.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 2.452, top1 = 36.01%], valid : [loss = 2.582, top1 = 33.60%], test : [loss = 2.577, top1 = 34.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 3.607, top1 = 15.97%], valid : [loss = 3.583, top1 = 17.10%], test : [loss = 3.630, top1 = 15.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.59%], valid : [loss = 1.500, top1 = 45.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13447/15625) 013447-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.02%], valid : [loss = 0.672, top1 = 77.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.522, top1 = 81.92%], test  : [loss = 0.600, top1 = 79.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.63 ms.
cifar100       train : [loss = 1.701, top1 = 53.86%], valid : [loss = 1.868, top1 = 50.25%], test : [loss = 1.881, top1 = 50.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 3.333, top1 = 21.11%], valid : [loss = 3.321, top1 = 21.98%], test : [loss = 3.352, top1 = 20.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.71%], valid : [loss = 1.305, top1 = 53.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13448/15625) 013448-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.502, top1 = 88.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.296, top1 = 92.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.323, top1 = 91.21%], valid : [loss = 1.239, top1 = 68.60%], test : [loss = 1.238, top1 = 68.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.05 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.79%], valid : [loss = 2.327, top1 = 40.73%], test : [loss = 2.354, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13449/15625) 013449-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.516, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.47 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.308, top1 = 93.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.93 ms.
cifar100       train : [loss = 0.149, top1 = 96.86%], valid : [loss = 1.280, top1 = 68.70%], test : [loss = 1.264, top1 = 69.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.37 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.38%], valid : [loss = 2.311, top1 = 41.23%], test : [loss = 2.292, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13450/15625) 013450-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.549, top1 = 89.26%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.343, top1 = 92.68%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.14 ms.
cifar100       train : [loss = 0.110, top1 = 97.85%], valid : [loss = 1.305, top1 = 69.70%], test : [loss = 1.339, top1 = 69.16%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 1.783, top1 = 52.54%], valid : [loss = 2.309, top1 = 41.83%], test : [loss = 2.293, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.25%], valid : [loss = 0.671, top1 = 77.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13451/15625) 013451-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.428, top1 = 90.91%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.30 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.294, top1 = 93.73%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.21 ms.
cifar100       train : [loss = 0.038, top1 = 99.65%], valid : [loss = 1.384, top1 = 70.58%], test : [loss = 1.362, top1 = 71.12%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 1.431, top1 = 61.14%], valid : [loss = 2.279, top1 = 43.53%], test : [loss = 2.277, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.433, top1 = 85.10%], valid : [loss = 0.554, top1 = 81.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13452/15625) 013452-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.95%], valid : [loss = 0.532, top1 = 86.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10        train : [loss = 0.116, top1 = 96.20%], test  : [loss = 0.367, top1 = 89.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.835, top1 = 75.75%], valid : [loss = 1.386, top1 = 62.54%], test : [loss = 1.345, top1 = 63.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.59%], valid : [loss = 2.602, top1 = 34.73%], test : [loss = 2.655, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.70%], valid : [loss = 0.895, top1 = 68.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13453/15625) 013453-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.59%], valid : [loss = 0.566, top1 = 87.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.80 ms.
cifar10        train : [loss = 0.033, top1 = 99.00%], test  : [loss = 0.385, top1 = 90.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.42 ms.
cifar100       train : [loss = 0.511, top1 = 85.15%], valid : [loss = 1.357, top1 = 65.08%], test : [loss = 1.350, top1 = 65.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.21%], valid : [loss = 2.578, top1 = 34.60%], test : [loss = 2.627, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.27%], valid : [loss = 0.949, top1 = 66.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13454/15625) 013454-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.21%], valid : [loss = 0.531, top1 = 87.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10        train : [loss = 0.064, top1 = 97.96%], test  : [loss = 0.390, top1 = 89.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.00 ms.
cifar100       train : [loss = 0.631, top1 = 81.49%], valid : [loss = 1.278, top1 = 64.74%], test : [loss = 1.270, top1 = 65.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.360, top1 = 39.44%], valid : [loss = 2.493, top1 = 35.87%], test : [loss = 2.494, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.66%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13455/15625) 013455-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.974, top1 = 65.50%], valid : [loss = 1.021, top1 = 64.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10        train : [loss = 0.528, top1 = 81.60%], test  : [loss = 0.592, top1 = 80.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.81 ms.
cifar100       train : [loss = 1.763, top1 = 52.17%], valid : [loss = 1.919, top1 = 49.34%], test : [loss = 1.938, top1 = 49.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 3.392, top1 = 19.94%], valid : [loss = 3.383, top1 = 20.63%], test : [loss = 3.398, top1 = 19.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.379, top1 = 49.75%], valid : [loss = 1.391, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13456/15625) 013456-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.192, top1 = 93.64%], valid : [loss = 0.546, top1 = 83.89%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.78 ms.
cifar10        train : [loss = 0.207, top1 = 93.00%], test  : [loss = 0.391, top1 = 87.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.39 ms.
cifar100       train : [loss = 1.237, top1 = 64.58%], valid : [loss = 1.549, top1 = 57.08%], test : [loss = 1.531, top1 = 57.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.46%], valid : [loss = 2.715, top1 = 32.27%], test : [loss = 2.763, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.918, top1 = 66.91%], valid : [loss = 0.983, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13457/15625) 013457-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.81%], valid : [loss = 0.529, top1 = 88.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.27 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.351, top1 = 92.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=21.20 ms.
cifar100       train : [loss = 0.253, top1 = 93.22%], valid : [loss = 1.307, top1 = 67.84%], test : [loss = 1.362, top1 = 66.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.76%], valid : [loss = 2.446, top1 = 38.20%], test : [loss = 2.435, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.921, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13458/15625) 013458-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.77%], valid : [loss = 0.536, top1 = 86.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.093, top1 = 97.10%], test  : [loss = 0.360, top1 = 89.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.27 ms.
cifar100       train : [loss = 0.688, top1 = 80.29%], valid : [loss = 1.294, top1 = 65.06%], test : [loss = 1.287, top1 = 65.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.423, top1 = 38.38%], valid : [loss = 2.533, top1 = 36.33%], test : [loss = 2.535, top1 = 36.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.89%], valid : [loss = 0.883, top1 = 68.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13459/15625) 013459-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.25%], valid : [loss = 0.548, top1 = 82.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10        train : [loss = 0.286, top1 = 90.24%], test  : [loss = 0.431, top1 = 85.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.87 ms.
cifar100       train : [loss = 1.431, top1 = 59.90%], valid : [loss = 1.713, top1 = 53.50%], test : [loss = 1.694, top1 = 54.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 2.945, top1 = 27.84%], valid : [loss = 2.953, top1 = 27.70%], test : [loss = 3.002, top1 = 26.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.42%], valid : [loss = 1.017, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13460/15625) 013460-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.50%], valid : [loss = 0.813, top1 = 76.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.60 ms.
cifar10        train : [loss = 0.329, top1 = 88.62%], test  : [loss = 0.629, top1 = 80.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 1.380, top1 = 61.27%], valid : [loss = 1.883, top1 = 50.08%], test : [loss = 1.923, top1 = 50.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 3.507, top1 = 17.12%], valid : [loss = 3.523, top1 = 17.27%], test : [loss = 3.520, top1 = 17.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.245, top1 = 54.68%], valid : [loss = 1.276, top1 = 53.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13461/15625) 013461-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.522, top1 = 89.45%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.86 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.330, top1 = 92.72%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.80 ms.
cifar100       train : [loss = 0.075, top1 = 98.55%], valid : [loss = 1.425, top1 = 69.56%], test : [loss = 1.436, top1 = 69.64%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=22.60 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.11%], valid : [loss = 2.505, top1 = 36.83%], test : [loss = 2.497, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.70%], valid : [loss = 0.854, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13462/15625) 013462-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.193, top1 = 93.62%], valid : [loss = 0.713, top1 = 79.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.23 ms.
cifar10        train : [loss = 0.184, top1 = 93.72%], test  : [loss = 0.520, top1 = 84.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.47 ms.
cifar100       train : [loss = 0.886, top1 = 74.02%], valid : [loss = 1.682, top1 = 57.30%], test : [loss = 1.664, top1 = 57.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 3.484, top1 = 17.19%], valid : [loss = 3.487, top1 = 18.23%], test : [loss = 3.494, top1 = 17.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13463/15625) 013463-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.128, top1 = 96.02%], valid : [loss = 0.465, top1 = 85.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.13 ms.
cifar10        train : [loss = 0.161, top1 = 94.76%], test  : [loss = 0.356, top1 = 88.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.04 ms.
cifar100       train : [loss = 1.003, top1 = 71.52%], valid : [loss = 1.341, top1 = 62.74%], test : [loss = 1.339, top1 = 62.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.662, top1 = 33.30%], valid : [loss = 2.694, top1 = 32.27%], test : [loss = 2.743, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 75.13%], valid : [loss = 0.776, top1 = 73.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13464/15625) 013464-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.547, top1 = 88.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.344, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.42 ms.
cifar100       train : [loss = 0.258, top1 = 92.88%], valid : [loss = 1.320, top1 = 68.22%], test : [loss = 1.299, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 42.89%], valid : [loss = 2.455, top1 = 38.57%], test : [loss = 2.470, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 68.95%], valid : [loss = 0.914, top1 = 67.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13465/15625) 013465-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.107, top1 = 96.44%], valid : [loss = 0.688, top1 = 82.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.39 ms.
cifar10        train : [loss = 0.146, top1 = 95.01%], test  : [loss = 0.432, top1 = 86.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 0.941, top1 = 72.57%], valid : [loss = 1.629, top1 = 57.10%], test : [loss = 1.630, top1 = 57.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 3.047, top1 = 25.54%], valid : [loss = 3.114, top1 = 24.97%], test : [loss = 3.150, top1 = 24.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 67.21%], valid : [loss = 0.969, top1 = 65.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13466/15625) 013466-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.443, top1 = 89.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.322, top1 = 91.30%], valid : [loss = 1.276, top1 = 67.95%], test : [loss = 1.291, top1 = 67.71%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.40%], valid : [loss = 2.368, top1 = 39.97%], test : [loss = 2.389, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.03%], valid : [loss = 0.545, top1 = 81.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13467/15625) 013467-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.92 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.40%], valid : [loss = 0.636, top1 = 85.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.51 ms.
cifar10        train : [loss = 0.039, top1 = 98.85%], test  : [loss = 0.409, top1 = 90.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.568, top1 = 83.35%], valid : [loss = 1.431, top1 = 62.40%], test : [loss = 1.430, top1 = 63.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.384, top1 = 39.04%], valid : [loss = 2.576, top1 = 35.03%], test : [loss = 2.581, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.37%], valid : [loss = 0.862, top1 = 69.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13468/15625) 013468-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.84%], valid : [loss = 0.460, top1 = 86.36%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.07 ms.
cifar10        train : [loss = 0.141, top1 = 95.39%], test  : [loss = 0.343, top1 = 88.69%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.26 ms.
cifar100       train : [loss = 0.906, top1 = 74.22%], valid : [loss = 1.326, top1 = 62.48%], test : [loss = 1.297, top1 = 63.58%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.52 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.42%], valid : [loss = 2.602, top1 = 35.27%], test : [loss = 2.658, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.41%], valid : [loss = 0.766, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13469/15625) 013469-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.57%], valid : [loss = 0.812, top1 = 72.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 0.508, top1 = 82.38%], test  : [loss = 0.649, top1 = 78.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.34 ms.
cifar100       train : [loss = 1.847, top1 = 49.79%], valid : [loss = 2.035, top1 = 46.28%], test : [loss = 2.040, top1 = 46.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 3.528, top1 = 17.48%], valid : [loss = 3.532, top1 = 18.20%], test : [loss = 3.567, top1 = 17.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.249, top1 = 54.87%], valid : [loss = 1.289, top1 = 53.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13470/15625) 013470-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.64%], valid : [loss = 0.445, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.31 ms.
cifar10        train : [loss = 0.055, top1 = 98.66%], test  : [loss = 0.325, top1 = 90.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.38 ms.
cifar100       train : [loss = 0.597, top1 = 83.39%], valid : [loss = 1.226, top1 = 66.34%], test : [loss = 1.195, top1 = 66.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.03%], valid : [loss = 2.481, top1 = 37.37%], test : [loss = 2.480, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.49%], valid : [loss = 0.635, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13471/15625) 013471-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.40%], valid : [loss = 0.613, top1 = 86.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10        train : [loss = 0.050, top1 = 98.51%], test  : [loss = 0.411, top1 = 89.56%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.45 ms.
cifar100       train : [loss = 0.624, top1 = 81.80%], valid : [loss = 1.417, top1 = 63.70%], test : [loss = 1.407, top1 = 64.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 37.53%], valid : [loss = 2.603, top1 = 34.40%], test : [loss = 2.633, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.30%], valid : [loss = 0.831, top1 = 71.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13472/15625) 013472-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.23%], valid : [loss = 0.555, top1 = 84.58%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.203, top1 = 93.17%], test  : [loss = 0.393, top1 = 87.44%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.23 ms.
cifar100       train : [loss = 1.007, top1 = 70.95%], valid : [loss = 1.439, top1 = 60.80%], test : [loss = 1.434, top1 = 61.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.726, top1 = 31.92%], valid : [loss = 2.783, top1 = 31.10%], test : [loss = 2.844, top1 = 29.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.53%], valid : [loss = 0.947, top1 = 66.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13473/15625) 013473-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.094, top1 = 97.25%], valid : [loss = 0.489, top1 = 86.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.104, top1 = 96.66%], test  : [loss = 0.333, top1 = 89.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.46 ms.
cifar100       train : [loss = 0.695, top1 = 79.94%], valid : [loss = 1.241, top1 = 66.92%], test : [loss = 1.205, top1 = 66.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.90 ms.
ImageNet16-120 train : [loss = 2.368, top1 = 39.48%], valid : [loss = 2.487, top1 = 37.67%], test : [loss = 2.482, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.17%], valid : [loss = 0.883, top1 = 68.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13474/15625) 013474-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.477, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.313, top1 = 92.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.320, top1 = 91.39%], valid : [loss = 1.262, top1 = 67.40%], test : [loss = 1.254, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.92 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.90%], valid : [loss = 2.295, top1 = 41.63%], test : [loss = 2.344, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.55%], valid : [loss = 0.590, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13475/15625) 013475-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.582, top1 = 87.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.405, top1 = 91.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.40 ms.
cifar100       train : [loss = 0.187, top1 = 95.72%], valid : [loss = 1.476, top1 = 66.68%], test : [loss = 1.465, top1 = 65.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.10 ms.
ImageNet16-120 train : [loss = 2.008, top1 = 47.37%], valid : [loss = 2.461, top1 = 38.30%], test : [loss = 2.486, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.22%], valid : [loss = 0.730, top1 = 74.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13476/15625) 013476-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.62%], valid : [loss = 0.464, top1 = 86.17%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10        train : [loss = 0.167, top1 = 94.60%], test  : [loss = 0.358, top1 = 88.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.58 ms.
cifar100       train : [loss = 0.991, top1 = 71.87%], valid : [loss = 1.351, top1 = 62.30%], test : [loss = 1.344, top1 = 62.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.46%], valid : [loss = 2.687, top1 = 32.80%], test : [loss = 2.697, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13477/15625) 013477-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.94%], valid : [loss = 0.863, top1 = 71.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.567, top1 = 80.22%], test  : [loss = 0.724, top1 = 75.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.46 ms.
cifar100       train : [loss = 1.783, top1 = 51.80%], valid : [loss = 2.040, top1 = 46.12%], test : [loss = 2.060, top1 = 47.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.81%], valid : [loss = 3.637, top1 = 16.40%], test : [loss = 3.655, top1 = 16.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.197, top1 = 56.94%], valid : [loss = 1.261, top1 = 54.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13478/15625) 013478-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.537, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.41 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.353, top1 = 92.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.21 ms.
cifar100       train : [loss = 0.082, top1 = 98.67%], valid : [loss = 1.414, top1 = 68.83%], test : [loss = 1.437, top1 = 68.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.27%], valid : [loss = 2.364, top1 = 41.18%], test : [loss = 2.361, top1 = 42.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.15%], valid : [loss = 0.671, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13479/15625) 013479-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=19.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.543, top1 = 89.14%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=19.46 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.368, top1 = 92.45%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=18.59 ms.
cifar100       train : [loss = 0.079, top1 = 98.74%], valid : [loss = 1.446, top1 = 68.33%], test : [loss = 1.455, top1 = 68.43%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=18.91 ms.
ImageNet16-120 train : [loss = 1.782, top1 = 52.69%], valid : [loss = 2.376, top1 = 40.84%], test : [loss = 2.399, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.70%], valid : [loss = 0.679, top1 = 76.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13480/15625) 013480-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.80%], valid : [loss = 0.575, top1 = 88.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.410, top1 = 90.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.376, top1 = 89.33%], valid : [loss = 1.495, top1 = 62.96%], test : [loss = 1.451, top1 = 63.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 2.439, top1 = 37.51%], valid : [loss = 2.622, top1 = 34.27%], test : [loss = 2.648, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.38%], valid : [loss = 1.098, top1 = 60.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13481/15625) 013481-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.479, top1 = 88.95%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.15 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.316, top1 = 91.87%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.41 ms.
cifar100       train : [loss = 0.275, top1 = 92.90%], valid : [loss = 1.211, top1 = 69.09%], test : [loss = 1.215, top1 = 68.95%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.40%], valid : [loss = 2.237, top1 = 42.37%], test : [loss = 2.272, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 80.96%], valid : [loss = 0.620, top1 = 78.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13482/15625) 013482-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.523, top1 = 88.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.019, top1 = 99.56%], test  : [loss = 0.366, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.389, top1 = 88.88%], valid : [loss = 1.341, top1 = 66.53%], test : [loss = 1.343, top1 = 66.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.210, top1 = 42.83%], valid : [loss = 2.412, top1 = 39.10%], test : [loss = 2.484, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.59%], valid : [loss = 0.640, top1 = 78.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13483/15625) 013483-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.527, top1 = 88.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.329, top1 = 91.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.24 ms.
cifar100       train : [loss = 0.343, top1 = 90.67%], valid : [loss = 1.295, top1 = 67.18%], test : [loss = 1.321, top1 = 67.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.20%], valid : [loss = 2.389, top1 = 39.87%], test : [loss = 2.448, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13484/15625) 013484-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.20%], valid : [loss = 0.461, top1 = 86.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.171, top1 = 94.31%], test  : [loss = 0.362, top1 = 88.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.92 ms.
cifar100       train : [loss = 0.999, top1 = 71.64%], valid : [loss = 1.354, top1 = 61.76%], test : [loss = 1.331, top1 = 62.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.82%], valid : [loss = 2.667, top1 = 32.87%], test : [loss = 2.716, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13485/15625) 013485-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.580, top1 = 87.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.05 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.395, top1 = 91.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.95 ms.
cifar100       train : [loss = 0.392, top1 = 88.95%], valid : [loss = 1.395, top1 = 65.60%], test : [loss = 1.377, top1 = 65.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.98 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.04%], valid : [loss = 2.508, top1 = 37.46%], test : [loss = 2.525, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13486/15625) 013486-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.576, top1 = 87.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.388, top1 = 91.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.98 ms.
cifar100       train : [loss = 0.394, top1 = 88.92%], valid : [loss = 1.395, top1 = 65.03%], test : [loss = 1.408, top1 = 65.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.10 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.77%], valid : [loss = 2.515, top1 = 36.82%], test : [loss = 2.543, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13487/15625) 013487-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.603, top1 = 88.12%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.382, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.087, top1 = 98.48%], valid : [loss = 1.549, top1 = 67.70%], test : [loss = 1.549, top1 = 66.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.21 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.50%], valid : [loss = 2.456, top1 = 38.67%], test : [loss = 2.456, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.34%], valid : [loss = 0.702, top1 = 75.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13488/15625) 013488-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.562, top1 = 88.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.27 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.369, top1 = 91.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.94 ms.
cifar100       train : [loss = 0.173, top1 = 96.30%], valid : [loss = 1.401, top1 = 66.10%], test : [loss = 1.412, top1 = 66.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.88%], valid : [loss = 2.450, top1 = 39.03%], test : [loss = 2.463, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.17%], valid : [loss = 0.681, top1 = 76.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13489/15625) 013489-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.83%], valid : [loss = 0.861, top1 = 70.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.66 ms.
cifar10        train : [loss = 0.696, top1 = 75.73%], test  : [loss = 0.788, top1 = 72.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.05 ms.
cifar100       train : [loss = 1.969, top1 = 47.75%], valid : [loss = 2.136, top1 = 44.68%], test : [loss = 2.151, top1 = 44.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 3.655, top1 = 15.57%], valid : [loss = 3.670, top1 = 15.00%], test : [loss = 3.693, top1 = 15.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.380, top1 = 49.95%], valid : [loss = 1.405, top1 = 49.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13490/15625) 013490-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.143, top1 = 95.43%], valid : [loss = 0.518, top1 = 84.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10        train : [loss = 0.163, top1 = 94.65%], test  : [loss = 0.390, top1 = 88.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.10 ms.
cifar100       train : [loss = 1.120, top1 = 68.11%], valid : [loss = 1.479, top1 = 59.60%], test : [loss = 1.484, top1 = 59.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.07%], valid : [loss = 2.658, top1 = 33.23%], test : [loss = 2.723, top1 = 32.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 67.17%], valid : [loss = 0.979, top1 = 65.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13491/15625) 013491-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.16 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.80%], valid : [loss = 0.473, top1 = 84.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10        train : [loss = 0.301, top1 = 90.13%], test  : [loss = 0.408, top1 = 86.41%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.35 ms.
cifar100       train : [loss = 1.324, top1 = 63.21%], valid : [loss = 1.537, top1 = 58.06%], test : [loss = 1.505, top1 = 58.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.22 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.44%], valid : [loss = 2.911, top1 = 29.37%], test : [loss = 2.966, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13492/15625) 013492-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=19.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.502, top1 = 89.06%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=18.72 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.330, top1 = 92.24%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=18.98 ms.
cifar100       train : [loss = 0.218, top1 = 94.64%], valid : [loss = 1.267, top1 = 68.66%], test : [loss = 1.277, top1 = 68.55%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.49%], valid : [loss = 2.256, top1 = 42.36%], test : [loss = 2.269, top1 = 42.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.620, top1 = 77.92%], valid : [loss = 0.703, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13493/15625) 013493-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.65%], valid : [loss = 0.617, top1 = 86.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.388, top1 = 90.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=18.68 ms.
cifar100       train : [loss = 0.541, top1 = 84.15%], valid : [loss = 1.441, top1 = 62.82%], test : [loss = 1.426, top1 = 64.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.386, top1 = 39.12%], valid : [loss = 2.607, top1 = 34.50%], test : [loss = 2.579, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.38%], valid : [loss = 0.854, top1 = 69.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13494/15625) 013494-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.131, top1 = 96.07%], valid : [loss = 0.467, top1 = 85.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10        train : [loss = 0.157, top1 = 94.93%], test  : [loss = 0.341, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.47 ms.
cifar100       train : [loss = 1.011, top1 = 71.18%], valid : [loss = 1.369, top1 = 61.98%], test : [loss = 1.365, top1 = 61.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.71%], valid : [loss = 2.675, top1 = 33.57%], test : [loss = 2.706, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13495/15625) 013495-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.65%], valid : [loss = 0.572, top1 = 87.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.04 ms.
cifar10        train : [loss = 0.030, top1 = 99.11%], test  : [loss = 0.380, top1 = 90.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.00 ms.
cifar100       train : [loss = 0.451, top1 = 87.14%], valid : [loss = 1.318, top1 = 65.92%], test : [loss = 1.323, top1 = 66.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.302, top1 = 40.71%], valid : [loss = 2.450, top1 = 37.67%], test : [loss = 2.455, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 70.07%], valid : [loss = 0.878, top1 = 69.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13496/15625) 013496-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.548, top1 = 88.32%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.361, top1 = 91.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.65 ms.
cifar100       train : [loss = 0.195, top1 = 95.16%], valid : [loss = 1.305, top1 = 67.24%], test : [loss = 1.319, top1 = 67.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.461, top1 = 37.02%], valid : [loss = 2.600, top1 = 33.90%], test : [loss = 2.589, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.59%], valid : [loss = 0.984, top1 = 64.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13497/15625) 013497-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.214, top1 = 92.82%], valid : [loss = 0.569, top1 = 83.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10        train : [loss = 0.191, top1 = 93.53%], test  : [loss = 0.407, top1 = 87.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.53 ms.
cifar100       train : [loss = 1.251, top1 = 64.30%], valid : [loss = 1.551, top1 = 56.72%], test : [loss = 1.561, top1 = 57.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.777, top1 = 30.97%], valid : [loss = 2.814, top1 = 29.10%], test : [loss = 2.827, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 66.90%], valid : [loss = 0.971, top1 = 65.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13498/15625) 013498-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.457, top1 = 89.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.60 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.315, top1 = 92.37%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.24 ms.
cifar100       train : [loss = 0.183, top1 = 95.76%], valid : [loss = 1.325, top1 = 68.54%], test : [loss = 1.334, top1 = 68.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 1.833, top1 = 51.46%], valid : [loss = 2.273, top1 = 42.13%], test : [loss = 2.326, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.433, top1 = 85.01%], valid : [loss = 0.539, top1 = 81.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13499/15625) 013499-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.78%], valid : [loss = 0.633, top1 = 86.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.400, top1 = 90.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.53 ms.
cifar100       train : [loss = 0.498, top1 = 85.54%], valid : [loss = 1.410, top1 = 64.24%], test : [loss = 1.388, top1 = 64.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.16%], valid : [loss = 2.560, top1 = 35.67%], test : [loss = 2.585, top1 = 35.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.66%], valid : [loss = 0.840, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13500/15625) 013500-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.48%], valid : [loss = 0.567, top1 = 87.55%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.08 ms.
cifar10        train : [loss = 0.034, top1 = 98.98%], test  : [loss = 0.359, top1 = 91.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.43 ms.
cifar100       train : [loss = 0.573, top1 = 83.23%], valid : [loss = 1.376, top1 = 63.92%], test : [loss = 1.395, top1 = 62.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.20%], valid : [loss = 2.623, top1 = 33.27%], test : [loss = 2.674, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.12%], valid : [loss = 0.892, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13501/15625) 013501-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.30%], valid : [loss = 0.453, top1 = 87.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.38 ms.
cifar10        train : [loss = 0.110, top1 = 96.57%], test  : [loss = 0.324, top1 = 89.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.58 ms.
cifar100       train : [loss = 0.859, top1 = 75.65%], valid : [loss = 1.286, top1 = 64.05%], test : [loss = 1.285, top1 = 63.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.76%], valid : [loss = 2.627, top1 = 34.23%], test : [loss = 2.643, top1 = 34.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.06%], valid : [loss = 0.652, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13502/15625) 013502-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.100, top1 = 96.95%], valid : [loss = 0.846, top1 = 79.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10        train : [loss = 0.146, top1 = 95.09%], test  : [loss = 0.517, top1 = 84.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 0.989, top1 = 71.41%], valid : [loss = 1.643, top1 = 56.42%], test : [loss = 1.647, top1 = 57.03%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 2.893, top1 = 28.86%], valid : [loss = 3.026, top1 = 26.90%], test : [loss = 3.075, top1 = 26.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.54%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13503/15625) 013503-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.86 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.512, top1 = 89.96%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.95 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.325, top1 = 93.23%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.68 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.315, top1 = 70.02%], test : [loss = 1.371, top1 = 69.56%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=23.76 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.67%], valid : [loss = 2.313, top1 = 40.77%], test : [loss = 2.291, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.30%], valid : [loss = 0.648, top1 = 77.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13504/15625) 013504-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.47%], valid : [loss = 0.657, top1 = 84.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.86 ms.
cifar10        train : [loss = 0.080, top1 = 97.41%], test  : [loss = 0.407, top1 = 88.98%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.60 ms.
cifar100       train : [loss = 0.747, top1 = 78.20%], valid : [loss = 1.423, top1 = 62.74%], test : [loss = 1.416, top1 = 62.40%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.560, top1 = 35.44%], valid : [loss = 2.695, top1 = 32.73%], test : [loss = 2.738, top1 = 31.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.46%], valid : [loss = 0.854, top1 = 69.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13505/15625) 013505-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.85 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.25%], valid : [loss = 0.615, top1 = 85.00%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.47 ms.
cifar10        train : [loss = 0.083, top1 = 97.32%], test  : [loss = 0.413, top1 = 88.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=17.41 ms.
cifar100       train : [loss = 0.692, top1 = 79.38%], valid : [loss = 1.522, top1 = 60.60%], test : [loss = 1.542, top1 = 60.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 3.214, top1 = 21.74%], valid : [loss = 3.228, top1 = 20.90%], test : [loss = 3.249, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.065, top1 = 61.71%], valid : [loss = 1.070, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13506/15625) 013506-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.544, top1 = 88.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.85 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.347, top1 = 92.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.61 ms.
cifar100       train : [loss = 0.133, top1 = 97.47%], valid : [loss = 1.380, top1 = 68.34%], test : [loss = 1.407, top1 = 68.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.12%], valid : [loss = 2.392, top1 = 40.57%], test : [loss = 2.446, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.06%], valid : [loss = 0.676, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13507/15625) 013507-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.536, top1 = 89.54%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.83 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.342, top1 = 93.33%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.10 ms.
cifar100       train : [loss = 0.020, top1 = 99.87%], valid : [loss = 1.377, top1 = 71.68%], test : [loss = 1.448, top1 = 70.28%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.80 ms.
ImageNet16-120 train : [loss = 1.392, top1 = 62.08%], valid : [loss = 2.437, top1 = 42.03%], test : [loss = 2.410, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.18%], valid : [loss = 0.654, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13508/15625) 013508-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.529, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.332, top1 = 92.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.24 ms.
cifar100       train : [loss = 0.338, top1 = 90.84%], valid : [loss = 1.310, top1 = 66.90%], test : [loss = 1.290, top1 = 66.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.72%], valid : [loss = 2.388, top1 = 38.53%], test : [loss = 2.444, top1 = 37.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.68%], valid : [loss = 0.746, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13509/15625) 013509-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.568, top1 = 87.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.08 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.375, top1 = 91.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.64 ms.
cifar100       train : [loss = 0.373, top1 = 89.46%], valid : [loss = 1.437, top1 = 65.29%], test : [loss = 1.400, top1 = 65.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.26%], valid : [loss = 2.500, top1 = 37.56%], test : [loss = 2.525, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.16%], valid : [loss = 0.791, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13510/15625) 013510-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.503, top1 = 88.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.332, top1 = 92.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.37 ms.
cifar100       train : [loss = 0.320, top1 = 91.38%], valid : [loss = 1.259, top1 = 67.55%], test : [loss = 1.278, top1 = 67.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.107, top1 = 45.12%], valid : [loss = 2.395, top1 = 39.44%], test : [loss = 2.400, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13511/15625) 013511-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.596, top1 = 87.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.92 ms.
cifar10        train : [loss = 0.017, top1 = 99.50%], test  : [loss = 0.392, top1 = 91.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.95 ms.
cifar100       train : [loss = 0.407, top1 = 88.46%], valid : [loss = 1.479, top1 = 63.98%], test : [loss = 1.472, top1 = 63.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 3.103, top1 = 23.48%], valid : [loss = 3.118, top1 = 23.60%], test : [loss = 3.122, top1 = 22.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13512/15625) 013512-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.03%], valid : [loss = 0.463, top1 = 86.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.75 ms.
cifar10        train : [loss = 0.162, top1 = 94.75%], test  : [loss = 0.352, top1 = 88.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.06 ms.
cifar100       train : [loss = 1.011, top1 = 71.12%], valid : [loss = 1.338, top1 = 62.04%], test : [loss = 1.375, top1 = 61.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.31%], valid : [loss = 2.724, top1 = 32.87%], test : [loss = 2.730, top1 = 31.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13513/15625) 013513-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.543, top1 = 88.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.374, top1 = 91.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.86 ms.
cifar100       train : [loss = 0.165, top1 = 96.34%], valid : [loss = 1.435, top1 = 66.91%], test : [loss = 1.406, top1 = 67.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.24%], valid : [loss = 2.348, top1 = 40.79%], test : [loss = 2.371, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.26%], valid : [loss = 0.669, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13514/15625) 013514-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.33%], valid : [loss = 0.543, top1 = 87.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.30 ms.
cifar10        train : [loss = 0.064, top1 = 97.97%], test  : [loss = 0.375, top1 = 89.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.54 ms.
cifar100       train : [loss = 0.718, top1 = 78.93%], valid : [loss = 1.371, top1 = 63.72%], test : [loss = 1.363, top1 = 63.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 39.19%], valid : [loss = 2.505, top1 = 37.20%], test : [loss = 2.544, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.78%], valid : [loss = 0.839, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13515/15625) 013515-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.473, top1 = 88.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.299, top1 = 92.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.95 ms.
cifar100       train : [loss = 0.331, top1 = 91.11%], valid : [loss = 1.241, top1 = 67.28%], test : [loss = 1.250, top1 = 67.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.11 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.92%], valid : [loss = 2.283, top1 = 42.47%], test : [loss = 2.332, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.49%], valid : [loss = 0.628, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13516/15625) 013516-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.512, top1 = 88.67%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.322, top1 = 92.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.92 ms.
cifar100       train : [loss = 0.353, top1 = 90.31%], valid : [loss = 1.276, top1 = 67.06%], test : [loss = 1.291, top1 = 67.42%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.66%], valid : [loss = 2.435, top1 = 37.97%], test : [loss = 2.437, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.87%], valid : [loss = 0.717, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13517/15625) 013517-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.553, top1 = 87.88%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.75 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.356, top1 = 91.80%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.93 ms.
cifar100       train : [loss = 0.270, top1 = 92.68%], valid : [loss = 1.304, top1 = 67.78%], test : [loss = 1.306, top1 = 67.70%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=23.12 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.41%], valid : [loss = 2.323, top1 = 40.43%], test : [loss = 2.321, top1 = 39.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.69%], valid : [loss = 0.909, top1 = 67.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13518/15625) 013518-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.50 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.50%], valid : [loss = 0.623, top1 = 86.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10        train : [loss = 0.029, top1 = 99.16%], test  : [loss = 0.385, top1 = 90.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.31 ms.
cifar100       train : [loss = 0.522, top1 = 84.74%], valid : [loss = 1.462, top1 = 62.48%], test : [loss = 1.445, top1 = 63.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.21%], valid : [loss = 2.561, top1 = 35.73%], test : [loss = 2.567, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.00%], valid : [loss = 0.887, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13519/15625) 013519-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.72%], valid : [loss = 0.623, top1 = 85.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.43 ms.
cifar10        train : [loss = 0.030, top1 = 99.21%], test  : [loss = 0.387, top1 = 90.05%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.25 ms.
cifar100       train : [loss = 0.500, top1 = 85.44%], valid : [loss = 1.407, top1 = 64.12%], test : [loss = 1.385, top1 = 64.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.409, top1 = 38.61%], valid : [loss = 2.582, top1 = 34.90%], test : [loss = 2.569, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.33%], valid : [loss = 0.838, top1 = 70.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13520/15625) 013520-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.574, top1 = 88.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.36 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.397, top1 = 91.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.39 ms.
cifar100       train : [loss = 0.101, top1 = 98.08%], valid : [loss = 1.479, top1 = 67.18%], test : [loss = 1.521, top1 = 66.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.63%], valid : [loss = 2.444, top1 = 38.53%], test : [loss = 2.451, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.622, top1 = 78.29%], valid : [loss = 0.730, top1 = 74.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13521/15625) 013521-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.92%], valid : [loss = 0.483, top1 = 84.36%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.59 ms.
cifar10        train : [loss = 0.297, top1 = 90.06%], test  : [loss = 0.398, top1 = 86.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 1.331, top1 = 63.37%], valid : [loss = 1.526, top1 = 57.68%], test : [loss = 1.511, top1 = 57.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.48%], valid : [loss = 2.888, top1 = 28.67%], test : [loss = 2.959, top1 = 27.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13522/15625) 013522-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.21%], valid : [loss = 0.569, top1 = 82.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10        train : [loss = 0.226, top1 = 92.25%], test  : [loss = 0.411, top1 = 86.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.93 ms.
cifar100       train : [loss = 1.305, top1 = 62.88%], valid : [loss = 1.595, top1 = 56.14%], test : [loss = 1.587, top1 = 56.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 2.772, top1 = 31.20%], valid : [loss = 2.801, top1 = 31.23%], test : [loss = 2.848, top1 = 30.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.970, top1 = 64.90%], valid : [loss = 1.030, top1 = 63.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13523/15625) 013523-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.303, top1 = 89.56%], valid : [loss = 0.535, top1 = 83.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.291, top1 = 90.02%], test  : [loss = 0.438, top1 = 85.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.32 ms.
cifar100       train : [loss = 1.374, top1 = 61.35%], valid : [loss = 1.621, top1 = 55.54%], test : [loss = 1.616, top1 = 56.28%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.49 ms.
ImageNet16-120 train : [loss = 2.895, top1 = 28.83%], valid : [loss = 2.899, top1 = 29.07%], test : [loss = 2.967, top1 = 27.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.72%], valid : [loss = 1.003, top1 = 64.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13524/15625) 013524-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.608, top1 = 87.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.64 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.409, top1 = 91.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.17 ms.
cifar100       train : [loss = 0.148, top1 = 96.95%], valid : [loss = 1.464, top1 = 67.22%], test : [loss = 1.498, top1 = 65.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.91%], valid : [loss = 2.398, top1 = 40.20%], test : [loss = 2.448, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 80.83%], valid : [loss = 0.655, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13525/15625) 013525-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.553, top1 = 88.81%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.41 ms.
cifar10        train : [loss = 0.009, top1 = 99.78%], test  : [loss = 0.359, top1 = 92.24%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.99 ms.
cifar100       train : [loss = 0.170, top1 = 95.76%], valid : [loss = 1.361, top1 = 68.60%], test : [loss = 1.348, top1 = 69.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.06 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.57%], valid : [loss = 2.229, top1 = 42.73%], test : [loss = 2.219, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.46%], valid : [loss = 0.784, top1 = 72.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13526/15625) 013526-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.74%], valid : [loss = 0.613, top1 = 84.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.42 ms.
cifar10        train : [loss = 0.081, top1 = 97.33%], test  : [loss = 0.409, top1 = 88.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.36 ms.
cifar100       train : [loss = 0.739, top1 = 78.29%], valid : [loss = 1.567, top1 = 60.02%], test : [loss = 1.586, top1 = 59.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 3.215, top1 = 21.68%], valid : [loss = 3.201, top1 = 22.70%], test : [loss = 3.251, top1 = 20.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 63.04%], valid : [loss = 1.057, top1 = 62.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13527/15625) 013527-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.14 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13528/15625) 013528-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.84%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.334, top1 = 93.30%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.01 ms.
cifar100       train : [loss = 0.060, top1 = 98.98%], valid : [loss = 1.362, top1 = 70.36%], test : [loss = 1.380, top1 = 69.94%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 1.592, top1 = 57.02%], valid : [loss = 2.231, top1 = 43.13%], test : [loss = 2.206, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.58%], valid : [loss = 0.593, top1 = 79.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13529/15625) 013529-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.475, top1 = 89.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.88 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.324, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.46 ms.
cifar100       train : [loss = 0.280, top1 = 92.52%], valid : [loss = 1.344, top1 = 67.68%], test : [loss = 1.331, top1 = 67.96%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.64%], valid : [loss = 2.326, top1 = 40.87%], test : [loss = 2.341, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.69%], valid : [loss = 0.607, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13530/15625) 013530-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.52 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.15%], valid : [loss = 0.595, top1 = 86.41%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.18 ms.
cifar10        train : [loss = 0.064, top1 = 97.99%], test  : [loss = 0.375, top1 = 89.63%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.60 ms.
cifar100       train : [loss = 0.674, top1 = 79.83%], valid : [loss = 1.305, top1 = 64.74%], test : [loss = 1.305, top1 = 65.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.95%], valid : [loss = 2.476, top1 = 37.10%], test : [loss = 2.505, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.59%], valid : [loss = 0.781, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13531/15625) 013531-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.537, top1 = 89.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.363, top1 = 92.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.78 ms.
cifar100       train : [loss = 0.173, top1 = 95.73%], valid : [loss = 1.380, top1 = 67.68%], test : [loss = 1.404, top1 = 67.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.15%], valid : [loss = 2.458, top1 = 37.07%], test : [loss = 2.416, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 68.94%], valid : [loss = 0.921, top1 = 66.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13532/15625) 013532-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.521, top1 = 89.74%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.80 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.323, top1 = 93.38%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.73 ms.
cifar100       train : [loss = 0.073, top1 = 98.79%], valid : [loss = 1.300, top1 = 70.88%], test : [loss = 1.308, top1 = 70.78%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=25.31 ms.
ImageNet16-120 train : [loss = 1.637, top1 = 56.02%], valid : [loss = 2.173, top1 = 44.20%], test : [loss = 2.196, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.782, top1 = 72.16%], valid : [loss = 0.834, top1 = 70.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13533/15625) 013533-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.263, top1 = 90.97%], valid : [loss = 0.533, top1 = 83.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10        train : [loss = 0.239, top1 = 91.76%], test  : [loss = 0.392, top1 = 87.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.85 ms.
cifar100       train : [loss = 1.344, top1 = 62.11%], valid : [loss = 1.605, top1 = 56.44%], test : [loss = 1.603, top1 = 56.17%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 2.838, top1 = 29.95%], valid : [loss = 2.859, top1 = 29.34%], test : [loss = 2.911, top1 = 28.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.000, top1 = 64.08%], valid : [loss = 1.037, top1 = 63.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13534/15625) 013534-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.604, top1 = 86.67%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.55 ms.
cifar10        train : [loss = 0.029, top1 = 99.29%], test  : [loss = 0.411, top1 = 90.16%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.07 ms.
cifar100       train : [loss = 0.374, top1 = 90.04%], valid : [loss = 1.414, top1 = 65.26%], test : [loss = 1.428, top1 = 64.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.313, top1 = 40.60%], valid : [loss = 2.591, top1 = 35.83%], test : [loss = 2.634, top1 = 35.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.92%], valid : [loss = 0.761, top1 = 73.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13535/15625) 013535-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.46%], valid : [loss = 0.551, top1 = 86.90%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10        train : [loss = 0.049, top1 = 98.49%], test  : [loss = 0.368, top1 = 89.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.86 ms.
cifar100       train : [loss = 0.600, top1 = 82.36%], valid : [loss = 1.338, top1 = 64.80%], test : [loss = 1.294, top1 = 65.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.63 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.56%], valid : [loss = 2.512, top1 = 36.60%], test : [loss = 2.545, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.71%], valid : [loss = 0.644, top1 = 78.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13536/15625) 013536-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.11 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.66%], valid : [loss = 0.467, top1 = 86.36%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.95 ms.
cifar10        train : [loss = 0.128, top1 = 95.96%], test  : [loss = 0.346, top1 = 89.04%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.36 ms.
cifar100       train : [loss = 0.756, top1 = 78.81%], valid : [loss = 1.277, top1 = 64.43%], test : [loss = 1.277, top1 = 64.59%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 2.499, top1 = 36.80%], valid : [loss = 2.589, top1 = 34.63%], test : [loss = 2.609, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13537/15625) 013537-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10-valid  train : [loss = 0.670, top1 = 76.58%], valid : [loss = 0.848, top1 = 71.23%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 0.668, top1 = 76.62%], test  : [loss = 0.759, top1 = 73.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.71 ms.
cifar100       train : [loss = 1.960, top1 = 47.78%], valid : [loss = 2.131, top1 = 44.53%], test : [loss = 2.152, top1 = 44.33%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.04 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.72%], valid : [loss = 3.670, top1 = 15.78%], test : [loss = 3.698, top1 = 14.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13538/15625) 013538-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.461, top1 = 89.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.312, top1 = 92.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 0.329, top1 = 91.15%], valid : [loss = 1.311, top1 = 66.84%], test : [loss = 1.324, top1 = 66.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.55 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.31%], valid : [loss = 2.389, top1 = 40.17%], test : [loss = 2.393, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13539/15625) 013539-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.02 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.400, top1 = 91.35%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.02 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.266, top1 = 94.19%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.25 ms.
cifar100       train : [loss = 0.026, top1 = 99.77%], valid : [loss = 1.323, top1 = 72.48%], test : [loss = 1.317, top1 = 72.64%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 1.228, top1 = 66.00%], valid : [loss = 2.292, top1 = 45.47%], test : [loss = 2.249, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.338, top1 = 88.42%], valid : [loss = 0.489, top1 = 84.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13540/15625) 013540-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.452, top1 = 89.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.315, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.327, top1 = 91.17%], valid : [loss = 1.295, top1 = 67.47%], test : [loss = 1.299, top1 = 67.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.14%], valid : [loss = 2.371, top1 = 40.29%], test : [loss = 2.395, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.470, top1 = 83.66%], valid : [loss = 0.563, top1 = 81.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13541/15625) 013541-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.86%], valid : [loss = 0.572, top1 = 86.08%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.95 ms.
cifar10        train : [loss = 0.071, top1 = 97.75%], test  : [loss = 0.386, top1 = 89.60%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.13 ms.
cifar100       train : [loss = 0.529, top1 = 84.62%], valid : [loss = 1.355, top1 = 65.32%], test : [loss = 1.353, top1 = 65.62%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.357, top1 = 39.51%], valid : [loss = 2.536, top1 = 36.37%], test : [loss = 2.566, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.30%], valid : [loss = 0.960, top1 = 65.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13542/15625) 013542-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.11%], valid : [loss = 0.550, top1 = 83.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.198, top1 = 93.38%], test  : [loss = 0.394, top1 = 87.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.80 ms.
cifar100       train : [loss = 1.266, top1 = 64.05%], valid : [loss = 1.558, top1 = 57.61%], test : [loss = 1.571, top1 = 56.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 2.710, top1 = 32.47%], valid : [loss = 2.731, top1 = 31.56%], test : [loss = 2.800, top1 = 30.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13543/15625) 013543-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.509, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10        train : [loss = 0.013, top1 = 99.63%], test  : [loss = 0.363, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.48 ms.
cifar100       train : [loss = 0.273, top1 = 92.81%], valid : [loss = 1.279, top1 = 67.42%], test : [loss = 1.287, top1 = 67.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.41%], valid : [loss = 2.232, top1 = 42.03%], test : [loss = 2.269, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.20%], valid : [loss = 0.652, top1 = 77.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13544/15625) 013544-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.561, top1 = 87.90%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.10 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.364, top1 = 91.66%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.24 ms.
cifar100       train : [loss = 0.295, top1 = 91.78%], valid : [loss = 1.290, top1 = 67.94%], test : [loss = 1.369, top1 = 66.76%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.83%], valid : [loss = 2.425, top1 = 38.43%], test : [loss = 2.403, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.48%], valid : [loss = 0.883, top1 = 68.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13545/15625) 013545-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.574, top1 = 88.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.88 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.352, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.09 ms.
cifar100       train : [loss = 0.064, top1 = 99.07%], valid : [loss = 1.437, top1 = 69.40%], test : [loss = 1.471, top1 = 68.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.74%], valid : [loss = 2.352, top1 = 40.70%], test : [loss = 2.433, top1 = 41.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.40%], valid : [loss = 0.669, top1 = 77.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13546/15625) 013546-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.55%], valid : [loss = 0.618, top1 = 86.35%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.039, top1 = 98.89%], test  : [loss = 0.400, top1 = 89.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.02 ms.
cifar100       train : [loss = 0.521, top1 = 84.67%], valid : [loss = 1.417, top1 = 64.08%], test : [loss = 1.392, top1 = 64.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 39.09%], valid : [loss = 2.568, top1 = 35.30%], test : [loss = 2.579, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.46%], valid : [loss = 0.881, top1 = 69.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13547/15625) 013547-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.482, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.63 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.358, top1 = 91.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.29 ms.
cifar100       train : [loss = 0.285, top1 = 92.32%], valid : [loss = 1.317, top1 = 67.48%], test : [loss = 1.266, top1 = 68.68%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.17%], valid : [loss = 2.316, top1 = 41.00%], test : [loss = 2.399, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.30%], valid : [loss = 0.591, top1 = 79.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13548/15625) 013548-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.569, top1 = 87.84%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.28 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.341, top1 = 91.99%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.09 ms.
cifar100       train : [loss = 0.339, top1 = 90.36%], valid : [loss = 1.318, top1 = 67.04%], test : [loss = 1.341, top1 = 66.74%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.37 ms.
ImageNet16-120 train : [loss = 2.585, top1 = 34.24%], valid : [loss = 2.673, top1 = 32.67%], test : [loss = 2.676, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.84%], valid : [loss = 0.937, top1 = 66.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13549/15625) 013549-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.27 ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.48%], valid : [loss = 0.864, top1 = 70.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.96 ms.
cifar10        train : [loss = 0.680, top1 = 76.10%], test  : [loss = 0.766, top1 = 73.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.17 ms.
cifar100       train : [loss = 2.015, top1 = 46.46%], valid : [loss = 2.180, top1 = 43.56%], test : [loss = 2.207, top1 = 43.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.72 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.77%], valid : [loss = 3.672, top1 = 15.83%], test : [loss = 3.691, top1 = 14.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13550/15625) 013550-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.311, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.327, top1 = 91.18%], valid : [loss = 1.304, top1 = 66.91%], test : [loss = 1.327, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.16%], valid : [loss = 2.383, top1 = 40.22%], test : [loss = 2.406, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13551/15625) 013551-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.426, top1 = 91.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.17 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.293, top1 = 93.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.77 ms.
cifar100       train : [loss = 0.056, top1 = 99.33%], valid : [loss = 1.343, top1 = 70.34%], test : [loss = 1.339, top1 = 71.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.96 ms.
ImageNet16-120 train : [loss = 1.507, top1 = 59.18%], valid : [loss = 2.266, top1 = 43.93%], test : [loss = 2.276, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.39%], valid : [loss = 0.519, top1 = 82.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13552/15625) 013552-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.560, top1 = 88.79%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=23.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.84%], test  : [loss = 0.339, top1 = 92.56%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.04 ms.
cifar100       train : [loss = 0.184, top1 = 95.76%], valid : [loss = 1.546, top1 = 64.44%], test : [loss = 1.541, top1 = 64.98%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.98 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.22%], valid : [loss = 2.473, top1 = 36.33%], test : [loss = 2.528, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.10%], valid : [loss = 0.987, top1 = 64.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13553/15625) 013553-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.531, top1 = 88.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.350, top1 = 92.41%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.15 ms.
cifar100       train : [loss = 0.159, top1 = 96.37%], valid : [loss = 1.359, top1 = 67.76%], test : [loss = 1.378, top1 = 68.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.55%], valid : [loss = 2.329, top1 = 41.57%], test : [loss = 2.331, top1 = 40.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 78.09%], valid : [loss = 0.697, top1 = 75.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13554/15625) 013554-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.47 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.62%], valid : [loss = 0.542, top1 = 88.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.341, top1 = 91.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.02 ms.
cifar100       train : [loss = 0.416, top1 = 87.93%], valid : [loss = 1.249, top1 = 67.30%], test : [loss = 1.283, top1 = 66.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.234, top1 = 42.25%], valid : [loss = 2.426, top1 = 38.73%], test : [loss = 2.425, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.07%], valid : [loss = 0.842, top1 = 70.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13555/15625) 013555-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.577, top1 = 88.04%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.31 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.381, top1 = 92.12%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.91 ms.
cifar100       train : [loss = 0.090, top1 = 98.35%], valid : [loss = 1.566, top1 = 66.68%], test : [loss = 1.536, top1 = 67.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.59%], valid : [loss = 2.392, top1 = 39.83%], test : [loss = 2.395, top1 = 41.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.71%], valid : [loss = 0.802, top1 = 71.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13556/15625) 013556-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.82%], valid : [loss = 0.558, top1 = 88.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.351, top1 = 91.77%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.26 ms.
cifar100       train : [loss = 0.288, top1 = 92.01%], valid : [loss = 1.301, top1 = 68.60%], test : [loss = 1.322, top1 = 67.12%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 43.87%], valid : [loss = 2.409, top1 = 37.90%], test : [loss = 2.405, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13557/15625) 013557-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.19%], valid : [loss = 0.765, top1 = 80.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.79 ms.
cifar10        train : [loss = 0.146, top1 = 95.07%], test  : [loss = 0.431, top1 = 87.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.04 ms.
cifar100       train : [loss = 0.972, top1 = 71.70%], valid : [loss = 1.635, top1 = 56.38%], test : [loss = 1.644, top1 = 57.22%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.61 ms.
ImageNet16-120 train : [loss = 3.090, top1 = 24.60%], valid : [loss = 3.137, top1 = 24.57%], test : [loss = 3.204, top1 = 22.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.50%], valid : [loss = 0.982, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13558/15625) 013558-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.561, top1 = 88.68%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.61 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.372, top1 = 92.01%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=20.29 ms.
cifar100       train : [loss = 0.139, top1 = 97.25%], valid : [loss = 1.406, top1 = 68.66%], test : [loss = 1.382, top1 = 68.66%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.86 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 50.04%], valid : [loss = 2.423, top1 = 39.50%], test : [loss = 2.422, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.26%], valid : [loss = 0.692, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13559/15625) 013559-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.552, top1 = 88.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.335, top1 = 91.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.313, top1 = 91.63%], valid : [loss = 1.296, top1 = 66.66%], test : [loss = 1.300, top1 = 67.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.65%], valid : [loss = 2.358, top1 = 39.78%], test : [loss = 2.376, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.847, top1 = 69.63%], valid : [loss = 0.871, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13560/15625) 013560-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.46 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.557, top1 = 89.37%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.47 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.332, top1 = 93.34%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=23.88 ms.
cifar100       train : [loss = 0.021, top1 = 99.87%], valid : [loss = 1.413, top1 = 70.64%], test : [loss = 1.405, top1 = 70.40%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 1.414, top1 = 61.54%], valid : [loss = 2.382, top1 = 42.97%], test : [loss = 2.401, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.26%], valid : [loss = 0.650, top1 = 77.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13561/15625) 013561-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.472, top1 = 89.74%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.91 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.319, top1 = 92.88%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.87 ms.
cifar100       train : [loss = 0.124, top1 = 97.74%], valid : [loss = 1.252, top1 = 69.90%], test : [loss = 1.244, top1 = 69.70%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.85 ms.
ImageNet16-120 train : [loss = 1.693, top1 = 54.63%], valid : [loss = 2.140, top1 = 45.13%], test : [loss = 2.182, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.22%], valid : [loss = 0.619, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13562/15625) 013562-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.66%], valid : [loss = 0.560, top1 = 87.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10        train : [loss = 0.023, top1 = 99.30%], test  : [loss = 0.360, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.04 ms.
cifar100       train : [loss = 0.286, top1 = 92.16%], valid : [loss = 1.364, top1 = 66.50%], test : [loss = 1.376, top1 = 66.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.55 ms.
ImageNet16-120 train : [loss = 2.441, top1 = 37.38%], valid : [loss = 2.577, top1 = 34.33%], test : [loss = 2.596, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 68.06%], valid : [loss = 0.927, top1 = 66.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13563/15625) 013563-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.12 ms.
cifar10-valid  train : [loss = 0.081, top1 = 97.57%], valid : [loss = 0.862, top1 = 79.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10        train : [loss = 0.132, top1 = 95.55%], test  : [loss = 0.529, top1 = 85.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.70 ms.
cifar100       train : [loss = 0.853, top1 = 75.18%], valid : [loss = 1.702, top1 = 56.96%], test : [loss = 1.686, top1 = 57.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.49%], valid : [loss = 3.167, top1 = 24.31%], test : [loss = 3.193, top1 = 23.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13564/15625) 013564-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.18%], valid : [loss = 0.467, top1 = 85.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.14 ms.
cifar10        train : [loss = 0.160, top1 = 94.76%], test  : [loss = 0.345, top1 = 89.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.986, top1 = 71.82%], valid : [loss = 1.352, top1 = 62.96%], test : [loss = 1.338, top1 = 62.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 2.630, top1 = 33.90%], valid : [loss = 2.680, top1 = 32.07%], test : [loss = 2.707, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13565/15625) 013565-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=14.77 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.94%], valid : [loss = 0.689, top1 = 84.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10        train : [loss = 0.058, top1 = 98.15%], test  : [loss = 0.412, top1 = 89.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=22.48 ms.
cifar100       train : [loss = 0.684, top1 = 79.91%], valid : [loss = 1.475, top1 = 61.88%], test : [loss = 1.461, top1 = 62.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.70%], valid : [loss = 2.618, top1 = 34.60%], test : [loss = 2.658, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.61%], valid : [loss = 0.882, top1 = 68.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13566/15625) 013566-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.47%], valid : [loss = 0.530, top1 = 87.41%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.29 ms.
cifar10        train : [loss = 0.053, top1 = 98.42%], test  : [loss = 0.380, top1 = 89.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.70 ms.
cifar100       train : [loss = 0.608, top1 = 82.26%], valid : [loss = 1.328, top1 = 64.82%], test : [loss = 1.318, top1 = 65.25%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.369, top1 = 39.38%], valid : [loss = 2.509, top1 = 36.16%], test : [loss = 2.561, top1 = 35.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.71%], valid : [loss = 0.644, top1 = 78.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13567/15625) 013567-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.279, top1 = 90.35%], valid : [loss = 0.542, top1 = 82.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.283, top1 = 90.16%], test  : [loss = 0.426, top1 = 86.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.88 ms.
cifar100       train : [loss = 1.389, top1 = 60.88%], valid : [loss = 1.673, top1 = 54.30%], test : [loss = 1.646, top1 = 55.62%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.30%], valid : [loss = 2.907, top1 = 28.50%], test : [loss = 2.990, top1 = 27.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.957, top1 = 65.62%], valid : [loss = 1.018, top1 = 64.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13568/15625) 013568-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.525, top1 = 88.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.341, top1 = 91.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.25 ms.
cifar100       train : [loss = 0.361, top1 = 90.10%], valid : [loss = 1.302, top1 = 66.50%], test : [loss = 1.295, top1 = 67.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.72 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.55%], valid : [loss = 2.413, top1 = 38.47%], test : [loss = 2.419, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13569/15625) 013569-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.73%], valid : [loss = 0.565, top1 = 83.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.219, top1 = 92.59%], test  : [loss = 0.411, top1 = 86.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=11.52 ms.
cifar100       train : [loss = 1.291, top1 = 63.35%], valid : [loss = 1.557, top1 = 57.00%], test : [loss = 1.557, top1 = 57.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.707, top1 = 32.35%], valid : [loss = 2.739, top1 = 31.37%], test : [loss = 2.771, top1 = 31.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 67.02%], valid : [loss = 0.958, top1 = 66.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13570/15625) 013570-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.550, top1 = 88.84%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.355, top1 = 92.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.93 ms.
cifar100       train : [loss = 0.125, top1 = 97.58%], valid : [loss = 1.466, top1 = 66.98%], test : [loss = 1.463, top1 = 67.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.68 ms.
ImageNet16-120 train : [loss = 1.930, top1 = 49.22%], valid : [loss = 2.456, top1 = 37.57%], test : [loss = 2.450, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.32%], valid : [loss = 0.700, top1 = 76.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13571/15625) 013571-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.589, top1 = 87.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.388, top1 = 91.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.60 ms.
cifar100       train : [loss = 0.164, top1 = 96.36%], valid : [loss = 1.457, top1 = 66.40%], test : [loss = 1.462, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.29 ms.
ImageNet16-120 train : [loss = 2.010, top1 = 47.38%], valid : [loss = 2.459, top1 = 37.30%], test : [loss = 2.487, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.68%], valid : [loss = 0.804, top1 = 71.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13572/15625) 013572-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.506, top1 = 89.69%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.54 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.317, top1 = 93.15%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.38 ms.
cifar100       train : [loss = 0.077, top1 = 98.75%], valid : [loss = 1.332, top1 = 69.88%], test : [loss = 1.314, top1 = 70.10%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=18.21 ms.
ImageNet16-120 train : [loss = 1.620, top1 = 56.33%], valid : [loss = 2.154, top1 = 45.20%], test : [loss = 2.170, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.59%], valid : [loss = 0.747, top1 = 73.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13573/15625) 013573-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.546, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.356, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.16 ms.
cifar100       train : [loss = 0.232, top1 = 93.88%], valid : [loss = 1.303, top1 = 68.36%], test : [loss = 1.301, top1 = 68.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.88 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.43%], valid : [loss = 2.544, top1 = 35.07%], test : [loss = 2.553, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.64%], valid : [loss = 0.961, top1 = 65.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13574/15625) 013574-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.471, top1 = 89.40%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.00 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.299, top1 = 92.42%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.39 ms.
cifar100       train : [loss = 0.269, top1 = 93.06%], valid : [loss = 1.205, top1 = 68.80%], test : [loss = 1.213, top1 = 69.16%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.70 ms.
ImageNet16-120 train : [loss = 1.819, top1 = 51.74%], valid : [loss = 2.188, top1 = 42.17%], test : [loss = 2.211, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.718, top1 = 74.85%], valid : [loss = 0.789, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13575/15625) 013575-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.542, top1 = 88.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.379, top1 = 91.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.92 ms.
cifar100       train : [loss = 0.381, top1 = 89.29%], valid : [loss = 1.408, top1 = 64.92%], test : [loss = 1.386, top1 = 65.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.98%], valid : [loss = 2.475, top1 = 37.36%], test : [loss = 2.495, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.51%], valid : [loss = 0.766, top1 = 73.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13576/15625) 013576-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.68%], valid : [loss = 0.849, top1 = 75.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.76 ms.
cifar10        train : [loss = 0.321, top1 = 88.81%], test  : [loss = 0.630, top1 = 80.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.43 ms.
cifar100       train : [loss = 1.353, top1 = 61.88%], valid : [loss = 1.904, top1 = 50.42%], test : [loss = 1.915, top1 = 50.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 3.497, top1 = 17.38%], valid : [loss = 3.511, top1 = 17.33%], test : [loss = 3.517, top1 = 17.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 52.93%], valid : [loss = 1.337, top1 = 51.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13577/15625) 013577-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.862, top1 = 69.56%], valid : [loss = 1.005, top1 = 65.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.50 ms.
cifar10        train : [loss = 0.767, top1 = 73.12%], test  : [loss = 0.845, top1 = 70.58%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.40 ms.
cifar100       train : [loss = 2.163, top1 = 43.06%], valid : [loss = 2.343, top1 = 40.50%], test : [loss = 2.357, top1 = 40.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 3.738, top1 = 14.35%], valid : [loss = 3.762, top1 = 14.83%], test : [loss = 3.768, top1 = 14.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.463, top1 = 46.40%], valid : [loss = 1.488, top1 = 45.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13578/15625) 013578-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.476, top1 = 89.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.95 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.302, top1 = 93.13%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.110, top1 = 98.01%], valid : [loss = 1.258, top1 = 70.14%], test : [loss = 1.266, top1 = 70.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.69 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.21%], valid : [loss = 2.163, top1 = 44.40%], test : [loss = 2.183, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.88%], valid : [loss = 0.627, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13579/15625) 013579-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.630, top1 = 87.26%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.61 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.387, top1 = 91.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.51 ms.
cifar100       train : [loss = 0.133, top1 = 97.34%], valid : [loss = 1.533, top1 = 66.02%], test : [loss = 1.626, top1 = 64.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.03 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.35%], valid : [loss = 2.417, top1 = 38.40%], test : [loss = 2.431, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.84%], valid : [loss = 0.800, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13580/15625) 013580-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.96 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.50%], valid : [loss = 0.675, top1 = 83.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.76 ms.
cifar10        train : [loss = 0.075, top1 = 97.52%], test  : [loss = 0.406, top1 = 88.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.78 ms.
cifar100       train : [loss = 0.781, top1 = 77.17%], valid : [loss = 1.572, top1 = 59.60%], test : [loss = 1.539, top1 = 59.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.447, top1 = 37.90%], valid : [loss = 2.607, top1 = 35.07%], test : [loss = 2.625, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 69.92%], valid : [loss = 0.894, top1 = 68.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13581/15625) 013581-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.00 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.586, top1 = 88.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.28 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.396, top1 = 91.57%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.14 ms.
cifar100       train : [loss = 0.155, top1 = 96.60%], valid : [loss = 1.565, top1 = 65.52%], test : [loss = 1.565, top1 = 65.98%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.67 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.48%], valid : [loss = 2.390, top1 = 39.87%], test : [loss = 2.444, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.50%], valid : [loss = 0.802, top1 = 71.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13582/15625) 013582-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=23.00 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.23%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.93 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.317, top1 = 92.98%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.66 ms.
cifar100       train : [loss = 0.118, top1 = 97.96%], valid : [loss = 1.324, top1 = 69.20%], test : [loss = 1.340, top1 = 69.72%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.73 ms.
ImageNet16-120 train : [loss = 1.742, top1 = 53.44%], valid : [loss = 2.219, top1 = 43.33%], test : [loss = 2.216, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.46%], valid : [loss = 0.707, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13583/15625) 013583-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.509, top1 = 89.83%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.63 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.305, top1 = 93.22%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.08 ms.
cifar100       train : [loss = 0.114, top1 = 97.80%], valid : [loss = 1.237, top1 = 70.16%], test : [loss = 1.285, top1 = 69.66%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.94 ms.
ImageNet16-120 train : [loss = 1.630, top1 = 56.05%], valid : [loss = 2.135, top1 = 45.13%], test : [loss = 2.157, top1 = 45.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.24%], valid : [loss = 0.599, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13584/15625) 013584-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.412, top1 = 85.70%], valid : [loss = 0.659, top1 = 78.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.363, top1 = 87.36%], test  : [loss = 0.512, top1 = 83.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.67 ms.
cifar100       train : [loss = 1.532, top1 = 57.47%], valid : [loss = 1.813, top1 = 51.87%], test : [loss = 1.805, top1 = 51.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 3.261, top1 = 22.14%], valid : [loss = 3.278, top1 = 22.16%], test : [loss = 3.297, top1 = 21.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.167, top1 = 57.74%], valid : [loss = 1.225, top1 = 56.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13585/15625) 013585-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.446, top1 = 90.64%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.271, top1 = 93.72%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.00 ms.
cifar100       train : [loss = 0.068, top1 = 99.02%], valid : [loss = 1.331, top1 = 70.10%], test : [loss = 1.329, top1 = 70.24%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 1.550, top1 = 58.08%], valid : [loss = 2.245, top1 = 43.53%], test : [loss = 2.313, top1 = 43.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.351, top1 = 88.05%], valid : [loss = 0.494, top1 = 83.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13586/15625) 013586-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.78%], valid : [loss = 0.612, top1 = 82.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10        train : [loss = 0.141, top1 = 95.19%], test  : [loss = 0.451, top1 = 87.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.47 ms.
cifar100       train : [loss = 0.910, top1 = 73.53%], valid : [loss = 1.683, top1 = 56.66%], test : [loss = 1.670, top1 = 56.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 3.682, top1 = 13.36%], valid : [loss = 3.629, top1 = 15.17%], test : [loss = 3.656, top1 = 13.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.74%], valid : [loss = 1.284, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13587/15625) 013587-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.530, top1 = 88.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.353, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.88 ms.
cifar100       train : [loss = 0.292, top1 = 92.24%], valid : [loss = 1.298, top1 = 67.57%], test : [loss = 1.290, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.03%], valid : [loss = 2.440, top1 = 38.03%], test : [loss = 2.413, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.16%], valid : [loss = 0.797, top1 = 72.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13588/15625) 013588-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.541, top1 = 88.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.333, top1 = 91.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.87 ms.
cifar100       train : [loss = 0.281, top1 = 92.48%], valid : [loss = 1.275, top1 = 68.00%], test : [loss = 1.292, top1 = 68.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.45%], valid : [loss = 2.419, top1 = 38.87%], test : [loss = 2.411, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.99%], valid : [loss = 0.873, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13589/15625) 013589-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.560, top1 = 87.70%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.373, top1 = 91.15%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.87 ms.
cifar100       train : [loss = 0.381, top1 = 89.29%], valid : [loss = 1.415, top1 = 64.89%], test : [loss = 1.375, top1 = 65.75%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.08%], valid : [loss = 2.446, top1 = 37.99%], test : [loss = 2.472, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.94%], valid : [loss = 0.670, top1 = 76.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13590/15625) 013590-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.90%], valid : [loss = 0.551, top1 = 82.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10        train : [loss = 0.285, top1 = 90.12%], test  : [loss = 0.423, top1 = 85.70%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 1.423, top1 = 59.77%], valid : [loss = 1.678, top1 = 54.02%], test : [loss = 1.678, top1 = 54.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.842, top1 = 29.76%], valid : [loss = 2.840, top1 = 30.90%], test : [loss = 2.905, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.983, top1 = 64.51%], valid : [loss = 1.022, top1 = 63.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13591/15625) 013591-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.496, top1 = 89.50%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.11 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.321, top1 = 92.78%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.67 ms.
cifar100       train : [loss = 0.112, top1 = 97.89%], valid : [loss = 1.301, top1 = 69.34%], test : [loss = 1.288, top1 = 69.94%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=24.80 ms.
ImageNet16-120 train : [loss = 1.763, top1 = 53.12%], valid : [loss = 2.252, top1 = 42.47%], test : [loss = 2.267, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 76.90%], valid : [loss = 0.727, top1 = 74.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13592/15625) 013592-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.539, top1 = 87.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.93 ms.
cifar10        train : [loss = 0.038, top1 = 98.88%], test  : [loss = 0.380, top1 = 90.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.34 ms.
cifar100       train : [loss = 0.649, top1 = 81.30%], valid : [loss = 1.446, top1 = 61.98%], test : [loss = 1.415, top1 = 62.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.495, top1 = 36.38%], valid : [loss = 2.604, top1 = 35.03%], test : [loss = 2.614, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.61%], valid : [loss = 0.972, top1 = 65.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13593/15625) 013593-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.58%], valid : [loss = 0.572, top1 = 87.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.040, top1 = 98.80%], test  : [loss = 0.400, top1 = 89.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.48 ms.
cifar100       train : [loss = 0.559, top1 = 83.64%], valid : [loss = 1.426, top1 = 63.80%], test : [loss = 1.426, top1 = 63.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.77%], valid : [loss = 2.614, top1 = 34.80%], test : [loss = 2.641, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.29%], valid : [loss = 0.722, top1 = 75.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13594/15625) 013594-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.495, top1 = 89.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.315, top1 = 92.92%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.79 ms.
cifar100       train : [loss = 0.134, top1 = 97.31%], valid : [loss = 1.278, top1 = 69.15%], test : [loss = 1.282, top1 = 69.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 1.757, top1 = 53.09%], valid : [loss = 2.185, top1 = 43.81%], test : [loss = 2.197, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.93%], valid : [loss = 0.621, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13595/15625) 013595-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.38 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.498, top1 = 89.16%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.97 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.327, top1 = 92.12%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.21 ms.
cifar100       train : [loss = 0.200, top1 = 95.39%], valid : [loss = 1.201, top1 = 69.48%], test : [loss = 1.232, top1 = 70.26%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.24 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.02%], valid : [loss = 2.175, top1 = 44.27%], test : [loss = 2.188, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.16%], valid : [loss = 0.648, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13596/15625) 013596-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.663, top1 = 86.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.92 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.432, top1 = 90.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.24 ms.
cifar100       train : [loss = 0.238, top1 = 94.11%], valid : [loss = 1.654, top1 = 62.84%], test : [loss = 1.623, top1 = 63.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.69%], valid : [loss = 2.502, top1 = 37.43%], test : [loss = 2.525, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.36%], valid : [loss = 0.825, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13597/15625) 013597-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.98%], valid : [loss = 0.431, top1 = 89.85%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.009, top1 = 99.89%], test  : [loss = 0.289, top1 = 92.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.210, top1 = 94.99%], valid : [loss = 1.266, top1 = 68.95%], test : [loss = 1.254, top1 = 69.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.64%], valid : [loss = 2.281, top1 = 42.38%], test : [loss = 2.302, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13598/15625) 013598-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.574, top1 = 88.50%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.13 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.392, top1 = 92.19%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.95 ms.
cifar100       train : [loss = 0.114, top1 = 97.68%], valid : [loss = 1.501, top1 = 66.62%], test : [loss = 1.554, top1 = 66.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.22%], valid : [loss = 2.498, top1 = 37.60%], test : [loss = 2.520, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.36%], valid : [loss = 0.665, top1 = 77.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13599/15625) 013599-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.668 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.504, top1 = 88.73%]
cifar10        FLOP= 94.29 M, Params=0.668 MB, latency=19.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.331, top1 = 92.03%]
cifar100       FLOP= 94.30 M, Params=0.674 MB, latency=18.77 ms.
cifar100       train : [loss = 0.338, top1 = 90.83%], valid : [loss = 1.282, top1 = 67.04%], test : [loss = 1.276, top1 = 67.25%]
ImageNet16-120 FLOP= 23.58 M, Params=0.676 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.04%], valid : [loss = 2.407, top1 = 39.17%], test : [loss = 2.417, top1 = 39.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.88%], valid : [loss = 0.625, top1 = 78.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13600/15625) 013600-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.510, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.335, top1 = 92.23%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.16 ms.
cifar100       train : [loss = 0.216, top1 = 94.66%], valid : [loss = 1.277, top1 = 68.99%], test : [loss = 1.271, top1 = 69.11%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.26 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.52%], valid : [loss = 2.351, top1 = 40.30%], test : [loss = 2.351, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.01%], valid : [loss = 0.754, top1 = 73.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13601/15625) 013601-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.90%], valid : [loss = 0.829, top1 = 72.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.02 ms.
cifar10        train : [loss = 0.579, top1 = 79.51%], test  : [loss = 0.738, top1 = 74.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.76 ms.
cifar100       train : [loss = 1.794, top1 = 51.74%], valid : [loss = 2.079, top1 = 46.84%], test : [loss = 2.073, top1 = 46.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.00 ms.
ImageNet16-120 train : [loss = 3.594, top1 = 16.71%], valid : [loss = 3.660, top1 = 15.53%], test : [loss = 3.666, top1 = 15.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.00%], valid : [loss = 1.244, top1 = 55.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13602/15625) 013602-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.72%], valid : [loss = 0.538, top1 = 84.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10        train : [loss = 0.179, top1 = 94.00%], test  : [loss = 0.386, top1 = 87.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.18 ms.
cifar100       train : [loss = 1.164, top1 = 66.72%], valid : [loss = 1.492, top1 = 59.05%], test : [loss = 1.490, top1 = 59.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.56 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 33.74%], valid : [loss = 2.696, top1 = 33.24%], test : [loss = 2.730, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13603/15625) 013603-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.451, top1 = 89.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.302, top1 = 92.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.11 ms.
cifar100       train : [loss = 0.120, top1 = 97.72%], valid : [loss = 1.273, top1 = 69.74%], test : [loss = 1.283, top1 = 69.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 1.734, top1 = 53.65%], valid : [loss = 2.205, top1 = 42.50%], test : [loss = 2.253, top1 = 44.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.416, top1 = 85.62%], valid : [loss = 0.536, top1 = 81.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13604/15625) 013604-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=22.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.548, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.77 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.348, top1 = 92.47%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.53 ms.
cifar100       train : [loss = 0.205, top1 = 94.63%], valid : [loss = 1.494, top1 = 65.58%], test : [loss = 1.517, top1 = 65.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.41 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.41%], valid : [loss = 2.440, top1 = 38.07%], test : [loss = 2.454, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.22%], valid : [loss = 0.929, top1 = 67.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13605/15625) 013605-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.437, top1 = 90.37%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.20 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.307, top1 = 92.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.10 ms.
cifar100       train : [loss = 0.162, top1 = 96.36%], valid : [loss = 1.266, top1 = 69.76%], test : [loss = 1.251, top1 = 69.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 1.773, top1 = 52.80%], valid : [loss = 2.245, top1 = 42.40%], test : [loss = 2.278, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.06%], valid : [loss = 0.505, top1 = 83.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13606/15625) 013606-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.549, top1 = 88.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.64%], test  : [loss = 0.354, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.264, top1 = 92.74%], valid : [loss = 1.413, top1 = 66.24%], test : [loss = 1.323, top1 = 67.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.250, top1 = 41.91%], valid : [loss = 2.470, top1 = 37.77%], test : [loss = 2.467, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.32%], valid : [loss = 0.967, top1 = 65.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13607/15625) 013607-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.499, top1 = 88.82%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.37 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.319, top1 = 92.19%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.97 ms.
cifar100       train : [loss = 0.236, top1 = 94.30%], valid : [loss = 1.239, top1 = 68.72%], test : [loss = 1.256, top1 = 68.66%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.88 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.36%], valid : [loss = 2.287, top1 = 42.27%], test : [loss = 2.294, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.19%], valid : [loss = 0.664, top1 = 76.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13608/15625) 013608-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.41%], valid : [loss = 0.629, top1 = 85.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10        train : [loss = 0.066, top1 = 98.11%], test  : [loss = 0.424, top1 = 88.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.76 ms.
cifar100       train : [loss = 0.722, top1 = 78.92%], valid : [loss = 1.395, top1 = 62.94%], test : [loss = 1.367, top1 = 62.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.10%], valid : [loss = 2.663, top1 = 32.43%], test : [loss = 2.711, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13609/15625) 013609-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.521, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.10 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.350, top1 = 92.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.084, top1 = 98.64%], valid : [loss = 1.420, top1 = 69.02%], test : [loss = 1.414, top1 = 68.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 1.767, top1 = 52.97%], valid : [loss = 2.392, top1 = 40.30%], test : [loss = 2.397, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.02%], valid : [loss = 0.647, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13610/15625) 013610-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.73 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.536, top1 = 89.35%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=23.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.363, top1 = 92.79%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=25.32 ms.
cifar100       train : [loss = 0.030, top1 = 99.75%], valid : [loss = 1.435, top1 = 70.56%], test : [loss = 1.378, top1 = 70.30%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.66 ms.
ImageNet16-120 train : [loss = 1.518, top1 = 59.07%], valid : [loss = 2.371, top1 = 42.17%], test : [loss = 2.440, top1 = 41.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.64%], valid : [loss = 0.672, top1 = 77.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13611/15625) 013611-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.532, top1 = 88.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.309, top1 = 92.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.53 ms.
cifar100       train : [loss = 0.350, top1 = 90.41%], valid : [loss = 1.279, top1 = 66.92%], test : [loss = 1.284, top1 = 66.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.00 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.55%], valid : [loss = 2.407, top1 = 39.17%], test : [loss = 2.393, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13612/15625) 013612-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.59 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.74 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13613/15625) 013613-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.657, top1 = 86.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.018, top1 = 99.58%], test  : [loss = 0.472, top1 = 89.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.33 ms.
cifar100       train : [loss = 0.265, top1 = 93.38%], valid : [loss = 1.621, top1 = 62.70%], test : [loss = 1.595, top1 = 62.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 40.06%], valid : [loss = 2.703, top1 = 32.97%], test : [loss = 2.770, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.37%], valid : [loss = 0.807, top1 = 71.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13614/15625) 013614-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.519, top1 = 88.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.357, top1 = 90.97%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 0.505, top1 = 84.99%], valid : [loss = 1.390, top1 = 64.86%], test : [loss = 1.346, top1 = 65.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.33 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 40.02%], valid : [loss = 2.517, top1 = 37.03%], test : [loss = 2.539, top1 = 35.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.06%], valid : [loss = 0.727, top1 = 75.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13615/15625) 013615-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.12%], valid : [loss = 0.645, top1 = 85.25%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.41 ms.
cifar10        train : [loss = 0.056, top1 = 98.30%], test  : [loss = 0.415, top1 = 89.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.13 ms.
cifar100       train : [loss = 0.653, top1 = 80.72%], valid : [loss = 1.452, top1 = 62.44%], test : [loss = 1.424, top1 = 62.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 37.18%], valid : [loss = 2.665, top1 = 33.73%], test : [loss = 2.651, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 69.88%], valid : [loss = 0.892, top1 = 68.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13616/15625) 013616-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.563, top1 = 87.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.390, top1 = 91.18%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.403, top1 = 88.60%], valid : [loss = 1.404, top1 = 65.52%], test : [loss = 1.385, top1 = 65.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.10%], valid : [loss = 2.531, top1 = 36.63%], test : [loss = 2.556, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13617/15625) 013617-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.538, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.65 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.327, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 0.331, top1 = 90.99%], valid : [loss = 1.278, top1 = 67.24%], test : [loss = 1.295, top1 = 67.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.77%], valid : [loss = 2.395, top1 = 38.93%], test : [loss = 2.411, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.20%], valid : [loss = 0.834, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13618/15625) 013618-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.76%], valid : [loss = 0.481, top1 = 84.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10        train : [loss = 0.300, top1 = 89.95%], test  : [loss = 0.396, top1 = 86.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 1.325, top1 = 63.21%], valid : [loss = 1.539, top1 = 57.79%], test : [loss = 1.511, top1 = 58.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.72%], valid : [loss = 2.901, top1 = 29.62%], test : [loss = 2.959, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13619/15625) 013619-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.17%], valid : [loss = 0.881, top1 = 71.30%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.99 ms.
cifar10        train : [loss = 0.552, top1 = 80.58%], test  : [loss = 0.698, top1 = 76.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.37 ms.
cifar100       train : [loss = 1.781, top1 = 52.21%], valid : [loss = 2.079, top1 = 46.16%], test : [loss = 2.096, top1 = 46.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.89%], valid : [loss = 3.613, top1 = 17.03%], test : [loss = 3.663, top1 = 16.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13620/15625) 013620-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.38%], valid : [loss = 0.670, top1 = 84.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.64 ms.
cifar10        train : [loss = 0.048, top1 = 98.57%], test  : [loss = 0.465, top1 = 88.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.67 ms.
cifar100       train : [loss = 0.631, top1 = 81.55%], valid : [loss = 1.551, top1 = 61.32%], test : [loss = 1.499, top1 = 61.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 2.688, top1 = 33.03%], valid : [loss = 2.848, top1 = 30.60%], test : [loss = 2.888, top1 = 29.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.24%], valid : [loss = 0.875, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13621/15625) 013621-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.69 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.26%], valid : [loss = 0.455, top1 = 86.32%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.163, top1 = 94.63%], test  : [loss = 0.361, top1 = 88.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 1.030, top1 = 70.76%], valid : [loss = 1.373, top1 = 61.56%], test : [loss = 1.379, top1 = 61.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.68%], valid : [loss = 2.713, top1 = 32.10%], test : [loss = 2.719, top1 = 32.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13622/15625) 013622-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.59 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.70%], valid : [loss = 0.586, top1 = 87.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.36 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.419, top1 = 90.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.87 ms.
cifar100       train : [loss = 0.349, top1 = 90.40%], valid : [loss = 1.432, top1 = 65.34%], test : [loss = 1.433, top1 = 64.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.438, top1 = 37.49%], valid : [loss = 2.570, top1 = 35.47%], test : [loss = 2.605, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.163, top1 = 57.36%], valid : [loss = 1.178, top1 = 57.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13623/15625) 013623-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.539, top1 = 88.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=14.81 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.361, top1 = 92.19%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.53 ms.
cifar100       train : [loss = 0.154, top1 = 96.78%], valid : [loss = 1.418, top1 = 66.54%], test : [loss = 1.379, top1 = 68.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 1.932, top1 = 49.12%], valid : [loss = 2.413, top1 = 39.70%], test : [loss = 2.425, top1 = 40.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.52%], valid : [loss = 0.707, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13624/15625) 013624-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.31%], valid : [loss = 0.457, top1 = 86.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.48 ms.
cifar10        train : [loss = 0.115, top1 = 96.45%], test  : [loss = 0.337, top1 = 89.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.45 ms.
cifar100       train : [loss = 0.876, top1 = 75.04%], valid : [loss = 1.311, top1 = 63.61%], test : [loss = 1.281, top1 = 63.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 2.558, top1 = 35.56%], valid : [loss = 2.622, top1 = 34.86%], test : [loss = 2.664, top1 = 33.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13625/15625) 013625-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.374, top1 = 87.05%], valid : [loss = 0.641, top1 = 79.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.44 ms.
cifar10        train : [loss = 0.297, top1 = 90.00%], test  : [loss = 0.445, top1 = 85.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.92 ms.
cifar100       train : [loss = 1.608, top1 = 55.24%], valid : [loss = 1.820, top1 = 50.48%], test : [loss = 1.817, top1 = 51.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 3.109, top1 = 24.82%], valid : [loss = 3.112, top1 = 25.43%], test : [loss = 3.173, top1 = 23.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.40%], valid : [loss = 1.014, top1 = 63.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13626/15625) 013626-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.578, top1 = 88.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.383, top1 = 92.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.47 ms.
cifar100       train : [loss = 0.107, top1 = 98.07%], valid : [loss = 1.491, top1 = 67.30%], test : [loss = 1.513, top1 = 66.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.57%], valid : [loss = 2.448, top1 = 39.03%], test : [loss = 2.460, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.40%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13627/15625) 013627-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.425, top1 = 90.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.85 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.307, top1 = 93.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.25 ms.
cifar100       train : [loss = 0.095, top1 = 98.36%], valid : [loss = 1.328, top1 = 69.58%], test : [loss = 1.298, top1 = 70.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.683, top1 = 54.95%], valid : [loss = 2.220, top1 = 43.20%], test : [loss = 2.269, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.430, top1 = 85.15%], valid : [loss = 0.546, top1 = 81.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13628/15625) 013628-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.49%], valid : [loss = 0.702, top1 = 84.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.03 ms.
cifar10        train : [loss = 0.058, top1 = 98.29%], test  : [loss = 0.449, top1 = 88.38%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.20 ms.
cifar100       train : [loss = 0.634, top1 = 81.32%], valid : [loss = 1.480, top1 = 62.40%], test : [loss = 1.500, top1 = 61.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.24%], valid : [loss = 2.834, top1 = 31.03%], test : [loss = 2.866, top1 = 29.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13629/15625) 013629-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.502, top1 = 88.84%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.343, top1 = 91.81%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.89 ms.
cifar100       train : [loss = 0.355, top1 = 90.39%], valid : [loss = 1.271, top1 = 66.54%], test : [loss = 1.276, top1 = 67.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.62 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.03%], valid : [loss = 2.444, top1 = 37.93%], test : [loss = 2.452, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13630/15625) 013630-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.07 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.24 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13631/15625) 013631-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.29 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.74%], valid : [loss = 0.544, top1 = 85.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.122, top1 = 96.01%], test  : [loss = 0.379, top1 = 88.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.41 ms.
cifar100       train : [loss = 0.826, top1 = 76.04%], valid : [loss = 1.387, top1 = 63.22%], test : [loss = 1.404, top1 = 61.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.26%], valid : [loss = 2.646, top1 = 34.00%], test : [loss = 2.652, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.50%], valid : [loss = 0.919, top1 = 67.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13632/15625) 013632-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.305, top1 = 89.34%], valid : [loss = 0.575, top1 = 81.70%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.259, top1 = 91.12%], test  : [loss = 0.395, top1 = 86.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.28 ms.
cifar100       train : [loss = 1.495, top1 = 58.10%], valid : [loss = 1.760, top1 = 52.44%], test : [loss = 1.749, top1 = 52.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.955, top1 = 27.53%], valid : [loss = 2.972, top1 = 27.28%], test : [loss = 3.008, top1 = 26.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.67%], valid : [loss = 1.017, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13633/15625) 013633-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.37 ms.
cifar10-valid  train : [loss = 0.491, top1 = 82.86%], valid : [loss = 0.651, top1 = 78.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10        train : [loss = 0.511, top1 = 82.35%], test  : [loss = 0.594, top1 = 79.94%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.54 ms.
cifar100       train : [loss = 1.696, top1 = 54.04%], valid : [loss = 1.862, top1 = 50.67%], test : [loss = 1.874, top1 = 50.55%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.87 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.30%], valid : [loss = 3.306, top1 = 21.79%], test : [loss = 3.355, top1 = 21.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13634/15625) 013634-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10-valid  train : [loss = 0.495, top1 = 82.80%], valid : [loss = 0.652, top1 = 78.07%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.10 ms.
cifar10        train : [loss = 0.506, top1 = 82.52%], test  : [loss = 0.584, top1 = 80.25%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.44 ms.
cifar100       train : [loss = 1.683, top1 = 54.28%], valid : [loss = 1.850, top1 = 50.81%], test : [loss = 1.856, top1 = 50.99%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.72 ms.
ImageNet16-120 train : [loss = 3.333, top1 = 21.11%], valid : [loss = 3.317, top1 = 21.50%], test : [loss = 3.354, top1 = 20.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13635/15625) 013635-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.65 ms.
cifar10-valid  train : [loss = 0.258, top1 = 91.03%], valid : [loss = 0.852, top1 = 75.86%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.311, top1 = 89.21%], test  : [loss = 0.630, top1 = 80.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.16 ms.
cifar100       train : [loss = 1.393, top1 = 60.81%], valid : [loss = 1.914, top1 = 50.74%], test : [loss = 1.940, top1 = 49.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 3.476, top1 = 17.79%], valid : [loss = 3.498, top1 = 18.37%], test : [loss = 3.487, top1 = 17.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13636/15625) 013636-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.531, top1 = 88.93%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.341, top1 = 92.44%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.75 ms.
cifar100       train : [loss = 0.116, top1 = 97.31%], valid : [loss = 1.419, top1 = 68.48%], test : [loss = 1.401, top1 = 68.58%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.27 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.47%], valid : [loss = 2.541, top1 = 35.73%], test : [loss = 2.577, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.05%], valid : [loss = 0.931, top1 = 66.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13637/15625) 013637-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.737, top1 = 84.57%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.47 ms.
cifar10        train : [loss = 0.021, top1 = 99.46%], test  : [loss = 0.448, top1 = 89.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.25 ms.
cifar100       train : [loss = 0.317, top1 = 91.68%], valid : [loss = 1.605, top1 = 62.08%], test : [loss = 1.612, top1 = 63.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 43.05%], valid : [loss = 2.621, top1 = 35.43%], test : [loss = 2.604, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.49%], valid : [loss = 0.814, top1 = 71.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13638/15625) 013638-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.40%], valid : [loss = 0.688, top1 = 80.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10        train : [loss = 0.209, top1 = 92.78%], test  : [loss = 0.417, top1 = 86.82%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.82 ms.
cifar100       train : [loss = 1.174, top1 = 66.49%], valid : [loss = 1.659, top1 = 55.86%], test : [loss = 1.632, top1 = 56.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 28.04%], valid : [loss = 2.979, top1 = 27.70%], test : [loss = 3.038, top1 = 26.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.977, top1 = 64.78%], valid : [loss = 1.051, top1 = 62.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13639/15625) 013639-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.129, top1 = 96.13%], valid : [loss = 0.468, top1 = 85.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.72 ms.
cifar10        train : [loss = 0.155, top1 = 94.86%], test  : [loss = 0.341, top1 = 89.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.34 ms.
cifar100       train : [loss = 1.005, top1 = 71.40%], valid : [loss = 1.363, top1 = 61.50%], test : [loss = 1.358, top1 = 61.36%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 33.99%], valid : [loss = 2.656, top1 = 34.33%], test : [loss = 2.687, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13640/15625) 013640-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.555, top1 = 89.13%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.02 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.352, top1 = 92.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.90 ms.
cifar100       train : [loss = 0.118, top1 = 97.57%], valid : [loss = 1.297, top1 = 69.28%], test : [loss = 1.293, top1 = 69.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.46 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.16%], valid : [loss = 2.182, top1 = 44.30%], test : [loss = 2.215, top1 = 44.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.42%], valid : [loss = 0.653, top1 = 77.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13641/15625) 013641-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.311, top1 = 89.50%], valid : [loss = 0.574, top1 = 81.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.261, top1 = 91.01%], test  : [loss = 0.414, top1 = 86.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.24 ms.
cifar100       train : [loss = 1.481, top1 = 58.35%], valid : [loss = 1.707, top1 = 53.02%], test : [loss = 1.698, top1 = 53.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.933, top1 = 27.93%], valid : [loss = 2.934, top1 = 28.03%], test : [loss = 2.971, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.003, top1 = 63.87%], valid : [loss = 1.061, top1 = 62.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13642/15625) 013642-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.47%], valid : [loss = 0.854, top1 = 71.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.547, top1 = 80.86%], test  : [loss = 0.719, top1 = 75.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.05 ms.
cifar100       train : [loss = 1.778, top1 = 52.13%], valid : [loss = 2.055, top1 = 46.72%], test : [loss = 2.060, top1 = 47.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.83%], valid : [loss = 3.631, top1 = 16.90%], test : [loss = 3.686, top1 = 15.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.42%], valid : [loss = 1.248, top1 = 55.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13643/15625) 013643-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.501, top1 = 88.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10        train : [loss = 0.019, top1 = 99.56%], test  : [loss = 0.360, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.390, top1 = 88.92%], valid : [loss = 1.364, top1 = 65.88%], test : [loss = 1.376, top1 = 65.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.20%], valid : [loss = 2.433, top1 = 38.40%], test : [loss = 2.472, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.78%], valid : [loss = 0.634, top1 = 78.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13644/15625) 013644-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.439, top1 = 90.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.291, top1 = 93.89%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.40 ms.
cifar100       train : [loss = 0.053, top1 = 99.19%], valid : [loss = 1.359, top1 = 70.18%], test : [loss = 1.324, top1 = 70.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 1.448, top1 = 60.52%], valid : [loss = 2.198, top1 = 45.07%], test : [loss = 2.173, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.336, top1 = 88.52%], valid : [loss = 0.480, top1 = 83.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13645/15625) 013645-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.526, top1 = 89.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.320, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.93 ms.
cifar100       train : [loss = 0.152, top1 = 96.85%], valid : [loss = 1.333, top1 = 68.32%], test : [loss = 1.318, top1 = 69.28%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 1.788, top1 = 52.37%], valid : [loss = 2.239, top1 = 43.17%], test : [loss = 2.262, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.81%], valid : [loss = 0.629, top1 = 78.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13646/15625) 013646-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.75%], valid : [loss = 0.475, top1 = 84.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.306, top1 = 89.88%], test  : [loss = 0.402, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.20 ms.
cifar100       train : [loss = 1.317, top1 = 63.59%], valid : [loss = 1.531, top1 = 58.06%], test : [loss = 1.505, top1 = 58.44%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.79%], valid : [loss = 2.902, top1 = 29.63%], test : [loss = 2.958, top1 = 28.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13647/15625) 013647-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.92%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.62 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.327, top1 = 93.41%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.93 ms.
cifar100       train : [loss = 0.083, top1 = 98.70%], valid : [loss = 1.359, top1 = 68.96%], test : [loss = 1.383, top1 = 69.24%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.966, top1 = 48.14%], valid : [loss = 2.377, top1 = 39.47%], test : [loss = 2.369, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.47%], valid : [loss = 0.820, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13648/15625) 013648-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.66 ms.
cifar10-valid  train : [loss = 0.349, top1 = 87.88%], valid : [loss = 0.618, top1 = 80.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10        train : [loss = 0.277, top1 = 90.49%], test  : [loss = 0.419, top1 = 85.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.69 ms.
cifar100       train : [loss = 1.487, top1 = 58.43%], valid : [loss = 1.724, top1 = 53.26%], test : [loss = 1.732, top1 = 53.60%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 28.01%], valid : [loss = 2.916, top1 = 27.10%], test : [loss = 2.994, top1 = 27.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.28%], valid : [loss = 1.019, top1 = 63.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13649/15625) 013649-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.461, top1 = 89.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.315, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.38 ms.
cifar100       train : [loss = 0.346, top1 = 90.41%], valid : [loss = 1.345, top1 = 67.02%], test : [loss = 1.293, top1 = 67.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.61%], valid : [loss = 2.379, top1 = 39.93%], test : [loss = 2.421, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.20%], valid : [loss = 0.612, top1 = 79.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13650/15625) 013650-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.404, top1 = 86.15%], valid : [loss = 0.535, top1 = 82.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.64 ms.
cifar10        train : [loss = 0.414, top1 = 85.94%], test  : [loss = 0.474, top1 = 83.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 1.561, top1 = 57.23%], valid : [loss = 1.676, top1 = 54.58%], test : [loss = 1.671, top1 = 54.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 3.051, top1 = 26.07%], valid : [loss = 3.016, top1 = 27.38%], test : [loss = 3.080, top1 = 25.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.135, top1 = 59.53%], valid : [loss = 1.156, top1 = 59.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13651/15625) 013651-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.554, top1 = 88.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.340, top1 = 92.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.97 ms.
cifar100       train : [loss = 0.212, top1 = 94.73%], valid : [loss = 1.323, top1 = 67.68%], test : [loss = 1.312, top1 = 67.91%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 2.088, top1 = 45.54%], valid : [loss = 2.398, top1 = 39.20%], test : [loss = 2.397, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.09%], valid : [loss = 0.928, top1 = 66.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13652/15625) 013652-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.450, top1 = 90.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.56 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.294, top1 = 93.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.77 ms.
cifar100       train : [loss = 0.072, top1 = 98.88%], valid : [loss = 1.385, top1 = 70.00%], test : [loss = 1.375, top1 = 69.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 1.583, top1 = 57.36%], valid : [loss = 2.239, top1 = 44.32%], test : [loss = 2.239, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.66%], valid : [loss = 0.517, top1 = 82.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13653/15625) 013653-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.523, top1 = 88.86%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.346, top1 = 92.22%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.94 ms.
cifar100       train : [loss = 0.185, top1 = 95.66%], valid : [loss = 1.302, top1 = 68.63%], test : [loss = 1.289, top1 = 68.97%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.61 ms.
ImageNet16-120 train : [loss = 1.873, top1 = 50.45%], valid : [loss = 2.254, top1 = 42.71%], test : [loss = 2.268, top1 = 42.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.687, top1 = 75.55%], valid : [loss = 0.742, top1 = 73.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13654/15625) 013654-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.526, top1 = 89.54%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.78 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.328, top1 = 93.08%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.11 ms.
cifar100       train : [loss = 0.067, top1 = 99.00%], valid : [loss = 1.361, top1 = 69.87%], test : [loss = 1.370, top1 = 69.73%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 2.009, top1 = 47.29%], valid : [loss = 2.360, top1 = 39.91%], test : [loss = 2.371, top1 = 40.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.38%], valid : [loss = 0.784, top1 = 72.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13655/15625) 013655-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.12 ms.
cifar10-valid  train : [loss = 1.288, top1 = 53.71%], valid : [loss = 1.331, top1 = 52.39%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.52 ms.
cifar10        train : [loss = 1.194, top1 = 57.46%], test  : [loss = 1.199, top1 = 57.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.13 ms.
cifar100       train : [loss = 2.735, top1 = 31.52%], valid : [loss = 2.817, top1 = 30.93%], test : [loss = 2.812, top1 = 30.76%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 3.880, top1 = 12.25%], valid : [loss = 3.872, top1 = 13.13%], test : [loss = 3.894, top1 = 12.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.714, top1 = 35.38%], valid : [loss = 1.720, top1 = 34.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13656/15625) 013656-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.02%], valid : [loss = 0.468, top1 = 84.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10        train : [loss = 0.298, top1 = 90.02%], test  : [loss = 0.395, top1 = 86.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.33 ms.
cifar100       train : [loss = 1.333, top1 = 63.04%], valid : [loss = 1.529, top1 = 57.99%], test : [loss = 1.510, top1 = 58.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.59%], valid : [loss = 2.904, top1 = 29.10%], test : [loss = 2.959, top1 = 27.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13657/15625) 013657-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.530, top1 = 87.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.95 ms.
cifar10        train : [loss = 0.032, top1 = 99.05%], test  : [loss = 0.344, top1 = 91.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.449, top1 = 86.75%], valid : [loss = 1.273, top1 = 66.77%], test : [loss = 1.285, top1 = 66.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.221, top1 = 42.50%], valid : [loss = 2.394, top1 = 39.29%], test : [loss = 2.395, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 66.84%], valid : [loss = 0.945, top1 = 65.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13658/15625) 013658-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.131, top1 = 95.93%], valid : [loss = 0.462, top1 = 85.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10        train : [loss = 0.163, top1 = 94.71%], test  : [loss = 0.357, top1 = 88.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 0.931, top1 = 73.49%], valid : [loss = 1.346, top1 = 62.38%], test : [loss = 1.337, top1 = 62.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 34.54%], valid : [loss = 2.661, top1 = 33.38%], test : [loss = 2.702, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.19%], valid : [loss = 0.916, top1 = 67.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13659/15625) 013659-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.93 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.21%], valid : [loss = 0.483, top1 = 84.07%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.30 ms.
cifar10        train : [loss = 0.301, top1 = 89.93%], test  : [loss = 0.404, top1 = 86.39%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.80 ms.
cifar100       train : [loss = 1.338, top1 = 62.88%], valid : [loss = 1.537, top1 = 58.07%], test : [loss = 1.509, top1 = 58.41%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.00 ms.
ImageNet16-120 train : [loss = 2.924, top1 = 28.60%], valid : [loss = 2.899, top1 = 29.30%], test : [loss = 2.969, top1 = 28.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13660/15625) 013660-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.534, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.355, top1 = 92.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.36 ms.
cifar100       train : [loss = 0.042, top1 = 99.61%], valid : [loss = 1.420, top1 = 69.87%], test : [loss = 1.419, top1 = 69.47%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 1.617, top1 = 56.53%], valid : [loss = 2.357, top1 = 41.73%], test : [loss = 2.361, top1 = 42.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.563, top1 = 80.16%], valid : [loss = 0.672, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13661/15625) 013661-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.36%], valid : [loss = 0.464, top1 = 86.00%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.156, top1 = 94.93%], test  : [loss = 0.348, top1 = 88.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 0.983, top1 = 72.01%], valid : [loss = 1.337, top1 = 62.32%], test : [loss = 1.336, top1 = 62.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.80%], valid : [loss = 2.688, top1 = 32.91%], test : [loss = 2.716, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13662/15625) 013662-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.77%], valid : [loss = 0.612, top1 = 84.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.098, top1 = 96.74%], test  : [loss = 0.407, top1 = 88.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 0.694, top1 = 79.47%], valid : [loss = 1.521, top1 = 60.68%], test : [loss = 1.533, top1 = 60.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 3.205, top1 = 21.96%], valid : [loss = 3.213, top1 = 21.87%], test : [loss = 3.265, top1 = 20.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13663/15625) 013663-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.56%], valid : [loss = 0.539, top1 = 82.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.30 ms.
cifar10        train : [loss = 0.247, top1 = 91.57%], test  : [loss = 0.416, top1 = 86.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.16 ms.
cifar100       train : [loss = 1.363, top1 = 61.61%], valid : [loss = 1.617, top1 = 55.75%], test : [loss = 1.604, top1 = 56.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.19 ms.
ImageNet16-120 train : [loss = 2.867, top1 = 29.31%], valid : [loss = 2.881, top1 = 29.48%], test : [loss = 2.926, top1 = 28.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.006, top1 = 63.76%], valid : [loss = 1.053, top1 = 62.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13664/15625) 013664-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.52 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13665/15625) 013665-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.474, top1 = 89.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.014, top1 = 99.74%], test  : [loss = 0.310, top1 = 92.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.77 ms.
cifar100       train : [loss = 0.325, top1 = 91.30%], valid : [loss = 1.248, top1 = 67.78%], test : [loss = 1.246, top1 = 67.83%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.59 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.57%], valid : [loss = 2.308, top1 = 41.42%], test : [loss = 2.337, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.520, top1 = 81.93%], valid : [loss = 0.608, top1 = 79.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13666/15625) 013666-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.84%], valid : [loss = 0.564, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.368, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.46 ms.
cifar100       train : [loss = 0.161, top1 = 96.00%], valid : [loss = 1.394, top1 = 67.74%], test : [loss = 1.386, top1 = 67.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 38.66%], valid : [loss = 2.565, top1 = 35.16%], test : [loss = 2.576, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.993, top1 = 64.15%], valid : [loss = 1.011, top1 = 63.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13667/15625) 013667-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.74 ms.
cifar10-valid  train : [loss = 1.116, top1 = 59.19%], valid : [loss = 1.237, top1 = 55.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10        train : [loss = 0.671, top1 = 76.61%], test  : [loss = 0.760, top1 = 73.88%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.28 ms.
cifar100       train : [loss = 1.966, top1 = 47.79%], valid : [loss = 2.133, top1 = 44.69%], test : [loss = 2.155, top1 = 44.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 3.651, top1 = 15.71%], valid : [loss = 3.669, top1 = 15.84%], test : [loss = 3.687, top1 = 14.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13668/15625) 013668-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.23 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.02 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.93 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13669/15625) 013669-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.616, top1 = 86.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.392, top1 = 90.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.04 ms.
cifar100       train : [loss = 0.528, top1 = 84.55%], valid : [loss = 1.395, top1 = 64.07%], test : [loss = 1.410, top1 = 63.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.06%], valid : [loss = 2.562, top1 = 35.68%], test : [loss = 2.590, top1 = 35.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.55%], valid : [loss = 0.907, top1 = 67.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13670/15625) 013670-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.57 ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.75%], valid : [loss = 0.741, top1 = 74.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.39 ms.
cifar10        train : [loss = 0.567, top1 = 80.23%], test  : [loss = 0.628, top1 = 78.36%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.03 ms.
cifar100       train : [loss = 1.983, top1 = 46.52%], valid : [loss = 2.148, top1 = 43.84%], test : [loss = 2.138, top1 = 43.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.12 ms.
ImageNet16-120 train : [loss = 3.234, top1 = 22.28%], valid : [loss = 3.232, top1 = 22.50%], test : [loss = 3.238, top1 = 22.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.00%], valid : [loss = 1.329, top1 = 52.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13671/15625) 013671-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.535, top1 = 89.05%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.13 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.351, top1 = 92.52%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.49 ms.
cifar100       train : [loss = 0.114, top1 = 97.94%], valid : [loss = 1.429, top1 = 68.17%], test : [loss = 1.425, top1 = 68.15%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.10%], valid : [loss = 2.372, top1 = 40.11%], test : [loss = 2.394, top1 = 40.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 80.85%], valid : [loss = 0.659, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13672/15625) 013672-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.58%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.326, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.48 ms.
cifar100       train : [loss = 0.071, top1 = 98.92%], valid : [loss = 1.374, top1 = 69.55%], test : [loss = 1.375, top1 = 69.55%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.13%], valid : [loss = 2.380, top1 = 40.04%], test : [loss = 2.380, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.78%], valid : [loss = 0.765, top1 = 73.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13673/15625) 013673-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.180, top1 = 94.11%], valid : [loss = 0.586, top1 = 83.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.67 ms.
cifar10        train : [loss = 0.164, top1 = 94.61%], test  : [loss = 0.391, top1 = 87.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.56 ms.
cifar100       train : [loss = 1.146, top1 = 67.28%], valid : [loss = 1.511, top1 = 58.69%], test : [loss = 1.512, top1 = 58.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.58%], valid : [loss = 2.621, top1 = 34.10%], test : [loss = 2.670, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 67.82%], valid : [loss = 0.965, top1 = 66.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13674/15625) 013674-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.583, top1 = 86.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.00 ms.
cifar10        train : [loss = 0.039, top1 = 98.88%], test  : [loss = 0.404, top1 = 89.94%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.37 ms.
cifar100       train : [loss = 0.553, top1 = 83.71%], valid : [loss = 1.426, top1 = 64.25%], test : [loss = 1.420, top1 = 63.95%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.93%], valid : [loss = 2.620, top1 = 34.11%], test : [loss = 2.646, top1 = 34.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13675/15625) 013675-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.422, top1 = 90.53%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.97 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.282, top1 = 93.21%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.85 ms.
cifar100       train : [loss = 0.167, top1 = 96.22%], valid : [loss = 1.289, top1 = 69.39%], test : [loss = 1.262, top1 = 70.29%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.65%], valid : [loss = 2.225, top1 = 43.56%], test : [loss = 2.251, top1 = 43.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.365, top1 = 87.44%], valid : [loss = 0.493, top1 = 83.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13676/15625) 013676-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.29%], valid : [loss = 0.855, top1 = 70.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10        train : [loss = 0.678, top1 = 76.14%], test  : [loss = 0.766, top1 = 73.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 1.954, top1 = 48.03%], valid : [loss = 2.122, top1 = 45.01%], test : [loss = 2.141, top1 = 44.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.82%], valid : [loss = 3.668, top1 = 16.00%], test : [loss = 3.690, top1 = 15.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13677/15625) 013677-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.09%], valid : [loss = 0.601, top1 = 83.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10        train : [loss = 0.150, top1 = 95.06%], test  : [loss = 0.408, top1 = 87.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.46 ms.
cifar100       train : [loss = 1.089, top1 = 68.66%], valid : [loss = 1.516, top1 = 58.86%], test : [loss = 1.507, top1 = 59.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.93%], valid : [loss = 2.628, top1 = 34.37%], test : [loss = 2.645, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.23%], valid : [loss = 0.895, top1 = 68.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13678/15625) 013678-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.641, top1 = 86.18%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.00 ms.
cifar10        train : [loss = 0.030, top1 = 99.22%], test  : [loss = 0.434, top1 = 89.50%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.37 ms.
cifar100       train : [loss = 0.359, top1 = 90.29%], valid : [loss = 1.453, top1 = 64.40%], test : [loss = 1.456, top1 = 64.07%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.15%], valid : [loss = 2.606, top1 = 34.48%], test : [loss = 2.642, top1 = 34.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.35%], valid : [loss = 0.799, top1 = 72.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13679/15625) 013679-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.606, top1 = 85.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.071, top1 = 97.83%], test  : [loss = 0.409, top1 = 88.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.92 ms.
cifar100       train : [loss = 0.711, top1 = 79.17%], valid : [loss = 1.391, top1 = 63.23%], test : [loss = 1.369, top1 = 63.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 36.08%], valid : [loss = 2.662, top1 = 33.86%], test : [loss = 2.689, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13680/15625) 013680-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.569, top1 = 87.97%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.016, top1 = 99.56%], test  : [loss = 0.367, top1 = 91.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.267, top1 = 92.37%], valid : [loss = 1.372, top1 = 67.00%], test : [loss = 1.354, top1 = 67.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.30%], valid : [loss = 2.443, top1 = 37.70%], test : [loss = 2.465, top1 = 37.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 66.82%], valid : [loss = 0.961, top1 = 65.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13681/15625) 013681-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.555, top1 = 89.05%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.371, top1 = 92.61%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.91 ms.
cifar100       train : [loss = 0.100, top1 = 98.21%], valid : [loss = 1.449, top1 = 67.68%], test : [loss = 1.453, top1 = 68.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 1.875, top1 = 50.51%], valid : [loss = 2.448, top1 = 39.06%], test : [loss = 2.457, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13682/15625) 013682-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.09 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.687, top1 = 84.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.435, top1 = 88.79%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.14 ms.
cifar100       train : [loss = 0.635, top1 = 81.41%], valid : [loss = 1.505, top1 = 61.78%], test : [loss = 1.503, top1 = 61.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.50 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.35%], valid : [loss = 2.814, top1 = 30.43%], test : [loss = 2.858, top1 = 30.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13683/15625) 013683-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.56%], valid : [loss = 0.757, top1 = 74.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10        train : [loss = 0.543, top1 = 81.08%], test  : [loss = 0.619, top1 = 78.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.80 ms.
cifar100       train : [loss = 1.989, top1 = 46.15%], valid : [loss = 2.109, top1 = 43.95%], test : [loss = 2.106, top1 = 44.08%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 3.003, top1 = 26.64%], valid : [loss = 2.981, top1 = 27.40%], test : [loss = 3.029, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.50%], valid : [loss = 1.189, top1 = 57.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13684/15625) 013684-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.21 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.95%], valid : [loss = 0.474, top1 = 84.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.76 ms.
cifar10        train : [loss = 0.300, top1 = 89.99%], test  : [loss = 0.400, top1 = 86.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 1.328, top1 = 63.07%], valid : [loss = 1.535, top1 = 57.65%], test : [loss = 1.509, top1 = 57.82%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.23 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.62%], valid : [loss = 2.913, top1 = 28.87%], test : [loss = 2.950, top1 = 28.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13685/15625) 013685-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.576, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.379, top1 = 92.37%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.38 ms.
cifar100       train : [loss = 0.095, top1 = 98.35%], valid : [loss = 1.451, top1 = 67.89%], test : [loss = 1.453, top1 = 67.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 51.01%], valid : [loss = 2.417, top1 = 39.54%], test : [loss = 2.458, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.81%], valid : [loss = 0.700, top1 = 75.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13686/15625) 013686-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.584, top1 = 87.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.385, top1 = 91.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.07 ms.
cifar100       train : [loss = 0.399, top1 = 88.70%], valid : [loss = 1.383, top1 = 65.73%], test : [loss = 1.394, top1 = 65.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.82%], valid : [loss = 2.524, top1 = 36.70%], test : [loss = 2.549, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.49%], valid : [loss = 0.787, top1 = 72.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13687/15625) 013687-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.91 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.584, top1 = 87.84%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.405, top1 = 91.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.95 ms.
cifar100       train : [loss = 0.178, top1 = 95.75%], valid : [loss = 1.536, top1 = 65.62%], test : [loss = 1.521, top1 = 65.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.04%], valid : [loss = 2.440, top1 = 39.08%], test : [loss = 2.472, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.50%], valid : [loss = 0.802, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13688/15625) 013688-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.526, top1 = 89.21%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.24 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.359, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.38 ms.
cifar100       train : [loss = 0.077, top1 = 98.87%], valid : [loss = 1.411, top1 = 69.02%], test : [loss = 1.423, top1 = 69.11%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.99 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.53%], valid : [loss = 2.357, top1 = 41.50%], test : [loss = 2.369, top1 = 41.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 80.93%], valid : [loss = 0.639, top1 = 77.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13689/15625) 013689-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.505, top1 = 88.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.60 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.330, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.04 ms.
cifar100       train : [loss = 0.343, top1 = 90.63%], valid : [loss = 1.277, top1 = 67.52%], test : [loss = 1.298, top1 = 67.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.71%], valid : [loss = 2.407, top1 = 38.96%], test : [loss = 2.430, top1 = 38.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13690/15625) 013690-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.547, top1 = 88.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.364, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.49 ms.
cifar100       train : [loss = 0.092, top1 = 98.40%], valid : [loss = 1.463, top1 = 67.69%], test : [loss = 1.472, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.10%], valid : [loss = 2.438, top1 = 39.33%], test : [loss = 2.459, top1 = 38.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.08%], valid : [loss = 0.718, top1 = 75.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13691/15625) 013691-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.15 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.587, top1 = 87.16%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.43 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.401, top1 = 90.84%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.03 ms.
cifar100       train : [loss = 0.355, top1 = 89.97%], valid : [loss = 1.434, top1 = 64.93%], test : [loss = 1.425, top1 = 65.29%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.37%], valid : [loss = 2.481, top1 = 37.46%], test : [loss = 2.492, top1 = 37.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.30%], valid : [loss = 0.861, top1 = 69.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13692/15625) 013692-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.66%], valid : [loss = 0.550, top1 = 87.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.373, top1 = 90.83%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.44 ms.
cifar100       train : [loss = 0.432, top1 = 87.48%], valid : [loss = 1.323, top1 = 65.98%], test : [loss = 1.322, top1 = 66.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 2.451, top1 = 37.51%], valid : [loss = 2.601, top1 = 34.30%], test : [loss = 2.615, top1 = 34.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.887, top1 = 68.25%], valid : [loss = 0.922, top1 = 67.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13693/15625) 013693-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.443, top1 = 89.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.299, top1 = 92.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.92 ms.
cifar100       train : [loss = 0.131, top1 = 97.40%], valid : [loss = 1.307, top1 = 69.45%], test : [loss = 1.300, top1 = 69.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.75%], valid : [loss = 2.221, top1 = 43.42%], test : [loss = 2.261, top1 = 43.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.417, top1 = 85.74%], valid : [loss = 0.531, top1 = 82.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13694/15625) 013694-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10-valid  train : [loss = 1.826, top1 = 33.84%], valid : [loss = 1.849, top1 = 33.10%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.74 ms.
cifar10        train : [loss = 1.218, top1 = 56.35%], test  : [loss = 1.223, top1 = 55.90%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.07 ms.
cifar100       train : [loss = 3.805, top1 = 11.84%], valid : [loss = 3.888, top1 = 10.37%], test : [loss = 3.882, top1 = 10.97%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.02 ms.
ImageNet16-120 train : [loss = 3.770, top1 = 13.76%], valid : [loss = 3.740, top1 = 14.90%], test : [loss = 3.755, top1 = 14.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.957, top1 = 27.98%], valid : [loss = 1.960, top1 = 27.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13695/15625) 013695-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.094, top1 = 96.94%], valid : [loss = 0.669, top1 = 82.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10        train : [loss = 0.102, top1 = 96.59%], test  : [loss = 0.414, top1 = 88.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.36 ms.
cifar100       train : [loss = 0.716, top1 = 78.95%], valid : [loss = 1.546, top1 = 59.93%], test : [loss = 1.530, top1 = 60.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 3.051, top1 = 24.97%], valid : [loss = 3.067, top1 = 25.08%], test : [loss = 3.102, top1 = 24.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.42%], valid : [loss = 1.077, top1 = 61.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13696/15625) 013696-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.81 ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.99%], valid : [loss = 0.854, top1 = 70.94%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.90 ms.
cifar10        train : [loss = 0.679, top1 = 76.22%], test  : [loss = 0.763, top1 = 73.79%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.07 ms.
cifar100       train : [loss = 1.957, top1 = 47.92%], valid : [loss = 2.132, top1 = 44.69%], test : [loss = 2.142, top1 = 44.39%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.76 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.76%], valid : [loss = 3.674, top1 = 15.90%], test : [loss = 3.689, top1 = 14.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13697/15625) 013697-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.80%], valid : [loss = 0.550, top1 = 86.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10        train : [loss = 0.078, top1 = 97.41%], test  : [loss = 0.367, top1 = 90.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.48 ms.
cifar100       train : [loss = 0.528, top1 = 84.41%], valid : [loss = 1.327, top1 = 65.01%], test : [loss = 1.339, top1 = 65.17%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.887, top1 = 27.77%], valid : [loss = 2.916, top1 = 26.82%], test : [loss = 2.941, top1 = 27.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.145, top1 = 58.70%], valid : [loss = 1.173, top1 = 57.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13698/15625) 013698-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.607, top1 = 87.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.96 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.391, top1 = 91.35%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.47 ms.
cifar100       train : [loss = 0.126, top1 = 97.44%], valid : [loss = 1.544, top1 = 66.26%], test : [loss = 1.504, top1 = 66.73%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 1.978, top1 = 48.10%], valid : [loss = 2.422, top1 = 39.11%], test : [loss = 2.467, top1 = 39.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.89%], valid : [loss = 0.765, top1 = 73.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13699/15625) 013699-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.25 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.25 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.09 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13700/15625) 013700-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=22.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.496, top1 = 89.49%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=22.96 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.308, top1 = 93.25%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=21.75 ms.
cifar100       train : [loss = 0.098, top1 = 98.39%], valid : [loss = 1.287, top1 = 69.49%], test : [loss = 1.284, top1 = 69.73%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=19.96 ms.
ImageNet16-120 train : [loss = 1.641, top1 = 55.92%], valid : [loss = 2.185, top1 = 44.07%], test : [loss = 2.198, top1 = 44.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.20%], valid : [loss = 0.748, top1 = 74.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13701/15625) 013701-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10-valid  train : [loss = 0.308, top1 = 89.38%], valid : [loss = 0.481, top1 = 84.19%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10        train : [loss = 0.275, top1 = 90.72%], test  : [loss = 0.376, top1 = 87.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.20 ms.
cifar100       train : [loss = 1.287, top1 = 64.10%], valid : [loss = 1.496, top1 = 58.67%], test : [loss = 1.466, top1 = 59.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.68 ms.
ImageNet16-120 train : [loss = 2.825, top1 = 30.31%], valid : [loss = 2.809, top1 = 30.97%], test : [loss = 2.859, top1 = 30.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.82%], valid : [loss = 1.031, top1 = 63.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13702/15625) 013702-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.560, top1 = 88.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.368, top1 = 92.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.95 ms.
cifar100       train : [loss = 0.103, top1 = 98.15%], valid : [loss = 1.448, top1 = 67.83%], test : [loss = 1.472, top1 = 67.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.57%], valid : [loss = 2.417, top1 = 39.51%], test : [loss = 2.458, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13703/15625) 013703-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.58%], valid : [loss = 0.551, top1 = 87.70%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.358, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 0.536, top1 = 84.71%], valid : [loss = 1.356, top1 = 64.29%], test : [loss = 1.349, top1 = 64.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 35.88%], valid : [loss = 2.616, top1 = 33.59%], test : [loss = 2.641, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13704/15625) 013704-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.483, top1 = 89.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.322, top1 = 91.98%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.98 ms.
cifar100       train : [loss = 0.291, top1 = 92.28%], valid : [loss = 1.242, top1 = 68.31%], test : [loss = 1.239, top1 = 68.53%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 1.938, top1 = 48.95%], valid : [loss = 2.222, top1 = 42.99%], test : [loss = 2.260, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.32%], valid : [loss = 0.649, top1 = 77.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13705/15625) 013705-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.505, top1 = 88.20%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.10 ms.
cifar10        train : [loss = 0.026, top1 = 99.39%], test  : [loss = 0.348, top1 = 90.98%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.49 ms.
cifar100       train : [loss = 0.373, top1 = 89.70%], valid : [loss = 1.292, top1 = 67.11%], test : [loss = 1.294, top1 = 67.35%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.74%], valid : [loss = 2.380, top1 = 39.68%], test : [loss = 2.412, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.32%], valid : [loss = 0.608, top1 = 79.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13706/15625) 013706-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.62%], valid : [loss = 0.480, top1 = 88.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10        train : [loss = 0.025, top1 = 99.38%], test  : [loss = 0.321, top1 = 91.66%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.31 ms.
cifar100       train : [loss = 0.362, top1 = 90.08%], valid : [loss = 1.195, top1 = 68.58%], test : [loss = 1.193, top1 = 68.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.09%], valid : [loss = 2.286, top1 = 41.63%], test : [loss = 2.302, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.02%], valid : [loss = 0.786, top1 = 72.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13707/15625) 013707-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.552, top1 = 87.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.41 ms.
cifar10        train : [loss = 0.020, top1 = 99.45%], test  : [loss = 0.347, top1 = 91.60%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.41 ms.
cifar100       train : [loss = 0.334, top1 = 90.36%], valid : [loss = 1.334, top1 = 66.83%], test : [loss = 1.339, top1 = 67.21%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.18%], valid : [loss = 2.715, top1 = 31.44%], test : [loss = 2.720, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 63.70%], valid : [loss = 1.021, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13708/15625) 013708-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.484, top1 = 88.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.305, top1 = 92.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.31 ms.
cifar100       train : [loss = 0.238, top1 = 94.20%], valid : [loss = 1.260, top1 = 68.62%], test : [loss = 1.274, top1 = 68.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.57%], valid : [loss = 2.260, top1 = 42.11%], test : [loss = 2.269, top1 = 42.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 81.98%], valid : [loss = 0.595, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13709/15625) 013709-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.634, top1 = 86.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.81 ms.
cifar10        train : [loss = 0.029, top1 = 99.27%], test  : [loss = 0.425, top1 = 89.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.41 ms.
cifar100       train : [loss = 0.389, top1 = 89.51%], valid : [loss = 1.412, top1 = 64.71%], test : [loss = 1.403, top1 = 64.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.77%], valid : [loss = 2.616, top1 = 34.80%], test : [loss = 2.630, top1 = 34.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13710/15625) 013710-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.53%], valid : [loss = 0.860, top1 = 82.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.055, top1 = 98.33%], test  : [loss = 0.513, top1 = 87.23%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.17 ms.
cifar100       train : [loss = 0.534, top1 = 85.03%], valid : [loss = 1.705, top1 = 58.71%], test : [loss = 1.697, top1 = 58.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.62%], valid : [loss = 2.995, top1 = 27.89%], test : [loss = 3.021, top1 = 27.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.91%], valid : [loss = 0.899, top1 = 68.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13711/15625) 013711-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.77 ms.
cifar10-valid  train : [loss = 0.099, top1 = 96.94%], valid : [loss = 0.880, top1 = 78.62%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.27 ms.
cifar10        train : [loss = 0.146, top1 = 95.03%], test  : [loss = 0.525, top1 = 85.11%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.10 ms.
cifar100       train : [loss = 1.011, top1 = 70.73%], valid : [loss = 1.681, top1 = 56.38%], test : [loss = 1.676, top1 = 56.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.894, top1 = 28.81%], valid : [loss = 3.026, top1 = 26.47%], test : [loss = 3.062, top1 = 25.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.54%], valid : [loss = 0.930, top1 = 67.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13712/15625) 013712-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.485, top1 = 89.25%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.52 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.335, top1 = 92.19%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.28 ms.
cifar100       train : [loss = 0.218, top1 = 94.31%], valid : [loss = 1.382, top1 = 67.43%], test : [loss = 1.389, top1 = 67.51%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 1.927, top1 = 49.15%], valid : [loss = 2.308, top1 = 41.67%], test : [loss = 2.340, top1 = 40.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.70%], valid : [loss = 0.572, top1 = 80.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13713/15625) 013713-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.17%], valid : [loss = 0.708, top1 = 81.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10        train : [loss = 0.148, top1 = 94.98%], test  : [loss = 0.460, top1 = 86.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.39 ms.
cifar100       train : [loss = 0.973, top1 = 71.79%], valid : [loss = 1.632, top1 = 56.93%], test : [loss = 1.623, top1 = 57.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.31%], valid : [loss = 3.125, top1 = 24.30%], test : [loss = 3.174, top1 = 23.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.88%], valid : [loss = 0.972, top1 = 65.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13714/15625) 013714-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.430, top1 = 91.50%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=20.72 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.272, top1 = 94.37%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.68 ms.
cifar100       train : [loss = 0.016, top1 = 99.90%], valid : [loss = 1.283, top1 = 73.31%], test : [loss = 1.282, top1 = 73.09%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=18.75 ms.
ImageNet16-120 train : [loss = 1.064, top1 = 70.31%], valid : [loss = 2.258, top1 = 45.59%], test : [loss = 2.283, top1 = 46.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.304, top1 = 89.67%], valid : [loss = 0.465, top1 = 84.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13715/15625) 013715-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.14 ms.
cifar10-valid  train : [loss = 0.589, top1 = 79.33%], valid : [loss = 0.732, top1 = 75.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10        train : [loss = 0.500, top1 = 82.69%], test  : [loss = 0.581, top1 = 80.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.51 ms.
cifar100       train : [loss = 1.927, top1 = 47.60%], valid : [loss = 2.046, top1 = 45.20%], test : [loss = 2.056, top1 = 44.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 2.971, top1 = 27.26%], valid : [loss = 2.950, top1 = 27.74%], test : [loss = 2.983, top1 = 26.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.56%], valid : [loss = 1.196, top1 = 57.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13716/15625) 013716-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.569, top1 = 88.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.378, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.94 ms.
cifar100       train : [loss = 0.133, top1 = 97.37%], valid : [loss = 1.441, top1 = 67.77%], test : [loss = 1.417, top1 = 67.53%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 1.935, top1 = 49.05%], valid : [loss = 2.416, top1 = 39.34%], test : [loss = 2.429, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.02%], valid : [loss = 0.738, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13717/15625) 013717-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=21.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.490, top1 = 90.12%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=22.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.326, top1 = 92.87%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=22.52 ms.
cifar100       train : [loss = 0.085, top1 = 98.56%], valid : [loss = 1.302, top1 = 70.07%], test : [loss = 1.292, top1 = 70.09%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=21.41 ms.
ImageNet16-120 train : [loss = 1.640, top1 = 55.96%], valid : [loss = 2.143, top1 = 44.86%], test : [loss = 2.140, top1 = 45.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.575, top1 = 80.12%], valid : [loss = 0.663, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13718/15625) 013718-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.468, top1 = 89.29%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.20 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.322, top1 = 92.16%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.29 ms.
cifar100       train : [loss = 0.295, top1 = 91.96%], valid : [loss = 1.318, top1 = 67.30%], test : [loss = 1.327, top1 = 67.36%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.21%], valid : [loss = 2.342, top1 = 40.77%], test : [loss = 2.351, top1 = 40.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.30%], valid : [loss = 0.660, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13719/15625) 013719-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.555, top1 = 87.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.352, top1 = 91.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.49 ms.
cifar100       train : [loss = 0.420, top1 = 87.73%], valid : [loss = 1.263, top1 = 67.33%], test : [loss = 1.282, top1 = 67.11%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.82 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.36%], valid : [loss = 2.365, top1 = 39.89%], test : [loss = 2.386, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.825, top1 = 70.74%], valid : [loss = 0.879, top1 = 69.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13720/15625) 013720-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.464, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.307, top1 = 92.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.70 ms.
cifar100       train : [loss = 0.328, top1 = 91.14%], valid : [loss = 1.243, top1 = 67.90%], test : [loss = 1.246, top1 = 68.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.48%], valid : [loss = 2.317, top1 = 40.58%], test : [loss = 2.332, top1 = 41.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.55%], valid : [loss = 0.577, top1 = 80.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13721/15625) 013721-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.195, top1 = 93.49%], valid : [loss = 0.561, top1 = 83.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.22 ms.
cifar10        train : [loss = 0.202, top1 = 93.15%], test  : [loss = 0.407, top1 = 87.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.73 ms.
cifar100       train : [loss = 1.248, top1 = 64.54%], valid : [loss = 1.537, top1 = 57.91%], test : [loss = 1.547, top1 = 57.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.695, top1 = 32.65%], valid : [loss = 2.725, top1 = 32.78%], test : [loss = 2.773, top1 = 31.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.30%], valid : [loss = 0.987, top1 = 65.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13722/15625) 013722-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.62%], valid : [loss = 0.462, top1 = 86.48%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.48 ms.
cifar10        train : [loss = 0.120, top1 = 96.24%], test  : [loss = 0.338, top1 = 89.46%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=19.20 ms.
cifar100       train : [loss = 0.766, top1 = 78.55%], valid : [loss = 1.284, top1 = 64.03%], test : [loss = 1.289, top1 = 64.03%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.65%], valid : [loss = 2.588, top1 = 34.96%], test : [loss = 2.615, top1 = 34.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13723/15625) 013723-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.482, top1 = 89.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.320, top1 = 92.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.65 ms.
cifar100       train : [loss = 0.282, top1 = 92.78%], valid : [loss = 1.222, top1 = 68.81%], test : [loss = 1.232, top1 = 68.51%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.81%], valid : [loss = 2.215, top1 = 42.62%], test : [loss = 2.265, top1 = 42.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13724/15625) 013724-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.33%], valid : [loss = 0.581, top1 = 85.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.111, top1 = 96.29%], test  : [loss = 0.403, top1 = 88.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.53 ms.
cifar100       train : [loss = 0.826, top1 = 75.76%], valid : [loss = 1.421, top1 = 62.35%], test : [loss = 1.407, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.90 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.90%], valid : [loss = 2.761, top1 = 31.62%], test : [loss = 2.819, top1 = 30.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13725/15625) 013725-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.19%], valid : [loss = 0.591, top1 = 86.53%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.05 ms.
cifar10        train : [loss = 0.057, top1 = 98.18%], test  : [loss = 0.367, top1 = 90.16%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.75 ms.
cifar100       train : [loss = 0.596, top1 = 82.31%], valid : [loss = 1.338, top1 = 64.57%], test : [loss = 1.313, top1 = 65.08%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 2.321, top1 = 40.47%], valid : [loss = 2.476, top1 = 37.21%], test : [loss = 2.514, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.817, top1 = 71.07%], valid : [loss = 0.867, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13726/15625) 013726-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.48%], valid : [loss = 0.570, top1 = 87.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.033, top1 = 99.03%], test  : [loss = 0.375, top1 = 90.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.24 ms.
cifar100       train : [loss = 0.515, top1 = 85.20%], valid : [loss = 1.358, top1 = 64.49%], test : [loss = 1.357, top1 = 64.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.562, top1 = 34.86%], valid : [loss = 2.626, top1 = 32.87%], test : [loss = 2.656, top1 = 33.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13727/15625) 013727-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.486, top1 = 88.95%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.71 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.322, top1 = 92.21%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.23 ms.
cifar100       train : [loss = 0.326, top1 = 91.25%], valid : [loss = 1.248, top1 = 67.49%], test : [loss = 1.253, top1 = 67.71%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.043, top1 = 46.52%], valid : [loss = 2.312, top1 = 40.52%], test : [loss = 2.336, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.80%], valid : [loss = 0.584, top1 = 80.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13728/15625) 013728-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.43 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13729/15625) 013729-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.166, top1 = 94.56%], valid : [loss = 0.538, top1 = 84.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.10 ms.
cifar10        train : [loss = 0.180, top1 = 93.91%], test  : [loss = 0.389, top1 = 87.83%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.88 ms.
cifar100       train : [loss = 1.213, top1 = 65.56%], valid : [loss = 1.533, top1 = 58.12%], test : [loss = 1.534, top1 = 58.21%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 34.16%], valid : [loss = 2.672, top1 = 32.79%], test : [loss = 2.713, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 68.25%], valid : [loss = 0.946, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13730/15625) 013730-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.573, top1 = 87.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.016, top1 = 99.66%], test  : [loss = 0.386, top1 = 91.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 0.392, top1 = 88.86%], valid : [loss = 1.399, top1 = 65.47%], test : [loss = 1.398, top1 = 65.55%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.05%], valid : [loss = 2.519, top1 = 36.80%], test : [loss = 2.523, top1 = 37.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13731/15625) 013731-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.511, top1 = 88.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.78 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.343, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.49 ms.
cifar100       train : [loss = 0.348, top1 = 90.52%], valid : [loss = 1.281, top1 = 66.77%], test : [loss = 1.289, top1 = 66.95%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.58%], valid : [loss = 2.418, top1 = 38.64%], test : [loss = 2.420, top1 = 38.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13732/15625) 013732-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.540, top1 = 88.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.352, top1 = 91.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.32 ms.
cifar100       train : [loss = 0.436, top1 = 87.38%], valid : [loss = 1.237, top1 = 67.35%], test : [loss = 1.262, top1 = 67.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.46%], valid : [loss = 2.378, top1 = 39.28%], test : [loss = 2.383, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.20%], valid : [loss = 0.698, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13733/15625) 013733-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.591, top1 = 87.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.022, top1 = 99.42%], test  : [loss = 0.401, top1 = 90.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.28 ms.
cifar100       train : [loss = 0.323, top1 = 91.18%], valid : [loss = 1.533, top1 = 63.57%], test : [loss = 1.526, top1 = 63.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.202, top1 = 43.15%], valid : [loss = 2.521, top1 = 36.44%], test : [loss = 2.517, top1 = 37.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.762, top1 = 72.78%], valid : [loss = 0.834, top1 = 70.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13734/15625) 013734-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.27 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.96%], valid : [loss = 0.479, top1 = 84.30%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.69 ms.
cifar10        train : [loss = 0.298, top1 = 90.04%], test  : [loss = 0.399, top1 = 86.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.73 ms.
cifar100       train : [loss = 1.331, top1 = 63.03%], valid : [loss = 1.537, top1 = 57.63%], test : [loss = 1.505, top1 = 58.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.76 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.81%], valid : [loss = 2.902, top1 = 29.37%], test : [loss = 2.951, top1 = 27.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13735/15625) 013735-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.500, top1 = 89.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.71 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.314, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.66 ms.
cifar100       train : [loss = 0.241, top1 = 93.72%], valid : [loss = 1.267, top1 = 68.25%], test : [loss = 1.297, top1 = 68.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.73%], valid : [loss = 2.252, top1 = 41.73%], test : [loss = 2.262, top1 = 42.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.14%], valid : [loss = 0.583, top1 = 80.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13736/15625) 013736-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.67 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.518, top1 = 88.83%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.21 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.329, top1 = 92.19%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.68 ms.
cifar100       train : [loss = 0.216, top1 = 94.76%], valid : [loss = 1.248, top1 = 68.97%], test : [loss = 1.258, top1 = 68.91%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.95 ms.
ImageNet16-120 train : [loss = 1.928, top1 = 49.11%], valid : [loss = 2.300, top1 = 41.23%], test : [loss = 2.299, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.16%], valid : [loss = 0.727, top1 = 74.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13737/15625) 013737-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.481, top1 = 89.21%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.34 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.320, top1 = 92.34%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.58 ms.
cifar100       train : [loss = 0.249, top1 = 93.85%], valid : [loss = 1.257, top1 = 68.25%], test : [loss = 1.249, top1 = 68.50%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.18 ms.
ImageNet16-120 train : [loss = 1.939, top1 = 48.97%], valid : [loss = 2.278, top1 = 41.33%], test : [loss = 2.301, top1 = 41.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.02%], valid : [loss = 0.630, top1 = 78.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13738/15625) 013738-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.53%], valid : [loss = 0.648, top1 = 86.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.031, top1 = 99.08%], test  : [loss = 0.419, top1 = 89.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.347, top1 = 90.35%], valid : [loss = 1.558, top1 = 63.03%], test : [loss = 1.582, top1 = 62.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.744, top1 = 31.14%], valid : [loss = 2.839, top1 = 29.30%], test : [loss = 2.860, top1 = 29.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.17%], valid : [loss = 0.992, top1 = 64.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13739/15625) 013739-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.569, top1 = 87.61%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.382, top1 = 91.11%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.60 ms.
cifar100       train : [loss = 0.414, top1 = 88.25%], valid : [loss = 1.390, top1 = 65.50%], test : [loss = 1.378, top1 = 65.81%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.99%], valid : [loss = 2.494, top1 = 37.10%], test : [loss = 2.517, top1 = 37.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.63%], valid : [loss = 0.829, top1 = 70.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13740/15625) 013740-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.690, top1 = 85.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10        train : [loss = 0.021, top1 = 99.42%], test  : [loss = 0.441, top1 = 89.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.52 ms.
cifar100       train : [loss = 0.294, top1 = 92.34%], valid : [loss = 1.614, top1 = 62.93%], test : [loss = 1.594, top1 = 62.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.179, top1 = 43.46%], valid : [loss = 2.551, top1 = 36.13%], test : [loss = 2.568, top1 = 36.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.766, top1 = 72.77%], valid : [loss = 0.842, top1 = 70.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13741/15625) 013741-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.452, top1 = 90.54%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.98%], test  : [loss = 0.306, top1 = 93.46%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.92 ms.
cifar100       train : [loss = 0.040, top1 = 99.52%], valid : [loss = 1.378, top1 = 70.49%], test : [loss = 1.363, top1 = 70.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.406, top1 = 61.66%], valid : [loss = 2.256, top1 = 43.44%], test : [loss = 2.285, top1 = 44.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.430, top1 = 85.03%], valid : [loss = 0.567, top1 = 80.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13742/15625) 013742-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.68%], valid : [loss = 0.643, top1 = 86.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10        train : [loss = 0.020, top1 = 99.42%], test  : [loss = 0.431, top1 = 90.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.85 ms.
cifar100       train : [loss = 0.229, top1 = 93.99%], valid : [loss = 1.551, top1 = 64.00%], test : [loss = 1.555, top1 = 64.49%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 2.698, top1 = 32.03%], valid : [loss = 2.801, top1 = 29.82%], test : [loss = 2.814, top1 = 29.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.06%], valid : [loss = 0.943, top1 = 66.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13743/15625) 013743-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.433, top1 = 90.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.53 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.294, top1 = 93.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.00 ms.
cifar100       train : [loss = 0.114, top1 = 97.95%], valid : [loss = 1.312, top1 = 69.37%], test : [loss = 1.277, top1 = 70.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 1.704, top1 = 54.45%], valid : [loss = 2.220, top1 = 44.10%], test : [loss = 2.256, top1 = 43.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.407, top1 = 85.93%], valid : [loss = 0.525, top1 = 82.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13744/15625) 013744-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.476, top1 = 89.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.72%], test  : [loss = 0.326, top1 = 92.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.01 ms.
cifar100       train : [loss = 0.367, top1 = 89.63%], valid : [loss = 1.309, top1 = 66.79%], test : [loss = 1.303, top1 = 67.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.24 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.77%], valid : [loss = 2.398, top1 = 39.01%], test : [loss = 2.433, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.25%], valid : [loss = 0.649, top1 = 77.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13745/15625) 013745-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.530, top1 = 88.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.343, top1 = 92.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 0.298, top1 = 91.93%], valid : [loss = 1.325, top1 = 67.43%], test : [loss = 1.317, top1 = 66.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.167, top1 = 43.73%], valid : [loss = 2.436, top1 = 38.30%], test : [loss = 2.430, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13746/15625) 013746-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.04 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.37%], valid : [loss = 0.453, top1 = 86.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.41 ms.
cifar10        train : [loss = 0.156, top1 = 94.91%], test  : [loss = 0.347, top1 = 88.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.26 ms.
cifar100       train : [loss = 0.984, top1 = 71.87%], valid : [loss = 1.361, top1 = 62.17%], test : [loss = 1.341, top1 = 62.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.89%], valid : [loss = 2.697, top1 = 33.21%], test : [loss = 2.714, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13747/15625) 013747-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13748/15625) 013748-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.567, top1 = 88.51%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.409, top1 = 91.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.04 ms.
cifar100       train : [loss = 0.152, top1 = 96.51%], valid : [loss = 1.507, top1 = 66.43%], test : [loss = 1.503, top1 = 66.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 48.07%], valid : [loss = 2.437, top1 = 38.92%], test : [loss = 2.467, top1 = 39.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.03%], valid : [loss = 0.761, top1 = 73.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13749/15625) 013749-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.480, top1 = 89.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.329, top1 = 92.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.209, top1 = 94.74%], valid : [loss = 1.406, top1 = 67.21%], test : [loss = 1.367, top1 = 67.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.80 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.52%], valid : [loss = 2.321, top1 = 41.01%], test : [loss = 2.351, top1 = 40.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.422, top1 = 85.49%], valid : [loss = 0.523, top1 = 82.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13750/15625) 013750-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.509, top1 = 89.89%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.324, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.52 ms.
cifar100       train : [loss = 0.110, top1 = 97.90%], valid : [loss = 1.294, top1 = 69.47%], test : [loss = 1.309, top1 = 69.55%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.58 ms.
ImageNet16-120 train : [loss = 1.698, top1 = 54.55%], valid : [loss = 2.184, top1 = 44.52%], test : [loss = 2.200, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.24%], valid : [loss = 0.633, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13751/15625) 013751-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.26%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.319, top1 = 91.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.97 ms.
cifar100       train : [loss = 0.328, top1 = 91.09%], valid : [loss = 1.310, top1 = 66.95%], test : [loss = 1.323, top1 = 67.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.18%], valid : [loss = 2.386, top1 = 39.82%], test : [loss = 2.416, top1 = 38.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13752/15625) 013752-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10-valid  train : [loss = 0.793, top1 = 72.03%], valid : [loss = 1.107, top1 = 63.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.99 ms.
cifar10        train : [loss = 0.780, top1 = 72.55%], test  : [loss = 0.913, top1 = 68.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.91 ms.
cifar100       train : [loss = 2.133, top1 = 44.07%], valid : [loss = 2.421, top1 = 39.00%], test : [loss = 2.412, top1 = 39.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 3.761, top1 = 13.97%], valid : [loss = 3.819, top1 = 13.98%], test : [loss = 3.829, top1 = 13.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.360, top1 = 50.56%], valid : [loss = 1.418, top1 = 48.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13753/15625) 013753-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.51%], valid : [loss = 0.731, top1 = 81.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.52 ms.
cifar10        train : [loss = 0.151, top1 = 94.86%], test  : [loss = 0.490, top1 = 85.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.65 ms.
cifar100       train : [loss = 0.938, top1 = 72.61%], valid : [loss = 1.626, top1 = 57.13%], test : [loss = 1.606, top1 = 58.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 25.61%], valid : [loss = 3.109, top1 = 24.76%], test : [loss = 3.151, top1 = 23.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.936, top1 = 66.72%], valid : [loss = 0.992, top1 = 64.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13754/15625) 013754-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.43%], valid : [loss = 0.471, top1 = 85.89%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.157, top1 = 94.86%], test  : [loss = 0.347, top1 = 88.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.69 ms.
cifar100       train : [loss = 0.986, top1 = 71.87%], valid : [loss = 1.344, top1 = 62.29%], test : [loss = 1.348, top1 = 62.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 34.03%], valid : [loss = 2.679, top1 = 32.90%], test : [loss = 2.696, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13755/15625) 013755-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.294, top1 = 93.57%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.01 ms.
cifar100       train : [loss = 0.064, top1 = 99.07%], valid : [loss = 1.365, top1 = 70.19%], test : [loss = 1.341, top1 = 70.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 1.545, top1 = 58.18%], valid : [loss = 2.242, top1 = 43.96%], test : [loss = 2.285, top1 = 43.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13756/15625) 013756-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13757/15625) 013757-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.309, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.54 ms.
cifar100       train : [loss = 0.336, top1 = 90.95%], valid : [loss = 1.251, top1 = 67.27%], test : [loss = 1.260, top1 = 67.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.62%], valid : [loss = 2.307, top1 = 40.99%], test : [loss = 2.337, top1 = 40.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 81.96%], valid : [loss = 0.599, top1 = 79.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13758/15625) 013758-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.345, top1 = 88.07%], valid : [loss = 0.581, top1 = 81.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10        train : [loss = 0.280, top1 = 90.42%], test  : [loss = 0.428, top1 = 86.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.90 ms.
cifar100       train : [loss = 1.496, top1 = 58.17%], valid : [loss = 1.725, top1 = 52.97%], test : [loss = 1.714, top1 = 53.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.66 ms.
ImageNet16-120 train : [loss = 3.002, top1 = 26.64%], valid : [loss = 2.991, top1 = 26.56%], test : [loss = 3.055, top1 = 25.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.029, top1 = 63.09%], valid : [loss = 1.078, top1 = 61.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13759/15625) 013759-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.516, top1 = 89.36%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.48 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.332, top1 = 92.69%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.62 ms.
cifar100       train : [loss = 0.128, top1 = 97.36%], valid : [loss = 1.337, top1 = 68.85%], test : [loss = 1.340, top1 = 68.87%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.84%], valid : [loss = 2.218, top1 = 43.31%], test : [loss = 2.218, top1 = 43.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.08%], valid : [loss = 0.671, top1 = 77.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13760/15625) 013760-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.18%], valid : [loss = 0.453, top1 = 86.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.43 ms.
cifar10        train : [loss = 0.161, top1 = 94.76%], test  : [loss = 0.354, top1 = 88.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.70 ms.
cifar100       train : [loss = 0.991, top1 = 71.83%], valid : [loss = 1.357, top1 = 61.93%], test : [loss = 1.350, top1 = 61.69%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.78%], valid : [loss = 2.691, top1 = 32.79%], test : [loss = 2.712, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13761/15625) 013761-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.430, top1 = 90.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.39 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.280, top1 = 93.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.83 ms.
cifar100       train : [loss = 0.164, top1 = 96.23%], valid : [loss = 1.282, top1 = 69.73%], test : [loss = 1.296, top1 = 69.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 1.779, top1 = 52.70%], valid : [loss = 2.239, top1 = 42.99%], test : [loss = 2.268, top1 = 43.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.38%], valid : [loss = 0.520, top1 = 82.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13762/15625) 013762-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.73%], valid : [loss = 0.569, top1 = 85.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.071, top1 = 97.87%], test  : [loss = 0.367, top1 = 89.47%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.09 ms.
cifar100       train : [loss = 0.627, top1 = 81.88%], valid : [loss = 1.350, top1 = 64.51%], test : [loss = 1.358, top1 = 64.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.411, top1 = 38.40%], valid : [loss = 2.545, top1 = 35.84%], test : [loss = 2.559, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.50%], valid : [loss = 0.867, top1 = 69.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13763/15625) 013763-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.90%], valid : [loss = 0.473, top1 = 84.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10        train : [loss = 0.299, top1 = 89.87%], test  : [loss = 0.397, top1 = 86.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 1.328, top1 = 63.17%], valid : [loss = 1.532, top1 = 57.81%], test : [loss = 1.516, top1 = 58.15%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.57%], valid : [loss = 2.902, top1 = 29.21%], test : [loss = 2.965, top1 = 28.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13764/15625) 013764-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.14%], valid : [loss = 0.546, top1 = 82.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.13 ms.
cifar10        train : [loss = 0.271, top1 = 90.70%], test  : [loss = 0.425, top1 = 85.87%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.15 ms.
cifar100       train : [loss = 1.426, top1 = 60.04%], valid : [loss = 1.677, top1 = 54.57%], test : [loss = 1.650, top1 = 55.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 2.947, top1 = 27.87%], valid : [loss = 2.957, top1 = 27.84%], test : [loss = 3.012, top1 = 26.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.957, top1 = 65.62%], valid : [loss = 1.018, top1 = 64.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13765/15625) 013765-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.517, top1 = 89.18%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.92 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.328, top1 = 92.65%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.39 ms.
cifar100       train : [loss = 0.202, top1 = 95.11%], valid : [loss = 1.277, top1 = 68.52%], test : [loss = 1.281, top1 = 69.29%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 1.783, top1 = 52.51%], valid : [loss = 2.197, top1 = 43.38%], test : [loss = 2.206, top1 = 43.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.44%], valid : [loss = 0.737, top1 = 74.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13766/15625) 013766-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.575, top1 = 88.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.386, top1 = 91.79%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.75 ms.
cifar100       train : [loss = 0.176, top1 = 96.17%], valid : [loss = 1.412, top1 = 67.47%], test : [loss = 1.422, top1 = 67.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.96%], valid : [loss = 2.463, top1 = 38.33%], test : [loss = 2.461, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13767/15625) 013767-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.01%], valid : [loss = 0.850, top1 = 71.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.85 ms.
cifar10        train : [loss = 0.558, top1 = 80.52%], test  : [loss = 0.707, top1 = 75.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.83 ms.
cifar100       train : [loss = 1.788, top1 = 51.83%], valid : [loss = 2.067, top1 = 46.61%], test : [loss = 2.059, top1 = 47.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.04 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.79%], valid : [loss = 3.634, top1 = 16.69%], test : [loss = 3.673, top1 = 15.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.187, top1 = 57.15%], valid : [loss = 1.249, top1 = 55.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13768/15625) 013768-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.434, top1 = 89.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.291, top1 = 92.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.60 ms.
cifar100       train : [loss = 0.205, top1 = 95.22%], valid : [loss = 1.284, top1 = 68.61%], test : [loss = 1.251, top1 = 69.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.83%], valid : [loss = 2.263, top1 = 42.28%], test : [loss = 2.305, top1 = 42.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13769/15625) 013769-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.431, top1 = 89.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.289, top1 = 92.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.61 ms.
cifar100       train : [loss = 0.208, top1 = 95.11%], valid : [loss = 1.259, top1 = 68.97%], test : [loss = 1.265, top1 = 68.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.90%], valid : [loss = 2.269, top1 = 42.20%], test : [loss = 2.290, top1 = 41.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13770/15625) 013770-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.74 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.30%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10        train : [loss = 0.014, top1 = 99.75%], test  : [loss = 0.317, top1 = 91.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 0.330, top1 = 91.01%], valid : [loss = 1.320, top1 = 66.93%], test : [loss = 1.293, top1 = 67.19%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.43%], valid : [loss = 2.381, top1 = 39.71%], test : [loss = 2.397, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13771/15625) 013771-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.23%], valid : [loss = 0.463, top1 = 86.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.80 ms.
cifar10        train : [loss = 0.152, top1 = 95.09%], test  : [loss = 0.347, top1 = 88.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.30 ms.
cifar100       train : [loss = 1.000, top1 = 71.52%], valid : [loss = 1.365, top1 = 61.90%], test : [loss = 1.354, top1 = 62.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.06%], valid : [loss = 2.668, top1 = 32.64%], test : [loss = 2.694, top1 = 32.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13772/15625) 013772-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.83%], valid : [loss = 0.575, top1 = 86.62%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.75 ms.
cifar10        train : [loss = 0.074, top1 = 97.57%], test  : [loss = 0.376, top1 = 89.75%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.01 ms.
cifar100       train : [loss = 0.684, top1 = 79.75%], valid : [loss = 1.358, top1 = 64.45%], test : [loss = 1.318, top1 = 64.67%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.10%], valid : [loss = 2.505, top1 = 36.41%], test : [loss = 2.536, top1 = 35.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.80%], valid : [loss = 0.822, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13773/15625) 013773-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.20%], valid : [loss = 0.590, top1 = 85.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.074, top1 = 97.74%], test  : [loss = 0.397, top1 = 88.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.74 ms.
cifar100       train : [loss = 0.719, top1 = 79.18%], valid : [loss = 1.372, top1 = 63.43%], test : [loss = 1.383, top1 = 63.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.92%], valid : [loss = 2.657, top1 = 33.92%], test : [loss = 2.693, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13774/15625) 013774-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.394, top1 = 86.42%], valid : [loss = 0.526, top1 = 82.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.400, top1 = 86.44%], test  : [loss = 0.461, top1 = 84.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.29 ms.
cifar100       train : [loss = 1.533, top1 = 57.89%], valid : [loss = 1.652, top1 = 54.53%], test : [loss = 1.657, top1 = 54.71%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 26.36%], valid : [loss = 3.007, top1 = 27.31%], test : [loss = 3.048, top1 = 26.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 60.45%], valid : [loss = 1.137, top1 = 59.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13775/15625) 013775-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.504, top1 = 89.58%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.309, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.130, top1 = 97.42%], valid : [loss = 1.293, top1 = 68.99%], test : [loss = 1.300, top1 = 69.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.66%], valid : [loss = 2.311, top1 = 41.51%], test : [loss = 2.293, top1 = 41.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13776/15625) 013776-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.42%], valid : [loss = 0.619, top1 = 85.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.46 ms.
cifar10        train : [loss = 0.036, top1 = 98.95%], test  : [loss = 0.403, top1 = 90.17%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.81 ms.
cifar100       train : [loss = 0.569, top1 = 83.26%], valid : [loss = 1.452, top1 = 63.00%], test : [loss = 1.434, top1 = 63.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.343, top1 = 39.90%], valid : [loss = 2.535, top1 = 36.54%], test : [loss = 2.566, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.07%], valid : [loss = 0.895, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13777/15625) 013777-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.506, top1 = 88.64%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.322, top1 = 92.32%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.81 ms.
cifar100       train : [loss = 0.325, top1 = 91.18%], valid : [loss = 1.291, top1 = 67.09%], test : [loss = 1.277, top1 = 67.58%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.18%], valid : [loss = 2.407, top1 = 38.61%], test : [loss = 2.407, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.78%], valid : [loss = 0.647, top1 = 77.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13778/15625) 013778-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.99 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.412, top1 = 91.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.282, top1 = 93.90%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.67 ms.
cifar100       train : [loss = 0.046, top1 = 99.41%], valid : [loss = 1.315, top1 = 71.75%], test : [loss = 1.307, top1 = 71.13%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.08 ms.
ImageNet16-120 train : [loss = 1.410, top1 = 61.59%], valid : [loss = 2.146, top1 = 46.06%], test : [loss = 2.206, top1 = 46.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.329, top1 = 88.94%], valid : [loss = 0.480, top1 = 84.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13779/15625) 013779-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.51%], valid : [loss = 0.561, top1 = 82.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.03 ms.
cifar10        train : [loss = 0.265, top1 = 90.86%], test  : [loss = 0.412, top1 = 86.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.92 ms.
cifar100       train : [loss = 1.425, top1 = 59.97%], valid : [loss = 1.669, top1 = 54.69%], test : [loss = 1.672, top1 = 54.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.20%], valid : [loss = 2.928, top1 = 27.83%], test : [loss = 2.986, top1 = 26.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.989, top1 = 64.28%], valid : [loss = 1.019, top1 = 63.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13780/15625) 013780-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.089, top1 = 97.59%], valid : [loss = 0.462, top1 = 86.45%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.11 ms.
cifar10        train : [loss = 0.122, top1 = 96.21%], test  : [loss = 0.329, top1 = 89.25%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.24 ms.
cifar100       train : [loss = 0.764, top1 = 78.51%], valid : [loss = 1.286, top1 = 64.37%], test : [loss = 1.272, top1 = 64.81%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.501, top1 = 36.68%], valid : [loss = 2.591, top1 = 35.12%], test : [loss = 2.615, top1 = 34.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.69%], valid : [loss = 0.835, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13781/15625) 013781-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.528, top1 = 89.09%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.24 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.356, top1 = 92.37%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.35 ms.
cifar100       train : [loss = 0.067, top1 = 99.24%], valid : [loss = 1.396, top1 = 69.05%], test : [loss = 1.407, top1 = 68.94%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 1.729, top1 = 53.92%], valid : [loss = 2.404, top1 = 40.77%], test : [loss = 2.431, top1 = 40.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.27%], valid : [loss = 0.701, top1 = 75.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13782/15625) 013782-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.54%], valid : [loss = 0.634, top1 = 85.75%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.03 ms.
cifar10        train : [loss = 0.038, top1 = 98.92%], test  : [loss = 0.404, top1 = 89.93%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.44 ms.
cifar100       train : [loss = 0.541, top1 = 84.24%], valid : [loss = 1.436, top1 = 63.63%], test : [loss = 1.441, top1 = 63.30%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.388, top1 = 38.95%], valid : [loss = 2.569, top1 = 35.56%], test : [loss = 2.605, top1 = 35.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.86%], valid : [loss = 0.894, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13783/15625) 013783-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.95%], valid : [loss = 0.452, top1 = 89.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.310, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.21 ms.
cifar100       train : [loss = 0.322, top1 = 91.35%], valid : [loss = 1.320, top1 = 67.21%], test : [loss = 1.311, top1 = 66.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.83 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.38%], valid : [loss = 2.376, top1 = 39.76%], test : [loss = 2.408, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 84.24%], valid : [loss = 0.560, top1 = 80.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13784/15625) 013784-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.72%], valid : [loss = 0.466, top1 = 86.49%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.35 ms.
cifar10        train : [loss = 0.125, top1 = 96.01%], test  : [loss = 0.345, top1 = 89.01%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.10 ms.
cifar100       train : [loss = 0.754, top1 = 78.93%], valid : [loss = 1.288, top1 = 64.40%], test : [loss = 1.283, top1 = 64.13%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.511, top1 = 36.49%], valid : [loss = 2.603, top1 = 34.42%], test : [loss = 2.612, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.26%], valid : [loss = 0.849, top1 = 70.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13785/15625) 013785-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.544, top1 = 89.02%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.70 ms.
cifar10        train : [loss = 0.009, top1 = 99.77%], test  : [loss = 0.348, top1 = 92.34%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.88 ms.
cifar100       train : [loss = 0.156, top1 = 96.41%], valid : [loss = 1.308, top1 = 69.18%], test : [loss = 1.285, top1 = 69.49%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.44 ms.
ImageNet16-120 train : [loss = 1.758, top1 = 53.17%], valid : [loss = 2.181, top1 = 43.78%], test : [loss = 2.200, top1 = 44.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.22%], valid : [loss = 0.840, top1 = 70.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13786/15625) 013786-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.568, top1 = 87.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.21 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.376, top1 = 91.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.22 ms.
cifar100       train : [loss = 0.202, top1 = 95.21%], valid : [loss = 1.466, top1 = 66.01%], test : [loss = 1.437, top1 = 66.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.42 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.81%], valid : [loss = 2.461, top1 = 37.81%], test : [loss = 2.471, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 77.75%], valid : [loss = 0.691, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13787/15625) 013787-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.545, top1 = 88.44%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.78 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.347, top1 = 92.18%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.36 ms.
cifar100       train : [loss = 0.155, top1 = 96.14%], valid : [loss = 1.401, top1 = 67.69%], test : [loss = 1.403, top1 = 68.49%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.52 ms.
ImageNet16-120 train : [loss = 2.243, top1 = 41.99%], valid : [loss = 2.462, top1 = 37.03%], test : [loss = 2.483, top1 = 37.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.65%], valid : [loss = 0.900, top1 = 67.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13788/15625) 013788-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.21%], valid : [loss = 0.604, top1 = 86.39%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10        train : [loss = 0.042, top1 = 98.73%], test  : [loss = 0.381, top1 = 90.42%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.09 ms.
cifar100       train : [loss = 0.229, top1 = 93.62%], valid : [loss = 1.366, top1 = 67.43%], test : [loss = 1.396, top1 = 67.35%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.779, top1 = 30.31%], valid : [loss = 2.889, top1 = 28.21%], test : [loss = 2.897, top1 = 28.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 63.96%], valid : [loss = 1.017, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13789/15625) 013789-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.593, top1 = 87.83%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.94 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.377, top1 = 91.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.31 ms.
cifar100       train : [loss = 0.091, top1 = 98.27%], valid : [loss = 1.584, top1 = 66.04%], test : [loss = 1.536, top1 = 66.87%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.59%], valid : [loss = 2.412, top1 = 39.51%], test : [loss = 2.405, top1 = 40.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.20%], valid : [loss = 0.788, top1 = 72.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13790/15625) 013790-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.81%], valid : [loss = 0.649, top1 = 86.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10        train : [loss = 0.022, top1 = 99.42%], test  : [loss = 0.430, top1 = 90.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.52 ms.
cifar100       train : [loss = 0.258, top1 = 93.16%], valid : [loss = 1.523, top1 = 64.23%], test : [loss = 1.527, top1 = 64.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.197, top1 = 43.24%], valid : [loss = 2.525, top1 = 36.60%], test : [loss = 2.546, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.789, top1 = 72.05%], valid : [loss = 0.853, top1 = 70.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13791/15625) 013791-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.530, top1 = 89.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.58 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.352, top1 = 92.38%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.220, top1 = 94.28%], valid : [loss = 1.296, top1 = 68.35%], test : [loss = 1.301, top1 = 68.73%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 1.955, top1 = 48.56%], valid : [loss = 2.279, top1 = 41.08%], test : [loss = 2.301, top1 = 41.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.08%], valid : [loss = 0.816, top1 = 71.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13792/15625) 013792-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.606, top1 = 86.43%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.027, top1 = 99.26%], test  : [loss = 0.399, top1 = 90.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.509, top1 = 85.21%], valid : [loss = 1.417, top1 = 63.87%], test : [loss = 1.431, top1 = 63.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 39.98%], valid : [loss = 2.555, top1 = 35.77%], test : [loss = 2.547, top1 = 36.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.06%], valid : [loss = 0.820, top1 = 71.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13793/15625) 013793-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.26%], valid : [loss = 0.459, top1 = 86.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10        train : [loss = 0.158, top1 = 94.84%], test  : [loss = 0.346, top1 = 88.76%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.46 ms.
cifar100       train : [loss = 0.998, top1 = 71.54%], valid : [loss = 1.361, top1 = 62.22%], test : [loss = 1.347, top1 = 62.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.76%], valid : [loss = 2.687, top1 = 33.34%], test : [loss = 2.706, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13794/15625) 013794-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.24 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.50%], valid : [loss = 0.561, top1 = 87.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.034, top1 = 98.99%], test  : [loss = 0.353, top1 = 91.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.455, top1 = 86.71%], valid : [loss = 1.322, top1 = 65.91%], test : [loss = 1.333, top1 = 65.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.18%], valid : [loss = 2.688, top1 = 31.99%], test : [loss = 2.721, top1 = 31.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.047, top1 = 62.06%], valid : [loss = 1.056, top1 = 62.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13795/15625) 013795-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.590, top1 = 87.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10        train : [loss = 0.021, top1 = 99.48%], test  : [loss = 0.387, top1 = 90.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.36 ms.
cifar100       train : [loss = 0.449, top1 = 87.04%], valid : [loss = 1.405, top1 = 65.06%], test : [loss = 1.378, top1 = 65.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.34%], valid : [loss = 2.517, top1 = 37.12%], test : [loss = 2.541, top1 = 36.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.75%], valid : [loss = 0.823, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13796/15625) 013796-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.57 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.21%], valid : [loss = 0.500, top1 = 86.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.73 ms.
cifar10        train : [loss = 0.054, top1 = 98.44%], test  : [loss = 0.346, top1 = 90.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.81 ms.
cifar100       train : [loss = 0.559, top1 = 83.74%], valid : [loss = 1.225, top1 = 66.93%], test : [loss = 1.211, top1 = 67.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.24 ms.
ImageNet16-120 train : [loss = 2.159, top1 = 43.99%], valid : [loss = 2.343, top1 = 40.46%], test : [loss = 2.369, top1 = 40.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.60%], valid : [loss = 0.865, top1 = 68.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13797/15625) 013797-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.19%], valid : [loss = 0.578, top1 = 85.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.68 ms.
cifar10        train : [loss = 0.110, top1 = 96.33%], test  : [loss = 0.387, top1 = 88.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.95 ms.
cifar100       train : [loss = 0.821, top1 = 75.86%], valid : [loss = 1.414, top1 = 62.42%], test : [loss = 1.410, top1 = 62.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.14%], valid : [loss = 2.754, top1 = 30.93%], test : [loss = 2.794, top1 = 31.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.17%], valid : [loss = 0.719, top1 = 75.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13798/15625) 013798-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.33%], valid : [loss = 0.706, top1 = 81.78%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.17 ms.
cifar10        train : [loss = 0.148, top1 = 95.02%], test  : [loss = 0.453, top1 = 86.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 0.974, top1 = 71.82%], valid : [loss = 1.642, top1 = 56.90%], test : [loss = 1.634, top1 = 57.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.62 ms.
ImageNet16-120 train : [loss = 3.063, top1 = 25.16%], valid : [loss = 3.116, top1 = 24.28%], test : [loss = 3.165, top1 = 23.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13799/15625) 013799-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.468, top1 = 89.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.99 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.315, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.60 ms.
cifar100       train : [loss = 0.197, top1 = 95.32%], valid : [loss = 1.326, top1 = 68.49%], test : [loss = 1.316, top1 = 68.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.61%], valid : [loss = 2.280, top1 = 41.44%], test : [loss = 2.311, top1 = 42.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.68%], valid : [loss = 0.572, top1 = 80.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13800/15625) 013800-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.30 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.525, top1 = 88.50%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.28 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.357, top1 = 91.24%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.16 ms.
cifar100       train : [loss = 0.422, top1 = 87.72%], valid : [loss = 1.255, top1 = 67.53%], test : [loss = 1.283, top1 = 67.14%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.72 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.58%], valid : [loss = 2.362, top1 = 39.94%], test : [loss = 2.385, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.95%], valid : [loss = 0.725, top1 = 75.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13801/15625) 013801-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.415, top1 = 91.12%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.23 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.277, top1 = 93.85%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.41 ms.
cifar100       train : [loss = 0.042, top1 = 99.57%], valid : [loss = 1.314, top1 = 70.77%], test : [loss = 1.324, top1 = 70.99%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.04 ms.
ImageNet16-120 train : [loss = 1.431, top1 = 61.00%], valid : [loss = 2.214, top1 = 44.38%], test : [loss = 2.246, top1 = 44.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.339, top1 = 88.43%], valid : [loss = 0.487, top1 = 83.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13802/15625) 013802-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.199, top1 = 93.40%], valid : [loss = 0.481, top1 = 84.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.13 ms.
cifar10        train : [loss = 0.229, top1 = 92.37%], test  : [loss = 0.385, top1 = 87.31%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.60 ms.
cifar100       train : [loss = 1.273, top1 = 64.18%], valid : [loss = 1.547, top1 = 57.24%], test : [loss = 1.554, top1 = 56.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 3.339, top1 = 20.58%], valid : [loss = 3.333, top1 = 20.19%], test : [loss = 3.354, top1 = 20.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.44%], valid : [loss = 1.046, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13803/15625) 013803-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.530, top1 = 89.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.17 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.330, top1 = 93.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.87 ms.
cifar100       train : [loss = 0.028, top1 = 99.77%], valid : [loss = 1.415, top1 = 70.32%], test : [loss = 1.390, top1 = 70.59%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.74 ms.
ImageNet16-120 train : [loss = 1.535, top1 = 58.57%], valid : [loss = 2.408, top1 = 41.11%], test : [loss = 2.407, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.12%], valid : [loss = 0.680, top1 = 76.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13804/15625) 013804-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.522, top1 = 88.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.72 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.335, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.29 ms.
cifar100       train : [loss = 0.349, top1 = 90.43%], valid : [loss = 1.282, top1 = 67.31%], test : [loss = 1.294, top1 = 67.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.67%], valid : [loss = 2.402, top1 = 38.37%], test : [loss = 2.422, top1 = 39.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13805/15625) 013805-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.513, top1 = 89.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.325, top1 = 93.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.118, top1 = 97.67%], valid : [loss = 1.278, top1 = 69.57%], test : [loss = 1.305, top1 = 69.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.61 ms.
ImageNet16-120 train : [loss = 1.704, top1 = 54.42%], valid : [loss = 2.176, top1 = 43.78%], test : [loss = 2.180, top1 = 44.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13806/15625) 013806-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.27%], valid : [loss = 0.551, top1 = 87.31%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.19 ms.
cifar10        train : [loss = 0.063, top1 = 97.96%], test  : [loss = 0.375, top1 = 90.20%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.32 ms.
cifar100       train : [loss = 0.671, top1 = 80.23%], valid : [loss = 1.320, top1 = 64.73%], test : [loss = 1.295, top1 = 65.40%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.01%], valid : [loss = 2.482, top1 = 37.36%], test : [loss = 2.495, top1 = 36.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.25%], valid : [loss = 0.768, top1 = 73.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13807/15625) 013807-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.572, top1 = 87.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.386, top1 = 90.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.96 ms.
cifar100       train : [loss = 0.409, top1 = 88.41%], valid : [loss = 1.380, top1 = 65.60%], test : [loss = 1.398, top1 = 65.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.82%], valid : [loss = 2.510, top1 = 36.96%], test : [loss = 2.559, top1 = 36.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13808/15625) 013808-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.337, top1 = 88.39%], valid : [loss = 0.641, top1 = 79.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.316, top1 = 89.09%], test  : [loss = 0.485, top1 = 84.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.11 ms.
cifar100       train : [loss = 1.458, top1 = 59.17%], valid : [loss = 1.739, top1 = 53.16%], test : [loss = 1.741, top1 = 53.62%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 3.135, top1 = 24.34%], valid : [loss = 3.162, top1 = 24.48%], test : [loss = 3.174, top1 = 23.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.087, top1 = 60.93%], valid : [loss = 1.146, top1 = 59.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13809/15625) 013809-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.493, top1 = 90.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.315, top1 = 93.54%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.65 ms.
cifar100       train : [loss = 0.062, top1 = 99.13%], valid : [loss = 1.330, top1 = 69.97%], test : [loss = 1.316, top1 = 70.36%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 1.608, top1 = 56.64%], valid : [loss = 2.178, top1 = 44.63%], test : [loss = 2.158, top1 = 44.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 82.08%], valid : [loss = 0.599, top1 = 79.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13810/15625) 013810-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.583, top1 = 87.93%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.394, top1 = 91.22%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.01 ms.
cifar100       train : [loss = 0.201, top1 = 95.39%], valid : [loss = 1.446, top1 = 66.31%], test : [loss = 1.438, top1 = 66.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.43 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.72%], valid : [loss = 2.469, top1 = 38.19%], test : [loss = 2.468, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.68%], valid : [loss = 0.711, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13811/15625) 013811-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.455, top1 = 89.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10        train : [loss = 0.014, top1 = 99.76%], test  : [loss = 0.314, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.28 ms.
cifar100       train : [loss = 0.325, top1 = 91.19%], valid : [loss = 1.321, top1 = 66.77%], test : [loss = 1.314, top1 = 66.73%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.09%], valid : [loss = 2.376, top1 = 40.52%], test : [loss = 2.404, top1 = 39.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13812/15625) 013812-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.556, top1 = 88.82%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.357, top1 = 92.49%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.72 ms.
cifar100       train : [loss = 0.077, top1 = 98.80%], valid : [loss = 1.450, top1 = 68.69%], test : [loss = 1.466, top1 = 68.23%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.23 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.37%], valid : [loss = 2.408, top1 = 39.34%], test : [loss = 2.435, top1 = 40.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.06%], valid : [loss = 0.728, top1 = 75.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13813/15625) 013813-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.62%], valid : [loss = 0.864, top1 = 79.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10        train : [loss = 0.131, top1 = 95.53%], test  : [loss = 0.553, top1 = 84.82%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.99 ms.
cifar100       train : [loss = 0.856, top1 = 74.99%], valid : [loss = 1.664, top1 = 57.85%], test : [loss = 1.663, top1 = 57.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 3.025, top1 = 26.59%], valid : [loss = 3.159, top1 = 24.53%], test : [loss = 3.192, top1 = 24.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13814/15625) 013814-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.485, top1 = 89.91%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.60 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.315, top1 = 93.27%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.41 ms.
cifar100       train : [loss = 0.077, top1 = 98.67%], valid : [loss = 1.379, top1 = 69.21%], test : [loss = 1.397, top1 = 69.35%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.573, top1 = 57.47%], valid : [loss = 2.153, top1 = 44.99%], test : [loss = 2.161, top1 = 45.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.48%], valid : [loss = 0.756, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13815/15625) 013815-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.186, top1 = 93.81%], valid : [loss = 0.529, top1 = 84.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.181, top1 = 93.95%], test  : [loss = 0.385, top1 = 87.87%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.06 ms.
cifar100       train : [loss = 1.201, top1 = 65.84%], valid : [loss = 1.507, top1 = 59.17%], test : [loss = 1.507, top1 = 58.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.95%], valid : [loss = 2.677, top1 = 32.93%], test : [loss = 2.730, top1 = 32.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.56%], valid : [loss = 0.979, top1 = 65.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13816/15625) 013816-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.555, top1 = 88.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.64 ms.
cifar10        train : [loss = 0.011, top1 = 99.72%], test  : [loss = 0.349, top1 = 92.32%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.30 ms.
cifar100       train : [loss = 0.241, top1 = 93.56%], valid : [loss = 1.335, top1 = 67.63%], test : [loss = 1.320, top1 = 68.03%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.63%], valid : [loss = 2.392, top1 = 39.14%], test : [loss = 2.400, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 69.04%], valid : [loss = 0.908, top1 = 67.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13817/15625) 013817-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.66%], valid : [loss = 0.839, top1 = 80.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 0.124, top1 = 95.80%], test  : [loss = 0.535, top1 = 85.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.851, top1 = 75.28%], valid : [loss = 1.652, top1 = 57.72%], test : [loss = 1.675, top1 = 57.75%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.49 ms.
ImageNet16-120 train : [loss = 3.033, top1 = 26.53%], valid : [loss = 3.169, top1 = 24.12%], test : [loss = 3.208, top1 = 23.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13818/15625) 013818-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.533, top1 = 89.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.313, top1 = 92.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.80 ms.
cifar100       train : [loss = 0.141, top1 = 96.98%], valid : [loss = 1.382, top1 = 67.92%], test : [loss = 1.374, top1 = 68.43%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 1.757, top1 = 53.20%], valid : [loss = 2.207, top1 = 43.56%], test : [loss = 2.235, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.92%], valid : [loss = 0.678, top1 = 76.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13819/15625) 013819-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.51%], valid : [loss = 0.534, top1 = 84.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 0.161, top1 = 94.62%], test  : [loss = 0.368, top1 = 88.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.217, top1 = 65.49%], valid : [loss = 1.504, top1 = 58.85%], test : [loss = 1.508, top1 = 58.78%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.44%], valid : [loss = 2.701, top1 = 33.03%], test : [loss = 2.745, top1 = 32.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.927, top1 = 66.51%], valid : [loss = 0.985, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13820/15625) 013820-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.12 ms.
cifar100       train : [loss = 0.332, top1 = 91.01%], valid : [loss = 1.291, top1 = 67.02%], test : [loss = 1.297, top1 = 67.35%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 44.94%], valid : [loss = 2.408, top1 = 39.21%], test : [loss = 2.412, top1 = 39.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13821/15625) 013821-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.447, top1 = 89.89%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.26 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.301, top1 = 92.62%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=15.73 ms.
cifar100       train : [loss = 0.182, top1 = 95.87%], valid : [loss = 1.269, top1 = 69.19%], test : [loss = 1.270, top1 = 69.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.34 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 52.11%], valid : [loss = 2.245, top1 = 42.60%], test : [loss = 2.271, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.412, top1 = 85.92%], valid : [loss = 0.525, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13822/15625) 013822-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.556, top1 = 88.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.371, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.54 ms.
cifar100       train : [loss = 0.100, top1 = 98.27%], valid : [loss = 1.456, top1 = 67.67%], test : [loss = 1.460, top1 = 67.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.89 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.51%], valid : [loss = 2.431, top1 = 39.22%], test : [loss = 2.456, top1 = 40.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.38%], valid : [loss = 0.728, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13823/15625) 013823-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.494, top1 = 89.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.47 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.317, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.42 ms.
cifar100       train : [loss = 0.235, top1 = 94.29%], valid : [loss = 1.259, top1 = 68.47%], test : [loss = 1.254, top1 = 68.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.38%], valid : [loss = 2.271, top1 = 42.10%], test : [loss = 2.290, top1 = 42.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.10%], valid : [loss = 0.664, top1 = 77.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13824/15625) 013824-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.72 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.09%], valid : [loss = 0.854, top1 = 71.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.40 ms.
cifar10        train : [loss = 0.564, top1 = 80.25%], test  : [loss = 0.721, top1 = 75.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 1.795, top1 = 51.76%], valid : [loss = 2.053, top1 = 46.92%], test : [loss = 2.068, top1 = 47.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.77%], valid : [loss = 3.644, top1 = 16.53%], test : [loss = 3.675, top1 = 15.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13825/15625) 013825-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.503, top1 = 89.86%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.70 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.327, top1 = 93.14%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.82 ms.
cifar100       train : [loss = 0.092, top1 = 98.28%], valid : [loss = 1.301, top1 = 70.13%], test : [loss = 1.297, top1 = 70.65%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.34 ms.
ImageNet16-120 train : [loss = 1.693, top1 = 54.62%], valid : [loss = 2.153, top1 = 44.73%], test : [loss = 2.158, top1 = 44.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.74%], valid : [loss = 0.704, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13826/15625) 013826-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.502, top1 = 89.54%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.319, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.24 ms.
cifar100       train : [loss = 0.121, top1 = 97.63%], valid : [loss = 1.295, top1 = 69.26%], test : [loss = 1.309, top1 = 69.49%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.92 ms.
ImageNet16-120 train : [loss = 1.837, top1 = 51.27%], valid : [loss = 2.290, top1 = 42.36%], test : [loss = 2.261, top1 = 43.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.26%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13827/15625) 013827-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.16 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.99%], valid : [loss = 0.865, top1 = 71.48%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10        train : [loss = 0.561, top1 = 80.43%], test  : [loss = 0.719, top1 = 75.77%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.30 ms.
cifar100       train : [loss = 1.775, top1 = 52.10%], valid : [loss = 2.045, top1 = 46.98%], test : [loss = 2.071, top1 = 46.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.00 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.72%], valid : [loss = 3.636, top1 = 16.72%], test : [loss = 3.675, top1 = 15.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13828/15625) 013828-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.21%], valid : [loss = 0.456, top1 = 86.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10        train : [loss = 0.160, top1 = 94.74%], test  : [loss = 0.350, top1 = 88.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 0.990, top1 = 71.80%], valid : [loss = 1.350, top1 = 62.30%], test : [loss = 1.342, top1 = 62.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.79%], valid : [loss = 2.684, top1 = 32.59%], test : [loss = 2.711, top1 = 32.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13829/15625) 013829-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.513, top1 = 88.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.332, top1 = 92.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.42 ms.
cifar100       train : [loss = 0.349, top1 = 90.41%], valid : [loss = 1.294, top1 = 66.64%], test : [loss = 1.297, top1 = 66.87%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.67%], valid : [loss = 2.406, top1 = 39.06%], test : [loss = 2.422, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13830/15625) 013830-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.551, top1 = 88.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.70 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.370, top1 = 92.18%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.89 ms.
cifar100       train : [loss = 0.077, top1 = 98.92%], valid : [loss = 1.440, top1 = 68.00%], test : [loss = 1.455, top1 = 68.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.21 ms.
ImageNet16-120 train : [loss = 1.773, top1 = 52.98%], valid : [loss = 2.418, top1 = 39.80%], test : [loss = 2.439, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.72%], valid : [loss = 0.695, top1 = 75.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13831/15625) 013831-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.593, top1 = 88.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.376, top1 = 91.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.53 ms.
cifar100       train : [loss = 0.172, top1 = 96.29%], valid : [loss = 1.411, top1 = 67.59%], test : [loss = 1.392, top1 = 67.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.54%], valid : [loss = 2.463, top1 = 38.03%], test : [loss = 2.486, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.24%], valid : [loss = 0.745, top1 = 74.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13832/15625) 013832-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.547, top1 = 89.04%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.66 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.354, top1 = 92.48%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.96 ms.
cifar100       train : [loss = 0.140, top1 = 97.00%], valid : [loss = 1.493, top1 = 65.95%], test : [loss = 1.488, top1 = 65.84%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=21.53 ms.
ImageNet16-120 train : [loss = 2.214, top1 = 42.29%], valid : [loss = 2.452, top1 = 37.46%], test : [loss = 2.454, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.45%], valid : [loss = 0.986, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13833/15625) 013833-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.528, top1 = 89.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.334, top1 = 92.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.141, top1 = 97.23%], valid : [loss = 1.426, top1 = 67.71%], test : [loss = 1.395, top1 = 67.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 1.881, top1 = 50.35%], valid : [loss = 2.406, top1 = 39.78%], test : [loss = 2.415, top1 = 40.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.46%], valid : [loss = 0.621, top1 = 78.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13834/15625) 013834-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.557, top1 = 88.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.367, top1 = 92.59%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.83 ms.
cifar100       train : [loss = 0.087, top1 = 98.54%], valid : [loss = 1.517, top1 = 67.39%], test : [loss = 1.520, top1 = 67.51%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.94 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.97%], valid : [loss = 2.448, top1 = 39.72%], test : [loss = 2.458, top1 = 39.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.55%], valid : [loss = 0.711, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13835/15625) 013835-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.28%], valid : [loss = 0.455, top1 = 87.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.112, top1 = 96.55%], test  : [loss = 0.326, top1 = 89.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.80 ms.
cifar100       train : [loss = 0.871, top1 = 75.13%], valid : [loss = 1.300, top1 = 64.32%], test : [loss = 1.293, top1 = 63.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.65%], valid : [loss = 2.629, top1 = 35.00%], test : [loss = 2.648, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13836/15625) 013836-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.508, top1 = 88.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.334, top1 = 91.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 0.337, top1 = 90.85%], valid : [loss = 1.281, top1 = 66.90%], test : [loss = 1.288, top1 = 67.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.51%], valid : [loss = 2.402, top1 = 39.32%], test : [loss = 2.425, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13837/15625) 013837-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.157, top1 = 94.88%], valid : [loss = 0.940, top1 = 76.17%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10        train : [loss = 0.222, top1 = 92.39%], test  : [loss = 0.608, top1 = 82.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.41 ms.
cifar100       train : [loss = 1.139, top1 = 67.66%], valid : [loss = 1.777, top1 = 54.05%], test : [loss = 1.772, top1 = 54.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.77%], valid : [loss = 3.344, top1 = 21.33%], test : [loss = 3.370, top1 = 20.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.59%], valid : [loss = 1.130, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13838/15625) 013838-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.211, top1 = 92.92%], valid : [loss = 0.534, top1 = 83.99%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.68 ms.
cifar10        train : [loss = 0.205, top1 = 93.04%], test  : [loss = 0.390, top1 = 87.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.37 ms.
cifar100       train : [loss = 1.249, top1 = 64.65%], valid : [loss = 1.544, top1 = 57.84%], test : [loss = 1.540, top1 = 57.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 2.725, top1 = 32.07%], valid : [loss = 2.746, top1 = 31.90%], test : [loss = 2.789, top1 = 31.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.60%], valid : [loss = 1.005, top1 = 64.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13839/15625) 013839-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.08%], valid : [loss = 0.559, top1 = 86.78%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.23 ms.
cifar10        train : [loss = 0.065, top1 = 97.89%], test  : [loss = 0.370, top1 = 90.05%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.33 ms.
cifar100       train : [loss = 0.644, top1 = 81.04%], valid : [loss = 1.294, top1 = 64.98%], test : [loss = 1.298, top1 = 64.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.371, top1 = 39.22%], valid : [loss = 2.508, top1 = 35.87%], test : [loss = 2.545, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.89%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13840/15625) 013840-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.481, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.48 ms.
cifar100       train : [loss = 0.323, top1 = 91.25%], valid : [loss = 1.248, top1 = 67.75%], test : [loss = 1.237, top1 = 68.09%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.82%], valid : [loss = 2.317, top1 = 40.47%], test : [loss = 2.335, top1 = 40.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13841/15625) 013841-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.608, top1 = 85.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.071, top1 = 97.81%], test  : [loss = 0.392, top1 = 89.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.26 ms.
cifar100       train : [loss = 0.715, top1 = 79.19%], valid : [loss = 1.402, top1 = 62.56%], test : [loss = 1.385, top1 = 63.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.68 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.07%], valid : [loss = 2.660, top1 = 33.97%], test : [loss = 2.680, top1 = 33.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13842/15625) 013842-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.597, top1 = 87.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.409, top1 = 90.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.33 ms.
cifar100       train : [loss = 0.196, top1 = 95.44%], valid : [loss = 1.418, top1 = 66.60%], test : [loss = 1.432, top1 = 66.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.079, top1 = 45.85%], valid : [loss = 2.485, top1 = 37.68%], test : [loss = 2.514, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.38%], valid : [loss = 0.776, top1 = 73.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13843/15625) 013843-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.493, top1 = 89.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.313, top1 = 92.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.90 ms.
cifar100       train : [loss = 0.119, top1 = 97.70%], valid : [loss = 1.295, top1 = 69.78%], test : [loss = 1.301, top1 = 69.54%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.43 ms.
ImageNet16-120 train : [loss = 1.706, top1 = 54.37%], valid : [loss = 2.187, top1 = 43.70%], test : [loss = 2.218, top1 = 43.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.04%], valid : [loss = 0.660, top1 = 77.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13844/15625) 013844-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.53%], valid : [loss = 0.454, top1 = 86.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.79 ms.
cifar10        train : [loss = 0.152, top1 = 95.09%], test  : [loss = 0.344, top1 = 88.93%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.987, top1 = 71.94%], valid : [loss = 1.371, top1 = 61.97%], test : [loss = 1.356, top1 = 62.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.613, top1 = 34.38%], valid : [loss = 2.666, top1 = 33.17%], test : [loss = 2.692, top1 = 32.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.787, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13845/15625) 013845-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.13%], valid : [loss = 0.684, top1 = 77.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10        train : [loss = 0.366, top1 = 87.32%], test  : [loss = 0.498, top1 = 83.55%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 1.598, top1 = 55.76%], valid : [loss = 1.860, top1 = 50.73%], test : [loss = 1.854, top1 = 50.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.07 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.52%], valid : [loss = 3.244, top1 = 22.43%], test : [loss = 3.300, top1 = 21.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.222, top1 = 56.01%], valid : [loss = 1.254, top1 = 54.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13846/15625) 013846-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.58%], valid : [loss = 0.449, top1 = 87.75%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.21 ms.
cifar10        train : [loss = 0.058, top1 = 98.54%], test  : [loss = 0.314, top1 = 90.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.75 ms.
cifar100       train : [loss = 0.579, top1 = 84.09%], valid : [loss = 1.223, top1 = 66.85%], test : [loss = 1.211, top1 = 66.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.28%], valid : [loss = 2.466, top1 = 37.82%], test : [loss = 2.477, top1 = 37.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13847/15625) 013847-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10-valid  train : [loss = 0.251, top1 = 91.38%], valid : [loss = 0.561, top1 = 82.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.240, top1 = 91.76%], test  : [loss = 0.423, top1 = 86.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.65 ms.
cifar100       train : [loss = 1.251, top1 = 64.54%], valid : [loss = 1.614, top1 = 56.38%], test : [loss = 1.603, top1 = 57.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.953, top1 = 27.93%], valid : [loss = 2.979, top1 = 27.28%], test : [loss = 3.035, top1 = 26.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.179, top1 = 57.38%], valid : [loss = 1.210, top1 = 56.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13848/15625) 013848-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.557, top1 = 87.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.388, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.38 ms.
cifar100       train : [loss = 0.388, top1 = 89.05%], valid : [loss = 1.366, top1 = 65.99%], test : [loss = 1.392, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.77%], valid : [loss = 2.477, top1 = 37.59%], test : [loss = 2.498, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.17%], valid : [loss = 0.773, top1 = 73.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13849/15625) 013849-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.02%], valid : [loss = 0.561, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10        train : [loss = 0.110, top1 = 96.45%], test  : [loss = 0.367, top1 = 89.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.22 ms.
cifar100       train : [loss = 0.805, top1 = 76.65%], valid : [loss = 1.383, top1 = 62.97%], test : [loss = 1.378, top1 = 62.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.61%], valid : [loss = 2.619, top1 = 34.18%], test : [loss = 2.648, top1 = 34.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.70%], valid : [loss = 0.895, top1 = 68.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13850/15625) 013850-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.468, top1 = 90.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.336, top1 = 92.63%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.20 ms.
cifar100       train : [loss = 0.118, top1 = 97.44%], valid : [loss = 1.425, top1 = 67.90%], test : [loss = 1.404, top1 = 68.57%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 1.810, top1 = 52.03%], valid : [loss = 2.319, top1 = 41.53%], test : [loss = 2.369, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.405, top1 = 86.15%], valid : [loss = 0.528, top1 = 82.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13851/15625) 013851-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.083, top1 = 97.51%], valid : [loss = 0.864, top1 = 79.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.134, top1 = 95.51%], test  : [loss = 0.545, top1 = 84.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.46 ms.
cifar100       train : [loss = 0.878, top1 = 74.58%], valid : [loss = 1.683, top1 = 56.81%], test : [loss = 1.687, top1 = 57.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.52%], valid : [loss = 3.164, top1 = 24.09%], test : [loss = 3.188, top1 = 23.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 61.94%], valid : [loss = 1.110, top1 = 60.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13852/15625) 013852-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.55 ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.96%], valid : [loss = 0.866, top1 = 71.38%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10        train : [loss = 0.553, top1 = 80.74%], test  : [loss = 0.715, top1 = 75.81%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.67 ms.
cifar100       train : [loss = 1.786, top1 = 51.91%], valid : [loss = 2.055, top1 = 47.03%], test : [loss = 2.071, top1 = 46.39%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.73 ms.
ImageNet16-120 train : [loss = 3.589, top1 = 16.68%], valid : [loss = 3.646, top1 = 16.21%], test : [loss = 3.678, top1 = 15.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13853/15625) 013853-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.254, top1 = 91.27%], valid : [loss = 0.541, top1 = 83.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10        train : [loss = 0.232, top1 = 92.06%], test  : [loss = 0.397, top1 = 87.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.91 ms.
cifar100       train : [loss = 1.312, top1 = 62.83%], valid : [loss = 1.576, top1 = 56.61%], test : [loss = 1.582, top1 = 56.50%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.791, top1 = 30.84%], valid : [loss = 2.792, top1 = 30.48%], test : [loss = 2.839, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.951, top1 = 65.68%], valid : [loss = 1.006, top1 = 64.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13854/15625) 013854-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.458, top1 = 89.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.317, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 0.327, top1 = 91.10%], valid : [loss = 1.309, top1 = 67.58%], test : [loss = 1.316, top1 = 67.25%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.40%], valid : [loss = 2.358, top1 = 39.90%], test : [loss = 2.411, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.445, top1 = 84.64%], valid : [loss = 0.544, top1 = 81.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13855/15625) 013855-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.590, top1 = 87.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.54 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.386, top1 = 91.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.94 ms.
cifar100       train : [loss = 0.402, top1 = 88.59%], valid : [loss = 1.394, top1 = 65.26%], test : [loss = 1.392, top1 = 65.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.94%], valid : [loss = 2.471, top1 = 37.97%], test : [loss = 2.482, top1 = 37.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.23%], valid : [loss = 0.796, top1 = 72.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13856/15625) 013856-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.99%], valid : [loss = 0.470, top1 = 84.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.59 ms.
cifar10        train : [loss = 0.299, top1 = 89.99%], test  : [loss = 0.400, top1 = 86.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 1.321, top1 = 63.39%], valid : [loss = 1.520, top1 = 58.14%], test : [loss = 1.506, top1 = 58.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.53%], valid : [loss = 2.903, top1 = 29.34%], test : [loss = 2.952, top1 = 28.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13857/15625) 013857-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.562, top1 = 88.21%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.335, top1 = 92.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.20 ms.
cifar100       train : [loss = 0.294, top1 = 91.77%], valid : [loss = 1.333, top1 = 67.33%], test : [loss = 1.362, top1 = 66.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 2.144, top1 = 44.22%], valid : [loss = 2.423, top1 = 38.87%], test : [loss = 2.431, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.28%], valid : [loss = 0.900, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13858/15625) 013858-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.240, top1 = 91.81%], valid : [loss = 0.516, top1 = 83.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.227, top1 = 92.24%], test  : [loss = 0.391, top1 = 87.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.01 ms.
cifar100       train : [loss = 1.292, top1 = 63.49%], valid : [loss = 1.564, top1 = 57.27%], test : [loss = 1.555, top1 = 57.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.76 ms.
ImageNet16-120 train : [loss = 2.762, top1 = 31.48%], valid : [loss = 2.769, top1 = 31.30%], test : [loss = 2.815, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.75%], valid : [loss = 0.997, top1 = 64.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13859/15625) 013859-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.330, top1 = 93.14%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.46 ms.
cifar100       train : [loss = 0.071, top1 = 98.91%], valid : [loss = 1.393, top1 = 68.96%], test : [loss = 1.371, top1 = 69.35%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.68%], valid : [loss = 2.383, top1 = 39.57%], test : [loss = 2.381, top1 = 40.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13860/15625) 013860-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.234, top1 = 92.12%], valid : [loss = 0.641, top1 = 80.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.62 ms.
cifar10        train : [loss = 0.265, top1 = 90.83%], test  : [loss = 0.490, top1 = 84.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.43 ms.
cifar100       train : [loss = 1.185, top1 = 66.27%], valid : [loss = 1.610, top1 = 56.89%], test : [loss = 1.638, top1 = 56.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.82 ms.
ImageNet16-120 train : [loss = 3.050, top1 = 25.99%], valid : [loss = 3.105, top1 = 24.93%], test : [loss = 3.145, top1 = 24.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.165, top1 = 57.83%], valid : [loss = 1.215, top1 = 56.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13861/15625) 013861-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.591, top1 = 87.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.409, top1 = 91.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.27 ms.
cifar100       train : [loss = 0.212, top1 = 95.01%], valid : [loss = 1.405, top1 = 66.67%], test : [loss = 1.418, top1 = 66.99%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.98%], valid : [loss = 2.489, top1 = 37.56%], test : [loss = 2.510, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.15%], valid : [loss = 0.738, top1 = 74.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13862/15625) 013862-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.40%], valid : [loss = 0.604, top1 = 86.42%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10        train : [loss = 0.047, top1 = 98.53%], test  : [loss = 0.420, top1 = 89.27%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.67 ms.
cifar100       train : [loss = 0.598, top1 = 82.25%], valid : [loss = 1.423, top1 = 63.23%], test : [loss = 1.420, top1 = 63.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 2.514, top1 = 36.45%], valid : [loss = 2.640, top1 = 34.13%], test : [loss = 2.685, top1 = 33.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.642, top1 = 77.36%], valid : [loss = 0.732, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13863/15625) 013863-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.431, top1 = 90.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.24 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.281, top1 = 93.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.04 ms.
cifar100       train : [loss = 0.165, top1 = 96.21%], valid : [loss = 1.269, top1 = 69.67%], test : [loss = 1.251, top1 = 69.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 1.774, top1 = 52.83%], valid : [loss = 2.232, top1 = 43.30%], test : [loss = 2.268, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.373, top1 = 87.41%], valid : [loss = 0.502, top1 = 83.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13864/15625) 013864-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.17%], valid : [loss = 0.560, top1 = 86.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10        train : [loss = 0.041, top1 = 98.73%], test  : [loss = 0.367, top1 = 90.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.04 ms.
cifar100       train : [loss = 0.465, top1 = 86.29%], valid : [loss = 1.316, top1 = 66.05%], test : [loss = 1.351, top1 = 65.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.00 ms.
ImageNet16-120 train : [loss = 2.766, top1 = 30.40%], valid : [loss = 2.823, top1 = 29.27%], test : [loss = 2.815, top1 = 29.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.60%], valid : [loss = 1.051, top1 = 62.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13865/15625) 013865-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.613, top1 = 87.13%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.396, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.61 ms.
cifar100       train : [loss = 0.189, top1 = 95.52%], valid : [loss = 1.523, top1 = 65.39%], test : [loss = 1.523, top1 = 65.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.86%], valid : [loss = 2.515, top1 = 37.32%], test : [loss = 2.532, top1 = 37.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.83%], valid : [loss = 0.809, top1 = 71.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13866/15625) 013866-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.16 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.07%], valid : [loss = 0.550, top1 = 86.85%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.94 ms.
cifar10        train : [loss = 0.062, top1 = 97.98%], test  : [loss = 0.366, top1 = 89.98%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.29 ms.
cifar100       train : [loss = 0.660, top1 = 80.55%], valid : [loss = 1.314, top1 = 64.79%], test : [loss = 1.308, top1 = 64.51%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 2.356, top1 = 39.57%], valid : [loss = 2.488, top1 = 36.97%], test : [loss = 2.516, top1 = 36.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.25%], valid : [loss = 0.827, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13867/15625) 013867-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.449, top1 = 89.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.309, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.320, top1 = 91.30%], valid : [loss = 1.297, top1 = 67.57%], test : [loss = 1.282, top1 = 67.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.048, top1 = 46.48%], valid : [loss = 2.360, top1 = 40.12%], test : [loss = 2.407, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.449, top1 = 84.62%], valid : [loss = 0.556, top1 = 81.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13868/15625) 013868-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.21%], valid : [loss = 0.582, top1 = 85.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.79 ms.
cifar10        train : [loss = 0.114, top1 = 96.22%], test  : [loss = 0.394, top1 = 88.60%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.45 ms.
cifar100       train : [loss = 0.814, top1 = 76.07%], valid : [loss = 1.421, top1 = 62.53%], test : [loss = 1.408, top1 = 62.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 33.02%], valid : [loss = 2.764, top1 = 31.50%], test : [loss = 2.817, top1 = 30.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.86%], valid : [loss = 0.713, top1 = 75.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13869/15625) 013869-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.412, top1 = 90.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.58 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.268, top1 = 93.66%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.31 ms.
cifar100       train : [loss = 0.127, top1 = 97.47%], valid : [loss = 1.246, top1 = 70.92%], test : [loss = 1.238, top1 = 70.71%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.637, top1 = 56.05%], valid : [loss = 2.158, top1 = 45.17%], test : [loss = 2.181, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.397, top1 = 86.44%], valid : [loss = 0.523, top1 = 82.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13870/15625) 013870-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.43%], valid : [loss = 0.733, top1 = 80.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.190, top1 = 93.47%], test  : [loss = 0.515, top1 = 84.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.895, top1 = 73.82%], valid : [loss = 1.639, top1 = 57.20%], test : [loss = 1.647, top1 = 57.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 3.535, top1 = 16.19%], valid : [loss = 3.529, top1 = 16.40%], test : [loss = 3.531, top1 = 15.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.302, top1 = 52.16%], valid : [loss = 1.305, top1 = 52.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13871/15625) 013871-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.13%], valid : [loss = 0.557, top1 = 83.81%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.47 ms.
cifar10        train : [loss = 0.189, top1 = 93.66%], test  : [loss = 0.393, top1 = 87.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.21 ms.
cifar100       train : [loss = 1.212, top1 = 65.34%], valid : [loss = 1.541, top1 = 57.39%], test : [loss = 1.535, top1 = 57.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 2.691, top1 = 32.78%], valid : [loss = 2.722, top1 = 32.20%], test : [loss = 2.771, top1 = 31.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 66.95%], valid : [loss = 0.975, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13872/15625) 013872-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.10%], valid : [loss = 0.570, top1 = 86.88%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.62 ms.
cifar10        train : [loss = 0.069, top1 = 97.74%], test  : [loss = 0.371, top1 = 89.96%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.88 ms.
cifar100       train : [loss = 0.684, top1 = 79.90%], valid : [loss = 1.322, top1 = 64.35%], test : [loss = 1.317, top1 = 64.73%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.70%], valid : [loss = 2.467, top1 = 37.54%], test : [loss = 2.508, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.63%], valid : [loss = 0.769, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13873/15625) 013873-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.564, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.364, top1 = 92.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.61 ms.
cifar100       train : [loss = 0.168, top1 = 96.37%], valid : [loss = 1.409, top1 = 67.33%], test : [loss = 1.391, top1 = 67.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.98%], valid : [loss = 2.460, top1 = 39.07%], test : [loss = 2.483, top1 = 38.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.48%], valid : [loss = 0.710, top1 = 75.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13874/15625) 013874-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.641, top1 = 86.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10        train : [loss = 0.030, top1 = 99.27%], test  : [loss = 0.419, top1 = 89.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.52 ms.
cifar100       train : [loss = 0.379, top1 = 89.96%], valid : [loss = 1.438, top1 = 64.34%], test : [loss = 1.409, top1 = 65.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 40.99%], valid : [loss = 2.601, top1 = 34.87%], test : [loss = 2.623, top1 = 35.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13875/15625) 013875-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.19%], valid : [loss = 0.558, top1 = 87.05%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.76 ms.
cifar10        train : [loss = 0.062, top1 = 97.97%], test  : [loss = 0.374, top1 = 90.02%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.73 ms.
cifar100       train : [loss = 0.654, top1 = 80.77%], valid : [loss = 1.309, top1 = 64.98%], test : [loss = 1.304, top1 = 64.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.11%], valid : [loss = 2.479, top1 = 37.14%], test : [loss = 2.505, top1 = 36.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.93%], valid : [loss = 0.712, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13876/15625) 013876-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.718, top1 = 84.90%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.035, top1 = 98.99%], test  : [loss = 0.441, top1 = 89.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.00 ms.
cifar100       train : [loss = 0.407, top1 = 88.52%], valid : [loss = 1.615, top1 = 61.23%], test : [loss = 1.635, top1 = 61.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.72%], valid : [loss = 2.628, top1 = 34.50%], test : [loss = 2.665, top1 = 34.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.29%], valid : [loss = 0.870, top1 = 69.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13877/15625) 013877-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.26%], valid : [loss = 0.603, top1 = 85.67%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.13 ms.
cifar10        train : [loss = 0.069, top1 = 97.92%], test  : [loss = 0.405, top1 = 88.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.44 ms.
cifar100       train : [loss = 0.697, top1 = 79.74%], valid : [loss = 1.368, top1 = 63.85%], test : [loss = 1.361, top1 = 64.11%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.522, top1 = 36.25%], valid : [loss = 2.631, top1 = 33.96%], test : [loss = 2.674, top1 = 33.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.42%], valid : [loss = 0.764, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13878/15625) 013878-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.31%], valid : [loss = 0.450, top1 = 86.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10        train : [loss = 0.112, top1 = 96.57%], test  : [loss = 0.326, top1 = 89.77%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 0.865, top1 = 75.50%], valid : [loss = 1.293, top1 = 63.69%], test : [loss = 1.275, top1 = 64.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.76%], valid : [loss = 2.628, top1 = 34.14%], test : [loss = 2.649, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.76%], valid : [loss = 0.671, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13879/15625) 013879-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.486, top1 = 89.52%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.01 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.311, top1 = 92.89%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=18.71 ms.
cifar100       train : [loss = 0.123, top1 = 97.75%], valid : [loss = 1.277, top1 = 69.45%], test : [loss = 1.304, top1 = 69.06%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=16.91 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.79%], valid : [loss = 2.221, top1 = 43.29%], test : [loss = 2.229, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.04%], valid : [loss = 0.682, top1 = 76.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13880/15625) 013880-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.20%], valid : [loss = 0.617, top1 = 85.31%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.071, top1 = 97.82%], test  : [loss = 0.405, top1 = 88.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.70 ms.
cifar100       train : [loss = 0.707, top1 = 79.45%], valid : [loss = 1.370, top1 = 63.55%], test : [loss = 1.376, top1 = 63.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.92%], valid : [loss = 2.658, top1 = 33.84%], test : [loss = 2.693, top1 = 33.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13881/15625) 013881-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.55%], valid : [loss = 0.844, top1 = 72.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.95 ms.
cifar10        train : [loss = 0.551, top1 = 80.82%], test  : [loss = 0.715, top1 = 75.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.35 ms.
cifar100       train : [loss = 1.796, top1 = 51.80%], valid : [loss = 2.063, top1 = 46.99%], test : [loss = 2.073, top1 = 46.95%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.82%], valid : [loss = 3.639, top1 = 16.67%], test : [loss = 3.669, top1 = 16.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13882/15625) 013882-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.579, top1 = 87.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.57 ms.
cifar10        train : [loss = 0.019, top1 = 99.54%], test  : [loss = 0.385, top1 = 90.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.62 ms.
cifar100       train : [loss = 0.427, top1 = 87.82%], valid : [loss = 1.379, top1 = 65.17%], test : [loss = 1.391, top1 = 65.01%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.325, top1 = 40.36%], valid : [loss = 2.527, top1 = 36.48%], test : [loss = 2.560, top1 = 36.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.41%], valid : [loss = 0.811, top1 = 71.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13883/15625) 013883-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.476, top1 = 89.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.315, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.68 ms.
cifar100       train : [loss = 0.323, top1 = 91.30%], valid : [loss = 1.257, top1 = 67.62%], test : [loss = 1.246, top1 = 68.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.75%], valid : [loss = 2.311, top1 = 40.66%], test : [loss = 2.340, top1 = 40.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13884/15625) 013884-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.483, top1 = 90.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.60 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.335, top1 = 92.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.08 ms.
cifar100       train : [loss = 0.082, top1 = 98.58%], valid : [loss = 1.444, top1 = 68.73%], test : [loss = 1.404, top1 = 69.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.65 ms.
ImageNet16-120 train : [loss = 1.674, top1 = 55.17%], valid : [loss = 2.352, top1 = 41.54%], test : [loss = 2.364, top1 = 41.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.45%], valid : [loss = 0.620, top1 = 78.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13885/15625) 013885-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.054, top1 = 98.50%], valid : [loss = 0.617, top1 = 84.51%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10        train : [loss = 0.090, top1 = 97.13%], test  : [loss = 0.403, top1 = 88.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.44 ms.
cifar100       train : [loss = 0.794, top1 = 76.83%], valid : [loss = 1.430, top1 = 61.41%], test : [loss = 1.433, top1 = 61.97%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 34.02%], valid : [loss = 2.748, top1 = 31.66%], test : [loss = 2.774, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.42%], valid : [loss = 0.842, top1 = 70.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13886/15625) 013886-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.265, top1 = 90.94%], valid : [loss = 0.533, top1 = 83.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10        train : [loss = 0.231, top1 = 92.13%], test  : [loss = 0.390, top1 = 87.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.01 ms.
cifar100       train : [loss = 1.323, top1 = 62.63%], valid : [loss = 1.582, top1 = 57.04%], test : [loss = 1.581, top1 = 56.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.60 ms.
ImageNet16-120 train : [loss = 2.786, top1 = 30.90%], valid : [loss = 2.803, top1 = 30.82%], test : [loss = 2.865, top1 = 29.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.017, top1 = 63.66%], valid : [loss = 1.061, top1 = 62.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13887/15625) 013887-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.073, top1 = 98.10%], valid : [loss = 0.458, top1 = 86.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.114, top1 = 96.53%], test  : [loss = 0.327, top1 = 89.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.33 ms.
cifar100       train : [loss = 0.868, top1 = 75.26%], valid : [loss = 1.309, top1 = 64.05%], test : [loss = 1.305, top1 = 63.67%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.72%], valid : [loss = 2.635, top1 = 34.78%], test : [loss = 2.648, top1 = 33.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13888/15625) 013888-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.49%], valid : [loss = 0.569, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.362, top1 = 91.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.549, top1 = 84.05%], valid : [loss = 1.377, top1 = 64.29%], test : [loss = 1.374, top1 = 64.03%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 2.597, top1 = 33.94%], valid : [loss = 2.678, top1 = 32.70%], test : [loss = 2.686, top1 = 32.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13889/15625) 013889-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.529, top1 = 88.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.333, top1 = 92.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 0.335, top1 = 90.87%], valid : [loss = 1.290, top1 = 66.83%], test : [loss = 1.287, top1 = 67.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.71%], valid : [loss = 2.420, top1 = 38.69%], test : [loss = 2.422, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13890/15625) 013890-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.554, top1 = 88.96%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.04 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.364, top1 = 92.44%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=22.39 ms.
cifar100       train : [loss = 0.137, top1 = 97.07%], valid : [loss = 1.508, top1 = 65.86%], test : [loss = 1.495, top1 = 66.06%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.48 ms.
ImageNet16-120 train : [loss = 2.454, top1 = 37.10%], valid : [loss = 2.631, top1 = 33.01%], test : [loss = 2.641, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.002, top1 = 63.88%], valid : [loss = 1.048, top1 = 62.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13891/15625) 013891-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.571, top1 = 88.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.392, top1 = 91.64%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.51 ms.
cifar100       train : [loss = 0.137, top1 = 97.16%], valid : [loss = 1.443, top1 = 67.31%], test : [loss = 1.450, top1 = 67.23%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.74%], valid : [loss = 2.445, top1 = 38.64%], test : [loss = 2.478, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.12%], valid : [loss = 0.775, top1 = 73.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13892/15625) 013892-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.559, top1 = 88.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.397, top1 = 91.68%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.40 ms.
cifar100       train : [loss = 0.134, top1 = 97.32%], valid : [loss = 1.464, top1 = 67.00%], test : [loss = 1.482, top1 = 67.05%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.940, top1 = 48.89%], valid : [loss = 2.412, top1 = 39.57%], test : [loss = 2.457, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.605, top1 = 78.50%], valid : [loss = 0.711, top1 = 75.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13893/15625) 013893-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.06%], valid : [loss = 0.574, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.21 ms.
cifar10        train : [loss = 0.063, top1 = 97.95%], test  : [loss = 0.370, top1 = 90.00%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.48 ms.
cifar100       train : [loss = 0.681, top1 = 80.04%], valid : [loss = 1.322, top1 = 63.95%], test : [loss = 1.335, top1 = 64.53%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.03%], valid : [loss = 2.516, top1 = 35.78%], test : [loss = 2.543, top1 = 36.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.89%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13894/15625) 013894-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.14%], valid : [loss = 0.901, top1 = 68.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.663, top1 = 76.75%], test  : [loss = 0.755, top1 = 73.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 1.966, top1 = 47.76%], valid : [loss = 2.129, top1 = 44.90%], test : [loss = 2.167, top1 = 44.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.73%], valid : [loss = 3.673, top1 = 15.82%], test : [loss = 3.699, top1 = 14.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.376, top1 = 49.82%], valid : [loss = 1.395, top1 = 49.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13895/15625) 013895-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.334, top1 = 91.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.37 ms.
cifar100       train : [loss = 0.348, top1 = 90.41%], valid : [loss = 1.273, top1 = 67.27%], test : [loss = 1.276, top1 = 67.29%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.72 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.67%], valid : [loss = 2.400, top1 = 38.98%], test : [loss = 2.415, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13896/15625) 013896-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.70 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.38 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13897/15625) 013897-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.562, top1 = 87.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.371, top1 = 91.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.394, top1 = 88.89%], valid : [loss = 1.382, top1 = 65.57%], test : [loss = 1.385, top1 = 65.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.258, top1 = 41.83%], valid : [loss = 2.490, top1 = 37.12%], test : [loss = 2.496, top1 = 37.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.66%], valid : [loss = 0.778, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13898/15625) 013898-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.482, top1 = 89.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.00 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.328, top1 = 92.08%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.274, top1 = 92.89%], valid : [loss = 1.283, top1 = 67.63%], test : [loss = 1.281, top1 = 68.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.59%], valid : [loss = 2.272, top1 = 41.57%], test : [loss = 2.308, top1 = 41.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.489, top1 = 83.24%], valid : [loss = 0.582, top1 = 80.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13899/15625) 013899-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.077, top1 = 97.51%], valid : [loss = 0.613, top1 = 84.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10        train : [loss = 0.088, top1 = 97.10%], test  : [loss = 0.416, top1 = 88.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.90 ms.
cifar100       train : [loss = 0.696, top1 = 79.45%], valid : [loss = 1.532, top1 = 60.07%], test : [loss = 1.505, top1 = 61.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.11 ms.
ImageNet16-120 train : [loss = 3.226, top1 = 21.46%], valid : [loss = 3.239, top1 = 21.16%], test : [loss = 3.263, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13900/15625) 013900-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.77 ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.16%], valid : [loss = 0.961, top1 = 67.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.35 ms.
cifar10        train : [loss = 0.795, top1 = 72.01%], test  : [loss = 0.871, top1 = 69.49%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.68 ms.
cifar100       train : [loss = 2.149, top1 = 43.77%], valid : [loss = 2.327, top1 = 40.61%], test : [loss = 2.336, top1 = 41.07%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.45 ms.
ImageNet16-120 train : [loss = 3.748, top1 = 14.18%], valid : [loss = 3.775, top1 = 14.72%], test : [loss = 3.783, top1 = 13.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13901/15625) 013901-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.09 ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.45%], valid : [loss = 0.853, top1 = 71.78%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10        train : [loss = 0.558, top1 = 80.49%], test  : [loss = 0.723, top1 = 75.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.26 ms.
cifar100       train : [loss = 1.783, top1 = 51.97%], valid : [loss = 2.060, top1 = 46.67%], test : [loss = 2.056, top1 = 47.41%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.86 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.76%], valid : [loss = 3.643, top1 = 16.59%], test : [loss = 3.673, top1 = 15.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13902/15625) 013902-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.067, top1 = 97.90%], valid : [loss = 0.619, top1 = 84.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10        train : [loss = 0.087, top1 = 97.17%], test  : [loss = 0.402, top1 = 88.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.66 ms.
cifar100       train : [loss = 0.727, top1 = 78.73%], valid : [loss = 1.554, top1 = 59.91%], test : [loss = 1.575, top1 = 59.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 3.200, top1 = 21.98%], valid : [loss = 3.207, top1 = 22.02%], test : [loss = 3.234, top1 = 21.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.72%], valid : [loss = 1.051, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13903/15625) 013903-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.16 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.530, top1 = 88.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.334, top1 = 91.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.52 ms.
cifar100       train : [loss = 0.346, top1 = 90.57%], valid : [loss = 1.297, top1 = 66.47%], test : [loss = 1.290, top1 = 66.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.53%], valid : [loss = 2.418, top1 = 39.44%], test : [loss = 2.436, top1 = 38.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13904/15625) 013904-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.509, top1 = 89.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.65 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.324, top1 = 92.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.33 ms.
cifar100       train : [loss = 0.112, top1 = 97.63%], valid : [loss = 1.302, top1 = 70.09%], test : [loss = 1.308, top1 = 70.05%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.31 ms.
ImageNet16-120 train : [loss = 1.672, top1 = 55.07%], valid : [loss = 2.167, top1 = 44.26%], test : [loss = 2.155, top1 = 45.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.73%], valid : [loss = 0.667, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13905/15625) 013905-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.03 ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.53%], valid : [loss = 0.665, top1 = 77.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.53 ms.
cifar10        train : [loss = 0.515, top1 = 82.22%], test  : [loss = 0.593, top1 = 79.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.00 ms.
cifar100       train : [loss = 1.697, top1 = 54.01%], valid : [loss = 1.861, top1 = 50.49%], test : [loss = 1.882, top1 = 50.25%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.00 ms.
ImageNet16-120 train : [loss = 3.339, top1 = 21.09%], valid : [loss = 3.332, top1 = 21.31%], test : [loss = 3.341, top1 = 20.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13906/15625) 013906-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.45 ms.
cifar10-valid  train : [loss = 0.074, top1 = 97.58%], valid : [loss = 0.594, top1 = 85.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.70 ms.
cifar10        train : [loss = 0.059, top1 = 98.10%], test  : [loss = 0.406, top1 = 89.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.42 ms.
cifar100       train : [loss = 0.617, top1 = 82.22%], valid : [loss = 1.468, top1 = 61.82%], test : [loss = 1.447, top1 = 62.01%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 3.222, top1 = 21.41%], valid : [loss = 3.236, top1 = 21.00%], test : [loss = 3.240, top1 = 20.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.504, top1 = 44.35%], valid : [loss = 1.497, top1 = 44.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13907/15625) 013907-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.549, top1 = 88.99%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.33 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.343, top1 = 92.69%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.26 ms.
cifar100       train : [loss = 0.107, top1 = 97.89%], valid : [loss = 1.342, top1 = 69.07%], test : [loss = 1.353, top1 = 69.19%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.70%], valid : [loss = 2.302, top1 = 41.19%], test : [loss = 2.297, top1 = 42.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 72.04%], valid : [loss = 0.826, top1 = 70.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13908/15625) 013908-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.458, top1 = 83.81%], valid : [loss = 0.680, top1 = 77.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10        train : [loss = 0.416, top1 = 85.51%], test  : [loss = 0.556, top1 = 81.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.27 ms.
cifar100       train : [loss = 1.666, top1 = 54.32%], valid : [loss = 1.906, top1 = 49.53%], test : [loss = 1.911, top1 = 50.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.81 ms.
ImageNet16-120 train : [loss = 3.341, top1 = 20.70%], valid : [loss = 3.351, top1 = 20.78%], test : [loss = 3.386, top1 = 19.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.182, top1 = 56.93%], valid : [loss = 1.228, top1 = 55.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13909/15625) 013909-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.092, top1 = 97.46%], valid : [loss = 0.472, top1 = 86.26%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10        train : [loss = 0.125, top1 = 96.04%], test  : [loss = 0.335, top1 = 89.16%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.93 ms.
cifar100       train : [loss = 0.805, top1 = 77.24%], valid : [loss = 1.291, top1 = 64.27%], test : [loss = 1.284, top1 = 64.15%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 36.94%], valid : [loss = 2.585, top1 = 35.39%], test : [loss = 2.602, top1 = 34.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.08%], valid : [loss = 0.799, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13910/15625) 013910-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.525, top1 = 88.69%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.328, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.31 ms.
cifar100       train : [loss = 0.249, top1 = 93.71%], valid : [loss = 1.261, top1 = 68.40%], test : [loss = 1.254, top1 = 68.55%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.41 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.06%], valid : [loss = 2.325, top1 = 40.52%], test : [loss = 2.303, top1 = 41.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.68%], valid : [loss = 0.683, top1 = 76.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13911/15625) 013911-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.602, top1 = 79.03%], valid : [loss = 0.696, top1 = 76.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.80 ms.
cifar10        train : [loss = 0.564, top1 = 80.65%], test  : [loss = 0.622, top1 = 78.28%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.56 ms.
cifar100       train : [loss = 1.990, top1 = 46.79%], valid : [loss = 2.107, top1 = 44.16%], test : [loss = 2.097, top1 = 44.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.45%], valid : [loss = 3.196, top1 = 23.14%], test : [loss = 3.229, top1 = 22.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.286, top1 = 53.61%], valid : [loss = 1.351, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13912/15625) 013912-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.55%], valid : [loss = 0.704, top1 = 84.45%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.01 ms.
cifar10        train : [loss = 0.042, top1 = 98.72%], test  : [loss = 0.451, top1 = 88.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.96 ms.
cifar100       train : [loss = 0.437, top1 = 87.57%], valid : [loss = 1.534, top1 = 62.49%], test : [loss = 1.520, top1 = 62.47%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.360, top1 = 39.65%], valid : [loss = 2.672, top1 = 34.02%], test : [loss = 2.678, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.87%], valid : [loss = 0.845, top1 = 70.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13913/15625) 013913-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.562, top1 = 88.93%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.52 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.358, top1 = 92.57%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.47 ms.
cifar100       train : [loss = 0.105, top1 = 98.03%], valid : [loss = 1.436, top1 = 67.79%], test : [loss = 1.459, top1 = 67.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.81 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.78%], valid : [loss = 2.445, top1 = 39.00%], test : [loss = 2.443, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 78.97%], valid : [loss = 0.692, top1 = 76.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13914/15625) 013914-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.611, top1 = 87.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.405, top1 = 91.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.47 ms.
cifar100       train : [loss = 0.211, top1 = 94.91%], valid : [loss = 1.512, top1 = 65.27%], test : [loss = 1.506, top1 = 65.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.32%], valid : [loss = 2.544, top1 = 36.22%], test : [loss = 2.546, top1 = 36.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.63%], valid : [loss = 0.756, top1 = 74.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13915/15625) 013915-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.098, top1 = 96.98%], valid : [loss = 0.865, top1 = 78.87%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10        train : [loss = 0.136, top1 = 95.45%], test  : [loss = 0.550, top1 = 84.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.891, top1 = 74.14%], valid : [loss = 1.691, top1 = 57.51%], test : [loss = 1.679, top1 = 57.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 3.052, top1 = 26.16%], valid : [loss = 3.184, top1 = 23.94%], test : [loss = 3.228, top1 = 23.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 62.91%], valid : [loss = 1.087, top1 = 61.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13916/15625) 013916-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.492, top1 = 88.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.69 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.318, top1 = 92.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.83 ms.
cifar100       train : [loss = 0.233, top1 = 94.27%], valid : [loss = 1.247, top1 = 68.52%], test : [loss = 1.257, top1 = 68.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.30%], valid : [loss = 2.274, top1 = 41.49%], test : [loss = 2.288, top1 = 41.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13917/15625) 013917-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.579, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.384, top1 = 91.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.69 ms.
cifar100       train : [loss = 0.161, top1 = 96.60%], valid : [loss = 1.459, top1 = 66.26%], test : [loss = 1.450, top1 = 66.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.37%], valid : [loss = 2.472, top1 = 38.71%], test : [loss = 2.467, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.694, top1 = 76.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13918/15625) 013918-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.00%], valid : [loss = 0.543, top1 = 86.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10        train : [loss = 0.078, top1 = 97.50%], test  : [loss = 0.359, top1 = 89.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 0.710, top1 = 79.20%], valid : [loss = 1.348, top1 = 64.61%], test : [loss = 1.338, top1 = 64.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.11 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.06%], valid : [loss = 2.631, top1 = 34.10%], test : [loss = 2.678, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.83%], valid : [loss = 0.705, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13919/15625) 013919-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.68 ms.
cifar10-valid  train : [loss = 0.162, top1 = 94.51%], valid : [loss = 0.750, top1 = 79.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.24 ms.
cifar10        train : [loss = 0.182, top1 = 93.75%], test  : [loss = 0.507, top1 = 84.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.36 ms.
cifar100       train : [loss = 0.890, top1 = 74.02%], valid : [loss = 1.641, top1 = 57.13%], test : [loss = 1.671, top1 = 56.42%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 3.515, top1 = 16.51%], valid : [loss = 3.506, top1 = 16.81%], test : [loss = 3.515, top1 = 16.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13920/15625) 013920-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.531, top1 = 89.35%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.40 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.353, top1 = 92.72%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.01 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.450, top1 = 68.47%], test : [loss = 1.437, top1 = 69.23%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.72 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.71%], valid : [loss = 2.359, top1 = 41.01%], test : [loss = 2.371, top1 = 41.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.77%], valid : [loss = 0.687, top1 = 76.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13921/15625) 013921-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.571, top1 = 87.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.374, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.32 ms.
cifar100       train : [loss = 0.383, top1 = 89.25%], valid : [loss = 1.368, top1 = 65.79%], test : [loss = 1.386, top1 = 65.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 41.32%], valid : [loss = 2.494, top1 = 37.16%], test : [loss = 2.517, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.57%], valid : [loss = 0.842, top1 = 70.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13922/15625) 013922-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.545, top1 = 89.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.337, top1 = 92.77%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.84 ms.
cifar100       train : [loss = 0.129, top1 = 97.29%], valid : [loss = 1.366, top1 = 68.60%], test : [loss = 1.369, top1 = 69.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.993, top1 = 47.66%], valid : [loss = 2.342, top1 = 40.68%], test : [loss = 2.333, top1 = 40.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.28%], valid : [loss = 0.825, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13923/15625) 013923-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.99 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.31%], valid : [loss = 0.586, top1 = 85.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10        train : [loss = 0.087, top1 = 97.32%], test  : [loss = 0.372, top1 = 89.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.61 ms.
cifar100       train : [loss = 0.702, top1 = 79.33%], valid : [loss = 1.395, top1 = 63.46%], test : [loss = 1.389, top1 = 63.23%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.50 ms.
ImageNet16-120 train : [loss = 2.456, top1 = 37.44%], valid : [loss = 2.563, top1 = 35.58%], test : [loss = 2.590, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.41%], valid : [loss = 0.850, top1 = 69.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13924/15625) 013924-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.464, top1 = 89.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.38%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.97 ms.
cifar100       train : [loss = 0.318, top1 = 91.46%], valid : [loss = 1.237, top1 = 67.89%], test : [loss = 1.269, top1 = 67.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.75%], valid : [loss = 2.323, top1 = 39.94%], test : [loss = 2.328, top1 = 40.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13925/15625) 013925-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.42 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.421, top1 = 91.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.96 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.276, top1 = 93.91%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.75 ms.
cifar100       train : [loss = 0.043, top1 = 99.53%], valid : [loss = 1.328, top1 = 71.19%], test : [loss = 1.305, top1 = 71.01%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.424, top1 = 61.24%], valid : [loss = 2.204, top1 = 45.37%], test : [loss = 2.219, top1 = 45.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.351, top1 = 88.29%], valid : [loss = 0.483, top1 = 83.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13926/15625) 013926-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.448, top1 = 90.56%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.23%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.127, top1 = 97.24%], valid : [loss = 1.305, top1 = 70.30%], test : [loss = 1.309, top1 = 69.71%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.70%], valid : [loss = 2.238, top1 = 43.41%], test : [loss = 2.255, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.418, top1 = 85.56%], valid : [loss = 0.543, top1 = 81.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13927/15625) 013927-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.387, top1 = 91.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.73 ms.
cifar100       train : [loss = 0.157, top1 = 96.69%], valid : [loss = 1.441, top1 = 67.23%], test : [loss = 1.436, top1 = 67.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 1.952, top1 = 48.59%], valid : [loss = 2.440, top1 = 39.23%], test : [loss = 2.467, top1 = 39.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.09%], valid : [loss = 0.711, top1 = 75.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13928/15625) 013928-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.55%], valid : [loss = 0.551, top1 = 87.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.357, top1 = 91.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.530, top1 = 84.81%], valid : [loss = 1.355, top1 = 64.53%], test : [loss = 1.354, top1 = 64.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.87 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.11%], valid : [loss = 2.636, top1 = 33.31%], test : [loss = 2.655, top1 = 32.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13929/15625) 013929-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.517, top1 = 88.66%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.322, top1 = 92.23%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.00 ms.
cifar100       train : [loss = 0.342, top1 = 90.64%], valid : [loss = 1.284, top1 = 67.15%], test : [loss = 1.298, top1 = 66.88%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.64%], valid : [loss = 2.410, top1 = 38.97%], test : [loss = 2.423, top1 = 39.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13930/15625) 013930-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.537, top1 = 88.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.343, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.313, top1 = 91.29%], valid : [loss = 1.342, top1 = 66.85%], test : [loss = 1.345, top1 = 67.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.108, top1 = 45.04%], valid : [loss = 2.411, top1 = 38.87%], test : [loss = 2.388, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.88%], valid : [loss = 0.808, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13931/15625) 013931-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.20%], valid : [loss = 0.477, top1 = 84.55%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10        train : [loss = 0.302, top1 = 89.92%], test  : [loss = 0.399, top1 = 86.32%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.24 ms.
cifar100       train : [loss = 1.321, top1 = 63.34%], valid : [loss = 1.531, top1 = 57.79%], test : [loss = 1.506, top1 = 58.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.67%], valid : [loss = 2.907, top1 = 29.12%], test : [loss = 2.950, top1 = 28.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13932/15625) 013932-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.607, top1 = 87.49%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.07 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.418, top1 = 90.91%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.08 ms.
cifar100       train : [loss = 0.203, top1 = 95.22%], valid : [loss = 1.501, top1 = 65.67%], test : [loss = 1.479, top1 = 65.89%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.066, top1 = 46.11%], valid : [loss = 2.501, top1 = 37.59%], test : [loss = 2.513, top1 = 38.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.70%], valid : [loss = 0.760, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13933/15625) 013933-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.547, top1 = 88.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.03 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.352, top1 = 92.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.81 ms.
cifar100       train : [loss = 0.252, top1 = 93.14%], valid : [loss = 1.319, top1 = 67.92%], test : [loss = 1.324, top1 = 67.65%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.47%], valid : [loss = 2.432, top1 = 38.30%], test : [loss = 2.433, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13934/15625) 013934-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.44 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.487, top1 = 88.82%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.33 ms.
cifar10        train : [loss = 0.020, top1 = 99.53%], test  : [loss = 0.328, top1 = 91.49%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.25 ms.
cifar100       train : [loss = 0.297, top1 = 92.24%], valid : [loss = 1.187, top1 = 68.80%], test : [loss = 1.181, top1 = 69.25%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=21.20 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.84%], valid : [loss = 2.230, top1 = 42.36%], test : [loss = 2.228, top1 = 42.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.60%], valid : [loss = 0.728, top1 = 74.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13935/15625) 013935-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.581, top1 = 87.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.398, top1 = 91.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.11 ms.
cifar100       train : [loss = 0.156, top1 = 96.61%], valid : [loss = 1.513, top1 = 65.83%], test : [loss = 1.502, top1 = 66.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.78%], valid : [loss = 2.509, top1 = 36.73%], test : [loss = 2.525, top1 = 38.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 73.87%], valid : [loss = 0.809, top1 = 71.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13936/15625) 013936-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.579, top1 = 87.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.378, top1 = 91.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.71 ms.
cifar100       train : [loss = 0.404, top1 = 88.51%], valid : [loss = 1.383, top1 = 65.86%], test : [loss = 1.371, top1 = 65.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 41.05%], valid : [loss = 2.509, top1 = 36.83%], test : [loss = 2.525, top1 = 36.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13937/15625) 013937-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.309, top1 = 89.41%], valid : [loss = 0.557, top1 = 82.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.273, top1 = 90.54%], test  : [loss = 0.421, top1 = 86.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.89 ms.
cifar100       train : [loss = 1.424, top1 = 60.03%], valid : [loss = 1.683, top1 = 54.41%], test : [loss = 1.662, top1 = 54.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.73 ms.
ImageNet16-120 train : [loss = 2.977, top1 = 27.26%], valid : [loss = 2.963, top1 = 28.23%], test : [loss = 3.025, top1 = 26.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.48%], valid : [loss = 1.042, top1 = 62.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13938/15625) 013938-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.583, top1 = 87.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.020, top1 = 99.49%], test  : [loss = 0.394, top1 = 90.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.429, top1 = 87.64%], valid : [loss = 1.399, top1 = 65.19%], test : [loss = 1.407, top1 = 65.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.36%], valid : [loss = 2.534, top1 = 36.17%], test : [loss = 2.545, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.34%], valid : [loss = 0.818, top1 = 71.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13939/15625) 013939-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.553, top1 = 88.32%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.09 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.360, top1 = 91.72%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.20 ms.
cifar100       train : [loss = 0.185, top1 = 95.62%], valid : [loss = 1.335, top1 = 68.31%], test : [loss = 1.324, top1 = 68.31%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.68 ms.
ImageNet16-120 train : [loss = 2.083, top1 = 45.56%], valid : [loss = 2.369, top1 = 39.79%], test : [loss = 2.374, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.872, top1 = 68.68%], valid : [loss = 0.925, top1 = 67.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13940/15625) 013940-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.603, top1 = 86.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.370, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.59 ms.
cifar100       train : [loss = 0.407, top1 = 88.50%], valid : [loss = 1.395, top1 = 65.07%], test : [loss = 1.394, top1 = 65.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.65%], valid : [loss = 2.526, top1 = 36.43%], test : [loss = 2.549, top1 = 36.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.12%], valid : [loss = 0.811, top1 = 71.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13941/15625) 013941-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.557, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.357, top1 = 92.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.97 ms.
cifar100       train : [loss = 0.101, top1 = 98.22%], valid : [loss = 1.450, top1 = 68.25%], test : [loss = 1.428, top1 = 68.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 1.859, top1 = 50.89%], valid : [loss = 2.410, top1 = 39.82%], test : [loss = 2.427, top1 = 40.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.06%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13942/15625) 013942-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.20%], valid : [loss = 0.547, top1 = 84.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.178, top1 = 93.99%], test  : [loss = 0.387, top1 = 87.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 1.193, top1 = 65.89%], valid : [loss = 1.515, top1 = 58.44%], test : [loss = 1.514, top1 = 58.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.13%], valid : [loss = 2.680, top1 = 32.96%], test : [loss = 2.720, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.946, top1 = 66.22%], valid : [loss = 1.005, top1 = 64.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13943/15625) 013943-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.457, top1 = 83.96%], valid : [loss = 0.695, top1 = 77.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10        train : [loss = 0.398, top1 = 86.21%], test  : [loss = 0.536, top1 = 82.09%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.39 ms.
cifar100       train : [loss = 1.651, top1 = 54.43%], valid : [loss = 1.867, top1 = 50.07%], test : [loss = 1.867, top1 = 50.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 3.317, top1 = 21.09%], valid : [loss = 3.323, top1 = 21.38%], test : [loss = 3.355, top1 = 20.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.192, top1 = 56.44%], valid : [loss = 1.251, top1 = 55.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13944/15625) 013944-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.261, top1 = 91.09%], valid : [loss = 0.587, top1 = 81.89%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10        train : [loss = 0.265, top1 = 90.91%], test  : [loss = 0.450, top1 = 85.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.62 ms.
cifar100       train : [loss = 1.321, top1 = 62.82%], valid : [loss = 1.650, top1 = 55.42%], test : [loss = 1.655, top1 = 55.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 3.029, top1 = 26.55%], valid : [loss = 3.038, top1 = 26.29%], test : [loss = 3.103, top1 = 25.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.132, top1 = 59.02%], valid : [loss = 1.163, top1 = 58.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13945/15625) 013945-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.460, top1 = 83.73%], valid : [loss = 0.681, top1 = 77.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.96 ms.
cifar10        train : [loss = 0.393, top1 = 86.32%], test  : [loss = 0.515, top1 = 82.70%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.725, top1 = 52.40%], valid : [loss = 1.950, top1 = 48.03%], test : [loss = 1.954, top1 = 47.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 3.213, top1 = 22.66%], valid : [loss = 3.216, top1 = 22.88%], test : [loss = 3.264, top1 = 21.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.104, top1 = 60.18%], valid : [loss = 1.144, top1 = 58.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13946/15625) 013946-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.566, top1 = 87.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.386, top1 = 91.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 0.400, top1 = 88.66%], valid : [loss = 1.385, top1 = 65.61%], test : [loss = 1.393, top1 = 65.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.89%], valid : [loss = 2.518, top1 = 36.74%], test : [loss = 2.533, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13947/15625) 013947-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.38%], valid : [loss = 0.588, top1 = 85.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10        train : [loss = 0.070, top1 = 97.90%], test  : [loss = 0.388, top1 = 89.25%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.15 ms.
cifar100       train : [loss = 0.705, top1 = 79.46%], valid : [loss = 1.373, top1 = 63.68%], test : [loss = 1.363, top1 = 63.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.36%], valid : [loss = 2.648, top1 = 34.01%], test : [loss = 2.669, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.86%], valid : [loss = 0.770, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13948/15625) 013948-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.569, top1 = 87.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.370, top1 = 91.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.389, top1 = 88.96%], valid : [loss = 1.402, top1 = 65.63%], test : [loss = 1.377, top1 = 65.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.258, top1 = 41.84%], valid : [loss = 2.462, top1 = 38.14%], test : [loss = 2.484, top1 = 37.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.60%], valid : [loss = 0.762, top1 = 73.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13949/15625) 013949-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.21%], valid : [loss = 0.585, top1 = 85.55%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.109, top1 = 96.39%], test  : [loss = 0.387, top1 = 88.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.79 ms.
cifar100       train : [loss = 0.812, top1 = 76.08%], valid : [loss = 1.397, top1 = 62.35%], test : [loss = 1.401, top1 = 62.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.26 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 33.01%], valid : [loss = 2.767, top1 = 31.67%], test : [loss = 2.818, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.06%], valid : [loss = 0.700, top1 = 75.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13950/15625) 013950-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.11 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.325, top1 = 93.23%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.00 ms.
cifar100       train : [loss = 0.063, top1 = 98.88%], valid : [loss = 1.374, top1 = 69.69%], test : [loss = 1.403, top1 = 69.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 1.680, top1 = 55.01%], valid : [loss = 2.281, top1 = 42.33%], test : [loss = 2.269, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.85%], valid : [loss = 0.672, top1 = 76.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13951/15625) 013951-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.203, top1 = 93.11%], valid : [loss = 0.548, top1 = 83.53%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.62 ms.
cifar10        train : [loss = 0.195, top1 = 93.36%], test  : [loss = 0.395, top1 = 87.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.80 ms.
cifar100       train : [loss = 1.256, top1 = 64.19%], valid : [loss = 1.566, top1 = 56.93%], test : [loss = 1.573, top1 = 57.01%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.09%], valid : [loss = 2.712, top1 = 32.58%], test : [loss = 2.751, top1 = 31.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.16%], valid : [loss = 0.997, top1 = 64.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13952/15625) 013952-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.64%], valid : [loss = 0.541, top1 = 83.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.198, top1 = 93.28%], test  : [loss = 0.391, top1 = 87.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 1.207, top1 = 65.50%], valid : [loss = 1.525, top1 = 58.47%], test : [loss = 1.511, top1 = 58.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.68 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.80%], valid : [loss = 2.688, top1 = 32.96%], test : [loss = 2.735, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.23%], valid : [loss = 0.982, top1 = 65.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13953/15625) 013953-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.59%], valid : [loss = 0.849, top1 = 72.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10        train : [loss = 0.550, top1 = 80.86%], test  : [loss = 0.715, top1 = 75.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 1.772, top1 = 52.16%], valid : [loss = 2.060, top1 = 47.07%], test : [loss = 2.072, top1 = 46.27%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 17.00%], valid : [loss = 3.627, top1 = 16.92%], test : [loss = 3.658, top1 = 15.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13954/15625) 013954-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.17%], valid : [loss = 0.455, top1 = 86.94%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.78 ms.
cifar10        train : [loss = 0.114, top1 = 96.50%], test  : [loss = 0.329, top1 = 89.44%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.43 ms.
cifar100       train : [loss = 0.862, top1 = 75.44%], valid : [loss = 1.303, top1 = 64.27%], test : [loss = 1.275, top1 = 64.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.62%], valid : [loss = 2.625, top1 = 34.63%], test : [loss = 2.667, top1 = 33.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13955/15625) 013955-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.542, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.348, top1 = 92.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.18 ms.
cifar100       train : [loss = 0.078, top1 = 98.80%], valid : [loss = 1.462, top1 = 68.11%], test : [loss = 1.411, top1 = 69.09%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.746, top1 = 53.56%], valid : [loss = 2.358, top1 = 41.51%], test : [loss = 2.375, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.53%], valid : [loss = 0.688, top1 = 76.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13956/15625) 013956-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.594, top1 = 87.06%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.017, top1 = 99.58%], test  : [loss = 0.395, top1 = 91.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.16 ms.
cifar100       train : [loss = 0.409, top1 = 88.27%], valid : [loss = 1.412, top1 = 65.00%], test : [loss = 1.404, top1 = 65.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.88%], valid : [loss = 2.519, top1 = 36.97%], test : [loss = 2.541, top1 = 36.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.30%], valid : [loss = 0.847, top1 = 70.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13957/15625) 013957-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.14%], valid : [loss = 0.553, top1 = 87.13%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.37 ms.
cifar10        train : [loss = 0.053, top1 = 98.29%], test  : [loss = 0.366, top1 = 90.40%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.53 ms.
cifar100       train : [loss = 0.544, top1 = 84.04%], valid : [loss = 1.334, top1 = 65.17%], test : [loss = 1.301, top1 = 65.47%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 2.223, top1 = 42.46%], valid : [loss = 2.414, top1 = 38.93%], test : [loss = 2.429, top1 = 38.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.50%], valid : [loss = 0.820, top1 = 71.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13958/15625) 013958-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.81%], valid : [loss = 0.858, top1 = 72.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10        train : [loss = 0.547, top1 = 80.89%], test  : [loss = 0.708, top1 = 75.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.88 ms.
cifar100       train : [loss = 1.770, top1 = 52.27%], valid : [loss = 2.040, top1 = 47.11%], test : [loss = 2.058, top1 = 46.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.88%], valid : [loss = 3.623, top1 = 16.42%], test : [loss = 3.669, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13959/15625) 013959-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.490, top1 = 89.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.07 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.321, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.65 ms.
cifar100       train : [loss = 0.230, top1 = 94.41%], valid : [loss = 1.258, top1 = 68.51%], test : [loss = 1.242, top1 = 68.45%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.17 ms.
ImageNet16-120 train : [loss = 1.909, top1 = 49.58%], valid : [loss = 2.278, top1 = 41.43%], test : [loss = 2.283, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.67%], valid : [loss = 0.659, top1 = 77.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13960/15625) 013960-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.69%], valid : [loss = 0.635, top1 = 84.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.088, top1 = 97.11%], test  : [loss = 0.410, top1 = 88.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.40 ms.
cifar100       train : [loss = 0.771, top1 = 77.39%], valid : [loss = 1.429, top1 = 62.54%], test : [loss = 1.401, top1 = 62.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.612, top1 = 34.38%], valid : [loss = 2.741, top1 = 32.32%], test : [loss = 2.752, top1 = 31.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.42%], valid : [loss = 0.844, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13961/15625) 013961-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.588, top1 = 87.19%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.94 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.403, top1 = 90.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.68 ms.
cifar100       train : [loss = 0.413, top1 = 88.19%], valid : [loss = 1.416, top1 = 64.94%], test : [loss = 1.388, top1 = 64.94%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.64 ms.
ImageNet16-120 train : [loss = 2.305, top1 = 40.81%], valid : [loss = 2.501, top1 = 37.14%], test : [loss = 2.530, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.53%], valid : [loss = 0.827, top1 = 70.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13962/15625) 013962-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.737, top1 = 84.88%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.474, top1 = 88.92%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 0.367, top1 = 89.92%], valid : [loss = 1.697, top1 = 60.39%], test : [loss = 1.714, top1 = 60.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.458, top1 = 37.58%], valid : [loss = 2.813, top1 = 30.60%], test : [loss = 2.833, top1 = 31.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.830, top1 = 70.17%], valid : [loss = 0.885, top1 = 68.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13963/15625) 013963-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.512, top1 = 89.49%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.03 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.321, top1 = 93.04%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.37 ms.
cifar100       train : [loss = 0.080, top1 = 98.74%], valid : [loss = 1.329, top1 = 69.60%], test : [loss = 1.303, top1 = 69.60%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.99 ms.
ImageNet16-120 train : [loss = 1.775, top1 = 52.71%], valid : [loss = 2.272, top1 = 42.73%], test : [loss = 2.260, top1 = 43.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.31%], valid : [loss = 0.824, top1 = 71.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13964/15625) 013964-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.40%], valid : [loss = 0.560, top1 = 86.95%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.50 ms.
cifar10        train : [loss = 0.045, top1 = 98.66%], test  : [loss = 0.373, top1 = 90.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.31 ms.
cifar100       train : [loss = 0.531, top1 = 84.56%], valid : [loss = 1.284, top1 = 65.69%], test : [loss = 1.317, top1 = 65.62%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.76%], valid : [loss = 2.443, top1 = 37.88%], test : [loss = 2.466, top1 = 38.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.25%], valid : [loss = 0.734, top1 = 74.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13965/15625) 013965-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.513, top1 = 89.20%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.86 ms.
cifar10        train : [loss = 0.007, top1 = 99.84%], test  : [loss = 0.343, top1 = 92.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.64 ms.
cifar100       train : [loss = 0.114, top1 = 97.52%], valid : [loss = 1.355, top1 = 69.62%], test : [loss = 1.365, top1 = 68.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.09%], valid : [loss = 2.391, top1 = 40.07%], test : [loss = 2.377, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.07%], valid : [loss = 0.790, top1 = 71.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13966/15625) 013966-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.52%], valid : [loss = 0.579, top1 = 87.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10        train : [loss = 0.036, top1 = 98.88%], test  : [loss = 0.374, top1 = 90.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.10 ms.
cifar100       train : [loss = 0.504, top1 = 85.55%], valid : [loss = 1.301, top1 = 65.42%], test : [loss = 1.339, top1 = 64.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 2.589, top1 = 34.31%], valid : [loss = 2.668, top1 = 32.40%], test : [loss = 2.689, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.65%], valid : [loss = 0.816, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13967/15625) 013967-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.47 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.28%], valid : [loss = 0.456, top1 = 87.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.115, top1 = 96.39%], test  : [loss = 0.329, top1 = 89.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 0.866, top1 = 75.27%], valid : [loss = 1.287, top1 = 64.26%], test : [loss = 1.278, top1 = 63.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.66 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.47%], valid : [loss = 2.638, top1 = 33.52%], test : [loss = 2.655, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.99%], valid : [loss = 0.629, top1 = 78.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13968/15625) 013968-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.64%], valid : [loss = 0.474, top1 = 85.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.158, top1 = 94.89%], test  : [loss = 0.349, top1 = 88.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.66 ms.
cifar100       train : [loss = 1.048, top1 = 70.28%], valid : [loss = 1.389, top1 = 62.02%], test : [loss = 1.399, top1 = 60.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.73%], valid : [loss = 2.696, top1 = 32.57%], test : [loss = 2.706, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13969/15625) 013969-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.84%], valid : [loss = 0.491, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.346, top1 = 91.53%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.05 ms.
cifar100       train : [loss = 0.410, top1 = 88.14%], valid : [loss = 1.328, top1 = 66.85%], test : [loss = 1.296, top1 = 66.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.168, top1 = 43.79%], valid : [loss = 2.420, top1 = 38.90%], test : [loss = 2.440, top1 = 38.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.14%], valid : [loss = 0.655, top1 = 77.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13970/15625) 013970-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.489, top1 = 89.06%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=14.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.315, top1 = 92.17%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=14.22 ms.
cifar100       train : [loss = 0.325, top1 = 91.18%], valid : [loss = 1.235, top1 = 67.77%], test : [loss = 1.238, top1 = 68.31%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.76%], valid : [loss = 2.304, top1 = 40.87%], test : [loss = 2.334, top1 = 40.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13971/15625) 013971-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.76 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.19 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13972/15625) 013972-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.65%], valid : [loss = 0.462, top1 = 86.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.154, top1 = 94.95%], test  : [loss = 0.341, top1 = 88.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.66 ms.
cifar100       train : [loss = 1.008, top1 = 71.56%], valid : [loss = 1.364, top1 = 61.74%], test : [loss = 1.369, top1 = 61.88%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.31%], valid : [loss = 2.718, top1 = 33.10%], test : [loss = 2.718, top1 = 31.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13973/15625) 013973-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.506, top1 = 82.40%], valid : [loss = 0.665, top1 = 77.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10        train : [loss = 0.508, top1 = 82.47%], test  : [loss = 0.584, top1 = 80.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.64 ms.
cifar100       train : [loss = 1.703, top1 = 53.82%], valid : [loss = 1.871, top1 = 50.68%], test : [loss = 1.879, top1 = 49.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.28%], valid : [loss = 3.309, top1 = 21.20%], test : [loss = 3.346, top1 = 21.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13974/15625) 013974-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.504, top1 = 88.88%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.327, top1 = 92.18%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.43 ms.
cifar100       train : [loss = 0.330, top1 = 91.07%], valid : [loss = 1.274, top1 = 67.29%], test : [loss = 1.271, top1 = 67.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.89%], valid : [loss = 2.398, top1 = 39.40%], test : [loss = 2.421, top1 = 39.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13975/15625) 013975-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.19%], valid : [loss = 0.847, top1 = 72.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.99 ms.
cifar10        train : [loss = 0.563, top1 = 80.41%], test  : [loss = 0.712, top1 = 76.39%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.76 ms.
cifar100       train : [loss = 1.792, top1 = 51.70%], valid : [loss = 2.070, top1 = 46.48%], test : [loss = 2.045, top1 = 46.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.73%], valid : [loss = 3.641, top1 = 16.60%], test : [loss = 3.668, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.202, top1 = 56.09%], valid : [loss = 1.257, top1 = 55.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13976/15625) 013976-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.551, top1 = 88.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.373, top1 = 91.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.81 ms.
cifar100       train : [loss = 0.167, top1 = 96.18%], valid : [loss = 1.500, top1 = 65.99%], test : [loss = 1.491, top1 = 66.84%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.46%], valid : [loss = 2.406, top1 = 39.26%], test : [loss = 2.422, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.44%], valid : [loss = 0.777, top1 = 73.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13977/15625) 013977-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.556, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.70 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.366, top1 = 92.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.33 ms.
cifar100       train : [loss = 0.137, top1 = 96.89%], valid : [loss = 1.357, top1 = 68.58%], test : [loss = 1.386, top1 = 68.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.25%], valid : [loss = 2.393, top1 = 40.13%], test : [loss = 2.397, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.958, top1 = 65.40%], valid : [loss = 0.994, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13978/15625) 013978-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.41%], valid : [loss = 0.642, top1 = 85.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.70 ms.
cifar10        train : [loss = 0.057, top1 = 98.24%], test  : [loss = 0.405, top1 = 89.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.06 ms.
cifar100       train : [loss = 0.653, top1 = 80.89%], valid : [loss = 1.393, top1 = 63.61%], test : [loss = 1.366, top1 = 64.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.484, top1 = 37.12%], valid : [loss = 2.609, top1 = 34.86%], test : [loss = 2.636, top1 = 33.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.66%], valid : [loss = 0.829, top1 = 70.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13979/15625) 013979-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.463, top1 = 89.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.308, top1 = 92.63%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.78 ms.
cifar100       train : [loss = 0.204, top1 = 95.05%], valid : [loss = 1.367, top1 = 68.23%], test : [loss = 1.344, top1 = 68.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.54%], valid : [loss = 2.291, top1 = 42.00%], test : [loss = 2.330, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.74%], valid : [loss = 0.578, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13980/15625) 013980-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.87%], valid : [loss = 0.840, top1 = 71.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.683, top1 = 76.09%], test  : [loss = 0.774, top1 = 72.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 1.959, top1 = 47.96%], valid : [loss = 2.128, top1 = 45.22%], test : [loss = 2.147, top1 = 44.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.35 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.71%], valid : [loss = 3.660, top1 = 15.97%], test : [loss = 3.708, top1 = 14.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13981/15625) 013981-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.415, top1 = 91.18%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.29 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.70%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.20 ms.
cifar100       train : [loss = 0.045, top1 = 99.52%], valid : [loss = 1.323, top1 = 70.88%], test : [loss = 1.300, top1 = 71.00%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.455, top1 = 60.40%], valid : [loss = 2.228, top1 = 44.03%], test : [loss = 2.262, top1 = 44.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.90%], valid : [loss = 0.482, top1 = 84.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13982/15625) 013982-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.586, top1 = 87.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.45 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.400, top1 = 91.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.94 ms.
cifar100       train : [loss = 0.294, top1 = 92.18%], valid : [loss = 1.428, top1 = 65.16%], test : [loss = 1.444, top1 = 65.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.19%], valid : [loss = 2.600, top1 = 36.13%], test : [loss = 2.618, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.90%], valid : [loss = 0.643, top1 = 77.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13983/15625) 013983-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.657, top1 = 86.24%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.04 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.425, top1 = 90.65%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.53 ms.
cifar100       train : [loss = 0.257, top1 = 93.73%], valid : [loss = 1.545, top1 = 63.54%], test : [loss = 1.509, top1 = 64.74%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.149, top1 = 44.20%], valid : [loss = 2.546, top1 = 36.83%], test : [loss = 2.552, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.11%], valid : [loss = 0.781, top1 = 72.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13984/15625) 013984-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.75 ms.
cifar10-valid  train : [loss = 1.245, top1 = 55.48%], valid : [loss = 1.291, top1 = 53.96%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10        train : [loss = 1.207, top1 = 56.72%], test  : [loss = 1.223, top1 = 55.99%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.10 ms.
cifar100       train : [loss = 2.752, top1 = 31.25%], valid : [loss = 2.836, top1 = 29.96%], test : [loss = 2.824, top1 = 30.29%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.71 ms.
ImageNet16-120 train : [loss = 3.916, top1 = 11.67%], valid : [loss = 3.913, top1 = 12.43%], test : [loss = 3.929, top1 = 11.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.764, top1 = 33.36%], valid : [loss = 1.758, top1 = 33.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13985/15625) 013985-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.519, top1 = 88.96%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.336, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.95 ms.
cifar100       train : [loss = 0.283, top1 = 92.41%], valid : [loss = 1.265, top1 = 67.16%], test : [loss = 1.264, top1 = 67.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.99 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.36%], valid : [loss = 2.302, top1 = 40.97%], test : [loss = 2.345, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13986/15625) 013986-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.509, top1 = 89.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.319, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.07 ms.
cifar100       train : [loss = 0.166, top1 = 96.18%], valid : [loss = 1.317, top1 = 68.50%], test : [loss = 1.359, top1 = 67.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.35%], valid : [loss = 2.215, top1 = 43.23%], test : [loss = 2.295, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.45%], valid : [loss = 0.625, top1 = 78.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13987/15625) 013987-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.408, top1 = 90.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.269, top1 = 93.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.45 ms.
cifar100       train : [loss = 0.172, top1 = 96.02%], valid : [loss = 1.272, top1 = 69.61%], test : [loss = 1.281, top1 = 69.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.31 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.29%], valid : [loss = 2.232, top1 = 43.21%], test : [loss = 2.268, top1 = 42.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.404, top1 = 86.10%], valid : [loss = 0.513, top1 = 82.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13988/15625) 013988-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.517, top1 = 82.13%], valid : [loss = 0.708, top1 = 76.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10        train : [loss = 0.347, top1 = 88.13%], test  : [loss = 0.480, top1 = 84.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.09 ms.
cifar100       train : [loss = 1.750, top1 = 52.01%], valid : [loss = 1.999, top1 = 47.60%], test : [loss = 1.970, top1 = 47.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 3.263, top1 = 21.92%], valid : [loss = 3.285, top1 = 22.20%], test : [loss = 3.317, top1 = 21.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.235, top1 = 55.41%], valid : [loss = 1.261, top1 = 54.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13989/15625) 013989-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.580, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.45 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.375, top1 = 91.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.32 ms.
cifar100       train : [loss = 0.172, top1 = 96.32%], valid : [loss = 1.461, top1 = 66.40%], test : [loss = 1.490, top1 = 66.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.97 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.83%], valid : [loss = 2.491, top1 = 38.50%], test : [loss = 2.456, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.87%], valid : [loss = 0.699, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13990/15625) 013990-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.510, top1 = 88.77%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.326, top1 = 92.04%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.68 ms.
cifar100       train : [loss = 0.349, top1 = 90.48%], valid : [loss = 1.280, top1 = 66.76%], test : [loss = 1.272, top1 = 67.56%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 2.114, top1 = 44.81%], valid : [loss = 2.396, top1 = 38.97%], test : [loss = 2.409, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13991/15625) 013991-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.67 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.411, top1 = 91.31%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.83 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.277, top1 = 93.81%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.43 ms.
cifar100       train : [loss = 0.047, top1 = 99.50%], valid : [loss = 1.350, top1 = 70.40%], test : [loss = 1.288, top1 = 71.46%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 1.453, top1 = 60.34%], valid : [loss = 2.250, top1 = 43.80%], test : [loss = 2.244, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.87%], valid : [loss = 0.499, top1 = 83.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13992/15625) 013992-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.74%], valid : [loss = 0.534, top1 = 87.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10        train : [loss = 0.027, top1 = 99.29%], test  : [loss = 0.331, top1 = 91.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.41 ms.
cifar100       train : [loss = 0.478, top1 = 85.94%], valid : [loss = 1.328, top1 = 65.68%], test : [loss = 1.332, top1 = 65.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.09%], valid : [loss = 2.519, top1 = 36.20%], test : [loss = 2.582, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.02%], valid : [loss = 0.693, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13993/15625) 013993-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.554, top1 = 88.47%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.358, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.40 ms.
cifar100       train : [loss = 0.175, top1 = 96.17%], valid : [loss = 1.380, top1 = 67.40%], test : [loss = 1.375, top1 = 68.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.54 ms.
ImageNet16-120 train : [loss = 1.977, top1 = 48.17%], valid : [loss = 2.460, top1 = 38.40%], test : [loss = 2.458, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.52%], valid : [loss = 0.715, top1 = 75.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13994/15625) 013994-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.45%], valid : [loss = 0.770, top1 = 74.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.529, top1 = 81.47%], test  : [loss = 0.639, top1 = 78.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.66 ms.
cifar100       train : [loss = 1.880, top1 = 48.82%], valid : [loss = 2.065, top1 = 45.32%], test : [loss = 2.037, top1 = 45.74%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 3.515, top1 = 17.72%], valid : [loss = 3.521, top1 = 17.40%], test : [loss = 3.559, top1 = 16.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.240, top1 = 54.79%], valid : [loss = 1.282, top1 = 53.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13995/15625) 013995-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.001, top1 = 100.00%], valid : [loss = 0.550, top1 = 89.42%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.358, top1 = 93.17%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.75 ms.
cifar100       train : [loss = 0.031, top1 = 99.69%], valid : [loss = 1.452, top1 = 70.00%], test : [loss = 1.441, top1 = 70.00%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.558, top1 = 57.88%], valid : [loss = 2.369, top1 = 41.80%], test : [loss = 2.381, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.565, top1 = 80.22%], valid : [loss = 0.669, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13996/15625) 013996-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.632, top1 = 86.86%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.400, top1 = 91.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.95 ms.
cifar100       train : [loss = 0.269, top1 = 92.72%], valid : [loss = 1.525, top1 = 63.94%], test : [loss = 1.522, top1 = 64.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.44 ms.
ImageNet16-120 train : [loss = 2.133, top1 = 44.70%], valid : [loss = 2.491, top1 = 37.43%], test : [loss = 2.521, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 73.75%], valid : [loss = 0.804, top1 = 71.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13997/15625) 013997-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.514, top1 = 90.01%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.03 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.324, top1 = 93.11%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.06 ms.
cifar100       train : [loss = 0.084, top1 = 98.57%], valid : [loss = 1.372, top1 = 69.06%], test : [loss = 1.327, top1 = 69.44%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 1.722, top1 = 53.83%], valid : [loss = 2.253, top1 = 43.00%], test : [loss = 2.240, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.63%], valid : [loss = 0.681, top1 = 76.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13998/15625) 013998-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.46%], valid : [loss = 0.862, top1 = 72.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.88 ms.
cifar10        train : [loss = 0.558, top1 = 80.47%], test  : [loss = 0.720, top1 = 75.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.99 ms.
cifar100       train : [loss = 1.773, top1 = 52.20%], valid : [loss = 2.075, top1 = 46.66%], test : [loss = 2.073, top1 = 46.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.99%], valid : [loss = 3.619, top1 = 16.70%], test : [loss = 3.660, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (13999/15625) 013999-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.28 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.505, top1 = 89.30%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.25 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.304, top1 = 93.09%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.05 ms.
cifar100       train : [loss = 0.151, top1 = 96.82%], valid : [loss = 1.285, top1 = 69.42%], test : [loss = 1.301, top1 = 69.48%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.36 ms.
ImageNet16-120 train : [loss = 1.823, top1 = 51.69%], valid : [loss = 2.270, top1 = 41.47%], test : [loss = 2.274, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.48%], valid : [loss = 0.682, top1 = 76.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14000/15625) 014000-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.567, top1 = 87.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.388, top1 = 91.33%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.16 ms.
cifar100       train : [loss = 0.391, top1 = 88.92%], valid : [loss = 1.402, top1 = 65.13%], test : [loss = 1.388, top1 = 65.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.41 ms.
ImageNet16-120 train : [loss = 2.301, top1 = 40.99%], valid : [loss = 2.508, top1 = 37.11%], test : [loss = 2.533, top1 = 36.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14001/15625) 014001-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.510, top1 = 89.04%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.311, top1 = 92.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.02 ms.
cifar100       train : [loss = 0.258, top1 = 93.28%], valid : [loss = 1.206, top1 = 69.26%], test : [loss = 1.210, top1 = 69.08%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 1.854, top1 = 51.05%], valid : [loss = 2.217, top1 = 42.97%], test : [loss = 2.245, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.84%], valid : [loss = 0.793, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14002/15625) 014002-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.51 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.538, top1 = 88.76%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.58 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.342, top1 = 92.18%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.83 ms.
cifar100       train : [loss = 0.168, top1 = 96.18%], valid : [loss = 1.304, top1 = 69.00%], test : [loss = 1.270, top1 = 69.24%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=21.37 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.27%], valid : [loss = 2.295, top1 = 41.90%], test : [loss = 2.319, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.72%], valid : [loss = 0.848, top1 = 70.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14003/15625) 014003-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.528, top1 = 88.71%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.14 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.355, top1 = 91.82%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.64 ms.
cifar100       train : [loss = 0.201, top1 = 95.01%], valid : [loss = 1.318, top1 = 67.22%], test : [loss = 1.327, top1 = 67.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.04 ms.
ImageNet16-120 train : [loss = 2.157, top1 = 43.87%], valid : [loss = 2.445, top1 = 37.60%], test : [loss = 2.424, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 66.07%], valid : [loss = 0.972, top1 = 65.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14004/15625) 014004-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.187, top1 = 93.92%], valid : [loss = 0.944, top1 = 75.53%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.74 ms.
cifar10        train : [loss = 0.225, top1 = 92.27%], test  : [loss = 0.594, top1 = 82.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.62 ms.
cifar100       train : [loss = 1.143, top1 = 67.55%], valid : [loss = 1.798, top1 = 52.88%], test : [loss = 1.777, top1 = 54.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.71%], valid : [loss = 3.347, top1 = 20.67%], test : [loss = 3.385, top1 = 20.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14005/15625) 014005-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10-valid  train : [loss = 1.263, top1 = 54.56%], valid : [loss = 1.306, top1 = 53.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.73 ms.
cifar10        train : [loss = 1.218, top1 = 56.31%], test  : [loss = 1.224, top1 = 55.84%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.97 ms.
cifar100       train : [loss = 2.772, top1 = 30.84%], valid : [loss = 2.860, top1 = 29.35%], test : [loss = 2.842, top1 = 29.85%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.29 ms.
ImageNet16-120 train : [loss = 3.905, top1 = 11.83%], valid : [loss = 3.911, top1 = 12.64%], test : [loss = 3.919, top1 = 11.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.737, top1 = 34.36%], valid : [loss = 1.720, top1 = 35.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14006/15625) 014006-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.10 ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.38%], valid : [loss = 0.744, top1 = 74.69%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10        train : [loss = 0.565, top1 = 80.20%], test  : [loss = 0.639, top1 = 78.28%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.77 ms.
cifar100       train : [loss = 1.995, top1 = 45.77%], valid : [loss = 2.118, top1 = 43.93%], test : [loss = 2.118, top1 = 43.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.056, top1 = 25.38%], valid : [loss = 3.040, top1 = 26.19%], test : [loss = 3.074, top1 = 24.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.161, top1 = 57.76%], valid : [loss = 1.187, top1 = 57.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14007/15625) 014007-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.60%], valid : [loss = 0.589, top1 = 86.85%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.040, top1 = 98.80%], test  : [loss = 0.394, top1 = 90.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.24 ms.
cifar100       train : [loss = 0.555, top1 = 83.65%], valid : [loss = 1.410, top1 = 63.93%], test : [loss = 1.437, top1 = 63.63%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.48 ms.
ImageNet16-120 train : [loss = 2.486, top1 = 37.04%], valid : [loss = 2.620, top1 = 34.01%], test : [loss = 2.661, top1 = 33.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.98%], valid : [loss = 0.716, top1 = 75.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14008/15625) 014008-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.46%], valid : [loss = 0.854, top1 = 70.95%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10        train : [loss = 0.688, top1 = 75.89%], test  : [loss = 0.776, top1 = 73.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.29 ms.
cifar100       train : [loss = 1.941, top1 = 48.39%], valid : [loss = 2.120, top1 = 45.28%], test : [loss = 2.141, top1 = 44.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 3.657, top1 = 15.50%], valid : [loss = 3.675, top1 = 16.00%], test : [loss = 3.705, top1 = 14.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.382, top1 = 49.78%], valid : [loss = 1.408, top1 = 49.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14009/15625) 014009-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.555, top1 = 88.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.34 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.323, top1 = 92.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.65 ms.
cifar100       train : [loss = 0.289, top1 = 91.95%], valid : [loss = 1.335, top1 = 66.70%], test : [loss = 1.314, top1 = 66.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.33%], valid : [loss = 2.404, top1 = 39.27%], test : [loss = 2.451, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.835, top1 = 69.71%], valid : [loss = 0.871, top1 = 69.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14010/15625) 014010-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.26%], valid : [loss = 0.457, top1 = 86.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.76 ms.
cifar10        train : [loss = 0.107, top1 = 96.71%], test  : [loss = 0.320, top1 = 89.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.53 ms.
cifar100       train : [loss = 0.845, top1 = 75.89%], valid : [loss = 1.279, top1 = 64.14%], test : [loss = 1.291, top1 = 64.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.99 ms.
ImageNet16-120 train : [loss = 2.545, top1 = 35.81%], valid : [loss = 2.617, top1 = 34.87%], test : [loss = 2.645, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 80.04%], valid : [loss = 0.648, top1 = 77.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14011/15625) 014011-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.34%], valid : [loss = 0.776, top1 = 73.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.519, top1 = 81.92%], test  : [loss = 0.599, top1 = 79.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.12 ms.
cifar100       train : [loss = 1.965, top1 = 46.55%], valid : [loss = 2.092, top1 = 44.02%], test : [loss = 2.095, top1 = 44.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.52 ms.
ImageNet16-120 train : [loss = 3.009, top1 = 26.44%], valid : [loss = 2.989, top1 = 27.52%], test : [loss = 3.030, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.17%], valid : [loss = 1.218, top1 = 56.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14012/15625) 014012-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.571, top1 = 87.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.375, top1 = 91.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 0.398, top1 = 88.76%], valid : [loss = 1.381, top1 = 65.74%], test : [loss = 1.390, top1 = 65.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.90 ms.
ImageNet16-120 train : [loss = 2.293, top1 = 41.03%], valid : [loss = 2.504, top1 = 37.13%], test : [loss = 2.525, top1 = 36.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14013/15625) 014013-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.32%], valid : [loss = 0.614, top1 = 84.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.55 ms.
cifar10        train : [loss = 0.086, top1 = 97.20%], test  : [loss = 0.411, top1 = 88.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.03 ms.
cifar100       train : [loss = 0.681, top1 = 79.99%], valid : [loss = 1.498, top1 = 61.30%], test : [loss = 1.518, top1 = 61.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 3.162, top1 = 22.89%], valid : [loss = 3.172, top1 = 22.53%], test : [loss = 3.203, top1 = 22.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.053, top1 = 61.96%], valid : [loss = 1.085, top1 = 61.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14014/15625) 014014-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.531, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.346, top1 = 91.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.301, top1 = 91.99%], valid : [loss = 1.268, top1 = 67.94%], test : [loss = 1.308, top1 = 67.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.96 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.60%], valid : [loss = 2.426, top1 = 37.73%], test : [loss = 2.435, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.82%], valid : [loss = 0.894, top1 = 68.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14015/15625) 014015-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.33 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.25 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14016/15625) 014016-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=26.66 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.523, top1 = 89.72%]
cifar10        FLOP=125.75 M, Params=0.886 MB, latency=22.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.291, top1 = 93.66%]
cifar100       FLOP=125.75 M, Params=0.892 MB, latency=24.19 ms.
cifar100       train : [loss = 0.074, top1 = 98.87%], valid : [loss = 1.361, top1 = 69.72%], test : [loss = 1.347, top1 = 68.92%]
ImageNet16-120 FLOP= 31.44 M, Params=0.894 MB, latency=22.40 ms.
ImageNet16-120 train : [loss = 1.630, top1 = 56.25%], valid : [loss = 2.201, top1 = 43.53%], test : [loss = 2.159, top1 = 45.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=125.75 M, Params=0.886 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.14%], valid : [loss = 0.703, top1 = 75.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14017/15625) 014017-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.68 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.79 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.64 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.48 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14018/15625) 014018-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.91 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.54 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14019/15625) 014019-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.49 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.536, top1 = 89.39%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.12 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.330, top1 = 93.02%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.47 ms.
cifar100       train : [loss = 0.065, top1 = 98.96%], valid : [loss = 1.370, top1 = 69.24%], test : [loss = 1.358, top1 = 69.66%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.19 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.68%], valid : [loss = 2.275, top1 = 42.23%], test : [loss = 2.296, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.67%], valid : [loss = 0.818, top1 = 71.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14020/15625) 014020-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.73%], valid : [loss = 0.466, top1 = 86.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.21 ms.
cifar10        train : [loss = 0.156, top1 = 94.88%], test  : [loss = 0.349, top1 = 88.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.02 ms.
cifar100       train : [loss = 0.993, top1 = 71.92%], valid : [loss = 1.377, top1 = 62.26%], test : [loss = 1.347, top1 = 61.66%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.10%], valid : [loss = 2.680, top1 = 33.80%], test : [loss = 2.727, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.769, top1 = 72.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14021/15625) 014021-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.99%], valid : [loss = 0.614, top1 = 85.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.081, top1 = 97.42%], test  : [loss = 0.407, top1 = 88.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.10 ms.
cifar100       train : [loss = 0.783, top1 = 77.00%], valid : [loss = 1.420, top1 = 62.52%], test : [loss = 1.391, top1 = 62.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.96%], valid : [loss = 2.765, top1 = 31.30%], test : [loss = 2.746, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14022/15625) 014022-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.518, top1 = 88.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.81 ms.
cifar10        train : [loss = 0.023, top1 = 99.42%], test  : [loss = 0.360, top1 = 90.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.40 ms.
cifar100       train : [loss = 0.428, top1 = 87.60%], valid : [loss = 1.369, top1 = 66.18%], test : [loss = 1.361, top1 = 65.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.281, top1 = 41.43%], valid : [loss = 2.506, top1 = 36.70%], test : [loss = 2.549, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.02%], valid : [loss = 0.752, top1 = 73.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14023/15625) 014023-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.95 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.92%], valid : [loss = 0.531, top1 = 83.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.15 ms.
cifar10        train : [loss = 0.278, top1 = 90.37%], test  : [loss = 0.420, top1 = 85.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 1.382, top1 = 61.13%], valid : [loss = 1.634, top1 = 55.24%], test : [loss = 1.623, top1 = 55.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.893, top1 = 29.06%], valid : [loss = 2.899, top1 = 28.93%], test : [loss = 2.954, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 66.03%], valid : [loss = 0.996, top1 = 65.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14024/15625) 014024-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.624, top1 = 86.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.95 ms.
cifar10        train : [loss = 0.034, top1 = 99.04%], test  : [loss = 0.386, top1 = 90.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 0.557, top1 = 83.64%], valid : [loss = 1.425, top1 = 63.54%], test : [loss = 1.429, top1 = 63.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.91%], valid : [loss = 2.580, top1 = 35.01%], test : [loss = 2.610, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.18%], valid : [loss = 0.870, top1 = 69.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14025/15625) 014025-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.19%], valid : [loss = 0.829, top1 = 80.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10        train : [loss = 0.135, top1 = 95.51%], test  : [loss = 0.538, top1 = 85.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.17 ms.
cifar100       train : [loss = 0.858, top1 = 75.00%], valid : [loss = 1.704, top1 = 57.08%], test : [loss = 1.669, top1 = 57.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 3.025, top1 = 26.61%], valid : [loss = 3.169, top1 = 23.93%], test : [loss = 3.209, top1 = 23.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.052, top1 = 61.73%], valid : [loss = 1.121, top1 = 59.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14026/15625) 014026-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.60 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.472, top1 = 89.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.302, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.22 ms.
cifar100       train : [loss = 0.255, top1 = 93.36%], valid : [loss = 1.266, top1 = 68.10%], test : [loss = 1.230, top1 = 68.92%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.73 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.96%], valid : [loss = 2.243, top1 = 41.73%], test : [loss = 2.224, top1 = 43.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.70%], valid : [loss = 0.618, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14027/15625) 014027-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.40%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10        train : [loss = 0.014, top1 = 99.75%], test  : [loss = 0.306, top1 = 91.88%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.50 ms.
cifar100       train : [loss = 0.330, top1 = 91.13%], valid : [loss = 1.307, top1 = 67.32%], test : [loss = 1.320, top1 = 67.28%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.047, top1 = 46.52%], valid : [loss = 2.351, top1 = 40.97%], test : [loss = 2.372, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.442, top1 = 84.53%], valid : [loss = 0.547, top1 = 81.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14028/15625) 014028-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.818, top1 = 71.46%], valid : [loss = 1.127, top1 = 62.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.61 ms.
cifar10        train : [loss = 0.797, top1 = 72.08%], test  : [loss = 0.920, top1 = 68.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.61 ms.
cifar100       train : [loss = 2.164, top1 = 43.41%], valid : [loss = 2.432, top1 = 39.24%], test : [loss = 2.428, top1 = 39.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 3.776, top1 = 13.66%], valid : [loss = 3.830, top1 = 13.73%], test : [loss = 3.830, top1 = 13.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.363, top1 = 50.26%], valid : [loss = 1.417, top1 = 48.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14029/15625) 014029-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=23.45 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.474, top1 = 90.43%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=24.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.321, top1 = 93.57%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=24.20 ms.
cifar100       train : [loss = 0.045, top1 = 99.44%], valid : [loss = 1.271, top1 = 71.52%], test : [loss = 1.269, top1 = 70.40%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=27.34 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.55%], valid : [loss = 2.179, top1 = 44.30%], test : [loss = 2.181, top1 = 45.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.66%], valid : [loss = 0.655, top1 = 77.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14030/15625) 014030-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.28 ms.
cifar10-valid  train : [loss = 0.944, top1 = 66.64%], valid : [loss = 1.219, top1 = 58.49%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=11.15 ms.
cifar10        train : [loss = 0.949, top1 = 66.24%], test  : [loss = 1.062, top1 = 63.16%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=11.33 ms.
cifar100       train : [loss = 2.378, top1 = 38.53%], valid : [loss = 2.629, top1 = 34.40%], test : [loss = 2.654, top1 = 34.76%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 3.856, top1 = 12.49%], valid : [loss = 3.909, top1 = 12.40%], test : [loss = 3.917, top1 = 11.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.88%], valid : [loss = 1.504, top1 = 45.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14031/15625) 014031-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.556, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.17 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.339, top1 = 92.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.90 ms.
cifar100       train : [loss = 0.123, top1 = 97.61%], valid : [loss = 1.442, top1 = 67.52%], test : [loss = 1.417, top1 = 68.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.18 ms.
ImageNet16-120 train : [loss = 1.931, top1 = 49.16%], valid : [loss = 2.402, top1 = 39.83%], test : [loss = 2.463, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 77.07%], valid : [loss = 0.752, top1 = 74.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14032/15625) 014032-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.86 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.15%], valid : [loss = 0.460, top1 = 86.22%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.10 ms.
cifar10        train : [loss = 0.168, top1 = 94.41%], test  : [loss = 0.350, top1 = 88.79%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.43 ms.
cifar100       train : [loss = 1.003, top1 = 71.43%], valid : [loss = 1.346, top1 = 62.32%], test : [loss = 1.339, top1 = 62.84%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.23%], valid : [loss = 2.676, top1 = 32.80%], test : [loss = 2.696, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 74.90%], valid : [loss = 0.754, top1 = 73.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14033/15625) 014033-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.64 ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.62%], valid : [loss = 0.644, top1 = 78.50%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10        train : [loss = 0.509, top1 = 82.36%], test  : [loss = 0.590, top1 = 79.92%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.45 ms.
cifar100       train : [loss = 1.672, top1 = 54.55%], valid : [loss = 1.842, top1 = 51.07%], test : [loss = 1.855, top1 = 50.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.62 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.30%], valid : [loss = 3.300, top1 = 22.03%], test : [loss = 3.350, top1 = 21.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14034/15625) 014034-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.73 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.71%], valid : [loss = 0.859, top1 = 71.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10        train : [loss = 0.549, top1 = 80.89%], test  : [loss = 0.713, top1 = 75.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.62 ms.
cifar100       train : [loss = 1.785, top1 = 51.87%], valid : [loss = 2.042, top1 = 46.92%], test : [loss = 2.061, top1 = 46.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 3.578, top1 = 16.97%], valid : [loss = 3.622, top1 = 16.33%], test : [loss = 3.671, top1 = 15.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14035/15625) 014035-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.86 ms.
cifar10-valid  train : [loss = 0.259, top1 = 90.90%], valid : [loss = 0.821, top1 = 76.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.96 ms.
cifar10        train : [loss = 0.290, top1 = 89.91%], test  : [loss = 0.636, top1 = 80.27%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.19 ms.
cifar100       train : [loss = 1.298, top1 = 63.32%], valid : [loss = 1.858, top1 = 51.54%], test : [loss = 1.869, top1 = 51.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 3.495, top1 = 17.30%], valid : [loss = 3.526, top1 = 17.33%], test : [loss = 3.520, top1 = 16.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14036/15625) 014036-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.194, top1 = 93.56%], valid : [loss = 0.505, top1 = 84.73%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10        train : [loss = 0.212, top1 = 92.80%], test  : [loss = 0.378, top1 = 88.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 1.168, top1 = 66.62%], valid : [loss = 1.466, top1 = 59.32%], test : [loss = 1.462, top1 = 59.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.93%], valid : [loss = 2.761, top1 = 31.77%], test : [loss = 2.814, top1 = 30.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.20%], valid : [loss = 0.900, top1 = 67.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14037/15625) 014037-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.39%], valid : [loss = 0.632, top1 = 86.21%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.81 ms.
cifar10        train : [loss = 0.036, top1 = 98.89%], test  : [loss = 0.412, top1 = 89.91%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.87 ms.
cifar100       train : [loss = 0.218, top1 = 94.19%], valid : [loss = 1.510, top1 = 65.52%], test : [loss = 1.549, top1 = 65.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 2.902, top1 = 28.09%], valid : [loss = 2.960, top1 = 26.67%], test : [loss = 2.993, top1 = 25.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.015, top1 = 62.80%], valid : [loss = 1.042, top1 = 62.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14038/15625) 014038-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.82 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.65%], valid : [loss = 0.867, top1 = 71.54%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.58 ms.
cifar10        train : [loss = 0.554, top1 = 80.71%], test  : [loss = 0.722, top1 = 75.40%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.36 ms.
cifar100       train : [loss = 1.783, top1 = 52.06%], valid : [loss = 2.049, top1 = 46.89%], test : [loss = 2.073, top1 = 46.48%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.00 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.69%], valid : [loss = 3.639, top1 = 16.73%], test : [loss = 3.675, top1 = 15.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14039/15625) 014039-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.82%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10        train : [loss = 0.004, top1 = 99.90%], test  : [loss = 0.327, top1 = 92.87%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.51 ms.
cifar100       train : [loss = 0.076, top1 = 98.77%], valid : [loss = 1.343, top1 = 69.90%], test : [loss = 1.323, top1 = 70.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.41 ms.
ImageNet16-120 train : [loss = 1.654, top1 = 55.60%], valid : [loss = 2.182, top1 = 43.83%], test : [loss = 2.115, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.09%], valid : [loss = 0.703, top1 = 75.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14040/15625) 014040-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.56 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.324, top1 = 92.64%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.97 ms.
cifar100       train : [loss = 0.151, top1 = 96.81%], valid : [loss = 1.286, top1 = 69.31%], test : [loss = 1.306, top1 = 68.86%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.79%], valid : [loss = 2.320, top1 = 41.03%], test : [loss = 2.312, top1 = 41.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.75%], valid : [loss = 0.704, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14041/15625) 014041-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.477, top1 = 89.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.327, top1 = 92.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 0.331, top1 = 90.77%], valid : [loss = 1.322, top1 = 67.39%], test : [loss = 1.300, top1 = 67.21%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.073, top1 = 45.98%], valid : [loss = 2.315, top1 = 40.93%], test : [loss = 2.398, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.71%], valid : [loss = 0.606, top1 = 79.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14042/15625) 014042-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.544, top1 = 88.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.344, top1 = 91.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 0.300, top1 = 91.84%], valid : [loss = 1.306, top1 = 66.80%], test : [loss = 1.306, top1 = 67.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.94%], valid : [loss = 2.429, top1 = 38.48%], test : [loss = 2.445, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14043/15625) 014043-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.24%], valid : [loss = 0.728, top1 = 81.21%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10        train : [loss = 0.148, top1 = 95.01%], test  : [loss = 0.466, top1 = 86.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.96 ms.
cifar100       train : [loss = 0.955, top1 = 72.26%], valid : [loss = 1.628, top1 = 57.23%], test : [loss = 1.614, top1 = 57.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 3.061, top1 = 25.16%], valid : [loss = 3.130, top1 = 24.48%], test : [loss = 3.179, top1 = 23.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.15%], valid : [loss = 1.050, top1 = 62.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14044/15625) 014044-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.50%], valid : [loss = 0.589, top1 = 86.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.044, top1 = 98.67%], test  : [loss = 0.401, top1 = 89.91%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.573, top1 = 83.08%], valid : [loss = 1.403, top1 = 64.05%], test : [loss = 1.390, top1 = 64.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.69%], valid : [loss = 2.632, top1 = 33.83%], test : [loss = 2.669, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.41%], valid : [loss = 0.703, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14045/15625) 014045-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.31 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.73%], valid : [loss = 0.567, top1 = 88.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.05 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.382, top1 = 91.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.68 ms.
cifar100       train : [loss = 0.231, top1 = 93.92%], valid : [loss = 1.318, top1 = 67.83%], test : [loss = 1.349, top1 = 68.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.82 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.62%], valid : [loss = 2.474, top1 = 37.62%], test : [loss = 2.482, top1 = 37.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.38%], valid : [loss = 0.953, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14046/15625) 014046-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.525, top1 = 89.49%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.327, top1 = 93.19%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.14 ms.
cifar100       train : [loss = 0.073, top1 = 98.88%], valid : [loss = 1.343, top1 = 69.84%], test : [loss = 1.343, top1 = 69.96%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.87 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 44.96%], valid : [loss = 2.401, top1 = 38.69%], test : [loss = 2.401, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.898, top1 = 67.90%], valid : [loss = 0.927, top1 = 67.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14047/15625) 014047-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.822, top1 = 70.73%], valid : [loss = 0.913, top1 = 68.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10        train : [loss = 0.738, top1 = 74.02%], test  : [loss = 0.786, top1 = 72.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.09 ms.
cifar100       train : [loss = 2.310, top1 = 39.45%], valid : [loss = 2.427, top1 = 37.17%], test : [loss = 2.418, top1 = 37.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.83 ms.
ImageNet16-120 train : [loss = 3.553, top1 = 17.08%], valid : [loss = 3.545, top1 = 17.59%], test : [loss = 3.565, top1 = 16.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.453, top1 = 46.67%], valid : [loss = 1.503, top1 = 44.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14048/15625) 014048-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.660, top1 = 86.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.019, top1 = 99.51%], test  : [loss = 0.429, top1 = 90.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.327, top1 = 91.12%], valid : [loss = 1.579, top1 = 62.81%], test : [loss = 1.578, top1 = 62.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.209, top1 = 42.83%], valid : [loss = 2.535, top1 = 36.82%], test : [loss = 2.574, top1 = 36.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 72.10%], valid : [loss = 0.848, top1 = 70.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14049/15625) 014049-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.45%], valid : [loss = 0.603, top1 = 87.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10        train : [loss = 0.025, top1 = 99.23%], test  : [loss = 0.386, top1 = 90.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.63 ms.
cifar100       train : [loss = 0.354, top1 = 90.05%], valid : [loss = 1.448, top1 = 64.38%], test : [loss = 1.451, top1 = 64.39%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 29.58%], valid : [loss = 2.883, top1 = 27.99%], test : [loss = 2.891, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14050/15625) 014050-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.506, top1 = 88.83%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.13 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.318, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.95 ms.
cifar100       train : [loss = 0.331, top1 = 91.03%], valid : [loss = 1.279, top1 = 66.66%], test : [loss = 1.279, top1 = 67.36%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.03%], valid : [loss = 2.417, top1 = 38.90%], test : [loss = 2.409, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14051/15625) 014051-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.513, top1 = 88.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.342, top1 = 91.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.73 ms.
cifar100       train : [loss = 0.336, top1 = 90.81%], valid : [loss = 1.269, top1 = 67.15%], test : [loss = 1.271, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.66%], valid : [loss = 2.409, top1 = 39.48%], test : [loss = 2.401, top1 = 38.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.90%], valid : [loss = 0.695, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14052/15625) 014052-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.10%], valid : [loss = 0.462, top1 = 86.02%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.28 ms.
cifar10        train : [loss = 0.166, top1 = 94.57%], test  : [loss = 0.346, top1 = 88.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.13 ms.
cifar100       train : [loss = 1.004, top1 = 71.55%], valid : [loss = 1.365, top1 = 61.76%], test : [loss = 1.357, top1 = 62.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.37%], valid : [loss = 2.704, top1 = 32.16%], test : [loss = 2.733, top1 = 32.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.48%], valid : [loss = 0.731, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14053/15625) 014053-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.580, top1 = 87.95%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.85 ms.
cifar10        train : [loss = 0.020, top1 = 99.41%], test  : [loss = 0.388, top1 = 91.08%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.48 ms.
cifar100       train : [loss = 0.265, top1 = 92.91%], valid : [loss = 1.357, top1 = 66.80%], test : [loss = 1.370, top1 = 66.63%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.48 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.85%], valid : [loss = 2.401, top1 = 38.86%], test : [loss = 2.413, top1 = 39.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 69.30%], valid : [loss = 0.900, top1 = 68.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14054/15625) 014054-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.470, top1 = 88.98%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.313, top1 = 92.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.05 ms.
cifar100       train : [loss = 0.324, top1 = 91.39%], valid : [loss = 1.254, top1 = 67.50%], test : [loss = 1.243, top1 = 68.41%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.61%], valid : [loss = 2.302, top1 = 40.68%], test : [loss = 2.329, top1 = 40.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.19%], valid : [loss = 0.596, top1 = 79.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14055/15625) 014055-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.511, top1 = 89.32%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.307, top1 = 92.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.43 ms.
cifar100       train : [loss = 0.120, top1 = 97.75%], valid : [loss = 1.289, top1 = 69.41%], test : [loss = 1.299, top1 = 69.38%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.71%], valid : [loss = 2.287, top1 = 41.76%], test : [loss = 2.288, top1 = 42.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.68%], valid : [loss = 0.813, top1 = 71.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14056/15625) 014056-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.88%], valid : [loss = 0.487, top1 = 84.06%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.302, top1 = 89.89%], test  : [loss = 0.406, top1 = 86.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.24 ms.
cifar100       train : [loss = 1.327, top1 = 63.16%], valid : [loss = 1.528, top1 = 58.21%], test : [loss = 1.502, top1 = 58.37%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.58%], valid : [loss = 2.901, top1 = 29.58%], test : [loss = 2.955, top1 = 28.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.84%], valid : [loss = 0.749, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14057/15625) 014057-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.44%], valid : [loss = 0.854, top1 = 71.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10        train : [loss = 0.552, top1 = 80.73%], test  : [loss = 0.722, top1 = 75.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.05 ms.
cifar100       train : [loss = 1.772, top1 = 52.29%], valid : [loss = 2.054, top1 = 47.05%], test : [loss = 2.070, top1 = 46.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.50 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.92%], valid : [loss = 3.638, top1 = 16.34%], test : [loss = 3.660, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14058/15625) 014058-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.467, top1 = 89.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.72 ms.
cifar100       train : [loss = 0.323, top1 = 91.26%], valid : [loss = 1.244, top1 = 68.00%], test : [loss = 1.247, top1 = 67.97%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.80%], valid : [loss = 2.303, top1 = 40.24%], test : [loss = 2.335, top1 = 40.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.29%], valid : [loss = 0.617, top1 = 78.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14059/15625) 014059-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.27 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.566, top1 = 87.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.033, top1 = 99.01%], test  : [loss = 0.379, top1 = 90.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.09 ms.
cifar100       train : [loss = 0.544, top1 = 84.20%], valid : [loss = 1.366, top1 = 64.56%], test : [loss = 1.350, top1 = 63.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.49 ms.
ImageNet16-120 train : [loss = 2.574, top1 = 34.56%], valid : [loss = 2.654, top1 = 32.77%], test : [loss = 2.688, top1 = 32.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14060/15625) 014060-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.04%], valid : [loss = 0.623, top1 = 79.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.366, top1 = 87.39%], test  : [loss = 0.505, top1 = 83.01%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.74 ms.
cifar100       train : [loss = 1.628, top1 = 54.83%], valid : [loss = 1.828, top1 = 50.63%], test : [loss = 1.830, top1 = 50.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.42 ms.
ImageNet16-120 train : [loss = 3.201, top1 = 22.95%], valid : [loss = 3.211, top1 = 23.52%], test : [loss = 3.239, top1 = 22.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.069, top1 = 61.31%], valid : [loss = 1.107, top1 = 60.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14061/15625) 014061-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.88%], valid : [loss = 0.566, top1 = 85.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10        train : [loss = 0.065, top1 = 98.08%], test  : [loss = 0.373, top1 = 89.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.32 ms.
cifar100       train : [loss = 0.615, top1 = 82.11%], valid : [loss = 1.372, top1 = 64.26%], test : [loss = 1.348, top1 = 64.45%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.20%], valid : [loss = 2.508, top1 = 36.48%], test : [loss = 2.520, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.25%], valid : [loss = 0.859, top1 = 69.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14062/15625) 014062-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.626, top1 = 87.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.07 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.419, top1 = 90.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.39 ms.
cifar100       train : [loss = 0.150, top1 = 96.84%], valid : [loss = 1.563, top1 = 64.90%], test : [loss = 1.563, top1 = 65.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.076, top1 = 45.91%], valid : [loss = 2.540, top1 = 36.99%], test : [loss = 2.531, top1 = 37.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.23%], valid : [loss = 0.733, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14063/15625) 014063-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.11%], valid : [loss = 0.559, top1 = 85.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.111, top1 = 96.20%], test  : [loss = 0.369, top1 = 89.10%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.10 ms.
cifar100       train : [loss = 0.813, top1 = 75.94%], valid : [loss = 1.413, top1 = 61.79%], test : [loss = 1.400, top1 = 61.83%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.07 ms.
ImageNet16-120 train : [loss = 2.516, top1 = 36.04%], valid : [loss = 2.643, top1 = 33.26%], test : [loss = 2.648, top1 = 33.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.933, top1 = 66.52%], valid : [loss = 0.950, top1 = 66.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14064/15625) 014064-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.548, top1 = 89.03%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.30 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.355, top1 = 92.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.97 ms.
cifar100       train : [loss = 0.071, top1 = 98.95%], valid : [loss = 1.479, top1 = 68.57%], test : [loss = 1.454, top1 = 68.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 1.788, top1 = 52.55%], valid : [loss = 2.390, top1 = 40.84%], test : [loss = 2.389, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.50%], valid : [loss = 0.727, top1 = 75.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14065/15625) 014065-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.580, top1 = 87.24%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.388, top1 = 91.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.50 ms.
cifar100       train : [loss = 0.402, top1 = 88.59%], valid : [loss = 1.369, top1 = 65.61%], test : [loss = 1.392, top1 = 65.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.22%], valid : [loss = 2.499, top1 = 36.33%], test : [loss = 2.527, top1 = 36.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.24%], valid : [loss = 0.787, top1 = 72.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14066/15625) 014066-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.61 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.479, top1 = 89.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.83 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.317, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.55 ms.
cifar100       train : [loss = 0.247, top1 = 93.72%], valid : [loss = 1.232, top1 = 68.51%], test : [loss = 1.268, top1 = 68.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 1.898, top1 = 49.86%], valid : [loss = 2.238, top1 = 42.10%], test : [loss = 2.240, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.76%], valid : [loss = 0.614, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14067/15625) 014067-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.36 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.512, top1 = 88.77%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.328, top1 = 92.16%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.03 ms.
cifar100       train : [loss = 0.317, top1 = 91.32%], valid : [loss = 1.269, top1 = 67.31%], test : [loss = 1.286, top1 = 67.43%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.63%], valid : [loss = 2.327, top1 = 40.20%], test : [loss = 2.337, top1 = 40.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.08%], valid : [loss = 0.739, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14068/15625) 014068-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 0.528, top1 = 81.70%], valid : [loss = 0.852, top1 = 71.99%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10        train : [loss = 0.553, top1 = 80.60%], test  : [loss = 0.718, top1 = 75.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 1.774, top1 = 52.17%], valid : [loss = 2.058, top1 = 46.90%], test : [loss = 2.059, top1 = 46.89%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.46 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.87%], valid : [loss = 3.619, top1 = 16.99%], test : [loss = 3.669, top1 = 15.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14069/15625) 014069-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.525, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.05 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.44%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.36 ms.
cifar100       train : [loss = 0.210, top1 = 94.90%], valid : [loss = 1.232, top1 = 68.87%], test : [loss = 1.251, top1 = 68.97%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.14 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.50%], valid : [loss = 2.199, top1 = 43.40%], test : [loss = 2.233, top1 = 43.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 76.22%], valid : [loss = 0.747, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14070/15625) 014070-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.65%], valid : [loss = 0.623, top1 = 84.66%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.31 ms.
cifar10        train : [loss = 0.087, top1 = 97.20%], test  : [loss = 0.414, top1 = 88.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.62 ms.
cifar100       train : [loss = 0.775, top1 = 77.36%], valid : [loss = 1.428, top1 = 62.26%], test : [loss = 1.401, top1 = 62.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.05%], valid : [loss = 2.752, top1 = 31.63%], test : [loss = 2.757, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.42%], valid : [loss = 0.844, top1 = 70.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14071/15625) 014071-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.498, top1 = 88.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.307, top1 = 92.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.15 ms.
cifar100       train : [loss = 0.319, top1 = 91.44%], valid : [loss = 1.252, top1 = 67.44%], test : [loss = 1.241, top1 = 68.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.041, top1 = 46.53%], valid : [loss = 2.321, top1 = 40.82%], test : [loss = 2.332, top1 = 40.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14072/15625) 014072-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.90 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.30%], valid : [loss = 0.616, top1 = 85.38%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10        train : [loss = 0.070, top1 = 97.89%], test  : [loss = 0.400, top1 = 88.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 0.715, top1 = 79.06%], valid : [loss = 1.389, top1 = 63.26%], test : [loss = 1.350, top1 = 64.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.96 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.09%], valid : [loss = 2.642, top1 = 34.31%], test : [loss = 2.687, top1 = 33.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 74.08%], valid : [loss = 0.795, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14073/15625) 014073-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.571, top1 = 87.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.98 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.382, top1 = 91.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.88 ms.
cifar100       train : [loss = 0.387, top1 = 89.04%], valid : [loss = 1.382, top1 = 65.53%], test : [loss = 1.410, top1 = 64.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.29%], valid : [loss = 2.515, top1 = 36.53%], test : [loss = 2.514, top1 = 37.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.97%], valid : [loss = 0.772, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14074/15625) 014074-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.52 ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.64%], valid : [loss = 0.932, top1 = 67.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.751, top1 = 73.56%], test  : [loss = 0.804, top1 = 71.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.40 ms.
cifar100       train : [loss = 2.318, top1 = 39.27%], valid : [loss = 2.441, top1 = 37.31%], test : [loss = 2.415, top1 = 37.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.75 ms.
ImageNet16-120 train : [loss = 3.562, top1 = 16.99%], valid : [loss = 3.549, top1 = 17.42%], test : [loss = 3.572, top1 = 16.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.451, top1 = 46.83%], valid : [loss = 1.500, top1 = 45.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14075/15625) 014075-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.74 ms.
cifar10-valid  train : [loss = 0.297, top1 = 89.92%], valid : [loss = 0.533, top1 = 82.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.52 ms.
cifar10        train : [loss = 0.259, top1 = 91.24%], test  : [loss = 0.424, top1 = 86.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.69 ms.
cifar100       train : [loss = 1.490, top1 = 58.70%], valid : [loss = 1.716, top1 = 53.47%], test : [loss = 1.705, top1 = 54.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.29 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 28.08%], valid : [loss = 2.957, top1 = 27.76%], test : [loss = 3.011, top1 = 26.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.33%], valid : [loss = 1.068, top1 = 61.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14076/15625) 014076-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.507, top1 = 88.80%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.64 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.328, top1 = 92.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.39 ms.
cifar100       train : [loss = 0.326, top1 = 91.17%], valid : [loss = 1.296, top1 = 67.06%], test : [loss = 1.296, top1 = 67.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 44.97%], valid : [loss = 2.406, top1 = 38.72%], test : [loss = 2.420, top1 = 38.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14077/15625) 014077-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.582, top1 = 86.99%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.63 ms.
cifar10        train : [loss = 0.039, top1 = 98.81%], test  : [loss = 0.387, top1 = 90.32%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.36 ms.
cifar100       train : [loss = 0.566, top1 = 83.32%], valid : [loss = 1.403, top1 = 63.99%], test : [loss = 1.393, top1 = 64.51%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.30 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.16%], valid : [loss = 2.603, top1 = 34.24%], test : [loss = 2.662, top1 = 34.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.577, top1 = 79.90%], valid : [loss = 0.653, top1 = 77.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14078/15625) 014078-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.473, top1 = 89.10%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.05 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.312, top1 = 92.16%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.74 ms.
cifar100       train : [loss = 0.241, top1 = 94.06%], valid : [loss = 1.265, top1 = 68.48%], test : [loss = 1.242, top1 = 68.84%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.75%], valid : [loss = 2.265, top1 = 41.78%], test : [loss = 2.273, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.519, top1 = 81.92%], valid : [loss = 0.615, top1 = 79.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14079/15625) 014079-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.18%], valid : [loss = 0.589, top1 = 85.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.066, top1 = 97.92%], test  : [loss = 0.407, top1 = 89.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.44 ms.
cifar100       train : [loss = 0.535, top1 = 84.25%], valid : [loss = 1.496, top1 = 62.51%], test : [loss = 1.501, top1 = 62.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 3.103, top1 = 23.75%], valid : [loss = 3.127, top1 = 23.36%], test : [loss = 3.158, top1 = 22.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.150, top1 = 58.14%], valid : [loss = 1.160, top1 = 57.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14080/15625) 014080-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.15%], valid : [loss = 0.450, top1 = 86.99%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.91 ms.
cifar10        train : [loss = 0.115, top1 = 96.46%], test  : [loss = 0.334, top1 = 89.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 0.860, top1 = 75.52%], valid : [loss = 1.301, top1 = 63.71%], test : [loss = 1.281, top1 = 64.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.69%], valid : [loss = 2.621, top1 = 34.57%], test : [loss = 2.634, top1 = 34.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.30%], valid : [loss = 0.658, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14081/15625) 014081-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.468, top1 = 89.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.320, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.42 ms.
cifar100       train : [loss = 0.279, top1 = 92.53%], valid : [loss = 1.334, top1 = 67.22%], test : [loss = 1.339, top1 = 67.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.002, top1 = 47.49%], valid : [loss = 2.357, top1 = 40.44%], test : [loss = 2.377, top1 = 40.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.518, top1 = 82.10%], valid : [loss = 0.610, top1 = 79.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14082/15625) 014082-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.458, top1 = 89.26%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.87 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.324, top1 = 91.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.331, top1 = 91.04%], valid : [loss = 1.307, top1 = 67.16%], test : [loss = 1.311, top1 = 67.31%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.75 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.23%], valid : [loss = 2.365, top1 = 40.09%], test : [loss = 2.403, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.62%], valid : [loss = 0.521, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14083/15625) 014083-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.461, top1 = 89.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.01 ms.
cifar100       train : [loss = 0.316, top1 = 91.54%], valid : [loss = 1.312, top1 = 67.28%], test : [loss = 1.297, top1 = 67.67%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.29%], valid : [loss = 2.369, top1 = 40.09%], test : [loss = 2.382, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.96%], valid : [loss = 0.553, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14084/15625) 014084-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.531, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.330, top1 = 92.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.68 ms.
cifar100       train : [loss = 0.231, top1 = 93.98%], valid : [loss = 1.256, top1 = 68.91%], test : [loss = 1.269, top1 = 68.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.27 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.88%], valid : [loss = 2.224, top1 = 42.87%], test : [loss = 2.243, top1 = 42.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.65%], valid : [loss = 0.665, top1 = 77.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14085/15625) 014085-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.570, top1 = 87.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.46 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.376, top1 = 91.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.13 ms.
cifar100       train : [loss = 0.328, top1 = 90.92%], valid : [loss = 1.411, top1 = 65.52%], test : [loss = 1.411, top1 = 65.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.186, top1 = 43.44%], valid : [loss = 2.445, top1 = 38.38%], test : [loss = 2.464, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.06%], valid : [loss = 0.797, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14086/15625) 014086-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.495, top1 = 89.03%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.62 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.313, top1 = 92.41%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.32 ms.
cifar100       train : [loss = 0.238, top1 = 94.15%], valid : [loss = 1.239, top1 = 68.87%], test : [loss = 1.265, top1 = 67.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.31%], valid : [loss = 2.278, top1 = 42.01%], test : [loss = 2.288, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.49%], valid : [loss = 0.645, top1 = 77.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14087/15625) 014087-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.534, top1 = 89.33%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.10 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.376, top1 = 92.67%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.21 ms.
cifar100       train : [loss = 0.079, top1 = 98.74%], valid : [loss = 1.419, top1 = 68.95%], test : [loss = 1.417, top1 = 68.71%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.47 ms.
ImageNet16-120 train : [loss = 1.761, top1 = 53.13%], valid : [loss = 2.358, top1 = 40.67%], test : [loss = 2.375, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.08%], valid : [loss = 0.677, top1 = 76.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14088/15625) 014088-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.582, top1 = 87.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.07 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.396, top1 = 91.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.14 ms.
cifar100       train : [loss = 0.204, top1 = 95.28%], valid : [loss = 1.456, top1 = 65.97%], test : [loss = 1.451, top1 = 66.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.94%], valid : [loss = 2.452, top1 = 38.60%], test : [loss = 2.456, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.68%], valid : [loss = 0.711, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14089/15625) 014089-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.44%], valid : [loss = 0.454, top1 = 86.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.157, top1 = 94.83%], test  : [loss = 0.346, top1 = 88.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.79 ms.
cifar100       train : [loss = 1.015, top1 = 71.10%], valid : [loss = 1.375, top1 = 61.82%], test : [loss = 1.370, top1 = 61.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.58%], valid : [loss = 2.705, top1 = 32.06%], test : [loss = 2.717, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14090/15625) 014090-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.44%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.334, top1 = 92.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.39 ms.
cifar100       train : [loss = 0.336, top1 = 90.90%], valid : [loss = 1.269, top1 = 66.93%], test : [loss = 1.291, top1 = 67.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.134, top1 = 44.40%], valid : [loss = 2.413, top1 = 38.72%], test : [loss = 2.432, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14091/15625) 014091-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.424, top1 = 90.49%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.282, top1 = 93.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.09 ms.
cifar100       train : [loss = 0.174, top1 = 96.00%], valid : [loss = 1.289, top1 = 69.41%], test : [loss = 1.281, top1 = 69.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.50 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 51.92%], valid : [loss = 2.240, top1 = 43.11%], test : [loss = 2.269, top1 = 42.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.383, top1 = 87.00%], valid : [loss = 0.514, top1 = 82.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14092/15625) 014092-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.599, top1 = 87.95%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.380, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.67 ms.
cifar100       train : [loss = 0.188, top1 = 95.54%], valid : [loss = 1.503, top1 = 66.44%], test : [loss = 1.491, top1 = 66.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.35%], valid : [loss = 2.421, top1 = 39.16%], test : [loss = 2.430, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.25%], valid : [loss = 0.747, top1 = 74.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14093/15625) 014093-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.217, top1 = 92.62%], valid : [loss = 0.542, top1 = 83.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10        train : [loss = 0.211, top1 = 92.80%], test  : [loss = 0.400, top1 = 87.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.03 ms.
cifar100       train : [loss = 1.299, top1 = 63.03%], valid : [loss = 1.592, top1 = 56.89%], test : [loss = 1.599, top1 = 56.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.724, top1 = 32.11%], valid : [loss = 2.749, top1 = 32.01%], test : [loss = 2.792, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.952, top1 = 65.41%], valid : [loss = 1.002, top1 = 64.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14094/15625) 014094-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.79%], valid : [loss = 0.782, top1 = 82.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10        train : [loss = 0.087, top1 = 97.23%], test  : [loss = 0.494, top1 = 86.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.61 ms.
cifar100       train : [loss = 0.806, top1 = 76.39%], valid : [loss = 1.538, top1 = 59.61%], test : [loss = 1.522, top1 = 60.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 2.813, top1 = 30.35%], valid : [loss = 2.944, top1 = 28.40%], test : [loss = 2.986, top1 = 27.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14095/15625) 014095-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.543, top1 = 81.25%], valid : [loss = 0.856, top1 = 71.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10        train : [loss = 0.564, top1 = 80.25%], test  : [loss = 0.715, top1 = 75.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.06 ms.
cifar100       train : [loss = 1.793, top1 = 51.60%], valid : [loss = 2.075, top1 = 46.45%], test : [loss = 2.076, top1 = 46.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.81%], valid : [loss = 3.633, top1 = 16.60%], test : [loss = 3.665, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.20%], valid : [loss = 1.234, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14096/15625) 014096-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.49%], valid : [loss = 0.562, top1 = 87.30%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.033, top1 = 99.06%], test  : [loss = 0.377, top1 = 90.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 0.535, top1 = 84.65%], valid : [loss = 1.368, top1 = 64.39%], test : [loss = 1.354, top1 = 64.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.41 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.35%], valid : [loss = 2.585, top1 = 34.61%], test : [loss = 2.599, top1 = 34.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14097/15625) 014097-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.25%], valid : [loss = 0.453, top1 = 86.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10        train : [loss = 0.157, top1 = 94.88%], test  : [loss = 0.341, top1 = 88.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.47 ms.
cifar100       train : [loss = 0.978, top1 = 72.13%], valid : [loss = 1.354, top1 = 62.13%], test : [loss = 1.354, top1 = 62.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.29 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.97%], valid : [loss = 2.692, top1 = 33.24%], test : [loss = 2.706, top1 = 31.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.73%], valid : [loss = 0.787, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14098/15625) 014098-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.316, top1 = 91.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.82 ms.
cifar100       train : [loss = 0.324, top1 = 91.14%], valid : [loss = 1.322, top1 = 67.13%], test : [loss = 1.300, top1 = 67.49%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.24 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.33%], valid : [loss = 2.367, top1 = 40.27%], test : [loss = 2.406, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14099/15625) 014099-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.548, top1 = 88.35%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.359, top1 = 91.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.41 ms.
cifar100       train : [loss = 0.273, top1 = 92.40%], valid : [loss = 1.339, top1 = 67.23%], test : [loss = 1.354, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.180, top1 = 43.40%], valid : [loss = 2.436, top1 = 38.03%], test : [loss = 2.436, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.74%], valid : [loss = 0.920, top1 = 67.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14100/15625) 014100-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.463, top1 = 89.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.60 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.309, top1 = 93.18%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.28 ms.
cifar100       train : [loss = 0.087, top1 = 98.32%], valid : [loss = 1.431, top1 = 68.70%], test : [loss = 1.407, top1 = 68.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 1.705, top1 = 54.46%], valid : [loss = 2.257, top1 = 43.41%], test : [loss = 2.281, top1 = 43.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.29%], valid : [loss = 0.632, top1 = 78.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14101/15625) 014101-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.71%], valid : [loss = 0.761, top1 = 74.04%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.20 ms.
cifar10        train : [loss = 0.488, top1 = 83.21%], test  : [loss = 0.568, top1 = 80.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.24 ms.
cifar100       train : [loss = 2.034, top1 = 44.89%], valid : [loss = 2.161, top1 = 42.13%], test : [loss = 2.171, top1 = 42.34%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.29 ms.
ImageNet16-120 train : [loss = 3.024, top1 = 26.10%], valid : [loss = 3.015, top1 = 26.40%], test : [loss = 3.037, top1 = 25.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.28%], valid : [loss = 1.248, top1 = 55.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14102/15625) 014102-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.75%], valid : [loss = 0.464, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.13 ms.
cifar10        train : [loss = 0.121, top1 = 96.23%], test  : [loss = 0.339, top1 = 89.26%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.53 ms.
cifar100       train : [loss = 0.733, top1 = 79.41%], valid : [loss = 1.266, top1 = 64.95%], test : [loss = 1.256, top1 = 65.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.487, top1 = 37.01%], valid : [loss = 2.581, top1 = 34.40%], test : [loss = 2.607, top1 = 34.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14103/15625) 014103-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.71%], valid : [loss = 0.453, top1 = 86.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10        train : [loss = 0.148, top1 = 95.26%], test  : [loss = 0.344, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.17 ms.
cifar100       train : [loss = 0.962, top1 = 72.61%], valid : [loss = 1.342, top1 = 62.21%], test : [loss = 1.332, top1 = 62.79%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.614, top1 = 34.27%], valid : [loss = 2.673, top1 = 33.19%], test : [loss = 2.703, top1 = 32.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14104/15625) 014104-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.65 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.607, top1 = 85.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.068, top1 = 97.93%], test  : [loss = 0.406, top1 = 88.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.70 ms.
cifar100       train : [loss = 0.715, top1 = 79.23%], valid : [loss = 1.414, top1 = 62.77%], test : [loss = 1.375, top1 = 63.37%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.74 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.91%], valid : [loss = 2.656, top1 = 33.17%], test : [loss = 2.691, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14105/15625) 014105-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.461, top1 = 83.86%], valid : [loss = 0.635, top1 = 78.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.498, top1 = 82.77%], test  : [loss = 0.578, top1 = 80.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.82 ms.
cifar100       train : [loss = 1.655, top1 = 55.06%], valid : [loss = 1.823, top1 = 51.39%], test : [loss = 1.844, top1 = 50.89%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.30%], valid : [loss = 3.307, top1 = 21.79%], test : [loss = 3.341, top1 = 21.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14106/15625) 014106-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.536, top1 = 89.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.49 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.370, top1 = 92.48%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.60 ms.
cifar100       train : [loss = 0.097, top1 = 98.32%], valid : [loss = 1.459, top1 = 68.11%], test : [loss = 1.441, top1 = 68.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 1.856, top1 = 50.91%], valid : [loss = 2.459, top1 = 38.56%], test : [loss = 2.452, top1 = 39.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.54%], valid : [loss = 0.726, top1 = 75.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14107/15625) 014107-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.489, top1 = 89.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.319, top1 = 92.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.59 ms.
cifar100       train : [loss = 0.242, top1 = 93.89%], valid : [loss = 1.262, top1 = 68.17%], test : [loss = 1.251, top1 = 68.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.97%], valid : [loss = 2.257, top1 = 41.84%], test : [loss = 2.255, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.76%], valid : [loss = 0.614, top1 = 79.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14108/15625) 014108-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.21%], valid : [loss = 0.473, top1 = 84.41%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.27 ms.
cifar10        train : [loss = 0.299, top1 = 90.05%], test  : [loss = 0.401, top1 = 86.51%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.88 ms.
cifar100       train : [loss = 1.326, top1 = 63.24%], valid : [loss = 1.523, top1 = 58.31%], test : [loss = 1.511, top1 = 58.23%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.74 ms.
ImageNet16-120 train : [loss = 2.909, top1 = 28.84%], valid : [loss = 2.883, top1 = 30.02%], test : [loss = 2.944, top1 = 28.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14109/15625) 014109-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.22%], valid : [loss = 0.472, top1 = 84.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10        train : [loss = 0.297, top1 = 90.10%], test  : [loss = 0.394, top1 = 86.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.93 ms.
cifar100       train : [loss = 1.322, top1 = 63.43%], valid : [loss = 1.546, top1 = 57.78%], test : [loss = 1.507, top1 = 58.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.68%], valid : [loss = 2.903, top1 = 29.13%], test : [loss = 2.959, top1 = 27.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14110/15625) 014110-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.563, top1 = 88.54%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.10 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.344, top1 = 92.04%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.37 ms.
cifar100       train : [loss = 0.235, top1 = 93.82%], valid : [loss = 1.306, top1 = 67.95%], test : [loss = 1.321, top1 = 68.11%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 2.074, top1 = 45.94%], valid : [loss = 2.368, top1 = 39.13%], test : [loss = 2.383, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.99%], valid : [loss = 0.821, top1 = 71.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14111/15625) 014111-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.28%], valid : [loss = 0.620, top1 = 85.39%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10        train : [loss = 0.068, top1 = 97.90%], test  : [loss = 0.415, top1 = 88.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.68 ms.
cifar100       train : [loss = 0.688, top1 = 79.87%], valid : [loss = 1.405, top1 = 63.53%], test : [loss = 1.376, top1 = 63.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.542, top1 = 35.77%], valid : [loss = 2.663, top1 = 33.76%], test : [loss = 2.703, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.00%], valid : [loss = 0.844, top1 = 70.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14112/15625) 014112-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=20.99 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.85%], valid : [loss = 0.429, top1 = 88.39%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=20.88 ms.
cifar10        train : [loss = 0.032, top1 = 99.43%], test  : [loss = 0.306, top1 = 91.30%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=20.44 ms.
cifar100       train : [loss = 0.292, top1 = 93.33%], valid : [loss = 1.237, top1 = 68.25%], test : [loss = 1.210, top1 = 68.39%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=20.67 ms.
ImageNet16-120 train : [loss = 1.982, top1 = 48.23%], valid : [loss = 2.340, top1 = 40.71%], test : [loss = 2.361, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.84%], valid : [loss = 0.627, top1 = 78.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14113/15625) 014113-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.207, top1 = 93.05%], valid : [loss = 0.557, top1 = 83.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.26 ms.
cifar10        train : [loss = 0.212, top1 = 92.80%], test  : [loss = 0.401, top1 = 87.21%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.00 ms.
cifar100       train : [loss = 1.290, top1 = 63.26%], valid : [loss = 1.585, top1 = 56.85%], test : [loss = 1.581, top1 = 56.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.720, top1 = 32.18%], valid : [loss = 2.750, top1 = 31.73%], test : [loss = 2.796, top1 = 30.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 66.70%], valid : [loss = 0.969, top1 = 65.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14114/15625) 014114-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.490, top1 = 89.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.342, top1 = 91.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.97 ms.
cifar100       train : [loss = 0.223, top1 = 94.37%], valid : [loss = 1.322, top1 = 67.85%], test : [loss = 1.319, top1 = 68.25%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.944, top1 = 48.97%], valid : [loss = 2.336, top1 = 40.91%], test : [loss = 2.349, top1 = 40.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.63%], valid : [loss = 0.571, top1 = 80.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14115/15625) 014115-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.564, top1 = 88.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.88 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.348, top1 = 92.57%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.83 ms.
cifar100       train : [loss = 0.119, top1 = 97.47%], valid : [loss = 1.375, top1 = 68.59%], test : [loss = 1.389, top1 = 68.47%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.92 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.74%], valid : [loss = 2.346, top1 = 40.37%], test : [loss = 2.354, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.834, top1 = 70.06%], valid : [loss = 0.876, top1 = 68.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14116/15625) 014116-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.520, top1 = 89.47%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.93 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.320, top1 = 92.83%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.10 ms.
cifar100       train : [loss = 0.113, top1 = 97.81%], valid : [loss = 1.285, top1 = 69.89%], test : [loss = 1.306, top1 = 69.79%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.19 ms.
ImageNet16-120 train : [loss = 1.752, top1 = 53.35%], valid : [loss = 2.239, top1 = 43.03%], test : [loss = 2.240, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.90%], valid : [loss = 0.630, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14117/15625) 014117-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.23%], valid : [loss = 0.477, top1 = 84.34%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.51 ms.
cifar10        train : [loss = 0.296, top1 = 90.12%], test  : [loss = 0.397, top1 = 86.63%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.86 ms.
cifar100       train : [loss = 1.328, top1 = 63.28%], valid : [loss = 1.537, top1 = 58.14%], test : [loss = 1.508, top1 = 58.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.23 ms.
ImageNet16-120 train : [loss = 2.908, top1 = 28.89%], valid : [loss = 2.890, top1 = 29.11%], test : [loss = 2.945, top1 = 28.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14118/15625) 014118-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.32 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.469, top1 = 90.44%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.58 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.307, top1 = 93.60%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.42 ms.
cifar100       train : [loss = 0.055, top1 = 99.35%], valid : [loss = 1.273, top1 = 70.51%], test : [loss = 1.269, top1 = 70.89%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.71 ms.
ImageNet16-120 train : [loss = 1.670, top1 = 55.19%], valid : [loss = 2.162, top1 = 44.37%], test : [loss = 2.160, top1 = 45.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.19%], valid : [loss = 0.627, top1 = 78.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14119/15625) 014119-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.55%], valid : [loss = 0.464, top1 = 86.37%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.24 ms.
cifar10        train : [loss = 0.127, top1 = 96.01%], test  : [loss = 0.335, top1 = 89.24%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.94 ms.
cifar100       train : [loss = 0.776, top1 = 78.16%], valid : [loss = 1.294, top1 = 63.65%], test : [loss = 1.295, top1 = 64.32%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.38%], valid : [loss = 2.621, top1 = 34.70%], test : [loss = 2.627, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.64%], valid : [loss = 0.854, top1 = 69.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14120/15625) 014120-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10-valid  train : [loss = 0.790, top1 = 72.01%], valid : [loss = 1.103, top1 = 63.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10        train : [loss = 0.776, top1 = 72.78%], test  : [loss = 0.912, top1 = 68.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.71 ms.
cifar100       train : [loss = 2.134, top1 = 44.15%], valid : [loss = 2.405, top1 = 39.50%], test : [loss = 2.423, top1 = 39.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 3.763, top1 = 13.96%], valid : [loss = 3.821, top1 = 13.73%], test : [loss = 3.826, top1 = 13.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.64%], valid : [loss = 1.400, top1 = 49.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14121/15625) 014121-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.174, top1 = 94.26%], valid : [loss = 0.439, top1 = 86.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.39 ms.
cifar10        train : [loss = 0.148, top1 = 95.20%], test  : [loss = 0.315, top1 = 89.76%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.86 ms.
cifar100       train : [loss = 0.921, top1 = 73.76%], valid : [loss = 1.283, top1 = 63.95%], test : [loss = 1.243, top1 = 64.69%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.690, top1 = 32.96%], valid : [loss = 2.684, top1 = 33.32%], test : [loss = 2.727, top1 = 32.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.48%], valid : [loss = 1.015, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14122/15625) 014122-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.569, top1 = 87.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.57 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.392, top1 = 91.19%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.84 ms.
cifar100       train : [loss = 0.408, top1 = 88.42%], valid : [loss = 1.404, top1 = 65.30%], test : [loss = 1.397, top1 = 65.25%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.88%], valid : [loss = 2.511, top1 = 36.70%], test : [loss = 2.540, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14123/15625) 014123-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.22 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.79%], valid : [loss = 0.532, top1 = 88.29%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10        train : [loss = 0.023, top1 = 99.38%], test  : [loss = 0.352, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.77 ms.
cifar100       train : [loss = 0.411, top1 = 88.19%], valid : [loss = 1.242, top1 = 67.43%], test : [loss = 1.249, top1 = 67.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.93 ms.
ImageNet16-120 train : [loss = 2.213, top1 = 42.77%], valid : [loss = 2.419, top1 = 39.39%], test : [loss = 2.428, top1 = 38.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.679, top1 = 75.87%], valid : [loss = 0.746, top1 = 74.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14124/15625) 014124-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.97%], valid : [loss = 0.708, top1 = 83.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10        train : [loss = 0.061, top1 = 98.12%], test  : [loss = 0.435, top1 = 88.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.37 ms.
cifar100       train : [loss = 0.676, top1 = 80.32%], valid : [loss = 1.535, top1 = 60.80%], test : [loss = 1.494, top1 = 61.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 33.11%], valid : [loss = 2.823, top1 = 30.87%], test : [loss = 2.877, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.69%], valid : [loss = 0.907, top1 = 68.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14125/15625) 014125-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.520, top1 = 89.57%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.86 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.322, top1 = 93.17%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.24 ms.
cifar100       train : [loss = 0.100, top1 = 98.09%], valid : [loss = 1.316, top1 = 69.75%], test : [loss = 1.332, top1 = 69.87%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 1.792, top1 = 52.35%], valid : [loss = 2.255, top1 = 42.56%], test : [loss = 2.256, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.76%], valid : [loss = 0.845, top1 = 70.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14126/15625) 014126-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.86 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.37%], valid : [loss = 0.458, top1 = 87.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.89 ms.
cifar10        train : [loss = 0.068, top1 = 98.18%], test  : [loss = 0.328, top1 = 90.04%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.49 ms.
cifar100       train : [loss = 0.577, top1 = 84.18%], valid : [loss = 1.205, top1 = 67.32%], test : [loss = 1.221, top1 = 66.59%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.42%], valid : [loss = 2.477, top1 = 38.17%], test : [loss = 2.490, top1 = 37.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.61%], valid : [loss = 0.655, top1 = 77.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14127/15625) 014127-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.98 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.52%], valid : [loss = 0.566, top1 = 87.39%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.40 ms.
cifar10        train : [loss = 0.042, top1 = 98.72%], test  : [loss = 0.371, top1 = 90.65%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.42 ms.
cifar100       train : [loss = 0.449, top1 = 87.28%], valid : [loss = 1.323, top1 = 65.60%], test : [loss = 1.294, top1 = 66.16%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.160, top1 = 43.95%], valid : [loss = 2.399, top1 = 39.12%], test : [loss = 2.406, top1 = 39.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.44%], valid : [loss = 0.781, top1 = 72.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14128/15625) 014128-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.60 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.19 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.17 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.27 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.85%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14129/15625) 014129-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.28 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.608, top1 = 87.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.413, top1 = 91.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.214, top1 = 94.64%], valid : [loss = 1.547, top1 = 64.73%], test : [loss = 1.546, top1 = 65.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 45.13%], valid : [loss = 2.510, top1 = 36.98%], test : [loss = 2.533, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.57%], valid : [loss = 0.806, top1 = 71.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14130/15625) 014130-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.403, top1 = 85.86%], valid : [loss = 0.653, top1 = 78.65%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.347, top1 = 88.06%], test  : [loss = 0.474, top1 = 84.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.48 ms.
cifar100       train : [loss = 1.621, top1 = 54.99%], valid : [loss = 1.853, top1 = 50.48%], test : [loss = 1.846, top1 = 50.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 3.181, top1 = 23.37%], valid : [loss = 3.187, top1 = 23.81%], test : [loss = 3.236, top1 = 22.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.042, top1 = 62.38%], valid : [loss = 1.080, top1 = 61.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14131/15625) 014131-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.47%], valid : [loss = 0.629, top1 = 79.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10        train : [loss = 0.312, top1 = 89.22%], test  : [loss = 0.457, top1 = 84.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.02 ms.
cifar100       train : [loss = 1.478, top1 = 58.83%], valid : [loss = 1.767, top1 = 52.44%], test : [loss = 1.763, top1 = 52.52%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 3.008, top1 = 26.75%], valid : [loss = 3.038, top1 = 26.27%], test : [loss = 3.085, top1 = 25.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.175, top1 = 57.35%], valid : [loss = 1.236, top1 = 56.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14132/15625) 014132-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.422, top1 = 90.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.95%], test  : [loss = 0.297, top1 = 93.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.84 ms.
cifar100       train : [loss = 0.102, top1 = 98.18%], valid : [loss = 1.306, top1 = 69.58%], test : [loss = 1.284, top1 = 70.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 1.646, top1 = 55.79%], valid : [loss = 2.217, top1 = 44.20%], test : [loss = 2.262, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.17%], valid : [loss = 0.523, top1 = 82.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14133/15625) 014133-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.65 ms.
cifar10-valid  train : [loss = 0.262, top1 = 91.32%], valid : [loss = 0.476, top1 = 84.44%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.36 ms.
cifar10        train : [loss = 0.300, top1 = 90.06%], test  : [loss = 0.399, top1 = 86.53%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.63 ms.
cifar100       train : [loss = 1.325, top1 = 63.32%], valid : [loss = 1.535, top1 = 57.94%], test : [loss = 1.516, top1 = 58.32%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.91 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.79%], valid : [loss = 2.886, top1 = 30.06%], test : [loss = 2.950, top1 = 28.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14134/15625) 014134-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.593, top1 = 87.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.49 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.379, top1 = 91.24%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.87 ms.
cifar100       train : [loss = 0.399, top1 = 88.63%], valid : [loss = 1.380, top1 = 65.64%], test : [loss = 1.415, top1 = 65.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.95 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.07%], valid : [loss = 2.505, top1 = 36.69%], test : [loss = 2.535, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.22%], valid : [loss = 0.815, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14135/15625) 014135-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.591, top1 = 86.72%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.90 ms.
cifar10        train : [loss = 0.029, top1 = 99.21%], test  : [loss = 0.386, top1 = 90.54%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.82 ms.
cifar100       train : [loss = 0.533, top1 = 84.47%], valid : [loss = 1.414, top1 = 63.90%], test : [loss = 1.409, top1 = 64.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.34 ms.
ImageNet16-120 train : [loss = 2.352, top1 = 39.76%], valid : [loss = 2.546, top1 = 35.80%], test : [loss = 2.572, top1 = 36.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.63%], valid : [loss = 0.847, top1 = 69.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14136/15625) 014136-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.795, top1 = 71.96%], valid : [loss = 1.103, top1 = 63.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10        train : [loss = 0.782, top1 = 72.54%], test  : [loss = 0.907, top1 = 68.47%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.30 ms.
cifar100       train : [loss = 2.136, top1 = 43.91%], valid : [loss = 2.426, top1 = 39.11%], test : [loss = 2.418, top1 = 39.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.14 ms.
ImageNet16-120 train : [loss = 3.762, top1 = 13.97%], valid : [loss = 3.820, top1 = 13.98%], test : [loss = 3.826, top1 = 12.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.364, top1 = 50.19%], valid : [loss = 1.411, top1 = 48.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14137/15625) 014137-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.47 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.473, top1 = 89.71%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.77 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.291, top1 = 92.89%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.88 ms.
cifar100       train : [loss = 0.139, top1 = 97.18%], valid : [loss = 1.281, top1 = 69.26%], test : [loss = 1.288, top1 = 68.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.38 ms.
ImageNet16-120 train : [loss = 1.735, top1 = 53.64%], valid : [loss = 2.200, top1 = 43.77%], test : [loss = 2.222, top1 = 43.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.70%], valid : [loss = 0.576, top1 = 80.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14138/15625) 014138-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.78 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.25%], valid : [loss = 0.613, top1 = 85.47%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.397, top1 = 88.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.66 ms.
cifar100       train : [loss = 0.714, top1 = 79.25%], valid : [loss = 1.395, top1 = 63.07%], test : [loss = 1.377, top1 = 63.07%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.10%], valid : [loss = 2.653, top1 = 33.30%], test : [loss = 2.686, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14139/15625) 014139-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.425, top1 = 91.01%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.04 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.278, top1 = 93.92%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.59 ms.
cifar100       train : [loss = 0.044, top1 = 99.51%], valid : [loss = 1.325, top1 = 71.21%], test : [loss = 1.329, top1 = 70.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 1.428, top1 = 61.12%], valid : [loss = 2.234, top1 = 44.11%], test : [loss = 2.232, top1 = 44.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.360, top1 = 87.52%], valid : [loss = 0.498, top1 = 83.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14140/15625) 014140-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.433, top1 = 90.19%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.293, top1 = 93.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.66 ms.
cifar100       train : [loss = 0.065, top1 = 99.18%], valid : [loss = 1.294, top1 = 70.82%], test : [loss = 1.282, top1 = 70.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.469, top1 = 60.13%], valid : [loss = 2.208, top1 = 44.38%], test : [loss = 2.226, top1 = 45.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.379, top1 = 87.01%], valid : [loss = 0.510, top1 = 82.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14141/15625) 014141-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.61 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.559, top1 = 88.72%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.361, top1 = 92.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.69 ms.
cifar100       train : [loss = 0.135, top1 = 97.00%], valid : [loss = 1.453, top1 = 67.24%], test : [loss = 1.450, top1 = 66.97%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.01 ms.
ImageNet16-120 train : [loss = 2.381, top1 = 38.46%], valid : [loss = 2.560, top1 = 34.76%], test : [loss = 2.568, top1 = 35.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.008, top1 = 63.26%], valid : [loss = 1.029, top1 = 63.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14142/15625) 014142-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.48%], valid : [loss = 0.579, top1 = 86.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.84 ms.
cifar10        train : [loss = 0.065, top1 = 97.91%], test  : [loss = 0.364, top1 = 90.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.47 ms.
cifar100       train : [loss = 0.314, top1 = 90.89%], valid : [loss = 1.339, top1 = 66.85%], test : [loss = 1.339, top1 = 67.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.820, top1 = 29.45%], valid : [loss = 2.903, top1 = 28.24%], test : [loss = 2.909, top1 = 27.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.02%], valid : [loss = 1.033, top1 = 62.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14143/15625) 014143-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.542, top1 = 88.61%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.351, top1 = 92.14%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.43 ms.
cifar100       train : [loss = 0.237, top1 = 93.69%], valid : [loss = 1.291, top1 = 67.73%], test : [loss = 1.294, top1 = 68.42%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 42.90%], valid : [loss = 2.429, top1 = 38.74%], test : [loss = 2.438, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.47%], valid : [loss = 0.928, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14144/15625) 014144-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.37%], valid : [loss = 0.848, top1 = 72.01%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.559, top1 = 80.47%], test  : [loss = 0.714, top1 = 75.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.51 ms.
cifar100       train : [loss = 1.773, top1 = 52.11%], valid : [loss = 2.043, top1 = 47.29%], test : [loss = 2.066, top1 = 46.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.82%], valid : [loss = 3.635, top1 = 16.42%], test : [loss = 3.669, top1 = 15.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14145/15625) 014145-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.508, top1 = 89.75%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.333, top1 = 93.21%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.39 ms.
cifar100       train : [loss = 0.053, top1 = 99.32%], valid : [loss = 1.345, top1 = 70.39%], test : [loss = 1.355, top1 = 70.27%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.87 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.58%], valid : [loss = 2.353, top1 = 39.77%], test : [loss = 2.372, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.871, top1 = 69.12%], valid : [loss = 0.901, top1 = 67.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14146/15625) 014146-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.45 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.18%], valid : [loss = 0.475, top1 = 84.53%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.89 ms.
cifar10        train : [loss = 0.297, top1 = 90.12%], test  : [loss = 0.396, top1 = 86.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.28 ms.
cifar100       train : [loss = 1.329, top1 = 63.12%], valid : [loss = 1.531, top1 = 57.83%], test : [loss = 1.513, top1 = 58.19%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.26 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.81%], valid : [loss = 2.883, top1 = 29.77%], test : [loss = 2.948, top1 = 28.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14147/15625) 014147-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.039, top1 = 99.03%], valid : [loss = 0.520, top1 = 87.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.81 ms.
cifar10        train : [loss = 0.076, top1 = 97.63%], test  : [loss = 0.356, top1 = 90.06%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.12 ms.
cifar100       train : [loss = 0.713, top1 = 79.10%], valid : [loss = 1.336, top1 = 64.17%], test : [loss = 1.346, top1 = 63.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.10 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.27%], valid : [loss = 2.610, top1 = 34.50%], test : [loss = 2.679, top1 = 33.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.65%], valid : [loss = 0.653, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14148/15625) 014148-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.479, top1 = 89.18%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.316, top1 = 92.44%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.63 ms.
cifar100       train : [loss = 0.287, top1 = 92.56%], valid : [loss = 1.252, top1 = 68.00%], test : [loss = 1.237, top1 = 68.69%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.07 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.20%], valid : [loss = 2.186, top1 = 43.42%], test : [loss = 2.213, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.23%], valid : [loss = 0.643, top1 = 77.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14149/15625) 014149-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.77 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.468, top1 = 89.89%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.26 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.300, top1 = 93.29%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.44 ms.
cifar100       train : [loss = 0.117, top1 = 97.84%], valid : [loss = 1.245, top1 = 69.91%], test : [loss = 1.239, top1 = 70.35%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.13 ms.
ImageNet16-120 train : [loss = 1.669, top1 = 55.25%], valid : [loss = 2.160, top1 = 44.51%], test : [loss = 2.173, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.73%], valid : [loss = 0.599, top1 = 79.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14150/15625) 014150-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.69%], valid : [loss = 0.556, top1 = 87.94%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.94 ms.
cifar10        train : [loss = 0.026, top1 = 99.23%], test  : [loss = 0.353, top1 = 91.40%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.68 ms.
cifar100       train : [loss = 0.419, top1 = 87.81%], valid : [loss = 1.279, top1 = 66.76%], test : [loss = 1.276, top1 = 66.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.63 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.34%], valid : [loss = 2.381, top1 = 39.37%], test : [loss = 2.395, top1 = 39.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.46%], valid : [loss = 0.835, top1 = 70.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14151/15625) 014151-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.146, top1 = 95.35%], valid : [loss = 0.511, top1 = 85.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.92 ms.
cifar10        train : [loss = 0.165, top1 = 94.43%], test  : [loss = 0.379, top1 = 88.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.10 ms.
cifar100       train : [loss = 1.055, top1 = 69.56%], valid : [loss = 1.429, top1 = 61.05%], test : [loss = 1.422, top1 = 60.83%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.81 ms.
ImageNet16-120 train : [loss = 2.591, top1 = 34.85%], valid : [loss = 2.645, top1 = 34.57%], test : [loss = 2.670, top1 = 33.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.14%], valid : [loss = 0.930, top1 = 67.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14152/15625) 014152-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.421, top1 = 91.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.287, top1 = 93.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.14 ms.
cifar100       train : [loss = 0.051, top1 = 99.35%], valid : [loss = 1.368, top1 = 70.61%], test : [loss = 1.347, top1 = 70.85%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.509, top1 = 59.16%], valid : [loss = 2.216, top1 = 44.01%], test : [loss = 2.242, top1 = 44.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.78%], valid : [loss = 0.556, top1 = 81.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14153/15625) 014153-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.91%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.90 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.333, top1 = 93.08%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.76 ms.
cifar100       train : [loss = 0.064, top1 = 99.00%], valid : [loss = 1.362, top1 = 70.15%], test : [loss = 1.389, top1 = 69.71%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.71 ms.
ImageNet16-120 train : [loss = 1.746, top1 = 53.41%], valid : [loss = 2.197, top1 = 43.96%], test : [loss = 2.209, top1 = 43.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.62%], valid : [loss = 0.629, top1 = 78.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14154/15625) 014154-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.78%], valid : [loss = 0.701, top1 = 82.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.096, top1 = 96.89%], test  : [loss = 0.440, top1 = 87.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.29 ms.
cifar100       train : [loss = 0.845, top1 = 75.31%], valid : [loss = 1.612, top1 = 57.91%], test : [loss = 1.606, top1 = 58.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.68%], valid : [loss = 2.874, top1 = 29.32%], test : [loss = 2.922, top1 = 28.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.874, top1 = 68.28%], valid : [loss = 0.927, top1 = 67.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14155/15625) 014155-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.71%], valid : [loss = 0.843, top1 = 72.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.562, top1 = 80.33%], test  : [loss = 0.718, top1 = 75.55%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.90 ms.
cifar100       train : [loss = 1.773, top1 = 52.11%], valid : [loss = 2.044, top1 = 47.17%], test : [loss = 2.053, top1 = 46.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.83%], valid : [loss = 3.635, top1 = 16.56%], test : [loss = 3.668, top1 = 15.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.178, top1 = 57.52%], valid : [loss = 1.237, top1 = 55.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14156/15625) 014156-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.456, top1 = 89.15%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.317, top1 = 92.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.88 ms.
cifar100       train : [loss = 0.320, top1 = 91.32%], valid : [loss = 1.300, top1 = 67.37%], test : [loss = 1.320, top1 = 67.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.26 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.32%], valid : [loss = 2.346, top1 = 40.40%], test : [loss = 2.397, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14157/15625) 014157-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.191, top1 = 93.53%], valid : [loss = 0.547, top1 = 83.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10        train : [loss = 0.196, top1 = 93.39%], test  : [loss = 0.399, top1 = 87.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 1.240, top1 = 64.77%], valid : [loss = 1.543, top1 = 58.09%], test : [loss = 1.548, top1 = 57.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 2.701, top1 = 32.58%], valid : [loss = 2.722, top1 = 32.31%], test : [loss = 2.783, top1 = 31.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.66%], valid : [loss = 0.988, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14158/15625) 014158-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.795, top1 = 83.90%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.09 ms.
cifar10        train : [loss = 0.018, top1 = 99.52%], test  : [loss = 0.568, top1 = 87.81%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.87 ms.
cifar100       train : [loss = 0.207, top1 = 95.11%], valid : [loss = 1.814, top1 = 61.07%], test : [loss = 1.789, top1 = 60.94%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.446, top1 = 38.14%], valid : [loss = 2.889, top1 = 30.00%], test : [loss = 2.931, top1 = 29.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 69.40%], valid : [loss = 0.932, top1 = 67.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14159/15625) 014159-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.545, top1 = 87.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.38 ms.
cifar10        train : [loss = 0.022, top1 = 99.41%], test  : [loss = 0.355, top1 = 91.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.50 ms.
cifar100       train : [loss = 0.417, top1 = 87.91%], valid : [loss = 1.384, top1 = 65.43%], test : [loss = 1.377, top1 = 65.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.270, top1 = 41.69%], valid : [loss = 2.488, top1 = 37.39%], test : [loss = 2.524, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.55%], valid : [loss = 0.777, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14160/15625) 014160-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.87 ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.40%], valid : [loss = 0.899, top1 = 68.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.95 ms.
cifar10        train : [loss = 0.710, top1 = 75.18%], test  : [loss = 0.762, top1 = 73.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.54 ms.
cifar100       train : [loss = 2.255, top1 = 40.75%], valid : [loss = 2.331, top1 = 39.57%], test : [loss = 2.330, top1 = 39.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.44 ms.
ImageNet16-120 train : [loss = 3.468, top1 = 18.45%], valid : [loss = 3.458, top1 = 19.59%], test : [loss = 3.484, top1 = 17.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.46%], valid : [loss = 1.388, top1 = 50.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14161/15625) 014161-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.60%], valid : [loss = 0.622, top1 = 85.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.043, top1 = 98.74%], test  : [loss = 0.416, top1 = 89.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.31 ms.
cifar100       train : [loss = 0.578, top1 = 83.13%], valid : [loss = 1.446, top1 = 63.29%], test : [loss = 1.417, top1 = 63.81%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 2.461, top1 = 37.50%], valid : [loss = 2.621, top1 = 34.21%], test : [loss = 2.650, top1 = 34.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.47%], valid : [loss = 0.834, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14162/15625) 014162-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.627, top1 = 86.94%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.54 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.417, top1 = 90.69%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.00 ms.
cifar100       train : [loss = 0.229, top1 = 94.43%], valid : [loss = 1.600, top1 = 64.22%], test : [loss = 1.572, top1 = 63.78%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.12 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.15%], valid : [loss = 2.479, top1 = 37.32%], test : [loss = 2.466, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.05%], valid : [loss = 0.803, top1 = 71.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14163/15625) 014163-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.98 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14164/15625) 014164-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.532, top1 = 88.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.59 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.341, top1 = 91.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.31 ms.
cifar100       train : [loss = 0.300, top1 = 91.90%], valid : [loss = 1.315, top1 = 67.09%], test : [loss = 1.303, top1 = 67.61%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.82 ms.
ImageNet16-120 train : [loss = 2.155, top1 = 43.98%], valid : [loss = 2.416, top1 = 39.14%], test : [loss = 2.441, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.00%], valid : [loss = 0.842, top1 = 70.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14165/15625) 014165-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.75 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.628, top1 = 86.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.02 ms.
cifar10        train : [loss = 0.019, top1 = 99.55%], test  : [loss = 0.425, top1 = 90.31%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.48 ms.
cifar100       train : [loss = 0.273, top1 = 92.96%], valid : [loss = 1.443, top1 = 65.55%], test : [loss = 1.424, top1 = 65.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.218, top1 = 42.73%], valid : [loss = 2.559, top1 = 36.27%], test : [loss = 2.580, top1 = 36.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 73.82%], valid : [loss = 0.799, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14166/15625) 014166-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.465, top1 = 89.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.318, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.84 ms.
cifar100       train : [loss = 0.331, top1 = 90.86%], valid : [loss = 1.301, top1 = 67.51%], test : [loss = 1.304, top1 = 67.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.21%], valid : [loss = 2.354, top1 = 40.69%], test : [loss = 2.405, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.03%], valid : [loss = 0.570, top1 = 80.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14167/15625) 014167-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.607, top1 = 87.59%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.13 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.404, top1 = 91.13%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.30 ms.
cifar100       train : [loss = 0.209, top1 = 95.08%], valid : [loss = 1.454, top1 = 66.19%], test : [loss = 1.435, top1 = 66.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 2.076, top1 = 45.94%], valid : [loss = 2.509, top1 = 37.40%], test : [loss = 2.530, top1 = 37.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.12%], valid : [loss = 0.730, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14168/15625) 014168-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.348, top1 = 92.79%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.17 ms.
cifar100       train : [loss = 0.066, top1 = 99.05%], valid : [loss = 1.460, top1 = 68.66%], test : [loss = 1.464, top1 = 68.55%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.28%], valid : [loss = 2.328, top1 = 41.58%], test : [loss = 2.352, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 82.04%], valid : [loss = 0.652, top1 = 77.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14169/15625) 014169-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.86%], valid : [loss = 0.627, top1 = 84.70%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.087, top1 = 97.21%], test  : [loss = 0.402, top1 = 88.59%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 0.783, top1 = 77.11%], valid : [loss = 1.434, top1 = 61.97%], test : [loss = 1.423, top1 = 61.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.12%], valid : [loss = 2.744, top1 = 31.72%], test : [loss = 2.759, top1 = 31.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14170/15625) 014170-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.094, top1 = 97.21%], valid : [loss = 0.518, top1 = 85.66%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.95 ms.
cifar10        train : [loss = 0.170, top1 = 94.27%], test  : [loss = 0.381, top1 = 88.13%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.22 ms.
cifar100       train : [loss = 0.930, top1 = 73.17%], valid : [loss = 1.368, top1 = 62.44%], test : [loss = 1.344, top1 = 62.66%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.81%], valid : [loss = 2.695, top1 = 32.88%], test : [loss = 2.752, top1 = 31.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.917, top1 = 67.50%], valid : [loss = 0.966, top1 = 66.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14171/15625) 014171-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.513, top1 = 88.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.338, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.90 ms.
cifar100       train : [loss = 0.344, top1 = 90.59%], valid : [loss = 1.281, top1 = 67.25%], test : [loss = 1.277, top1 = 67.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.67%], valid : [loss = 2.390, top1 = 38.96%], test : [loss = 2.393, top1 = 39.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14172/15625) 014172-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.46 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.539, top1 = 88.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.025, top1 = 99.28%], test  : [loss = 0.349, top1 = 91.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.32 ms.
cifar100       train : [loss = 0.436, top1 = 87.36%], valid : [loss = 1.237, top1 = 66.69%], test : [loss = 1.252, top1 = 67.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.49%], valid : [loss = 2.376, top1 = 39.67%], test : [loss = 2.381, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.54%], valid : [loss = 0.814, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14173/15625) 014173-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.578, top1 = 87.48%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.95 ms.
cifar10        train : [loss = 0.018, top1 = 99.56%], test  : [loss = 0.391, top1 = 90.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.12 ms.
cifar100       train : [loss = 0.404, top1 = 88.51%], valid : [loss = 1.396, top1 = 65.11%], test : [loss = 1.396, top1 = 65.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.77%], valid : [loss = 2.499, top1 = 37.21%], test : [loss = 2.538, top1 = 36.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.57%], valid : [loss = 0.823, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14174/15625) 014174-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.403, top1 = 91.51%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.91 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.274, top1 = 93.94%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.78 ms.
cifar100       train : [loss = 0.024, top1 = 99.82%], valid : [loss = 1.275, top1 = 72.16%], test : [loss = 1.251, top1 = 72.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.86 ms.
ImageNet16-120 train : [loss = 1.211, top1 = 66.45%], valid : [loss = 2.246, top1 = 45.00%], test : [loss = 2.242, top1 = 45.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.320, top1 = 89.13%], valid : [loss = 0.472, top1 = 84.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14175/15625) 014175-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.561, top1 = 88.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.384, top1 = 92.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.85 ms.
cifar100       train : [loss = 0.079, top1 = 98.76%], valid : [loss = 1.497, top1 = 67.49%], test : [loss = 1.452, top1 = 68.07%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.799, top1 = 52.25%], valid : [loss = 2.421, top1 = 39.91%], test : [loss = 2.422, top1 = 40.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.26%], valid : [loss = 0.740, top1 = 74.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14176/15625) 014176-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.60%], valid : [loss = 0.743, top1 = 81.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.53 ms.
cifar10        train : [loss = 0.129, top1 = 95.64%], test  : [loss = 0.468, top1 = 86.68%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.99 ms.
cifar100       train : [loss = 0.871, top1 = 74.46%], valid : [loss = 1.617, top1 = 57.77%], test : [loss = 1.599, top1 = 58.31%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.969, top1 = 26.76%], valid : [loss = 3.032, top1 = 25.70%], test : [loss = 3.082, top1 = 25.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.44%], valid : [loss = 1.059, top1 = 62.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14177/15625) 014177-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.526, top1 = 81.56%], valid : [loss = 0.852, top1 = 72.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10        train : [loss = 0.546, top1 = 80.83%], test  : [loss = 0.711, top1 = 76.02%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.92 ms.
cifar100       train : [loss = 1.767, top1 = 52.49%], valid : [loss = 2.056, top1 = 47.14%], test : [loss = 2.051, top1 = 47.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.33 ms.
ImageNet16-120 train : [loss = 3.580, top1 = 16.92%], valid : [loss = 3.631, top1 = 16.98%], test : [loss = 3.664, top1 = 15.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14178/15625) 014178-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.467, top1 = 89.25%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.18 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.315, top1 = 92.30%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.74 ms.
cifar100       train : [loss = 0.308, top1 = 91.79%], valid : [loss = 1.241, top1 = 67.77%], test : [loss = 1.250, top1 = 68.11%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 1.968, top1 = 48.20%], valid : [loss = 2.273, top1 = 42.09%], test : [loss = 2.286, top1 = 41.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.60%], valid : [loss = 0.615, top1 = 78.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14179/15625) 014179-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.95 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.48%], valid : [loss = 0.762, top1 = 81.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.63 ms.
cifar10        train : [loss = 0.124, top1 = 95.86%], test  : [loss = 0.477, top1 = 86.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.41 ms.
cifar100       train : [loss = 0.949, top1 = 72.39%], valid : [loss = 1.618, top1 = 57.55%], test : [loss = 1.596, top1 = 57.75%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.719, top1 = 32.03%], valid : [loss = 2.818, top1 = 30.52%], test : [loss = 2.863, top1 = 30.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 69.46%], valid : [loss = 0.911, top1 = 67.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14180/15625) 014180-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.516, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.62 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.327, top1 = 92.81%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.27 ms.
cifar100       train : [loss = 0.152, top1 = 96.68%], valid : [loss = 1.231, top1 = 70.43%], test : [loss = 1.237, top1 = 70.07%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.57 ms.
ImageNet16-120 train : [loss = 1.762, top1 = 53.09%], valid : [loss = 2.178, top1 = 43.90%], test : [loss = 2.180, top1 = 43.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.637, top1 = 77.50%], valid : [loss = 0.704, top1 = 75.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14181/15625) 014181-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.581, top1 = 86.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.33 ms.
cifar10        train : [loss = 0.068, top1 = 97.92%], test  : [loss = 0.404, top1 = 88.90%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.25 ms.
cifar100       train : [loss = 0.700, top1 = 79.59%], valid : [loss = 1.373, top1 = 63.51%], test : [loss = 1.362, top1 = 63.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.46%], valid : [loss = 2.623, top1 = 34.08%], test : [loss = 2.658, top1 = 34.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.11%], valid : [loss = 0.769, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14182/15625) 014182-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.75%], valid : [loss = 0.528, top1 = 88.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.77 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.361, top1 = 91.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.99 ms.
cifar100       train : [loss = 0.428, top1 = 87.58%], valid : [loss = 1.242, top1 = 67.35%], test : [loss = 1.230, top1 = 67.29%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.02 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.41%], valid : [loss = 2.369, top1 = 39.73%], test : [loss = 2.387, top1 = 39.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.15%], valid : [loss = 0.836, top1 = 70.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14183/15625) 014183-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.534, top1 = 89.11%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.79 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.335, top1 = 92.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.47 ms.
cifar100       train : [loss = 0.186, top1 = 95.29%], valid : [loss = 1.448, top1 = 66.62%], test : [loss = 1.461, top1 = 66.39%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.74 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 37.53%], valid : [loss = 2.596, top1 = 33.63%], test : [loss = 2.595, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 66.25%], valid : [loss = 0.965, top1 = 65.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14184/15625) 014184-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.604, top1 = 78.86%], valid : [loss = 0.751, top1 = 74.68%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.41 ms.
cifar10        train : [loss = 0.494, top1 = 82.95%], test  : [loss = 0.574, top1 = 80.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.78 ms.
cifar100       train : [loss = 1.975, top1 = 46.60%], valid : [loss = 2.083, top1 = 44.57%], test : [loss = 2.106, top1 = 44.21%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.53 ms.
ImageNet16-120 train : [loss = 2.986, top1 = 26.87%], valid : [loss = 2.973, top1 = 27.30%], test : [loss = 3.009, top1 = 26.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.73%], valid : [loss = 1.201, top1 = 57.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14185/15625) 014185-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.547, top1 = 88.89%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.42 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.358, top1 = 92.02%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.64 ms.
cifar100       train : [loss = 0.197, top1 = 95.10%], valid : [loss = 1.329, top1 = 68.46%], test : [loss = 1.348, top1 = 67.69%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.94%], valid : [loss = 2.270, top1 = 42.32%], test : [loss = 2.293, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.18%], valid : [loss = 0.790, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14186/15625) 014186-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.25%], valid : [loss = 0.589, top1 = 85.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10        train : [loss = 0.106, top1 = 96.51%], test  : [loss = 0.397, top1 = 88.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 0.818, top1 = 76.06%], valid : [loss = 1.416, top1 = 62.11%], test : [loss = 1.403, top1 = 62.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.667, top1 = 33.17%], valid : [loss = 2.736, top1 = 31.71%], test : [loss = 2.803, top1 = 31.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 78.82%], valid : [loss = 0.672, top1 = 76.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14187/15625) 014187-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.23 ms.
cifar10-valid  train : [loss = 1.084, top1 = 61.65%], valid : [loss = 1.130, top1 = 60.40%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.05 ms.
cifar10        train : [loss = 1.054, top1 = 62.91%], test  : [loss = 1.051, top1 = 62.63%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.52 ms.
cifar100       train : [loss = 2.590, top1 = 34.61%], valid : [loss = 2.662, top1 = 33.62%], test : [loss = 2.645, top1 = 33.91%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.93 ms.
ImageNet16-120 train : [loss = 3.782, top1 = 13.74%], valid : [loss = 3.773, top1 = 14.48%], test : [loss = 3.790, top1 = 13.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14188/15625) 014188-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.578, top1 = 87.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.50 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.391, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.39 ms.
cifar100       train : [loss = 0.356, top1 = 90.02%], valid : [loss = 1.428, top1 = 64.98%], test : [loss = 1.421, top1 = 65.25%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.10%], valid : [loss = 2.465, top1 = 37.82%], test : [loss = 2.491, top1 = 37.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.784, top1 = 72.00%], valid : [loss = 0.841, top1 = 70.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14189/15625) 014189-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.96%], valid : [loss = 0.991, top1 = 65.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10        train : [loss = 0.803, top1 = 71.74%], test  : [loss = 0.885, top1 = 69.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.79 ms.
cifar100       train : [loss = 2.161, top1 = 43.50%], valid : [loss = 2.341, top1 = 40.44%], test : [loss = 2.360, top1 = 40.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.39 ms.
ImageNet16-120 train : [loss = 3.750, top1 = 14.13%], valid : [loss = 3.773, top1 = 14.51%], test : [loss = 3.789, top1 = 13.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.468, top1 = 45.82%], valid : [loss = 1.494, top1 = 45.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14190/15625) 014190-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.565, top1 = 88.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.08 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.390, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.148, top1 = 96.91%], valid : [loss = 1.491, top1 = 66.35%], test : [loss = 1.502, top1 = 66.27%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 1.984, top1 = 47.90%], valid : [loss = 2.465, top1 = 38.22%], test : [loss = 2.482, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.38%], valid : [loss = 0.697, top1 = 75.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14191/15625) 014191-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.571, top1 = 87.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.29 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.379, top1 = 91.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.67 ms.
cifar100       train : [loss = 0.380, top1 = 89.35%], valid : [loss = 1.407, top1 = 65.19%], test : [loss = 1.389, top1 = 65.77%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 2.289, top1 = 41.17%], valid : [loss = 2.495, top1 = 36.90%], test : [loss = 2.520, top1 = 37.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.97%], valid : [loss = 0.772, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14192/15625) 014192-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.501, top1 = 88.92%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.334, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.72 ms.
cifar100       train : [loss = 0.345, top1 = 90.71%], valid : [loss = 1.272, top1 = 67.09%], test : [loss = 1.296, top1 = 67.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.03%], valid : [loss = 2.398, top1 = 39.19%], test : [loss = 2.406, top1 = 38.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.02%], valid : [loss = 0.633, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14193/15625) 014193-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.60%], valid : [loss = 0.720, top1 = 81.64%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10        train : [loss = 0.145, top1 = 95.08%], test  : [loss = 0.459, top1 = 86.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 0.938, top1 = 72.70%], valid : [loss = 1.616, top1 = 57.49%], test : [loss = 1.609, top1 = 57.63%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 3.025, top1 = 25.84%], valid : [loss = 3.114, top1 = 25.21%], test : [loss = 3.147, top1 = 24.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.925, top1 = 66.88%], valid : [loss = 0.972, top1 = 65.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14194/15625) 014194-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.63 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.560, top1 = 87.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.98 ms.
cifar10        train : [loss = 0.028, top1 = 99.25%], test  : [loss = 0.353, top1 = 91.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.10 ms.
cifar100       train : [loss = 0.542, top1 = 84.46%], valid : [loss = 1.382, top1 = 63.67%], test : [loss = 1.364, top1 = 64.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.24 ms.
ImageNet16-120 train : [loss = 2.488, top1 = 36.54%], valid : [loss = 2.584, top1 = 34.77%], test : [loss = 2.599, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 68.00%], valid : [loss = 0.932, top1 = 67.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14195/15625) 014195-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.70%], valid : [loss = 0.541, top1 = 88.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.355, top1 = 91.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.53 ms.
cifar100       train : [loss = 0.415, top1 = 88.01%], valid : [loss = 1.254, top1 = 66.99%], test : [loss = 1.290, top1 = 66.53%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.233, top1 = 42.20%], valid : [loss = 2.412, top1 = 39.12%], test : [loss = 2.434, top1 = 38.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14196/15625) 014196-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.562, top1 = 88.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.11 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.359, top1 = 92.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.32 ms.
cifar100       train : [loss = 0.160, top1 = 96.14%], valid : [loss = 1.377, top1 = 67.69%], test : [loss = 1.408, top1 = 68.09%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.48 ms.
ImageNet16-120 train : [loss = 2.097, top1 = 45.23%], valid : [loss = 2.376, top1 = 39.91%], test : [loss = 2.385, top1 = 40.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.24%], valid : [loss = 0.976, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14197/15625) 014197-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.08 ms.
cifar10-valid  train : [loss = 0.797, top1 = 71.86%], valid : [loss = 0.976, top1 = 66.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.44 ms.
cifar10        train : [loss = 0.786, top1 = 72.32%], test  : [loss = 0.869, top1 = 69.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.81 ms.
cifar100       train : [loss = 2.124, top1 = 44.16%], valid : [loss = 2.289, top1 = 41.51%], test : [loss = 2.310, top1 = 41.26%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.25%], valid : [loss = 3.770, top1 = 14.91%], test : [loss = 3.778, top1 = 13.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.466, top1 = 46.26%], valid : [loss = 1.487, top1 = 45.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14198/15625) 014198-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10-valid  train : [loss = 0.433, top1 = 84.99%], valid : [loss = 0.688, top1 = 77.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10        train : [loss = 0.368, top1 = 87.26%], test  : [loss = 0.517, top1 = 82.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.58 ms.
cifar100       train : [loss = 1.570, top1 = 56.47%], valid : [loss = 1.836, top1 = 51.18%], test : [loss = 1.835, top1 = 51.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 3.278, top1 = 21.83%], valid : [loss = 3.283, top1 = 21.90%], test : [loss = 3.330, top1 = 21.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.25%], valid : [loss = 1.233, top1 = 55.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14199/15625) 014199-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.49%], valid : [loss = 0.458, top1 = 86.22%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.53 ms.
cifar10        train : [loss = 0.153, top1 = 94.98%], test  : [loss = 0.341, top1 = 88.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.69 ms.
cifar100       train : [loss = 0.980, top1 = 72.10%], valid : [loss = 1.325, top1 = 62.91%], test : [loss = 1.321, top1 = 62.91%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 34.04%], valid : [loss = 2.674, top1 = 33.03%], test : [loss = 2.698, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.05%], valid : [loss = 0.781, top1 = 72.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14200/15625) 014200-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.68 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.18%], valid : [loss = 0.509, top1 = 86.60%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.091, top1 = 97.05%], test  : [loss = 0.353, top1 = 90.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.51 ms.
cifar100       train : [loss = 0.677, top1 = 80.34%], valid : [loss = 1.220, top1 = 66.25%], test : [loss = 1.212, top1 = 66.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.90 ms.
ImageNet16-120 train : [loss = 2.316, top1 = 40.49%], valid : [loss = 2.437, top1 = 38.43%], test : [loss = 2.472, top1 = 38.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.79%], valid : [loss = 0.944, top1 = 66.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14201/15625) 014201-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.79%], valid : [loss = 0.448, top1 = 86.43%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.52 ms.
cifar10        train : [loss = 0.150, top1 = 95.18%], test  : [loss = 0.343, top1 = 89.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.88 ms.
cifar100       train : [loss = 0.938, top1 = 73.23%], valid : [loss = 1.318, top1 = 63.35%], test : [loss = 1.317, top1 = 62.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.43 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.28%], valid : [loss = 2.671, top1 = 33.47%], test : [loss = 2.698, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14202/15625) 014202-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.22 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.567, top1 = 87.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.383, top1 = 91.33%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.29 ms.
cifar100       train : [loss = 0.386, top1 = 89.11%], valid : [loss = 1.418, top1 = 64.91%], test : [loss = 1.389, top1 = 65.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.19%], valid : [loss = 2.502, top1 = 36.60%], test : [loss = 2.522, top1 = 37.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.97%], valid : [loss = 0.772, top1 = 72.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14203/15625) 014203-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.92%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.83 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.291, top1 = 93.65%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.43 ms.
cifar100       train : [loss = 0.065, top1 = 99.03%], valid : [loss = 1.344, top1 = 70.63%], test : [loss = 1.323, top1 = 70.86%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.83 ms.
ImageNet16-120 train : [loss = 1.535, top1 = 58.54%], valid : [loss = 2.249, top1 = 43.72%], test : [loss = 2.261, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.338, top1 = 88.62%], valid : [loss = 0.480, top1 = 84.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14204/15625) 014204-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.417, top1 = 90.58%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.33 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.278, top1 = 93.23%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.08 ms.
cifar100       train : [loss = 0.152, top1 = 96.65%], valid : [loss = 1.272, top1 = 70.26%], test : [loss = 1.262, top1 = 69.95%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 1.754, top1 = 53.20%], valid : [loss = 2.214, top1 = 43.20%], test : [loss = 2.248, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.24%], valid : [loss = 0.496, top1 = 83.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14205/15625) 014205-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.28 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.04 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.51 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14206/15625) 014206-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10-valid  train : [loss = 0.531, top1 = 81.32%], valid : [loss = 0.858, top1 = 71.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 0.555, top1 = 80.67%], test  : [loss = 0.716, top1 = 75.50%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.61 ms.
cifar100       train : [loss = 1.770, top1 = 52.17%], valid : [loss = 2.043, top1 = 47.63%], test : [loss = 2.080, top1 = 46.40%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.72 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.81%], valid : [loss = 3.644, top1 = 16.38%], test : [loss = 3.657, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14207/15625) 014207-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.75%], valid : [loss = 0.547, top1 = 88.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.71 ms.
cifar10        train : [loss = 0.026, top1 = 99.25%], test  : [loss = 0.343, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.18 ms.
cifar100       train : [loss = 0.433, top1 = 87.45%], valid : [loss = 1.237, top1 = 66.89%], test : [loss = 1.244, top1 = 67.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.89 ms.
ImageNet16-120 train : [loss = 2.175, top1 = 43.68%], valid : [loss = 2.375, top1 = 39.37%], test : [loss = 2.374, top1 = 39.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.54%], valid : [loss = 0.814, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14208/15625) 014208-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.59 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.545, top1 = 87.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.368, top1 = 91.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.98 ms.
cifar100       train : [loss = 0.534, top1 = 84.50%], valid : [loss = 1.368, top1 = 64.05%], test : [loss = 1.362, top1 = 64.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.78%], valid : [loss = 2.441, top1 = 37.53%], test : [loss = 2.455, top1 = 37.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 70.07%], valid : [loss = 0.878, top1 = 69.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14209/15625) 014209-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.468, top1 = 89.40%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.05 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.333, top1 = 91.85%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.96 ms.
cifar100       train : [loss = 0.372, top1 = 89.43%], valid : [loss = 1.316, top1 = 67.15%], test : [loss = 1.306, top1 = 67.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.95%], valid : [loss = 2.365, top1 = 39.76%], test : [loss = 2.395, top1 = 39.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.88%], valid : [loss = 0.651, top1 = 77.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14210/15625) 014210-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.577, top1 = 88.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.39 ms.
cifar10        train : [loss = 0.013, top1 = 99.64%], test  : [loss = 0.393, top1 = 91.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.74 ms.
cifar100       train : [loss = 0.354, top1 = 90.08%], valid : [loss = 1.458, top1 = 64.06%], test : [loss = 1.457, top1 = 64.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 36.82%], valid : [loss = 2.588, top1 = 34.57%], test : [loss = 2.611, top1 = 34.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.38%], valid : [loss = 1.098, top1 = 60.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14211/15625) 014211-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.64%], valid : [loss = 0.848, top1 = 72.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.71 ms.
cifar10        train : [loss = 0.547, top1 = 80.88%], test  : [loss = 0.704, top1 = 76.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.02 ms.
cifar100       train : [loss = 1.789, top1 = 51.81%], valid : [loss = 2.061, top1 = 46.85%], test : [loss = 2.080, top1 = 46.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.87%], valid : [loss = 3.644, top1 = 16.37%], test : [loss = 3.676, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 56.36%], valid : [loss = 1.273, top1 = 54.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14212/15625) 014212-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.70%], valid : [loss = 0.455, top1 = 86.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10        train : [loss = 0.149, top1 = 95.23%], test  : [loss = 0.354, top1 = 88.80%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 0.985, top1 = 71.97%], valid : [loss = 1.353, top1 = 62.09%], test : [loss = 1.355, top1 = 61.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.23%], valid : [loss = 2.652, top1 = 33.97%], test : [loss = 2.690, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14213/15625) 014213-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.85%], valid : [loss = 0.636, top1 = 86.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10        train : [loss = 0.027, top1 = 99.36%], test  : [loss = 0.425, top1 = 89.41%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.28 ms.
cifar100       train : [loss = 0.361, top1 = 90.45%], valid : [loss = 1.445, top1 = 64.77%], test : [loss = 1.418, top1 = 64.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.277, top1 = 41.42%], valid : [loss = 2.589, top1 = 35.39%], test : [loss = 2.615, top1 = 35.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.70%], valid : [loss = 0.765, top1 = 73.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14214/15625) 014214-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.462, top1 = 89.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.58 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.313, top1 = 92.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.15 ms.
cifar100       train : [loss = 0.199, top1 = 95.06%], valid : [loss = 1.386, top1 = 67.37%], test : [loss = 1.363, top1 = 67.73%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.58%], valid : [loss = 2.320, top1 = 41.37%], test : [loss = 2.353, top1 = 41.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.26%], valid : [loss = 0.590, top1 = 80.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14215/15625) 014215-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.335, top1 = 91.95%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.84 ms.
cifar100       train : [loss = 0.340, top1 = 90.67%], valid : [loss = 1.291, top1 = 66.99%], test : [loss = 1.295, top1 = 67.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.90%], valid : [loss = 2.431, top1 = 38.88%], test : [loss = 2.427, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14216/15625) 014216-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.21 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.466, top1 = 89.39%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.308, top1 = 92.35%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.97 ms.
cifar100       train : [loss = 0.313, top1 = 91.63%], valid : [loss = 1.247, top1 = 67.69%], test : [loss = 1.237, top1 = 67.97%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.974, top1 = 48.09%], valid : [loss = 2.291, top1 = 41.30%], test : [loss = 2.295, top1 = 41.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.522, top1 = 81.74%], valid : [loss = 0.621, top1 = 78.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14217/15625) 014217-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.93 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.467, top1 = 89.97%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.30 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.289, top1 = 93.33%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.42 ms.
cifar100       train : [loss = 0.112, top1 = 97.98%], valid : [loss = 1.257, top1 = 70.32%], test : [loss = 1.233, top1 = 70.82%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 1.664, top1 = 55.33%], valid : [loss = 2.148, top1 = 45.44%], test : [loss = 2.158, top1 = 45.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.495, top1 = 83.09%], valid : [loss = 0.590, top1 = 79.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14218/15625) 014218-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.76%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.297, top1 = 93.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.06 ms.
cifar100       train : [loss = 0.065, top1 = 99.00%], valid : [loss = 1.372, top1 = 70.19%], test : [loss = 1.355, top1 = 70.13%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.30 ms.
ImageNet16-120 train : [loss = 1.523, top1 = 58.76%], valid : [loss = 2.238, top1 = 43.71%], test : [loss = 2.249, top1 = 44.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.04%], valid : [loss = 0.514, top1 = 82.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14219/15625) 014219-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.493, top1 = 88.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.323, top1 = 92.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.08 ms.
cifar100       train : [loss = 0.312, top1 = 91.67%], valid : [loss = 1.285, top1 = 67.27%], test : [loss = 1.262, top1 = 67.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 2.035, top1 = 46.72%], valid : [loss = 2.314, top1 = 40.13%], test : [loss = 2.335, top1 = 40.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14220/15625) 014220-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.466, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.31 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.314, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.322, top1 = 91.21%], valid : [loss = 1.302, top1 = 67.13%], test : [loss = 1.298, top1 = 67.63%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.042, top1 = 46.63%], valid : [loss = 2.357, top1 = 39.73%], test : [loss = 2.394, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.470, top1 = 83.66%], valid : [loss = 0.563, top1 = 81.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14221/15625) 014221-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.486, top1 = 89.36%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.74 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.314, top1 = 92.32%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.17 ms.
cifar100       train : [loss = 0.242, top1 = 93.82%], valid : [loss = 1.257, top1 = 68.24%], test : [loss = 1.273, top1 = 68.84%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.62%], valid : [loss = 2.184, top1 = 43.53%], test : [loss = 2.201, top1 = 43.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.99%], valid : [loss = 0.690, top1 = 76.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14222/15625) 014222-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.664, top1 = 85.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.95 ms.
cifar10        train : [loss = 0.038, top1 = 98.88%], test  : [loss = 0.422, top1 = 89.44%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.27 ms.
cifar100       train : [loss = 0.395, top1 = 89.12%], valid : [loss = 1.571, top1 = 62.41%], test : [loss = 1.553, top1 = 62.69%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.58 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.12%], valid : [loss = 2.631, top1 = 34.02%], test : [loss = 2.654, top1 = 35.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.69%], valid : [loss = 0.817, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14223/15625) 014223-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.522, top1 = 88.62%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.347, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.44 ms.
cifar100       train : [loss = 0.283, top1 = 92.35%], valid : [loss = 1.310, top1 = 67.30%], test : [loss = 1.317, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.75 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.60%], valid : [loss = 2.419, top1 = 38.42%], test : [loss = 2.430, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.81%], valid : [loss = 0.870, top1 = 69.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14224/15625) 014224-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.80 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.498, top1 = 90.08%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.43 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.304, top1 = 93.49%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.87 ms.
cifar100       train : [loss = 0.094, top1 = 98.08%], valid : [loss = 1.379, top1 = 69.39%], test : [loss = 1.338, top1 = 69.65%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 55.95%], valid : [loss = 2.150, top1 = 45.40%], test : [loss = 2.140, top1 = 44.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.52%], valid : [loss = 0.725, top1 = 75.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14225/15625) 014225-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.246, top1 = 91.44%], valid : [loss = 0.842, top1 = 76.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10        train : [loss = 0.292, top1 = 89.88%], test  : [loss = 0.615, top1 = 80.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.05 ms.
cifar100       train : [loss = 1.283, top1 = 63.48%], valid : [loss = 1.854, top1 = 51.18%], test : [loss = 1.866, top1 = 51.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 3.464, top1 = 17.97%], valid : [loss = 3.495, top1 = 17.87%], test : [loss = 3.501, top1 = 17.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.158, top1 = 58.21%], valid : [loss = 1.209, top1 = 56.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14226/15625) 014226-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.582, top1 = 88.29%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.35 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.369, top1 = 91.88%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.62 ms.
cifar100       train : [loss = 0.098, top1 = 98.40%], valid : [loss = 1.452, top1 = 67.87%], test : [loss = 1.447, top1 = 67.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.12 ms.
ImageNet16-120 train : [loss = 1.876, top1 = 50.47%], valid : [loss = 2.397, top1 = 40.30%], test : [loss = 2.425, top1 = 39.95%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.47%], valid : [loss = 0.727, top1 = 74.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14227/15625) 014227-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.441, top1 = 89.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.312, top1 = 92.15%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.03 ms.
cifar100       train : [loss = 0.320, top1 = 91.38%], valid : [loss = 1.277, top1 = 67.92%], test : [loss = 1.289, top1 = 67.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.42%], valid : [loss = 2.354, top1 = 40.29%], test : [loss = 2.399, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.20%], valid : [loss = 0.555, top1 = 81.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14228/15625) 014228-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.447, top1 = 90.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.09 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.294, top1 = 93.73%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.20 ms.
cifar100       train : [loss = 0.066, top1 = 99.01%], valid : [loss = 1.360, top1 = 70.01%], test : [loss = 1.341, top1 = 70.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 1.531, top1 = 58.65%], valid : [loss = 2.260, top1 = 43.60%], test : [loss = 2.271, top1 = 43.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.391, top1 = 86.47%], valid : [loss = 0.519, top1 = 82.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14229/15625) 014229-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.540, top1 = 88.97%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.75 ms.
cifar10        train : [loss = 0.010, top1 = 99.75%], test  : [loss = 0.341, top1 = 92.50%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.43 ms.
cifar100       train : [loss = 0.148, top1 = 96.51%], valid : [loss = 1.344, top1 = 68.35%], test : [loss = 1.340, top1 = 69.11%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 2.346, top1 = 39.56%], valid : [loss = 2.503, top1 = 35.90%], test : [loss = 2.500, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.75%], valid : [loss = 0.985, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14230/15625) 014230-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.55%], valid : [loss = 0.551, top1 = 87.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.032, top1 = 99.03%], test  : [loss = 0.370, top1 = 90.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.94 ms.
cifar100       train : [loss = 0.507, top1 = 85.35%], valid : [loss = 1.334, top1 = 64.83%], test : [loss = 1.329, top1 = 65.39%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.553, top1 = 35.08%], valid : [loss = 2.637, top1 = 33.35%], test : [loss = 2.655, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14231/15625) 014231-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.64%], valid : [loss = 0.631, top1 = 78.84%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.89 ms.
cifar10        train : [loss = 0.507, top1 = 82.44%], test  : [loss = 0.591, top1 = 80.09%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.06 ms.
cifar100       train : [loss = 1.679, top1 = 54.26%], valid : [loss = 1.851, top1 = 50.81%], test : [loss = 1.850, top1 = 50.65%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.21 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.48%], valid : [loss = 3.314, top1 = 21.90%], test : [loss = 3.349, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14232/15625) 014232-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.30 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.453, top1 = 89.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.312, top1 = 92.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.75 ms.
cifar100       train : [loss = 0.120, top1 = 97.53%], valid : [loss = 1.382, top1 = 68.75%], test : [loss = 1.382, top1 = 68.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 1.750, top1 = 53.40%], valid : [loss = 2.268, top1 = 42.62%], test : [loss = 2.297, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.62%], valid : [loss = 0.581, top1 = 80.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14233/15625) 014233-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.49%], valid : [loss = 0.590, top1 = 87.28%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.26 ms.
cifar10        train : [loss = 0.018, top1 = 99.50%], test  : [loss = 0.398, top1 = 91.09%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.68 ms.
cifar100       train : [loss = 0.379, top1 = 89.17%], valid : [loss = 1.494, top1 = 63.21%], test : [loss = 1.491, top1 = 63.03%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.65 ms.
ImageNet16-120 train : [loss = 2.838, top1 = 28.83%], valid : [loss = 2.913, top1 = 27.87%], test : [loss = 2.922, top1 = 26.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.335, top1 = 51.10%], valid : [loss = 1.343, top1 = 50.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14234/15625) 014234-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.547, top1 = 88.26%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.71 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.383, top1 = 91.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.84 ms.
cifar100       train : [loss = 0.107, top1 = 97.85%], valid : [loss = 1.540, top1 = 66.40%], test : [loss = 1.557, top1 = 66.27%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 1.970, top1 = 48.38%], valid : [loss = 2.394, top1 = 39.52%], test : [loss = 2.456, top1 = 39.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 74.12%], valid : [loss = 0.803, top1 = 72.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14235/15625) 014235-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.074, top1 = 98.12%], valid : [loss = 0.463, top1 = 86.60%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.01 ms.
cifar10        train : [loss = 0.108, top1 = 96.71%], test  : [loss = 0.342, top1 = 89.34%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.49 ms.
cifar100       train : [loss = 0.696, top1 = 80.69%], valid : [loss = 1.281, top1 = 65.21%], test : [loss = 1.279, top1 = 64.96%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 2.457, top1 = 37.57%], valid : [loss = 2.566, top1 = 35.07%], test : [loss = 2.571, top1 = 35.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.16%], valid : [loss = 0.803, top1 = 71.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14236/15625) 014236-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.645, top1 = 86.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10        train : [loss = 0.025, top1 = 99.33%], test  : [loss = 0.424, top1 = 90.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.287, top1 = 92.33%], valid : [loss = 1.514, top1 = 64.72%], test : [loss = 1.522, top1 = 64.61%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.64%], valid : [loss = 2.564, top1 = 35.48%], test : [loss = 2.586, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.759, top1 = 72.82%], valid : [loss = 0.821, top1 = 71.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14237/15625) 014237-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.222, top1 = 92.42%], valid : [loss = 0.552, top1 = 83.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10        train : [loss = 0.224, top1 = 92.32%], test  : [loss = 0.414, top1 = 86.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 1.205, top1 = 65.74%], valid : [loss = 1.569, top1 = 58.01%], test : [loss = 1.564, top1 = 57.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.939, top1 = 28.28%], valid : [loss = 2.973, top1 = 27.64%], test : [loss = 3.035, top1 = 27.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.151, top1 = 58.36%], valid : [loss = 1.209, top1 = 56.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14238/15625) 014238-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.570, top1 = 87.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.021, top1 = 99.48%], test  : [loss = 0.383, top1 = 90.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 0.441, top1 = 87.30%], valid : [loss = 1.383, top1 = 65.23%], test : [loss = 1.372, top1 = 65.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.327, top1 = 40.31%], valid : [loss = 2.521, top1 = 36.87%], test : [loss = 2.534, top1 = 37.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.78%], valid : [loss = 0.799, top1 = 72.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14239/15625) 014239-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.90 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.548, top1 = 89.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.28 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.351, top1 = 92.77%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.07 ms.
cifar100       train : [loss = 0.047, top1 = 99.50%], valid : [loss = 1.410, top1 = 69.53%], test : [loss = 1.443, top1 = 69.22%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.52%], valid : [loss = 2.423, top1 = 40.62%], test : [loss = 2.414, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.93%], valid : [loss = 0.753, top1 = 73.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14240/15625) 014240-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.511, top1 = 89.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.329, top1 = 92.44%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.21 ms.
cifar100       train : [loss = 0.152, top1 = 96.80%], valid : [loss = 1.271, top1 = 69.53%], test : [loss = 1.274, top1 = 69.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.63%], valid : [loss = 2.335, top1 = 40.68%], test : [loss = 2.304, top1 = 41.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14241/15625) 014241-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.18%], valid : [loss = 0.482, top1 = 84.41%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10        train : [loss = 0.295, top1 = 90.09%], test  : [loss = 0.394, top1 = 86.49%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.31 ms.
cifar100       train : [loss = 1.317, top1 = 63.43%], valid : [loss = 1.524, top1 = 58.22%], test : [loss = 1.500, top1 = 58.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.79%], valid : [loss = 2.891, top1 = 29.37%], test : [loss = 2.955, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14242/15625) 014242-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.509, top1 = 89.00%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.022, top1 = 99.40%], test  : [loss = 0.358, top1 = 91.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.60 ms.
cifar100       train : [loss = 0.350, top1 = 90.06%], valid : [loss = 1.339, top1 = 66.84%], test : [loss = 1.315, top1 = 66.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.044, top1 = 46.49%], valid : [loss = 2.312, top1 = 40.82%], test : [loss = 2.327, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.559, top1 = 80.25%], valid : [loss = 0.631, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14243/15625) 014243-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.66%], valid : [loss = 0.460, top1 = 85.99%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.97 ms.
cifar10        train : [loss = 0.154, top1 = 95.01%], test  : [loss = 0.345, top1 = 88.81%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.30 ms.
cifar100       train : [loss = 0.967, top1 = 72.60%], valid : [loss = 1.341, top1 = 62.63%], test : [loss = 1.332, top1 = 62.98%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.10%], valid : [loss = 2.681, top1 = 32.93%], test : [loss = 2.706, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14244/15625) 014244-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=22.23 ms.
cifar10-valid  train : [loss = 0.077, top1 = 98.05%], valid : [loss = 0.462, top1 = 86.59%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=20.77 ms.
cifar10        train : [loss = 0.114, top1 = 96.50%], test  : [loss = 0.336, top1 = 89.45%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=20.86 ms.
cifar100       train : [loss = 0.752, top1 = 78.91%], valid : [loss = 1.278, top1 = 64.71%], test : [loss = 1.274, top1 = 64.54%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=21.18 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.11%], valid : [loss = 2.587, top1 = 35.13%], test : [loss = 2.598, top1 = 34.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.90%], valid : [loss = 0.863, top1 = 69.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14245/15625) 014245-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.596, top1 = 88.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.405, top1 = 91.69%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.07 ms.
cifar100       train : [loss = 0.145, top1 = 96.98%], valid : [loss = 1.474, top1 = 67.04%], test : [loss = 1.454, top1 = 67.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.36 ms.
ImageNet16-120 train : [loss = 1.998, top1 = 47.58%], valid : [loss = 2.465, top1 = 38.62%], test : [loss = 2.462, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.03%], valid : [loss = 0.791, top1 = 72.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14246/15625) 014246-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10-valid  train : [loss = 0.283, top1 = 90.32%], valid : [loss = 0.844, top1 = 75.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.296, top1 = 89.71%], test  : [loss = 0.601, top1 = 81.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 1.343, top1 = 62.29%], valid : [loss = 1.936, top1 = 50.12%], test : [loss = 1.922, top1 = 50.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.78 ms.
ImageNet16-120 train : [loss = 3.510, top1 = 17.01%], valid : [loss = 3.517, top1 = 17.53%], test : [loss = 3.532, top1 = 16.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 53.28%], valid : [loss = 1.309, top1 = 52.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14247/15625) 014247-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.640, top1 = 86.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.53 ms.
cifar10        train : [loss = 0.023, top1 = 99.38%], test  : [loss = 0.419, top1 = 90.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.99 ms.
cifar100       train : [loss = 0.311, top1 = 91.65%], valid : [loss = 1.610, top1 = 63.00%], test : [loss = 1.627, top1 = 62.32%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.77 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 43.03%], valid : [loss = 2.590, top1 = 35.62%], test : [loss = 2.608, top1 = 35.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.26%], valid : [loss = 0.820, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14248/15625) 014248-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.286, top1 = 90.11%], valid : [loss = 0.554, top1 = 82.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.265, top1 = 90.91%], test  : [loss = 0.419, top1 = 86.33%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.28 ms.
cifar100       train : [loss = 1.387, top1 = 60.95%], valid : [loss = 1.640, top1 = 55.25%], test : [loss = 1.633, top1 = 55.41%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.814, top1 = 30.35%], valid : [loss = 2.825, top1 = 29.71%], test : [loss = 2.873, top1 = 29.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.25%], valid : [loss = 1.035, top1 = 62.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14249/15625) 014249-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.35%], valid : [loss = 0.457, top1 = 86.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10        train : [loss = 0.153, top1 = 95.00%], test  : [loss = 0.342, top1 = 88.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.984, top1 = 72.00%], valid : [loss = 1.348, top1 = 62.32%], test : [loss = 1.341, top1 = 62.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.60%], valid : [loss = 2.706, top1 = 32.32%], test : [loss = 2.706, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14250/15625) 014250-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.71%], valid : [loss = 0.453, top1 = 86.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.04 ms.
cifar10        train : [loss = 0.148, top1 = 95.18%], test  : [loss = 0.341, top1 = 88.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.87 ms.
cifar100       train : [loss = 0.967, top1 = 72.57%], valid : [loss = 1.349, top1 = 62.87%], test : [loss = 1.333, top1 = 62.13%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.45%], valid : [loss = 2.658, top1 = 33.28%], test : [loss = 2.684, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.34%], valid : [loss = 0.769, top1 = 72.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14251/15625) 014251-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.492, top1 = 89.77%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.310, top1 = 93.03%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.78 ms.
cifar100       train : [loss = 0.132, top1 = 97.33%], valid : [loss = 1.291, top1 = 69.08%], test : [loss = 1.308, top1 = 69.40%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.18 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 51.90%], valid : [loss = 2.273, top1 = 42.02%], test : [loss = 2.276, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.69%], valid : [loss = 0.680, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14252/15625) 014252-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.00 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.92 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.06 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14253/15625) 014253-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.412, top1 = 90.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.91 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.269, top1 = 93.48%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.83 ms.
cifar100       train : [loss = 0.128, top1 = 97.38%], valid : [loss = 1.270, top1 = 70.33%], test : [loss = 1.251, top1 = 70.86%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.80 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.52%], valid : [loss = 2.195, top1 = 44.08%], test : [loss = 2.230, top1 = 44.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.36%], valid : [loss = 0.521, top1 = 82.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14254/15625) 014254-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.80%], valid : [loss = 0.438, top1 = 86.55%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.23 ms.
cifar10        train : [loss = 0.164, top1 = 94.63%], test  : [loss = 0.327, top1 = 89.27%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.85 ms.
cifar100       train : [loss = 0.964, top1 = 72.58%], valid : [loss = 1.301, top1 = 63.68%], test : [loss = 1.273, top1 = 63.73%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.707, top1 = 32.65%], valid : [loss = 2.704, top1 = 32.83%], test : [loss = 2.743, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.005, top1 = 64.24%], valid : [loss = 1.028, top1 = 63.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14255/15625) 014255-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.507, top1 = 89.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.11 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.332, top1 = 92.80%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.89 ms.
cifar100       train : [loss = 0.148, top1 = 96.93%], valid : [loss = 1.302, top1 = 68.40%], test : [loss = 1.306, top1 = 69.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.76 ms.
ImageNet16-120 train : [loss = 1.855, top1 = 50.79%], valid : [loss = 2.295, top1 = 42.10%], test : [loss = 2.301, top1 = 42.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.08%], valid : [loss = 0.690, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14256/15625) 014256-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.503, top1 = 88.82%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.74 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.347, top1 = 91.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.75 ms.
cifar100       train : [loss = 0.358, top1 = 90.05%], valid : [loss = 1.256, top1 = 67.16%], test : [loss = 1.287, top1 = 66.94%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.91%], valid : [loss = 2.404, top1 = 39.27%], test : [loss = 2.416, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14257/15625) 014257-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.547, top1 = 81.10%], valid : [loss = 0.860, top1 = 71.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10        train : [loss = 0.553, top1 = 80.63%], test  : [loss = 0.713, top1 = 76.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.19 ms.
cifar100       train : [loss = 1.795, top1 = 51.59%], valid : [loss = 2.036, top1 = 47.24%], test : [loss = 2.069, top1 = 46.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.75%], valid : [loss = 3.650, top1 = 17.07%], test : [loss = 3.671, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14258/15625) 014258-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.485, top1 = 88.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.44 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.314, top1 = 92.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.39 ms.
cifar100       train : [loss = 0.235, top1 = 94.20%], valid : [loss = 1.231, top1 = 68.74%], test : [loss = 1.260, top1 = 68.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.10 ms.
ImageNet16-120 train : [loss = 1.906, top1 = 49.74%], valid : [loss = 2.248, top1 = 42.31%], test : [loss = 2.269, top1 = 42.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.74%], valid : [loss = 0.666, top1 = 77.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14259/15625) 014259-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.29 ms.
cifar10-valid  train : [loss = 0.543, top1 = 80.98%], valid : [loss = 0.856, top1 = 71.70%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.88 ms.
cifar10        train : [loss = 0.564, top1 = 80.33%], test  : [loss = 0.725, top1 = 75.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.54 ms.
cifar100       train : [loss = 1.780, top1 = 52.18%], valid : [loss = 2.055, top1 = 46.71%], test : [loss = 2.050, top1 = 46.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.38 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.73%], valid : [loss = 3.646, top1 = 16.59%], test : [loss = 3.674, top1 = 15.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14260/15625) 014260-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.580, top1 = 87.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.036, top1 = 98.97%], test  : [loss = 0.379, top1 = 90.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.77 ms.
cifar100       train : [loss = 0.624, top1 = 81.93%], valid : [loss = 1.426, top1 = 62.50%], test : [loss = 1.417, top1 = 63.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.06%], valid : [loss = 2.647, top1 = 33.50%], test : [loss = 2.679, top1 = 33.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14261/15625) 014261-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.563, top1 = 88.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.383, top1 = 91.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.36 ms.
cifar100       train : [loss = 0.210, top1 = 94.77%], valid : [loss = 1.446, top1 = 66.67%], test : [loss = 1.425, top1 = 66.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.31%], valid : [loss = 2.429, top1 = 38.92%], test : [loss = 2.440, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.641, top1 = 77.09%], valid : [loss = 0.725, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14262/15625) 014262-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.92 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.534, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.28 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.358, top1 = 91.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.21 ms.
cifar100       train : [loss = 0.447, top1 = 87.02%], valid : [loss = 1.294, top1 = 66.40%], test : [loss = 1.284, top1 = 66.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 2.203, top1 = 43.04%], valid : [loss = 2.368, top1 = 40.37%], test : [loss = 2.373, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14263/15625) 014263-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.17%], valid : [loss = 0.539, top1 = 84.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10        train : [loss = 0.182, top1 = 93.84%], test  : [loss = 0.392, top1 = 87.68%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 1.159, top1 = 66.84%], valid : [loss = 1.508, top1 = 58.91%], test : [loss = 1.507, top1 = 58.92%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.50 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.74%], valid : [loss = 2.707, top1 = 32.83%], test : [loss = 2.758, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.904, top1 = 67.50%], valid : [loss = 0.952, top1 = 66.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14264/15625) 014264-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.668 MB, latency=19.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.527, top1 = 89.08%]
cifar10        FLOP= 94.29 M, Params=0.668 MB, latency=19.02 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.358, top1 = 92.36%]
cifar100       FLOP= 94.30 M, Params=0.674 MB, latency=17.69 ms.
cifar100       train : [loss = 0.116, top1 = 97.78%], valid : [loss = 1.436, top1 = 68.23%], test : [loss = 1.407, top1 = 68.00%]
ImageNet16-120 FLOP= 23.58 M, Params=0.676 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 50.93%], valid : [loss = 2.404, top1 = 40.10%], test : [loss = 2.408, top1 = 40.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.13%], valid : [loss = 0.696, top1 = 75.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14265/15625) 014265-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.469, top1 = 88.89%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.312, top1 = 92.53%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.75 ms.
cifar100       train : [loss = 0.332, top1 = 91.14%], valid : [loss = 1.251, top1 = 67.50%], test : [loss = 1.283, top1 = 67.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.99 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.18%], valid : [loss = 2.267, top1 = 40.80%], test : [loss = 2.316, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.86%], valid : [loss = 0.629, top1 = 78.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14266/15625) 014266-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.43%], valid : [loss = 0.468, top1 = 86.64%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.48 ms.
cifar10        train : [loss = 0.116, top1 = 96.38%], test  : [loss = 0.330, top1 = 89.30%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.99 ms.
cifar100       train : [loss = 0.869, top1 = 75.19%], valid : [loss = 1.306, top1 = 64.44%], test : [loss = 1.279, top1 = 63.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 2.574, top1 = 35.21%], valid : [loss = 2.609, top1 = 35.23%], test : [loss = 2.656, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14267/15625) 014267-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.64%], valid : [loss = 0.455, top1 = 86.38%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=16.35 ms.
cifar10        train : [loss = 0.150, top1 = 95.08%], test  : [loss = 0.339, top1 = 89.02%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=17.10 ms.
cifar100       train : [loss = 0.974, top1 = 72.37%], valid : [loss = 1.340, top1 = 62.72%], test : [loss = 1.338, top1 = 62.33%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.58%], valid : [loss = 2.652, top1 = 33.23%], test : [loss = 2.675, top1 = 32.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.64%], valid : [loss = 0.787, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14268/15625) 014268-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.483, top1 = 89.39%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.84 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.313, top1 = 92.53%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.57 ms.
cifar100       train : [loss = 0.250, top1 = 93.51%], valid : [loss = 1.249, top1 = 69.18%], test : [loss = 1.239, top1 = 69.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.96 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.86%], valid : [loss = 2.234, top1 = 42.60%], test : [loss = 2.221, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.39%], valid : [loss = 0.629, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14269/15625) 014269-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.35%], valid : [loss = 0.459, top1 = 86.05%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.45 ms.
cifar10        train : [loss = 0.168, top1 = 94.39%], test  : [loss = 0.354, top1 = 88.42%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.09 ms.
cifar100       train : [loss = 1.007, top1 = 71.39%], valid : [loss = 1.384, top1 = 61.48%], test : [loss = 1.380, top1 = 61.42%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.57%], valid : [loss = 2.742, top1 = 31.17%], test : [loss = 2.715, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14270/15625) 014270-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.628, top1 = 86.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.17 ms.
cifar10        train : [loss = 0.030, top1 = 99.23%], test  : [loss = 0.427, top1 = 89.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 0.394, top1 = 89.24%], valid : [loss = 1.445, top1 = 63.76%], test : [loss = 1.422, top1 = 64.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.284, top1 = 41.16%], valid : [loss = 2.603, top1 = 35.47%], test : [loss = 2.615, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.42%], valid : [loss = 0.769, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14271/15625) 014271-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.567, top1 = 88.05%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.358, top1 = 91.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.55 ms.
cifar100       train : [loss = 0.296, top1 = 91.58%], valid : [loss = 1.377, top1 = 66.60%], test : [loss = 1.359, top1 = 66.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.28 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.19%], valid : [loss = 2.446, top1 = 38.28%], test : [loss = 2.447, top1 = 38.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.66%], valid : [loss = 0.867, top1 = 69.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14272/15625) 014272-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.493, top1 = 89.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.89 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.350, top1 = 92.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.78 ms.
cifar100       train : [loss = 0.083, top1 = 98.53%], valid : [loss = 1.441, top1 = 69.12%], test : [loss = 1.429, top1 = 69.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 1.727, top1 = 54.12%], valid : [loss = 2.405, top1 = 41.00%], test : [loss = 2.413, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 83.95%], valid : [loss = 0.586, top1 = 80.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14273/15625) 014273-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.590, top1 = 88.31%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.39 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.376, top1 = 92.34%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.35 ms.
cifar100       train : [loss = 0.101, top1 = 98.17%], valid : [loss = 1.504, top1 = 67.68%], test : [loss = 1.510, top1 = 67.58%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.24 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.58%], valid : [loss = 2.446, top1 = 38.97%], test : [loss = 2.472, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.80%], valid : [loss = 0.784, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14274/15625) 014274-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.527, top1 = 89.08%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.351, top1 = 92.15%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.79 ms.
cifar100       train : [loss = 0.214, top1 = 94.43%], valid : [loss = 1.268, top1 = 68.68%], test : [loss = 1.289, top1 = 68.54%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.51%], valid : [loss = 2.213, top1 = 43.37%], test : [loss = 2.218, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.93%], valid : [loss = 0.770, top1 = 73.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14275/15625) 014275-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.36%], valid : [loss = 0.461, top1 = 86.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.61 ms.
cifar10        train : [loss = 0.157, top1 = 94.78%], test  : [loss = 0.346, top1 = 88.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=23.23 ms.
cifar100       train : [loss = 0.991, top1 = 71.75%], valid : [loss = 1.367, top1 = 61.72%], test : [loss = 1.360, top1 = 61.76%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.81%], valid : [loss = 2.705, top1 = 32.20%], test : [loss = 2.720, top1 = 31.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.33%], valid : [loss = 0.787, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14276/15625) 014276-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.202, top1 = 93.30%], valid : [loss = 0.485, top1 = 84.80%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.43 ms.
cifar10        train : [loss = 0.268, top1 = 90.79%], test  : [loss = 0.425, top1 = 86.05%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.92 ms.
cifar100       train : [loss = 1.258, top1 = 64.71%], valid : [loss = 1.553, top1 = 57.86%], test : [loss = 1.538, top1 = 56.76%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 2.851, top1 = 29.41%], valid : [loss = 2.871, top1 = 28.90%], test : [loss = 2.882, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 59.67%], valid : [loss = 1.123, top1 = 59.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14277/15625) 014277-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.574, top1 = 87.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.74 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.393, top1 = 91.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.91 ms.
cifar100       train : [loss = 0.171, top1 = 95.99%], valid : [loss = 1.538, top1 = 65.55%], test : [loss = 1.545, top1 = 65.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.36 ms.
ImageNet16-120 train : [loss = 2.069, top1 = 46.03%], valid : [loss = 2.444, top1 = 38.50%], test : [loss = 2.468, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.50%], valid : [loss = 0.802, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14278/15625) 014278-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.682, top1 = 86.24%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.38 ms.
cifar10        train : [loss = 0.015, top1 = 99.61%], test  : [loss = 0.411, top1 = 90.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.191, top1 = 95.31%], valid : [loss = 1.587, top1 = 64.18%], test : [loss = 1.590, top1 = 64.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.38 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.79%], valid : [loss = 2.468, top1 = 39.03%], test : [loss = 2.467, top1 = 37.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.65%], valid : [loss = 0.814, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14279/15625) 014279-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.48%], valid : [loss = 0.518, top1 = 87.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.46 ms.
cifar10        train : [loss = 0.045, top1 = 98.84%], test  : [loss = 0.347, top1 = 90.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=11.90 ms.
cifar100       train : [loss = 0.560, top1 = 83.80%], valid : [loss = 1.275, top1 = 66.48%], test : [loss = 1.281, top1 = 65.80%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.88%], valid : [loss = 2.446, top1 = 37.73%], test : [loss = 2.476, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.52%], valid : [loss = 0.625, top1 = 78.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14280/15625) 014280-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.76 ms.
cifar10-valid  train : [loss = 0.785, top1 = 72.07%], valid : [loss = 0.967, top1 = 66.90%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.08 ms.
cifar10        train : [loss = 0.761, top1 = 73.21%], test  : [loss = 0.864, top1 = 69.61%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.39 ms.
cifar100       train : [loss = 2.164, top1 = 43.33%], valid : [loss = 2.344, top1 = 40.22%], test : [loss = 2.376, top1 = 40.16%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.57 ms.
ImageNet16-120 train : [loss = 3.743, top1 = 14.19%], valid : [loss = 3.756, top1 = 14.87%], test : [loss = 3.770, top1 = 14.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14281/15625) 014281-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.48 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.441, top1 = 89.40%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.326, top1 = 91.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.22 ms.
cifar100       train : [loss = 0.328, top1 = 91.11%], valid : [loss = 1.290, top1 = 67.20%], test : [loss = 1.323, top1 = 67.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.59 ms.
ImageNet16-120 train : [loss = 2.067, top1 = 46.12%], valid : [loss = 2.369, top1 = 40.07%], test : [loss = 2.398, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14282/15625) 014282-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.660, top1 = 86.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.429, top1 = 90.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.28 ms.
cifar100       train : [loss = 0.282, top1 = 92.67%], valid : [loss = 1.530, top1 = 64.74%], test : [loss = 1.528, top1 = 63.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.18 ms.
ImageNet16-120 train : [loss = 2.205, top1 = 43.04%], valid : [loss = 2.574, top1 = 36.07%], test : [loss = 2.588, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.52%], valid : [loss = 0.824, top1 = 71.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14283/15625) 014283-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.510, top1 = 88.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.59 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.385, top1 = 90.82%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.44 ms.
cifar100       train : [loss = 0.406, top1 = 88.37%], valid : [loss = 1.420, top1 = 64.96%], test : [loss = 1.415, top1 = 64.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.65 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 40.97%], valid : [loss = 2.486, top1 = 37.80%], test : [loss = 2.562, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 78.02%], valid : [loss = 0.711, top1 = 75.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14284/15625) 014284-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.541, top1 = 88.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.347, top1 = 92.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.70 ms.
cifar100       train : [loss = 0.270, top1 = 92.69%], valid : [loss = 1.290, top1 = 68.08%], test : [loss = 1.239, top1 = 69.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.19 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.67%], valid : [loss = 2.294, top1 = 40.87%], test : [loss = 2.323, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.638, top1 = 77.82%], valid : [loss = 0.693, top1 = 76.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14285/15625) 014285-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.624, top1 = 86.49%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.39 ms.
cifar10        train : [loss = 0.025, top1 = 99.37%], test  : [loss = 0.427, top1 = 89.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.92 ms.
cifar100       train : [loss = 0.336, top1 = 91.14%], valid : [loss = 1.467, top1 = 64.24%], test : [loss = 1.433, top1 = 64.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.41 ms.
ImageNet16-120 train : [loss = 2.279, top1 = 41.30%], valid : [loss = 2.590, top1 = 35.30%], test : [loss = 2.640, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 73.19%], valid : [loss = 0.823, top1 = 70.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14286/15625) 014286-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.63 ms.
cifar10-valid  train : [loss = 0.040, top1 = 99.16%], valid : [loss = 0.540, top1 = 86.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10        train : [loss = 0.056, top1 = 98.47%], test  : [loss = 0.339, top1 = 90.40%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.569, top1 = 83.63%], valid : [loss = 1.349, top1 = 64.76%], test : [loss = 1.309, top1 = 64.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.12%], valid : [loss = 2.436, top1 = 38.37%], test : [loss = 2.457, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.790, top1 = 71.45%], valid : [loss = 0.854, top1 = 69.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14287/15625) 014287-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.514, top1 = 89.47%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.297, top1 = 93.35%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.14 ms.
cifar100       train : [loss = 0.125, top1 = 97.52%], valid : [loss = 1.273, top1 = 69.72%], test : [loss = 1.276, top1 = 69.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.02 ms.
ImageNet16-120 train : [loss = 1.803, top1 = 52.18%], valid : [loss = 2.273, top1 = 42.23%], test : [loss = 2.293, top1 = 42.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.86%], valid : [loss = 0.628, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14288/15625) 014288-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.32 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.555, top1 = 88.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.45 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.388, top1 = 91.75%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.71 ms.
cifar100       train : [loss = 0.162, top1 = 96.45%], valid : [loss = 1.467, top1 = 66.92%], test : [loss = 1.439, top1 = 67.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 1.983, top1 = 47.93%], valid : [loss = 2.396, top1 = 40.37%], test : [loss = 2.470, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.39%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14289/15625) 014289-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.532, top1 = 89.59%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.344, top1 = 93.22%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.17 ms.
cifar100       train : [loss = 0.033, top1 = 99.71%], valid : [loss = 1.424, top1 = 69.72%], test : [loss = 1.419, top1 = 70.12%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.04 ms.
ImageNet16-120 train : [loss = 1.537, top1 = 58.43%], valid : [loss = 2.373, top1 = 41.57%], test : [loss = 2.402, top1 = 42.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.583, top1 = 79.27%], valid : [loss = 0.696, top1 = 76.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14290/15625) 014290-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.498, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.97 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.299, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.61 ms.
cifar100       train : [loss = 0.322, top1 = 91.30%], valid : [loss = 1.277, top1 = 67.32%], test : [loss = 1.237, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.91%], valid : [loss = 2.316, top1 = 39.80%], test : [loss = 2.359, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.97%], valid : [loss = 0.596, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14291/15625) 014291-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.483, top1 = 89.11%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.00 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.324, top1 = 92.01%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.15 ms.
cifar100       train : [loss = 0.231, top1 = 94.35%], valid : [loss = 1.244, top1 = 68.18%], test : [loss = 1.263, top1 = 69.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.20%], valid : [loss = 2.285, top1 = 40.30%], test : [loss = 2.305, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.590, top1 = 79.42%], valid : [loss = 0.656, top1 = 77.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14292/15625) 014292-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.35%], valid : [loss = 0.562, top1 = 83.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.194, top1 = 93.50%], test  : [loss = 0.414, top1 = 87.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 1.225, top1 = 65.00%], valid : [loss = 1.547, top1 = 57.46%], test : [loss = 1.536, top1 = 57.44%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 2.681, top1 = 33.06%], valid : [loss = 2.709, top1 = 32.27%], test : [loss = 2.747, top1 = 32.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.914, top1 = 67.45%], valid : [loss = 0.962, top1 = 66.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14293/15625) 014293-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=13.89 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.76%], valid : [loss = 0.512, top1 = 84.65%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=15.06 ms.
cifar10        train : [loss = 0.165, top1 = 94.45%], test  : [loss = 0.387, top1 = 88.18%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=13.49 ms.
cifar100       train : [loss = 1.067, top1 = 69.29%], valid : [loss = 1.430, top1 = 61.19%], test : [loss = 1.439, top1 = 60.65%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=12.32 ms.
ImageNet16-120 train : [loss = 2.601, top1 = 34.60%], valid : [loss = 2.662, top1 = 33.90%], test : [loss = 2.692, top1 = 33.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.14%], valid : [loss = 0.930, top1 = 67.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14294/15625) 014294-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.73 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.453, top1 = 90.66%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.47 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.328, top1 = 93.24%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.49 ms.
cifar100       train : [loss = 0.109, top1 = 97.93%], valid : [loss = 1.259, top1 = 70.50%], test : [loss = 1.272, top1 = 70.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 1.672, top1 = 55.15%], valid : [loss = 2.175, top1 = 43.83%], test : [loss = 2.211, top1 = 43.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.89%], valid : [loss = 0.570, top1 = 80.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14295/15625) 014295-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.807, top1 = 71.55%], valid : [loss = 1.128, top1 = 62.65%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.55 ms.
cifar10        train : [loss = 0.786, top1 = 72.23%], test  : [loss = 0.914, top1 = 68.48%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.09 ms.
cifar100       train : [loss = 2.128, top1 = 43.95%], valid : [loss = 2.381, top1 = 39.88%], test : [loss = 2.400, top1 = 39.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.80 ms.
ImageNet16-120 train : [loss = 3.770, top1 = 13.74%], valid : [loss = 3.828, top1 = 13.40%], test : [loss = 3.840, top1 = 13.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.364, top1 = 50.19%], valid : [loss = 1.411, top1 = 48.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14296/15625) 014296-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.418, top1 = 91.09%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.66 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.297, top1 = 93.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.41 ms.
cifar100       train : [loss = 0.046, top1 = 99.46%], valid : [loss = 1.316, top1 = 71.12%], test : [loss = 1.327, top1 = 70.88%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 1.444, top1 = 60.83%], valid : [loss = 2.228, top1 = 44.53%], test : [loss = 2.281, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.74%], valid : [loss = 0.500, top1 = 83.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14297/15625) 014297-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.534, top1 = 88.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.352, top1 = 91.74%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.64 ms.
cifar100       train : [loss = 0.351, top1 = 90.52%], valid : [loss = 1.290, top1 = 66.30%], test : [loss = 1.292, top1 = 67.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.24%], valid : [loss = 2.444, top1 = 38.33%], test : [loss = 2.414, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14298/15625) 014298-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.51 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.85%], valid : [loss = 0.622, top1 = 81.51%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10        train : [loss = 0.212, top1 = 92.76%], test  : [loss = 0.460, top1 = 85.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.27 ms.
cifar100       train : [loss = 1.127, top1 = 67.80%], valid : [loss = 1.632, top1 = 56.48%], test : [loss = 1.648, top1 = 56.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 3.091, top1 = 25.13%], valid : [loss = 3.129, top1 = 23.17%], test : [loss = 3.146, top1 = 24.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.011, top1 = 63.64%], valid : [loss = 1.058, top1 = 62.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14299/15625) 014299-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.45 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.507, top1 = 89.83%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.93 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.329, top1 = 93.15%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=15.32 ms.
cifar100       train : [loss = 0.071, top1 = 98.98%], valid : [loss = 1.351, top1 = 69.80%], test : [loss = 1.351, top1 = 70.36%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 2.004, top1 = 47.39%], valid : [loss = 2.365, top1 = 40.80%], test : [loss = 2.365, top1 = 40.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.29%], valid : [loss = 0.747, top1 = 74.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14300/15625) 014300-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.523, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.336, top1 = 91.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.08 ms.
cifar100       train : [loss = 0.353, top1 = 90.38%], valid : [loss = 1.289, top1 = 66.72%], test : [loss = 1.278, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.86%], valid : [loss = 2.383, top1 = 38.87%], test : [loss = 2.426, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14301/15625) 014301-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.43 ms.
cifar10-valid  train : [loss = 0.039, top1 = 98.97%], valid : [loss = 0.519, top1 = 86.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.074, top1 = 97.59%], test  : [loss = 0.372, top1 = 89.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=14.50 ms.
cifar100       train : [loss = 0.727, top1 = 78.40%], valid : [loss = 1.354, top1 = 64.20%], test : [loss = 1.376, top1 = 63.58%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.69 ms.
ImageNet16-120 train : [loss = 2.528, top1 = 36.14%], valid : [loss = 2.630, top1 = 34.60%], test : [loss = 2.678, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14302/15625) 014302-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.04 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.07%], valid : [loss = 0.546, top1 = 86.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.08 ms.
cifar10        train : [loss = 0.062, top1 = 98.08%], test  : [loss = 0.380, top1 = 89.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.06 ms.
cifar100       train : [loss = 0.658, top1 = 80.69%], valid : [loss = 1.352, top1 = 63.80%], test : [loss = 1.314, top1 = 64.28%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.412, top1 = 38.42%], valid : [loss = 2.520, top1 = 36.17%], test : [loss = 2.579, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.89%], valid : [loss = 0.815, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14303/15625) 014303-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.49%], valid : [loss = 0.637, top1 = 85.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.403, top1 = 90.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.45 ms.
cifar100       train : [loss = 0.577, top1 = 83.11%], valid : [loss = 1.474, top1 = 62.62%], test : [loss = 1.446, top1 = 63.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.375, top1 = 39.31%], valid : [loss = 2.553, top1 = 35.60%], test : [loss = 2.592, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.26%], valid : [loss = 0.890, top1 = 68.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14304/15625) 014304-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.535, top1 = 89.40%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.333, top1 = 92.97%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.38 ms.
cifar100       train : [loss = 0.091, top1 = 98.39%], valid : [loss = 1.321, top1 = 69.26%], test : [loss = 1.302, top1 = 70.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.51%], valid : [loss = 2.326, top1 = 40.77%], test : [loss = 2.271, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.32%], valid : [loss = 0.824, top1 = 71.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14305/15625) 014305-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.63%], valid : [loss = 0.560, top1 = 87.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10        train : [loss = 0.027, top1 = 99.21%], test  : [loss = 0.360, top1 = 91.28%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.93 ms.
cifar100       train : [loss = 0.476, top1 = 86.06%], valid : [loss = 1.231, top1 = 67.68%], test : [loss = 1.256, top1 = 66.78%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.91 ms.
ImageNet16-120 train : [loss = 2.182, top1 = 43.46%], valid : [loss = 2.369, top1 = 39.67%], test : [loss = 2.397, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 73.81%], valid : [loss = 0.778, top1 = 72.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14306/15625) 014306-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.410, top1 = 90.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.78 ms.
cifar10        train : [loss = 0.007, top1 = 99.92%], test  : [loss = 0.291, top1 = 92.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.69 ms.
cifar100       train : [loss = 0.193, top1 = 95.37%], valid : [loss = 1.240, top1 = 69.72%], test : [loss = 1.262, top1 = 69.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.40 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.68%], valid : [loss = 2.285, top1 = 41.67%], test : [loss = 2.302, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14307/15625) 014307-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.496, top1 = 88.74%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.323, top1 = 92.09%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.33 ms.
cifar100       train : [loss = 0.330, top1 = 91.08%], valid : [loss = 1.303, top1 = 67.16%], test : [loss = 1.289, top1 = 67.08%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.096, top1 = 45.39%], valid : [loss = 2.376, top1 = 39.50%], test : [loss = 2.426, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14308/15625) 014308-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.475, top1 = 88.85%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.314, top1 = 92.29%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.04 ms.
cifar100       train : [loss = 0.314, top1 = 91.63%], valid : [loss = 1.243, top1 = 68.30%], test : [loss = 1.231, top1 = 68.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.74%], valid : [loss = 2.333, top1 = 40.33%], test : [loss = 2.350, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.88%], valid : [loss = 0.589, top1 = 79.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14309/15625) 014309-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.28%], valid : [loss = 0.592, top1 = 86.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10        train : [loss = 0.030, top1 = 99.13%], test  : [loss = 0.413, top1 = 90.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.72 ms.
cifar100       train : [loss = 0.371, top1 = 89.37%], valid : [loss = 1.339, top1 = 66.16%], test : [loss = 1.357, top1 = 66.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.45 ms.
ImageNet16-120 train : [loss = 2.476, top1 = 36.91%], valid : [loss = 2.637, top1 = 33.77%], test : [loss = 2.648, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.03%], valid : [loss = 1.035, top1 = 62.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14310/15625) 014310-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.519, top1 = 88.51%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.333, top1 = 92.15%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.41 ms.
cifar100       train : [loss = 0.347, top1 = 90.54%], valid : [loss = 1.288, top1 = 67.44%], test : [loss = 1.284, top1 = 67.27%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.120, top1 = 44.84%], valid : [loss = 2.402, top1 = 39.07%], test : [loss = 2.418, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14311/15625) 014311-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.98 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.11 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14312/15625) 014312-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.361, top1 = 92.66%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.75 ms.
cifar100       train : [loss = 0.054, top1 = 99.39%], valid : [loss = 1.468, top1 = 69.10%], test : [loss = 1.461, top1 = 68.82%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.62%], valid : [loss = 2.426, top1 = 40.00%], test : [loss = 2.440, top1 = 40.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.19%], valid : [loss = 0.660, top1 = 77.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14313/15625) 014313-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.500, top1 = 89.40%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.37 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.315, top1 = 92.59%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.38 ms.
cifar100       train : [loss = 0.166, top1 = 96.22%], valid : [loss = 1.246, top1 = 69.34%], test : [loss = 1.248, top1 = 69.88%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.14 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.52%], valid : [loss = 2.166, top1 = 45.27%], test : [loss = 2.198, top1 = 44.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.27%], valid : [loss = 0.709, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14314/15625) 014314-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.67 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.75%], valid : [loss = 0.574, top1 = 87.57%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=22.72 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.304, top1 = 91.94%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.77 ms.
cifar100       train : [loss = 0.369, top1 = 89.71%], valid : [loss = 1.312, top1 = 66.74%], test : [loss = 1.303, top1 = 67.24%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=24.21 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.79%], valid : [loss = 2.346, top1 = 39.53%], test : [loss = 2.360, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.832, top1 = 70.44%], valid : [loss = 0.860, top1 = 69.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14315/15625) 014315-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.12%], valid : [loss = 0.661, top1 = 77.70%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.506, top1 = 82.47%], test  : [loss = 0.583, top1 = 80.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.694, top1 = 54.05%], valid : [loss = 1.853, top1 = 50.65%], test : [loss = 1.872, top1 = 50.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.77 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.26%], valid : [loss = 3.310, top1 = 21.14%], test : [loss = 3.347, top1 = 21.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14316/15625) 014316-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.538, top1 = 88.94%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.65 ms.
cifar10        train : [loss = 0.008, top1 = 99.81%], test  : [loss = 0.368, top1 = 91.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.34 ms.
cifar100       train : [loss = 0.174, top1 = 96.18%], valid : [loss = 1.386, top1 = 67.58%], test : [loss = 1.428, top1 = 67.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.93%], valid : [loss = 2.463, top1 = 38.53%], test : [loss = 2.506, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 79.96%], valid : [loss = 0.683, top1 = 76.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14317/15625) 014317-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.606, top1 = 87.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.410, top1 = 90.64%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.57 ms.
cifar100       train : [loss = 0.230, top1 = 94.33%], valid : [loss = 1.413, top1 = 66.70%], test : [loss = 1.401, top1 = 65.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.65 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.34%], valid : [loss = 2.471, top1 = 38.43%], test : [loss = 2.520, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.20%], valid : [loss = 0.742, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14318/15625) 014318-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.514, top1 = 81.88%], valid : [loss = 0.654, top1 = 77.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.34 ms.
cifar10        train : [loss = 0.519, top1 = 82.00%], test  : [loss = 0.594, top1 = 79.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.27 ms.
cifar100       train : [loss = 1.746, top1 = 52.45%], valid : [loss = 1.935, top1 = 48.92%], test : [loss = 1.909, top1 = 49.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.28 ms.
ImageNet16-120 train : [loss = 3.333, top1 = 21.16%], valid : [loss = 3.307, top1 = 21.70%], test : [loss = 3.343, top1 = 21.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.291, top1 = 53.57%], valid : [loss = 1.310, top1 = 53.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14319/15625) 014319-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.41%], valid : [loss = 0.863, top1 = 79.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.12 ms.
cifar10        train : [loss = 0.139, top1 = 95.44%], test  : [loss = 0.548, top1 = 84.66%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.88 ms.
cifar100       train : [loss = 0.867, top1 = 74.83%], valid : [loss = 1.688, top1 = 58.02%], test : [loss = 1.681, top1 = 57.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.79 ms.
ImageNet16-120 train : [loss = 3.028, top1 = 26.63%], valid : [loss = 3.149, top1 = 24.70%], test : [loss = 3.199, top1 = 24.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.76%], valid : [loss = 1.023, top1 = 63.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14320/15625) 014320-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.62%], valid : [loss = 0.674, top1 = 77.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10        train : [loss = 0.516, top1 = 82.07%], test  : [loss = 0.589, top1 = 79.91%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.48 ms.
cifar100       train : [loss = 1.662, top1 = 54.69%], valid : [loss = 1.839, top1 = 50.90%], test : [loss = 1.842, top1 = 51.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.38%], valid : [loss = 3.307, top1 = 22.40%], test : [loss = 3.344, top1 = 20.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.281, top1 = 53.71%], valid : [loss = 1.305, top1 = 53.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14321/15625) 014321-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.86%], valid : [loss = 0.527, top1 = 84.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.03 ms.
cifar10        train : [loss = 0.160, top1 = 94.66%], test  : [loss = 0.385, top1 = 88.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.79 ms.
cifar100       train : [loss = 1.173, top1 = 66.45%], valid : [loss = 1.500, top1 = 59.08%], test : [loss = 1.484, top1 = 59.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.665, top1 = 33.41%], valid : [loss = 2.696, top1 = 32.83%], test : [loss = 2.766, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.74%], valid : [loss = 0.985, top1 = 65.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14322/15625) 014322-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.60%], valid : [loss = 0.579, top1 = 86.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.043, top1 = 98.65%], test  : [loss = 0.397, top1 = 89.98%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.26 ms.
cifar100       train : [loss = 0.546, top1 = 83.88%], valid : [loss = 1.388, top1 = 64.54%], test : [loss = 1.406, top1 = 63.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.34%], valid : [loss = 2.591, top1 = 35.13%], test : [loss = 2.640, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.82%], valid : [loss = 0.660, top1 = 77.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14323/15625) 014323-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.509, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.323, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.06 ms.
cifar100       train : [loss = 0.353, top1 = 90.29%], valid : [loss = 1.259, top1 = 67.26%], test : [loss = 1.293, top1 = 66.88%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.59%], valid : [loss = 2.400, top1 = 38.40%], test : [loss = 2.428, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14324/15625) 014324-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.629, top1 = 86.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.36 ms.
cifar10        train : [loss = 0.031, top1 = 99.17%], test  : [loss = 0.419, top1 = 89.83%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.08 ms.
cifar100       train : [loss = 0.516, top1 = 84.94%], valid : [loss = 1.387, top1 = 64.61%], test : [loss = 1.389, top1 = 64.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.00 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.24%], valid : [loss = 2.556, top1 = 35.50%], test : [loss = 2.564, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.35%], valid : [loss = 0.811, top1 = 71.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14325/15625) 014325-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.76%], valid : [loss = 0.558, top1 = 88.14%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.55 ms.
cifar10        train : [loss = 0.019, top1 = 99.49%], test  : [loss = 0.365, top1 = 91.43%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.11 ms.
cifar100       train : [loss = 0.130, top1 = 96.79%], valid : [loss = 1.317, top1 = 69.34%], test : [loss = 1.370, top1 = 68.92%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.93 ms.
ImageNet16-120 train : [loss = 2.747, top1 = 30.96%], valid : [loss = 2.869, top1 = 29.10%], test : [loss = 2.884, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.44%], valid : [loss = 1.031, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14326/15625) 014326-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.95 ms.
cifar10-valid  train : [loss = 0.079, top1 = 97.67%], valid : [loss = 0.549, top1 = 85.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10        train : [loss = 0.105, top1 = 96.64%], test  : [loss = 0.372, top1 = 88.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.56 ms.
cifar100       train : [loss = 0.848, top1 = 75.33%], valid : [loss = 1.429, top1 = 61.36%], test : [loss = 1.397, top1 = 62.34%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 35.99%], valid : [loss = 2.622, top1 = 34.70%], test : [loss = 2.678, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 70.78%], valid : [loss = 0.860, top1 = 69.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14327/15625) 014327-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.183, top1 = 93.90%], valid : [loss = 0.507, top1 = 84.68%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10        train : [loss = 0.197, top1 = 93.37%], test  : [loss = 0.367, top1 = 88.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.01 ms.
cifar100       train : [loss = 1.237, top1 = 65.05%], valid : [loss = 1.571, top1 = 57.21%], test : [loss = 1.552, top1 = 57.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 2.774, top1 = 31.15%], valid : [loss = 2.813, top1 = 30.38%], test : [loss = 2.844, top1 = 30.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.04%], valid : [loss = 1.037, top1 = 63.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14328/15625) 014328-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.56%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=18.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.05%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=16.49 ms.
cifar100       train : [loss = 0.346, top1 = 90.57%], valid : [loss = 1.292, top1 = 66.93%], test : [loss = 1.288, top1 = 67.32%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.73%], valid : [loss = 2.388, top1 = 39.09%], test : [loss = 2.405, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.27%], valid : [loss = 0.770, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14329/15625) 014329-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.457, top1 = 89.33%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 91.80%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.66 ms.
cifar100       train : [loss = 0.332, top1 = 91.05%], valid : [loss = 1.308, top1 = 67.50%], test : [loss = 1.300, top1 = 67.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.15%], valid : [loss = 2.370, top1 = 39.90%], test : [loss = 2.416, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.62%], valid : [loss = 0.521, top1 = 82.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14330/15625) 014330-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.533, top1 = 88.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.20 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.343, top1 = 91.61%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.73 ms.
cifar100       train : [loss = 0.332, top1 = 90.94%], valid : [loss = 1.280, top1 = 67.46%], test : [loss = 1.335, top1 = 66.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.00 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.57%], valid : [loss = 2.434, top1 = 38.93%], test : [loss = 2.463, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.41%], valid : [loss = 0.803, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14331/15625) 014331-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.454, top1 = 90.36%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.51 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.313, top1 = 93.15%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.24 ms.
cifar100       train : [loss = 0.073, top1 = 98.65%], valid : [loss = 1.438, top1 = 69.16%], test : [loss = 1.467, top1 = 68.60%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.94 ms.
ImageNet16-120 train : [loss = 1.689, top1 = 54.96%], valid : [loss = 2.245, top1 = 43.17%], test : [loss = 2.295, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.14%], valid : [loss = 0.695, top1 = 76.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14332/15625) 014332-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.82 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.32%], valid : [loss = 0.640, top1 = 84.93%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.94 ms.
cifar10        train : [loss = 0.064, top1 = 98.07%], test  : [loss = 0.405, top1 = 89.05%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.677, top1 = 80.24%], valid : [loss = 1.398, top1 = 63.42%], test : [loss = 1.372, top1 = 63.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.552, top1 = 35.58%], valid : [loss = 2.678, top1 = 32.83%], test : [loss = 2.674, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.40%], valid : [loss = 0.822, top1 = 71.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14333/15625) 014333-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.31 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.33%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=23.14 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.318, top1 = 92.60%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.52 ms.
cifar100       train : [loss = 0.151, top1 = 96.88%], valid : [loss = 1.324, top1 = 68.80%], test : [loss = 1.351, top1 = 68.58%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=17.32 ms.
ImageNet16-120 train : [loss = 1.901, top1 = 49.91%], valid : [loss = 2.316, top1 = 41.00%], test : [loss = 2.300, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.93%], valid : [loss = 0.697, top1 = 75.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14334/15625) 014334-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.99 ms.
cifar10-valid  train : [loss = 0.070, top1 = 97.87%], valid : [loss = 0.605, top1 = 84.61%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.23 ms.
cifar10        train : [loss = 0.093, top1 = 97.04%], test  : [loss = 0.414, top1 = 88.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=9.45 ms.
cifar100       train : [loss = 0.689, top1 = 79.56%], valid : [loss = 1.506, top1 = 60.84%], test : [loss = 1.510, top1 = 60.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 3.209, top1 = 22.01%], valid : [loss = 3.236, top1 = 21.20%], test : [loss = 3.259, top1 = 21.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14335/15625) 014335-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.634, top1 = 87.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.77 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.425, top1 = 90.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.86 ms.
cifar100       train : [loss = 0.240, top1 = 94.03%], valid : [loss = 1.498, top1 = 65.54%], test : [loss = 1.431, top1 = 65.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.47%], valid : [loss = 2.542, top1 = 35.67%], test : [loss = 2.529, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.10%], valid : [loss = 0.775, top1 = 72.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14336/15625) 014336-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.627, top1 = 85.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.58 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.395, top1 = 90.69%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.19 ms.
cifar100       train : [loss = 0.483, top1 = 86.04%], valid : [loss = 1.451, top1 = 63.26%], test : [loss = 1.468, top1 = 63.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.416, top1 = 38.49%], valid : [loss = 2.593, top1 = 35.67%], test : [loss = 2.590, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.71%], valid : [loss = 0.853, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14337/15625) 014337-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.593, top1 = 86.93%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.041, top1 = 98.76%], test  : [loss = 0.400, top1 = 89.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.94 ms.
cifar100       train : [loss = 0.566, top1 = 83.30%], valid : [loss = 1.425, top1 = 63.72%], test : [loss = 1.433, top1 = 63.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.482, top1 = 37.02%], valid : [loss = 2.625, top1 = 35.30%], test : [loss = 2.666, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.27%], valid : [loss = 0.707, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14338/15625) 014338-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.91%], valid : [loss = 0.521, top1 = 89.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.325, top1 = 93.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.89 ms.
cifar100       train : [loss = 0.112, top1 = 97.68%], valid : [loss = 1.360, top1 = 69.12%], test : [loss = 1.355, top1 = 69.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.16%], valid : [loss = 2.208, top1 = 43.57%], test : [loss = 2.216, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.30%], valid : [loss = 0.753, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14339/15625) 014339-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=22.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.557, top1 = 88.68%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.19 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.371, top1 = 92.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.29 ms.
cifar100       train : [loss = 0.171, top1 = 96.26%], valid : [loss = 1.471, top1 = 66.50%], test : [loss = 1.450, top1 = 66.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 1.986, top1 = 47.94%], valid : [loss = 2.508, top1 = 37.83%], test : [loss = 2.483, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.45%], valid : [loss = 0.685, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14340/15625) 014340-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.615, top1 = 86.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10        train : [loss = 0.032, top1 = 99.18%], test  : [loss = 0.433, top1 = 89.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.03 ms.
cifar100       train : [loss = 0.376, top1 = 89.97%], valid : [loss = 1.416, top1 = 64.74%], test : [loss = 1.395, top1 = 65.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 41.01%], valid : [loss = 2.590, top1 = 35.13%], test : [loss = 2.619, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.42%], valid : [loss = 0.769, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14341/15625) 014341-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.041, top1 = 99.24%], valid : [loss = 0.464, top1 = 87.20%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.40 ms.
cifar10        train : [loss = 0.070, top1 = 98.05%], test  : [loss = 0.308, top1 = 90.27%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.95 ms.
cifar100       train : [loss = 0.646, top1 = 81.96%], valid : [loss = 1.234, top1 = 66.12%], test : [loss = 1.195, top1 = 66.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.22%], valid : [loss = 2.483, top1 = 37.73%], test : [loss = 2.525, top1 = 35.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.28%], valid : [loss = 0.637, top1 = 78.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14342/15625) 014342-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.78%], valid : [loss = 0.651, top1 = 86.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10        train : [loss = 0.037, top1 = 99.06%], test  : [loss = 0.422, top1 = 89.18%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 0.462, top1 = 87.12%], valid : [loss = 1.464, top1 = 64.18%], test : [loss = 1.422, top1 = 63.42%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.56%], valid : [loss = 2.619, top1 = 34.53%], test : [loss = 2.686, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.50%], valid : [loss = 0.799, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14343/15625) 014343-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.526, top1 = 89.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.74 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.353, top1 = 92.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.02 ms.
cifar100       train : [loss = 0.133, top1 = 97.20%], valid : [loss = 1.335, top1 = 68.30%], test : [loss = 1.375, top1 = 68.68%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 1.931, top1 = 49.08%], valid : [loss = 2.279, top1 = 41.37%], test : [loss = 2.299, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.65%], valid : [loss = 0.823, top1 = 70.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14344/15625) 014344-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.91%], valid : [loss = 0.869, top1 = 77.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10        train : [loss = 0.187, top1 = 93.59%], test  : [loss = 0.571, top1 = 83.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.58 ms.
cifar100       train : [loss = 1.082, top1 = 68.93%], valid : [loss = 1.802, top1 = 53.64%], test : [loss = 1.843, top1 = 52.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.76 ms.
ImageNet16-120 train : [loss = 3.098, top1 = 25.30%], valid : [loss = 3.219, top1 = 22.97%], test : [loss = 3.234, top1 = 23.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.095, top1 = 60.41%], valid : [loss = 1.152, top1 = 58.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14345/15625) 014345-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.47%], valid : [loss = 0.686, top1 = 84.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.052, top1 = 98.43%], test  : [loss = 0.446, top1 = 88.70%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 0.636, top1 = 81.41%], valid : [loss = 1.523, top1 = 61.41%], test : [loss = 1.498, top1 = 62.03%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.27%], valid : [loss = 2.834, top1 = 30.36%], test : [loss = 2.892, top1 = 29.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14346/15625) 014346-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.73%], valid : [loss = 0.508, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.88 ms.
cifar10        train : [loss = 0.081, top1 = 97.48%], test  : [loss = 0.348, top1 = 89.99%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.76 ms.
cifar100       train : [loss = 0.729, top1 = 78.75%], valid : [loss = 1.305, top1 = 64.93%], test : [loss = 1.302, top1 = 64.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.12 ms.
ImageNet16-120 train : [loss = 2.491, top1 = 36.91%], valid : [loss = 2.603, top1 = 34.78%], test : [loss = 2.627, top1 = 34.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.35%], valid : [loss = 0.648, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14347/15625) 014347-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.22 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.32%], valid : [loss = 0.615, top1 = 85.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10        train : [loss = 0.069, top1 = 97.93%], test  : [loss = 0.408, top1 = 88.86%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.65 ms.
cifar100       train : [loss = 0.712, top1 = 79.24%], valid : [loss = 1.384, top1 = 63.30%], test : [loss = 1.389, top1 = 63.81%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.22%], valid : [loss = 2.641, top1 = 33.25%], test : [loss = 2.698, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14348/15625) 014348-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.119, top1 = 96.45%], valid : [loss = 0.464, top1 = 85.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.91 ms.
cifar10        train : [loss = 0.158, top1 = 94.83%], test  : [loss = 0.349, top1 = 88.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.67 ms.
cifar100       train : [loss = 0.988, top1 = 71.88%], valid : [loss = 1.355, top1 = 62.37%], test : [loss = 1.347, top1 = 62.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.633, top1 = 33.86%], valid : [loss = 2.679, top1 = 33.52%], test : [loss = 2.709, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14349/15625) 014349-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.528, top1 = 89.16%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.56 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.371, top1 = 92.66%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.98 ms.
cifar100       train : [loss = 0.067, top1 = 99.08%], valid : [loss = 1.397, top1 = 69.58%], test : [loss = 1.408, top1 = 68.96%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=21.53 ms.
ImageNet16-120 train : [loss = 1.758, top1 = 53.10%], valid : [loss = 2.357, top1 = 41.93%], test : [loss = 2.350, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 79.95%], valid : [loss = 0.665, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14350/15625) 014350-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.573, top1 = 88.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.345, top1 = 92.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.19 ms.
cifar100       train : [loss = 0.117, top1 = 97.75%], valid : [loss = 1.478, top1 = 67.40%], test : [loss = 1.419, top1 = 68.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 50.05%], valid : [loss = 2.353, top1 = 39.87%], test : [loss = 2.401, top1 = 39.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 76.96%], valid : [loss = 0.742, top1 = 74.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14351/15625) 014351-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10-valid  train : [loss = 0.344, top1 = 88.11%], valid : [loss = 0.599, top1 = 80.90%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.54 ms.
cifar10        train : [loss = 0.300, top1 = 89.71%], test  : [loss = 0.437, top1 = 85.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.12 ms.
cifar100       train : [loss = 1.292, top1 = 63.39%], valid : [loss = 1.594, top1 = 56.38%], test : [loss = 1.572, top1 = 57.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.38 ms.
ImageNet16-120 train : [loss = 3.060, top1 = 25.78%], valid : [loss = 3.069, top1 = 25.83%], test : [loss = 3.134, top1 = 24.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.215, top1 = 56.12%], valid : [loss = 1.257, top1 = 54.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14352/15625) 014352-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.552, top1 = 89.08%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.365, top1 = 92.30%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.93 ms.
cifar100       train : [loss = 0.095, top1 = 97.87%], valid : [loss = 1.434, top1 = 68.40%], test : [loss = 1.423, top1 = 69.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.91 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.71%], valid : [loss = 2.359, top1 = 40.07%], test : [loss = 2.365, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.935, top1 = 66.43%], valid : [loss = 0.967, top1 = 65.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14353/15625) 014353-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.545, top1 = 88.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.83 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.347, top1 = 92.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.94 ms.
cifar100       train : [loss = 0.254, top1 = 93.15%], valid : [loss = 1.296, top1 = 67.40%], test : [loss = 1.302, top1 = 68.14%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.71%], valid : [loss = 2.398, top1 = 39.43%], test : [loss = 2.416, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14354/15625) 014354-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.41 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.51%], valid : [loss = 0.449, top1 = 86.44%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.56 ms.
cifar10        train : [loss = 0.156, top1 = 94.96%], test  : [loss = 0.356, top1 = 88.48%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.89 ms.
cifar100       train : [loss = 0.978, top1 = 72.21%], valid : [loss = 1.335, top1 = 62.74%], test : [loss = 1.331, top1 = 62.50%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.610, top1 = 34.42%], valid : [loss = 2.667, top1 = 32.67%], test : [loss = 2.710, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.85%], valid : [loss = 0.786, top1 = 72.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14355/15625) 014355-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.537, top1 = 88.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.350, top1 = 91.69%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.54 ms.
cifar100       train : [loss = 0.295, top1 = 92.06%], valid : [loss = 1.288, top1 = 67.98%], test : [loss = 1.288, top1 = 68.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.198, top1 = 43.00%], valid : [loss = 2.445, top1 = 38.17%], test : [loss = 2.462, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.56%], valid : [loss = 0.854, top1 = 69.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14356/15625) 014356-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.534, top1 = 89.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.78 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.343, top1 = 92.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.53 ms.
cifar100       train : [loss = 0.109, top1 = 97.73%], valid : [loss = 1.370, top1 = 69.14%], test : [loss = 1.370, top1 = 68.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 1.789, top1 = 52.26%], valid : [loss = 2.239, top1 = 43.33%], test : [loss = 2.202, top1 = 44.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.15%], valid : [loss = 0.724, top1 = 74.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14357/15625) 014357-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.57%], valid : [loss = 0.557, top1 = 87.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.68 ms.
cifar10        train : [loss = 0.032, top1 = 99.09%], test  : [loss = 0.381, top1 = 90.75%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.03 ms.
cifar100       train : [loss = 0.514, top1 = 85.43%], valid : [loss = 1.346, top1 = 64.06%], test : [loss = 1.366, top1 = 64.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 2.596, top1 = 34.01%], valid : [loss = 2.668, top1 = 31.90%], test : [loss = 2.697, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14358/15625) 014358-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.40%], valid : [loss = 0.750, top1 = 74.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10        train : [loss = 0.499, top1 = 82.60%], test  : [loss = 0.604, top1 = 79.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.55 ms.
cifar100       train : [loss = 1.833, top1 = 50.19%], valid : [loss = 2.013, top1 = 46.54%], test : [loss = 2.027, top1 = 45.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 3.505, top1 = 17.84%], valid : [loss = 3.506, top1 = 18.33%], test : [loss = 3.541, top1 = 17.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.219, top1 = 56.05%], valid : [loss = 1.257, top1 = 55.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14359/15625) 014359-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.475, top1 = 90.33%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.61 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.328, top1 = 93.23%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=24.38 ms.
cifar100       train : [loss = 0.132, top1 = 97.14%], valid : [loss = 1.364, top1 = 68.50%], test : [loss = 1.338, top1 = 68.66%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.16 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.59%], valid : [loss = 2.187, top1 = 44.13%], test : [loss = 2.209, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.99%], valid : [loss = 0.627, top1 = 78.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14360/15625) 014360-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.36%], valid : [loss = 0.548, top1 = 87.16%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.99 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.385, top1 = 89.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.53 ms.
cifar100       train : [loss = 0.610, top1 = 81.94%], valid : [loss = 1.369, top1 = 63.88%], test : [loss = 1.398, top1 = 63.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 2.428, top1 = 38.21%], valid : [loss = 2.611, top1 = 34.97%], test : [loss = 2.674, top1 = 34.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.701, top1 = 76.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14361/15625) 014361-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.53%], valid : [loss = 0.615, top1 = 85.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.08 ms.
cifar10        train : [loss = 0.053, top1 = 98.43%], test  : [loss = 0.397, top1 = 89.24%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.10 ms.
cifar100       train : [loss = 0.603, top1 = 82.35%], valid : [loss = 1.376, top1 = 63.48%], test : [loss = 1.353, top1 = 64.34%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.446, top1 = 37.88%], valid : [loss = 2.610, top1 = 34.17%], test : [loss = 2.637, top1 = 34.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 72.84%], valid : [loss = 0.808, top1 = 71.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14362/15625) 014362-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.863, top1 = 82.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.57 ms.
cifar10        train : [loss = 0.028, top1 = 99.26%], test  : [loss = 0.614, top1 = 86.53%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.55 ms.
cifar100       train : [loss = 0.342, top1 = 91.02%], valid : [loss = 1.732, top1 = 59.96%], test : [loss = 1.747, top1 = 60.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.76%], valid : [loss = 3.032, top1 = 27.20%], test : [loss = 3.056, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 68.00%], valid : [loss = 0.966, top1 = 65.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14363/15625) 014363-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.463, top1 = 89.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.28 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.311, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.329, top1 = 91.05%], valid : [loss = 1.305, top1 = 67.46%], test : [loss = 1.304, top1 = 67.32%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.27 ms.
ImageNet16-120 train : [loss = 2.054, top1 = 46.37%], valid : [loss = 2.359, top1 = 40.27%], test : [loss = 2.402, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.445, top1 = 84.64%], valid : [loss = 0.544, top1 = 81.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14364/15625) 014364-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.510, top1 = 88.87%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.341, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.94 ms.
cifar100       train : [loss = 0.336, top1 = 90.76%], valid : [loss = 1.253, top1 = 67.80%], test : [loss = 1.304, top1 = 67.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.04%], valid : [loss = 2.393, top1 = 39.47%], test : [loss = 2.421, top1 = 39.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 78.84%], valid : [loss = 0.658, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14365/15625) 014365-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.610, top1 = 87.52%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.70 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.430, top1 = 90.68%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.70 ms.
cifar100       train : [loss = 0.225, top1 = 94.52%], valid : [loss = 1.528, top1 = 64.74%], test : [loss = 1.495, top1 = 65.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.66%], valid : [loss = 2.576, top1 = 36.57%], test : [loss = 2.584, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.70%], valid : [loss = 0.781, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14366/15625) 014366-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.19%], valid : [loss = 0.466, top1 = 84.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.299, top1 = 90.04%], test  : [loss = 0.405, top1 = 86.38%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.11 ms.
cifar100       train : [loss = 1.336, top1 = 63.00%], valid : [loss = 1.532, top1 = 58.14%], test : [loss = 1.536, top1 = 58.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.933, top1 = 28.42%], valid : [loss = 2.908, top1 = 28.83%], test : [loss = 2.967, top1 = 28.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14367/15625) 014367-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.488, top1 = 88.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.323, top1 = 91.29%], valid : [loss = 1.253, top1 = 67.49%], test : [loss = 1.261, top1 = 67.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.71%], valid : [loss = 2.322, top1 = 40.74%], test : [loss = 2.342, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14368/15625) 014368-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.499, top1 = 89.31%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.07 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.296, top1 = 92.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.37 ms.
cifar100       train : [loss = 0.174, top1 = 96.20%], valid : [loss = 1.239, top1 = 69.63%], test : [loss = 1.259, top1 = 69.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 1.771, top1 = 52.82%], valid : [loss = 2.222, top1 = 43.15%], test : [loss = 2.227, top1 = 43.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.10%], valid : [loss = 0.605, top1 = 79.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14369/15625) 014369-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.528, top1 = 88.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.340, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.87 ms.
cifar100       train : [loss = 0.301, top1 = 91.55%], valid : [loss = 1.279, top1 = 68.18%], test : [loss = 1.292, top1 = 67.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.43 ms.
ImageNet16-120 train : [loss = 2.019, top1 = 47.06%], valid : [loss = 2.297, top1 = 41.10%], test : [loss = 2.312, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 69.06%], valid : [loss = 0.903, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14370/15625) 014370-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.519, top1 = 88.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.21 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.325, top1 = 92.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 0.340, top1 = 90.80%], valid : [loss = 1.267, top1 = 66.90%], test : [loss = 1.292, top1 = 67.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.60%], valid : [loss = 2.415, top1 = 39.22%], test : [loss = 2.395, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14371/15625) 014371-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.53 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.42%], valid : [loss = 0.543, top1 = 87.65%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10        train : [loss = 0.035, top1 = 98.90%], test  : [loss = 0.348, top1 = 90.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.98 ms.
cifar100       train : [loss = 0.469, top1 = 86.05%], valid : [loss = 1.235, top1 = 66.84%], test : [loss = 1.274, top1 = 66.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 2.280, top1 = 41.13%], valid : [loss = 2.464, top1 = 38.10%], test : [loss = 2.451, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.87%], valid : [loss = 0.889, top1 = 68.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14372/15625) 014372-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.41%], valid : [loss = 0.469, top1 = 85.92%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10        train : [loss = 0.163, top1 = 94.68%], test  : [loss = 0.356, top1 = 88.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.11 ms.
cifar100       train : [loss = 0.989, top1 = 71.87%], valid : [loss = 1.355, top1 = 62.78%], test : [loss = 1.350, top1 = 61.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.71%], valid : [loss = 2.680, top1 = 32.60%], test : [loss = 2.695, top1 = 32.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14373/15625) 014373-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.455, top1 = 89.48%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.315, top1 = 92.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.84 ms.
cifar100       train : [loss = 0.211, top1 = 94.82%], valid : [loss = 1.284, top1 = 68.69%], test : [loss = 1.326, top1 = 68.56%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.30%], valid : [loss = 2.303, top1 = 41.83%], test : [loss = 2.323, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.92%], valid : [loss = 0.544, top1 = 81.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14374/15625) 014374-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.477, top1 = 89.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.54 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.336, top1 = 92.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.19 ms.
cifar100       train : [loss = 0.208, top1 = 94.55%], valid : [loss = 1.393, top1 = 67.30%], test : [loss = 1.408, top1 = 67.04%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.62%], valid : [loss = 2.329, top1 = 41.40%], test : [loss = 2.358, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.457, top1 = 84.23%], valid : [loss = 0.553, top1 = 81.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14375/15625) 014375-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.415, top1 = 91.55%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.284, top1 = 93.89%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.90 ms.
cifar100       train : [loss = 0.046, top1 = 99.36%], valid : [loss = 1.300, top1 = 71.88%], test : [loss = 1.314, top1 = 71.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.57 ms.
ImageNet16-120 train : [loss = 1.438, top1 = 60.94%], valid : [loss = 2.193, top1 = 45.47%], test : [loss = 2.226, top1 = 44.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.324, top1 = 88.86%], valid : [loss = 0.473, top1 = 84.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14376/15625) 014376-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.20%], valid : [loss = 0.859, top1 = 71.72%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.551, top1 = 80.71%], test  : [loss = 0.712, top1 = 75.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.81 ms.
cifar100       train : [loss = 1.765, top1 = 52.54%], valid : [loss = 2.048, top1 = 47.37%], test : [loss = 2.067, top1 = 47.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.91%], valid : [loss = 3.636, top1 = 16.74%], test : [loss = 3.669, top1 = 15.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14377/15625) 014377-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.501, top1 = 90.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.341, top1 = 92.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.117, top1 = 97.58%], valid : [loss = 1.317, top1 = 69.22%], test : [loss = 1.314, top1 = 69.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 1.682, top1 = 54.97%], valid : [loss = 2.150, top1 = 43.70%], test : [loss = 2.198, top1 = 44.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.77%], valid : [loss = 0.575, top1 = 80.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14378/15625) 014378-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=21.22 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.570, top1 = 87.50%]
cifar10        FLOP= 27.44 M, Params=0.213 MB, latency=20.00 ms.
cifar10        train : [loss = 0.029, top1 = 99.15%], test  : [loss = 0.384, top1 = 90.60%]
cifar100       FLOP= 27.45 M, Params=0.219 MB, latency=19.91 ms.
cifar100       train : [loss = 0.375, top1 = 89.46%], valid : [loss = 1.321, top1 = 66.16%], test : [loss = 1.330, top1 = 66.48%]
ImageNet16-120 FLOP=  6.87 M, Params=0.220 MB, latency=20.17 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 46.06%], valid : [loss = 2.346, top1 = 40.30%], test : [loss = 2.372, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 27.44 M, Params=0.213 MB, latency=None ms.
cifar10-valid  train : [loss = 0.802, top1 = 71.55%], valid : [loss = 0.850, top1 = 69.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14379/15625) 014379-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.58 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.648, top1 = 85.88%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10        train : [loss = 0.030, top1 = 99.27%], test  : [loss = 0.427, top1 = 89.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.407, top1 = 88.98%], valid : [loss = 1.501, top1 = 63.38%], test : [loss = 1.461, top1 = 63.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.03%], valid : [loss = 2.601, top1 = 34.83%], test : [loss = 2.618, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14380/15625) 014380-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.79%], valid : [loss = 0.806, top1 = 81.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10        train : [loss = 0.069, top1 = 97.87%], test  : [loss = 0.455, top1 = 87.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.60 ms.
cifar100       train : [loss = 0.734, top1 = 78.56%], valid : [loss = 1.470, top1 = 61.28%], test : [loss = 1.439, top1 = 62.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.616, top1 = 34.21%], valid : [loss = 2.733, top1 = 32.23%], test : [loss = 2.779, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.63%], valid : [loss = 0.828, top1 = 71.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14381/15625) 014381-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.529, top1 = 89.19%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.328, top1 = 92.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.68 ms.
cifar100       train : [loss = 0.118, top1 = 97.42%], valid : [loss = 1.426, top1 = 67.54%], test : [loss = 1.426, top1 = 68.18%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.45%], valid : [loss = 2.339, top1 = 41.27%], test : [loss = 2.326, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.67%], valid : [loss = 0.722, top1 = 74.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14382/15625) 014382-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.548, top1 = 87.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.021, top1 = 99.38%], test  : [loss = 0.358, top1 = 91.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.01 ms.
cifar100       train : [loss = 0.331, top1 = 90.38%], valid : [loss = 1.333, top1 = 67.38%], test : [loss = 1.318, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.78 ms.
ImageNet16-120 train : [loss = 2.350, top1 = 39.53%], valid : [loss = 2.518, top1 = 36.07%], test : [loss = 2.521, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.993, top1 = 64.14%], valid : [loss = 1.035, top1 = 63.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14383/15625) 014383-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.98%], valid : [loss = 0.852, top1 = 70.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.680, top1 = 76.19%], test  : [loss = 0.762, top1 = 73.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.35 ms.
cifar100       train : [loss = 2.070, top1 = 45.17%], valid : [loss = 2.229, top1 = 42.56%], test : [loss = 2.256, top1 = 42.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 3.660, top1 = 15.58%], valid : [loss = 3.682, top1 = 15.50%], test : [loss = 3.694, top1 = 15.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.381, top1 = 49.87%], valid : [loss = 1.401, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14384/15625) 014384-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.87%], valid : [loss = 0.541, top1 = 88.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.28 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.346, top1 = 92.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.64 ms.
cifar100       train : [loss = 0.250, top1 = 93.33%], valid : [loss = 1.324, top1 = 67.38%], test : [loss = 1.341, top1 = 67.61%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.206, top1 = 42.74%], valid : [loss = 2.414, top1 = 38.06%], test : [loss = 2.432, top1 = 38.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14385/15625) 014385-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.51 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.49%], valid : [loss = 0.551, top1 = 87.53%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.21 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.362, top1 = 91.19%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.49 ms.
cifar100       train : [loss = 0.564, top1 = 83.53%], valid : [loss = 1.369, top1 = 64.34%], test : [loss = 1.361, top1 = 64.52%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.04%], valid : [loss = 2.654, top1 = 33.17%], test : [loss = 2.653, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.25%], valid : [loss = 0.927, top1 = 66.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14386/15625) 014386-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.35%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.23 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.327, top1 = 93.13%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.55 ms.
cifar100       train : [loss = 0.083, top1 = 98.47%], valid : [loss = 1.516, top1 = 67.74%], test : [loss = 1.506, top1 = 66.86%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.01 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.49%], valid : [loss = 2.333, top1 = 40.20%], test : [loss = 2.341, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 68.38%], valid : [loss = 0.912, top1 = 67.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14387/15625) 014387-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.60 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.54 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.67 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14388/15625) 014388-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.70 ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.15%], valid : [loss = 0.646, top1 = 78.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.81 ms.
cifar10        train : [loss = 0.510, top1 = 82.22%], test  : [loss = 0.597, top1 = 79.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.09 ms.
cifar100       train : [loss = 1.756, top1 = 52.41%], valid : [loss = 1.898, top1 = 49.44%], test : [loss = 1.916, top1 = 48.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 3.331, top1 = 21.21%], valid : [loss = 3.317, top1 = 21.47%], test : [loss = 3.345, top1 = 22.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.264, top1 = 54.32%], valid : [loss = 1.291, top1 = 53.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14389/15625) 014389-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.90%], valid : [loss = 0.475, top1 = 84.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.294, top1 = 90.17%], test  : [loss = 0.397, top1 = 86.51%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.54 ms.
cifar100       train : [loss = 1.326, top1 = 63.18%], valid : [loss = 1.544, top1 = 57.46%], test : [loss = 1.504, top1 = 58.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.75%], valid : [loss = 2.893, top1 = 29.23%], test : [loss = 2.955, top1 = 28.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14390/15625) 014390-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.22%], valid : [loss = 0.625, top1 = 85.42%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.15 ms.
cifar10        train : [loss = 0.069, top1 = 97.90%], test  : [loss = 0.398, top1 = 88.71%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.92 ms.
cifar100       train : [loss = 0.734, top1 = 78.76%], valid : [loss = 1.371, top1 = 63.78%], test : [loss = 1.346, top1 = 63.96%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 35.41%], valid : [loss = 2.673, top1 = 33.43%], test : [loss = 2.678, top1 = 33.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14391/15625) 014391-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.93 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.12%], valid : [loss = 0.724, top1 = 83.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10        train : [loss = 0.049, top1 = 98.48%], test  : [loss = 0.394, top1 = 89.62%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.78 ms.
cifar100       train : [loss = 0.632, top1 = 81.62%], valid : [loss = 1.479, top1 = 61.34%], test : [loss = 1.479, top1 = 61.24%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.408, top1 = 38.58%], valid : [loss = 2.562, top1 = 34.77%], test : [loss = 2.606, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.79%], valid : [loss = 0.894, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14392/15625) 014392-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.91%], valid : [loss = 0.478, top1 = 84.35%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.57 ms.
cifar10        train : [loss = 0.299, top1 = 89.96%], test  : [loss = 0.399, top1 = 86.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.47 ms.
cifar100       train : [loss = 1.337, top1 = 62.90%], valid : [loss = 1.544, top1 = 57.57%], test : [loss = 1.517, top1 = 58.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.61%], valid : [loss = 2.900, top1 = 29.33%], test : [loss = 2.954, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14393/15625) 014393-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.309, top1 = 89.41%], valid : [loss = 0.557, top1 = 82.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.273, top1 = 90.54%], test  : [loss = 0.421, top1 = 86.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 1.424, top1 = 60.03%], valid : [loss = 1.683, top1 = 54.41%], test : [loss = 1.662, top1 = 54.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.977, top1 = 27.26%], valid : [loss = 2.963, top1 = 28.23%], test : [loss = 3.025, top1 = 26.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.48%], valid : [loss = 1.040, top1 = 62.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14394/15625) 014394-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 22.20 M, Params=0.176 MB, latency=18.74 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.597, top1 = 86.63%]
cifar10        FLOP= 22.20 M, Params=0.176 MB, latency=19.41 ms.
cifar10        train : [loss = 0.023, top1 = 99.47%], test  : [loss = 0.400, top1 = 90.20%]
cifar100       FLOP= 22.21 M, Params=0.182 MB, latency=18.39 ms.
cifar100       train : [loss = 0.320, top1 = 91.70%], valid : [loss = 1.364, top1 = 66.10%], test : [loss = 1.366, top1 = 66.09%]
ImageNet16-120 FLOP=  5.56 M, Params=0.183 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.166, top1 = 43.87%], valid : [loss = 2.516, top1 = 37.26%], test : [loss = 2.525, top1 = 37.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.78%], valid : [loss = 0.737, top1 = 74.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14395/15625) 014395-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.74 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.07 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14396/15625) 014396-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.539, top1 = 88.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.98 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.345, top1 = 91.69%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.74 ms.
cifar100       train : [loss = 0.323, top1 = 91.28%], valid : [loss = 1.302, top1 = 66.86%], test : [loss = 1.308, top1 = 66.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.80 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.31%], valid : [loss = 2.430, top1 = 38.00%], test : [loss = 2.441, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.50%], valid : [loss = 0.832, top1 = 70.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14397/15625) 014397-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.53 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.586, top1 = 87.69%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.42 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.398, top1 = 90.98%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=15.06 ms.
cifar100       train : [loss = 0.241, top1 = 94.12%], valid : [loss = 1.575, top1 = 64.68%], test : [loss = 1.528, top1 = 64.16%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.09 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.86%], valid : [loss = 2.483, top1 = 38.10%], test : [loss = 2.463, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.67%], valid : [loss = 0.794, top1 = 71.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14398/15625) 014398-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.588, top1 = 87.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.393, top1 = 90.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 0.423, top1 = 87.88%], valid : [loss = 1.402, top1 = 65.09%], test : [loss = 1.388, top1 = 65.29%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 41.15%], valid : [loss = 2.489, top1 = 36.40%], test : [loss = 2.510, top1 = 37.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.96%], valid : [loss = 0.826, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14399/15625) 014399-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.78 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.96%], valid : [loss = 0.453, top1 = 86.67%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=14.70 ms.
cifar10        train : [loss = 0.141, top1 = 95.53%], test  : [loss = 0.328, top1 = 89.38%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=13.95 ms.
cifar100       train : [loss = 0.910, top1 = 74.30%], valid : [loss = 1.306, top1 = 63.28%], test : [loss = 1.325, top1 = 63.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.83 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 35.90%], valid : [loss = 2.603, top1 = 34.97%], test : [loss = 2.618, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.41%], valid : [loss = 0.766, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14400/15625) 014400-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.612, top1 = 87.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.430, top1 = 90.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.29 ms.
cifar100       train : [loss = 0.219, top1 = 94.82%], valid : [loss = 1.448, top1 = 66.40%], test : [loss = 1.482, top1 = 65.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.091, top1 = 45.55%], valid : [loss = 2.506, top1 = 38.03%], test : [loss = 2.550, top1 = 38.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14401/15625) 014401-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.42 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.560, top1 = 87.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.387, top1 = 91.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.27 ms.
cifar100       train : [loss = 0.380, top1 = 89.18%], valid : [loss = 1.398, top1 = 64.46%], test : [loss = 1.377, top1 = 65.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.28 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.86%], valid : [loss = 2.477, top1 = 37.77%], test : [loss = 2.503, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14402/15625) 014402-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.32%], valid : [loss = 0.511, top1 = 83.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.232, top1 = 92.12%], test  : [loss = 0.388, top1 = 87.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 1.211, top1 = 65.56%], valid : [loss = 1.504, top1 = 58.67%], test : [loss = 1.489, top1 = 58.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 2.771, top1 = 31.33%], valid : [loss = 2.783, top1 = 31.42%], test : [loss = 2.836, top1 = 29.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.951, top1 = 65.99%], valid : [loss = 0.991, top1 = 64.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14403/15625) 014403-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.528, top1 = 88.46%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.31 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.355, top1 = 91.72%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.00 ms.
cifar100       train : [loss = 0.302, top1 = 91.76%], valid : [loss = 1.278, top1 = 67.22%], test : [loss = 1.301, top1 = 67.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.53 ms.
ImageNet16-120 train : [loss = 2.192, top1 = 43.13%], valid : [loss = 2.442, top1 = 37.90%], test : [loss = 2.415, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.07%], valid : [loss = 0.849, top1 = 70.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14404/15625) 014404-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.93%], valid : [loss = 0.530, top1 = 87.73%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.55 ms.
cifar10        train : [loss = 0.062, top1 = 97.95%], test  : [loss = 0.365, top1 = 90.34%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.37 ms.
cifar100       train : [loss = 0.542, top1 = 84.21%], valid : [loss = 1.298, top1 = 65.44%], test : [loss = 1.284, top1 = 65.84%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.55 ms.
ImageNet16-120 train : [loss = 2.226, top1 = 42.32%], valid : [loss = 2.420, top1 = 38.03%], test : [loss = 2.416, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.83%], valid : [loss = 0.722, top1 = 75.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14405/15625) 014405-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.87%], valid : [loss = 0.642, top1 = 86.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.30 ms.
cifar10        train : [loss = 0.028, top1 = 99.35%], test  : [loss = 0.438, top1 = 89.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.69 ms.
cifar100       train : [loss = 0.395, top1 = 89.37%], valid : [loss = 1.451, top1 = 63.88%], test : [loss = 1.412, top1 = 64.38%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 2.300, top1 = 40.94%], valid : [loss = 2.637, top1 = 34.50%], test : [loss = 2.616, top1 = 35.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.92%], valid : [loss = 0.761, top1 = 73.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14406/15625) 014406-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.62%], valid : [loss = 0.855, top1 = 79.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.26 ms.
cifar10        train : [loss = 0.125, top1 = 95.88%], test  : [loss = 0.532, top1 = 85.36%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.87 ms.
cifar100       train : [loss = 0.840, top1 = 75.58%], valid : [loss = 1.681, top1 = 57.94%], test : [loss = 1.682, top1 = 58.22%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.43 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 26.31%], valid : [loss = 3.157, top1 = 24.20%], test : [loss = 3.228, top1 = 23.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.46%], valid : [loss = 1.117, top1 = 60.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14407/15625) 014407-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.00%], valid : [loss = 0.480, top1 = 84.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.295, top1 = 90.15%], test  : [loss = 0.398, top1 = 86.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.14 ms.
cifar100       train : [loss = 1.342, top1 = 62.97%], valid : [loss = 1.556, top1 = 56.94%], test : [loss = 1.539, top1 = 58.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.87 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.66%], valid : [loss = 2.899, top1 = 29.53%], test : [loss = 2.939, top1 = 28.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14408/15625) 014408-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.61%], valid : [loss = 0.697, top1 = 85.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.86 ms.
cifar10        train : [loss = 0.045, top1 = 98.61%], test  : [loss = 0.444, top1 = 89.37%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.39 ms.
cifar100       train : [loss = 0.451, top1 = 87.32%], valid : [loss = 1.537, top1 = 62.26%], test : [loss = 1.504, top1 = 62.72%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.93%], valid : [loss = 2.691, top1 = 34.00%], test : [loss = 2.748, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.84%], valid : [loss = 0.818, top1 = 71.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14409/15625) 014409-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.17%], valid : [loss = 0.672, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.75 ms.
cifar10        train : [loss = 0.079, top1 = 97.57%], test  : [loss = 0.434, top1 = 88.07%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.87 ms.
cifar100       train : [loss = 0.750, top1 = 78.01%], valid : [loss = 1.477, top1 = 61.62%], test : [loss = 1.456, top1 = 61.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.711, top1 = 32.39%], valid : [loss = 2.860, top1 = 30.37%], test : [loss = 2.890, top1 = 29.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.67%], valid : [loss = 0.832, top1 = 70.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14410/15625) 014410-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.531, top1 = 89.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.323, top1 = 93.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.44 ms.
cifar100       train : [loss = 0.109, top1 = 97.85%], valid : [loss = 1.293, top1 = 68.86%], test : [loss = 1.290, top1 = 69.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.05%], valid : [loss = 2.200, top1 = 44.63%], test : [loss = 2.205, top1 = 43.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14411/15625) 014411-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.496, top1 = 88.91%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.22 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.319, top1 = 92.36%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.36 ms.
cifar100       train : [loss = 0.236, top1 = 94.29%], valid : [loss = 1.225, top1 = 68.92%], test : [loss = 1.239, top1 = 68.94%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=23.51 ms.
ImageNet16-120 train : [loss = 1.925, top1 = 49.29%], valid : [loss = 2.262, top1 = 42.17%], test : [loss = 2.303, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.64%], valid : [loss = 0.661, top1 = 77.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14412/15625) 014412-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.640 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.01%]
cifar10        FLOP= 90.36 M, Params=0.640 MB, latency=16.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.324, top1 = 91.93%]
cifar100       FLOP= 90.36 M, Params=0.646 MB, latency=16.80 ms.
cifar100       train : [loss = 0.326, top1 = 91.16%], valid : [loss = 1.336, top1 = 67.04%], test : [loss = 1.317, top1 = 67.20%]
ImageNet16-120 FLOP= 22.60 M, Params=0.648 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.24%], valid : [loss = 2.377, top1 = 39.44%], test : [loss = 2.409, top1 = 39.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.454, top1 = 84.16%], valid : [loss = 0.548, top1 = 81.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14413/15625) 014413-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.92 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.33%], valid : [loss = 0.631, top1 = 85.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10        train : [loss = 0.029, top1 = 99.24%], test  : [loss = 0.376, top1 = 90.73%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 0.541, top1 = 84.09%], valid : [loss = 1.448, top1 = 63.80%], test : [loss = 1.405, top1 = 63.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.406, top1 = 38.65%], valid : [loss = 2.585, top1 = 34.70%], test : [loss = 2.601, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.47%], valid : [loss = 0.834, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14414/15625) 014414-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.612, top1 = 87.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.407, top1 = 91.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.211, top1 = 94.89%], valid : [loss = 1.499, top1 = 65.65%], test : [loss = 1.495, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.91%], valid : [loss = 2.521, top1 = 36.90%], test : [loss = 2.549, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.37%], valid : [loss = 0.747, top1 = 73.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14415/15625) 014415-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.510, top1 = 88.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.344, top1 = 91.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.24 ms.
cifar100       train : [loss = 0.339, top1 = 90.74%], valid : [loss = 1.277, top1 = 67.32%], test : [loss = 1.295, top1 = 66.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.75%], valid : [loss = 2.423, top1 = 39.01%], test : [loss = 2.422, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14416/15625) 014416-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.446, top1 = 90.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.322, top1 = 93.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.13 ms.
cifar100       train : [loss = 0.071, top1 = 98.94%], valid : [loss = 1.370, top1 = 69.86%], test : [loss = 1.336, top1 = 70.48%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.09 ms.
ImageNet16-120 train : [loss = 1.574, top1 = 57.63%], valid : [loss = 2.298, top1 = 43.23%], test : [loss = 2.312, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.392, top1 = 86.70%], valid : [loss = 0.526, top1 = 82.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14417/15625) 014417-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=22.41 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.483, top1 = 89.12%]
cifar10        FLOP= 62.83 M, Params=0.456 MB, latency=25.91 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.318, top1 = 92.40%]
cifar100       FLOP= 62.84 M, Params=0.462 MB, latency=21.03 ms.
cifar100       train : [loss = 0.244, top1 = 93.84%], valid : [loss = 1.268, top1 = 67.66%], test : [loss = 1.257, top1 = 68.76%]
ImageNet16-120 FLOP= 15.72 M, Params=0.463 MB, latency=20.23 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.60%], valid : [loss = 2.175, top1 = 43.33%], test : [loss = 2.152, top1 = 45.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 62.83 M, Params=0.456 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 75.99%], valid : [loss = 0.746, top1 = 73.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14418/15625) 014418-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.528, top1 = 89.93%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.50 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.329, top1 = 93.46%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.34 ms.
cifar100       train : [loss = 0.040, top1 = 99.55%], valid : [loss = 1.405, top1 = 69.84%], test : [loss = 1.385, top1 = 69.26%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 1.536, top1 = 58.44%], valid : [loss = 2.303, top1 = 43.20%], test : [loss = 2.308, top1 = 42.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.464, top1 = 84.16%], valid : [loss = 0.560, top1 = 81.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14419/15625) 014419-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.507, top1 = 88.73%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=14.52 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.336, top1 = 92.05%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=13.88 ms.
cifar100       train : [loss = 0.329, top1 = 91.08%], valid : [loss = 1.298, top1 = 66.64%], test : [loss = 1.289, top1 = 67.54%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=13.86 ms.
ImageNet16-120 train : [loss = 2.104, top1 = 45.23%], valid : [loss = 2.406, top1 = 38.94%], test : [loss = 2.423, top1 = 39.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14420/15625) 014420-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10-valid  train : [loss = 0.181, top1 = 93.98%], valid : [loss = 0.494, top1 = 84.97%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.73 ms.
cifar10        train : [loss = 0.192, top1 = 93.46%], test  : [loss = 0.386, top1 = 87.79%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.98 ms.
cifar100       train : [loss = 1.205, top1 = 65.75%], valid : [loss = 1.535, top1 = 58.48%], test : [loss = 1.560, top1 = 57.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.792, top1 = 31.00%], valid : [loss = 2.840, top1 = 30.53%], test : [loss = 2.860, top1 = 29.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.40%], valid : [loss = 1.015, top1 = 64.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14421/15625) 014421-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.587, top1 = 87.29%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.395, top1 = 91.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 0.386, top1 = 89.07%], valid : [loss = 1.393, top1 = 65.74%], test : [loss = 1.393, top1 = 65.37%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.73 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.89%], valid : [loss = 2.508, top1 = 36.80%], test : [loss = 2.537, top1 = 36.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14422/15625) 014422-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.87%], valid : [loss = 0.668, top1 = 77.13%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.63 ms.
cifar10        train : [loss = 0.504, top1 = 82.69%], test  : [loss = 0.580, top1 = 80.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.40 ms.
cifar100       train : [loss = 1.714, top1 = 53.32%], valid : [loss = 1.875, top1 = 50.14%], test : [loss = 1.893, top1 = 49.14%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.16 ms.
ImageNet16-120 train : [loss = 3.380, top1 = 20.07%], valid : [loss = 3.362, top1 = 20.33%], test : [loss = 3.397, top1 = 19.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14423/15625) 014423-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.86%], valid : [loss = 0.454, top1 = 86.47%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10        train : [loss = 0.150, top1 = 95.17%], test  : [loss = 0.343, top1 = 89.01%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.90 ms.
cifar100       train : [loss = 0.968, top1 = 72.45%], valid : [loss = 1.339, top1 = 62.53%], test : [loss = 1.339, top1 = 62.47%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.95 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 34.11%], valid : [loss = 2.675, top1 = 33.07%], test : [loss = 2.685, top1 = 32.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14424/15625) 014424-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.239, top1 = 91.93%], valid : [loss = 0.534, top1 = 83.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.49 ms.
cifar10        train : [loss = 0.231, top1 = 92.11%], test  : [loss = 0.411, top1 = 86.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.06 ms.
cifar100       train : [loss = 1.312, top1 = 62.84%], valid : [loss = 1.601, top1 = 56.25%], test : [loss = 1.604, top1 = 56.05%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.32%], valid : [loss = 2.934, top1 = 28.01%], test : [loss = 2.961, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.990, top1 = 64.60%], valid : [loss = 1.048, top1 = 63.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14425/15625) 014425-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.622, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.56 ms.
cifar10        train : [loss = 0.037, top1 = 99.00%], test  : [loss = 0.407, top1 = 89.36%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.78 ms.
cifar100       train : [loss = 0.448, top1 = 87.58%], valid : [loss = 1.383, top1 = 64.92%], test : [loss = 1.348, top1 = 65.23%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 40.93%], valid : [loss = 2.569, top1 = 35.49%], test : [loss = 2.591, top1 = 35.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.671, top1 = 76.46%], valid : [loss = 0.744, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14426/15625) 014426-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.33%], valid : [loss = 0.595, top1 = 85.70%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.75 ms.
cifar10        train : [loss = 0.068, top1 = 97.95%], test  : [loss = 0.399, top1 = 88.96%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.25 ms.
cifar100       train : [loss = 0.698, top1 = 79.74%], valid : [loss = 1.386, top1 = 63.21%], test : [loss = 1.360, top1 = 63.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.39%], valid : [loss = 2.625, top1 = 34.72%], test : [loss = 2.687, top1 = 33.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.32%], valid : [loss = 0.759, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14427/15625) 014427-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.583, top1 = 87.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.391, top1 = 91.06%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.97 ms.
cifar100       train : [loss = 0.396, top1 = 88.76%], valid : [loss = 1.407, top1 = 65.14%], test : [loss = 1.400, top1 = 65.33%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.15 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.77%], valid : [loss = 2.520, top1 = 36.51%], test : [loss = 2.541, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14428/15625) 014428-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.86%], valid : [loss = 0.443, top1 = 86.72%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.22 ms.
cifar10        train : [loss = 0.150, top1 = 95.19%], test  : [loss = 0.334, top1 = 89.12%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.51 ms.
cifar100       train : [loss = 0.997, top1 = 71.78%], valid : [loss = 1.342, top1 = 61.84%], test : [loss = 1.354, top1 = 62.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.31%], valid : [loss = 2.671, top1 = 32.73%], test : [loss = 2.680, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14429/15625) 014429-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.556, top1 = 89.03%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.46 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.340, top1 = 92.95%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.25 ms.
cifar100       train : [loss = 0.089, top1 = 98.23%], valid : [loss = 1.408, top1 = 68.34%], test : [loss = 1.471, top1 = 67.54%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 1.804, top1 = 52.20%], valid : [loss = 2.280, top1 = 41.80%], test : [loss = 2.300, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.08%], valid : [loss = 0.753, top1 = 73.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14430/15625) 014430-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.63%], valid : [loss = 0.559, top1 = 87.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.16 ms.
cifar10        train : [loss = 0.028, top1 = 99.18%], test  : [loss = 0.355, top1 = 91.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.45 ms.
cifar100       train : [loss = 0.429, top1 = 87.43%], valid : [loss = 1.279, top1 = 66.78%], test : [loss = 1.291, top1 = 66.65%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.252, top1 = 41.83%], valid : [loss = 2.433, top1 = 38.33%], test : [loss = 2.447, top1 = 37.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.858, top1 = 69.68%], valid : [loss = 0.896, top1 = 68.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14431/15625) 014431-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.126, top1 = 96.17%], valid : [loss = 0.462, top1 = 86.13%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10        train : [loss = 0.160, top1 = 94.81%], test  : [loss = 0.348, top1 = 88.67%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.74 ms.
cifar100       train : [loss = 0.995, top1 = 71.68%], valid : [loss = 1.353, top1 = 61.87%], test : [loss = 1.336, top1 = 62.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.80%], valid : [loss = 2.697, top1 = 32.19%], test : [loss = 2.719, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14432/15625) 014432-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.439, top1 = 90.22%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.297, top1 = 93.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.165, top1 = 96.24%], valid : [loss = 1.309, top1 = 69.47%], test : [loss = 1.307, top1 = 69.10%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.97 ms.
ImageNet16-120 train : [loss = 1.785, top1 = 52.41%], valid : [loss = 2.250, top1 = 43.08%], test : [loss = 2.287, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.419, top1 = 85.50%], valid : [loss = 0.550, top1 = 81.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14433/15625) 014433-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.470, top1 = 89.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.321, top1 = 92.03%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.69 ms.
cifar100       train : [loss = 0.316, top1 = 91.44%], valid : [loss = 1.273, top1 = 67.33%], test : [loss = 1.247, top1 = 67.94%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.82%], valid : [loss = 2.312, top1 = 40.92%], test : [loss = 2.320, top1 = 41.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.515, top1 = 81.97%], valid : [loss = 0.605, top1 = 79.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14434/15625) 014434-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=22.06 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.532, top1 = 89.47%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.325, top1 = 93.16%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.81 ms.
cifar100       train : [loss = 0.067, top1 = 99.00%], valid : [loss = 1.346, top1 = 69.57%], test : [loss = 1.356, top1 = 69.79%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=22.82 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.50%], valid : [loss = 2.373, top1 = 39.30%], test : [loss = 2.381, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 78.01%], valid : [loss = 0.694, top1 = 76.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14435/15625) 014435-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.553, top1 = 88.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.344, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.65 ms.
cifar100       train : [loss = 0.254, top1 = 93.13%], valid : [loss = 1.307, top1 = 67.54%], test : [loss = 1.316, top1 = 67.85%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 2.292, top1 = 40.92%], valid : [loss = 2.478, top1 = 37.40%], test : [loss = 2.497, top1 = 37.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.51%], valid : [loss = 0.930, top1 = 66.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14436/15625) 014436-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.137, top1 = 95.77%], valid : [loss = 0.507, top1 = 85.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10        train : [loss = 0.151, top1 = 94.93%], test  : [loss = 0.381, top1 = 88.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.94 ms.
cifar100       train : [loss = 1.020, top1 = 70.56%], valid : [loss = 1.411, top1 = 61.35%], test : [loss = 1.405, top1 = 61.13%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.72 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 36.00%], valid : [loss = 2.614, top1 = 34.48%], test : [loss = 2.630, top1 = 34.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.960, top1 = 65.84%], valid : [loss = 1.000, top1 = 64.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14437/15625) 014437-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.171, top1 = 94.40%], valid : [loss = 0.987, top1 = 75.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.49 ms.
cifar10        train : [loss = 0.214, top1 = 92.68%], test  : [loss = 0.598, top1 = 82.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.03 ms.
cifar100       train : [loss = 1.147, top1 = 67.31%], valid : [loss = 1.780, top1 = 53.79%], test : [loss = 1.755, top1 = 54.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 3.231, top1 = 22.69%], valid : [loss = 3.344, top1 = 21.08%], test : [loss = 3.387, top1 = 20.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 62.89%], valid : [loss = 1.077, top1 = 62.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14438/15625) 014438-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.603, top1 = 86.69%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10        train : [loss = 0.027, top1 = 99.29%], test  : [loss = 0.380, top1 = 90.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.72 ms.
cifar100       train : [loss = 0.509, top1 = 85.29%], valid : [loss = 1.426, top1 = 63.97%], test : [loss = 1.420, top1 = 63.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.68 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.84%], valid : [loss = 2.549, top1 = 35.98%], test : [loss = 2.547, top1 = 36.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.13%], valid : [loss = 0.816, top1 = 71.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14439/15625) 014439-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.30%], valid : [loss = 0.474, top1 = 85.77%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.49 ms.
cifar10        train : [loss = 0.160, top1 = 94.73%], test  : [loss = 0.347, top1 = 88.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.72 ms.
cifar100       train : [loss = 1.010, top1 = 71.46%], valid : [loss = 1.360, top1 = 62.15%], test : [loss = 1.353, top1 = 62.01%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.37 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.94%], valid : [loss = 2.672, top1 = 32.72%], test : [loss = 2.711, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14440/15625) 014440-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.519, top1 = 88.66%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.331, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.11 ms.
cifar100       train : [loss = 0.338, top1 = 90.84%], valid : [loss = 1.283, top1 = 67.13%], test : [loss = 1.274, top1 = 67.39%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.36%], valid : [loss = 2.415, top1 = 39.00%], test : [loss = 2.422, top1 = 38.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14441/15625) 014441-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.456, top1 = 89.11%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.314, top1 = 92.02%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.53 ms.
cifar100       train : [loss = 0.323, top1 = 91.33%], valid : [loss = 1.290, top1 = 67.00%], test : [loss = 1.308, top1 = 67.13%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 2.056, top1 = 46.43%], valid : [loss = 2.365, top1 = 40.08%], test : [loss = 2.398, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.472, top1 = 83.60%], valid : [loss = 0.581, top1 = 80.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14442/15625) 014442-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.518, top1 = 88.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.33 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.329, top1 = 92.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.98 ms.
cifar100       train : [loss = 0.329, top1 = 91.08%], valid : [loss = 1.282, top1 = 66.64%], test : [loss = 1.306, top1 = 67.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.91%], valid : [loss = 2.400, top1 = 39.20%], test : [loss = 2.427, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14443/15625) 014443-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.34 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.391, top1 = 90.99%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.00 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.258, top1 = 93.76%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.08 ms.
cifar100       train : [loss = 0.053, top1 = 99.39%], valid : [loss = 1.253, top1 = 71.85%], test : [loss = 1.239, top1 = 71.74%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.84 ms.
ImageNet16-120 train : [loss = 1.433, top1 = 60.93%], valid : [loss = 2.178, top1 = 45.16%], test : [loss = 2.188, top1 = 45.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 88.07%], valid : [loss = 0.494, top1 = 83.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14444/15625) 014444-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.106, top1 = 96.79%], valid : [loss = 0.513, top1 = 85.60%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.61 ms.
cifar10        train : [loss = 0.172, top1 = 94.22%], test  : [loss = 0.366, top1 = 88.42%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.42 ms.
cifar100       train : [loss = 0.987, top1 = 71.62%], valid : [loss = 1.360, top1 = 62.42%], test : [loss = 1.343, top1 = 62.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.659, top1 = 33.50%], valid : [loss = 2.693, top1 = 32.69%], test : [loss = 2.738, top1 = 32.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 65.98%], valid : [loss = 0.998, top1 = 64.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14445/15625) 014445-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.156, top1 = 94.70%], valid : [loss = 0.722, top1 = 80.52%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.32 ms.
cifar10        train : [loss = 0.184, top1 = 93.67%], test  : [loss = 0.513, top1 = 84.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.64 ms.
cifar100       train : [loss = 0.887, top1 = 74.06%], valid : [loss = 1.662, top1 = 57.22%], test : [loss = 1.666, top1 = 57.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.77 ms.
ImageNet16-120 train : [loss = 3.492, top1 = 16.94%], valid : [loss = 3.488, top1 = 17.50%], test : [loss = 3.506, top1 = 16.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14446/15625) 014446-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.612, top1 = 85.37%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10        train : [loss = 0.070, top1 = 97.87%], test  : [loss = 0.401, top1 = 89.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.93 ms.
cifar100       train : [loss = 0.713, top1 = 79.25%], valid : [loss = 1.378, top1 = 63.23%], test : [loss = 1.350, top1 = 63.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.83%], valid : [loss = 2.656, top1 = 33.58%], test : [loss = 2.707, top1 = 32.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14447/15625) 014447-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.19%], valid : [loss = 0.609, top1 = 85.40%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.073, top1 = 97.76%], test  : [loss = 0.401, top1 = 88.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.54 ms.
cifar100       train : [loss = 0.714, top1 = 79.38%], valid : [loss = 1.382, top1 = 63.33%], test : [loss = 1.364, top1 = 63.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.23%], valid : [loss = 2.655, top1 = 33.88%], test : [loss = 2.695, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14448/15625) 014448-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.494, top1 = 89.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.34 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.322, top1 = 92.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.22 ms.
cifar100       train : [loss = 0.241, top1 = 94.07%], valid : [loss = 1.236, top1 = 68.97%], test : [loss = 1.257, top1 = 68.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 1.923, top1 = 49.26%], valid : [loss = 2.288, top1 = 41.46%], test : [loss = 2.280, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14449/15625) 014449-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.53 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.561, top1 = 88.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.384, top1 = 91.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.169, top1 = 96.07%], valid : [loss = 1.503, top1 = 66.58%], test : [loss = 1.471, top1 = 67.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 2.005, top1 = 47.46%], valid : [loss = 2.439, top1 = 39.06%], test : [loss = 2.435, top1 = 39.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.10%], valid : [loss = 0.768, top1 = 73.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14450/15625) 014450-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.59 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.537, top1 = 89.69%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.83 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.334, top1 = 92.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.66 ms.
cifar100       train : [loss = 0.116, top1 = 97.40%], valid : [loss = 1.364, top1 = 68.92%], test : [loss = 1.352, top1 = 68.85%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.714, top1 = 54.15%], valid : [loss = 2.233, top1 = 42.56%], test : [loss = 2.250, top1 = 43.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.06%], valid : [loss = 0.774, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14451/15625) 014451-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.504, top1 = 88.86%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.45 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.308, top1 = 92.43%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.72 ms.
cifar100       train : [loss = 0.243, top1 = 94.00%], valid : [loss = 1.236, top1 = 68.53%], test : [loss = 1.244, top1 = 68.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.23 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.48%], valid : [loss = 2.260, top1 = 42.12%], test : [loss = 2.259, top1 = 42.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.86%], valid : [loss = 0.692, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14452/15625) 014452-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.82%], valid : [loss = 0.482, top1 = 88.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10        train : [loss = 0.021, top1 = 99.47%], test  : [loss = 0.339, top1 = 91.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.39 ms.
cifar100       train : [loss = 0.401, top1 = 88.42%], valid : [loss = 1.308, top1 = 66.68%], test : [loss = 1.296, top1 = 66.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.68%], valid : [loss = 2.390, top1 = 39.61%], test : [loss = 2.423, top1 = 38.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.54%], valid : [loss = 0.633, top1 = 78.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14453/15625) 014453-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.39%], valid : [loss = 0.455, top1 = 86.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10        train : [loss = 0.160, top1 = 94.79%], test  : [loss = 0.352, top1 = 88.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.75 ms.
cifar100       train : [loss = 0.976, top1 = 72.26%], valid : [loss = 1.348, top1 = 62.62%], test : [loss = 1.340, top1 = 61.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.61%], valid : [loss = 2.699, top1 = 32.34%], test : [loss = 2.728, top1 = 32.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14454/15625) 014454-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.225, top1 = 92.36%], valid : [loss = 0.540, top1 = 83.62%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.17 ms.
cifar10        train : [loss = 0.218, top1 = 92.54%], test  : [loss = 0.395, top1 = 87.34%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 1.256, top1 = 64.22%], valid : [loss = 1.547, top1 = 57.80%], test : [loss = 1.533, top1 = 57.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.716, top1 = 32.38%], valid : [loss = 2.727, top1 = 32.41%], test : [loss = 2.785, top1 = 31.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.12%], valid : [loss = 0.998, top1 = 64.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14455/15625) 014455-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.484, top1 = 89.59%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.51 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.316, top1 = 92.63%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.99 ms.
cifar100       train : [loss = 0.165, top1 = 96.24%], valid : [loss = 1.309, top1 = 69.19%], test : [loss = 1.293, top1 = 69.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.743, top1 = 53.54%], valid : [loss = 2.210, top1 = 43.18%], test : [loss = 2.236, top1 = 43.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.72%], valid : [loss = 0.538, top1 = 81.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14456/15625) 014456-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.15 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.535, top1 = 89.34%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.46 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.332, top1 = 92.79%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.74 ms.
cifar100       train : [loss = 0.104, top1 = 98.00%], valid : [loss = 1.334, top1 = 69.59%], test : [loss = 1.350, top1 = 69.56%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.92 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.39%], valid : [loss = 2.331, top1 = 40.51%], test : [loss = 2.313, top1 = 41.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.57%], valid : [loss = 0.799, top1 = 72.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14457/15625) 014457-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.600, top1 = 87.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.403, top1 = 91.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.05 ms.
cifar100       train : [loss = 0.213, top1 = 95.00%], valid : [loss = 1.441, top1 = 66.37%], test : [loss = 1.432, top1 = 66.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.60 ms.
ImageNet16-120 train : [loss = 2.075, top1 = 45.86%], valid : [loss = 2.479, top1 = 37.42%], test : [loss = 2.514, top1 = 38.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.87%], valid : [loss = 0.744, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14458/15625) 014458-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.17 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.563, top1 = 88.14%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10        train : [loss = 0.014, top1 = 99.63%], test  : [loss = 0.353, top1 = 91.95%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.84 ms.
cifar100       train : [loss = 0.260, top1 = 92.83%], valid : [loss = 1.340, top1 = 67.11%], test : [loss = 1.335, top1 = 67.31%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.20 ms.
ImageNet16-120 train : [loss = 2.262, top1 = 41.47%], valid : [loss = 2.445, top1 = 38.10%], test : [loss = 2.478, top1 = 37.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 65.92%], valid : [loss = 0.973, top1 = 65.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14459/15625) 014459-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.21 ms.
cifar10-valid  train : [loss = 1.169, top1 = 58.23%], valid : [loss = 1.223, top1 = 56.64%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.80 ms.
cifar10        train : [loss = 1.147, top1 = 59.28%], test  : [loss = 1.146, top1 = 58.97%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 2.700, top1 = 32.30%], valid : [loss = 2.775, top1 = 31.34%], test : [loss = 2.762, top1 = 31.04%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.06 ms.
ImageNet16-120 train : [loss = 3.855, top1 = 12.60%], valid : [loss = 3.842, top1 = 13.43%], test : [loss = 3.855, top1 = 13.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.721, top1 = 34.98%], valid : [loss = 1.735, top1 = 34.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14460/15625) 014460-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.243, top1 = 91.78%], valid : [loss = 0.545, top1 = 83.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.229, top1 = 92.17%], test  : [loss = 0.407, top1 = 86.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 1.295, top1 = 63.44%], valid : [loss = 1.591, top1 = 56.70%], test : [loss = 1.596, top1 = 56.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.40 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.32%], valid : [loss = 2.927, top1 = 27.96%], test : [loss = 2.965, top1 = 27.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.36%], valid : [loss = 1.045, top1 = 63.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14461/15625) 014461-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.63 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.579, top1 = 87.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.384, top1 = 91.11%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.70 ms.
cifar100       train : [loss = 0.400, top1 = 88.66%], valid : [loss = 1.415, top1 = 65.06%], test : [loss = 1.400, top1 = 65.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.02%], valid : [loss = 2.517, top1 = 36.64%], test : [loss = 2.535, top1 = 37.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14462/15625) 014462-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.437, top1 = 90.81%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.92%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.13 ms.
cifar100       train : [loss = 0.048, top1 = 99.43%], valid : [loss = 1.325, top1 = 71.17%], test : [loss = 1.308, top1 = 71.40%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 1.482, top1 = 59.75%], valid : [loss = 2.221, top1 = 44.36%], test : [loss = 2.265, top1 = 44.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.35%], valid : [loss = 0.520, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14463/15625) 014463-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.468, top1 = 89.30%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.64 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.326, top1 = 92.13%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.66 ms.
cifar100       train : [loss = 0.290, top1 = 92.21%], valid : [loss = 1.333, top1 = 67.35%], test : [loss = 1.338, top1 = 67.55%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.99 ms.
ImageNet16-120 train : [loss = 2.013, top1 = 47.30%], valid : [loss = 2.330, top1 = 40.60%], test : [loss = 2.362, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.89%], valid : [loss = 0.638, top1 = 78.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14464/15625) 014464-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.588, top1 = 87.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.73 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.382, top1 = 91.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.61 ms.
cifar100       train : [loss = 0.347, top1 = 90.30%], valid : [loss = 1.421, top1 = 65.15%], test : [loss = 1.430, top1 = 64.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.239, top1 = 42.30%], valid : [loss = 2.464, top1 = 37.58%], test : [loss = 2.490, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.48%], valid : [loss = 0.852, top1 = 70.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14465/15625) 014465-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.27%], valid : [loss = 0.457, top1 = 86.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.114, top1 = 96.50%], test  : [loss = 0.332, top1 = 89.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 0.866, top1 = 75.30%], valid : [loss = 1.296, top1 = 64.19%], test : [loss = 1.284, top1 = 63.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 2.554, top1 = 35.68%], valid : [loss = 2.644, top1 = 34.24%], test : [loss = 2.675, top1 = 33.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14466/15625) 014466-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.518, top1 = 88.56%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.329, top1 = 92.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.86 ms.
cifar100       train : [loss = 0.346, top1 = 90.58%], valid : [loss = 1.284, top1 = 66.72%], test : [loss = 1.302, top1 = 67.45%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.74%], valid : [loss = 2.404, top1 = 38.53%], test : [loss = 2.407, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14467/15625) 014467-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.80%], valid : [loss = 0.477, top1 = 84.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10        train : [loss = 0.301, top1 = 89.98%], test  : [loss = 0.405, top1 = 86.37%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.51 ms.
cifar100       train : [loss = 1.328, top1 = 63.03%], valid : [loss = 1.519, top1 = 58.26%], test : [loss = 1.507, top1 = 58.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.05 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.59%], valid : [loss = 2.902, top1 = 29.70%], test : [loss = 2.971, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14468/15625) 014468-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.66 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.494, top1 = 89.27%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.91 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.303, top1 = 92.83%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.79 ms.
cifar100       train : [loss = 0.154, top1 = 96.77%], valid : [loss = 1.266, top1 = 69.66%], test : [loss = 1.263, top1 = 69.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 1.764, top1 = 52.93%], valid : [loss = 2.224, top1 = 43.18%], test : [loss = 2.208, top1 = 43.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.498, top1 = 82.83%], valid : [loss = 0.590, top1 = 79.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14469/15625) 014469-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.434, top1 = 90.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.58 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.282, top1 = 93.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.30 ms.
cifar100       train : [loss = 0.070, top1 = 98.91%], valid : [loss = 1.352, top1 = 70.40%], test : [loss = 1.325, top1 = 70.57%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.74 ms.
ImageNet16-120 train : [loss = 1.555, top1 = 58.02%], valid : [loss = 2.227, top1 = 44.63%], test : [loss = 2.255, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.354, top1 = 87.85%], valid : [loss = 0.490, top1 = 83.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14470/15625) 014470-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.574, top1 = 87.83%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.27 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.384, top1 = 91.63%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.22 ms.
cifar100       train : [loss = 0.158, top1 = 96.57%], valid : [loss = 1.511, top1 = 65.97%], test : [loss = 1.500, top1 = 66.37%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 2.022, top1 = 47.24%], valid : [loss = 2.449, top1 = 38.18%], test : [loss = 2.446, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.01%], valid : [loss = 0.729, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14471/15625) 014471-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.48 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.57 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14472/15625) 014472-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.85%], valid : [loss = 0.858, top1 = 71.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.31 ms.
cifar10        train : [loss = 0.566, top1 = 80.19%], test  : [loss = 0.721, top1 = 75.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.88 ms.
cifar100       train : [loss = 1.787, top1 = 52.01%], valid : [loss = 2.043, top1 = 47.23%], test : [loss = 2.055, top1 = 46.61%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.85%], valid : [loss = 3.642, top1 = 16.60%], test : [loss = 3.681, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14473/15625) 014473-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.485, top1 = 90.17%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.71 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.311, top1 = 93.36%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.80 ms.
cifar100       train : [loss = 0.095, top1 = 98.40%], valid : [loss = 1.284, top1 = 69.67%], test : [loss = 1.279, top1 = 69.85%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.39 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.72%], valid : [loss = 2.188, top1 = 44.18%], test : [loss = 2.185, top1 = 44.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.716, top1 = 75.08%], valid : [loss = 0.765, top1 = 73.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14474/15625) 014474-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.086, top1 = 97.66%], valid : [loss = 0.462, top1 = 86.44%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.25 ms.
cifar10        train : [loss = 0.123, top1 = 96.13%], test  : [loss = 0.342, top1 = 89.12%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.39 ms.
cifar100       train : [loss = 0.757, top1 = 78.81%], valid : [loss = 1.285, top1 = 64.41%], test : [loss = 1.283, top1 = 64.61%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 2.503, top1 = 36.63%], valid : [loss = 2.603, top1 = 34.54%], test : [loss = 2.624, top1 = 34.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14475/15625) 014475-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.30 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.494, top1 = 89.96%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.68 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.311, top1 = 93.23%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.58 ms.
cifar100       train : [loss = 0.112, top1 = 97.82%], valid : [loss = 1.311, top1 = 69.11%], test : [loss = 1.306, top1 = 69.59%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 1.702, top1 = 54.46%], valid : [loss = 2.178, top1 = 43.98%], test : [loss = 2.177, top1 = 44.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 82.37%], valid : [loss = 0.606, top1 = 79.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14476/15625) 014476-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.558, top1 = 87.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.344, top1 = 91.77%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.91 ms.
cifar100       train : [loss = 0.317, top1 = 91.22%], valid : [loss = 1.299, top1 = 67.15%], test : [loss = 1.315, top1 = 67.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.08%], valid : [loss = 2.463, top1 = 37.48%], test : [loss = 2.484, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.34%], valid : [loss = 0.947, top1 = 66.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14477/15625) 014477-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.74 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.459, top1 = 89.45%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.008, top1 = 99.89%], test  : [loss = 0.315, top1 = 92.25%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.64 ms.
cifar100       train : [loss = 0.197, top1 = 95.26%], valid : [loss = 1.341, top1 = 67.78%], test : [loss = 1.327, top1 = 68.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 1.879, top1 = 50.32%], valid : [loss = 2.276, top1 = 41.97%], test : [loss = 2.328, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.458, top1 = 84.08%], valid : [loss = 0.553, top1 = 81.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14478/15625) 014478-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.574, top1 = 88.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.56 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.360, top1 = 91.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.32 ms.
cifar100       train : [loss = 0.234, top1 = 93.74%], valid : [loss = 1.341, top1 = 67.26%], test : [loss = 1.346, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.18%], valid : [loss = 2.394, top1 = 38.96%], test : [loss = 2.378, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.920, top1 = 66.76%], valid : [loss = 0.951, top1 = 66.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14479/15625) 014479-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.57%], valid : [loss = 0.438, top1 = 88.12%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.89 ms.
cifar10        train : [loss = 0.054, top1 = 98.70%], test  : [loss = 0.316, top1 = 90.61%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.66 ms.
cifar100       train : [loss = 0.589, top1 = 83.79%], valid : [loss = 1.241, top1 = 66.52%], test : [loss = 1.216, top1 = 66.62%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.21%], valid : [loss = 2.463, top1 = 37.93%], test : [loss = 2.481, top1 = 37.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.47%], valid : [loss = 0.632, top1 = 78.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14480/15625) 014480-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.522, top1 = 89.52%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.340, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.11 ms.
cifar100       train : [loss = 0.063, top1 = 98.83%], valid : [loss = 1.403, top1 = 69.61%], test : [loss = 1.394, top1 = 70.09%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.649, top1 = 55.72%], valid : [loss = 2.191, top1 = 44.31%], test : [loss = 2.174, top1 = 44.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.751, top1 = 73.33%], valid : [loss = 0.815, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14481/15625) 014481-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.73 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.79%], valid : [loss = 0.601, top1 = 87.57%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.70 ms.
cifar10        train : [loss = 0.016, top1 = 99.57%], test  : [loss = 0.400, top1 = 91.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.42 ms.
cifar100       train : [loss = 0.332, top1 = 90.83%], valid : [loss = 1.491, top1 = 63.72%], test : [loss = 1.459, top1 = 64.53%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.47 ms.
ImageNet16-120 train : [loss = 2.583, top1 = 34.20%], valid : [loss = 2.702, top1 = 31.84%], test : [loss = 2.693, top1 = 31.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.176, top1 = 57.71%], valid : [loss = 1.178, top1 = 57.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14482/15625) 014482-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.445, top1 = 89.36%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.311, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.26 ms.
cifar100       train : [loss = 0.317, top1 = 91.46%], valid : [loss = 1.314, top1 = 66.99%], test : [loss = 1.282, top1 = 67.89%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.29%], valid : [loss = 2.361, top1 = 40.27%], test : [loss = 2.392, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.459, top1 = 83.99%], valid : [loss = 0.568, top1 = 80.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14483/15625) 014483-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.43 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.90%], valid : [loss = 0.484, top1 = 84.23%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.95 ms.
cifar10        train : [loss = 0.300, top1 = 89.96%], test  : [loss = 0.402, top1 = 86.37%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.43 ms.
cifar100       train : [loss = 1.331, top1 = 63.10%], valid : [loss = 1.537, top1 = 57.47%], test : [loss = 1.508, top1 = 58.57%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.19 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.81%], valid : [loss = 2.896, top1 = 30.08%], test : [loss = 2.948, top1 = 27.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14484/15625) 014484-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.543, top1 = 87.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.027, top1 = 99.25%], test  : [loss = 0.382, top1 = 90.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.58 ms.
cifar100       train : [loss = 0.447, top1 = 86.91%], valid : [loss = 1.384, top1 = 65.25%], test : [loss = 1.387, top1 = 65.04%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.314, top1 = 40.60%], valid : [loss = 2.520, top1 = 36.50%], test : [loss = 2.552, top1 = 35.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.84%], valid : [loss = 0.713, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14485/15625) 014485-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.18 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.24 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.64 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14486/15625) 014486-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.86 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.09%], valid : [loss = 0.680, top1 = 83.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.33 ms.
cifar10        train : [loss = 0.073, top1 = 97.54%], test  : [loss = 0.465, top1 = 87.93%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.76 ms.
cifar100       train : [loss = 0.361, top1 = 89.76%], valid : [loss = 1.679, top1 = 60.79%], test : [loss = 1.720, top1 = 60.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 3.277, top1 = 20.67%], valid : [loss = 3.307, top1 = 20.96%], test : [loss = 3.334, top1 = 20.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 1.239, top1 = 54.77%], valid : [loss = 1.260, top1 = 54.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14487/15625) 014487-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.39 ms.
cifar10-valid  train : [loss = 0.169, top1 = 94.42%], valid : [loss = 0.914, top1 = 76.29%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.57 ms.
cifar10        train : [loss = 0.226, top1 = 92.21%], test  : [loss = 0.589, top1 = 82.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.49 ms.
cifar100       train : [loss = 1.183, top1 = 66.31%], valid : [loss = 1.793, top1 = 53.36%], test : [loss = 1.784, top1 = 53.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.06 ms.
ImageNet16-120 train : [loss = 3.229, top1 = 22.67%], valid : [loss = 3.339, top1 = 21.49%], test : [loss = 3.369, top1 = 21.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14488/15625) 014488-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.043, top1 = 98.76%], valid : [loss = 0.556, top1 = 86.59%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10        train : [loss = 0.084, top1 = 97.25%], test  : [loss = 0.357, top1 = 89.98%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.89 ms.
cifar100       train : [loss = 0.745, top1 = 78.11%], valid : [loss = 1.304, top1 = 64.77%], test : [loss = 1.304, top1 = 64.24%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 2.450, top1 = 37.55%], valid : [loss = 2.551, top1 = 35.57%], test : [loss = 2.601, top1 = 34.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.49%], valid : [loss = 0.724, top1 = 74.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14489/15625) 014489-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.190, top1 = 93.74%], valid : [loss = 0.535, top1 = 84.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.197, top1 = 93.32%], test  : [loss = 0.397, top1 = 87.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.51 ms.
cifar100       train : [loss = 1.173, top1 = 66.53%], valid : [loss = 1.510, top1 = 58.37%], test : [loss = 1.499, top1 = 59.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.694, top1 = 32.65%], valid : [loss = 2.708, top1 = 32.58%], test : [loss = 2.760, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.04%], valid : [loss = 0.971, top1 = 66.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14490/15625) 014490-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.526, top1 = 88.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.328, top1 = 92.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.87 ms.
cifar100       train : [loss = 0.350, top1 = 90.39%], valid : [loss = 1.291, top1 = 67.02%], test : [loss = 1.291, top1 = 67.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.63%], valid : [loss = 2.416, top1 = 39.13%], test : [loss = 2.429, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14491/15625) 014491-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.514, top1 = 89.67%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.34 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.331, top1 = 93.13%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.08 ms.
cifar100       train : [loss = 0.063, top1 = 98.94%], valid : [loss = 1.375, top1 = 69.83%], test : [loss = 1.358, top1 = 70.04%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=22.35 ms.
ImageNet16-120 train : [loss = 1.921, top1 = 49.36%], valid : [loss = 2.306, top1 = 40.86%], test : [loss = 2.282, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.03%], valid : [loss = 0.822, top1 = 70.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14492/15625) 014492-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.329, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.06 ms.
cifar100       train : [loss = 0.150, top1 = 96.85%], valid : [loss = 1.310, top1 = 68.73%], test : [loss = 1.288, top1 = 69.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.06 ms.
ImageNet16-120 train : [loss = 1.881, top1 = 50.29%], valid : [loss = 2.303, top1 = 41.59%], test : [loss = 2.297, top1 = 41.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14493/15625) 014493-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.513, top1 = 89.60%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=22.70 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.335, top1 = 92.82%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=21.93 ms.
cifar100       train : [loss = 0.073, top1 = 98.66%], valid : [loss = 1.330, top1 = 70.40%], test : [loss = 1.344, top1 = 70.24%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=24.49 ms.
ImageNet16-120 train : [loss = 2.196, top1 = 42.78%], valid : [loss = 2.453, top1 = 37.76%], test : [loss = 2.425, top1 = 38.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.80%], valid : [loss = 0.809, top1 = 71.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14494/15625) 014494-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.454, top1 = 89.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.81 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.331, top1 = 91.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.27 ms.
cifar100       train : [loss = 0.329, top1 = 90.94%], valid : [loss = 1.273, top1 = 67.62%], test : [loss = 1.287, top1 = 67.81%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.76 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.21%], valid : [loss = 2.377, top1 = 40.13%], test : [loss = 2.412, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.89%], valid : [loss = 0.538, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14495/15625) 014495-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.563, top1 = 88.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.13 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.365, top1 = 92.42%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.19 ms.
cifar100       train : [loss = 0.117, top1 = 97.81%], valid : [loss = 1.458, top1 = 67.82%], test : [loss = 1.475, top1 = 67.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.80 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.65%], valid : [loss = 2.402, top1 = 40.03%], test : [loss = 2.426, top1 = 40.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.01%], valid : [loss = 0.752, top1 = 73.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14496/15625) 014496-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.538, top1 = 81.20%], valid : [loss = 0.864, top1 = 71.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.57 ms.
cifar10        train : [loss = 0.559, top1 = 80.50%], test  : [loss = 0.710, top1 = 75.72%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.24 ms.
cifar100       train : [loss = 1.774, top1 = 52.21%], valid : [loss = 2.054, top1 = 46.84%], test : [loss = 2.064, top1 = 46.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.85%], valid : [loss = 3.634, top1 = 16.73%], test : [loss = 3.657, top1 = 16.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.65%], valid : [loss = 1.252, top1 = 55.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14497/15625) 014497-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.53%], valid : [loss = 0.633, top1 = 85.99%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.80 ms.
cifar10        train : [loss = 0.032, top1 = 99.10%], test  : [loss = 0.392, top1 = 90.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.05 ms.
cifar100       train : [loss = 0.539, top1 = 84.21%], valid : [loss = 1.430, top1 = 63.99%], test : [loss = 1.414, top1 = 63.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.31%], valid : [loss = 2.567, top1 = 35.42%], test : [loss = 2.579, top1 = 35.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.68%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14498/15625) 014498-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.34 ms.
cifar10-valid  train : [loss = 0.386, top1 = 86.75%], valid : [loss = 0.518, top1 = 82.63%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.64 ms.
cifar10        train : [loss = 0.397, top1 = 86.54%], test  : [loss = 0.462, top1 = 84.23%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 1.527, top1 = 58.03%], valid : [loss = 1.659, top1 = 54.35%], test : [loss = 1.636, top1 = 55.05%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.21 ms.
ImageNet16-120 train : [loss = 3.026, top1 = 26.57%], valid : [loss = 2.990, top1 = 27.38%], test : [loss = 3.052, top1 = 26.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14499/15625) 014499-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.487, top1 = 89.67%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.306, top1 = 92.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.82 ms.
cifar100       train : [loss = 0.127, top1 = 97.58%], valid : [loss = 1.276, top1 = 69.55%], test : [loss = 1.290, top1 = 69.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.08 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.11%], valid : [loss = 2.191, top1 = 43.50%], test : [loss = 2.214, top1 = 43.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.46%], valid : [loss = 0.588, top1 = 79.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14500/15625) 014500-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.220, top1 = 92.50%], valid : [loss = 1.023, top1 = 73.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.30 ms.
cifar10        train : [loss = 0.283, top1 = 90.22%], test  : [loss = 0.651, top1 = 80.24%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.60 ms.
cifar100       train : [loss = 1.279, top1 = 64.06%], valid : [loss = 1.896, top1 = 51.33%], test : [loss = 1.905, top1 = 51.49%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 3.331, top1 = 20.90%], valid : [loss = 3.441, top1 = 20.02%], test : [loss = 3.473, top1 = 18.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.109, top1 = 60.26%], valid : [loss = 1.172, top1 = 58.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14501/15625) 014501-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.520, top1 = 89.00%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.57 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.375, top1 = 92.45%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.36 ms.
cifar100       train : [loss = 0.076, top1 = 98.70%], valid : [loss = 1.529, top1 = 67.27%], test : [loss = 1.524, top1 = 67.29%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.79 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.81%], valid : [loss = 2.358, top1 = 40.74%], test : [loss = 2.388, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.83%], valid : [loss = 0.738, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14502/15625) 014502-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.565, top1 = 88.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.017, top1 = 99.54%], test  : [loss = 0.376, top1 = 91.39%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.07 ms.
cifar100       train : [loss = 0.276, top1 = 92.53%], valid : [loss = 1.350, top1 = 67.00%], test : [loss = 1.350, top1 = 67.03%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.06%], valid : [loss = 2.375, top1 = 39.83%], test : [loss = 2.398, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.794, top1 = 71.45%], valid : [loss = 0.838, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14503/15625) 014503-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.058, top1 = 98.37%], valid : [loss = 0.579, top1 = 85.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10        train : [loss = 0.107, top1 = 96.44%], test  : [loss = 0.393, top1 = 88.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 0.814, top1 = 76.05%], valid : [loss = 1.413, top1 = 62.08%], test : [loss = 1.395, top1 = 62.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.72 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 32.98%], valid : [loss = 2.773, top1 = 31.78%], test : [loss = 2.820, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 77.05%], valid : [loss = 0.718, top1 = 75.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14504/15625) 014504-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.542, top1 = 88.55%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.64 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.354, top1 = 91.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.27 ms.
cifar100       train : [loss = 0.289, top1 = 91.97%], valid : [loss = 1.328, top1 = 67.62%], test : [loss = 1.340, top1 = 67.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.34 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.91%], valid : [loss = 2.431, top1 = 38.56%], test : [loss = 2.433, top1 = 38.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.30%], valid : [loss = 1.002, top1 = 64.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14505/15625) 014505-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.42%], valid : [loss = 0.646, top1 = 85.35%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10        train : [loss = 0.041, top1 = 98.80%], test  : [loss = 0.402, top1 = 89.89%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.64 ms.
cifar100       train : [loss = 0.559, top1 = 83.52%], valid : [loss = 1.442, top1 = 63.61%], test : [loss = 1.429, top1 = 63.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.87%], valid : [loss = 2.545, top1 = 35.59%], test : [loss = 2.552, top1 = 35.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.06%], valid : [loss = 0.884, top1 = 68.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14506/15625) 014506-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.46%], valid : [loss = 0.529, top1 = 87.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10        train : [loss = 0.035, top1 = 98.92%], test  : [loss = 0.339, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.22 ms.
cifar100       train : [loss = 0.492, top1 = 85.55%], valid : [loss = 1.276, top1 = 66.78%], test : [loss = 1.253, top1 = 66.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.49%], valid : [loss = 2.391, top1 = 39.79%], test : [loss = 2.404, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.807, top1 = 70.70%], valid : [loss = 0.847, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14507/15625) 014507-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.545, top1 = 88.80%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.38 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.346, top1 = 92.05%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.81 ms.
cifar100       train : [loss = 0.235, top1 = 93.83%], valid : [loss = 1.299, top1 = 68.04%], test : [loss = 1.340, top1 = 67.92%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.67%], valid : [loss = 2.400, top1 = 38.83%], test : [loss = 2.408, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.83%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14508/15625) 014508-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.557, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.96 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.351, top1 = 92.59%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.74 ms.
cifar100       train : [loss = 0.072, top1 = 98.67%], valid : [loss = 1.406, top1 = 69.51%], test : [loss = 1.417, top1 = 68.92%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.13%], valid : [loss = 2.349, top1 = 40.51%], test : [loss = 2.344, top1 = 41.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 72.82%], valid : [loss = 0.834, top1 = 70.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14509/15625) 014509-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.72%], valid : [loss = 0.605, top1 = 86.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.027, top1 = 99.27%], test  : [loss = 0.401, top1 = 90.23%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.469, top1 = 86.32%], valid : [loss = 1.430, top1 = 64.07%], test : [loss = 1.394, top1 = 64.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 40.25%], valid : [loss = 2.528, top1 = 36.43%], test : [loss = 2.554, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.44%], valid : [loss = 0.856, top1 = 70.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14510/15625) 014510-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.62%], valid : [loss = 0.542, top1 = 83.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.14 ms.
cifar10        train : [loss = 0.269, top1 = 90.77%], test  : [loss = 0.419, top1 = 86.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.75 ms.
cifar100       train : [loss = 1.392, top1 = 60.83%], valid : [loss = 1.636, top1 = 55.36%], test : [loss = 1.640, top1 = 55.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.891, top1 = 28.93%], valid : [loss = 2.895, top1 = 29.48%], test : [loss = 2.955, top1 = 27.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.40%], valid : [loss = 1.010, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14511/15625) 014511-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.446, top1 = 89.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.316, top1 = 92.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.41 ms.
cifar100       train : [loss = 0.323, top1 = 91.30%], valid : [loss = 1.283, top1 = 67.61%], test : [loss = 1.295, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.28%], valid : [loss = 2.393, top1 = 39.64%], test : [loss = 2.424, top1 = 39.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.32%], valid : [loss = 0.547, top1 = 81.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14512/15625) 014512-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.30%], valid : [loss = 0.866, top1 = 79.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.135, top1 = 95.46%], test  : [loss = 0.531, top1 = 84.92%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.12 ms.
cifar100       train : [loss = 0.844, top1 = 75.32%], valid : [loss = 1.693, top1 = 57.44%], test : [loss = 1.688, top1 = 57.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.39 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.47%], valid : [loss = 3.172, top1 = 24.30%], test : [loss = 3.198, top1 = 23.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14513/15625) 014513-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 0.516, top1 = 81.88%], valid : [loss = 0.724, top1 = 75.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.07 ms.
cifar10        train : [loss = 0.464, top1 = 83.77%], test  : [loss = 0.600, top1 = 79.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.61 ms.
cifar100       train : [loss = 1.804, top1 = 50.89%], valid : [loss = 2.001, top1 = 47.31%], test : [loss = 1.983, top1 = 47.09%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 3.434, top1 = 18.95%], valid : [loss = 3.433, top1 = 19.96%], test : [loss = 3.462, top1 = 18.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.222, top1 = 55.74%], valid : [loss = 1.263, top1 = 54.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14514/15625) 014514-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.434, top1 = 89.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.011, top1 = 99.82%], test  : [loss = 0.300, top1 = 92.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.66 ms.
cifar100       train : [loss = 0.222, top1 = 94.53%], valid : [loss = 1.278, top1 = 68.74%], test : [loss = 1.266, top1 = 68.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.82 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.43%], valid : [loss = 2.280, top1 = 41.78%], test : [loss = 2.307, top1 = 42.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.439, top1 = 84.82%], valid : [loss = 0.540, top1 = 81.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14515/15625) 014515-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.77 ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.34%], valid : [loss = 0.658, top1 = 77.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.95 ms.
cifar10        train : [loss = 0.511, top1 = 82.26%], test  : [loss = 0.587, top1 = 80.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.65 ms.
cifar100       train : [loss = 1.701, top1 = 53.82%], valid : [loss = 1.871, top1 = 50.08%], test : [loss = 1.876, top1 = 50.73%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.24%], valid : [loss = 3.314, top1 = 21.56%], test : [loss = 3.341, top1 = 21.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14516/15625) 014516-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.550, top1 = 88.52%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.354, top1 = 92.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.169, top1 = 95.91%], valid : [loss = 1.382, top1 = 68.12%], test : [loss = 1.413, top1 = 68.16%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.072, top1 = 45.85%], valid : [loss = 2.374, top1 = 39.33%], test : [loss = 2.376, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.866, top1 = 68.70%], valid : [loss = 0.904, top1 = 67.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14517/15625) 014517-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.43%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.33 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.340, top1 = 93.03%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.29 ms.
cifar100       train : [loss = 0.065, top1 = 99.09%], valid : [loss = 1.456, top1 = 68.40%], test : [loss = 1.424, top1 = 69.17%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 1.731, top1 = 53.91%], valid : [loss = 2.375, top1 = 40.43%], test : [loss = 2.383, top1 = 41.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.66%], valid : [loss = 0.689, top1 = 76.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14518/15625) 014518-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.465, top1 = 89.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.96 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.85 ms.
cifar100       train : [loss = 0.323, top1 = 91.18%], valid : [loss = 1.302, top1 = 67.05%], test : [loss = 1.288, top1 = 67.77%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.21%], valid : [loss = 2.389, top1 = 39.88%], test : [loss = 2.404, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.41%], valid : [loss = 0.544, top1 = 81.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14519/15625) 014519-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=11.13 ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.83%], valid : [loss = 0.859, top1 = 71.67%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.07 ms.
cifar10        train : [loss = 0.559, top1 = 80.54%], test  : [loss = 0.722, top1 = 75.65%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.58 ms.
cifar100       train : [loss = 1.780, top1 = 51.98%], valid : [loss = 2.052, top1 = 46.85%], test : [loss = 2.061, top1 = 46.47%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.01 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.71%], valid : [loss = 3.646, top1 = 16.26%], test : [loss = 3.661, top1 = 15.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14520/15625) 014520-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.15%], valid : [loss = 0.664, top1 = 84.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.57 ms.
cifar10        train : [loss = 0.055, top1 = 98.28%], test  : [loss = 0.402, top1 = 89.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.17 ms.
cifar100       train : [loss = 0.660, top1 = 80.64%], valid : [loss = 1.469, top1 = 61.69%], test : [loss = 1.450, top1 = 62.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.30%], valid : [loss = 2.628, top1 = 34.30%], test : [loss = 2.641, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.15%], valid : [loss = 0.865, top1 = 69.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14521/15625) 014521-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.557, top1 = 87.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.48 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.386, top1 = 91.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.37 ms.
cifar100       train : [loss = 0.404, top1 = 88.51%], valid : [loss = 1.394, top1 = 65.52%], test : [loss = 1.388, top1 = 65.43%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.86%], valid : [loss = 2.510, top1 = 36.37%], test : [loss = 2.530, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.32%], valid : [loss = 0.822, top1 = 71.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14522/15625) 014522-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.72 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.481, top1 = 90.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.14 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.314, top1 = 93.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.32 ms.
cifar100       train : [loss = 0.117, top1 = 97.70%], valid : [loss = 1.276, top1 = 69.58%], test : [loss = 1.297, top1 = 69.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=24.04 ms.
ImageNet16-120 train : [loss = 1.733, top1 = 53.74%], valid : [loss = 2.172, top1 = 43.60%], test : [loss = 2.204, top1 = 44.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 79.27%], valid : [loss = 0.671, top1 = 76.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14523/15625) 014523-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.568, top1 = 88.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.81 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.365, top1 = 91.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.05 ms.
cifar100       train : [loss = 0.145, top1 = 97.00%], valid : [loss = 1.501, top1 = 66.59%], test : [loss = 1.527, top1 = 65.85%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.959, top1 = 48.49%], valid : [loss = 2.442, top1 = 38.62%], test : [loss = 2.452, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.62%], valid : [loss = 0.801, top1 = 72.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14524/15625) 014524-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.29%], valid : [loss = 0.616, top1 = 85.58%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.065, top1 = 98.06%], test  : [loss = 0.405, top1 = 88.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.04 ms.
cifar100       train : [loss = 0.725, top1 = 78.87%], valid : [loss = 1.392, top1 = 63.11%], test : [loss = 1.386, top1 = 63.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 2.534, top1 = 36.05%], valid : [loss = 2.654, top1 = 34.08%], test : [loss = 2.699, top1 = 33.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14525/15625) 014525-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.50 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.21%], valid : [loss = 0.462, top1 = 86.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10        train : [loss = 0.153, top1 = 94.95%], test  : [loss = 0.346, top1 = 88.78%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.36 ms.
cifar100       train : [loss = 1.019, top1 = 71.16%], valid : [loss = 1.363, top1 = 61.86%], test : [loss = 1.393, top1 = 60.41%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.86%], valid : [loss = 2.680, top1 = 32.95%], test : [loss = 2.711, top1 = 32.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14526/15625) 014526-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.90 ms.
cifar10-valid  train : [loss = 0.873, top1 = 69.82%], valid : [loss = 0.915, top1 = 68.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.83 ms.
cifar10        train : [loss = 0.838, top1 = 71.37%], test  : [loss = 0.846, top1 = 70.60%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.78 ms.
cifar100       train : [loss = 2.321, top1 = 40.73%], valid : [loss = 2.379, top1 = 38.75%], test : [loss = 2.372, top1 = 39.41%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.20 ms.
ImageNet16-120 train : [loss = 3.489, top1 = 18.45%], valid : [loss = 3.474, top1 = 18.67%], test : [loss = 3.483, top1 = 18.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.717, top1 = 36.06%], valid : [loss = 1.723, top1 = 35.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14527/15625) 014527-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.99%], valid : [loss = 0.474, top1 = 84.46%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10        train : [loss = 0.294, top1 = 90.23%], test  : [loss = 0.392, top1 = 86.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.27 ms.
cifar100       train : [loss = 1.314, top1 = 63.54%], valid : [loss = 1.519, top1 = 58.10%], test : [loss = 1.483, top1 = 58.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.76%], valid : [loss = 2.903, top1 = 29.47%], test : [loss = 2.945, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14528/15625) 014528-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.21 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.519, top1 = 88.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.334, top1 = 91.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.88 ms.
cifar100       train : [loss = 0.342, top1 = 90.66%], valid : [loss = 1.276, top1 = 66.72%], test : [loss = 1.299, top1 = 67.36%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.69 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.63%], valid : [loss = 2.406, top1 = 38.78%], test : [loss = 2.422, top1 = 38.45%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14529/15625) 014529-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=15.99 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.577, top1 = 87.47%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=16.18 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.389, top1 = 90.98%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=15.51 ms.
cifar100       train : [loss = 0.404, top1 = 88.49%], valid : [loss = 1.385, top1 = 65.59%], test : [loss = 1.383, top1 = 65.50%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.290, top1 = 41.05%], valid : [loss = 2.486, top1 = 38.11%], test : [loss = 2.518, top1 = 37.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.20%], valid : [loss = 0.783, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14530/15625) 014530-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.87 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.86%], valid : [loss = 0.488, top1 = 84.03%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.19 ms.
cifar10        train : [loss = 0.298, top1 = 89.91%], test  : [loss = 0.396, top1 = 86.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.50 ms.
cifar100       train : [loss = 1.331, top1 = 63.10%], valid : [loss = 1.559, top1 = 57.54%], test : [loss = 1.505, top1 = 58.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.83%], valid : [loss = 2.902, top1 = 29.23%], test : [loss = 2.961, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14531/15625) 014531-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.549, top1 = 88.60%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.58 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.374, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.95 ms.
cifar100       train : [loss = 0.153, top1 = 96.73%], valid : [loss = 1.452, top1 = 66.86%], test : [loss = 1.450, top1 = 67.04%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.31 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.89%], valid : [loss = 2.392, top1 = 40.18%], test : [loss = 2.422, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.11%], valid : [loss = 0.707, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14532/15625) 014532-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.80%], valid : [loss = 0.529, top1 = 84.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.184, top1 = 93.78%], test  : [loss = 0.387, top1 = 88.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 1.241, top1 = 64.67%], valid : [loss = 1.531, top1 = 58.11%], test : [loss = 1.543, top1 = 57.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.83 ms.
ImageNet16-120 train : [loss = 2.691, top1 = 32.77%], valid : [loss = 2.730, top1 = 32.78%], test : [loss = 2.771, top1 = 31.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.43%], valid : [loss = 0.956, top1 = 66.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14533/15625) 014533-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.577, top1 = 87.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.389, top1 = 90.97%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.83 ms.
cifar100       train : [loss = 0.395, top1 = 88.86%], valid : [loss = 1.389, top1 = 65.15%], test : [loss = 1.416, top1 = 65.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.84%], valid : [loss = 2.505, top1 = 36.66%], test : [loss = 2.547, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14534/15625) 014534-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.84%], valid : [loss = 0.467, top1 = 86.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.156, top1 = 94.88%], test  : [loss = 0.344, top1 = 88.84%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.80 ms.
cifar100       train : [loss = 0.984, top1 = 72.06%], valid : [loss = 1.356, top1 = 62.11%], test : [loss = 1.337, top1 = 62.77%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.620, top1 = 34.14%], valid : [loss = 2.667, top1 = 33.40%], test : [loss = 2.683, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14535/15625) 014535-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.47 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.563, top1 = 87.90%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.61 ms.
cifar10        train : [loss = 0.019, top1 = 99.51%], test  : [loss = 0.353, top1 = 91.63%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.88 ms.
cifar100       train : [loss = 0.315, top1 = 91.71%], valid : [loss = 1.329, top1 = 66.15%], test : [loss = 1.321, top1 = 67.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 2.457, top1 = 36.80%], valid : [loss = 2.569, top1 = 33.93%], test : [loss = 2.599, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.54%], valid : [loss = 1.014, top1 = 63.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14536/15625) 014536-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10-valid  train : [loss = 1.227, top1 = 55.52%], valid : [loss = 1.280, top1 = 54.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.88 ms.
cifar10        train : [loss = 1.216, top1 = 56.48%], test  : [loss = 1.222, top1 = 56.02%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.27 ms.
cifar100       train : [loss = 2.757, top1 = 31.15%], valid : [loss = 2.842, top1 = 30.16%], test : [loss = 2.833, top1 = 30.17%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.47 ms.
ImageNet16-120 train : [loss = 3.908, top1 = 11.82%], valid : [loss = 3.907, top1 = 12.23%], test : [loss = 3.921, top1 = 11.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.740, top1 = 34.17%], valid : [loss = 1.741, top1 = 34.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14537/15625) 014537-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.69 ms.
cifar10-valid  train : [loss = 0.355, top1 = 87.61%], valid : [loss = 0.640, top1 = 79.35%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10        train : [loss = 0.302, top1 = 89.51%], test  : [loss = 0.455, top1 = 84.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.00 ms.
cifar100       train : [loss = 1.528, top1 = 57.43%], valid : [loss = 1.770, top1 = 52.98%], test : [loss = 1.761, top1 = 51.90%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.884, top1 = 28.85%], valid : [loss = 2.914, top1 = 27.97%], test : [loss = 2.974, top1 = 27.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.020, top1 = 63.07%], valid : [loss = 1.080, top1 = 61.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14538/15625) 014538-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.70 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.516, top1 = 89.76%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.85 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.344, top1 = 93.03%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.77 ms.
cifar100       train : [loss = 0.064, top1 = 98.95%], valid : [loss = 1.308, top1 = 70.48%], test : [loss = 1.330, top1 = 70.08%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.645, top1 = 55.86%], valid : [loss = 2.178, top1 = 44.23%], test : [loss = 2.148, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.34%], valid : [loss = 0.787, top1 = 72.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14539/15625) 014539-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.497, top1 = 89.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.306, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.69 ms.
cifar100       train : [loss = 0.257, top1 = 93.22%], valid : [loss = 1.228, top1 = 68.50%], test : [loss = 1.234, top1 = 69.03%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.16 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.50%], valid : [loss = 2.219, top1 = 43.42%], test : [loss = 2.204, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.36%], valid : [loss = 0.634, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14540/15625) 014540-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.82 ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.64%], valid : [loss = 0.838, top1 = 72.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.69 ms.
cifar10        train : [loss = 0.545, top1 = 81.04%], test  : [loss = 0.699, top1 = 76.45%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.63 ms.
cifar100       train : [loss = 1.775, top1 = 52.35%], valid : [loss = 2.033, top1 = 47.32%], test : [loss = 2.069, top1 = 47.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.24 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.80%], valid : [loss = 3.648, top1 = 16.77%], test : [loss = 3.672, top1 = 15.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.187, top1 = 57.15%], valid : [loss = 1.249, top1 = 55.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14541/15625) 014541-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.072, top1 = 97.85%], valid : [loss = 0.810, top1 = 80.54%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.02 ms.
cifar10        train : [loss = 0.129, top1 = 95.74%], test  : [loss = 0.517, top1 = 85.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.05 ms.
cifar100       train : [loss = 0.890, top1 = 74.22%], valid : [loss = 1.724, top1 = 56.38%], test : [loss = 1.689, top1 = 57.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.98 ms.
ImageNet16-120 train : [loss = 3.028, top1 = 26.38%], valid : [loss = 3.171, top1 = 24.40%], test : [loss = 3.177, top1 = 23.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.112, top1 = 59.53%], valid : [loss = 1.156, top1 = 58.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14542/15625) 014542-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.11 ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.59%], valid : [loss = 1.112, top1 = 63.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10        train : [loss = 0.780, top1 = 72.53%], test  : [loss = 0.921, top1 = 68.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.60 ms.
cifar100       train : [loss = 2.122, top1 = 44.53%], valid : [loss = 2.391, top1 = 39.84%], test : [loss = 2.400, top1 = 39.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 3.770, top1 = 13.76%], valid : [loss = 3.817, top1 = 13.27%], test : [loss = 3.844, top1 = 12.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.364, top1 = 50.19%], valid : [loss = 1.411, top1 = 48.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14543/15625) 014543-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.623, top1 = 85.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.55 ms.
cifar10        train : [loss = 0.048, top1 = 98.51%], test  : [loss = 0.412, top1 = 89.32%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.77 ms.
cifar100       train : [loss = 0.618, top1 = 81.85%], valid : [loss = 1.438, top1 = 62.76%], test : [loss = 1.404, top1 = 63.44%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.62 ms.
ImageNet16-120 train : [loss = 2.450, top1 = 37.72%], valid : [loss = 2.614, top1 = 33.97%], test : [loss = 2.649, top1 = 34.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.56%], valid : [loss = 0.831, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14544/15625) 014544-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.267, top1 = 90.98%], valid : [loss = 0.477, top1 = 84.43%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.08 ms.
cifar10        train : [loss = 0.307, top1 = 89.65%], test  : [loss = 0.411, top1 = 86.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.11 ms.
cifar100       train : [loss = 1.347, top1 = 62.68%], valid : [loss = 1.540, top1 = 57.82%], test : [loss = 1.517, top1 = 57.78%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.72%], valid : [loss = 2.909, top1 = 29.73%], test : [loss = 2.955, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14545/15625) 014545-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.42%], valid : [loss = 0.567, top1 = 87.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.14 ms.
cifar10        train : [loss = 0.033, top1 = 98.92%], test  : [loss = 0.371, top1 = 91.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.81 ms.
cifar100       train : [loss = 0.459, top1 = 86.72%], valid : [loss = 1.329, top1 = 65.82%], test : [loss = 1.331, top1 = 65.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.700, top1 = 31.52%], valid : [loss = 2.747, top1 = 30.70%], test : [loss = 2.791, top1 = 29.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.148, top1 = 58.53%], valid : [loss = 1.163, top1 = 57.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14546/15625) 014546-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.442, top1 = 90.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.309, top1 = 92.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.67 ms.
cifar100       train : [loss = 0.217, top1 = 94.62%], valid : [loss = 1.285, top1 = 68.62%], test : [loss = 1.290, top1 = 68.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.48%], valid : [loss = 2.276, top1 = 42.66%], test : [loss = 2.330, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.32%], valid : [loss = 0.541, top1 = 81.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14547/15625) 014547-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.525, top1 = 89.80%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.99 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.309, top1 = 93.57%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.62 ms.
cifar100       train : [loss = 0.058, top1 = 99.02%], valid : [loss = 1.396, top1 = 70.48%], test : [loss = 1.439, top1 = 69.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.93 ms.
ImageNet16-120 train : [loss = 1.658, top1 = 55.61%], valid : [loss = 2.181, top1 = 44.20%], test : [loss = 2.201, top1 = 43.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.08%], valid : [loss = 0.622, top1 = 78.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14548/15625) 014548-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.537, top1 = 89.04%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.26 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.326, top1 = 93.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.89 ms.
cifar100       train : [loss = 0.108, top1 = 97.70%], valid : [loss = 1.352, top1 = 69.66%], test : [loss = 1.387, top1 = 68.68%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 1.687, top1 = 54.84%], valid : [loss = 2.197, top1 = 43.43%], test : [loss = 2.240, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.63%], valid : [loss = 0.764, top1 = 73.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14549/15625) 014549-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.72 ms.
cifar10-valid  train : [loss = 0.219, top1 = 92.42%], valid : [loss = 0.663, top1 = 80.98%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10        train : [loss = 0.291, top1 = 89.91%], test  : [loss = 0.556, top1 = 82.52%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.13 ms.
cifar100       train : [loss = 1.322, top1 = 62.54%], valid : [loss = 1.895, top1 = 50.64%], test : [loss = 1.901, top1 = 51.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 3.506, top1 = 16.59%], valid : [loss = 3.513, top1 = 16.57%], test : [loss = 3.523, top1 = 17.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.375, top1 = 49.41%], valid : [loss = 1.413, top1 = 48.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14550/15625) 014550-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.15%], valid : [loss = 0.487, top1 = 84.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.22 ms.
cifar10        train : [loss = 0.301, top1 = 89.89%], test  : [loss = 0.403, top1 = 86.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.83 ms.
cifar100       train : [loss = 1.325, top1 = 63.39%], valid : [loss = 1.537, top1 = 58.22%], test : [loss = 1.518, top1 = 58.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.78 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.58%], valid : [loss = 2.912, top1 = 29.27%], test : [loss = 2.960, top1 = 28.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.54%], valid : [loss = 0.746, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14551/15625) 014551-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.52%], valid : [loss = 0.581, top1 = 87.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.94 ms.
cifar10        train : [loss = 0.030, top1 = 99.13%], test  : [loss = 0.365, top1 = 90.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.68 ms.
cifar100       train : [loss = 0.583, top1 = 83.24%], valid : [loss = 1.355, top1 = 63.50%], test : [loss = 1.352, top1 = 63.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.571, top1 = 34.68%], valid : [loss = 2.653, top1 = 32.13%], test : [loss = 2.664, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14552/15625) 014552-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.585, top1 = 87.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.383, top1 = 91.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.05 ms.
cifar100       train : [loss = 0.410, top1 = 88.45%], valid : [loss = 1.414, top1 = 64.67%], test : [loss = 1.401, top1 = 65.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.60 ms.
ImageNet16-120 train : [loss = 2.287, top1 = 41.12%], valid : [loss = 2.497, top1 = 36.91%], test : [loss = 2.509, top1 = 37.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 74.07%], valid : [loss = 0.800, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14553/15625) 014553-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10-valid  train : [loss = 0.603, top1 = 78.77%], valid : [loss = 0.738, top1 = 74.97%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.65 ms.
cifar10        train : [loss = 0.519, top1 = 82.00%], test  : [loss = 0.593, top1 = 79.78%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.09 ms.
cifar100       train : [loss = 2.002, top1 = 45.97%], valid : [loss = 2.126, top1 = 44.17%], test : [loss = 2.111, top1 = 43.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.62 ms.
ImageNet16-120 train : [loss = 2.990, top1 = 26.92%], valid : [loss = 2.981, top1 = 27.18%], test : [loss = 3.019, top1 = 26.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.141, top1 = 58.78%], valid : [loss = 1.192, top1 = 57.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14554/15625) 014554-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.96%], valid : [loss = 0.836, top1 = 71.77%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10        train : [loss = 0.659, top1 = 76.97%], test  : [loss = 0.758, top1 = 73.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.79 ms.
cifar100       train : [loss = 1.963, top1 = 47.84%], valid : [loss = 2.125, top1 = 44.94%], test : [loss = 2.144, top1 = 44.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 3.646, top1 = 15.84%], valid : [loss = 3.673, top1 = 15.87%], test : [loss = 3.704, top1 = 14.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.394, top1 = 49.50%], valid : [loss = 1.407, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14555/15625) 014555-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.49%], valid : [loss = 0.610, top1 = 86.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.32 ms.
cifar10        train : [loss = 0.051, top1 = 98.44%], test  : [loss = 0.440, top1 = 88.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.24 ms.
cifar100       train : [loss = 0.609, top1 = 82.37%], valid : [loss = 1.388, top1 = 62.80%], test : [loss = 1.395, top1 = 63.48%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.441, top1 = 38.05%], valid : [loss = 2.590, top1 = 35.57%], test : [loss = 2.616, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 71.97%], valid : [loss = 0.856, top1 = 70.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14556/15625) 014556-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.06 ms.
cifar10-valid  train : [loss = 0.056, top1 = 98.42%], valid : [loss = 0.656, top1 = 83.85%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.25 ms.
cifar10        train : [loss = 0.073, top1 = 97.61%], test  : [loss = 0.415, top1 = 88.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=18.06 ms.
cifar100       train : [loss = 0.820, top1 = 75.84%], valid : [loss = 1.489, top1 = 61.00%], test : [loss = 1.481, top1 = 60.24%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 2.539, top1 = 35.74%], valid : [loss = 2.644, top1 = 33.57%], test : [loss = 2.707, top1 = 34.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 69.17%], valid : [loss = 0.914, top1 = 67.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14557/15625) 014557-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.097, top1 = 96.97%], valid : [loss = 0.840, top1 = 79.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.12 ms.
cifar10        train : [loss = 0.121, top1 = 95.89%], test  : [loss = 0.484, top1 = 86.04%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=15.59 ms.
cifar100       train : [loss = 0.887, top1 = 74.29%], valid : [loss = 1.660, top1 = 57.12%], test : [loss = 1.670, top1 = 57.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.04 ms.
ImageNet16-120 train : [loss = 2.871, top1 = 29.38%], valid : [loss = 2.995, top1 = 26.50%], test : [loss = 3.058, top1 = 26.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.981, top1 = 64.99%], valid : [loss = 1.033, top1 = 63.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14558/15625) 014558-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.05%], valid : [loss = 0.548, top1 = 86.76%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.72 ms.
cifar10        train : [loss = 0.058, top1 = 98.14%], test  : [loss = 0.371, top1 = 90.29%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.15 ms.
cifar100       train : [loss = 0.561, top1 = 83.61%], valid : [loss = 1.325, top1 = 65.16%], test : [loss = 1.296, top1 = 65.32%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.11%], valid : [loss = 2.424, top1 = 38.53%], test : [loss = 2.456, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.09%], valid : [loss = 0.781, top1 = 72.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14559/15625) 014559-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.644, top1 = 85.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.86 ms.
cifar10        train : [loss = 0.055, top1 = 98.34%], test  : [loss = 0.432, top1 = 88.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.642, top1 = 81.12%], valid : [loss = 1.527, top1 = 61.46%], test : [loss = 1.543, top1 = 61.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.663, top1 = 33.55%], valid : [loss = 2.823, top1 = 29.63%], test : [loss = 2.863, top1 = 30.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.81%], valid : [loss = 0.900, top1 = 67.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14560/15625) 014560-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.98 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.500, top1 = 90.13%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.79 ms.
cifar10        train : [loss = 0.003, top1 = 99.93%], test  : [loss = 0.338, top1 = 93.13%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.03 ms.
cifar100       train : [loss = 0.062, top1 = 99.03%], valid : [loss = 1.369, top1 = 69.96%], test : [loss = 1.353, top1 = 69.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 1.708, top1 = 54.42%], valid : [loss = 2.217, top1 = 42.50%], test : [loss = 2.218, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.68%], valid : [loss = 0.729, top1 = 74.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14561/15625) 014561-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.469, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.317, top1 = 92.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.65 ms.
cifar100       train : [loss = 0.319, top1 = 91.36%], valid : [loss = 1.260, top1 = 67.50%], test : [loss = 1.239, top1 = 67.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.72%], valid : [loss = 2.313, top1 = 41.18%], test : [loss = 2.323, top1 = 40.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.497, top1 = 82.58%], valid : [loss = 0.576, top1 = 80.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14562/15625) 014562-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.71%], valid : [loss = 0.635, top1 = 86.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.64 ms.
cifar10        train : [loss = 0.036, top1 = 99.03%], test  : [loss = 0.438, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.78 ms.
cifar100       train : [loss = 0.452, top1 = 87.46%], valid : [loss = 1.430, top1 = 63.80%], test : [loss = 1.475, top1 = 63.04%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.38%], valid : [loss = 2.606, top1 = 35.10%], test : [loss = 2.645, top1 = 35.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.20%], valid : [loss = 0.792, top1 = 72.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14563/15625) 014563-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.467, top1 = 89.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.10 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.308, top1 = 92.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.09 ms.
cifar100       train : [loss = 0.277, top1 = 92.59%], valid : [loss = 1.360, top1 = 67.22%], test : [loss = 1.284, top1 = 68.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.004, top1 = 47.59%], valid : [loss = 2.353, top1 = 40.33%], test : [loss = 2.381, top1 = 40.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.511, top1 = 82.34%], valid : [loss = 0.600, top1 = 79.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14564/15625) 014564-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.493, top1 = 88.89%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.020, top1 = 99.44%], test  : [loss = 0.361, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.372, top1 = 89.27%], valid : [loss = 1.342, top1 = 66.58%], test : [loss = 1.314, top1 = 66.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 2.158, top1 = 43.96%], valid : [loss = 2.348, top1 = 40.10%], test : [loss = 2.413, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.18%], valid : [loss = 0.622, top1 = 78.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14565/15625) 014565-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.86 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.65%], valid : [loss = 0.457, top1 = 86.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.14 ms.
cifar10        train : [loss = 0.159, top1 = 94.81%], test  : [loss = 0.341, top1 = 88.88%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.46 ms.
cifar100       train : [loss = 1.006, top1 = 71.31%], valid : [loss = 1.353, top1 = 62.24%], test : [loss = 1.349, top1 = 62.44%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.82 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.67%], valid : [loss = 2.666, top1 = 33.40%], test : [loss = 2.704, top1 = 32.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.724, top1 = 74.30%], valid : [loss = 0.780, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14566/15625) 014566-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.20 ms.
cifar10-valid  train : [loss = 0.221, top1 = 92.42%], valid : [loss = 0.552, top1 = 83.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.215, top1 = 92.65%], test  : [loss = 0.411, top1 = 86.77%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.52 ms.
cifar100       train : [loss = 1.305, top1 = 63.04%], valid : [loss = 1.603, top1 = 56.44%], test : [loss = 1.588, top1 = 56.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.747, top1 = 31.66%], valid : [loss = 2.782, top1 = 31.14%], test : [loss = 2.803, top1 = 30.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.938, top1 = 66.29%], valid : [loss = 0.993, top1 = 64.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14567/15625) 014567-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.415, top1 = 89.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.66 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.291, top1 = 92.61%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.22 ms.
cifar100       train : [loss = 0.207, top1 = 95.16%], valid : [loss = 1.257, top1 = 69.50%], test : [loss = 1.252, top1 = 69.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 1.853, top1 = 50.97%], valid : [loss = 2.249, top1 = 43.60%], test : [loss = 2.298, top1 = 41.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14568/15625) 014568-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.35%], valid : [loss = 0.531, top1 = 87.18%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.66 ms.
cifar10        train : [loss = 0.050, top1 = 98.54%], test  : [loss = 0.347, top1 = 90.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.84 ms.
cifar100       train : [loss = 0.595, top1 = 82.47%], valid : [loss = 1.347, top1 = 64.72%], test : [loss = 1.312, top1 = 65.58%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.378, top1 = 39.31%], valid : [loss = 2.530, top1 = 35.80%], test : [loss = 2.566, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.06%], valid : [loss = 0.630, top1 = 78.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14569/15625) 014569-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.594, top1 = 86.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.60 ms.
cifar10        train : [loss = 0.030, top1 = 99.23%], test  : [loss = 0.406, top1 = 89.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.10 ms.
cifar100       train : [loss = 0.503, top1 = 85.46%], valid : [loss = 1.402, top1 = 64.28%], test : [loss = 1.387, top1 = 64.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.60 ms.
ImageNet16-120 train : [loss = 2.405, top1 = 38.77%], valid : [loss = 2.553, top1 = 35.87%], test : [loss = 2.592, top1 = 35.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.775, top1 = 72.33%], valid : [loss = 0.838, top1 = 70.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14570/15625) 014570-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.61%], valid : [loss = 0.501, top1 = 88.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10        train : [loss = 0.033, top1 = 99.07%], test  : [loss = 0.330, top1 = 91.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.95 ms.
cifar100       train : [loss = 0.501, top1 = 85.19%], valid : [loss = 1.314, top1 = 65.76%], test : [loss = 1.335, top1 = 65.16%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.345, top1 = 39.85%], valid : [loss = 2.510, top1 = 36.63%], test : [loss = 2.585, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.88%], valid : [loss = 0.695, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14571/15625) 014571-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.73 ms.
cifar10-valid  train : [loss = 1.420, top1 = 47.61%], valid : [loss = 1.455, top1 = 46.11%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.62 ms.
cifar10        train : [loss = 1.021, top1 = 63.97%], test  : [loss = 1.029, top1 = 63.19%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.46 ms.
cifar100       train : [loss = 3.666, top1 = 14.70%], valid : [loss = 3.745, top1 = 12.43%], test : [loss = 3.735, top1 = 13.49%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.73 ms.
ImageNet16-120 train : [loss = 3.683, top1 = 15.06%], valid : [loss = 3.655, top1 = 16.24%], test : [loss = 3.677, top1 = 15.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.902, top1 = 30.57%], valid : [loss = 1.907, top1 = 30.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14572/15625) 014572-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.416, top1 = 91.02%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.29 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.287, top1 = 93.76%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.58 ms.
cifar100       train : [loss = 0.038, top1 = 99.67%], valid : [loss = 1.302, top1 = 71.14%], test : [loss = 1.306, top1 = 70.96%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 1.392, top1 = 62.11%], valid : [loss = 2.255, top1 = 44.07%], test : [loss = 2.258, top1 = 45.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.377, top1 = 87.11%], valid : [loss = 0.512, top1 = 82.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14573/15625) 014573-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.486, top1 = 90.32%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.83 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.333, top1 = 93.14%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.34 ms.
cifar100       train : [loss = 0.070, top1 = 98.96%], valid : [loss = 1.353, top1 = 70.06%], test : [loss = 1.349, top1 = 69.78%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=20.77 ms.
ImageNet16-120 train : [loss = 1.943, top1 = 48.86%], valid : [loss = 2.323, top1 = 40.57%], test : [loss = 2.360, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.07%], valid : [loss = 0.775, top1 = 72.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14574/15625) 014574-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.12 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.531, top1 = 88.84%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.17 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.305, top1 = 92.32%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.74 ms.
cifar100       train : [loss = 0.186, top1 = 95.77%], valid : [loss = 1.222, top1 = 68.60%], test : [loss = 1.263, top1 = 69.02%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.814, top1 = 51.89%], valid : [loss = 2.164, top1 = 43.67%], test : [loss = 2.203, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.27%], valid : [loss = 0.638, top1 = 78.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14575/15625) 014575-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.97 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.519, top1 = 88.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.56 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.331, top1 = 92.34%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.75 ms.
cifar100       train : [loss = 0.176, top1 = 96.09%], valid : [loss = 1.297, top1 = 68.81%], test : [loss = 1.310, top1 = 68.65%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.76 ms.
ImageNet16-120 train : [loss = 1.945, top1 = 48.78%], valid : [loss = 2.309, top1 = 41.14%], test : [loss = 2.325, top1 = 41.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.61%], valid : [loss = 0.683, top1 = 76.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14576/15625) 014576-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.900, top1 = 82.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.83 ms.
cifar10        train : [loss = 0.036, top1 = 99.01%], test  : [loss = 0.593, top1 = 86.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.92 ms.
cifar100       train : [loss = 0.301, top1 = 92.12%], valid : [loss = 1.814, top1 = 59.76%], test : [loss = 1.800, top1 = 59.96%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.555, top1 = 35.79%], valid : [loss = 2.934, top1 = 28.47%], test : [loss = 2.928, top1 = 29.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 69.16%], valid : [loss = 0.924, top1 = 67.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14577/15625) 014577-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.74 ms.
cifar10-valid  train : [loss = 0.521, top1 = 81.71%], valid : [loss = 0.841, top1 = 72.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=17.63 ms.
cifar10        train : [loss = 0.567, top1 = 80.10%], test  : [loss = 0.706, top1 = 76.03%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.98 ms.
cifar100       train : [loss = 1.805, top1 = 51.45%], valid : [loss = 2.062, top1 = 46.72%], test : [loss = 2.045, top1 = 47.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.73%], valid : [loss = 3.636, top1 = 17.33%], test : [loss = 3.679, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.22%], valid : [loss = 1.258, top1 = 54.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14578/15625) 014578-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.516, top1 = 88.64%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.14 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.315, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.69 ms.
cifar100       train : [loss = 0.326, top1 = 91.14%], valid : [loss = 1.282, top1 = 67.10%], test : [loss = 1.285, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=22.44 ms.
ImageNet16-120 train : [loss = 2.161, top1 = 43.87%], valid : [loss = 2.410, top1 = 38.80%], test : [loss = 2.407, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 73.96%], valid : [loss = 0.788, top1 = 72.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14579/15625) 014579-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.593, top1 = 87.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.84 ms.
cifar10        train : [loss = 0.018, top1 = 99.47%], test  : [loss = 0.423, top1 = 90.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.59 ms.
cifar100       train : [loss = 0.370, top1 = 89.54%], valid : [loss = 1.509, top1 = 63.54%], test : [loss = 1.454, top1 = 64.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.32 ms.
ImageNet16-120 train : [loss = 3.003, top1 = 25.70%], valid : [loss = 3.074, top1 = 24.30%], test : [loss = 3.079, top1 = 24.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14580/15625) 014580-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.23 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.440, top1 = 90.94%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.37 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.284, top1 = 93.71%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.31 ms.
cifar100       train : [loss = 0.048, top1 = 99.47%], valid : [loss = 1.370, top1 = 70.64%], test : [loss = 1.324, top1 = 70.36%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 1.465, top1 = 60.22%], valid : [loss = 2.249, top1 = 43.90%], test : [loss = 2.267, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.18%], valid : [loss = 0.530, top1 = 82.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14581/15625) 014581-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.635, top1 = 86.97%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.21 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.383, top1 = 91.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.96 ms.
cifar100       train : [loss = 0.210, top1 = 94.84%], valid : [loss = 1.505, top1 = 65.06%], test : [loss = 1.491, top1 = 65.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.078, top1 = 45.82%], valid : [loss = 2.504, top1 = 37.33%], test : [loss = 2.496, top1 = 38.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.43%], valid : [loss = 0.803, top1 = 71.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14582/15625) 014582-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.92%], valid : [loss = 0.584, top1 = 87.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.387, top1 = 91.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.35 ms.
cifar100       train : [loss = 0.406, top1 = 88.58%], valid : [loss = 1.346, top1 = 66.96%], test : [loss = 1.316, top1 = 67.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.71 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.97%], valid : [loss = 2.515, top1 = 36.83%], test : [loss = 2.505, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.93%], valid : [loss = 0.780, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14583/15625) 014583-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.07 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.491, top1 = 89.35%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.290, top1 = 92.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.09 ms.
cifar100       train : [loss = 0.289, top1 = 92.33%], valid : [loss = 1.245, top1 = 68.54%], test : [loss = 1.233, top1 = 68.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.05 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.95%], valid : [loss = 2.242, top1 = 41.20%], test : [loss = 2.252, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14584/15625) 014584-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.274, top1 = 90.88%], valid : [loss = 0.469, top1 = 84.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.45 ms.
cifar10        train : [loss = 0.300, top1 = 89.97%], test  : [loss = 0.402, top1 = 86.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.01 ms.
cifar100       train : [loss = 1.339, top1 = 63.03%], valid : [loss = 1.541, top1 = 58.14%], test : [loss = 1.521, top1 = 58.42%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.97 ms.
ImageNet16-120 train : [loss = 2.941, top1 = 28.30%], valid : [loss = 2.908, top1 = 29.27%], test : [loss = 2.947, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.28%], valid : [loss = 0.752, top1 = 74.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14585/15625) 014585-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=23.72 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.90%], valid : [loss = 0.556, top1 = 89.04%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=23.08 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.336, top1 = 92.94%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=24.91 ms.
cifar100       train : [loss = 0.159, top1 = 96.25%], valid : [loss = 1.543, top1 = 65.38%], test : [loss = 1.571, top1 = 65.12%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=17.96 ms.
ImageNet16-120 train : [loss = 2.334, top1 = 39.61%], valid : [loss = 2.495, top1 = 35.33%], test : [loss = 2.525, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.20%], valid : [loss = 1.009, top1 = 64.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14586/15625) 014586-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=22.33 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.38%], valid : [loss = 0.490, top1 = 85.88%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=21.35 ms.
cifar10        train : [loss = 0.113, top1 = 96.49%], test  : [loss = 0.336, top1 = 89.30%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.27 ms.
cifar100       train : [loss = 0.757, top1 = 78.83%], valid : [loss = 1.323, top1 = 63.74%], test : [loss = 1.291, top1 = 64.12%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.13 ms.
ImageNet16-120 train : [loss = 2.478, top1 = 37.13%], valid : [loss = 2.571, top1 = 34.93%], test : [loss = 2.593, top1 = 33.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.51%], valid : [loss = 0.948, top1 = 66.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14587/15625) 014587-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.80%], valid : [loss = 0.985, top1 = 66.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.06 ms.
cifar10        train : [loss = 0.770, top1 = 72.85%], test  : [loss = 0.854, top1 = 70.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.79 ms.
cifar100       train : [loss = 2.141, top1 = 43.62%], valid : [loss = 2.312, top1 = 41.02%], test : [loss = 2.335, top1 = 40.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 3.741, top1 = 14.40%], valid : [loss = 3.781, top1 = 14.83%], test : [loss = 3.780, top1 = 14.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.463, top1 = 46.40%], valid : [loss = 1.488, top1 = 45.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14588/15625) 014588-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.259, top1 = 91.19%], valid : [loss = 0.537, top1 = 83.12%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.234, top1 = 91.98%], test  : [loss = 0.384, top1 = 87.40%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.41 ms.
cifar100       train : [loss = 1.287, top1 = 63.47%], valid : [loss = 1.583, top1 = 56.94%], test : [loss = 1.555, top1 = 57.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.15 ms.
ImageNet16-120 train : [loss = 2.858, top1 = 29.49%], valid : [loss = 2.903, top1 = 29.60%], test : [loss = 2.932, top1 = 28.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.20%], valid : [loss = 0.991, top1 = 64.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14589/15625) 014589-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.09%], valid : [loss = 0.473, top1 = 84.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.90 ms.
cifar10        train : [loss = 0.297, top1 = 90.11%], test  : [loss = 0.398, top1 = 86.63%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.92 ms.
cifar100       train : [loss = 1.331, top1 = 63.17%], valid : [loss = 1.558, top1 = 57.36%], test : [loss = 1.519, top1 = 58.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.75 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.50%], valid : [loss = 2.897, top1 = 29.47%], test : [loss = 2.970, top1 = 27.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14590/15625) 014590-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.32 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.82%], valid : [loss = 0.528, top1 = 82.28%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.37 ms.
cifar10        train : [loss = 0.395, top1 = 86.68%], test  : [loss = 0.456, top1 = 84.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.77 ms.
cifar100       train : [loss = 1.548, top1 = 57.51%], valid : [loss = 1.660, top1 = 53.88%], test : [loss = 1.657, top1 = 54.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.50 ms.
ImageNet16-120 train : [loss = 3.033, top1 = 26.44%], valid : [loss = 3.005, top1 = 27.43%], test : [loss = 3.040, top1 = 26.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14591/15625) 014591-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.42%], valid : [loss = 0.856, top1 = 72.24%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.35 ms.
cifar10        train : [loss = 0.552, top1 = 80.71%], test  : [loss = 0.724, top1 = 75.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.07 ms.
cifar100       train : [loss = 1.787, top1 = 51.72%], valid : [loss = 2.049, top1 = 46.68%], test : [loss = 2.081, top1 = 46.14%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.26 ms.
ImageNet16-120 train : [loss = 3.581, top1 = 16.97%], valid : [loss = 3.628, top1 = 16.27%], test : [loss = 3.663, top1 = 15.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.96%], valid : [loss = 1.262, top1 = 55.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14592/15625) 014592-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.58%], valid : [loss = 0.515, top1 = 88.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.25 ms.
cifar10        train : [loss = 0.037, top1 = 98.86%], test  : [loss = 0.344, top1 = 91.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.10 ms.
cifar100       train : [loss = 0.455, top1 = 86.60%], valid : [loss = 1.242, top1 = 67.50%], test : [loss = 1.287, top1 = 66.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.37%], valid : [loss = 2.409, top1 = 38.53%], test : [loss = 2.415, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.930, top1 = 66.45%], valid : [loss = 0.979, top1 = 65.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14593/15625) 014593-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.273, top1 = 91.01%], valid : [loss = 0.473, top1 = 84.55%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10        train : [loss = 0.300, top1 = 90.00%], test  : [loss = 0.399, top1 = 86.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 1.319, top1 = 63.36%], valid : [loss = 1.528, top1 = 58.56%], test : [loss = 1.499, top1 = 58.48%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 2.922, top1 = 28.55%], valid : [loss = 2.903, top1 = 29.67%], test : [loss = 2.954, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14594/15625) 014594-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.20 ms.
cifar10-valid  train : [loss = 0.256, top1 = 91.24%], valid : [loss = 0.557, top1 = 82.45%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.13 ms.
cifar10        train : [loss = 0.226, top1 = 92.34%], test  : [loss = 0.402, top1 = 86.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.38 ms.
cifar100       train : [loss = 1.324, top1 = 62.28%], valid : [loss = 1.588, top1 = 57.20%], test : [loss = 1.607, top1 = 55.20%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.763, top1 = 31.27%], valid : [loss = 2.779, top1 = 30.13%], test : [loss = 2.806, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.947, top1 = 65.66%], valid : [loss = 0.998, top1 = 64.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14595/15625) 014595-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.35 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.08 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.08 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14596/15625) 014596-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.93 ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.41%], valid : [loss = 0.982, top1 = 66.62%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.10 ms.
cifar10        train : [loss = 0.771, top1 = 72.89%], test  : [loss = 0.862, top1 = 69.83%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.15 ms.
cifar100       train : [loss = 2.133, top1 = 44.01%], valid : [loss = 2.296, top1 = 41.12%], test : [loss = 2.328, top1 = 41.12%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.74 ms.
ImageNet16-120 train : [loss = 3.738, top1 = 14.36%], valid : [loss = 3.766, top1 = 14.80%], test : [loss = 3.776, top1 = 13.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14597/15625) 014597-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.50%], valid : [loss = 0.660, top1 = 77.74%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.06 ms.
cifar10        train : [loss = 0.515, top1 = 82.25%], test  : [loss = 0.594, top1 = 79.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.44 ms.
cifar100       train : [loss = 1.687, top1 = 54.23%], valid : [loss = 1.854, top1 = 50.61%], test : [loss = 1.852, top1 = 50.75%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.92 ms.
ImageNet16-120 train : [loss = 3.326, top1 = 21.26%], valid : [loss = 3.311, top1 = 21.61%], test : [loss = 3.345, top1 = 20.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14598/15625) 014598-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.91 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.551, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.26 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.358, top1 = 92.43%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.32 ms.
cifar100       train : [loss = 0.099, top1 = 98.24%], valid : [loss = 1.437, top1 = 68.44%], test : [loss = 1.418, top1 = 68.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 1.889, top1 = 50.18%], valid : [loss = 2.461, top1 = 39.67%], test : [loss = 2.450, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.44%], valid : [loss = 0.732, top1 = 74.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14599/15625) 014599-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.517, top1 = 81.86%], valid : [loss = 0.847, top1 = 72.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.99 ms.
cifar10        train : [loss = 0.547, top1 = 80.93%], test  : [loss = 0.699, top1 = 76.24%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.62 ms.
cifar100       train : [loss = 1.795, top1 = 51.50%], valid : [loss = 2.056, top1 = 46.48%], test : [loss = 2.092, top1 = 46.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.81%], valid : [loss = 3.648, top1 = 16.87%], test : [loss = 3.675, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.213, top1 = 56.36%], valid : [loss = 1.272, top1 = 54.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14600/15625) 014600-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.234, top1 = 92.13%], valid : [loss = 0.558, top1 = 82.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.233, top1 = 92.03%], test  : [loss = 0.419, top1 = 86.43%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.35 ms.
cifar100       train : [loss = 1.324, top1 = 62.41%], valid : [loss = 1.611, top1 = 56.08%], test : [loss = 1.599, top1 = 56.17%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.65%], valid : [loss = 2.763, top1 = 31.44%], test : [loss = 2.812, top1 = 30.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.909, top1 = 67.20%], valid : [loss = 0.978, top1 = 65.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14601/15625) 014601-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.100, top1 = 97.14%], valid : [loss = 0.461, top1 = 86.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.28 ms.
cifar10        train : [loss = 0.138, top1 = 95.58%], test  : [loss = 0.338, top1 = 89.22%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.55 ms.
cifar100       train : [loss = 0.804, top1 = 77.42%], valid : [loss = 1.304, top1 = 63.75%], test : [loss = 1.300, top1 = 64.09%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 2.526, top1 = 36.10%], valid : [loss = 2.612, top1 = 34.42%], test : [loss = 2.632, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.781, top1 = 72.24%], valid : [loss = 0.837, top1 = 70.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14602/15625) 014602-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.37 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.523, top1 = 89.14%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.33 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.331, top1 = 92.64%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.36 ms.
cifar100       train : [loss = 0.112, top1 = 97.90%], valid : [loss = 1.347, top1 = 68.58%], test : [loss = 1.355, top1 = 69.34%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.838, top1 = 51.34%], valid : [loss = 2.289, top1 = 41.40%], test : [loss = 2.277, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.681, top1 = 76.06%], valid : [loss = 0.733, top1 = 74.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14603/15625) 014603-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.425, top1 = 90.40%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.279, top1 = 93.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.190, top1 = 95.41%], valid : [loss = 1.320, top1 = 69.12%], test : [loss = 1.291, top1 = 68.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.15 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 51.95%], valid : [loss = 2.249, top1 = 42.37%], test : [loss = 2.330, top1 = 41.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.03%], valid : [loss = 0.504, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14604/15625) 014604-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=22.05 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.04%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=24.09 ms.
cifar10        train : [loss = 0.010, top1 = 99.86%], test  : [loss = 0.307, top1 = 92.64%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=23.28 ms.
cifar100       train : [loss = 0.183, top1 = 96.01%], valid : [loss = 1.225, top1 = 69.56%], test : [loss = 1.215, top1 = 69.76%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.52 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.92%], valid : [loss = 2.248, top1 = 43.03%], test : [loss = 2.264, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.14%], valid : [loss = 0.659, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14605/15625) 014605-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.30%], valid : [loss = 0.796, top1 = 80.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10        train : [loss = 0.159, top1 = 94.60%], test  : [loss = 0.467, top1 = 86.17%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.92 ms.
cifar100       train : [loss = 0.957, top1 = 72.34%], valid : [loss = 1.638, top1 = 57.04%], test : [loss = 1.624, top1 = 57.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 3.059, top1 = 25.35%], valid : [loss = 3.143, top1 = 24.17%], test : [loss = 3.174, top1 = 23.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14606/15625) 014606-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.57 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.529, top1 = 88.91%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.370, top1 = 92.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.90 ms.
cifar100       train : [loss = 0.128, top1 = 97.23%], valid : [loss = 1.322, top1 = 69.24%], test : [loss = 1.319, top1 = 69.06%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 1.786, top1 = 52.37%], valid : [loss = 2.210, top1 = 43.13%], test : [loss = 2.212, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.598, top1 = 79.02%], valid : [loss = 0.674, top1 = 76.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14607/15625) 014607-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.431, top1 = 90.36%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.05 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.306, top1 = 92.74%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.22 ms.
cifar100       train : [loss = 0.102, top1 = 98.22%], valid : [loss = 1.300, top1 = 70.80%], test : [loss = 1.253, top1 = 70.96%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 1.629, top1 = 56.25%], valid : [loss = 2.178, top1 = 44.03%], test : [loss = 2.200, top1 = 44.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.19%], valid : [loss = 0.507, top1 = 83.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14608/15625) 014608-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 0.275, top1 = 91.06%], valid : [loss = 0.478, top1 = 84.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.298, top1 = 89.98%], test  : [loss = 0.390, top1 = 86.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.37 ms.
cifar100       train : [loss = 1.326, top1 = 63.16%], valid : [loss = 1.522, top1 = 58.56%], test : [loss = 1.521, top1 = 57.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.67%], valid : [loss = 2.889, top1 = 29.40%], test : [loss = 2.967, top1 = 27.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.32%], valid : [loss = 0.760, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14609/15625) 014609-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.480, top1 = 89.40%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.77 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.296, top1 = 93.05%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.11 ms.
cifar100       train : [loss = 0.144, top1 = 97.22%], valid : [loss = 1.250, top1 = 69.62%], test : [loss = 1.290, top1 = 69.06%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.64 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.67%], valid : [loss = 2.188, top1 = 44.00%], test : [loss = 2.204, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 80.09%], valid : [loss = 0.651, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14610/15625) 014610-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.582, top1 = 88.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.371, top1 = 92.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.77 ms.
cifar100       train : [loss = 0.175, top1 = 96.07%], valid : [loss = 1.406, top1 = 66.72%], test : [loss = 1.404, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.93%], valid : [loss = 2.482, top1 = 38.37%], test : [loss = 2.486, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14611/15625) 014611-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.259, top1 = 91.31%], valid : [loss = 0.846, top1 = 76.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10        train : [loss = 0.346, top1 = 87.92%], test  : [loss = 0.625, top1 = 80.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.19 ms.
cifar100       train : [loss = 1.366, top1 = 61.92%], valid : [loss = 1.917, top1 = 49.94%], test : [loss = 1.919, top1 = 49.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.31 ms.
ImageNet16-120 train : [loss = 3.561, top1 = 16.33%], valid : [loss = 3.567, top1 = 16.93%], test : [loss = 3.559, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.290, top1 = 52.70%], valid : [loss = 1.326, top1 = 51.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14612/15625) 014612-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.02%], valid : [loss = 0.476, top1 = 84.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.58 ms.
cifar10        train : [loss = 0.298, top1 = 90.06%], test  : [loss = 0.403, top1 = 86.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.56 ms.
cifar100       train : [loss = 1.327, top1 = 63.19%], valid : [loss = 1.530, top1 = 58.30%], test : [loss = 1.513, top1 = 58.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.59%], valid : [loss = 2.903, top1 = 29.50%], test : [loss = 2.963, top1 = 28.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14613/15625) 014613-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.12%], valid : [loss = 0.694, top1 = 77.16%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.87 ms.
cifar10        train : [loss = 0.454, top1 = 84.05%], test  : [loss = 0.569, top1 = 80.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.38 ms.
cifar100       train : [loss = 1.722, top1 = 52.73%], valid : [loss = 1.949, top1 = 49.10%], test : [loss = 1.927, top1 = 48.92%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.68 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 20.80%], valid : [loss = 3.331, top1 = 21.73%], test : [loss = 3.349, top1 = 20.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.201, top1 = 56.44%], valid : [loss = 1.255, top1 = 55.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14614/15625) 014614-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.885, top1 = 81.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10        train : [loss = 0.060, top1 = 98.06%], test  : [loss = 0.648, top1 = 84.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.35 ms.
cifar100       train : [loss = 0.561, top1 = 84.12%], valid : [loss = 1.949, top1 = 55.10%], test : [loss = 1.982, top1 = 54.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.811, top1 = 30.61%], valid : [loss = 3.119, top1 = 25.23%], test : [loss = 3.175, top1 = 25.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.905, top1 = 67.46%], valid : [loss = 0.965, top1 = 65.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14615/15625) 014615-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.161, top1 = 94.52%], valid : [loss = 0.728, top1 = 80.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.06 ms.
cifar10        train : [loss = 0.187, top1 = 93.55%], test  : [loss = 0.510, top1 = 84.77%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.30 ms.
cifar100       train : [loss = 0.886, top1 = 74.14%], valid : [loss = 1.641, top1 = 57.46%], test : [loss = 1.660, top1 = 56.98%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 3.500, top1 = 16.76%], valid : [loss = 3.496, top1 = 16.81%], test : [loss = 3.512, top1 = 16.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14616/15625) 014616-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.447, top1 = 90.09%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.61 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.297, top1 = 92.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.94 ms.
cifar100       train : [loss = 0.150, top1 = 96.57%], valid : [loss = 1.278, top1 = 70.16%], test : [loss = 1.257, top1 = 70.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 1.780, top1 = 52.70%], valid : [loss = 2.213, top1 = 43.33%], test : [loss = 2.266, top1 = 42.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.383, top1 = 86.72%], valid : [loss = 0.499, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14617/15625) 014617-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.65%], valid : [loss = 0.616, top1 = 86.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.62 ms.
cifar10        train : [loss = 0.025, top1 = 99.34%], test  : [loss = 0.383, top1 = 90.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=19.50 ms.
cifar100       train : [loss = 0.504, top1 = 85.32%], valid : [loss = 1.426, top1 = 63.14%], test : [loss = 1.441, top1 = 63.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.96 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.91%], valid : [loss = 2.537, top1 = 36.03%], test : [loss = 2.563, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.20%], valid : [loss = 0.836, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14618/15625) 014618-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.583, top1 = 87.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.59 ms.
cifar10        train : [loss = 0.038, top1 = 98.90%], test  : [loss = 0.386, top1 = 90.42%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.65 ms.
cifar100       train : [loss = 0.552, top1 = 83.52%], valid : [loss = 1.421, top1 = 63.64%], test : [loss = 1.392, top1 = 64.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.59 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.91%], valid : [loss = 2.628, top1 = 34.83%], test : [loss = 2.677, top1 = 33.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.52%], valid : [loss = 0.627, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14619/15625) 014619-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.60%], valid : [loss = 0.569, top1 = 84.80%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.67 ms.
cifar10        train : [loss = 0.114, top1 = 96.38%], test  : [loss = 0.364, top1 = 89.02%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.738, top1 = 78.59%], valid : [loss = 1.335, top1 = 64.62%], test : [loss = 1.322, top1 = 64.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.489, top1 = 36.68%], valid : [loss = 2.606, top1 = 33.73%], test : [loss = 2.638, top1 = 34.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.68%], valid : [loss = 0.893, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14620/15625) 014620-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.64 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.539, top1 = 89.04%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.36 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.330, top1 = 92.91%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.54 ms.
cifar100       train : [loss = 0.120, top1 = 97.48%], valid : [loss = 1.355, top1 = 68.96%], test : [loss = 1.339, top1 = 69.08%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=24.94 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.23%], valid : [loss = 2.262, top1 = 41.87%], test : [loss = 2.285, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.66%], valid : [loss = 0.839, top1 = 70.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14621/15625) 014621-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.51%], valid : [loss = 0.537, top1 = 82.99%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.279, top1 = 90.45%], test  : [loss = 0.421, top1 = 86.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.73 ms.
cifar100       train : [loss = 1.403, top1 = 60.63%], valid : [loss = 1.679, top1 = 54.77%], test : [loss = 1.662, top1 = 54.83%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.63 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.44%], valid : [loss = 2.913, top1 = 28.90%], test : [loss = 2.977, top1 = 27.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 64.74%], valid : [loss = 1.018, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14622/15625) 014622-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.506, top1 = 89.47%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=23.27 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.321, top1 = 92.95%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.76 ms.
cifar100       train : [loss = 0.095, top1 = 98.18%], valid : [loss = 1.350, top1 = 69.66%], test : [loss = 1.387, top1 = 68.70%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.78 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.31%], valid : [loss = 2.288, top1 = 41.47%], test : [loss = 2.281, top1 = 41.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.63%], valid : [loss = 0.827, top1 = 71.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14623/15625) 014623-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.20 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.36%], valid : [loss = 0.539, top1 = 84.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.177, top1 = 94.08%], test  : [loss = 0.377, top1 = 88.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.11 ms.
cifar100       train : [loss = 1.167, top1 = 66.54%], valid : [loss = 1.517, top1 = 59.20%], test : [loss = 1.499, top1 = 58.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.90 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.76%], valid : [loss = 2.693, top1 = 32.95%], test : [loss = 2.729, top1 = 32.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.11%], valid : [loss = 0.970, top1 = 65.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14624/15625) 014624-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=21.45 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.507, top1 = 90.19%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=23.11 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.328, top1 = 93.27%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=20.81 ms.
cifar100       train : [loss = 0.031, top1 = 99.66%], valid : [loss = 1.356, top1 = 71.10%], test : [loss = 1.362, top1 = 71.70%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=19.14 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.32%], valid : [loss = 2.281, top1 = 41.93%], test : [loss = 2.280, top1 = 42.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.86%], valid : [loss = 0.664, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14625/15625) 014625-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 0.142, top1 = 95.24%], valid : [loss = 0.620, top1 = 83.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.42 ms.
cifar10        train : [loss = 0.154, top1 = 94.73%], test  : [loss = 0.431, top1 = 87.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 0.992, top1 = 71.09%], valid : [loss = 1.741, top1 = 54.46%], test : [loss = 1.710, top1 = 54.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.08 ms.
ImageNet16-120 train : [loss = 3.620, top1 = 14.59%], valid : [loss = 3.595, top1 = 16.17%], test : [loss = 3.600, top1 = 14.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.302, top1 = 52.34%], valid : [loss = 1.310, top1 = 51.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14626/15625) 014626-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.13 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.78 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.70 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.82 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14627/15625) 014627-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.507, top1 = 88.86%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.27 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.341, top1 = 91.99%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 0.348, top1 = 90.37%], valid : [loss = 1.286, top1 = 66.16%], test : [loss = 1.262, top1 = 67.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.09 ms.
ImageNet16-120 train : [loss = 2.128, top1 = 44.64%], valid : [loss = 2.433, top1 = 38.50%], test : [loss = 2.433, top1 = 38.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14628/15625) 014628-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.10%], valid : [loss = 0.547, top1 = 83.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.194, top1 = 93.43%], test  : [loss = 0.394, top1 = 87.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 1.270, top1 = 63.91%], valid : [loss = 1.559, top1 = 57.23%], test : [loss = 1.579, top1 = 56.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.690, top1 = 32.81%], valid : [loss = 2.717, top1 = 32.08%], test : [loss = 2.765, top1 = 31.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.940, top1 = 66.48%], valid : [loss = 0.990, top1 = 65.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14629/15625) 014629-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.316, top1 = 88.95%], valid : [loss = 0.632, top1 = 80.49%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10        train : [loss = 0.286, top1 = 90.09%], test  : [loss = 0.466, top1 = 85.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.49 ms.
cifar100       train : [loss = 1.356, top1 = 61.84%], valid : [loss = 1.700, top1 = 54.66%], test : [loss = 1.711, top1 = 53.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 3.069, top1 = 25.61%], valid : [loss = 3.062, top1 = 25.50%], test : [loss = 3.111, top1 = 25.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.030, top1 = 62.89%], valid : [loss = 1.073, top1 = 61.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14630/15625) 014630-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.35%], valid : [loss = 0.588, top1 = 81.22%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.38 ms.
cifar10        train : [loss = 0.305, top1 = 89.46%], test  : [loss = 0.458, top1 = 84.96%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.72 ms.
cifar100       train : [loss = 1.585, top1 = 56.02%], valid : [loss = 1.806, top1 = 51.04%], test : [loss = 1.799, top1 = 51.64%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 3.046, top1 = 25.82%], valid : [loss = 3.071, top1 = 26.70%], test : [loss = 3.126, top1 = 24.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.58%], valid : [loss = 1.081, top1 = 61.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14631/15625) 014631-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.67%], valid : [loss = 0.543, top1 = 85.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.76 ms.
cifar10        train : [loss = 0.116, top1 = 96.28%], test  : [loss = 0.389, top1 = 88.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.35 ms.
cifar100       train : [loss = 0.877, top1 = 74.34%], valid : [loss = 1.404, top1 = 62.52%], test : [loss = 1.412, top1 = 61.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.44 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 33.85%], valid : [loss = 2.681, top1 = 32.10%], test : [loss = 2.747, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.32%], valid : [loss = 0.957, top1 = 65.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14632/15625) 014632-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.65%], valid : [loss = 0.622, top1 = 86.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.036, top1 = 98.97%], test  : [loss = 0.397, top1 = 90.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.07 ms.
cifar100       train : [loss = 0.517, top1 = 84.73%], valid : [loss = 1.341, top1 = 65.06%], test : [loss = 1.371, top1 = 65.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.448, top1 = 37.74%], valid : [loss = 2.595, top1 = 35.27%], test : [loss = 2.618, top1 = 34.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.58%], valid : [loss = 0.877, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14633/15625) 014633-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.493, top1 = 89.44%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.00 ms.
cifar10        train : [loss = 0.006, top1 = 99.85%], test  : [loss = 0.334, top1 = 92.65%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.35 ms.
cifar100       train : [loss = 0.138, top1 = 97.29%], valid : [loss = 1.322, top1 = 68.52%], test : [loss = 1.306, top1 = 68.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.15 ms.
ImageNet16-120 train : [loss = 1.741, top1 = 53.45%], valid : [loss = 2.221, top1 = 42.77%], test : [loss = 2.203, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.43%], valid : [loss = 0.581, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14634/15625) 014634-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.561, top1 = 88.74%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.375, top1 = 91.64%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.82 ms.
cifar100       train : [loss = 0.176, top1 = 96.05%], valid : [loss = 1.384, top1 = 67.32%], test : [loss = 1.366, top1 = 68.58%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.84%], valid : [loss = 2.474, top1 = 38.20%], test : [loss = 2.478, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.573, top1 = 79.85%], valid : [loss = 0.674, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14635/15625) 014635-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.89%], valid : [loss = 0.532, top1 = 84.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10        train : [loss = 0.174, top1 = 94.13%], test  : [loss = 0.380, top1 = 88.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 1.220, top1 = 65.48%], valid : [loss = 1.525, top1 = 58.23%], test : [loss = 1.516, top1 = 58.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.617, top1 = 34.41%], valid : [loss = 2.682, top1 = 33.23%], test : [loss = 2.702, top1 = 33.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.902, top1 = 67.70%], valid : [loss = 0.946, top1 = 66.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14636/15625) 014636-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.021, top1 = 99.50%], valid : [loss = 0.607, top1 = 86.49%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.49 ms.
cifar10        train : [loss = 0.036, top1 = 98.98%], test  : [loss = 0.394, top1 = 90.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.45 ms.
cifar100       train : [loss = 0.545, top1 = 84.00%], valid : [loss = 1.432, top1 = 63.40%], test : [loss = 1.426, top1 = 63.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.50 ms.
ImageNet16-120 train : [loss = 2.370, top1 = 39.30%], valid : [loss = 2.569, top1 = 35.17%], test : [loss = 2.585, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.32%], valid : [loss = 0.884, top1 = 68.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14637/15625) 014637-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.042, top1 = 98.93%], valid : [loss = 0.682, top1 = 84.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10        train : [loss = 0.084, top1 = 97.41%], test  : [loss = 0.475, top1 = 87.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.804, top1 = 76.86%], valid : [loss = 1.512, top1 = 60.08%], test : [loss = 1.490, top1 = 61.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 2.842, top1 = 29.81%], valid : [loss = 2.950, top1 = 28.03%], test : [loss = 3.006, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.52%], valid : [loss = 0.894, top1 = 68.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14638/15625) 014638-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.407, top1 = 91.34%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.295, top1 = 93.42%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.77 ms.
cifar100       train : [loss = 0.065, top1 = 99.13%], valid : [loss = 1.348, top1 = 70.06%], test : [loss = 1.319, top1 = 70.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.97 ms.
ImageNet16-120 train : [loss = 1.546, top1 = 58.27%], valid : [loss = 2.241, top1 = 44.20%], test : [loss = 2.215, top1 = 44.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.359, top1 = 87.64%], valid : [loss = 0.498, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14639/15625) 014639-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.38 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.23%], valid : [loss = 0.584, top1 = 87.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.14 ms.
cifar10        train : [loss = 0.032, top1 = 99.04%], test  : [loss = 0.379, top1 = 90.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.509, top1 = 85.12%], valid : [loss = 1.336, top1 = 64.62%], test : [loss = 1.309, top1 = 66.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.75 ms.
ImageNet16-120 train : [loss = 2.649, top1 = 32.99%], valid : [loss = 2.720, top1 = 31.70%], test : [loss = 2.740, top1 = 31.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14640/15625) 014640-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.58 ms.
cifar10        train : [loss = 0.005, top1 = 99.87%], test  : [loss = 0.321, top1 = 93.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.72 ms.
cifar100       train : [loss = 0.096, top1 = 98.26%], valid : [loss = 1.282, top1 = 69.92%], test : [loss = 1.295, top1 = 70.18%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 1.675, top1 = 55.01%], valid : [loss = 2.184, top1 = 43.60%], test : [loss = 2.171, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 77.09%], valid : [loss = 0.716, top1 = 74.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14641/15625) 014641-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.661, top1 = 85.64%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.07 ms.
cifar10        train : [loss = 0.033, top1 = 99.13%], test  : [loss = 0.465, top1 = 88.77%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.07 ms.
cifar100       train : [loss = 0.326, top1 = 91.67%], valid : [loss = 1.451, top1 = 64.10%], test : [loss = 1.467, top1 = 64.70%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 2.296, top1 = 41.09%], valid : [loss = 2.683, top1 = 32.73%], test : [loss = 2.725, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.09%], valid : [loss = 0.832, top1 = 70.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14642/15625) 014642-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.23%], valid : [loss = 0.630, top1 = 83.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.46 ms.
cifar10        train : [loss = 0.151, top1 = 94.99%], test  : [loss = 0.451, top1 = 86.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.43 ms.
cifar100       train : [loss = 0.976, top1 = 71.57%], valid : [loss = 1.632, top1 = 56.80%], test : [loss = 1.645, top1 = 56.90%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 3.038, top1 = 25.69%], valid : [loss = 3.131, top1 = 24.70%], test : [loss = 3.147, top1 = 23.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.15%], valid : [loss = 1.050, top1 = 62.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14643/15625) 014643-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.34%], valid : [loss = 0.512, top1 = 87.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.76 ms.
cifar10        train : [loss = 0.053, top1 = 98.34%], test  : [loss = 0.349, top1 = 90.53%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.48 ms.
cifar100       train : [loss = 0.627, top1 = 81.62%], valid : [loss = 1.321, top1 = 66.12%], test : [loss = 1.326, top1 = 65.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.50%], valid : [loss = 2.520, top1 = 36.43%], test : [loss = 2.526, top1 = 36.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.24%], valid : [loss = 0.626, top1 = 78.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14644/15625) 014644-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.68%], valid : [loss = 0.855, top1 = 71.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.34 ms.
cifar10        train : [loss = 0.559, top1 = 80.44%], test  : [loss = 0.717, top1 = 75.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.30 ms.
cifar100       train : [loss = 1.784, top1 = 51.92%], valid : [loss = 2.057, top1 = 46.52%], test : [loss = 2.069, top1 = 46.56%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.63 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.77%], valid : [loss = 3.642, top1 = 16.40%], test : [loss = 3.670, top1 = 15.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14645/15625) 014645-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.41 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.52 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.96 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14646/15625) 014646-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.459, top1 = 88.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.79 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.311, top1 = 92.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.26 ms.
cifar100       train : [loss = 0.327, top1 = 91.18%], valid : [loss = 1.304, top1 = 66.91%], test : [loss = 1.327, top1 = 67.12%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.74 ms.
ImageNet16-120 train : [loss = 2.060, top1 = 46.16%], valid : [loss = 2.383, top1 = 40.22%], test : [loss = 2.406, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14647/15625) 014647-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.53 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.487, top1 = 90.54%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.73 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.317, top1 = 93.32%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.14 ms.
cifar100       train : [loss = 0.056, top1 = 99.19%], valid : [loss = 1.349, top1 = 70.18%], test : [loss = 1.334, top1 = 70.76%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 1.514, top1 = 58.97%], valid : [loss = 2.143, top1 = 45.70%], test : [loss = 2.151, top1 = 45.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.94%], valid : [loss = 0.634, top1 = 78.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14648/15625) 014648-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.522, top1 = 88.61%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=15.56 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.335, top1 = 92.02%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=15.24 ms.
cifar100       train : [loss = 0.343, top1 = 90.68%], valid : [loss = 1.302, top1 = 66.63%], test : [loss = 1.277, top1 = 66.90%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.75%], valid : [loss = 2.383, top1 = 39.39%], test : [loss = 2.398, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14649/15625) 014649-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.66 ms.
cifar10-valid  train : [loss = 0.533, top1 = 81.32%], valid : [loss = 0.660, top1 = 77.56%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.620, top1 = 78.31%], test  : [loss = 0.667, top1 = 77.33%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.31 ms.
cifar100       train : [loss = 1.727, top1 = 53.24%], valid : [loss = 1.884, top1 = 49.78%], test : [loss = 1.897, top1 = 50.46%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.55 ms.
ImageNet16-120 train : [loss = 3.383, top1 = 20.18%], valid : [loss = 3.363, top1 = 20.93%], test : [loss = 3.401, top1 = 19.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14650/15625) 014650-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.616, top1 = 87.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.010, top1 = 99.78%], test  : [loss = 0.385, top1 = 91.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.91 ms.
cifar100       train : [loss = 0.219, top1 = 94.84%], valid : [loss = 1.459, top1 = 66.10%], test : [loss = 1.446, top1 = 65.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.96 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.15%], valid : [loss = 2.496, top1 = 37.57%], test : [loss = 2.518, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14651/15625) 014651-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=24.04 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.52%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.26 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.304, top1 = 93.55%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.89 ms.
cifar100       train : [loss = 0.071, top1 = 98.93%], valid : [loss = 1.322, top1 = 69.24%], test : [loss = 1.309, top1 = 70.98%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.30 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 45.89%], valid : [loss = 2.381, top1 = 39.10%], test : [loss = 2.395, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.80%], valid : [loss = 0.761, top1 = 73.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14652/15625) 014652-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.605, top1 = 87.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.94 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.404, top1 = 91.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.15 ms.
cifar100       train : [loss = 0.217, top1 = 94.69%], valid : [loss = 1.483, top1 = 65.93%], test : [loss = 1.498, top1 = 65.51%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 45.02%], valid : [loss = 2.530, top1 = 37.09%], test : [loss = 2.543, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.37%], valid : [loss = 0.747, top1 = 73.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14653/15625) 014653-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.56 ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.44%], valid : [loss = 0.767, top1 = 74.34%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.92 ms.
cifar10        train : [loss = 0.548, top1 = 80.80%], test  : [loss = 0.655, top1 = 77.69%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.75 ms.
cifar100       train : [loss = 1.886, top1 = 48.81%], valid : [loss = 2.065, top1 = 44.96%], test : [loss = 2.049, top1 = 45.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 3.513, top1 = 17.66%], valid : [loss = 3.521, top1 = 18.17%], test : [loss = 3.534, top1 = 17.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.242, top1 = 54.77%], valid : [loss = 1.281, top1 = 53.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14654/15625) 014654-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.405, top1 = 91.36%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.76 ms.
cifar10        train : [loss = 0.002, top1 = 99.99%], test  : [loss = 0.286, top1 = 93.69%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=18.17 ms.
cifar100       train : [loss = 0.044, top1 = 99.54%], valid : [loss = 1.340, top1 = 70.90%], test : [loss = 1.327, top1 = 71.32%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 1.443, top1 = 60.58%], valid : [loss = 2.203, top1 = 44.63%], test : [loss = 2.253, top1 = 43.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.348, top1 = 88.06%], valid : [loss = 0.488, top1 = 83.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14655/15625) 014655-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.478, top1 = 89.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.50 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.316, top1 = 92.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.78 ms.
cifar100       train : [loss = 0.247, top1 = 93.67%], valid : [loss = 1.219, top1 = 69.28%], test : [loss = 1.202, top1 = 69.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.73 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.77%], valid : [loss = 2.229, top1 = 42.57%], test : [loss = 2.228, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14656/15625) 014656-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.610, top1 = 86.58%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.77 ms.
cifar10        train : [loss = 0.028, top1 = 99.25%], test  : [loss = 0.428, top1 = 90.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.28 ms.
cifar100       train : [loss = 0.506, top1 = 85.26%], valid : [loss = 1.438, top1 = 63.78%], test : [loss = 1.428, top1 = 62.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.10 ms.
ImageNet16-120 train : [loss = 2.385, top1 = 39.01%], valid : [loss = 2.588, top1 = 34.80%], test : [loss = 2.613, top1 = 33.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.48%], valid : [loss = 0.856, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14657/15625) 014657-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.621, top1 = 86.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.34 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.411, top1 = 90.57%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.45 ms.
cifar100       train : [loss = 0.230, top1 = 94.21%], valid : [loss = 1.594, top1 = 63.26%], test : [loss = 1.607, top1 = 63.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.56 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.82%], valid : [loss = 2.470, top1 = 39.07%], test : [loss = 2.485, top1 = 38.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.14%], valid : [loss = 0.814, top1 = 71.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14658/15625) 014658-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10-valid  train : [loss = 0.094, top1 = 97.16%], valid : [loss = 0.494, top1 = 86.28%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.113, top1 = 96.28%], test  : [loss = 0.339, top1 = 89.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.31 ms.
cifar100       train : [loss = 0.725, top1 = 79.16%], valid : [loss = 1.233, top1 = 65.94%], test : [loss = 1.213, top1 = 66.56%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.34 ms.
ImageNet16-120 train : [loss = 2.367, top1 = 39.59%], valid : [loss = 2.447, top1 = 37.63%], test : [loss = 2.481, top1 = 37.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.40%], valid : [loss = 0.889, top1 = 68.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14659/15625) 014659-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.60 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.29 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.59 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14660/15625) 014660-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.07 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.82%], valid : [loss = 0.466, top1 = 86.15%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.13 ms.
cifar10        train : [loss = 0.150, top1 = 95.16%], test  : [loss = 0.339, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.75 ms.
cifar100       train : [loss = 0.974, top1 = 72.23%], valid : [loss = 1.347, top1 = 62.74%], test : [loss = 1.336, top1 = 62.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.10%], valid : [loss = 2.664, top1 = 33.20%], test : [loss = 2.679, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14661/15625) 014661-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 13.03 M, Params=0.111 MB, latency=14.50 ms.
cifar10-valid  train : [loss = 0.298, top1 = 89.85%], valid : [loss = 0.497, top1 = 83.95%]
cifar10        FLOP= 13.03 M, Params=0.111 MB, latency=14.23 ms.
cifar10        train : [loss = 0.267, top1 = 90.94%], test  : [loss = 0.373, top1 = 87.54%]
cifar100       FLOP= 13.03 M, Params=0.116 MB, latency=14.22 ms.
cifar100       train : [loss = 1.291, top1 = 63.78%], valid : [loss = 1.495, top1 = 58.37%], test : [loss = 1.473, top1 = 58.49%]
ImageNet16-120 FLOP=  3.26 M, Params=0.118 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 2.815, top1 = 30.59%], valid : [loss = 2.814, top1 = 30.47%], test : [loss = 2.850, top1 = 29.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.78%], valid : [loss = 1.069, top1 = 62.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14662/15625) 014662-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.24 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.64%], valid : [loss = 0.537, top1 = 88.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.74 ms.
cifar10        train : [loss = 0.023, top1 = 99.35%], test  : [loss = 0.342, top1 = 91.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.63 ms.
cifar100       train : [loss = 0.402, top1 = 88.66%], valid : [loss = 1.232, top1 = 67.78%], test : [loss = 1.258, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 45.96%], valid : [loss = 2.317, top1 = 40.67%], test : [loss = 2.294, top1 = 41.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 76.92%], valid : [loss = 0.717, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14663/15625) 014663-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.95 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.30%], valid : [loss = 0.903, top1 = 78.90%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.98 ms.
cifar10        train : [loss = 0.129, top1 = 95.63%], test  : [loss = 0.559, top1 = 84.67%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.53 ms.
cifar100       train : [loss = 0.829, top1 = 75.75%], valid : [loss = 1.672, top1 = 57.52%], test : [loss = 1.659, top1 = 57.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.46%], valid : [loss = 3.176, top1 = 24.20%], test : [loss = 3.227, top1 = 23.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14664/15625) 014664-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.19 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.462, top1 = 89.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.314, top1 = 91.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.95 ms.
cifar100       train : [loss = 0.331, top1 = 90.97%], valid : [loss = 1.358, top1 = 67.00%], test : [loss = 1.325, top1 = 67.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.34%], valid : [loss = 2.362, top1 = 39.67%], test : [loss = 2.415, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.89%], valid : [loss = 0.538, top1 = 81.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14665/15625) 014665-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.277, top1 = 90.56%], valid : [loss = 0.564, top1 = 82.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10        train : [loss = 0.262, top1 = 90.96%], test  : [loss = 0.417, top1 = 86.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.52 ms.
cifar100       train : [loss = 1.426, top1 = 60.14%], valid : [loss = 1.686, top1 = 54.10%], test : [loss = 1.659, top1 = 55.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.64 ms.
ImageNet16-120 train : [loss = 2.930, top1 = 28.12%], valid : [loss = 2.943, top1 = 27.87%], test : [loss = 3.001, top1 = 27.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.94%], valid : [loss = 1.001, top1 = 64.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14666/15625) 014666-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.564, top1 = 88.34%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.52 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.388, top1 = 91.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.72 ms.
cifar100       train : [loss = 0.152, top1 = 96.85%], valid : [loss = 1.486, top1 = 66.62%], test : [loss = 1.429, top1 = 67.40%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 1.965, top1 = 48.35%], valid : [loss = 2.388, top1 = 39.03%], test : [loss = 2.420, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.11%], valid : [loss = 0.712, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14667/15625) 014667-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.503, top1 = 88.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.89 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.332, top1 = 91.82%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.28 ms.
cifar100       train : [loss = 0.319, top1 = 91.46%], valid : [loss = 1.313, top1 = 66.96%], test : [loss = 1.280, top1 = 68.38%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.70 ms.
ImageNet16-120 train : [loss = 2.113, top1 = 44.90%], valid : [loss = 2.395, top1 = 38.40%], test : [loss = 2.417, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14668/15625) 014668-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.535, top1 = 88.66%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.61 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.340, top1 = 92.46%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.41 ms.
cifar100       train : [loss = 0.282, top1 = 92.29%], valid : [loss = 1.321, top1 = 67.62%], test : [loss = 1.307, top1 = 67.66%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=20.77 ms.
ImageNet16-120 train : [loss = 2.099, top1 = 45.26%], valid : [loss = 2.401, top1 = 39.20%], test : [loss = 2.421, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.64%], valid : [loss = 0.820, top1 = 71.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14669/15625) 014669-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=21.20 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.502, top1 = 90.08%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.81 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.318, top1 = 93.61%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.01 ms.
cifar100       train : [loss = 0.063, top1 = 99.11%], valid : [loss = 1.332, top1 = 69.96%], test : [loss = 1.348, top1 = 69.66%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=23.25 ms.
ImageNet16-120 train : [loss = 1.753, top1 = 53.27%], valid : [loss = 2.292, top1 = 42.43%], test : [loss = 2.276, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.30%], valid : [loss = 0.648, top1 = 77.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14670/15625) 014670-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.296, top1 = 89.95%], valid : [loss = 0.471, top1 = 84.45%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.92 ms.
cifar10        train : [loss = 0.266, top1 = 91.03%], test  : [loss = 0.368, top1 = 87.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.80 ms.
cifar100       train : [loss = 1.307, top1 = 63.42%], valid : [loss = 1.495, top1 = 58.11%], test : [loss = 1.485, top1 = 58.39%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.829, top1 = 30.32%], valid : [loss = 2.813, top1 = 30.98%], test : [loss = 2.863, top1 = 29.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.82%], valid : [loss = 1.031, top1 = 63.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14671/15625) 014671-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.294, top1 = 89.96%], valid : [loss = 0.565, top1 = 82.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10        train : [loss = 0.235, top1 = 92.04%], test  : [loss = 0.400, top1 = 86.74%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.13 ms.
cifar100       train : [loss = 1.301, top1 = 63.15%], valid : [loss = 1.570, top1 = 56.92%], test : [loss = 1.586, top1 = 56.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.03 ms.
ImageNet16-120 train : [loss = 2.837, top1 = 30.03%], valid : [loss = 2.882, top1 = 28.60%], test : [loss = 2.906, top1 = 28.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.18%], valid : [loss = 1.007, top1 = 64.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14672/15625) 014672-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.82 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14673/15625) 014673-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.69%], valid : [loss = 0.540, top1 = 88.07%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.79 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.362, top1 = 91.93%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.06 ms.
cifar100       train : [loss = 0.275, top1 = 92.52%], valid : [loss = 1.300, top1 = 68.58%], test : [loss = 1.319, top1 = 68.08%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.87 ms.
ImageNet16-120 train : [loss = 2.331, top1 = 40.12%], valid : [loss = 2.493, top1 = 36.83%], test : [loss = 2.505, top1 = 36.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.55%], valid : [loss = 0.945, top1 = 66.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14674/15625) 014674-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.44 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.98%], valid : [loss = 0.483, top1 = 84.24%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.59 ms.
cifar10        train : [loss = 0.302, top1 = 89.85%], test  : [loss = 0.403, top1 = 86.44%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.24 ms.
cifar100       train : [loss = 1.325, top1 = 63.34%], valid : [loss = 1.531, top1 = 57.94%], test : [loss = 1.512, top1 = 57.84%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.15 ms.
ImageNet16-120 train : [loss = 2.916, top1 = 28.72%], valid : [loss = 2.889, top1 = 29.97%], test : [loss = 2.956, top1 = 28.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.82%], valid : [loss = 0.782, top1 = 72.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14675/15625) 014675-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.54%], valid : [loss = 0.462, top1 = 85.97%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10        train : [loss = 0.165, top1 = 94.59%], test  : [loss = 0.351, top1 = 88.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 0.999, top1 = 71.62%], valid : [loss = 1.374, top1 = 61.70%], test : [loss = 1.337, top1 = 62.22%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.58 ms.
ImageNet16-120 train : [loss = 2.652, top1 = 33.46%], valid : [loss = 2.733, top1 = 32.77%], test : [loss = 2.718, top1 = 32.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.79%], valid : [loss = 0.783, top1 = 72.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14676/15625) 014676-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.497, top1 = 89.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.47 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.306, top1 = 92.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.99 ms.
cifar100       train : [loss = 0.257, top1 = 93.22%], valid : [loss = 1.228, top1 = 68.50%], test : [loss = 1.234, top1 = 69.03%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.50%], valid : [loss = 2.219, top1 = 43.42%], test : [loss = 2.204, top1 = 43.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.75%], valid : [loss = 0.638, top1 = 78.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14677/15625) 014677-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.26%], valid : [loss = 0.454, top1 = 86.11%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.22 ms.
cifar10        train : [loss = 0.159, top1 = 94.87%], test  : [loss = 0.350, top1 = 88.67%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.91 ms.
cifar100       train : [loss = 0.988, top1 = 71.82%], valid : [loss = 1.354, top1 = 61.88%], test : [loss = 1.348, top1 = 62.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.92%], valid : [loss = 2.676, top1 = 32.80%], test : [loss = 2.707, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.79%], valid : [loss = 0.789, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14678/15625) 014678-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.94 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.16%], valid : [loss = 0.576, top1 = 86.54%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.92 ms.
cifar10        train : [loss = 0.060, top1 = 98.12%], test  : [loss = 0.358, top1 = 90.23%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.46 ms.
cifar100       train : [loss = 0.636, top1 = 81.22%], valid : [loss = 1.281, top1 = 65.46%], test : [loss = 1.322, top1 = 64.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.82 ms.
ImageNet16-120 train : [loss = 2.399, top1 = 38.74%], valid : [loss = 2.565, top1 = 35.47%], test : [loss = 2.539, top1 = 35.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.10%], valid : [loss = 0.805, top1 = 72.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14679/15625) 014679-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.559, top1 = 88.69%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.76 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.343, top1 = 92.27%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.37 ms.
cifar100       train : [loss = 0.175, top1 = 96.05%], valid : [loss = 1.288, top1 = 69.08%], test : [loss = 1.280, top1 = 69.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=21.93 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.75%], valid : [loss = 2.232, top1 = 42.97%], test : [loss = 2.272, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.42%], valid : [loss = 0.789, top1 = 72.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14680/15625) 014680-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.12 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.596, top1 = 87.45%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.404, top1 = 91.55%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.06 ms.
cifar100       train : [loss = 0.163, top1 = 96.23%], valid : [loss = 1.507, top1 = 66.20%], test : [loss = 1.548, top1 = 65.80%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.071, top1 = 46.17%], valid : [loss = 2.442, top1 = 38.83%], test : [loss = 2.461, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.52%], valid : [loss = 0.801, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14681/15625) 014681-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.499, top1 = 88.94%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.321, top1 = 92.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.64 ms.
cifar100       train : [loss = 0.323, top1 = 91.30%], valid : [loss = 1.229, top1 = 67.84%], test : [loss = 1.253, top1 = 68.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.75%], valid : [loss = 2.317, top1 = 40.22%], test : [loss = 2.341, top1 = 40.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.74%], valid : [loss = 0.577, top1 = 80.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14682/15625) 014682-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.20%], valid : [loss = 0.457, top1 = 86.14%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10        train : [loss = 0.155, top1 = 94.99%], test  : [loss = 0.343, top1 = 89.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.39 ms.
cifar100       train : [loss = 1.007, top1 = 71.27%], valid : [loss = 1.367, top1 = 61.78%], test : [loss = 1.359, top1 = 61.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.34%], valid : [loss = 2.707, top1 = 32.58%], test : [loss = 2.734, top1 = 31.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.742, top1 = 73.70%], valid : [loss = 0.800, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14683/15625) 014683-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.469, top1 = 89.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.303, top1 = 92.46%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.75 ms.
cifar100       train : [loss = 0.324, top1 = 91.35%], valid : [loss = 1.249, top1 = 67.41%], test : [loss = 1.256, top1 = 67.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.52%], valid : [loss = 2.340, top1 = 40.23%], test : [loss = 2.343, top1 = 40.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.476, top1 = 83.56%], valid : [loss = 0.569, top1 = 80.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14684/15625) 014684-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=20.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.512, top1 = 89.18%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=19.77 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.328, top1 = 92.68%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=19.32 ms.
cifar100       train : [loss = 0.148, top1 = 96.70%], valid : [loss = 1.317, top1 = 68.61%], test : [loss = 1.352, top1 = 68.72%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=17.00 ms.
ImageNet16-120 train : [loss = 1.919, top1 = 49.41%], valid : [loss = 2.332, top1 = 41.00%], test : [loss = 2.330, top1 = 41.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.49%], valid : [loss = 0.731, top1 = 74.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14685/15625) 014685-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.92 ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.74%], valid : [loss = 0.749, top1 = 74.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.26 ms.
cifar10        train : [loss = 0.518, top1 = 82.15%], test  : [loss = 0.596, top1 = 79.58%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.69 ms.
cifar100       train : [loss = 1.922, top1 = 48.09%], valid : [loss = 2.051, top1 = 45.75%], test : [loss = 2.060, top1 = 45.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.08 ms.
ImageNet16-120 train : [loss = 2.988, top1 = 26.88%], valid : [loss = 2.977, top1 = 27.33%], test : [loss = 3.012, top1 = 26.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.128, top1 = 59.54%], valid : [loss = 1.178, top1 = 57.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14686/15625) 014686-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.67 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.510, top1 = 89.34%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.39 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.319, top1 = 92.94%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.06 ms.
cifar100       train : [loss = 0.123, top1 = 97.40%], valid : [loss = 1.342, top1 = 68.52%], test : [loss = 1.357, top1 = 68.98%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.32 ms.
ImageNet16-120 train : [loss = 1.900, top1 = 49.74%], valid : [loss = 2.315, top1 = 40.80%], test : [loss = 2.301, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.43%], valid : [loss = 0.845, top1 = 70.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14687/15625) 014687-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.28%], valid : [loss = 0.530, top1 = 87.40%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.30 ms.
cifar10        train : [loss = 0.032, top1 = 99.06%], test  : [loss = 0.355, top1 = 91.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.31 ms.
cifar100       train : [loss = 0.490, top1 = 85.70%], valid : [loss = 1.407, top1 = 63.44%], test : [loss = 1.396, top1 = 63.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 2.762, top1 = 30.27%], valid : [loss = 2.849, top1 = 28.47%], test : [loss = 2.828, top1 = 28.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.067, top1 = 61.15%], valid : [loss = 1.090, top1 = 60.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14688/15625) 014688-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.696, top1 = 75.28%], valid : [loss = 0.783, top1 = 73.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.57 ms.
cifar10        train : [loss = 0.538, top1 = 81.39%], test  : [loss = 0.593, top1 = 79.74%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.79 ms.
cifar100       train : [loss = 2.123, top1 = 42.80%], valid : [loss = 2.234, top1 = 40.34%], test : [loss = 2.238, top1 = 40.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 3.281, top1 = 21.27%], valid : [loss = 3.227, top1 = 22.43%], test : [loss = 3.284, top1 = 21.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.207, top1 = 56.05%], valid : [loss = 1.269, top1 = 54.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14689/15625) 014689-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 85.12 M, Params=0.606 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.487, top1 = 88.91%]
cifar10        FLOP= 85.12 M, Params=0.606 MB, latency=18.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.24%]
cifar100       FLOP= 85.12 M, Params=0.612 MB, latency=17.30 ms.
cifar100       train : [loss = 0.322, top1 = 91.38%], valid : [loss = 1.258, top1 = 66.89%], test : [loss = 1.238, top1 = 68.03%]
ImageNet16-120 FLOP= 21.29 M, Params=0.613 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.62%], valid : [loss = 2.342, top1 = 40.80%], test : [loss = 2.362, top1 = 40.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.512, top1 = 81.92%], valid : [loss = 0.593, top1 = 79.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14690/15625) 014690-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.30 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.92%], valid : [loss = 0.486, top1 = 84.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.88 ms.
cifar10        train : [loss = 0.296, top1 = 90.09%], test  : [loss = 0.393, top1 = 86.56%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.59 ms.
cifar100       train : [loss = 1.338, top1 = 62.89%], valid : [loss = 1.550, top1 = 56.42%], test : [loss = 1.513, top1 = 57.82%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.930, top1 = 28.53%], valid : [loss = 2.908, top1 = 29.43%], test : [loss = 2.979, top1 = 27.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14691/15625) 014691-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.91 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.06%], valid : [loss = 0.840, top1 = 72.02%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.29 ms.
cifar10        train : [loss = 0.550, top1 = 80.72%], test  : [loss = 0.699, top1 = 76.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.97 ms.
cifar100       train : [loss = 1.797, top1 = 51.81%], valid : [loss = 2.044, top1 = 47.04%], test : [loss = 2.060, top1 = 48.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.82%], valid : [loss = 3.632, top1 = 16.50%], test : [loss = 3.672, top1 = 16.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14692/15625) 014692-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.86%], valid : [loss = 0.739, top1 = 80.13%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10        train : [loss = 0.181, top1 = 93.78%], test  : [loss = 0.506, top1 = 84.91%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.57 ms.
cifar100       train : [loss = 0.890, top1 = 74.00%], valid : [loss = 1.643, top1 = 57.19%], test : [loss = 1.657, top1 = 57.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.27 ms.
ImageNet16-120 train : [loss = 3.518, top1 = 16.51%], valid : [loss = 3.510, top1 = 16.88%], test : [loss = 3.520, top1 = 16.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14693/15625) 014693-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=18.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 89.79%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=21.65 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.60%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=20.24 ms.
cifar100       train : [loss = 0.042, top1 = 99.44%], valid : [loss = 1.383, top1 = 69.14%], test : [loss = 1.381, top1 = 70.10%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.41 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.62%], valid : [loss = 2.316, top1 = 41.87%], test : [loss = 2.316, top1 = 42.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.56%], valid : [loss = 0.757, top1 = 73.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14694/15625) 014694-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.34 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.02%], valid : [loss = 0.476, top1 = 84.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10        train : [loss = 0.298, top1 = 90.06%], test  : [loss = 0.403, top1 = 86.50%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.91 ms.
cifar100       train : [loss = 1.327, top1 = 63.19%], valid : [loss = 1.530, top1 = 58.30%], test : [loss = 1.513, top1 = 58.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.78 ms.
ImageNet16-120 train : [loss = 2.920, top1 = 28.59%], valid : [loss = 2.903, top1 = 29.50%], test : [loss = 2.963, top1 = 28.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14695/15625) 014695-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.17 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.66%], valid : [loss = 0.568, top1 = 87.32%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.19 ms.
cifar10        train : [loss = 0.043, top1 = 98.66%], test  : [loss = 0.397, top1 = 89.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.45 ms.
cifar100       train : [loss = 0.555, top1 = 83.56%], valid : [loss = 1.410, top1 = 64.56%], test : [loss = 1.391, top1 = 64.40%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.480, top1 = 37.31%], valid : [loss = 2.592, top1 = 35.17%], test : [loss = 2.649, top1 = 33.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14696/15625) 014696-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.167, top1 = 94.58%], valid : [loss = 0.985, top1 = 74.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.221, top1 = 92.40%], test  : [loss = 0.604, top1 = 82.14%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.62 ms.
cifar100       train : [loss = 1.129, top1 = 67.88%], valid : [loss = 1.776, top1 = 53.92%], test : [loss = 1.734, top1 = 55.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.78%], valid : [loss = 3.337, top1 = 21.63%], test : [loss = 3.363, top1 = 20.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.041, top1 = 62.82%], valid : [loss = 1.094, top1 = 61.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14697/15625) 014697-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.30%], valid : [loss = 0.453, top1 = 87.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.12 ms.
cifar10        train : [loss = 0.114, top1 = 96.47%], test  : [loss = 0.326, top1 = 89.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.00 ms.
cifar100       train : [loss = 0.871, top1 = 75.04%], valid : [loss = 1.313, top1 = 63.33%], test : [loss = 1.283, top1 = 64.21%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.66%], valid : [loss = 2.615, top1 = 34.58%], test : [loss = 2.647, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14698/15625) 014698-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.90 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.326, top1 = 91.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.89 ms.
cifar100       train : [loss = 0.328, top1 = 91.03%], valid : [loss = 1.341, top1 = 66.72%], test : [loss = 1.303, top1 = 67.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.76 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.32%], valid : [loss = 2.369, top1 = 40.40%], test : [loss = 2.426, top1 = 39.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14699/15625) 014699-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.66 ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.02%], valid : [loss = 0.671, top1 = 77.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.36 ms.
cifar10        train : [loss = 0.537, top1 = 81.26%], test  : [loss = 0.605, top1 = 79.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.25 ms.
cifar100       train : [loss = 1.702, top1 = 53.62%], valid : [loss = 1.861, top1 = 50.26%], test : [loss = 1.881, top1 = 49.78%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.21 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.33%], valid : [loss = 3.313, top1 = 20.97%], test : [loss = 3.320, top1 = 22.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14700/15625) 014700-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.68%], valid : [loss = 0.537, top1 = 88.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10        train : [loss = 0.026, top1 = 99.26%], test  : [loss = 0.349, top1 = 91.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.32 ms.
cifar100       train : [loss = 0.422, top1 = 87.78%], valid : [loss = 1.266, top1 = 66.98%], test : [loss = 1.276, top1 = 66.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.84 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.04%], valid : [loss = 2.406, top1 = 38.37%], test : [loss = 2.456, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.40%], valid : [loss = 0.810, top1 = 71.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14701/15625) 014701-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.71 ms.
cifar10-valid  train : [loss = 0.190, top1 = 93.67%], valid : [loss = 0.537, top1 = 84.12%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10        train : [loss = 0.194, top1 = 93.48%], test  : [loss = 0.391, top1 = 87.60%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.73 ms.
cifar100       train : [loss = 1.247, top1 = 64.50%], valid : [loss = 1.536, top1 = 57.87%], test : [loss = 1.536, top1 = 57.81%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.85 ms.
ImageNet16-120 train : [loss = 2.669, top1 = 33.23%], valid : [loss = 2.715, top1 = 32.36%], test : [loss = 2.759, top1 = 32.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.922, top1 = 66.92%], valid : [loss = 0.972, top1 = 65.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14702/15625) 014702-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.155, top1 = 94.92%], valid : [loss = 0.504, top1 = 85.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10        train : [loss = 0.169, top1 = 94.40%], test  : [loss = 0.382, top1 = 88.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.39 ms.
cifar100       train : [loss = 1.009, top1 = 71.05%], valid : [loss = 1.368, top1 = 61.60%], test : [loss = 1.366, top1 = 62.09%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.604, top1 = 34.58%], valid : [loss = 2.633, top1 = 34.25%], test : [loss = 2.715, top1 = 33.75%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.17%], valid : [loss = 0.931, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14703/15625) 014703-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.59 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.99%], valid : [loss = 0.419, top1 = 90.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.92 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.293, top1 = 93.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.39 ms.
cifar100       train : [loss = 0.125, top1 = 97.68%], valid : [loss = 1.331, top1 = 68.62%], test : [loss = 1.280, top1 = 70.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.00%], valid : [loss = 2.209, top1 = 44.17%], test : [loss = 2.241, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.32%], valid : [loss = 0.547, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14704/15625) 014704-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.05%], valid : [loss = 0.542, top1 = 83.82%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.00 ms.
cifar10        train : [loss = 0.161, top1 = 94.70%], test  : [loss = 0.388, top1 = 88.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.72 ms.
cifar100       train : [loss = 1.142, top1 = 67.20%], valid : [loss = 1.496, top1 = 59.32%], test : [loss = 1.460, top1 = 60.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.598, top1 = 34.64%], valid : [loss = 2.681, top1 = 33.50%], test : [loss = 2.693, top1 = 32.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.942, top1 = 66.14%], valid : [loss = 0.996, top1 = 64.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14705/15625) 014705-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.31 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.542, top1 = 88.75%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.341, top1 = 92.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.72 ms.
cifar100       train : [loss = 0.271, top1 = 92.65%], valid : [loss = 1.288, top1 = 67.38%], test : [loss = 1.260, top1 = 68.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.63 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.74%], valid : [loss = 2.284, top1 = 41.67%], test : [loss = 2.310, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.734, top1 = 74.02%], valid : [loss = 0.798, top1 = 72.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14706/15625) 014706-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.79 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.78%], valid : [loss = 0.556, top1 = 88.29%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.53 ms.
cifar10        train : [loss = 0.017, top1 = 99.57%], test  : [loss = 0.354, top1 = 91.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.275, top1 = 92.35%], valid : [loss = 1.367, top1 = 66.18%], test : [loss = 1.376, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.21 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.45%], valid : [loss = 2.449, top1 = 37.43%], test : [loss = 2.453, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.12%], valid : [loss = 0.954, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14707/15625) 014707-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.59 ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.39%], valid : [loss = 0.525, top1 = 82.42%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.60 ms.
cifar10        train : [loss = 0.403, top1 = 86.15%], test  : [loss = 0.470, top1 = 84.17%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.15 ms.
cifar100       train : [loss = 1.541, top1 = 57.77%], valid : [loss = 1.654, top1 = 54.56%], test : [loss = 1.651, top1 = 54.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.32 ms.
ImageNet16-120 train : [loss = 3.035, top1 = 26.40%], valid : [loss = 3.021, top1 = 27.10%], test : [loss = 3.060, top1 = 25.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.119, top1 = 60.17%], valid : [loss = 1.136, top1 = 60.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14708/15625) 014708-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.523, top1 = 88.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.10 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.353, top1 = 91.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.54 ms.
cifar100       train : [loss = 0.221, top1 = 94.44%], valid : [loss = 1.274, top1 = 68.38%], test : [loss = 1.270, top1 = 67.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.996, top1 = 47.51%], valid : [loss = 2.327, top1 = 41.10%], test : [loss = 2.333, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.90%], valid : [loss = 0.778, top1 = 72.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14709/15625) 014709-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.15 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.449, top1 = 90.72%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.64 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.310, top1 = 93.62%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.25 ms.
cifar100       train : [loss = 0.053, top1 = 99.33%], valid : [loss = 1.350, top1 = 71.04%], test : [loss = 1.359, top1 = 70.40%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.48 ms.
ImageNet16-120 train : [loss = 1.495, top1 = 59.50%], valid : [loss = 2.256, top1 = 43.83%], test : [loss = 2.272, top1 = 43.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.05%], valid : [loss = 0.540, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14710/15625) 014710-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.33 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.521, top1 = 88.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.89 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.333, top1 = 92.12%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.16 ms.
cifar100       train : [loss = 0.274, top1 = 92.66%], valid : [loss = 1.265, top1 = 67.74%], test : [loss = 1.296, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.52%], valid : [loss = 2.306, top1 = 40.63%], test : [loss = 2.318, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.21%], valid : [loss = 0.726, top1 = 74.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14711/15625) 014711-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.32%], valid : [loss = 0.917, top1 = 67.95%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.771, top1 = 73.02%], test  : [loss = 0.820, top1 = 71.04%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.40 ms.
cifar100       train : [loss = 2.296, top1 = 39.80%], valid : [loss = 2.406, top1 = 37.74%], test : [loss = 2.399, top1 = 37.32%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.21 ms.
ImageNet16-120 train : [loss = 3.601, top1 = 16.33%], valid : [loss = 3.597, top1 = 17.40%], test : [loss = 3.636, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 46.49%], valid : [loss = 1.500, top1 = 45.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14712/15625) 014712-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.464, top1 = 89.20%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.307, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.34 ms.
cifar100       train : [loss = 0.317, top1 = 91.28%], valid : [loss = 1.357, top1 = 67.04%], test : [loss = 1.326, top1 = 66.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.29%], valid : [loss = 2.348, top1 = 40.63%], test : [loss = 2.382, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.500, top1 = 82.57%], valid : [loss = 0.590, top1 = 80.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14713/15625) 014713-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.531, top1 = 88.82%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.356, top1 = 91.99%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.84 ms.
cifar100       train : [loss = 0.242, top1 = 93.64%], valid : [loss = 1.257, top1 = 68.81%], test : [loss = 1.249, top1 = 68.97%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.45%], valid : [loss = 2.225, top1 = 43.02%], test : [loss = 2.268, top1 = 42.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 77.34%], valid : [loss = 0.718, top1 = 75.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14714/15625) 014714-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.419, top1 = 90.68%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.280, top1 = 93.45%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=21.48 ms.
cifar100       train : [loss = 0.083, top1 = 98.54%], valid : [loss = 1.257, top1 = 71.22%], test : [loss = 1.272, top1 = 71.28%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 1.566, top1 = 57.65%], valid : [loss = 2.145, top1 = 45.73%], test : [loss = 2.202, top1 = 44.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.86%], valid : [loss = 0.493, top1 = 83.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14715/15625) 014715-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.90 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.39 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.82 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14716/15625) 014716-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.545, top1 = 88.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.13 ms.
cifar10        train : [loss = 0.020, top1 = 99.45%], test  : [loss = 0.362, top1 = 91.43%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.65 ms.
cifar100       train : [loss = 0.293, top1 = 91.73%], valid : [loss = 1.368, top1 = 67.32%], test : [loss = 1.383, top1 = 67.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.98 ms.
ImageNet16-120 train : [loss = 2.438, top1 = 37.57%], valid : [loss = 2.564, top1 = 35.00%], test : [loss = 2.574, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.20%], valid : [loss = 0.939, top1 = 66.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14717/15625) 014717-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.525, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.63 ms.
cifar10        train : [loss = 0.013, top1 = 99.67%], test  : [loss = 0.356, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.02 ms.
cifar100       train : [loss = 0.305, top1 = 91.58%], valid : [loss = 1.281, top1 = 67.34%], test : [loss = 1.335, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.04 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.09%], valid : [loss = 2.414, top1 = 38.97%], test : [loss = 2.424, top1 = 39.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.30%], valid : [loss = 1.002, top1 = 64.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14718/15625) 014718-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.15 ms.
cifar10-valid  train : [loss = 0.070, top1 = 98.18%], valid : [loss = 0.440, top1 = 87.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 0.113, top1 = 96.53%], test  : [loss = 0.325, top1 = 89.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.38 ms.
cifar100       train : [loss = 0.875, top1 = 75.01%], valid : [loss = 1.313, top1 = 63.38%], test : [loss = 1.278, top1 = 63.80%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.550, top1 = 35.59%], valid : [loss = 2.609, top1 = 34.17%], test : [loss = 2.668, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.70%], valid : [loss = 0.642, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14719/15625) 014719-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.64%], valid : [loss = 0.565, top1 = 87.64%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.87 ms.
cifar10        train : [loss = 0.014, top1 = 99.58%], test  : [loss = 0.365, top1 = 91.70%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.50 ms.
cifar100       train : [loss = 0.263, top1 = 92.54%], valid : [loss = 1.375, top1 = 67.04%], test : [loss = 1.364, top1 = 66.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=24.42 ms.
ImageNet16-120 train : [loss = 2.394, top1 = 38.45%], valid : [loss = 2.523, top1 = 36.10%], test : [loss = 2.549, top1 = 34.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.953, top1 = 65.95%], valid : [loss = 0.989, top1 = 65.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14720/15625) 014720-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.92 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.471, top1 = 90.47%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.53 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.297, top1 = 93.57%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.80 ms.
cifar100       train : [loss = 0.079, top1 = 98.67%], valid : [loss = 1.312, top1 = 69.90%], test : [loss = 1.325, top1 = 69.88%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.82 ms.
ImageNet16-120 train : [loss = 1.581, top1 = 57.25%], valid : [loss = 2.125, top1 = 45.20%], test : [loss = 2.146, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.33%], valid : [loss = 0.637, top1 = 78.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14721/15625) 014721-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.03%], valid : [loss = 0.553, top1 = 87.21%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.97 ms.
cifar10        train : [loss = 0.064, top1 = 97.86%], test  : [loss = 0.360, top1 = 90.15%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.85 ms.
cifar100       train : [loss = 0.640, top1 = 81.09%], valid : [loss = 1.308, top1 = 64.92%], test : [loss = 1.313, top1 = 64.40%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=20.11 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 38.82%], valid : [loss = 2.530, top1 = 36.30%], test : [loss = 2.553, top1 = 35.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.821, top1 = 70.93%], valid : [loss = 0.852, top1 = 69.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14722/15625) 014722-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.040, top1 = 99.13%], valid : [loss = 0.555, top1 = 86.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.03 ms.
cifar10        train : [loss = 0.055, top1 = 98.43%], test  : [loss = 0.358, top1 = 89.89%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.93 ms.
cifar100       train : [loss = 0.519, top1 = 85.30%], valid : [loss = 1.308, top1 = 65.82%], test : [loss = 1.305, top1 = 66.34%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.271, top1 = 41.55%], valid : [loss = 2.455, top1 = 38.60%], test : [loss = 2.441, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.737, top1 = 73.67%], valid : [loss = 0.814, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14723/15625) 014723-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.626, top1 = 87.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.06 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.417, top1 = 90.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.199, top1 = 95.07%], valid : [loss = 1.503, top1 = 65.60%], test : [loss = 1.499, top1 = 66.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.25 ms.
ImageNet16-120 train : [loss = 2.145, top1 = 44.24%], valid : [loss = 2.481, top1 = 37.53%], test : [loss = 2.470, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.663, top1 = 76.63%], valid : [loss = 0.746, top1 = 74.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14724/15625) 014724-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.71%], valid : [loss = 0.498, top1 = 84.48%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.63 ms.
cifar10        train : [loss = 0.223, top1 = 92.45%], test  : [loss = 0.391, top1 = 87.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.25 ms.
cifar100       train : [loss = 1.331, top1 = 62.46%], valid : [loss = 1.583, top1 = 56.84%], test : [loss = 1.548, top1 = 57.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.39 ms.
ImageNet16-120 train : [loss = 2.785, top1 = 30.93%], valid : [loss = 2.795, top1 = 30.47%], test : [loss = 2.823, top1 = 30.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.057, top1 = 61.84%], valid : [loss = 1.097, top1 = 60.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14725/15625) 014725-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.28 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.56%], valid : [loss = 0.558, top1 = 87.38%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.043, top1 = 98.72%], test  : [loss = 0.394, top1 = 90.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.09 ms.
cifar100       train : [loss = 0.550, top1 = 83.84%], valid : [loss = 1.407, top1 = 64.12%], test : [loss = 1.413, top1 = 64.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.31 ms.
ImageNet16-120 train : [loss = 2.505, top1 = 36.68%], valid : [loss = 2.629, top1 = 34.00%], test : [loss = 2.666, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.54%], valid : [loss = 0.687, top1 = 76.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14726/15625) 014726-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.542, top1 = 89.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.21 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.368, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.43 ms.
cifar100       train : [loss = 0.095, top1 = 98.36%], valid : [loss = 1.464, top1 = 67.68%], test : [loss = 1.464, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.90 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.42%], valid : [loss = 2.380, top1 = 40.47%], test : [loss = 2.396, top1 = 40.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.14%], valid : [loss = 0.695, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14727/15625) 014727-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.06 ms.
cifar10-valid  train : [loss = 0.114, top1 = 96.61%], valid : [loss = 0.469, top1 = 86.00%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10        train : [loss = 0.149, top1 = 95.21%], test  : [loss = 0.327, top1 = 89.28%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.50 ms.
cifar100       train : [loss = 0.976, top1 = 72.36%], valid : [loss = 1.343, top1 = 63.12%], test : [loss = 1.321, top1 = 63.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.80 ms.
ImageNet16-120 train : [loss = 2.607, top1 = 34.37%], valid : [loss = 2.628, top1 = 33.10%], test : [loss = 2.686, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14728/15625) 014728-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.51 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.98%], valid : [loss = 0.514, top1 = 86.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.21 ms.
cifar10        train : [loss = 0.082, top1 = 97.40%], test  : [loss = 0.346, top1 = 89.79%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=8.96 ms.
cifar100       train : [loss = 0.737, top1 = 78.48%], valid : [loss = 1.319, top1 = 64.76%], test : [loss = 1.297, top1 = 64.62%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.71 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.62%], valid : [loss = 2.591, top1 = 35.00%], test : [loss = 2.652, top1 = 34.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.56%], valid : [loss = 0.672, top1 = 76.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14729/15625) 014729-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.80%], valid : [loss = 0.500, top1 = 88.50%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10        train : [loss = 0.021, top1 = 99.45%], test  : [loss = 0.340, top1 = 91.78%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.34 ms.
cifar100       train : [loss = 0.408, top1 = 88.11%], valid : [loss = 1.309, top1 = 66.32%], test : [loss = 1.310, top1 = 66.52%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.73%], valid : [loss = 2.386, top1 = 39.27%], test : [loss = 2.443, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.558, top1 = 80.54%], valid : [loss = 0.633, top1 = 78.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14730/15625) 014730-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.470, top1 = 89.51%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.310, top1 = 92.69%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.22 ms.
cifar100       train : [loss = 0.200, top1 = 95.18%], valid : [loss = 1.242, top1 = 68.52%], test : [loss = 1.259, top1 = 69.22%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.53 ms.
ImageNet16-120 train : [loss = 1.843, top1 = 51.02%], valid : [loss = 2.195, top1 = 43.77%], test : [loss = 2.226, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.80%], valid : [loss = 0.621, top1 = 78.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14731/15625) 014731-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.037, top1 = 98.98%], valid : [loss = 0.562, top1 = 86.91%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=17.00 ms.
cifar10        train : [loss = 0.065, top1 = 97.91%], test  : [loss = 0.386, top1 = 89.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.08 ms.
cifar100       train : [loss = 0.658, top1 = 80.53%], valid : [loss = 1.325, top1 = 64.50%], test : [loss = 1.317, top1 = 65.20%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.73 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.03%], valid : [loss = 2.462, top1 = 38.13%], test : [loss = 2.497, top1 = 36.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14732/15625) 014732-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.496, top1 = 90.02%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=21.63 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.332, top1 = 93.36%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.37 ms.
cifar100       train : [loss = 0.086, top1 = 98.45%], valid : [loss = 1.382, top1 = 69.38%], test : [loss = 1.347, top1 = 69.64%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.103, top1 = 45.04%], valid : [loss = 2.379, top1 = 38.27%], test : [loss = 2.401, top1 = 38.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.815, top1 = 70.70%], valid : [loss = 0.846, top1 = 69.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14733/15625) 014733-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.77 ms.
cifar10-valid  train : [loss = 0.271, top1 = 91.16%], valid : [loss = 0.466, top1 = 84.59%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.16 ms.
cifar10        train : [loss = 0.301, top1 = 89.91%], test  : [loss = 0.401, top1 = 86.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.70 ms.
cifar100       train : [loss = 1.326, top1 = 63.28%], valid : [loss = 1.523, top1 = 58.32%], test : [loss = 1.493, top1 = 58.64%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.86%], valid : [loss = 2.898, top1 = 30.87%], test : [loss = 2.941, top1 = 27.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14734/15625) 014734-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.38%], valid : [loss = 0.851, top1 = 79.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.125, top1 = 95.82%], test  : [loss = 0.537, top1 = 85.12%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.61 ms.
cifar100       train : [loss = 0.847, top1 = 75.40%], valid : [loss = 1.681, top1 = 57.41%], test : [loss = 1.681, top1 = 57.29%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.68 ms.
ImageNet16-120 train : [loss = 3.045, top1 = 26.27%], valid : [loss = 3.184, top1 = 24.37%], test : [loss = 3.219, top1 = 23.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.037, top1 = 62.71%], valid : [loss = 1.096, top1 = 60.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14735/15625) 014735-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.443, top1 = 90.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.22 ms.
cifar10        train : [loss = 0.002, top1 = 99.97%], test  : [loss = 0.305, top1 = 93.47%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.89 ms.
cifar100       train : [loss = 0.050, top1 = 99.42%], valid : [loss = 1.353, top1 = 70.30%], test : [loss = 1.323, top1 = 70.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 1.469, top1 = 60.05%], valid : [loss = 2.246, top1 = 44.07%], test : [loss = 2.258, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.18%], valid : [loss = 0.530, top1 = 82.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14736/15625) 014736-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.524, top1 = 88.37%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.12 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.337, top1 = 92.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.01 ms.
cifar100       train : [loss = 0.339, top1 = 90.67%], valid : [loss = 1.275, top1 = 66.62%], test : [loss = 1.296, top1 = 66.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.53 ms.
ImageNet16-120 train : [loss = 2.147, top1 = 44.26%], valid : [loss = 2.422, top1 = 37.50%], test : [loss = 2.442, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14737/15625) 014737-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.32%], valid : [loss = 0.529, top1 = 87.34%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.50 ms.
cifar10        train : [loss = 0.057, top1 = 98.27%], test  : [loss = 0.372, top1 = 90.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.61 ms.
cifar100       train : [loss = 0.630, top1 = 81.49%], valid : [loss = 1.329, top1 = 65.56%], test : [loss = 1.341, top1 = 64.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.50%], valid : [loss = 2.500, top1 = 36.77%], test : [loss = 2.548, top1 = 35.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.24%], valid : [loss = 0.629, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14738/15625) 014738-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.19 ms.
cifar10-valid  train : [loss = 0.100, top1 = 97.00%], valid : [loss = 0.584, top1 = 84.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.134, top1 = 95.56%], test  : [loss = 0.389, top1 = 88.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.31 ms.
cifar100       train : [loss = 0.862, top1 = 74.53%], valid : [loss = 1.416, top1 = 61.26%], test : [loss = 1.414, top1 = 61.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.08 ms.
ImageNet16-120 train : [loss = 2.585, top1 = 34.75%], valid : [loss = 2.678, top1 = 32.43%], test : [loss = 2.673, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.39%], valid : [loss = 0.933, top1 = 67.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14739/15625) 014739-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.68 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.524, top1 = 88.77%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.24 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.325, top1 = 91.97%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.98 ms.
cifar100       train : [loss = 0.294, top1 = 92.20%], valid : [loss = 1.289, top1 = 67.34%], test : [loss = 1.290, top1 = 68.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.48 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.18%], valid : [loss = 2.429, top1 = 37.87%], test : [loss = 2.376, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 74.34%], valid : [loss = 0.783, top1 = 72.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14740/15625) 014740-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.520, top1 = 89.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=19.04 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.310, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.56 ms.
cifar100       train : [loss = 0.131, top1 = 97.43%], valid : [loss = 1.267, top1 = 69.58%], test : [loss = 1.264, top1 = 70.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.59 ms.
ImageNet16-120 train : [loss = 1.813, top1 = 51.77%], valid : [loss = 2.282, top1 = 42.10%], test : [loss = 2.256, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14741/15625) 014741-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.34%], valid : [loss = 0.665, top1 = 85.18%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.35 ms.
cifar10        train : [loss = 0.051, top1 = 98.44%], test  : [loss = 0.440, top1 = 88.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.48 ms.
cifar100       train : [loss = 0.646, top1 = 80.96%], valid : [loss = 1.546, top1 = 61.60%], test : [loss = 1.518, top1 = 61.04%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=22.44 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.30%], valid : [loss = 2.822, top1 = 30.30%], test : [loss = 2.883, top1 = 30.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.97%], valid : [loss = 0.866, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14742/15625) 014742-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.532, top1 = 89.39%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.06 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.329, top1 = 93.17%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.10 ms.
cifar100       train : [loss = 0.077, top1 = 98.75%], valid : [loss = 1.365, top1 = 69.26%], test : [loss = 1.355, top1 = 69.51%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=19.87 ms.
ImageNet16-120 train : [loss = 1.775, top1 = 52.69%], valid : [loss = 2.267, top1 = 42.56%], test : [loss = 2.257, top1 = 43.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.16%], valid : [loss = 0.643, top1 = 78.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14743/15625) 014743-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.31 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.505, top1 = 89.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.325, top1 = 92.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.348, top1 = 90.29%], valid : [loss = 1.252, top1 = 68.01%], test : [loss = 1.255, top1 = 68.23%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.13 ms.
ImageNet16-120 train : [loss = 2.081, top1 = 45.70%], valid : [loss = 2.325, top1 = 41.03%], test : [loss = 2.333, top1 = 40.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.675, top1 = 76.12%], valid : [loss = 0.743, top1 = 74.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14744/15625) 014744-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.80 ms.
cifar10-valid  train : [loss = 0.625, top1 = 78.12%], valid : [loss = 0.757, top1 = 74.16%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.67 ms.
cifar10        train : [loss = 0.531, top1 = 81.35%], test  : [loss = 0.607, top1 = 79.17%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 1.977, top1 = 46.15%], valid : [loss = 2.105, top1 = 43.64%], test : [loss = 2.118, top1 = 43.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.93 ms.
ImageNet16-120 train : [loss = 3.003, top1 = 26.62%], valid : [loss = 2.993, top1 = 26.87%], test : [loss = 3.019, top1 = 26.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.205, top1 = 56.28%], valid : [loss = 1.248, top1 = 55.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14745/15625) 014745-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.617, top1 = 87.46%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.30 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.381, top1 = 91.66%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.97 ms.
cifar100       train : [loss = 0.166, top1 = 96.34%], valid : [loss = 1.522, top1 = 65.22%], test : [loss = 1.478, top1 = 66.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.76%], valid : [loss = 2.504, top1 = 38.70%], test : [loss = 2.488, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.632, top1 = 77.56%], valid : [loss = 0.720, top1 = 75.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14746/15625) 014746-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.559, top1 = 88.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=21.25 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.394, top1 = 91.59%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.64 ms.
cifar100       train : [loss = 0.150, top1 = 96.86%], valid : [loss = 1.437, top1 = 67.52%], test : [loss = 1.451, top1 = 67.56%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=21.07 ms.
ImageNet16-120 train : [loss = 1.918, top1 = 49.58%], valid : [loss = 2.433, top1 = 39.33%], test : [loss = 2.451, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.41%], valid : [loss = 0.768, top1 = 73.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14747/15625) 014747-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.62%], valid : [loss = 0.568, top1 = 87.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.374, top1 = 90.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.64 ms.
cifar100       train : [loss = 0.514, top1 = 85.21%], valid : [loss = 1.381, top1 = 64.60%], test : [loss = 1.365, top1 = 64.76%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.21 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 35.98%], valid : [loss = 2.586, top1 = 33.17%], test : [loss = 2.626, top1 = 33.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.970, top1 = 64.87%], valid : [loss = 0.982, top1 = 64.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14748/15625) 014748-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.412, top1 = 90.54%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.06 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.270, top1 = 93.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.85 ms.
cifar100       train : [loss = 0.158, top1 = 96.46%], valid : [loss = 1.255, top1 = 70.34%], test : [loss = 1.239, top1 = 70.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 1.709, top1 = 54.23%], valid : [loss = 2.187, top1 = 43.97%], test : [loss = 2.218, top1 = 44.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.374, top1 = 87.04%], valid : [loss = 0.499, top1 = 83.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14749/15625) 014749-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.65 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.511, top1 = 89.70%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.20 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.317, top1 = 92.78%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.69 ms.
cifar100       train : [loss = 0.104, top1 = 98.03%], valid : [loss = 1.290, top1 = 69.62%], test : [loss = 1.319, top1 = 70.20%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.22 ms.
ImageNet16-120 train : [loss = 1.644, top1 = 55.85%], valid : [loss = 2.188, top1 = 45.17%], test : [loss = 2.222, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.424, top1 = 85.51%], valid : [loss = 0.534, top1 = 81.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14750/15625) 014750-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=14.35 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.61%], valid : [loss = 0.451, top1 = 86.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10        train : [loss = 0.152, top1 = 95.18%], test  : [loss = 0.350, top1 = 88.80%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.85 ms.
cifar100       train : [loss = 0.979, top1 = 72.02%], valid : [loss = 1.341, top1 = 62.64%], test : [loss = 1.349, top1 = 62.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.646, top1 = 33.63%], valid : [loss = 2.706, top1 = 32.33%], test : [loss = 2.719, top1 = 32.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14751/15625) 014751-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.79 ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.72%], valid : [loss = 0.947, top1 = 67.92%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10        train : [loss = 0.836, top1 = 70.62%], test  : [loss = 0.915, top1 = 67.89%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.30 ms.
cifar100       train : [loss = 2.155, top1 = 43.69%], valid : [loss = 2.336, top1 = 40.82%], test : [loss = 2.341, top1 = 40.72%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.46 ms.
ImageNet16-120 train : [loss = 3.752, top1 = 14.08%], valid : [loss = 3.779, top1 = 14.27%], test : [loss = 3.780, top1 = 13.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.449, top1 = 47.06%], valid : [loss = 1.471, top1 = 46.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14752/15625) 014752-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.24 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.41%], valid : [loss = 0.637, top1 = 85.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10        train : [loss = 0.045, top1 = 98.66%], test  : [loss = 0.423, top1 = 89.15%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.12 ms.
cifar100       train : [loss = 0.648, top1 = 81.20%], valid : [loss = 1.453, top1 = 63.24%], test : [loss = 1.408, top1 = 62.78%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.476, top1 = 37.17%], valid : [loss = 2.637, top1 = 33.43%], test : [loss = 2.664, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.12%], valid : [loss = 0.838, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14753/15625) 014753-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.20%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.46 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.366, top1 = 92.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 0.176, top1 = 96.15%], valid : [loss = 1.398, top1 = 67.40%], test : [loss = 1.423, top1 = 67.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.09 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.77%], valid : [loss = 2.492, top1 = 38.00%], test : [loss = 2.476, top1 = 39.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.99%], valid : [loss = 0.698, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14754/15625) 014754-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.29%], valid : [loss = 0.543, top1 = 86.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10        train : [loss = 0.049, top1 = 98.62%], test  : [loss = 0.364, top1 = 90.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.86 ms.
cifar100       train : [loss = 0.522, top1 = 85.08%], valid : [loss = 1.312, top1 = 65.33%], test : [loss = 1.309, top1 = 65.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.03 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.21%], valid : [loss = 2.418, top1 = 38.73%], test : [loss = 2.445, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.34%], valid : [loss = 0.838, top1 = 70.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14755/15625) 014755-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.544, top1 = 88.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.80 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.357, top1 = 91.79%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.90 ms.
cifar100       train : [loss = 0.302, top1 = 91.75%], valid : [loss = 1.279, top1 = 67.38%], test : [loss = 1.311, top1 = 67.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.66 ms.
ImageNet16-120 train : [loss = 2.229, top1 = 42.29%], valid : [loss = 2.445, top1 = 37.43%], test : [loss = 2.484, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.906, top1 = 67.43%], valid : [loss = 0.950, top1 = 66.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14756/15625) 014756-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.52 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.544, top1 = 88.16%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.28 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.378, top1 = 91.75%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.49 ms.
cifar100       train : [loss = 0.199, top1 = 95.48%], valid : [loss = 1.417, top1 = 66.38%], test : [loss = 1.409, top1 = 67.68%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.05 ms.
ImageNet16-120 train : [loss = 2.020, top1 = 47.27%], valid : [loss = 2.410, top1 = 39.83%], test : [loss = 2.411, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.69%], valid : [loss = 0.719, top1 = 75.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14757/15625) 014757-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.583, top1 = 88.28%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.01 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.391, top1 = 92.15%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.15 ms.
cifar100       train : [loss = 0.124, top1 = 97.47%], valid : [loss = 1.514, top1 = 66.70%], test : [loss = 1.532, top1 = 66.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.29%], valid : [loss = 2.425, top1 = 39.70%], test : [loss = 2.406, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.96%], valid : [loss = 0.786, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14758/15625) 014758-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.643, top1 = 86.24%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.51 ms.
cifar10        train : [loss = 0.025, top1 = 99.39%], test  : [loss = 0.442, top1 = 89.10%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.04 ms.
cifar100       train : [loss = 0.323, top1 = 91.59%], valid : [loss = 1.442, top1 = 65.32%], test : [loss = 1.452, top1 = 65.12%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.42%], valid : [loss = 2.582, top1 = 35.73%], test : [loss = 2.595, top1 = 36.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.86%], valid : [loss = 0.842, top1 = 70.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14759/15625) 014759-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.96 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.91%], valid : [loss = 0.543, top1 = 86.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.80 ms.
cifar10        train : [loss = 0.076, top1 = 97.60%], test  : [loss = 0.359, top1 = 89.80%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.51 ms.
cifar100       train : [loss = 0.713, top1 = 79.18%], valid : [loss = 1.341, top1 = 64.10%], test : [loss = 1.336, top1 = 64.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.05%], valid : [loss = 2.663, top1 = 33.50%], test : [loss = 2.682, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 80.04%], valid : [loss = 0.668, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14760/15625) 014760-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.448, top1 = 90.43%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.309, top1 = 93.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.16 ms.
cifar100       train : [loss = 0.083, top1 = 98.46%], valid : [loss = 1.425, top1 = 69.42%], test : [loss = 1.388, top1 = 69.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 1.638, top1 = 56.14%], valid : [loss = 2.273, top1 = 43.00%], test : [loss = 2.289, top1 = 43.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.32%], valid : [loss = 0.561, top1 = 80.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14761/15625) 014761-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.535, top1 = 88.81%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.32 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.342, top1 = 92.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.143, top1 = 97.15%], valid : [loss = 1.407, top1 = 67.89%], test : [loss = 1.411, top1 = 67.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 1.888, top1 = 50.11%], valid : [loss = 2.406, top1 = 39.29%], test : [loss = 2.434, top1 = 40.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.85%], valid : [loss = 0.684, top1 = 76.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14762/15625) 014762-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.595, top1 = 87.41%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.95 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.400, top1 = 91.02%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.99 ms.
cifar100       train : [loss = 0.393, top1 = 88.89%], valid : [loss = 1.392, top1 = 65.94%], test : [loss = 1.368, top1 = 66.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.45 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.84%], valid : [loss = 2.484, top1 = 37.57%], test : [loss = 2.520, top1 = 37.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.736, top1 = 73.93%], valid : [loss = 0.814, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14763/15625) 014763-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.03 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.78 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.50 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14764/15625) 014764-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.429, top1 = 90.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.01 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.289, top1 = 93.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.76 ms.
cifar100       train : [loss = 0.187, top1 = 95.65%], valid : [loss = 1.299, top1 = 69.62%], test : [loss = 1.272, top1 = 69.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.56%], valid : [loss = 2.281, top1 = 41.87%], test : [loss = 2.279, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14765/15625) 014765-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.52 ms.
cifar10-valid  train : [loss = 0.171, top1 = 94.14%], valid : [loss = 0.739, top1 = 79.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10        train : [loss = 0.197, top1 = 93.29%], test  : [loss = 0.528, top1 = 84.07%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 0.963, top1 = 72.00%], valid : [loss = 1.688, top1 = 56.00%], test : [loss = 1.690, top1 = 56.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.22 ms.
ImageNet16-120 train : [loss = 3.403, top1 = 18.82%], valid : [loss = 3.402, top1 = 18.67%], test : [loss = 3.440, top1 = 18.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.267, top1 = 53.56%], valid : [loss = 1.294, top1 = 52.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14766/15625) 014766-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.96 ms.
cifar10-valid  train : [loss = 0.278, top1 = 90.83%], valid : [loss = 0.472, top1 = 84.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.34 ms.
cifar10        train : [loss = 0.298, top1 = 90.11%], test  : [loss = 0.408, top1 = 86.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.84 ms.
cifar100       train : [loss = 1.317, top1 = 63.34%], valid : [loss = 1.528, top1 = 57.74%], test : [loss = 1.500, top1 = 57.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.73%], valid : [loss = 2.893, top1 = 30.17%], test : [loss = 2.954, top1 = 28.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.44%], valid : [loss = 0.743, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14767/15625) 014767-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.575, top1 = 88.85%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.392, top1 = 91.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=19.02 ms.
cifar100       train : [loss = 0.078, top1 = 98.96%], valid : [loss = 1.505, top1 = 67.64%], test : [loss = 1.483, top1 = 68.46%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.28 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.33%], valid : [loss = 2.423, top1 = 40.07%], test : [loss = 2.452, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.84%], valid : [loss = 0.730, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14768/15625) 014768-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.41 ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.28%], valid : [loss = 0.855, top1 = 71.92%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.42 ms.
cifar10        train : [loss = 0.555, top1 = 80.42%], test  : [loss = 0.723, top1 = 75.58%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.85 ms.
cifar100       train : [loss = 1.767, top1 = 52.44%], valid : [loss = 2.056, top1 = 47.24%], test : [loss = 2.059, top1 = 47.20%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.46 ms.
ImageNet16-120 train : [loss = 3.591, top1 = 16.74%], valid : [loss = 3.645, top1 = 15.83%], test : [loss = 3.673, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14769/15625) 014769-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.515, top1 = 89.38%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.01 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.323, top1 = 92.84%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.53 ms.
cifar100       train : [loss = 0.137, top1 = 97.30%], valid : [loss = 1.312, top1 = 68.92%], test : [loss = 1.312, top1 = 69.02%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 52.03%], valid : [loss = 2.289, top1 = 41.07%], test : [loss = 2.263, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.26%], valid : [loss = 0.695, top1 = 75.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14770/15625) 014770-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.37 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.74 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.96 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.26 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14771/15625) 014771-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.454, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.19 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.315, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.67 ms.
cifar100       train : [loss = 0.326, top1 = 91.10%], valid : [loss = 1.297, top1 = 67.23%], test : [loss = 1.287, top1 = 67.65%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.12%], valid : [loss = 2.357, top1 = 40.43%], test : [loss = 2.397, top1 = 39.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 84.28%], valid : [loss = 0.561, top1 = 80.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14772/15625) 014772-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.80%], valid : [loss = 1.126, top1 = 62.50%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.11 ms.
cifar10        train : [loss = 0.782, top1 = 72.44%], test  : [loss = 0.918, top1 = 68.16%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.79 ms.
cifar100       train : [loss = 2.122, top1 = 44.37%], valid : [loss = 2.400, top1 = 39.66%], test : [loss = 2.375, top1 = 39.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 3.762, top1 = 13.99%], valid : [loss = 3.823, top1 = 14.03%], test : [loss = 3.832, top1 = 13.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.78%], valid : [loss = 1.412, top1 = 49.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14773/15625) 014773-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.421, top1 = 90.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.288, top1 = 93.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.02 ms.
cifar100       train : [loss = 0.117, top1 = 97.76%], valid : [loss = 1.331, top1 = 69.69%], test : [loss = 1.333, top1 = 69.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.692, top1 = 54.75%], valid : [loss = 2.227, top1 = 43.52%], test : [loss = 2.263, top1 = 43.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.432, top1 = 84.89%], valid : [loss = 0.547, top1 = 81.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14774/15625) 014774-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.36 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.15%], valid : [loss = 0.473, top1 = 85.87%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.67 ms.
cifar10        train : [loss = 0.160, top1 = 94.80%], test  : [loss = 0.349, top1 = 88.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.45 ms.
cifar100       train : [loss = 1.033, top1 = 70.65%], valid : [loss = 1.376, top1 = 61.54%], test : [loss = 1.371, top1 = 61.62%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.78 ms.
ImageNet16-120 train : [loss = 2.648, top1 = 33.72%], valid : [loss = 2.701, top1 = 33.40%], test : [loss = 2.732, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.69%], valid : [loss = 0.789, top1 = 72.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14775/15625) 014775-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.96%], valid : [loss = 0.550, top1 = 89.00%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.05 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.374, top1 = 92.65%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=21.23 ms.
cifar100       train : [loss = 0.042, top1 = 99.55%], valid : [loss = 1.451, top1 = 70.10%], test : [loss = 1.411, top1 = 70.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=22.17 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 55.74%], valid : [loss = 2.413, top1 = 41.10%], test : [loss = 2.413, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.20%], valid : [loss = 0.722, top1 = 75.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14776/15625) 014776-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.544, top1 = 88.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.86 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.359, top1 = 91.45%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.04 ms.
cifar100       train : [loss = 0.351, top1 = 90.23%], valid : [loss = 1.262, top1 = 67.06%], test : [loss = 1.288, top1 = 67.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.33 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 41.89%], valid : [loss = 2.452, top1 = 38.50%], test : [loss = 2.484, top1 = 37.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.867, top1 = 68.81%], valid : [loss = 0.914, top1 = 67.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14777/15625) 014777-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.438, top1 = 89.73%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.30 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.301, top1 = 92.67%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.197, top1 = 95.49%], valid : [loss = 1.286, top1 = 68.46%], test : [loss = 1.271, top1 = 69.30%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.28%], valid : [loss = 2.251, top1 = 43.05%], test : [loss = 2.268, top1 = 42.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.429, top1 = 85.25%], valid : [loss = 0.536, top1 = 81.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14778/15625) 014778-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.35 ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.69%], valid : [loss = 1.102, top1 = 63.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.21 ms.
cifar10        train : [loss = 0.786, top1 = 72.41%], test  : [loss = 0.910, top1 = 68.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.01 ms.
cifar100       train : [loss = 2.138, top1 = 44.26%], valid : [loss = 2.408, top1 = 39.36%], test : [loss = 2.425, top1 = 39.22%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.78 ms.
ImageNet16-120 train : [loss = 3.762, top1 = 13.86%], valid : [loss = 3.814, top1 = 13.80%], test : [loss = 3.822, top1 = 13.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.355, top1 = 50.78%], valid : [loss = 1.412, top1 = 49.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14779/15625) 014779-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.507, top1 = 89.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.93 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.316, top1 = 92.66%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.74 ms.
cifar100       train : [loss = 0.144, top1 = 96.99%], valid : [loss = 1.297, top1 = 68.78%], test : [loss = 1.281, top1 = 70.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.05 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 51.02%], valid : [loss = 2.315, top1 = 40.97%], test : [loss = 2.322, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.28%], valid : [loss = 0.695, top1 = 76.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14780/15625) 014780-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.164, top1 = 94.37%], valid : [loss = 0.707, top1 = 80.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.56 ms.
cifar10        train : [loss = 0.189, top1 = 93.54%], test  : [loss = 0.508, top1 = 84.54%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.30 ms.
cifar100       train : [loss = 0.892, top1 = 74.07%], valid : [loss = 1.650, top1 = 56.66%], test : [loss = 1.688, top1 = 56.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.18 ms.
ImageNet16-120 train : [loss = 3.483, top1 = 17.14%], valid : [loss = 3.492, top1 = 16.67%], test : [loss = 3.496, top1 = 17.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14781/15625) 014781-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.16 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.14%], valid : [loss = 0.469, top1 = 85.90%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.54 ms.
cifar10        train : [loss = 0.153, top1 = 95.06%], test  : [loss = 0.354, top1 = 88.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.35 ms.
cifar100       train : [loss = 1.002, top1 = 71.61%], valid : [loss = 1.353, top1 = 62.20%], test : [loss = 1.342, top1 = 62.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 2.651, top1 = 33.55%], valid : [loss = 2.703, top1 = 32.17%], test : [loss = 2.748, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.76%], valid : [loss = 0.787, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14782/15625) 014782-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.11%], valid : [loss = 0.583, top1 = 86.85%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.02 ms.
cifar10        train : [loss = 0.050, top1 = 98.38%], test  : [loss = 0.405, top1 = 89.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.37 ms.
cifar100       train : [loss = 0.544, top1 = 84.02%], valid : [loss = 1.340, top1 = 63.82%], test : [loss = 1.374, top1 = 63.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.401, top1 = 38.43%], valid : [loss = 2.511, top1 = 36.47%], test : [loss = 2.525, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.954, top1 = 65.76%], valid : [loss = 0.998, top1 = 64.53%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14783/15625) 014783-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.08 ms.
cifar10-valid  train : [loss = 0.693, top1 = 75.71%], valid : [loss = 0.854, top1 = 70.89%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.39 ms.
cifar10        train : [loss = 0.691, top1 = 75.81%], test  : [loss = 0.776, top1 = 73.14%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.27 ms.
cifar100       train : [loss = 1.950, top1 = 48.00%], valid : [loss = 2.122, top1 = 44.84%], test : [loss = 2.133, top1 = 45.10%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.22 ms.
ImageNet16-120 train : [loss = 3.652, top1 = 15.75%], valid : [loss = 3.675, top1 = 15.83%], test : [loss = 3.698, top1 = 14.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14784/15625) 014784-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.511, top1 = 89.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.320, top1 = 92.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.23 ms.
cifar100       train : [loss = 0.275, top1 = 92.72%], valid : [loss = 1.271, top1 = 67.98%], test : [loss = 1.255, top1 = 68.93%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.987, top1 = 47.84%], valid : [loss = 2.291, top1 = 41.56%], test : [loss = 2.294, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.18%], valid : [loss = 0.668, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14785/15625) 014785-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.58 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.77%], valid : [loss = 0.663, top1 = 85.72%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.06 ms.
cifar10        train : [loss = 0.022, top1 = 99.39%], test  : [loss = 0.422, top1 = 89.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.10 ms.
cifar100       train : [loss = 0.322, top1 = 91.24%], valid : [loss = 1.544, top1 = 63.54%], test : [loss = 1.515, top1 = 63.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.91%], valid : [loss = 2.573, top1 = 34.97%], test : [loss = 2.586, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.754, top1 = 73.06%], valid : [loss = 0.824, top1 = 71.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14786/15625) 014786-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.465, top1 = 88.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.08 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.314, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.46 ms.
cifar100       train : [loss = 0.328, top1 = 91.23%], valid : [loss = 1.342, top1 = 66.38%], test : [loss = 1.315, top1 = 67.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.92%], valid : [loss = 2.376, top1 = 39.63%], test : [loss = 2.426, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14787/15625) 014787-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.467, top1 = 89.49%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.34 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.311, top1 = 92.23%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.86 ms.
cifar100       train : [loss = 0.234, top1 = 94.20%], valid : [loss = 1.250, top1 = 69.00%], test : [loss = 1.236, top1 = 69.20%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.73%], valid : [loss = 2.220, top1 = 42.20%], test : [loss = 2.226, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.529, top1 = 81.62%], valid : [loss = 0.614, top1 = 78.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14788/15625) 014788-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.83 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.618, top1 = 87.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.409, top1 = 90.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.45 ms.
cifar100       train : [loss = 0.210, top1 = 95.14%], valid : [loss = 1.470, top1 = 66.04%], test : [loss = 1.456, top1 = 65.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.080, top1 = 45.90%], valid : [loss = 2.496, top1 = 38.33%], test : [loss = 2.533, top1 = 38.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.25%], valid : [loss = 0.727, top1 = 75.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14789/15625) 014789-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.88%], valid : [loss = 0.854, top1 = 77.84%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.97 ms.
cifar10        train : [loss = 0.228, top1 = 92.01%], test  : [loss = 0.598, top1 = 82.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.90 ms.
cifar100       train : [loss = 1.175, top1 = 66.58%], valid : [loss = 1.808, top1 = 54.14%], test : [loss = 1.802, top1 = 53.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 3.239, top1 = 22.63%], valid : [loss = 3.315, top1 = 22.57%], test : [loss = 3.381, top1 = 19.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.68%], valid : [loss = 1.091, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14790/15625) 014790-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.598, top1 = 87.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.383, top1 = 91.05%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.07 ms.
cifar100       train : [loss = 0.396, top1 = 88.78%], valid : [loss = 1.379, top1 = 65.74%], test : [loss = 1.356, top1 = 65.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.47 ms.
ImageNet16-120 train : [loss = 2.303, top1 = 40.93%], valid : [loss = 2.515, top1 = 36.93%], test : [loss = 2.530, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14791/15625) 014791-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=20.22 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.519, top1 = 89.11%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=20.34 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.352, top1 = 92.29%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=20.16 ms.
cifar100       train : [loss = 0.134, top1 = 97.38%], valid : [loss = 1.416, top1 = 67.96%], test : [loss = 1.406, top1 = 67.96%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.66%], valid : [loss = 2.362, top1 = 40.57%], test : [loss = 2.402, top1 = 40.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.21%], valid : [loss = 0.700, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14792/15625) 014792-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=18.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.406, top1 = 90.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.98 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.291, top1 = 93.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.19 ms.
cifar100       train : [loss = 0.177, top1 = 95.91%], valid : [loss = 1.260, top1 = 69.40%], test : [loss = 1.285, top1 = 69.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.75 ms.
ImageNet16-120 train : [loss = 1.818, top1 = 51.77%], valid : [loss = 2.219, top1 = 43.63%], test : [loss = 2.289, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14793/15625) 014793-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=21.42 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.36%], valid : [loss = 0.471, top1 = 85.80%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.56 ms.
cifar10        train : [loss = 0.164, top1 = 94.63%], test  : [loss = 0.344, top1 = 88.71%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=22.37 ms.
cifar100       train : [loss = 1.001, top1 = 71.56%], valid : [loss = 1.364, top1 = 61.34%], test : [loss = 1.348, top1 = 61.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=24.27 ms.
ImageNet16-120 train : [loss = 2.653, top1 = 33.39%], valid : [loss = 2.677, top1 = 33.53%], test : [loss = 2.721, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 74.90%], valid : [loss = 0.754, top1 = 73.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14794/15625) 014794-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=20.12 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.551, top1 = 88.06%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.23 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.347, top1 = 91.91%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.03 ms.
cifar100       train : [loss = 0.299, top1 = 91.57%], valid : [loss = 1.325, top1 = 68.20%], test : [loss = 1.315, top1 = 67.16%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.374, top1 = 39.12%], valid : [loss = 2.523, top1 = 36.30%], test : [loss = 2.532, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.923, top1 = 66.74%], valid : [loss = 0.951, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14795/15625) 014795-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.504, top1 = 90.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.17 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.344, top1 = 92.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.45 ms.
cifar100       train : [loss = 0.114, top1 = 97.56%], valid : [loss = 1.388, top1 = 68.74%], test : [loss = 1.376, top1 = 69.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 1.778, top1 = 52.64%], valid : [loss = 2.200, top1 = 43.50%], test : [loss = 2.242, top1 = 43.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.15%], valid : [loss = 0.724, top1 = 74.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14796/15625) 014796-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.42 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.33%], valid : [loss = 0.567, top1 = 86.96%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.98 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.358, top1 = 90.87%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.14 ms.
cifar100       train : [loss = 0.553, top1 = 83.98%], valid : [loss = 1.412, top1 = 63.30%], test : [loss = 1.400, top1 = 64.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.19 ms.
ImageNet16-120 train : [loss = 2.580, top1 = 34.38%], valid : [loss = 2.615, top1 = 33.43%], test : [loss = 2.666, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.50%], valid : [loss = 0.884, top1 = 68.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14797/15625) 014797-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.20%], valid : [loss = 0.725, top1 = 82.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.56 ms.
cifar10        train : [loss = 0.088, top1 = 97.02%], test  : [loss = 0.449, top1 = 87.90%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.52 ms.
cifar100       train : [loss = 0.780, top1 = 77.09%], valid : [loss = 1.599, top1 = 59.30%], test : [loss = 1.547, top1 = 59.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.38 ms.
ImageNet16-120 train : [loss = 2.745, top1 = 31.75%], valid : [loss = 2.858, top1 = 28.70%], test : [loss = 2.923, top1 = 28.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.54%], valid : [loss = 0.937, top1 = 66.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14798/15625) 014798-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.74%], valid : [loss = 0.867, top1 = 78.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.26 ms.
cifar10        train : [loss = 0.137, top1 = 95.43%], test  : [loss = 0.467, top1 = 86.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.56 ms.
cifar100       train : [loss = 0.982, top1 = 71.60%], valid : [loss = 1.643, top1 = 56.54%], test : [loss = 1.675, top1 = 56.02%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.873, top1 = 29.13%], valid : [loss = 2.978, top1 = 27.43%], test : [loss = 3.042, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.879, top1 = 68.77%], valid : [loss = 0.939, top1 = 66.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14799/15625) 014799-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.69 ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.10%], valid : [loss = 0.888, top1 = 70.88%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.74 ms.
cifar10        train : [loss = 0.556, top1 = 80.61%], test  : [loss = 0.706, top1 = 75.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.96 ms.
cifar100       train : [loss = 1.758, top1 = 52.66%], valid : [loss = 2.036, top1 = 46.54%], test : [loss = 2.051, top1 = 46.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.47 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.69%], valid : [loss = 3.650, top1 = 16.23%], test : [loss = 3.672, top1 = 15.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14800/15625) 014800-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.92 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.497, top1 = 89.31%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.76 ms.
cifar10        train : [loss = 0.016, top1 = 99.64%], test  : [loss = 0.298, top1 = 92.37%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.61 ms.
cifar100       train : [loss = 0.260, top1 = 93.25%], valid : [loss = 1.227, top1 = 69.08%], test : [loss = 1.214, top1 = 68.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.49 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 50.90%], valid : [loss = 2.176, top1 = 43.23%], test : [loss = 2.217, top1 = 43.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.557, top1 = 80.37%], valid : [loss = 0.649, top1 = 77.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14801/15625) 014801-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.593, top1 = 88.10%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.384, top1 = 92.37%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.21 ms.
cifar100       train : [loss = 0.087, top1 = 98.57%], valid : [loss = 1.409, top1 = 68.66%], test : [loss = 1.402, top1 = 69.10%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.861, top1 = 50.87%], valid : [loss = 2.447, top1 = 39.40%], test : [loss = 2.443, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.710, top1 = 74.81%], valid : [loss = 0.789, top1 = 72.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14802/15625) 014802-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.257, top1 = 91.07%], valid : [loss = 0.977, top1 = 72.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 0.266, top1 = 90.84%], test  : [loss = 0.603, top1 = 81.41%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.42 ms.
cifar100       train : [loss = 1.277, top1 = 63.84%], valid : [loss = 1.870, top1 = 52.42%], test : [loss = 1.850, top1 = 51.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.71 ms.
ImageNet16-120 train : [loss = 3.289, top1 = 21.46%], valid : [loss = 3.396, top1 = 20.27%], test : [loss = 3.428, top1 = 19.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.124, top1 = 59.54%], valid : [loss = 1.166, top1 = 58.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14803/15625) 014803-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.81 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.81%], valid : [loss = 0.572, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.013, top1 = 99.63%], test  : [loss = 0.356, top1 = 92.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.86 ms.
cifar100       train : [loss = 0.209, top1 = 94.63%], valid : [loss = 1.321, top1 = 68.32%], test : [loss = 1.369, top1 = 67.64%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.22 ms.
ImageNet16-120 train : [loss = 2.264, top1 = 41.53%], valid : [loss = 2.460, top1 = 36.93%], test : [loss = 2.510, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.46%], valid : [loss = 0.945, top1 = 66.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14804/15625) 014804-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.68 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.02%], valid : [loss = 0.558, top1 = 87.01%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.43 ms.
cifar10        train : [loss = 0.062, top1 = 98.03%], test  : [loss = 0.364, top1 = 89.97%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.47 ms.
cifar100       train : [loss = 0.648, top1 = 80.75%], valid : [loss = 1.303, top1 = 65.00%], test : [loss = 1.280, top1 = 65.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.379, top1 = 39.06%], valid : [loss = 2.507, top1 = 37.17%], test : [loss = 2.533, top1 = 36.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14805/15625) 014805-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.436, top1 = 91.07%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.18 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.305, top1 = 93.42%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.84 ms.
cifar100       train : [loss = 0.032, top1 = 99.70%], valid : [loss = 1.327, top1 = 71.24%], test : [loss = 1.357, top1 = 71.54%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.07 ms.
ImageNet16-120 train : [loss = 1.359, top1 = 62.77%], valid : [loss = 2.264, top1 = 44.70%], test : [loss = 2.279, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.81%], valid : [loss = 0.495, top1 = 83.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14806/15625) 014806-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.00 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.499, top1 = 90.29%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.74 ms.
cifar10        train : [loss = 0.005, top1 = 99.87%], test  : [loss = 0.323, top1 = 93.03%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=21.74 ms.
cifar100       train : [loss = 0.114, top1 = 97.57%], valid : [loss = 1.348, top1 = 68.86%], test : [loss = 1.385, top1 = 68.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 1.685, top1 = 54.82%], valid : [loss = 2.159, top1 = 43.57%], test : [loss = 2.179, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.48%], valid : [loss = 0.762, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14807/15625) 014807-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.23%], valid : [loss = 0.607, top1 = 85.46%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.99 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.399, top1 = 88.88%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.56 ms.
cifar100       train : [loss = 0.716, top1 = 79.19%], valid : [loss = 1.386, top1 = 63.28%], test : [loss = 1.383, top1 = 63.09%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.541, top1 = 35.86%], valid : [loss = 2.659, top1 = 33.40%], test : [loss = 2.697, top1 = 33.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14808/15625) 014808-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.546, top1 = 88.73%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.57 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.338, top1 = 92.26%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.96 ms.
cifar100       train : [loss = 0.277, top1 = 92.37%], valid : [loss = 1.290, top1 = 68.19%], test : [loss = 1.276, top1 = 68.32%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.76 ms.
ImageNet16-120 train : [loss = 2.008, top1 = 47.35%], valid : [loss = 2.287, top1 = 41.43%], test : [loss = 2.309, top1 = 41.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.771, top1 = 72.30%], valid : [loss = 0.820, top1 = 71.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14809/15625) 014809-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.54 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.510, top1 = 89.38%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=22.19 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.328, top1 = 92.39%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.17 ms.
cifar100       train : [loss = 0.208, top1 = 94.79%], valid : [loss = 1.294, top1 = 68.60%], test : [loss = 1.289, top1 = 68.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 1.971, top1 = 48.27%], valid : [loss = 2.288, top1 = 41.63%], test : [loss = 2.281, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.56%], valid : [loss = 0.802, top1 = 71.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14810/15625) 014810-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.21 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.472, top1 = 89.42%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.313, top1 = 92.39%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.83 ms.
cifar100       train : [loss = 0.271, top1 = 93.02%], valid : [loss = 1.216, top1 = 68.70%], test : [loss = 1.219, top1 = 69.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.03 ms.
ImageNet16-120 train : [loss = 1.890, top1 = 50.12%], valid : [loss = 2.208, top1 = 42.87%], test : [loss = 2.204, top1 = 43.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.541, top1 = 81.28%], valid : [loss = 0.628, top1 = 78.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14811/15625) 014811-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.433, top1 = 89.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.300, top1 = 92.62%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.93 ms.
cifar100       train : [loss = 0.207, top1 = 95.19%], valid : [loss = 1.283, top1 = 68.78%], test : [loss = 1.257, top1 = 69.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=18.29 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.50%], valid : [loss = 2.246, top1 = 43.17%], test : [loss = 2.329, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14812/15625) 014812-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.85%], valid : [loss = 0.594, top1 = 87.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10        train : [loss = 0.015, top1 = 99.62%], test  : [loss = 0.399, top1 = 91.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.389, top1 = 89.02%], valid : [loss = 1.414, top1 = 65.40%], test : [loss = 1.443, top1 = 64.90%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.98 ms.
ImageNet16-120 train : [loss = 2.286, top1 = 41.19%], valid : [loss = 2.515, top1 = 36.70%], test : [loss = 2.521, top1 = 36.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.65%], valid : [loss = 0.851, top1 = 70.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14813/15625) 014813-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.471, top1 = 89.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.51 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.299, top1 = 92.96%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.78 ms.
cifar100       train : [loss = 0.248, top1 = 93.58%], valid : [loss = 1.183, top1 = 69.80%], test : [loss = 1.204, top1 = 70.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 1.884, top1 = 50.01%], valid : [loss = 2.191, top1 = 43.00%], test : [loss = 2.239, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14814/15625) 014814-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.76 ms.
cifar10-valid  train : [loss = 0.044, top1 = 98.87%], valid : [loss = 0.779, top1 = 82.23%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.76 ms.
cifar10        train : [loss = 0.085, top1 = 97.27%], test  : [loss = 0.489, top1 = 86.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.27 ms.
cifar100       train : [loss = 0.798, top1 = 76.75%], valid : [loss = 1.517, top1 = 60.56%], test : [loss = 1.499, top1 = 61.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 30.58%], valid : [loss = 2.926, top1 = 28.39%], test : [loss = 2.976, top1 = 27.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14815/15625) 014815-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.610, top1 = 87.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.402, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.82 ms.
cifar100       train : [loss = 0.214, top1 = 95.15%], valid : [loss = 1.431, top1 = 65.04%], test : [loss = 1.407, top1 = 66.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.12 ms.
ImageNet16-120 train : [loss = 2.087, top1 = 45.52%], valid : [loss = 2.505, top1 = 37.57%], test : [loss = 2.498, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14816/15625) 014816-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=14.02 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.502, top1 = 88.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.329, top1 = 92.03%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.34 ms.
cifar100       train : [loss = 0.352, top1 = 90.41%], valid : [loss = 1.278, top1 = 67.38%], test : [loss = 1.296, top1 = 66.86%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.131, top1 = 44.47%], valid : [loss = 2.411, top1 = 38.73%], test : [loss = 2.423, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14817/15625) 014817-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.571, top1 = 88.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.33 ms.
cifar10        train : [loss = 0.009, top1 = 99.80%], test  : [loss = 0.371, top1 = 91.84%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.88 ms.
cifar100       train : [loss = 0.183, top1 = 95.77%], valid : [loss = 1.445, top1 = 66.42%], test : [loss = 1.433, top1 = 67.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.65 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.57%], valid : [loss = 2.469, top1 = 38.53%], test : [loss = 2.487, top1 = 37.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.00%], valid : [loss = 0.708, top1 = 75.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14818/15625) 014818-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.217, top1 = 92.72%], valid : [loss = 0.542, top1 = 83.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.183, top1 = 93.86%], test  : [loss = 0.409, top1 = 87.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.16 ms.
cifar100       train : [loss = 1.249, top1 = 64.44%], valid : [loss = 1.538, top1 = 57.70%], test : [loss = 1.540, top1 = 57.26%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.684, top1 = 32.86%], valid : [loss = 2.737, top1 = 32.37%], test : [loss = 2.754, top1 = 31.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.12%], valid : [loss = 0.998, top1 = 64.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14819/15625) 014819-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.72 ms.
cifar10-valid  train : [loss = 0.123, top1 = 96.14%], valid : [loss = 0.573, top1 = 84.02%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.12 ms.
cifar10        train : [loss = 0.176, top1 = 94.09%], test  : [loss = 0.401, top1 = 87.50%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.44 ms.
cifar100       train : [loss = 0.988, top1 = 71.39%], valid : [loss = 1.435, top1 = 61.02%], test : [loss = 1.433, top1 = 60.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.11 ms.
ImageNet16-120 train : [loss = 2.714, top1 = 32.17%], valid : [loss = 2.750, top1 = 31.97%], test : [loss = 2.817, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.924, top1 = 66.76%], valid : [loss = 0.967, top1 = 65.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14820/15625) 014820-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.580, top1 = 87.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.84 ms.
cifar10        train : [loss = 0.025, top1 = 99.39%], test  : [loss = 0.407, top1 = 89.88%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.97 ms.
cifar100       train : [loss = 0.325, top1 = 91.49%], valid : [loss = 1.398, top1 = 65.62%], test : [loss = 1.420, top1 = 65.78%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.195, top1 = 43.28%], valid : [loss = 2.519, top1 = 36.83%], test : [loss = 2.548, top1 = 37.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.656, top1 = 76.60%], valid : [loss = 0.726, top1 = 74.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14821/15625) 014821-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.46%], valid : [loss = 0.572, top1 = 84.92%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.91 ms.
cifar10        train : [loss = 0.104, top1 = 96.69%], test  : [loss = 0.368, top1 = 88.86%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.31 ms.
cifar100       train : [loss = 0.768, top1 = 77.47%], valid : [loss = 1.396, top1 = 62.49%], test : [loss = 1.391, top1 = 62.66%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.502, top1 = 36.53%], valid : [loss = 2.584, top1 = 34.37%], test : [loss = 2.626, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 69.92%], valid : [loss = 0.895, top1 = 68.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14822/15625) 014822-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.84%], valid : [loss = 0.550, top1 = 88.47%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.16 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.353, top1 = 91.80%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=22.26 ms.
cifar100       train : [loss = 0.219, top1 = 94.41%], valid : [loss = 1.292, top1 = 67.95%], test : [loss = 1.315, top1 = 67.96%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.22 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.19%], valid : [loss = 2.291, top1 = 42.01%], test : [loss = 2.281, top1 = 41.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.792, top1 = 71.79%], valid : [loss = 0.844, top1 = 70.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14823/15625) 014823-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.82 ms.
cifar10-valid  train : [loss = 1.276, top1 = 54.25%], valid : [loss = 1.316, top1 = 52.98%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.50 ms.
cifar10        train : [loss = 1.223, top1 = 56.27%], test  : [loss = 1.227, top1 = 55.82%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.08 ms.
cifar100       train : [loss = 2.811, top1 = 29.94%], valid : [loss = 2.893, top1 = 28.86%], test : [loss = 2.887, top1 = 28.69%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.23 ms.
ImageNet16-120 train : [loss = 3.916, top1 = 11.64%], valid : [loss = 3.913, top1 = 12.54%], test : [loss = 3.935, top1 = 11.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.780, top1 = 33.07%], valid : [loss = 1.773, top1 = 32.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14824/15625) 014824-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.613, top1 = 87.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.43 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.417, top1 = 90.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.219, top1 = 94.79%], valid : [loss = 1.466, top1 = 65.89%], test : [loss = 1.442, top1 = 65.93%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.064, top1 = 46.19%], valid : [loss = 2.494, top1 = 37.42%], test : [loss = 2.497, top1 = 38.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14825/15625) 014825-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.74%], valid : [loss = 0.600, top1 = 87.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.80 ms.
cifar10        train : [loss = 0.020, top1 = 99.41%], test  : [loss = 0.396, top1 = 90.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.11 ms.
cifar100       train : [loss = 0.367, top1 = 89.74%], valid : [loss = 1.452, top1 = 64.01%], test : [loss = 1.434, top1 = 64.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.988, top1 = 25.75%], valid : [loss = 3.039, top1 = 25.24%], test : [loss = 3.052, top1 = 24.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14826/15625) 014826-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.575, top1 = 87.75%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.397, top1 = 91.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.93 ms.
cifar100       train : [loss = 0.226, top1 = 94.32%], valid : [loss = 1.475, top1 = 65.87%], test : [loss = 1.448, top1 = 66.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.19 ms.
ImageNet16-120 train : [loss = 2.121, top1 = 44.88%], valid : [loss = 2.438, top1 = 38.27%], test : [loss = 2.465, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.25%], valid : [loss = 0.765, top1 = 73.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14827/15625) 014827-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.46 ms.
cifar10-valid  train : [loss = 0.678, top1 = 75.88%], valid : [loss = 0.788, top1 = 72.66%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.32 ms.
cifar10        train : [loss = 0.617, top1 = 78.34%], test  : [loss = 0.679, top1 = 76.40%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.32 ms.
cifar100       train : [loss = 2.043, top1 = 45.13%], valid : [loss = 2.198, top1 = 41.95%], test : [loss = 2.188, top1 = 41.96%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.45 ms.
ImageNet16-120 train : [loss = 3.245, top1 = 22.12%], valid : [loss = 3.252, top1 = 22.38%], test : [loss = 3.270, top1 = 22.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.285, top1 = 53.21%], valid : [loss = 1.341, top1 = 51.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14828/15625) 014828-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.36%], valid : [loss = 0.594, top1 = 85.83%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.86 ms.
cifar10        train : [loss = 0.072, top1 = 97.80%], test  : [loss = 0.392, top1 = 88.86%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.68 ms.
cifar100       train : [loss = 0.699, top1 = 79.78%], valid : [loss = 1.356, top1 = 63.89%], test : [loss = 1.361, top1 = 63.79%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.81 ms.
ImageNet16-120 train : [loss = 2.529, top1 = 36.14%], valid : [loss = 2.642, top1 = 34.39%], test : [loss = 2.686, top1 = 33.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.79%], valid : [loss = 0.769, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14829/15625) 014829-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.13%], valid : [loss = 0.454, top1 = 86.08%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.81 ms.
cifar10        train : [loss = 0.159, top1 = 94.78%], test  : [loss = 0.330, top1 = 89.22%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.84 ms.
cifar100       train : [loss = 0.904, top1 = 74.09%], valid : [loss = 1.277, top1 = 64.34%], test : [loss = 1.249, top1 = 64.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.81 ms.
ImageNet16-120 train : [loss = 2.591, top1 = 34.83%], valid : [loss = 2.637, top1 = 33.97%], test : [loss = 2.661, top1 = 33.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 64.39%], valid : [loss = 1.029, top1 = 63.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14830/15625) 014830-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.08 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.536, top1 = 88.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.67 ms.
cifar10        train : [loss = 0.008, top1 = 99.85%], test  : [loss = 0.339, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.46 ms.
cifar100       train : [loss = 0.164, top1 = 96.16%], valid : [loss = 1.323, top1 = 68.45%], test : [loss = 1.362, top1 = 68.20%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.49%], valid : [loss = 2.316, top1 = 41.04%], test : [loss = 2.298, top1 = 41.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.72%], valid : [loss = 0.616, top1 = 78.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14831/15625) 014831-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.51 ms.
cifar10-valid  train : [loss = 0.037, top1 = 99.22%], valid : [loss = 0.543, top1 = 86.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.47 ms.
cifar10        train : [loss = 0.051, top1 = 98.58%], test  : [loss = 0.367, top1 = 90.12%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.94 ms.
cifar100       train : [loss = 0.518, top1 = 85.29%], valid : [loss = 1.304, top1 = 66.27%], test : [loss = 1.308, top1 = 66.03%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.261, top1 = 41.80%], valid : [loss = 2.434, top1 = 38.30%], test : [loss = 2.448, top1 = 38.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.25%], valid : [loss = 0.844, top1 = 70.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14832/15625) 014832-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.53%], valid : [loss = 0.644, top1 = 85.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.034, top1 = 99.02%], test  : [loss = 0.411, top1 = 90.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.33 ms.
cifar100       train : [loss = 0.528, top1 = 84.68%], valid : [loss = 1.423, top1 = 63.59%], test : [loss = 1.444, top1 = 63.37%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.30 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.51%], valid : [loss = 2.556, top1 = 35.43%], test : [loss = 2.560, top1 = 36.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.851, top1 = 69.14%], valid : [loss = 0.889, top1 = 68.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14833/15625) 014833-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.85 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.24%], valid : [loss = 0.609, top1 = 85.41%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.19 ms.
cifar10        train : [loss = 0.071, top1 = 97.86%], test  : [loss = 0.400, top1 = 88.65%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.94 ms.
cifar100       train : [loss = 0.711, top1 = 79.37%], valid : [loss = 1.399, top1 = 62.97%], test : [loss = 1.385, top1 = 63.12%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.85 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.88%], valid : [loss = 2.652, top1 = 33.80%], test : [loss = 2.697, top1 = 33.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14834/15625) 014834-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.66 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.28%], valid : [loss = 0.577, top1 = 85.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.82 ms.
cifar10        train : [loss = 0.109, top1 = 96.36%], test  : [loss = 0.405, top1 = 88.23%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.94 ms.
cifar100       train : [loss = 0.822, top1 = 75.91%], valid : [loss = 1.419, top1 = 62.07%], test : [loss = 1.404, top1 = 62.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 2.672, top1 = 33.04%], valid : [loss = 2.763, top1 = 31.41%], test : [loss = 2.810, top1 = 31.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14835/15625) 014835-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.582, top1 = 87.92%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10        train : [loss = 0.006, top1 = 99.86%], test  : [loss = 0.398, top1 = 91.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.19 ms.
cifar100       train : [loss = 0.112, top1 = 97.72%], valid : [loss = 1.555, top1 = 66.71%], test : [loss = 1.525, top1 = 66.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 1.930, top1 = 49.32%], valid : [loss = 2.395, top1 = 39.51%], test : [loss = 2.432, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 75.94%], valid : [loss = 0.759, top1 = 73.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14836/15625) 014836-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10-valid  train : [loss = 0.306, top1 = 89.44%], valid : [loss = 0.567, top1 = 82.06%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.267, top1 = 90.86%], test  : [loss = 0.438, top1 = 86.06%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.68 ms.
cifar100       train : [loss = 1.393, top1 = 60.87%], valid : [loss = 1.704, top1 = 54.25%], test : [loss = 1.696, top1 = 54.35%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.39 ms.
ImageNet16-120 train : [loss = 2.999, top1 = 27.00%], valid : [loss = 3.022, top1 = 26.87%], test : [loss = 3.078, top1 = 26.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 56.98%], valid : [loss = 1.238, top1 = 55.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14837/15625) 014837-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.02 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.74%], valid : [loss = 0.919, top1 = 76.49%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.35 ms.
cifar10        train : [loss = 0.225, top1 = 92.20%], test  : [loss = 0.586, top1 = 82.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 1.142, top1 = 67.58%], valid : [loss = 1.770, top1 = 54.47%], test : [loss = 1.764, top1 = 54.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 3.222, top1 = 22.91%], valid : [loss = 3.333, top1 = 21.43%], test : [loss = 3.349, top1 = 20.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.018, top1 = 63.68%], valid : [loss = 1.080, top1 = 61.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14838/15625) 014838-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.13 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.542, top1 = 88.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.22 ms.
cifar10        train : [loss = 0.025, top1 = 99.26%], test  : [loss = 0.348, top1 = 91.36%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.69 ms.
cifar100       train : [loss = 0.420, top1 = 87.88%], valid : [loss = 1.285, top1 = 66.02%], test : [loss = 1.291, top1 = 66.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.51 ms.
ImageNet16-120 train : [loss = 2.231, top1 = 42.37%], valid : [loss = 2.417, top1 = 38.99%], test : [loss = 2.434, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14839/15625) 014839-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.507, top1 = 88.73%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.85 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.337, top1 = 92.02%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.66 ms.
cifar100       train : [loss = 0.337, top1 = 90.85%], valid : [loss = 1.298, top1 = 66.57%], test : [loss = 1.285, top1 = 67.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.54 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.62%], valid : [loss = 2.401, top1 = 38.97%], test : [loss = 2.437, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14840/15625) 014840-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.494, top1 = 90.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.31 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.308, top1 = 93.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.84 ms.
cifar100       train : [loss = 0.123, top1 = 97.52%], valid : [loss = 1.324, top1 = 68.95%], test : [loss = 1.315, top1 = 69.51%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 1.703, top1 = 54.38%], valid : [loss = 2.184, top1 = 44.10%], test : [loss = 2.173, top1 = 45.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.540, top1 = 81.24%], valid : [loss = 0.633, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14841/15625) 014841-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.67%], valid : [loss = 0.624, top1 = 86.64%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.31 ms.
cifar10        train : [loss = 0.021, top1 = 99.40%], test  : [loss = 0.396, top1 = 91.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.38 ms.
cifar100       train : [loss = 0.387, top1 = 89.05%], valid : [loss = 1.464, top1 = 63.61%], test : [loss = 1.455, top1 = 63.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 2.846, top1 = 28.61%], valid : [loss = 2.903, top1 = 27.71%], test : [loss = 2.926, top1 = 27.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.217, top1 = 55.04%], valid : [loss = 1.219, top1 = 55.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14842/15625) 014842-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.510, top1 = 89.77%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.317, top1 = 93.35%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.92 ms.
cifar100       train : [loss = 0.070, top1 = 98.94%], valid : [loss = 1.358, top1 = 69.22%], test : [loss = 1.361, top1 = 69.37%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.58%], valid : [loss = 2.364, top1 = 39.74%], test : [loss = 2.387, top1 = 39.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.88%], valid : [loss = 0.814, top1 = 71.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14843/15625) 014843-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.41%], valid : [loss = 0.462, top1 = 85.97%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10        train : [loss = 0.164, top1 = 94.66%], test  : [loss = 0.351, top1 = 88.62%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.48 ms.
cifar100       train : [loss = 1.011, top1 = 71.35%], valid : [loss = 1.364, top1 = 61.79%], test : [loss = 1.361, top1 = 61.83%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 2.658, top1 = 33.37%], valid : [loss = 2.697, top1 = 32.80%], test : [loss = 2.725, top1 = 31.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14844/15625) 014844-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.458, top1 = 89.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.307, top1 = 92.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.48 ms.
cifar100       train : [loss = 0.139, top1 = 97.09%], valid : [loss = 1.319, top1 = 69.28%], test : [loss = 1.299, top1 = 69.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.57 ms.
ImageNet16-120 train : [loss = 1.755, top1 = 53.15%], valid : [loss = 2.218, top1 = 43.23%], test : [loss = 2.247, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.10%], valid : [loss = 0.536, top1 = 82.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14845/15625) 014845-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.86%], valid : [loss = 0.571, top1 = 87.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.18 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.387, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.45 ms.
cifar100       train : [loss = 0.413, top1 = 88.30%], valid : [loss = 1.402, top1 = 65.04%], test : [loss = 1.407, top1 = 65.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 2.298, top1 = 41.06%], valid : [loss = 2.509, top1 = 36.71%], test : [loss = 2.522, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14846/15625) 014846-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.500, top1 = 89.13%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.14 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.332, top1 = 92.07%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.25 ms.
cifar100       train : [loss = 0.250, top1 = 93.73%], valid : [loss = 1.248, top1 = 68.69%], test : [loss = 1.246, top1 = 68.57%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.31 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.47%], valid : [loss = 2.253, top1 = 42.02%], test : [loss = 2.282, top1 = 43.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.44%], valid : [loss = 0.689, top1 = 76.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14847/15625) 014847-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.59 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.03%], valid : [loss = 0.560, top1 = 86.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.95 ms.
cifar10        train : [loss = 0.063, top1 = 97.95%], test  : [loss = 0.375, top1 = 89.55%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.43 ms.
cifar100       train : [loss = 0.658, top1 = 80.56%], valid : [loss = 1.328, top1 = 64.26%], test : [loss = 1.328, top1 = 64.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.19%], valid : [loss = 2.530, top1 = 36.31%], test : [loss = 2.541, top1 = 35.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.71%], valid : [loss = 0.823, top1 = 71.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14848/15625) 014848-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.03%], valid : [loss = 0.475, top1 = 84.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.69 ms.
cifar10        train : [loss = 0.301, top1 = 89.94%], test  : [loss = 0.400, top1 = 86.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.82 ms.
cifar100       train : [loss = 1.330, top1 = 63.23%], valid : [loss = 1.537, top1 = 58.19%], test : [loss = 1.512, top1 = 58.38%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.65%], valid : [loss = 2.904, top1 = 29.48%], test : [loss = 2.963, top1 = 28.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14849/15625) 014849-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.84%], valid : [loss = 0.627, top1 = 86.19%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.73 ms.
cifar10        train : [loss = 0.027, top1 = 99.36%], test  : [loss = 0.431, top1 = 89.53%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.68 ms.
cifar100       train : [loss = 0.381, top1 = 89.86%], valid : [loss = 1.442, top1 = 64.49%], test : [loss = 1.418, top1 = 65.22%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.67%], valid : [loss = 2.632, top1 = 33.92%], test : [loss = 2.662, top1 = 34.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.694, top1 = 75.27%], valid : [loss = 0.765, top1 = 73.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14850/15625) 014850-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.539, top1 = 88.95%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.40 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.345, top1 = 92.53%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.77 ms.
cifar100       train : [loss = 0.084, top1 = 98.37%], valid : [loss = 1.390, top1 = 68.93%], test : [loss = 1.390, top1 = 69.51%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 2.208, top1 = 42.66%], valid : [loss = 2.433, top1 = 38.67%], test : [loss = 2.457, top1 = 38.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.94%], valid : [loss = 0.943, top1 = 66.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14851/15625) 014851-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.468, top1 = 89.18%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.314, top1 = 92.28%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.06 ms.
cifar100       train : [loss = 0.286, top1 = 92.28%], valid : [loss = 1.325, top1 = 67.44%], test : [loss = 1.326, top1 = 67.39%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.006, top1 = 47.37%], valid : [loss = 2.338, top1 = 41.14%], test : [loss = 2.357, top1 = 40.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.39%], valid : [loss = 0.609, top1 = 79.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14852/15625) 014852-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.20 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.01%], valid : [loss = 0.474, top1 = 84.45%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.60 ms.
cifar10        train : [loss = 0.299, top1 = 90.06%], test  : [loss = 0.401, top1 = 86.62%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.36 ms.
cifar100       train : [loss = 1.325, top1 = 63.23%], valid : [loss = 1.528, top1 = 57.94%], test : [loss = 1.510, top1 = 57.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.52 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.69%], valid : [loss = 2.902, top1 = 29.98%], test : [loss = 2.950, top1 = 28.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14853/15625) 014853-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.37%], valid : [loss = 0.698, top1 = 84.52%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.056, top1 = 98.27%], test  : [loss = 0.448, top1 = 88.53%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.30 ms.
cifar100       train : [loss = 0.633, top1 = 81.48%], valid : [loss = 1.520, top1 = 61.89%], test : [loss = 1.493, top1 = 62.39%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.03 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.30%], valid : [loss = 2.828, top1 = 30.72%], test : [loss = 2.855, top1 = 30.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.71%], valid : [loss = 0.887, top1 = 68.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14854/15625) 014854-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.572, top1 = 88.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.382, top1 = 91.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.09 ms.
cifar100       train : [loss = 0.199, top1 = 95.41%], valid : [loss = 1.461, top1 = 65.80%], test : [loss = 1.456, top1 = 66.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.027, top1 = 46.92%], valid : [loss = 2.436, top1 = 39.22%], test : [loss = 2.487, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.606, top1 = 78.56%], valid : [loss = 0.700, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14855/15625) 014855-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.24%], valid : [loss = 0.610, top1 = 85.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.01 ms.
cifar10        train : [loss = 0.066, top1 = 98.03%], test  : [loss = 0.406, top1 = 88.88%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.26 ms.
cifar100       train : [loss = 0.716, top1 = 79.12%], valid : [loss = 1.396, top1 = 63.01%], test : [loss = 1.365, top1 = 63.18%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.93 ms.
ImageNet16-120 train : [loss = 2.533, top1 = 36.03%], valid : [loss = 2.667, top1 = 33.52%], test : [loss = 2.682, top1 = 32.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.77%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14856/15625) 014856-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.483, top1 = 89.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.73 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.30%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.58 ms.
cifar100       train : [loss = 0.319, top1 = 91.47%], valid : [loss = 1.254, top1 = 67.58%], test : [loss = 1.260, top1 = 67.73%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.66 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.78%], valid : [loss = 2.316, top1 = 40.50%], test : [loss = 2.336, top1 = 40.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14857/15625) 014857-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.86 ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.97%], valid : [loss = 0.881, top1 = 69.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10        train : [loss = 0.712, top1 = 74.95%], test  : [loss = 0.759, top1 = 73.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.64 ms.
cifar100       train : [loss = 2.242, top1 = 40.94%], valid : [loss = 2.334, top1 = 39.36%], test : [loss = 2.341, top1 = 39.15%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.17 ms.
ImageNet16-120 train : [loss = 3.508, top1 = 17.65%], valid : [loss = 3.495, top1 = 18.31%], test : [loss = 3.511, top1 = 17.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.365, top1 = 50.30%], valid : [loss = 1.411, top1 = 48.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14858/15625) 014858-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.561, top1 = 88.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.84 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.379, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.24 ms.
cifar100       train : [loss = 0.160, top1 = 96.66%], valid : [loss = 1.421, top1 = 67.45%], test : [loss = 1.406, top1 = 67.85%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.64%], valid : [loss = 2.434, top1 = 39.80%], test : [loss = 2.448, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.54%], valid : [loss = 0.672, top1 = 76.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14859/15625) 014859-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.505, top1 = 89.90%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=19.88 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.304, top1 = 93.41%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.25 ms.
cifar100       train : [loss = 0.042, top1 = 99.57%], valid : [loss = 1.327, top1 = 70.36%], test : [loss = 1.324, top1 = 70.72%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.28%], valid : [loss = 2.289, top1 = 41.26%], test : [loss = 2.308, top1 = 41.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.633, top1 = 77.74%], valid : [loss = 0.703, top1 = 75.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14860/15625) 014860-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.510, top1 = 88.78%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.323, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.57 ms.
cifar100       train : [loss = 0.327, top1 = 91.10%], valid : [loss = 1.269, top1 = 67.16%], test : [loss = 1.285, top1 = 67.33%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 2.101, top1 = 45.16%], valid : [loss = 2.388, top1 = 39.58%], test : [loss = 2.402, top1 = 39.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14861/15625) 014861-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.440, top1 = 90.94%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.284, top1 = 93.73%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.00 ms.
cifar100       train : [loss = 0.046, top1 = 99.46%], valid : [loss = 1.320, top1 = 71.27%], test : [loss = 1.309, top1 = 71.24%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 1.414, top1 = 61.38%], valid : [loss = 2.200, top1 = 45.22%], test : [loss = 2.229, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.342, top1 = 88.49%], valid : [loss = 0.479, top1 = 84.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14862/15625) 014862-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.08%], valid : [loss = 0.551, top1 = 87.35%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.22 ms.
cifar10        train : [loss = 0.056, top1 = 98.15%], test  : [loss = 0.374, top1 = 90.11%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.39 ms.
cifar100       train : [loss = 0.511, top1 = 85.15%], valid : [loss = 1.280, top1 = 66.28%], test : [loss = 1.281, top1 = 66.41%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.201, top1 = 42.95%], valid : [loss = 2.380, top1 = 38.77%], test : [loss = 2.395, top1 = 39.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.72%], valid : [loss = 0.815, top1 = 71.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14863/15625) 014863-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.265, top1 = 91.19%], valid : [loss = 0.477, top1 = 84.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10        train : [loss = 0.295, top1 = 90.21%], test  : [loss = 0.397, top1 = 86.66%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.39 ms.
cifar100       train : [loss = 1.320, top1 = 63.39%], valid : [loss = 1.530, top1 = 57.71%], test : [loss = 1.503, top1 = 58.26%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.20 ms.
ImageNet16-120 train : [loss = 2.913, top1 = 28.81%], valid : [loss = 2.891, top1 = 29.47%], test : [loss = 2.952, top1 = 27.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14864/15625) 014864-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.608, top1 = 87.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.92 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.419, top1 = 91.13%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 0.175, top1 = 96.11%], valid : [loss = 1.517, top1 = 65.77%], test : [loss = 1.484, top1 = 66.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 2.050, top1 = 46.53%], valid : [loss = 2.462, top1 = 38.48%], test : [loss = 2.500, top1 = 38.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.28%], valid : [loss = 0.803, top1 = 72.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14865/15625) 014865-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.479, top1 = 89.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.320, top1 = 92.28%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.61 ms.
cifar100       train : [loss = 0.316, top1 = 91.53%], valid : [loss = 1.240, top1 = 67.72%], test : [loss = 1.247, top1 = 68.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.76%], valid : [loss = 2.320, top1 = 40.31%], test : [loss = 2.324, top1 = 41.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14866/15625) 014866-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.33 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.416, top1 = 90.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.73 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.263, top1 = 93.87%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.80 ms.
cifar100       train : [loss = 0.055, top1 = 99.31%], valid : [loss = 1.290, top1 = 71.38%], test : [loss = 1.258, top1 = 71.11%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.38 ms.
ImageNet16-120 train : [loss = 1.426, top1 = 61.11%], valid : [loss = 2.162, top1 = 45.91%], test : [loss = 2.187, top1 = 45.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.370, top1 = 87.38%], valid : [loss = 0.501, top1 = 83.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14867/15625) 014867-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.19%], valid : [loss = 0.601, top1 = 85.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.14 ms.
cifar10        train : [loss = 0.072, top1 = 97.80%], test  : [loss = 0.399, top1 = 89.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.24 ms.
cifar100       train : [loss = 0.710, top1 = 79.43%], valid : [loss = 1.374, top1 = 63.47%], test : [loss = 1.365, top1 = 63.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 2.527, top1 = 36.15%], valid : [loss = 2.650, top1 = 34.30%], test : [loss = 2.690, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14868/15625) 014868-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.25%], valid : [loss = 0.619, top1 = 85.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10        train : [loss = 0.074, top1 = 97.72%], test  : [loss = 0.393, top1 = 89.03%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.75 ms.
cifar100       train : [loss = 0.703, top1 = 79.50%], valid : [loss = 1.382, top1 = 63.15%], test : [loss = 1.380, top1 = 63.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 2.532, top1 = 36.04%], valid : [loss = 2.659, top1 = 34.08%], test : [loss = 2.677, top1 = 33.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14869/15625) 014869-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.580, top1 = 88.33%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.397, top1 = 91.72%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.32 ms.
cifar100       train : [loss = 0.109, top1 = 97.98%], valid : [loss = 1.554, top1 = 66.28%], test : [loss = 1.566, top1 = 66.09%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=17.71 ms.
ImageNet16-120 train : [loss = 1.868, top1 = 50.52%], valid : [loss = 2.414, top1 = 39.24%], test : [loss = 2.406, top1 = 40.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.669, top1 = 76.22%], valid : [loss = 0.744, top1 = 74.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14870/15625) 014870-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.88 ms.
cifar10-valid  train : [loss = 0.161, top1 = 94.75%], valid : [loss = 0.445, top1 = 86.32%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.19 ms.
cifar10        train : [loss = 0.146, top1 = 95.28%], test  : [loss = 0.316, top1 = 89.75%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.56 ms.
cifar100       train : [loss = 0.916, top1 = 73.96%], valid : [loss = 1.282, top1 = 63.79%], test : [loss = 1.255, top1 = 64.53%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.693, top1 = 32.93%], valid : [loss = 2.696, top1 = 32.58%], test : [loss = 2.732, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.971, top1 = 65.23%], valid : [loss = 0.995, top1 = 64.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14871/15625) 014871-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.82%], valid : [loss = 0.589, top1 = 86.81%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=14.66 ms.
cifar10        train : [loss = 0.031, top1 = 99.21%], test  : [loss = 0.403, top1 = 89.76%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.52 ms.
cifar100       train : [loss = 0.366, top1 = 90.21%], valid : [loss = 1.401, top1 = 65.11%], test : [loss = 1.390, top1 = 65.25%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.206, top1 = 43.00%], valid : [loss = 2.512, top1 = 36.41%], test : [loss = 2.542, top1 = 37.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.10%], valid : [loss = 0.730, top1 = 74.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14872/15625) 014872-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.58 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.494, top1 = 90.05%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.29 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.312, top1 = 93.24%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.25 ms.
cifar100       train : [loss = 0.055, top1 = 99.22%], valid : [loss = 1.324, top1 = 70.45%], test : [loss = 1.327, top1 = 70.57%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.25 ms.
ImageNet16-120 train : [loss = 1.509, top1 = 59.15%], valid : [loss = 2.158, top1 = 45.34%], test : [loss = 2.177, top1 = 45.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.448, top1 = 84.67%], valid : [loss = 0.563, top1 = 81.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14873/15625) 014873-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.570, top1 = 88.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.372, top1 = 92.03%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.166, top1 = 96.44%], valid : [loss = 1.404, top1 = 67.43%], test : [loss = 1.426, top1 = 67.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 1.975, top1 = 48.15%], valid : [loss = 2.452, top1 = 39.18%], test : [loss = 2.477, top1 = 39.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14874/15625) 014874-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.37%], valid : [loss = 0.607, top1 = 80.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10        train : [loss = 0.308, top1 = 89.45%], test  : [loss = 0.442, top1 = 85.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.83 ms.
cifar100       train : [loss = 1.581, top1 = 55.99%], valid : [loss = 1.810, top1 = 51.19%], test : [loss = 1.809, top1 = 51.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.67 ms.
ImageNet16-120 train : [loss = 2.962, top1 = 27.35%], valid : [loss = 2.978, top1 = 27.28%], test : [loss = 3.023, top1 = 26.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.012, top1 = 63.28%], valid : [loss = 1.051, top1 = 62.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14875/15625) 014875-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.152, top1 = 95.04%], valid : [loss = 0.512, top1 = 84.95%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.165, top1 = 94.50%], test  : [loss = 0.380, top1 = 88.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.54 ms.
cifar100       train : [loss = 1.084, top1 = 68.92%], valid : [loss = 1.460, top1 = 60.16%], test : [loss = 1.441, top1 = 59.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.87 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.96%], valid : [loss = 2.681, top1 = 33.07%], test : [loss = 2.710, top1 = 32.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.59%], valid : [loss = 0.970, top1 = 65.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14876/15625) 014876-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.320, top1 = 89.03%], valid : [loss = 0.569, top1 = 81.70%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.08 ms.
cifar10        train : [loss = 0.301, top1 = 89.67%], test  : [loss = 0.444, top1 = 85.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 1.481, top1 = 58.43%], valid : [loss = 1.702, top1 = 53.85%], test : [loss = 1.703, top1 = 53.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.81 ms.
ImageNet16-120 train : [loss = 3.017, top1 = 26.48%], valid : [loss = 3.022, top1 = 26.53%], test : [loss = 3.062, top1 = 26.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.999, top1 = 63.74%], valid : [loss = 1.050, top1 = 62.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14877/15625) 014877-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.47 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.484, top1 = 89.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.80 ms.
cifar10        train : [loss = 0.010, top1 = 99.86%], test  : [loss = 0.306, top1 = 92.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.71 ms.
cifar100       train : [loss = 0.226, top1 = 94.56%], valid : [loss = 1.255, top1 = 68.22%], test : [loss = 1.239, top1 = 69.15%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.76 ms.
ImageNet16-120 train : [loss = 1.897, top1 = 49.97%], valid : [loss = 2.254, top1 = 41.93%], test : [loss = 2.252, top1 = 42.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.516, top1 = 81.98%], valid : [loss = 0.595, top1 = 79.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14878/15625) 014878-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.443, top1 = 89.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.98 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.295, top1 = 92.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.73 ms.
cifar100       train : [loss = 0.124, top1 = 97.64%], valid : [loss = 1.324, top1 = 69.43%], test : [loss = 1.308, top1 = 69.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.32 ms.
ImageNet16-120 train : [loss = 1.713, top1 = 54.25%], valid : [loss = 2.222, top1 = 43.81%], test : [loss = 2.253, top1 = 43.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.417, top1 = 85.46%], valid : [loss = 0.534, top1 = 82.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14879/15625) 014879-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.516, top1 = 88.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.328, top1 = 91.90%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.34 ms.
cifar100       train : [loss = 0.335, top1 = 90.93%], valid : [loss = 1.295, top1 = 67.15%], test : [loss = 1.293, top1 = 66.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.87 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.89%], valid : [loss = 2.408, top1 = 39.10%], test : [loss = 2.419, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.26%], valid : [loss = 0.694, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14880/15625) 014880-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.527, top1 = 89.48%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.16 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.07%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=19.99 ms.
cifar100       train : [loss = 0.053, top1 = 99.19%], valid : [loss = 1.362, top1 = 70.58%], test : [loss = 1.354, top1 = 70.42%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.22 ms.
ImageNet16-120 train : [loss = 1.867, top1 = 50.58%], valid : [loss = 2.292, top1 = 41.16%], test : [loss = 2.303, top1 = 41.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.828, top1 = 70.39%], valid : [loss = 0.872, top1 = 69.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14881/15625) 014881-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.97 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.485, top1 = 89.40%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.20 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.303, top1 = 92.63%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.48 ms.
cifar100       train : [loss = 0.261, top1 = 93.19%], valid : [loss = 1.239, top1 = 68.77%], test : [loss = 1.248, top1 = 69.41%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.61 ms.
ImageNet16-120 train : [loss = 1.886, top1 = 50.19%], valid : [loss = 2.215, top1 = 42.78%], test : [loss = 2.229, top1 = 43.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 80.14%], valid : [loss = 0.644, top1 = 77.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14882/15625) 014882-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.79 ms.
cifar10-valid  train : [loss = 0.105, top1 = 96.97%], valid : [loss = 0.457, top1 = 86.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10        train : [loss = 0.149, top1 = 95.17%], test  : [loss = 0.342, top1 = 88.84%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.82 ms.
cifar100       train : [loss = 0.950, top1 = 72.99%], valid : [loss = 1.330, top1 = 62.99%], test : [loss = 1.324, top1 = 62.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.07 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.27%], valid : [loss = 2.673, top1 = 33.06%], test : [loss = 2.695, top1 = 32.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14883/15625) 014883-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.500, top1 = 88.78%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.11 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.325, top1 = 91.98%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.38 ms.
cifar100       train : [loss = 0.319, top1 = 91.42%], valid : [loss = 1.274, top1 = 67.41%], test : [loss = 1.286, top1 = 67.41%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.29%], valid : [loss = 2.407, top1 = 38.91%], test : [loss = 2.389, top1 = 39.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.41%], valid : [loss = 0.652, top1 = 77.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14884/15625) 014884-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.25 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.585, top1 = 87.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.387, top1 = 91.46%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.48 ms.
cifar100       train : [loss = 0.183, top1 = 95.90%], valid : [loss = 1.483, top1 = 66.01%], test : [loss = 1.465, top1 = 66.19%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.05%], valid : [loss = 2.483, top1 = 38.00%], test : [loss = 2.483, top1 = 38.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.61%], valid : [loss = 0.721, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14885/15625) 014885-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.244, top1 = 91.75%], valid : [loss = 0.538, top1 = 83.30%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.83 ms.
cifar10        train : [loss = 0.231, top1 = 92.10%], test  : [loss = 0.392, top1 = 87.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 1.362, top1 = 61.64%], valid : [loss = 1.644, top1 = 55.59%], test : [loss = 1.627, top1 = 56.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.830, top1 = 30.15%], valid : [loss = 2.860, top1 = 29.38%], test : [loss = 2.909, top1 = 28.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.49%], valid : [loss = 1.030, top1 = 63.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14886/15625) 014886-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.544, top1 = 88.75%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.13 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.334, top1 = 92.52%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.43 ms.
cifar100       train : [loss = 0.122, top1 = 97.34%], valid : [loss = 1.352, top1 = 68.57%], test : [loss = 1.362, top1 = 68.91%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.38 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.37%], valid : [loss = 2.434, top1 = 37.99%], test : [loss = 2.426, top1 = 38.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.83%], valid : [loss = 0.923, top1 = 67.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14887/15625) 014887-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.466, top1 = 90.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.305, top1 = 93.29%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.57 ms.
cifar100       train : [loss = 0.075, top1 = 98.73%], valid : [loss = 1.391, top1 = 69.39%], test : [loss = 1.384, top1 = 69.51%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.34 ms.
ImageNet16-120 train : [loss = 1.568, top1 = 57.70%], valid : [loss = 2.247, top1 = 43.60%], test : [loss = 2.272, top1 = 43.68%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.41%], valid : [loss = 0.545, top1 = 81.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14888/15625) 014888-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.35 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.485, top1 = 89.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.29 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.308, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.67 ms.
cifar100       train : [loss = 0.262, top1 = 93.33%], valid : [loss = 1.194, top1 = 69.14%], test : [loss = 1.203, top1 = 69.17%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 1.883, top1 = 50.19%], valid : [loss = 2.226, top1 = 42.52%], test : [loss = 2.234, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14889/15625) 014889-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.39%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.321, top1 = 91.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.27 ms.
cifar100       train : [loss = 0.317, top1 = 91.39%], valid : [loss = 1.293, top1 = 67.54%], test : [loss = 1.271, top1 = 67.87%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.64 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.42%], valid : [loss = 2.362, top1 = 40.28%], test : [loss = 2.413, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.460, top1 = 84.15%], valid : [loss = 0.567, top1 = 80.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14890/15625) 014890-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 90.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.308, top1 = 93.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.47 ms.
cifar100       train : [loss = 0.114, top1 = 97.78%], valid : [loss = 1.289, top1 = 69.83%], test : [loss = 1.309, top1 = 69.47%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 1.717, top1 = 54.08%], valid : [loss = 2.186, top1 = 44.48%], test : [loss = 2.194, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.579, top1 = 79.74%], valid : [loss = 0.650, top1 = 77.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14891/15625) 014891-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.508, top1 = 89.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.307, top1 = 93.19%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.55 ms.
cifar100       train : [loss = 0.127, top1 = 97.56%], valid : [loss = 1.278, top1 = 69.46%], test : [loss = 1.299, top1 = 69.25%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.09 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.76%], valid : [loss = 2.277, top1 = 42.43%], test : [loss = 2.282, top1 = 42.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14892/15625) 014892-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.49 ms.
cifar10-valid  train : [loss = 0.088, top1 = 97.56%], valid : [loss = 0.464, top1 = 86.41%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.76 ms.
cifar10        train : [loss = 0.125, top1 = 96.10%], test  : [loss = 0.342, top1 = 89.15%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=17.95 ms.
cifar100       train : [loss = 0.769, top1 = 78.37%], valid : [loss = 1.284, top1 = 64.48%], test : [loss = 1.282, top1 = 64.17%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.74 ms.
ImageNet16-120 train : [loss = 2.503, top1 = 36.69%], valid : [loss = 2.590, top1 = 34.76%], test : [loss = 2.605, top1 = 34.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.980, top1 = 64.57%], valid : [loss = 0.998, top1 = 64.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14893/15625) 014893-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.29%], valid : [loss = 0.864, top1 = 71.73%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.81 ms.
cifar10        train : [loss = 0.544, top1 = 80.97%], test  : [loss = 0.713, top1 = 75.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.44 ms.
cifar100       train : [loss = 1.760, top1 = 52.55%], valid : [loss = 2.039, top1 = 47.23%], test : [loss = 2.047, top1 = 47.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 3.576, top1 = 17.00%], valid : [loss = 3.624, top1 = 16.83%], test : [loss = 3.661, top1 = 15.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14894/15625) 014894-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.595, top1 = 87.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.74 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.412, top1 = 90.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.49 ms.
cifar100       train : [loss = 0.385, top1 = 89.15%], valid : [loss = 1.411, top1 = 65.97%], test : [loss = 1.396, top1 = 65.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.269, top1 = 41.65%], valid : [loss = 2.465, top1 = 37.03%], test : [loss = 2.496, top1 = 37.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.745, top1 = 73.30%], valid : [loss = 0.811, top1 = 71.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14895/15625) 014895-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.641, top1 = 86.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.423, top1 = 90.36%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.14 ms.
cifar100       train : [loss = 0.237, top1 = 94.16%], valid : [loss = 1.461, top1 = 65.45%], test : [loss = 1.474, top1 = 65.43%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.152, top1 = 44.18%], valid : [loss = 2.551, top1 = 36.37%], test : [loss = 2.571, top1 = 36.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.89%], valid : [loss = 0.780, top1 = 73.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14896/15625) 014896-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.509, top1 = 88.78%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.90 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.336, top1 = 91.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.343, top1 = 90.66%], valid : [loss = 1.274, top1 = 67.09%], test : [loss = 1.286, top1 = 67.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 44.98%], valid : [loss = 2.405, top1 = 38.64%], test : [loss = 2.405, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.738, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14897/15625) 014897-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.496, top1 = 89.14%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.25 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.306, top1 = 92.34%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.96 ms.
cifar100       train : [loss = 0.276, top1 = 92.88%], valid : [loss = 1.226, top1 = 68.55%], test : [loss = 1.201, top1 = 68.88%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.29 ms.
ImageNet16-120 train : [loss = 1.893, top1 = 49.96%], valid : [loss = 2.205, top1 = 43.53%], test : [loss = 2.204, top1 = 43.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.72%], valid : [loss = 0.663, top1 = 77.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14898/15625) 014898-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.559, top1 = 88.60%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.88 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.359, top1 = 92.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.64 ms.
cifar100       train : [loss = 0.153, top1 = 96.44%], valid : [loss = 1.388, top1 = 67.54%], test : [loss = 1.376, top1 = 68.37%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 2.070, top1 = 45.92%], valid : [loss = 2.395, top1 = 39.07%], test : [loss = 2.371, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.92%], valid : [loss = 0.862, top1 = 69.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14899/15625) 014899-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.26%], valid : [loss = 0.606, top1 = 85.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.56 ms.
cifar10        train : [loss = 0.074, top1 = 97.73%], test  : [loss = 0.394, top1 = 89.07%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.66 ms.
cifar100       train : [loss = 0.712, top1 = 79.25%], valid : [loss = 1.377, top1 = 63.49%], test : [loss = 1.372, top1 = 63.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.99 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.94%], valid : [loss = 2.648, top1 = 34.49%], test : [loss = 2.679, top1 = 33.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 74.67%], valid : [loss = 0.771, top1 = 73.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14900/15625) 014900-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.65 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.446, top1 = 90.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.48 ms.
cifar10        train : [loss = 0.004, top1 = 99.96%], test  : [loss = 0.311, top1 = 93.01%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.29 ms.
cifar100       train : [loss = 0.076, top1 = 98.68%], valid : [loss = 1.371, top1 = 69.66%], test : [loss = 1.375, top1 = 69.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 1.597, top1 = 57.01%], valid : [loss = 2.274, top1 = 42.80%], test : [loss = 2.277, top1 = 43.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.22%], valid : [loss = 0.528, top1 = 82.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14901/15625) 014901-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.21%], valid : [loss = 0.518, top1 = 86.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.12 ms.
cifar10        train : [loss = 0.080, top1 = 97.57%], test  : [loss = 0.351, top1 = 89.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.88 ms.
cifar100       train : [loss = 0.711, top1 = 79.27%], valid : [loss = 1.340, top1 = 64.57%], test : [loss = 1.334, top1 = 64.40%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 2.369, top1 = 39.35%], valid : [loss = 2.502, top1 = 36.76%], test : [loss = 2.519, top1 = 36.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.59%], valid : [loss = 0.896, top1 = 68.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14902/15625) 014902-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.136, top1 = 95.73%], valid : [loss = 0.538, top1 = 84.58%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.138, top1 = 95.43%], test  : [loss = 0.380, top1 = 88.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.895, top1 = 74.11%], valid : [loss = 1.429, top1 = 61.39%], test : [loss = 1.411, top1 = 61.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.638, top1 = 33.79%], valid : [loss = 2.706, top1 = 31.98%], test : [loss = 2.734, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.894, top1 = 67.85%], valid : [loss = 0.948, top1 = 66.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14903/15625) 014903-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.83 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.479, top1 = 89.07%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.310, top1 = 92.34%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.74 ms.
cifar100       train : [loss = 0.314, top1 = 91.55%], valid : [loss = 1.264, top1 = 67.65%], test : [loss = 1.238, top1 = 68.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.81%], valid : [loss = 2.301, top1 = 41.24%], test : [loss = 2.329, top1 = 41.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14904/15625) 014904-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.619, top1 = 86.68%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.30 ms.
cifar10        train : [loss = 0.023, top1 = 99.44%], test  : [loss = 0.428, top1 = 89.68%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.84 ms.
cifar100       train : [loss = 0.293, top1 = 92.54%], valid : [loss = 1.468, top1 = 65.01%], test : [loss = 1.463, top1 = 64.92%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.37%], valid : [loss = 2.576, top1 = 34.96%], test : [loss = 2.590, top1 = 36.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.62%], valid : [loss = 0.760, top1 = 73.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14905/15625) 014905-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.550, top1 = 88.36%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.68 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.383, top1 = 91.62%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.06 ms.
cifar100       train : [loss = 0.156, top1 = 96.58%], valid : [loss = 1.505, top1 = 66.43%], test : [loss = 1.461, top1 = 66.63%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.40 ms.
ImageNet16-120 train : [loss = 2.030, top1 = 46.91%], valid : [loss = 2.466, top1 = 38.17%], test : [loss = 2.453, top1 = 39.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.49%], valid : [loss = 0.738, top1 = 74.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14906/15625) 014906-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.68 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.75%], valid : [loss = 0.539, top1 = 88.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.68 ms.
cifar10        train : [loss = 0.022, top1 = 99.40%], test  : [loss = 0.352, top1 = 91.52%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.30 ms.
cifar100       train : [loss = 0.319, top1 = 91.02%], valid : [loss = 1.287, top1 = 67.81%], test : [loss = 1.284, top1 = 67.89%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.73 ms.
ImageNet16-120 train : [loss = 2.129, top1 = 44.70%], valid : [loss = 2.335, top1 = 39.74%], test : [loss = 2.359, top1 = 39.99%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.38%], valid : [loss = 0.925, top1 = 66.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14907/15625) 014907-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.50 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.61%], valid : [loss = 0.588, top1 = 87.60%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.49 ms.
cifar10        train : [loss = 0.020, top1 = 99.46%], test  : [loss = 0.392, top1 = 91.12%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.80 ms.
cifar100       train : [loss = 0.340, top1 = 90.51%], valid : [loss = 1.434, top1 = 64.35%], test : [loss = 1.446, top1 = 64.53%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.698, top1 = 31.62%], valid : [loss = 2.776, top1 = 30.09%], test : [loss = 2.802, top1 = 29.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 1.225, top1 = 55.71%], valid : [loss = 1.233, top1 = 55.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14908/15625) 014908-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.74%], valid : [loss = 0.574, top1 = 87.90%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.55 ms.
cifar10        train : [loss = 0.015, top1 = 99.63%], test  : [loss = 0.358, top1 = 91.75%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.54 ms.
cifar100       train : [loss = 0.118, top1 = 97.24%], valid : [loss = 1.409, top1 = 69.00%], test : [loss = 1.426, top1 = 68.47%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 2.566, top1 = 34.71%], valid : [loss = 2.713, top1 = 31.30%], test : [loss = 2.726, top1 = 32.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.11%], valid : [loss = 0.989, top1 = 64.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14909/15625) 014909-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.83%], valid : [loss = 0.710, top1 = 83.50%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10        train : [loss = 0.088, top1 = 97.17%], test  : [loss = 0.478, top1 = 87.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.29 ms.
cifar100       train : [loss = 0.802, top1 = 76.63%], valid : [loss = 1.553, top1 = 59.78%], test : [loss = 1.534, top1 = 60.11%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 2.821, top1 = 30.22%], valid : [loss = 2.945, top1 = 28.64%], test : [loss = 3.001, top1 = 27.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.16%], valid : [loss = 0.867, top1 = 69.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14910/15625) 014910-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.533, top1 = 88.93%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=18.95 ms.
cifar10        train : [loss = 0.007, top1 = 99.85%], test  : [loss = 0.339, top1 = 92.50%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=18.90 ms.
cifar100       train : [loss = 0.090, top1 = 98.13%], valid : [loss = 1.444, top1 = 68.70%], test : [loss = 1.439, top1 = 68.89%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.66 ms.
ImageNet16-120 train : [loss = 2.282, top1 = 40.87%], valid : [loss = 2.485, top1 = 36.53%], test : [loss = 2.504, top1 = 36.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 65.98%], valid : [loss = 0.977, top1 = 65.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14911/15625) 014911-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.67 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.451, top1 = 89.35%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.313, top1 = 91.96%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.06 ms.
cifar100       train : [loss = 0.321, top1 = 91.27%], valid : [loss = 1.322, top1 = 66.89%], test : [loss = 1.308, top1 = 67.59%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.42%], valid : [loss = 2.366, top1 = 39.90%], test : [loss = 2.397, top1 = 39.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.85%], valid : [loss = 0.540, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14912/15625) 014912-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.37%], valid : [loss = 0.863, top1 = 75.67%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.06 ms.
cifar10        train : [loss = 0.296, top1 = 89.75%], test  : [loss = 0.629, top1 = 80.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.29 ms.
cifar100       train : [loss = 1.342, top1 = 62.23%], valid : [loss = 1.906, top1 = 49.95%], test : [loss = 1.918, top1 = 50.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.81 ms.
ImageNet16-120 train : [loss = 3.467, top1 = 17.82%], valid : [loss = 3.501, top1 = 17.91%], test : [loss = 3.502, top1 = 17.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14913/15625) 014913-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.81%], valid : [loss = 0.530, top1 = 86.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10        train : [loss = 0.096, top1 = 96.98%], test  : [loss = 0.353, top1 = 89.65%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.11 ms.
cifar100       train : [loss = 0.698, top1 = 79.90%], valid : [loss = 1.308, top1 = 64.47%], test : [loss = 1.304, top1 = 65.11%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.463, top1 = 37.37%], valid : [loss = 2.530, top1 = 35.92%], test : [loss = 2.558, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.60%], valid : [loss = 0.884, top1 = 68.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14914/15625) 014914-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.54%], valid : [loss = 0.439, top1 = 88.11%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.23 ms.
cifar10        train : [loss = 0.054, top1 = 98.69%], test  : [loss = 0.308, top1 = 90.60%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=16.95 ms.
cifar100       train : [loss = 0.523, top1 = 85.83%], valid : [loss = 1.203, top1 = 67.48%], test : [loss = 1.195, top1 = 67.27%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 42.28%], valid : [loss = 2.450, top1 = 38.30%], test : [loss = 2.463, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 80.31%], valid : [loss = 0.638, top1 = 77.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14915/15625) 014915-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.510, top1 = 89.25%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.332, top1 = 92.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.88 ms.
cifar100       train : [loss = 0.151, top1 = 96.82%], valid : [loss = 1.310, top1 = 68.75%], test : [loss = 1.298, top1 = 69.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.77 ms.
ImageNet16-120 train : [loss = 1.904, top1 = 49.75%], valid : [loss = 2.310, top1 = 41.11%], test : [loss = 2.290, top1 = 41.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14916/15625) 014916-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.069, top1 = 98.29%], valid : [loss = 0.450, top1 = 87.22%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.51 ms.
cifar10        train : [loss = 0.109, top1 = 96.68%], test  : [loss = 0.318, top1 = 89.71%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.03 ms.
cifar100       train : [loss = 0.859, top1 = 75.45%], valid : [loss = 1.277, top1 = 64.59%], test : [loss = 1.280, top1 = 64.55%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.544, top1 = 35.91%], valid : [loss = 2.617, top1 = 34.72%], test : [loss = 2.641, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.599, top1 = 78.92%], valid : [loss = 0.664, top1 = 77.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14917/15625) 014917-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.531, top1 = 89.75%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=20.13 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.351, top1 = 93.02%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=17.92 ms.
cifar100       train : [loss = 0.031, top1 = 99.73%], valid : [loss = 1.416, top1 = 70.23%], test : [loss = 1.402, top1 = 70.25%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.59 ms.
ImageNet16-120 train : [loss = 1.634, top1 = 56.18%], valid : [loss = 2.350, top1 = 41.88%], test : [loss = 2.373, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.584, top1 = 79.40%], valid : [loss = 0.686, top1 = 76.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14918/15625) 014918-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.41 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.622, top1 = 86.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.019, top1 = 99.50%], test  : [loss = 0.397, top1 = 90.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.46 ms.
cifar100       train : [loss = 0.303, top1 = 91.98%], valid : [loss = 1.579, top1 = 63.19%], test : [loss = 1.581, top1 = 62.90%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.51 ms.
ImageNet16-120 train : [loss = 2.181, top1 = 43.42%], valid : [loss = 2.514, top1 = 36.62%], test : [loss = 2.543, top1 = 37.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 72.12%], valid : [loss = 0.838, top1 = 70.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14919/15625) 014919-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.21 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.527, top1 = 89.63%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.54 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.314, top1 = 93.48%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.57 ms.
cifar100       train : [loss = 0.069, top1 = 98.83%], valid : [loss = 1.381, top1 = 69.29%], test : [loss = 1.376, top1 = 69.79%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.14 ms.
ImageNet16-120 train : [loss = 1.990, top1 = 47.62%], valid : [loss = 2.393, top1 = 39.14%], test : [loss = 2.382, top1 = 39.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 68.35%], valid : [loss = 0.916, top1 = 67.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14920/15625) 014920-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.476, top1 = 89.18%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.46 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.314, top1 = 92.20%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.60 ms.
cifar100       train : [loss = 0.317, top1 = 91.52%], valid : [loss = 1.275, top1 = 66.95%], test : [loss = 1.266, top1 = 68.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.85%], valid : [loss = 2.315, top1 = 40.74%], test : [loss = 2.327, top1 = 41.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.488, top1 = 83.02%], valid : [loss = 0.574, top1 = 80.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14921/15625) 014921-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10-valid  train : [loss = 0.307, top1 = 89.36%], valid : [loss = 0.564, top1 = 81.96%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.38 ms.
cifar10        train : [loss = 0.262, top1 = 90.95%], test  : [loss = 0.421, top1 = 86.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.78 ms.
cifar100       train : [loss = 1.470, top1 = 58.74%], valid : [loss = 1.709, top1 = 53.19%], test : [loss = 1.714, top1 = 53.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.46 ms.
ImageNet16-120 train : [loss = 2.945, top1 = 27.79%], valid : [loss = 2.957, top1 = 27.57%], test : [loss = 3.007, top1 = 26.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.979, top1 = 65.01%], valid : [loss = 1.017, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14922/15625) 014922-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.33 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.440, top1 = 89.97%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.57 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.297, top1 = 92.70%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.96 ms.
cifar100       train : [loss = 0.198, top1 = 95.36%], valid : [loss = 1.252, top1 = 69.36%], test : [loss = 1.250, top1 = 69.35%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.07 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.51%], valid : [loss = 2.237, top1 = 42.92%], test : [loss = 2.283, top1 = 43.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.395, top1 = 86.44%], valid : [loss = 0.527, top1 = 82.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14923/15625) 014923-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.485, top1 = 89.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.49 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.298, top1 = 92.95%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.73 ms.
cifar100       train : [loss = 0.137, top1 = 97.24%], valid : [loss = 1.270, top1 = 69.39%], test : [loss = 1.253, top1 = 69.80%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 1.739, top1 = 53.71%], valid : [loss = 2.195, top1 = 43.26%], test : [loss = 2.210, top1 = 43.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.496, top1 = 82.58%], valid : [loss = 0.586, top1 = 80.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14924/15625) 014924-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.466, top1 = 83.66%], valid : [loss = 0.702, top1 = 76.93%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10        train : [loss = 0.427, top1 = 85.11%], test  : [loss = 0.570, top1 = 80.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.08 ms.
cifar100       train : [loss = 1.668, top1 = 54.05%], valid : [loss = 1.908, top1 = 49.66%], test : [loss = 1.905, top1 = 49.38%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.11 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 20.97%], valid : [loss = 3.334, top1 = 21.30%], test : [loss = 3.374, top1 = 19.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.189, top1 = 56.89%], valid : [loss = 1.241, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14925/15625) 014925-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.64 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.484, top1 = 89.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.93 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.311, top1 = 92.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.58 ms.
cifar100       train : [loss = 0.225, top1 = 94.54%], valid : [loss = 1.241, top1 = 68.85%], test : [loss = 1.258, top1 = 68.67%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.60%], valid : [loss = 2.262, top1 = 41.51%], test : [loss = 2.277, top1 = 41.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.602, top1 = 78.86%], valid : [loss = 0.672, top1 = 76.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14926/15625) 014926-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.573, top1 = 88.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.378, top1 = 91.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.44 ms.
cifar100       train : [loss = 0.157, top1 = 96.61%], valid : [loss = 1.449, top1 = 67.06%], test : [loss = 1.458, top1 = 66.72%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.51 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.74%], valid : [loss = 2.437, top1 = 39.29%], test : [loss = 2.471, top1 = 39.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.26%], valid : [loss = 0.784, top1 = 72.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14927/15625) 014927-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.474, top1 = 89.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.322, top1 = 92.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.71 ms.
cifar100       train : [loss = 0.315, top1 = 91.52%], valid : [loss = 1.276, top1 = 67.38%], test : [loss = 1.253, top1 = 67.87%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.60%], valid : [loss = 2.308, top1 = 40.44%], test : [loss = 2.322, top1 = 41.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14928/15625) 014928-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.511, top1 = 89.53%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.81 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.308, top1 = 93.34%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.01 ms.
cifar100       train : [loss = 0.128, top1 = 97.13%], valid : [loss = 1.296, top1 = 69.94%], test : [loss = 1.306, top1 = 69.53%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.64 ms.
ImageNet16-120 train : [loss = 1.723, top1 = 53.93%], valid : [loss = 2.176, top1 = 44.32%], test : [loss = 2.188, top1 = 44.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.726, top1 = 73.98%], valid : [loss = 0.796, top1 = 72.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14929/15625) 014929-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.24 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.02 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14930/15625) 014930-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.525, top1 = 81.67%], valid : [loss = 0.862, top1 = 71.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10        train : [loss = 0.550, top1 = 80.70%], test  : [loss = 0.710, top1 = 76.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.70 ms.
cifar100       train : [loss = 1.774, top1 = 51.99%], valid : [loss = 2.059, top1 = 46.97%], test : [loss = 2.067, top1 = 46.81%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.45 ms.
ImageNet16-120 train : [loss = 3.577, top1 = 17.01%], valid : [loss = 3.630, top1 = 16.33%], test : [loss = 3.648, top1 = 16.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.203, top1 = 56.89%], valid : [loss = 1.260, top1 = 54.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14931/15625) 014931-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.478, top1 = 89.19%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.314, top1 = 92.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.268, top1 = 93.13%], valid : [loss = 1.212, top1 = 68.72%], test : [loss = 1.218, top1 = 69.20%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.79%], valid : [loss = 2.225, top1 = 42.67%], test : [loss = 2.242, top1 = 42.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.551, top1 = 80.74%], valid : [loss = 0.620, top1 = 78.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14932/15625) 014932-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.67 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.79%], valid : [loss = 0.924, top1 = 76.19%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.215, top1 = 92.57%], test  : [loss = 0.583, top1 = 82.53%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.85 ms.
cifar100       train : [loss = 1.141, top1 = 67.64%], valid : [loss = 1.780, top1 = 54.21%], test : [loss = 1.762, top1 = 54.45%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 3.230, top1 = 22.74%], valid : [loss = 3.340, top1 = 20.97%], test : [loss = 3.371, top1 = 20.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.68%], valid : [loss = 1.091, top1 = 61.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14933/15625) 014933-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.88%], valid : [loss = 0.757, top1 = 73.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.14 ms.
cifar10        train : [loss = 0.565, top1 = 80.42%], test  : [loss = 0.626, top1 = 78.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.08 ms.
cifar100       train : [loss = 2.037, top1 = 45.29%], valid : [loss = 2.176, top1 = 42.69%], test : [loss = 2.165, top1 = 42.51%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.37 ms.
ImageNet16-120 train : [loss = 3.329, top1 = 20.65%], valid : [loss = 3.327, top1 = 20.57%], test : [loss = 3.365, top1 = 19.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.260, top1 = 54.38%], valid : [loss = 1.327, top1 = 52.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14934/15625) 014934-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.96 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.79%], valid : [loss = 0.637, top1 = 86.18%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.26 ms.
cifar10        train : [loss = 0.026, top1 = 99.28%], test  : [loss = 0.414, top1 = 90.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.87 ms.
cifar100       train : [loss = 0.310, top1 = 91.60%], valid : [loss = 1.575, top1 = 63.06%], test : [loss = 1.582, top1 = 62.76%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.38 ms.
ImageNet16-120 train : [loss = 2.206, top1 = 42.98%], valid : [loss = 2.549, top1 = 35.94%], test : [loss = 2.565, top1 = 37.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.747, top1 = 73.42%], valid : [loss = 0.813, top1 = 71.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14935/15625) 014935-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.10 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.72 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14936/15625) 014936-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.504, top1 = 88.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.37 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.334, top1 = 92.04%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.44 ms.
cifar100       train : [loss = 0.343, top1 = 90.60%], valid : [loss = 1.263, top1 = 67.14%], test : [loss = 1.269, top1 = 67.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.53 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 45.06%], valid : [loss = 2.409, top1 = 38.54%], test : [loss = 2.408, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14937/15625) 014937-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.263, top1 = 91.22%], valid : [loss = 0.473, top1 = 84.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.298, top1 = 90.04%], test  : [loss = 0.399, top1 = 86.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.76 ms.
cifar100       train : [loss = 1.318, top1 = 63.40%], valid : [loss = 1.531, top1 = 58.25%], test : [loss = 1.502, top1 = 58.35%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.78 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.90%], valid : [loss = 2.890, top1 = 29.90%], test : [loss = 2.952, top1 = 28.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 74.93%], valid : [loss = 0.755, top1 = 73.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14938/15625) 014938-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.546, top1 = 87.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10        train : [loss = 0.023, top1 = 99.35%], test  : [loss = 0.351, top1 = 91.56%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.83 ms.
cifar100       train : [loss = 0.382, top1 = 89.02%], valid : [loss = 1.285, top1 = 67.07%], test : [loss = 1.288, top1 = 66.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.88 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.40%], valid : [loss = 2.399, top1 = 38.89%], test : [loss = 2.429, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.30%], valid : [loss = 0.815, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14939/15625) 014939-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.97 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.618, top1 = 86.51%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.39 ms.
cifar10        train : [loss = 0.026, top1 = 99.32%], test  : [loss = 0.436, top1 = 89.62%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.37 ms.
cifar100       train : [loss = 0.320, top1 = 91.73%], valid : [loss = 1.453, top1 = 64.60%], test : [loss = 1.435, top1 = 64.73%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.85 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.38%], valid : [loss = 2.584, top1 = 35.79%], test : [loss = 2.617, top1 = 35.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.68%], valid : [loss = 0.787, top1 = 72.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14940/15625) 014940-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.115, top1 = 96.54%], valid : [loss = 0.456, top1 = 86.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.24 ms.
cifar10        train : [loss = 0.152, top1 = 95.07%], test  : [loss = 0.342, top1 = 89.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.21 ms.
cifar100       train : [loss = 0.988, top1 = 71.88%], valid : [loss = 1.356, top1 = 62.12%], test : [loss = 1.342, top1 = 62.24%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.75%], valid : [loss = 2.664, top1 = 33.03%], test : [loss = 2.718, top1 = 32.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14941/15625) 014941-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.38%], valid : [loss = 0.460, top1 = 86.91%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.24 ms.
cifar10        train : [loss = 0.112, top1 = 96.53%], test  : [loss = 0.325, top1 = 89.71%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.63 ms.
cifar100       train : [loss = 0.856, top1 = 75.59%], valid : [loss = 1.287, top1 = 64.00%], test : [loss = 1.283, top1 = 63.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.56%], valid : [loss = 2.625, top1 = 34.48%], test : [loss = 2.664, top1 = 33.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.23%], valid : [loss = 0.635, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14942/15625) 014942-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.71 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.94 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14943/15625) 014943-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.153, top1 = 94.80%], valid : [loss = 0.725, top1 = 80.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.64 ms.
cifar10        train : [loss = 0.172, top1 = 94.02%], test  : [loss = 0.514, top1 = 85.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.24 ms.
cifar100       train : [loss = 0.876, top1 = 74.46%], valid : [loss = 1.655, top1 = 56.98%], test : [loss = 1.648, top1 = 57.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 3.509, top1 = 16.80%], valid : [loss = 3.519, top1 = 16.94%], test : [loss = 3.522, top1 = 16.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.276, top1 = 53.38%], valid : [loss = 1.303, top1 = 52.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14944/15625) 014944-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.39%], valid : [loss = 0.597, top1 = 85.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.406, top1 = 88.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.38 ms.
cifar100       train : [loss = 0.714, top1 = 79.28%], valid : [loss = 1.392, top1 = 62.57%], test : [loss = 1.393, top1 = 63.33%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.88 ms.
ImageNet16-120 train : [loss = 2.540, top1 = 35.96%], valid : [loss = 2.652, top1 = 34.00%], test : [loss = 2.681, top1 = 33.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14945/15625) 014945-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.22%], valid : [loss = 0.476, top1 = 84.44%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.27 ms.
cifar10        train : [loss = 0.299, top1 = 90.07%], test  : [loss = 0.398, top1 = 86.70%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.49 ms.
cifar100       train : [loss = 1.323, top1 = 63.28%], valid : [loss = 1.527, top1 = 57.94%], test : [loss = 1.514, top1 = 58.50%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.36 ms.
ImageNet16-120 train : [loss = 2.910, top1 = 28.78%], valid : [loss = 2.877, top1 = 29.98%], test : [loss = 2.947, top1 = 28.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14946/15625) 014946-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.82 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.67%], valid : [loss = 0.580, top1 = 85.59%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.31 ms.
cifar10        train : [loss = 0.068, top1 = 97.96%], test  : [loss = 0.368, top1 = 89.75%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.16 ms.
cifar100       train : [loss = 0.629, top1 = 81.72%], valid : [loss = 1.368, top1 = 64.01%], test : [loss = 1.346, top1 = 64.55%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 2.419, top1 = 38.32%], valid : [loss = 2.533, top1 = 35.70%], test : [loss = 2.566, top1 = 36.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.02%], valid : [loss = 0.877, top1 = 69.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14947/15625) 014947-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.70 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.46 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.13 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.85%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14948/15625) 014948-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.91 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.23 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.25 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14949/15625) 014949-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10-valid  train : [loss = 0.148, top1 = 94.95%], valid : [loss = 0.605, top1 = 83.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.39 ms.
cifar10        train : [loss = 0.151, top1 = 94.89%], test  : [loss = 0.430, top1 = 87.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.87 ms.
cifar100       train : [loss = 0.784, top1 = 77.08%], valid : [loss = 1.588, top1 = 58.69%], test : [loss = 1.585, top1 = 59.28%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 3.332, top1 = 19.49%], valid : [loss = 3.337, top1 = 19.12%], test : [loss = 3.355, top1 = 19.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.044, top1 = 62.30%], valid : [loss = 1.071, top1 = 61.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14950/15625) 014950-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.24 ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.76%], valid : [loss = 0.724, top1 = 75.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.532, top1 = 81.62%], test  : [loss = 0.590, top1 = 79.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.76 ms.
cifar100       train : [loss = 1.917, top1 = 48.57%], valid : [loss = 2.038, top1 = 46.05%], test : [loss = 2.046, top1 = 46.36%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.39 ms.
ImageNet16-120 train : [loss = 3.259, top1 = 21.98%], valid : [loss = 3.222, top1 = 23.16%], test : [loss = 3.277, top1 = 21.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.317, top1 = 51.88%], valid : [loss = 1.366, top1 = 51.17%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14951/15625) 014951-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.457, top1 = 89.17%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.65 ms.
cifar10        train : [loss = 0.013, top1 = 99.80%], test  : [loss = 0.309, top1 = 92.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.75 ms.
cifar100       train : [loss = 0.323, top1 = 91.32%], valid : [loss = 1.297, top1 = 67.03%], test : [loss = 1.292, top1 = 67.43%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.81 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.33%], valid : [loss = 2.372, top1 = 39.86%], test : [loss = 2.399, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.25%], valid : [loss = 0.587, top1 = 80.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14952/15625) 014952-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.517, top1 = 89.48%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.343, top1 = 92.67%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.40 ms.
cifar100       train : [loss = 0.095, top1 = 98.17%], valid : [loss = 1.385, top1 = 68.57%], test : [loss = 1.404, top1 = 68.65%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.82 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 43.97%], valid : [loss = 2.422, top1 = 37.94%], test : [loss = 2.421, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.931, top1 = 66.37%], valid : [loss = 0.944, top1 = 65.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14953/15625) 014953-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.075, top1 = 97.89%], valid : [loss = 0.558, top1 = 85.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10        train : [loss = 0.115, top1 = 96.26%], test  : [loss = 0.374, top1 = 88.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.79 ms.
cifar100       train : [loss = 0.796, top1 = 76.80%], valid : [loss = 1.387, top1 = 63.27%], test : [loss = 1.373, top1 = 62.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.61%], valid : [loss = 2.621, top1 = 33.99%], test : [loss = 2.644, top1 = 34.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.877, top1 = 68.41%], valid : [loss = 0.931, top1 = 66.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14954/15625) 014954-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.01 ms.
cifar10-valid  train : [loss = 0.155, top1 = 95.05%], valid : [loss = 0.434, top1 = 86.67%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.22 ms.
cifar10        train : [loss = 0.145, top1 = 95.33%], test  : [loss = 0.310, top1 = 89.85%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.47 ms.
cifar100       train : [loss = 0.941, top1 = 73.15%], valid : [loss = 1.288, top1 = 63.43%], test : [loss = 1.270, top1 = 63.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.713, top1 = 32.51%], valid : [loss = 2.706, top1 = 32.36%], test : [loss = 2.749, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.945, top1 = 66.18%], valid : [loss = 0.973, top1 = 65.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14955/15625) 014955-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.488, top1 = 89.04%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.304, top1 = 92.48%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.33 ms.
cifar100       train : [loss = 0.315, top1 = 91.60%], valid : [loss = 1.251, top1 = 67.67%], test : [loss = 1.261, top1 = 67.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.78 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.63%], valid : [loss = 2.326, top1 = 40.27%], test : [loss = 2.347, top1 = 40.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.17%], valid : [loss = 0.600, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14956/15625) 014956-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.56 ms.
cifar10-valid  train : [loss = 0.473, top1 = 83.51%], valid : [loss = 0.646, top1 = 78.26%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.38 ms.
cifar10        train : [loss = 0.512, top1 = 82.30%], test  : [loss = 0.589, top1 = 80.03%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.05 ms.
cifar100       train : [loss = 1.673, top1 = 54.52%], valid : [loss = 1.839, top1 = 51.25%], test : [loss = 1.858, top1 = 50.88%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.48 ms.
ImageNet16-120 train : [loss = 3.321, top1 = 21.41%], valid : [loss = 3.314, top1 = 21.89%], test : [loss = 3.355, top1 = 20.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14957/15625) 014957-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.462, top1 = 89.76%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.37 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.298, top1 = 92.65%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.68 ms.
cifar100       train : [loss = 0.252, top1 = 93.45%], valid : [loss = 1.252, top1 = 68.14%], test : [loss = 1.254, top1 = 68.56%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.51 ms.
ImageNet16-120 train : [loss = 1.872, top1 = 50.29%], valid : [loss = 2.224, top1 = 42.84%], test : [loss = 2.237, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.61%], valid : [loss = 0.577, top1 = 80.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14958/15625) 014958-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.529, top1 = 89.66%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.77 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.342, top1 = 93.00%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.79 ms.
cifar100       train : [loss = 0.078, top1 = 98.64%], valid : [loss = 1.381, top1 = 69.16%], test : [loss = 1.382, top1 = 69.42%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.69 ms.
ImageNet16-120 train : [loss = 1.981, top1 = 47.83%], valid : [loss = 2.333, top1 = 40.36%], test : [loss = 2.338, top1 = 40.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.735, top1 = 73.98%], valid : [loss = 0.789, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14959/15625) 014959-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.579, top1 = 87.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.15 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.385, top1 = 91.30%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.98 ms.
cifar100       train : [loss = 0.399, top1 = 88.72%], valid : [loss = 1.409, top1 = 65.31%], test : [loss = 1.395, top1 = 65.58%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.306, top1 = 40.85%], valid : [loss = 2.518, top1 = 36.39%], test : [loss = 2.535, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14960/15625) 014960-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.69 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.537, top1 = 89.14%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.355, top1 = 92.47%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.23 ms.
cifar100       train : [loss = 0.124, top1 = 97.32%], valid : [loss = 1.389, top1 = 68.17%], test : [loss = 1.402, top1 = 68.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.98 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.50%], valid : [loss = 2.424, top1 = 38.07%], test : [loss = 2.435, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.861, top1 = 69.22%], valid : [loss = 0.908, top1 = 67.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14961/15625) 014961-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.73%], valid : [loss = 0.676, top1 = 85.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.06 ms.
cifar10        train : [loss = 0.037, top1 = 99.02%], test  : [loss = 0.437, top1 = 89.20%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.47 ms.
cifar100       train : [loss = 0.426, top1 = 88.12%], valid : [loss = 1.410, top1 = 64.49%], test : [loss = 1.395, top1 = 64.35%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.329, top1 = 40.30%], valid : [loss = 2.635, top1 = 35.22%], test : [loss = 2.647, top1 = 34.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 73.83%], valid : [loss = 0.793, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14962/15625) 014962-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.518, top1 = 88.72%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.319, top1 = 92.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.32 ms.
cifar100       train : [loss = 0.344, top1 = 90.54%], valid : [loss = 1.273, top1 = 67.09%], test : [loss = 1.276, top1 = 67.31%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.115, top1 = 44.89%], valid : [loss = 2.394, top1 = 38.97%], test : [loss = 2.409, top1 = 39.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.22%], valid : [loss = 0.657, top1 = 77.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14963/15625) 014963-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.511, top1 = 88.82%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.81 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.331, top1 = 92.14%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.66 ms.
cifar100       train : [loss = 0.321, top1 = 91.41%], valid : [loss = 1.281, top1 = 66.95%], test : [loss = 1.284, top1 = 67.26%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.78 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 44.97%], valid : [loss = 2.414, top1 = 38.59%], test : [loss = 2.412, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 81.00%], valid : [loss = 0.620, top1 = 78.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14964/15625) 014964-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.57 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.525, top1 = 88.29%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.31 ms.
cifar10        train : [loss = 0.024, top1 = 99.36%], test  : [loss = 0.382, top1 = 90.89%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.90 ms.
cifar100       train : [loss = 0.369, top1 = 89.60%], valid : [loss = 1.308, top1 = 67.14%], test : [loss = 1.297, top1 = 67.15%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.02 ms.
ImageNet16-120 train : [loss = 2.111, top1 = 45.17%], valid : [loss = 2.404, top1 = 39.19%], test : [loss = 2.445, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.521, top1 = 82.01%], valid : [loss = 0.625, top1 = 78.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14965/15625) 014965-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.28 ms.
cifar10-valid  train : [loss = 0.158, top1 = 94.74%], valid : [loss = 0.733, top1 = 80.20%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.74 ms.
cifar10        train : [loss = 0.181, top1 = 93.77%], test  : [loss = 0.518, top1 = 84.84%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.95 ms.
cifar100       train : [loss = 0.878, top1 = 74.31%], valid : [loss = 1.627, top1 = 57.43%], test : [loss = 1.663, top1 = 57.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 3.468, top1 = 17.44%], valid : [loss = 3.474, top1 = 17.64%], test : [loss = 3.489, top1 = 16.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.272, top1 = 53.60%], valid : [loss = 1.314, top1 = 52.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14966/15625) 014966-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.510, top1 = 88.73%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=18.32 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.333, top1 = 91.94%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.76 ms.
cifar100       train : [loss = 0.341, top1 = 90.59%], valid : [loss = 1.293, top1 = 66.95%], test : [loss = 1.293, top1 = 67.17%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.42 ms.
ImageNet16-120 train : [loss = 2.119, top1 = 44.88%], valid : [loss = 2.417, top1 = 39.01%], test : [loss = 2.414, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.39%], valid : [loss = 0.661, top1 = 77.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14967/15625) 014967-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.565, top1 = 88.55%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.37 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.379, top1 = 92.01%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.99 ms.
cifar100       train : [loss = 0.164, top1 = 96.53%], valid : [loss = 1.409, top1 = 67.21%], test : [loss = 1.433, top1 = 67.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.28 ms.
ImageNet16-120 train : [loss = 1.977, top1 = 48.16%], valid : [loss = 2.476, top1 = 38.33%], test : [loss = 2.478, top1 = 39.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14968/15625) 014968-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.48 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.559, top1 = 88.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.70 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.366, top1 = 91.99%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.46 ms.
cifar100       train : [loss = 0.201, top1 = 94.82%], valid : [loss = 1.349, top1 = 67.68%], test : [loss = 1.353, top1 = 68.05%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.41 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.13%], valid : [loss = 2.405, top1 = 39.11%], test : [loss = 2.397, top1 = 39.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.814, top1 = 70.84%], valid : [loss = 0.869, top1 = 69.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14969/15625) 014969-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.42 ms.
cifar10-valid  train : [loss = 0.372, top1 = 87.05%], valid : [loss = 0.604, top1 = 80.10%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.71 ms.
cifar10        train : [loss = 0.335, top1 = 88.27%], test  : [loss = 0.470, top1 = 84.46%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 1.629, top1 = 54.68%], valid : [loss = 1.862, top1 = 49.89%], test : [loss = 1.863, top1 = 49.99%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.30 ms.
ImageNet16-120 train : [loss = 2.981, top1 = 26.94%], valid : [loss = 2.998, top1 = 26.86%], test : [loss = 3.040, top1 = 25.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 64.64%], valid : [loss = 1.047, top1 = 62.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14970/15625) 014970-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.73%], valid : [loss = 0.824, top1 = 78.11%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.96 ms.
cifar10        train : [loss = 0.219, top1 = 92.44%], test  : [loss = 0.571, top1 = 82.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.50 ms.
cifar100       train : [loss = 1.108, top1 = 68.18%], valid : [loss = 1.732, top1 = 55.03%], test : [loss = 1.726, top1 = 55.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.56 ms.
ImageNet16-120 train : [loss = 3.195, top1 = 23.30%], valid : [loss = 3.296, top1 = 21.73%], test : [loss = 3.341, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.054, top1 = 62.30%], valid : [loss = 1.108, top1 = 60.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14971/15625) 014971-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.97 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.73%], valid : [loss = 0.547, top1 = 88.22%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.40 ms.
cifar10        train : [loss = 0.026, top1 = 99.27%], test  : [loss = 0.341, top1 = 91.58%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.13 ms.
cifar100       train : [loss = 0.426, top1 = 87.67%], valid : [loss = 1.235, top1 = 67.88%], test : [loss = 1.248, top1 = 67.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.56%], valid : [loss = 2.374, top1 = 39.64%], test : [loss = 2.402, top1 = 38.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.78%], valid : [loss = 0.806, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14972/15625) 014972-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.508, top1 = 89.77%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.47 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.316, top1 = 93.18%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.49 ms.
cifar100       train : [loss = 0.068, top1 = 98.94%], valid : [loss = 1.326, top1 = 69.97%], test : [loss = 1.335, top1 = 69.87%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.936, top1 = 48.89%], valid : [loss = 2.328, top1 = 40.86%], test : [loss = 2.334, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.928, top1 = 66.60%], valid : [loss = 0.970, top1 = 65.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14973/15625) 014973-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.39 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.10%], valid : [loss = 0.564, top1 = 87.02%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10        train : [loss = 0.061, top1 = 98.03%], test  : [loss = 0.382, top1 = 89.81%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.06 ms.
cifar100       train : [loss = 0.682, top1 = 79.95%], valid : [loss = 1.351, top1 = 63.93%], test : [loss = 1.333, top1 = 64.55%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.347, top1 = 39.79%], valid : [loss = 2.484, top1 = 36.69%], test : [loss = 2.505, top1 = 36.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.00%], valid : [loss = 0.817, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14974/15625) 014974-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.26%], valid : [loss = 0.471, top1 = 84.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.84 ms.
cifar10        train : [loss = 0.298, top1 = 90.06%], test  : [loss = 0.404, top1 = 86.44%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.17 ms.
cifar100       train : [loss = 1.321, top1 = 63.43%], valid : [loss = 1.526, top1 = 57.72%], test : [loss = 1.511, top1 = 58.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.74%], valid : [loss = 2.899, top1 = 29.17%], test : [loss = 2.953, top1 = 28.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14975/15625) 014975-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.551, top1 = 87.83%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.49 ms.
cifar10        train : [loss = 0.030, top1 = 99.17%], test  : [loss = 0.350, top1 = 91.25%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.56 ms.
cifar100       train : [loss = 0.569, top1 = 83.70%], valid : [loss = 1.406, top1 = 63.09%], test : [loss = 1.380, top1 = 63.82%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.92 ms.
ImageNet16-120 train : [loss = 2.509, top1 = 35.97%], valid : [loss = 2.598, top1 = 34.27%], test : [loss = 2.612, top1 = 34.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.988, top1 = 64.81%], valid : [loss = 1.025, top1 = 63.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14976/15625) 014976-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.509, top1 = 89.23%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.94 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.317, top1 = 92.64%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.38 ms.
cifar100       train : [loss = 0.146, top1 = 96.98%], valid : [loss = 1.294, top1 = 68.93%], test : [loss = 1.305, top1 = 68.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.37 ms.
ImageNet16-120 train : [loss = 1.871, top1 = 50.56%], valid : [loss = 2.284, top1 = 42.34%], test : [loss = 2.292, top1 = 41.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.560, top1 = 80.66%], valid : [loss = 0.634, top1 = 78.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14977/15625) 014977-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.51 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.59%], valid : [loss = 0.525, top1 = 83.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.00 ms.
cifar10        train : [loss = 0.240, top1 = 91.82%], test  : [loss = 0.394, top1 = 87.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.00 ms.
cifar100       train : [loss = 1.358, top1 = 61.83%], valid : [loss = 1.614, top1 = 56.13%], test : [loss = 1.603, top1 = 56.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.26 ms.
ImageNet16-120 train : [loss = 2.882, top1 = 29.12%], valid : [loss = 2.890, top1 = 29.27%], test : [loss = 2.946, top1 = 27.69%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.37%], valid : [loss = 0.997, top1 = 64.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14978/15625) 014978-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.26%], valid : [loss = 0.623, top1 = 85.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.11 ms.
cifar10        train : [loss = 0.072, top1 = 97.78%], test  : [loss = 0.386, top1 = 89.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.60 ms.
cifar100       train : [loss = 0.715, top1 = 79.21%], valid : [loss = 1.402, top1 = 62.61%], test : [loss = 1.374, top1 = 63.57%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.13%], valid : [loss = 2.646, top1 = 33.83%], test : [loss = 2.694, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.06%], valid : [loss = 0.807, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14979/15625) 014979-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.20%], valid : [loss = 0.618, top1 = 85.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.067, top1 = 97.93%], test  : [loss = 0.402, top1 = 88.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.61 ms.
cifar100       train : [loss = 0.712, top1 = 79.33%], valid : [loss = 1.381, top1 = 63.37%], test : [loss = 1.372, top1 = 63.23%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.02 ms.
ImageNet16-120 train : [loss = 2.525, top1 = 36.20%], valid : [loss = 2.657, top1 = 33.96%], test : [loss = 2.678, top1 = 33.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14980/15625) 014980-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.86%], valid : [loss = 0.540, top1 = 84.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.66 ms.
cifar10        train : [loss = 0.194, top1 = 93.43%], test  : [loss = 0.396, top1 = 87.56%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.81 ms.
cifar100       train : [loss = 1.236, top1 = 64.74%], valid : [loss = 1.556, top1 = 57.43%], test : [loss = 1.533, top1 = 57.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.14 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.95%], valid : [loss = 2.688, top1 = 32.67%], test : [loss = 2.741, top1 = 31.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.70%], valid : [loss = 1.023, top1 = 63.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14981/15625) 014981-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.90 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.622, top1 = 86.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.426, top1 = 90.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.233, top1 = 94.34%], valid : [loss = 1.431, top1 = 66.31%], test : [loss = 1.446, top1 = 65.95%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.172, top1 = 43.70%], valid : [loss = 2.581, top1 = 36.12%], test : [loss = 2.571, top1 = 36.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 74.61%], valid : [loss = 0.785, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14982/15625) 014982-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.93 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.28%], valid : [loss = 0.473, top1 = 84.46%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.294, top1 = 90.14%], test  : [loss = 0.395, top1 = 86.64%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.68 ms.
cifar100       train : [loss = 1.324, top1 = 63.35%], valid : [loss = 1.538, top1 = 57.81%], test : [loss = 1.515, top1 = 58.35%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.22 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.75%], valid : [loss = 2.897, top1 = 29.32%], test : [loss = 2.947, top1 = 28.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.72%], valid : [loss = 0.742, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14983/15625) 014983-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.93 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.515, top1 = 89.82%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.333, top1 = 93.03%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.36 ms.
cifar100       train : [loss = 0.070, top1 = 98.91%], valid : [loss = 1.338, top1 = 69.75%], test : [loss = 1.351, top1 = 69.91%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.75 ms.
ImageNet16-120 train : [loss = 1.760, top1 = 53.10%], valid : [loss = 2.272, top1 = 42.22%], test : [loss = 2.242, top1 = 43.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 79.27%], valid : [loss = 0.670, top1 = 76.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14984/15625) 014984-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.67 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.515, top1 = 88.44%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.07 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.334, top1 = 91.95%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.61 ms.
cifar100       train : [loss = 0.336, top1 = 90.80%], valid : [loss = 1.292, top1 = 67.08%], test : [loss = 1.290, top1 = 67.17%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.79 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.81%], valid : [loss = 2.408, top1 = 38.66%], test : [loss = 2.418, top1 = 38.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 77.79%], valid : [loss = 0.697, top1 = 75.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14985/15625) 014985-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.47 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.470, top1 = 90.12%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.15 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.293, top1 = 93.56%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.63 ms.
cifar100       train : [loss = 0.054, top1 = 99.28%], valid : [loss = 1.286, top1 = 70.78%], test : [loss = 1.302, top1 = 70.91%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=21.43 ms.
ImageNet16-120 train : [loss = 1.497, top1 = 59.48%], valid : [loss = 2.155, top1 = 44.89%], test : [loss = 2.140, top1 = 46.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.38%], valid : [loss = 0.586, top1 = 80.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14986/15625) 014986-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.29%], valid : [loss = 0.902, top1 = 68.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10        train : [loss = 0.710, top1 = 74.96%], test  : [loss = 0.766, top1 = 73.57%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.50 ms.
cifar100       train : [loss = 2.223, top1 = 41.08%], valid : [loss = 2.316, top1 = 39.39%], test : [loss = 2.323, top1 = 39.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.04 ms.
ImageNet16-120 train : [loss = 3.491, top1 = 17.86%], valid : [loss = 3.472, top1 = 18.81%], test : [loss = 3.495, top1 = 18.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.371, top1 = 49.66%], valid : [loss = 1.417, top1 = 48.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14987/15625) 014987-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.473, top1 = 89.09%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.307, top1 = 92.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.28 ms.
cifar100       train : [loss = 0.314, top1 = 91.57%], valid : [loss = 1.261, top1 = 67.95%], test : [loss = 1.243, top1 = 68.19%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.10 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.79%], valid : [loss = 2.303, top1 = 40.93%], test : [loss = 2.318, top1 = 41.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14988/15625) 014988-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.38%], valid : [loss = 0.857, top1 = 79.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.40 ms.
cifar10        train : [loss = 0.133, top1 = 95.51%], test  : [loss = 0.536, top1 = 84.85%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.01 ms.
cifar100       train : [loss = 0.846, top1 = 75.29%], valid : [loss = 1.676, top1 = 57.79%], test : [loss = 1.684, top1 = 57.69%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.32 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 26.40%], valid : [loss = 3.166, top1 = 24.13%], test : [loss = 3.196, top1 = 23.56%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14989/15625) 014989-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.15%], valid : [loss = 0.468, top1 = 84.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.33 ms.
cifar10        train : [loss = 0.297, top1 = 90.04%], test  : [loss = 0.401, top1 = 86.54%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.30 ms.
cifar100       train : [loss = 1.328, top1 = 63.14%], valid : [loss = 1.537, top1 = 57.69%], test : [loss = 1.512, top1 = 58.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.914, top1 = 28.80%], valid : [loss = 2.902, top1 = 29.40%], test : [loss = 2.954, top1 = 28.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 75.03%], valid : [loss = 0.750, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14990/15625) 014990-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.465, top1 = 89.77%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.78 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.304, top1 = 92.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.76 ms.
cifar100       train : [loss = 0.164, top1 = 96.24%], valid : [loss = 1.303, top1 = 69.32%], test : [loss = 1.281, top1 = 69.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 1.756, top1 = 53.32%], valid : [loss = 2.231, top1 = 43.57%], test : [loss = 2.249, top1 = 43.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.83%], valid : [loss = 0.512, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14991/15625) 014991-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.51%], valid : [loss = 0.873, top1 = 75.61%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.03 ms.
cifar10        train : [loss = 0.292, top1 = 89.85%], test  : [loss = 0.625, top1 = 80.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.73 ms.
cifar100       train : [loss = 1.350, top1 = 61.97%], valid : [loss = 1.895, top1 = 50.06%], test : [loss = 1.912, top1 = 50.01%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.28 ms.
ImageNet16-120 train : [loss = 3.479, top1 = 17.59%], valid : [loss = 3.514, top1 = 17.21%], test : [loss = 3.522, top1 = 16.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14992/15625) 014992-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.76%], valid : [loss = 0.620, top1 = 84.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.25 ms.
cifar10        train : [loss = 0.085, top1 = 97.26%], test  : [loss = 0.408, top1 = 88.48%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.50 ms.
cifar100       train : [loss = 0.759, top1 = 77.79%], valid : [loss = 1.422, top1 = 62.43%], test : [loss = 1.404, top1 = 62.50%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.42 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.56%], valid : [loss = 2.723, top1 = 31.91%], test : [loss = 2.724, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.774, top1 = 72.16%], valid : [loss = 0.835, top1 = 70.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14993/15625) 014993-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.503, top1 = 88.87%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.11 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.333, top1 = 92.08%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.41 ms.
cifar100       train : [loss = 0.328, top1 = 91.12%], valid : [loss = 1.287, top1 = 67.24%], test : [loss = 1.276, top1 = 67.43%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.30 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.79%], valid : [loss = 2.405, top1 = 38.62%], test : [loss = 2.416, top1 = 39.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14994/15625) 014994-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.28%], valid : [loss = 0.886, top1 = 70.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.23 ms.
cifar10        train : [loss = 0.627, top1 = 78.15%], test  : [loss = 0.739, top1 = 74.81%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.71 ms.
cifar100       train : [loss = 2.052, top1 = 45.40%], valid : [loss = 2.230, top1 = 42.04%], test : [loss = 2.218, top1 = 42.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.60%], valid : [loss = 3.654, top1 = 16.31%], test : [loss = 3.685, top1 = 15.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.314, top1 = 52.26%], valid : [loss = 1.354, top1 = 50.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14995/15625) 014995-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=102.15 M, Params=0.721 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.94%], valid : [loss = 0.451, top1 = 89.20%]
cifar10        FLOP=102.15 M, Params=0.721 MB, latency=15.97 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.309, top1 = 92.02%]
cifar100       FLOP=102.16 M, Params=0.727 MB, latency=16.31 ms.
cifar100       train : [loss = 0.320, top1 = 91.38%], valid : [loss = 1.290, top1 = 67.11%], test : [loss = 1.314, top1 = 67.35%]
ImageNet16-120 FLOP= 25.55 M, Params=0.729 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.052, top1 = 46.44%], valid : [loss = 2.358, top1 = 40.39%], test : [loss = 2.413, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.463, top1 = 83.88%], valid : [loss = 0.572, top1 = 80.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14996/15625) 014996-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.01 ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.40%], valid : [loss = 0.772, top1 = 73.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.71 ms.
cifar10        train : [loss = 0.585, top1 = 79.67%], test  : [loss = 0.642, top1 = 77.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.22 ms.
cifar100       train : [loss = 2.055, top1 = 44.69%], valid : [loss = 2.189, top1 = 42.26%], test : [loss = 2.191, top1 = 42.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 3.316, top1 = 20.89%], valid : [loss = 3.299, top1 = 21.04%], test : [loss = 3.350, top1 = 20.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.306, top1 = 52.80%], valid : [loss = 1.368, top1 = 50.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14997/15625) 014997-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.41%], valid : [loss = 0.904, top1 = 68.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.694, top1 = 75.76%], test  : [loss = 0.748, top1 = 74.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.91 ms.
cifar100       train : [loss = 2.216, top1 = 41.43%], valid : [loss = 2.302, top1 = 39.40%], test : [loss = 2.311, top1 = 39.57%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.36 ms.
ImageNet16-120 train : [loss = 3.464, top1 = 18.52%], valid : [loss = 3.441, top1 = 19.38%], test : [loss = 3.462, top1 = 18.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.342, top1 = 51.49%], valid : [loss = 1.388, top1 = 50.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14998/15625) 014998-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.48 ms.
cifar10-valid  train : [loss = 0.614, top1 = 78.50%], valid : [loss = 0.755, top1 = 74.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.47 ms.
cifar10        train : [loss = 0.498, top1 = 82.75%], test  : [loss = 0.571, top1 = 80.23%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.88 ms.
cifar100       train : [loss = 1.967, top1 = 46.75%], valid : [loss = 2.098, top1 = 44.14%], test : [loss = 2.093, top1 = 43.93%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.09 ms.
ImageNet16-120 train : [loss = 2.985, top1 = 26.91%], valid : [loss = 2.968, top1 = 27.04%], test : [loss = 2.999, top1 = 26.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.149, top1 = 58.56%], valid : [loss = 1.196, top1 = 57.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (14999/15625) 014999-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.01%], valid : [loss = 0.646, top1 = 85.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.34 ms.
cifar10        train : [loss = 0.057, top1 = 98.22%], test  : [loss = 0.392, top1 = 89.50%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.59 ms.
cifar100       train : [loss = 0.637, top1 = 81.22%], valid : [loss = 1.425, top1 = 62.82%], test : [loss = 1.420, top1 = 63.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.49 ms.
ImageNet16-120 train : [loss = 2.427, top1 = 38.16%], valid : [loss = 2.579, top1 = 34.77%], test : [loss = 2.605, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.852, top1 = 69.46%], valid : [loss = 0.899, top1 = 68.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15000/15625) 015000-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.511, top1 = 88.60%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.321, top1 = 92.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.34 ms.
cifar100       train : [loss = 0.337, top1 = 90.75%], valid : [loss = 1.278, top1 = 67.23%], test : [loss = 1.286, top1 = 67.51%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 2.132, top1 = 44.54%], valid : [loss = 2.420, top1 = 38.92%], test : [loss = 2.420, top1 = 39.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15001/15625) 015001-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.74 ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.98%], valid : [loss = 0.947, top1 = 66.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.78 ms.
cifar10        train : [loss = 0.774, top1 = 72.68%], test  : [loss = 0.827, top1 = 70.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.35 ms.
cifar100       train : [loss = 2.416, top1 = 36.88%], valid : [loss = 2.561, top1 = 34.33%], test : [loss = 2.551, top1 = 34.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.46%], valid : [loss = 3.584, top1 = 16.87%], test : [loss = 3.604, top1 = 16.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.66%], valid : [loss = 1.504, top1 = 44.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15002/15625) 015002-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.97%], valid : [loss = 0.449, top1 = 89.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.310, top1 = 92.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.218, top1 = 94.74%], valid : [loss = 1.324, top1 = 67.47%], test : [loss = 1.317, top1 = 68.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.66%], valid : [loss = 2.295, top1 = 42.30%], test : [loss = 2.352, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.50%], valid : [loss = 0.540, top1 = 81.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15003/15625) 015003-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.478, top1 = 89.88%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.82 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.299, top1 = 93.28%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=19.22 ms.
cifar100       train : [loss = 0.070, top1 = 99.07%], valid : [loss = 1.300, top1 = 69.92%], test : [loss = 1.284, top1 = 70.54%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.34 ms.
ImageNet16-120 train : [loss = 1.732, top1 = 53.69%], valid : [loss = 2.223, top1 = 43.42%], test : [loss = 2.222, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.664, top1 = 76.75%], valid : [loss = 0.716, top1 = 75.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15004/15625) 015004-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.485, top1 = 88.98%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.305, top1 = 92.42%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.12 ms.
cifar100       train : [loss = 0.318, top1 = 91.55%], valid : [loss = 1.258, top1 = 67.65%], test : [loss = 1.239, top1 = 68.28%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.11 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.74%], valid : [loss = 2.300, top1 = 40.50%], test : [loss = 2.342, top1 = 41.09%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.510, top1 = 82.10%], valid : [loss = 0.595, top1 = 79.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15005/15625) 015005-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.83 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.36%], valid : [loss = 0.708, top1 = 84.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.08 ms.
cifar10        train : [loss = 0.054, top1 = 98.38%], test  : [loss = 0.452, top1 = 88.11%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.49 ms.
cifar100       train : [loss = 0.627, top1 = 81.67%], valid : [loss = 1.552, top1 = 61.38%], test : [loss = 1.513, top1 = 62.31%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.52 ms.
ImageNet16-120 train : [loss = 2.673, top1 = 33.17%], valid : [loss = 2.830, top1 = 30.00%], test : [loss = 2.878, top1 = 29.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.68%], valid : [loss = 0.892, top1 = 68.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15006/15625) 015006-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.56%], valid : [loss = 0.842, top1 = 79.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.75 ms.
cifar10        train : [loss = 0.124, top1 = 95.83%], test  : [loss = 0.540, top1 = 84.94%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.55 ms.
cifar100       train : [loss = 0.837, top1 = 75.73%], valid : [loss = 1.696, top1 = 56.85%], test : [loss = 1.691, top1 = 57.54%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 3.034, top1 = 26.45%], valid : [loss = 3.180, top1 = 23.52%], test : [loss = 3.215, top1 = 24.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.044, top1 = 62.28%], valid : [loss = 1.106, top1 = 60.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15007/15625) 015007-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.84 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.91 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.33 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.12 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15008/15625) 015008-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.538, top1 = 87.61%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.44 ms.
cifar10        train : [loss = 0.036, top1 = 99.02%], test  : [loss = 0.371, top1 = 90.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.83 ms.
cifar100       train : [loss = 0.529, top1 = 84.60%], valid : [loss = 1.348, top1 = 65.15%], test : [loss = 1.327, top1 = 65.27%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.20 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.16%], valid : [loss = 2.481, top1 = 37.44%], test : [loss = 2.517, top1 = 36.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.534, top1 = 81.15%], valid : [loss = 0.635, top1 = 78.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15009/15625) 015009-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.24 ms.
cifar10-valid  train : [loss = 0.116, top1 = 96.55%], valid : [loss = 0.460, top1 = 86.15%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10        train : [loss = 0.155, top1 = 95.01%], test  : [loss = 0.341, top1 = 88.97%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.30 ms.
cifar100       train : [loss = 0.980, top1 = 72.19%], valid : [loss = 1.343, top1 = 62.68%], test : [loss = 1.349, top1 = 62.04%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.47 ms.
ImageNet16-120 train : [loss = 2.632, top1 = 33.96%], valid : [loss = 2.699, top1 = 32.25%], test : [loss = 2.695, top1 = 32.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15010/15625) 015010-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.00 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.584, top1 = 88.03%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.389, top1 = 91.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 0.205, top1 = 95.27%], valid : [loss = 1.431, top1 = 66.10%], test : [loss = 1.442, top1 = 66.01%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.70 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.06%], valid : [loss = 2.474, top1 = 38.03%], test : [loss = 2.504, top1 = 39.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.20%], valid : [loss = 0.754, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15011/15625) 015011-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.14%], valid : [loss = 0.934, top1 = 75.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.77 ms.
cifar10        train : [loss = 0.219, top1 = 92.47%], test  : [loss = 0.590, top1 = 82.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=16.68 ms.
cifar100       train : [loss = 1.160, top1 = 66.90%], valid : [loss = 1.789, top1 = 53.46%], test : [loss = 1.782, top1 = 53.91%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 3.232, top1 = 22.65%], valid : [loss = 3.330, top1 = 21.77%], test : [loss = 3.367, top1 = 20.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.072, top1 = 61.59%], valid : [loss = 1.130, top1 = 59.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15012/15625) 015012-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.30%], valid : [loss = 0.453, top1 = 87.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=13.22 ms.
cifar10        train : [loss = 0.110, top1 = 96.57%], test  : [loss = 0.324, top1 = 89.69%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.38 ms.
cifar100       train : [loss = 0.859, top1 = 75.65%], valid : [loss = 1.286, top1 = 64.05%], test : [loss = 1.285, top1 = 63.85%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.54 ms.
ImageNet16-120 train : [loss = 2.551, top1 = 35.76%], valid : [loss = 2.627, top1 = 34.23%], test : [loss = 2.643, top1 = 34.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 80.06%], valid : [loss = 0.652, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15013/15625) 015013-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.39 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.561, top1 = 88.81%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.54 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.386, top1 = 92.17%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=16.52 ms.
cifar100       train : [loss = 0.065, top1 = 99.08%], valid : [loss = 1.482, top1 = 68.48%], test : [loss = 1.509, top1 = 68.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.12 ms.
ImageNet16-120 train : [loss = 1.772, top1 = 53.00%], valid : [loss = 2.410, top1 = 39.93%], test : [loss = 2.435, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.587, top1 = 79.32%], valid : [loss = 0.695, top1 = 75.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15014/15625) 015014-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.52 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.85%], valid : [loss = 0.490, top1 = 84.09%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.63 ms.
cifar10        train : [loss = 0.297, top1 = 90.09%], test  : [loss = 0.407, top1 = 86.20%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.32 ms.
cifar100       train : [loss = 1.315, top1 = 63.53%], valid : [loss = 1.520, top1 = 57.96%], test : [loss = 1.506, top1 = 58.54%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.62 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.71%], valid : [loss = 2.910, top1 = 30.20%], test : [loss = 2.948, top1 = 28.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15015/15625) 015015-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.599, top1 = 87.59%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.75 ms.
cifar10        train : [loss = 0.010, top1 = 99.80%], test  : [loss = 0.430, top1 = 90.86%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.44 ms.
cifar100       train : [loss = 0.143, top1 = 96.80%], valid : [loss = 1.575, top1 = 65.86%], test : [loss = 1.584, top1 = 65.00%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.049, top1 = 46.58%], valid : [loss = 2.479, top1 = 38.73%], test : [loss = 2.484, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.42%], valid : [loss = 0.818, top1 = 71.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15016/15625) 015016-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.504, top1 = 89.15%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.317, top1 = 91.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.54 ms.
cifar100       train : [loss = 0.333, top1 = 90.85%], valid : [loss = 1.273, top1 = 67.40%], test : [loss = 1.269, top1 = 67.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.40 ms.
ImageNet16-120 train : [loss = 2.109, top1 = 45.11%], valid : [loss = 2.378, top1 = 39.63%], test : [loss = 2.399, top1 = 40.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15017/15625) 015017-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=18.65 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.577, top1 = 86.82%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.46 ms.
cifar10        train : [loss = 0.037, top1 = 98.93%], test  : [loss = 0.389, top1 = 90.12%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.74 ms.
cifar100       train : [loss = 0.468, top1 = 86.59%], valid : [loss = 1.326, top1 = 65.96%], test : [loss = 1.336, top1 = 65.06%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.173, top1 = 43.59%], valid : [loss = 2.406, top1 = 38.73%], test : [loss = 2.405, top1 = 38.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.66%], valid : [loss = 0.749, top1 = 73.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15018/15625) 015018-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.90 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.29%], valid : [loss = 0.543, top1 = 86.54%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.95 ms.
cifar10        train : [loss = 0.049, top1 = 98.62%], test  : [loss = 0.364, top1 = 90.34%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.43 ms.
cifar100       train : [loss = 0.522, top1 = 85.08%], valid : [loss = 1.312, top1 = 65.33%], test : [loss = 1.309, top1 = 65.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.06 ms.
ImageNet16-120 train : [loss = 2.242, top1 = 42.21%], valid : [loss = 2.418, top1 = 38.73%], test : [loss = 2.445, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.780, top1 = 71.82%], valid : [loss = 0.847, top1 = 70.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15019/15625) 015019-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.454, top1 = 89.19%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.97 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.311, top1 = 92.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.85 ms.
cifar100       train : [loss = 0.328, top1 = 91.13%], valid : [loss = 1.294, top1 = 67.01%], test : [loss = 1.297, top1 = 67.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.79 ms.
ImageNet16-120 train : [loss = 2.055, top1 = 46.35%], valid : [loss = 2.373, top1 = 40.00%], test : [loss = 2.404, top1 = 39.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.477, top1 = 83.25%], valid : [loss = 0.587, top1 = 80.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15020/15625) 015020-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.42%], valid : [loss = 0.581, top1 = 86.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.30 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.368, top1 = 91.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.23 ms.
cifar100       train : [loss = 0.553, top1 = 84.11%], valid : [loss = 1.373, top1 = 63.48%], test : [loss = 1.342, top1 = 64.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.86 ms.
ImageNet16-120 train : [loss = 2.570, top1 = 34.73%], valid : [loss = 2.655, top1 = 32.67%], test : [loss = 2.661, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.45%], valid : [loss = 0.868, top1 = 69.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15021/15625) 015021-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.46%], valid : [loss = 0.872, top1 = 71.15%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.03 ms.
cifar10        train : [loss = 0.562, top1 = 80.29%], test  : [loss = 0.721, top1 = 75.52%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.62 ms.
cifar100       train : [loss = 1.790, top1 = 51.79%], valid : [loss = 2.056, top1 = 46.84%], test : [loss = 2.064, top1 = 46.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.80 ms.
ImageNet16-120 train : [loss = 3.587, top1 = 16.74%], valid : [loss = 3.648, top1 = 16.21%], test : [loss = 3.661, top1 = 15.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15022/15625) 015022-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=16.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.542, top1 = 88.63%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.93 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.354, top1 = 91.85%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.35 ms.
cifar100       train : [loss = 0.248, top1 = 93.56%], valid : [loss = 1.301, top1 = 68.32%], test : [loss = 1.350, top1 = 67.44%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.47%], valid : [loss = 2.468, top1 = 37.93%], test : [loss = 2.478, top1 = 37.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.911, top1 = 67.08%], valid : [loss = 0.938, top1 = 66.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15023/15625) 015023-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.299, top1 = 89.63%], valid : [loss = 0.560, top1 = 82.09%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.05 ms.
cifar10        train : [loss = 0.277, top1 = 90.40%], test  : [loss = 0.425, top1 = 86.19%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.76 ms.
cifar100       train : [loss = 1.455, top1 = 59.38%], valid : [loss = 1.703, top1 = 54.26%], test : [loss = 1.681, top1 = 54.65%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.07 ms.
ImageNet16-120 train : [loss = 3.016, top1 = 26.66%], valid : [loss = 3.025, top1 = 27.02%], test : [loss = 3.100, top1 = 25.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.083, top1 = 60.98%], valid : [loss = 1.115, top1 = 60.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15024/15625) 015024-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.555, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.64 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.383, top1 = 92.26%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.39 ms.
cifar100       train : [loss = 0.121, top1 = 97.66%], valid : [loss = 1.495, top1 = 67.38%], test : [loss = 1.446, top1 = 67.54%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.05 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.31%], valid : [loss = 2.432, top1 = 38.93%], test : [loss = 2.418, top1 = 40.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 77.01%], valid : [loss = 0.752, top1 = 73.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15025/15625) 015025-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.095, top1 = 97.33%], valid : [loss = 0.460, top1 = 86.39%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.99 ms.
cifar10        train : [loss = 0.135, top1 = 95.61%], test  : [loss = 0.339, top1 = 89.11%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.36 ms.
cifar100       train : [loss = 0.805, top1 = 77.27%], valid : [loss = 1.288, top1 = 64.12%], test : [loss = 1.292, top1 = 63.82%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 36.37%], valid : [loss = 2.605, top1 = 33.80%], test : [loss = 2.609, top1 = 33.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.76%], valid : [loss = 0.838, top1 = 70.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15026/15625) 015026-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.72 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.492, top1 = 89.01%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=21.93 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.325, top1 = 91.83%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.14 ms.
cifar100       train : [loss = 0.278, top1 = 92.94%], valid : [loss = 1.203, top1 = 68.78%], test : [loss = 1.227, top1 = 68.16%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=18.30 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.23%], valid : [loss = 2.247, top1 = 42.10%], test : [loss = 2.228, top1 = 42.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.760, top1 = 73.11%], valid : [loss = 0.808, top1 = 71.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15027/15625) 015027-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.484, top1 = 89.20%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.298, top1 = 92.22%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.52 ms.
cifar100       train : [loss = 0.314, top1 = 91.45%], valid : [loss = 1.256, top1 = 67.84%], test : [loss = 1.266, top1 = 68.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.18 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.71%], valid : [loss = 2.320, top1 = 40.43%], test : [loss = 2.311, top1 = 41.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.514, top1 = 82.06%], valid : [loss = 0.604, top1 = 79.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15028/15625) 015028-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.444, top1 = 90.69%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.81 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.284, top1 = 93.78%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.83 ms.
cifar100       train : [loss = 0.067, top1 = 99.03%], valid : [loss = 1.350, top1 = 70.08%], test : [loss = 1.331, top1 = 70.36%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 1.544, top1 = 58.31%], valid : [loss = 2.226, top1 = 43.77%], test : [loss = 2.254, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.45%], valid : [loss = 0.512, top1 = 82.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15029/15625) 015029-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.12 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.430, top1 = 90.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10        train : [loss = 0.007, top1 = 99.90%], test  : [loss = 0.280, top1 = 93.10%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.31 ms.
cifar100       train : [loss = 0.185, top1 = 95.48%], valid : [loss = 1.276, top1 = 69.86%], test : [loss = 1.269, top1 = 69.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 1.822, top1 = 51.63%], valid : [loss = 2.249, top1 = 42.60%], test : [loss = 2.278, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.376, top1 = 87.03%], valid : [loss = 0.504, top1 = 83.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15030/15625) 015030-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.62 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.527, top1 = 89.10%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.01 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.339, top1 = 92.44%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.41 ms.
cifar100       train : [loss = 0.148, top1 = 96.79%], valid : [loss = 1.333, top1 = 69.24%], test : [loss = 1.340, top1 = 69.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.29 ms.
ImageNet16-120 train : [loss = 1.866, top1 = 50.71%], valid : [loss = 2.272, top1 = 41.97%], test : [loss = 2.305, top1 = 41.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 76.98%], valid : [loss = 0.718, top1 = 75.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15031/15625) 015031-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.45 ms.
cifar10-valid  train : [loss = 0.545, top1 = 81.09%], valid : [loss = 0.679, top1 = 76.93%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.31 ms.
cifar10        train : [loss = 0.551, top1 = 80.87%], test  : [loss = 0.608, top1 = 79.42%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.76 ms.
cifar100       train : [loss = 1.740, top1 = 52.78%], valid : [loss = 1.881, top1 = 49.22%], test : [loss = 1.916, top1 = 49.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.00 ms.
ImageNet16-120 train : [loss = 3.377, top1 = 20.29%], valid : [loss = 3.350, top1 = 21.26%], test : [loss = 3.403, top1 = 19.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.370, top1 = 50.10%], valid : [loss = 1.404, top1 = 49.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15032/15625) 015032-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.43%], valid : [loss = 0.451, top1 = 87.72%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.30 ms.
cifar10        train : [loss = 0.057, top1 = 98.52%], test  : [loss = 0.310, top1 = 90.82%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.83 ms.
cifar100       train : [loss = 0.589, top1 = 83.73%], valid : [loss = 1.205, top1 = 67.66%], test : [loss = 1.218, top1 = 66.80%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.56 ms.
ImageNet16-120 train : [loss = 2.299, top1 = 41.07%], valid : [loss = 2.485, top1 = 37.87%], test : [loss = 2.488, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.58%], valid : [loss = 0.652, top1 = 77.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15033/15625) 015033-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.521, top1 = 88.63%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=12.20 ms.
cifar10        train : [loss = 0.013, top1 = 99.76%], test  : [loss = 0.328, top1 = 92.07%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=11.06 ms.
cifar100       train : [loss = 0.343, top1 = 90.62%], valid : [loss = 1.288, top1 = 66.69%], test : [loss = 1.275, top1 = 67.79%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=10.58 ms.
ImageNet16-120 train : [loss = 2.123, top1 = 44.79%], valid : [loss = 2.398, top1 = 39.34%], test : [loss = 2.412, top1 = 39.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15034/15625) 015034-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.500, top1 = 89.67%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.24 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.314, top1 = 93.09%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.125, top1 = 97.55%], valid : [loss = 1.288, top1 = 69.59%], test : [loss = 1.281, top1 = 69.66%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 50.99%], valid : [loss = 2.299, top1 = 42.11%], test : [loss = 2.285, top1 = 42.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.21%], valid : [loss = 0.751, top1 = 73.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15035/15625) 015035-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.35 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.413, top1 = 90.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.13 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.285, top1 = 93.33%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.20 ms.
cifar100       train : [loss = 0.183, top1 = 95.80%], valid : [loss = 1.263, top1 = 69.24%], test : [loss = 1.256, top1 = 69.70%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.70%], valid : [loss = 2.236, top1 = 42.73%], test : [loss = 2.293, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.387, top1 = 86.72%], valid : [loss = 0.503, top1 = 83.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15036/15625) 015036-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 52.35 M, Params=0.382 MB, latency=19.77 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.71%], valid : [loss = 0.550, top1 = 88.02%]
cifar10        FLOP= 52.35 M, Params=0.382 MB, latency=19.02 ms.
cifar10        train : [loss = 0.028, top1 = 99.21%], test  : [loss = 0.362, top1 = 91.22%]
cifar100       FLOP= 52.35 M, Params=0.388 MB, latency=18.12 ms.
cifar100       train : [loss = 0.435, top1 = 87.27%], valid : [loss = 1.275, top1 = 67.18%], test : [loss = 1.276, top1 = 67.14%]
ImageNet16-120 FLOP= 13.09 M, Params=0.389 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 2.202, top1 = 42.93%], valid : [loss = 2.372, top1 = 39.89%], test : [loss = 2.417, top1 = 38.64%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.28%], valid : [loss = 0.771, top1 = 73.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15037/15625) 015037-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.18%], valid : [loss = 0.858, top1 = 71.87%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.46 ms.
cifar10        train : [loss = 0.563, top1 = 80.37%], test  : [loss = 0.715, top1 = 75.67%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.54 ms.
cifar100       train : [loss = 1.775, top1 = 52.17%], valid : [loss = 2.056, top1 = 47.12%], test : [loss = 2.076, top1 = 46.52%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.99 ms.
ImageNet16-120 train : [loss = 3.594, top1 = 16.64%], valid : [loss = 3.661, top1 = 16.13%], test : [loss = 3.687, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15038/15625) 015038-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.74%], valid : [loss = 0.623, top1 = 86.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.05 ms.
cifar10        train : [loss = 0.031, top1 = 99.11%], test  : [loss = 0.404, top1 = 90.15%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.46 ms.
cifar100       train : [loss = 0.497, top1 = 85.48%], valid : [loss = 1.383, top1 = 64.89%], test : [loss = 1.361, top1 = 65.37%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.22 ms.
ImageNet16-120 train : [loss = 2.382, top1 = 39.25%], valid : [loss = 2.554, top1 = 35.76%], test : [loss = 2.582, top1 = 35.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.768, top1 = 72.86%], valid : [loss = 0.839, top1 = 70.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15039/15625) 015039-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.39 ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.73%], valid : [loss = 0.773, top1 = 73.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=10.45 ms.
cifar10        train : [loss = 0.566, top1 = 80.18%], test  : [loss = 0.632, top1 = 78.30%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.82 ms.
cifar100       train : [loss = 1.996, top1 = 45.89%], valid : [loss = 2.143, top1 = 42.94%], test : [loss = 2.141, top1 = 43.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.55 ms.
ImageNet16-120 train : [loss = 3.213, top1 = 22.52%], valid : [loss = 3.232, top1 = 23.07%], test : [loss = 3.225, top1 = 22.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.305, top1 = 52.45%], valid : [loss = 1.352, top1 = 50.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15040/15625) 015040-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=106.09 M, Params=0.749 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.465, top1 = 89.53%]
cifar10        FLOP=106.09 M, Params=0.749 MB, latency=18.71 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.301, top1 = 92.81%]
cifar100       FLOP=106.09 M, Params=0.755 MB, latency=18.48 ms.
cifar100       train : [loss = 0.167, top1 = 96.35%], valid : [loss = 1.284, top1 = 69.02%], test : [loss = 1.275, top1 = 69.07%]
ImageNet16-120 FLOP= 26.53 M, Params=0.757 MB, latency=16.46 ms.
ImageNet16-120 train : [loss = 1.809, top1 = 51.92%], valid : [loss = 2.239, top1 = 42.58%], test : [loss = 2.255, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.34%], valid : [loss = 0.596, top1 = 79.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15041/15625) 015041-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=23.24 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.521, top1 = 89.55%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=18.92 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.324, top1 = 93.09%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=20.15 ms.
cifar100       train : [loss = 0.064, top1 = 98.97%], valid : [loss = 1.426, top1 = 68.50%], test : [loss = 1.404, top1 = 69.72%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.31 ms.
ImageNet16-120 train : [loss = 2.193, top1 = 42.85%], valid : [loss = 2.459, top1 = 38.37%], test : [loss = 2.436, top1 = 38.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.864, top1 = 68.97%], valid : [loss = 0.897, top1 = 67.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15042/15625) 015042-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.00 ms.
cifar10-valid  train : [loss = 0.250, top1 = 91.54%], valid : [loss = 0.511, top1 = 83.96%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.10 ms.
cifar10        train : [loss = 0.259, top1 = 91.22%], test  : [loss = 0.412, top1 = 86.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.66 ms.
cifar100       train : [loss = 1.377, top1 = 61.33%], valid : [loss = 1.620, top1 = 56.28%], test : [loss = 1.626, top1 = 56.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.06 ms.
ImageNet16-120 train : [loss = 2.852, top1 = 29.94%], valid : [loss = 2.845, top1 = 29.97%], test : [loss = 2.897, top1 = 29.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.987, top1 = 64.58%], valid : [loss = 1.030, top1 = 63.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15043/15625) 015043-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.70%], valid : [loss = 0.848, top1 = 82.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.75 ms.
cifar10        train : [loss = 0.041, top1 = 98.87%], test  : [loss = 0.607, top1 = 85.87%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.17 ms.
cifar100       train : [loss = 0.381, top1 = 89.60%], valid : [loss = 1.812, top1 = 58.32%], test : [loss = 1.807, top1 = 58.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.44 ms.
ImageNet16-120 train : [loss = 2.706, top1 = 32.69%], valid : [loss = 3.070, top1 = 27.10%], test : [loss = 3.094, top1 = 26.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.848, top1 = 69.62%], valid : [loss = 0.910, top1 = 67.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15044/15625) 015044-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.73 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.40%], valid : [loss = 0.499, top1 = 85.86%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.66 ms.
cifar10        train : [loss = 0.172, top1 = 94.19%], test  : [loss = 0.377, top1 = 88.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.96 ms.
cifar100       train : [loss = 0.957, top1 = 72.70%], valid : [loss = 1.382, top1 = 62.32%], test : [loss = 1.385, top1 = 61.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 2.689, top1 = 32.89%], valid : [loss = 2.728, top1 = 32.17%], test : [loss = 2.771, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.08%], valid : [loss = 0.942, top1 = 66.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15045/15625) 015045-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.45 ms.
cifar10-valid  train : [loss = 0.072, top1 = 98.13%], valid : [loss = 0.459, top1 = 86.96%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.113, top1 = 96.48%], test  : [loss = 0.328, top1 = 89.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.46 ms.
cifar100       train : [loss = 0.859, top1 = 75.68%], valid : [loss = 1.305, top1 = 64.18%], test : [loss = 1.284, top1 = 63.75%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=16.23 ms.
ImageNet16-120 train : [loss = 2.556, top1 = 35.56%], valid : [loss = 2.632, top1 = 34.06%], test : [loss = 2.672, top1 = 33.21%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.69%], valid : [loss = 0.657, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15046/15625) 015046-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.649, top1 = 87.16%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.30 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.429, top1 = 90.44%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.94 ms.
cifar100       train : [loss = 0.168, top1 = 96.27%], valid : [loss = 1.526, top1 = 65.82%], test : [loss = 1.597, top1 = 64.80%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.39 ms.
ImageNet16-120 train : [loss = 2.025, top1 = 47.11%], valid : [loss = 2.465, top1 = 38.47%], test : [loss = 2.487, top1 = 37.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.712, top1 = 74.62%], valid : [loss = 0.785, top1 = 72.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15047/15625) 015047-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10-valid  train : [loss = 0.257, top1 = 91.26%], valid : [loss = 0.561, top1 = 82.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10        train : [loss = 0.220, top1 = 92.45%], test  : [loss = 0.396, top1 = 87.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.74 ms.
cifar100       train : [loss = 1.350, top1 = 61.81%], valid : [loss = 1.621, top1 = 57.18%], test : [loss = 1.598, top1 = 56.28%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.769, top1 = 31.34%], valid : [loss = 2.779, top1 = 31.80%], test : [loss = 2.839, top1 = 30.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.966, top1 = 65.27%], valid : [loss = 1.025, top1 = 63.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15048/15625) 015048-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.94 ms.
cifar10-valid  train : [loss = 0.040, top1 = 99.22%], valid : [loss = 0.482, top1 = 87.21%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.056, top1 = 98.39%], test  : [loss = 0.358, top1 = 90.34%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.43 ms.
cifar100       train : [loss = 0.528, top1 = 84.81%], valid : [loss = 1.230, top1 = 67.09%], test : [loss = 1.191, top1 = 68.15%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.80 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.15%], valid : [loss = 2.361, top1 = 40.00%], test : [loss = 2.363, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.71%], valid : [loss = 0.819, top1 = 71.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15049/15625) 015049-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.59 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.430, top1 = 90.87%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.85 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.295, top1 = 93.50%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.89 ms.
cifar100       train : [loss = 0.056, top1 = 99.27%], valid : [loss = 1.372, top1 = 69.82%], test : [loss = 1.374, top1 = 70.56%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=19.92 ms.
ImageNet16-120 train : [loss = 1.512, top1 = 59.16%], valid : [loss = 2.244, top1 = 44.30%], test : [loss = 2.249, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.462, top1 = 84.15%], valid : [loss = 0.594, top1 = 80.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15050/15625) 015050-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.06%], valid : [loss = 0.536, top1 = 87.28%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.30 ms.
cifar10        train : [loss = 0.062, top1 = 98.06%], test  : [loss = 0.379, top1 = 89.33%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.28 ms.
cifar100       train : [loss = 0.677, top1 = 79.90%], valid : [loss = 1.333, top1 = 64.60%], test : [loss = 1.345, top1 = 64.74%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 2.500, top1 = 36.83%], valid : [loss = 2.621, top1 = 35.13%], test : [loss = 2.665, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.41%], valid : [loss = 0.676, top1 = 76.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15051/15625) 015051-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.72 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.28 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15052/15625) 015052-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.17%], valid : [loss = 0.542, top1 = 84.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.11 ms.
cifar10        train : [loss = 0.180, top1 = 93.95%], test  : [loss = 0.396, top1 = 87.80%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.82 ms.
cifar100       train : [loss = 1.208, top1 = 65.80%], valid : [loss = 1.527, top1 = 58.27%], test : [loss = 1.504, top1 = 58.19%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.24 ms.
ImageNet16-120 train : [loss = 2.608, top1 = 34.52%], valid : [loss = 2.673, top1 = 33.21%], test : [loss = 2.706, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.61%], valid : [loss = 0.938, top1 = 67.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15053/15625) 015053-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.18 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.07%], valid : [loss = 0.588, top1 = 86.50%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10        train : [loss = 0.111, top1 = 96.32%], test  : [loss = 0.399, top1 = 88.70%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.01 ms.
cifar100       train : [loss = 0.582, top1 = 83.24%], valid : [loss = 1.503, top1 = 61.30%], test : [loss = 1.472, top1 = 62.42%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.33 ms.
ImageNet16-120 train : [loss = 3.246, top1 = 20.46%], valid : [loss = 3.232, top1 = 21.20%], test : [loss = 3.242, top1 = 20.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.418, top1 = 48.34%], valid : [loss = 1.421, top1 = 48.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15054/15625) 015054-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.13 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.537, top1 = 88.90%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.70%], test  : [loss = 0.362, top1 = 92.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.34 ms.
cifar100       train : [loss = 0.192, top1 = 95.00%], valid : [loss = 1.362, top1 = 68.38%], test : [loss = 1.381, top1 = 67.58%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.977, top1 = 48.08%], valid : [loss = 2.304, top1 = 40.77%], test : [loss = 2.327, top1 = 41.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.36%], valid : [loss = 0.755, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15055/15625) 015055-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.11 ms.
cifar10-valid  train : [loss = 1.834, top1 = 33.75%], valid : [loss = 1.855, top1 = 33.12%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.69 ms.
cifar10        train : [loss = 1.334, top1 = 51.70%], test  : [loss = 1.333, top1 = 51.42%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.11 ms.
cifar100       train : [loss = 3.800, top1 = 11.96%], valid : [loss = 3.902, top1 = 10.33%], test : [loss = 3.896, top1 = 10.91%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.00 ms.
ImageNet16-120 train : [loss = 3.934, top1 = 11.32%], valid : [loss = 3.911, top1 = 12.02%], test : [loss = 3.918, top1 = 11.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.964, top1 = 27.53%], valid : [loss = 1.967, top1 = 27.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15056/15625) 015056-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.17 ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.22%], valid : [loss = 0.871, top1 = 71.49%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.78 ms.
cifar10        train : [loss = 0.555, top1 = 80.58%], test  : [loss = 0.725, top1 = 75.31%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.70 ms.
cifar100       train : [loss = 1.793, top1 = 51.51%], valid : [loss = 2.032, top1 = 47.64%], test : [loss = 2.077, top1 = 46.84%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.16 ms.
ImageNet16-120 train : [loss = 3.590, top1 = 16.67%], valid : [loss = 3.632, top1 = 17.10%], test : [loss = 3.644, top1 = 15.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15057/15625) 015057-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.618, top1 = 87.31%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.59 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.413, top1 = 91.22%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.09 ms.
cifar100       train : [loss = 0.207, top1 = 95.21%], valid : [loss = 1.436, top1 = 67.40%], test : [loss = 1.395, top1 = 67.22%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.94 ms.
ImageNet16-120 train : [loss = 2.075, top1 = 46.03%], valid : [loss = 2.521, top1 = 37.23%], test : [loss = 2.516, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.657, top1 = 76.62%], valid : [loss = 0.751, top1 = 74.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15058/15625) 015058-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.041, top1 = 98.93%], valid : [loss = 0.638, top1 = 84.69%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.14 ms.
cifar10        train : [loss = 0.083, top1 = 97.31%], test  : [loss = 0.390, top1 = 88.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.53 ms.
cifar100       train : [loss = 0.787, top1 = 77.02%], valid : [loss = 1.439, top1 = 62.22%], test : [loss = 1.406, top1 = 62.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.03 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.26%], valid : [loss = 2.717, top1 = 31.83%], test : [loss = 2.758, top1 = 32.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15059/15625) 015059-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.61 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.11 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.44 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15060/15625) 015060-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10-valid  train : [loss = 0.554, top1 = 80.71%], valid : [loss = 0.855, top1 = 71.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=14.10 ms.
cifar10        train : [loss = 0.558, top1 = 80.35%], test  : [loss = 0.714, top1 = 75.34%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.11 ms.
cifar100       train : [loss = 1.795, top1 = 51.62%], valid : [loss = 2.050, top1 = 47.48%], test : [loss = 2.073, top1 = 46.30%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.85%], valid : [loss = 3.636, top1 = 16.60%], test : [loss = 3.672, top1 = 15.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15061/15625) 015061-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.83 ms.
cifar10-valid  train : [loss = 0.420, top1 = 85.37%], valid : [loss = 0.666, top1 = 78.35%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10        train : [loss = 0.386, top1 = 86.67%], test  : [loss = 0.531, top1 = 82.01%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.25 ms.
cifar100       train : [loss = 1.567, top1 = 56.57%], valid : [loss = 1.819, top1 = 51.39%], test : [loss = 1.828, top1 = 51.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.88 ms.
ImageNet16-120 train : [loss = 3.260, top1 = 22.15%], valid : [loss = 3.273, top1 = 22.53%], test : [loss = 3.297, top1 = 22.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.183, top1 = 57.01%], valid : [loss = 1.222, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15062/15625) 015062-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.302, top1 = 89.50%], valid : [loss = 0.555, top1 = 82.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.64 ms.
cifar10        train : [loss = 0.280, top1 = 90.40%], test  : [loss = 0.435, top1 = 85.61%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.58 ms.
cifar100       train : [loss = 1.427, top1 = 59.94%], valid : [loss = 1.678, top1 = 54.74%], test : [loss = 1.652, top1 = 54.68%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.939, top1 = 27.96%], valid : [loss = 2.945, top1 = 27.67%], test : [loss = 2.997, top1 = 27.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.963, top1 = 65.42%], valid : [loss = 1.017, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15063/15625) 015063-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.29%], valid : [loss = 0.695, top1 = 76.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.68 ms.
cifar10        train : [loss = 0.546, top1 = 80.98%], test  : [loss = 0.610, top1 = 78.77%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.93 ms.
cifar100       train : [loss = 1.741, top1 = 52.52%], valid : [loss = 1.880, top1 = 50.42%], test : [loss = 1.912, top1 = 49.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 3.387, top1 = 19.99%], valid : [loss = 3.356, top1 = 20.93%], test : [loss = 3.408, top1 = 20.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.379, top1 = 49.75%], valid : [loss = 1.391, top1 = 49.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15064/15625) 015064-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.512, top1 = 88.79%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.09 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.343, top1 = 91.95%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.54 ms.
cifar100       train : [loss = 0.341, top1 = 90.67%], valid : [loss = 1.266, top1 = 67.20%], test : [loss = 1.261, top1 = 68.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=21.05 ms.
ImageNet16-120 train : [loss = 2.146, top1 = 44.30%], valid : [loss = 2.409, top1 = 38.90%], test : [loss = 2.413, top1 = 39.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.603, top1 = 79.03%], valid : [loss = 0.660, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15065/15625) 015065-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.400, top1 = 90.80%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.66 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.275, top1 = 93.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.24 ms.
cifar100       train : [loss = 0.089, top1 = 98.65%], valid : [loss = 1.299, top1 = 70.06%], test : [loss = 1.292, top1 = 70.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.77 ms.
ImageNet16-120 train : [loss = 1.628, top1 = 56.25%], valid : [loss = 2.215, top1 = 44.03%], test : [loss = 2.238, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.366, top1 = 87.38%], valid : [loss = 0.507, top1 = 83.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15066/15625) 015066-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.568, top1 = 87.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.026, top1 = 99.22%], test  : [loss = 0.352, top1 = 91.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.50 ms.
cifar100       train : [loss = 0.425, top1 = 87.70%], valid : [loss = 1.227, top1 = 67.82%], test : [loss = 1.235, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.198, top1 = 43.02%], valid : [loss = 2.398, top1 = 39.60%], test : [loss = 2.380, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15067/15625) 015067-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.81%], valid : [loss = 0.568, top1 = 88.27%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10        train : [loss = 0.015, top1 = 99.57%], test  : [loss = 0.373, top1 = 91.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.26 ms.
cifar100       train : [loss = 0.286, top1 = 92.04%], valid : [loss = 1.293, top1 = 67.96%], test : [loss = 1.311, top1 = 66.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 2.275, top1 = 41.31%], valid : [loss = 2.494, top1 = 36.83%], test : [loss = 2.455, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 69.89%], valid : [loss = 0.865, top1 = 69.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15068/15625) 015068-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.33 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.82 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.07 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15069/15625) 015069-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.33 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.35%], valid : [loss = 0.535, top1 = 84.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.65 ms.
cifar10        train : [loss = 0.180, top1 = 93.95%], test  : [loss = 0.391, top1 = 87.97%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.96 ms.
cifar100       train : [loss = 1.216, top1 = 65.56%], valid : [loss = 1.537, top1 = 58.17%], test : [loss = 1.508, top1 = 58.41%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.80 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.48%], valid : [loss = 2.663, top1 = 33.30%], test : [loss = 2.700, top1 = 32.31%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.57%], valid : [loss = 0.933, top1 = 67.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15070/15625) 015070-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.23 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.504, top1 = 89.78%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.317, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.86 ms.
cifar100       train : [loss = 0.135, top1 = 97.19%], valid : [loss = 1.396, top1 = 67.88%], test : [loss = 1.379, top1 = 68.50%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.69 ms.
ImageNet16-120 train : [loss = 1.668, top1 = 55.25%], valid : [loss = 2.198, top1 = 43.97%], test : [loss = 2.174, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.600, top1 = 79.21%], valid : [loss = 0.657, top1 = 77.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15071/15625) 015071-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.154, top1 = 94.73%], valid : [loss = 0.716, top1 = 80.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.99 ms.
cifar10        train : [loss = 0.193, top1 = 93.32%], test  : [loss = 0.528, top1 = 84.37%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.44 ms.
cifar100       train : [loss = 0.890, top1 = 74.00%], valid : [loss = 1.672, top1 = 57.28%], test : [loss = 1.701, top1 = 56.86%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 3.478, top1 = 17.24%], valid : [loss = 3.477, top1 = 17.97%], test : [loss = 3.494, top1 = 17.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.268, top1 = 53.63%], valid : [loss = 1.283, top1 = 52.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15072/15625) 015072-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.30 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.534, top1 = 88.35%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.32 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.318, top1 = 92.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 0.340, top1 = 90.67%], valid : [loss = 1.301, top1 = 66.58%], test : [loss = 1.273, top1 = 67.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 2.125, top1 = 44.79%], valid : [loss = 2.410, top1 = 38.83%], test : [loss = 2.416, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15073/15625) 015073-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.17%], valid : [loss = 0.851, top1 = 72.13%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.49 ms.
cifar10        train : [loss = 0.553, top1 = 80.74%], test  : [loss = 0.714, top1 = 75.92%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.24 ms.
cifar100       train : [loss = 1.771, top1 = 52.31%], valid : [loss = 2.042, top1 = 47.64%], test : [loss = 2.060, top1 = 47.74%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.79 ms.
ImageNet16-120 train : [loss = 3.586, top1 = 16.74%], valid : [loss = 3.643, top1 = 16.10%], test : [loss = 3.665, top1 = 15.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.174, top1 = 57.75%], valid : [loss = 1.247, top1 = 55.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15074/15625) 015074-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.245, top1 = 91.67%], valid : [loss = 0.514, top1 = 83.91%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.70 ms.
cifar10        train : [loss = 0.236, top1 = 91.90%], test  : [loss = 0.377, top1 = 87.52%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.14 ms.
cifar100       train : [loss = 1.411, top1 = 60.35%], valid : [loss = 1.677, top1 = 55.04%], test : [loss = 1.663, top1 = 55.52%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.07 ms.
ImageNet16-120 train : [loss = 2.946, top1 = 27.87%], valid : [loss = 2.951, top1 = 27.33%], test : [loss = 3.027, top1 = 26.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.984, top1 = 64.58%], valid : [loss = 1.017, top1 = 63.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15075/15625) 015075-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.31 ms.
cifar10-valid  train : [loss = 0.269, top1 = 91.02%], valid : [loss = 0.475, top1 = 84.46%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.301, top1 = 89.98%], test  : [loss = 0.402, top1 = 86.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.20 ms.
cifar100       train : [loss = 1.328, top1 = 63.22%], valid : [loss = 1.535, top1 = 57.81%], test : [loss = 1.514, top1 = 58.56%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.921, top1 = 28.64%], valid : [loss = 2.910, top1 = 28.92%], test : [loss = 2.966, top1 = 28.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15076/15625) 015076-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=23.82 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.492, top1 = 90.11%]
cifar10        FLOP=184.73 M, Params=1.289 MB, latency=21.89 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.327, top1 = 93.12%]
cifar100       FLOP=184.74 M, Params=1.294 MB, latency=21.73 ms.
cifar100       train : [loss = 0.051, top1 = 99.16%], valid : [loss = 1.367, top1 = 70.98%], test : [loss = 1.370, top1 = 71.22%]
ImageNet16-120 FLOP= 46.19 M, Params=1.296 MB, latency=20.98 ms.
ImageNet16-120 train : [loss = 2.224, top1 = 42.20%], valid : [loss = 2.497, top1 = 37.00%], test : [loss = 2.469, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=184.73 M, Params=1.289 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.48%], valid : [loss = 0.866, top1 = 69.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15077/15625) 015077-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.63 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.55 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.34 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15078/15625) 015078-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.23%], valid : [loss = 0.478, top1 = 85.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.19 ms.
cifar10        train : [loss = 0.159, top1 = 94.85%], test  : [loss = 0.339, top1 = 88.93%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.01 ms.
cifar100       train : [loss = 1.010, top1 = 71.13%], valid : [loss = 1.369, top1 = 61.97%], test : [loss = 1.365, top1 = 61.83%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.24 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.64%], valid : [loss = 2.697, top1 = 32.77%], test : [loss = 2.723, top1 = 31.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.743, top1 = 73.54%], valid : [loss = 0.796, top1 = 72.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15079/15625) 015079-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.99%], valid : [loss = 0.467, top1 = 86.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10        train : [loss = 0.152, top1 = 95.11%], test  : [loss = 0.343, top1 = 88.75%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.27 ms.
cifar100       train : [loss = 0.971, top1 = 72.44%], valid : [loss = 1.344, top1 = 62.46%], test : [loss = 1.354, top1 = 61.84%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.14 ms.
ImageNet16-120 train : [loss = 2.618, top1 = 34.14%], valid : [loss = 2.653, top1 = 33.60%], test : [loss = 2.700, top1 = 32.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.723, top1 = 74.40%], valid : [loss = 0.772, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15080/15625) 015080-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.461, top1 = 89.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.86 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.306, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.76 ms.
cifar100       train : [loss = 0.350, top1 = 90.25%], valid : [loss = 1.317, top1 = 67.30%], test : [loss = 1.287, top1 = 67.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.092, top1 = 45.49%], valid : [loss = 2.345, top1 = 40.23%], test : [loss = 2.416, top1 = 38.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.69%], valid : [loss = 0.629, top1 = 78.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15081/15625) 015081-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.48%], valid : [loss = 0.851, top1 = 79.37%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.13 ms.
cifar10        train : [loss = 0.136, top1 = 95.36%], test  : [loss = 0.554, top1 = 84.62%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.10 ms.
cifar100       train : [loss = 0.861, top1 = 74.89%], valid : [loss = 1.684, top1 = 56.46%], test : [loss = 1.678, top1 = 57.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.53 ms.
ImageNet16-120 train : [loss = 3.050, top1 = 26.09%], valid : [loss = 3.172, top1 = 24.63%], test : [loss = 3.208, top1 = 23.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.133, top1 = 58.96%], valid : [loss = 1.189, top1 = 57.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15082/15625) 015082-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.556, top1 = 88.05%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.73 ms.
cifar10        train : [loss = 0.018, top1 = 99.57%], test  : [loss = 0.355, top1 = 91.51%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=21.58 ms.
cifar100       train : [loss = 0.337, top1 = 90.49%], valid : [loss = 1.300, top1 = 67.04%], test : [loss = 1.292, top1 = 66.98%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 2.207, top1 = 42.97%], valid : [loss = 2.455, top1 = 37.30%], test : [loss = 2.463, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.83%], valid : [loss = 0.816, top1 = 71.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15083/15625) 015083-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.478, top1 = 89.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.89 ms.
cifar10        train : [loss = 0.008, top1 = 99.87%], test  : [loss = 0.324, top1 = 92.58%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.86 ms.
cifar100       train : [loss = 0.162, top1 = 96.21%], valid : [loss = 1.350, top1 = 68.94%], test : [loss = 1.344, top1 = 68.08%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 1.827, top1 = 51.51%], valid : [loss = 2.293, top1 = 42.37%], test : [loss = 2.323, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.475, top1 = 83.50%], valid : [loss = 0.582, top1 = 80.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15084/15625) 015084-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.512, top1 = 89.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.330, top1 = 92.96%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.67 ms.
cifar100       train : [loss = 0.130, top1 = 97.04%], valid : [loss = 1.370, top1 = 68.65%], test : [loss = 1.357, top1 = 68.91%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.38 ms.
ImageNet16-120 train : [loss = 1.731, top1 = 53.77%], valid : [loss = 2.192, top1 = 43.71%], test : [loss = 2.205, top1 = 43.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.595, top1 = 79.52%], valid : [loss = 0.658, top1 = 77.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15085/15625) 015085-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.79%], valid : [loss = 0.515, top1 = 83.93%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.65 ms.
cifar10        train : [loss = 0.230, top1 = 92.33%], test  : [loss = 0.398, top1 = 86.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.06 ms.
cifar100       train : [loss = 1.263, top1 = 64.46%], valid : [loss = 1.560, top1 = 56.96%], test : [loss = 1.529, top1 = 57.76%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.993, top1 = 26.41%], valid : [loss = 2.983, top1 = 26.97%], test : [loss = 3.003, top1 = 26.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15086/15625) 015086-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.22%], valid : [loss = 0.885, top1 = 77.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.47 ms.
cifar10        train : [loss = 0.153, top1 = 94.70%], test  : [loss = 0.561, top1 = 84.29%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.15 ms.
cifar100       train : [loss = 0.938, top1 = 72.80%], valid : [loss = 1.735, top1 = 55.32%], test : [loss = 1.721, top1 = 56.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.02 ms.
ImageNet16-120 train : [loss = 3.049, top1 = 26.12%], valid : [loss = 3.179, top1 = 23.70%], test : [loss = 3.182, top1 = 22.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.051, top1 = 62.24%], valid : [loss = 1.107, top1 = 60.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15087/15625) 015087-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.567, top1 = 88.61%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.62 ms.
cifar10        train : [loss = 0.005, top1 = 99.86%], test  : [loss = 0.392, top1 = 92.06%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.61 ms.
cifar100       train : [loss = 0.094, top1 = 98.42%], valid : [loss = 1.458, top1 = 68.16%], test : [loss = 1.496, top1 = 67.36%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=23.82 ms.
ImageNet16-120 train : [loss = 1.874, top1 = 50.46%], valid : [loss = 2.461, top1 = 39.00%], test : [loss = 2.495, top1 = 39.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.73%], valid : [loss = 0.733, top1 = 74.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15088/15625) 015088-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.94 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.57%], valid : [loss = 0.636, top1 = 85.78%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.08 ms.
cifar10        train : [loss = 0.030, top1 = 99.16%], test  : [loss = 0.390, top1 = 90.37%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.43 ms.
cifar100       train : [loss = 0.509, top1 = 85.24%], valid : [loss = 1.448, top1 = 63.04%], test : [loss = 1.457, top1 = 63.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.387, top1 = 39.06%], valid : [loss = 2.559, top1 = 35.70%], test : [loss = 2.594, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.46%], valid : [loss = 0.834, top1 = 70.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15089/15625) 015089-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.11 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.495, top1 = 90.14%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.63 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.314, top1 = 93.47%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.43 ms.
cifar100       train : [loss = 0.083, top1 = 98.36%], valid : [loss = 1.322, top1 = 70.00%], test : [loss = 1.356, top1 = 70.38%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.19 ms.
ImageNet16-120 train : [loss = 1.613, top1 = 56.68%], valid : [loss = 2.137, top1 = 46.47%], test : [loss = 2.176, top1 = 45.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.26%], valid : [loss = 0.592, top1 = 79.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15090/15625) 015090-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.543, top1 = 88.91%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.92 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.345, top1 = 92.94%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=13.92 ms.
cifar100       train : [loss = 0.108, top1 = 98.11%], valid : [loss = 1.418, top1 = 68.52%], test : [loss = 1.443, top1 = 68.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 1.849, top1 = 51.01%], valid : [loss = 2.404, top1 = 40.47%], test : [loss = 2.391, top1 = 41.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.71%], valid : [loss = 0.708, top1 = 75.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15091/15625) 015091-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.575, top1 = 87.42%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.05 ms.
cifar10        train : [loss = 0.015, top1 = 99.69%], test  : [loss = 0.398, top1 = 90.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.04 ms.
cifar100       train : [loss = 0.396, top1 = 88.88%], valid : [loss = 1.364, top1 = 66.08%], test : [loss = 1.371, top1 = 65.78%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.311, top1 = 40.82%], valid : [loss = 2.537, top1 = 36.67%], test : [loss = 2.531, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.06%], valid : [loss = 0.776, top1 = 72.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15092/15625) 015092-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.43 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.431, top1 = 90.38%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.284, top1 = 93.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.51 ms.
cifar100       train : [loss = 0.145, top1 = 96.80%], valid : [loss = 1.268, top1 = 70.02%], test : [loss = 1.237, top1 = 70.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 1.734, top1 = 53.80%], valid : [loss = 2.227, top1 = 43.03%], test : [loss = 2.239, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.60%], valid : [loss = 0.515, top1 = 82.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15093/15625) 015093-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.38 ms.
cifar10-valid  train : [loss = 0.231, top1 = 92.11%], valid : [loss = 0.650, top1 = 80.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10        train : [loss = 0.203, top1 = 93.02%], test  : [loss = 0.492, top1 = 84.89%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.20 ms.
cifar100       train : [loss = 1.008, top1 = 70.88%], valid : [loss = 1.716, top1 = 55.76%], test : [loss = 1.726, top1 = 54.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 3.595, top1 = 15.03%], valid : [loss = 3.575, top1 = 15.47%], test : [loss = 3.585, top1 = 14.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.424, top1 = 47.40%], valid : [loss = 1.428, top1 = 47.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15094/15625) 015094-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.569, top1 = 88.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.404, top1 = 91.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.46 ms.
cifar100       train : [loss = 0.169, top1 = 96.09%], valid : [loss = 1.476, top1 = 65.84%], test : [loss = 1.449, top1 = 66.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.25 ms.
ImageNet16-120 train : [loss = 2.105, top1 = 45.42%], valid : [loss = 2.515, top1 = 37.93%], test : [loss = 2.546, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.30%], valid : [loss = 0.686, top1 = 76.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15095/15625) 015095-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.12 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.46%], valid : [loss = 0.785, top1 = 82.74%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.00 ms.
cifar10        train : [loss = 0.046, top1 = 98.62%], test  : [loss = 0.437, top1 = 89.14%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.98 ms.
cifar100       train : [loss = 0.533, top1 = 84.80%], valid : [loss = 1.554, top1 = 60.74%], test : [loss = 1.575, top1 = 61.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.88 ms.
ImageNet16-120 train : [loss = 2.428, top1 = 38.18%], valid : [loss = 2.708, top1 = 33.13%], test : [loss = 2.723, top1 = 34.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.06%], valid : [loss = 0.893, top1 = 68.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15096/15625) 015096-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.79 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.648, top1 = 86.63%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.96 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.434, top1 = 90.75%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.67 ms.
cifar100       train : [loss = 0.188, top1 = 95.69%], valid : [loss = 1.542, top1 = 64.78%], test : [loss = 1.486, top1 = 66.48%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.90 ms.
ImageNet16-120 train : [loss = 2.106, top1 = 45.24%], valid : [loss = 2.538, top1 = 36.17%], test : [loss = 2.592, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.19%], valid : [loss = 0.807, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15097/15625) 015097-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.08 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.84%], valid : [loss = 0.534, top1 = 83.63%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.27 ms.
cifar10        train : [loss = 0.202, top1 = 93.11%], test  : [loss = 0.399, top1 = 87.39%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.50 ms.
cifar100       train : [loss = 1.325, top1 = 62.75%], valid : [loss = 1.620, top1 = 55.86%], test : [loss = 1.621, top1 = 56.48%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 2.739, top1 = 32.00%], valid : [loss = 2.795, top1 = 30.73%], test : [loss = 2.807, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.950, top1 = 65.73%], valid : [loss = 0.999, top1 = 64.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15098/15625) 015098-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.179, top1 = 94.12%], valid : [loss = 0.530, top1 = 84.25%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10        train : [loss = 0.184, top1 = 93.87%], test  : [loss = 0.383, top1 = 88.05%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.14 ms.
cifar100       train : [loss = 1.186, top1 = 66.33%], valid : [loss = 1.508, top1 = 58.63%], test : [loss = 1.500, top1 = 59.13%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.70 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.29%], valid : [loss = 2.729, top1 = 32.28%], test : [loss = 2.742, top1 = 31.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.20%], valid : [loss = 0.954, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15099/15625) 015099-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.243, top1 = 91.75%], valid : [loss = 0.521, top1 = 83.87%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.53 ms.
cifar10        train : [loss = 0.252, top1 = 91.41%], test  : [loss = 0.399, top1 = 86.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.39 ms.
cifar100       train : [loss = 1.430, top1 = 60.07%], valid : [loss = 1.698, top1 = 54.00%], test : [loss = 1.671, top1 = 54.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.19 ms.
ImageNet16-120 train : [loss = 2.944, top1 = 27.95%], valid : [loss = 2.953, top1 = 28.09%], test : [loss = 3.020, top1 = 27.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.94%], valid : [loss = 1.001, top1 = 64.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15100/15625) 015100-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.586, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.385, top1 = 91.43%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.11 ms.
cifar100       train : [loss = 0.220, top1 = 94.76%], valid : [loss = 1.399, top1 = 66.44%], test : [loss = 1.370, top1 = 66.86%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.67 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.25%], valid : [loss = 2.465, top1 = 38.70%], test : [loss = 2.531, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.651, top1 = 76.94%], valid : [loss = 0.736, top1 = 74.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15101/15625) 015101-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.588, top1 = 87.38%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.374, top1 = 91.11%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.83 ms.
cifar100       train : [loss = 0.402, top1 = 88.56%], valid : [loss = 1.422, top1 = 65.52%], test : [loss = 1.409, top1 = 65.35%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.70 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.13%], valid : [loss = 2.506, top1 = 36.50%], test : [loss = 2.521, top1 = 37.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.49%], valid : [loss = 0.760, top1 = 73.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15102/15625) 015102-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.467, top1 = 89.24%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.325, top1 = 92.18%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.53 ms.
cifar100       train : [loss = 0.328, top1 = 91.15%], valid : [loss = 1.262, top1 = 67.62%], test : [loss = 1.209, top1 = 68.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.24 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.64%], valid : [loss = 2.324, top1 = 40.03%], test : [loss = 2.347, top1 = 40.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.64%], valid : [loss = 0.603, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15103/15625) 015103-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.28 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.66%], valid : [loss = 0.609, top1 = 86.05%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.59 ms.
cifar10        train : [loss = 0.031, top1 = 99.17%], test  : [loss = 0.399, top1 = 90.17%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.501, top1 = 85.37%], valid : [loss = 1.398, top1 = 64.40%], test : [loss = 1.385, top1 = 64.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 39.01%], valid : [loss = 2.565, top1 = 35.30%], test : [loss = 2.591, top1 = 35.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.82%], valid : [loss = 0.805, top1 = 71.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15104/15625) 015104-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.78 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.31%], valid : [loss = 0.588, top1 = 85.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.88 ms.
cifar10        train : [loss = 0.068, top1 = 97.89%], test  : [loss = 0.393, top1 = 89.11%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.10 ms.
cifar100       train : [loss = 0.702, top1 = 79.50%], valid : [loss = 1.381, top1 = 63.56%], test : [loss = 1.364, top1 = 63.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.32 ms.
ImageNet16-120 train : [loss = 2.521, top1 = 36.34%], valid : [loss = 2.639, top1 = 34.35%], test : [loss = 2.655, top1 = 33.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.72%], valid : [loss = 0.769, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15105/15625) 015105-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.02 ms.
cifar10-valid  train : [loss = 0.090, top1 = 97.34%], valid : [loss = 0.548, top1 = 85.34%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.48 ms.
cifar10        train : [loss = 0.135, top1 = 95.50%], test  : [loss = 0.384, top1 = 88.32%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.64 ms.
cifar100       train : [loss = 0.863, top1 = 74.69%], valid : [loss = 1.426, top1 = 62.60%], test : [loss = 1.422, top1 = 61.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.73 ms.
ImageNet16-120 train : [loss = 2.582, top1 = 34.96%], valid : [loss = 2.624, top1 = 33.83%], test : [loss = 2.677, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 68.83%], valid : [loss = 0.913, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15106/15625) 015106-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.066, top1 = 97.94%], valid : [loss = 0.576, top1 = 85.65%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.61 ms.
cifar10        train : [loss = 0.099, top1 = 96.73%], test  : [loss = 0.395, top1 = 88.98%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.05 ms.
cifar100       train : [loss = 0.703, top1 = 79.33%], valid : [loss = 1.464, top1 = 62.68%], test : [loss = 1.390, top1 = 62.64%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.93 ms.
ImageNet16-120 train : [loss = 2.473, top1 = 36.92%], valid : [loss = 2.626, top1 = 33.70%], test : [loss = 2.620, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.071, top1 = 60.98%], valid : [loss = 1.087, top1 = 60.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15107/15625) 015107-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.537, top1 = 88.31%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=15.48 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.337, top1 = 91.87%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=14.40 ms.
cifar100       train : [loss = 0.360, top1 = 90.04%], valid : [loss = 1.287, top1 = 67.09%], test : [loss = 1.303, top1 = 66.62%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.70%], valid : [loss = 2.418, top1 = 39.36%], test : [loss = 2.410, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.738, top1 = 74.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15108/15625) 015108-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.27 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.536, top1 = 88.22%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.43 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.328, top1 = 92.16%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.68 ms.
cifar100       train : [loss = 0.359, top1 = 90.12%], valid : [loss = 1.258, top1 = 67.06%], test : [loss = 1.277, top1 = 67.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.47 ms.
ImageNet16-120 train : [loss = 2.127, top1 = 44.64%], valid : [loss = 2.404, top1 = 38.67%], test : [loss = 2.424, top1 = 38.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15109/15625) 015109-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.35 ms.
cifar10-valid  train : [loss = 0.062, top1 = 98.19%], valid : [loss = 0.589, top1 = 85.44%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.54 ms.
cifar10        train : [loss = 0.105, top1 = 96.57%], test  : [loss = 0.382, top1 = 89.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.64 ms.
cifar100       train : [loss = 0.833, top1 = 75.76%], valid : [loss = 1.435, top1 = 61.82%], test : [loss = 1.411, top1 = 62.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.97 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 32.88%], valid : [loss = 2.767, top1 = 30.67%], test : [loss = 2.806, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15110/15625) 015110-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.57 ms.
cifar10-valid  train : [loss = 0.087, top1 = 97.38%], valid : [loss = 0.821, top1 = 80.13%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.82 ms.
cifar10        train : [loss = 0.137, top1 = 95.39%], test  : [loss = 0.552, top1 = 84.76%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.15 ms.
cifar100       train : [loss = 0.848, top1 = 75.45%], valid : [loss = 1.670, top1 = 57.68%], test : [loss = 1.684, top1 = 57.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.46 ms.
ImageNet16-120 train : [loss = 3.045, top1 = 26.34%], valid : [loss = 3.175, top1 = 24.30%], test : [loss = 3.240, top1 = 23.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.986, top1 = 64.70%], valid : [loss = 1.053, top1 = 62.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15111/15625) 015111-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.104, top1 = 96.94%], valid : [loss = 0.458, top1 = 86.36%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.10 ms.
cifar10        train : [loss = 0.135, top1 = 95.68%], test  : [loss = 0.347, top1 = 89.23%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.85 ms.
cifar100       train : [loss = 0.833, top1 = 76.48%], valid : [loss = 1.307, top1 = 63.92%], test : [loss = 1.325, top1 = 63.30%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.51 ms.
ImageNet16-120 train : [loss = 2.516, top1 = 36.15%], valid : [loss = 2.625, top1 = 34.50%], test : [loss = 2.643, top1 = 33.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.899, top1 = 67.82%], valid : [loss = 0.922, top1 = 67.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15112/15625) 015112-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.75 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.05 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.74 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15113/15625) 015113-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.26 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.586, top1 = 87.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.50 ms.
cifar10        train : [loss = 0.016, top1 = 99.59%], test  : [loss = 0.372, top1 = 91.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.60 ms.
cifar100       train : [loss = 0.300, top1 = 91.54%], valid : [loss = 1.304, top1 = 67.40%], test : [loss = 1.331, top1 = 66.94%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.54 ms.
ImageNet16-120 train : [loss = 2.183, top1 = 43.37%], valid : [loss = 2.451, top1 = 37.37%], test : [loss = 2.414, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.856, top1 = 69.18%], valid : [loss = 0.893, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15114/15625) 015114-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.06 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.526, top1 = 88.92%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.78 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.341, top1 = 92.10%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.10 ms.
cifar100       train : [loss = 0.228, top1 = 94.35%], valid : [loss = 1.270, top1 = 68.72%], test : [loss = 1.264, top1 = 68.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 1.922, top1 = 49.32%], valid : [loss = 2.292, top1 = 42.00%], test : [loss = 2.297, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.42%], valid : [loss = 0.692, top1 = 76.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15115/15625) 015115-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.97 ms.
cifar10        train : [loss = 2.303, top1 = 9.97%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.30 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.35 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15116/15625) 015116-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.88 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.44%], valid : [loss = 0.599, top1 = 86.89%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.80 ms.
cifar10        train : [loss = 0.017, top1 = 99.51%], test  : [loss = 0.386, top1 = 91.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.30 ms.
cifar100       train : [loss = 0.345, top1 = 90.44%], valid : [loss = 1.459, top1 = 63.94%], test : [loss = 1.397, top1 = 65.48%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.80 ms.
ImageNet16-120 train : [loss = 2.732, top1 = 30.92%], valid : [loss = 2.810, top1 = 29.73%], test : [loss = 2.818, top1 = 29.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.194, top1 = 56.08%], valid : [loss = 1.197, top1 = 56.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15117/15625) 015117-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.182, top1 = 94.20%], valid : [loss = 0.558, top1 = 83.67%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.182, top1 = 93.78%], test  : [loss = 0.394, top1 = 87.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.56 ms.
cifar100       train : [loss = 1.183, top1 = 66.17%], valid : [loss = 1.524, top1 = 58.26%], test : [loss = 1.514, top1 = 58.54%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.01%], valid : [loss = 2.707, top1 = 31.67%], test : [loss = 2.735, top1 = 32.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.898, top1 = 67.97%], valid : [loss = 0.950, top1 = 66.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15118/15625) 015118-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10-valid  train : [loss = 0.117, top1 = 96.46%], valid : [loss = 0.464, top1 = 86.14%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.79 ms.
cifar10        train : [loss = 0.162, top1 = 94.74%], test  : [loss = 0.339, top1 = 88.79%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.53 ms.
cifar100       train : [loss = 1.011, top1 = 71.35%], valid : [loss = 1.372, top1 = 61.74%], test : [loss = 1.372, top1 = 61.24%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.661, top1 = 33.32%], valid : [loss = 2.719, top1 = 32.57%], test : [loss = 2.734, top1 = 31.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15119/15625) 015119-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.466, top1 = 89.50%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10        train : [loss = 0.010, top1 = 99.82%], test  : [loss = 0.328, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.213, top1 = 94.87%], valid : [loss = 1.272, top1 = 68.68%], test : [loss = 1.263, top1 = 69.12%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 1.842, top1 = 51.32%], valid : [loss = 2.261, top1 = 41.47%], test : [loss = 2.267, top1 = 43.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.00%], valid : [loss = 0.536, top1 = 81.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15120/15625) 015120-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.06 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.472, top1 = 89.58%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.28 ms.
cifar10        train : [loss = 0.011, top1 = 99.76%], test  : [loss = 0.306, top1 = 92.55%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.82 ms.
cifar100       train : [loss = 0.248, top1 = 93.58%], valid : [loss = 1.235, top1 = 68.69%], test : [loss = 1.234, top1 = 68.97%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.16 ms.
ImageNet16-120 train : [loss = 1.880, top1 = 50.18%], valid : [loss = 2.225, top1 = 42.15%], test : [loss = 2.223, top1 = 42.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.59%], valid : [loss = 0.598, top1 = 79.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15121/15625) 015121-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.165, top1 = 94.62%], valid : [loss = 0.944, top1 = 75.92%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.31 ms.
cifar10        train : [loss = 0.203, top1 = 93.00%], test  : [loss = 0.593, top1 = 82.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.92 ms.
cifar100       train : [loss = 1.173, top1 = 66.61%], valid : [loss = 1.766, top1 = 53.54%], test : [loss = 1.736, top1 = 55.14%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.69 ms.
ImageNet16-120 train : [loss = 3.227, top1 = 22.79%], valid : [loss = 3.341, top1 = 21.23%], test : [loss = 3.391, top1 = 20.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15122/15625) 015122-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.62%], valid : [loss = 0.566, top1 = 87.67%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.74 ms.
cifar10        train : [loss = 0.024, top1 = 99.28%], test  : [loss = 0.369, top1 = 91.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.381, top1 = 88.93%], valid : [loss = 1.283, top1 = 66.96%], test : [loss = 1.302, top1 = 67.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.77 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.13%], valid : [loss = 2.395, top1 = 39.90%], test : [loss = 2.369, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.34%], valid : [loss = 0.869, top1 = 69.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15123/15625) 015123-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.515, top1 = 89.75%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.56 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.321, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=20.75 ms.
cifar100       train : [loss = 0.069, top1 = 98.91%], valid : [loss = 1.357, top1 = 69.74%], test : [loss = 1.325, top1 = 70.40%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.66 ms.
ImageNet16-120 train : [loss = 2.026, top1 = 46.72%], valid : [loss = 2.406, top1 = 38.83%], test : [loss = 2.396, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.741, top1 = 73.84%], valid : [loss = 0.782, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15124/15625) 015124-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.62 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.484, top1 = 88.62%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.96 ms.
cifar10        train : [loss = 0.022, top1 = 99.45%], test  : [loss = 0.345, top1 = 91.49%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.69 ms.
cifar100       train : [loss = 0.409, top1 = 88.06%], valid : [loss = 1.274, top1 = 67.08%], test : [loss = 1.335, top1 = 66.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.31 ms.
ImageNet16-120 train : [loss = 2.176, top1 = 43.57%], valid : [loss = 2.372, top1 = 39.57%], test : [loss = 2.451, top1 = 37.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.41%], valid : [loss = 0.670, top1 = 77.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15125/15625) 015125-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.78 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.38%], valid : [loss = 0.562, top1 = 87.07%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.60 ms.
cifar10        train : [loss = 0.050, top1 = 98.46%], test  : [loss = 0.383, top1 = 89.74%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.49 ms.
cifar100       train : [loss = 0.569, top1 = 83.43%], valid : [loss = 1.336, top1 = 64.60%], test : [loss = 1.330, top1 = 65.22%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.79 ms.
ImageNet16-120 train : [loss = 2.295, top1 = 40.94%], valid : [loss = 2.454, top1 = 37.60%], test : [loss = 2.455, top1 = 36.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.88%], valid : [loss = 0.745, top1 = 74.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15126/15625) 015126-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.53 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.77%], valid : [loss = 0.566, top1 = 87.22%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.024, top1 = 99.37%], test  : [loss = 0.386, top1 = 90.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=10.99 ms.
cifar100       train : [loss = 0.481, top1 = 86.10%], valid : [loss = 1.392, top1 = 65.18%], test : [loss = 1.396, top1 = 64.76%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 2.314, top1 = 40.63%], valid : [loss = 2.461, top1 = 38.53%], test : [loss = 2.503, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.758, top1 = 72.84%], valid : [loss = 0.823, top1 = 70.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15127/15625) 015127-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.61%], valid : [loss = 0.612, top1 = 86.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.68 ms.
cifar10        train : [loss = 0.031, top1 = 99.09%], test  : [loss = 0.390, top1 = 90.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.51 ms.
cifar100       train : [loss = 0.541, top1 = 84.19%], valid : [loss = 1.432, top1 = 63.48%], test : [loss = 1.434, top1 = 63.72%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.72 ms.
ImageNet16-120 train : [loss = 2.396, top1 = 38.88%], valid : [loss = 2.568, top1 = 35.93%], test : [loss = 2.631, top1 = 34.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.824, top1 = 70.68%], valid : [loss = 0.877, top1 = 69.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15128/15625) 015128-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=21.02 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.479, top1 = 89.79%]
cifar10        FLOP= 94.29 M, Params=0.671 MB, latency=23.69 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.304, top1 = 93.11%]
cifar100       FLOP= 94.30 M, Params=0.677 MB, latency=20.53 ms.
cifar100       train : [loss = 0.125, top1 = 97.66%], valid : [loss = 1.296, top1 = 69.74%], test : [loss = 1.250, top1 = 70.14%]
ImageNet16-120 FLOP= 23.58 M, Params=0.679 MB, latency=27.68 ms.
ImageNet16-120 train : [loss = 1.605, top1 = 56.99%], valid : [loss = 2.160, top1 = 44.27%], test : [loss = 2.169, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.671 MB, latency=None ms.
cifar10-valid  train : [loss = 0.610, top1 = 78.83%], valid : [loss = 0.684, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15129/15625) 015129-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.89%], valid : [loss = 0.513, top1 = 88.91%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.82 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.317, top1 = 92.10%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.45 ms.
cifar100       train : [loss = 0.227, top1 = 94.38%], valid : [loss = 1.190, top1 = 69.34%], test : [loss = 1.273, top1 = 68.80%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 1.825, top1 = 51.66%], valid : [loss = 2.202, top1 = 43.53%], test : [loss = 2.230, top1 = 43.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.553, top1 = 80.67%], valid : [loss = 0.653, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15130/15625) 015130-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.76 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.459, top1 = 89.07%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.326, top1 = 91.95%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.50 ms.
cifar100       train : [loss = 0.330, top1 = 91.14%], valid : [loss = 1.333, top1 = 66.43%], test : [loss = 1.314, top1 = 66.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.76 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.23%], valid : [loss = 2.357, top1 = 40.13%], test : [loss = 2.413, top1 = 39.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15131/15625) 015131-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.32 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.531, top1 = 89.23%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.32 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.33%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=15.61 ms.
cifar100       train : [loss = 0.062, top1 = 99.05%], valid : [loss = 1.385, top1 = 69.68%], test : [loss = 1.345, top1 = 70.10%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 1.786, top1 = 52.49%], valid : [loss = 2.280, top1 = 41.93%], test : [loss = 2.273, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.636, top1 = 77.65%], valid : [loss = 0.707, top1 = 75.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15132/15625) 015132-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.84 ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.78%], valid : [loss = 0.966, top1 = 66.91%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.51 ms.
cifar10        train : [loss = 0.789, top1 = 72.19%], test  : [loss = 0.864, top1 = 69.76%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.83 ms.
cifar100       train : [loss = 2.155, top1 = 43.52%], valid : [loss = 2.314, top1 = 40.80%], test : [loss = 2.332, top1 = 40.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.54 ms.
ImageNet16-120 train : [loss = 3.751, top1 = 14.04%], valid : [loss = 3.777, top1 = 14.20%], test : [loss = 3.772, top1 = 14.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.455, top1 = 47.04%], valid : [loss = 1.486, top1 = 46.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15133/15625) 015133-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.98 ms.
cifar10-valid  train : [loss = 0.690, top1 = 75.81%], valid : [loss = 0.862, top1 = 70.33%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.94 ms.
cifar10        train : [loss = 0.657, top1 = 77.10%], test  : [loss = 0.751, top1 = 73.94%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=7.67 ms.
cifar100       train : [loss = 1.967, top1 = 47.60%], valid : [loss = 2.129, top1 = 44.64%], test : [loss = 2.159, top1 = 44.38%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.45 ms.
ImageNet16-120 train : [loss = 3.655, top1 = 15.72%], valid : [loss = 3.677, top1 = 15.27%], test : [loss = 3.707, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15134/15625) 015134-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.258, top1 = 91.28%], valid : [loss = 0.971, top1 = 73.08%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.27 ms.
cifar10        train : [loss = 0.316, top1 = 88.96%], test  : [loss = 0.693, top1 = 78.53%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.48 ms.
cifar100       train : [loss = 1.303, top1 = 63.02%], valid : [loss = 1.934, top1 = 50.40%], test : [loss = 1.909, top1 = 50.48%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 3.266, top1 = 21.92%], valid : [loss = 3.356, top1 = 20.47%], test : [loss = 3.420, top1 = 19.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.107, top1 = 60.06%], valid : [loss = 1.163, top1 = 58.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15135/15625) 015135-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.39%], valid : [loss = 0.636, top1 = 85.66%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.035, top1 = 98.94%], test  : [loss = 0.421, top1 = 89.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.49 ms.
cifar100       train : [loss = 0.595, top1 = 82.47%], valid : [loss = 1.481, top1 = 61.78%], test : [loss = 1.465, top1 = 61.84%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.12 ms.
ImageNet16-120 train : [loss = 2.400, top1 = 38.68%], valid : [loss = 2.592, top1 = 34.53%], test : [loss = 2.618, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.831, top1 = 70.22%], valid : [loss = 0.889, top1 = 68.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15136/15625) 015136-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.48 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.94%], valid : [loss = 0.575, top1 = 88.61%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.76 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.370, top1 = 92.35%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.10 ms.
cifar100       train : [loss = 0.107, top1 = 98.06%], valid : [loss = 1.495, top1 = 68.14%], test : [loss = 1.438, top1 = 68.32%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.44 ms.
ImageNet16-120 train : [loss = 1.914, top1 = 49.65%], valid : [loss = 2.439, top1 = 39.13%], test : [loss = 2.445, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.665, top1 = 76.40%], valid : [loss = 0.748, top1 = 74.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15137/15625) 015137-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.128, top1 = 95.93%], valid : [loss = 0.460, top1 = 86.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.157, top1 = 94.85%], test  : [loss = 0.353, top1 = 88.82%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.78 ms.
cifar100       train : [loss = 0.990, top1 = 71.78%], valid : [loss = 1.333, top1 = 62.66%], test : [loss = 1.324, top1 = 63.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.26 ms.
ImageNet16-120 train : [loss = 2.635, top1 = 33.65%], valid : [loss = 2.684, top1 = 33.37%], test : [loss = 2.735, top1 = 31.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15138/15625) 015138-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.483, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.14 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.311, top1 = 92.33%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.38 ms.
cifar100       train : [loss = 0.318, top1 = 91.47%], valid : [loss = 1.256, top1 = 67.44%], test : [loss = 1.251, top1 = 68.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.77 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.71%], valid : [loss = 2.314, top1 = 40.63%], test : [loss = 2.345, top1 = 40.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.572, top1 = 79.98%], valid : [loss = 0.650, top1 = 77.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15139/15625) 015139-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.430, top1 = 89.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.56 ms.
cifar10        train : [loss = 0.008, top1 = 99.91%], test  : [loss = 0.299, top1 = 92.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.43 ms.
cifar100       train : [loss = 0.206, top1 = 95.24%], valid : [loss = 1.260, top1 = 69.30%], test : [loss = 1.280, top1 = 69.02%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.95 ms.
ImageNet16-120 train : [loss = 1.878, top1 = 50.34%], valid : [loss = 2.301, top1 = 41.63%], test : [loss = 2.287, top1 = 41.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.396, top1 = 86.41%], valid : [loss = 0.518, top1 = 82.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15140/15625) 015140-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.65 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.579, top1 = 88.01%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.399, top1 = 91.56%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.40 ms.
cifar100       train : [loss = 0.096, top1 = 98.63%], valid : [loss = 1.472, top1 = 66.78%], test : [loss = 1.434, top1 = 67.84%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.20 ms.
ImageNet16-120 train : [loss = 1.887, top1 = 50.20%], valid : [loss = 2.403, top1 = 40.00%], test : [loss = 2.425, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.624, top1 = 77.79%], valid : [loss = 0.729, top1 = 74.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15141/15625) 015141-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.516, top1 = 89.79%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.80 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.326, top1 = 93.09%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.72 ms.
cifar100       train : [loss = 0.072, top1 = 98.82%], valid : [loss = 1.363, top1 = 69.57%], test : [loss = 1.350, top1 = 69.99%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.35 ms.
ImageNet16-120 train : [loss = 1.662, top1 = 55.38%], valid : [loss = 2.216, top1 = 44.19%], test : [loss = 2.198, top1 = 44.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.92%], valid : [loss = 0.647, top1 = 77.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15142/15625) 015142-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.62 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.504, top1 = 88.70%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.07 ms.
cifar10        train : [loss = 0.015, top1 = 99.68%], test  : [loss = 0.316, top1 = 92.30%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.06 ms.
cifar100       train : [loss = 0.286, top1 = 92.55%], valid : [loss = 1.201, top1 = 69.20%], test : [loss = 1.191, top1 = 69.04%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.05 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.61%], valid : [loss = 2.217, top1 = 43.10%], test : [loss = 2.262, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.30%], valid : [loss = 0.677, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15143/15625) 015143-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.44 ms.
cifar10-valid  train : [loss = 0.970, top1 = 65.71%], valid : [loss = 1.006, top1 = 64.95%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.22 ms.
cifar10        train : [loss = 0.897, top1 = 68.77%], test  : [loss = 0.896, top1 = 68.50%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.38 ms.
cifar100       train : [loss = 2.377, top1 = 39.20%], valid : [loss = 2.446, top1 = 37.53%], test : [loss = 2.432, top1 = 38.28%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.00 ms.
ImageNet16-120 train : [loss = 3.632, top1 = 15.99%], valid : [loss = 3.595, top1 = 17.20%], test : [loss = 3.633, top1 = 16.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.607, top1 = 39.57%], valid : [loss = 1.631, top1 = 38.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15144/15625) 015144-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=21.35 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.506, top1 = 90.07%]
cifar10        FLOP=153.27 M, Params=1.073 MB, latency=21.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.323, top1 = 93.63%]
cifar100       FLOP=153.28 M, Params=1.079 MB, latency=18.95 ms.
cifar100       train : [loss = 0.056, top1 = 99.25%], valid : [loss = 1.382, top1 = 68.98%], test : [loss = 1.383, top1 = 69.30%]
ImageNet16-120 FLOP= 38.33 M, Params=1.081 MB, latency=19.48 ms.
ImageNet16-120 train : [loss = 1.820, top1 = 51.57%], valid : [loss = 2.248, top1 = 41.93%], test : [loss = 2.253, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=153.27 M, Params=1.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.739, top1 = 74.02%], valid : [loss = 0.789, top1 = 72.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15145/15625) 015145-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.40 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.67%], valid : [loss = 0.537, top1 = 88.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10        train : [loss = 0.026, top1 = 99.24%], test  : [loss = 0.347, top1 = 91.58%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.96 ms.
cifar100       train : [loss = 0.419, top1 = 87.90%], valid : [loss = 1.273, top1 = 66.76%], test : [loss = 1.270, top1 = 66.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.69 ms.
ImageNet16-120 train : [loss = 2.247, top1 = 41.99%], valid : [loss = 2.408, top1 = 38.82%], test : [loss = 2.435, top1 = 38.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15146/15625) 015146-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.83%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.84 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.334, top1 = 93.13%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.95 ms.
cifar100       train : [loss = 0.100, top1 = 97.99%], valid : [loss = 1.317, top1 = 70.10%], test : [loss = 1.302, top1 = 69.58%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.711, top1 = 54.21%], valid : [loss = 2.174, top1 = 45.00%], test : [loss = 2.181, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.19%], valid : [loss = 0.637, top1 = 78.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15147/15625) 015147-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.22 ms.
cifar10-valid  train : [loss = 0.213, top1 = 92.79%], valid : [loss = 0.544, top1 = 83.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10        train : [loss = 0.206, top1 = 93.03%], test  : [loss = 0.402, top1 = 87.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.65 ms.
cifar100       train : [loss = 1.265, top1 = 64.11%], valid : [loss = 1.562, top1 = 57.11%], test : [loss = 1.565, top1 = 57.39%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.94 ms.
ImageNet16-120 train : [loss = 2.680, top1 = 32.98%], valid : [loss = 2.716, top1 = 31.81%], test : [loss = 2.776, top1 = 31.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.965, top1 = 65.29%], valid : [loss = 1.017, top1 = 64.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15148/15625) 015148-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.73%], valid : [loss = 0.527, top1 = 88.23%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.21 ms.
cifar10        train : [loss = 0.027, top1 = 99.22%], test  : [loss = 0.369, top1 = 90.96%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.52 ms.
cifar100       train : [loss = 0.443, top1 = 87.21%], valid : [loss = 1.271, top1 = 67.44%], test : [loss = 1.273, top1 = 66.74%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.50 ms.
ImageNet16-120 train : [loss = 2.245, top1 = 42.02%], valid : [loss = 2.423, top1 = 38.77%], test : [loss = 2.461, top1 = 37.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.770, top1 = 72.81%], valid : [loss = 0.810, top1 = 71.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15149/15625) 015149-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.01 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.93 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.13 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15150/15625) 015150-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.57%], valid : [loss = 0.615, top1 = 84.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.56 ms.
cifar10        train : [loss = 0.083, top1 = 97.33%], test  : [loss = 0.379, top1 = 89.06%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 0.787, top1 = 76.91%], valid : [loss = 1.427, top1 = 62.48%], test : [loss = 1.425, top1 = 62.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.38 ms.
ImageNet16-120 train : [loss = 2.611, top1 = 34.36%], valid : [loss = 2.764, top1 = 32.10%], test : [loss = 2.757, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15151/15625) 015151-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.516, top1 = 89.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.342, top1 = 92.90%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.98 ms.
cifar100       train : [loss = 0.116, top1 = 97.49%], valid : [loss = 1.405, top1 = 67.98%], test : [loss = 1.389, top1 = 69.08%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.26 ms.
ImageNet16-120 train : [loss = 1.757, top1 = 53.08%], valid : [loss = 2.214, top1 = 43.33%], test : [loss = 2.231, top1 = 44.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.30%], valid : [loss = 0.753, top1 = 73.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15152/15625) 015152-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.70 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.66%], valid : [loss = 0.473, top1 = 85.84%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10        train : [loss = 0.147, top1 = 95.28%], test  : [loss = 0.327, top1 = 89.34%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.38 ms.
cifar100       train : [loss = 0.975, top1 = 72.23%], valid : [loss = 1.335, top1 = 62.26%], test : [loss = 1.346, top1 = 62.18%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.616, top1 = 34.15%], valid : [loss = 2.650, top1 = 33.93%], test : [loss = 2.687, top1 = 33.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15153/15625) 015153-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.548, top1 = 88.81%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.23 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.376, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.37 ms.
cifar100       train : [loss = 0.095, top1 = 98.22%], valid : [loss = 1.483, top1 = 67.55%], test : [loss = 1.477, top1 = 67.98%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 1.847, top1 = 51.21%], valid : [loss = 2.365, top1 = 41.11%], test : [loss = 2.393, top1 = 41.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.574, top1 = 79.69%], valid : [loss = 0.669, top1 = 76.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15154/15625) 015154-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.58 ms.
cifar10-valid  train : [loss = 0.640, top1 = 77.44%], valid : [loss = 0.751, top1 = 74.13%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10        train : [loss = 0.573, top1 = 80.01%], test  : [loss = 0.637, top1 = 78.16%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.86 ms.
cifar100       train : [loss = 2.021, top1 = 45.65%], valid : [loss = 2.162, top1 = 43.13%], test : [loss = 2.155, top1 = 42.95%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 3.222, top1 = 22.41%], valid : [loss = 3.225, top1 = 22.89%], test : [loss = 3.248, top1 = 22.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.275, top1 = 54.26%], valid : [loss = 1.360, top1 = 51.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15155/15625) 015155-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.79%], valid : [loss = 0.533, top1 = 84.29%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.55 ms.
cifar10        train : [loss = 0.186, top1 = 93.73%], test  : [loss = 0.391, top1 = 87.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.75 ms.
cifar100       train : [loss = 1.183, top1 = 66.33%], valid : [loss = 1.506, top1 = 58.90%], test : [loss = 1.497, top1 = 58.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.06 ms.
ImageNet16-120 train : [loss = 2.644, top1 = 33.70%], valid : [loss = 2.685, top1 = 32.98%], test : [loss = 2.729, top1 = 32.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.915, top1 = 67.01%], valid : [loss = 0.958, top1 = 65.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15156/15625) 015156-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.54 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.95%], valid : [loss = 0.716, top1 = 82.50%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10        train : [loss = 0.120, top1 = 96.02%], test  : [loss = 0.448, top1 = 87.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.17 ms.
cifar100       train : [loss = 0.944, top1 = 72.77%], valid : [loss = 1.546, top1 = 58.86%], test : [loss = 1.519, top1 = 59.70%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.15 ms.
ImageNet16-120 train : [loss = 2.865, top1 = 29.47%], valid : [loss = 2.963, top1 = 28.17%], test : [loss = 3.014, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.907, top1 = 67.88%], valid : [loss = 0.945, top1 = 66.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15157/15625) 015157-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.23 ms.
cifar10-valid  train : [loss = 0.385, top1 = 86.75%], valid : [loss = 0.525, top1 = 82.53%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.06 ms.
cifar10        train : [loss = 0.393, top1 = 86.60%], test  : [loss = 0.463, top1 = 84.32%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.62 ms.
cifar100       train : [loss = 1.536, top1 = 57.79%], valid : [loss = 1.649, top1 = 54.53%], test : [loss = 1.648, top1 = 54.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.94 ms.
ImageNet16-120 train : [loss = 3.037, top1 = 26.41%], valid : [loss = 3.014, top1 = 27.45%], test : [loss = 3.057, top1 = 25.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.115, top1 = 60.45%], valid : [loss = 1.137, top1 = 59.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15158/15625) 015158-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.50%], valid : [loss = 0.544, top1 = 86.89%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.14 ms.
cifar10        train : [loss = 0.087, top1 = 97.11%], test  : [loss = 0.362, top1 = 89.78%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.90 ms.
cifar100       train : [loss = 0.766, top1 = 77.44%], valid : [loss = 1.328, top1 = 63.80%], test : [loss = 1.333, top1 = 64.05%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.465, top1 = 37.23%], valid : [loss = 2.567, top1 = 35.53%], test : [loss = 2.602, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.700, top1 = 75.26%], valid : [loss = 0.769, top1 = 73.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15159/15625) 015159-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.50 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.450, top1 = 90.60%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.84 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.294, top1 = 93.62%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.12 ms.
cifar100       train : [loss = 0.047, top1 = 99.39%], valid : [loss = 1.398, top1 = 70.44%], test : [loss = 1.349, top1 = 71.16%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 1.472, top1 = 59.91%], valid : [loss = 2.223, top1 = 44.83%], test : [loss = 2.232, top1 = 45.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.428, top1 = 85.33%], valid : [loss = 0.551, top1 = 81.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15160/15625) 015160-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.275, top1 = 90.81%], valid : [loss = 0.472, top1 = 84.51%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.43 ms.
cifar10        train : [loss = 0.302, top1 = 89.93%], test  : [loss = 0.399, top1 = 86.29%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.70 ms.
cifar100       train : [loss = 1.327, top1 = 63.04%], valid : [loss = 1.534, top1 = 57.30%], test : [loss = 1.502, top1 = 58.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.928, top1 = 28.51%], valid : [loss = 2.921, top1 = 28.97%], test : [loss = 2.963, top1 = 27.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.65%], valid : [loss = 0.751, top1 = 73.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15161/15625) 015161-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.86%], valid : [loss = 0.596, top1 = 87.01%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.63 ms.
cifar10        train : [loss = 0.017, top1 = 99.60%], test  : [loss = 0.385, top1 = 91.20%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.78 ms.
cifar100       train : [loss = 0.379, top1 = 89.23%], valid : [loss = 1.393, top1 = 65.49%], test : [loss = 1.415, top1 = 65.60%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.52 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.19%], valid : [loss = 2.516, top1 = 37.01%], test : [loss = 2.527, top1 = 37.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.767, top1 = 72.59%], valid : [loss = 0.841, top1 = 70.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15162/15625) 015162-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.17 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.99 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.06 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15163/15625) 015163-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.25 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.04%], valid : [loss = 0.525, top1 = 85.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.85 ms.
cifar10        train : [loss = 0.078, top1 = 97.65%], test  : [loss = 0.351, top1 = 90.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.58 ms.
cifar100       train : [loss = 0.619, top1 = 82.19%], valid : [loss = 1.333, top1 = 64.46%], test : [loss = 1.340, top1 = 64.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.403, top1 = 38.50%], valid : [loss = 2.530, top1 = 36.63%], test : [loss = 2.558, top1 = 35.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.826, top1 = 70.31%], valid : [loss = 0.888, top1 = 69.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15164/15625) 015164-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.48 ms.
cifar10-valid  train : [loss = 0.053, top1 = 98.60%], valid : [loss = 0.516, top1 = 86.53%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.54 ms.
cifar10        train : [loss = 0.100, top1 = 96.91%], test  : [loss = 0.348, top1 = 89.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=16.28 ms.
cifar100       train : [loss = 0.689, top1 = 80.15%], valid : [loss = 1.320, top1 = 64.66%], test : [loss = 1.280, top1 = 64.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 2.496, top1 = 36.78%], valid : [loss = 2.526, top1 = 35.80%], test : [loss = 2.594, top1 = 34.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.90%], valid : [loss = 0.868, top1 = 69.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15165/15625) 015165-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.472, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.22 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.329, top1 = 92.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.75 ms.
cifar100       train : [loss = 0.269, top1 = 92.86%], valid : [loss = 1.255, top1 = 68.62%], test : [loss = 1.262, top1 = 68.74%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.36 ms.
ImageNet16-120 train : [loss = 1.988, top1 = 47.89%], valid : [loss = 2.307, top1 = 41.10%], test : [loss = 2.328, top1 = 41.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.494, top1 = 82.85%], valid : [loss = 0.584, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15166/15625) 015166-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.51 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.491, top1 = 90.21%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.99 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.312, top1 = 93.36%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.77 ms.
cifar100       train : [loss = 0.069, top1 = 99.02%], valid : [loss = 1.325, top1 = 70.05%], test : [loss = 1.313, top1 = 70.26%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.22 ms.
ImageNet16-120 train : [loss = 1.605, top1 = 56.84%], valid : [loss = 2.163, top1 = 44.60%], test : [loss = 2.181, top1 = 45.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.490, top1 = 83.12%], valid : [loss = 0.580, top1 = 80.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15167/15625) 015167-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.92 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.570, top1 = 87.49%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.374, top1 = 91.17%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.64 ms.
cifar100       train : [loss = 0.384, top1 = 89.22%], valid : [loss = 1.395, top1 = 64.98%], test : [loss = 1.380, top1 = 65.77%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.13%], valid : [loss = 2.469, top1 = 37.51%], test : [loss = 2.487, top1 = 37.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.660, top1 = 76.55%], valid : [loss = 0.722, top1 = 75.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15168/15625) 015168-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10-valid  train : [loss = 0.032, top1 = 99.10%], valid : [loss = 0.553, top1 = 87.06%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.51 ms.
cifar10        train : [loss = 0.064, top1 = 98.01%], test  : [loss = 0.379, top1 = 89.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.80 ms.
cifar100       train : [loss = 0.681, top1 = 79.97%], valid : [loss = 1.303, top1 = 65.06%], test : [loss = 1.294, top1 = 64.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.383, top1 = 38.94%], valid : [loss = 2.553, top1 = 36.03%], test : [loss = 2.540, top1 = 35.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.801, top1 = 71.47%], valid : [loss = 0.848, top1 = 70.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15169/15625) 015169-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.563, top1 = 87.92%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.381, top1 = 91.52%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.17 ms.
cifar100       train : [loss = 0.228, top1 = 94.36%], valid : [loss = 1.422, top1 = 66.33%], test : [loss = 1.419, top1 = 66.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.52 ms.
ImageNet16-120 train : [loss = 2.096, top1 = 45.39%], valid : [loss = 2.404, top1 = 39.52%], test : [loss = 2.444, top1 = 38.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.60%], valid : [loss = 0.736, top1 = 74.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15170/15625) 015170-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.39 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.581, top1 = 87.79%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.28 ms.
cifar10        train : [loss = 0.010, top1 = 99.76%], test  : [loss = 0.360, top1 = 91.92%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.67 ms.
cifar100       train : [loss = 0.165, top1 = 95.74%], valid : [loss = 1.428, top1 = 67.76%], test : [loss = 1.447, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=21.30 ms.
ImageNet16-120 train : [loss = 2.408, top1 = 38.05%], valid : [loss = 2.559, top1 = 35.00%], test : [loss = 2.607, top1 = 33.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.929, top1 = 66.51%], valid : [loss = 0.969, top1 = 65.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15171/15625) 015171-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.98 ms.
cifar10-valid  train : [loss = 0.084, top1 = 97.43%], valid : [loss = 0.854, top1 = 79.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.88 ms.
cifar10        train : [loss = 0.128, top1 = 95.71%], test  : [loss = 0.527, top1 = 85.36%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.95 ms.
cifar100       train : [loss = 0.848, top1 = 75.33%], valid : [loss = 1.685, top1 = 57.22%], test : [loss = 1.670, top1 = 57.41%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.01 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.34%], valid : [loss = 3.169, top1 = 24.32%], test : [loss = 3.199, top1 = 23.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.016, top1 = 63.38%], valid : [loss = 1.077, top1 = 61.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15172/15625) 015172-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.45 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.25%], valid : [loss = 0.576, top1 = 87.00%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.75 ms.
cifar10        train : [loss = 0.062, top1 = 98.05%], test  : [loss = 0.386, top1 = 89.63%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=17.95 ms.
cifar100       train : [loss = 0.644, top1 = 80.86%], valid : [loss = 1.313, top1 = 65.34%], test : [loss = 1.316, top1 = 65.28%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.59 ms.
ImageNet16-120 train : [loss = 2.341, top1 = 39.87%], valid : [loss = 2.479, top1 = 36.97%], test : [loss = 2.508, top1 = 35.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.752, top1 = 73.45%], valid : [loss = 0.808, top1 = 71.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15173/15625) 015173-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.89 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.524, top1 = 88.73%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.74 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.317, top1 = 92.25%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.78 ms.
cifar100       train : [loss = 0.340, top1 = 90.63%], valid : [loss = 1.297, top1 = 66.96%], test : [loss = 1.280, top1 = 67.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.09 ms.
ImageNet16-120 train : [loss = 2.118, top1 = 44.85%], valid : [loss = 2.416, top1 = 39.07%], test : [loss = 2.432, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.64%], valid : [loss = 0.702, top1 = 75.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15174/15625) 015174-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.65 ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.47%], valid : [loss = 0.876, top1 = 70.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.67 ms.
cifar10        train : [loss = 0.676, top1 = 76.24%], test  : [loss = 0.764, top1 = 73.50%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.66 ms.
cifar100       train : [loss = 1.978, top1 = 47.45%], valid : [loss = 2.140, top1 = 44.77%], test : [loss = 2.171, top1 = 44.16%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.04 ms.
ImageNet16-120 train : [loss = 3.655, top1 = 15.68%], valid : [loss = 3.675, top1 = 15.65%], test : [loss = 3.709, top1 = 14.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15175/15625) 015175-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.45 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.464, top1 = 90.45%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.08 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.309, top1 = 93.04%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.88 ms.
cifar100       train : [loss = 0.071, top1 = 98.89%], valid : [loss = 1.346, top1 = 70.08%], test : [loss = 1.338, top1 = 70.32%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=22.38 ms.
ImageNet16-120 train : [loss = 1.607, top1 = 56.82%], valid : [loss = 2.222, top1 = 43.83%], test : [loss = 2.223, top1 = 44.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.444, top1 = 84.78%], valid : [loss = 0.565, top1 = 80.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15176/15625) 015176-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.67%], valid : [loss = 0.608, top1 = 86.48%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.40 ms.
cifar10        train : [loss = 0.033, top1 = 99.05%], test  : [loss = 0.394, top1 = 90.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.55 ms.
cifar100       train : [loss = 0.518, top1 = 84.91%], valid : [loss = 1.427, top1 = 64.05%], test : [loss = 1.417, top1 = 64.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.84 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.37%], valid : [loss = 2.566, top1 = 35.11%], test : [loss = 2.598, top1 = 35.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.750, top1 = 73.38%], valid : [loss = 0.823, top1 = 71.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15177/15625) 015177-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.70%], valid : [loss = 0.617, top1 = 86.61%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.34 ms.
cifar10        train : [loss = 0.034, top1 = 99.03%], test  : [loss = 0.402, top1 = 90.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.80 ms.
cifar100       train : [loss = 0.517, top1 = 84.76%], valid : [loss = 1.430, top1 = 63.28%], test : [loss = 1.424, top1 = 64.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=10.54 ms.
ImageNet16-120 train : [loss = 2.365, top1 = 39.46%], valid : [loss = 2.560, top1 = 35.57%], test : [loss = 2.605, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.820, top1 = 70.70%], valid : [loss = 0.887, top1 = 68.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15178/15625) 015178-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10-valid  train : [loss = 0.071, top1 = 98.04%], valid : [loss = 0.544, top1 = 85.78%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.00 ms.
cifar10        train : [loss = 0.085, top1 = 97.37%], test  : [loss = 0.350, top1 = 89.80%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.16 ms.
cifar100       train : [loss = 0.738, top1 = 78.43%], valid : [loss = 1.404, top1 = 63.10%], test : [loss = 1.381, top1 = 63.62%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.24 ms.
ImageNet16-120 train : [loss = 2.430, top1 = 37.99%], valid : [loss = 2.555, top1 = 35.03%], test : [loss = 2.570, top1 = 35.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.844, top1 = 69.93%], valid : [loss = 0.897, top1 = 68.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15179/15625) 015179-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.05 ms.
cifar10-valid  train : [loss = 0.516, top1 = 81.93%], valid : [loss = 0.664, top1 = 77.61%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.542, top1 = 81.32%], test  : [loss = 0.611, top1 = 79.47%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.52 ms.
cifar100       train : [loss = 1.692, top1 = 54.05%], valid : [loss = 1.848, top1 = 51.00%], test : [loss = 1.865, top1 = 50.86%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.21 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.33%], valid : [loss = 3.303, top1 = 21.23%], test : [loss = 3.347, top1 = 21.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15180/15625) 015180-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.433, top1 = 89.66%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.59 ms.
cifar10        train : [loss = 0.011, top1 = 99.83%], test  : [loss = 0.311, top1 = 92.47%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.31 ms.
cifar100       train : [loss = 0.204, top1 = 95.17%], valid : [loss = 1.292, top1 = 68.60%], test : [loss = 1.274, top1 = 68.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.37 ms.
ImageNet16-120 train : [loss = 1.860, top1 = 50.68%], valid : [loss = 2.256, top1 = 42.30%], test : [loss = 2.272, top1 = 42.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.448, top1 = 84.40%], valid : [loss = 0.546, top1 = 81.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15181/15625) 015181-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.29 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.473, top1 = 89.61%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.67 ms.
cifar10        train : [loss = 0.011, top1 = 99.77%], test  : [loss = 0.304, top1 = 92.65%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.63 ms.
cifar100       train : [loss = 0.266, top1 = 92.98%], valid : [loss = 1.215, top1 = 68.91%], test : [loss = 1.235, top1 = 68.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 1.899, top1 = 49.75%], valid : [loss = 2.222, top1 = 42.40%], test : [loss = 2.233, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.537, top1 = 81.40%], valid : [loss = 0.640, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15182/15625) 015182-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.37 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.69%], valid : [loss = 0.562, top1 = 88.29%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=16.86 ms.
cifar10        train : [loss = 0.023, top1 = 99.30%], test  : [loss = 0.383, top1 = 91.08%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.68 ms.
cifar100       train : [loss = 0.290, top1 = 92.12%], valid : [loss = 1.353, top1 = 66.84%], test : [loss = 1.366, top1 = 66.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.61%], valid : [loss = 2.444, top1 = 38.40%], test : [loss = 2.454, top1 = 38.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.48%], valid : [loss = 1.000, top1 = 64.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15183/15625) 015183-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.53 ms.
cifar10-valid  train : [loss = 0.118, top1 = 96.42%], valid : [loss = 0.461, top1 = 85.92%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.41 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.349, top1 = 88.70%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.98 ms.
cifar100       train : [loss = 0.981, top1 = 72.06%], valid : [loss = 1.341, top1 = 62.50%], test : [loss = 1.323, top1 = 63.46%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.72 ms.
ImageNet16-120 train : [loss = 2.645, top1 = 33.55%], valid : [loss = 2.699, top1 = 32.27%], test : [loss = 2.737, top1 = 31.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15184/15625) 015184-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.17 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.80%], valid : [loss = 0.579, top1 = 87.89%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.54 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.342, top1 = 92.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.80 ms.
cifar100       train : [loss = 0.289, top1 = 91.96%], valid : [loss = 1.339, top1 = 67.38%], test : [loss = 1.335, top1 = 66.62%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.18 ms.
ImageNet16-120 train : [loss = 2.150, top1 = 44.00%], valid : [loss = 2.434, top1 = 37.93%], test : [loss = 2.425, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15185/15625) 015185-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.45 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.30%], valid : [loss = 0.465, top1 = 85.88%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.67 ms.
cifar10        train : [loss = 0.157, top1 = 94.91%], test  : [loss = 0.344, top1 = 88.85%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.13 ms.
cifar100       train : [loss = 1.033, top1 = 70.89%], valid : [loss = 1.382, top1 = 61.66%], test : [loss = 1.388, top1 = 61.46%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.92 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.00%], valid : [loss = 2.664, top1 = 33.30%], test : [loss = 2.700, top1 = 31.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.86%], valid : [loss = 0.790, top1 = 72.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15186/15625) 015186-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.88 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.491, top1 = 90.28%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=19.55 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.328, top1 = 93.10%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.13 ms.
cifar100       train : [loss = 0.080, top1 = 98.68%], valid : [loss = 1.284, top1 = 70.38%], test : [loss = 1.280, top1 = 70.92%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=16.98 ms.
ImageNet16-120 train : [loss = 1.682, top1 = 54.85%], valid : [loss = 2.163, top1 = 44.47%], test : [loss = 2.171, top1 = 43.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 78.14%], valid : [loss = 0.684, top1 = 76.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15187/15625) 015187-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.99 ms.
cifar10-valid  train : [loss = 0.099, top1 = 96.80%], valid : [loss = 0.666, top1 = 82.80%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.76 ms.
cifar10        train : [loss = 0.152, top1 = 94.93%], test  : [loss = 0.459, top1 = 86.61%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.70 ms.
cifar100       train : [loss = 0.966, top1 = 71.75%], valid : [loss = 1.642, top1 = 56.98%], test : [loss = 1.643, top1 = 57.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 3.020, top1 = 26.02%], valid : [loss = 3.093, top1 = 25.70%], test : [loss = 3.142, top1 = 24.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15188/15625) 015188-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.61 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.530, top1 = 88.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=17.40 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.330, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.19 ms.
cifar100       train : [loss = 0.337, top1 = 90.75%], valid : [loss = 1.276, top1 = 67.76%], test : [loss = 1.290, top1 = 67.10%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 2.139, top1 = 44.40%], valid : [loss = 2.396, top1 = 39.20%], test : [loss = 2.402, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.65%], valid : [loss = 0.713, top1 = 75.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15189/15625) 015189-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.94 ms.
cifar10-valid  train : [loss = 0.201, top1 = 93.60%], valid : [loss = 0.481, top1 = 84.88%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.17 ms.
cifar10        train : [loss = 0.215, top1 = 92.79%], test  : [loss = 0.368, top1 = 88.03%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.31 ms.
cifar100       train : [loss = 1.405, top1 = 60.89%], valid : [loss = 1.627, top1 = 55.44%], test : [loss = 1.641, top1 = 54.40%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.68 ms.
ImageNet16-120 train : [loss = 3.208, top1 = 22.57%], valid : [loss = 3.201, top1 = 23.10%], test : [loss = 3.240, top1 = 22.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.44%], valid : [loss = 1.046, top1 = 62.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15190/15625) 015190-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.53 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.456, top1 = 90.42%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.72 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.318, top1 = 93.13%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=22.60 ms.
cifar100       train : [loss = 0.067, top1 = 98.93%], valid : [loss = 1.331, top1 = 70.16%], test : [loss = 1.275, top1 = 71.16%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.64 ms.
ImageNet16-120 train : [loss = 1.551, top1 = 58.09%], valid : [loss = 2.161, top1 = 45.40%], test : [loss = 2.176, top1 = 45.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.484, top1 = 83.28%], valid : [loss = 0.579, top1 = 80.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15191/15625) 015191-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.185, top1 = 93.84%], valid : [loss = 0.506, top1 = 84.63%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.23 ms.
cifar10        train : [loss = 0.199, top1 = 93.27%], test  : [loss = 0.371, top1 = 88.04%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.00 ms.
cifar100       train : [loss = 1.229, top1 = 65.24%], valid : [loss = 1.566, top1 = 57.42%], test : [loss = 1.544, top1 = 57.57%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.40 ms.
ImageNet16-120 train : [loss = 2.762, top1 = 31.43%], valid : [loss = 2.801, top1 = 30.81%], test : [loss = 2.830, top1 = 30.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.939, top1 = 66.27%], valid : [loss = 0.979, top1 = 65.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15192/15625) 015192-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.88 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.72%], valid : [loss = 0.733, top1 = 82.78%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.54 ms.
cifar10        train : [loss = 0.089, top1 = 97.17%], test  : [loss = 0.493, top1 = 86.83%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.27 ms.
cifar100       train : [loss = 0.813, top1 = 76.26%], valid : [loss = 1.540, top1 = 60.04%], test : [loss = 1.518, top1 = 59.74%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 2.791, top1 = 31.00%], valid : [loss = 2.907, top1 = 28.33%], test : [loss = 2.973, top1 = 27.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.808, top1 = 71.28%], valid : [loss = 0.864, top1 = 70.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15193/15625) 015193-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.96%], valid : [loss = 0.476, top1 = 84.28%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.75 ms.
cifar10        train : [loss = 0.303, top1 = 89.83%], test  : [loss = 0.398, top1 = 86.43%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 1.327, top1 = 63.21%], valid : [loss = 1.537, top1 = 57.52%], test : [loss = 1.511, top1 = 59.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.94 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.58%], valid : [loss = 2.915, top1 = 29.57%], test : [loss = 2.964, top1 = 28.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15194/15625) 015194-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.15 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.467, top1 = 89.21%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.19 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.317, top1 = 92.09%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.98 ms.
cifar100       train : [loss = 0.320, top1 = 91.42%], valid : [loss = 1.232, top1 = 68.24%], test : [loss = 1.236, top1 = 68.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.68%], valid : [loss = 2.311, top1 = 40.87%], test : [loss = 2.338, top1 = 40.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 82.26%], valid : [loss = 0.599, top1 = 79.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15195/15625) 015195-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10-valid  train : [loss = 0.487, top1 = 82.97%], valid : [loss = 0.647, top1 = 78.39%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.26 ms.
cifar10        train : [loss = 0.508, top1 = 82.41%], test  : [loss = 0.585, top1 = 80.13%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.29 ms.
cifar100       train : [loss = 1.698, top1 = 54.04%], valid : [loss = 1.861, top1 = 50.33%], test : [loss = 1.873, top1 = 50.54%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 3.324, top1 = 21.29%], valid : [loss = 3.313, top1 = 21.24%], test : [loss = 3.346, top1 = 21.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15196/15625) 015196-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.48 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.531, top1 = 88.17%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.52 ms.
cifar10        train : [loss = 0.020, top1 = 99.47%], test  : [loss = 0.361, top1 = 91.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.22 ms.
cifar100       train : [loss = 0.334, top1 = 90.42%], valid : [loss = 1.333, top1 = 66.00%], test : [loss = 1.312, top1 = 68.34%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.10 ms.
ImageNet16-120 train : [loss = 2.247, top1 = 41.88%], valid : [loss = 2.485, top1 = 37.53%], test : [loss = 2.513, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.72%], valid : [loss = 0.991, top1 = 64.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15197/15625) 015197-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.03 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.554, top1 = 88.81%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.92 ms.
cifar10        train : [loss = 0.008, top1 = 99.80%], test  : [loss = 0.353, top1 = 92.23%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.61 ms.
cifar100       train : [loss = 0.231, top1 = 93.94%], valid : [loss = 1.289, top1 = 69.04%], test : [loss = 1.275, top1 = 68.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 1.864, top1 = 50.69%], valid : [loss = 2.219, top1 = 43.37%], test : [loss = 2.214, top1 = 43.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.62%], valid : [loss = 0.691, top1 = 76.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15198/15625) 015198-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=20.75 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.518, top1 = 89.99%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=22.68 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.330, top1 = 93.23%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=21.68 ms.
cifar100       train : [loss = 0.076, top1 = 98.71%], valid : [loss = 1.359, top1 = 69.70%], test : [loss = 1.365, top1 = 69.64%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=24.33 ms.
ImageNet16-120 train : [loss = 1.829, top1 = 51.52%], valid : [loss = 2.290, top1 = 42.00%], test : [loss = 2.292, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.746, top1 = 73.64%], valid : [loss = 0.794, top1 = 71.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15199/15625) 015199-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=19.08 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.549, top1 = 88.76%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.51 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.350, top1 = 92.10%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.73 ms.
cifar100       train : [loss = 0.250, top1 = 93.32%], valid : [loss = 1.318, top1 = 67.68%], test : [loss = 1.319, top1 = 68.28%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 2.198, top1 = 43.08%], valid : [loss = 2.426, top1 = 38.90%], test : [loss = 2.422, top1 = 38.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.859, top1 = 68.93%], valid : [loss = 0.894, top1 = 68.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15200/15625) 015200-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.00 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.83 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.69 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15201/15625) 015201-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.98 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.580, top1 = 88.56%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.72 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.357, top1 = 92.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.77 ms.
cifar100       train : [loss = 0.053, top1 = 99.30%], valid : [loss = 1.539, top1 = 68.20%], test : [loss = 1.545, top1 = 67.74%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.60 ms.
ImageNet16-120 train : [loss = 1.828, top1 = 51.56%], valid : [loss = 2.406, top1 = 39.97%], test : [loss = 2.437, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.596, top1 = 78.77%], valid : [loss = 0.689, top1 = 76.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15202/15625) 015202-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.44 ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.36%], valid : [loss = 0.772, top1 = 73.47%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.56 ms.
cifar10        train : [loss = 0.561, top1 = 80.38%], test  : [loss = 0.636, top1 = 78.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.17 ms.
cifar100       train : [loss = 2.005, top1 = 45.64%], valid : [loss = 2.111, top1 = 44.20%], test : [loss = 2.141, top1 = 42.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.73 ms.
ImageNet16-120 train : [loss = 3.013, top1 = 26.32%], valid : [loss = 3.029, top1 = 26.73%], test : [loss = 3.019, top1 = 25.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.171, top1 = 57.84%], valid : [loss = 1.212, top1 = 57.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15203/15625) 015203-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.601, top1 = 88.34%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.28 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.369, top1 = 92.61%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.10 ms.
cifar100       train : [loss = 0.105, top1 = 98.05%], valid : [loss = 1.458, top1 = 67.48%], test : [loss = 1.486, top1 = 67.36%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=18.73 ms.
ImageNet16-120 train : [loss = 1.885, top1 = 50.29%], valid : [loss = 2.417, top1 = 39.80%], test : [loss = 2.444, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.684, top1 = 75.76%], valid : [loss = 0.765, top1 = 73.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15204/15625) 015204-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.54%], valid : [loss = 0.643, top1 = 84.16%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.16 ms.
cifar10        train : [loss = 0.074, top1 = 97.59%], test  : [loss = 0.408, top1 = 88.81%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.92 ms.
cifar100       train : [loss = 0.765, top1 = 77.46%], valid : [loss = 1.533, top1 = 59.78%], test : [loss = 1.507, top1 = 60.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.43 ms.
ImageNet16-120 train : [loss = 2.477, top1 = 37.12%], valid : [loss = 2.649, top1 = 33.93%], test : [loss = 2.694, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.846, top1 = 69.60%], valid : [loss = 0.902, top1 = 68.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15205/15625) 015205-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.64 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.40%], valid : [loss = 0.673, top1 = 84.74%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.15 ms.
cifar10        train : [loss = 0.059, top1 = 98.22%], test  : [loss = 0.435, top1 = 88.47%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 0.657, top1 = 80.76%], valid : [loss = 1.525, top1 = 60.84%], test : [loss = 1.475, top1 = 61.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.28 ms.
ImageNet16-120 train : [loss = 2.654, top1 = 33.54%], valid : [loss = 2.795, top1 = 30.77%], test : [loss = 2.846, top1 = 30.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.42%], valid : [loss = 0.862, top1 = 69.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15206/15625) 015206-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.02 ms.
cifar10-valid  train : [loss = 0.272, top1 = 90.87%], valid : [loss = 0.472, top1 = 84.41%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.69 ms.
cifar10        train : [loss = 0.296, top1 = 90.09%], test  : [loss = 0.400, top1 = 86.48%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.39 ms.
cifar100       train : [loss = 1.318, top1 = 63.26%], valid : [loss = 1.515, top1 = 58.28%], test : [loss = 1.485, top1 = 57.80%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.06 ms.
ImageNet16-120 train : [loss = 2.925, top1 = 28.67%], valid : [loss = 2.912, top1 = 29.43%], test : [loss = 2.963, top1 = 27.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15207/15625) 015207-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.99 ms.
cifar10-valid  train : [loss = 0.292, top1 = 89.90%], valid : [loss = 0.557, top1 = 82.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.89 ms.
cifar10        train : [loss = 0.261, top1 = 90.95%], test  : [loss = 0.421, top1 = 86.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.66 ms.
cifar100       train : [loss = 1.376, top1 = 61.25%], valid : [loss = 1.631, top1 = 55.44%], test : [loss = 1.614, top1 = 55.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.70 ms.
ImageNet16-120 train : [loss = 2.809, top1 = 30.42%], valid : [loss = 2.824, top1 = 29.69%], test : [loss = 2.867, top1 = 29.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.32%], valid : [loss = 1.018, top1 = 63.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15208/15625) 015208-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.46 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.520, top1 = 89.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.36 ms.
cifar10        train : [loss = 0.009, top1 = 99.84%], test  : [loss = 0.330, top1 = 92.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=16.09 ms.
cifar100       train : [loss = 0.203, top1 = 95.03%], valid : [loss = 1.239, top1 = 69.96%], test : [loss = 1.273, top1 = 69.46%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.17%], valid : [loss = 2.222, top1 = 42.47%], test : [loss = 2.243, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.593, top1 = 78.74%], valid : [loss = 0.675, top1 = 76.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15209/15625) 015209-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.56 ms.
cifar10-valid  train : [loss = 0.480, top1 = 83.37%], valid : [loss = 0.638, top1 = 78.54%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.55 ms.
cifar10        train : [loss = 0.507, top1 = 82.60%], test  : [loss = 0.589, top1 = 80.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.57 ms.
cifar100       train : [loss = 1.720, top1 = 53.53%], valid : [loss = 1.868, top1 = 50.70%], test : [loss = 1.888, top1 = 50.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.70 ms.
ImageNet16-120 train : [loss = 3.327, top1 = 21.27%], valid : [loss = 3.312, top1 = 21.40%], test : [loss = 3.340, top1 = 21.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.86%], valid : [loss = 1.327, top1 = 52.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15210/15625) 015210-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.149, top1 = 95.22%], valid : [loss = 0.546, top1 = 84.26%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.14 ms.
cifar10        train : [loss = 0.158, top1 = 94.74%], test  : [loss = 0.388, top1 = 88.14%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.40 ms.
cifar100       train : [loss = 1.093, top1 = 68.65%], valid : [loss = 1.479, top1 = 59.41%], test : [loss = 1.469, top1 = 59.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.580, top1 = 35.10%], valid : [loss = 2.640, top1 = 33.99%], test : [loss = 2.675, top1 = 33.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.943, top1 = 66.04%], valid : [loss = 0.993, top1 = 65.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15211/15625) 015211-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.55 ms.
cifar10        train : [loss = 2.303, top1 = 9.95%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.13 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15212/15625) 015212-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.20%], valid : [loss = 0.558, top1 = 86.16%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=15.79 ms.
cifar10        train : [loss = 0.049, top1 = 98.68%], test  : [loss = 0.364, top1 = 90.12%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.04 ms.
cifar100       train : [loss = 0.503, top1 = 85.69%], valid : [loss = 1.297, top1 = 66.40%], test : [loss = 1.293, top1 = 66.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.85 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.33%], valid : [loss = 2.423, top1 = 38.16%], test : [loss = 2.437, top1 = 39.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.788, top1 = 71.74%], valid : [loss = 0.848, top1 = 70.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15213/15625) 015213-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.32 ms.
cifar10-valid  train : [loss = 0.120, top1 = 96.21%], valid : [loss = 0.899, top1 = 77.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.19 ms.
cifar10        train : [loss = 0.172, top1 = 94.12%], test  : [loss = 0.582, top1 = 83.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.93 ms.
cifar100       train : [loss = 0.973, top1 = 71.99%], valid : [loss = 1.741, top1 = 55.61%], test : [loss = 1.763, top1 = 55.47%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 3.116, top1 = 24.85%], valid : [loss = 3.250, top1 = 22.89%], test : [loss = 3.276, top1 = 22.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.096, top1 = 60.24%], valid : [loss = 1.161, top1 = 58.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15214/15625) 015214-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.93%], valid : [loss = 0.736, top1 = 83.39%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10        train : [loss = 0.064, top1 = 97.91%], test  : [loss = 0.492, top1 = 87.88%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.75 ms.
cifar100       train : [loss = 0.355, top1 = 90.08%], valid : [loss = 1.690, top1 = 60.17%], test : [loss = 1.728, top1 = 60.19%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.65 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 25.46%], valid : [loss = 3.122, top1 = 24.02%], test : [loss = 3.132, top1 = 24.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 57.06%], valid : [loss = 1.211, top1 = 56.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15215/15625) 015215-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.466, top1 = 89.07%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.49 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.319, top1 = 91.98%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.64 ms.
cifar100       train : [loss = 0.326, top1 = 91.17%], valid : [loss = 1.322, top1 = 66.86%], test : [loss = 1.299, top1 = 67.11%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 2.057, top1 = 46.35%], valid : [loss = 2.379, top1 = 39.61%], test : [loss = 2.411, top1 = 39.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.453, top1 = 84.43%], valid : [loss = 0.560, top1 = 81.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15216/15625) 015216-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.547, top1 = 87.91%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.29 ms.
cifar10        train : [loss = 0.016, top1 = 99.65%], test  : [loss = 0.372, top1 = 91.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.32 ms.
cifar100       train : [loss = 0.386, top1 = 89.12%], valid : [loss = 1.374, top1 = 65.74%], test : [loss = 1.347, top1 = 65.97%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.244, top1 = 42.16%], valid : [loss = 2.468, top1 = 37.89%], test : [loss = 2.474, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.652, top1 = 76.87%], valid : [loss = 0.735, top1 = 74.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15217/15625) 015217-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.519, top1 = 89.10%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.51 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.339, top1 = 92.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.90 ms.
cifar100       train : [loss = 0.167, top1 = 96.04%], valid : [loss = 1.291, top1 = 69.22%], test : [loss = 1.326, top1 = 68.74%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.74 ms.
ImageNet16-120 train : [loss = 1.862, top1 = 50.77%], valid : [loss = 2.262, top1 = 42.70%], test : [loss = 2.246, top1 = 42.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.695, top1 = 75.30%], valid : [loss = 0.769, top1 = 72.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15218/15625) 015218-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.12 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.474, top1 = 89.49%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=20.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.73%], test  : [loss = 0.310, top1 = 92.42%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=20.88 ms.
cifar100       train : [loss = 0.269, top1 = 93.04%], valid : [loss = 1.257, top1 = 68.31%], test : [loss = 1.262, top1 = 68.07%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.63 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.20%], valid : [loss = 2.181, top1 = 43.36%], test : [loss = 2.160, top1 = 44.26%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.30%], valid : [loss = 0.669, top1 = 76.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15219/15625) 015219-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.35%], valid : [loss = 0.571, top1 = 87.41%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.65 ms.
cifar10        train : [loss = 0.029, top1 = 99.12%], test  : [loss = 0.383, top1 = 90.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.90 ms.
cifar100       train : [loss = 0.432, top1 = 87.38%], valid : [loss = 1.360, top1 = 65.61%], test : [loss = 1.359, top1 = 65.06%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.35 ms.
ImageNet16-120 train : [loss = 2.627, top1 = 33.26%], valid : [loss = 2.690, top1 = 32.08%], test : [loss = 2.716, top1 = 31.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 1.113, top1 = 59.24%], valid : [loss = 1.140, top1 = 58.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15220/15625) 015220-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.13 ms.
cifar10-valid  train : [loss = 0.249, top1 = 91.61%], valid : [loss = 0.530, top1 = 83.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.01 ms.
cifar10        train : [loss = 0.241, top1 = 91.80%], test  : [loss = 0.398, top1 = 87.03%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.40 ms.
cifar100       train : [loss = 1.301, top1 = 63.21%], valid : [loss = 1.580, top1 = 57.07%], test : [loss = 1.573, top1 = 57.10%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.836, top1 = 29.90%], valid : [loss = 2.853, top1 = 29.84%], test : [loss = 2.913, top1 = 28.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.994, top1 = 64.28%], valid : [loss = 1.035, top1 = 63.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15221/15625) 015221-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.447, top1 = 90.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.55 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.301, top1 = 92.91%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.07 ms.
cifar100       train : [loss = 0.104, top1 = 98.08%], valid : [loss = 1.374, top1 = 68.75%], test : [loss = 1.368, top1 = 69.06%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.43 ms.
ImageNet16-120 train : [loss = 1.673, top1 = 55.20%], valid : [loss = 2.272, top1 = 43.32%], test : [loss = 2.279, top1 = 43.36%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.434, top1 = 85.09%], valid : [loss = 0.548, top1 = 81.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15222/15625) 015222-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.589, top1 = 87.34%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.43 ms.
cifar10        train : [loss = 0.016, top1 = 99.63%], test  : [loss = 0.393, top1 = 91.08%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.70 ms.
cifar100       train : [loss = 0.395, top1 = 88.76%], valid : [loss = 1.393, top1 = 65.69%], test : [loss = 1.384, top1 = 65.70%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.85 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.79%], valid : [loss = 2.506, top1 = 36.83%], test : [loss = 2.534, top1 = 36.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15223/15625) 015223-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.35 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.519, top1 = 88.67%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.013, top1 = 99.73%], test  : [loss = 0.344, top1 = 91.87%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.77 ms.
cifar100       train : [loss = 0.341, top1 = 90.64%], valid : [loss = 1.286, top1 = 66.90%], test : [loss = 1.301, top1 = 66.82%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.51 ms.
ImageNet16-120 train : [loss = 2.142, top1 = 44.32%], valid : [loss = 2.405, top1 = 39.03%], test : [loss = 2.420, top1 = 39.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15224/15625) 015224-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.44 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.512, top1 = 88.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.09 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.339, top1 = 92.04%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.46 ms.
cifar100       train : [loss = 0.341, top1 = 90.67%], valid : [loss = 1.288, top1 = 66.75%], test : [loss = 1.272, top1 = 67.90%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.61 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.56%], valid : [loss = 2.408, top1 = 39.30%], test : [loss = 2.433, top1 = 38.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15225/15625) 015225-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.12 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.78%], valid : [loss = 0.849, top1 = 77.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10        train : [loss = 0.224, top1 = 92.32%], test  : [loss = 0.591, top1 = 82.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.98 ms.
cifar100       train : [loss = 1.174, top1 = 66.77%], valid : [loss = 1.807, top1 = 53.05%], test : [loss = 1.789, top1 = 53.99%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.45 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.78%], valid : [loss = 3.330, top1 = 21.72%], test : [loss = 3.364, top1 = 20.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.022, top1 = 63.55%], valid : [loss = 1.073, top1 = 61.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15226/15625) 015226-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.508, top1 = 88.99%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.14 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.329, top1 = 92.14%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.83 ms.
cifar100       train : [loss = 0.233, top1 = 94.27%], valid : [loss = 1.235, top1 = 68.79%], test : [loss = 1.257, top1 = 68.35%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.82 ms.
ImageNet16-120 train : [loss = 1.913, top1 = 49.56%], valid : [loss = 2.242, top1 = 42.61%], test : [loss = 2.265, top1 = 42.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.576, top1 = 79.76%], valid : [loss = 0.662, top1 = 77.36%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15227/15625) 015227-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.00 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.50%], valid : [loss = 0.560, top1 = 87.05%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.45 ms.
cifar10        train : [loss = 0.046, top1 = 98.63%], test  : [loss = 0.381, top1 = 89.99%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=16.82 ms.
cifar100       train : [loss = 0.595, top1 = 82.39%], valid : [loss = 1.361, top1 = 64.30%], test : [loss = 1.359, top1 = 64.69%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=17.13 ms.
ImageNet16-120 train : [loss = 2.406, top1 = 38.56%], valid : [loss = 2.558, top1 = 35.34%], test : [loss = 2.610, top1 = 34.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.53%], valid : [loss = 0.771, top1 = 73.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15228/15625) 015228-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.79 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.526, top1 = 89.25%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.75 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.333, top1 = 92.82%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.98 ms.
cifar100       train : [loss = 0.122, top1 = 97.63%], valid : [loss = 1.296, top1 = 69.33%], test : [loss = 1.321, top1 = 69.50%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 1.794, top1 = 52.32%], valid : [loss = 2.278, top1 = 41.79%], test : [loss = 2.260, top1 = 42.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.06%], valid : [loss = 0.643, top1 = 77.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15229/15625) 015229-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.18 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.98 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.58 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.93 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15230/15625) 015230-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.532, top1 = 89.02%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.340, top1 = 92.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.05 ms.
cifar100       train : [loss = 0.129, top1 = 97.26%], valid : [loss = 1.361, top1 = 68.83%], test : [loss = 1.337, top1 = 68.95%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.65 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.94%], valid : [loss = 2.323, top1 = 41.49%], test : [loss = 2.291, top1 = 42.04%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.53%], valid : [loss = 0.784, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15231/15625) 015231-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.75 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.73%], valid : [loss = 0.555, top1 = 86.59%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10        train : [loss = 0.084, top1 = 97.19%], test  : [loss = 0.368, top1 = 89.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.14 ms.
cifar100       train : [loss = 0.767, top1 = 77.46%], valid : [loss = 1.344, top1 = 63.50%], test : [loss = 1.324, top1 = 64.19%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.52 ms.
ImageNet16-120 train : [loss = 2.460, top1 = 37.45%], valid : [loss = 2.570, top1 = 35.13%], test : [loss = 2.583, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.57%], valid : [loss = 0.786, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15232/15625) 015232-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.44 ms.
cifar10-valid  train : [loss = 0.297, top1 = 89.70%], valid : [loss = 0.567, top1 = 82.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10        train : [loss = 0.259, top1 = 91.11%], test  : [loss = 0.403, top1 = 86.75%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.69 ms.
cifar100       train : [loss = 1.464, top1 = 59.09%], valid : [loss = 1.708, top1 = 54.10%], test : [loss = 1.704, top1 = 53.85%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.61 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 27.97%], valid : [loss = 2.950, top1 = 27.67%], test : [loss = 2.998, top1 = 27.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|none~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.31%], valid : [loss = 0.993, top1 = 64.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15233/15625) 015233-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.72 ms.
cifar10-valid  train : [loss = 0.296, top1 = 89.67%], valid : [loss = 0.558, top1 = 82.26%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.83 ms.
cifar10        train : [loss = 0.263, top1 = 91.01%], test  : [loss = 0.418, top1 = 86.26%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.91 ms.
cifar100       train : [loss = 1.453, top1 = 59.19%], valid : [loss = 1.705, top1 = 54.15%], test : [loss = 1.696, top1 = 53.91%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.08 ms.
ImageNet16-120 train : [loss = 2.945, top1 = 27.75%], valid : [loss = 2.948, top1 = 27.97%], test : [loss = 3.006, top1 = 27.24%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.978, top1 = 64.76%], valid : [loss = 1.016, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15234/15625) 015234-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.034, top1 = 99.22%], valid : [loss = 0.613, top1 = 85.39%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.70 ms.
cifar10        train : [loss = 0.071, top1 = 97.84%], test  : [loss = 0.404, top1 = 88.94%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.94 ms.
cifar100       train : [loss = 0.724, top1 = 78.96%], valid : [loss = 1.395, top1 = 62.62%], test : [loss = 1.381, top1 = 62.89%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.535, top1 = 35.93%], valid : [loss = 2.650, top1 = 33.79%], test : [loss = 2.678, top1 = 33.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.77%], valid : [loss = 0.792, top1 = 72.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15235/15625) 015235-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.462, top1 = 89.03%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.10 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.318, top1 = 91.89%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.27 ms.
cifar100       train : [loss = 0.329, top1 = 91.06%], valid : [loss = 1.322, top1 = 66.80%], test : [loss = 1.315, top1 = 67.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.21 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.16%], valid : [loss = 2.386, top1 = 39.96%], test : [loss = 2.401, top1 = 39.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.00%], valid : [loss = 0.555, top1 = 81.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15236/15625) 015236-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.27 ms.
cifar10-valid  train : [loss = 0.159, top1 = 94.79%], valid : [loss = 0.500, top1 = 85.08%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.89 ms.
cifar10        train : [loss = 0.168, top1 = 94.34%], test  : [loss = 0.375, top1 = 88.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.70 ms.
cifar100       train : [loss = 1.038, top1 = 70.10%], valid : [loss = 1.421, top1 = 61.09%], test : [loss = 1.404, top1 = 61.61%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.67%], valid : [loss = 2.599, top1 = 34.44%], test : [loss = 2.640, top1 = 34.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.903, top1 = 67.56%], valid : [loss = 0.966, top1 = 65.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15237/15625) 015237-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.581, top1 = 87.38%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.37 ms.
cifar10        train : [loss = 0.019, top1 = 99.45%], test  : [loss = 0.393, top1 = 91.01%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.21 ms.
cifar100       train : [loss = 0.290, top1 = 91.83%], valid : [loss = 1.435, top1 = 66.02%], test : [loss = 1.450, top1 = 66.15%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.17 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 29.59%], valid : [loss = 2.901, top1 = 27.30%], test : [loss = 2.906, top1 = 27.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.094, top1 = 60.51%], valid : [loss = 1.096, top1 = 60.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15238/15625) 015238-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.81 ms.
cifar10-valid  train : [loss = 0.783, top1 = 72.41%], valid : [loss = 0.968, top1 = 66.86%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.28 ms.
cifar10        train : [loss = 0.766, top1 = 73.00%], test  : [loss = 0.863, top1 = 69.98%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.45 ms.
cifar100       train : [loss = 2.141, top1 = 43.86%], valid : [loss = 2.316, top1 = 40.49%], test : [loss = 2.338, top1 = 40.31%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.74 ms.
ImageNet16-120 train : [loss = 3.744, top1 = 14.18%], valid : [loss = 3.770, top1 = 14.29%], test : [loss = 3.781, top1 = 13.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15239/15625) 015239-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.486, top1 = 89.40%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.23 ms.
cifar10        train : [loss = 0.011, top1 = 99.78%], test  : [loss = 0.335, top1 = 92.35%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.75 ms.
cifar100       train : [loss = 0.210, top1 = 94.75%], valid : [loss = 1.305, top1 = 69.00%], test : [loss = 1.278, top1 = 69.39%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.04 ms.
ImageNet16-120 train : [loss = 1.834, top1 = 51.44%], valid : [loss = 2.220, top1 = 42.99%], test : [loss = 2.275, top1 = 42.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.448, top1 = 84.34%], valid : [loss = 0.554, top1 = 81.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15240/15625) 015240-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.16 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.66 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.02 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15241/15625) 015241-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.121, top1 = 96.37%], valid : [loss = 0.467, top1 = 86.02%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.09 ms.
cifar10        train : [loss = 0.159, top1 = 94.87%], test  : [loss = 0.341, top1 = 88.94%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.86 ms.
cifar100       train : [loss = 0.988, top1 = 71.89%], valid : [loss = 1.337, top1 = 62.65%], test : [loss = 1.347, top1 = 62.07%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.43 ms.
ImageNet16-120 train : [loss = 2.642, top1 = 33.61%], valid : [loss = 2.694, top1 = 32.30%], test : [loss = 2.713, top1 = 31.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 73.35%], valid : [loss = 0.806, top1 = 71.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15242/15625) 015242-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.76 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.12%], valid : [loss = 0.475, top1 = 84.27%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.41 ms.
cifar10        train : [loss = 0.302, top1 = 89.95%], test  : [loss = 0.400, top1 = 86.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.87 ms.
cifar100       train : [loss = 1.322, top1 = 63.28%], valid : [loss = 1.539, top1 = 57.76%], test : [loss = 1.508, top1 = 57.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.17 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.73%], valid : [loss = 2.905, top1 = 29.26%], test : [loss = 2.956, top1 = 28.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15243/15625) 015243-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.31 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.567, top1 = 87.75%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.20 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.396, top1 = 90.94%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.83 ms.
cifar100       train : [loss = 0.363, top1 = 89.73%], valid : [loss = 1.405, top1 = 65.60%], test : [loss = 1.409, top1 = 65.96%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.230, top1 = 42.43%], valid : [loss = 2.450, top1 = 38.04%], test : [loss = 2.457, top1 = 38.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.13%], valid : [loss = 0.740, top1 = 74.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15244/15625) 015244-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10-valid  train : [loss = 0.023, top1 = 99.42%], valid : [loss = 0.603, top1 = 86.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10        train : [loss = 0.054, top1 = 98.29%], test  : [loss = 0.391, top1 = 89.84%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.18 ms.
cifar100       train : [loss = 0.610, top1 = 81.81%], valid : [loss = 1.423, top1 = 63.23%], test : [loss = 1.414, top1 = 63.58%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.65 ms.
ImageNet16-120 train : [loss = 2.512, top1 = 36.38%], valid : [loss = 2.635, top1 = 33.39%], test : [loss = 2.656, top1 = 33.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.14%], valid : [loss = 0.768, top1 = 73.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15245/15625) 015245-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.111, top1 = 96.69%], valid : [loss = 0.446, top1 = 86.60%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.57 ms.
cifar10        train : [loss = 0.150, top1 = 95.19%], test  : [loss = 0.336, top1 = 89.16%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.37 ms.
cifar100       train : [loss = 0.973, top1 = 72.35%], valid : [loss = 1.344, top1 = 62.52%], test : [loss = 1.343, top1 = 62.45%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.09 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.14%], valid : [loss = 2.683, top1 = 32.87%], test : [loss = 2.699, top1 = 32.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.50%], valid : [loss = 0.778, top1 = 72.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15246/15625) 015246-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10-valid  train : [loss = 0.031, top1 = 99.52%], valid : [loss = 0.450, top1 = 87.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.15 ms.
cifar10        train : [loss = 0.056, top1 = 98.59%], test  : [loss = 0.308, top1 = 90.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.10 ms.
cifar100       train : [loss = 0.584, top1 = 83.89%], valid : [loss = 1.226, top1 = 66.39%], test : [loss = 1.200, top1 = 66.97%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.29 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.11%], valid : [loss = 2.467, top1 = 37.40%], test : [loss = 2.489, top1 = 37.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.548, top1 = 81.09%], valid : [loss = 0.627, top1 = 78.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15247/15625) 015247-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.38%], valid : [loss = 0.861, top1 = 71.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.73 ms.
cifar10        train : [loss = 0.551, top1 = 80.72%], test  : [loss = 0.710, top1 = 76.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.97 ms.
cifar100       train : [loss = 1.767, top1 = 52.34%], valid : [loss = 2.056, top1 = 47.09%], test : [loss = 2.060, top1 = 47.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.50 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.91%], valid : [loss = 3.629, top1 = 16.58%], test : [loss = 3.662, top1 = 15.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15248/15625) 015248-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.52 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.521, top1 = 88.66%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.99 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.348, top1 = 91.86%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.92 ms.
cifar100       train : [loss = 0.239, top1 = 94.03%], valid : [loss = 1.276, top1 = 68.39%], test : [loss = 1.283, top1 = 68.24%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.24 ms.
ImageNet16-120 train : [loss = 2.018, top1 = 47.06%], valid : [loss = 2.335, top1 = 40.27%], test : [loss = 2.338, top1 = 40.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.798, top1 = 71.63%], valid : [loss = 0.844, top1 = 70.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15249/15625) 015249-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.83 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.530, top1 = 88.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.55 ms.
cifar10        train : [loss = 0.013, top1 = 99.74%], test  : [loss = 0.337, top1 = 91.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.55 ms.
cifar100       train : [loss = 0.351, top1 = 90.34%], valid : [loss = 1.281, top1 = 66.74%], test : [loss = 1.284, top1 = 67.28%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.71 ms.
ImageNet16-120 train : [loss = 2.136, top1 = 44.47%], valid : [loss = 2.423, top1 = 38.66%], test : [loss = 2.437, top1 = 38.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.661, top1 = 77.04%], valid : [loss = 0.723, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15250/15625) 015250-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.17 ms.
cifar10-valid  train : [loss = 0.045, top1 = 99.01%], valid : [loss = 0.550, top1 = 86.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.69 ms.
cifar10        train : [loss = 0.057, top1 = 98.44%], test  : [loss = 0.365, top1 = 90.04%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.09 ms.
cifar100       train : [loss = 0.560, top1 = 83.79%], valid : [loss = 1.322, top1 = 65.22%], test : [loss = 1.315, top1 = 65.40%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 2.248, top1 = 41.97%], valid : [loss = 2.428, top1 = 38.47%], test : [loss = 2.423, top1 = 38.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.56%], valid : [loss = 0.911, top1 = 68.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15251/15625) 015251-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.70 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.91%], valid : [loss = 0.649, top1 = 87.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.41 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.449, top1 = 90.60%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.23 ms.
cifar100       train : [loss = 0.195, top1 = 95.42%], valid : [loss = 1.616, top1 = 64.25%], test : [loss = 1.604, top1 = 64.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 2.222, top1 = 42.71%], valid : [loss = 2.653, top1 = 34.29%], test : [loss = 2.660, top1 = 35.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 73.90%], valid : [loss = 0.805, top1 = 71.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15252/15625) 015252-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.518, top1 = 89.61%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.35 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.324, top1 = 93.19%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.81 ms.
cifar100       train : [loss = 0.065, top1 = 99.04%], valid : [loss = 1.372, top1 = 69.51%], test : [loss = 1.362, top1 = 69.67%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.09 ms.
ImageNet16-120 train : [loss = 1.966, top1 = 48.18%], valid : [loss = 2.364, top1 = 40.16%], test : [loss = 2.358, top1 = 40.46%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 71.13%], valid : [loss = 0.858, top1 = 69.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15253/15625) 015253-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.93 ms.
cifar10-valid  train : [loss = 0.170, top1 = 94.51%], valid : [loss = 0.505, top1 = 84.99%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.64 ms.
cifar10        train : [loss = 0.170, top1 = 94.23%], test  : [loss = 0.375, top1 = 88.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.82 ms.
cifar100       train : [loss = 1.027, top1 = 70.49%], valid : [loss = 1.387, top1 = 61.46%], test : [loss = 1.373, top1 = 61.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.43 ms.
ImageNet16-120 train : [loss = 2.606, top1 = 34.56%], valid : [loss = 2.649, top1 = 33.92%], test : [loss = 2.692, top1 = 32.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.891, top1 = 68.17%], valid : [loss = 0.931, top1 = 66.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15254/15625) 015254-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.85 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.515, top1 = 89.41%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.48 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.309, top1 = 93.06%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.24 ms.
cifar100       train : [loss = 0.131, top1 = 97.40%], valid : [loss = 1.310, top1 = 68.93%], test : [loss = 1.295, top1 = 69.57%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=16.81 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.18%], valid : [loss = 2.278, top1 = 42.69%], test : [loss = 2.268, top1 = 42.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.607, top1 = 78.95%], valid : [loss = 0.681, top1 = 76.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15255/15625) 015255-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.23 ms.
cifar10-valid  train : [loss = 0.310, top1 = 89.30%], valid : [loss = 0.560, top1 = 82.23%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10        train : [loss = 0.280, top1 = 90.35%], test  : [loss = 0.431, top1 = 85.80%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.11 ms.
cifar100       train : [loss = 1.477, top1 = 58.54%], valid : [loss = 1.712, top1 = 53.75%], test : [loss = 1.708, top1 = 53.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 3.011, top1 = 26.63%], valid : [loss = 2.996, top1 = 27.18%], test : [loss = 3.052, top1 = 25.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.36%], valid : [loss = 1.009, top1 = 64.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15256/15625) 015256-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.56%], valid : [loss = 0.557, top1 = 87.44%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.50 ms.
cifar10        train : [loss = 0.034, top1 = 99.00%], test  : [loss = 0.365, top1 = 91.10%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.19 ms.
cifar100       train : [loss = 0.530, top1 = 84.81%], valid : [loss = 1.338, top1 = 65.16%], test : [loss = 1.355, top1 = 64.70%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.50 ms.
ImageNet16-120 train : [loss = 2.549, top1 = 35.16%], valid : [loss = 2.614, top1 = 34.04%], test : [loss = 2.629, top1 = 33.94%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15257/15625) 015257-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.500, top1 = 90.12%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.59 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.315, top1 = 93.37%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.78 ms.
cifar100       train : [loss = 0.061, top1 = 99.17%], valid : [loss = 1.313, top1 = 70.47%], test : [loss = 1.309, top1 = 70.35%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.21 ms.
ImageNet16-120 train : [loss = 1.591, top1 = 57.10%], valid : [loss = 2.175, top1 = 44.43%], test : [loss = 2.168, top1 = 45.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.479, top1 = 83.69%], valid : [loss = 0.572, top1 = 80.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15258/15625) 015258-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.95 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.442, top1 = 90.35%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.48 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.308, top1 = 93.35%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.38 ms.
cifar100       train : [loss = 0.059, top1 = 99.18%], valid : [loss = 1.385, top1 = 69.65%], test : [loss = 1.400, top1 = 69.35%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.40 ms.
ImageNet16-120 train : [loss = 1.524, top1 = 58.88%], valid : [loss = 2.267, top1 = 43.39%], test : [loss = 2.292, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.435, top1 = 85.09%], valid : [loss = 0.554, top1 = 81.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15259/15625) 015259-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.44 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.562, top1 = 89.04%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.20 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.364, top1 = 92.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.39 ms.
cifar100       train : [loss = 0.061, top1 = 99.30%], valid : [loss = 1.422, top1 = 69.35%], test : [loss = 1.415, top1 = 69.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 1.750, top1 = 53.41%], valid : [loss = 2.434, top1 = 40.20%], test : [loss = 2.449, top1 = 39.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.591, top1 = 79.29%], valid : [loss = 0.705, top1 = 75.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15260/15625) 015260-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.81 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.61%], valid : [loss = 0.558, top1 = 87.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.033, top1 = 99.02%], test  : [loss = 0.372, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.04 ms.
cifar100       train : [loss = 0.528, top1 = 84.68%], valid : [loss = 1.343, top1 = 64.67%], test : [loss = 1.358, top1 = 64.44%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.561, top1 = 34.85%], valid : [loss = 2.651, top1 = 33.09%], test : [loss = 2.672, top1 = 32.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15261/15625) 015261-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.68%], valid : [loss = 0.531, top1 = 88.27%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.25 ms.
cifar10        train : [loss = 0.026, top1 = 99.22%], test  : [loss = 0.340, top1 = 91.67%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.08 ms.
cifar100       train : [loss = 0.442, top1 = 87.18%], valid : [loss = 1.265, top1 = 66.85%], test : [loss = 1.251, top1 = 67.27%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.187, top1 = 43.34%], valid : [loss = 2.363, top1 = 40.18%], test : [loss = 2.402, top1 = 38.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.731, top1 = 74.28%], valid : [loss = 0.784, top1 = 72.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15262/15625) 015262-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.409, top1 = 90.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.53 ms.
cifar10        train : [loss = 0.004, top1 = 99.95%], test  : [loss = 0.273, top1 = 93.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.49 ms.
cifar100       train : [loss = 0.061, top1 = 99.31%], valid : [loss = 1.297, top1 = 70.35%], test : [loss = 1.284, top1 = 70.73%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 1.467, top1 = 60.16%], valid : [loss = 2.216, top1 = 44.82%], test : [loss = 2.225, top1 = 44.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.402, top1 = 86.18%], valid : [loss = 0.523, top1 = 82.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15263/15625) 015263-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.552, top1 = 87.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10        train : [loss = 0.014, top1 = 99.66%], test  : [loss = 0.377, top1 = 91.51%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.64 ms.
cifar100       train : [loss = 0.385, top1 = 89.12%], valid : [loss = 1.401, top1 = 64.71%], test : [loss = 1.389, top1 = 65.49%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.86 ms.
ImageNet16-120 train : [loss = 2.257, top1 = 41.84%], valid : [loss = 2.479, top1 = 37.21%], test : [loss = 2.483, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.713, top1 = 74.66%], valid : [loss = 0.778, top1 = 72.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15264/15625) 015264-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.91 ms.
cifar10-valid  train : [loss = 0.823, top1 = 70.65%], valid : [loss = 0.909, top1 = 68.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.63 ms.
cifar10        train : [loss = 0.685, top1 = 76.02%], test  : [loss = 0.740, top1 = 74.40%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.44 ms.
cifar100       train : [loss = 2.266, top1 = 40.17%], valid : [loss = 2.354, top1 = 38.68%], test : [loss = 2.369, top1 = 38.61%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.53 ms.
ImageNet16-120 train : [loss = 3.490, top1 = 17.92%], valid : [loss = 3.479, top1 = 18.40%], test : [loss = 3.494, top1 = 17.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.373, top1 = 49.73%], valid : [loss = 1.416, top1 = 48.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15265/15625) 015265-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.96 ms.
cifar10-valid  train : [loss = 0.173, top1 = 94.33%], valid : [loss = 0.531, top1 = 84.32%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.85 ms.
cifar10        train : [loss = 0.171, top1 = 94.24%], test  : [loss = 0.391, top1 = 88.07%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.69 ms.
cifar100       train : [loss = 1.194, top1 = 66.22%], valid : [loss = 1.530, top1 = 58.26%], test : [loss = 1.497, top1 = 58.91%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 2.637, top1 = 33.88%], valid : [loss = 2.682, top1 = 33.53%], test : [loss = 2.726, top1 = 32.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.884, top1 = 68.49%], valid : [loss = 0.933, top1 = 67.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15266/15625) 015266-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.63 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.38%], valid : [loss = 0.596, top1 = 85.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.51 ms.
cifar10        train : [loss = 0.109, top1 = 96.41%], test  : [loss = 0.385, top1 = 88.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.73 ms.
cifar100       train : [loss = 0.807, top1 = 76.26%], valid : [loss = 1.418, top1 = 62.40%], test : [loss = 1.409, top1 = 62.79%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.96 ms.
ImageNet16-120 train : [loss = 2.661, top1 = 33.30%], valid : [loss = 2.747, top1 = 32.38%], test : [loss = 2.801, top1 = 30.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.36%], valid : [loss = 0.691, top1 = 76.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15267/15625) 015267-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.70 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.480, top1 = 89.08%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.29 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.305, top1 = 92.41%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.75 ms.
cifar100       train : [loss = 0.324, top1 = 91.22%], valid : [loss = 1.247, top1 = 67.67%], test : [loss = 1.249, top1 = 68.11%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.88 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.69%], valid : [loss = 2.321, top1 = 40.49%], test : [loss = 2.340, top1 = 40.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.502, top1 = 82.55%], valid : [loss = 0.590, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15268/15625) 015268-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.70 ms.
cifar10-valid  train : [loss = 0.786, top1 = 72.00%], valid : [loss = 0.879, top1 = 69.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.66 ms.
cifar10        train : [loss = 0.751, top1 = 73.51%], test  : [loss = 0.794, top1 = 72.18%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.77 ms.
cifar100       train : [loss = 2.358, top1 = 38.43%], valid : [loss = 2.481, top1 = 36.37%], test : [loss = 2.465, top1 = 36.79%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.11 ms.
ImageNet16-120 train : [loss = 3.544, top1 = 17.34%], valid : [loss = 3.530, top1 = 17.79%], test : [loss = 3.540, top1 = 17.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.451, top1 = 46.56%], valid : [loss = 1.498, top1 = 44.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15269/15625) 015269-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.05 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.577, top1 = 88.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.37 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.371, top1 = 92.39%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.50 ms.
cifar100       train : [loss = 0.100, top1 = 98.24%], valid : [loss = 1.464, top1 = 67.87%], test : [loss = 1.444, top1 = 68.69%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 1.848, top1 = 51.07%], valid : [loss = 2.404, top1 = 40.34%], test : [loss = 2.419, top1 = 40.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.19%], valid : [loss = 0.697, top1 = 76.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15270/15625) 015270-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.17 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.36%], valid : [loss = 0.581, top1 = 86.58%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.32 ms.
cifar10        train : [loss = 0.037, top1 = 98.87%], test  : [loss = 0.376, top1 = 90.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.14 ms.
cifar100       train : [loss = 0.339, top1 = 90.24%], valid : [loss = 1.358, top1 = 66.09%], test : [loss = 1.367, top1 = 66.35%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.69 ms.
ImageNet16-120 train : [loss = 2.746, top1 = 30.83%], valid : [loss = 2.805, top1 = 29.34%], test : [loss = 2.842, top1 = 28.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.37%], valid : [loss = 0.996, top1 = 64.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15271/15625) 015271-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.56 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.578, top1 = 87.33%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.59 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.375, top1 = 91.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.07 ms.
cifar100       train : [loss = 0.350, top1 = 90.13%], valid : [loss = 1.434, top1 = 65.14%], test : [loss = 1.429, top1 = 64.93%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.91 ms.
ImageNet16-120 train : [loss = 2.235, top1 = 42.42%], valid : [loss = 2.484, top1 = 37.60%], test : [loss = 2.518, top1 = 37.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.793, top1 = 71.44%], valid : [loss = 0.850, top1 = 69.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15272/15625) 015272-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.326, top1 = 88.74%], valid : [loss = 0.563, top1 = 81.74%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.285, top1 = 90.22%], test  : [loss = 0.433, top1 = 85.93%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.01 ms.
cifar100       train : [loss = 1.566, top1 = 56.35%], valid : [loss = 1.773, top1 = 52.33%], test : [loss = 1.769, top1 = 51.88%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 3.043, top1 = 25.89%], valid : [loss = 3.035, top1 = 26.13%], test : [loss = 3.107, top1 = 24.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.032, top1 = 62.84%], valid : [loss = 1.077, top1 = 61.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15273/15625) 015273-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.41 ms.
cifar10-valid  train : [loss = 0.127, top1 = 95.95%], valid : [loss = 0.566, top1 = 84.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.71 ms.
cifar10        train : [loss = 0.135, top1 = 95.57%], test  : [loss = 0.383, top1 = 88.45%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.23 ms.
cifar100       train : [loss = 1.062, top1 = 69.29%], valid : [loss = 1.477, top1 = 59.97%], test : [loss = 1.479, top1 = 59.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.518, top1 = 36.32%], valid : [loss = 2.601, top1 = 34.83%], test : [loss = 2.636, top1 = 34.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.850, top1 = 69.37%], valid : [loss = 0.912, top1 = 67.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15274/15625) 015274-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.484, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.38 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.316, top1 = 92.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.60 ms.
cifar100       train : [loss = 0.326, top1 = 91.26%], valid : [loss = 1.256, top1 = 67.53%], test : [loss = 1.265, top1 = 67.47%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.39 ms.
ImageNet16-120 train : [loss = 2.027, top1 = 46.95%], valid : [loss = 2.296, top1 = 40.83%], test : [loss = 2.332, top1 = 40.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.504, top1 = 82.64%], valid : [loss = 0.603, top1 = 79.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15275/15625) 015275-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.07 ms.
cifar10-valid  train : [loss = 1.287, top1 = 53.68%], valid : [loss = 1.327, top1 = 52.52%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10        train : [loss = 1.220, top1 = 56.38%], test  : [loss = 1.226, top1 = 55.91%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.22 ms.
cifar100       train : [loss = 2.747, top1 = 31.34%], valid : [loss = 2.830, top1 = 30.05%], test : [loss = 2.811, top1 = 30.56%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.47 ms.
ImageNet16-120 train : [loss = 3.904, top1 = 11.88%], valid : [loss = 3.894, top1 = 12.69%], test : [loss = 3.919, top1 = 12.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.733, top1 = 34.62%], valid : [loss = 1.739, top1 = 33.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15276/15625) 015276-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.538, top1 = 88.36%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.32 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.353, top1 = 91.81%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.59 ms.
cifar100       train : [loss = 0.303, top1 = 91.63%], valid : [loss = 1.285, top1 = 67.41%], test : [loss = 1.310, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.00 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.69%], valid : [loss = 2.428, top1 = 38.71%], test : [loss = 2.435, top1 = 39.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.812, top1 = 70.67%], valid : [loss = 0.864, top1 = 69.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15277/15625) 015277-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.482, top1 = 88.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.320, top1 = 92.21%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.54 ms.
cifar100       train : [loss = 0.316, top1 = 91.51%], valid : [loss = 1.255, top1 = 67.69%], test : [loss = 1.252, top1 = 68.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.01 ms.
ImageNet16-120 train : [loss = 2.038, top1 = 46.70%], valid : [loss = 2.326, top1 = 40.46%], test : [loss = 2.340, top1 = 40.96%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.527, top1 = 81.83%], valid : [loss = 0.614, top1 = 78.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15278/15625) 015278-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.63 ms.
cifar10-valid  train : [loss = 0.297, top1 = 89.77%], valid : [loss = 0.557, top1 = 82.35%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.46 ms.
cifar10        train : [loss = 0.270, top1 = 90.78%], test  : [loss = 0.419, top1 = 86.13%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.75 ms.
cifar100       train : [loss = 1.402, top1 = 60.57%], valid : [loss = 1.651, top1 = 54.85%], test : [loss = 1.652, top1 = 55.15%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.94 ms.
ImageNet16-120 train : [loss = 2.931, top1 = 27.94%], valid : [loss = 2.939, top1 = 28.00%], test : [loss = 2.994, top1 = 27.01%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.42%], valid : [loss = 1.053, top1 = 62.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15279/15625) 015279-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.36 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.589, top1 = 87.65%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.62 ms.
cifar10        train : [loss = 0.010, top1 = 99.81%], test  : [loss = 0.394, top1 = 91.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.41 ms.
cifar100       train : [loss = 0.158, top1 = 96.42%], valid : [loss = 1.528, top1 = 65.93%], test : [loss = 1.523, top1 = 66.21%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.156, top1 = 44.08%], valid : [loss = 2.462, top1 = 38.04%], test : [loss = 2.486, top1 = 37.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.653, top1 = 77.06%], valid : [loss = 0.735, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15280/15625) 015280-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.47 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.573, top1 = 87.39%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.87 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.381, top1 = 91.27%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.10 ms.
cifar100       train : [loss = 0.398, top1 = 88.69%], valid : [loss = 1.423, top1 = 64.96%], test : [loss = 1.394, top1 = 65.69%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.25 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.90%], valid : [loss = 2.523, top1 = 36.63%], test : [loss = 2.550, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15281/15625) 015281-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.435, top1 = 90.23%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.288, top1 = 93.27%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.40 ms.
cifar100       train : [loss = 0.115, top1 = 97.76%], valid : [loss = 1.317, top1 = 69.51%], test : [loss = 1.294, top1 = 70.27%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.74 ms.
ImageNet16-120 train : [loss = 1.692, top1 = 54.66%], valid : [loss = 2.223, top1 = 43.62%], test : [loss = 2.253, top1 = 43.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.481, top1 = 83.17%], valid : [loss = 0.586, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15282/15625) 015282-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.38%], valid : [loss = 0.519, top1 = 86.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.077, top1 = 97.71%], test  : [loss = 0.344, top1 = 90.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.43 ms.
cifar100       train : [loss = 0.682, top1 = 80.18%], valid : [loss = 1.319, top1 = 64.48%], test : [loss = 1.292, top1 = 65.43%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.361, top1 = 39.60%], valid : [loss = 2.491, top1 = 36.76%], test : [loss = 2.519, top1 = 36.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.71%], valid : [loss = 0.921, top1 = 68.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15283/15625) 015283-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.78 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.426, top1 = 91.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.295, top1 = 93.51%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.75 ms.
cifar100       train : [loss = 0.058, top1 = 99.20%], valid : [loss = 1.337, top1 = 70.57%], test : [loss = 1.343, top1 = 70.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.46 ms.
ImageNet16-120 train : [loss = 1.501, top1 = 59.40%], valid : [loss = 2.225, top1 = 44.09%], test : [loss = 2.250, top1 = 44.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.97%], valid : [loss = 0.512, top1 = 82.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15284/15625) 015284-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.509, top1 = 88.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10        train : [loss = 0.013, top1 = 99.72%], test  : [loss = 0.359, top1 = 91.44%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.270, top1 = 92.72%], valid : [loss = 1.411, top1 = 66.27%], test : [loss = 1.402, top1 = 66.33%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.00 ms.
ImageNet16-120 train : [loss = 2.135, top1 = 44.68%], valid : [loss = 2.503, top1 = 37.36%], test : [loss = 2.524, top1 = 37.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.552, top1 = 80.83%], valid : [loss = 0.653, top1 = 77.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15285/15625) 015285-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.62 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.87%], valid : [loss = 0.537, top1 = 88.59%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.352, top1 = 91.85%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.42 ms.
cifar100       train : [loss = 0.288, top1 = 92.04%], valid : [loss = 1.309, top1 = 68.07%], test : [loss = 1.335, top1 = 67.59%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 2.164, top1 = 43.84%], valid : [loss = 2.426, top1 = 38.38%], test : [loss = 2.433, top1 = 38.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.967, top1 = 65.30%], valid : [loss = 1.002, top1 = 64.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15286/15625) 015286-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.29 ms.
cifar10-valid  train : [loss = 0.160, top1 = 94.60%], valid : [loss = 0.874, top1 = 77.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.55 ms.
cifar10        train : [loss = 0.228, top1 = 92.20%], test  : [loss = 0.595, top1 = 82.40%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.23 ms.
cifar100       train : [loss = 1.155, top1 = 67.20%], valid : [loss = 1.801, top1 = 53.50%], test : [loss = 1.791, top1 = 54.24%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 3.224, top1 = 22.82%], valid : [loss = 3.323, top1 = 21.34%], test : [loss = 3.354, top1 = 20.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15287/15625) 015287-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.78 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.559, top1 = 89.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.372, top1 = 92.31%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.99 ms.
cifar100       train : [loss = 0.097, top1 = 98.33%], valid : [loss = 1.437, top1 = 68.40%], test : [loss = 1.448, top1 = 68.23%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.66 ms.
ImageNet16-120 train : [loss = 1.863, top1 = 50.76%], valid : [loss = 2.426, top1 = 39.32%], test : [loss = 2.453, top1 = 39.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15288/15625) 015288-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.17%], valid : [loss = 0.473, top1 = 84.52%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.32 ms.
cifar10        train : [loss = 0.295, top1 = 90.10%], test  : [loss = 0.395, top1 = 86.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.51 ms.
cifar100       train : [loss = 1.327, top1 = 63.27%], valid : [loss = 1.542, top1 = 58.33%], test : [loss = 1.503, top1 = 58.13%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 2.906, top1 = 28.92%], valid : [loss = 2.885, top1 = 29.23%], test : [loss = 2.946, top1 = 28.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15289/15625) 015289-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.87 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.32%], valid : [loss = 0.858, top1 = 71.83%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10        train : [loss = 0.553, top1 = 80.63%], test  : [loss = 0.715, top1 = 75.54%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.50 ms.
cifar100       train : [loss = 1.770, top1 = 52.18%], valid : [loss = 2.039, top1 = 47.21%], test : [loss = 2.070, top1 = 46.37%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.27 ms.
ImageNet16-120 train : [loss = 3.584, top1 = 16.83%], valid : [loss = 3.634, top1 = 16.27%], test : [loss = 3.660, top1 = 15.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15290/15625) 015290-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.38 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.599, top1 = 86.71%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.11 ms.
cifar10        train : [loss = 0.024, top1 = 99.41%], test  : [loss = 0.429, top1 = 89.52%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.81 ms.
cifar100       train : [loss = 0.300, top1 = 92.34%], valid : [loss = 1.461, top1 = 64.77%], test : [loss = 1.450, top1 = 64.85%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.204, top1 = 43.05%], valid : [loss = 2.561, top1 = 36.10%], test : [loss = 2.567, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.59%], valid : [loss = 0.741, top1 = 74.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15291/15625) 015291-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.491, top1 = 90.02%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=21.84 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.319, top1 = 93.32%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.46 ms.
cifar100       train : [loss = 0.117, top1 = 97.73%], valid : [loss = 1.298, top1 = 69.32%], test : [loss = 1.292, top1 = 69.72%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=18.16 ms.
ImageNet16-120 train : [loss = 1.701, top1 = 54.45%], valid : [loss = 2.183, top1 = 44.21%], test : [loss = 2.200, top1 = 43.84%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.628, top1 = 77.84%], valid : [loss = 0.699, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15292/15625) 015292-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.00 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.39%], valid : [loss = 0.722, top1 = 83.83%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.93 ms.
cifar10        train : [loss = 0.051, top1 = 98.47%], test  : [loss = 0.439, top1 = 88.66%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.98 ms.
cifar100       train : [loss = 0.622, top1 = 81.76%], valid : [loss = 1.526, top1 = 61.06%], test : [loss = 1.492, top1 = 61.89%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.48 ms.
ImageNet16-120 train : [loss = 2.647, top1 = 33.75%], valid : [loss = 2.806, top1 = 30.32%], test : [loss = 2.856, top1 = 30.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.80%], valid : [loss = 0.876, top1 = 69.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15293/15625) 015293-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.84 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.81%], valid : [loss = 0.822, top1 = 83.47%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.50 ms.
cifar10        train : [loss = 0.025, top1 = 99.35%], test  : [loss = 0.557, top1 = 87.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.00 ms.
cifar100       train : [loss = 0.291, top1 = 92.59%], valid : [loss = 1.815, top1 = 59.88%], test : [loss = 1.818, top1 = 60.17%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 2.557, top1 = 35.81%], valid : [loss = 2.989, top1 = 27.94%], test : [loss = 3.004, top1 = 28.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.888, top1 = 68.39%], valid : [loss = 0.957, top1 = 65.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15294/15625) 015294-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.560, top1 = 88.71%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.00 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.378, top1 = 92.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.56 ms.
cifar100       train : [loss = 0.118, top1 = 97.80%], valid : [loss = 1.425, top1 = 67.81%], test : [loss = 1.461, top1 = 67.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.99 ms.
ImageNet16-120 train : [loss = 1.915, top1 = 49.56%], valid : [loss = 2.414, top1 = 40.12%], test : [loss = 2.421, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.666, top1 = 76.36%], valid : [loss = 0.753, top1 = 73.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15295/15625) 015295-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.93%], valid : [loss = 0.530, top1 = 87.03%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.59 ms.
cifar10        train : [loss = 0.074, top1 = 97.70%], test  : [loss = 0.362, top1 = 90.05%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.48 ms.
cifar100       train : [loss = 0.707, top1 = 79.19%], valid : [loss = 1.365, top1 = 64.16%], test : [loss = 1.332, top1 = 63.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.77 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 36.27%], valid : [loss = 2.642, top1 = 34.48%], test : [loss = 2.671, top1 = 33.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15296/15625) 015296-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.525, top1 = 89.00%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.00 ms.
cifar10        train : [loss = 0.009, top1 = 99.83%], test  : [loss = 0.309, top1 = 92.70%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.05 ms.
cifar100       train : [loss = 0.170, top1 = 96.20%], valid : [loss = 1.302, top1 = 69.02%], test : [loss = 1.309, top1 = 68.52%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.19 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.88%], valid : [loss = 2.269, top1 = 41.93%], test : [loss = 2.300, top1 = 41.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.756, top1 = 72.94%], valid : [loss = 0.810, top1 = 71.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15297/15625) 015297-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.01 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.525, top1 = 89.00%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.373, top1 = 92.44%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=14.93 ms.
cifar100       train : [loss = 0.075, top1 = 98.73%], valid : [loss = 1.542, top1 = 67.49%], test : [loss = 1.508, top1 = 67.61%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.56 ms.
ImageNet16-120 train : [loss = 1.826, top1 = 51.74%], valid : [loss = 2.369, top1 = 40.39%], test : [loss = 2.389, top1 = 41.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.655, top1 = 76.83%], valid : [loss = 0.738, top1 = 74.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15298/15625) 015298-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.019, top1 = 99.46%], valid : [loss = 0.547, top1 = 87.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.05 ms.
cifar10        train : [loss = 0.032, top1 = 99.01%], test  : [loss = 0.350, top1 = 91.10%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.97 ms.
cifar100       train : [loss = 0.434, top1 = 87.18%], valid : [loss = 1.285, top1 = 66.41%], test : [loss = 1.290, top1 = 66.79%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.241, top1 = 42.02%], valid : [loss = 2.420, top1 = 38.52%], test : [loss = 2.440, top1 = 38.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 68.12%], valid : [loss = 0.935, top1 = 66.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15299/15625) 015299-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.76 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.502, top1 = 89.37%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.81 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.312, top1 = 93.00%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.28 ms.
cifar100       train : [loss = 0.157, top1 = 96.60%], valid : [loss = 1.210, top1 = 70.75%], test : [loss = 1.226, top1 = 69.93%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.15 ms.
ImageNet16-120 train : [loss = 1.796, top1 = 52.31%], valid : [loss = 2.154, top1 = 44.20%], test : [loss = 2.185, top1 = 44.05%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.686, top1 = 75.50%], valid : [loss = 0.755, top1 = 73.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15300/15625) 015300-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.53%], valid : [loss = 0.658, top1 = 82.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.90 ms.
cifar10        train : [loss = 0.149, top1 = 95.01%], test  : [loss = 0.445, top1 = 86.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.27 ms.
cifar100       train : [loss = 0.981, top1 = 71.52%], valid : [loss = 1.632, top1 = 57.00%], test : [loss = 1.636, top1 = 56.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.53 ms.
ImageNet16-120 train : [loss = 3.040, top1 = 25.66%], valid : [loss = 3.120, top1 = 24.69%], test : [loss = 3.165, top1 = 23.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15301/15625) 015301-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.35 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.19%], valid : [loss = 0.610, top1 = 85.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.02 ms.
cifar10        train : [loss = 0.066, top1 = 98.03%], test  : [loss = 0.396, top1 = 88.87%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.24 ms.
cifar100       train : [loss = 0.719, top1 = 79.19%], valid : [loss = 1.394, top1 = 63.22%], test : [loss = 1.362, top1 = 63.59%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 2.531, top1 = 36.11%], valid : [loss = 2.644, top1 = 34.22%], test : [loss = 2.696, top1 = 33.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15302/15625) 015302-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.88 ms.
cifar10-valid  train : [loss = 0.658, top1 = 76.77%], valid : [loss = 0.757, top1 = 74.08%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.07 ms.
cifar10        train : [loss = 0.556, top1 = 80.82%], test  : [loss = 0.619, top1 = 78.86%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.22 ms.
cifar100       train : [loss = 2.012, top1 = 45.75%], valid : [loss = 2.108, top1 = 43.93%], test : [loss = 2.111, top1 = 43.33%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.16 ms.
ImageNet16-120 train : [loss = 3.187, top1 = 23.14%], valid : [loss = 3.147, top1 = 24.40%], test : [loss = 3.185, top1 = 23.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.196, top1 = 57.07%], valid : [loss = 1.234, top1 = 56.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15303/15625) 015303-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.429, top1 = 90.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.82 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.283, top1 = 93.31%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.27 ms.
cifar100       train : [loss = 0.180, top1 = 95.79%], valid : [loss = 1.277, top1 = 69.63%], test : [loss = 1.277, top1 = 69.59%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.813, top1 = 51.74%], valid : [loss = 2.251, top1 = 43.08%], test : [loss = 2.265, top1 = 42.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 86.99%], valid : [loss = 0.506, top1 = 82.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15304/15625) 015304-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.49 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.74%], valid : [loss = 0.562, top1 = 87.83%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.35 ms.
cifar10        train : [loss = 0.018, top1 = 99.53%], test  : [loss = 0.369, top1 = 91.28%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.34 ms.
cifar100       train : [loss = 0.272, top1 = 92.52%], valid : [loss = 1.332, top1 = 67.23%], test : [loss = 1.321, top1 = 67.52%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.94 ms.
ImageNet16-120 train : [loss = 2.472, top1 = 36.79%], valid : [loss = 2.567, top1 = 34.45%], test : [loss = 2.623, top1 = 33.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.972, top1 = 65.18%], valid : [loss = 1.012, top1 = 64.07%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15305/15625) 015305-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.60 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.89%], valid : [loss = 0.580, top1 = 87.17%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.76 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.368, top1 = 91.50%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.34 ms.
cifar100       train : [loss = 0.415, top1 = 88.18%], valid : [loss = 1.401, top1 = 64.63%], test : [loss = 1.378, top1 = 65.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.27 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.83%], valid : [loss = 2.519, top1 = 36.48%], test : [loss = 2.535, top1 = 37.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.03%], valid : [loss = 0.777, top1 = 73.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15306/15625) 015306-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.57 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.59%], valid : [loss = 0.585, top1 = 87.09%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.79 ms.
cifar10        train : [loss = 0.040, top1 = 98.83%], test  : [loss = 0.395, top1 = 90.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.67 ms.
cifar100       train : [loss = 0.553, top1 = 83.74%], valid : [loss = 1.401, top1 = 64.17%], test : [loss = 1.413, top1 = 63.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.02 ms.
ImageNet16-120 train : [loss = 2.492, top1 = 36.86%], valid : [loss = 2.610, top1 = 34.22%], test : [loss = 2.685, top1 = 33.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.27%], valid : [loss = 0.707, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15307/15625) 015307-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.113, top1 = 96.62%], valid : [loss = 0.449, top1 = 86.32%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.42 ms.
cifar10        train : [loss = 0.154, top1 = 95.01%], test  : [loss = 0.340, top1 = 89.07%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.83 ms.
cifar100       train : [loss = 0.997, top1 = 71.70%], valid : [loss = 1.347, top1 = 62.32%], test : [loss = 1.338, top1 = 61.93%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.22 ms.
ImageNet16-120 train : [loss = 2.629, top1 = 33.92%], valid : [loss = 2.662, top1 = 33.03%], test : [loss = 2.701, top1 = 33.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.702, top1 = 75.01%], valid : [loss = 0.736, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15308/15625) 015308-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.75 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.75%], valid : [loss = 0.652, top1 = 85.81%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.16 ms.
cifar10        train : [loss = 0.031, top1 = 99.14%], test  : [loss = 0.417, top1 = 89.90%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.17 ms.
cifar100       train : [loss = 0.509, top1 = 85.20%], valid : [loss = 1.457, top1 = 63.72%], test : [loss = 1.424, top1 = 64.26%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.89 ms.
ImageNet16-120 train : [loss = 2.419, top1 = 38.41%], valid : [loss = 2.606, top1 = 34.02%], test : [loss = 2.619, top1 = 35.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.776, top1 = 72.58%], valid : [loss = 0.839, top1 = 70.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15309/15625) 015309-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.33 ms.
cifar10-valid  train : [loss = 0.539, top1 = 81.15%], valid : [loss = 0.861, top1 = 71.74%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.69 ms.
cifar10        train : [loss = 0.558, top1 = 80.57%], test  : [loss = 0.715, top1 = 75.69%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.56 ms.
cifar100       train : [loss = 1.765, top1 = 52.35%], valid : [loss = 2.032, top1 = 47.62%], test : [loss = 2.066, top1 = 46.92%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.88 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.82%], valid : [loss = 3.634, top1 = 16.58%], test : [loss = 3.674, top1 = 15.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15310/15625) 015310-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.73 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.526, top1 = 88.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.02 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.354, top1 = 91.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.23 ms.
cifar100       train : [loss = 0.335, top1 = 90.86%], valid : [loss = 1.294, top1 = 66.62%], test : [loss = 1.321, top1 = 67.18%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.33 ms.
ImageNet16-120 train : [loss = 2.140, top1 = 44.33%], valid : [loss = 2.426, top1 = 37.50%], test : [loss = 2.423, top1 = 39.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.773, top1 = 72.54%], valid : [loss = 0.836, top1 = 70.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15311/15625) 015311-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.72 ms.
cifar10-valid  train : [loss = 0.103, top1 = 97.01%], valid : [loss = 0.467, top1 = 86.09%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.43 ms.
cifar10        train : [loss = 0.146, top1 = 95.27%], test  : [loss = 0.339, top1 = 89.02%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.24 ms.
cifar100       train : [loss = 0.963, top1 = 72.57%], valid : [loss = 1.351, top1 = 62.33%], test : [loss = 1.336, top1 = 62.65%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.00 ms.
ImageNet16-120 train : [loss = 2.624, top1 = 34.04%], valid : [loss = 2.680, top1 = 33.22%], test : [loss = 2.706, top1 = 32.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15312/15625) 015312-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=21.60 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.509, top1 = 89.86%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.98 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.334, top1 = 93.12%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=20.10 ms.
cifar100       train : [loss = 0.075, top1 = 98.83%], valid : [loss = 1.378, top1 = 69.12%], test : [loss = 1.380, top1 = 69.55%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=19.92 ms.
ImageNet16-120 train : [loss = 2.007, top1 = 47.23%], valid : [loss = 2.370, top1 = 39.37%], test : [loss = 2.358, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.634, top1 = 77.88%], valid : [loss = 0.683, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15313/15625) 015313-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.04 ms.
cifar10-valid  train : [loss = 0.332, top1 = 88.56%], valid : [loss = 0.574, top1 = 81.56%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.48 ms.
cifar10        train : [loss = 0.253, top1 = 91.30%], test  : [loss = 0.436, top1 = 86.14%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.05 ms.
cifar100       train : [loss = 1.327, top1 = 62.53%], valid : [loss = 1.655, top1 = 55.42%], test : [loss = 1.654, top1 = 55.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.22 ms.
ImageNet16-120 train : [loss = 2.973, top1 = 27.48%], valid : [loss = 3.016, top1 = 26.65%], test : [loss = 3.047, top1 = 26.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.185, top1 = 56.98%], valid : [loss = 1.238, top1 = 55.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15314/15625) 015314-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.37 ms.
cifar10-valid  train : [loss = 0.322, top1 = 88.90%], valid : [loss = 0.568, top1 = 81.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.57 ms.
cifar10        train : [loss = 0.261, top1 = 91.03%], test  : [loss = 0.420, top1 = 86.40%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.58 ms.
cifar100       train : [loss = 1.461, top1 = 58.92%], valid : [loss = 1.691, top1 = 54.13%], test : [loss = 1.693, top1 = 53.54%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.879, top1 = 28.98%], valid : [loss = 2.896, top1 = 29.14%], test : [loss = 2.934, top1 = 27.81%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.023, top1 = 63.05%], valid : [loss = 1.078, top1 = 62.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15315/15625) 015315-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.86 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.77%], valid : [loss = 0.577, top1 = 88.08%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.40 ms.
cifar10        train : [loss = 0.017, top1 = 99.54%], test  : [loss = 0.384, top1 = 91.44%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.02 ms.
cifar100       train : [loss = 0.270, top1 = 92.85%], valid : [loss = 1.313, top1 = 67.48%], test : [loss = 1.376, top1 = 66.73%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.75 ms.
ImageNet16-120 train : [loss = 2.278, top1 = 41.15%], valid : [loss = 2.517, top1 = 36.22%], test : [loss = 2.520, top1 = 36.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.890, top1 = 67.75%], valid : [loss = 0.934, top1 = 66.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15316/15625) 015316-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.545, top1 = 88.47%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.356, top1 = 91.92%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.00 ms.
cifar100       train : [loss = 0.292, top1 = 91.83%], valid : [loss = 1.335, top1 = 67.41%], test : [loss = 1.315, top1 = 67.63%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.67 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 43.85%], valid : [loss = 2.439, top1 = 38.13%], test : [loss = 2.427, top1 = 38.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.900, top1 = 67.63%], valid : [loss = 0.925, top1 = 67.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15317/15625) 015317-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.97 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.69%], valid : [loss = 0.465, top1 = 86.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.18 ms.
cifar10        train : [loss = 0.151, top1 = 95.11%], test  : [loss = 0.349, top1 = 88.68%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.49 ms.
cifar100       train : [loss = 0.973, top1 = 72.34%], valid : [loss = 1.333, top1 = 62.87%], test : [loss = 1.332, top1 = 62.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.92%], valid : [loss = 2.693, top1 = 32.42%], test : [loss = 2.702, top1 = 32.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15318/15625) 015318-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.60%], valid : [loss = 0.458, top1 = 86.23%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.33 ms.
cifar10        train : [loss = 0.153, top1 = 95.02%], test  : [loss = 0.339, top1 = 89.00%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.16 ms.
cifar100       train : [loss = 0.982, top1 = 72.21%], valid : [loss = 1.351, top1 = 62.41%], test : [loss = 1.347, top1 = 62.22%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.30 ms.
ImageNet16-120 train : [loss = 2.622, top1 = 34.14%], valid : [loss = 2.674, top1 = 33.18%], test : [loss = 2.696, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.61%], valid : [loss = 0.806, top1 = 71.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15319/15625) 015319-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.87 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.68%], valid : [loss = 0.704, top1 = 84.76%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.48 ms.
cifar10        train : [loss = 0.036, top1 = 99.04%], test  : [loss = 0.428, top1 = 89.28%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.02 ms.
cifar100       train : [loss = 0.426, top1 = 88.19%], valid : [loss = 1.412, top1 = 64.47%], test : [loss = 1.391, top1 = 64.77%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.59 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.69%], valid : [loss = 2.661, top1 = 34.80%], test : [loss = 2.665, top1 = 34.72%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 73.83%], valid : [loss = 0.793, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15320/15625) 015320-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.44 ms.
cifar10-valid  train : [loss = 0.080, top1 = 97.55%], valid : [loss = 0.855, top1 = 79.60%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.42 ms.
cifar10        train : [loss = 0.129, top1 = 95.68%], test  : [loss = 0.536, top1 = 85.20%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.82 ms.
cifar100       train : [loss = 0.848, top1 = 75.33%], valid : [loss = 1.701, top1 = 57.29%], test : [loss = 1.679, top1 = 57.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.16 ms.
ImageNet16-120 train : [loss = 3.045, top1 = 26.23%], valid : [loss = 3.176, top1 = 24.02%], test : [loss = 3.219, top1 = 23.65%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.46%], valid : [loss = 1.117, top1 = 60.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15321/15625) 015321-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.488, top1 = 88.93%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.10 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.326, top1 = 92.08%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.21 ms.
cifar100       train : [loss = 0.323, top1 = 91.29%], valid : [loss = 1.253, top1 = 67.49%], test : [loss = 1.261, top1 = 67.95%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.99 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.71%], valid : [loss = 2.322, top1 = 40.74%], test : [loss = 2.342, top1 = 40.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15322/15625) 015322-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.05 ms.
cifar10-valid  train : [loss = 0.040, top1 = 98.97%], valid : [loss = 0.532, top1 = 86.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.56 ms.
cifar10        train : [loss = 0.074, top1 = 97.63%], test  : [loss = 0.356, top1 = 89.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.21 ms.
cifar100       train : [loss = 0.702, top1 = 79.36%], valid : [loss = 1.349, top1 = 64.78%], test : [loss = 1.340, top1 = 64.05%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.69 ms.
ImageNet16-120 train : [loss = 2.524, top1 = 36.20%], valid : [loss = 2.633, top1 = 34.25%], test : [loss = 2.681, top1 = 32.92%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.567, top1 = 79.89%], valid : [loss = 0.646, top1 = 77.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15323/15625) 015323-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.86 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.34%], valid : [loss = 0.862, top1 = 71.75%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.02 ms.
cifar10        train : [loss = 0.549, top1 = 80.85%], test  : [loss = 0.718, top1 = 75.45%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.86 ms.
cifar100       train : [loss = 1.768, top1 = 52.46%], valid : [loss = 2.039, top1 = 47.31%], test : [loss = 2.039, top1 = 47.29%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.95%], valid : [loss = 3.629, top1 = 16.75%], test : [loss = 3.664, top1 = 16.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15324/15625) 015324-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.45 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.475, top1 = 89.16%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.94 ms.
cifar10        train : [loss = 0.010, top1 = 99.83%], test  : [loss = 0.306, top1 = 92.36%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.35 ms.
cifar100       train : [loss = 0.226, top1 = 94.58%], valid : [loss = 1.237, top1 = 68.70%], test : [loss = 1.232, top1 = 69.13%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.58 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.67%], valid : [loss = 2.226, top1 = 42.54%], test : [loss = 2.252, top1 = 41.76%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.54%], valid : [loss = 0.620, top1 = 78.89%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15325/15625) 015325-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.30 ms.
cifar10-valid  train : [loss = 0.207, top1 = 93.15%], valid : [loss = 0.563, top1 = 83.04%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.97 ms.
cifar10        train : [loss = 0.190, top1 = 93.56%], test  : [loss = 0.389, top1 = 87.83%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.55 ms.
cifar100       train : [loss = 1.199, top1 = 65.58%], valid : [loss = 1.545, top1 = 57.64%], test : [loss = 1.514, top1 = 58.14%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.729, top1 = 31.96%], valid : [loss = 2.753, top1 = 30.83%], test : [loss = 2.814, top1 = 30.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.34%], valid : [loss = 0.975, top1 = 65.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15326/15625) 015326-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.61 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.467, top1 = 89.23%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.313, top1 = 92.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.72 ms.
cifar100       train : [loss = 0.327, top1 = 91.28%], valid : [loss = 1.238, top1 = 68.01%], test : [loss = 1.231, top1 = 68.07%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.45 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.79%], valid : [loss = 2.326, top1 = 39.91%], test : [loss = 2.340, top1 = 41.28%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.483, top1 = 83.16%], valid : [loss = 0.577, top1 = 80.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15327/15625) 015327-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.92 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.40%], valid : [loss = 0.679, top1 = 84.74%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.01 ms.
cifar10        train : [loss = 0.054, top1 = 98.38%], test  : [loss = 0.458, top1 = 88.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.12 ms.
cifar100       train : [loss = 0.617, top1 = 81.83%], valid : [loss = 1.547, top1 = 61.19%], test : [loss = 1.504, top1 = 61.88%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.58 ms.
ImageNet16-120 train : [loss = 2.675, top1 = 33.25%], valid : [loss = 2.829, top1 = 30.63%], test : [loss = 2.889, top1 = 30.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.809, top1 = 71.11%], valid : [loss = 0.884, top1 = 68.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15328/15625) 015328-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.18 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.555, top1 = 88.70%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.35 ms.
cifar10        train : [loss = 0.008, top1 = 99.83%], test  : [loss = 0.361, top1 = 91.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.87 ms.
cifar100       train : [loss = 0.145, top1 = 96.66%], valid : [loss = 1.374, top1 = 68.52%], test : [loss = 1.355, top1 = 69.26%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.46 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.41%], valid : [loss = 2.355, top1 = 40.23%], test : [loss = 2.352, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.853, top1 = 69.16%], valid : [loss = 0.893, top1 = 68.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15329/15625) 015329-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.91%], valid : [loss = 0.506, top1 = 88.81%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.26 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.338, top1 = 92.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.68 ms.
cifar100       train : [loss = 0.325, top1 = 91.12%], valid : [loss = 1.276, top1 = 66.84%], test : [loss = 1.304, top1 = 67.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.56 ms.
ImageNet16-120 train : [loss = 2.110, top1 = 45.01%], valid : [loss = 2.394, top1 = 39.50%], test : [loss = 2.399, top1 = 39.25%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 77.24%], valid : [loss = 0.707, top1 = 75.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15330/15625) 015330-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.071, top1 = 97.77%], valid : [loss = 0.644, top1 = 84.05%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.73 ms.
cifar10        train : [loss = 0.092, top1 = 97.05%], test  : [loss = 0.425, top1 = 88.39%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=13.51 ms.
cifar100       train : [loss = 0.687, top1 = 79.64%], valid : [loss = 1.553, top1 = 60.08%], test : [loss = 1.553, top1 = 60.46%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 3.225, top1 = 21.53%], valid : [loss = 3.228, top1 = 22.10%], test : [loss = 3.242, top1 = 21.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15331/15625) 015331-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.60 ms.
cifar10-valid  train : [loss = 0.103, top1 = 96.92%], valid : [loss = 0.526, top1 = 85.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.01 ms.
cifar10        train : [loss = 0.165, top1 = 94.50%], test  : [loss = 0.356, top1 = 88.94%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.55 ms.
cifar100       train : [loss = 1.005, top1 = 71.03%], valid : [loss = 1.369, top1 = 62.10%], test : [loss = 1.361, top1 = 62.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.13 ms.
ImageNet16-120 train : [loss = 2.678, top1 = 33.07%], valid : [loss = 2.704, top1 = 33.03%], test : [loss = 2.731, top1 = 32.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.75%], valid : [loss = 1.015, top1 = 64.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15332/15625) 015332-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.65 ms.
cifar10-valid  train : [loss = 0.132, top1 = 95.80%], valid : [loss = 0.533, top1 = 85.03%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.54 ms.
cifar10        train : [loss = 0.207, top1 = 93.00%], test  : [loss = 0.400, top1 = 87.57%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.01 ms.
cifar100       train : [loss = 0.990, top1 = 71.33%], valid : [loss = 1.402, top1 = 61.82%], test : [loss = 1.370, top1 = 62.06%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.77 ms.
ImageNet16-120 train : [loss = 2.746, top1 = 31.55%], valid : [loss = 2.743, top1 = 31.90%], test : [loss = 2.814, top1 = 30.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.975, top1 = 65.09%], valid : [loss = 1.030, top1 = 63.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15333/15625) 015333-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.49 ms.
cifar10-valid  train : [loss = 0.172, top1 = 94.41%], valid : [loss = 0.525, top1 = 84.37%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.67 ms.
cifar10        train : [loss = 0.183, top1 = 93.79%], test  : [loss = 0.395, top1 = 87.51%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.26 ms.
cifar100       train : [loss = 1.166, top1 = 66.68%], valid : [loss = 1.500, top1 = 59.01%], test : [loss = 1.488, top1 = 58.84%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.20 ms.
ImageNet16-120 train : [loss = 2.656, top1 = 33.56%], valid : [loss = 2.701, top1 = 32.46%], test : [loss = 2.742, top1 = 32.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.912, top1 = 67.09%], valid : [loss = 0.964, top1 = 66.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15334/15625) 015334-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.454, top1 = 89.68%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.07 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.338, top1 = 92.14%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.78 ms.
cifar100       train : [loss = 0.198, top1 = 95.09%], valid : [loss = 1.375, top1 = 67.23%], test : [loss = 1.362, top1 = 67.49%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.27 ms.
ImageNet16-120 train : [loss = 1.911, top1 = 49.57%], valid : [loss = 2.331, top1 = 40.94%], test : [loss = 2.349, top1 = 40.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.92%], valid : [loss = 0.568, top1 = 80.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15335/15625) 015335-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.04 ms.
cifar10-valid  train : [loss = 0.178, top1 = 94.28%], valid : [loss = 0.970, top1 = 74.72%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.83 ms.
cifar10        train : [loss = 0.229, top1 = 92.04%], test  : [loss = 0.590, top1 = 82.60%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.75 ms.
cifar100       train : [loss = 1.161, top1 = 67.15%], valid : [loss = 1.811, top1 = 53.42%], test : [loss = 1.783, top1 = 53.50%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.77 ms.
ImageNet16-120 train : [loss = 3.239, top1 = 22.46%], valid : [loss = 3.338, top1 = 21.50%], test : [loss = 3.386, top1 = 20.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15336/15625) 015336-th architecture! ----------
arch : |none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.79 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.452, top1 = 89.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.52 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.329, top1 = 92.25%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.62 ms.
cifar100       train : [loss = 0.332, top1 = 91.00%], valid : [loss = 1.312, top1 = 67.24%], test : [loss = 1.305, top1 = 67.10%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.06 ms.
ImageNet16-120 train : [loss = 2.061, top1 = 46.30%], valid : [loss = 2.396, top1 = 39.27%], test : [loss = 2.381, top1 = 40.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15337/15625) 015337-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.33 ms.
cifar10-valid  train : [loss = 0.582, top1 = 79.76%], valid : [loss = 0.715, top1 = 75.68%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.49 ms.
cifar10        train : [loss = 0.619, top1 = 78.29%], test  : [loss = 0.665, top1 = 77.43%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.11 ms.
cifar100       train : [loss = 1.792, top1 = 51.44%], valid : [loss = 1.943, top1 = 48.42%], test : [loss = 1.982, top1 = 48.20%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=14.08 ms.
ImageNet16-120 train : [loss = 3.407, top1 = 19.71%], valid : [loss = 3.391, top1 = 20.73%], test : [loss = 3.418, top1 = 19.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.377, top1 = 50.02%], valid : [loss = 1.389, top1 = 49.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15338/15625) 015338-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.61 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.41%], valid : [loss = 0.696, top1 = 84.64%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.99 ms.
cifar10        train : [loss = 0.052, top1 = 98.42%], test  : [loss = 0.446, top1 = 88.57%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.85 ms.
cifar100       train : [loss = 0.638, top1 = 81.38%], valid : [loss = 1.530, top1 = 61.41%], test : [loss = 1.514, top1 = 61.66%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.677, top1 = 33.16%], valid : [loss = 2.846, top1 = 29.88%], test : [loss = 2.889, top1 = 29.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.813, top1 = 70.94%], valid : [loss = 0.880, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15339/15625) 015339-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.51 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.78%], valid : [loss = 0.620, top1 = 86.35%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.84 ms.
cifar10        train : [loss = 0.029, top1 = 99.29%], test  : [loss = 0.413, top1 = 89.35%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.75 ms.
cifar100       train : [loss = 0.388, top1 = 89.59%], valid : [loss = 1.486, top1 = 64.40%], test : [loss = 1.421, top1 = 64.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.79 ms.
ImageNet16-120 train : [loss = 2.291, top1 = 41.03%], valid : [loss = 2.621, top1 = 34.73%], test : [loss = 2.639, top1 = 34.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.40%], valid : [loss = 0.777, top1 = 73.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15340/15625) 015340-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.50 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.447, top1 = 89.24%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.33 ms.
cifar10        train : [loss = 0.012, top1 = 99.81%], test  : [loss = 0.331, top1 = 91.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.52 ms.
cifar100       train : [loss = 0.330, top1 = 91.13%], valid : [loss = 1.302, top1 = 66.54%], test : [loss = 1.294, top1 = 66.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.59 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.07%], valid : [loss = 2.367, top1 = 39.50%], test : [loss = 2.397, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15341/15625) 015341-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=22.40 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.502, top1 = 90.07%]
cifar10        FLOP=188.66 M, Params=1.317 MB, latency=24.93 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.290, top1 = 93.78%]
cifar100       FLOP=188.67 M, Params=1.322 MB, latency=25.74 ms.
cifar100       train : [loss = 0.043, top1 = 99.56%], valid : [loss = 1.379, top1 = 69.90%], test : [loss = 1.361, top1 = 70.44%]
ImageNet16-120 FLOP= 47.17 M, Params=1.324 MB, latency=20.00 ms.
ImageNet16-120 train : [loss = 1.777, top1 = 52.68%], valid : [loss = 2.331, top1 = 40.53%], test : [loss = 2.353, top1 = 41.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=188.66 M, Params=1.317 MB, latency=None ms.
cifar10-valid  train : [loss = 0.609, top1 = 78.75%], valid : [loss = 0.684, top1 = 76.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15342/15625) 015342-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.98 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.561, top1 = 87.88%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=15.49 ms.
cifar10        train : [loss = 0.014, top1 = 99.62%], test  : [loss = 0.351, top1 = 91.84%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.71 ms.
cifar100       train : [loss = 0.297, top1 = 91.73%], valid : [loss = 1.285, top1 = 67.22%], test : [loss = 1.342, top1 = 67.02%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=15.20 ms.
ImageNet16-120 train : [loss = 2.225, top1 = 42.52%], valid : [loss = 2.452, top1 = 37.80%], test : [loss = 2.459, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 70.06%], valid : [loss = 0.869, top1 = 69.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15343/15625) 015343-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.34 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.37%], valid : [loss = 0.688, top1 = 84.66%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.70 ms.
cifar10        train : [loss = 0.055, top1 = 98.30%], test  : [loss = 0.438, top1 = 88.74%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.71 ms.
cifar100       train : [loss = 0.624, top1 = 81.83%], valid : [loss = 1.502, top1 = 62.10%], test : [loss = 1.467, top1 = 62.14%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.35 ms.
ImageNet16-120 train : [loss = 2.676, top1 = 33.18%], valid : [loss = 2.843, top1 = 29.87%], test : [loss = 2.899, top1 = 29.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.22%], valid : [loss = 0.858, top1 = 69.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15344/15625) 015344-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.49 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.80%], valid : [loss = 0.553, top1 = 82.66%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.93 ms.
cifar10        train : [loss = 0.251, top1 = 91.48%], test  : [loss = 0.407, top1 = 86.69%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.95 ms.
cifar100       train : [loss = 1.326, top1 = 62.59%], valid : [loss = 1.598, top1 = 56.50%], test : [loss = 1.582, top1 = 56.71%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.97 ms.
ImageNet16-120 train : [loss = 2.844, top1 = 29.86%], valid : [loss = 2.851, top1 = 30.12%], test : [loss = 2.895, top1 = 29.61%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.000, top1 = 63.85%], valid : [loss = 1.060, top1 = 63.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15345/15625) 015345-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.066, top1 = 98.14%], valid : [loss = 0.836, top1 = 80.62%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.17 ms.
cifar10        train : [loss = 0.133, top1 = 95.54%], test  : [loss = 0.570, top1 = 84.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.37 ms.
cifar100       train : [loss = 0.842, top1 = 75.44%], valid : [loss = 1.662, top1 = 57.96%], test : [loss = 1.730, top1 = 56.60%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.36 ms.
ImageNet16-120 train : [loss = 3.027, top1 = 26.72%], valid : [loss = 3.160, top1 = 24.37%], test : [loss = 3.195, top1 = 23.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.045, top1 = 62.46%], valid : [loss = 1.117, top1 = 60.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15346/15625) 015346-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.038, top1 = 99.17%], valid : [loss = 0.598, top1 = 85.54%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.73 ms.
cifar10        train : [loss = 0.070, top1 = 97.88%], test  : [loss = 0.400, top1 = 89.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.69 ms.
cifar100       train : [loss = 0.699, top1 = 79.75%], valid : [loss = 1.349, top1 = 63.20%], test : [loss = 1.349, top1 = 63.64%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.28 ms.
ImageNet16-120 train : [loss = 2.538, top1 = 35.99%], valid : [loss = 2.648, top1 = 34.63%], test : [loss = 2.689, top1 = 33.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.711, top1 = 75.02%], valid : [loss = 0.784, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15347/15625) 015347-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 48.42 M, Params=0.354 MB, latency=16.15 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.68%], valid : [loss = 0.605, top1 = 86.39%]
cifar10        FLOP= 48.42 M, Params=0.354 MB, latency=17.18 ms.
cifar10        train : [loss = 0.031, top1 = 99.11%], test  : [loss = 0.388, top1 = 90.35%]
cifar100       FLOP= 48.42 M, Params=0.360 MB, latency=16.86 ms.
cifar100       train : [loss = 0.555, top1 = 83.76%], valid : [loss = 1.409, top1 = 63.89%], test : [loss = 1.420, top1 = 63.51%]
ImageNet16-120 FLOP= 12.11 M, Params=0.361 MB, latency=13.62 ms.
ImageNet16-120 train : [loss = 2.372, top1 = 39.37%], valid : [loss = 2.564, top1 = 35.98%], test : [loss = 2.593, top1 = 35.51%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.779, top1 = 72.24%], valid : [loss = 0.839, top1 = 70.41%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15348/15625) 015348-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.525, top1 = 90.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.42 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.332, top1 = 93.20%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.87 ms.
cifar100       train : [loss = 0.109, top1 = 97.77%], valid : [loss = 1.388, top1 = 68.74%], test : [loss = 1.360, top1 = 69.12%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.89 ms.
ImageNet16-120 train : [loss = 1.715, top1 = 54.10%], valid : [loss = 2.187, top1 = 43.43%], test : [loss = 2.214, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.40%], valid : [loss = 0.668, top1 = 76.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15349/15625) 015349-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.064, top1 = 98.08%], valid : [loss = 0.576, top1 = 85.62%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.59 ms.
cifar10        train : [loss = 0.110, top1 = 96.38%], test  : [loss = 0.388, top1 = 88.67%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.48 ms.
cifar100       train : [loss = 0.816, top1 = 76.27%], valid : [loss = 1.399, top1 = 62.50%], test : [loss = 1.385, top1 = 62.36%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.98 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 32.90%], valid : [loss = 2.756, top1 = 32.60%], test : [loss = 2.822, top1 = 30.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.635, top1 = 77.71%], valid : [loss = 0.706, top1 = 75.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15350/15625) 015350-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.43 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.65%], valid : [loss = 0.867, top1 = 79.45%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.98 ms.
cifar10        train : [loss = 0.134, top1 = 95.46%], test  : [loss = 0.554, top1 = 84.59%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.14 ms.
cifar100       train : [loss = 0.851, top1 = 75.22%], valid : [loss = 1.671, top1 = 57.08%], test : [loss = 1.660, top1 = 57.66%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.25 ms.
ImageNet16-120 train : [loss = 3.048, top1 = 26.14%], valid : [loss = 3.194, top1 = 23.57%], test : [loss = 3.236, top1 = 23.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.066, top1 = 61.42%], valid : [loss = 1.128, top1 = 59.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15351/15625) 015351-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.55 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.538, top1 = 88.42%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.344, top1 = 91.98%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.36 ms.
cifar100       train : [loss = 0.305, top1 = 91.77%], valid : [loss = 1.306, top1 = 67.36%], test : [loss = 1.321, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.67 ms.
ImageNet16-120 train : [loss = 2.188, top1 = 43.22%], valid : [loss = 2.446, top1 = 37.97%], test : [loss = 2.448, top1 = 38.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.857, top1 = 69.02%], valid : [loss = 0.906, top1 = 67.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15352/15625) 015352-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.72 ms.
cifar10-valid  train : [loss = 0.198, top1 = 93.29%], valid : [loss = 0.548, top1 = 83.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.202, top1 = 93.22%], test  : [loss = 0.397, top1 = 87.53%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.89 ms.
cifar100       train : [loss = 1.259, top1 = 64.25%], valid : [loss = 1.556, top1 = 57.77%], test : [loss = 1.562, top1 = 57.05%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.60 ms.
ImageNet16-120 train : [loss = 2.692, top1 = 32.77%], valid : [loss = 2.728, top1 = 31.98%], test : [loss = 2.783, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.941, top1 = 66.08%], valid : [loss = 1.005, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15353/15625) 015353-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.76 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.506, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.42 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.325, top1 = 92.17%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.22 ms.
cifar100       train : [loss = 0.315, top1 = 91.45%], valid : [loss = 1.268, top1 = 67.28%], test : [loss = 1.286, top1 = 67.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.21 ms.
ImageNet16-120 train : [loss = 2.112, top1 = 44.92%], valid : [loss = 2.401, top1 = 39.12%], test : [loss = 2.393, top1 = 39.18%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.92%], valid : [loss = 0.761, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15354/15625) 015354-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.71%], valid : [loss = 0.544, top1 = 88.00%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.73 ms.
cifar10        train : [loss = 0.027, top1 = 99.30%], test  : [loss = 0.352, top1 = 91.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.65 ms.
cifar100       train : [loss = 0.466, top1 = 86.42%], valid : [loss = 1.350, top1 = 65.68%], test : [loss = 1.353, top1 = 65.64%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.30 ms.
ImageNet16-120 train : [loss = 2.335, top1 = 40.15%], valid : [loss = 2.528, top1 = 36.37%], test : [loss = 2.555, top1 = 35.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.631, top1 = 77.93%], valid : [loss = 0.709, top1 = 75.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15355/15625) 015355-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=19.73 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.96%], valid : [loss = 0.509, top1 = 88.87%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=23.20 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.314, top1 = 91.97%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=19.03 ms.
cifar100       train : [loss = 0.251, top1 = 93.66%], valid : [loss = 1.245, top1 = 68.54%], test : [loss = 1.257, top1 = 68.52%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=17.44 ms.
ImageNet16-120 train : [loss = 1.951, top1 = 48.79%], valid : [loss = 2.288, top1 = 41.47%], test : [loss = 2.309, top1 = 41.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.566, top1 = 80.11%], valid : [loss = 0.633, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15356/15625) 015356-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.79 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.72%], valid : [loss = 0.517, top1 = 87.97%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.14 ms.
cifar10        train : [loss = 0.030, top1 = 99.20%], test  : [loss = 0.348, top1 = 91.16%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.81 ms.
cifar100       train : [loss = 0.472, top1 = 86.32%], valid : [loss = 1.347, top1 = 66.38%], test : [loss = 1.348, top1 = 66.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.36 ms.
ImageNet16-120 train : [loss = 2.342, top1 = 39.93%], valid : [loss = 2.519, top1 = 36.47%], test : [loss = 2.565, top1 = 36.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.608, top1 = 78.50%], valid : [loss = 0.695, top1 = 76.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15357/15625) 015357-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.11 ms.
cifar10-valid  train : [loss = 0.047, top1 = 98.74%], valid : [loss = 0.538, top1 = 86.95%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.082, top1 = 97.39%], test  : [loss = 0.346, top1 = 90.21%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=12.20 ms.
cifar100       train : [loss = 0.722, top1 = 78.89%], valid : [loss = 1.324, top1 = 64.58%], test : [loss = 1.311, top1 = 64.68%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.55 ms.
ImageNet16-120 train : [loss = 2.423, top1 = 38.27%], valid : [loss = 2.564, top1 = 36.60%], test : [loss = 2.527, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.580, top1 = 79.52%], valid : [loss = 0.653, top1 = 77.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15358/15625) 015358-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.91%], valid : [loss = 0.568, top1 = 87.57%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.42 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.375, top1 = 91.40%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 0.397, top1 = 88.67%], valid : [loss = 1.404, top1 = 65.41%], test : [loss = 1.397, top1 = 65.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.38 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 41.92%], valid : [loss = 2.478, top1 = 37.90%], test : [loss = 2.477, top1 = 38.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.69%], valid : [loss = 0.756, top1 = 73.63%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15359/15625) 015359-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.333, top1 = 88.68%], valid : [loss = 0.588, top1 = 81.03%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.87 ms.
cifar10        train : [loss = 0.283, top1 = 90.31%], test  : [loss = 0.418, top1 = 85.95%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.44 ms.
cifar100       train : [loss = 1.438, top1 = 59.39%], valid : [loss = 1.696, top1 = 54.34%], test : [loss = 1.669, top1 = 54.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=17.78 ms.
ImageNet16-120 train : [loss = 2.976, top1 = 27.28%], valid : [loss = 2.959, top1 = 28.07%], test : [loss = 3.027, top1 = 26.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 63.95%], valid : [loss = 1.063, top1 = 62.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15360/15625) 015360-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.29%], valid : [loss = 0.465, top1 = 85.93%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.156, top1 = 94.84%], test  : [loss = 0.345, top1 = 88.88%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.43 ms.
cifar100       train : [loss = 0.991, top1 = 71.82%], valid : [loss = 1.359, top1 = 62.07%], test : [loss = 1.353, top1 = 61.81%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.29 ms.
ImageNet16-120 train : [loss = 2.636, top1 = 33.78%], valid : [loss = 2.688, top1 = 33.07%], test : [loss = 2.710, top1 = 32.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15361/15625) 015361-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.37 ms.
cifar10-valid  train : [loss = 0.621, top1 = 78.17%], valid : [loss = 0.727, top1 = 75.05%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.45 ms.
cifar10        train : [loss = 0.591, top1 = 79.49%], test  : [loss = 0.649, top1 = 77.54%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.35 ms.
cifar100       train : [loss = 1.959, top1 = 47.28%], valid : [loss = 2.101, top1 = 44.44%], test : [loss = 2.085, top1 = 44.08%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.45 ms.
ImageNet16-120 train : [loss = 3.242, top1 = 22.11%], valid : [loss = 3.238, top1 = 23.18%], test : [loss = 3.263, top1 = 22.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.283, top1 = 53.88%], valid : [loss = 1.336, top1 = 52.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15362/15625) 015362-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=22.16 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.500, top1 = 90.04%]
cifar10        FLOP=121.82 M, Params=0.858 MB, latency=20.67 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.294, top1 = 93.80%]
cifar100       FLOP=121.82 M, Params=0.864 MB, latency=18.00 ms.
cifar100       train : [loss = 0.062, top1 = 99.14%], valid : [loss = 1.267, top1 = 70.90%], test : [loss = 1.301, top1 = 71.00%]
ImageNet16-120 FLOP= 30.46 M, Params=0.866 MB, latency=25.32 ms.
ImageNet16-120 train : [loss = 1.640, top1 = 56.06%], valid : [loss = 2.157, top1 = 44.73%], test : [loss = 2.187, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=121.82 M, Params=0.858 MB, latency=None ms.
cifar10-valid  train : [loss = 0.550, top1 = 80.97%], valid : [loss = 0.646, top1 = 77.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15363/15625) 015363-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.99 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.98%], valid : [loss = 0.408, top1 = 90.64%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.89 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.273, top1 = 93.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.95 ms.
cifar100       train : [loss = 0.144, top1 = 97.01%], valid : [loss = 1.277, top1 = 69.98%], test : [loss = 1.240, top1 = 70.52%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.21 ms.
ImageNet16-120 train : [loss = 1.718, top1 = 54.15%], valid : [loss = 2.181, top1 = 43.37%], test : [loss = 2.238, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 87.08%], valid : [loss = 0.522, top1 = 82.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15364/15625) 015364-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.97 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.28 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.95 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15365/15625) 015365-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.184, top1 = 93.71%], valid : [loss = 0.724, top1 = 80.04%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.58 ms.
cifar10        train : [loss = 0.193, top1 = 93.19%], test  : [loss = 0.490, top1 = 85.02%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.42 ms.
cifar100       train : [loss = 0.903, top1 = 73.51%], valid : [loss = 1.673, top1 = 56.58%], test : [loss = 1.693, top1 = 56.92%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.92 ms.
ImageNet16-120 train : [loss = 3.526, top1 = 16.45%], valid : [loss = 3.533, top1 = 16.07%], test : [loss = 3.530, top1 = 15.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 1.309, top1 = 51.98%], valid : [loss = 1.327, top1 = 51.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15366/15625) 015366-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.83%], valid : [loss = 0.621, top1 = 86.82%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.95 ms.
cifar10        train : [loss = 0.025, top1 = 99.36%], test  : [loss = 0.394, top1 = 90.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.58 ms.
cifar100       train : [loss = 0.439, top1 = 87.34%], valid : [loss = 1.379, top1 = 65.70%], test : [loss = 1.369, top1 = 66.06%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.87 ms.
ImageNet16-120 train : [loss = 2.333, top1 = 40.13%], valid : [loss = 2.547, top1 = 35.83%], test : [loss = 2.539, top1 = 36.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 72.82%], valid : [loss = 0.823, top1 = 71.31%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15367/15625) 015367-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.69 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.610, top1 = 86.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.11 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.445, top1 = 90.20%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.227, top1 = 94.34%], valid : [loss = 1.570, top1 = 64.18%], test : [loss = 1.509, top1 = 65.72%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.98 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.84%], valid : [loss = 2.497, top1 = 37.27%], test : [loss = 2.527, top1 = 37.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.683, top1 = 75.60%], valid : [loss = 0.767, top1 = 73.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15368/15625) 015368-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.63 ms.
cifar10-valid  train : [loss = 0.036, top1 = 98.94%], valid : [loss = 0.580, top1 = 86.46%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=18.55 ms.
cifar10        train : [loss = 0.066, top1 = 97.92%], test  : [loss = 0.387, top1 = 89.42%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=13.84 ms.
cifar100       train : [loss = 0.652, top1 = 80.76%], valid : [loss = 1.321, top1 = 64.76%], test : [loss = 1.304, top1 = 65.72%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=18.94 ms.
ImageNet16-120 train : [loss = 2.339, top1 = 39.99%], valid : [loss = 2.464, top1 = 37.50%], test : [loss = 2.521, top1 = 37.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.720, top1 = 74.88%], valid : [loss = 0.780, top1 = 72.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15369/15625) 015369-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.81 ms.
cifar10-valid  train : [loss = 0.063, top1 = 98.13%], valid : [loss = 0.557, top1 = 86.12%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.90 ms.
cifar10        train : [loss = 0.107, top1 = 96.47%], test  : [loss = 0.399, top1 = 88.59%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.21 ms.
cifar100       train : [loss = 0.832, top1 = 75.55%], valid : [loss = 1.400, top1 = 61.92%], test : [loss = 1.421, top1 = 61.82%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.81 ms.
ImageNet16-120 train : [loss = 2.670, top1 = 33.22%], valid : [loss = 2.741, top1 = 32.47%], test : [loss = 2.817, top1 = 30.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.91%], valid : [loss = 0.707, top1 = 75.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15370/15625) 015370-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.276, top1 = 90.88%], valid : [loss = 0.483, top1 = 84.22%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.43 ms.
cifar10        train : [loss = 0.304, top1 = 89.85%], test  : [loss = 0.403, top1 = 86.62%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.79 ms.
cifar100       train : [loss = 1.321, top1 = 63.19%], valid : [loss = 1.525, top1 = 58.08%], test : [loss = 1.498, top1 = 58.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.23 ms.
ImageNet16-120 train : [loss = 2.911, top1 = 28.81%], valid : [loss = 2.909, top1 = 29.70%], test : [loss = 2.942, top1 = 27.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.699, top1 = 75.62%], valid : [loss = 0.756, top1 = 73.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15371/15625) 015371-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.55 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.504, top1 = 89.44%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.318, top1 = 93.14%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.25 ms.
cifar100       train : [loss = 0.132, top1 = 97.40%], valid : [loss = 1.276, top1 = 69.30%], test : [loss = 1.332, top1 = 68.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.03 ms.
ImageNet16-120 train : [loss = 1.831, top1 = 51.47%], valid : [loss = 2.295, top1 = 41.73%], test : [loss = 2.278, top1 = 42.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.623, top1 = 78.36%], valid : [loss = 0.686, top1 = 76.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15372/15625) 015372-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=131.65 M, Params=0.924 MB, latency=17.82 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.85%], valid : [loss = 0.544, top1 = 88.55%]
cifar10        FLOP=131.65 M, Params=0.924 MB, latency=18.61 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.351, top1 = 91.90%]
cifar100       FLOP=131.65 M, Params=0.930 MB, latency=17.66 ms.
cifar100       train : [loss = 0.300, top1 = 91.59%], valid : [loss = 1.334, top1 = 67.24%], test : [loss = 1.323, top1 = 67.41%]
ImageNet16-120 FLOP= 32.92 M, Params=0.931 MB, latency=21.16 ms.
ImageNet16-120 train : [loss = 2.163, top1 = 43.91%], valid : [loss = 2.435, top1 = 38.18%], test : [loss = 2.431, top1 = 38.42%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.854, top1 = 69.41%], valid : [loss = 0.881, top1 = 68.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15373/15625) 015373-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.45 ms.
cifar10-valid  train : [loss = 0.645, top1 = 77.29%], valid : [loss = 0.752, top1 = 74.33%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.48 ms.
cifar10        train : [loss = 0.525, top1 = 81.83%], test  : [loss = 0.592, top1 = 80.07%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.32 ms.
cifar100       train : [loss = 1.917, top1 = 48.24%], valid : [loss = 2.027, top1 = 45.46%], test : [loss = 2.047, top1 = 46.14%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.90 ms.
ImageNet16-120 train : [loss = 3.287, top1 = 21.37%], valid : [loss = 3.254, top1 = 22.87%], test : [loss = 3.310, top1 = 20.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.352, top1 = 50.83%], valid : [loss = 1.386, top1 = 49.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15374/15625) 015374-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.28 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.609, top1 = 87.01%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.16 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.443, top1 = 90.25%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.59 ms.
cifar100       train : [loss = 0.239, top1 = 93.83%], valid : [loss = 1.636, top1 = 62.66%], test : [loss = 1.625, top1 = 63.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.05 ms.
ImageNet16-120 train : [loss = 2.194, top1 = 43.28%], valid : [loss = 2.558, top1 = 36.17%], test : [loss = 2.550, top1 = 37.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.30%], valid : [loss = 0.844, top1 = 69.85%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15375/15625) 015375-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.01 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.89%], valid : [loss = 0.546, top1 = 88.06%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.84 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.374, top1 = 91.35%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.30 ms.
cifar100       train : [loss = 0.382, top1 = 89.36%], valid : [loss = 1.421, top1 = 64.83%], test : [loss = 1.388, top1 = 65.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.37 ms.
ImageNet16-120 train : [loss = 2.258, top1 = 41.85%], valid : [loss = 2.480, top1 = 37.83%], test : [loss = 2.496, top1 = 36.79%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.51%], valid : [loss = 0.766, top1 = 73.37%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15376/15625) 015376-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.77 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.34 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|none~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15377/15625) 015377-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.04 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.67%], valid : [loss = 0.667, top1 = 85.54%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.41 ms.
cifar10        train : [loss = 0.027, top1 = 99.28%], test  : [loss = 0.397, top1 = 90.06%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.49 ms.
cifar100       train : [loss = 0.512, top1 = 85.23%], valid : [loss = 1.387, top1 = 64.16%], test : [loss = 1.391, top1 = 63.98%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.38 ms.
ImageNet16-120 train : [loss = 2.349, top1 = 39.97%], valid : [loss = 2.548, top1 = 34.97%], test : [loss = 2.566, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.769, top1 = 72.74%], valid : [loss = 0.836, top1 = 70.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15378/15625) 015378-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.39 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.581, top1 = 88.38%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.88 ms.
cifar10        train : [loss = 0.008, top1 = 99.86%], test  : [loss = 0.382, top1 = 91.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.26 ms.
cifar100       train : [loss = 0.180, top1 = 95.94%], valid : [loss = 1.422, top1 = 66.28%], test : [loss = 1.449, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.42 ms.
ImageNet16-120 train : [loss = 1.995, top1 = 47.75%], valid : [loss = 2.481, top1 = 37.43%], test : [loss = 2.493, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.613, top1 = 78.31%], valid : [loss = 0.723, top1 = 75.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15379/15625) 015379-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.57 ms.
cifar10-valid  train : [loss = 0.486, top1 = 83.07%], valid : [loss = 0.646, top1 = 78.27%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.16 ms.
cifar10        train : [loss = 0.523, top1 = 81.90%], test  : [loss = 0.602, top1 = 79.35%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=9.38 ms.
cifar100       train : [loss = 1.673, top1 = 54.49%], valid : [loss = 1.850, top1 = 50.95%], test : [loss = 1.858, top1 = 50.62%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.04 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.40%], valid : [loss = 3.317, top1 = 21.46%], test : [loss = 3.348, top1 = 21.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15380/15625) 015380-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.88%], valid : [loss = 0.499, top1 = 89.19%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.35 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.302, top1 = 92.81%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=19.20 ms.
cifar100       train : [loss = 0.299, top1 = 91.91%], valid : [loss = 1.233, top1 = 67.88%], test : [loss = 1.256, top1 = 68.82%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.85 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.92%], valid : [loss = 2.212, top1 = 43.47%], test : [loss = 2.242, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.61%], valid : [loss = 0.609, top1 = 79.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15381/15625) 015381-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.39 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.501, top1 = 88.86%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.66 ms.
cifar10        train : [loss = 0.012, top1 = 99.74%], test  : [loss = 0.349, top1 = 91.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.02 ms.
cifar100       train : [loss = 0.300, top1 = 91.63%], valid : [loss = 1.421, top1 = 67.12%], test : [loss = 1.373, top1 = 66.72%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=16.29 ms.
ImageNet16-120 train : [loss = 2.051, top1 = 46.34%], valid : [loss = 2.354, top1 = 40.40%], test : [loss = 2.373, top1 = 40.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 80.21%], valid : [loss = 0.652, top1 = 77.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15382/15625) 015382-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.39 ms.
cifar10-valid  train : [loss = 0.206, top1 = 93.12%], valid : [loss = 0.488, top1 = 84.30%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.23 ms.
cifar10        train : [loss = 0.216, top1 = 92.83%], test  : [loss = 0.384, top1 = 87.36%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.46 ms.
cifar100       train : [loss = 1.262, top1 = 64.56%], valid : [loss = 1.542, top1 = 57.60%], test : [loss = 1.536, top1 = 57.10%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=19.62 ms.
ImageNet16-120 train : [loss = 2.986, top1 = 26.71%], valid : [loss = 2.981, top1 = 27.17%], test : [loss = 3.021, top1 = 26.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 1.079, top1 = 61.00%], valid : [loss = 1.080, top1 = 61.09%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15383/15625) 015383-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.99%], valid : [loss = 0.400, top1 = 90.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.60 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.270, top1 = 93.89%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.42 ms.
cifar100       train : [loss = 0.073, top1 = 98.98%], valid : [loss = 1.233, top1 = 71.64%], test : [loss = 1.225, top1 = 71.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.67 ms.
ImageNet16-120 train : [loss = 1.480, top1 = 59.84%], valid : [loss = 2.166, top1 = 45.70%], test : [loss = 2.137, top1 = 47.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.361, top1 = 87.74%], valid : [loss = 0.502, top1 = 83.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15384/15625) 015384-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.82 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.473, top1 = 89.04%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.33 ms.
cifar10        train : [loss = 0.012, top1 = 99.80%], test  : [loss = 0.301, top1 = 92.42%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.77 ms.
cifar100       train : [loss = 0.326, top1 = 91.24%], valid : [loss = 1.237, top1 = 67.69%], test : [loss = 1.261, top1 = 67.34%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 2.036, top1 = 46.75%], valid : [loss = 2.315, top1 = 40.78%], test : [loss = 2.351, top1 = 40.59%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.505, top1 = 82.60%], valid : [loss = 0.602, top1 = 79.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15385/15625) 015385-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.76%], valid : [loss = 0.725, top1 = 83.25%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.36 ms.
cifar10        train : [loss = 0.089, top1 = 97.11%], test  : [loss = 0.473, top1 = 87.16%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.58 ms.
cifar100       train : [loss = 0.785, top1 = 77.34%], valid : [loss = 1.529, top1 = 60.78%], test : [loss = 1.533, top1 = 59.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.812, top1 = 30.37%], valid : [loss = 2.924, top1 = 28.63%], test : [loss = 2.990, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.805, top1 = 71.45%], valid : [loss = 0.872, top1 = 69.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15386/15625) 015386-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 53.66 M, Params=0.391 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.93%], valid : [loss = 0.498, top1 = 89.21%]
cifar10        FLOP= 53.66 M, Params=0.391 MB, latency=18.79 ms.
cifar10        train : [loss = 0.009, top1 = 99.81%], test  : [loss = 0.325, top1 = 92.35%]
cifar100       FLOP= 53.66 M, Params=0.397 MB, latency=19.73 ms.
cifar100       train : [loss = 0.218, top1 = 94.64%], valid : [loss = 1.267, top1 = 68.66%], test : [loss = 1.280, top1 = 68.51%]
ImageNet16-120 FLOP= 13.42 M, Params=0.398 MB, latency=15.79 ms.
ImageNet16-120 train : [loss = 1.916, top1 = 49.36%], valid : [loss = 2.258, top1 = 42.22%], test : [loss = 2.273, top1 = 42.44%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.569, top1 = 80.06%], valid : [loss = 0.648, top1 = 77.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15387/15625) 015387-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.24 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.560, top1 = 88.28%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.91 ms.
cifar10        train : [loss = 0.006, top1 = 99.89%], test  : [loss = 0.380, top1 = 91.99%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.97 ms.
cifar100       train : [loss = 0.134, top1 = 97.29%], valid : [loss = 1.528, top1 = 66.72%], test : [loss = 1.443, top1 = 68.44%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.62 ms.
ImageNet16-120 train : [loss = 1.934, top1 = 49.03%], valid : [loss = 2.428, top1 = 39.00%], test : [loss = 2.445, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.12%], valid : [loss = 0.765, top1 = 73.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15388/15625) 015388-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10-valid  train : [loss = 0.297, top1 = 89.73%], valid : [loss = 0.833, top1 = 75.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.80 ms.
cifar10        train : [loss = 0.328, top1 = 88.46%], test  : [loss = 0.651, top1 = 79.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.89 ms.
cifar100       train : [loss = 1.420, top1 = 60.45%], valid : [loss = 1.984, top1 = 48.76%], test : [loss = 1.993, top1 = 48.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.95 ms.
ImageNet16-120 train : [loss = 3.532, top1 = 16.76%], valid : [loss = 3.548, top1 = 17.33%], test : [loss = 3.536, top1 = 16.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.258, top1 = 53.80%], valid : [loss = 1.308, top1 = 52.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15389/15625) 015389-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.068, top1 = 97.88%], valid : [loss = 0.579, top1 = 85.27%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.32 ms.
cifar10        train : [loss = 0.106, top1 = 96.42%], test  : [loss = 0.391, top1 = 88.65%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.94 ms.
cifar100       train : [loss = 0.809, top1 = 76.32%], valid : [loss = 1.410, top1 = 62.08%], test : [loss = 1.420, top1 = 62.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.16 ms.
ImageNet16-120 train : [loss = 2.455, top1 = 37.40%], valid : [loss = 2.581, top1 = 35.20%], test : [loss = 2.585, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.878, top1 = 68.33%], valid : [loss = 0.909, top1 = 67.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15390/15625) 015390-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.033, top1 = 99.27%], valid : [loss = 0.612, top1 = 85.21%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.43 ms.
cifar10        train : [loss = 0.073, top1 = 97.77%], test  : [loss = 0.392, top1 = 89.23%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.34 ms.
cifar100       train : [loss = 0.723, top1 = 79.07%], valid : [loss = 1.403, top1 = 62.95%], test : [loss = 1.389, top1 = 63.07%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.05 ms.
ImageNet16-120 train : [loss = 2.546, top1 = 35.83%], valid : [loss = 2.658, top1 = 33.98%], test : [loss = 2.714, top1 = 33.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.18%], valid : [loss = 0.791, top1 = 72.45%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15391/15625) 015391-th architecture! ----------
arch : |skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.124, top1 = 96.22%], valid : [loss = 0.474, top1 = 85.85%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.95 ms.
cifar10        train : [loss = 0.157, top1 = 94.92%], test  : [loss = 0.351, top1 = 88.74%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.98 ms.
cifar100       train : [loss = 0.985, top1 = 71.99%], valid : [loss = 1.350, top1 = 62.56%], test : [loss = 1.338, top1 = 62.41%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.97 ms.
ImageNet16-120 train : [loss = 2.640, top1 = 33.68%], valid : [loss = 2.689, top1 = 32.57%], test : [loss = 2.710, top1 = 32.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.689, top1 = 75.54%], valid : [loss = 0.734, top1 = 74.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15392/15625) 015392-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.640 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.559, top1 = 88.92%]
cifar10        FLOP= 90.36 M, Params=0.640 MB, latency=17.07 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.366, top1 = 92.54%]
cifar100       FLOP= 90.36 M, Params=0.646 MB, latency=16.77 ms.
cifar100       train : [loss = 0.094, top1 = 98.30%], valid : [loss = 1.470, top1 = 67.94%], test : [loss = 1.452, top1 = 68.47%]
ImageNet16-120 FLOP= 22.60 M, Params=0.648 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 1.856, top1 = 50.91%], valid : [loss = 2.413, top1 = 39.51%], test : [loss = 2.408, top1 = 40.06%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 79.95%], valid : [loss = 0.665, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15393/15625) 015393-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.12 ms.
cifar10-valid  train : [loss = 0.163, top1 = 94.74%], valid : [loss = 0.945, top1 = 76.18%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.13 ms.
cifar10        train : [loss = 0.225, top1 = 92.22%], test  : [loss = 0.607, top1 = 82.04%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.78 ms.
cifar100       train : [loss = 1.195, top1 = 66.15%], valid : [loss = 1.783, top1 = 53.80%], test : [loss = 1.770, top1 = 54.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.83 ms.
ImageNet16-120 train : [loss = 3.240, top1 = 22.46%], valid : [loss = 3.365, top1 = 20.20%], test : [loss = 3.377, top1 = 20.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15394/15625) 015394-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.471, top1 = 89.30%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=20.07 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.307, top1 = 92.55%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.27 ms.
cifar100       train : [loss = 0.255, top1 = 93.64%], valid : [loss = 1.261, top1 = 68.12%], test : [loss = 1.270, top1 = 68.12%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.12 ms.
ImageNet16-120 train : [loss = 1.908, top1 = 49.73%], valid : [loss = 2.281, top1 = 41.83%], test : [loss = 2.275, top1 = 42.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.672, top1 = 76.30%], valid : [loss = 0.721, top1 = 74.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15395/15625) 015395-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.013, top1 = 99.72%], valid : [loss = 0.525, top1 = 88.57%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.03 ms.
cifar10        train : [loss = 0.026, top1 = 99.29%], test  : [loss = 0.334, top1 = 91.59%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.61 ms.
cifar100       train : [loss = 0.439, top1 = 87.24%], valid : [loss = 1.229, top1 = 67.14%], test : [loss = 1.272, top1 = 66.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.83 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.55%], valid : [loss = 2.355, top1 = 39.10%], test : [loss = 2.354, top1 = 40.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.740, top1 = 73.72%], valid : [loss = 0.787, top1 = 72.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15396/15625) 015396-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.487, top1 = 89.06%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.25 ms.
cifar10        train : [loss = 0.012, top1 = 99.78%], test  : [loss = 0.319, top1 = 92.33%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.05 ms.
cifar100       train : [loss = 0.314, top1 = 91.67%], valid : [loss = 1.249, top1 = 67.61%], test : [loss = 1.258, top1 = 67.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.23 ms.
ImageNet16-120 train : [loss = 2.037, top1 = 46.63%], valid : [loss = 2.320, top1 = 40.67%], test : [loss = 2.343, top1 = 40.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.503, top1 = 82.43%], valid : [loss = 0.589, top1 = 79.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15397/15625) 015397-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.082, top1 = 97.76%], valid : [loss = 0.466, top1 = 86.32%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.64 ms.
cifar10        train : [loss = 0.125, top1 = 96.05%], test  : [loss = 0.339, top1 = 89.08%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.86 ms.
cifar100       train : [loss = 0.788, top1 = 77.85%], valid : [loss = 1.293, top1 = 64.16%], test : [loss = 1.312, top1 = 63.00%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=12.85 ms.
ImageNet16-120 train : [loss = 2.513, top1 = 36.46%], valid : [loss = 2.588, top1 = 35.07%], test : [loss = 2.604, top1 = 33.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.840, top1 = 70.08%], valid : [loss = 0.874, top1 = 68.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15398/15625) 015398-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.027, top1 = 99.27%], valid : [loss = 0.587, top1 = 86.64%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.62 ms.
cifar10        train : [loss = 0.041, top1 = 98.78%], test  : [loss = 0.381, top1 = 90.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.86 ms.
cifar100       train : [loss = 0.484, top1 = 85.83%], valid : [loss = 1.335, top1 = 65.58%], test : [loss = 1.366, top1 = 64.88%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 2.626, top1 = 33.56%], valid : [loss = 2.679, top1 = 32.17%], test : [loss = 2.720, top1 = 32.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.056, top1 = 61.40%], valid : [loss = 1.103, top1 = 60.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15399/15625) 015399-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.20 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.528, top1 = 89.40%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.25 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.325, top1 = 92.90%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=19.55 ms.
cifar100       train : [loss = 0.104, top1 = 97.97%], valid : [loss = 1.282, top1 = 70.34%], test : [loss = 1.330, top1 = 69.72%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=23.39 ms.
ImageNet16-120 train : [loss = 1.719, top1 = 54.14%], valid : [loss = 2.149, top1 = 45.07%], test : [loss = 2.175, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 74.74%], valid : [loss = 0.771, top1 = 72.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15400/15625) 015400-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.27 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.522, top1 = 88.74%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.19 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.308, top1 = 92.79%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.38 ms.
cifar100       train : [loss = 0.150, top1 = 96.89%], valid : [loss = 1.318, top1 = 69.04%], test : [loss = 1.302, top1 = 68.80%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=21.33 ms.
ImageNet16-120 train : [loss = 1.807, top1 = 52.00%], valid : [loss = 2.250, top1 = 42.83%], test : [loss = 2.245, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.688, top1 = 75.64%], valid : [loss = 0.739, top1 = 74.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15401/15625) 015401-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.487, top1 = 89.00%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.298, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.56 ms.
cifar100       train : [loss = 0.333, top1 = 90.91%], valid : [loss = 1.230, top1 = 68.40%], test : [loss = 1.286, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.80%], valid : [loss = 2.320, top1 = 39.80%], test : [loss = 2.350, top1 = 40.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.513, top1 = 81.97%], valid : [loss = 0.596, top1 = 79.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15402/15625) 015402-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.46 ms.
cifar10-valid  train : [loss = 0.674, top1 = 76.57%], valid : [loss = 0.856, top1 = 70.79%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.687, top1 = 76.00%], test  : [loss = 0.774, top1 = 73.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.89 ms.
cifar100       train : [loss = 1.971, top1 = 47.66%], valid : [loss = 2.157, top1 = 44.68%], test : [loss = 2.163, top1 = 44.66%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=6.93 ms.
ImageNet16-120 train : [loss = 3.656, top1 = 15.62%], valid : [loss = 3.678, top1 = 15.77%], test : [loss = 3.693, top1 = 14.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15403/15625) 015403-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=14.54 ms.
cifar10-valid  train : [loss = 0.110, top1 = 96.80%], valid : [loss = 0.451, top1 = 86.40%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=15.61 ms.
cifar10        train : [loss = 0.152, top1 = 95.01%], test  : [loss = 0.344, top1 = 88.84%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=14.33 ms.
cifar100       train : [loss = 0.964, top1 = 72.53%], valid : [loss = 1.351, top1 = 62.52%], test : [loss = 1.328, top1 = 62.40%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=12.83 ms.
ImageNet16-120 train : [loss = 2.621, top1 = 34.11%], valid : [loss = 2.680, top1 = 33.19%], test : [loss = 2.698, top1 = 32.58%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15404/15625) 015404-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.36 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.707, top1 = 85.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.17 ms.
cifar10        train : [loss = 0.019, top1 = 99.53%], test  : [loss = 0.508, top1 = 88.85%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.63 ms.
cifar100       train : [loss = 0.292, top1 = 92.42%], valid : [loss = 1.560, top1 = 63.26%], test : [loss = 1.557, top1 = 63.82%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.23 ms.
ImageNet16-120 train : [loss = 2.428, top1 = 38.35%], valid : [loss = 2.773, top1 = 31.47%], test : [loss = 2.864, top1 = 30.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.757, top1 = 72.90%], valid : [loss = 0.828, top1 = 70.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15405/15625) 015405-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.10 ms.
cifar10-valid  train : [loss = 0.125, top1 = 96.15%], valid : [loss = 0.463, top1 = 85.96%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.91 ms.
cifar10        train : [loss = 0.160, top1 = 94.75%], test  : [loss = 0.343, top1 = 88.86%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.55 ms.
cifar100       train : [loss = 1.008, top1 = 71.26%], valid : [loss = 1.362, top1 = 61.96%], test : [loss = 1.360, top1 = 61.85%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 2.639, top1 = 33.76%], valid : [loss = 2.685, top1 = 33.03%], test : [loss = 2.719, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.62%], valid : [loss = 0.792, top1 = 71.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15406/15625) 015406-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.97 ms.
cifar10-valid  train : [loss = 0.247, top1 = 91.53%], valid : [loss = 0.526, top1 = 83.49%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.68 ms.
cifar10        train : [loss = 0.245, top1 = 91.62%], test  : [loss = 0.394, top1 = 86.95%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.56 ms.
cifar100       train : [loss = 1.322, top1 = 62.65%], valid : [loss = 1.591, top1 = 56.46%], test : [loss = 1.578, top1 = 56.83%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.62 ms.
ImageNet16-120 train : [loss = 2.851, top1 = 29.63%], valid : [loss = 2.861, top1 = 29.53%], test : [loss = 2.919, top1 = 28.38%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.968, top1 = 65.20%], valid : [loss = 0.991, top1 = 64.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15407/15625) 015407-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.02%], valid : [loss = 0.533, top1 = 87.28%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=17.34 ms.
cifar10        train : [loss = 0.065, top1 = 97.83%], test  : [loss = 0.370, top1 = 90.11%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.98 ms.
cifar100       train : [loss = 0.530, top1 = 84.57%], valid : [loss = 1.335, top1 = 65.00%], test : [loss = 1.330, top1 = 64.88%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 2.195, top1 = 43.03%], valid : [loss = 2.378, top1 = 39.47%], test : [loss = 2.386, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.730, top1 = 74.01%], valid : [loss = 0.795, top1 = 72.04%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15408/15625) 015408-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.65 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.520, top1 = 89.09%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.40 ms.
cifar10        train : [loss = 0.009, top1 = 99.82%], test  : [loss = 0.352, top1 = 92.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=14.94 ms.
cifar100       train : [loss = 0.228, top1 = 94.13%], valid : [loss = 1.294, top1 = 68.32%], test : [loss = 1.285, top1 = 68.38%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.28 ms.
ImageNet16-120 train : [loss = 1.946, top1 = 48.84%], valid : [loss = 2.279, top1 = 41.70%], test : [loss = 2.304, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.16%], valid : [loss = 0.808, top1 = 71.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15409/15625) 015409-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.49 ms.
cifar10-valid  train : [loss = 0.532, top1 = 81.41%], valid : [loss = 0.859, top1 = 71.76%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.56 ms.
cifar10        train : [loss = 0.548, top1 = 80.81%], test  : [loss = 0.707, top1 = 75.98%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.05 ms.
cifar100       train : [loss = 1.772, top1 = 52.42%], valid : [loss = 2.040, top1 = 47.40%], test : [loss = 2.069, top1 = 46.85%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.97 ms.
ImageNet16-120 train : [loss = 3.579, top1 = 16.95%], valid : [loss = 3.639, top1 = 16.68%], test : [loss = 3.667, top1 = 15.49%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.190, top1 = 57.00%], valid : [loss = 1.242, top1 = 55.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15410/15625) 015410-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.679, top1 = 76.04%], valid : [loss = 0.849, top1 = 71.14%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.13 ms.
cifar10        train : [loss = 0.674, top1 = 76.42%], test  : [loss = 0.760, top1 = 73.72%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.35 ms.
cifar100       train : [loss = 1.956, top1 = 48.06%], valid : [loss = 2.123, top1 = 45.02%], test : [loss = 2.146, top1 = 44.87%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 3.647, top1 = 15.78%], valid : [loss = 3.670, top1 = 16.12%], test : [loss = 3.696, top1 = 15.12%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.402, top1 = 48.73%], valid : [loss = 1.416, top1 = 48.77%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15411/15625) 015411-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.14 ms.
cifar10-valid  train : [loss = 0.051, top1 = 98.54%], valid : [loss = 0.651, top1 = 84.43%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.93 ms.
cifar10        train : [loss = 0.078, top1 = 97.52%], test  : [loss = 0.417, top1 = 88.39%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.49 ms.
cifar100       train : [loss = 0.765, top1 = 77.79%], valid : [loss = 1.397, top1 = 61.66%], test : [loss = 1.409, top1 = 62.66%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.580, top1 = 35.09%], valid : [loss = 2.703, top1 = 32.57%], test : [loss = 2.719, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.833, top1 = 70.40%], valid : [loss = 0.911, top1 = 67.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15412/15625) 015412-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.83%], valid : [loss = 0.613, top1 = 86.85%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.42 ms.
cifar10        train : [loss = 0.015, top1 = 99.66%], test  : [loss = 0.388, top1 = 91.08%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.72 ms.
cifar100       train : [loss = 0.398, top1 = 88.87%], valid : [loss = 1.385, top1 = 65.56%], test : [loss = 1.367, top1 = 66.20%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.60 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.14%], valid : [loss = 2.508, top1 = 37.00%], test : [loss = 2.541, top1 = 36.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 73.76%], valid : [loss = 0.805, top1 = 71.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15413/15625) 015413-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.552, top1 = 88.10%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=14.24 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.324, top1 = 92.13%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.86 ms.
cifar100       train : [loss = 0.358, top1 = 90.24%], valid : [loss = 1.287, top1 = 67.40%], test : [loss = 1.266, top1 = 67.12%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.04 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.65%], valid : [loss = 2.361, top1 = 39.70%], test : [loss = 2.422, top1 = 38.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.65%], valid : [loss = 0.681, top1 = 76.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15414/15625) 015414-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.15 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.474, top1 = 89.52%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.30 ms.
cifar10        train : [loss = 0.011, top1 = 99.81%], test  : [loss = 0.315, top1 = 92.38%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.11 ms.
cifar100       train : [loss = 0.251, top1 = 93.72%], valid : [loss = 1.250, top1 = 68.26%], test : [loss = 1.253, top1 = 68.54%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 1.924, top1 = 49.36%], valid : [loss = 2.254, top1 = 42.23%], test : [loss = 2.329, top1 = 41.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.680, top1 = 75.96%], valid : [loss = 0.764, top1 = 73.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15415/15625) 015415-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.627, top1 = 87.17%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.16 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.412, top1 = 91.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.92 ms.
cifar100       train : [loss = 0.165, top1 = 96.30%], valid : [loss = 1.579, top1 = 64.46%], test : [loss = 1.603, top1 = 64.62%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.62 ms.
ImageNet16-120 train : [loss = 1.973, top1 = 48.18%], valid : [loss = 2.492, top1 = 38.80%], test : [loss = 2.463, top1 = 39.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.708, top1 = 74.77%], valid : [loss = 0.795, top1 = 72.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15416/15625) 015416-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.67 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.85%], valid : [loss = 0.592, top1 = 87.02%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.27 ms.
cifar10        train : [loss = 0.016, top1 = 99.60%], test  : [loss = 0.389, top1 = 91.12%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.34 ms.
cifar100       train : [loss = 0.384, top1 = 88.97%], valid : [loss = 1.354, top1 = 66.84%], test : [loss = 1.361, top1 = 66.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.11 ms.
ImageNet16-120 train : [loss = 2.309, top1 = 40.57%], valid : [loss = 2.523, top1 = 36.57%], test : [loss = 2.542, top1 = 36.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.721, top1 = 74.20%], valid : [loss = 0.783, top1 = 72.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15417/15625) 015417-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.09 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.449, top1 = 89.18%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.86 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.316, top1 = 91.99%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.20 ms.
cifar100       train : [loss = 0.330, top1 = 91.10%], valid : [loss = 1.311, top1 = 66.87%], test : [loss = 1.325, top1 = 66.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.54 ms.
ImageNet16-120 train : [loss = 2.063, top1 = 46.11%], valid : [loss = 2.387, top1 = 40.37%], test : [loss = 2.409, top1 = 39.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.456, top1 = 84.38%], valid : [loss = 0.550, top1 = 81.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15418/15625) 015418-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.14 ms.
cifar10-valid  train : [loss = 0.085, top1 = 97.72%], valid : [loss = 0.483, top1 = 86.20%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.59 ms.
cifar10        train : [loss = 0.127, top1 = 95.99%], test  : [loss = 0.343, top1 = 88.80%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.51 ms.
cifar100       train : [loss = 0.764, top1 = 78.58%], valid : [loss = 1.253, top1 = 64.56%], test : [loss = 1.270, top1 = 64.58%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.93 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.21%], valid : [loss = 2.575, top1 = 35.47%], test : [loss = 2.589, top1 = 33.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.842, top1 = 70.08%], valid : [loss = 0.879, top1 = 68.60%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15419/15625) 015419-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.82%], valid : [loss = 0.541, top1 = 88.50%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.42 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.360, top1 = 91.80%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.73 ms.
cifar100       train : [loss = 0.316, top1 = 91.08%], valid : [loss = 1.317, top1 = 67.38%], test : [loss = 1.314, top1 = 67.52%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.63 ms.
ImageNet16-120 train : [loss = 2.212, top1 = 42.73%], valid : [loss = 2.440, top1 = 37.43%], test : [loss = 2.451, top1 = 38.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 68.96%], valid : [loss = 0.885, top1 = 68.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15420/15625) 015420-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.772, top1 = 72.80%], valid : [loss = 0.949, top1 = 67.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.04 ms.
cifar10        train : [loss = 0.793, top1 = 72.20%], test  : [loss = 0.871, top1 = 69.62%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.89 ms.
cifar100       train : [loss = 2.133, top1 = 43.90%], valid : [loss = 2.297, top1 = 41.36%], test : [loss = 2.316, top1 = 41.84%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.69 ms.
ImageNet16-120 train : [loss = 3.750, top1 = 14.14%], valid : [loss = 3.762, top1 = 14.63%], test : [loss = 3.771, top1 = 13.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.463, top1 = 46.40%], valid : [loss = 1.488, top1 = 45.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15421/15625) 015421-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.56 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.483, top1 = 89.85%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.82 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.296, top1 = 93.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.70 ms.
cifar100       train : [loss = 0.115, top1 = 97.98%], valid : [loss = 1.235, top1 = 70.82%], test : [loss = 1.260, top1 = 69.90%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=14.91 ms.
ImageNet16-120 train : [loss = 1.726, top1 = 53.95%], valid : [loss = 2.144, top1 = 45.03%], test : [loss = 2.186, top1 = 44.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.53%], valid : [loss = 0.611, top1 = 79.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15422/15625) 015422-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.94 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.507, top1 = 89.88%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.56 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.320, top1 = 93.09%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.59 ms.
cifar100       train : [loss = 0.105, top1 = 97.95%], valid : [loss = 1.279, top1 = 69.86%], test : [loss = 1.314, top1 = 70.16%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.21 ms.
ImageNet16-120 train : [loss = 1.725, top1 = 53.85%], valid : [loss = 2.187, top1 = 44.33%], test : [loss = 2.184, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|none~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.643, top1 = 77.66%], valid : [loss = 0.710, top1 = 75.66%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15423/15625) 015423-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.85 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.460, top1 = 89.47%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.42 ms.
cifar10        train : [loss = 0.009, top1 = 99.85%], test  : [loss = 0.305, top1 = 92.45%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.57 ms.
cifar100       train : [loss = 0.167, top1 = 96.53%], valid : [loss = 1.226, top1 = 69.48%], test : [loss = 1.250, top1 = 69.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.16 ms.
ImageNet16-120 train : [loss = 1.767, top1 = 52.94%], valid : [loss = 2.191, top1 = 44.47%], test : [loss = 2.238, top1 = 42.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.426, top1 = 85.22%], valid : [loss = 0.540, top1 = 81.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15424/15625) 015424-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=16.67 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.543, top1 = 89.24%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.01 ms.
cifar10        train : [loss = 0.006, top1 = 99.87%], test  : [loss = 0.341, top1 = 93.02%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.37 ms.
cifar100       train : [loss = 0.102, top1 = 97.85%], valid : [loss = 1.338, top1 = 69.66%], test : [loss = 1.371, top1 = 69.00%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.98 ms.
ImageNet16-120 train : [loss = 1.744, top1 = 53.47%], valid : [loss = 2.199, top1 = 42.50%], test : [loss = 2.188, top1 = 44.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.592, top1 = 79.16%], valid : [loss = 0.656, top1 = 77.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15425/15625) 015425-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.19 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.432, top1 = 90.77%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=16.94 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.277, top1 = 93.99%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.65 ms.
cifar100       train : [loss = 0.031, top1 = 99.73%], valid : [loss = 1.279, top1 = 72.12%], test : [loss = 1.271, top1 = 71.80%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=23.16 ms.
ImageNet16-120 train : [loss = 1.262, top1 = 65.22%], valid : [loss = 2.219, top1 = 44.63%], test : [loss = 2.261, top1 = 44.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.353, top1 = 87.87%], valid : [loss = 0.493, top1 = 83.57%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15426/15625) 015426-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=17.76 ms.
cifar10-valid  train : [loss = 0.028, top1 = 99.64%], valid : [loss = 0.447, top1 = 87.87%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.82 ms.
cifar10        train : [loss = 0.057, top1 = 98.63%], test  : [loss = 0.310, top1 = 90.62%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.86 ms.
cifar100       train : [loss = 0.570, top1 = 84.41%], valid : [loss = 1.236, top1 = 67.16%], test : [loss = 1.220, top1 = 67.46%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=15.07 ms.
ImageNet16-120 train : [loss = 2.256, top1 = 42.00%], valid : [loss = 2.437, top1 = 38.73%], test : [loss = 2.447, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.597, top1 = 78.95%], valid : [loss = 0.680, top1 = 76.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15427/15625) 015427-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=18.08 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.609, top1 = 86.72%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.40 ms.
cifar10        train : [loss = 0.031, top1 = 99.18%], test  : [loss = 0.395, top1 = 90.17%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.66 ms.
cifar100       train : [loss = 0.549, top1 = 84.05%], valid : [loss = 1.422, top1 = 63.04%], test : [loss = 1.411, top1 = 63.24%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=16.33 ms.
ImageNet16-120 train : [loss = 2.413, top1 = 38.50%], valid : [loss = 2.553, top1 = 35.87%], test : [loss = 2.620, top1 = 35.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.787, top1 = 71.96%], valid : [loss = 0.853, top1 = 70.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15428/15625) 015428-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.01 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.616, top1 = 87.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10        train : [loss = 0.012, top1 = 99.71%], test  : [loss = 0.384, top1 = 91.26%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.47 ms.
cifar100       train : [loss = 0.206, top1 = 95.16%], valid : [loss = 1.567, top1 = 65.06%], test : [loss = 1.522, top1 = 64.92%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.68 ms.
ImageNet16-120 train : [loss = 2.068, top1 = 45.93%], valid : [loss = 2.464, top1 = 37.77%], test : [loss = 2.474, top1 = 38.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.20%], valid : [loss = 0.809, top1 = 71.19%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15429/15625) 015429-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.42 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.443, top1 = 90.86%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.73 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.290, top1 = 93.49%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.25 ms.
cifar100       train : [loss = 0.082, top1 = 98.46%], valid : [loss = 1.337, top1 = 71.28%], test : [loss = 1.362, top1 = 70.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 1.642, top1 = 55.97%], valid : [loss = 2.196, top1 = 45.17%], test : [loss = 2.272, top1 = 43.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.421, top1 = 85.49%], valid : [loss = 0.540, top1 = 81.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15430/15625) 015430-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.57 ms.
cifar10-valid  train : [loss = 0.015, top1 = 99.63%], valid : [loss = 0.544, top1 = 87.76%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.84 ms.
cifar10        train : [loss = 0.023, top1 = 99.38%], test  : [loss = 0.387, top1 = 91.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.03 ms.
cifar100       train : [loss = 0.292, top1 = 91.73%], valid : [loss = 1.365, top1 = 66.98%], test : [loss = 1.380, top1 = 66.62%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.47 ms.
ImageNet16-120 train : [loss = 2.803, top1 = 29.57%], valid : [loss = 2.879, top1 = 28.27%], test : [loss = 2.908, top1 = 28.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.47%], valid : [loss = 0.916, top1 = 67.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15431/15625) 015431-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.62 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.77%], valid : [loss = 0.595, top1 = 84.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.64 ms.
cifar10        train : [loss = 0.111, top1 = 96.36%], test  : [loss = 0.399, top1 = 88.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.15 ms.
cifar100       train : [loss = 0.889, top1 = 74.16%], valid : [loss = 1.464, top1 = 60.73%], test : [loss = 1.460, top1 = 60.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.42 ms.
ImageNet16-120 train : [loss = 2.711, top1 = 32.23%], valid : [loss = 2.839, top1 = 30.00%], test : [loss = 2.851, top1 = 30.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|skip_connect~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 70.31%], valid : [loss = 0.884, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15432/15625) 015432-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.46 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.498, top1 = 88.45%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.23 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.345, top1 = 91.38%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.03 ms.
cifar100       train : [loss = 0.460, top1 = 86.64%], valid : [loss = 1.350, top1 = 65.72%], test : [loss = 1.360, top1 = 65.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.59 ms.
ImageNet16-120 train : [loss = 2.337, top1 = 40.29%], valid : [loss = 2.506, top1 = 36.17%], test : [loss = 2.554, top1 = 35.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.66%], valid : [loss = 0.677, top1 = 76.70%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15433/15625) 015433-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.71 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.88%], valid : [loss = 0.579, top1 = 87.36%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.382, top1 = 91.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.72 ms.
cifar100       train : [loss = 0.388, top1 = 89.00%], valid : [loss = 1.378, top1 = 65.93%], test : [loss = 1.381, top1 = 65.59%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=13.20 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.83%], valid : [loss = 2.525, top1 = 36.57%], test : [loss = 2.540, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15434/15625) 015434-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.85 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.574, top1 = 87.44%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.36 ms.
cifar10        train : [loss = 0.016, top1 = 99.62%], test  : [loss = 0.383, top1 = 91.24%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.62 ms.
cifar100       train : [loss = 0.395, top1 = 88.77%], valid : [loss = 1.399, top1 = 65.22%], test : [loss = 1.400, top1 = 65.32%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.74 ms.
ImageNet16-120 train : [loss = 2.304, top1 = 40.93%], valid : [loss = 2.507, top1 = 36.93%], test : [loss = 2.536, top1 = 36.34%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15435/15625) 015435-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 94.29 M, Params=0.668 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.486, top1 = 89.08%]
cifar10        FLOP= 94.29 M, Params=0.668 MB, latency=19.00 ms.
cifar10        train : [loss = 0.011, top1 = 99.79%], test  : [loss = 0.312, top1 = 92.37%]
cifar100       FLOP= 94.30 M, Params=0.674 MB, latency=17.97 ms.
cifar100       train : [loss = 0.315, top1 = 91.60%], valid : [loss = 1.249, top1 = 67.76%], test : [loss = 1.258, top1 = 67.64%]
ImageNet16-120 FLOP= 23.58 M, Params=0.676 MB, latency=18.88 ms.
ImageNet16-120 train : [loss = 2.039, top1 = 46.63%], valid : [loss = 2.337, top1 = 40.19%], test : [loss = 2.359, top1 = 40.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.555, top1 = 80.42%], valid : [loss = 0.642, top1 = 78.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15436/15625) 015436-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.64 ms.
cifar10-valid  train : [loss = 0.036, top1 = 99.03%], valid : [loss = 0.700, top1 = 83.76%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.44 ms.
cifar10        train : [loss = 0.054, top1 = 98.36%], test  : [loss = 0.432, top1 = 88.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.22 ms.
cifar100       train : [loss = 0.658, top1 = 80.63%], valid : [loss = 1.528, top1 = 60.68%], test : [loss = 1.490, top1 = 61.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.05 ms.
ImageNet16-120 train : [loss = 2.699, top1 = 32.78%], valid : [loss = 2.860, top1 = 30.73%], test : [loss = 2.902, top1 = 29.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.58%], valid : [loss = 0.888, top1 = 68.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15437/15625) 015437-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.93 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.90%], valid : [loss = 0.489, top1 = 89.12%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.20 ms.
cifar10        train : [loss = 0.012, top1 = 99.76%], test  : [loss = 0.322, top1 = 91.76%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=14.09 ms.
cifar100       train : [loss = 0.350, top1 = 90.42%], valid : [loss = 1.265, top1 = 67.34%], test : [loss = 1.265, top1 = 66.94%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=17.84 ms.
ImageNet16-120 train : [loss = 2.033, top1 = 46.80%], valid : [loss = 2.297, top1 = 40.43%], test : [loss = 2.352, top1 = 40.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.501, top1 = 82.50%], valid : [loss = 0.587, top1 = 79.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15438/15625) 015438-th architecture! ----------
arch : |none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.70 ms.
cifar10-valid  train : [loss = 0.267, top1 = 91.06%], valid : [loss = 0.469, top1 = 84.75%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.53 ms.
cifar10        train : [loss = 0.303, top1 = 89.91%], test  : [loss = 0.400, top1 = 86.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.67 ms.
cifar100       train : [loss = 1.335, top1 = 63.04%], valid : [loss = 1.530, top1 = 57.66%], test : [loss = 1.510, top1 = 59.04%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.88 ms.
ImageNet16-120 train : [loss = 2.929, top1 = 28.58%], valid : [loss = 2.901, top1 = 29.43%], test : [loss = 2.981, top1 = 28.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|none~1|+|skip_connect~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.691, top1 = 75.67%], valid : [loss = 0.747, top1 = 73.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15439/15625) 015439-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.532, top1 = 89.24%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=16.39 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.338, top1 = 92.65%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=21.43 ms.
cifar100       train : [loss = 0.178, top1 = 95.60%], valid : [loss = 1.277, top1 = 69.38%], test : [loss = 1.305, top1 = 69.76%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=19.20 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.81%], valid : [loss = 2.227, top1 = 43.50%], test : [loss = 2.236, top1 = 42.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.619, top1 = 78.15%], valid : [loss = 0.693, top1 = 75.91%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15440/15625) 015440-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.524, top1 = 81.73%], valid : [loss = 0.857, top1 = 72.04%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.16 ms.
cifar10        train : [loss = 0.548, top1 = 80.78%], test  : [loss = 0.702, top1 = 76.31%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.76 ms.
cifar100       train : [loss = 1.775, top1 = 52.24%], valid : [loss = 2.074, top1 = 46.74%], test : [loss = 2.076, top1 = 46.40%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.20 ms.
ImageNet16-120 train : [loss = 3.582, top1 = 16.84%], valid : [loss = 3.639, top1 = 16.81%], test : [loss = 3.669, top1 = 15.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|none~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.177, top1 = 57.65%], valid : [loss = 1.240, top1 = 55.81%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15441/15625) 015441-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.25 ms.
cifar10-valid  train : [loss = 0.546, top1 = 80.99%], valid : [loss = 0.857, top1 = 71.84%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.45 ms.
cifar10        train : [loss = 0.560, top1 = 80.35%], test  : [loss = 0.719, top1 = 75.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.17 ms.
cifar100       train : [loss = 1.779, top1 = 52.18%], valid : [loss = 2.047, top1 = 46.62%], test : [loss = 2.052, top1 = 46.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.76 ms.
ImageNet16-120 train : [loss = 3.588, top1 = 16.79%], valid : [loss = 3.651, top1 = 17.37%], test : [loss = 3.676, top1 = 15.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15442/15625) 015442-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.69 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.488, top1 = 89.26%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.53 ms.
cifar10        train : [loss = 0.010, top1 = 99.85%], test  : [loss = 0.317, top1 = 92.17%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.07 ms.
cifar100       train : [loss = 0.225, top1 = 94.60%], valid : [loss = 1.210, top1 = 69.28%], test : [loss = 1.223, top1 = 69.18%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=14.88 ms.
ImageNet16-120 train : [loss = 1.917, top1 = 49.48%], valid : [loss = 2.236, top1 = 42.83%], test : [loss = 2.245, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.535, top1 = 81.66%], valid : [loss = 0.617, top1 = 78.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15443/15625) 015443-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.22 ms.
cifar10-valid  train : [loss = 0.285, top1 = 90.04%], valid : [loss = 0.834, top1 = 75.81%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.72 ms.
cifar10        train : [loss = 0.316, top1 = 88.98%], test  : [loss = 0.656, top1 = 79.66%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.55 ms.
cifar100       train : [loss = 1.418, top1 = 60.34%], valid : [loss = 1.960, top1 = 49.28%], test : [loss = 1.980, top1 = 48.94%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.35 ms.
ImageNet16-120 train : [loss = 3.472, top1 = 17.93%], valid : [loss = 3.514, top1 = 18.10%], test : [loss = 3.513, top1 = 17.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15444/15625) 015444-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.587, top1 = 87.82%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.33 ms.
cifar10        train : [loss = 0.007, top1 = 99.88%], test  : [loss = 0.390, top1 = 91.56%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.77 ms.
cifar100       train : [loss = 0.155, top1 = 96.67%], valid : [loss = 1.460, top1 = 66.72%], test : [loss = 1.460, top1 = 67.00%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.14 ms.
ImageNet16-120 train : [loss = 1.985, top1 = 47.86%], valid : [loss = 2.413, top1 = 38.77%], test : [loss = 2.466, top1 = 39.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.647, top1 = 76.95%], valid : [loss = 0.739, top1 = 74.58%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15445/15625) 015445-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.54 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.472, top1 = 89.39%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.63 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.314, top1 = 92.35%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.80 ms.
cifar100       train : [loss = 0.202, top1 = 94.91%], valid : [loss = 1.384, top1 = 67.68%], test : [loss = 1.389, top1 = 67.32%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.62 ms.
ImageNet16-120 train : [loss = 1.912, top1 = 49.60%], valid : [loss = 2.291, top1 = 42.17%], test : [loss = 2.366, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.468, top1 = 83.74%], valid : [loss = 0.567, top1 = 80.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15446/15625) 015446-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=15.34 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.431, top1 = 90.48%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.35 ms.
cifar10        train : [loss = 0.006, top1 = 99.92%], test  : [loss = 0.294, top1 = 93.25%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.02 ms.
cifar100       train : [loss = 0.115, top1 = 97.81%], valid : [loss = 1.285, top1 = 70.62%], test : [loss = 1.281, top1 = 70.42%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=18.02 ms.
ImageNet16-120 train : [loss = 1.653, top1 = 55.57%], valid : [loss = 2.174, top1 = 45.13%], test : [loss = 2.188, top1 = 45.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.389, top1 = 86.58%], valid : [loss = 0.517, top1 = 82.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15447/15625) 015447-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.62 ms.
cifar10-valid  train : [loss = 0.646, top1 = 77.16%], valid : [loss = 0.744, top1 = 74.25%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.84 ms.
cifar10        train : [loss = 0.576, top1 = 80.05%], test  : [loss = 0.630, top1 = 78.49%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.22 ms.
cifar100       train : [loss = 2.109, top1 = 43.71%], valid : [loss = 2.236, top1 = 41.21%], test : [loss = 2.231, top1 = 41.17%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.99 ms.
ImageNet16-120 train : [loss = 3.293, top1 = 21.42%], valid : [loss = 3.277, top1 = 22.07%], test : [loss = 3.318, top1 = 21.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.278, top1 = 53.92%], valid : [loss = 1.350, top1 = 51.03%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15448/15625) 015448-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.11 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.97%], valid : [loss = 0.454, top1 = 89.22%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.44 ms.
cifar10        train : [loss = 0.013, top1 = 99.78%], test  : [loss = 0.312, top1 = 92.22%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=10.76 ms.
cifar100       train : [loss = 0.322, top1 = 91.38%], valid : [loss = 1.286, top1 = 67.30%], test : [loss = 1.306, top1 = 66.98%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=9.98 ms.
ImageNet16-120 train : [loss = 2.058, top1 = 46.34%], valid : [loss = 2.404, top1 = 39.47%], test : [loss = 2.424, top1 = 39.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.441, top1 = 84.85%], valid : [loss = 0.540, top1 = 81.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15449/15625) 015449-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.55 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.64%], valid : [loss = 0.589, top1 = 87.10%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.61 ms.
cifar10        train : [loss = 0.038, top1 = 98.91%], test  : [loss = 0.389, top1 = 90.26%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.67 ms.
cifar100       train : [loss = 0.558, top1 = 83.49%], valid : [loss = 1.396, top1 = 64.62%], test : [loss = 1.398, top1 = 64.64%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=12.58 ms.
ImageNet16-120 train : [loss = 2.498, top1 = 36.65%], valid : [loss = 2.622, top1 = 34.20%], test : [loss = 2.671, top1 = 33.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.618, top1 = 78.27%], valid : [loss = 0.707, top1 = 75.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15450/15625) 015450-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.529, top1 = 89.06%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.95 ms.
cifar10        train : [loss = 0.007, top1 = 99.86%], test  : [loss = 0.320, top1 = 92.57%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.86 ms.
cifar100       train : [loss = 0.164, top1 = 96.48%], valid : [loss = 1.341, top1 = 68.14%], test : [loss = 1.304, top1 = 68.92%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=19.79 ms.
ImageNet16-120 train : [loss = 1.891, top1 = 49.92%], valid : [loss = 2.316, top1 = 41.97%], test : [loss = 2.298, top1 = 41.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.58%], valid : [loss = 0.731, top1 = 74.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15451/15625) 015451-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.52 ms.
cifar10-valid  train : [loss = 0.177, top1 = 94.22%], valid : [loss = 0.574, top1 = 83.41%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.24 ms.
cifar10        train : [loss = 0.189, top1 = 93.63%], test  : [loss = 0.396, top1 = 87.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.96 ms.
cifar100       train : [loss = 1.187, top1 = 66.07%], valid : [loss = 1.530, top1 = 58.45%], test : [loss = 1.506, top1 = 58.35%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.58 ms.
ImageNet16-120 train : [loss = 2.655, top1 = 33.53%], valid : [loss = 2.689, top1 = 33.17%], test : [loss = 2.721, top1 = 32.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.937, top1 = 66.20%], valid : [loss = 0.989, top1 = 65.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15452/15625) 015452-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.526, top1 = 89.65%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.23 ms.
cifar10        train : [loss = 0.006, top1 = 99.90%], test  : [loss = 0.329, top1 = 92.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.94 ms.
cifar100       train : [loss = 0.168, top1 = 96.22%], valid : [loss = 1.376, top1 = 67.44%], test : [loss = 1.384, top1 = 67.30%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.17 ms.
ImageNet16-120 train : [loss = 1.839, top1 = 51.29%], valid : [loss = 2.192, top1 = 42.80%], test : [loss = 2.212, top1 = 44.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 75.67%], valid : [loss = 0.764, top1 = 73.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15453/15625) 015453-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.76%], valid : [loss = 0.540, top1 = 88.14%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.025, top1 = 99.28%], test  : [loss = 0.350, top1 = 90.91%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.93 ms.
cifar100       train : [loss = 0.450, top1 = 86.82%], valid : [loss = 1.247, top1 = 67.38%], test : [loss = 1.244, top1 = 66.54%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.96 ms.
ImageNet16-120 train : [loss = 2.185, top1 = 43.40%], valid : [loss = 2.404, top1 = 39.57%], test : [loss = 2.406, top1 = 39.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.644, top1 = 77.20%], valid : [loss = 0.698, top1 = 75.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15454/15625) 015454-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.39 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.555, top1 = 88.94%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.73 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.378, top1 = 92.54%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.68 ms.
cifar100       train : [loss = 0.104, top1 = 98.07%], valid : [loss = 1.443, top1 = 68.18%], test : [loss = 1.416, top1 = 68.18%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=19.37 ms.
ImageNet16-120 train : [loss = 1.892, top1 = 50.04%], valid : [loss = 2.433, top1 = 39.57%], test : [loss = 2.449, top1 = 39.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.627, top1 = 78.02%], valid : [loss = 0.721, top1 = 75.25%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15455/15625) 015455-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.41 ms.
cifar10-valid  train : [loss = 0.487, top1 = 82.99%], valid : [loss = 0.651, top1 = 78.37%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.16 ms.
cifar10        train : [loss = 0.503, top1 = 82.65%], test  : [loss = 0.583, top1 = 80.08%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=13.20 ms.
cifar100       train : [loss = 1.684, top1 = 54.34%], valid : [loss = 1.857, top1 = 50.67%], test : [loss = 1.861, top1 = 50.73%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.36 ms.
ImageNet16-120 train : [loss = 3.328, top1 = 21.22%], valid : [loss = 3.307, top1 = 21.26%], test : [loss = 3.333, top1 = 21.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.07%], valid : [loss = 1.292, top1 = 53.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15456/15625) 015456-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.74 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.439, top1 = 89.94%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=21.09 ms.
cifar10        train : [loss = 0.008, top1 = 99.88%], test  : [loss = 0.296, top1 = 92.97%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.07 ms.
cifar100       train : [loss = 0.196, top1 = 95.38%], valid : [loss = 1.290, top1 = 68.64%], test : [loss = 1.259, top1 = 68.64%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.64 ms.
ImageNet16-120 train : [loss = 1.815, top1 = 51.92%], valid : [loss = 2.253, top1 = 41.57%], test : [loss = 2.244, top1 = 43.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.443, top1 = 84.42%], valid : [loss = 0.545, top1 = 81.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15457/15625) 015457-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.806, top1 = 71.32%], valid : [loss = 1.115, top1 = 62.99%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.71 ms.
cifar10        train : [loss = 0.780, top1 = 72.65%], test  : [loss = 0.922, top1 = 68.26%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.87 ms.
cifar100       train : [loss = 2.141, top1 = 44.02%], valid : [loss = 2.441, top1 = 38.98%], test : [loss = 2.448, top1 = 39.40%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.57 ms.
ImageNet16-120 train : [loss = 3.763, top1 = 13.94%], valid : [loss = 3.811, top1 = 13.73%], test : [loss = 3.826, top1 = 13.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.362, top1 = 50.29%], valid : [loss = 1.425, top1 = 48.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15458/15625) 015458-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.65 ms.
cifar10-valid  train : [loss = 0.469, top1 = 83.58%], valid : [loss = 0.697, top1 = 76.99%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.34 ms.
cifar10        train : [loss = 0.385, top1 = 86.58%], test  : [loss = 0.519, top1 = 82.93%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.92 ms.
cifar100       train : [loss = 1.677, top1 = 53.83%], valid : [loss = 1.910, top1 = 49.42%], test : [loss = 1.909, top1 = 49.30%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.91 ms.
ImageNet16-120 train : [loss = 3.290, top1 = 21.56%], valid : [loss = 3.292, top1 = 21.57%], test : [loss = 3.317, top1 = 21.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.192, top1 = 56.44%], valid : [loss = 1.251, top1 = 55.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15459/15625) 015459-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.50 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.419, top1 = 90.53%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.60 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.285, top1 = 93.16%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.05 ms.
cifar100       train : [loss = 0.181, top1 = 95.68%], valid : [loss = 1.276, top1 = 69.28%], test : [loss = 1.280, top1 = 69.36%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.71 ms.
ImageNet16-120 train : [loss = 1.817, top1 = 51.71%], valid : [loss = 2.284, top1 = 42.93%], test : [loss = 2.288, top1 = 42.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.368, top1 = 87.33%], valid : [loss = 0.505, top1 = 83.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15460/15625) 015460-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.52 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.530, top1 = 88.72%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=17.12 ms.
cifar10        train : [loss = 0.013, top1 = 99.66%], test  : [loss = 0.353, top1 = 91.93%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.93 ms.
cifar100       train : [loss = 0.304, top1 = 91.41%], valid : [loss = 1.316, top1 = 67.54%], test : [loss = 1.343, top1 = 67.16%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=20.95 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.00%], valid : [loss = 2.433, top1 = 38.03%], test : [loss = 2.445, top1 = 38.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.52%], valid : [loss = 0.862, top1 = 69.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15461/15625) 015461-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=15.89 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.540, top1 = 89.30%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=19.21 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.302, top1 = 93.64%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=17.50 ms.
cifar100       train : [loss = 0.070, top1 = 98.89%], valid : [loss = 1.371, top1 = 68.82%], test : [loss = 1.366, top1 = 69.06%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.28 ms.
ImageNet16-120 train : [loss = 2.034, top1 = 46.69%], valid : [loss = 2.392, top1 = 40.03%], test : [loss = 2.379, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.12%], valid : [loss = 0.730, top1 = 74.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15462/15625) 015462-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.07 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.540, top1 = 89.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.59 ms.
cifar10        train : [loss = 0.004, top1 = 99.91%], test  : [loss = 0.337, top1 = 92.85%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.96 ms.
cifar100       train : [loss = 0.057, top1 = 99.32%], valid : [loss = 1.403, top1 = 69.30%], test : [loss = 1.460, top1 = 68.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.47 ms.
ImageNet16-120 train : [loss = 1.738, top1 = 53.76%], valid : [loss = 2.353, top1 = 41.17%], test : [loss = 2.379, top1 = 42.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.601, top1 = 78.84%], valid : [loss = 0.696, top1 = 75.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15463/15625) 015463-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=21.04 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.83%], valid : [loss = 0.531, top1 = 88.97%]
cifar10        FLOP= 58.90 M, Params=0.428 MB, latency=19.50 ms.
cifar10        train : [loss = 0.017, top1 = 99.52%], test  : [loss = 0.364, top1 = 91.41%]
cifar100       FLOP= 58.91 M, Params=0.434 MB, latency=18.98 ms.
cifar100       train : [loss = 0.240, top1 = 93.79%], valid : [loss = 1.303, top1 = 68.34%], test : [loss = 1.281, top1 = 68.44%]
ImageNet16-120 FLOP= 14.73 M, Params=0.435 MB, latency=20.89 ms.
ImageNet16-120 train : [loss = 1.950, top1 = 48.72%], valid : [loss = 2.285, top1 = 41.60%], test : [loss = 2.267, top1 = 42.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 58.90 M, Params=0.428 MB, latency=None ms.
cifar10-valid  train : [loss = 0.727, top1 = 74.31%], valid : [loss = 0.789, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15464/15625) 015464-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.556, top1 = 87.94%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.17 ms.
cifar10        train : [loss = 0.014, top1 = 99.70%], test  : [loss = 0.398, top1 = 91.29%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.71 ms.
cifar100       train : [loss = 0.371, top1 = 89.58%], valid : [loss = 1.410, top1 = 65.28%], test : [loss = 1.390, top1 = 66.24%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.08 ms.
ImageNet16-120 train : [loss = 2.288, top1 = 41.26%], valid : [loss = 2.488, top1 = 37.93%], test : [loss = 2.530, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.28%], valid : [loss = 0.786, top1 = 72.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15465/15625) 015465-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.98 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.28 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.91 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.55 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|none~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15466/15625) 015466-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.55 ms.
cifar10-valid  train : [loss = 0.122, top1 = 96.26%], valid : [loss = 0.467, top1 = 85.90%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.95 ms.
cifar10        train : [loss = 0.161, top1 = 94.70%], test  : [loss = 0.347, top1 = 88.56%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.79 ms.
cifar100       train : [loss = 1.031, top1 = 70.64%], valid : [loss = 1.375, top1 = 61.82%], test : [loss = 1.402, top1 = 60.50%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.54 ms.
ImageNet16-120 train : [loss = 2.661, top1 = 33.32%], valid : [loss = 2.702, top1 = 32.77%], test : [loss = 2.764, top1 = 31.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 74.03%], valid : [loss = 0.786, top1 = 72.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15467/15625) 015467-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.068, top1 = 98.13%], valid : [loss = 0.563, top1 = 85.53%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.69 ms.
cifar10        train : [loss = 0.086, top1 = 97.34%], test  : [loss = 0.375, top1 = 88.82%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.69 ms.
cifar100       train : [loss = 0.690, top1 = 79.93%], valid : [loss = 1.381, top1 = 63.58%], test : [loss = 1.341, top1 = 63.78%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.58 ms.
ImageNet16-120 train : [loss = 2.438, top1 = 37.89%], valid : [loss = 2.537, top1 = 35.23%], test : [loss = 2.575, top1 = 35.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.799, top1 = 71.00%], valid : [loss = 0.867, top1 = 69.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15468/15625) 015468-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.97%], valid : [loss = 0.551, top1 = 88.78%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.43 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.375, top1 = 92.01%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=18.02 ms.
cifar100       train : [loss = 0.172, top1 = 96.21%], valid : [loss = 1.396, top1 = 68.10%], test : [loss = 1.392, top1 = 67.64%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=13.78 ms.
ImageNet16-120 train : [loss = 2.001, top1 = 47.65%], valid : [loss = 2.467, top1 = 38.40%], test : [loss = 2.483, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.42%], valid : [loss = 0.712, top1 = 75.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15469/15625) 015469-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.25%], valid : [loss = 0.585, top1 = 86.33%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.36 ms.
cifar10        train : [loss = 0.029, top1 = 99.11%], test  : [loss = 0.345, top1 = 91.47%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.90 ms.
cifar100       train : [loss = 0.275, top1 = 92.22%], valid : [loss = 1.358, top1 = 66.82%], test : [loss = 1.343, top1 = 67.70%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.43 ms.
ImageNet16-120 train : [loss = 2.707, top1 = 31.83%], valid : [loss = 2.795, top1 = 29.17%], test : [loss = 2.814, top1 = 30.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.995, top1 = 63.99%], valid : [loss = 1.023, top1 = 63.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15470/15625) 015470-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=18.45 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.556, top1 = 88.36%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.69 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.386, top1 = 91.60%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.28 ms.
cifar100       train : [loss = 0.094, top1 = 98.64%], valid : [loss = 1.491, top1 = 67.60%], test : [loss = 1.462, top1 = 67.48%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=20.87 ms.
ImageNet16-120 train : [loss = 1.808, top1 = 52.10%], valid : [loss = 2.384, top1 = 39.97%], test : [loss = 2.453, top1 = 39.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.615, top1 = 78.25%], valid : [loss = 0.717, top1 = 75.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15471/15625) 015471-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.560, top1 = 88.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.27 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.346, top1 = 92.14%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.79 ms.
cifar100       train : [loss = 0.222, top1 = 94.35%], valid : [loss = 1.320, top1 = 68.02%], test : [loss = 1.334, top1 = 68.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.16 ms.
ImageNet16-120 train : [loss = 2.000, top1 = 47.48%], valid : [loss = 2.322, top1 = 40.80%], test : [loss = 2.345, top1 = 41.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.22%], valid : [loss = 0.843, top1 = 70.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15472/15625) 015472-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.46 ms.
cifar10-valid  train : [loss = 0.270, top1 = 90.86%], valid : [loss = 0.486, top1 = 83.98%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.21 ms.
cifar10        train : [loss = 0.300, top1 = 90.01%], test  : [loss = 0.401, top1 = 86.39%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.36 ms.
cifar100       train : [loss = 1.341, top1 = 62.67%], valid : [loss = 1.544, top1 = 58.62%], test : [loss = 1.513, top1 = 57.86%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.86 ms.
ImageNet16-120 train : [loss = 2.915, top1 = 28.59%], valid : [loss = 2.900, top1 = 28.90%], test : [loss = 2.948, top1 = 28.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.714, top1 = 75.06%], valid : [loss = 0.758, top1 = 73.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15473/15625) 015473-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.74 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.560, top1 = 89.01%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.84 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.357, top1 = 92.74%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=17.58 ms.
cifar100       train : [loss = 0.100, top1 = 98.21%], valid : [loss = 1.442, top1 = 68.44%], test : [loss = 1.442, top1 = 68.58%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.31 ms.
ImageNet16-120 train : [loss = 1.877, top1 = 50.56%], valid : [loss = 2.455, top1 = 39.07%], test : [loss = 2.423, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.649, top1 = 77.28%], valid : [loss = 0.730, top1 = 74.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15474/15625) 015474-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.640 MB, latency=17.03 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.542, top1 = 89.09%]
cifar10        FLOP= 90.36 M, Params=0.640 MB, latency=16.41 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.372, top1 = 92.38%]
cifar100       FLOP= 90.36 M, Params=0.646 MB, latency=16.61 ms.
cifar100       train : [loss = 0.095, top1 = 98.25%], valid : [loss = 1.451, top1 = 68.23%], test : [loss = 1.447, top1 = 68.36%]
ImageNet16-120 FLOP= 22.60 M, Params=0.648 MB, latency=15.61 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.86%], valid : [loss = 2.419, top1 = 39.50%], test : [loss = 2.418, top1 = 39.78%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.568, top1 = 79.95%], valid : [loss = 0.665, top1 = 77.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15475/15625) 015475-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.46 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.54%], valid : [loss = 0.669, top1 = 85.13%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.06 ms.
cifar10        train : [loss = 0.057, top1 = 98.21%], test  : [loss = 0.455, top1 = 88.09%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.54 ms.
cifar100       train : [loss = 0.620, top1 = 81.70%], valid : [loss = 1.486, top1 = 62.30%], test : [loss = 1.454, top1 = 62.22%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=14.14 ms.
ImageNet16-120 train : [loss = 2.674, top1 = 33.18%], valid : [loss = 2.841, top1 = 30.00%], test : [loss = 2.887, top1 = 29.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.819, top1 = 70.82%], valid : [loss = 0.877, top1 = 69.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15476/15625) 015476-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.02 ms.
cifar10-valid  train : [loss = 0.216, top1 = 92.80%], valid : [loss = 0.540, top1 = 83.79%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.01 ms.
cifar10        train : [loss = 0.206, top1 = 93.06%], test  : [loss = 0.390, top1 = 87.75%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.26 ms.
cifar100       train : [loss = 1.238, top1 = 64.91%], valid : [loss = 1.533, top1 = 58.08%], test : [loss = 1.532, top1 = 58.11%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.36 ms.
ImageNet16-120 train : [loss = 2.725, top1 = 32.10%], valid : [loss = 2.738, top1 = 32.10%], test : [loss = 2.793, top1 = 30.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.964, top1 = 65.60%], valid : [loss = 1.005, top1 = 64.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15477/15625) 015477-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.75 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.21%], valid : [loss = 0.894, top1 = 76.29%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.90 ms.
cifar10        train : [loss = 0.209, top1 = 92.67%], test  : [loss = 0.634, top1 = 81.59%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=13.65 ms.
cifar100       train : [loss = 1.058, top1 = 69.78%], valid : [loss = 1.864, top1 = 52.28%], test : [loss = 1.873, top1 = 52.88%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=19.34 ms.
ImageNet16-120 train : [loss = 3.345, top1 = 19.79%], valid : [loss = 3.406, top1 = 20.30%], test : [loss = 3.426, top1 = 18.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 1.220, top1 = 55.57%], valid : [loss = 1.253, top1 = 54.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15478/15625) 015478-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.43 ms.
cifar10-valid  train : [loss = 0.480, top1 = 83.35%], valid : [loss = 0.643, top1 = 78.37%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.97 ms.
cifar10        train : [loss = 0.505, top1 = 82.51%], test  : [loss = 0.583, top1 = 80.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.44 ms.
cifar100       train : [loss = 1.687, top1 = 54.19%], valid : [loss = 1.851, top1 = 50.76%], test : [loss = 1.873, top1 = 50.68%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.19 ms.
ImageNet16-120 train : [loss = 3.323, top1 = 21.31%], valid : [loss = 3.315, top1 = 21.02%], test : [loss = 3.358, top1 = 21.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15479/15625) 015479-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.218, top1 = 92.61%], valid : [loss = 0.542, top1 = 83.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10        train : [loss = 0.199, top1 = 93.22%], test  : [loss = 0.398, top1 = 87.41%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.10 ms.
cifar100       train : [loss = 1.269, top1 = 63.99%], valid : [loss = 1.530, top1 = 58.07%], test : [loss = 1.546, top1 = 57.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.10 ms.
ImageNet16-120 train : [loss = 2.700, top1 = 32.54%], valid : [loss = 2.733, top1 = 32.17%], test : [loss = 2.774, top1 = 30.55%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.955, top1 = 65.27%], valid : [loss = 1.020, top1 = 63.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15480/15625) 015480-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.77 ms.
cifar10-valid  train : [loss = 0.060, top1 = 98.43%], valid : [loss = 0.528, top1 = 86.20%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.38 ms.
cifar10        train : [loss = 0.108, top1 = 96.55%], test  : [loss = 0.350, top1 = 89.27%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.13 ms.
cifar100       train : [loss = 0.780, top1 = 77.32%], valid : [loss = 1.346, top1 = 63.40%], test : [loss = 1.330, top1 = 63.34%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.96 ms.
ImageNet16-120 train : [loss = 2.485, top1 = 37.09%], valid : [loss = 2.574, top1 = 34.73%], test : [loss = 2.561, top1 = 35.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.860, top1 = 68.81%], valid : [loss = 0.914, top1 = 67.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15481/15625) 015481-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=10.55 ms.
cifar10-valid  train : [loss = 0.624, top1 = 78.10%], valid : [loss = 0.720, top1 = 75.24%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.47 ms.
cifar10        train : [loss = 0.549, top1 = 81.14%], test  : [loss = 0.600, top1 = 79.32%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.49 ms.
cifar100       train : [loss = 2.006, top1 = 46.51%], valid : [loss = 2.125, top1 = 44.31%], test : [loss = 2.105, top1 = 44.57%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.93 ms.
ImageNet16-120 train : [loss = 3.238, top1 = 22.24%], valid : [loss = 3.215, top1 = 23.20%], test : [loss = 3.247, top1 = 21.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.286, top1 = 53.61%], valid : [loss = 1.351, top1 = 51.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15482/15625) 015482-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.29 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.95 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.66 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.84 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15483/15625) 015483-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.80 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.460, top1 = 89.56%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.59 ms.
cifar10        train : [loss = 0.011, top1 = 99.80%], test  : [loss = 0.294, top1 = 92.66%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=23.10 ms.
cifar100       train : [loss = 0.305, top1 = 91.78%], valid : [loss = 1.275, top1 = 68.10%], test : [loss = 1.267, top1 = 68.12%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.58 ms.
ImageNet16-120 train : [loss = 1.896, top1 = 49.87%], valid : [loss = 2.219, top1 = 42.07%], test : [loss = 2.236, top1 = 42.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.564, top1 = 80.42%], valid : [loss = 0.641, top1 = 77.82%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15484/15625) 015484-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 66.77 M, Params=0.478 MB, latency=15.18 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.93%], valid : [loss = 0.467, top1 = 89.12%]
cifar10        FLOP= 66.77 M, Params=0.478 MB, latency=14.84 ms.
cifar10        train : [loss = 0.012, top1 = 99.79%], test  : [loss = 0.330, top1 = 92.02%]
cifar100       FLOP= 66.77 M, Params=0.484 MB, latency=13.73 ms.
cifar100       train : [loss = 0.309, top1 = 91.60%], valid : [loss = 1.340, top1 = 66.95%], test : [loss = 1.322, top1 = 67.51%]
ImageNet16-120 FLOP= 16.70 M, Params=0.486 MB, latency=14.41 ms.
ImageNet16-120 train : [loss = 2.045, top1 = 46.54%], valid : [loss = 2.361, top1 = 40.16%], test : [loss = 2.388, top1 = 39.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.508, top1 = 82.39%], valid : [loss = 0.609, top1 = 79.13%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15485/15625) 015485-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.22 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.441, top1 = 90.65%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.18 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.285, top1 = 93.82%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.17 ms.
cifar100       train : [loss = 0.054, top1 = 99.15%], valid : [loss = 1.419, top1 = 70.10%], test : [loss = 1.340, top1 = 71.04%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.97 ms.
ImageNet16-120 train : [loss = 1.531, top1 = 58.56%], valid : [loss = 2.222, top1 = 45.27%], test : [loss = 2.244, top1 = 44.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.378, top1 = 87.24%], valid : [loss = 0.506, top1 = 82.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15486/15625) 015486-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.29 ms.
cifar10-valid  train : [loss = 0.685, top1 = 76.10%], valid : [loss = 0.854, top1 = 71.07%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.70 ms.
cifar10        train : [loss = 0.690, top1 = 75.77%], test  : [loss = 0.790, top1 = 72.51%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.72 ms.
cifar100       train : [loss = 1.989, top1 = 47.20%], valid : [loss = 2.152, top1 = 43.74%], test : [loss = 2.181, top1 = 43.98%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.84 ms.
ImageNet16-120 train : [loss = 3.657, top1 = 15.64%], valid : [loss = 3.686, top1 = 15.73%], test : [loss = 3.702, top1 = 14.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.419, top1 = 48.11%], valid : [loss = 1.445, top1 = 47.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15487/15625) 015487-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.28 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.537, top1 = 88.25%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.49 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.346, top1 = 91.60%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.84 ms.
cifar100       train : [loss = 0.330, top1 = 90.93%], valid : [loss = 1.303, top1 = 66.80%], test : [loss = 1.289, top1 = 68.02%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.34 ms.
ImageNet16-120 train : [loss = 2.171, top1 = 43.72%], valid : [loss = 2.385, top1 = 39.20%], test : [loss = 2.448, top1 = 37.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.786, top1 = 71.96%], valid : [loss = 0.839, top1 = 70.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15488/15625) 015488-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.59 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.492, top1 = 88.94%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.57 ms.
cifar10        train : [loss = 0.012, top1 = 99.75%], test  : [loss = 0.340, top1 = 91.93%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.15 ms.
cifar100       train : [loss = 0.338, top1 = 90.74%], valid : [loss = 1.300, top1 = 66.42%], test : [loss = 1.302, top1 = 67.24%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.93 ms.
ImageNet16-120 train : [loss = 2.117, top1 = 44.72%], valid : [loss = 2.402, top1 = 39.53%], test : [loss = 2.404, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|none~1|+|nor_conv_3x3~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.594, top1 = 79.18%], valid : [loss = 0.660, top1 = 77.08%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15489/15625) 015489-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.72 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.66%], valid : [loss = 0.569, top1 = 87.68%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=18.00 ms.
cifar10        train : [loss = 0.029, top1 = 99.13%], test  : [loss = 0.365, top1 = 91.34%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.35 ms.
cifar100       train : [loss = 0.518, top1 = 85.14%], valid : [loss = 1.341, top1 = 64.76%], test : [loss = 1.344, top1 = 64.80%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.52 ms.
ImageNet16-120 train : [loss = 2.430, top1 = 37.90%], valid : [loss = 2.543, top1 = 35.57%], test : [loss = 2.546, top1 = 35.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.881, top1 = 68.22%], valid : [loss = 0.905, top1 = 67.88%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15490/15625) 015490-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.51 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.79%], valid : [loss = 0.542, top1 = 88.18%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.07 ms.
cifar10        train : [loss = 0.014, top1 = 99.71%], test  : [loss = 0.336, top1 = 92.12%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.45 ms.
cifar100       train : [loss = 0.286, top1 = 92.10%], valid : [loss = 1.328, top1 = 67.44%], test : [loss = 1.343, top1 = 66.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.27 ms.
ImageNet16-120 train : [loss = 2.154, top1 = 44.01%], valid : [loss = 2.436, top1 = 37.77%], test : [loss = 2.435, top1 = 38.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.59%], valid : [loss = 0.829, top1 = 70.76%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15491/15625) 015491-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.23 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.87%], valid : [loss = 0.576, top1 = 87.47%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.99 ms.
cifar10        train : [loss = 0.015, top1 = 99.64%], test  : [loss = 0.403, top1 = 90.68%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=12.76 ms.
cifar100       train : [loss = 0.423, top1 = 88.04%], valid : [loss = 1.432, top1 = 64.76%], test : [loss = 1.404, top1 = 65.30%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.21 ms.
ImageNet16-120 train : [loss = 2.315, top1 = 40.65%], valid : [loss = 2.538, top1 = 36.27%], test : [loss = 2.548, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.722, top1 = 74.28%], valid : [loss = 0.795, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15492/15625) 015492-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.188, top1 = 93.96%], valid : [loss = 0.908, top1 = 75.82%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.48 ms.
cifar10        train : [loss = 0.211, top1 = 92.81%], test  : [loss = 0.582, top1 = 82.89%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.80 ms.
cifar100       train : [loss = 1.204, top1 = 65.96%], valid : [loss = 1.834, top1 = 52.58%], test : [loss = 1.778, top1 = 54.06%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=12.17 ms.
ImageNet16-120 train : [loss = 3.216, top1 = 22.99%], valid : [loss = 3.331, top1 = 21.73%], test : [loss = 3.347, top1 = 20.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.039, top1 = 62.73%], valid : [loss = 1.094, top1 = 61.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15493/15625) 015493-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.65 ms.
cifar10-valid  train : [loss = 0.012, top1 = 99.79%], valid : [loss = 0.522, top1 = 88.12%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.75 ms.
cifar10        train : [loss = 0.027, top1 = 99.20%], test  : [loss = 0.358, top1 = 90.99%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=15.03 ms.
cifar100       train : [loss = 0.477, top1 = 86.03%], valid : [loss = 1.346, top1 = 65.66%], test : [loss = 1.349, top1 = 65.68%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=10.87 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.22%], valid : [loss = 2.543, top1 = 36.30%], test : [loss = 2.533, top1 = 35.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.588, top1 = 79.44%], valid : [loss = 0.680, top1 = 77.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15494/15625) 015494-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.26 ms.
cifar10-valid  train : [loss = 0.078, top1 = 97.75%], valid : [loss = 0.573, top1 = 85.07%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=14.75 ms.
cifar10        train : [loss = 0.112, top1 = 96.42%], test  : [loss = 0.356, top1 = 89.07%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.10 ms.
cifar100       train : [loss = 0.780, top1 = 77.22%], valid : [loss = 1.380, top1 = 63.10%], test : [loss = 1.382, top1 = 63.04%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.66 ms.
ImageNet16-120 train : [loss = 2.516, top1 = 36.31%], valid : [loss = 2.579, top1 = 34.20%], test : [loss = 2.621, top1 = 34.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.873, top1 = 68.60%], valid : [loss = 0.917, top1 = 67.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15495/15625) 015495-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=20.16 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.95%], valid : [loss = 0.474, top1 = 89.28%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=19.50 ms.
cifar10        train : [loss = 0.009, top1 = 99.86%], test  : [loss = 0.303, top1 = 92.64%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=17.92 ms.
cifar100       train : [loss = 0.216, top1 = 94.87%], valid : [loss = 1.194, top1 = 69.04%], test : [loss = 1.237, top1 = 68.72%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.59 ms.
ImageNet16-120 train : [loss = 1.907, top1 = 49.69%], valid : [loss = 2.235, top1 = 41.83%], test : [loss = 2.241, top1 = 43.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.549, top1 = 80.78%], valid : [loss = 0.642, top1 = 78.22%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15496/15625) 015496-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.76 ms.
cifar10-valid  train : [loss = 0.612, top1 = 78.54%], valid : [loss = 0.707, top1 = 75.76%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=11.55 ms.
cifar10        train : [loss = 0.545, top1 = 81.31%], test  : [loss = 0.601, top1 = 79.33%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.69 ms.
cifar100       train : [loss = 1.947, top1 = 47.76%], valid : [loss = 2.063, top1 = 45.75%], test : [loss = 2.049, top1 = 45.19%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.57 ms.
ImageNet16-120 train : [loss = 3.228, top1 = 22.36%], valid : [loss = 3.199, top1 = 23.10%], test : [loss = 3.234, top1 = 22.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|skip_connect~1|+|nor_conv_1x1~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.279, top1 = 53.96%], valid : [loss = 1.368, top1 = 50.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15497/15625) 015497-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10-valid  train : [loss = 0.014, top1 = 99.73%], valid : [loss = 0.523, top1 = 88.15%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.77 ms.
cifar10        train : [loss = 0.029, top1 = 99.20%], test  : [loss = 0.353, top1 = 91.13%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.71 ms.
cifar100       train : [loss = 0.483, top1 = 85.81%], valid : [loss = 1.350, top1 = 65.53%], test : [loss = 1.332, top1 = 65.67%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.83 ms.
ImageNet16-120 train : [loss = 2.338, top1 = 40.05%], valid : [loss = 2.544, top1 = 35.89%], test : [loss = 2.551, top1 = 36.02%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.52%], valid : [loss = 0.691, top1 = 76.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15498/15625) 015498-th architecture! ----------
arch : |none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.09 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.89%], valid : [loss = 0.568, top1 = 87.58%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.29 ms.
cifar10        train : [loss = 0.015, top1 = 99.65%], test  : [loss = 0.378, top1 = 91.31%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.58 ms.
cifar100       train : [loss = 0.391, top1 = 88.90%], valid : [loss = 1.371, top1 = 65.83%], test : [loss = 1.374, top1 = 65.87%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.75 ms.
ImageNet16-120 train : [loss = 2.308, top1 = 40.79%], valid : [loss = 2.526, top1 = 36.62%], test : [loss = 2.531, top1 = 36.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15499/15625) 015499-th architecture! ----------
arch : |none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=12.82 ms.
cifar10-valid  train : [loss = 0.130, top1 = 95.87%], valid : [loss = 0.479, top1 = 85.73%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.77 ms.
cifar10        train : [loss = 0.159, top1 = 94.84%], test  : [loss = 0.351, top1 = 88.86%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.56 ms.
cifar100       train : [loss = 1.003, top1 = 71.34%], valid : [loss = 1.351, top1 = 61.98%], test : [loss = 1.337, top1 = 62.94%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.15 ms.
ImageNet16-120 train : [loss = 2.650, top1 = 33.66%], valid : [loss = 2.680, top1 = 34.33%], test : [loss = 2.717, top1 = 32.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.744, top1 = 73.55%], valid : [loss = 0.804, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15500/15625) 015500-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.86 ms.
cifar10-valid  train : [loss = 0.491, top1 = 82.82%], valid : [loss = 0.652, top1 = 78.16%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.44 ms.
cifar10        train : [loss = 0.520, top1 = 81.89%], test  : [loss = 0.599, top1 = 79.56%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.88 ms.
cifar100       train : [loss = 1.699, top1 = 53.88%], valid : [loss = 1.858, top1 = 50.66%], test : [loss = 1.870, top1 = 50.71%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.62 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.29%], valid : [loss = 3.309, top1 = 21.42%], test : [loss = 3.340, top1 = 20.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|skip_connect~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15501/15625) 015501-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.36 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.550, top1 = 88.98%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=17.95 ms.
cifar10        train : [loss = 0.008, top1 = 99.82%], test  : [loss = 0.347, top1 = 92.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.33 ms.
cifar100       train : [loss = 0.153, top1 = 96.49%], valid : [loss = 1.316, top1 = 69.36%], test : [loss = 1.324, top1 = 69.70%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.70 ms.
ImageNet16-120 train : [loss = 1.830, top1 = 51.42%], valid : [loss = 2.250, top1 = 42.37%], test : [loss = 2.292, top1 = 41.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.765, top1 = 72.46%], valid : [loss = 0.824, top1 = 71.30%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15502/15625) 015502-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.32 ms.
cifar10-valid  train : [loss = 0.100, top1 = 96.73%], valid : [loss = 0.673, top1 = 82.48%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.88 ms.
cifar10        train : [loss = 0.150, top1 = 94.94%], test  : [loss = 0.470, top1 = 86.83%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.36 ms.
cifar100       train : [loss = 0.949, top1 = 72.49%], valid : [loss = 1.636, top1 = 56.60%], test : [loss = 1.636, top1 = 57.72%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 3.036, top1 = 25.86%], valid : [loss = 3.122, top1 = 25.50%], test : [loss = 3.166, top1 = 23.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.961, top1 = 65.29%], valid : [loss = 0.996, top1 = 64.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15503/15625) 015503-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.81 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.66%], valid : [loss = 0.601, top1 = 86.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.24 ms.
cifar10        train : [loss = 0.029, top1 = 99.25%], test  : [loss = 0.395, top1 = 90.24%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.10 ms.
cifar100       train : [loss = 0.505, top1 = 85.28%], valid : [loss = 1.436, top1 = 63.41%], test : [loss = 1.415, top1 = 64.71%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.52 ms.
ImageNet16-120 train : [loss = 2.390, top1 = 39.05%], valid : [loss = 2.564, top1 = 35.91%], test : [loss = 2.590, top1 = 35.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.778, top1 = 72.25%], valid : [loss = 0.837, top1 = 70.40%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15504/15625) 015504-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.82 ms.
cifar10-valid  train : [loss = 1.007, top1 = 64.51%], valid : [loss = 1.056, top1 = 63.19%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.48 ms.
cifar10        train : [loss = 0.960, top1 = 66.40%], test  : [loss = 0.959, top1 = 66.11%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.14 ms.
cifar100       train : [loss = 2.438, top1 = 37.68%], valid : [loss = 2.505, top1 = 36.15%], test : [loss = 2.489, top1 = 36.09%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.10 ms.
ImageNet16-120 train : [loss = 3.650, top1 = 15.56%], valid : [loss = 3.621, top1 = 17.15%], test : [loss = 3.643, top1 = 15.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.620, top1 = 39.34%], valid : [loss = 1.667, top1 = 36.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15505/15625) 015505-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=13.53 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.51%], valid : [loss = 0.620, top1 = 86.26%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.12 ms.
cifar10        train : [loss = 0.028, top1 = 99.17%], test  : [loss = 0.383, top1 = 90.71%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.42 ms.
cifar100       train : [loss = 0.508, top1 = 85.22%], valid : [loss = 1.448, top1 = 63.56%], test : [loss = 1.446, top1 = 64.70%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.83 ms.
ImageNet16-120 train : [loss = 2.332, top1 = 40.16%], valid : [loss = 2.551, top1 = 36.40%], test : [loss = 2.563, top1 = 36.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.827, top1 = 70.61%], valid : [loss = 0.888, top1 = 68.51%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15506/15625) 015506-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.85 ms.
cifar10-valid  train : [loss = 0.025, top1 = 99.50%], valid : [loss = 0.627, top1 = 85.38%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=16.03 ms.
cifar10        train : [loss = 0.053, top1 = 98.42%], test  : [loss = 0.391, top1 = 89.49%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.88 ms.
cifar100       train : [loss = 0.637, top1 = 81.67%], valid : [loss = 1.370, top1 = 64.12%], test : [loss = 1.345, top1 = 64.32%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=14.36 ms.
ImageNet16-120 train : [loss = 2.435, top1 = 38.10%], valid : [loss = 2.574, top1 = 35.23%], test : [loss = 2.607, top1 = 35.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.703, top1 = 75.00%], valid : [loss = 0.771, top1 = 73.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15507/15625) 015507-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.09 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.72%], valid : [loss = 0.538, top1 = 87.65%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.89 ms.
cifar10        train : [loss = 0.036, top1 = 99.00%], test  : [loss = 0.368, top1 = 90.26%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.14 ms.
cifar100       train : [loss = 0.529, top1 = 84.60%], valid : [loss = 1.336, top1 = 65.44%], test : [loss = 1.333, top1 = 65.07%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=11.56 ms.
ImageNet16-120 train : [loss = 2.285, top1 = 41.34%], valid : [loss = 2.468, top1 = 37.79%], test : [loss = 2.511, top1 = 37.14%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.536, top1 = 81.29%], valid : [loss = 0.632, top1 = 78.42%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15508/15625) 015508-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.87 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.469, top1 = 90.45%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.79 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.317, top1 = 93.36%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.57 ms.
cifar100       train : [loss = 0.095, top1 = 98.35%], valid : [loss = 1.302, top1 = 69.94%], test : [loss = 1.285, top1 = 70.30%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=22.41 ms.
ImageNet16-120 train : [loss = 1.623, top1 = 56.32%], valid : [loss = 2.163, top1 = 45.13%], test : [loss = 2.189, top1 = 45.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.471, top1 = 83.69%], valid : [loss = 0.575, top1 = 80.61%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15509/15625) 015509-th architecture! ----------
arch : |none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.26 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.90%], valid : [loss = 0.587, top1 = 87.31%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.25 ms.
cifar10        train : [loss = 0.016, top1 = 99.61%], test  : [loss = 0.384, top1 = 91.02%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.27 ms.
cifar100       train : [loss = 0.394, top1 = 88.81%], valid : [loss = 1.380, top1 = 65.82%], test : [loss = 1.398, top1 = 64.74%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=9.84 ms.
ImageNet16-120 train : [loss = 2.297, top1 = 41.15%], valid : [loss = 2.497, top1 = 36.33%], test : [loss = 2.534, top1 = 36.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.698, top1 = 75.23%], valid : [loss = 0.778, top1 = 73.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15510/15625) 015510-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=20.04 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.98%], valid : [loss = 0.421, top1 = 90.31%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=21.41 ms.
cifar10        train : [loss = 0.004, top1 = 99.94%], test  : [loss = 0.269, top1 = 93.33%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=21.90 ms.
cifar100       train : [loss = 0.058, top1 = 99.41%], valid : [loss = 1.267, top1 = 70.88%], test : [loss = 1.296, top1 = 70.94%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=17.53 ms.
ImageNet16-120 train : [loss = 1.440, top1 = 60.71%], valid : [loss = 2.210, top1 = 44.80%], test : [loss = 2.240, top1 = 45.33%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.393, top1 = 86.47%], valid : [loss = 0.518, top1 = 82.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15511/15625) 015511-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.47 ms.
cifar10-valid  train : [loss = 0.073, top1 = 97.77%], valid : [loss = 0.595, top1 = 84.83%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.84 ms.
cifar10        train : [loss = 0.111, top1 = 96.36%], test  : [loss = 0.399, top1 = 88.56%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.12 ms.
cifar100       train : [loss = 0.889, top1 = 74.16%], valid : [loss = 1.464, top1 = 60.73%], test : [loss = 1.460, top1 = 60.68%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=10.17 ms.
ImageNet16-120 train : [loss = 2.711, top1 = 32.23%], valid : [loss = 2.839, top1 = 30.00%], test : [loss = 2.851, top1 = 30.35%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|avg_pool_3x3~1|+|none~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.839, top1 = 70.31%], valid : [loss = 0.884, top1 = 68.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15512/15625) 015512-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.98 ms.
cifar10-valid  train : [loss = 0.282, top1 = 90.32%], valid : [loss = 0.544, top1 = 82.99%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.17 ms.
cifar10        train : [loss = 0.269, top1 = 90.80%], test  : [loss = 0.415, top1 = 86.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=12.57 ms.
cifar100       train : [loss = 1.384, top1 = 61.24%], valid : [loss = 1.658, top1 = 55.16%], test : [loss = 1.641, top1 = 55.50%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.34 ms.
ImageNet16-120 train : [loss = 2.971, top1 = 27.39%], valid : [loss = 2.971, top1 = 27.07%], test : [loss = 3.025, top1 = 27.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.976, top1 = 65.25%], valid : [loss = 1.029, top1 = 63.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15513/15625) 015513-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.87%], valid : [loss = 0.667, top1 = 85.86%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.08 ms.
cifar10        train : [loss = 0.028, top1 = 99.24%], test  : [loss = 0.470, top1 = 88.91%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=14.96 ms.
cifar100       train : [loss = 0.358, top1 = 90.31%], valid : [loss = 1.523, top1 = 64.10%], test : [loss = 1.502, top1 = 63.20%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=14.11 ms.
ImageNet16-120 train : [loss = 2.324, top1 = 40.35%], valid : [loss = 2.669, top1 = 33.83%], test : [loss = 2.692, top1 = 34.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.733, top1 = 74.16%], valid : [loss = 0.809, top1 = 72.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15514/15625) 015514-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=11.45 ms.
cifar10-valid  train : [loss = 0.394, top1 = 85.94%], valid : [loss = 0.625, top1 = 79.60%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.20 ms.
cifar10        train : [loss = 0.336, top1 = 88.42%], test  : [loss = 0.465, top1 = 84.42%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.32 ms.
cifar100       train : [loss = 1.607, top1 = 55.48%], valid : [loss = 1.837, top1 = 50.86%], test : [loss = 1.816, top1 = 51.44%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.89 ms.
ImageNet16-120 train : [loss = 3.127, top1 = 24.27%], valid : [loss = 3.130, top1 = 24.77%], test : [loss = 3.176, top1 = 23.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.036, top1 = 62.71%], valid : [loss = 1.085, top1 = 61.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15515/15625) 015515-th architecture! ----------
arch : |nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.101, top1 = 96.96%], valid : [loss = 0.549, top1 = 85.02%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.91 ms.
cifar10        train : [loss = 0.119, top1 = 96.11%], test  : [loss = 0.393, top1 = 88.27%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.22 ms.
cifar100       train : [loss = 0.842, top1 = 75.31%], valid : [loss = 1.409, top1 = 62.48%], test : [loss = 1.429, top1 = 62.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.77 ms.
ImageNet16-120 train : [loss = 2.634, top1 = 33.77%], valid : [loss = 2.731, top1 = 32.10%], test : [loss = 2.753, top1 = 30.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|avg_pool_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.845, top1 = 69.49%], valid : [loss = 0.893, top1 = 68.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15516/15625) 015516-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.77 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.78%], valid : [loss = 0.573, top1 = 88.36%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.08 ms.
cifar10        train : [loss = 0.018, top1 = 99.48%], test  : [loss = 0.385, top1 = 91.67%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.71 ms.
cifar100       train : [loss = 0.258, top1 = 93.14%], valid : [loss = 1.335, top1 = 67.62%], test : [loss = 1.338, top1 = 67.56%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=20.04 ms.
ImageNet16-120 train : [loss = 2.031, top1 = 46.91%], valid : [loss = 2.309, top1 = 41.23%], test : [loss = 2.317, top1 = 40.73%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.841, top1 = 69.69%], valid : [loss = 0.885, top1 = 68.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15517/15625) 015517-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.20 ms.
cifar10-valid  train : [loss = 0.176, top1 = 94.28%], valid : [loss = 0.451, top1 = 86.04%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=12.93 ms.
cifar10        train : [loss = 0.153, top1 = 95.07%], test  : [loss = 0.313, top1 = 89.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.28 ms.
cifar100       train : [loss = 0.910, top1 = 74.13%], valid : [loss = 1.243, top1 = 65.04%], test : [loss = 1.240, top1 = 64.34%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.12 ms.
ImageNet16-120 train : [loss = 2.679, top1 = 33.21%], valid : [loss = 2.707, top1 = 32.47%], test : [loss = 2.705, top1 = 32.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|skip_connect~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.991, top1 = 64.48%], valid : [loss = 1.015, top1 = 63.86%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15518/15625) 015518-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=19.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.489, top1 = 89.98%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.45 ms.
cifar10        train : [loss = 0.005, top1 = 99.91%], test  : [loss = 0.313, top1 = 93.05%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.71 ms.
cifar100       train : [loss = 0.124, top1 = 97.62%], valid : [loss = 1.274, top1 = 69.18%], test : [loss = 1.303, top1 = 69.86%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=18.18 ms.
ImageNet16-120 train : [loss = 1.851, top1 = 51.07%], valid : [loss = 2.281, top1 = 41.63%], test : [loss = 2.300, top1 = 42.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.692, top1 = 75.50%], valid : [loss = 0.756, top1 = 73.46%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15519/15625) 015519-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.46 ms.
cifar10-valid  train : [loss = 0.049, top1 = 98.84%], valid : [loss = 0.511, top1 = 86.79%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.34 ms.
cifar10        train : [loss = 0.071, top1 = 97.93%], test  : [loss = 0.344, top1 = 90.19%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.03 ms.
cifar100       train : [loss = 0.655, top1 = 81.04%], valid : [loss = 1.298, top1 = 65.14%], test : [loss = 1.280, top1 = 65.55%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.31 ms.
ImageNet16-120 train : [loss = 2.391, top1 = 38.98%], valid : [loss = 2.507, top1 = 36.46%], test : [loss = 2.533, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.869, top1 = 68.89%], valid : [loss = 0.913, top1 = 67.84%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15520/15625) 015520-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.68 ms.
cifar10-valid  train : [loss = 0.026, top1 = 99.47%], valid : [loss = 0.532, top1 = 87.26%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.74 ms.
cifar10        train : [loss = 0.053, top1 = 98.40%], test  : [loss = 0.371, top1 = 89.87%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.67 ms.
cifar100       train : [loss = 0.606, top1 = 82.29%], valid : [loss = 1.328, top1 = 65.00%], test : [loss = 1.312, top1 = 65.17%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.99 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.43%], valid : [loss = 2.513, top1 = 36.41%], test : [loss = 2.561, top1 = 35.62%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.544, top1 = 81.25%], valid : [loss = 0.619, top1 = 78.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15521/15625) 015521-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=20.66 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.83%], valid : [loss = 0.554, top1 = 88.30%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.31 ms.
cifar10        train : [loss = 0.014, top1 = 99.65%], test  : [loss = 0.351, top1 = 91.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.60 ms.
cifar100       train : [loss = 0.308, top1 = 91.64%], valid : [loss = 1.272, top1 = 68.22%], test : [loss = 1.271, top1 = 67.12%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.57 ms.
ImageNet16-120 train : [loss = 2.203, top1 = 42.96%], valid : [loss = 2.469, top1 = 38.33%], test : [loss = 2.456, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.811, top1 = 71.22%], valid : [loss = 0.857, top1 = 69.68%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15522/15625) 015522-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=18.95 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.583, top1 = 88.27%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.01 ms.
cifar10        train : [loss = 0.011, top1 = 99.75%], test  : [loss = 0.415, top1 = 90.81%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.25 ms.
cifar100       train : [loss = 0.209, top1 = 95.04%], valid : [loss = 1.382, top1 = 66.84%], test : [loss = 1.423, top1 = 67.10%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.55 ms.
ImageNet16-120 train : [loss = 2.059, top1 = 46.17%], valid : [loss = 2.468, top1 = 38.00%], test : [loss = 2.516, top1 = 38.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|avg_pool_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.648, top1 = 76.72%], valid : [loss = 0.752, top1 = 73.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15523/15625) 015523-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.85 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.529, top1 = 89.74%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.87 ms.
cifar10        train : [loss = 0.005, top1 = 99.88%], test  : [loss = 0.318, top1 = 93.14%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=15.76 ms.
cifar100       train : [loss = 0.128, top1 = 97.04%], valid : [loss = 1.406, top1 = 68.48%], test : [loss = 1.383, top1 = 69.18%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 1.765, top1 = 53.05%], valid : [loss = 2.197, top1 = 43.43%], test : [loss = 2.201, top1 = 43.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.650, top1 = 77.15%], valid : [loss = 0.724, top1 = 74.83%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15524/15625) 015524-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.13 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.477, top1 = 90.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.19 ms.
cifar10        train : [loss = 0.004, top1 = 99.92%], test  : [loss = 0.310, top1 = 93.28%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.73 ms.
cifar100       train : [loss = 0.105, top1 = 98.17%], valid : [loss = 1.267, top1 = 69.56%], test : [loss = 1.286, top1 = 69.72%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.86 ms.
ImageNet16-120 train : [loss = 1.674, top1 = 55.07%], valid : [loss = 2.148, top1 = 45.03%], test : [loss = 2.184, top1 = 45.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.561, top1 = 80.42%], valid : [loss = 0.650, top1 = 77.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15525/15625) 015525-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=16.09 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.48%], valid : [loss = 0.548, top1 = 87.98%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.75 ms.
cifar10        train : [loss = 0.035, top1 = 98.91%], test  : [loss = 0.374, top1 = 90.88%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=17.96 ms.
cifar100       train : [loss = 0.508, top1 = 85.31%], valid : [loss = 1.303, top1 = 65.88%], test : [loss = 1.325, top1 = 65.20%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.51 ms.
ImageNet16-120 train : [loss = 2.523, top1 = 35.71%], valid : [loss = 2.600, top1 = 34.97%], test : [loss = 2.606, top1 = 34.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.804, top1 = 70.99%], valid : [loss = 0.847, top1 = 69.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15526/15625) 015526-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.016, top1 = 99.70%], valid : [loss = 0.618, top1 = 86.44%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.63 ms.
cifar10        train : [loss = 0.032, top1 = 99.11%], test  : [loss = 0.402, top1 = 90.05%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.71 ms.
cifar100       train : [loss = 0.508, top1 = 85.21%], valid : [loss = 1.394, top1 = 64.39%], test : [loss = 1.390, top1 = 64.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.06 ms.
ImageNet16-120 train : [loss = 2.376, top1 = 39.35%], valid : [loss = 2.550, top1 = 35.73%], test : [loss = 2.558, top1 = 36.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.33%], valid : [loss = 0.815, top1 = 71.72%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15527/15625) 015527-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=14.61 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.553, top1 = 88.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.60 ms.
cifar10        train : [loss = 0.014, top1 = 99.67%], test  : [loss = 0.364, top1 = 91.49%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=16.07 ms.
cifar100       train : [loss = 0.255, top1 = 93.25%], valid : [loss = 1.298, top1 = 67.78%], test : [loss = 1.307, top1 = 67.82%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=16.18 ms.
ImageNet16-120 train : [loss = 2.124, top1 = 44.68%], valid : [loss = 2.425, top1 = 38.43%], test : [loss = 2.415, top1 = 39.03%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.829, top1 = 70.67%], valid : [loss = 0.876, top1 = 69.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15528/15625) 015528-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.52 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.35%], valid : [loss = 0.619, top1 = 85.59%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.18 ms.
cifar10        train : [loss = 0.065, top1 = 98.08%], test  : [loss = 0.410, top1 = 88.84%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.86 ms.
cifar100       train : [loss = 0.729, top1 = 78.69%], valid : [loss = 1.379, top1 = 63.23%], test : [loss = 1.397, top1 = 63.11%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.02 ms.
ImageNet16-120 train : [loss = 2.536, top1 = 36.05%], valid : [loss = 2.656, top1 = 34.13%], test : [loss = 2.699, top1 = 33.15%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|none~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.728, top1 = 74.40%], valid : [loss = 0.790, top1 = 72.10%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15529/15625) 015529-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=19.87 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.520, top1 = 89.39%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=19.70 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.312, top1 = 93.15%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.45 ms.
cifar100       train : [loss = 0.112, top1 = 97.69%], valid : [loss = 1.295, top1 = 70.10%], test : [loss = 1.298, top1 = 70.38%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.16 ms.
ImageNet16-120 train : [loss = 1.857, top1 = 50.97%], valid : [loss = 2.222, top1 = 42.90%], test : [loss = 2.184, top1 = 43.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.764, top1 = 72.66%], valid : [loss = 0.820, top1 = 71.06%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15530/15625) 015530-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.02 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.604, top1 = 87.19%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=18.45 ms.
cifar10        train : [loss = 0.013, top1 = 99.77%], test  : [loss = 0.419, top1 = 90.19%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=18.17 ms.
cifar100       train : [loss = 0.153, top1 = 97.36%], valid : [loss = 1.473, top1 = 65.84%], test : [loss = 1.486, top1 = 65.08%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=17.91 ms.
ImageNet16-120 train : [loss = 2.017, top1 = 47.14%], valid : [loss = 2.496, top1 = 37.83%], test : [loss = 2.561, top1 = 36.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.617, top1 = 78.18%], valid : [loss = 0.691, top1 = 76.05%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15531/15625) 015531-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=16.25 ms.
cifar10-valid  train : [loss = 0.291, top1 = 90.06%], valid : [loss = 0.545, top1 = 82.82%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=14.92 ms.
cifar10        train : [loss = 0.240, top1 = 91.74%], test  : [loss = 0.410, top1 = 86.50%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.79 ms.
cifar100       train : [loss = 1.517, top1 = 57.65%], valid : [loss = 1.759, top1 = 52.32%], test : [loss = 1.748, top1 = 53.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=12.47 ms.
ImageNet16-120 train : [loss = 2.985, top1 = 26.99%], valid : [loss = 2.972, top1 = 26.67%], test : [loss = 3.031, top1 = 26.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.992, top1 = 64.34%], valid : [loss = 1.028, top1 = 63.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15532/15625) 015532-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.54 ms.
cifar10-valid  train : [loss = 0.266, top1 = 91.22%], valid : [loss = 0.470, top1 = 84.46%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.82 ms.
cifar10        train : [loss = 0.300, top1 = 89.94%], test  : [loss = 0.405, top1 = 86.21%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.51 ms.
cifar100       train : [loss = 1.312, top1 = 63.44%], valid : [loss = 1.530, top1 = 58.52%], test : [loss = 1.496, top1 = 58.52%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=18.01 ms.
ImageNet16-120 train : [loss = 2.923, top1 = 28.62%], valid : [loss = 2.906, top1 = 29.83%], test : [loss = 2.951, top1 = 28.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.707, top1 = 75.00%], valid : [loss = 0.764, top1 = 73.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15533/15625) 015533-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.88 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.51%], valid : [loss = 0.561, top1 = 87.49%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.46 ms.
cifar10        train : [loss = 0.031, top1 = 99.15%], test  : [loss = 0.365, top1 = 91.01%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.17 ms.
cifar100       train : [loss = 0.500, top1 = 85.68%], valid : [loss = 1.311, top1 = 65.08%], test : [loss = 1.330, top1 = 65.60%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.89 ms.
ImageNet16-120 train : [loss = 2.564, top1 = 34.66%], valid : [loss = 2.645, top1 = 32.80%], test : [loss = 2.674, top1 = 32.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.997, top1 = 64.30%], valid : [loss = 1.018, top1 = 63.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15534/15625) 015534-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 18.27 M, Params=0.148 MB, latency=17.19 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.63%], valid : [loss = 0.636, top1 = 86.08%]
cifar10        FLOP= 18.27 M, Params=0.148 MB, latency=16.85 ms.
cifar10        train : [loss = 0.037, top1 = 98.95%], test  : [loss = 0.438, top1 = 89.19%]
cifar100       FLOP= 18.27 M, Params=0.154 MB, latency=16.28 ms.
cifar100       train : [loss = 0.464, top1 = 87.01%], valid : [loss = 1.459, top1 = 63.42%], test : [loss = 1.441, top1 = 64.22%]
ImageNet16-120 FLOP=  4.57 M, Params=0.155 MB, latency=14.16 ms.
ImageNet16-120 train : [loss = 2.359, top1 = 39.65%], valid : [loss = 2.590, top1 = 35.26%], test : [loss = 2.605, top1 = 35.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.709, top1 = 74.92%], valid : [loss = 0.785, top1 = 72.47%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15535/15625) 015535-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.69 ms.
cifar10-valid  train : [loss = 0.045, top1 = 98.82%], valid : [loss = 0.852, top1 = 81.21%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.75 ms.
cifar10        train : [loss = 0.082, top1 = 97.41%], test  : [loss = 0.489, top1 = 87.00%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.01 ms.
cifar100       train : [loss = 0.838, top1 = 75.51%], valid : [loss = 1.506, top1 = 60.26%], test : [loss = 1.494, top1 = 61.10%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=8.35 ms.
ImageNet16-120 train : [loss = 2.804, top1 = 30.57%], valid : [loss = 2.936, top1 = 28.57%], test : [loss = 2.999, top1 = 27.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.837, top1 = 70.11%], valid : [loss = 0.888, top1 = 68.55%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15536/15625) 015536-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.31 ms.
cifar10-valid  train : [loss = 0.168, top1 = 94.56%], valid : [loss = 0.540, top1 = 84.11%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10        train : [loss = 0.174, top1 = 94.22%], test  : [loss = 0.385, top1 = 87.73%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.85 ms.
cifar100       train : [loss = 1.155, top1 = 67.05%], valid : [loss = 1.486, top1 = 59.05%], test : [loss = 1.479, top1 = 59.60%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.95 ms.
ImageNet16-120 train : [loss = 2.641, top1 = 33.85%], valid : [loss = 2.697, top1 = 32.88%], test : [loss = 2.729, top1 = 32.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.908, top1 = 67.20%], valid : [loss = 0.954, top1 = 66.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15537/15625) 015537-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=24.41 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.519, top1 = 90.00%]
cifar10        FLOP=157.21 M, Params=1.101 MB, latency=21.80 ms.
cifar10        train : [loss = 0.002, top1 = 99.98%], test  : [loss = 0.304, top1 = 93.64%]
cifar100       FLOP=157.21 M, Params=1.107 MB, latency=19.10 ms.
cifar100       train : [loss = 0.034, top1 = 99.67%], valid : [loss = 1.368, top1 = 70.64%], test : [loss = 1.373, top1 = 70.48%]
ImageNet16-120 FLOP= 39.31 M, Params=1.109 MB, latency=28.22 ms.
ImageNet16-120 train : [loss = 1.895, top1 = 49.78%], valid : [loss = 2.301, top1 = 41.57%], test : [loss = 2.320, top1 = 42.13%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=157.21 M, Params=1.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.625, top1 = 77.98%], valid : [loss = 0.696, top1 = 76.01%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15538/15625) 015538-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.96 ms.
cifar10-valid  train : [loss = 0.273, top1 = 90.73%], valid : [loss = 0.538, top1 = 83.14%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.41 ms.
cifar10        train : [loss = 0.274, top1 = 90.54%], test  : [loss = 0.425, top1 = 86.10%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.10 ms.
cifar100       train : [loss = 1.380, top1 = 61.13%], valid : [loss = 1.626, top1 = 55.45%], test : [loss = 1.614, top1 = 56.01%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.05 ms.
ImageNet16-120 train : [loss = 2.917, top1 = 28.45%], valid : [loss = 2.915, top1 = 28.54%], test : [loss = 2.966, top1 = 27.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.962, top1 = 65.40%], valid : [loss = 1.010, top1 = 64.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15539/15625) 015539-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 20.89 M, Params=0.167 MB, latency=18.09 ms.
cifar10-valid  train : [loss = 0.030, top1 = 99.54%], valid : [loss = 0.446, top1 = 87.82%]
cifar10        FLOP= 20.89 M, Params=0.167 MB, latency=18.74 ms.
cifar10        train : [loss = 0.057, top1 = 98.60%], test  : [loss = 0.324, top1 = 90.26%]
cifar100       FLOP= 20.90 M, Params=0.172 MB, latency=19.21 ms.
cifar100       train : [loss = 0.551, top1 = 85.01%], valid : [loss = 1.224, top1 = 66.64%], test : [loss = 1.204, top1 = 67.67%]
ImageNet16-120 FLOP=  5.23 M, Params=0.174 MB, latency=17.64 ms.
ImageNet16-120 train : [loss = 2.268, top1 = 41.78%], valid : [loss = 2.461, top1 = 38.30%], test : [loss = 2.481, top1 = 37.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.581, top1 = 79.62%], valid : [loss = 0.649, top1 = 77.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15540/15625) 015540-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.30 ms.
cifar10-valid  train : [loss = 0.112, top1 = 96.72%], valid : [loss = 0.455, top1 = 86.35%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.83 ms.
cifar10        train : [loss = 0.156, top1 = 94.97%], test  : [loss = 0.340, top1 = 88.78%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.64 ms.
cifar100       train : [loss = 0.965, top1 = 72.70%], valid : [loss = 1.326, top1 = 62.92%], test : [loss = 1.302, top1 = 63.00%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.23 ms.
ImageNet16-120 train : [loss = 2.616, top1 = 34.16%], valid : [loss = 2.661, top1 = 33.70%], test : [loss = 2.692, top1 = 33.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 74.97%], valid : [loss = 0.768, top1 = 73.21%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15541/15625) 015541-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.23 ms.
cifar10-valid  train : [loss = 0.215, top1 = 92.97%], valid : [loss = 0.474, top1 = 84.80%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.71 ms.
cifar10        train : [loss = 0.255, top1 = 91.38%], test  : [loss = 0.416, top1 = 86.30%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=17.54 ms.
cifar100       train : [loss = 1.281, top1 = 63.96%], valid : [loss = 1.575, top1 = 56.46%], test : [loss = 1.591, top1 = 56.16%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.57 ms.
ImageNet16-120 train : [loss = 3.009, top1 = 26.11%], valid : [loss = 2.998, top1 = 25.70%], test : [loss = 3.016, top1 = 25.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|skip_connect~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.136, top1 = 59.22%], valid : [loss = 1.141, top1 = 58.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15542/15625) 015542-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=21.76 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.94%], valid : [loss = 0.460, top1 = 89.54%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=20.99 ms.
cifar10        train : [loss = 0.010, top1 = 99.84%], test  : [loss = 0.299, top1 = 92.69%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=22.26 ms.
cifar100       train : [loss = 0.240, top1 = 94.09%], valid : [loss = 1.258, top1 = 68.80%], test : [loss = 1.283, top1 = 68.28%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=20.02 ms.
ImageNet16-120 train : [loss = 1.910, top1 = 49.58%], valid : [loss = 2.260, top1 = 41.77%], test : [loss = 2.276, top1 = 41.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.585, top1 = 79.72%], valid : [loss = 0.674, top1 = 76.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15543/15625) 015543-th architecture! ----------
arch : |nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.10 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.93%], valid : [loss = 0.550, top1 = 88.93%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10        train : [loss = 0.008, top1 = 99.79%], test  : [loss = 0.353, top1 = 92.41%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=15.48 ms.
cifar100       train : [loss = 0.127, top1 = 97.26%], valid : [loss = 1.336, top1 = 68.88%], test : [loss = 1.356, top1 = 68.94%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.87 ms.
ImageNet16-120 train : [loss = 1.989, top1 = 47.60%], valid : [loss = 2.322, top1 = 40.33%], test : [loss = 2.326, top1 = 39.77%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.791, top1 = 71.56%], valid : [loss = 0.844, top1 = 70.12%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15544/15625) 015544-th architecture! ----------
arch : |none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.26 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.92%], valid : [loss = 0.502, top1 = 89.50%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.02 ms.
cifar10        train : [loss = 0.007, top1 = 99.89%], test  : [loss = 0.324, top1 = 92.60%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=16.19 ms.
cifar100       train : [loss = 0.152, top1 = 96.80%], valid : [loss = 1.313, top1 = 68.44%], test : [loss = 1.303, top1 = 69.04%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=18.26 ms.
ImageNet16-120 train : [loss = 1.999, top1 = 47.46%], valid : [loss = 2.363, top1 = 40.37%], test : [loss = 2.328, top1 = 39.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_1x1~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.629, top1 = 77.75%], valid : [loss = 0.704, top1 = 75.65%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15545/15625) 015545-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.94%], valid : [loss = 0.485, top1 = 89.12%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.49 ms.
cifar10        train : [loss = 0.011, top1 = 99.85%], test  : [loss = 0.318, top1 = 92.04%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=14.44 ms.
cifar100       train : [loss = 0.355, top1 = 90.29%], valid : [loss = 1.279, top1 = 67.04%], test : [loss = 1.263, top1 = 67.26%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=20.32 ms.
ImageNet16-120 train : [loss = 2.040, top1 = 46.54%], valid : [loss = 2.328, top1 = 40.30%], test : [loss = 2.358, top1 = 39.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.546, top1 = 81.25%], valid : [loss = 0.620, top1 = 79.02%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15546/15625) 015546-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.42 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.60%], valid : [loss = 0.562, top1 = 87.33%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=14.69 ms.
cifar10        train : [loss = 0.030, top1 = 99.11%], test  : [loss = 0.405, top1 = 90.46%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.01 ms.
cifar100       train : [loss = 0.624, top1 = 81.94%], valid : [loss = 1.542, top1 = 61.42%], test : [loss = 1.515, top1 = 61.08%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=11.10 ms.
ImageNet16-120 train : [loss = 2.443, top1 = 37.58%], valid : [loss = 2.557, top1 = 34.83%], test : [loss = 2.578, top1 = 34.50%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.916, top1 = 66.96%], valid : [loss = 0.932, top1 = 66.97%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15547/15625) 015547-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.04 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.506, top1 = 88.89%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=19.26 ms.
cifar10        train : [loss = 0.013, top1 = 99.70%], test  : [loss = 0.334, top1 = 91.92%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.89 ms.
cifar100       train : [loss = 0.349, top1 = 90.33%], valid : [loss = 1.270, top1 = 67.36%], test : [loss = 1.296, top1 = 67.42%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.95 ms.
ImageNet16-120 train : [loss = 2.148, top1 = 44.16%], valid : [loss = 2.442, top1 = 37.87%], test : [loss = 2.426, top1 = 39.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.578, top1 = 79.75%], valid : [loss = 0.642, top1 = 77.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15548/15625) 015548-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=17.80 ms.
cifar10-valid  train : [loss = 0.002, top1 = 100.00%], valid : [loss = 0.511, top1 = 89.72%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=17.29 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.299, top1 = 93.66%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=19.85 ms.
cifar100       train : [loss = 0.049, top1 = 99.40%], valid : [loss = 1.338, top1 = 70.44%], test : [loss = 1.325, top1 = 70.72%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=17.37 ms.
ImageNet16-120 train : [loss = 1.824, top1 = 51.56%], valid : [loss = 2.291, top1 = 41.53%], test : [loss = 2.265, top1 = 42.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.662, top1 = 76.60%], valid : [loss = 0.719, top1 = 74.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15549/15625) 015549-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=14.80 ms.
cifar10-valid  train : [loss = 0.108, top1 = 96.72%], valid : [loss = 0.867, top1 = 78.56%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.43 ms.
cifar10        train : [loss = 0.152, top1 = 94.86%], test  : [loss = 0.555, top1 = 84.25%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.80 ms.
cifar100       train : [loss = 0.918, top1 = 73.38%], valid : [loss = 1.651, top1 = 56.96%], test : [loss = 1.654, top1 = 57.50%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.73 ms.
ImageNet16-120 train : [loss = 3.041, top1 = 26.33%], valid : [loss = 3.197, top1 = 23.80%], test : [loss = 3.218, top1 = 22.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.56%], valid : [loss = 1.102, top1 = 61.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15550/15625) 015550-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.82%], valid : [loss = 0.572, top1 = 88.07%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.21 ms.
cifar10        train : [loss = 0.011, top1 = 99.73%], test  : [loss = 0.364, top1 = 92.29%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=20.99 ms.
cifar100       train : [loss = 0.309, top1 = 91.68%], valid : [loss = 1.551, top1 = 63.12%], test : [loss = 1.496, top1 = 64.42%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=18.40 ms.
ImageNet16-120 train : [loss = 2.259, top1 = 41.61%], valid : [loss = 2.431, top1 = 37.90%], test : [loss = 2.469, top1 = 37.43%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.954, top1 = 65.52%], valid : [loss = 0.975, top1 = 65.23%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15551/15625) 015551-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 70.70 M, Params=0.506 MB, latency=17.60 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.529, top1 = 89.20%]
cifar10        FLOP= 70.70 M, Params=0.506 MB, latency=17.37 ms.
cifar10        train : [loss = 0.006, top1 = 99.88%], test  : [loss = 0.353, top1 = 92.36%]
cifar100       FLOP= 70.70 M, Params=0.512 MB, latency=15.55 ms.
cifar100       train : [loss = 0.136, top1 = 97.20%], valid : [loss = 1.402, top1 = 68.13%], test : [loss = 1.407, top1 = 68.07%]
ImageNet16-120 FLOP= 17.68 M, Params=0.514 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 1.903, top1 = 49.78%], valid : [loss = 2.389, top1 = 40.01%], test : [loss = 2.440, top1 = 40.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.611, top1 = 78.67%], valid : [loss = 0.716, top1 = 75.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15552/15625) 015552-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=14.13 ms.
cifar10-valid  train : [loss = 0.238, top1 = 92.06%], valid : [loss = 0.534, top1 = 83.48%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=12.99 ms.
cifar10        train : [loss = 0.222, top1 = 92.45%], test  : [loss = 0.410, top1 = 86.92%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.60 ms.
cifar100       train : [loss = 1.237, top1 = 64.67%], valid : [loss = 1.561, top1 = 56.94%], test : [loss = 1.567, top1 = 57.12%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=15.32 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.25%], valid : [loss = 2.965, top1 = 27.63%], test : [loss = 2.953, top1 = 26.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 1.013, top1 = 63.72%], valid : [loss = 1.071, top1 = 62.33%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15553/15625) 015553-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=13.64 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.635, top1 = 87.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.35 ms.
cifar10        train : [loss = 0.014, top1 = 99.68%], test  : [loss = 0.431, top1 = 90.72%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.42 ms.
cifar100       train : [loss = 0.241, top1 = 94.14%], valid : [loss = 1.459, top1 = 65.56%], test : [loss = 1.498, top1 = 65.68%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.67 ms.
ImageNet16-120 train : [loss = 2.143, top1 = 44.35%], valid : [loss = 2.550, top1 = 36.27%], test : [loss = 2.583, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|skip_connect~1|+|none~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.639, top1 = 77.47%], valid : [loss = 0.738, top1 = 74.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15554/15625) 015554-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=21.51 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.486, top1 = 90.16%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.50 ms.
cifar10        train : [loss = 0.005, top1 = 99.92%], test  : [loss = 0.320, top1 = 93.08%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.07 ms.
cifar100       train : [loss = 0.117, top1 = 97.66%], valid : [loss = 1.292, top1 = 69.28%], test : [loss = 1.280, top1 = 69.70%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.39 ms.
ImageNet16-120 train : [loss = 1.684, top1 = 54.80%], valid : [loss = 2.189, top1 = 44.50%], test : [loss = 2.190, top1 = 44.57%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.586, top1 = 79.72%], valid : [loss = 0.656, top1 = 77.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15555/15625) 015555-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.06 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.92%], valid : [loss = 0.544, top1 = 88.23%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.70 ms.
cifar10        train : [loss = 0.012, top1 = 99.77%], test  : [loss = 0.324, top1 = 92.29%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.67 ms.
cifar100       train : [loss = 0.332, top1 = 91.00%], valid : [loss = 1.269, top1 = 66.84%], test : [loss = 1.279, top1 = 68.10%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.37 ms.
ImageNet16-120 train : [loss = 2.126, top1 = 44.58%], valid : [loss = 2.425, top1 = 38.97%], test : [loss = 2.425, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15556/15625) 015556-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=17.14 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.518, top1 = 88.86%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.59 ms.
cifar10        train : [loss = 0.013, top1 = 99.71%], test  : [loss = 0.325, top1 = 92.23%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.60 ms.
cifar100       train : [loss = 0.326, top1 = 91.10%], valid : [loss = 1.264, top1 = 67.36%], test : [loss = 1.288, top1 = 68.18%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=11.65 ms.
ImageNet16-120 train : [loss = 2.116, top1 = 44.86%], valid : [loss = 2.417, top1 = 39.27%], test : [loss = 2.424, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.571, top1 = 79.97%], valid : [loss = 0.646, top1 = 77.78%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15557/15625) 015557-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.62 ms.
cifar10-valid  train : [loss = 0.017, top1 = 99.61%], valid : [loss = 0.559, top1 = 87.77%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=16.12 ms.
cifar10        train : [loss = 0.034, top1 = 98.98%], test  : [loss = 0.360, top1 = 90.71%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.44 ms.
cifar100       train : [loss = 0.523, top1 = 84.87%], valid : [loss = 1.339, top1 = 65.04%], test : [loss = 1.323, top1 = 64.80%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=15.13 ms.
ImageNet16-120 train : [loss = 2.579, top1 = 34.32%], valid : [loss = 2.637, top1 = 33.93%], test : [loss = 2.692, top1 = 32.17%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|none~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 1.007, top1 = 63.86%], valid : [loss = 1.022, top1 = 63.35%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15558/15625) 015558-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.40 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.91%], valid : [loss = 0.448, top1 = 89.43%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.69 ms.
cifar10        train : [loss = 0.014, top1 = 99.72%], test  : [loss = 0.306, top1 = 92.35%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.09 ms.
cifar100       train : [loss = 0.335, top1 = 90.82%], valid : [loss = 1.312, top1 = 67.24%], test : [loss = 1.312, top1 = 66.96%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=8.39 ms.
ImageNet16-120 train : [loss = 2.065, top1 = 46.20%], valid : [loss = 2.383, top1 = 39.40%], test : [loss = 2.386, top1 = 39.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15559/15625) 015559-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.63 ms.
cifar10-valid  train : [loss = 0.003, top1 = 100.00%], valid : [loss = 0.430, top1 = 90.34%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.58 ms.
cifar10        train : [loss = 0.006, top1 = 99.93%], test  : [loss = 0.289, top1 = 93.06%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=22.78 ms.
cifar100       train : [loss = 0.111, top1 = 98.06%], valid : [loss = 1.276, top1 = 69.96%], test : [loss = 1.279, top1 = 69.60%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=15.18 ms.
ImageNet16-120 train : [loss = 1.617, top1 = 56.52%], valid : [loss = 2.163, top1 = 44.27%], test : [loss = 2.209, top1 = 44.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.405, top1 = 85.91%], valid : [loss = 0.534, top1 = 82.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15560/15625) 015560-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=16.23 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.84%], valid : [loss = 0.564, top1 = 87.69%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=15.14 ms.
cifar10        train : [loss = 0.017, top1 = 99.59%], test  : [loss = 0.382, top1 = 91.03%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=16.08 ms.
cifar100       train : [loss = 0.394, top1 = 88.90%], valid : [loss = 1.388, top1 = 65.68%], test : [loss = 1.382, top1 = 66.00%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.40 ms.
ImageNet16-120 train : [loss = 2.312, top1 = 40.64%], valid : [loss = 2.517, top1 = 37.10%], test : [loss = 2.516, top1 = 36.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.729, top1 = 74.13%], valid : [loss = 0.796, top1 = 72.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15561/15625) 015561-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=22.10 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.487, top1 = 89.94%]
cifar10        FLOP= 90.36 M, Params=0.643 MB, latency=22.38 ms.
cifar10        train : [loss = 0.005, top1 = 99.93%], test  : [loss = 0.293, top1 = 93.21%]
cifar100       FLOP= 90.36 M, Params=0.649 MB, latency=20.33 ms.
cifar100       train : [loss = 0.104, top1 = 98.25%], valid : [loss = 1.297, top1 = 68.94%], test : [loss = 1.261, top1 = 69.78%]
ImageNet16-120 FLOP= 22.60 M, Params=0.651 MB, latency=19.09 ms.
ImageNet16-120 train : [loss = 1.673, top1 = 55.20%], valid : [loss = 2.196, top1 = 44.43%], test : [loss = 2.213, top1 = 43.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 90.36 M, Params=0.643 MB, latency=None ms.
cifar10-valid  train : [loss = 0.570, top1 = 79.82%], valid : [loss = 0.657, top1 = 77.18%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15562/15625) 015562-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=18.20 ms.
cifar10-valid  train : [loss = 0.010, top1 = 99.87%], valid : [loss = 0.612, top1 = 86.35%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=16.62 ms.
cifar10        train : [loss = 0.026, top1 = 99.36%], test  : [loss = 0.382, top1 = 90.46%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.12 ms.
cifar100       train : [loss = 0.358, top1 = 90.39%], valid : [loss = 1.357, top1 = 65.74%], test : [loss = 1.347, top1 = 66.12%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 2.184, top1 = 43.46%], valid : [loss = 2.534, top1 = 37.23%], test : [loss = 2.507, top1 = 38.07%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.654, top1 = 76.82%], valid : [loss = 0.747, top1 = 73.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15563/15625) 015563-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.37 ms.
cifar10-valid  train : [loss = 0.109, top1 = 96.77%], valid : [loss = 0.469, top1 = 85.99%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=15.94 ms.
cifar10        train : [loss = 0.152, top1 = 95.05%], test  : [loss = 0.344, top1 = 88.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.99 ms.
cifar100       train : [loss = 0.977, top1 = 71.96%], valid : [loss = 1.325, top1 = 63.26%], test : [loss = 1.358, top1 = 62.16%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=18.51 ms.
ImageNet16-120 train : [loss = 2.615, top1 = 34.20%], valid : [loss = 2.640, top1 = 33.97%], test : [loss = 2.687, top1 = 32.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|none~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.725, top1 = 74.00%], valid : [loss = 0.775, top1 = 72.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15564/15625) 015564-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.74 ms.
cifar10-valid  train : [loss = 0.255, top1 = 91.46%], valid : [loss = 0.515, top1 = 83.55%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=18.95 ms.
cifar10        train : [loss = 0.277, top1 = 90.64%], test  : [loss = 0.425, top1 = 85.70%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.02 ms.
cifar100       train : [loss = 1.595, top1 = 56.25%], valid : [loss = 1.780, top1 = 51.24%], test : [loss = 1.761, top1 = 51.94%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=16.26 ms.
ImageNet16-120 train : [loss = 3.169, top1 = 23.32%], valid : [loss = 3.173, top1 = 23.70%], test : [loss = 3.211, top1 = 22.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 1.095, top1 = 60.73%], valid : [loss = 1.112, top1 = 59.64%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15565/15625) 015565-th architecture! ----------
arch : |skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=15.97 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.92%], valid : [loss = 0.533, top1 = 88.99%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.90 ms.
cifar10        train : [loss = 0.009, top1 = 99.79%], test  : [loss = 0.333, top1 = 92.50%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.83 ms.
cifar100       train : [loss = 0.218, top1 = 94.38%], valid : [loss = 1.268, top1 = 68.71%], test : [loss = 1.283, top1 = 68.41%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.62 ms.
ImageNet16-120 train : [loss = 1.949, top1 = 48.63%], valid : [loss = 2.270, top1 = 42.12%], test : [loss = 2.286, top1 = 42.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_1x1~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.673, top1 = 76.19%], valid : [loss = 0.727, top1 = 74.69%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15566/15625) 015566-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.27 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.95%], valid : [loss = 0.493, top1 = 89.74%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.57 ms.
cifar10        train : [loss = 0.006, top1 = 99.91%], test  : [loss = 0.314, top1 = 92.96%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.13 ms.
cifar100       train : [loss = 0.128, top1 = 97.41%], valid : [loss = 1.267, top1 = 70.36%], test : [loss = 1.332, top1 = 68.54%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 1.736, top1 = 53.59%], valid : [loss = 2.183, top1 = 44.63%], test : [loss = 2.234, top1 = 42.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|skip_connect~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.530, top1 = 81.53%], valid : [loss = 0.613, top1 = 78.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15567/15625) 015567-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.431, top1 = 90.93%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.86 ms.
cifar10        train : [loss = 0.003, top1 = 99.96%], test  : [loss = 0.286, top1 = 93.63%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.59 ms.
cifar100       train : [loss = 0.068, top1 = 98.98%], valid : [loss = 1.340, top1 = 69.38%], test : [loss = 1.357, top1 = 69.82%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.29 ms.
ImageNet16-120 train : [loss = 1.538, top1 = 58.61%], valid : [loss = 2.270, top1 = 43.47%], test : [loss = 2.256, top1 = 44.30%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.375, top1 = 87.40%], valid : [loss = 0.514, top1 = 82.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15568/15625) 015568-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.19 ms.
cifar10-valid  train : [loss = 1.851, top1 = 32.95%], valid : [loss = 1.863, top1 = 32.55%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.08 ms.
cifar10        train : [loss = 1.344, top1 = 51.03%], test  : [loss = 1.346, top1 = 50.98%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.80 ms.
cifar100       train : [loss = 3.878, top1 = 10.42%], valid : [loss = 3.911, top1 = 9.89%], test : [loss = 3.909, top1 = 10.45%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.26 ms.
ImageNet16-120 train : [loss = 3.994, top1 = 10.44%], valid : [loss = 3.986, top1 = 10.62%], test : [loss = 3.997, top1 = 10.54%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.970, top1 = 27.10%], valid : [loss = 1.970, top1 = 27.39%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15569/15625) 015569-th architecture! ----------
arch : |none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.58 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.00%], valid : [loss = 0.473, top1 = 84.48%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=15.94 ms.
cifar10        train : [loss = 0.297, top1 = 90.03%], test  : [loss = 0.405, top1 = 86.48%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=15.74 ms.
cifar100       train : [loss = 1.327, top1 = 63.18%], valid : [loss = 1.526, top1 = 58.30%], test : [loss = 1.502, top1 = 57.86%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=13.63 ms.
ImageNet16-120 train : [loss = 2.912, top1 = 28.77%], valid : [loss = 2.899, top1 = 29.93%], test : [loss = 2.962, top1 = 27.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.33%], valid : [loss = 0.752, top1 = 73.90%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15570/15625) 015570-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=21.55 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.89%], valid : [loss = 0.541, top1 = 88.62%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.83 ms.
cifar10        train : [loss = 0.013, top1 = 99.68%], test  : [loss = 0.368, top1 = 91.71%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.61 ms.
cifar100       train : [loss = 0.250, top1 = 93.62%], valid : [loss = 1.394, top1 = 66.40%], test : [loss = 1.399, top1 = 66.26%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.63 ms.
ImageNet16-120 train : [loss = 2.223, top1 = 42.44%], valid : [loss = 2.445, top1 = 37.37%], test : [loss = 2.423, top1 = 38.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.932, top1 = 66.55%], valid : [loss = 0.987, top1 = 64.93%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15571/15625) 015571-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.51 ms.
cifar10-valid  train : [loss = 0.009, top1 = 99.82%], valid : [loss = 0.564, top1 = 88.34%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.38 ms.
cifar10        train : [loss = 0.013, top1 = 99.69%], test  : [loss = 0.365, top1 = 91.98%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=18.67 ms.
cifar100       train : [loss = 0.168, top1 = 95.97%], valid : [loss = 1.378, top1 = 67.80%], test : [loss = 1.328, top1 = 68.78%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.67 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.33%], valid : [loss = 2.410, top1 = 39.00%], test : [loss = 2.456, top1 = 38.20%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.892, top1 = 67.50%], valid : [loss = 0.936, top1 = 66.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15572/15625) 015572-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=16.60 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.26%], valid : [loss = 0.508, top1 = 87.04%]
cifar10        FLOP= 19.58 M, Params=0.157 MB, latency=15.25 ms.
cifar10        train : [loss = 0.085, top1 = 97.12%], test  : [loss = 0.341, top1 = 90.39%]
cifar100       FLOP= 19.59 M, Params=0.163 MB, latency=15.69 ms.
cifar100       train : [loss = 0.727, top1 = 78.57%], valid : [loss = 1.319, top1 = 63.64%], test : [loss = 1.317, top1 = 63.96%]
ImageNet16-120 FLOP=  4.90 M, Params=0.164 MB, latency=13.58 ms.
ImageNet16-120 train : [loss = 2.400, top1 = 38.51%], valid : [loss = 2.501, top1 = 35.90%], test : [loss = 2.513, top1 = 35.87%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|avg_pool_3x3~1|+|nor_conv_1x1~0|skip_connect~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 19.58 M, Params=0.157 MB, latency=None ms.
cifar10-valid  train : [loss = 0.659, top1 = 76.78%], valid : [loss = 0.725, top1 = 75.00%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15573/15625) 015573-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.89 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.94%], valid : [loss = 0.549, top1 = 89.38%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.87 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.319, top1 = 93.00%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.07 ms.
cifar100       train : [loss = 0.147, top1 = 96.72%], valid : [loss = 1.342, top1 = 68.96%], test : [loss = 1.339, top1 = 68.90%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.41 ms.
ImageNet16-120 train : [loss = 1.852, top1 = 50.97%], valid : [loss = 2.223, top1 = 42.93%], test : [loss = 2.226, top1 = 42.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.717, top1 = 74.54%], valid : [loss = 0.771, top1 = 72.98%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15574/15625) 015574-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.067, top1 = 98.21%], valid : [loss = 0.518, top1 = 86.10%]
cifar10        FLOP= 47.10 M, Params=0.344 MB, latency=13.81 ms.
cifar10        train : [loss = 0.080, top1 = 97.60%], test  : [loss = 0.355, top1 = 89.56%]
cifar100       FLOP= 47.11 M, Params=0.350 MB, latency=13.83 ms.
cifar100       train : [loss = 0.731, top1 = 78.87%], valid : [loss = 1.316, top1 = 63.98%], test : [loss = 1.316, top1 = 64.46%]
ImageNet16-120 FLOP= 11.78 M, Params=0.351 MB, latency=12.18 ms.
ImageNet16-120 train : [loss = 2.366, top1 = 39.44%], valid : [loss = 2.520, top1 = 37.13%], test : [loss = 2.512, top1 = 36.40%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 47.10 M, Params=0.344 MB, latency=None ms.
cifar10-valid  train : [loss = 0.880, top1 = 68.68%], valid : [loss = 0.952, top1 = 66.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15575/15625) 015575-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=13.45 ms.
cifar10-valid  train : [loss = 0.057, top1 = 98.50%], valid : [loss = 0.597, top1 = 85.31%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=12.24 ms.
cifar10        train : [loss = 0.100, top1 = 96.67%], test  : [loss = 0.394, top1 = 88.47%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=13.39 ms.
cifar100       train : [loss = 0.814, top1 = 76.16%], valid : [loss = 1.410, top1 = 62.40%], test : [loss = 1.390, top1 = 62.60%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=17.15 ms.
ImageNet16-120 train : [loss = 2.657, top1 = 33.32%], valid : [loss = 2.760, top1 = 31.40%], test : [loss = 2.786, top1 = 31.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.668, top1 = 76.46%], valid : [loss = 0.751, top1 = 74.15%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15576/15625) 015576-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.59 ms.
cifar10-valid  train : [loss = 0.682, top1 = 76.17%], valid : [loss = 0.860, top1 = 70.72%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.25 ms.
cifar10        train : [loss = 0.680, top1 = 76.24%], test  : [loss = 0.766, top1 = 73.38%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=10.01 ms.
cifar100       train : [loss = 1.973, top1 = 47.63%], valid : [loss = 2.144, top1 = 44.57%], test : [loss = 2.158, top1 = 44.03%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=7.82 ms.
ImageNet16-120 train : [loss = 3.649, top1 = 15.76%], valid : [loss = 3.669, top1 = 15.78%], test : [loss = 3.692, top1 = 14.90%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|none~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.401, top1 = 48.95%], valid : [loss = 1.426, top1 = 48.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15577/15625) 015577-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.62 ms.
cifar10-valid  train : [loss = 0.556, top1 = 80.58%], valid : [loss = 0.875, top1 = 71.20%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.98 ms.
cifar10        train : [loss = 0.565, top1 = 80.35%], test  : [loss = 0.722, top1 = 75.20%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.16 ms.
cifar100       train : [loss = 1.777, top1 = 52.16%], valid : [loss = 2.049, top1 = 47.38%], test : [loss = 2.065, top1 = 46.90%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.64 ms.
ImageNet16-120 train : [loss = 3.593, top1 = 16.65%], valid : [loss = 3.627, top1 = 16.70%], test : [loss = 3.660, top1 = 15.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.191, top1 = 56.79%], valid : [loss = 1.254, top1 = 55.34%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15578/15625) 015578-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.74 ms.
cifar10-valid  train : [loss = 0.050, top1 = 98.60%], valid : [loss = 0.640, top1 = 84.20%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.54 ms.
cifar10        train : [loss = 0.085, top1 = 97.30%], test  : [loss = 0.413, top1 = 88.20%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.39 ms.
cifar100       train : [loss = 0.778, top1 = 77.13%], valid : [loss = 1.416, top1 = 62.54%], test : [loss = 1.432, top1 = 61.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=9.41 ms.
ImageNet16-120 train : [loss = 2.625, top1 = 33.99%], valid : [loss = 2.756, top1 = 31.87%], test : [loss = 2.793, top1 = 31.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|none~1|+|nor_conv_1x1~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15579/15625) 015579-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.07 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=12.22 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.80 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_3x3~1|+|none~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15580/15625) 015580-th architecture! ----------
arch : |skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.71 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.88%], valid : [loss = 0.564, top1 = 88.33%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.39 ms.
cifar10        train : [loss = 0.011, top1 = 99.74%], test  : [loss = 0.344, top1 = 92.17%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=15.74 ms.
cifar100       train : [loss = 0.284, top1 = 92.16%], valid : [loss = 1.317, top1 = 67.49%], test : [loss = 1.338, top1 = 67.29%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.90 ms.
ImageNet16-120 train : [loss = 2.098, top1 = 45.33%], valid : [loss = 2.403, top1 = 38.48%], test : [loss = 2.407, top1 = 39.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.719, top1 = 74.27%], valid : [loss = 0.777, top1 = 72.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15581/15625) 015581-th architecture! ----------
arch : |skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.41 ms.
cifar10-valid  train : [loss = 0.478, top1 = 83.33%], valid : [loss = 0.638, top1 = 78.57%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=8.95 ms.
cifar10        train : [loss = 0.507, top1 = 82.38%], test  : [loss = 0.586, top1 = 80.35%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.19 ms.
cifar100       train : [loss = 1.677, top1 = 54.48%], valid : [loss = 1.843, top1 = 50.99%], test : [loss = 1.867, top1 = 50.98%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.06 ms.
ImageNet16-120 train : [loss = 3.325, top1 = 21.23%], valid : [loss = 3.324, top1 = 20.87%], test : [loss = 3.358, top1 = 20.82%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|skip_connect~1|+|none~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.271, top1 = 54.08%], valid : [loss = 1.301, top1 = 53.44%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15582/15625) 015582-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=11.94 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.93%], valid : [loss = 0.457, top1 = 89.22%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=11.47 ms.
cifar10        train : [loss = 0.013, top1 = 99.79%], test  : [loss = 0.323, top1 = 91.71%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.95 ms.
cifar100       train : [loss = 0.331, top1 = 90.91%], valid : [loss = 1.295, top1 = 67.42%], test : [loss = 1.290, top1 = 67.16%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.19 ms.
ImageNet16-120 train : [loss = 2.062, top1 = 46.02%], valid : [loss = 2.372, top1 = 40.47%], test : [loss = 2.399, top1 = 39.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.485, top1 = 83.08%], valid : [loss = 0.585, top1 = 79.99%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15583/15625) 015583-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.95 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.95%], valid : [loss = 0.461, top1 = 89.42%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.26 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.312, top1 = 92.45%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.53 ms.
cifar100       train : [loss = 0.210, top1 = 95.07%], valid : [loss = 1.224, top1 = 69.54%], test : [loss = 1.267, top1 = 68.48%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=14.39 ms.
ImageNet16-120 train : [loss = 1.840, top1 = 51.31%], valid : [loss = 2.264, top1 = 43.47%], test : [loss = 2.291, top1 = 41.47%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.431, top1 = 85.14%], valid : [loss = 0.548, top1 = 81.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15584/15625) 015584-th architecture! ----------
arch : |skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 14.34 M, Params=0.120 MB, latency=14.97 ms.
cifar10-valid  train : [loss = 0.029, top1 = 99.35%], valid : [loss = 0.648, top1 = 85.22%]
cifar10        FLOP= 14.34 M, Params=0.120 MB, latency=14.90 ms.
cifar10        train : [loss = 0.065, top1 = 98.04%], test  : [loss = 0.416, top1 = 88.78%]
cifar100       FLOP= 14.34 M, Params=0.126 MB, latency=14.20 ms.
cifar100       train : [loss = 0.697, top1 = 79.74%], valid : [loss = 1.436, top1 = 62.08%], test : [loss = 1.418, top1 = 62.85%]
ImageNet16-120 FLOP=  3.59 M, Params=0.127 MB, latency=11.91 ms.
ImageNet16-120 train : [loss = 2.547, top1 = 35.77%], valid : [loss = 2.678, top1 = 33.31%], test : [loss = 2.721, top1 = 32.39%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|skip_connect~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.763, top1 = 73.01%], valid : [loss = 0.823, top1 = 71.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15585/15625) 015585-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.88 ms.
cifar10-valid  train : [loss = 0.326, top1 = 88.64%], valid : [loss = 1.026, top1 = 70.79%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.36 ms.
cifar10        train : [loss = 0.346, top1 = 88.00%], test  : [loss = 0.653, top1 = 78.94%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=11.67 ms.
cifar100       train : [loss = 1.443, top1 = 59.84%], valid : [loss = 2.027, top1 = 47.36%], test : [loss = 2.004, top1 = 48.90%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.03 ms.
ImageNet16-120 train : [loss = 3.445, top1 = 18.94%], valid : [loss = 3.558, top1 = 18.10%], test : [loss = 3.596, top1 = 17.10%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|none~0|avg_pool_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.189, top1 = 56.96%], valid : [loss = 1.254, top1 = 54.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15586/15625) 015586-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=19.43 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.457, top1 = 90.58%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.90 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.307, top1 = 93.45%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.45 ms.
cifar100       train : [loss = 0.088, top1 = 98.34%], valid : [loss = 1.363, top1 = 69.24%], test : [loss = 1.317, top1 = 69.98%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=16.61 ms.
ImageNet16-120 train : [loss = 1.639, top1 = 55.93%], valid : [loss = 2.199, top1 = 43.23%], test : [loss = 2.253, top1 = 43.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.437, top1 = 84.94%], valid : [loss = 0.544, top1 = 81.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15587/15625) 015587-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.10 ms.
cifar10-valid  train : [loss = 0.291, top1 = 90.11%], valid : [loss = 0.865, top1 = 75.32%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=13.52 ms.
cifar10        train : [loss = 0.314, top1 = 89.01%], test  : [loss = 0.641, top1 = 80.10%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=10.96 ms.
cifar100       train : [loss = 1.405, top1 = 60.66%], valid : [loss = 1.965, top1 = 49.68%], test : [loss = 1.945, top1 = 50.02%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.46 ms.
ImageNet16-120 train : [loss = 3.490, top1 = 17.32%], valid : [loss = 3.512, top1 = 17.53%], test : [loss = 3.513, top1 = 16.63%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|none~1|+|none~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.270, top1 = 53.72%], valid : [loss = 1.325, top1 = 51.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15588/15625) 015588-th architecture! ----------
arch : |none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=16.48 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.88%], valid : [loss = 0.574, top1 = 87.62%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=17.58 ms.
cifar10        train : [loss = 0.015, top1 = 99.67%], test  : [loss = 0.399, top1 = 90.97%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.27 ms.
cifar100       train : [loss = 0.385, top1 = 89.30%], valid : [loss = 1.353, top1 = 65.92%], test : [loss = 1.340, top1 = 65.96%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=12.92 ms.
ImageNet16-120 train : [loss = 2.307, top1 = 40.88%], valid : [loss = 2.503, top1 = 36.63%], test : [loss = 2.503, top1 = 37.27%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.701, top1 = 75.18%], valid : [loss = 0.755, top1 = 73.56%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15589/15625) 015589-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.89 ms.
cifar10-valid  train : [loss = 0.268, top1 = 91.07%], valid : [loss = 0.479, top1 = 84.21%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.30 ms.
cifar10        train : [loss = 0.299, top1 = 90.09%], test  : [loss = 0.403, top1 = 86.49%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.14 ms.
cifar100       train : [loss = 1.322, top1 = 63.20%], valid : [loss = 1.529, top1 = 58.35%], test : [loss = 1.508, top1 = 59.06%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=12.68 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.61%], valid : [loss = 2.899, top1 = 29.41%], test : [loss = 2.964, top1 = 28.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|skip_connect~0|none~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15590/15625) 015590-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=20.05 ms.
cifar10-valid  train : [loss = 0.011, top1 = 99.81%], valid : [loss = 0.777, top1 = 83.59%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.26 ms.
cifar10        train : [loss = 0.019, top1 = 99.55%], test  : [loss = 0.464, top1 = 89.25%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=15.90 ms.
cifar100       train : [loss = 0.298, top1 = 92.39%], valid : [loss = 1.464, top1 = 65.06%], test : [loss = 1.466, top1 = 64.64%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=16.17 ms.
ImageNet16-120 train : [loss = 2.236, top1 = 42.28%], valid : [loss = 2.573, top1 = 36.00%], test : [loss = 2.601, top1 = 36.67%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 0.753, top1 = 73.10%], valid : [loss = 0.825, top1 = 71.16%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15591/15625) 015591-th architecture! ----------
arch : |avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.25 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.62%], valid : [loss = 0.592, top1 = 86.94%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.91 ms.
cifar10        train : [loss = 0.041, top1 = 98.82%], test  : [loss = 0.416, top1 = 89.65%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=11.62 ms.
cifar100       train : [loss = 0.554, top1 = 83.74%], valid : [loss = 1.407, top1 = 64.42%], test : [loss = 1.408, top1 = 63.46%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=13.04 ms.
ImageNet16-120 train : [loss = 2.479, top1 = 37.14%], valid : [loss = 2.627, top1 = 32.93%], test : [loss = 2.658, top1 = 33.80%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|skip_connect~0|nor_conv_3x3~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.658, top1 = 77.01%], valid : [loss = 0.728, top1 = 75.14%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15592/15625) 015592-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.27 ms.
cifar10-valid  train : [loss = 0.024, top1 = 99.48%], valid : [loss = 0.636, top1 = 85.62%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.38 ms.
cifar10        train : [loss = 0.059, top1 = 98.21%], test  : [loss = 0.427, top1 = 88.89%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=14.93 ms.
cifar100       train : [loss = 0.650, top1 = 80.91%], valid : [loss = 1.387, top1 = 63.64%], test : [loss = 1.375, top1 = 63.70%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.57 ms.
ImageNet16-120 train : [loss = 2.470, top1 = 37.38%], valid : [loss = 2.587, top1 = 35.33%], test : [loss = 2.630, top1 = 35.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.755, top1 = 73.15%], valid : [loss = 0.813, top1 = 71.54%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15593/15625) 015593-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=20.26 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.505, top1 = 89.65%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=19.04 ms.
cifar10        train : [loss = 0.003, top1 = 99.95%], test  : [loss = 0.295, top1 = 93.53%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=17.55 ms.
cifar100       train : [loss = 0.070, top1 = 98.92%], valid : [loss = 1.372, top1 = 68.54%], test : [loss = 1.349, top1 = 69.84%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=21.75 ms.
ImageNet16-120 train : [loss = 2.029, top1 = 46.81%], valid : [loss = 2.358, top1 = 39.70%], test : [loss = 2.379, top1 = 39.70%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|none~1|+|nor_conv_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.761, top1 = 72.88%], valid : [loss = 0.814, top1 = 71.38%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15594/15625) 015594-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=12.11 ms.
cifar10-valid  train : [loss = 0.046, top1 = 98.80%], valid : [loss = 0.637, top1 = 84.57%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.28 ms.
cifar10        train : [loss = 0.086, top1 = 97.24%], test  : [loss = 0.392, top1 = 88.78%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.25 ms.
cifar100       train : [loss = 0.783, top1 = 77.19%], valid : [loss = 1.424, top1 = 61.85%], test : [loss = 1.413, top1 = 62.28%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.57 ms.
ImageNet16-120 train : [loss = 2.619, top1 = 34.16%], valid : [loss = 2.735, top1 = 32.32%], test : [loss = 2.764, top1 = 32.16%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|skip_connect~1|+|nor_conv_1x1~0|skip_connect~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 0.818, top1 = 70.78%], valid : [loss = 0.873, top1 = 69.20%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15595/15625) 015595-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10-valid  train : [loss = 0.271, top1 = 90.91%], valid : [loss = 0.478, top1 = 84.39%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=13.21 ms.
cifar10        train : [loss = 0.297, top1 = 90.02%], test  : [loss = 0.399, top1 = 86.72%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=11.87 ms.
cifar100       train : [loss = 1.326, top1 = 63.08%], valid : [loss = 1.525, top1 = 58.00%], test : [loss = 1.507, top1 = 58.67%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.75 ms.
ImageNet16-120 train : [loss = 2.918, top1 = 28.70%], valid : [loss = 2.907, top1 = 29.27%], test : [loss = 2.949, top1 = 28.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|none~1|+|none~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 75.02%], valid : [loss = 0.762, top1 = 73.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15596/15625) 015596-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.02 ms.
cifar10-valid  train : [loss = 0.264, top1 = 91.24%], valid : [loss = 0.470, top1 = 84.63%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=18.27 ms.
cifar10        train : [loss = 0.295, top1 = 90.07%], test  : [loss = 0.392, top1 = 86.61%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.30 ms.
cifar100       train : [loss = 1.334, top1 = 63.10%], valid : [loss = 1.531, top1 = 58.18%], test : [loss = 1.504, top1 = 58.60%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=14.87 ms.
ImageNet16-120 train : [loss = 2.935, top1 = 28.40%], valid : [loss = 2.908, top1 = 29.33%], test : [loss = 2.973, top1 = 27.97%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.705, top1 = 75.32%], valid : [loss = 0.760, top1 = 73.48%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15597/15625) 015597-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=17.31 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.96%], valid : [loss = 0.447, top1 = 89.84%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.50 ms.
cifar10        train : [loss = 0.009, top1 = 99.87%], test  : [loss = 0.302, top1 = 92.55%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.54 ms.
cifar100       train : [loss = 0.205, top1 = 95.16%], valid : [loss = 1.279, top1 = 69.20%], test : [loss = 1.251, top1 = 69.60%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=19.84 ms.
ImageNet16-120 train : [loss = 1.844, top1 = 51.13%], valid : [loss = 2.271, top1 = 43.07%], test : [loss = 2.287, top1 = 42.37%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|none~0|nor_conv_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.438, top1 = 85.10%], valid : [loss = 0.550, top1 = 81.49%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15598/15625) 015598-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=16.98 ms.
cifar10-valid  train : [loss = 0.005, top1 = 99.90%], valid : [loss = 0.548, top1 = 89.06%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=20.10 ms.
cifar10        train : [loss = 0.007, top1 = 99.83%], test  : [loss = 0.361, top1 = 92.61%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=17.28 ms.
cifar100       train : [loss = 0.120, top1 = 97.24%], valid : [loss = 1.392, top1 = 68.84%], test : [loss = 1.425, top1 = 68.66%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=20.35 ms.
ImageNet16-120 train : [loss = 2.102, top1 = 45.12%], valid : [loss = 2.391, top1 = 39.37%], test : [loss = 2.383, top1 = 39.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.865, top1 = 69.02%], valid : [loss = 0.916, top1 = 67.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15599/15625) 015599-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=18.83 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.497, top1 = 90.08%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=18.62 ms.
cifar10        train : [loss = 0.005, top1 = 99.90%], test  : [loss = 0.320, top1 = 93.30%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.65 ms.
cifar100       train : [loss = 0.118, top1 = 97.73%], valid : [loss = 1.281, top1 = 69.45%], test : [loss = 1.277, top1 = 69.89%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=15.64 ms.
ImageNet16-120 train : [loss = 1.677, top1 = 54.99%], valid : [loss = 2.167, top1 = 44.38%], test : [loss = 2.160, top1 = 45.19%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.542, top1 = 81.09%], valid : [loss = 0.620, top1 = 78.74%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15600/15625) 015600-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=16.33 ms.
cifar10-valid  train : [loss = 0.008, top1 = 99.86%], valid : [loss = 0.543, top1 = 88.15%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.97 ms.
cifar10        train : [loss = 0.014, top1 = 99.69%], test  : [loss = 0.336, top1 = 91.86%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=18.00 ms.
cifar100       train : [loss = 0.328, top1 = 91.02%], valid : [loss = 1.281, top1 = 67.11%], test : [loss = 1.307, top1 = 67.21%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=15.56 ms.
ImageNet16-120 train : [loss = 2.153, top1 = 44.07%], valid : [loss = 2.419, top1 = 38.83%], test : [loss = 2.439, top1 = 38.89%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.738, top1 = 73.43%], valid : [loss = 0.802, top1 = 71.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15601/15625) 015601-th architecture! ----------
arch : |nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=19.70 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.565, top1 = 88.29%]
cifar10        FLOP= 54.97 M, Params=0.400 MB, latency=17.82 ms.
cifar10        train : [loss = 0.007, top1 = 99.87%], test  : [loss = 0.373, top1 = 91.70%]
cifar100       FLOP= 54.97 M, Params=0.406 MB, latency=18.66 ms.
cifar100       train : [loss = 0.128, top1 = 97.52%], valid : [loss = 1.481, top1 = 67.08%], test : [loss = 1.497, top1 = 66.94%]
ImageNet16-120 FLOP= 13.75 M, Params=0.407 MB, latency=17.96 ms.
ImageNet16-120 train : [loss = 1.962, top1 = 48.42%], valid : [loss = 2.401, top1 = 39.67%], test : [loss = 2.406, top1 = 40.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|skip_connect~0|nor_conv_1x1~1|+|avg_pool_3x3~0|nor_conv_1x1~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 54.97 M, Params=0.400 MB, latency=None ms.
cifar10-valid  train : [loss = 0.616, top1 = 78.11%], valid : [loss = 0.720, top1 = 75.28%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15602/15625) 015602-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.61 ms.
cifar10-valid  train : [loss = 0.018, top1 = 99.63%], valid : [loss = 0.618, top1 = 86.31%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.52 ms.
cifar10        train : [loss = 0.031, top1 = 99.11%], test  : [loss = 0.392, top1 = 90.38%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=17.86 ms.
cifar100       train : [loss = 0.532, top1 = 84.52%], valid : [loss = 1.413, top1 = 63.64%], test : [loss = 1.404, top1 = 63.69%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=17.68 ms.
ImageNet16-120 train : [loss = 2.389, top1 = 39.01%], valid : [loss = 2.564, top1 = 35.58%], test : [loss = 2.604, top1 = 35.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.796, top1 = 71.54%], valid : [loss = 0.852, top1 = 69.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15603/15625) 015603-th architecture! ----------
arch : |nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.29 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.98%], valid : [loss = 0.534, top1 = 89.41%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=17.00 ms.
cifar10        train : [loss = 0.003, top1 = 99.94%], test  : [loss = 0.355, top1 = 92.75%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.95 ms.
cifar100       train : [loss = 0.052, top1 = 99.32%], valid : [loss = 1.466, top1 = 68.36%], test : [loss = 1.465, top1 = 69.12%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.42 ms.
ImageNet16-120 train : [loss = 1.734, top1 = 53.80%], valid : [loss = 2.395, top1 = 40.40%], test : [loss = 2.422, top1 = 40.32%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|none~0|nor_conv_3x3~1|+|avg_pool_3x3~0|skip_connect~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.562, top1 = 80.34%], valid : [loss = 0.662, top1 = 77.32%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15604/15625) 015604-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=19.81 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.96%], valid : [loss = 0.488, top1 = 90.24%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=20.06 ms.
cifar10        train : [loss = 0.005, top1 = 99.89%], test  : [loss = 0.325, top1 = 93.02%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=19.73 ms.
cifar100       train : [loss = 0.111, top1 = 97.85%], valid : [loss = 1.308, top1 = 69.21%], test : [loss = 1.300, top1 = 69.99%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=17.70 ms.
ImageNet16-120 train : [loss = 1.702, top1 = 54.40%], valid : [loss = 2.170, top1 = 43.66%], test : [loss = 2.186, top1 = 44.22%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_1x1~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.547, top1 = 80.98%], valid : [loss = 0.621, top1 = 78.79%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15605/15625) 015605-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.16 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.96%], valid : [loss = 0.421, top1 = 90.51%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.66 ms.
cifar10        train : [loss = 0.007, top1 = 99.91%], test  : [loss = 0.283, top1 = 93.32%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.12 ms.
cifar100       train : [loss = 0.187, top1 = 95.54%], valid : [loss = 1.276, top1 = 69.57%], test : [loss = 1.279, top1 = 69.63%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.14 ms.
ImageNet16-120 train : [loss = 1.821, top1 = 51.60%], valid : [loss = 2.248, top1 = 43.43%], test : [loss = 2.283, top1 = 42.52%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|none~1|+|skip_connect~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.388, top1 = 86.54%], valid : [loss = 0.515, top1 = 82.67%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15606/15625) 015606-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=12.87 ms.
cifar10-valid  train : [loss = 0.067, top1 = 97.95%], valid : [loss = 0.610, top1 = 84.67%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.12 ms.
cifar10        train : [loss = 0.086, top1 = 97.19%], test  : [loss = 0.412, top1 = 88.65%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=10.67 ms.
cifar100       train : [loss = 0.706, top1 = 79.25%], valid : [loss = 1.549, top1 = 60.19%], test : [loss = 1.546, top1 = 60.18%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=10.37 ms.
ImageNet16-120 train : [loss = 3.197, top1 = 22.08%], valid : [loss = 3.203, top1 = 21.70%], test : [loss = 3.243, top1 = 21.11%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|skip_connect~1|+|none~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 1.043, top1 = 62.41%], valid : [loss = 1.073, top1 = 61.43%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15607/15625) 015607-th architecture! ----------
arch : |avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.26 ms.
cifar10-valid  train : [loss = 0.020, top1 = 99.57%], valid : [loss = 0.639, top1 = 85.92%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=13.86 ms.
cifar10        train : [loss = 0.032, top1 = 99.08%], test  : [loss = 0.394, top1 = 90.30%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=13.19 ms.
cifar100       train : [loss = 0.516, top1 = 84.97%], valid : [loss = 1.443, top1 = 63.47%], test : [loss = 1.428, top1 = 63.80%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.55 ms.
ImageNet16-120 train : [loss = 2.336, top1 = 40.07%], valid : [loss = 2.532, top1 = 36.34%], test : [loss = 2.556, top1 = 36.29%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.838, top1 = 69.66%], valid : [loss = 0.903, top1 = 67.87%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15608/15625) 015608-th architecture! ----------
arch : |skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=8.97 ms.
cifar10-valid  train : [loss = 1.122, top1 = 59.99%], valid : [loss = 1.165, top1 = 58.70%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.09 ms.
cifar10        train : [loss = 1.071, top1 = 62.19%], test  : [loss = 1.068, top1 = 62.00%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.19 ms.
cifar100       train : [loss = 2.579, top1 = 34.83%], valid : [loss = 2.651, top1 = 33.33%], test : [loss = 2.625, top1 = 34.21%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=8.40 ms.
ImageNet16-120 train : [loss = 3.784, top1 = 13.69%], valid : [loss = 3.773, top1 = 13.96%], test : [loss = 3.785, top1 = 13.91%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|none~0|avg_pool_3x3~1|+|skip_connect~0|avg_pool_3x3~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.637, top1 = 38.96%], valid : [loss = 1.693, top1 = 36.11%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15609/15625) 015609-th architecture! ----------
arch : |none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.96 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.92%], valid : [loss = 0.518, top1 = 88.68%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.88 ms.
cifar10        train : [loss = 0.013, top1 = 99.75%], test  : [loss = 0.339, top1 = 92.03%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=17.04 ms.
cifar100       train : [loss = 0.349, top1 = 90.42%], valid : [loss = 1.294, top1 = 66.67%], test : [loss = 1.314, top1 = 66.67%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=17.47 ms.
ImageNet16-120 train : [loss = 2.122, top1 = 44.73%], valid : [loss = 2.407, top1 = 38.86%], test : [loss = 2.412, top1 = 39.00%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|nor_conv_3x3~0|nor_conv_1x1~1|+|nor_conv_3x3~0|avg_pool_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.630, top1 = 77.92%], valid : [loss = 0.699, top1 = 75.96%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15610/15625) 015610-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=15.87 ms.
cifar10-valid  train : [loss = 0.035, top1 = 99.17%], valid : [loss = 0.606, top1 = 85.44%]
cifar10        FLOP= 15.65 M, Params=0.129 MB, latency=15.37 ms.
cifar10        train : [loss = 0.072, top1 = 97.80%], test  : [loss = 0.396, top1 = 89.08%]
cifar100       FLOP= 15.65 M, Params=0.135 MB, latency=15.22 ms.
cifar100       train : [loss = 0.716, top1 = 79.16%], valid : [loss = 1.385, top1 = 63.40%], test : [loss = 1.384, top1 = 62.86%]
ImageNet16-120 FLOP=  3.92 M, Params=0.136 MB, latency=13.29 ms.
ImageNet16-120 train : [loss = 2.543, top1 = 35.82%], valid : [loss = 2.665, top1 = 34.44%], test : [loss = 2.705, top1 = 32.88%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_1x1~0|none~1|+|avg_pool_3x3~0|none~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 15.65 M, Params=0.129 MB, latency=None ms.
cifar10-valid  train : [loss = 0.697, top1 = 75.49%], valid : [loss = 0.777, top1 = 73.59%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15611/15625) 015611-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=18.04 ms.
cifar10-valid  train : [loss = 0.004, top1 = 99.95%], valid : [loss = 0.591, top1 = 88.10%]
cifar10        FLOP= 51.04 M, Params=0.372 MB, latency=16.76 ms.
cifar10        train : [loss = 0.008, top1 = 99.84%], test  : [loss = 0.385, top1 = 91.70%]
cifar100       FLOP= 51.04 M, Params=0.378 MB, latency=15.53 ms.
cifar100       train : [loss = 0.168, top1 = 96.26%], valid : [loss = 1.429, top1 = 67.21%], test : [loss = 1.430, top1 = 67.14%]
ImageNet16-120 FLOP= 12.77 M, Params=0.379 MB, latency=15.33 ms.
ImageNet16-120 train : [loss = 2.032, top1 = 46.79%], valid : [loss = 2.477, top1 = 37.82%], test : [loss = 2.477, top1 = 38.93%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_1x1~0|avg_pool_3x3~1|+|avg_pool_3x3~0|nor_conv_1x1~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 51.04 M, Params=0.372 MB, latency=None ms.
cifar10-valid  train : [loss = 0.706, top1 = 74.83%], valid : [loss = 0.775, top1 = 72.94%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15612/15625) 015612-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=19.34 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.97%], valid : [loss = 0.531, top1 = 89.51%]
cifar10        FLOP=149.34 M, Params=1.045 MB, latency=19.04 ms.
cifar10        train : [loss = 0.004, top1 = 99.93%], test  : [loss = 0.344, top1 = 93.00%]
cifar100       FLOP=149.35 M, Params=1.051 MB, latency=16.62 ms.
cifar100       train : [loss = 0.080, top1 = 98.51%], valid : [loss = 1.430, top1 = 68.87%], test : [loss = 1.400, top1 = 69.01%]
ImageNet16-120 FLOP= 37.34 M, Params=1.053 MB, latency=18.49 ms.
ImageNet16-120 train : [loss = 1.882, top1 = 50.15%], valid : [loss = 2.321, top1 = 40.69%], test : [loss = 2.301, top1 = 41.86%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=149.34 M, Params=1.045 MB, latency=None ms.
cifar10-valid  train : [loss = 0.676, top1 = 75.96%], valid : [loss = 0.725, top1 = 74.92%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15613/15625) 015613-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=20.14 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.86%], valid : [loss = 0.550, top1 = 88.48%]
cifar10        FLOP= 86.43 M, Params=0.615 MB, latency=19.14 ms.
cifar10        train : [loss = 0.010, top1 = 99.77%], test  : [loss = 0.358, top1 = 92.20%]
cifar100       FLOP= 86.43 M, Params=0.621 MB, latency=19.24 ms.
cifar100       train : [loss = 0.178, top1 = 95.67%], valid : [loss = 1.319, top1 = 68.69%], test : [loss = 1.315, top1 = 68.97%]
ImageNet16-120 FLOP= 21.61 M, Params=0.623 MB, latency=17.20 ms.
ImageNet16-120 train : [loss = 2.130, top1 = 44.49%], valid : [loss = 2.374, top1 = 39.09%], test : [loss = 2.391, top1 = 39.66%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_1x1~0|skip_connect~1|+|nor_conv_3x3~0|nor_conv_3x3~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 86.43 M, Params=0.615 MB, latency=None ms.
cifar10-valid  train : [loss = 0.800, top1 = 71.25%], valid : [loss = 0.839, top1 = 70.29%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15614/15625) 015614-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=13.38 ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
cifar10        FLOP= 43.17 M, Params=0.316 MB, latency=12.60 ms.
cifar10        train : [loss = 2.303, top1 = 10.00%], test  : [loss = 2.303, top1 = 10.00%]
cifar100       FLOP= 43.18 M, Params=0.322 MB, latency=14.60 ms.
cifar100       train : [loss = 4.605, top1 = 1.00%], valid : [loss = 4.605, top1 = 1.00%], test : [loss = 4.605, top1 = 1.00%]
ImageNet16-120 FLOP= 10.80 M, Params=0.323 MB, latency=11.48 ms.
ImageNet16-120 train : [loss = 4.783, top1 = 0.86%], valid : [loss = 4.792, top1 = 0.83%], test : [loss = 4.792, top1 = 0.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 43.17 M, Params=0.316 MB, latency=None ms.
cifar10-valid  train : [loss = 2.302, top1 = 10.29%], valid : [loss = 2.303, top1 = 9.71%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15615/15625) 015615-th architecture! ----------
arch : |nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=17.81 ms.
cifar10-valid  train : [loss = 0.002, top1 = 99.99%], valid : [loss = 0.437, top1 = 90.85%]
cifar10        FLOP=113.95 M, Params=0.802 MB, latency=16.60 ms.
cifar10        train : [loss = 0.003, top1 = 99.97%], test  : [loss = 0.292, top1 = 93.54%]
cifar100       FLOP=113.96 M, Params=0.808 MB, latency=16.01 ms.
cifar100       train : [loss = 0.068, top1 = 99.00%], valid : [loss = 1.339, top1 = 70.51%], test : [loss = 1.318, top1 = 70.46%]
ImageNet16-120 FLOP= 28.50 M, Params=0.810 MB, latency=14.61 ms.
ImageNet16-120 train : [loss = 1.551, top1 = 58.11%], valid : [loss = 2.272, top1 = 43.23%], test : [loss = 2.282, top1 = 43.23%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|nor_conv_3x3~0|skip_connect~1|+|skip_connect~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=113.95 M, Params=0.802 MB, latency=None ms.
cifar10-valid  train : [loss = 0.371, top1 = 87.17%], valid : [loss = 0.505, top1 = 83.27%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15616/15625) 015616-th architecture! ----------
arch : |avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=15.92 ms.
cifar10-valid  train : [loss = 0.007, top1 = 99.85%], valid : [loss = 0.549, top1 = 88.63%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=16.02 ms.
cifar10        train : [loss = 0.012, top1 = 99.72%], test  : [loss = 0.355, top1 = 92.10%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.55 ms.
cifar100       train : [loss = 0.251, top1 = 93.31%], valid : [loss = 1.291, top1 = 68.47%], test : [loss = 1.332, top1 = 67.47%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=15.44 ms.
ImageNet16-120 train : [loss = 2.178, top1 = 43.47%], valid : [loss = 2.416, top1 = 38.76%], test : [loss = 2.428, top1 = 38.71%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|none~0|none~1|+|nor_conv_3x3~0|nor_conv_3x3~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.889, top1 = 68.03%], valid : [loss = 0.915, top1 = 67.62%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15617/15625) 015617-th architecture! ----------
arch : |nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.91 ms.
cifar10-valid  train : [loss = 0.022, top1 = 99.38%], valid : [loss = 0.587, top1 = 86.88%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=16.69 ms.
cifar10        train : [loss = 0.034, top1 = 98.95%], test  : [loss = 0.386, top1 = 90.71%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.28 ms.
cifar100       train : [loss = 0.401, top1 = 88.46%], valid : [loss = 1.571, top1 = 62.26%], test : [loss = 1.554, top1 = 62.65%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.75 ms.
ImageNet16-120 train : [loss = 2.842, top1 = 28.77%], valid : [loss = 2.917, top1 = 27.13%], test : [loss = 2.911, top1 = 27.83%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|nor_conv_3x3~0|avg_pool_3x3~1|+|none~0|none~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 1.238, top1 = 54.96%], valid : [loss = 1.243, top1 = 54.73%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15618/15625) 015618-th architecture! ----------
arch : |none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=13.58 ms.
cifar10-valid  train : [loss = 0.548, top1 = 80.95%], valid : [loss = 0.848, top1 = 72.06%]
cifar10        FLOP= 11.72 M, Params=0.101 MB, latency=12.98 ms.
cifar10        train : [loss = 0.560, top1 = 80.42%], test  : [loss = 0.716, top1 = 75.71%]
cifar100       FLOP= 11.72 M, Params=0.107 MB, latency=12.22 ms.
cifar100       train : [loss = 1.789, top1 = 51.93%], valid : [loss = 2.059, top1 = 46.73%], test : [loss = 2.071, top1 = 46.55%]
ImageNet16-120 FLOP=  2.94 M, Params=0.108 MB, latency=11.11 ms.
ImageNet16-120 train : [loss = 3.585, top1 = 16.75%], valid : [loss = 3.642, top1 = 15.89%], test : [loss = 3.663, top1 = 15.48%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|none~0|skip_connect~1|+|avg_pool_3x3~0|nor_conv_1x1~1|skip_connect~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 11.72 M, Params=0.101 MB, latency=None ms.
cifar10-valid  train : [loss = 1.188, top1 = 57.29%], valid : [loss = 1.244, top1 = 55.50%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15619/15625) 015619-th architecture! ----------
arch : |nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=14.36 ms.
cifar10-valid  train : [loss = 0.006, top1 = 99.90%], valid : [loss = 0.575, top1 = 87.79%]
cifar10        FLOP= 78.56 M, Params=0.559 MB, latency=14.17 ms.
cifar10        train : [loss = 0.010, top1 = 99.79%], test  : [loss = 0.396, top1 = 91.46%]
cifar100       FLOP= 78.57 M, Params=0.565 MB, latency=14.84 ms.
cifar100       train : [loss = 0.292, top1 = 92.01%], valid : [loss = 1.453, top1 = 65.53%], test : [loss = 1.479, top1 = 65.35%]
ImageNet16-120 FLOP= 19.65 M, Params=0.567 MB, latency=14.25 ms.
ImageNet16-120 train : [loss = 2.177, top1 = 43.60%], valid : [loss = 2.438, top1 = 38.68%], test : [loss = 2.469, top1 = 37.98%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_3x3~0|+|skip_connect~0|skip_connect~1|+|avg_pool_3x3~0|avg_pool_3x3~1|nor_conv_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 78.56 M, Params=0.559 MB, latency=None ms.
cifar10-valid  train : [loss = 0.748, top1 = 73.31%], valid : [loss = 0.821, top1 = 71.52%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15620/15625) 015620-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=9.39 ms.
cifar10-valid  train : [loss = 0.270, top1 = 91.10%], valid : [loss = 0.479, top1 = 84.42%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=10.14 ms.
cifar10        train : [loss = 0.299, top1 = 89.98%], test  : [loss = 0.402, top1 = 86.45%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.34 ms.
cifar100       train : [loss = 1.328, top1 = 63.15%], valid : [loss = 1.535, top1 = 57.67%], test : [loss = 1.504, top1 = 58.87%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=9.38 ms.
ImageNet16-120 train : [loss = 2.919, top1 = 28.71%], valid : [loss = 2.903, top1 = 29.82%], test : [loss = 2.962, top1 = 28.53%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|skip_connect~0|skip_connect~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 0.704, top1 = 75.42%], valid : [loss = 0.757, top1 = 73.80%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15621/15625) 015621-th architecture! ----------
arch : |avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=17.09 ms.
cifar10-valid  train : [loss = 0.061, top1 = 98.26%], valid : [loss = 0.586, top1 = 85.56%]
cifar10        FLOP= 82.49 M, Params=0.587 MB, latency=17.56 ms.
cifar10        train : [loss = 0.108, top1 = 96.37%], test  : [loss = 0.396, top1 = 88.46%]
cifar100       FLOP= 82.50 M, Params=0.593 MB, latency=16.18 ms.
cifar100       train : [loss = 0.820, top1 = 75.79%], valid : [loss = 1.427, top1 = 61.92%], test : [loss = 1.429, top1 = 61.81%]
ImageNet16-120 FLOP= 20.63 M, Params=0.595 MB, latency=16.01 ms.
ImageNet16-120 train : [loss = 2.671, top1 = 33.15%], valid : [loss = 2.767, top1 = 31.80%], test : [loss = 2.791, top1 = 30.60%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|avg_pool_3x3~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|skip_connect~0|nor_conv_1x1~1|none~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 82.49 M, Params=0.587 MB, latency=None ms.
cifar10-valid  train : [loss = 0.667, top1 = 76.51%], valid : [loss = 0.743, top1 = 74.24%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15622/15625) 015622-th architecture! ----------
arch : |skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=18.76 ms.
cifar10-valid  train : [loss = 0.003, top1 = 99.97%], valid : [loss = 0.513, top1 = 89.46%]
cifar10        FLOP=117.88 M, Params=0.830 MB, latency=18.85 ms.
cifar10        train : [loss = 0.005, top1 = 99.94%], test  : [loss = 0.313, top1 = 92.97%]
cifar100       FLOP=117.89 M, Params=0.836 MB, latency=18.22 ms.
cifar100       train : [loss = 0.121, top1 = 97.63%], valid : [loss = 1.292, top1 = 69.27%], test : [loss = 1.302, top1 = 69.78%]
ImageNet16-120 FLOP= 29.48 M, Params=0.838 MB, latency=15.29 ms.
ImageNet16-120 train : [loss = 1.816, top1 = 51.81%], valid : [loss = 2.285, top1 = 41.86%], test : [loss = 2.269, top1 = 42.74%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|skip_connect~0|+|nor_conv_3x3~0|nor_conv_3x3~1|+|nor_conv_3x3~0|none~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=117.88 M, Params=0.830 MB, latency=None ms.
cifar10-valid  train : [loss = 0.626, top1 = 78.21%], valid : [loss = 0.710, top1 = 75.75%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15623/15625) 015623-th architecture! ----------
arch : |none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=10.30 ms.
cifar10-valid  train : [loss = 0.810, top1 = 71.19%], valid : [loss = 0.985, top1 = 66.52%]
cifar10        FLOP=  7.78 M, Params=0.073 MB, latency=9.84 ms.
cifar10        train : [loss = 0.777, top1 = 72.57%], test  : [loss = 0.858, top1 = 69.98%]
cifar100       FLOP=  7.79 M, Params=0.079 MB, latency=8.60 ms.
cifar100       train : [loss = 2.149, top1 = 43.82%], valid : [loss = 2.339, top1 = 40.64%], test : [loss = 2.348, top1 = 40.61%]
ImageNet16-120 FLOP=  1.95 M, Params=0.080 MB, latency=10.25 ms.
ImageNet16-120 train : [loss = 3.740, top1 = 14.26%], valid : [loss = 3.767, top1 = 14.41%], test : [loss = 3.768, top1 = 14.08%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|none~0|+|avg_pool_3x3~0|avg_pool_3x3~1|+|avg_pool_3x3~0|none~1|avg_pool_3x3~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP=  7.78 M, Params=0.073 MB, latency=None ms.
cifar10-valid  train : [loss = 1.457, top1 = 46.37%], valid : [loss = 1.470, top1 = 46.26%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

---------- The (15624/15625) 015624-th architecture! ----------
arch : |nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 200 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid', 'cifar10', 'cifar100', 'ImageNet16-120'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=19.41 ms.
cifar10-valid  train : [loss = 0.208, top1 = 93.16%], valid : [loss = 0.502, top1 = 84.19%]
cifar10        FLOP= 23.51 M, Params=0.185 MB, latency=19.68 ms.
cifar10        train : [loss = 0.237, top1 = 92.05%], test  : [loss = 0.402, top1 = 86.82%]
cifar100       FLOP= 23.52 M, Params=0.191 MB, latency=19.33 ms.
cifar100       train : [loss = 1.346, top1 = 62.46%], valid : [loss = 1.625, top1 = 55.79%], test : [loss = 1.611, top1 = 55.22%]
ImageNet16-120 FLOP=  5.89 M, Params=0.192 MB, latency=20.88 ms.
ImageNet16-120 train : [loss = 3.250, top1 = 21.97%], valid : [loss = 3.250, top1 = 21.39%], test : [loss = 3.287, top1 = 21.41%]
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 012 epochs >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
|nor_conv_1x1~0|+|none~0|nor_conv_1x1~1|+|none~0|nor_conv_1x1~1|nor_conv_1x1~2|
datasets : ['cifar10-valid'], extra-info : None
cifar10-valid  FLOP= 23.51 M, Params=0.185 MB, latency=None ms.
cifar10-valid  train : [loss = 1.244, top1 = 54.99%], valid : [loss = 1.241, top1 = 54.95%]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<------------<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
